Benyamin Ghojogh

Tree-Based Optimization: A Meta-Algorithm for Metaheuristic Optimization

2018 · arXiv (Cornell University)

Designing search algorithms for finding global optima is one of the most active research fields, recently. These algorithms consist of two main categories, i.e., classic mathematical and metaheuristic algorithms. This article proposes a meta-algorithm, Tree-Based …

Isolation Mondrian Forest for Batch and Online Anomaly Detection

2020

We propose a new method, named isolation Mondrian forest (iMondrian forest), for batch and online anomaly detection. The proposed method is a novel hybrid of isolation forest and Mondrian forest which are existing methods for …

Johnson-Lindenstrauss Lemma, Linear and Nonlinear Random Projections,\n Random Fourier Features, and Random Kitchen Sinks: Tutorial and Survey

2021 · arXiv (Cornell University)

This is a tutorial and survey paper on the Johnson-Lindenstrauss (JL) lemma\nand linear and nonlinear random projections. We start with linear random\nprojection and then justify its correctness by JL lemma and its proof. Then,\nsparse random …

Attention Mechanism, Transformers, BERT, and GPT: Tutorial and Survey

2024

This is a tutorial and survey paper on the attention mechanism, transformers, BERT, and GPT. We first explain attention mechanism, sequence-to-sequence model without and with attention, self-attention, and attention in different areas such as natural …