Mamba and S4 Explained: Architecture, Parallel Scan, Kernel Fusion, Recurrent, Convolution, Math

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

MAMBA and State Space Models explained | SSM explained

Kolmogorov-Arnold Networks: MLP vs KAN, Math, B-Splines, Universal Approximation Theorem

Efficiently Modeling Long Sequences with Structured State Spaces - Albert Gu | Stanford MLSys #46

Recurrences, Karatsuba, Dynamic Programming

The math behind Attention: Keys, Queries, and Values matrices

Mamba: Linear-Time Sequence Modeling with Selective State Spaces (Paper Explained)

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer

【博士Vlog】2024最新模型Mamba详解，Transformer已死，你想知道的都在这里了！

Reinforcement Learning from Human Feedback explained with math derivations and the PyTorch code.

Mamba, Mamba-2 and Post-Transformer Architectures for Generative AI with Albert Gu - 693

Direct Preference Optimization (DPO) explained: Bradley-Terry model, log probabilities, math

Mamba - a replacement for Transformers?

Attention is all you need (Transformer) - Model explanation (including math), Inference and Training

MedAI #41: Efficiently Modeling Long Sequences with Structured State Spaces | Albert Gu

[Paper Review] Mamba: Linear-Time Sequence Modeling with Selective State Spaces

MAMBA from Scratch: Neural Nets Better and Faster than Transformers

Mathematics for Machine Learning | Lec 10 | Linear Algebra | Part III

Structured State Space Models for Deep Sequence Modeling (Albert Gu, CMU)

Merve Bodur - Two-stage and Lagrangian Dual Decision Rules for Multistage Adaptive Robust Optimiza..