🛻 Transformers Series

How Google DeepMind's AlphaGeometry Reached Math Olympiad Level Reasoning By Combining Creative LLMs With Deductive Symbolic Engines

How open-sourced Neurosymbolic AI (Neural Networks + Symbolic Systems) is revolutionizing automated theorem proving

Aug 22, 2024 •

What is QLoRA?: A Visual Guide to Efficient Finetuning of Quantized LLMs

Sometimes smaller is better. How QLoRA combines efficiency and performance.

Aug 8, 2024 •

What is LoRA?: A Visual Guide to Low-Rank Approximation for Fine-Tuning LLMs Efficiently

Why LoRA Is Essential For Model Fine-Tuning

Jun 13, 2024 •

Transformers and the Power of Positional Encoding [Transformers Series]

How Transformers Find Order In Data

May 9, 2024 •

"Attention, Please!": A Visual Guide To The Attention Mechanism [Transformers Series]

Develop an intuition behind Attention: why it took over machine learning + LLMs and what it actually does

May 2, 2024 •

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts