Maarten Grootendorst's Avatar

Maarten Grootendorst

@maartengr.bsky.social

πŸ§‘β€πŸ’» Data Scientist | Psychologist πŸ“– Author of "Hands-On LLMs" (http://LLM-book.com) πŸ§™β€β™‚οΈ Open Sourcerer (BERTopic, PolyFuzz, KeyBERT; github.com/MaartenGr) πŸ’‘ Demystifying LLMs (newsletter.maartengrootendorst.com)

188 Followers  |  2 Following  |  34 Posts  |  Joined: 29.11.2023  |  1.8992

Latest posts by maartengr.bsky.social on Bluesky

Preview
Hands-On-Large-Language-Models/bonus at main Β· HandsOnLLM/Hands-On-Large-Language-Models Official code repo for the O'Reilly Book - "Hands-On Large Language Models" - HandsOnLLM/Hands-On-Large-Language-Models

Building off the book's foundation, we created enough content to hopefully keep you busy for a while:

github.com/HandsOnLLM/H...

30.04.2025 15:37 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

We've made so much extra (free!) content it could be its own book πŸ˜…

I counted more than 300 visuals across our illustrated and visual guides!

30.04.2025 15:37 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Intuition behind Mamba and State Space Models | Enhancing LLMs!
YouTube video by Maarten Grootendorst Intuition behind Mamba and State Space Models | Enhancing LLMs!

www.youtube.com/watch?v=BDTV...

21.03.2025 15:40 β€” πŸ‘ 3    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Video thumbnail

Happy to introduce my video on this alternative LLM architecture, Mamba and State Space Models!

I wanted to do it for a while now and finally found the time to work on animating my visual guide. Expect to gain an intuitive understanding of this alternative LLM architecture.

Link below πŸ‘‡

21.03.2025 15:40 β€” πŸ‘ 8    πŸ” 1    πŸ’¬ 1    πŸ“Œ 0
Preview
Release v0.17.0 Β· MaartenGr/BERTopic Highlights: Light-weight installation without UMAP and HDBSCAN by @MaartenGr in #2289 Add Model2Vec as an embedding backend by @MaartenGr in #2245 Add LiteLLM as a representation model by @Maarten...

You can find the full changelog here: github.com/MaartenGr/BE...

19.03.2025 17:08 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Video thumbnail

Announcing BERTopic v0.17 πŸ₯³

This is a feature-packed update that includes the amazing Model2Vec, more interactive DataMapPlot functionalities, a method for lightweight installation, and much more!

19.03.2025 17:08 β€” πŸ‘ 7    πŸ” 3    πŸ’¬ 1    πŸ“Œ 0
Preview
A Visual Guide to LLM Agents Exploring the main components of Single- and Multi-Agents

I might have gone a little overboard with the number of visuals... but this is such an exciting topic! Here's the article: newsletter.maartengrootendorst.com/p/a-visual-g...

17.03.2025 15:57 β€” πŸ‘ 4    πŸ” 2    πŸ’¬ 1    πŸ“Œ 0
Post image

Introducing "A Visual Guide to LLM Agents" πŸ€–

With over 60 (!) custom visuals, explore how Agents work, how they are created, their reasoning behavior, Model Context Protocol (MCP), Multi-Agent frameworks, and much more!

Link below πŸ‘‡

17.03.2025 15:57 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

Can you guess which visual guide is coming?

14.03.2025 16:05 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

MCP is such an interesting protocol and a welcome addition to LLM-based frameworks.

14.03.2025 16:05 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Video thumbnail

I discuss Model Context Protocol (MCP) in an upcoming article and figured I would share a small video illustrating a simplified flow!

14.03.2025 16:05 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Preview
GitHub - MaartenGr/KeyBERT: Minimal keyword extraction with BERT Minimal keyword extraction with BERT. Contribute to MaartenGr/KeyBERT development by creating an account on GitHub.

You can find the repo here: github.com/MaartenGr/Ke...

19.02.2025 15:36 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

As a bonus, I created a lightweight installation of KeyBERT using ONLY scikit-learn and Model2Vec! Installation is straightforward:

19.02.2025 15:36 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

Blazingly fast keyword generation with KeyBERT v0.9 and Model2Vec πŸ”₯

I have been a big fan of the amazing embedding models by The Minish Lab, so I had to integrate them with KeyBERT.

A release for the GPU-poor πŸ˜‰

19.02.2025 15:36 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

You can find everything at our repo: github.com/HandsOnLLM/H...

11.02.2025 16:23 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

To Reasoning LLMs and DeepSeek-R1:

11.02.2025 16:23 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

There are also guides to common principles like Quantization and Mixture of Experts:

11.02.2025 16:23 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

@jayalammar.bsky.social and I are incredibly proud to bring you this highly animated (and free πŸ˜‰) course:

11.02.2025 16:23 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

Did you know we continue to develop new content for the "Hands-On Large Language Models" book?

There's now even a free course available with
@deeplearningai.bsky.social!

11.02.2025 16:23 β€” πŸ‘ 11    πŸ” 3    πŸ’¬ 1    πŸ“Œ 0
Preview
A Visual Guide to Reasoning LLMs Exploring Test-Time Compute techniques and DeepSeek-R1

Article: newsletter.maartengrootendorst.com/p/a-visual-g...

03.02.2025 15:51 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

All the way to DeepSeek-R1-(zero):

03.02.2025 15:51 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

From exploring verifiers for distilling reasoning:

03.02.2025 15:51 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

A Visual Guide to Reasoning LLMs πŸ’­

With over 40 custom visuals, explore DeepSeek-R1, the train-time compute paradigm shift, test-time compute techniques, verifiers, STaR, and much more!

Link below

03.02.2025 15:51 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 1
Preview
Exploring Language Models | Maarten Grootendorst | Substack ML Engineer writing about GenAI | Open Sourcerer (BERTopic, PolyFuzz, KeyBERT) | Author of "Hands-On Large Language Models". Click to read Exploring Language Models, by Maarten Grootendorst, a Substac...

To celebrate this milestone, I'm working hard on an update to the Mamba guide (with animations!) and there's also a video version almost ready to record!

Link to the newsletter:
newsletter.maartengrootendorst.com

20.01.2025 15:42 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

I'm incredibly grateful that "Exploring Language Models" has reached over 10k subscribersπŸ”₯

A big thank you to all readers who have enjoyed my visual guides to Mixture of Experts (MoE), Quantization, State Space Models (SSMs) and Mamba πŸ€—

20.01.2025 15:42 β€” πŸ‘ 2    πŸ” 0    πŸ’¬ 1    πŸ“Œ 1
Post image

I started working on animating "A Visual Guide to Mamba" and it's been a blast.

Perhaps I should just add animations as a default to upcoming visual guides πŸ˜‰

18.12.2024 15:57 β€” πŸ‘ 1    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
A Visual Guide to Mixture of Experts (MoE) in LLMs
YouTube video by Maarten Grootendorst A Visual Guide to Mixture of Experts (MoE) in LLMs

🍿 Introducing the animated "Visual Guide to Mixture of Experts (MoE)"!

This was a blast to make and contains more in-depth descriptions than the original already had! Expect even more intuition as we break down visuals and discover the nuances behind MoE.

www.youtube.com/watch?v=sOPD...

18.11.2024 16:20 β€” πŸ‘ 4    πŸ” 3    πŸ’¬ 0    πŸ“Œ 0
Preview
A Visual Guide to Quantization Exploring memory-efficient techniques for LLMs

You can find the guide here: newsletter.maartengrootendorst.com/p/a-visual-g...

12.11.2024 15:40 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 0    πŸ“Œ 0
Post image

All the way up to BitNet 1.58b with Bitlinear:

12.11.2024 15:40 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0
Post image

We start with the basics of quantization like the absmax method:

12.11.2024 15:40 β€” πŸ‘ 0    πŸ” 0    πŸ’¬ 1    πŸ“Œ 0

@maartengr is following 2 prominent accounts