Ben Burtenshaw

🤖 As AI-generated content is shared in movies/TV/across the web, there's one simple low-hanging fruit 🍇 to help know what's real: Visible watermarks. With others @hf.co, I've made sure it's trivially easy to add this disclosure to images, video, chatbot text. See how:
huggingface.co/blog/waterma...

Building Tensors From Scratch in Rust: Part 1, Core Structure and Indexing A Blog post by Kyle Birnbaum on Hugging Face

I'm writing an article series about creating tensors from scratch in Rust. #tensors #machine-learning #ml #ai

huggingface.co/blog/KeighBe...

Feel - a Hugging Face Space by feel-fl Discover amazing ML apps made by the community

AI doesn’t get your culture?❌ butchers your language? 😤
With FeeL – you can fix that🛠️🌍

💬 Talk to AI in your language
✏️ Correct its mistakes
👁‍🗨 Watch it improve
The more we use it, the smarter it gets for everyone!

👉 Try it now: huggingface.co/spaces/feel-...

👶🤖📈
#ai #genAI #llm

How should AI tools be designed to support rather than replace workers?

At the Reshaping Work conference, I led a roundtable exploring AI’s impact on labor. We published a blogpost on our key takeaways on responsible AI and the future of work w/ Franco Bastida
🔗 www.rsm.nl/discovery/20...
🧵👇

I've put together some of the handier tools for building courses and educational material on the @huggingface hub.

These should bootstrap you projects with quizzes, friendly sized model, usefule datasets, and informative spaces.

Let me know if you use or need more.

https://buff.ly/42qyanw

GitHub - huggingface/open-r1: Fully open reproduction of DeepSeek-R1 Fully open reproduction of DeepSeek-R1. Contribute to huggingface/open-r1 development by creating an account on GitHub.

The science team at Hugging Face reproduced and open source the seek r1. https://buff.ly/4jtbp8x

Manic few days in open source AI, with game changing development all over the place. Here's a round up of the resources:

Here's a thread on it all:

Dataset Quiz - a Hugging Face Space by burtenshaw A quiz app for rows of a dataset

quiz app https://buff.ly/4atPzxo
dataset with questions https://buff.ly/3ClY9Sm
agents course we're working on https://buff.ly/4gehzqi

Here's how it works:

- make a dataset of multiple choice questions
- duplicate the space add set the dataset repo
- log in and do the quiz
- submit the questions to create a new dataset

I made this to get ready for the agents course, but I hope it's useful for you projects too!

Teachers and Students! Here's a handy quiz app if you're preparing your own study material.

TLDR, It's a quiz that uses a dataset to make questions and save answers.

Mastering Long Contexts in LLMs with KVPress A Blog post by NVIDIA on Hugging Face

If you need long context for RAG, tool use, agents, or just because, Nvidia released a new library to make it super simple.

TLDR: You can get 128k context at 50% less memory 🐳

Here's a blog post on everything:

What happened yesterday in the Chinese AI community? 🚀
huggingface.co/posts/AdinaY...

Deepseek just dropped a frontier reasoning model on the hub. It's 685 billion parameters of bleeding edge performance on COMPLEX tasks.

Who's considering this for synthetic datasets, distillation, or pruning?

Gradio spaces are the perfect agent tools\! A Blog post by ben burtenshaw on Hugging Face

Here's a blog post I wrote with the details https://buff.ly/4gVpudi

Gradio And Llm Agents A Step-by-Step Gradio Tutorial

Playing around with AI agents, and I reckon Gradio spaces on the hub make the perfect tools.

- super easy to connect your agents to a bunch of useful tools and apps.
- find a Space you like on Hugging Face Hub or make your own with Gradio.
- link it up with smolagents.

🧵

We’re launching a FREE course on LLM Agents 🥳

📖 Learn what Agents are
🕵️ Build your own Agents using the latest libraries and tools.
🎓 Earn a certificate of completion to showcase your achievement.

Enroll now 👉 huggingface.us17.list-manage.com/subscribe?u=...

Tools 4 Agents - a burtenshaw Collection This is a collection of spaces on the hub that are useful for building agents. https://huggingface.co/docs/smolagents/en/tutorials/tools

Here's a collection with tools for:

- create a plotly visualisation
- get travel duration
- transcribe youtube video
- transform image

https://buff.ly/3PAU6od

Tools We’re on a journey to advance and democratize artificial intelligence through open source and open science.

These should setup a few cool agent application, but if not it's easy to build a tool within a gradio application. Here's a guide:

https://buff.ly/3Wm2ZG1

Agents need tools and the Hugging Face hub is full of them. You can use Gradio spaces on the hub as agent tools. I created a short list that I tried out and made. Here's an overview

🧵

AI Agents Are Here. What Now? We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Great deep dive blog post on Agents, covering all the fundamentals from the ground up.

@mmitchell.bsky.social @sashamtl.bsky.social @giadapistilli.com @evijit.io

huggingface.co/blog/ethics-...

smol-course/8_agents at main · huggingface/smol-course A course on aligning smol models. Contribute to huggingface/smol-course development by creating an account on GitHub.

Here's the chapter on agent in smol course: https://buff.ly/3Cf5NOf

Free course on Agents by Hugging Face. We just added a chapter to smol course on agents. Naturally, using smolagents! The course cover these topics:

- Code agents
- Retrieval agents
- Custom functional

If you're building agent applications, this course should help.

CO₂ Emissions and Models Performance: Insights from the Open LLM Leaderboard We’re on a journey to advance and democratize artificial intelligence through open source and open science.

If you're looking for real talk from experience, check out this blogpost on emissions from generative ai models:

huggingface.co/blog/leaderb...

❓What we need now?
Most of use aren't building systems to solve frontier math problems on a daily basis. Shucks! That means we need reward models and representative datasets that represent the kinds of problems we're trying to solve. Crucially, in the domains and languages we're actually working!

⏩ What does it mean for us builders?
As these approaches develop, we can use small models on our use cases, and increase inference for challenging domain specific tasks. This means that for most tasks models need minimal compute, but for complex tasks we'll scale up compute.

Scaling test-time compute - a Hugging Face Space by HuggingFaceH4 Discover amazing ML apps made by the community

🔑 What happened in the open?
Researchers at @hf.co shared an approach that got a small(ish) model of 3 billion parameters to out perform its 70 billion variant using a search and a reward model.

@lewtun.bsky.social
Ed Beeching

https://buff.ly/3BAmi7o

🔒 What happened in the closed?
You've probably seen that OpenAi released a new model that aces some of the hardest math and reasoning benchmarks out there, in some cases outperforming the best human minds.

What does o3 mean for small open source models on real domains? I've been asking myself this question a lot the last week, and I think it sets up an interesting path forward.
OpenAI, is calling o3 a new paradigm. If that's true, then these two developments illustrate how that paradigm plays out:

🧵

GitHub - huggingface/smol-course: A course on aligning smol models. A course on aligning smol models. Contribute to huggingface/smol-course development by creating an account on GitHub.

If you want to try this out and learn the core topics, check out the smol course!

Here's the repo on smol course: https://buff.ly/3ZCMKX2

GitHub - huggingface/smol-course: A course on aligning smol models. A course on aligning smol models. Contribute to huggingface/smol-course development by creating an account on GitHub.

- a dataset that represents your use case or language, without costly data collection of annotation teams.
- an evaluation set so you can compare models and APIs. Unlocking performance, latency, and cost improvements.
- Improve existing datasets by filtering down to the highest quality samples.