Potato 2.1 is here! Our open-source annotation platform now includes
- multi-field span annotation (e.g., labeling premise/hypothesis separate)
- span linking for relation extraction, and
- AI-assisted visual annotation with YOLO + VLLMs—bounding boxes, labels, rationales, and many more!

GitHub - davidjurgens/potato: potato: portable text annotation tool potato: portable text annotation tool. Contribute to davidjurgens/potato development by creating an account on GitHub.

We're looking forward to adding new features and keeping Potato supported for years to come, so please feel free to send feature requests on the github too github.com/davidjurgens...

A whole dedicated website! www.potatoannotator.com

- Task design wizard!
- Extensive showcase of 80+ annotation tasks from real papers
- So much documentation
You can easily add your tasks to our showcase with a pull request here github.com/davidjurgens...

Many, many quality of life improvements

- New support for Amazon Mechanical Turk!
- Passwordless servers for trusted environments
- Dynamic data loading—new data can be added to a running server (h/t @mariaa.bsky.social for the request)
- Easier debugging
- So much new documentation

Improved and customized UI

- The whole Potato UI has been overhauled to support mobile annotation better
- New task-specific UI customization lets you easily adjust your task's specific layout without hacking the tool

It's now super easy to polish your design the way you want on Potato

Flexible annotation/survey flow

- Annotators can go through mandatory training
- Support for multiple pre/post-annotation surveys
- Chain together different annotation tasks one-after-another
- Expertise-base instance routing

We're working on more dynamic flows and item routing too!

Built in support for quality control

- Attention checks (catch distracted annotators)
- Gold standard tracking
- Live inter-annotator agreement metrics
- Training phase with feedback

We have a whole new admin dashboard to keep track of annotation process in real time

Potato has finally moved beyond just text! New in 2.0:

- Audio annotation with segment labeling and waveform visualization
- Video annotation with frame-by-frame labeling
- Image region labeling

One platform for text, audio, video, and images—or multimodal!

AI-Assisted Annotation

Potato 2.0 works with multiple LLM providers (OpenAI, Anthropic, Gemini) and local LLMs (vLLM, Ollama) to help annotators work faster:
- Intelligent hints without giving answers
- Keyword highlighting
- Label suggestions

Your annotators get guidance. You keep control.

Super proud that today we're releasing Potato 2.0 - the biggest update yet to our open-source annotation platform www.potatoannotator.com 🥔

Major UI/UX improvements. Support for image, audio & video annotation. AI-powered assistance/hints/labeling. And still free 🤩

Here's some of what's new: