Snorkel AI

Training data, evaluations, and enterprise GenAI from the data-labeling giant.

Scale supplies the human-annotated training data behind most frontier AI labs through its Data Engine, spanning labeling, RLHF, and expert red-teaming. On top of the data business it runs evaluation leaderboards, an enterprise GenAI platform, and Donovan, its platform for the US public sector.

Data factory for AI teams — labeling, evals, and human data for training.

Labelbox is a platform for generating and managing training data for AI models, combining annotation tools (Annotate), data curation (Catalog), and model-assisted labeling and evaluation (Model Foundry). It now spans reinforcement-learning data, custom evals, robotics datasets, and an on-demand network of expert human labelers, metered by a usage-based Labelbox Unit (LBU).

Open-source multi-type data labeling and AI evaluation.

Widely-used open-source tool for labeling and annotating data across images, text, audio, video, and time-series, with a standardized export format for training and fine-tuning. ML backends can pre-label data to speed up human review, and it increasingly doubles as a human-in-the-loop AI evaluation surface. Maintained by HumanSignal, which offers a hosted Starter tier and Label Studio Enterprise.

Platform for building multimodal AI datasets and evaluation pipelines.

SuperAnnotate is an enterprise data platform for creating, managing, and evaluating high-quality datasets for AI. It spans annotation across images, video, text, audio, and LiDAR, with AI-assisted labeling, customizable workflows, and an optional managed annotation workforce. Teams use it to build human-in-the-loop data and evaluation pipelines for agentic, multimodal, and frontier AI.