# Human-In-The-Loop  At Scale

Orchestrate annotation workflows with multi-step pipelines, team management, and quality control. Add annotators, set sample rates, and track progress.

## Workflows

### Custom multi-step pipelines

Design annotation workflows that match your quality requirements. Chain annotation and review steps with configurable sample rates.

#### Annotation Steps

Workers create initial annotations on assigned assets

#### Review Steps

Team members validate and accept/reject previous work

#### Sample Rates

Control what percentage of assets proceed to each step

**Example Pipeline**

1. Initial Annotation - 100%
2. First Review - 50%
3. Final Validation - 25%

## Task Management

### Full visibility on progress

Track every task through its lifecycle. Reassign work, manage priorities, and ensure nothing falls through the cracks.

- 234 In Progress
- 12 To Rework
- 1,847 Done
- 8 Skipped

**Task Lifecycle**

- In Progress
- Submitted
- Done
- To Rework

## Team Management

### Scale with external teams

Onboard external annotators quickly with clear guidelines. Control access, distribute work evenly, and maintain quality standards.

- Equal or weighted task distribution
- Instruction PDFs for annotators
- Role-based access controls
- Bulk task reassignment

## Quality Control

### Collaborative issue tracking

Flag problems, discuss solutions, and ensure quality before assets leave the pipeline. No asset can be marked done with open issues.

#### Zone Issues

Flag specific areas with rectangular markers. Perfect for pointing out boundary errors, missing annotations, or unclear regions.

#### Image Issues

Flag concerns about the entire asset. Use for classification errors, image quality problems, or incorrect labeling approach.

**Assets cannot be marked Done with open issues**

- ISSUES: 2 open
- Unclear boundary: open
- IMG_0042.jpg: Wrong classification resolved
- IMG_0156.jpg: Missing annotation open
- IMG_0089.jpg: Missing annotation open

## Analytics

### Real-time performance insights

Track time spent, monitor productivity, and identify bottlenecks. See where work slows down and fix it.

- 2.4 min: Avg. Time per Asset  
- 847/day: Team Throughput (Assets completed by all workers)  
- 98.2%: Acceptance Rate (First-pass review approval)

## Ready to scale your annotation?

Set up multi-step annotation workflows with built-in review and quality control. Free trial, no credit card.
