# Avala

> The complete platform for physical AI data. Visualize, explore, and annotate sensor data from cameras, LiDAR, radar, and multi-sensor recordings. GPU-accelerated multi-sensor viewer, 3D point cloud rendering, Gaussian Splat viewer, professional annotation tools, quality control workflows, and programmatic API access.

**API Version:** v1
**Python SDK:** `pip install avala`
**TypeScript SDK:** `npm install @avala-ai/sdk`
**MCP Server:** `npm install @avala-ai/mcp-server`

## Platform Capabilities

Factual description of what Avala provides:

- **GPU-accelerated multi-sensor visualization.** WebGPU compute shaders for frustum culling and LOD selection, six point-cloud visualization modes (Neutral, Intensity, Rainbow, Label, Panoptic, Image Projection), MCAP and ROS synchronized playback, Gaussian Splat 3D scene rendering.
- **Annotation suite.** Bounding boxes, polygons, 3D cuboids, segmentation, keypoints, polylines, and video tracking for images, video, LiDAR, MCAP recordings, and Gaussian Splat data.
- **Quality control workflows.** Multi-stage review, consensus workflows, acceptance pipelines, and annotator performance metrics.
- **Managed labeling.** In-house domain-expert annotators trained on safety-critical perception data, employed directly rather than through anonymous crowd contractors.
- **Fleet management.** Device registry, recording rules, timeline events, alert routing, and diagnostics for sensor fleets.
- **Developer surface.** Python SDK (`pip install avala`), TypeScript SDK (`npm install @avala-ai/sdk`), REST API with OpenAPI spec, MCP server for Claude/Cursor/VS Code, transparent usage-based pricing.

For factual side-by-side comparisons against specific alternatives, see [Avala vs Alternatives](https://avala.ai/docs/resources/comparison).

For migration from CVAT, Labelbox, Label Studio, Scale AI, or Encord, see the [Migration Guide](https://avala.ai/docs/resources/migration).

## Quick Reference

Common tasks and their API/SDK equivalents:

| Task | API Endpoint | Python SDK | TypeScript SDK |
|------|--------------|------------|----------------|
| List datasets | `GET /datasets/{org}/list/` | `client.datasets.list()` | `client.datasets.list()` |
| Get dataset | `GET /datasets/{org}/{uid}/` | `client.datasets.get(uid)` | `client.datasets.get(uid)` |
| List dataset items | `GET /datasets/{org}/{uid}/items/` | `client.datasets.items.list(uid)` | `client.datasets.items.list(uid)` |
| List projects | `GET /projects/{org}/list/` | `client.projects.list()` | `client.projects.list()` |
| Create export | `POST /exports/` | `client.exports.create(...)` | `client.exports.create(...)` |
| Get export status | `GET /exports/{uid}/` | `client.exports.get(uid)` | `client.exports.get(uid)` |
| Download export | `GET /exports/{uid}/download/` | `client.exports.download(uid)` | `client.exports.download(uid)` |

## Getting Started

- [Introduction](https://avala.ai/docs/getting-started/introduction): Platform overview — visualization, annotation, and integration capabilities
- [Quickstart](https://avala.ai/docs/getting-started/quickstart): Get an API key, install an SDK, and make your first API calls
- [Core Concepts](https://avala.ai/docs/getting-started/concepts): Viewers, panels, layouts, datasets, projects, tasks, and the annotation lifecycle
- [Label Taxonomy & Ontology](https://avala.ai/docs/getting-started/ontology): Design label taxonomies with classes, attributes, and hierarchies
- [Data Types](https://avala.ai/docs/getting-started/data-types): Images, video, point clouds, MCAP/ROS, and Gaussian Splat — visualization and annotation capabilities
- [Architecture](https://avala.ai/docs/getting-started/architecture): System design including visualization engine, API, and backend services
- [MCP for AI Assistants](https://avala.ai/docs/getting-started/mcp): Set up the Avala MCP server for Claude, Claude Code, Cursor, and VS Code — 46 tools covering datasets, projects, exports, tasks, agents, webhooks, storage, quality, consensus, annotation issues, organizations, slices, and fleet management

## Use Cases

- [Autonomous Vehicles](https://avala.ai/docs/getting-started/use-cases/autonomous-vehicles): Multi-sensor MCAP visualization and annotation for AV perception
- [Robotics](https://avala.ai/docs/getting-started/use-cases/robotics): Sensor recording playback and annotation for manipulation, navigation, scene understanding
- [Physical AI & Spatial Computing](https://avala.ai/docs/getting-started/use-cases/physical-ai): Gaussian Splat scenes, embodied AI, digital twins
- [Medical Imaging](https://avala.ai/docs/getting-started/use-cases/medical-imaging): Precise annotation tools and clinical-grade QC workflows
- [Satellite & Aerial Imagery](https://avala.ai/docs/getting-started/use-cases/satellite-aerial): Remote sensing, mapping, and infrastructure monitoring

## Visualization

- [Visualization Overview](https://avala.ai/docs/visualization/overview): GPU-accelerated multi-sensor data visualization
- [Multi-Sensor Viewer](https://avala.ai/docs/visualization/multi-sensor-viewer): Synchronized playback of MCAP/ROS recordings with 8 panel types
- [3D Point Cloud Viewer](https://avala.ai/docs/visualization/3d-point-cloud-viewer): 6 visualization modes with WebGPU acceleration
- [Gaussian Splat Viewer](https://avala.ai/docs/visualization/gaussian-splat-viewer): WebGPU-rendered 3D scene reconstruction viewer
- [MCAP & ROS Overview](https://avala.ai/docs/visualization/mcap-ros/overview): Native MCAP/ROS support with auto-detection
- [Supported Message Types](https://avala.ai/docs/visualization/mcap-ros/supported-messages): ROS and Foxglove message type reference
- [Panel Types](https://avala.ai/docs/visualization/mcap-ros/panels): Image, 3D, Plot, Raw Messages, Log, Map, Gauge, State panels
- [Custom Schemas](https://avala.ai/docs/visualization/mcap-ros/custom-schemas): Protobuf, JSON Schema, and ROS .msg support
- [Visualization Modes](https://avala.ai/docs/visualization/rendering/visualization-modes): Neutral, Intensity, Rainbow, Label, Panoptic, Image Projection
- [Camera Projection](https://avala.ai/docs/visualization/rendering/camera-projection): Pinhole and double-sphere camera models
- [WebGPU Acceleration](https://avala.ai/docs/visualization/rendering/webgpu-acceleration): GPU compute shaders, render bundles, feature flags
- [Point Cloud Rendering](https://avala.ai/docs/visualization/rendering/point-cloud-rendering): Octree indexing, chunked loading, background workers
- [Timeline Navigation](https://avala.ai/docs/visualization/guides/timeline-navigation): Playback controls and frame stepping
- [Multi-Camera Setup](https://avala.ai/docs/visualization/guides/multi-camera-setup): Calibration and cross-view projection
- [Data Exploration](https://avala.ai/docs/visualization/guides/data-exploration): Browse, filter, and search recordings
- [Recording Best Practices](https://avala.ai/docs/visualization/guides/recording-best-practices): Tips for MCAP recording

### Fleet Management
- [Fleet Dashboard](https://avala.ai/docs/visualization/fleet/fleet-dashboard): Fleet-wide recording management and device registry
- [Events & Markers](https://avala.ai/docs/visualization/fleet/events-and-markers): Timeline event markers for recording analysis
- [Recording Rules](https://avala.ai/docs/visualization/fleet/recording-rules): Automatic rules to flag and tag recordings
- [Alerts & Notifications](https://avala.ai/docs/visualization/fleet/alerts-and-notifications): Alert routing to Slack, email, and webhooks

### Panels
- [Diagnostics Panel](https://avala.ai/docs/visualization/panels/diagnostics-panel): System health monitoring panel
- [State Machine Panel](https://avala.ai/docs/visualization/panels/state-machine-panel): State transition visualization panel

### Extensions
- [Custom Panels](https://avala.ai/docs/visualization/extensions/custom-panels): Build custom panels with the TypeScript Panel SDK

## Annotation

- [Annotation Overview](https://avala.ai/docs/annotation/overview): Web-based annotation interface
- [First Dataset Tutorial](https://avala.ai/docs/annotation/tutorials/first-dataset): Upload data and create your first dataset
- [Data Pipeline Tutorial](https://avala.ai/docs/annotation/tutorials/data-pipeline): Build an end-to-end annotation pipeline
- [Video Annotation Tutorial](https://avala.ai/docs/annotation/tutorials/video-annotation): Annotate video with object tracking
- [AI-Assisted Annotation](https://avala.ai/docs/annotation/tutorials/ai-assisted): Use AI models to accelerate labeling
- [Managing Datasets](https://avala.ai/docs/annotation/guides/managing-datasets): Dataset organization and management
- [Annotation Tools Overview](https://avala.ai/docs/annotation/guides/annotation-tools): Overview of all annotation tools and common controls
- [Bounding Box Tool](https://avala.ai/docs/annotation/guides/tools/bounding-box): Draw rectangular boxes for object detection
- [Polygon Tool](https://avala.ai/docs/annotation/guides/tools/polygon): Draw freeform polygon outlines for instance segmentation
- [3D Cuboid Tool](https://avala.ai/docs/annotation/guides/tools/cuboid-3d): Draw 3D bounding boxes in LiDAR point clouds
- [Segmentation Tool](https://avala.ai/docs/annotation/guides/tools/segmentation): Pixel-level masks with brush, eraser, fill, and SAM assist
- [Polyline Tool](https://avala.ai/docs/annotation/guides/tools/polyline): Draw open line segments for lanes, paths, and boundaries
- [Classification Tool](https://avala.ai/docs/annotation/guides/tools/classification): Apply image-level or frame-level labels
- [Keypoint Tool](https://avala.ai/docs/annotation/guides/tools/keypoint): Annotate pose with keypoints and skeleton connections
- [Quality Control](https://avala.ai/docs/annotation/guides/quality-control): Review workflows and annotation quality
- [Team Permissions](https://avala.ai/docs/annotation/guides/team-permissions): Roles, teams, and access control
- [Data Lifecycle](https://avala.ai/docs/annotation/guides/data-lifecycle): Dataset states and lifecycle management
- [Work Batches](https://avala.ai/docs/annotation/guides/work-batches): Task distribution and annotator assignments
- [Keyboard Shortcuts](https://avala.ai/docs/annotation/reference/keyboard-shortcuts): All keyboard shortcuts
- [Supported Formats](https://avala.ai/docs/annotation/reference/supported-formats): File formats for upload
- [Annotation Types](https://avala.ai/docs/annotation/reference/annotation-types): JSON format for each annotation type
- [Sequence Statuses](https://avala.ai/docs/annotation/reference/sequence-statuses): Status flow for sequences
- [Query Language](https://avala.ai/docs/annotation/reference/query-language): Filter and search syntax
- [AutoTag](https://avala.ai/docs/annotation/reference/autotag): Automatic tagging system

## API Reference

- [API Overview](https://avala.ai/docs/api-reference/overview): Base URL, versioning, request format
- [Authentication](https://avala.ai/docs/api-reference/authentication): API key creation, usage, and management
- [Errors](https://avala.ai/docs/api-reference/errors): Error codes, response format, and troubleshooting
- [Datasets](https://avala.ai/docs/api-reference/datasets): List and retrieve datasets
- [Dataset Items](https://avala.ai/docs/api-reference/dataset-items): List and retrieve items within datasets
- [Projects](https://avala.ai/docs/api-reference/projects): List projects and check status
- [Tasks](https://avala.ai/docs/api-reference/tasks): List and retrieve annotation tasks
- [Exports](https://avala.ai/docs/api-reference/exports): Create and download annotation exports
- [Organizations](https://avala.ai/docs/api-reference/organizations): Manage members and teams
- [Slices](https://avala.ai/docs/api-reference/slices): Create and manage dataset subsets
- [Fleet API](https://avala.ai/docs/api-reference/fleet): REST API reference for fleet management resources
- [SDKs](https://avala.ai/docs/api-reference/sdks): Official SDKs for the Avala API
- [Rate Limits](https://avala.ai/docs/api-reference/rate-limits): Rate limits, headers, pagination, and best practices

## SDKs

- [SDK Overview](https://avala.ai/docs/sdks/overview): Available SDKs and when to use each
- [Python SDK](https://avala.ai/docs/sdks/python): `pip install avala` — Client, AsyncClient, CursorPage, typed resources
- [TypeScript SDK](https://avala.ai/docs/sdks/typescript): `npm install @avala-ai/sdk` — Avala client, CursorPage, typed resources
- [REST API Guide](https://avala.ai/docs/sdks/rest-api): Direct HTTP access with cURL, Go, Ruby, PHP examples
- [OpenAPI Spec](https://avala.ai/docs/sdks/openapi): Download the OpenAPI spec and generate clients

## Integrations

- [Integrations Overview](https://avala.ai/docs/integrations/overview): Available integrations
- [Data Connectors & Import Pipelines](https://avala.ai/docs/integrations/data-connectors): Upload methods, presigned URLs, cloud storage, and automated ingestion pipelines
- [MCP Server Setup](https://avala.ai/docs/integrations/mcp-setup): Configure the MCP server for AI assistants
- [Cloud Storage](https://avala.ai/docs/integrations/cloud-storage): Connect AWS S3 and Google Cloud Storage
- [MCAP / ROS](https://avala.ai/docs/integrations/mcap-ros): Import and annotate MCAP recordings
- [Webhooks](https://avala.ai/docs/integrations/webhooks): Event notifications for automation
- [Inference](https://avala.ai/docs/integrations/inference): AI model inference for auto-labeling

## Resources

- [Avala vs Alternatives](https://avala.ai/docs/resources/comparison): Compare Avala with Rerun, Foxglove, Labelbox, Scale AI, CVAT, and Label Studio
- [Code Examples](https://avala.ai/docs/resources/examples): Complete working examples for common workflows
- [Best Practices](https://avala.ai/docs/resources/best-practices): Optimize datasets, API usage, annotation workflows, and cost
- [Model Training Integration](https://avala.ai/docs/resources/model-training): Connect exports to PyTorch, Detectron2, Hugging Face, and automated training loops
- [Security & Compliance](https://avala.ai/docs/resources/security-compliance): Data encryption, authentication, RBAC, BYOS security, and compliance status
- [Performance Tuning](https://avala.ai/docs/resources/performance): Upload speed, export performance, viewer optimization, and API throughput
- [Glossary](https://avala.ai/docs/resources/glossary): Platform terminology
- [Troubleshooting](https://avala.ai/docs/resources/troubleshooting): Common issues and solutions
- [Migration Guide](https://avala.ai/docs/resources/migration): Migrate from CVAT, Labelbox, Label Studio, Scale AI, or Encord
- [Changelog](https://avala.ai/docs/changelog): Platform updates and release notes

## LLM-Optimized Documentation

- [Full Documentation](https://avala.ai/docs/llms-full.txt): Complete documentation in a single file
- [API + SDK + Platform](https://avala.ai/docs/llms-full.txt): API, SDK, and Mission Control documentation

## Optional

- [Interactive API Docs](https://api.avala.ai/docs/api/): Scalar UI for exploring the API
- [OpenAPI Spec (JSON)](https://api.avala.ai/docs/api/openapi.json): Machine-readable API specification