The Model Context Protocol (MCP) is an open standard that lets AI assistants interact with external tools and data sources. Avala’s MCP server exposes your datasets, projects, and exports as tools that any MCP-compatible client can call, so you can manage your annotation workflow through natural language without switching context. This means you can ask Claude to “list all my datasets,” have Cursor create an export, or use VS Code to check project status — all powered by the same Avala API you already use.Documentation Index
Fetch the complete documentation index at: https://avala.ai/docs/llms.txt
Use this file to discover all available pages before exploring further.
Prerequisites
- Node.js 18 or later installed on your machine
- An Avala API key (generate one in Mission Control under Settings > Security)
Setup
Claude Desktop
Open your Claude Desktop configuration file:- macOS:
~/Library/Application Support/Claude/claude_desktop_config.json - Windows:
%APPDATA%\Claude\claude_desktop_config.json
Cursor
Create or edit.cursor/mcp.json in your project root (or global config directory):
VS Code
Create or edit.vscode/mcp.json in your workspace:
Claude Code
Add the Avala MCP server to Claude Code with a single command:ChatGPT
MCP Security Mode
For safety, the MCP server is read-only by default. Mutating tools are not registered unless you explicitly enable them with:create_datasetcreate_agent,delete_agentcreate_annotation_issue,update_annotation_issue,delete_annotation_issuecreate_storage_config,delete_storage_configcreate_webhook,delete_webhookcreate_exportevaluate_qualitycompute_consensusfleet_register_device,fleet_acknowledge_alert
Available MCP Tools
Once connected, the following tools are available to the AI assistant:| Tool | Description |
|---|---|
list_datasets | List all datasets in your workspace. |
get_dataset | Get details for a specific dataset. |
list_sequences | List sequences for a dataset (paginated). |
get_sequence | Get a sequence including its embedded frames array. |
get_frame | Get a single frame’s LiDAR JSON metadata (camera model, intrinsics, device pose). |
get_calibration | Get the canonicalized per-camera rig for a sequence (derived from frame[0]). |
get_dataset_health | Read-only ingest/health snapshot: frame totals, per-sequence counts, S3 prefix, detected issues. |
create_dataset | Create a new dataset for annotation. mutation |
list_projects | List all annotation projects. |
get_project | Get full project details. |
create_export | Trigger a new export for a dataset or project. (requires AVALA_MCP_ENABLE_MUTATIONS=true) |
get_export_status | Check export status. |
list_exports | List all exports. |
get_workspace_stats | Get workspace usage summary. |
list_tasks | List tasks with optional filtering. |
get_task | Get task details. |
list_agents | List automation agents. |
get_agent | Get agent details. |
create_agent | Create a new automation agent. (requires AVALA_MCP_ENABLE_MUTATIONS=true) |
delete_agent | Delete an agent. (requires AVALA_MCP_ENABLE_MUTATIONS=true) |
list_webhooks | List webhook subscriptions. |
create_webhook | Create a webhook subscription. (requires AVALA_MCP_ENABLE_MUTATIONS=true) |
delete_webhook | Delete a webhook. (requires AVALA_MCP_ENABLE_MUTATIONS=true) |
list_storage_configs | List storage configurations. |
create_storage_config | Create a storage configuration. (requires AVALA_MCP_ENABLE_MUTATIONS=true) |
test_storage_config | Test storage connectivity. |
delete_storage_config | Delete a storage configuration. (requires AVALA_MCP_ENABLE_MUTATIONS=true) |
list_quality_targets | List quality targets for a project. |
evaluate_quality | Evaluate quality targets. (requires AVALA_MCP_ENABLE_MUTATIONS=true) |
get_consensus_summary | Get consensus summary for a project. |
compute_consensus | Trigger consensus computation. (requires AVALA_MCP_ENABLE_MUTATIONS=true) |
list_organizations | List organizations. |
get_organization | Get organization details. |
list_slices | List slices for an owner. |
get_slice | Get slice details. |
list_annotation_issues_by_sequence | List annotation issues for a sequence. |
create_annotation_issue | Create a new annotation issue. (requires AVALA_MCP_ENABLE_MUTATIONS=true) |
update_annotation_issue | Update an annotation issue. (requires AVALA_MCP_ENABLE_MUTATIONS=true) |
delete_annotation_issue | Delete an annotation issue. (requires AVALA_MCP_ENABLE_MUTATIONS=true) |
list_annotation_issues_by_dataset | List annotation issues for a dataset. |
get_annotation_issue_metrics | Get issue metrics for a dataset. |
list_qc_tools | List available QC tools. |
Fleet (Preview)
Fleet tools are in preview and may change. They provide read and write access to fleet devices, recordings, events, alerts, and rules.
| Tool | Description |
|---|---|
fleet_list_devices | List fleet devices with optional filters. |
fleet_get_device | Get detailed information about a specific fleet device. |
fleet_list_recordings | List fleet recordings with optional filters. |
fleet_get_recording | Get detailed information about a specific recording. |
fleet_list_events | List fleet events with optional filters. |
fleet_list_alerts | List fleet alerts with optional filters. |
fleet_list_rules | List fleet rules with optional filters. |
fleet_register_device | Register a new fleet device. mutation |
fleet_acknowledge_alert | Acknowledge a fleet alert. mutation |
Tool Definitions
Detailed schemas for each MCP tool. All tools return JSON as text content.list_datasets
Lists all datasets in the workspace. Parameters:dataType(string, optional) — Filter by data type (image,video,lidar,mcap,splat)name(string, optional) — Filter by dataset name (partial match)status(string, optional) — Filter by dataset statusvisibility(string, optional) — Filter by visibility (privateorpublic)limit(number, optional) — Maximum number of datasets to returncursor(string, optional) — Pagination cursor from a previous request
get_dataset
Gets details for a specific dataset. Parameters:uid(string, required) — The unique identifier (UUID) of the dataset
list_sequences
Lists sequences for a dataset. Parameters:owner(string, required) — Dataset owner username, handle, or organization slugslug(string, required) — Dataset sluglimit(number, optional) — Maximum number of sequences to returncursor(string, optional) — Pagination cursor from a previous request
get_sequence
Gets a sequence including its embeddedframes array (full LiDAR JSON metadata for every frame).
Parameters:
owner(string, required) — Dataset owner username, handle, or organization slugslug(string, required) — Dataset slugsequenceUid(string, required) — Sequence UUID
get_frame
Gets a single frame’s LiDAR JSON metadata — the same blob Mission Control loads. Useful for post-ingest validation: confirm camera model, intrinsics, extrinsics, and device pose without opening the UI. Parameters:owner(string, required) — Dataset owner username, handle, or organization slugslug(string, required) — Dataset slugsequenceUid(string, required) — Sequence UUIDframeIdx(number, required) — Zero-based frame index within the sequence
get_calibration
Gets the canonicalized per-camera rig for a sequence, derived fromframe[0].
Parameters:
owner(string, required) — Dataset owner username, handle, or organization slugslug(string, required) — Dataset slugsequenceUid(string, required) — Sequence UUID
get_dataset_health
Read-only ingest/health snapshot for a dataset. Intended for programmatic validation after upload. Parameters:owner(string, required) — Dataset owner username, handle, or organization slugslug(string, required) — Dataset slug
list_projects
Lists all annotation projects. Parameters:limit(number, optional) — Maximum number of projects to returncursor(string, optional) — Pagination cursor from a previous request
get_project
Gets details for a specific project. Parameters:uid(string, required) — The unique identifier (UUID) of the project
create_dataset
Creates a new dataset for annotation. Parameters:name(string, required) — Display name for the datasetslug(string, required) — URL-friendly identifier for the datasetdataType(string, required) — Type of data:image,video,lidar, ormcapisSequence(boolean, optional) — Whether the dataset contains sequences (default: false)visibility(string, optional) — Dataset visibility:privateorpublic(default:private)createMetadata(boolean, optional) — Whether to create dataset metadata (default: true)providerConfig(object, optional) — Cloud storage provider configurationownerName(string, optional) — Dataset owner username or email
create_export
Triggers a new export for a dataset or project. Parameters:project(string, optional) — Project UID to exportdataset(string, optional) — Dataset UID to export
get_export_status
Checks the status of an export. Parameters:uid(string, required) — The unique identifier (UUID) of the export
list_exports
Lists all exports in the workspace. Parameters:limit(number, optional) — Maximum number of exports to returncursor(string, optional) — Pagination cursor from a previous request
get_workspace_stats
Gets a quick check of workspace contents (datasets, projects, exports). Parameters: None Example response:list_tasks
Lists tasks with optional filtering by project or status. Parameters:project(string, optional) — Filter by project UIDstatus(string, optional) — Filter by task statuslimit(number, optional) — Maximum number of tasks to returncursor(string, optional) — Pagination cursor from a previous request
get_task
Gets detailed information about a specific task. Parameters:uid(string, required) — The unique identifier (UUID) of the task
list_agents
Lists all automation agents configured in your workspace. Parameters:limit(number, optional) — Maximum number of agents to returncursor(string, optional) — Pagination cursor from a previous request
get_agent
Gets detailed information about a specific automation agent. Parameters:uid(string, required) — The unique identifier (UUID) of the agent
create_agent
Creates a new automation agent with event subscriptions and a callback URL. Parameters:name(string, required) — Name of the agentevents(string[], required) — List of event types the agent subscribes tocallbackUrl(string, optional) — URL to receive event callbacksdescription(string, optional) — Description of the agentproject(string, optional) — Project UID to scope the agent totaskTypes(string[], optional) — Task types the agent handles
delete_agent
Deletes an automation agent by its UID. Parameters:uid(string, required) — The unique identifier (UUID) of the agent to delete
list_webhooks
Lists all webhook subscriptions in your workspace. Parameters:limit(number, optional) — Maximum number of webhooks to returncursor(string, optional) — Pagination cursor from a previous request
create_webhook
Creates a new webhook subscription for specific events. Parameters:targetUrl(string, required) — URL to receive webhook deliveriesevents(string[], required) — List of event types to subscribe to
delete_webhook
Deletes a webhook subscription by its UID. Parameters:uid(string, required) — The unique identifier (UUID) of the webhook to delete
list_storage_configs
Lists all storage configurations in your workspace. Parameters:limit(number, optional) — Maximum number of storage configs to returncursor(string, optional) — Pagination cursor from a previous request
create_storage_config
Creates a new storage configuration (S3 or Google Cloud Storage). Parameters:name(string, required) — Name for the storage configurationprovider(string, required) — Storage provider type (s3orgcs)s3BucketName(string, optional) — S3 bucket names3BucketRegion(string, optional) — S3 bucket regions3BucketPrefix(string, optional) — S3 key prefixs3AccessKeyId(string, optional) — S3 access key ID (stored securely server-side)s3SecretAccessKey(string, optional) — S3 secret access key (stored securely server-side)s3IsAccelerated(boolean, optional) — Enable S3 Transfer AccelerationgcStorageBucketName(string, optional) — Google Cloud Storage bucket namegcStoragePrefix(string, optional) — Google Cloud Storage prefixgcStorageAuthJsonContent(string, optional) — GCS service account JSON credentials (stored securely server-side)
test_storage_config
Tests connectivity for a storage configuration. Parameters:uid(string, required) — The unique identifier (UUID) of the storage config to test
delete_storage_config
Deletes a storage configuration by its UID. Parameters:uid(string, required) — The unique identifier (UUID) of the storage config to delete
list_quality_targets
Lists quality targets configured for a specific project. Parameters:projectUid(string, required) — The unique identifier (UUID) of the projectlimit(number, optional) — Maximum number of quality targets to returncursor(string, optional) — Pagination cursor from a previous request
evaluate_quality
Evaluates all quality targets for a project and returns their current status. Parameters:projectUid(string, required) — The unique identifier (UUID) of the project to evaluate
get_consensus_summary
Gets a consensus summary for a project including mean/median scores and distribution. Parameters:projectUid(string, required) — The unique identifier (UUID) of the project
compute_consensus
Triggers consensus computation for a project. Parameters:projectUid(string, required) — The unique identifier (UUID) of the project
list_organizations
Lists all organizations you are a member of. Parameters:limit(number, optional) — Maximum number of organizations to returncursor(string, optional) — Pagination cursor from a previous request
get_organization
Gets detailed information about a specific organization. Parameters:slug(string, required) — The slug identifier of the organization
list_slices
Lists slices for an owner (user or organization). Parameters:owner(string, required) — Owner name (user or organization slug)limit(number, optional) — Maximum number of slices to returncursor(string, optional) — Pagination cursor from a previous request
get_slice
Gets detailed information about a specific slice. Parameters:owner(string, required) — Owner name (user or organization slug)slug(string, required) — The slug of the slice
list_annotation_issues_by_sequence
Lists all annotation issues for a specific sequence. Parameters:sequenceUid(string, required) — The UUID of the sequencedatasetItemUid(string, optional) — Filter by dataset item UUIDprojectUid(string, optional) — Filter by project UUID
create_annotation_issue
Creates a new annotation issue on a sequence. Parameters:sequenceUid(string, required) — The UUID of the sequencetoolUid(string, required) — UUID of the annotation toolproblemUid(string, required) — UUID of the problem typedatasetItemUid(string, optional) — Dataset item UUIDprojectUid(string, optional) — Project UUIDpriority(string, optional) — Priority level:lowest,low,medium,high,highestseverity(string, optional) — Severity level:critical,moderatedescription(string, optional) — Issue descriptionwrongClass(string, optional) — Incorrect class labelcorrectClass(string, optional) — Correct class labelobjectUid(string, optional) — UUID of the annotation objectshouldReAnnotate(boolean, optional) — Whether to re-annotateshouldDelete(boolean, optional) — Whether to delete the annotationframesAffected(string, optional) — Frames affected by the issue
update_annotation_issue
Updates an existing annotation issue (status, priority, etc.). Parameters:sequenceUid(string, required) — The UUID of the sequenceissueUid(string, required) — The UUID of the annotation issuestatus(string, optional) — Status:open,relabeling,in_review,completed,cant_reproduce,awaiting_feedback,no_action_takenpriority(string, optional) — Priority level:lowest,low,medium,high,highestseverity(string, optional) — Severity level:critical,moderatedescription(string, optional) — Updated descriptiontoolUid(string, optional) — UUID of the annotation toolproblemUid(string, optional) — UUID of the problem typewrongClass(string, optional) — Incorrect class labelframesAffected(string, optional) — Frames affected by the issue
delete_annotation_issue
Deletes an annotation issue. Parameters:sequenceUid(string, required) — The UUID of the sequenceissueUid(string, required) — The UUID of the annotation issue to delete
list_annotation_issues_by_dataset
Lists all annotation issues for a dataset. Parameters:owner(string, required) — Dataset owner usernamedatasetSlug(string, required) — Dataset slugsequenceUid(string, optional) — Filter by sequence UUID
get_annotation_issue_metrics
Gets aggregated metrics for annotation issues in a dataset (status/priority/severity counts, close times). Parameters:owner(string, required) — Dataset owner usernamedatasetSlug(string, required) — Dataset slugsequenceUid(string, optional) — Filter by sequence UUID
list_qc_tools
Lists available QC annotation tools for a given dataset type. Parameters:datasetType(string, required) — The dataset type (e.g.,lidar,image,video)
fleet_list_devices
Lists fleet devices with optional filters. Parameters:status(string, optional) — Filter by device status (online,offline,maintenance)type(string, optional) — Filter by device typelimit(number, optional) — Maximum number of devices to returncursor(string, optional) — Pagination cursor
fleet_get_device
Gets detailed information about a specific fleet device. Parameters:uid(string, required) — The unique identifier of the device
fleet_list_recordings
Lists fleet recordings with optional filters. Parameters:device(string, optional) — Filter by device UIDstatus(string, optional) — Filter by recording statuslimit(number, optional) — Maximum number of recordings to returncursor(string, optional) — Pagination cursor
fleet_get_recording
Gets detailed information about a specific recording. Parameters:uid(string, required) — The unique identifier of the recording
fleet_list_events
Lists fleet events with optional filters. Parameters:recording(string, optional) — Filter by recording UIDdevice(string, optional) — Filter by device UIDtype(string, optional) — Filter by event typeseverity(string, optional) — Filter by severitylimit(number, optional) — Maximum number of events to returncursor(string, optional) — Pagination cursor
fleet_list_alerts
Lists fleet alerts with optional filters. Parameters:status(string, optional) — Filter by alert status (open,acknowledged,resolved)severity(string, optional) — Filter by severity (info,warning,error,critical)device(string, optional) — Filter by device UIDrule(string, optional) — Filter by rule UIDlimit(number, optional) — Maximum number of alerts to returncursor(string, optional) — Pagination cursor
fleet_list_rules
Lists fleet rules with optional filters. Parameters:enabled(boolean, optional) — Filter by enabled statuslimit(number, optional) — Maximum number of rules to returncursor(string, optional) — Pagination cursor
fleet_register_device
Registers a new fleet device. Parameters:name(string, required) — Name of the devicetype(string, required) — Type of the devicefirmwareVersion(string, optional) — Firmware versiontags(string[], optional) — Tags for the device
fleet_acknowledge_alert
Acknowledges a fleet alert. Parameters:uid(string, required) — The unique identifier of the alert to acknowledge
Recipes
Multi-step workflows you can run through natural language. Each recipe shows the tool calls the assistant makes behind the scenes.Recipe 1: Dataset health check
Ask your assistant: “Give me a health check on my workspace — how many datasets do I have, and which ones have the most items?” Step 1 — The assistant callsget_workspace_stats to get the overview.
list_datasets with limit: 50 to fetch all datasets.
Step 3 — The assistant sorts the results by itemCount and presents a ranked summary:
You have 14 datasets. The three largest are:
- Warehouse Cameras — 34,200 items (image)
- Urban Driving Q1 — 12,450 items (lidar)
- Parking Lot Footage — 8,900 items (video)
Recipe 2: Export and download
Ask your assistant: “Export the Urban Driving Q1 project and let me know when it’s ready.” Step 1 — The assistant callslist_projects to find the project UID matching “Urban Driving Q1.”
Step 2 — The assistant calls create_export with the project UID.
get_export_status until the status changes to completed.
Your export is ready (50 MB). Download it here: https://api.avala.ai/exports/.../download
Recipe 3: Quality audit across projects
Ask your assistant: “Evaluate quality targets for all my projects and flag any that are failing.” Step 1 — The assistant callslist_projects to retrieve all projects.
Step 2 — For each project, the assistant calls evaluate_quality with the project UID.
Step 3 — The assistant aggregates the results and highlights failures:
5 of 7 projects are passing all quality targets. Two need attention:
- Sidewalk Segmentation — “Label accuracy” target at 88% (threshold: 95%)
- Fleet Camera Review — “Consensus score” target at 0.72 (threshold: 0.85)
Recipe 4: Fleet device monitoring
Ask your assistant: “Show me all fleet alerts that haven’t been acknowledged yet, grouped by severity.” Step 1 — The assistant callsfleet_list_alerts with status: "open".
Step 2 — The assistant groups and formats the response:
Critical (1)Step 3 — You can follow up: “Acknowledge all the warning-level alerts.” The assistant callsWarning (2)
- Dock Camera 3 — “Device offline for more than 24 hours” (since Mar 18)
- Forklift Sensor Unit 12 — “Device temperature exceeded threshold (72C)” (since Mar 19)
- Rooftop LiDAR 1 — “Low disk space (< 5%)” (since Mar 19)
fleet_acknowledge_alert for each warning alert UID.
Recipe 5: Annotation issue triage
Ask your assistant: “Get the annotation issue metrics for the urban-driving-q1 dataset and show me the breakdown.” Step 1 — The assistant callsget_annotation_issue_metrics with owner and dataset slug.
Step 2 — The assistant presents a formatted summary:
Urban Driving Q1 — Issue Metrics By status: 12 open, 5 in review, 3 relabeling, 45 completed By severity: 8 critical, 57 moderate By priority: 2 highest, 6 high, 18 medium, 25 low, 14 lowest Average close time: 4.2 hoursStep 3 — You follow up: “List the open critical issues.” The assistant calls
list_annotation_issues_by_dataset with filters and shows the results.
Example Prompts
Here are some natural-language prompts you can use with any MCP-compatible client:Troubleshooting
AVALA_API_KEY not set
The MCP server exits immediately with error code 1 if the AVALA_API_KEY environment variable is missing. Make sure the key is set in the env block of your MCP config or exported in your shell before launching the server.
Mutation tools not appearing
If tools likecreate_export, create_agent, or fleet_register_device are missing from the tool list, you need to set AVALA_MCP_ENABLE_MUTATIONS=true in the server environment. Add it to the env block in your MCP configuration file:
npx not found or wrong Node.js version
The MCP server requires Node.js 18 or later. If you see npx: command not found or module syntax errors, verify your Node.js version:
Stale cached MCP server
If you recently updated the@avala-ai/mcp-server package but still see old behavior or missing tools, npx may be serving a cached version. Force a fresh install:
API key invalid or expired
If tool calls return401 Unauthorized, your API key may be invalid, expired, or revoked. Generate a new key in Mission Control under Settings > Security and update your MCP configuration.