Welcome to EvalAI’s documentation!

EvalAI is an open source platform for evaluating and comparing machine learning (ML) and artificial intelligence algorithms (AI) at scale.

It is built to provide a scalable solution to the research community to fulfill the critical need of evaluating machine learning models and agents acting in an environment against annotations or with a human-in-the-loop.

Contents:

• Getting Started
  • Introduction
  • Installation
  • Setup
  • Pricing
• For Challenge Hosts
  • Hosting Guide
  • Configuration
  • Evaluation
  • Templates
• For Participants
  • Participants Guide
  • Submissions
  • CLI Tools
  • Visibility
• Development
  • Architecture
  • Contributing
  • Deployment
  • Maintenance
• API Reference
  • Authentication
  • Endpoints
  • CLI Reference
  • Webhooks
• Examples Tutorials
  • Host Examples
  • Participants Examples
  • Integration Examples
• Troubleshooting
  • Common Issues
  • Error Codes
  • Support
• References
  • Glossary
  • Cite
  • Changelog
  • Roadmap
  • Configuration Reference
  • Legal

Indices and tables

• Index

• Module Index

• Search Page