Configuration

This guide is for challenge organizers who want to set up and customize challenges on EvalAI using YAML configuration files. Each section below explains a part of the config with examples and common use cases.

Table of Contents

• Challenge Configuration
  • Challenge Metadata
  • Challenge Timeline
  • Challenge Settings
  • Tags
  • Evaluation Script
  • Leaderboard Configuration
• Challenge Phases Setup
  • Challenge Phase
  • Challenge Phase Splits
• Dataset Splits
• YAML Reference
• Editing Challenge Configuration
  • Editable Fields
  • How to Edit the fields
  • How to test the changes locally before submission

For evaluation setup and configuration, checkout the Evaluation section:

• Evaluation