Skip to main content
POST
Prepare Evaluation

Authorizations

Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json
taskset
string
required
Required string length: 1 - 256
model
string
required
Required string length: 1 - 256
checkpoint
string
required
Required string length: 1 - 512
endpoint
string
required
Required string length: 1 - 2048
runtime_digest
string
required
Pattern: ^[a-f0-9]{64}$
harness_digest
string
required
Pattern: ^[a-f0-9]{64}$
sandbox_pool
string
default:""
Maximum string length: 48
Pattern: ^[a-f0-9]*$
agent
string
default:openhands
Pattern: ^[a-zA-Z0-9_-]{1,128}$
sandbox
string
default:docker
Pattern: ^(docker|e2b)$
repetitions
integer
default:1
Required range: 1 <= x <= 64
max_concurrent
integer
default:1
Required range: 1 <= x <= 256
timeout_seconds
integer
default:600
Required range: 1 <= x <= 86400

Response

Successful Response