.jsonl
file where each line is a JSON object representing a single request. Each request must include a unique custom_id
(UUID recommended), a type
, a version
, and a body
with the model and input parameters.
Example:
.jsonl
file corresponds to a request, including the model, result, and token usage.
Example:
custom_id
to match input and output lines.'claude-3.7-sonnet'
'claude-3.5-sonnet'
'gemini-2.5-pro-exp'
'gemini-2.0-flash'
'gemma3:4b'
'gemma3:12b'
'gemma3:27b'
'gpt-4o-mini'
'gpt-4o'
'llama3.3:70b-instruct-q4_K_M'
'llama3.1:8b-instruct-q4_K_M'
'llama3.2:1b-instruct-q4_K_M'
'mixtral-nemo:12b'
.jsonl
files.jsonl
file after processing.