Create Benchmark Run | Apologist AI

Executes a benchmark run and returns the aggregated result with nested evaluators, questions, and a flat evaluations array.

x-api-keystring

API key for authentication

AuthorizationBearer

Bearer token authentication

idstringRequired

The id or key of the benchmark

This endpoint expects an object.

contentstring or list of anyOptional

Content to evaluate. Required when source_id is supplied.

completion_idstring or nullOptional

Completion UUID whose stored response should be evaluated.

source_idinteger or nullOptional>=1

modelstring or nullOptional1-100 characters

num_responsesinteger or nullOptional1-10

use_question_variantsboolean or nullOptional

reasoning_effortenum or nullOptional

verbosityenum or nullOptional

score_thresholddouble or nullOptional

value_thresholddouble or nullOptional

temperaturedouble or nullOptional

top_pdouble or nullOptional

frequency_penaltydouble or nullOptional

presence_penaltydouble or nullOptional

Benchmark run result

403

Forbidden Error

404

Not Found Error

422

Unprocessable Entity Error

500

Internal Server Error

503

Service Unavailable Error

1	import { ApologistAgentClient } from "apologist";
2
3	async function main() {
4	const client = new ApologistAgentClient({
5	apiKey: "YOUR_API_KEY_HERE",
6	});
7	await client.benchmarks.runBenchmark("id", {});
8	}
9	main();