infosave2007andClaude Opus 4.8 9242806795 docs: add task-type accuracy benchmark (router vs keyword heuristic) ...

- bench/tasks.jsonl (37 natural-language prompts, 7 task types) + bench/accuracy.py
- measured on the live allaigate router: 100% (37/37) vs keyword heuristic 32%
- BENCHMARKS.md accuracy section; README (EN+RU) perf+accuracy tables and test matrix
- run.sh runs accuracy when CORTIQ_ROUTER_KEY is set

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

2026-07-01 07:45:16 +03:00

..

accuracy.py

docs: add task-type accuracy benchmark (router vs keyword heuristic)

2026-07-01 07:45:16 +03:00

body.json

docs: add latency benchmark vs LiteLLM/Portkey

2026-06-30 18:11:26 +03:00

cortiq.bench.toml

docs: add latency benchmark vs LiteLLM/Portkey

2026-06-30 18:11:26 +03:00

mock.js

docs: add latency benchmark vs LiteLLM/Portkey

2026-06-30 18:11:26 +03:00

run.sh

docs: add task-type accuracy benchmark (router vs keyword heuristic)

2026-07-01 07:45:16 +03:00

tasks.jsonl

docs: add task-type accuracy benchmark (router vs keyword heuristic)

2026-07-01 07:45:16 +03:00