Choose capability before price
Every model in API Compare shows its catalog-reported inputs, tool calling and structured-output capabilities next to price. These are interface requirements, not independently tested quality ratings. An absent catalog flag is unknown, not a measured failure. Image input means understanding images, not generating images.
Evaluation standards & original sources
Choose an evaluation that matches your task. The sources below are independent evaluation projects, not endorsements of TokenPico. These links explain the standards; they do not assert that every model in our catalog appears on each leaderboard.
Artificial Analysis Intelligence Index
General reasoning & knowledge
Composite of multiple evaluations. Compare the same index version and reasoning settings. Primarily English and text; it does not establish image, audio or multilingual quality.
Original methodology ↗ · Original results ↗
LiveBench
Reasoning, mathematics & instruction following
Uses objective ground-truth answers across multiple tasks. Check the benchmark release, category, model version and inference settings; releases are not interchangeable.
Original methodology ↗ · Original results ↗
LiveCodeBench
Code generation & problem solving
Evaluates code with execution tests and dated problem sets. Match the task, problem date range, sampling settings and pass@k; contest coding is not the same as maintaining an application.
Original methodology ↗ · Original results ↗
SWE-bench Verified
Software engineering agents
Reports the percentage of repository issues resolved. The model, agent harness, tools and budget together determine the result. Compare the same Verified subset and harness.
Original methodology ↗ · Original results ↗
How a score can enter this comparison
Require an exact model/version match, benchmark version or problem date range, reasoning settings, agent harness and tools where relevant, inference/token budget, score scale, result date, original source and permission to republish. Vendor-reported results and independent runs must be labeled separately. Never inherit a family score or mix different benchmark scales into an invented overall score.
Quality score: not imported means no authorized, configuration-matched result is attached here. It does not mean zero, poor quality or absent testing elsewhere. No quality sorting, price-per-score or best-model recommendations are enabled without comparable evidence.
Artificial Analysis provides a versioned methodology and a data API with attribution and licensing conditions. Public visibility alone is not republication permission. API attribution and licensing ↗
Source references checked October 25, 2026. Test releases and coverage can change; consult the original result before choosing a model. Validate shortlisted models on representative tasks of your own.