Benchmark · results pending

Same research tasks. Deep research tools, research APIs and this pipeline.

I'm running the same research tasks through deep research from Claude, ChatGPT, Gemini and Grok, through research and enrichment tools such as Parallel, Exa and Clay, and through this pipeline. The results go here, with the full method behind them.

Why measure first. An earlier research product I built produced reports clients liked, but $100 per report was too much when ChatGPT covered about half of it.

Results pending. No numbers have been measured yet.

Benchmark of deep research tools, research APIs and this pipeline, results pending
Deep researchResearch and enrichment
Compared onClaudeChatGPTGeminiGrokParallelExaClayThis pipeline
Qualityhow many values are rightPendingPendingPendingPendingPendingPendingPendingPending
Coveragerows found for the taskPendingPendingPendingPendingPendingPendingPendingPending
Speedtime per rowPendingPendingPendingPendingPendingPendingPendingPending
Costcost per rowPendingPendingPendingPendingPendingPendingPendingPending

Published withtask definitions, comparison setup, model versions, evaluation method, sources and limitations. As HTML tables, JSON and CSV.

More tools may be added before publishing. Costs and timings are shown only where measured and comparable.

Get the results by email.

Only updates and important emails. No slop.