CryptoAnalystBench logo

CryptoAnalystBench

Open-source benchmark and evaluation harness for long-form crypto and Web3 AI-agent responses.
Category: Developer Tooling

Description

CryptoAnalystBench evaluates AI-generated crypto and DeFi analysis with an LLM judge across relevance, temporal relevance, depth, and data consistency. It contains 198 production queries across 11 categories, an agentic evaluation harness, citation and hallucination checks, annotated queries, judge rubrics, and a seven-part error taxonomy.