Back to feed
arXiv cs.CL·

SANA: What Matters for QA Agents over Massive Data Lakes?

Signal
72
Hype
18
In three linesSANA is a diagnostic ablation framework for evaluating QA agents over massive data lakes. It deconstructs end-to-end failures into four components: search, planning, data analysis, and action policy. Tested on LakeQA and KramaBench, it reveals data analysis as the primary bottleneck, while search is a major limitation mainly in large data-lake settings.
Read source
Your take?
AI AgentsEvalsBenchmarksRAG

Summary generated by Claude — human-verified