SANE Schema-aware Natural-language Evaluation of Biological Data

In three linesSANE introduces a schema-aware text-to-SQL evaluation paradigm for domain-specific biological data, using automatically generated benchmarks tied to real experimental structures. Few-shot LLMs achieve accurate query generation without fine-tuning when combined with schema-aware prompting; failures stem mainly from ambiguous inputs rather than SQL generation errors.

Summary generated by Claude — human-verified