AMNESIA: A Large Scale Medical Unlearning Benchmark Suite with Disease-Informed Analysis

In three linesAMNESIA is the first large-scale open-source benchmark for machine unlearning in medical LLMs. It contains 70,560 question-answer pairs from 8,820 patient notes across 11 disease categories. The authors evaluate 4 unlearning methods and show that forgetting individual patients erodes knowledge of others with the same condition.

Summary generated by Claude — human-verified