SocialMemBench: Are AI Memory Systems Ready for Social Group Settings?

In three linesSocialMemBench benchmarks AI memory systems in multi-party social groups (430 personas, 7,355 conversation turns, 1,031 QA pairs). Gemini 2.5 Flash reaches 0.721 on small networks vs 0.98 expected. Four open-source frameworks (Mem0, LangMem, Graphiti, Cognee) score 0.12-0.18, well below references (0.345-0.369), revealing a measurable gap.

Summary generated by Claude — human-verified