AmchiBias: Measuring Stereotypical Bias in Goan Identity Groups with a Minimal Pair Dataset in English and Konkani

In three linesAmchiBias is a benchmark measuring socio-cultural stereotypical bias for India's Goa state in English and Devanagari Konkani. 313 minimal pairs span 8 demographic dimensions. Evaluation of 5 multilingual models shows near-chance scores in Konkani and higher bias for pan-Indian groups than hyperlocal Goan communities.

Summary generated by Claude — human-verified