m3BERT: A Modern, Multi-lingual, Matryoshka Bidirectional Encoder

In three linesm3BERT is a multilingual embedding model using a Matryoshka strategy to jointly optimize representations across transformer layers and multiple embedding dimensions. Three-stage pretraining (monolingual, multilingual, web domain) outperforms existing models on Bing-Click and adapts to varying resource constraints.

Summary generated by Claude — human-verified