Efficient training of language models to fill in the middle
OpenAI presents an efficient training method for language models capable of filling in text in the middle of sequences. The technique reduces computational costs while maintaining performance on standard tasks.