Description Implementation of "Efficient Training of Language Models to Fill in the Middle" (ref.: https://arxiv.org/abs/2207.14255) Based on: https://medium.com/@rajabmondal97/pretraining-extending-pretraining-of-autoregressive-model-using-the-fill-in-the-middle-objective-cc04c8f01d77 Run python ./fim.py ""