CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts

An open source implementation of "Scaling Autoregressive Multi-Modal Models: Pretraining and Instruction Tuning", an all-new multi modal AI that uses just a decoder to generate both text and images