An unofficial implementation of "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

Retrieval and Retrieval-augmented LLMs

Unify Efficient Fine-tuning of 100+ LLMs

🌟 The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo

The official GitHub page for the survey paper "A Survey of Large Language Models".

Meta-Transformer for Unified Multimodal Learning

DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection and Instruction-Aware Models for Conversational AI

🩹Editing large language models within 10 seconds⚡

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

Text-to-video generation. The repo for ICLR2023 paper "CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformers"

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference,…

mPLUG-Owl🦉: Modularization Empowers Large Language Models with Multimodality

Chinese safety prompts for evaluating and improving the safety of LLMs. 中文安全prompts，用于评估和提升大模型的安全性。

Personal website

An open-source tool-augmented conversational language model from Fudan University

Large Language-and-Vision Assistant built towards multimodal GPT-4 level capabilities.

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

Taming Transformers for High-Resolution Image Synthesis