Advancing Open-source Language Models with Mixed-Quality Data

OpenChat is dedicated to advancing and releasing open-source language models, fine-tuned with our C-RLFT technique, which is inspired by offline reinforcement learning. Our models learn from mixed-quality data without preference labels, delivering exceptional performance on par with ChatGPT, which we were the first to beat with only 7B parameter LLMs which can be run on a consumer GPU (e.g. RTX 3090).

💌Contact

Project Lead:

Guan Wang [imonenext@gmail.com]
Alpay Ariyak [alpay@ariyak.ai]

Sponsors:

Sen Song (Tsinghua University)
Yang Liu (Tsinghua University)
01.AI Company
RunPod