TechFlow news: Microsoft has announced the open-sourcing of Deep Speed Chat, a tool designed to help users train ChatGPT-like large language models, enabling everyone to build their own ChatGPT.
Deep Speed Chat is built upon Microsoft's Deep Speed deep learning optimization library. It supports training, reinforcement inference, and employs RLHF (Reinforcement Learning with Human Feedback) technology, accelerating training speed by over 15 times compared to existing systems while significantly reducing costs. For example, a ChatGPT-like model with 13 billion parameters can be trained in just 1.25 hours.
Add to Favorites
Share to Social Media
