-
Notifications
You must be signed in to change notification settings - Fork 56
Description
Is your feature request related to a problem? Please describe.
Currently, our teacher model framework in SDG is limited in its support for third-party teacher models, which restricts our ability to leverage cutting-edge language models such as Llama. This limitation results in missed opportunities for generating more context-aware and high-quality educational content.
Describe the solution you'd like
Upgrade our system by integrating third-party teacher models, starting with the Llama model family. This solution involves updating instructlab to recognize and utilize Llama models(Llama-3.3-70B-Instruct), adding a dedicated Llama chat template to our prompt registry, and establishing new pipelines and configuration files tailored for Llama’s unique capabilities. The goal is to enhance overall knowledge generation by leveraging the advanced performance and context-awareness of these models.
Additional context