Fine-tuning

Building with Open Models
Talk covering how developers customize and deploy OpenAI’s open models.

DevDay — distillation breakout
DevDay session on model distillation techniques.

Model distillation overview
Overview of distillation techniques for creating efficient models.

Reinforcement fine-tuning overview
Guide on reinforcement learning-based fine-tuning techniques.

Supervised fine-tuning overview
Guide to supervised fine-tuning for customizing model behavior.

Vision fine-tuning overview
Guide to fine-tuning models on vision tasks.

Fine-tuning best practices
Recommendations for effective and efficient model fine-tuning.

Fine-tuning guide
Comprehensive guide to fine-tuning OpenAI models.

Exploring Model Graders for Reinforcement Fine-Tuning
Cookbook to use model graders for reinforcement fine-tuning in expert tasks.

Reinforcement Fine-Tuning for Conversational Reasoning with the OpenAI API
Cookbook for reinforcement fine-tuning conversational reasoning using HealthBench evaluations.

Leveraging model distillation to fine-tune a model
Cookbook to distill a larger model into a smaller fine-tuned model.