Hallacy/11 4 release (openai#54)

* Make embeddings_utils be importable (openai#104)

* Make embeddings_utils be importable

* Small tweaks to dicts for typing

* Remove default api_prefix and move v1 prefix to default api_base (openai#95)

* make construct_from key argument optional (openai#92)

* Split search.prepare_data into answers/classifications/search versions (openai#93)

* Break out prepare_data into answers, classifications, and search

* And cleaned up CLI

* Validate search files (openai#69)

* Add validators for search files

* Clean up fields

Co-authored-by: kennyhsu5 <[email protected]>
Co-authored-by: Madeleine Thompson <[email protected]>

Add necessary import (openai#51)

* Add necessary import

* version

[fine-tuning] accept file URLs as train & validation files (openai#50)

also a few fixes: setting the correct filename for file uploads using files.create, reinstating the progress meter for uploading files in conjunction with the fine-tuning endpoint, standardizing punctuation on FT help strings

Boris/embedding examples (openai#49)

* add Olympics Q&A fine-tuning tutorial notebooks

* fix batch calculation for very small datasets

* Add embeddings tutorial notebooks

Add embeddings endpoint (openai#85) (openai#36)

Search v2 functionality (openai#33)

* Add support for search_indices (openai#64)

* Add support for search_indices

* Updated with Schnurr's comments

* Add version to search (openai#65)

* Make search query required (openai#67)

Boris/examples and cli (openai#32)

* Add a codex backtranslation example to improve SQL queries (openai#58)

* Add a codex backtranslation example to improve SQL queries

* Boris update ft example (openai#57)

* update fine-tune example to show the new CLI outputs

* model specifiction for search (openai#60)

* Catch chunked encoding errors and retry (openai#63)

* Add batch suggestion logic to prepare_data for fine_tunes and custom Q&A answers logic (openai#62)

* Add batch suggestion logic to prepare_data for fine_tunes; add an example of how to create a rudimentary answers endpoint with a custom Q&A model

Co-authored-by: Madeleine Thompson <[email protected]>
Co-authored-by: hallacy <[email protected]>

Updates to prepare_data function (openai#29)

* update documentation links to point to the website

* Fix encoding

* Add rough time estimator based on historical stats

* Fix train_test split naming logic; add quiet mode for running inside scripts

* Add a finetuning step by step example for a classification use case.

* add classification params if train and valid set; add length_validator

removing timeout and engine from args (openai#50) (openai#28)

renaming snapshot to model (openai#27)

* rename snapshot to model in sdk (openai#48)

* updating version