ilab model test using a local directory (zip file from Google Colab) #1872
Unanswered
rushil-x-gupta
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I trained my model (default model,
merlinite-7b-lab-Q4_K_M) on Google Colab because I do not have enough VRAM on my local machine. However, downloading the training instructions resulted in the trained model being contained in a directory as opposed to a single.gguffile, which I believe is what it should be if I am to move on with testing my model in InstructLab. As a result, I downloaded the model as a zip file and extracted the contents.How should I move on from here? Has anyone else experienced this?
Beta Was this translation helpful? Give feedback.
All reactions