README: add example for using local model wtth docker container #528
Conversation
There was a problem hiding this comment.
PR Summary
Added a new section to the README.md demonstrating how to use local models with Docker containers, providing clear instructions for mounting and utilizing locally stored models in the Infinity framework.
- Added example in
README.mdshowing how to clone and mount HuggingFace models into Docker containers - Included command-line example for mounting local model directory using Docker volumes
- Added explanation for using local models with the
--model-idparameter
1 file(s) reviewed, no comment(s)
Edit PR Review Bot Settings | Greptile
There was a problem hiding this comment.
Requires ‘git install git-lfs’ otherwise git clone won’t clone large files.
There was a problem hiding this comment.
Good point. git lfs install ? https://git-lfs.com/
|
Codecov ReportAll modified and coverable lines are covered by tests ✅
❗ Your organization needs to install the Codecov GitHub app to enable full functionality. Additional details and impacted files@@ Coverage Diff @@
## main #528 +/- ##
==========================================
- Coverage 79.86% 79.80% -0.06%
==========================================
Files 43 43
Lines 3486 3486
==========================================
- Hits 2784 2782 -2
- Misses 702 704 +2 ☔ View full report in Codecov by Sentry. |
This question came up a few times already.
#527
Checklist