-
Notifications
You must be signed in to change notification settings - Fork 56
Closed
Labels
release-1.0Issues need to be address for release 1.0Issues need to be address for release 1.0
Description
It would be really useful as a dev contributor if you could quickly spin a model inference server.
Two approaches could be taken here:
-
ilab cli setup and ilab serve instructions - link to existing documentation here.
-
Docker contained service to expose port 8000 and 8001 just in case users have another server running on 8000.
Acceptance Criteria:
- Update https://github.com/instructlab/ui/blob/main/docs/development.md
- add Dockerfile and config.yaml example.
- Optional - push a instructlab serve container to dockerhub for easy running.
nerdalert
Metadata
Metadata
Assignees
Labels
release-1.0Issues need to be address for release 1.0Issues need to be address for release 1.0