You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It appears that InstructLab is utilizing only a single thread and minimal memory during the training process. I suspect this might be due to the limited VRAM available on my RTX 3060, despite having 64GB of system RAM and a powerful 12th Gen i7 CPU.
I have some questions:
Is single-threaded execution the default behavior for InstructLab, or is there a configuration setting I'm missing to enable multi-threading?
Are there any known workarounds or optimizations for running InstructLab with limited VRAM, especially when system RAM is abundant and a multi-core CPU is available?
Is there a way to leverage the available system RAM and CPU cores to compensate for the limited VRAM?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
-
'm experiencing extremely slow training times (multiple days) when running InstructLab with the following configuration:
How did I execute it?
It appears that InstructLab is utilizing only a single thread and minimal memory during the training process. I suspect this might be due to the limited VRAM available on my RTX 3060, despite having 64GB of system RAM and a powerful 12th Gen i7 CPU.
I have some questions:
Is single-threaded execution the default behavior for InstructLab, or is there a configuration setting I'm missing to enable multi-threading?
Are there any known workarounds or optimizations for running InstructLab with limited VRAM, especially when system RAM is abundant and a multi-core CPU is available?
Is there a way to leverage the available system RAM and CPU cores to compensate for the limited VRAM?
Additional Information:
Beta Was this translation helpful? Give feedback.
All reactions