-
-
Couldn't load subscription status.
- Fork 1.4k
Labels
p3-enhancement 🔥Much new such featureMuch new such featuresubmodule ⊂Periphery/subclassesPeriphery/subclassessynchronisation ⇶Multi-thread/processingMulti-thread/processingto-merge ↰ImminentImminent
Milestone
Description
Dask itself has a basic progressbar, but tqdm is certainly better - so I made a basic wrapper:
from dask.callbacks import Callback
class ProgressBar(Callback):
def _start_state(self, dsk, state):
self._tqdm = tqdm_notebook(total=sum(len(state[k]) for k in ['ready', 'waiting', 'running', 'finished']))
def _posttask(self, key, result, dsk, state, worker_id):
self._tqdm.update(1)
def _finish(self, dsk, state, errored):
passUsage (the same as dask progressbar):
with ProgressBar():
... .compute()Does it belong to tqdm, what to you think? Also, any further suggestions/improvements?
bphi, thomasaarholt, rrmistry, pachocamacho1990 and leshaker
Metadata
Metadata
Assignees
Labels
p3-enhancement 🔥Much new such featureMuch new such featuresubmodule ⊂Periphery/subclassesPeriphery/subclassessynchronisation ⇶Multi-thread/processingMulti-thread/processingto-merge ↰ImminentImminent