Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Replace stream= with comm= in handlers - #3860

Merged
mrocklin merged 3 commits into
dask:masterfrom
jjerphan:rename_stream_to_comm
Jun 11, 2020
Merged

Replace stream= with comm= in handlers#3860
mrocklin merged 3 commits into
dask:masterfrom
jjerphan:rename_stream_to_comm

Conversation

@jjerphan

@jjerphan jjerphan commented Jun 8, 2020

Copy link
Copy Markdown
Contributor

Fixes #3824.

@quasiben

quasiben commented Jun 9, 2020

Copy link
Copy Markdown
Member

Thanks for doing this @jjerphan . What do you think about things like:

def get_stream_address(stream):

def set_tcp_timeout(stream):

I found those by doing:

git grep 'stream)'

@mrocklin mrocklin left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are also a couple of times when we are overly aggressive about this change :)

Thanks for doing this @jjerphan

Comment thread distributed/comm/ucx.py Outdated
stream.synchronize()
cu_stream = numba.cuda.driver.drvapi.cu_stream(comm)
comm = numba.cuda.driver.Stream(ctx, cu_stream, None)
comm.synchronize()

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is actually a different kind of stream (CUDA streams rather than Dask streams) and we should probably leave it as is.

Comment thread distributed/comm/tcp.py Outdated
if not comm.closed():
logger.warning("Closing dangling stream in %s" % (r,))
stream.close()
comm.close()

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is actually a different kind of stream (Torando IOStream rather than Dask stream) and we should probably leave it as-is.

@jjerphan

Copy link
Copy Markdown
Contributor Author

Hum, I am trying to understand the failing test on the Travis CI build: it does not fail for me (it is skipped when running it locally).

@mrocklin

Copy link
Copy Markdown
Member

Yeah, that isn't your fault. I don't know what happened, but that test has become flaky recently, and only on Python 3.6. I'm going to go ahead and skip it for now. It's a very peripheral feature.

See #3888

@mrocklin

Copy link
Copy Markdown
Member

My apologies for the testing uncleanliness . Thank you for your patience with it.

@mrocklin
mrocklin merged commit 7ce0df0 into dask:master Jun 11, 2020
@mrocklin

Copy link
Copy Markdown
Member

I'm merging this in. Thank you for your work here @jjerphan !

Also, I notice that this is your first code contribution to this repository. Welcome!

@jjerphan

jjerphan commented Jun 11, 2020

Copy link
Copy Markdown
Contributor Author

My apologies for the testing uncleanliness

It really is fine: don't worry. :)
Thanks for the review!

@jjerphan

Copy link
Copy Markdown
Contributor Author

In fact, I once studied a problem between in the DaskBackendConnector but I have not been able fixed it. joblib#914 did however!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Replace stream= with comm= in handlers

3 participants