Skip to content

bpo-35267: warning deadlock in multiprocessing.Pool#11143

Closed
Windsooon wants to merge 1 commit intopython:masterfrom
Windsooon:bpo-35267
Closed

bpo-35267: warning deadlock in multiprocessing.Pool#11143
Windsooon wants to merge 1 commit intopython:masterfrom
Windsooon:bpo-35267

Conversation

@Windsooon
Copy link
Contributor

@Windsooon Windsooon commented Dec 13, 2018

@ZackerySpytz
Copy link
Contributor

The issue number is wrong.

@Windsooon Windsooon changed the title bpo-35367: warning deadlock in multiprocessing.Pool bpo-35267: warning deadlock in multiprocessing.Pool Dec 13, 2018
@Windsooon
Copy link
Contributor Author

Thank you @ZackerySpytz, I updated it.

@ZackerySpytz
Copy link
Contributor

Not quite. Please also fix the commit message and the link in the first post.

Copy link
Member

@vstinner vstinner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would prefer to see the issue fixed rather than documented.

@bedevere-bot
Copy link

A Python core developer has requested some changes be made to your pull request before we can consider merging it. If you could please address their requests along with any other requests in other reviews from core developers that would be appreciated.

Once you have made the requested changes, please leave a comment on this pull request containing the phrase I have made the requested changes; please review again. I will then notify any core developers who have left a review that you're ready for them to take another look at this pull request.

@Windsooon
Copy link
Contributor Author

@vstinner any ideas to fix it?

@vstinner
Copy link
Member

@vstinner any ideas to fix it?

Sorry, I have no idea.

@Windsooon
Copy link
Contributor Author

I don't know how to fix it. As Nathaniel J. Smith said:

you might be thinking of PIPE_BUF, which POSIX says has to be >= 512 bytes, and on linux is 4096 bytes. This a magic number where if you send < PIPE_BUF bytes in a single write, then the kernel isn't allowed to break it up into pieces. This means that if you have a non-blocking pipe, then select can only report it as being writable if it as at least PIPE_BUF bytes of free space available.

Some new ideas are needed.

@csabella csabella requested a review from pitrou June 5, 2019 23:33
@JulienPalard
Copy link
Member

As said here by Victor and in b.p.o by Davin, there may be a fix, so we better work on fixing it than documenting the bug.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

awaiting changes docs Documentation in the Doc dir

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants