➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author pitrou
Recipients bquinlan, pitrou, tbrink
Date 2011-06-05.13:14:44
SpamBayes Score 2.3376783e-06
Marked as misclassified No
Message-id <1307279744.72.0.238869941318.issue11271@psf.upfronthosting.co.za>
In-reply-to
Content 
Using your test script fixed (on Python 3.3), I get the following numbers:

Starting multiproc...done in 2.1014609336853027 s.
Starting futures...done in 20.209479093551636 s.
Starting futures "fixed"...done in 2.026125907897949 s.

So there's a 0.2ms overhead per remote function call here (20/(100100000-100000000)).

Can't your chunks() function use itertools.islice()?

Also, the chunksize can't be anything else than 1 by default, since your approach is increasing latency of returning results.
History
Date User Action Args
2011-06-05 13:15:44pitrousetrecipients: + pitrou, bquinlan, tbrink
2011-06-05 13:15:44pitrousetmessageid: <1307279744.72.0.238869941318.issue11271@psf.upfronthosting.co.za>
2011-06-05 13:14:44pitroulinkissue11271 messages
2011-06-05 13:14:44pitroucreate