| Server IP : 61.19.30.66 / Your IP : 216.73.216.15 Web Server : Apache/2.2.22 (Ubuntu) System : Linux klw 3.11.0-15-generic #25~precise1-Ubuntu SMP Thu Jan 30 17:39:31 UTC 2014 x86_64 User : www-data ( 33) PHP Version : 5.3.10-1ubuntu3.48 Disable Function : pcntl_alarm,pcntl_fork,pcntl_waitpid,pcntl_wait,pcntl_wifexited,pcntl_wifstopped,pcntl_wifsignaled,pcntl_wexitstatus,pcntl_wtermsig,pcntl_wstopsig,pcntl_signal,pcntl_signal_dispatch,pcntl_get_last_error,pcntl_strerror,pcntl_sigprocmask,pcntl_sigwaitinfo,pcntl_sigtimedwait,pcntl_exec,pcntl_getpriority,pcntl_setpriority, MySQL : ON | cURL : OFF | WGET : ON | Perl : ON | Python : ON | Sudo : ON | Pkexec : OFF Directory : /usr/lib/python2.7/multiprocessing/ |
Upload File : |
ó
—|_c @ s8 d g Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z m Z m Z d d l
m Z m Z d Z
d Z d Z e j ƒ Z d „ Z e f e d „ Z d e f d
„ ƒ YZ d e f d „ ƒ YZ d
e f d „ ƒ YZ d e f d „ ƒ YZ d e f d „ ƒ YZ d e f d „ ƒ YZ d S( t PooliÿÿÿÿN( t Processt cpu_countt TimeoutError( t Finalizet debugi i i c C s
t | ΠS( N( t map( t args( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt mapstar@ s c
C s} | d k s0 t | ƒ t k r* | d k s0 t ‚ | j } | j } t | d ƒ rn | j j ƒ | j j ƒ n | d k r‡ | | Œ n d } xÛ | d k s® | rj| | k rjy
| ƒ } Wn" t
t f k
rß t d ƒ Pn X| d k rú t d ƒ Pn | \ } }
} } }
y t
| | |
Ž f } Wn t k
rI} t | f } n X| | |
| f ƒ | d 7} q Wt d | ƒ d S( Ni t _writers) worker got EOFError or IOError -- exitings worker got sentinel -- exitingi s worker exiting after %d tasks( t Nonet typet intt AssertionErrort putt gett hasattrR t closet _readert EOFErrort IOErrorR t Truet Exceptiont False( t inqueuet outqueuet initializert initargst maxtasksR R t completedt taskt jobt it funcR t kwdst resultt e( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt workerG s4 0
!
c B s e Z d Z e Z d d d d d „ Z d „ Z d „ Z d „ Z d „ Z d i d „ Z
d d „ Z d d „ Z d d
„ Z
d i d d „ Z d d d „ Z e d
„ ƒ Z e d „ ƒ Z e d „ ƒ Z e d „ ƒ Z d „ Z d „ Z d „ Z d „ Z e d „ ƒ Z e d „ ƒ Z RS( sH
Class which supports an async version of the `apply()` builtin
c
C s) | j ƒ t j ƒ | _ i | _ t | _ | | _ | | _ | | _ | d k r| y
t
ƒ } Wq| t k
rx d } q| Xn | d k r— t d ƒ ‚ n | d k r t
| d ƒ r t d ƒ ‚ n | | _ g | _ | j ƒ t j d t j d | f ƒ | _ t | j _ t | j _ | j j ƒ t j d t j d | j | j | j | j f ƒ | _ t | j _ t | j _ | j j ƒ t j d t j d | j | j | j f ƒ | _ t | j _ t | j _ | j j ƒ t! | | j" d | j | j# | j | j | j | j | j | j f d d ƒ| _$ d S( Ni s& Number of processes must be at least 1t __call__s initializer must be a callablet targetR t exitpriorityi (% t
_setup_queuest Queuet
_taskqueuet _cachet RUNt _statet _maxtasksperchildt _initializert _initargsR
R t NotImplementedErrort
ValueErrorR t TypeErrort
_processest _poolt _repopulate_poolt threadingt ThreadR t _handle_workerst _worker_handlerR t daemont startt
_handle_taskst
_quick_putt _outqueuet
_task_handlert _handle_resultst
_quick_gett _result_handlerR t _terminate_poolt _inqueuet
_terminate( t selft processesR R t maxtasksperchild( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt __init__q sV
$
c C sw t } xj t t t | j ƒ ƒ ƒ D]M } | j | } | j d k r" t d | ƒ | j ƒ t } | j | =q" q" W| S( s Cleanup after any worker processes which have exited due to reaching
their specified lifetime. Returns True if any workers were cleaned up.
s cleaning up worker %dN(
R t reversedt ranget lenR6 t exitcodeR
R t joinR ( RH t cleanedR R% ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt _join_exited_workers« s "
c
C s¦ xŸ t | j t | j ƒ ƒ D] } | j d t d | j | j | j | j | j
f ƒ } | j j | ƒ | j j
d d ƒ | _ t | _ | j ƒ t d ƒ q Wd S( s€ Bring the number of pool processes up to the specified number,
for use after reaping workers which have exited.
R' R R t
PoolWorkers added workerN( RM R5 RN R6 R R% RF R@ R0 R1 R/ t appendt namet replaceR R< R= R ( RH R t w( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR7 º s #
c C s | j ƒ r | j ƒ n d S( sE Clean up any exited workers and start replacements for them.
N( RR R7 ( RH ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt _maintain_poolÊ s c C sP d d l m } | ƒ | _ | ƒ | _ | j j j | _ | j j j | _ d S( Ni ( t SimpleQueue(
t queuesRY RF R@ R t sendR? R t recvRC ( RH RY ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR) Ð s
c C s. | j t k s t ‚ | j | | | ƒ j ƒ S( s1
Equivalent of `apply()` builtin
( R. R- R
t apply_asyncR ( RH R! R R" ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt apply× s c C s. | j t k s t ‚ | j | | | ƒ j ƒ S( s/
Equivalent of `map()` builtin
( R. R- R
t map_asyncR ( RH R! t iterablet chunksize( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR Þ s i c sÝ | j t k s t ‚ | d k rf t | j ƒ ‰ | j j ‡ ‡ f d † t | ƒ Dƒ ˆ j f ƒ ˆ S| d k sx t ‚ t j
ˆ | | ƒ } t | j ƒ ‰ | j j ‡ f d † t | ƒ Dƒ ˆ j f ƒ d „ ˆ Dƒ Sd S( sZ
Equivalent of `itertools.imap()` -- can be MUCH slower than `Pool.map()`
i c 3 s0 | ]& \ } } ˆ j | ˆ | f i f Vq d S( N( t _job( t .0R t x( R# R! ( s* /usr/lib/python2.7/multiprocessing/pool.pys <genexpr>ì s c 3 s0 | ]& \ } } ˆ j | t | f i f Vq d S( N( Rb R ( Rc R Rd ( R# ( s* /usr/lib/python2.7/multiprocessing/pool.pys <genexpr>ó s c s s" | ] } | D] } | Vq
q d S( N( ( Rc t chunkt item( ( s* /usr/lib/python2.7/multiprocessing/pool.pys <genexpr>õ s N( R. R- R
t IMapIteratorR, R+ R t enumeratet _set_lengthR t
_get_tasks( RH R! R` Ra t task_batches( ( R# R! s* /usr/lib/python2.7/multiprocessing/pool.pyt imapå s c sÝ | j t k s t ‚ | d k rf t | j ƒ ‰ | j j ‡ ‡ f d † t | ƒ Dƒ ˆ j f ƒ ˆ S| d k sx t ‚ t j
ˆ | | ƒ } t | j ƒ ‰ | j j ‡ f d † t | ƒ Dƒ ˆ j f ƒ d „ ˆ Dƒ Sd S( sK
Like `imap()` method but ordering of results is arbitrary
i c 3 s0 | ]& \ } } ˆ j | ˆ | f i f Vq d S( N( Rb ( Rc R Rd ( R# R! ( s* /usr/lib/python2.7/multiprocessing/pool.pys <genexpr>þ s c 3 s0 | ]& \ } } ˆ j | t | f i f Vq d S( N( Rb R ( Rc R Rd ( R# ( s* /usr/lib/python2.7/multiprocessing/pool.pys <genexpr> s c s s" | ] } | D] } | Vq
q d S( N( ( Rc Re Rf ( ( s* /usr/lib/python2.7/multiprocessing/pool.pys <genexpr> s N( R. R- R
t IMapUnorderedIteratorR, R+ R Rh Ri R Rj ( RH R! R` Ra Rk ( ( R# R! s* /usr/lib/python2.7/multiprocessing/pool.pyt imap_unordered÷ s c C sV | j t k s t ‚ t | j | ƒ } | j j | j d | | | f g d f ƒ | S( s>
Asynchronous equivalent of `apply()` builtin
N( R. R- R
t ApplyResultR, R+ R Rb R
( RH R! R R" t callbackR# ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR] s +c sû | j t k s t ‚ t | d ƒ s3 t | ƒ } n | d k r} t t | ƒ t | j ƒ d ƒ \ } } | r} | d 7} q} n t | ƒ d k r˜ d } n t j
| | | ƒ } t | j | t | ƒ | ƒ ‰ | j
j ‡ f d † t | ƒ Dƒ d f ƒ ˆ S( s<
Asynchronous equivalent of `map()` builtin
t __len__i i i c 3 s0 | ]& \ } } ˆ j | t | f i f Vq d S( N( Rb R ( Rc R Rd ( R# ( s* /usr/lib/python2.7/multiprocessing/pool.pys <genexpr># s N( R. R- R
R t listR
t divmodRN R6 R Rj t MapResultR, R+ R Rh ( RH R! R` Ra Rp t extraRk ( ( R# s* /usr/lib/python2.7/multiprocessing/pool.pyR_ s ( c C so t j ƒ } xB | j t k s6 | j rP | j t k rP | j ƒ t j d ƒ q W| j j
d ƒ t d ƒ d S( Ngš™™™™™¹?s worker handler exiting(
R8 t current_threadR. R- R, t TERMINATERX t timet sleepR+ R R
R ( t poolt thread( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR: ' s *
c
C s1 t j ƒ } x¶ t | j d ƒ D]˜ \ } } d } x‚ t | ƒ D]P \ } } | j ra t d ƒ Pn y | | ƒ Wq> t k
r t d ƒ Pq> Xq> W| r t d ƒ | | d ƒ q q Pq Wt d ƒ y@ t d ƒ | j d ƒ t d ƒ x | D] } | d ƒ qð WWn t k
r"t d ƒ n Xt d
ƒ d S( Niÿÿÿÿs' task handler found thread._state != RUNs could not put task on queues doing set_length()i s task handler got sentinels/ task handler sending sentinel to result handlers( task handler sending sentinel to workerss/ task handler got IOError when sending sentinelss task handler exiting(
R8 Rv t iterR R
Rh R. R R R (
t taskqueueR R Rz R{ t taskseqt
set_lengthR R t p( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR> 4 s6
c C sò t j ƒ } x¶ y
| ƒ } Wn" t t f k
r@ t d ƒ d SX| j rm | j t k s_ t ‚ t d ƒ Pn | d k r‡ t d ƒ Pn | \ } } } y | | j | | ƒ Wq t
k
rÁ q Xq x¢ | ri| j t k riy
| ƒ } Wn" t t f k
rt d ƒ d SX| d k r+t d ƒ qÈ n | \ } } } y | | j | | ƒ WqÈ t
k
reqÈ XqÈ Wt | d ƒ rÕt d ƒ y5 x. t d ƒ D] } | j
j ƒ s¬Pn | ƒ q“WWqÕt t f k
rÑqÕXn t d t | ƒ | j ƒ d S( Ns. result handler got EOFError/IOError -- exitings, result handler found thread._state=TERMINATEs result handler got sentinels& result handler ignoring extra sentinelR s" ensuring that outqueue is not fulli
s7 result handler exiting: len(cache)=%s, thread._state=%s( R8 Rv R R R R. Rw R
R
t _sett KeyErrorR RM R t pollRN ( R R t cacheR{ R R R t obj( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRB [ sX
c c sC t | ƒ } x0 t t j | | ƒ ƒ } | s1 d S| | f Vq d S( N( R| t tuplet itertoolst islice( R! t itt sizeRd ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRj • s c C s t d ƒ ‚ d S( Ns: pool objects cannot be passed between processes or pickled( R2 ( RH ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt
__reduce__ž s c C s5 t d ƒ | j t k r1 t | _ t | j _ n d S( Ns closing pool( R R. R- t CLOSER; ( RH ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR £ s
c C s- t d ƒ t | _ t | j _ | j ƒ d S( Ns terminating pool( R Rw R. R; RG ( RH ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt terminate© s
c C sn t d ƒ | j t t f k s% t ‚ | j j ƒ | j j ƒ | j j ƒ x | j D] } | j ƒ qV Wd S( Ns joining pool(
R R. RΠRw R
R; RP RA RD R6 ( RH R€ ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRP ¯ s
c C sW t d ƒ | j j ƒ x9 | j ƒ rR | j j ƒ rR | j j ƒ t j d ƒ q Wd S( Ns7 removing tasks from inqueue until task handler finishedi ( R t _rlockt acquiret is_aliveR Rƒ R\ Rx Ry ( R t task_handlerRŠ ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt _help_stuff_finish¸ s
c
C ss t d ƒ t | _ t | _ t d ƒ | j | | t | ƒ ƒ | j ƒ sc t | ƒ d k sc t ‚ t | _ | j d ƒ t d ƒ | j ƒ | rà t
| d d ƒ rà t d ƒ x- | D]" } | j d k r· | j ƒ q· q· Wn t d ƒ | j d ƒ t d ƒ | j d ƒ | rot
| d d ƒ rot d
ƒ x; | D]0 } | j ƒ r8t d | j
ƒ | j ƒ q8q8Wn d S( Ns finalizing pools& helping task handler/workers to finishi s joining worker handlerR s terminating workerss joining task handlerg}Ô%I²Ts joining result handlers joining pool workerss cleaning up worker %d( R Rw R. R’ RN R R
R R
RP R RO R t pid(
t clsR} R R Rz t worker_handlerR‘ t result_handlerR„ R€ ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRE Á s2
$
N( ( ( ( t __name__t
__module__t __doc__R R
RK RR R7 RX R) R^ R Rl Rn R] R_ t staticmethodR: R> RB Rj R‹ R R RP R’ t classmethodRE ( ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR k s0 9
': Ro c B sD e Z d „ Z d „ Z d „ Z d d „ Z d d „ Z d „ Z RS( c C sS t j t j ƒ ƒ | _ t j ƒ | _ | | _ t | _ | | _
| | | j <d S( N( R8 t Conditiont Lockt _condt job_countert nextRb R, R t _readyt _callback( RH R„ Rp ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRK ò s c C s | j S( N( R¡ ( RH ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt readyú s c C s | j s t ‚ | j S( N( R¡ R
t _success( RH ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt
successfulý s c C sB | j j ƒ z | j s, | j j | ƒ n Wd | j j ƒ Xd S( N( Rž R R¡ t waitt release( RH t timeout( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR¦ s
c C s< | j | ƒ | j s t ‚ n | j r/ | j S| j ‚ d S( N( R¦ R¡ R R¤ t _value( RH R¨ ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR s
c C s€ | \ | _ | _ | j r7 | j r7 | j | j ƒ n | j j ƒ z t | _ | j j ƒ Wd | j j ƒ X| j | j
=d S( N( R¤ R© R¢ Rž R R R¡ t notifyR§ R, Rb ( RH R R… ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR s
N( R— R˜ RK R£ R¥ R
R¦ R R ( ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRo ð s Rt c B s e Z d „ Z d „ Z RS( c C su t j | | | ƒ t | _ d g | | _ | | _ | d k rV d | _ t | _ n | | t | | ƒ | _ d S( Ni (
Ro RK R R¤ R
R© t
_chunksizet _number_leftR¡ t bool( RH R„ Ra t lengthRp ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRK $ s c C s | \ } } | r¹ | | j | | j | d | j +| j d 8_ | j d k r| j rn | j | j ƒ n | j | j =| j j ƒ z t | _ | j j
ƒ Wd | j j ƒ XqnW t | _
| | _ | j | j =| j j ƒ z t | _ | j j
ƒ Wd | j j ƒ Xd S( Ni i ( R© R« R¬ R¢ R, Rb Rž R R R¡ Rª R§ R R¤ ( RH R t success_resultt successR# ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR / s* "
( R— R˜ RK R ( ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRt " s Rg c B s> e Z d „ Z d „ Z d d „ Z e Z d „ Z d „ Z RS( c C sk t j t j ƒ ƒ | _ t j ƒ | _ | | _ t j ƒ | _
d | _ d | _
i | _ | | | j <d S( Ni ( R8 Rœ R Rž RŸ R Rb R, t collectionst dequet _itemst _indexR
t _lengtht _unsorted( RH R„ ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRK P s c C s | S( N( ( RH ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt __iter__Z s c C sÜ | j j ƒ zž y | j j ƒ } Wn„ t k
r© | j | j k rN t ‚ n | j j | ƒ y | j j ƒ } Wqª t k
r¥ | j | j k rœ t ‚ n t ‚ qª Xn XWd | j j
ƒ X| \ } } | rÒ | S| ‚ d S( N( Rž R R³ t popleftt
IndexErrorR´ Rµ t
StopIterationR¦ R R§ ( RH R¨ Rf R° t value( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR ] s&
c C sà | j j ƒ z¾ | j | k r› | j j | ƒ | j d 7_ xJ | j | j k rŠ | j j | j ƒ } | j j | ƒ | j d 7_ qA W| j j ƒ n
| | j | <| j | j k rÊ | j | j
=n Wd | j j ƒ Xd S( Ni ( Rž R R´ R³ RT R¶ t popRª Rµ R, Rb R§ ( RH R R… ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR v s
c C s^ | j j ƒ z< | | _ | j | j k rH | j j ƒ | j | j =n Wd | j j ƒ Xd S( N( Rž R Rµ R´ Rª R, Rb R§ ( RH R® ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRi ‰ s
N( R— R˜ RK R· R
R t __next__R Ri ( ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRg N s
Rm c B s e Z d „ Z RS( c C st | j j ƒ zR | j j | ƒ | j d 7_ | j j ƒ | j | j k r^ | j | j =n Wd | j j ƒ Xd S( Ni (
Rž R R³ RT R´ Rª Rµ R, Rb R§ ( RH R R… ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR ™ s
( R— R˜ R ( ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRm — s t
ThreadPoolc B sB e Z d d l m Z d d d d „ Z d „ Z e d „ ƒ Z RS( i ( R c C s t j | | | | ƒ d S( N( R RK ( RH RI R R ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyRK ¬ s c C s@ t j ƒ | _ t j ƒ | _ | j j | _ | j j | _ d S( N( R* RF R@ R R? R RC ( RH ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR) ¯ s c C sW | j j ƒ z5 | j j ƒ | j j d g | ƒ | j j ƒ Wd | j j ƒ Xd S( N( t not_emptyR t queuet cleart extendR
t
notify_allR§ ( R R‘ RŠ ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR’ µ s
N( ( R— R˜ t dummyR R
RK R) Rš R’ ( ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyR¾ ¨ s ( t __all__R8 R* R‡ R± Rx t multiprocessingR R R t multiprocessing.utilR R R- RŒ Rw t countRŸ R R
R% t objectR Ro Rt Rg Rm R¾ ( ( ( s* /usr/lib/python2.7/multiprocessing/pool.pyt <module># s( $ÿ †2,I