File: //usr/lib/python3.9/multiprocessing/__pycache__/managers.cpython-39.pyc
a
kx�g�� � @ sB g d �Z ddlZddlZddlZddlZddlZddlZddlZddlZddlm Z ddl
m Z ddl m
Z
ddlmZmZmZ ddl mZ dd l mZ dd
l mZ dd l mZ zdd l mZ d
ZW n ey� dZY n0 dd� Ze�eje� dd� dD �Zed e u�r.dd� Z eD ]Z e�e e � �qG dd� de �Z di fdd�Z!dd � Z"G d d � d e#�Z$d d � Z%d!d"� Z&G d#d$� d$e �Z'G d%d&� d&e �Z(e
j)e
j*fe
j+e
j,fd'�Z-G d(d)� d)e �Z.G d*d+� d+e/�Z0G d,d-� d-e �Z1d.d/� Z2i fd0d1�Z3dmd2d3�Z4G d4d5� d5e �Z5G d6d7� d7e �Z6dnd8d9�Z7G d:d;� d;e1�Z8G d<d=� d=e1�Z9G d>d?� d?e9�Z:G d@dA� dAe1�Z;G dBdC� dCe1�Z<G dDdE� dEe1�Z=G dFdG� dGe1�Z>e3dHdI�Z?G dJdK� dKe?�Z@e3dLdM�ZAdNdOieA_Be3dPdQ�ZCe3dRdS�ZDdTdTdTdOdOdU�eD_BG dVdR� dReD�ZEG dWdX� dXe.�ZFeF�dYejG� eF�dZejG� eF�d[ejHe;� eF�d\ejIe9� eF�d]ejJe9� eF�d^ejKe9� eF�d_ejLe9� eF�d`ejMe:� eF�daejNe<� eF�dbejOeE� eF�dce e@� eF�ddePeA� eF�d7e6e>� eF�d9e7eC� eF�d5e5e=� eFjdOe8dde� eFjdTddf� e�r>G dgdh� dh�ZQG didj� dje'�ZRG dkdl� dle.�ZSdS )o)� BaseManager� SyncManager� BaseProxy�Token�SharedMemoryManager� N)�getpid)�
format_exc� )�
connection)� reduction�get_spawning_popen� ProcessError)�pool)�process)�util)� get_context)�
shared_memoryTFc C s t j | j| �� ffS �N)�array�typecode�tobytes)�a� r �./usr/lib/python3.9/multiprocessing/managers.py� reduce_array. s r c C s g | ]}t ti |�� ��qS r )�type�getattr��.0�namer r r �
<listcomp>2 � r )�items�keys�valuesc C s t t | �ffS r )�list��objr r r �rebuild_as_list4 s r( c @ s4 e Zd ZdZdZdd� Zdd� Zdd� Zd d
� Zd S ) r z3
Type to uniquely identify a shared object
��typeid�address�idc C s ||| | _ | _| _d S r r) )�selfr* r+ r, r r r �__init__C s zToken.__init__c C s | j | j| jfS r r) �r- r r r � __getstate__F s zToken.__getstate__c C s |\| _ | _| _d S r r) �r- �stater r r � __setstate__I s zToken.__setstate__c C s d| j j| j| j| jf S )Nz %s(typeid=%r, address=%r, id=%r))� __class__�__name__r* r+ r, r/ r r r �__repr__L s �zToken.__repr__N) r5 �
__module__� __qualname__�__doc__� __slots__r. r0 r3 r6 r r r r r = s r r c C s8 | � ||||f� | �� \}}|dkr*|S t||��dS )zL
Send a message to manager using connection `c` and return response
�#RETURNN)�send�recv�convert_to_error)�cr, �
methodname�args�kwds�kind�resultr r r �dispatchT s
rE c C sd | dkr |S | dv rRt |t�s4td�|| t|����| dkrHtd| �S t|�S ntd�| ��S d S )N�#ERROR)�
#TRACEBACK�#UNSERIALIZABLEz.Result {0!r} (kind '{1}') type is {2}, not strrH zUnserializable message: %s
z Unrecognized message type {!r})�
isinstance�str� TypeError�formatr � RemoteError�
ValueError)rC rD r r r r> ^ s
��
r> c @ s e Zd Zdd� ZdS )rM c C s dt | jd � d S )NzM
---------------------------------------------------------------------------
r zK---------------------------------------------------------------------------)rJ rA r/ r r r �__str__n s zRemoteError.__str__N)r5 r7 r8 rO r r r r rM m s rM c C s2 g }t | �D ] }t| |�}t|�r |�|� q |S )z4
Return a list of names of methods of `obj`
)�dirr �callable�append)r' �tempr �funcr r r � all_methodsu s
rU c C s dd� t | �D �S )zP
Return a list of names of methods of `obj` which do not start with '_'
c S s g | ]}|d dkr|�qS )r �_r r r r r r � r! z"public_methods.<locals>.<listcomp>)rU r& r r r �public_methods� s rW c @ s� e Zd ZdZg d�Zdd� Zdd� Zdd� Zd d
� Zd d � Z d
d� Z
dd� Z dd� Z e e e
d�Z
dd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zd&S )'�ServerzM
Server class which runs in a process controlled by a manager object
) �shutdown�create�accept_connection� get_methods�
debug_info�number_of_objects�dummy�incref�decrefc C sx t |t�s td�|t|����|| _t�|�| _t | \}}||dd�| _
| j
j | _ ddi| _ i | _
i | _t�� | _d S )Nz&Authkey {0!r} is type {1!s}, not bytes� )r+ Zbacklog�0�Nr )rI �bytesrK rL r �registryr �AuthenticationString�authkey�listener_client�listenerr+ � id_to_obj�id_to_refcount�id_to_local_proxy_obj� threading�Lock�mutex)r- rf r+ rh �
serializer�Listener�Clientr r r r. � s
��
zServer.__init__c C s� t �� | _| t�� _z�t j| jd�}d|_|� � z | j�
� sL| j� d� q4W n t t
fyd Y n0 W tjtjkr�t�d� tjt_tjt_t�d� n2tjtjkr�t�d� tjt_tjt_t�d� 0 dS )z(
Run the server forever
)�targetTr zresetting stdout, stderrr N)rn �Event�
stop_eventr �current_process�_manager_server�Thread�accepter�daemon�start�is_set�wait�KeyboardInterrupt�
SystemExit�sys�stdout�
__stdout__r �debug�
__stderr__�stderr�exit)r- rz r r r �
serve_forever� s*
�
zServer.serve_foreverc C sL z| j �� }W n ty$ Y q Y n0 tj| j|fd�}d|_|�� q d S )N�rt rA T)rj Zaccept�OSErrorrn ry �handle_requestr{ r| )r- r? �tr r r rz � s
zServer.accepterc C sN d } }}zTt �|| j� t �|| j� |�� }|\}}}}|| jv sTJ d| ��t| |�}W n ty| dt� f} Y nB0 z||g|�R i |��}W n ty� dt� f} Y n
0 d|f} z|� | � W nt t�y@ }
zZz|� dt� f� W n t�y Y n0 t
� d| � t
� d|� t
� d|
� W Y d}
~
n
d}
~
0 0 |� � dS )z)
Handle a new connection
Nz%r unrecognizedrG r; zFailure to send message: %rz ... request was %r� ... exception was %r)
r
Zdeliver_challengerh Zanswer_challenger= �publicr � Exceptionr r< r �info�close) r- r? �funcnamerD �request�ignorerA rB rT �msg�er r r r� � s4 "zServer.handle_requestc C s� t �dt�� j� |j}|j}| j}| j� � �sΐz:d }}|� }|\}}} }
z|| \}} } W nP t
y� }
z8z| j | \}} } W n t
y� |
�Y n0 W Y d}
~
n
d}
~
0 0 || vr�t d|t
|�| f ��t||�}z|| i |
��}W n. t�y } zd|f}W Y d}~nXd}~0 0 | �o,| �|d�}|�rb| �|||�\}}t|| j|�}d||ff}nd|f}W n� t �y� |du �r�dt� f}nRz2| j| }|| |||g| �R i |
��}d|f}W n t�y� dt� f}Y n0 Y nL t�y t �dt�� j� t�d � Y n t�y2 dt� f}Y n0 z4z ||� W n" t�yd |d
t� f� Y n0 W q$ t�y� } zHt �d t�� j� t �d |� t �d
|� |�� t�d� W Y d}~q$d}~0 0 q$dS )zQ
Handle requests from the proxies in a particular process/thread
z$starting server thread to service %rNz+method %r of %r object is not in exposed=%rrF �#PROXYr; rG z$got EOF -- exiting thread serving %rr rH z exception in thread serving %rz ... message was %rr� r )r r� rn �current_threadr r= r< rk rv r} �KeyErrorrm �AttributeErrorr r r� �getrZ r r+ r �fallback_mapping�EOFErrorr� r� r� r� )r- �connr= r< rk r@ r' r� �identrA rB �exposed� gettypeid�keZfunction�resr� r� r* ZridentZrexposed�tokenZ
fallback_funcrD r r r � serve_client� s� � � ��
��� � � zServer.serve_clientc C s |S r r �r- r� r� r' r r r �fallback_getvalue6 s zServer.fallback_getvaluec C s t |�S r �rJ r� r r r � fallback_str9 s zServer.fallback_strc C s t |�S r )�reprr� r r r �
fallback_repr< s zServer.fallback_repr)rO r6 � #GETVALUEc C s d S r r �r- r? r r r r_ E s z Server.dummyc
C s� | j �v g }t| j�� �}|�� |D ]<}|dkr&|�d|| j| t| j| d �dd� f � q&d�|�W d � S 1 s�0 Y dS )zO
Return some info --- useful to spot problems with refcounting
rc z %s: refcount=%s
%sr N�K �
) rp r% rl r# �sortrR rJ rk �join)r- r? rD r# r� r r r r] H s
��zServer.debug_infoc C s
t | j�S )z*
Number of shared objects
)�lenrl r� r r r r^ X s zServer.number_of_objectsc C sV zDzt �d� |�d� W n ddl}|�� Y n0 W | j�� n | j�� 0 dS )z'
Shutdown this process
z!manager received shutdown message�r; Nr N)r r� r< � traceback� print_excrv �set)r- r? r� r r r rY _ s
zServer.shutdownc O s | j �� | j| \}}}}|du rD|s2t|�dkr:td��|d } n||i |��} |du rbt| �}|dur�t|t�s�td�|t |����t
|�t
|� }dt | � }
t �
d||
� | t|�|f| j|
< |
| jvr�d| j|
< W d � n1 s�0 Y | �||
� |
t|�fS )z>
Create a new shared object and return its id
Nr z4Without callable, must have one non-keyword argumentr z,Method_to_typeid {0!r}: type {1!s}, not dictz%xz&%r callable returned object with id %r)rp rf r� rN rW rI �dictrK rL r r% r, r r� r� rk rl r` �tuple) r- r? r* rA rB rQ r� �method_to_typeid� proxytyper' r� r r r rZ l s6 �
�
��
( z
Server.createc C s t | j|j d �S )zL
Return the methods of the shared object indicated by token
r )r� rk r, )r- r? r� r r r r\ � s zServer.get_methodsc C s" |t �� _|�d� | �|� dS )z=
Spawn a new thread to serve this connection
r� N)rn r� r r< r� )r- r? r r r r r[ � s
zServer.accept_connectionc C s� | j �� z| j| d7 < W nj ty� } zR|| jv rpd| j|< | j| | j|< | j| \}}}t�d|� n|�W Y d }~n
d }~0 0 W d � n1 s�0 Y d S )Nr z&Server re-enabled tracking & INCREF %r)rp rl r� rm rk r r� )r- r? r� r� r' r� r� r r r r` � s
�z
Server.increfc C s� || j vr$|| jv r$t�d|� d S | j�d | j | dkrXtd�|| j| | j | ���| j | d8 < | j | dkr�| j |= W d � n1 s�0 Y || j vr�d| j|< t�d|� | j� | j|= W d � n1 s�0 Y d S )NzServer DECREF skipping %rr z+Id {0!s} ({1!r}) has refcount {2:n}, not 1+r )Nr Nzdisposing of obj with id %r)rl rm r r� rp �AssertionErrorrL rk )r- r? r� r r r ra � s*
�
��&
z
Server.decrefN)r5 r7 r8 r9 r� r. r� rz r� r� r� r� r� r� r_ r] r^ rY rZ r\ r[ r` ra r r r r rX � s.
"Q�
$rX c @ s e Zd ZdgZdZdZdZdS )�State�valuer r � N)r5 r7 r8 r: �INITIAL�STARTED�SHUTDOWNr r r r r� � s r� )�pickleZ xmlrpclibc @ s� e Zd ZdZi ZeZd"dd�Zdd� Zdd � Z d#d d �Z
e d$d
d��Z dd� Z
d%dd�Zdd� Zdd� Zdd� Zdd� Zedd � �Zed d � �Ze d&d d!��ZdS )'r z!
Base class for managers
Nr� c C s\ |d u rt �� j}|| _t �|�| _t� | _tj| j_ || _
t | \| _ | _
|pTt� | _d S r )r rw rh �_addressrg �_authkeyr� �_stater� r� � _serializerri Z _Listener�_Clientr �_ctx)r- r+ rh rq �ctxr r r r. � s
zBaseManager.__init__c C sf | j jtjkrP| j jtjkr&td��n*| j jtjkr>td��ntd�| j j���t| j | j
| j | j �S )zX
Return server object with serve_forever() method and address attribute
�Already started server�Manager has shut down�Unknown state {!r})
r� r� r� r� r� r
r� rL rX � _registryr� r� r� r/ r r r �
get_server� s
�
�zBaseManager.get_serverc C s8 t | j \}}|| j| jd�}t|dd� tj| j_dS )z>
Connect manager object to the server process
�rh Nr_ ) ri r� r� r� rE r� r� r� r� )r- rr rs r� r r r �connect s zBaseManager.connectr c C s4 | j jtjkrP| j jtjkr&td��n*| j jtjkr>td��ntd�| j j���|durht|�sht d��t
j dd�\}}| j j
t| �j| j| j| j| j|||fd�| _d �d
d � | jjD ��}t| �jd | | j_| j�� |�� |�� | _|�� tj| j _t j | t| �j | j| j| j| j | j fd
d�| _ dS )z@
Spawn a server process for this manager object
r� r� r� Nz initializer must be a callableF)Zduplexr� �:c s s | ]}t |�V qd S r r� )r �ir r r � <genexpr>' r! z$BaseManager.start.<locals>.<genexpr>�-r �rA Z exitpriority)!r� r� r� r� r� r
r� rL rQ rK r
ZPiper� ZProcessr � _run_serverr� r� r� r� �_processr� Z _identityr5 r r| r� r= r �Finalize�_finalize_managerr� rY )r- � initializer�initargs�reader�writerr� r r r r| s>
�
��
��zBaseManager.startc C s^ t � t jt j� |dur ||� | �||||�}|�|j� |�� t�d|j� |� � dS )z@
Create a server, report its address and run it
Nzmanager serving at %r)
�signal�SIGINT�SIG_IGN�_Serverr< r+ r� r r� r� ) �clsrf r+ rh rq r� r� r� �serverr r r r� 9 s zBaseManager._run_serverc O sl | j jtjksJ d��| j| j| jd�}z&t|dd|f| |�\}}W |�� n
|�� 0 t || j|�|fS )zP
Create a new shared object; return the token and exposed tuple
zserver not yet startedr� NrZ )
r� r� r� r� r� r� r� rE r� r )r- r* rA rB r� r, r� r r r �_createP s zBaseManager._createc C s* | j dur&| j �|� | j �� s&d| _ dS )zC
Join the manager process (if it has been spawned)
N)r� r� �is_alive�r- �timeoutr r r r� \ s
zBaseManager.joinc C s8 | j | j| jd�}zt|dd�W |�� S |�� 0 dS )zS
Return some info about the servers shared objects and connections
r� Nr] �r� r� r� rE r� �r- r� r r r � _debug_infoe s �zBaseManager._debug_infoc C s8 | j | j| jd�}zt|dd�W |�� S |�� 0 dS )z5
Return the number of shared objects
r� Nr^ r� r� r r r �_number_of_objectso s �z BaseManager._number_of_objectsc C sj | j jtjkr| �� | j jtjkrf| j jtjkr<td��n*| j jtjkrTtd��ntd�| j j���| S )NzUnable to start serverr� r� ) r� r� r� r� r| r� r
r� rL r/ r r r � __enter__y s
�zBaseManager.__enter__c C s | � � d S r )rY �r- �exc_typeZexc_valZexc_tbr r r �__exit__� s zBaseManager.__exit__c C s� | � � r�t�d� z4|||d�}zt|dd� W |�� n
|�� 0 W n tyX Y n0 | jdd� | � � r�t�d� t| d�r�t�d � | �� | jd
d� | � � r�t�d � t j
|_ z t j
|= W n ty� Y n0 dS ) zQ
Shutdown the manager process; will be registered as a finalizer
z#sending shutdown message to managerr� NrY g �?)r� zmanager still alive� terminatez'trying to `terminate()` manager processg�������?z#manager still alive after terminate)r� r r� rE r� r� r� �hasattrr� r� r� r� r �_address_to_localr� )r r+ rh r2 r� r� r r r r� � s.
z BaseManager._finalize_managerc C s | j S r )r� r/ r r r r+ � s zBaseManager.addressTc
s� d| j vr| j�� | _� du r"t� |p0t� dd�}|p@t� dd�}|r�t|�� �D ]8\}}t|�tu srJ d| ��t|�tu sRJ d| ��qR|||� f| j�< |r �fdd�} �| _ t
| �| � dS )z9
Register a typeid with the manager type
r� N� _exposed_�_method_to_typeid_z%r is not a stringc sf t �d�� | j�g|�R i |��\}}� || j| | j|d�}| j|j| jd�}t|d d|jf� |S )Nz)requesting creation of a shared %r object��managerrh r� r� ra ) r r� r� r� r� r� r+ rE r, )r- rA rB r� Zexp�proxyr� �r� r* r r rS � s �z"BaseManager.register.<locals>.temp) �__dict__r� �copy� AutoProxyr r% r" r rJ r5 �setattr)
r� r* rQ r� r� r� �
create_method�keyr� rS r r� r �register� s$
��
zBaseManager.register)NNr� N)Nr )Nr )N)NNNNT)r5 r7 r8 r9 r� rX r� r. r� r� r| � classmethodr� r� r� r� r� r� r� � staticmethodr� �propertyr+ r� r r r r r � s4 �
+ �
�r c @ s e Zd Zdd� Zdd� ZdS )�ProcessLocalSetc C s t �| dd� � d S )Nc S s | � � S r )�clearr& r r r �<lambda>� r! z*ProcessLocalSet.__init__.<locals>.<lambda>)r �register_after_forkr/ r r r r. � s zProcessLocalSet.__init__c C s t | �dfS rd )r r/ r r r �
__reduce__� s zProcessLocalSet.__reduce__N)r5 r7 r8 r. r r r r r r � s r c @ s� e Zd ZdZi Ze�� Zd dd�Zdd� Z d i fd
d �Z
d d
� Z dd� Z e
dd� �Zdd� Zdd� Zdd� Zdd� Zdd� ZdS ) r z.
A base for proxies of shared objects
NTFc C s� t j�B t j�|jd �}|d u r:t�� t� f}|t j|j< W d � n1 sN0 Y |d | _|d | _ || _
| j
j | _ || _
|| _t| d | _|| _|d ur�t�|�| _n"| j
d ur�| j
j| _n t�� j| _|r�| �� t�| t j� d S )Nr r )r �_mutexr� r� r+ r ZForkAwareLocalr �_tls�_idset�_tokenr, �_id�_managerr� ri r� �_owned_by_managerr rg r� rw rh �_increfr � _after_fork) r- r� rq r� rh r� r` �
manager_ownedZ tls_idsetr r r r. � s* *
zBaseProxy.__init__c C sd t �d� t�� j}t�� jdkr4|dt�� j 7 }| j| jj | j
d�}t |d d|f� || j _
d S )Nz making connection to managerZ
MainThread�|r� r[ )r r� r rw r rn r� r� r r+ r� rE r r
)r- r r� r r r �_connect s
zBaseProxy._connectr c C s� z | j j}W n4 ty@ t�dt�� j� | �� | j j}Y n0 |� | j
|||f� |� � \}}|dkrn|S |dkr�|\}}| j j
|j d } | jj|_| || j| j | j|d�}
| j|j| jd�}t|dd|jf� |
S t||��dS ) zV
Try to call a method of the referent and return a copy of the result
z#thread %r does not own a connectionr; r� ���r� r� Nra )r r
r� r r� rn r� r r r< r r= r
r� r* r r+ r� r� r� rE r, r> ) r- r@ rA rB r� rC rD r� r� r� r� r r r � _callmethod s0 �
�zBaseProxy._callmethodc C s
| � d�S )z9
Get a copy of the value of the referent
r� �r r/ r r r � _getvalue: s zBaseProxy._getvaluec C s� | j rt�d| jj� d S | j| jj| jd�}t|d d| j f� t�d| jj� | j
� | j � | j oj| j j
}tj| tj| j| j|| j| j
| jfdd�| _d S )Nz%owned_by_manager skipped INCREF of %rr� r` z INCREF %r�
r� )r r r� r r, r� r+ r� rE r r
�addr
r� r� r �_decrefr Z_close)r- r� r2 r r r r @ s
��zBaseProxy._increfc
C s� |� | j� |d u s |jtjkr�z2t�d| j� || j|d�}t|d d| jf� W q� t y� } zt�d|� W Y d }~q�d }~0 0 nt�d| j� |s�t
|d�r�t�dt � � j
� |j�� |`d S )Nz DECREF %rr� ra z... decref failed %sz%DECREF %r -- manager already shutdownr
z-thread %r has no more proxies so closing conn)�discardr, r� r� r� r r� r+ rE r� r� rn r� r r
r� )r� rh r2 ZtlsZidsetr� r� r� r r r r T s $�
zBaseProxy._decrefc
C sJ d | _ z | �� W n2 tyD } zt�d| � W Y d }~n
d }~0 0 d S )Nzincref failed: %s)r
r r� r r� )r- r� r r r r m s
zBaseProxy._after_forkc C s^ i }t � d ur| j|d< t| dd�rB| j|d< tt| j| j|ffS tt| �| j| j|ffS d S )Nrh �_isautoFr� ) r r� r r� � RebuildProxyr� r r� r �r- rB r r r r u s
��zBaseProxy.__reduce__c C s | � � S r )r )r- �memor r r � __deepcopy__� s zBaseProxy.__deepcopy__c C s dt | �j| jjt| �f S )Nz <%s object, typeid %r at %#x>)r r5 r r* r, r/ r r r r6 � s �zBaseProxy.__repr__c C s8 z | � d�W S ty2 t| �dd� d Y S 0 dS )zV
Return representation of the referent (or a fall-back if that fails)
r6 Nr z; '__str__()' failed>)r r� r� r/ r r r rO � s zBaseProxy.__str__)NNNTF)r5 r7 r8 r9 r� r ZForkAwareThreadLockr r. r r r r r r r r r r6 rO r r r r r � s" �
)
r c C s� t t�� dd�}|rT|j|jkrTt�d|� d|d< |j|jvrT|j|j |j|j< |� dd�opt t�� dd� }| ||fd|i|��S ) z5
Function used for unpickling proxy objects.
rx Nz*Rebuild a proxy owned by manager, token=%rTr r` Z _inheritingF)
r r rw r+ r r� r, rm rk �pop)rT r� rq rB r� r` r r r r � s
�
�r c C sn t |�}z|| |f W S ty( Y n0 i }|D ]}td||f |� q2t| tf|�}||_||| |f< |S )zB
Return a proxy type whose methods are given by `exposed`
zOdef %s(self, /, *args, **kwds):
return self._callmethod(%r, args, kwds))r� r� �execr r r� )r r� �_cacheZdicZmeth� ProxyTyper r r �
MakeProxyType� s �� r% c
C s� t | d }|du rJ|| j|d�}z t|dd| f�}W |�� n
|�� 0 |du r`|dur`|j}|du rrt�� j}td| j |�}|| ||||d�} d| _
| S )z*
Return an auto-proxy for `token`
r Nr� r\ z
AutoProxy[%s])r� rh r` T) ri r+ rE r� r� r rw rh r% r* r )
r� rq r� rh r� r` r� r� r$ r� r r r r� � s
�r� c @ s e Zd Zdd� Zdd� ZdS )� Namespacec K s | j �|� d S r )r� �updater r r r r. � s zNamespace.__init__c C sZ t | j�� �}g }|D ]$\}}|�d�s|�d||f � q|�� d| jjd�|�f S )NrV z%s=%rz%s(%s)z, ) r% r� r" �
startswithrR r� r4 r5 r� )r- r" rS r r� r r r r6 � s
zNamespace.__repr__N)r5 r7 r8 r. r6 r r r r r& � s r& c @ s8 e Zd Zd dd�Zdd� Zdd� Zdd � Zeee�Zd
S ) �ValueTc C s || _ || _d S r )� _typecode�_value)r- r r� �lockr r r r. � s zValue.__init__c C s | j S r �r+ r/ r r r r� � s z Value.getc C s
|| _ d S r r- �r- r� r r r r� � s z Value.setc C s dt | �j| j| jf S )Nz
%s(%r, %r))r r5 r* r+ r/ r r r r6 � s zValue.__repr__N)T) r5 r7 r8 r. r� r� r6 r r� r r r r r) � s
r) c C s t � | |�S r )r )r �sequencer, r r r �Array� s r0 c @ s8 e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zd S )
�
IteratorProxy)�__next__r< �throwr� c C s | S r r r/ r r r �__iter__� s zIteratorProxy.__iter__c G s | � d|�S )Nr2 r �r- rA r r r r2 s zIteratorProxy.__next__c G s | � d|�S )Nr< r r5 r r r r< s zIteratorProxy.sendc G s | � d|�S )Nr3 r r5 r r r r3 s zIteratorProxy.throwc G s | � d|�S )Nr� r r5 r r r r� s zIteratorProxy.closeN) r5 r7 r8 r� r4 r2 r< r3 r� r r r r r1 � s r1 c @ s2 e Zd ZdZd dd�Zdd� Zdd � Zd
d � ZdS )
�
AcquirerProxy)�acquire�releaseTNc C s" |d u r|fn||f}| � d|�S �Nr7 r )r- Zblockingr� rA r r r r7
s zAcquirerProxy.acquirec C s
| � d�S �Nr8 r r/ r r r r8 s zAcquirerProxy.releasec C s
| � d�S r9 r r/ r r r r� s zAcquirerProxy.__enter__c C s
| � d�S r: r r� r r r r� s zAcquirerProxy.__exit__)TN)r5 r7 r8 r� r7 r8 r� r� r r r r r6 s
r6 c @ s6 e Zd ZdZd dd�Zd
dd�Zdd � Zdd
d �ZdS )�ConditionProxy)r7 r8 r~ �notify�
notify_allNc C s | � d|f�S �Nr~ r r� r r r r~ s zConditionProxy.waitr c C s | � d|f�S )Nr< r )r- �nr r r r< s zConditionProxy.notifyc C s
| � d�S )Nr= r r/ r r r r= s zConditionProxy.notify_allc C sd |� }|r|S |d ur$t �� | }nd }d }|s`|d urN|t �� }|dkrNq`| �|� |� }q,|S )Nr )�time� monotonicr~ )r- Z predicater� rD ZendtimeZwaittimer r r �wait_for s
zConditionProxy.wait_for)N)r )N)r5 r7 r8 r� r~ r< r= rB r r r r r; s
r; c @ s2 e Zd ZdZdd� Zdd� Zdd� Zd d d
�ZdS ) �
EventProxy)r} r� r r~ c C s
| � d�S )Nr} r r/ r r r r} 5 s zEventProxy.is_setc C s
| � d�S �Nr� r r/ r r r r� 7 s zEventProxy.setc C s
| � d�S )Nr r r/ r r r r 9 s zEventProxy.clearNc C s | � d|f�S r> r r� r r r r~ ; s zEventProxy.wait)N)r5 r7 r8 r� r} r� r r~ r r r r rC 3 s
rC c @ sN e Zd ZdZddd�Zdd� Zdd� Zed d
� �Zed d � �Z ed
d� �Z
dS )� BarrierProxy)�__getattribute__r~ �abort�resetNc C s | � d|f�S r> r r� r r r r~ A s zBarrierProxy.waitc C s
| � d�S )NrG r r/ r r r rG C s zBarrierProxy.abortc C s
| � d�S )NrH r r/ r r r rH E s zBarrierProxy.resetc C s | � dd�S )NrF )�partiesr r/ r r r rI G s zBarrierProxy.partiesc C s | � dd�S )NrF )� n_waitingr r/ r r r rJ J s zBarrierProxy.n_waitingc C s | � dd�S )NrF )�brokenr r/ r r r rK M s zBarrierProxy.broken)N) r5 r7 r8 r� r~ rG rH r rI rJ rK r r r r rE ? s
rE c @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �NamespaceProxy)rF � __setattr__� __delattr__c C s0 |d dkrt �| |�S t �| d�}|d|f�S )Nr rV r rF )�objectrF �r- r� �
callmethodr r r � __getattr__T s zNamespaceProxy.__getattr__c C s4 |d dkrt �| ||�S t �| d�}|d||f�S )Nr rV r rM )rO rM rF )r- r� r� rQ r r r rM Y s zNamespaceProxy.__setattr__c C s0 |d dkrt �| |�S t �| d�}|d|f�S )Nr rV r rN )rO rN rF rP r r r rN ^ s zNamespaceProxy.__delattr__N)r5 r7 r8 r� rR rM rN r r r r rL R s rL c @ s4 e Zd ZdZdd� Zdd� Zeee�Zee j
�Z dS )�
ValueProxy)r� r� c C s
| � d�S )Nr� r r/ r r r r� g s zValueProxy.getc C s | � d|f�S rD r r. r r r r� i s zValueProxy.setN) r5 r7 r8 r� r� r� r r� r �types� GenericAlias�__class_getitem__r r r r rS e s
rS �
BaseListProxy)�__add__� __contains__� __delitem__� __getitem__�__len__�__mul__� __reversed__�__rmul__� __setitem__rR �count�extend�index�insertr! �remove�reverser� �__imul__c @ s e Zd Zdd� Zdd� ZdS )� ListProxyc C s | � d|f� | S )Nrb r r. r r r �__iadd__w s zListProxy.__iadd__c C s | � d|f� | S )Nrg r r. r r r rg z s zListProxy.__imul__N)r5 r7 r8 ri rg r r r r rh v s rh � DictProxy)rY rZ r[ r4 r\ r` r r� r� r" r# r! �popitem�
setdefaultr' r$ r4 �Iterator�
ArrayProxy)r\ r[ r` � PoolProxy) Zapply� apply_asyncr� �imap�imap_unorderedr� �map� map_async�starmap�
starmap_asyncr� Z AsyncResult)rp rt rv rq rr c @ s e Zd Zdd� Zdd� ZdS )ro c C s | S r r r/ r r r r� � s zPoolProxy.__enter__c C s | � � d S r )r� r� r r r r� � s zPoolProxy.__exit__N)r5 r7 r8 r� r� r r r r ro � s c @ s e Zd ZdZdS )r a(
Subclass of `BaseManager` which supports a number of shared object types.
The types registered are those intended for the synchronization
of threads, plus `dict`, `list` and `Namespace`.
The `multiprocessing.Manager()` function creates started instances of
this class.
N)r5 r7 r8 r9 r r r r r � s r �QueueZ
JoinableQueueru ro �RLock� Semaphore�BoundedSemaphore� Condition�Barrier�Poolr% r� )r� r� )r� c @ sL e Zd ZdZg fdd�Zdd� Zdd� Zdd � Zd
d � Zd d
� Z dd� Z
dS )�_SharedMemoryTrackerz+Manages one or more shared memory segments.c C s || _ || _d S r �Zshared_memory_context_name�
segment_names)r- r r� r r r r. � s z _SharedMemoryTracker.__init__c C s( t �d|�dt� � �� | j�|� dS )z6Adds the supplied shared memory block name to tracker.zRegister segment � in pid N)r r� r r� rR �r- � segment_namer r r �register_segment� s z%_SharedMemoryTracker.register_segmentc C sB t �d|�dt� � �� | j�|� t�|�}|�� |�� dS )z�Calls unlink() on the shared memory block with the supplied name
and removes it from the list of blocks being tracked.zDestroy segment r� N) r r� r r� re r � SharedMemoryr� �unlink)r- r� Zsegmentr r r �destroy_segment� s
z$_SharedMemoryTracker.destroy_segmentc C s" | j dd� D ]}| �|� qdS )z<Calls destroy_segment() on all tracked shared memory blocks.N)r� r� r� r r r r� � s z_SharedMemoryTracker.unlinkc C s( t �d| jj� dt� � �� | �� d S )NzCall z .__del__ in )r r� r4 r5 r r� r/ r r r �__del__� s z _SharedMemoryTracker.__del__c C s | j | jfS r r r/ r r r r0 � s z!_SharedMemoryTracker.__getstate__c C s | j |� d S r )r. r1 r r r r3 � s z!_SharedMemoryTracker.__setstate__N) r5 r7 r8 r9 r. r� r� r� r� r0 r3 r r r r r~ � s r~ c @ sJ e Zd Zejg d� Zdd� Zdd� Zdd� Zdd � Zd
d � Z d d
� Z
dS )�SharedMemoryServer)�
track_segment�release_segment�
list_segmentsc O s` t j| g|�R i |�� | j}t|t�r2t�|�}td|� dt� � ��| _ t
� dt� � �� d S )NZshm_rV z"SharedMemoryServer started by pid ) rX r. r+ rI re �os�fsdecoder~ r �shared_memory_contextr r� )r- rA �kwargsr+ r r r r. � s
�zSharedMemoryServer.__init__c O s: t | j| d d�r | j|d< tj| ||g|�R i |��S )z�Create a new distributed-shared object (not backed by a shared
memory block) and return its id to be used in a Proxy Object.r Z_shared_memory_proxyr� )r� rf r� rX rZ )r- r? r* rA r� r r r rZ � s
zSharedMemoryServer.createc C s | j �� t�| |�S )zACall unlink() on all tracked shared memory, terminate the Server.)r� r� rX rY r� r r r rY s
zSharedMemoryServer.shutdownc C s | j �|� dS )z?Adds the supplied shared memory block name to Server's tracker.N)r� r� �r- r? r� r r r r� s z SharedMemoryServer.track_segmentc C s | j �|� dS )z�Calls unlink() on the shared memory block with the supplied name
and removes it from the tracker instance inside the Server.N)r� r� r� r r r r� s z"SharedMemoryServer.release_segmentc C s | j jS )zbReturns a list of names of shared memory blocks that the Server
is currently tracking.)r� r� r� r r r r� s z SharedMemoryServer.list_segmentsN) r5 r7 r8 rX r� r. rZ rY r� r� r� r r r r r� � s �
r� c @ s< e Zd ZdZeZdd� Zdd� Zdd� Zdd � Z d
d � Z
d S )
r a� Like SyncManager but uses SharedMemoryServer instead of Server.
It provides methods for creating and returning SharedMemory instances
and for creating a list-like object (ShareableList) backed by shared
memory. It also provides methods that create and return Proxy Objects
that support synchronization across processes (i.e. multi-process-safe
locks and semaphores).
c O sT t jdkr ddlm} |�� tj| g|�R i |�� t�| j j
� dt � � �� d S )N�posixr )�resource_trackerz created by pid ) r� r � r� Zensure_runningr r. r r� r4 r5 r )r- rA r� r� r r r r. & s
z SharedMemoryManager.__init__c C s t �| jj� dt� � �� d S )Nz.__del__ by pid )r r� r4 r5 r r/ r r r r� 2 s zSharedMemoryManager.__del__c C sh | j jtjkrP| j jtjkr&td��n*| j jtjkr>td��ntd�| j j���| �| j | j
| j | j �S )z@Better than monkeypatching for now; merge into Server ultimatelyz"Already started SharedMemoryServerz!SharedMemoryManager has shut downr� )
r� r� r� r� r� r
r� rL r� r� r� r� r� r/ r r r r� 6 s
� �z SharedMemoryManager.get_serverc C s� | j | j| jd��h}tjdd|d�}zt|dd|jf� W n0 tyj } z|�� |�W Y d}~n
d}~0 0 W d � n1 s�0 Y |S )zoReturns a new SharedMemory instance with the specified size in
bytes, to be tracked by the manager.r� NT)rZ �sizer� ) r� r� r� r r� rE r �
BaseExceptionr� )r- r� r� Zsmsr� r r r r� C s 8z SharedMemoryManager.SharedMemoryc C s� | j | j| jd��f}t�|�}zt|dd|jjf� W n2 tyh } z|j� � |�W Y d}~n
d}~0 0 W d � n1 s~0 Y |S )z�Returns a new ShareableList instance populated with the values
from the input sequence, to be tracked by the manager.r� Nr� )
r� r� r� r �
ShareableListrE Zshmr r� r� )r- r/ r� Zslr� r r r r� O s
8z!SharedMemoryManager.ShareableListN) r5 r7 r8 r9 r� r� r. r� r� r� r� r r r r r s
r )NNNT)T)T�__all__r� rn r� r Zqueuer@ rT r� r r� r r� r
�contextr r r
r r r r r Z HAS_SHMEM� ImportErrorr r� Z
view_typesr% r( Z view_typerO r rE r> r� rM rU rW rX r� rr rs Z XmlListenerZ XmlClientri r r� r r r r% r� r& r) r0 r1 r6 r; rC rE rL rS rW rh rj r� rn Z
BasePoolProxyro r rw ru ro rx ry rz r{ r| r} r� r~ r� r r r r r �<module> s�
H
� w
4 �
�
�
�%-