File: //lib/python3.7/multiprocessing/__pycache__/connection.cpython-37.pyc
B
U��e�y � @ s d dddgZ ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
m Z ddl
m Z m
Z
dd lmZ ejZy$ddlZdd
lmZmZmZmZ W n$ ek
r� ejd kr dZY nX d Zd
Ze�� Z dZ dgZ e ed�r�dZ e dg7 Z ejd k�rdZ e dg7 Z efdd�Z dd� Z!dd� Z"dd� Z#dd� Z$G dd � d �Z%e�rhG d d � d e%�Z&G d d � d e%�Z'G d!d� de(�Z)dOd"d �Z*ejd k�r�dPd$d�Z+n
dQd%d�Z+G d&d'� d'e(�Z,d(d)� Z-ejd k�r�G d*d+� d+e(�Z.d,d-� Z/d.Z0d/Z1d0Z2d1Z3d2d3� Z4d4d5� Z5G d6d7� d7e(�Z6d8d9� Z7d:d;� Z8G d<d=� d=e)�Z9d>d?� Z:ejd k�rtd@dA� Z;ej<ej=hZ>dRdBd�Z?n,ddl@Z@e e@dC��r�e@jAZBne@jCZBdSdDd�Z?ejd k�r�dEdF� ZDdGdH� ZEe�Fe'eD� dIdJ� ZGdKdL� ZHe�Fe&eG� n dMdF� ZDdNdH� ZEe�Fe'eD� dS )T�Client�Listener�Pipe�wait� N� )�util)�AuthenticationError�BufferTooShort)� reduction)�
WAIT_OBJECT_0�WAIT_ABANDONED_0� WAIT_TIMEOUT�INFINITE�win32i g 4@�AF_INET�AF_UNIX�AF_PIPEc C s t �� | S )N)�time� monotonic)�timeout� r �0/usr/lib/python3.7/multiprocessing/connection.py�
_init_timeout; s r c C s t �� | kS )N)r r )�tr r r �_check_timeout> s r c C sX | dkr dS | dkr&t jdt�� d�S | dkrLt jdt�� tt�f dd�S td ��d
S ) z?
Return an arbitrary free address for the given family
r )Z localhostr r z listener-)�prefix�dirr z\\.\pipe\pyc-%d-%d-� zunrecognized familyN) �tempfileZmktempr Z get_temp_dir�os�getpid�next�
_mmap_counter�
ValueError)�familyr r r �arbitrary_addressE s r% c C sJ t jdkr | dkr td| ��t jdkrF| dkrFtt| �sFtd| ��dS )zD
Checks if the family is valid for the current environment.
r r z Family %s is not recognized.r N)�sys�platformr# �hasattr�socket)r$ r r r �_validate_familyS s
r* c C sJ t | �tkrdS t | �tkr*| �d�r*dS t | �tkr:dS td| ��dS )z]
Return the types of the address
This can be 'AF_INET', 'AF_UNIX', or 'AF_PIPE'
r z\\r r z address type of %r unrecognizedN)�type�tuple�str�
startswithr# )�addressr r r � address_type_ s r0 c @ s� e Zd ZdZd+dd�Zdd� Zdd� Zd d
� Zd d � Zd
d� Z e
dd� �Z e
dd� �Z e
dd� �Z
dd� Zdd� Zd,dd�Zd d � Zd-d d �Zd.d d!�Zd"d#� Zd/d%d&�Zd'd(� Zd)d*� ZdS )0�_ConnectionBaseNTc C s> |� � }|dk rtd��|s(|s(td��|| _|| _|| _d S )Nr zinvalid handlez6at least one of `readable` and `writable` must be True)� __index__r# �_handle� _readable� _writable)�self�handle�readable�writabler r r �__init__u s z_ConnectionBase.__init__c C s | j d k r| �� d S )N)r3 �_close)r6 r r r �__del__� s
z_ConnectionBase.__del__c C s | j d krtd��d S )Nzhandle is closed)r3 �OSError)r6 r r r �
_check_closed� s
z _ConnectionBase._check_closedc C s | j std��d S )Nzconnection is write-only)r4 r= )r6 r r r �_check_readable� s z _ConnectionBase._check_readablec C s | j std��d S )Nzconnection is read-only)r5 r= )r6 r r r �_check_writable� s z _ConnectionBase._check_writablec C s" | j rd| _n| �� td��d S )NFzbad message length)r5 r4 �closer= )r6 r r r �_bad_message_length� s z#_ConnectionBase._bad_message_lengthc C s
| j dkS )z True if the connection is closedN)r3 )r6 r r r �closed� s z_ConnectionBase.closedc C s | j S )z"True if the connection is readable)r4 )r6 r r r r8 � s z_ConnectionBase.readablec C s | j S )z"True if the connection is writable)r5 )r6 r r r r9 � s z_ConnectionBase.writablec C s | � � | jS )z+File descriptor or handle of the connection)r> r3 )r6 r r r �fileno� s z_ConnectionBase.filenoc C s$ | j dk r z | �� W dd| _ X dS )zClose the connectionN)r3 r; )r6 r r r rA � s
z_ConnectionBase.closer c C s� | � � | �� t|�}|jdkr.tt|��}t|�}|dk rFtd��||k rVtd��|dkrh|| }n&|dk rztd��n|| |kr�td��| �|||| � � dS )z,Send the bytes data from a bytes-like objectr r zoffset is negativezbuffer length < offsetNzsize is negativez buffer length < offset + size)r> r@ �
memoryview�itemsize�bytes�lenr# � _send_bytes)r6 �buf�offset�size�m�nr r r �
send_bytes� s"
z_ConnectionBase.send_bytesc C s$ | � � | �� | �t�|�� dS )zSend a (picklable) objectN)r> r@ rI �_ForkingPickler�dumps)r6 �objr r r �send� s z_ConnectionBase.sendc C sJ | � � | �� |dk r(|dk r(td��| �|�}|dkrB| �� |�� S )z7
Receive bytes data as a bytes object.
Nr znegative maxlength)r> r? r# � _recv_bytesrB �getvalue)r6 Z maxlengthrJ r r r �
recv_bytes� s
z_ConnectionBase.recv_bytesc C s� | � � | �� t|���}|j}|t|� }|dk r>td��n||krNtd��| �� }|�� }||| k rvt|� � ��|�
d� |� ||| || | � � |S Q R X dS )zq
Receive bytes data into a writeable bytes-like object.
Return the number of bytes read.
r znegative offsetzoffset too largeN) r> r? rE rF rH r# rT �tellr rU �seek�readinto)r6 rJ rK rM rF Zbytesize�resultrL r r r �recv_bytes_into� s"
z _ConnectionBase.recv_bytes_intoc C s& | � � | �� | �� }t�|�� �S )z Receive a (picklable) object)r> r? rT rP �loads� getbuffer)r6 rJ r r r �recv� s z_ConnectionBase.recv� c C s | � � | �� | �|�S )z/Whether there is any input available to be read)r> r? �_poll)r6 r r r r �poll� s z_ConnectionBase.pollc C s | S )Nr )r6 r r r � __enter__ s z_ConnectionBase.__enter__c C s | � � d S )N)rA )r6 �exc_type� exc_value�exc_tbr r r �__exit__ s z_ConnectionBase.__exit__)TT)r N)N)r )r_ )�__name__�
__module__� __qualname__r3 r: r< r> r? r@ rB �propertyrC r8 r9 rD rA rO rS rV r[ r^ ra rb rf r r r r r1 r s(
r1 c @ sD e Zd ZdZdZejfdd�Zdd� Zddd �Z d
d � Z
d d
� Z dS )�PipeConnectionz�
Connection class based on a Windows named pipe.
Overlapped I/O is used, so the handles must have been created
with FILE_FLAG_OVERLAPPED.
Fc C s || j � d S )N)r3 )r6 Z _CloseHandler r r r; s zPipeConnection._closec C s� t j| j|dd�\}}zHy,|t jkrBt �|jgdt�}|tksBt�W n |� � � Y nX W d |�
d�\}}X |dks|t�|t |�ks�t�d S )NT)�
overlappedFr ) �_winapiZ WriteFiler3 �ERROR_IO_PENDING�WaitForMultipleObjects�eventr r �AssertionError�cancel�GetOverlappedResultrH )r6 rJ �ov�err�waitresZnwrittenr r r rI s
zPipeConnection._send_bytesNc
C s | j rd| _ t�� S |d kr dnt|d�}y�tj| j|dd�\}}zHy,|tjkrnt�|j gdt
�}|t ksnt �W n |�
� � Y nX W d |�d�\}}|dkr�t�� }|�|�� � |S |tjkr�| �||�S X W n: tk
�r } z|jtjk� r�t�n� W d d }~X Y nX td��d S )NF� T)rl r z.shouldn't get here; expected KeyboardInterrupt)�_got_empty_message�io�BytesIO�minrm �ReadFiler3 rn ro rp r r rq rr rs �writer] ZERROR_MORE_DATA�_get_more_datar= �winerror�ERROR_BROKEN_PIPE�EOFError� RuntimeError) r6 �maxsizeZbsizert ru rv Znread�f�er r r rT & s6
zPipeConnection._recv_bytesc C s. | j st�| j�d dkr dS tt| g|��S )Nr T)rx rm �
PeekNamedPiper3 �boolr )r6 r r r r r` F s zPipeConnection._pollc C s� |� � }t�� }|�|� t�| j�d }|dks6t�|d k rVt|�| |krV| � � tj
| j|dd�\}}|� d�\}}|dks�t�||ks�t�|�|� � � |S )Nr r T)rl ) r] ry rz r} rm r� r3 rq rH rB r| rs )r6 rt r� rJ r� �leftru Zrbytesr r r r~ L s
z PipeConnection._get_more_data)N) rg rh ri �__doc__rx rm � CloseHandler; rI rT r` r~ r r r r rk s
rk c @ s| e Zd ZdZer,ejfdd�ZejZ ej
Z ne j
fdd�Ze jZ e jZ e fdd�Ze fdd�Zd d
� Zdd d
�Zdd� Zd S )�
Connectionzo
Connection class based on an arbitrary file descriptor (Unix only), or
a socket handle (Windows).
c C s || j � d S )N)r3 )r6 r; r r r r; c s zConnection._closec C s || j � d S )N)r3 )r6 r; r r r r; h s c C s< t |�}x.|| j|�}||8 }|dkr(P ||d � }q
W d S )Nr )rH r3 )r6 rJ r} � remainingrN r r r �_sendm s zConnection._sendc C sf t �� }| j}|}xN|dkr`|||�}t|�}|dkrL||krDt�ntd��|�|� ||8 }qW |S )Nr z got end of file during message)ry rz r3 rH r� r= r} )r6 rL �readrJ r7 r� �chunkrN r r r �_recvv s
zConnection._recvc C sD t |�}t�d|�}|dkr2| �|� | �|� n| �|| � d S )Nz!ii @ )rH �structZpackr� )r6 rJ rN �headerr r r rI � s
zConnection._send_bytesNc C s: | � d�}t�d|�� �\}|d k r0||kr0d S | � |�S )N� z!i)r� r� ZunpackrU )r6 r� rJ rL r r r rT � s
zConnection._recv_bytesc C s t | g|�}t|�S )N)r r� )r6 r �rr r r r` � s zConnection._poll)N)rg rh ri r� rm �_multiprocessingZ closesocketr; rS Z_writer^ Z_readr rA r} r� r� r� rI rT r` r r r r r� \ s
r� c @ sR e Zd ZdZddd�Zdd� Zdd � Zed
d � �Zed d
� �Z dd� Z
dd� Z dS )r z�
Returns a listener object.
This is a wrapper for a bound socket which is 'listening' for
connections, or for a Windows named pipe.
Nr c C sp |p|rt |�pt}|p t|�}t|� |dkr>t||�| _nt|||�| _|d k rft|t�sft d��|| _
d S )Nr z authkey should be a byte string) r0 �default_familyr% r* � PipeListener� _listener�SocketListener�
isinstancerG � TypeError�_authkey)r6 r/ r$ �backlog�authkeyr r r r: � s zListener.__init__c C s> | j dkrtd��| j �� }| jr:t|| j� t|| j� |S )zz
Accept a connection on the bound socket or named pipe of `self`.
Returns a `Connection` object.
Nzlistener is closed)r� r= �acceptr� �deliver_challenge�answer_challenge)r6 �cr r r r� � s
zListener.acceptc C s | j }|dk r d| _ |�� dS )zA
Close the bound socket or named pipe of `self`.
N)r� rA )r6 Zlistenerr r r rA � s zListener.closec C s | j jS )N)r� �_address)r6 r r r r/ � s zListener.addressc C s | j jS )N)r� �_last_accepted)r6 r r r �
last_accepted� s zListener.last_acceptedc C s | S )Nr )r6 r r r rb � s zListener.__enter__c C s | � � d S )N)rA )r6 rc rd re r r r rf � s zListener.__exit__)NNr N) rg rh ri r� r: r� rA rj r/ r� rb rf r r r r r � s
c C sh |p
t | �}t|� |dkr&t| �}nt| �}|dk rHt|t�sHtd��|dk rdt||� t||� |S )z=
Returns a connection to the address of a `Listener`
r Nz authkey should be a byte string) r0 r* �
PipeClient� SocketClientr� rG r� r� r� )r/ r$ r� r� r r r r � s
Tc C sj | r>t �� \}}|�d� |�d� t|�� �}t|�� �}n$t�� \}}t|dd�}t|dd�}||fS )zL
Returns pair of connection objects at either end of a pipe
TF)r9 )r8 )r) Z
socketpair� setblockingr� �detachr �pipe)�duplex�s1�s2�c1�c2Zfd1Zfd2r r r r � s
c
C s� t d�}| r*tj}tjtjB }tt }}ntj}tj}dt }}t�||tjB tj B tj
tj B tj B d||tj
tj�}t�||dtjtjtjtj�}t�|tj dd� tj|dd�}|�d�\} }
|
dks�t�t|| d�} t|| d�} | | fS ) zL
Returns pair of connection objects at either end of a pipe
r r r NT)rl )r9 )r8 )r% rm �PIPE_ACCESS_DUPLEX� GENERIC_READ�
GENERIC_WRITE�BUFSIZEZPIPE_ACCESS_INBOUND�CreateNamedPipe�FILE_FLAG_OVERLAPPED� FILE_FLAG_FIRST_PIPE_INSTANCE�PIPE_TYPE_MESSAGE�PIPE_READMODE_MESSAGE� PIPE_WAIT�NMPWAIT_WAIT_FOREVER�NULL�
CreateFile�
OPEN_EXISTING�SetNamedPipeHandleState�ConnectNamedPipers rq rk )
r� r/ Zopenmode�accessZobsizeZibsizeZh1Zh2rl �_ru r� r� r r r r
s4
c @ s* e Zd ZdZd
dd�Zdd� Zdd� Zd S ) r� zO
Representation of a socket which is bound to an address and listening
r c C s� t � tt |��| _yRtjdkr2| j�t jt jd� | j�d� | j� |� | j�
|� | j� � | _ W n t
k
r� | j�� � Y nX || _d | _|dkr�tj| tj|fdd�| _nd | _d S )N�posixr Tr r )�args� exitpriority)r) �getattr�_socketr �nameZ
setsockoptZ
SOL_SOCKETZ SO_REUSEADDRr� ZbindZlistenZ getsocknamer� r= rA Z_familyr� r �Finalize�unlink�_unlink)r6 r/ r$ r� r r r r: = s$
zSocketListener.__init__c C s& | j �� \}| _|�d� t|�� �S )NT)r� r� r� r� r� r� )r6 �sr r r r� U s
zSocketListener.acceptc C s0 z| j �� W d | j}|d k r*d | _|� X d S )N)r� rA r� )r6 r� r r r rA Z s zSocketListener.closeN)r )rg rh ri r� r: r� rA r r r r r� 9 s
r� c C sD t | �}t�tt|���"}|�d� |�| � t|�� �S Q R X dS )zO
Return a connection object connected to the socket given by `address`
TN)r0 r) r� r� Zconnectr� r� )r/ r$ r� r r r r� d s
r� c @ s8 e Zd ZdZd dd�Zd
dd�Zdd � Zed
d � �ZdS )r� z0
Representation of a named pipe
Nc C sL || _ | jdd�g| _d | _t�d| j � tj| tj| j| j fdd�| _ d S )NT)�firstz listener created with address=%rr )r� r� )
r� � _new_handle�
_handle_queuer� r � sub_debugr� r� �_finalize_pipe_listenerrA )r6 r/ r� r r r r: x s zPipeListener.__init__Fc
C sH t jt jB }|r|t jO }t �| j|t jt jB t jB t j t
t
t j t j �S )N)
rm r� r� r� r� r� r� r� r� ZPIPE_UNLIMITED_INSTANCESr� r� r� )r6 r� �flagsr r r r� � s
zPipeListener._new_handlec
C s� | j �| �� � | j �d�}ytj|dd�}W n0 tk
r^ } z|jtjkrN� W d d }~X Y n\X z<yt� |j
gdt �}W n |� � t�
|� � Y nX W d |�d�\}}|dks�t�X t|�S )Nr T)rl F)r� �appendr� �poprm r� r= r Z
ERROR_NO_DATAro rp r rr r� rs rq rk )r6 r7 rt r� �resr� ru r r r r� � s"
zPipeListener.acceptc C s( t �d|� x| D ]}t�|� qW d S )Nz closing listener with address=%r)r r� rm r� )Zqueuer/ r7 r r r r� � s
z$PipeListener._finalize_pipe_listener)N)F) rg rh ri r� r: r� r� � staticmethodr� r r r r r� t s
r� c
C s� t � }x~y6t�| d� t�| tjtjB dtjtjtjtj�}W n> t k
r| } z |j
tj tj fksjt
|�rl� W dd}~X Y qX P qW � t�|tjdd� t|�S )zU
Return a connection object connected to the pipe given by `address`
i� r N)r rm Z
WaitNamedPiper� r� r� r� r� r� r= r ZERROR_SEM_TIMEOUTZERROR_PIPE_BUSYr r� r� rk )r/ r �hr� r r r r� � s"
r� � s #CHALLENGE#s #WELCOME#s #FAILURE#c C s� dd l }t|t�s$td�t|����t�t�}| � t
| � |� ||d�� � }| �
d�}||krl| � t� n| � t� td��d S )Nr z Authkey must be bytes, not {0!s}�md5� zdigest received was wrong)�hmacr� rG r# �formatr+ r �urandom�MESSAGE_LENGTHrO � CHALLENGE�new�digestrV �WELCOME�FAILUREr )�
connectionr� r� �messager� �responser r r r� � s
r� c C s� dd l }t|t�s$td�t|����| �d�}|d tt�� tksNt d| ��|tt�d � }|�
||d�� � }| � |� | �d�}|t
kr�td��d S )Nr z Authkey must be bytes, not {0!s}r� z message = %rr� zdigest sent was rejected)r� r� rG r# r� r+ rV rH r� rq r� r� rO r� r )r� r� r� r� r� r� r r r r� � s
r� c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )�ConnectionWrapperc C s: || _ || _|| _x"dD ]}t||�}t| ||� qW d S )N)rD rA ra rV rO )�_conn�_dumps�_loadsr� �setattr)r6 �connrQ r\ �attrrR r r r r: � s
zConnectionWrapper.__init__c C s | � |�}| j�|� d S )N)r� r� rO )r6 rR r� r r r rS � s
zConnectionWrapper.sendc C s | j �� }| �|�S )N)r� rV r� )r6 r� r r r r^ � s
zConnectionWrapper.recvN)rg rh ri r: rS r^ r r r r r� � s r� c C s t �| fd d d d��d�S )Nr zutf-8)� xmlrpclibrQ �encode)rR r r r �
_xml_dumps s r� c C s t �| �d��\\}}|S )Nzutf-8)r� r\ �decode)r� rR �methodr r r �
_xml_loads s r� c @ s e Zd Zdd� ZdS )� XmlListenerc C s" dd l ma t�| �}t|tt�S )Nr )�
xmlrpc.client�clientr� r r� r� r� r� )r6 rR r r r r� s
zXmlListener.acceptN)rg rh ri r� r r r r r� s r� c O s dd l ma tt| |�tt�S )Nr )r� r� r� r� r r� r� )r� �kwdsr r r � XmlClient s r� c C s� t | �}g }x�|r�t�|d|�}|tkr,P n\t| krHtt|� k rVn n
|t8 }n2t| krrtt|� k r�n n
|t8 }ntd��|�|| � ||d d � }d}qW |S )NFzShould not get herer r ) �listrm ro r
r rH r r� r� )Zhandlesr �L�readyr� r r r �_exhaustive_wait s
r� c
sl |dkrt }n |dk r d}nt|d d �}t| �} i �g }t� � t� }�zF�x0| D �]&}yt|d�}W n tk
r� |�|�� < Y qTX yt�|� dd�\}}W n8 t k
r� } zd|j
}}|t krʂ W dd}~X Y nX |tj kr�|�
|� |�|j< qT|�rnt�� dd� dk�rny|�d �\} }W n* t k
�rT } z
|j
}W dd}~X Y nX |�snt|d
��rnd|_� �|� d}qTW t��� |�}W dx|D ]}|�� �q�W x�|D ]�}y|�d�\} }W n6 t k
�r� } z|j
}|t k�r� W dd}~X Y nX |tjk�r��|j }� �|� |dk�r�t|d
��r�d|_�q�W X � ��fd d �|D �� � fd
d�| D �S )z�
Wait till an object in object_list is ready/readable.
Returns list of those objects in object_list which are ready/readable.
Nr i� g �?rD T� )� r� Frx c 3 s | ]}� | V qd S )Nr )�.0r� )�waithandle_to_objr r � <genexpr>{ s zwait.<locals>.<genexpr>c s g | ]}|� kr|�qS r r )r� �o)�
ready_objectsr r �
<listcomp>| s zwait.<locals>.<listcomp>)r �intr� �setr� �AttributeErrorr2 rm r| r= r �
_ready_errorsrn r� rp r& Zgetwindowsversionrs r( rx �addr� �keysrr ZERROR_OPERATION_ABORTED�update)
� object_listr Zov_listZ
ready_handlesr rD rt ru r� r� r )r r� r r 0 sh
� PollSelectorc C s� t � �x}x| D ]}|�|tj� qW |dk r8t�� | }x@|�|�}|rVdd� |D �S |dk r:|t�� }|dk r:|S q:W W dQ R X dS )z�
Wait till an object in object_list is ready/readable.
Returns list of those objects in object_list which are ready/readable.
Nc S s g | ]\}}|j �qS r )Zfileobj)r� �keyZeventsr r r r � s zwait.<locals>.<listcomp>r )�
_WaitSelector�register� selectorsZ
EVENT_READr r Zselect)r r ZselectorrR Zdeadliner� r r r r � s
c C sN | � � }t�|tjtj��*}ddlm} |�|�}t|| j | j
ffS Q R X d S )Nr )�resource_sharer) rD r) Zfromfdr Z SOCK_STREAMr r Z DupSocket�rebuild_connectionr8 r9 )r� r7 r� r �dsr r r �reduce_connection� s
r c C s | � � }t|� � ||�S )N)r� r� )r r8 r9 Zsockr r r r � s r c C sB | j r tjnd| jrtjndB }t�| �� |�}t|| j | jffS )Nr ) r8 rm ZFILE_GENERIC_READr9 ZFILE_GENERIC_WRITEr
Z DupHandlerD �rebuild_pipe_connection)r� r� �dhr r r �reduce_pipe_connection� s r c C s | � � }t|||�S )N)r� rk )r r8 r9 r7 r r r r � s r c C s t �| �� �}t|| j| jffS )N)r
ZDupFdrD r r8 r9 )r� �dfr r r r � s c C s | � � }t|||�S )N)r� r� )r r8 r9 �fdr r r r � s )NN)T)T)N)N)I�__all__ry r r& r) r� r r � itertoolsr� r r r r �contextr
ZForkingPicklerrP rm r r r
r � ImportErrorr' r� ZCONNECTION_TIMEOUT�countr" r� Zfamiliesr( r r r% r* r0 r1 rk r� �objectr r r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� ZERROR_NETNAME_DELETEDr r r r r ZSelectSelectorr r r r r r r r r �<module>
s�
PJ=
,+ 8 P