OwlCyberSecurity - MANAGER
Edit File: download.cpython-38.pyc
U ��.eEQ � @ s� d dl mZ d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl m Z d dl m Z m Z d dlmZ d dlmZ d dlmZmZ d dlmZ d d lmZ d d lmZ d d l m Z d d l m Z m Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z' d d l(m)Z) d dl*m+Z+ d dl,m-Z- d dl.m/Z/ d dl0m1Z1 d dl2m3Z3 e+�r�d dl4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z: d dl;m<Z< d dl=m>Z> d dl?m@Z@ d dlAmBZB e�r�e<de6eCe7eC ge7eC f eDd�dd�ZEn8e<de6eCeCgdf e6eCe7eC ge7eC f eDeDd �dd�ZEd d d d d!d"d#gZFe�GeH�ZId=d$d �ZJe�Kd%ejL�ZMd&d � ZNd'd(� ZOd)d*� ZPd+d,� ZQd-d.� ZRd>d0d �ZSd1d2� ZTd3d4� ZUd?d5d �ZVd@d6d!�ZWd7d#� ZXd8d"� ZYd9d:� ZZd;d<� Z[dS )A� )�absolute_importN)�requests)�CONTENT_CHUNK_SIZE�Response)�PY2)�parse)� HashMismatch�InstallationError)�PyPI)� PipSession)� auto_decode)� copy2_fixed) �ask_path_exists� backup_dir�consume� display_path� format_size�hide_url�path_to_display�rmtree�splitext)� TempDirectory)�MYPY_CHECK_RUNNING)�DownloadProgressProvider)� unpack_file)�get_url_scheme)�vcs)�IO�Callable�List�Optional�Text�Tuple)� TypedDict)�Link)�Hashes)�VersionControl�CopytreeKwargs��ignore�symlinksF)Ztotal)� copy_functionr) Zignore_dangling_symlinksr* �get_file_content�unpack_vcs_link�unpack_file_url�unpack_http_url� unpack_url�parse_content_disposition�sanitize_content_filenamec C s6 |dkrt d��t| �}|dkr>|�| �}|�� |j|jfS |dkr�|rd|�d�rdtd|| f ��| �dd�d }|� d d �}t � |�}|r�|� d�d |�d d�d }t �|�}|�d �r�d |�d � }|} z&t| d ��}t|�� �}W 5 Q R X W n4 tk �r, } ztd t| � ��W 5 d} ~ X Y nX | |fS )a* Gets the content of a file; it may be a filename, file: URL, or http: URL. Returns (location, content). Content is unicode. :param url: File path or url. :param comes_from: Origin description of requirements. :param session: Instance of pip.download.PipSession. NzAget_file_content() missing 1 required keyword argument: 'session')�httpZhttps�filer3 z6Requirements file %s references URL %s, which is local�:� �\�/�|�rbz$Could not open requirements file: %s)� TypeErrorr �get�raise_for_status�url�text� startswithr �split�replace�_url_slash_drive_re�match�group� urllib_parseZunquote�lstrip�openr �read�IOError�str) r> Z comes_from�session�scheme�resp�pathrD �fZcontent�exc� rR �:/usr/lib/python3.8/site-packages/pip/_internal/download.pyr, U sB � �� �z /*([a-z])\|c C s, t | �}|d k st�|j|t| j�d� d S )N)r> )�_get_used_vcs_backend�AssertionError�unpackr r> )�link�location� vcs_backendrR rR rS r- � s c C s$ t jD ]}| j|jkr| S qdS )z1 Return a VersionControl object or None. N)r ZbackendsrM Zschemes)rW rY rR rR rS rT � s rT c O s | S �NrR )�iterable�args�kwargsrR rR rS �_progress_indicator� s r^ c s6 zt �jd �}W n tttfk r0 d}Y nX t�dd�}t�� tj krRd}n&|r\d}n |dkrjd}n|std}nd}|j }�fdd�} � fd d �} t } |j t j kr�|} n|j} |r�t||d �} |r�t�d | t|�� n t�d | � n |r�t�d| � n t�d | � | | | t�t��} |�r*|�| � nt| � d S )Nzcontent-lengthr Z from_cacheFi@� Tc 3 sT z � j j| dd�D ] }|V qW n. tk rN � j �| �}|sBqJ|V q0Y nX d S )NF)Zdecode_content)�raw�stream�AttributeErrorrI )Z chunk_size�chunk)rN rR rS � resp_read� s � z _download_url.<locals>.resp_readc 3 s | D ]}� � |� |V qd S rZ )�write)Zchunksrb )� content_filerR rS �written_chunks� s z%_download_url.<locals>.written_chunks)�maxzDownloading %s (%s)zDownloading %szUsing cached %s)�int�headers� ValueError�KeyErrorr; �getattr�loggerZgetEffectiveLevel�logging�INFO�show_urlr^ Znetlocr Zurl_without_fragmentr �infor r Zcheck_against_chunksr )rN rW re �hashes� progress_barZ total_lengthZ cached_respZ show_progressrp rc rf Zprogress_indicatorr> Zdownloaded_chunksrR )re rN rS � _download_url� sP % � �� rt c C s� d}t j�||j�}t j�|�r�tdt|� d�}|dkr@d}nj|dkrdt�dt|�� t � |� nF|dkr�t |�}t�d t|�t|�� t � ||� n|d kr�t �d � |r�t �| |� t�d t|�� d S ) NTz8The file %s exists. (i)gnore, (w)ipe, (b)ackup, (a)abort)�i�w�b�aru Frv z Deleting %srw zBacking up %s to %srx ���zSaved %s)�osrO �join�filename�existsr r rm �warning�remover �shutilZmove�sys�exit�copyrq )r| rX rW r� Zdownload_location�responseZ dest_filerR rR rS � _copy_file s6 �� � r� �onc C s� |d krt d��tdd��v}d }|r0t| ||�}|rH|}t�|�d } nt| ||j||�\}} t||| � |r~|s~t||| � |s�t � |� W 5 Q R X d S )Nz@unpack_http_url() missing 1 required keyword argument: 'session'rV )Zkindr ) r; r �_check_download_dir� mimetypes� guess_type�_download_http_urlrO r r� rz �unlink) rW rX � download_dirrL rr rs �temp_dir�already_downloaded_path� from_path� content_typerR rR rS r/ s2 � �� c C sT zt | |� W n@ tjk rN } z t�dt|�t| �t|�� W 5 d}~X Y nX dS )z�Copying special files is not supported, but as a convenience to users we skip errors copying them. This supports tools that may create e.g. socket files in the project source directory. z>Ignoring special file error '%s' encountered copying %s to %s.N)r r� ZSpecialFileErrorrm r~ rK r )�src�dest�erR rR rS � _copy2_ignoring_special_filesJ s �r� c s` t j�|�}t j�|��t j�|��� ��fdd�}t|dd�}tsLt|d< tj � |f|� d S )Nc s6 g }| � kr|ddg7 }t j�| ��kr2|�g7 }|S )Nz.toxz.nox)rz rO �abspath)�d�namesZskipped��sourceZtarget_basenameZtarget_dirnamerR rS r) e s z!_copy_source_tree.<locals>.ignoreTr( r+ ) rz rO r� �basename�dirname�dictr r� r� Zcopytree)r� �targetZtarget_abspathr) r] rR r� rS �_copy_source_tree_ s r� c C s� | j }| �� r>tj�|�r"t|� t||� |r:t�d� dS |rL|� |� d}|r`t | ||�}|rj|}n|}t � |�d }t |||� |r�|s�t||| � dS )z�Unpack link into location. If download_dir is provided and link points to a file, make a copy of the link file inside download_dir. z*Link is a directory, ignoring download_dirNr )� file_pathZis_existing_dirrz rO �isdirr r� rm rq �check_against_pathr� r� r� r r� )rW rX r� rr Z link_pathr� r� r� rR rR rS r. ~ s. � c C sP | j rt| |� n:| jr*t| |||d� n"|dkr8t� }t| |||||d� dS )av Unpack link. If link is a VCS link: if only_download, export into download_dir and ignore location else unpack into location for other types of link: - unpack into location - if download_dir, copy the file into download_dir - if only_download, mark location for deletion :param hashes: A Hashes object, one of whose embedded hashes must match, or HashMismatch will be raised. If the Hashes is empty, no matches are required, and unhashable types of requirements (like VCS ones, which would ordinarily raise HashUnsupported) are allowed. )rr N)rr rs )Zis_vcsr- �is_filer. r r/ )rW rX r� rL rr rs rR rR rS r0 � s �c C s t j�| �S )zJ Sanitize the "filename" value from a Content-Disposition header. )rz rO r� )r| rR rR rS r2 � s c C s, t �| �\}}|�d�}|r$t|�}|p*|S )z� Parse the "filename" value from a Content-Disposition header, and return the default filename if the result is empty. r| )�cgiZ parse_headerr< r2 )�content_dispositionZdefault_filenameZ_typeZparamsr| rR rR rS r1 � s c C s* | j �dd�d }z |j|ddidd�}|�� W n8 tjk rj } zt�d|jj | � � W 5 d }~X Y nX |j �d d �}| j } |j �d �} | r�t | | �} t | �d } | s�t�|�} | r�| | 7 } | s�| j |j kr�tj� |j �d } | r�| | 7 } tj�|| �} t| d ��} t|| | ||� W 5 Q R X | |fS )z6Download link url into temp_dir using provided session�#r6 r zAccept-EncodingZidentityT)ri r` z HTTP error %s while getting %sNz content-type� zcontent-disposition�wb)r> rA r< r= r Z HTTPErrorrm Zcriticalr� Z status_coderi r| r1 r r� Zguess_extensionrz rO r{ rH rt )rW rL r� rr rs Z target_urlrN rQ r� r| r� Zextr� re rR rR rS r� � sB � � r� c C sp t j�|| j�}t j�|�s dS t�d|� |rlz|�|� W n, tk rj t� d|� t � |� Y dS X |S )z� Check download_dir for previously downloaded file with correct hash If a correct file is found return its path else None Nz File was already downloaded %sz;Previously-downloaded file %s has bad hash. Re-downloading.) rz rO r{ r| r} rm rq r� r r~ r� )rW r� rr Z download_pathrR rR rS r� 7 s � r� )NN)NNNr� )NN)NNNr� )\Z __future__r r� rn r� rz �rer� r� Z pip._vendorr Zpip._vendor.requests.modelsr r Zpip._vendor.sixr Z pip._vendor.six.moves.urllibr rF Zpip._internal.exceptionsr r Zpip._internal.models.indexr Z pip._internal.network.sessionr Z pip._internal.utils.encodingr Z pip._internal.utils.filesystemr Zpip._internal.utils.miscr r r r r r r r r Z pip._internal.utils.temp_dirr Zpip._internal.utils.typingr Zpip._internal.utils.uir Z pip._internal.utils.unpackingr Zpip._internal.utils.urlsr Zpip._internal.vcsr �typingr r r r r! r" Zmypy_extensionsr# Zpip._internal.models.linkr$ Zpip._internal.utils.hashesr% Z pip._internal.vcs.versioncontrolr& rK �boolr' �__all__Z getLogger�__name__rm r, �compile�IrC r- rT r^ rt r� r/ r� r� r. r0 r2 r1 r� r� rR rR rR rS �<module> s� , �� �� � 0 d � -" � 8 � .?