OwlCyberSecurity - MANAGER
Edit File: database.cpython-38.pyc
U ��.eU� � @ s� d Z ddlmZ ddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl m Z mZ ddlmZ ddlmZmZ ddlmZmZmZmZ dd lmZmZm Z m Z m Z m Z m Z d d d d dgZ!e�"e#�Z$dZ%dZ&deddde%dfZ'dZ(G dd� de)�Z*G dd� de)�Z+G dd � d e)�Z,G dd � d e,�Z-G d d � d e-�Z.G d d � d e-�Z/e.Z0e/Z1G d d � d e)�Z2d)d!d"�Z3d#d$� Z4d%d&� Z5d'd(� Z6dS )*zPEP 376 implementation.� )�unicode_literalsN� )�DistlibException� resources)�StringIO)� get_scheme�UnsupportedVersionError)�Metadata�METADATA_FILENAME�WHEEL_METADATA_FILENAME�LEGACY_METADATA_FILENAME)�parse_requirement�cached_property�parse_name_and_version� read_exports� write_exports� CSVReader� CSVWriter� Distribution�BaseInstalledDistribution�InstalledDistribution�EggInfoDistribution�DistributionPathzpydist-exports.jsonzpydist-commands.jsonZ INSTALLER�RECORD� REQUESTED� RESOURCES�SHAREDz .dist-infoc @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) �_CachezL A simple cache mapping names and .dist-info paths to distributions c C s i | _ i | _d| _dS )zZ Initialise an instance. There is normally one for each DistributionPath. FN)�name�path� generated��self� r# �@/usr/lib/python3.8/site-packages/pip/_vendor/distlib/database.py�__init__1 s z_Cache.__init__c C s | j �� | j�� d| _dS )zC Clear the cache, setting it to its initial state. FN)r �clearr r r! r# r# r$ r& 9 s z _Cache.clearc C s2 |j | j kr.|| j |j < | j�|jg ��|� dS )z` Add a distribution to the cache. :param dist: The distribution to add. N)r r � setdefault�key�append�r" �distr# r# r$ �addA s z _Cache.addN)�__name__� __module__� __qualname__�__doc__r% r& r, r# r# r# r$ r - s r c @ s� e Zd ZdZd dd�Zdd� Zdd � Zeee�Zd d � Z d d � Z dd� Z e dd� �Z dd� Zdd� Zd dd�Zdd� Zd dd�ZdS ) r zU Represents a set of distributions installed on a path (typically sys.path). NFc C sD |dkrt j}|| _d| _|| _t� | _t� | _d| _td�| _ dS )a� Create an instance from a path, optionally including legacy (distutils/ setuptools/distribute) distributions. :param path: The path to use, as a list of directories. If not specified, sys.path is used. :param include_egg: If True, this instance will look for and return legacy distributions as well as those based on PEP 376. NT�default) �sysr � _include_dist� _include_eggr �_cache� _cache_egg�_cache_enabledr �_scheme)r" r Z include_eggr# r# r$ r% O s zDistributionPath.__init__c C s | j S �N�r7 r! r# r# r$ �_get_cache_enabledc s z#DistributionPath._get_cache_enabledc C s || _ d S r9 r: )r" �valuer# r# r$ �_set_cache_enabledf s z#DistributionPath._set_cache_enabledc C s | j �� | j�� dS )z, Clears the internal cache. N)r5 r& r6 r! r# r# r$ � clear_cachek s z DistributionPath.clear_cachec c sD t � }| jD �]0}t�|�}|dkr&q |�d�}|r |js<q t|j�}|D ]�}|�|�}|rJ|j|krhqJ| j�r|�t ��rt t t g}|D ]"}t �||�} |�| �} | r� q�q�qJt�| �� ��} t| dd�} W 5 Q R X t�d|j� |�|j� t|j| | d�V qJ| jrJ|�d�rJt�d|j� |�|j� t|j| �V qJq dS )zD Yield .dist-info and/or .egg(-info) distributions. N� �legacy��fileobj�schemezFound %s)�metadata�env)� .egg-info�.egg)�setr r �finder_for_path�findZ is_container�sortedr3 �endswith� DISTINFO_EXTr r r � posixpath�join� contextlib�closing� as_streamr �logger�debugr, �new_dist_classr4 �old_dist_class) r" �seenr �finder�rZrset�entryZpossible_filenamesZmetadata_filenameZ metadata_pathZpydist�streamrD r# r# r$ �_yield_distributionss sF � � z%DistributionPath._yield_distributionsc C sp | j j }| jo| jj }|s"|rl| �� D ](}t|t�rF| j �|� q*| j�|� q*|r`d| j _|rld| j_dS )zk Scan the path for distributions and populate the cache with those that are found. TN)r5 r r4 r6 r\ � isinstancer r, )r" Zgen_distZgen_eggr+ r# r# r$ �_generate_cache� s z DistributionPath._generate_cachec C s |� dd�}d�||g�t S )ao The *name* and *version* parameters are converted into their filename-escaped form, i.e. any ``'-'`` characters are replaced with ``'_'`` other than the one in ``'dist-info'`` and the one separating the name from the version number. :parameter name: is converted to a standard distribution name by replacing any runs of non- alphanumeric characters with a single ``'-'``. :type name: string :parameter version: is converted to a standard version string. Spaces become dots, and all other non-alphanumeric characters (except dots) become dashes, with runs of multiple dashes condensed to a single dash. :type version: string :returns: directory name :rtype: string�-�_)�replacerO rM )�clsr �versionr# r# r$ �distinfo_dirname� s z!DistributionPath.distinfo_dirnamec c s^ | j s | �� D ] }|V qn>| �� | jj�� D ] }|V q0| jrZ| jj�� D ] }|V qNdS )a5 Provides an iterator that looks for distributions and returns :class:`InstalledDistribution` or :class:`EggInfoDistribution` instances for each one of them. :rtype: iterator of :class:`InstalledDistribution` and :class:`EggInfoDistribution` instances N)r7 r\ r^ r5 r �valuesr4 r6 r* r# r# r$ �get_distributions� s z"DistributionPath.get_distributionsc C s� d}|� � }| js4| �� D ]}|j|kr|} q|qnH| �� || jjkrZ| jj| d }n"| jr||| jjkr|| jj| d }|S )a= Looks for a named distribution on the path. This function only returns the first result found, as no more than one value is expected. If nothing is found, ``None`` is returned. :rtype: :class:`InstalledDistribution`, :class:`EggInfoDistribution` or ``None`` Nr ) �lowerr7 r\ r( r^ r5 r r4 r6 )r" r �resultr+ r# r# r$ �get_distribution� s z!DistributionPath.get_distributionc c s� d}|dk rJz| j �d||f �}W n$ tk rH td||f ��Y nX | �� D ]p}t|d�snt�d|� qR|j}|D ]H}t |�\}}|dkr�||kr�|V qRqx||krx|� |�rx|V qRqxqRdS )a Iterates over all distributions to find which distributions provide *name*. If a *version* is provided, it will be used to filter the results. This function only returns the first result found, since no more than one values are expected. If the directory is not found, returns ``None``. :parameter version: a version specifier that indicates the version required, conforming to the format in ``PEP-345`` :type name: string :type version: string N�%s (%s)z invalid name or version: %r, %r�provideszNo "provides": %s) r8 �matcher� ValueErrorr rf �hasattrrS rT rk r �match) r" r rc rl r+ �provided�p�p_name�p_verr# r# r$ �provides_distribution� s* � z&DistributionPath.provides_distributionc C s( | � |�}|dkr td| ��|�|�S )z5 Return the path to a resource file. Nz no distribution named %r found)ri � LookupError�get_resource_path)r" r � relative_pathr+ r# r# r$ � get_file_path! s z DistributionPath.get_file_pathc c sX | � � D ]J}|j}||kr|| }|dk r>||krR|| V q|�� D ] }|V qFqdS )z� Return all of the exported entries in a particular category. :param category: The category to search for entries. :param name: If specified, only entries with that name are returned. N)rf �exportsre )r" �categoryr r+ rY �d�vr# r# r$ �get_exported_entries* s z%DistributionPath.get_exported_entries)NF)N)N)r- r. r/ r0 r% r; r= �propertyZ cache_enabledr> r\ r^ � classmethodrd rf ri rt rx r} r# r# r# r$ r K s , ) c @ s� e Zd ZdZdZdZdd� Zedd� �ZeZ edd� �Z ed d � �Z d d � Z ed d� �Z edd� �Zedd� �Zedd� �Zedd� �Zdd� Zdd� Zdd � Zd d � Zd S ) r z� A base class for distributions, whether installed or from indexes. Either way, it must have some metadata, so that's all that's needed for construction. Fc C sL || _ |j| _| j�� | _|j| _d| _d| _d| _d| _t � | _ i | _ dS )z� Initialise an instance. :param metadata: The instance of :class:`Metadata` describing this distribution. N) rD r rg r( rc Zlocator�digest�extras�contextrH Z download_urlsZdigests)r" rD r# r# r$ r% O s zDistribution.__init__c C s | j jS )zH The source archive download URL for this distribution. )rD � source_urlr! r# r# r$ r� ` s zDistribution.source_urlc C s d| j | jf S )zX A utility property which displays the name and version in parentheses. rj �r rc r! r# r# r$ �name_and_versioni s z Distribution.name_and_versionc C s. | j j}d| j| jf }||kr*|�|� |S )z� A set of distribution names and versions provided by this distribution. :return: A set of "name (version)" strings. rj )rD rk r rc r) )r" Zplist�sr# r# r$ rk p s zDistribution.providesc C s8 | j }t�d|�� � t||�}t|j|| j| jd��S )Nz%Getting requirements from metadata %r)r� rE ) rD rS rT Ztodict�getattrrH Zget_requirementsr� r� )r" Zreq_attr�mdZreqtsr# r# r$ �_get_requirements| s �z Distribution._get_requirementsc C s | � d�S )N� run_requires�r� r! r# r# r$ r� � s zDistribution.run_requiresc C s | � d�S )N� meta_requiresr� r! r# r# r$ r� � s zDistribution.meta_requiresc C s | � d�S )N�build_requiresr� r! r# r# r$ r� � s zDistribution.build_requiresc C s | � d�S )N� test_requiresr� r! r# r# r$ r� � s zDistribution.test_requiresc C s | � d�S )N� dev_requiresr� r! r# r# r$ r� � s zDistribution.dev_requiresc C s� t |�}t| jj�}z|�|j�}W n6 tk rZ t�d|� |� � d }|�|�}Y nX |j }d}| j D ]D}t |�\}} ||kr�qlz|� | �}W q�W ql tk r� Y qlX ql|S )z� Say if this instance matches (fulfills) a requirement. :param req: The requirement to match. :rtype req: str :return: True if it matches, else False. �+could not read version %r - using name onlyr F)r r rD rC rl � requirementr rS �warning�splitr( rk r ro ) r" �reqrY rC rl r rh rq rr rs r# r# r$ �matches_requirement� s, � z Distribution.matches_requirementc C s( | j rd| j }nd}d| j| j|f S )zC Return a textual representation of this instance, z [%s]r? z<Distribution %s (%s)%s>)r� r rc )r" �suffixr# r# r$ �__repr__� s zDistribution.__repr__c C s> t |�t | �k rd}n$| j|jko8| j|jko8| j|jk}|S )a< See if this distribution is the same as another. :param other: The distribution to compare with. To be equal to one another. distributions must have the same type, name, version and source_url. :return: True if it is the same, else False. F)�typer rc r� )r" �otherrh r# r# r$ �__eq__� s � �zDistribution.__eq__c C s t | j�t | j� t | j� S )zH Compute hash in a way which matches the equality test. )�hashr rc r� r! r# r# r$ �__hash__� s zDistribution.__hash__N)r- r. r/ r0 Zbuild_time_dependency� requestedr% r~ r� Z download_urlr� rk r� r� r� r� r� r� r� r� r� r� r# r# r# r$ r = s4 " c s0 e Zd ZdZdZd� fdd� Zddd�Z� ZS ) r z] This is the base class for installed distributions (whether PEP 376 or legacy). Nc s t t| ��|� || _|| _dS )a Initialise an instance. :param metadata: An instance of :class:`Metadata` which describes the distribution. This will normally have been initialised from a metadata file in the ``path``. :param path: The path of the ``.dist-info`` or ``.egg-info`` directory for the distribution. :param env: This is normally the :class:`DistributionPath` instance where this distribution was found. N)�superr r% r � dist_path)r" rD r rE �� __class__r# r$ r% � s z"BaseInstalledDistribution.__init__c C sd |dkr| j }|dkr"tj}d}ntt|�}d| j }||��� }t�|��d��d�}d||f S )a� Get the hash of some data, using a particular hash algorithm, if specified. :param data: The data to be hashed. :type data: bytes :param hasher: The name of a hash implementation, supported by hashlib, or ``None``. Examples of valid values are ``'sha1'``, ``'sha224'``, ``'sha384'``, '``sha256'``, ``'md5'`` and ``'sha512'``. If no hasher is specified, the ``hasher`` attribute of the :class:`InstalledDistribution` instance is used. If the hasher is determined to be ``None``, MD5 is used as the hashing algorithm. :returns: The hash of the data. If a hasher was explicitly specified, the returned hash will be prefixed with the specified hasher followed by '='. :rtype: str Nr? z%s=� =�ascii�%s%s) �hasher�hashlib�md5r� r� �base64Zurlsafe_b64encode�rstrip�decode)r" �datar� �prefixr� r# r# r$ �get_hash� s z"BaseInstalledDistribution.get_hash)N)N)r- r. r/ r0 r� r% r� � __classcell__r# r# r� r$ r � s c s� e Zd ZdZdZd'� fdd� Zdd� Zdd � Zd d � Ze d d � �Z dd� Z dd� Z dd� Z dd� Zd(dd�Zdd� Ze dd � �Zd)d d �Zd d � Zd!d"� Zd#d$� Zd%d&� ZejZ� ZS )*r a Created with the *path* of the ``.dist-info`` directory provided to the constructor. It reads the metadata contained in ``pydist.json`` when it is instantiated., or uses a passed in Metadata instance (useful for when dry-run mode is being used). Zsha256Nc sJ g | _ t�|� | _}|d kr*td| ��|rP|jrP||jjkrP|jj| j}nt|d kr�|� t �}|d krt|� t �}|d kr�|� d�}|d kr�tdt |f ��t � |�� ��}t|dd�}W 5 Q R X tt| ��|||� |r�|jr�|j�| � |� d�}|d k | _tj�|d�}tj�|��rFt|d��}|�� } W 5 Q R X | �� | _ d S ) Nzfinder unavailable for %sZMETADATAzno %s found in %sr@ rA r � top_level.txt�rb)�modulesr rI rX rm r7 r5 r rD rJ r r rP rQ rR r r� r r% r, r� �osrO �exists�open�read� splitlines) r" r rD rE rX rY r[ rq �fr� r� r# r$ r% s8 � z InstalledDistribution.__init__c C s d| j | j| jf S )Nz#<InstalledDistribution %r %s at %r>�r rc r r! r# r# r$ r� = s �z InstalledDistribution.__repr__c C s d| j | jf S �Nz%s %sr� r! r# r# r$ �__str__A s z InstalledDistribution.__str__c C s� g }| � d�}t�|�� ��\}t|d��F}|D ]:}dd� tt|�d�D �}|| \}}} |�||| f� q.W 5 Q R X W 5 Q R X |S )a" Get the list of installed files for the distribution :return: A list of tuples of path, hash and size. Note that hash and size might be ``None`` for some entries. The path is exactly as stored in the file (which is as in PEP 376). r �r[ c S s g | ]}d �qS r9 r# )�.0�ir# r# r$ � <listcomp>S s z6InstalledDistribution._get_records.<locals>.<listcomp>� )�get_distinfo_resourcerP rQ rR r �range�lenr) ) r" �resultsrY r[ Z record_reader�row�missingr �checksum�sizer# r# r$ � _get_recordsD s &z"InstalledDistribution._get_recordsc C s i }| � t�}|r| �� }|S )a Return the information exported by this distribution. :return: A dictionary of exports, mapping an export category to a dict of :class:`ExportEntry` instances describing the individual export entries, and keyed by name. )r� �EXPORTS_FILENAMEr )r" rh rY r# r# r$ ry [ s z InstalledDistribution.exportsc C s8 i }| � t�}|r4t�|�� ��}t|�}W 5 Q R X |S )z� Read exports data from a file in .ini format. :return: A dictionary of exports, mapping an export category to a list of :class:`ExportEntry` instances describing the individual export entries. )r� r� rP rQ rR r )r" rh rY r[ r# r# r$ r i s z"InstalledDistribution.read_exportsc C s. | � t�}t|d��}t||� W 5 Q R X dS )a Write a dictionary of exports to a file in .ini format. :param exports: A dictionary of exports, mapping an export category to a list of :class:`ExportEntry` instances describing the individual export entries. �wN)�get_distinfo_filer� r� r )r" ry Zrfr� r# r# r$ r x s z#InstalledDistribution.write_exportsc C s� | � d�}t�|�� ��R}t|d��<}|D ]0\}}||kr*| W 5 Q R � W 5 Q R � S q*W 5 Q R X W 5 Q R X td| ��dS )aW NOTE: This API may change in the future. Return the absolute path to a resource file with the given relative path. :param relative_path: The path, relative to .dist-info, of the resource of interest. :return: The absolute path where the resource is to be found. r r� z3no resource file with relative path %r is installedN)r� rP rQ rR r �KeyError)r" rw rY r[ Zresources_reader�relativeZ destinationr# r# r$ rv � s 6�z'InstalledDistribution.get_resource_pathc c s | � � D ] }|V qdS )z� Iterates over the ``RECORD`` entries and returns a tuple ``(path, hash, size)`` for each line. :returns: iterator of (path, hash, size) N)r� )r" rh r# r# r$ �list_installed_files� s z*InstalledDistribution.list_installed_filesFc C s( t j�|d�}t j�| j�}|�|�}t j�|d�}| �d�}t�d|� |rRdS t|���}|D ]�}t j� |�sz|� d�r�d } } n4dt j� |� } t |d��} | � | �� �} W 5 Q R X |�|�s�|r�|�|�r�t j�||�}|�|| | f� q`|�|��r t j�||�}|�|ddf� W 5 Q R X |S )z� Writes the ``RECORD`` file, using the ``paths`` iterable passed in. Any existing ``RECORD`` file is silently overwritten. prefix is used to determine when to write absolute paths. r? r � creating %sN�z.pycz.pyoz%dr� )r� r rO �dirname� startswithr� rS �infor �isdirrL �getsizer� r� r� �relpathZwriterow) r" �pathsr� �dry_run�baseZbase_under_prefix� record_path�writerr � hash_valuer� �fpr# r# r$ �write_installed_files� s0 � z+InstalledDistribution.write_installed_filesc C s g }t j�| j�}| �d�}| �� D ]�\}}}t j�|�sHt j�||�}||krRq$t j�|�sr|�|dddf� q$t j� |�r$t t j� |��}|r�||kr�|�|d||f� q$|r$d|kr�|� dd�d }nd }t |d ��2} | �| �� |�} | |k�r|�|d || f� W 5 Q R X q$|S ) � Checks that the hashes and sizes of the files in ``RECORD`` are matched by the files themselves. Returns a (possibly empty) list of mismatches. Each entry in the mismatch list will be a tuple consisting of the path, 'exists', 'size' or 'hash' according to what didn't match (existence is checked first, then size, then hash), the expected value and the actual value. r r� TFr� �=r r Nr� r� )r� r r� r� r� �isabsrO r� r) �isfile�strr� r� r� r� r� ) r" � mismatchesr� r� r r� r� Z actual_sizer� r� Z actual_hashr# r# r$ �check_installed_files� s. z+InstalledDistribution.check_installed_filesc C s� i }t j�| jd�}t j�|�r�tj|ddd��}|�� �� }W 5 Q R X |D ]8}|�dd�\}}|dkr||� |g �� |� qL|||< qL|S )a� A dictionary of shared locations whose keys are in the set 'prefix', 'purelib', 'platlib', 'scripts', 'headers', 'data' and 'namespace'. The corresponding value is the absolute path of that category for this distribution, and takes into account any paths selected by the user at installation time (e.g. via command-line arguments). In the case of the 'namespace' key, this would be a list of absolute paths for the roots of namespace packages in this distribution. The first time this property is accessed, the relevant information is read from the SHARED file in the .dist-info directory. r rY �utf-8��encodingr� r � namespace) r� r rO r� �codecsr� r� r� r� r' r) )r" rh � shared_pathr� �lines�liner( r< r# r# r$ �shared_locations� s z&InstalledDistribution.shared_locationsc C s� t j�| jd�}t�d|� |r$dS g }dD ].}|| }t j�|| �r,|�d||f � q,|�dd�D ]}|�d| � qhtj |d d d ��}|� d �|�� W 5 Q R X |S ) aa Write shared location information to the SHARED file in .dist-info. :param paths: A dictionary as described in the documentation for :meth:`shared_locations`. :param dry_run: If True, the action is logged but no file is actually written. :return: The path of the file written to. r r� N)r� �libZheadersZscriptsr� z%s=%sr� r# z namespace=%sr� r� r� � ) r� r rO rS r� r� r) �getr� r� �write) r" r� r� r� r� r( r �nsr� r# r# r$ �write_shared_locations s z,InstalledDistribution.write_shared_locationsc C sF |t krtd|| jf ��t�| j�}|d kr<td| j ��|�|�S )N�+invalid path for a dist-info file: %r at %rz Unable to get a finder for %s)� DIST_FILESr r r rI rJ )r" r rX r# r# r$ r� s � z+InstalledDistribution.get_distinfo_resourcec C s~ |� tj�dkrT|�tj�dd� \}}|| j�tj�d krTtd|| j| jf ��|tkrntd|| jf ��tj� | j|�S )a� Returns a path located under the ``.dist-info`` directory. Returns a string representing the path. :parameter path: a ``'/'``-separated path relative to the ``.dist-info`` directory or an absolute path; If *path* is an absolute path and doesn't start with the ``.dist-info`` directory path, a :class:`DistlibException` is raised :type path: str :rtype: str r ���N���z;dist-info file %r does not belong to the %r %s distributionr� ) rJ r� �sepr� r r r rc r� rO )r" r rd r# r# r$ r� $ s ���z'InstalledDistribution.get_distinfo_filec c sR t j�| j�}| �� D ]6\}}}t j�|�s:t j�||�}|�| j�r|V qdS )z� Iterates over the ``RECORD`` entries and returns paths for each line if the path is pointing to a file located in the ``.dist-info`` directory or one of its subdirectories. :returns: iterator of paths N)r� r r� r� r� rO r� )r" r� r r� r� r# r# r$ �list_distinfo_filesA s z)InstalledDistribution.list_distinfo_filesc C s t |t�o| j|jkS r9 )r] r r �r" r� r# r# r$ r� Q s �z InstalledDistribution.__eq__)NN)F)F)r- r. r/ r0 r� r% r� r� r� r ry r r rv r� r� r� r� r� r� r� r� r� �objectr� r� r# r# r� r$ r s, " ## c sj e Zd ZdZdZi Zd� fdd� Zdd� Zdd � Zd d � Z d d � Z dd� Z ddd�Z dd� Z ejZ� ZS )r a Created with the *path* of the ``.egg-info`` directory or file provided to the constructor. It reads the metadata contained in the file itself, or if the given path happens to be a directory, the metadata is read from the file ``PKG-INFO`` under that directory.TNc s� dd� }|| _ || _|rJ|jrJ||jj krJ|jj | j}|| |j|j� n0| �|�}|| |j|j� |rz|jrz|j�| � t t | �� |||� d S )Nc S s || _ |�� | _|| _d S r9 )r rg r( rc )r� �nr| r# r# r$ �set_name_and_versionc s z:EggInfoDistribution.__init__.<locals>.set_name_and_version) r r� r7 r6 rD r rc � _get_metadatar, r� r r% )r" r rE r� rD r� r# r$ r% b s z EggInfoDistribution.__init__c s� d }dd� � � fdd�}d }}|� d�r�tj�|�r�tj�|d�}tj�|d�}t|dd �}tj�|d �} tj�|d �}|| �}npt�|�} t| � d �� d ��} t| dd�}z,| � d�} | � d�� d�}� | � d��}W n t k r� d }Y nX nf|� d��rPtj�|��rBtj�|d �} || �}tj�|d�}tj�|d �}t|dd �}n t d| ��|�rl|� |� |d k�r�|d k �r�tj�|��r�t|d��} | �� � d�}W 5 Q R X |�s�g }n|�� }|| _|S )Nc S s� g }| � � }|D ]�}|�� }|�d�r6t�d|� q�t|�}|sPt�d|� q|jr`t�d� |jst|�|j � qd� dd� |jD ��}|�d|j |f � q|S ) z�Create a list of dependencies from a requires.txt file. *data*: the contents of a setuptools-produced requires.txt file. �[z.Unexpected line: quitting requirement scan: %rz#Not recognised as a requirement: %rz4extra requirements in requires.txt are not supportedz, c s s | ]}d | V qdS )r� Nr# )r� �cr# r# r$ � <genexpr>� s zQEggInfoDistribution._get_metadata.<locals>.parse_requires_data.<locals>.<genexpr>rj ) r� �stripr� rS r� r r� Z constraintsr) r rO )r� �reqsr� r� rY Zconsr# r# r$ �parse_requires_dataz s( � z>EggInfoDistribution._get_metadata.<locals>.parse_requires_datac sH g }z*t �| dd��}� |�� �}W 5 Q R X W n tk rB Y nX |S )z�Create a list of dependencies from a requires.txt file. *req_path*: the path to a setuptools-produced requires.txt file. rY r� )r� r� r� �IOError)�req_pathr r� �r r# r$ �parse_requires_path� s z>EggInfoDistribution._get_metadata.<locals>.parse_requires_pathrG zEGG-INFOzPKG-INFOr@ )r rC z requires.txtr� zEGG-INFO/PKG-INFO�utf8rA zEGG-INFO/requires.txtzEGG-INFO/top_level.txtr� rF z,path must end with .egg-info or .egg, got %rr� )rL r� r r� rO r � zipimport� zipimporterr �get_datar� r r Zadd_requirementsr� r� r� r� r� )r" r �requiresr Ztl_pathZtl_datarq � meta_pathrD r ZzipfrB r� r� r# r r$ r� w sX � � z!EggInfoDistribution._get_metadatac C s d| j | j| jf S )Nz!<EggInfoDistribution %r %s at %r>r� r! r# r# r$ r� � s �z EggInfoDistribution.__repr__c C s d| j | jf S r� r� r! r# r# r$ r� � s zEggInfoDistribution.__str__c C s` g }t j�| jd�}t j�|�r\| �� D ]2\}}}||kr<q(t j�|�s(|�|dddf� q(|S )r� �installed-files.txtr� TF)r� r rO r� r� r) )r" r� r� r r` r# r# r$ r� � s z)EggInfoDistribution.check_installed_filesc C s� dd� }dd� }t j�| jd�}g }t j�|�r�tj|ddd��x}|D ]l}|�� }t j�t j�| j|��}t j�|�s�t� d |� |� d �r�qFt j� |�sF|� |||�||�f� qFW 5 Q R X |� |d d f� |S ) z� Iterates over the ``installed-files.txt`` entries and returns a tuple ``(path, hash, size)`` for each line. :returns: a list of (path, hash, size) c S s0 t | d�}z |�� }W 5 |�� X t�|��� S )Nr� )r� �closer� r� r� Z hexdigest)r r� Zcontentr# r# r$ �_md5� s z6EggInfoDistribution.list_installed_files.<locals>._md5c S s t �| �jS r9 )r� �stat�st_size)r r# r# r$ �_size� s z7EggInfoDistribution.list_installed_files.<locals>._sizer rY r� r� zNon-existent file: %sr� N) r� r rO r� r� r� r �normpathrS r� rL r� r) )r" r r r� rh r� r� rq r# r# r$ r� � s" $z(EggInfoDistribution.list_installed_filesFc c s� t j�| jd�}t j�|�r�d}tj|ddd��`}|D ]T}|�� }|dkrPd}q6|s6t j�t j�| j|��}|�| j�r6|r�|V q6|V q6W 5 Q R X dS ) a Iterates over the ``installed-files.txt`` entries and returns paths for each line if the path is pointing to a file located in the ``.egg-info`` directory or one of its subdirectories. :parameter absolute: If *absolute* is ``True``, each returned path is transformed into a local absolute path. Otherwise the raw value from ``installed-files.txt`` is returned. :type absolute: boolean :returns: iterator of paths r TrY r� r� z./FN) r� r rO r� r� r� r r r� )r" Zabsoluter� �skipr� r� rq r# r# r$ r� s z'EggInfoDistribution.list_distinfo_filesc C s t |t�o| j|jkS r9 )r] r r r� r# r# r$ r� . s �zEggInfoDistribution.__eq__)N)F)r- r. r/ r0 r� r� r% r� r� r� r� r� r� r� r� r� r� r# r# r� r$ r Y s Z& c @ s^ e Zd ZdZdd� Zdd� Zddd�Zd d � Zd d � Zddd�Z ddd�Z dd� Z dd� Z dS )�DependencyGrapha� Represents a dependency graph between distributions. The dependency relationships are stored in an ``adjacency_list`` that maps distributions to a list of ``(other, label)`` tuples where ``other`` is a distribution and the edge is labeled with ``label`` (i.e. the version specifier, if such was provided). Also, for more efficient traversal, for every distribution ``x``, a list of predecessors is kept in ``reverse_list[x]``. An edge from distribution ``a`` to distribution ``b`` means that ``a`` depends on ``b``. If any missing dependencies are found, they are stored in ``missing``, which is a dictionary that maps distributions to a list of requirements that were not provided by any other distributions. c C s i | _ i | _i | _d S r9 )�adjacency_list� reverse_listr� r! r# r# r$ r% I s zDependencyGraph.__init__c C s g | j |< g | j|< dS )z�Add the *distribution* to the graph. :type distribution: :class:`distutils2.database.InstalledDistribution` or :class:`distutils2.database.EggInfoDistribution` N)r r )r" � distributionr# r# r$ �add_distributionN s z DependencyGraph.add_distributionNc C s6 | j | �||f� || j| kr2| j| �|� dS )a� Add an edge from distribution *x* to distribution *y* with the given *label*. :type x: :class:`distutils2.database.InstalledDistribution` or :class:`distutils2.database.EggInfoDistribution` :type y: :class:`distutils2.database.InstalledDistribution` or :class:`distutils2.database.EggInfoDistribution` :type label: ``str`` or ``None`` N)r r) r )r" �x�y�labelr# r# r$ �add_edgeX s zDependencyGraph.add_edgec C s& t �d||� | j�|g ��|� dS )a Add a missing *requirement* for the given *distribution*. :type distribution: :class:`distutils2.database.InstalledDistribution` or :class:`distutils2.database.EggInfoDistribution` :type requirement: ``str`` z %s missing %rN)rS rT r� r' r) )r" r r� r# r# r$ � add_missingg s zDependencyGraph.add_missingc C s d|j |jf S r� r� r* r# r# r$ � _repr_distr s zDependencyGraph._repr_distr c C s� | � |�g}| j| D ]h\}}| � |�}|dk r<d||f }|�d| t|� � | �||d �}|�d�}|�|dd� � qd�|�S )zPrints only a subgraphNz%s [%s]z r r� )r" r r) r� � repr_noder� �extendrO )r" r+ �level�outputr� r Z suboutputZsubsr# r# r$ r# u s zDependencyGraph.repr_nodeTc C s� g }|� d� | j�� D ]h\}}t|�dkr:|s:|�|� |D ]@\}}|dk rh|� d|j|j|f � q>|� d|j|jf � q>q|s�t|�dkr�|� d� |� d� |� d� |D ] }|� d |j � |� d � q�|� d � |� d � dS ) a9 Writes a DOT output for the graph to the provided file *f*. If *skip_disconnected* is set to ``True``, then all distributions that are not dependent on any other distribution are skipped. :type f: has to support ``file``-like operations :type skip_disconnected: ``bool`` zdigraph dependencies { r Nz"%s" -> "%s" [label="%s"] z "%s" -> "%s" zsubgraph disconnected { zlabel = "Disconnected" zbgcolor = red z"%s"r� z} )r� r �itemsr� r) r )r" r� Zskip_disconnectedZ disconnectedr+ �adjsr� r r# r# r$ �to_dot� s( � zDependencyGraph.to_dotc s� g }i }| j �� D ]\}}|dd� ||< qg � t|�� �dd� D ] \}}|sD� �|� ||= qD� shq�|�� D ] \}}� fdd�|D �||< qpt�ddd� � D �� |�� � q,|t|�� �fS )aa Perform a topological sort of the graph. :return: A tuple, the first element of which is a topologically sorted list of distributions, and the second element of which is a list of distributions that cannot be sorted because they have circular dependencies and so form a cycle. Nc s g | ]\}}|� kr||f�qS r# r# )r� r{ rY �Z to_remover# r$ r� � s z4DependencyGraph.topological_sort.<locals>.<listcomp>zMoving to result: %sc S s g | ]}d |j |jf �qS )rj r� )r� r{ r# r# r$ r� � s )r r' �listr) rS rT r$ �keys)r" rh Zalist�kr| r# r* r$ �topological_sort� s$ � z DependencyGraph.topological_sortc C s2 g }| j �� D ]\}}|�| �|�� qd�|�S )zRepresentation of the graphr� )r r' r) r# rO )r" r& r+ r( r# r# r$ r� � s zDependencyGraph.__repr__)N)r )T) r- r. r/ r0 r% r r r! r" r# r) r. r� r# r# r# r$ r 9 s r r1 c C sV t |�}t� }i }| D ]L}|�|� |jD ]6}t|�\}}t�d|||� |�|g ��||f� q*q| D ]�}|j |j B |j B |j B }|D ]�} z|� | �} W n6 tk r� t�d| � | �� d }|� |�} Y nX | j}d} ||k�r>|| D ]N\}} z| �|�} W n tk �r d} Y nX | r�|�|| | � d} �q>q�| s�|�|| � q�qh|S )a6 Makes a dependency graph from the given distributions. :parameter dists: a list of distributions :type dists: list of :class:`distutils2.database.InstalledDistribution` and :class:`distutils2.database.EggInfoDistribution` instances :rtype: a :class:`DependencyGraph` instance zAdd to provided: %s, %s, %sr� r FT)r r r rk r rS rT r' r) r� r� r� r� rl r r� r� r( ro r r! )�distsrC �graphrp r+ rq r rc r r� rl ZmatchedZproviderro r# r# r$ � make_graph� sN ��� r1 c C sv || krt d|j ��t| �}|g}|j| }|rh|�� }|�|� |j| D ]}||krN|�|� qNq.|�d� |S )z�Recursively generate a list of distributions from *dists* that are dependent on *dist*. :param dists: a list of distributions :param dist: a distribution, member of *dists* for which we are interested �1given distribution %r is not a member of the listr )r r r1 r �popr) )r/ r+ r0 Zdep�todor{ Zsuccr# r# r$ �get_dependent_dists� s � r5 c C sn || krt d|j ��t| �}g }|j| }|rj|�� d }|�|� |j| D ]}||krP|�|� qPq,|S )z�Recursively generate a list of distributions from *dists* that are required by *dist*. :param dists: a list of distributions :param dist: a distribution, member of *dists* for which we are interested r2 r )r r r1 r r3 r) )r/ r+ r0 r� r4 r{ Zpredr# r# r$ �get_required_dists s � r6 c K s4 |� dd�}tf |�}| |_||_|p(d|_t|�S )zO A convenience method for making a dist given just a name and version. �summaryzPlaceholder for summary)r3 r r rc r7 r )r rc �kwargsr7 r� r# r# r$ � make_dist2 s r9 )r1 )7r0 Z __future__r r� r� rP r� Zloggingr� rN r2 r r? r r �compatr rc r r rD r r r r �utilr r r r r r r �__all__Z getLoggerr- rS r� ZCOMMANDS_FILENAMEr� rM r� r r r r r r rU rV r r1 r5 r6 r9 r# r# r# r$ �<module> s` $ � � s 7 J ] 6