OwlCyberSecurity - MANAGER
Edit File: test_memory_leaks.cpython-36.pyc
3 ��JZ=G � @ s< d Z ddlmZ ddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl m Z ddl m Z ddl mZ ddl mZ ddl mZ dd l mZ dd lmZ dd lmZ dd lmZ dd lmZ ddlmZ ddlmZ ddlmZ ddlmZ ddlm Z ddlm Z ddlm Z ddlm Z ddlm Z ddlm!Z! ddlm"Z" ddlm#Z# ddlm$Z$ ddlm%Z% dd lm&Z& dd lm'Z' dd lm(Z( d Z)d Z*d!Z+e'�r�d"nd#Z,e j-j.Z.e j/� Z0e'�r�d"nd#Z,d$d%� Z1d&d'� Z2G d(d)� d)e(j3�Z4G d*d+� d+e4�Z5G d,d-� d-e5�Z6G d.d/� d/e4�Z7e8d0k�r8e#e9� dS )1a) Tests for detecting function memory leaks (typically the ones implemented in C). It does so by calling a function many times and checking whether process memory usage keeps increasing between calls or over time. Note that this may produce false positives (especially on Windows for some reason). � )�print_functionN)�LINUX)�OPENBSD)�OSX)�POSIX)�SUNOS)�WINDOWS)�xrange)�create_sockets)�get_test_subprocess)�HAS_CPU_AFFINITY)� HAS_CPU_FREQ)� HAS_ENVIRON)� HAS_IONICE)�HAS_MEMORY_MAPS)�HAS_PROC_CPU_NUM)�HAS_PROC_IO_COUNTERS)� HAS_RLIMIT)�HAS_SENSORS_BATTERY)�HAS_SENSORS_FANS)�HAS_SENSORS_TEMPERATURES)� reap_children)�run_test_module_by_name)� safe_rmpath)�skip_on_access_denied)�TESTFN)�TRAVIS)�unittesti� i � TFc C s t jto td�S )Nz worthless on LINUX (pure python))r �skipIfr �SKIP_PYTHON_IMPL� r! r! �)/usr/lib64/python3.6/test_memory_leaks.py� skip_if_linuxF s r# c C st d }i }x(t |�D ] \}}d |d d > ||< qW x8t|�D ],}| || kr<t| �|| }d ||f S q<W d | S )z� http://code.activestate.com/recipes/578019 >>> bytes2human(10000) '9.8K' >>> bytes2human(100001221) '95.4M' �K�M�G�T�P�E�Z�Y� � z%.2f%sz%sB)r$ r% r& r' r( r) r* r+ )� enumerate�reversed�float)�nZsymbols�prefix�i�s�valuer! r! r" � bytes2humanK s r6 c @ sL e Zd ZdZeZeZeZ dd� Z dd� Z dd� Z e dd � �Ze d d � �Zd S ) � TestMemLeakz�Base framework class which calls a function many times and produces a failure if process memory usage keeps increasing between calls or over time. c C s t j� d S )N)�gc�collect)�selfr! r! r" �setUpg s zTestMemLeak.setUpc s~ � ����fdd�}�j dd�p$�j}�j dd�p6�j��j dd�pH�j}x"td�D ]}�j�f� ��� qTW �jtjg � �jt j � d� �jt j � g � |� �j � }|� �j � } | | } | |k�rzd } tj� | } x,tj� | k�r�j�f� ��� | d7 } q�W ~ tj� �j � } | | }| | k�rzt| | �}td | tjd � d }|d 7 }|t| ��t|�| |f }�j|� dS )zTest a callable.c s2 x"t ��D ]} �j�f� ��� q W ~ tj� d S )N)r �_callr8 r9 )�x)�args�fun�kwargs�loopsr: r! r" �call_many_timesl s z,TestMemLeak.execute.<locals>.call_many_times� tolerance_NZloops_Z retry_for_r- r, r zexta proc mem: %s)�filez0+%s after %s calls, +%s after another %s calls, z+%s extra proc mem)�pop� tolerancerA � retry_for�ranger< Z assertEqualr8 Zgarbage� threadingZ active_count�thisproc�children�_get_mem�timer9 r6 �print�sys�stderrZfail)r: r? r> r@ rB rF rG r= Zmem1Zmem2Zdiff1ZncallsZstop_atZmem3Zdiff2Zextra_proc_mem�msgr! )r> r? r@ rA r: r" �executej sB zTestMemLeak.executec s" � ����fdd�}�j |� dS )zRConvenience function which tests a callable raising an exception. c s �j ��f� ��� d S )N)Z assertRaisesr! )r> �excr? r@ r: r! r" �call� s z'TestMemLeak.execute_w_exc.<locals>.callN)rR )r: rS r? r> r@ rT r! )r> rS r? r@ r: r" � execute_w_exc� s zTestMemLeak.execute_w_excc C s$ t s ts trtj� jS tj� jS d S )N)r r r rJ �memory_full_infoZuss� memory_infoZrssr! r! r! r" rL � s zTestMemLeak._get_memc O s | ||� d S )Nr! )r? r> r@ r! r! r" r< � s zTestMemLeak._callN)�__name__� __module__� __qualname__�__doc__�MEMORY_TOLERANCErF �LOOPSrA � RETRY_FORrG r; rR rU � staticmethodrL r< r! r! r! r" r7 ^ s ; r7 c @ s� e Zd ZdZeZdd� Ze� dd� �Ze� dd� �Z e� dd � �Z e� d d � �Z e j e d �e� d d� ��Ze j e d �e� dd� ��Ze� dd� �Zdd� Zdd� Ze j e d�dd� �Ze j e d�dd� �Ze j e d�e� d d � ��Ze j ed �d d � �Ze� d!d"� �Ze� ee d#�d$d%� ��Z e j e d&�d'd(� �Z e j e d �e� d)d*� ��Z e� d+d,� �Z!e� ee d#�d-d.� ��Z"e� d/d0� �Z#e� e j e$ d�d1d2� ��Z%e� d3d4� �Z&e� d5d6� �Z'e j e d �e� d7d8� ��Z(e j e�o�e)d9�d:d;� �Z*e� d<d=� �Z+e j e, d�d>d?� �Z-e j e, d�d@dA� �Z.e� dBdC� �Z/e j e0dD�e j e1 d�e� dEdF� ���Z2e j e3 dG�e j e4 d�dHdI� ��Z5e j e3 dG�e j e4 d�dJdK� ��Z6e� e j e dL�dMdN� ��Z7e j e8 d�dOdP� �Z9e j e d&�dQdR� �Z:dSS )T�TestProcessObjectLeaksz$Test leaks of Process class methods.c C sN t d�}x@ttj�D ]2}|jd�r$q||kr.q| jt| d| �|d� qW d S )N�pid�as_dictrK � cpu_affinity� cpu_percent�ionice� is_running�kill�memory_info_ex�memory_percent�nice�oneshot�parent�rlimit� send_signal�suspend� terminate�wait�_�test_)rQ )ra rb rK rc rd re rf rg rh ri rj rk rl rm rn ro rp rq )�set�dir�psutil�Process� startswith� assertTrue�hasattr)r: �skip�namer! r! r" � test_coverage� s z$TestProcessObjectLeaks.test_coveragec C s | j | jj� d S )N)rR �procr| )r: r! r! r" � test_name� s z TestProcessObjectLeaks.test_namec C s | j | jj� d S )N)rR r~ Zcmdline)r: r! r! r" � test_cmdline� s z#TestProcessObjectLeaks.test_cmdlinec C s | j | jj� d S )N)rR r~ Zexe)r: r! r! r" �test_exe� s z TestProcessObjectLeaks.test_exec C s | j | jj� d S )N)rR r~ Zppid)r: r! r! r" � test_ppid� s z TestProcessObjectLeaks.test_ppidz POSIX onlyc C s | j | jj� d S )N)rR r~ Zuids)r: r! r! r" � test_uids� s z TestProcessObjectLeaks.test_uidsc C s | j | jj� d S )N)rR r~ Zgids)r: r! r! r" � test_gids� s z TestProcessObjectLeaks.test_gidsc C s | j | jj� d S )N)rR r~ Zstatus)r: r! r! r" � test_status� s z"TestProcessObjectLeaks.test_statusc C s | j | jj� d S )N)rR r~ rj )r: r! r! r" � test_nice_get� s z$TestProcessObjectLeaks.test_nice_getc C s t j� }| j| jj|� d S )N)rJ rj rR r~ )r: Znicenessr! r! r" � test_nice_set� s z$TestProcessObjectLeaks.test_nice_setz not supportedc C s | j | jj� d S )N)rR r~ re )r: r! r! r" �test_ionice_get� s z&TestProcessObjectLeaks.test_ionice_getc C sV t r tj� }| j| jj|� n4| j| jjtj� tjt j t j � dd�}| j t|� d S )Nr, r ���)r rJ re rR r~ rv ZIOPRIO_CLASS_NONE� functools�partial�cextZproc_ioprio_set�os�getpidrU �OSError)r: r5 r? r! r! r" �test_ionice_set� s z&TestProcessObjectLeaks.test_ionice_setc C s | j | jj� d S )N)rR r~ Z io_counters)r: r! r! r" �test_io_counters s z'TestProcessObjectLeaks.test_io_counterszworthless on POSIXc C s | j | jj� d S )N)rR r~ Zusername)r: r! r! r" � test_username s z$TestProcessObjectLeaks.test_usernamec C s | j | jj� d S )N)rR r~ Z create_time)r: r! r! r" �test_create_time s z'TestProcessObjectLeaks.test_create_time)Zonly_ifc C s | j | jj� d S )N)rR r~ Z num_threads)r: r! r! r" �test_num_threads s z'TestProcessObjectLeaks.test_num_threadsz WINDOWS onlyc C s | j | jj� d S )N)rR r~ Z num_handles)r: r! r! r" �test_num_handles s z'TestProcessObjectLeaks.test_num_handlesc C s | j | jj� d S )N)rR r~ Znum_fds)r: r! r! r" � test_num_fds s z#TestProcessObjectLeaks.test_num_fdsc C s | j | jj� d S )N)rR r~ Znum_ctx_switches)r: r! r! r" �test_num_ctx_switches! s z,TestProcessObjectLeaks.test_num_ctx_switchesc C s | j | jj� d S )N)rR r~ Zthreads)r: r! r! r" � test_threads% s z#TestProcessObjectLeaks.test_threadsc C s | j | jj� d S )N)rR r~ � cpu_times)r: r! r! r" �test_cpu_times* s z%TestProcessObjectLeaks.test_cpu_timesc C s | j | jj� d S )N)rR r~ Zcpu_num)r: r! r! r" � test_cpu_num. s z#TestProcessObjectLeaks.test_cpu_numc C s | j | jj� d S )N)rR r~ rW )r: r! r! r" �test_memory_info3 s z'TestProcessObjectLeaks.test_memory_infoc C s | j | jj� d S )N)rR r~ rV )r: r! r! r" �test_memory_full_info7 s z,TestProcessObjectLeaks.test_memory_full_infoc C s | j | jj� d S )N)rR r~ Zterminal)r: r! r! r" � test_terminal; s z$TestProcessObjectLeaks.test_terminalz worthless on POSIX (pure python)c C s | j | jj� d S )N)rR r~ �resume)r: r! r! r" � test_resume@ s z"TestProcessObjectLeaks.test_resumec C s | j | jj� d S )N)rR r~ �cwd)r: r! r! r" �test_cwdE s z TestProcessObjectLeaks.test_cwdc C s | j | jj� d S )N)rR r~ rc )r: r! r! r" �test_cpu_affinity_getI s z,TestProcessObjectLeaks.test_cpu_affinity_getc C s4 t j� }| j| jj|� ts0| jt| jjdg� d S )Nr, r� )rJ rc rR r~ r rU � ValueError)r: Zaffinityr! r! r" �test_cpu_affinity_setM s z,TestProcessObjectLeaks.test_cpu_affinity_setc C s0 t t� ttd�� | j| jj� W d Q R X d S )N�w)r r �openrR r~ Z open_files)r: r! r! r" �test_open_filesT s z&TestProcessObjectLeaks.test_open_filesztoo slow on OSXc C s | j | jj� d S )N)rR r~ Z memory_maps)r: r! r! r" �test_memory_maps[ s z'TestProcessObjectLeaks.test_memory_mapsz LINUX onlyc C s | j | jjtj� d S )N)rR r~ rm rv � RLIMIT_NOFILE)r: r! r! r" �test_rlimit_geta s z&TestProcessObjectLeaks.test_rlimit_getc C s6 t jtj�}| j| jjtj|� | jt| jjd� d S )Nr, r� )rJ rm rv r� rR r~ rU r� )r: �limitr! r! r" �test_rlimit_setf s z&TestProcessObjectLeaks.test_rlimit_setzworthless on WINDOWSc C s2 t � �" trdnd}| j| jj|� W d Q R X d S )NZinet�all)r r rR r~ Z connections)r: Zkindr! r! r" �test_connectionsm s z'TestProcessObjectLeaks.test_connectionsc C s | j | jj� d S )N)rR r~ �environ)r: r! r! r" � test_environy s z#TestProcessObjectLeaks.test_environc C s | j tjtj� � d S )N)rR r� � proc_infor� r� )r: r! r! r" �test_proc_info} s z%TestProcessObjectLeaks.test_proc_infoN);rX rY rZ r[ rJ r~ r} r# r r� r� r� r r r r� r� r� r� r� r r� r� r r� r� r� r r r� r r� r� r� r� r� r r� r� r� r� r r� r� r r� r� r� r r r� r r r� r� r� r r� r� r! r! r! r" r` � sh r` c sp e Zd ZdZe� fdd��Ze� fdd��Zdd� Zerhdd � Z d d � Z d d � Z dd� Z dd� Z dd� Z� ZS )�TestTerminatedProcessLeaksz�Repeat the tests above looking for leaks occurring when dealing with terminated processes raising NoSuchProcess exception. The C functions are still invoked but will follow different code paths. We'll check those code paths. c s: t t| �j� t� }tj|j�| _| jj� | jj � d S )N) �superr� � setUpClassr rv rw ra r~ rg rq )�cls�p)� __class__r! r" r� � s z%TestTerminatedProcessLeaks.setUpClassc s t t| �j� t� d S )N)r� r� � tearDownClassr )r� )r� r! r" r� � s z(TestTerminatedProcessLeaks.tearDownClassc O s* y|||� W n t jk r$ Y nX d S )N)rv Z NoSuchProcess)r: r? r> r@ r! r! r" r< � s z TestTerminatedProcessLeaks._callc C s | j | jj� d S )N)rR r~ rg )r: r! r! r" � test_kill� s z$TestTerminatedProcessLeaks.test_killc C s | j | jj� d S )N)rR r~ rp )r: r! r! r" �test_terminate� s z)TestTerminatedProcessLeaks.test_terminatec C s | j | jj� d S )N)rR r~ ro )r: r! r! r" � test_suspend� s z'TestTerminatedProcessLeaks.test_suspendc C s | j | jj� d S )N)rR r~ r� )r: r! r! r" r� � s z&TestTerminatedProcessLeaks.test_resumec C s | j | jj� d S )N)rR r~ rq )r: r! r! r" � test_wait� s z$TestTerminatedProcessLeaks.test_waitc s � fdd�}� j |� d S )Nc sD yt j� jj�S tk r> } z| jtjkr.� W Y d d } ~ X nX d S )N)r� r� r~ ra r� �errnoZESRCH)�err)r: r! r" rT � s z7TestTerminatedProcessLeaks.test_proc_info.<locals>.call)rR )r: rT r! )r: r" r� � s z)TestTerminatedProcessLeaks.test_proc_info)rX rY rZ r[ � classmethodr� r� r< r r� r� r� r� r� r� � __classcell__r! r! )r� r" r� � s r� c @ s� e Zd ZdZdd� Ze� dd� �Ze� dd� �Ze� dd � �Ze� d d � �Z d d � Z e� e j e d�dd� ��Zdd� Ze j ed�dd� �Ze j eo�ed�dd� �Ze j eo�ed�dd� �Zdd � Ze j eo�ejjd � d �e� d d � ��Ze� d!d"� �Z e� d#d$� �Z e j ed%�e j e �o&ej � d&kd'�d(d)� ��Z d*d+� Z!e j e"d,�d-d.� �Z#e� e j e$ d�d/d0� ��Z%e� e j e& d�d1d2� ��Z'e� e j e( d�d3d4� ��Z)e� d5d6� �Z*e j e+d7�d8d9� �Z,e+�r�d:d;� Z-d<d=� Z.d>d?� Z/d@dA� Z0dBdC� Z1dDS )E�TestModuleFunctionsLeaksz&Test leaks of psutil module functions.c C sH t d �}x:tjD ]0}|j� s q||kr(q| jt| d| �|d � qW d S ) N� version_info� __version__� process_iter� wait_procsrd �cpu_times_percent� cpu_countrs )rQ )r� r� r� r� rd r� r� )rt rv �__all__�islowerry rz )r: r{ r| r! r! r" r} � s z&TestModuleFunctionsLeaks.test_coveragec C s | j tjdd� d S )NT)�logical)rR rv r� )r: r! r! r" �test_cpu_count_logical� s z/TestModuleFunctionsLeaks.test_cpu_count_logicalc C s | j tjdd� d S )NF)r� )rR rv r� )r: r! r! r" �test_cpu_count_physical� s z0TestModuleFunctionsLeaks.test_cpu_count_physicalc C s | j tj� d S )N)rR rv r� )r: r! r! r" r� � s z'TestModuleFunctionsLeaks.test_cpu_timesc C s | j tjdd� d S )NT)Zpercpu)rR rv r� )r: r! r! r" �test_per_cpu_times� s z+TestModuleFunctionsLeaks.test_per_cpu_timesc C s | j tj� d S )N)rR rv Z cpu_stats)r: r! r! r" �test_cpu_stats� s z'TestModuleFunctionsLeaks.test_cpu_statsz not supportedc C s | j tj� d S )N)rR rv Zcpu_freq)r: r! r! r" � test_cpu_freq� s z&TestModuleFunctionsLeaks.test_cpu_freqc C s | j tj� d S )N)rR rv Zvirtual_memory)r: r! r! r" �test_virtual_memory� s z,TestModuleFunctionsLeaks.test_virtual_memoryz&worthless on SUNOS (uses a subprocess)c C s | j tj� d S )N)rR rv Z swap_memory)r: r! r! r" �test_swap_memory� s z)TestModuleFunctionsLeaks.test_swap_memoryz worthless on POSIX (pure python)c C s | j tjtj� � d S )N)rR rv Z pid_existsr� r� )r: r! r! r" �test_pid_exists� s z(TestModuleFunctionsLeaks.test_pid_existsc C s | j tjd� d S )N�.)rR rv Z disk_usage)r: r! r! r" �test_disk_usage� s z(TestModuleFunctionsLeaks.test_disk_usagec C s | j tj� d S )N)rR rv Zdisk_partitions)r: r! r! r" �test_disk_partitions� s z-TestModuleFunctionsLeaks.test_disk_partitionsz/proc/diskstatsz3/proc/diskstats not available on this Linux versionc C s | j tjdd� d S )NF)�nowrap)rR rv Zdisk_io_counters)r: r! r! r" �test_disk_io_counters s z.TestModuleFunctionsLeaks.test_disk_io_countersc C s | j tj� d S )N)rR rv Zpids)r: r! r! r" � test_pids s z"TestModuleFunctionsLeaks.test_pidsc C s | j tjdd� d S )NF)r� )rR rv Znet_io_counters)r: r! r! r" �test_net_io_counters s z-TestModuleFunctionsLeaks.test_net_io_countersz worthless on Linux (pure python)r zneed root accessc C s" t � � | jtj� W d Q R X d S )N)r rR rv Znet_connections)r: r! r! r" �test_net_connections s z-TestModuleFunctionsLeaks.test_net_connectionsc C s | j tjtrdnd d� d S )N�P i )rC i @ )rR rv Z net_if_addrsr )r: r! r! r" �test_net_if_addrs s z*TestModuleFunctionsLeaks.test_net_if_addrszEPERM on travisc C s | j tj� d S )N)rR rv Z net_if_stats)r: r! r! r" �test_net_if_stats s z*TestModuleFunctionsLeaks.test_net_if_statsc C s | j tj� d S )N)rR rv Zsensors_battery)r: r! r! r" �test_sensors_battery$ s z-TestModuleFunctionsLeaks.test_sensors_batteryc C s | j tj� d S )N)rR rv Zsensors_temperatures)r: r! r! r" �test_sensors_temperatures) s z2TestModuleFunctionsLeaks.test_sensors_temperaturesc C s | j tj� d S )N)rR rv Z sensors_fans)r: r! r! r" �test_sensors_fans. s z*TestModuleFunctionsLeaks.test_sensors_fansc C s | j tj� d S )N)rR rv Z boot_time)r: r! r! r" �test_boot_time5 s z'TestModuleFunctionsLeaks.test_boot_timez(XXX produces a false positive on Windowsc C s | j tj� d S )N)rR rv Zusers)r: r! r! r" � test_users: s z#TestModuleFunctionsLeaks.test_usersc C s | j tj� d S )N)rR r� Zwinservice_enumerate)r: r! r! r" �test_win_service_iterB s z.TestModuleFunctionsLeaks.test_win_service_iterc C s d S )Nr! )r: r! r! r" �test_win_service_getE s z-TestModuleFunctionsLeaks.test_win_service_getc C s" t tj� �j� }| jtj|� d S )N)�nextrv �win_service_iterr| rR r� Zwinservice_query_config)r: r| r! r! r" �test_win_service_get_configH s z4TestModuleFunctionsLeaks.test_win_service_get_configc C s" t tj� �j� }| jtj|� d S )N)r� rv r� r| rR r� Zwinservice_query_status)r: r| r! r! r" �test_win_service_get_statusL s z4TestModuleFunctionsLeaks.test_win_service_get_statusc C s" t tj� �j� }| jtj|� d S )N)r� rv r� r| rR r� Zwinservice_query_descr)r: r| r! r! r" � test_win_service_get_descriptionP s z9TestModuleFunctionsLeaks.test_win_service_get_descriptionN)2rX rY rZ r[ r} r# r� r� r� r� r� r r r r� r� r r� r r r� r� r� r r� �path�existsr� r� r� r �getuidr� r� r r� r r� r r� r r� r� r r� r� r� r� r� r� r! r! r! r" r� � sR $r� �__main__):r[ Z __future__r r� r� r8 r� rO rI rM rv Zpsutil._commonr r r r r r Zpsutil._compatr Z psutil.testsr r r r r r r r r r r r r r r r r r r r r] r\ r^ r Z _psplatformr� rw rJ r# r6 ZTestCaser7 r` r� r� rX �__file__r! r! r! r" �<module> sl c B<