p f>pddlZddlZddlZddlmZddlmZmZddlm Z ddl m Z ddl m Z ddlmZed Zeej" Zd Zd ZGd deZGddeZGddeZGddeZej6dZGddeZGddeZGddeZy)N) timedelta)loggerconf)CGroupsException)ustr) get_osutil)fileutil)hours)secondszwalinuxagent.servicezazure-walinuxagent-logcollectorc eZdZy)CounterNotFoundN)__name__ __module__ __qualname__?/usr/lib/python3/dist-packages/azurelinuxagent/common/cgroup.pyrr#srrcjeZdZdZefdZedZedZedZ edZ edZ y) MetricValuezN Class for defining all the required metric fields to send telemetry. cJ||_||_||_||_||_yN) _category_counter _instance_value_report_period)selfcategorycounterinstancevalue report_periods r__init__zMetricValue.__init__-s&! ! +rc|jSr)rrs rrzMetricValue.category4 ~~rc|jSr)rr&s rr zMetricValue.counter8s }}rc|jSr)rr&s rr!zMetricValue.instance<r'rc|jSr)rr&s rr"zMetricValue.value@s {{rc|jSr)rr&s rr#zMetricValue.report_periodDs"""rN) rrr__doc___DEFAULT_REPORT_PERIODr$propertyrr r!r"r#rrrrr'swJ`,##rrceZdZdZdZy)MetricsCategoryMemoryCPUN)rrrMEMORY_CATEGORY CPU_CATEGORYrrrr0r0Is OLrr0c(eZdZdZdZdZdZdZdZdZ y) MetricsCounterz% Processor TimezTotal Memory UsagezMax Memory UsagezThrottled TimezSwap Memory UsagezAvailable MBytesz Used MBytesN) rrrPROCESSOR_PERCENT_TIMETOTAL_MEM_USAGE MAX_MEM_USAGETHROTTLED_TIMESWAP_MEM_USAGE AVAILABLE_MEMUSED_MEMrrrr6r6Ns&/*O&M%N(N&MHrr6zuser (\d+)\nsystem (\d+)\nc8eZdZdZdZdZdZd dZdZdZ y) CGroupc ||_||_y)z Initialize _data collection for the Memory controller :param: name: Name of the CGroup :param: cgroup_path: Path of the controller :return: N)namepath)rrA cgroup_paths rr$zCGroup.__init__\s  rcNdj|j|jS)Nz {0} [{1}])formatrArBr&s r__str__zCGroup.__str__fs!!$))TYY77rcVtjj|j|Sr)osrBjoin)r file_names r_get_cgroup_filezCGroup._get_cgroup_fileisww||DIIy11rcN|j|}tj|S)z Retrieve the contents to file. :param str file_name: Name of file within that metric controller :return: Entire contents of the file :rtype: str )rKr read_file)rrJparameter_files r_get_file_contentszCGroup._get_file_contentsls%..y9!!.11rcg} |j|j}|r|d}|S|}|S#t$rP|j|}t j dj |tdj |t$rf}t|ttfr|jtjk(r||j|}tdj ||d}~wwxYw)a[ Retrieve the values of a parameter from a controller. Returns a list of values in the file. :param first_line_only: return only the first line. :param str parameter_name: Name of file within that metric controller :return: The first line of the file, without line terminator :rtype: [str] rz#File {0} is empty but should not be&Exception while attempting to read {0}N)rO splitlines IndexErrorrKrerrorrEr Exception isinstanceIOErrorOSErrorerrnoENOENT)rparameter_namefirst_line_onlyresultvaluesparameter_filenamees r_get_parameterszCGroup._get_parametersxs k,,^<GGIF"1VAYF 8>F  e!%!6!6~!F  LL>EEFXY Z"#H#O#OPb#cd d k!gw/0QWW 5L!%!6!6~!F "#K#R#RSe#fhij j  ks&00A C6A!C11C6c  |jd}|rt|dk7S y#ttf$ro}|jtj k(rnGt jt jdj|jt|Yd}~yd}~wt$rQ}t jt jdj|jt|Yd}~yd}~wwxYw)NtasksrzUCould not get list of tasks from "tasks" file in the cgroup: {0}. Internal error: {1}F) ralenrWrXrYrZr periodic_warnEVERY_HALF_HOURrErBrr)rrcr`s r is_activezCGroup.is_actives T((1E5zQ&! Xww%,,&$$V%;%;&<tyy$q'8R T T  Ts" %C;A%B C;*AC66C;c t)z Retrieves the current value of the metrics tracked for this cgroup and returns them as an array. Note: Agent won't track the metrics if the current cpu ticks less than previous value and returns empty array. )NotImplementedErrorr_s rget_tracked_metricszCGroup.get_tracked_metricss "##rNF) rrrr$rFrKrOrargrlrrrr?r?[s% 82 22&$rr?cLeZdZfdZd dZdZdZdZdZd dZ dZ xZ S) CpuCgroupctt| ||t|_d|_d|_d|_d|_d|_ d|_ yr) superror$r_osutil_previous_cgroup_cpu_previous_system_cpu_current_cgroup_cpu_current_system_cpu_previous_throttled_time_current_throttled_timerrArC __class__s rr$zCpuCgroup.__init__sM i'k:!| $(!$(!#' #' (,%'+$rc  |jd}d}|ztj|}|s*tdj|jd|t|jdt|jdz}|S#t$rf}t|ttfr|j t j k7r#tdjt||s|d}Yd}~d}~wwxYw)a: Returns the number of USER_HZ of CPU time (user and system) consumed by this cgroup. If allow_no_such_file_or_directory_error is set to True and cpuacct.stat does not exist the function returns 0; this is useful when the function can be called before the cgroup has been created. z cpuacct.statz Failed to read cpuacct.stat: {0}Nrz$The contents of {0} are invalid: {1}r )rOrUrVrWrXrYrZrrErre_user_system_timesmatchrKintgroups)r%allow_no_such_file_or_directory_error cpuacct_statr` cpu_ticksr}s r_get_cpu_tickszCpuCgroup._get_cpu_tickss 22>BL  #)..|h%CDHH%>EE!"J} ")BD I%( ("5<<>!#4z#ABB+ > >C <==- > >.! Sww%,,&"#A#H#Ha#QR R S"#A#H#Ha#QR R SsR3B2:B&0 B& B2 B&&B/+B2/B22D:D##D D:#D55D:c>|jduxr|jduSr)rurvr&s r_cpu_usage_initializedz CpuCgroup._cpu_usage_initializeds$''t3\8P8PX\8\\rc|jr td|jd|_|jj |_|j|_y)zu Sets the initial values of CPU usage. This function must be invoked before calling get_cpu_usage(). z2initialize_cpu_usage() should be invoked only onceT)rN) rrrrurrget_total_cpu_ticks_since_bootrvrrxr&s rinitialize_cpu_usagezCpuCgroup.initialize_cpu_usagesY  & & ("#WX X#'#6#6]a#6#b #'<<#N#N#P '+'>'>'@$rc|js td|j|_|j|_|j |_|jj|_|j|jz }td|j|j z }td|jjzt|zt|z dS)ag Computes the CPU used by the cgroup since the last call to this function. The usage is measured as a percentage of utilization of 1 core in the system. For example, using 1 core all of the time on a 4-core system would be reported as 100%. NOTE: initialize_cpu_usage() must be invoked before calling get_cpu_usage() zOinitialize_cpu_usage() must be invoked before the first call to get_cpu_usage()r gY@) rrrursrvrtrrrrmaxroundget_processor_coresfloat)r cgroup_delta system_deltas r get_cpu_usagezCpuCgroup.get_cpu_usages**,"#tu u$($<$<!$($<$<!#'#6#6#8 #'<<#N#N#P //$2K2KK 1d669R9RRS UT\\==??% BUUX]^jXkkmnoorc |st|jdz S|js td|j|_|j|_t|j|j z dz S)a  Computes the throttled time (in seconds) since the last call to this function. NOTE: initialize_cpu_usage() must be invoked before calling this function Compute only current throttled time if read_previous_throttled_time set to False geAzTinitialize_cpu_usage() must be invoked before the first call to get_throttled_time())rrrrrxrw)rread_previous_throttled_times rget_cpu_throttled_timez CpuCgroup.get_cpu_throttled_times ,002S89 9**,"fh h)-(D(D%'+'>'>'@$T11D4Q4QQRUXXXrc g}|j}|tdk\rC|jttj t j|j|d|vrt|dro|j}|tdk\rQ|tdk\rC|jttj t j|j||S)Nrtrack_throttled_time) rrappendrr0r4r6r7rArr:)rkwargstracked cpu_usagethrottled_times rrlzCpuCgroup.get_tracked_metrics/s&&( a NNO88.:_:_aeajajluv x "V +7M0N!88:NE!H$58)C < [>[]a]f]fhvwyrrm)T) rrrr$rrrrrrrl __classcell__rzs@rroros2 ,BS@]Ap,Y$ rroc<eZdZfdZdZdZdZdZdZxZ S) MemoryCgroupc<tt| ||d|_y)Nr)rqrr$_counter_not_found_error_countrys rr$zMemoryCgroup.__init__@s lD*4=./+rc ttjj|jd5}|D]R}dj |}t j ||}|-t|jdccdddS dddt!dj |#1swY#xYw#ttf$rF}|jtjk(rtdj t|d}~wt$r(}tdj t|d}~wwxYw)Nz memory.statz {0}\s+(\d+)rzFailed to read memory.stat: {0}zCannot find counter: {0})rrHrBrIrErr}r~rrWrXrYrZrrrUr)r counter_name memory_statrre_memory_counterr}r`s r_get_memory_stat_counterz%MemoryCgroup._get_memory_stat_counterEs Vbggll499m<= 6 (6D(6(=(=l(K%HH%6=E("5<<>!#455 6 6 6 6$8?? MNN% 6 6! Vww%,,&"#D#K#KDQRG#TU U V"#D#K#KDQRG#TU U VsM3B</B0%B0 B< B0B<0B95B<<E AD  E#D;;EcP|jd}|jd}||zS)zx Collect RSS+CACHE from memory.stat cgroup. :return: Memory usage in bytes :rtype: int cacherss)r)rrrs rget_memory_usagezMemoryCgroup.get_memory_usage[s.--g6++E2s{rc ( |jdS#t$ru}|jdkr\tjtj dj t||j|xjdz c_Yd}~yd}~wwxYw)a Collect SWAP from memory.stat cgroup. :return: Memory usage in bytes :rtype: int Note: stat file is the only place to get the SWAP since other swap related file memory.memsw.usage_in_bytes is for total Memory+SWAP. swapr zs{0} from "memory.stat" file in the cgroup: {1}---[Note: This log for informational purpose only and can be ignored]Nr) rrrr periodic_inforfrErrB)rr`s rtry_swap_memory_usagez"MemoryCgroup.try_swap_memory_usagegs 008 8 22Q6$$V%;%;&[&b&bcghicjlplulu&vw33q83  s BA+B  Bcd} t|jdd}|S#t$rT}t|tt fr|j t jk(rtdjd|d}~wwxYw)z Collect memory.max_usage_in_bytes from the cgroup. :return: Memory usage in bytes :rtype: int rzmemory.max_usage_in_bytesT)r\rQN) r~rarUrVrWrXrYrZrrE)rusager`s rget_max_memory_usagez!MemoryCgroup.get_max_memory_usagexs t,,-HZ^,_`E   t!gw/0QWW 5L"#K#R#RSn#oqrs s ts" A?AA::A?c ttjtj|j |j ttjtj|j |jtttjtj|j |jtgSr) rr0r3r6r8rArr9r_REPORT_EVERY_HOURr;rrjs rrlz MemoryCgroup.get_tracked_metricss 779W9WY]YbYb--/ 1 779U9UW[W`W`1135G I 779V9VX\XaXa2246H J   r) rrrr$rrrrrlrrs@rrr?s"0 O, "" rr) rYrHrdatetimerazurelinuxagent.commonrr azurelinuxagent.common.exceptionrazurelinuxagent.common.futurerazurelinuxagent.common.osutilrazurelinuxagent.common.utilsr rget_cgroup_check_periodr-AGENT_NAME_TELEMETRYAGENT_LOG_COLLECTORrUrobjectrr0r6compiler|r?rorrrrrs" /=.41Q'"+G4+G+G+IJ-7 i #&#Df V"rzz"?@O$VO$dOOdR 6R r