p fG&ddlZddlZddlZddlZddlZddlZddlmZddlm Z m Z ddl m Z ddl mZddlmZmZmZmZddlmZddlmZdd lmZmZdd lmZmZmZdd lm Z dd l!m"Z"d Z#ddgZ$dZ%GddeZ&Gdde'Z(Gdde(Z)y)N)logger) CpuCgroup MemoryCgroup)CGroupsTelemetry)get_agent_pid_file_path)CGroupsExceptionExtensionErrorCodesExtensionErrorExtensionOperationError)ustr)systemd)fileutil shellutil)handle_process_completion read_outputTELEMETRY_MESSAGE_MAX_LEN)FlexibleVersion) get_distroz/sys/fs/cgroupcpumemoryzazure-vmextensionsc$eZdZdZdfd ZxZS)SystemdRunErrorz' Raised when systemd-run fails c,tt| |yN)superr__init__)selfmsg __class__s B/usr/lib/python3/dist-packages/azurelinuxagent/common/cgroupapi.pyrzSystemdRunError.__init__1s ot-c2r)__name__ __module__ __qualname____doc__r __classcell__)rs@r rr,s33r!rc\eZdZedZedZedZedZedZy) CGroupsApict}|d} t|d}|jdk(xr|jdk\S#t$rYywxYw)NrFubuntu)rr ValueErrorlowermajor) distro_info distro_namedistro_versions r cgroups_supportedzCGroupsApi.cgroups_supported6s_ l !!n  ,[^3G3G23MM  sA AAc  |D]}tj|y#t$rB}tjdj j t|Yd}~yd}~wwxYw)NzXCannot add cgroup '{0}' to tracking list; resource usage will not be tracked. Error: {1})r track_cgroup Exceptionrwarnformatpathr )extension_cgroupscgroup exceptions r track_cgroupszCGroupsApi.track_cgroups@sc K+ 6 --f5 6 K KK%%+VFKKi%I K K Ks A*8A%%A*cttjj|dd5}|j j Dcgc] }t |c}cdddScc}w#1swYyxYw)N cgroup.procsr)openosr9joinreadsplitint) cgroup_path cgroup_procspids r get_processes_in_cgroupz"CGroupsApi.get_processes_in_cgroupIsc "'',,{N;S A E\(4(9(9(;(A(A(CDCHD E ED E Es!A/ A*A/*A//A8c"g}dD]q}tjjt|dd}tjj |sIt j d||j||fs |D]\}}tjj|d}tjj |sFtj|j}tj}t||vs||| |D]2\}}t j d|tj|d4t!|S#|D]2\}}t j d|tj|d4wxYw)aE Previous versions of the daemon (2.2.31-2.2.40) wrote their PID to /sys/fs/cgroup/{cpu,memory}/WALinuxAgent/WALinuxAgent; starting from version 2.2.41 we track the agent service in walinuxagent.service instead of WALinuxAgent/WALinuxAgent. Also, when running under systemd, the PIDs should not be explicitly moved to the cgroup filesystem. The older daemons would incorrectly do that under certain conditions. This method checks for the existence of the legacy cgroups and, if the daemon's PID has been added to them, executes the given operation on the cgroups. After this check, the method attempts to remove the legacy cgroups. :param operation: The function to execute on each legacy cgroup. It must take 2 arguments: the controller and the daemon's PID rr WALinuxAgentzFound legacy cgroup {0}r?z Removing {0}T) ignore_errors)rBr9rCCGROUPS_FILE_SYSTEM_ROOTexistsrinfoappendr read_filestripr(get_daemon_pidr shutilrmtreelen) operationlegacy_cgroups controllerr; procs_fileprocs_file_contents daemon_pid_s r _foreach_legacy_cgroupz!CGroupsApi._foreach_legacy_cgroupNsR+ %%z6&:;  < :&4 :" FWW\\&.A 77>>*-*2*<*>!*j9 :, : 6 NF3 fD9 :>"", : 6 NF3 fD9 :s:AEAE E9Fcjttjtj Sr)rFrrSrrTr!r rUzCGroupsApi.get_daemon_pidss%8%%&=&?@FFHIIr!N) r"r#r$ staticmethodr3r=rJr`rUrbr!r r(r(5smNNKKEE"#"#HJJr!r(ceZdZdZdZdZdZedZdZ dZ edZ ed Z edd Z ejfd Zd Zy )SystemdCgroupsApiz' Cgroups interface via systemd c`d|_d|_g|_tj|_yr)_cgroup_mountpoints_agent_unit_name_systemd_run_commands threadingRLock_systemd_run_commands_lockrs r rzSystemdCgroupsApi.__init__}s)#' $%'"*3//*;'r!cd|j5|jddcdddS#1swYyxYw)z^ Returns a list of the systemd-run commands currently running (given as PIDs) N)rlrirms r get_systemd_run_commandsz*SystemdCgroupsApi.get_systemd_run_commandss0 , , 1--a0 1 1 1s&/c,|jkd}d}tjgdjD]5}t j d|}||j d}d|vr|}4|}7||d|_|jd|jdfS) z Returns a tuple with the mount points for the cpu and memory controllers; the values can be None if the corresponding controller is not mounted N)mount-tr;z%on\s+(?P/\S+(memory|cpuacct))\sr9cpuacctrLrr)rgr run_command splitlinesresearchgroup)rrrlinematchr9s r get_cgroup_mount_pointsz)SystemdCgroupsApi.get_cgroup_mount_pointss  # # +CF!--.GHSSU & "JDQ$ ;;v.D D("!% &03f'ED $''.0H0H0RRRr!cd}d}tjdj|jD]}t j d|}|R|j d}|j ddk7r |j djdnd}|dk(r|}j|}mt j d|}|s|j ddk7r |j djdnd}|}|}||fS) a Returns a tuple with the path of the cpu and memory cgroups for the given process (relative to the mount point of the corresponding controller). The 'process_id' can be a numeric PID or the string "self" for the current process. The values returned can be None if the process is not in a cgroup for that controller (e.g. the controller is not mounted). Nz/proc/{0}/cgroupz5\d+:(?P(memory|.*cpuacct.*)):(?P.+)r[r9/rz\d+::(?P.+))rrSr8rurvrzrxlstrip) process_idcpu_path memory_pathryrzr[r9s r !get_process_cgroup_relative_pathsz3SystemdCgroupsApi.get_process_cgroup_relative_pathss" &&'9'@'@'LMXXZ 'DHHUW[\E "[[6 :?++f:MQT:Tu{{6*11#6Z^)"&K#H!5t<>Ckk&>QUX>X5;;v.55c:^bD#H"&K '"$$r!c|j|\}}|j\}}||ptjd|j \}}|Fd}d|vsd|vrtjdd}d|vsd |vrtjd d}|s|}|}|"| t j j||nd} |"| t j j||nd} | | fS) a< Returns a tuple with the path of the cpu and memory cgroups for the given process. The 'process_id' can be a numeric PID or the string "self" for the current process. The values returned can be None if the process is not in a cgroup for that controller (e.g. the controller is not mounted). Nz Cgroup v1 mount points not foundFrz-memoryz)Memory controller not active in cgroup v2Trz-cpuz&CPU controller not active in cgroup v2)rr{rr7get_cgroup2_controllersrBr9rC) rrcpu_cgroup_relative_pathmemory_cgroup_relative_pathcpu_mount_pointmemory_mount_pointcgroup2_mount_pointcgroup2_controllerscontroller_missingcpu_cgroup_pathmemory_cgroup_paths r get_process_cgroup_pathsz*SystemdCgroupsApi.get_process_cgroup_pathss' AE@f@fgq@r= "=.2.J.J.L++  "&8&@ KK: ;7;7S7S7U 4 !4".%*"#66)GZ:ZKK KL)-& 33vAT7TKK HI)-&)&9O)<&*/G/S'',,8PQY] "-2M2Y WW\\*<>YZ_c  222r!ctj|d}|j\}}|#tjj ||ddnd}|#tjj ||ddnd}||fS)a' Returns a tuple with the path of the cpu and memory cgroups for the given unit. The values returned can be None if the controller is not mounted. Ex: ControlGroup=/azure.slice/walinuxagent.service controlgroup_path[1:] = azure.slice/walinuxagent.service ControlGroupNr*)r get_unit_propertyr{rBr9rC)r unit_namecontrolgroup_pathrrrrs r get_unit_cgroup_pathsz'SystemdCgroupsApi.get_unit_cgroup_pathss$55iP.2.J.J.L++*'',,8I!"8MN04 "- WW\\*<>OPQPR>ST37  222r!cbtjgdjD]}tjd|}||j d}d}t jj|d}t jj|rtj|}||fcSy)z Returns a tuple with the mount point for the cgroups v2 controllers, and the currently mounted controllers; either value can be None if cgroups v2 or its controllers are not mounted )rqrrcgroup2zon\s+(?P/\S+)\sNr9zcgroup.subtree_control)NN) rrtrurvrwrxrBr9rCrPrrS)ryrz mount_point controllerscontrollers_files r rz)SystemdCgroupsApi.get_cgroup2_controllerss))*DEPPR 0DII6=E #kk&1 " #%77<< =U#V 77>>"23"*"4"45E"FK"K// 0r!c|jdt|jtdd}dj |}||vxs||vS)Nrzutf-8backslashreplace)encodingerrorszUnit {0} not found.)seekr rDrr8) scope_namestderrunit_not_founds r _is_systemd_failurez%SystemdCgroupsApi._is_systemd_failuresK Afkk";Failed to start tracking resource usage for the extension: {0})processcommandtimeoutrr error_code cpu_cgrouprz!Systemd process exited with code z and output zSystemd timed-out, output: %s)#r8uuiduuid4rrl subprocessPopenrBsetsidrirRrIrrQr9rCr{rrr5rIOErrorerrnor r6rremover rrtruncate isinstancer exit_coder)rrrcmd_namerrrrrrrscopeextension_slice_namerrrcgroup_relative_pathcpu_cgroup_mountpointmemory_cgroup_mountpointrr memory_cgroupeprocess_outputerr_msgs r start_extension_commandz)SystemdCgroupsApi.start_extension_command#s  4::<8#<<^L  , , ; &&|CCDIK_ahi99 &G  & & - -gkk : ; X%  5zB  c#%77<<0VXl#m >B>Z>Z>\ ; !#;$, ^_"$'',,/DFZ"[&~G  --j9'/ ab%'WW\\2JL`%a" ,^=O P  --m< ?,WgW^gm4:z^hj.00 ?**11'++> ? ?Q ; ;P cww!| de KKXZ^_`Za b b c KKXZ^_`Za b b c8 ? ?+ +++E6:)8N OOA  OOA !45KK1"'* *:NJ!'* *' +*00 ?**11'++> ? ? ?s|A!G; C%H/J &J;H JAI J%J  JJ  L)&A>L$$L))L,, M49&M( M4(M1 -M4c.tjdS)a Previous versions of the daemon (2.2.31-2.2.40) wrote their PID to /sys/fs/cgroup/{cpu,memory}/WALinuxAgent/WALinuxAgent; starting from version 2.2.41 we track the agent service in walinuxagent.service instead of WALinuxAgent/WALinuxAgent. If we find that any of the legacy groups include the PID of the daemon then we need to disable data collection for this instance (under systemd, moving PIDs across the cgroup file system can produce unpredictable results) cyrrb)r_s r z:SystemdCgroupsApi.cleanup_legacy_cgroups..ysr!)r(r`rms r cleanup_legacy_cgroupsz(SystemdCgroupsApi.cleanup_legacy_cgroupsrs00AAr!N)F)r"r#r$r%rror{rcrrrrrrr PluginUnknownFailurerrrbr!r rerexs< 1S6#%#%J3>3$*DD ZZ,?+S+SM?^Br!re)*rBrvrVrrjrazurelinuxagent.commonrazurelinuxagent.common.cgrouprr'azurelinuxagent.common.cgroupstelemetryrazurelinuxagent.common.confr azurelinuxagent.common.exceptionrr r r azurelinuxagent.common.futurer azurelinuxagent.common.osutilr azurelinuxagent.common.utilsrr1azurelinuxagent.common.utils.extensionprocessutilrrr-azurelinuxagent.common.utils.flexible_versionrazurelinuxagent.common.versionrrOCGROUP_CONTROLLERSrrobjectr(rerbr!r rs$  )AD?.1<I5+X&-3&3@J@JFAB ABr!