o
Mij @ s
d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl
Z
d dl Z d dl Z d dl
Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlmZ d dl m Z d dlm Z m Z d dl m!Z! d dl"m#Z# d dl$m%Z% d dl&m'Z' d d l(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6 d d
l7m8Z8 d dl9Z9d d l:m;Z;mZ>m?Z?m@Z@mAZAmBZBmCZCmDZDmEZE d d lFmGZG d d
lHmIZI e*rd dlJmKZK daLe MeNZOe jPdiZQdejR ejS ZTdZUdZVdd ZWe# dd ZXe# dd ZYdede5eZe[f deZfd d Z\ded e5eZe[f de[fd d Z]e?^d!d"e[de[fd#d$Z_d%d& Z`G d'd( d(ZaG d)d* d*ebZcG d+d, d,ebZdd-d. Zedfd/d0Zfdfd1d2Zgdfd3d4Zhdgd6d7Zidfd8d9Zjdd:de.fd;d<Zkd=d> Zld?d@ ZmdAdB ZndhdDdEZodFdG ZpdHeZdeqfdIdJZre# dKdL Zse# dMdN Zte# dOdP Zue# dQdR Zve# dSdT Zwe# dUdV ZxdidXdYZydfdZd[Zzdjd\d]Z{dfd^d_Z|e# d`da Z}dbdc Z~e# ddde ZdfdfdgZdfdhdiZdjdk ZdkdldmZdidne4e1 deqfdodpZej dqdr Zej dsdt Zdudv Zdwdx Zdld{d|Zdfd}d~ZdeqffddZdmddZdd:deqfddZdd:deqfddZdfddZdfddZdd ZG dd de2ZdiddZdnddZe?^ddefddZdd Zdd Zdd Zdd Z doddZ doddZ doddZ doddZ doddZdpddZdd ZddWdde5eZe jf de3e,egdf dede[fddZddWdde5eZe jf de3e,egdf dedeZfddZe# dd Zdd ZdefddZdqddZdkddZdkddÄZde.eZe+f de3eZ de0e3eZ fddDŽZde.eZe+f fddɄZdfdeZdeZfdd̄Zdd΄ ZddЄ Zdd҄ ZdrddՄZe?^d֡eqffddZddڄ Zdsdd܄Zej ddބ Zdd Z CdtddZdd Zdd ZdiddZdd Zdd Zdd Ze# dd Zdd Zdd Z dudWddededdfddZdd Zdd ZdeZdefdd ZĐdeZdefddZŐdeZdeZfddZƐdeZdeZfddZǐdeZde0eZ fd d
Ze?^d WdvdCddd
dedefddZɐdd ZʐdwddZːdxddZ̐dkddZ͐dd Zΐd d Zϐd d ZАd!d" Ze# d#d$ ZҐd%d& ZӐ 'dyd(eZd)eZde.eZeZf fd*d+ZԐd,d- ZՐd.d/ Zd0d1 ZeOdWfd2d3Zؐd4d5 Zِd6d7 Zڐd8d9 Zېd:d; Zܐdid<d=ZeOdWfd>d?Zސd@eZdefdAdBZߐdCdD Zdde jjPfdEdFZdzdHdIZdJdK ZdfdLdMZdNdO ZdPdQ ZdRdS ZdTdU Zd{dVdWZd|dYdZZd[d\ Zdkd]d^Zd_d`deqfdadbZe de/de+df fdcddZdS (} N) b64decode)deque)contextmanagersuppress)ENOENT) lru_cache)Path)
ModuleType)IO
TYPE_CHECKINGAnyCallableDequeDict GeneratorListMapping
NamedTupleOptionalSequenceUnioncast)parse) featuresimportermergersnet performancesettingssubp
temp_utils
type_utils
url_helperversion)logexc) CFG_BUILTIN)Paths_z_-.())true1onyes)off0nofalsec C s" t ttt jdd d S )N. )tuplemapintosunamereleasesplit r9 r9 0/usr/lib/python3/dist-packages/cloudinit/util.pykernel_version` s "r; c C s t j ddgdd} | j S )zReturn the sanitized string output by `dpkg --print-architecture`.
N.B. This function is wrapped in functools.lru_cache, so repeated calls
won't shell out every time.
dpkgz--print-architectureTcapture)r stdoutstrip)outr9 r9 r: get_dpkg_architectured s
rB c
s ddddd} i zAt j ddgdd }|j D ]}|d
\}}}|| v r.| | | < q fd d | D }|rHtd
d| W S W S t j yo } ztd| t
dd | D W Y d }~ S d }~ww )Ncodename descriptionidr7 )Codename DescriptionzDistributor IDRelease lsb_releasez--allTr= :c s g | ]}| vr|qS r9 r9 ).0kdatar9 r:
s z lsb_release..z.Missing fields in lsb_release --all output: %s,z#Unable to get lsb_release --all: %sc s s | ]}|d fV qdS ) UNAVAILABLENr9 rK vr9 r9 r: s z lsb_release..) r r?
splitlines partitionr@ valuesLOGwarningjoinProcessExecutionErrordict)fmaprA linefnamer' valmissingerrr9 rM r: rI o s8
rI utf-8blobreturnc C t | tr| S | j|dS N)encoding)
isinstancestrdecode)rd rh r9 r9 r:
decode_binary rl textc C rf rg )ri bytesencode)rn rh r9 r9 r: encode_text rm rq zBase64 decodingrN c C sB t | ts
tdt| zt| ddW S tjy | Y S w )zbase64 decode data
If data is base64 encoded bytes, return b64decode(data).
If not, return data unmodified.
@param data: data as bytes. TypeError is raised if not bytes.
z data is '%s', expected bytesT)validate)ri ro TypeErrortyper binasciiErrorrM r9 r9 r: maybe_b64decode s
rw c C sP | j dd}| dkr&t|tr&| }|r |jr |j}nd}||dS |S )NT)rk rn rc surrogateescape) get_payloadget_content_maintyperi ro get_charset input_codecrk )part cte_payloadcharsetrh r9 r9 r: fully_decoded_payload s
r c @ s& e Zd Zd ddZdd Zdd ZdS )
SeLinuxGuardFc C s> | zt d| _W n ty d | _Y nw || _|| _d S )Nselinux)r
import_moduler ImportErrorpath recursive)selfr r r9 r9 r: __init__ s
zSeLinuxGuard.__init__c C s | j r
| j r
dS dS NTF)r is_selinux_enabled)r r9 r9 r: __enter__ s zSeLinuxGuard.__enter__c
C s | j r| j s
d S tj| jsd S tj| j}zt|}| j ||tj W n
t
y5 Y d S w t d|| j
z | j j|| j
d W d S t
yf } zt d|| j
| W Y d }~d S d }~ww )Nz,Restoring selinux mode for %s (recursive=%s)r z,restorecon failed on %s,%s maybe badness? %s)r r r5 r lexistsrealpathlstat matchpathconstatST_MODEOSErrorrX debugr
restoreconrY )r excp_type
excp_valueexcp_tracebackr statser9 r9 r: __exit__ s6
zSeLinuxGuard.__exit__NF)__name__
__module__ __qualname__r r r r9 r9 r9 r: r s
r c @ e Zd ZdS )MountFailedErrorNr r r r9 r9 r9 r: r r c @ r )DecompressionErrorNr r9 r9 r9 r: r r r c O sx t }|dkr0z| |i | t d W d S ty/ ttdt| t d Y d S w td|t| d S )Nr z&Failed forking and calling callback %s z(Forked child %s who will run callback %s) r5 fork_exit Exceptionr$ rX r! obj_namer )child_cbargskwargsfidr9 r9 r: fork_cb s$ r c C sB t | tr | du S t}|rt|| }t| |v r dS dS r )ri bool TRUE_STRINGSlistrj lowerr@ r` addons check_setr9 r9 r: is_true
r c C sB t | tr | du S t}|rt|| }t| |v r dS dS )NFT)ri r
FALSE_STRINGSr rj r r@ r r9 r9 r: is_false r r c C s | sdS t | tr | S t| |S NF)ri r r )r` r r9 r9 r: translate_bool s
r c s6 t s tjtj d fddt| D S )N c s g | ]} qS r9 )choice)rK _xr select_fromr9 r: rO , s z rand_str..)random SystemRandomstring
ascii_lettersdigitsrZ range)strlenr r9 r r: rand_str( s r c C s, |sd} t ddd | }|| vr |S q)Nr T )r r' )r )
dictionarypostfixnewkeyr9 r9 r:
rand_dict_key/ s r instance_data_filec
C s ddl m}m}m}m} zt| }W n ty i Y S w |rrtj |rrz||| |}t
d|| W n< |yN } z
t
d| | W Y d}~n(d}~w |yV Y n |yq } zt
d||t
| W Y d}~nd}~ww t|i dS )z>Read a yaml config with optional template, and convert to dictr )JinjaLoadErrorJinjaSyntaxParsingException
NotJinjaError render_jinja_payload_from_filez?Applied instance data in '%s' to configuration loaded from '%s'z4Failed to render templated yaml config file '%s'. %sNz:Could not apply Jinja template '%s' to '%s'. Exception: %sdefault)!cloudinit.handlers.jinja_templater r r r load_text_fileFileNotFoundErrorr5 r existsrX r rY repr load_yaml)r_ r r r r r config_filer r9 r9 r: read_conf9 sJ r c G s t t| S N)sorted
uniq_merge)listsr9 r9 r: uniq_merge_sortedm r c G sF g }| D ]}t |tr| d}dd |D }|| qt|S )NrP c S g | ]}|r|qS r9 r9 )rK ar9 r9 r: rO z uniq_merge..)ri rj r@ r8 extend uniq_list)r
combined_lista_listr9 r9 r: r y s
r c C s` t D ]
\}}| ||} qg }| D ] }|tvr || q|D ]}| |d} q!| } | S )Nr )FN_REPLACEMENTSitemsreplace
FN_ALLOWEDappendr@ )fnrL rS removalsr9 r9 r: clean_filename s
r Tc
C s zWt t| E}td dd|+}|r)t| W d W d W S | W d W d W S 1 s?w Y W d W d S 1 sPw Y W d S tyt } z|ri| W Y d }~S tt ||d }~ww )Nrbr )
ioBytesIOrq gzipGzipFilerl readr r rj )rN quietrk bufghr r9 r9 r: decomp_gzip s
Xr c C s~ | sdS | dd}|d }t|dkr |d }nd }|r+|dks+| dkr-d }|r9|dks9| dkr;d }||fS )NNNrJ r r r1 z-1none)r8 r@ lenr )ug_pair ug_partedugr9 r9 r: extract_usergroup s r root_dirc C sh t }ttj| dD ]$}tj|sq
tj|dd }| }|r1|ddkr1|||< q
|S )Nz*.pyr r0 ) r\ globr5 r rZ isfilebasenamer@ find)r entriesr_ modnamer9 r9 r: get_modules_from_dir s r c C s dt v S )a deprecated: prefer Distro object's `is_linux` property
Multiple sources of truth is bad, and already know whether we are
working with Linux from the Distro class. Using Distro offers greater code
reusablity, cleaner code, and easier maintenance.
Linuxplatformsystemr9 r9 r9 r: is_Linux s r c C s$ dt v rdS t dkrdS dS )NBSDT DragonFlyFr r9 r9 r9 r: is_BSD s
r c C t d dkS )Nvariantfreebsd system_infor9 r9 r9 r:
is_FreeBSD r c C r )Nr dragonflyr r9 r9 r9 r: is_DragonFlyBSD r r! c C r )Nr netbsdr r9 r9 r9 r: is_NetBSD r r# c C r )Nr openbsdr r9 r9 r9 r:
is_OpenBSD r r% Fc C s || vr|S t | | S r )r yobjkeyr r9 r9 r: get_cfg_option_bool s r) c C s* || vr|S | | }t |tst|}|S r )ri rj )r' r( r r` r9 r9 r: get_cfg_option_str s
r* c C t t| ||dS )Nr )r4 r* r& r9 r9 r: get_cfg_option_int s r, c C s | sd} t j| s i S t| }d}d|v rd}t||}|rS| }d|d v r0|d |d< |d dd |d< |d d krGd
|d< |d |d |d d S i S )
zReturn a dictionary of distro info fields from /etc/redhat-release.
Dict keys will align with /etc/os-release keys:
ID, VERSION_ID, VERSION_CODENAME
z/etc/redhat-releasezA(?P.+) release (?P[\d\.]+) \((?P[^)]+)\) Virtuozzoz)(?P.+) release (?P[\d\.]+)namerC z linuxr zred hat enterpriseredhatr# )ID
VERSION_IDVERSION_CODENAME) r5 r r r rematch groupdictr rV ) release_fileredhat_release redhat_regexr4 groupr9 r9 r: _parse_redhat_release s, r: c C s d} d}d}i }d}t jdr ttd}t jdr d|d< |s'd}t }|r|dd} |dd}d | v s=d
| v rBt }n6| d ksJ| d krQ|d
d}n'| dkr^|s^|d
d}n|dd}|sxt
d|dd}|rx| d }| dkr~d} nJt rt
} t }n[^)]+)\)VERSIONrC rhelr/ )r r r r zPUnable to determine distribution, template expansion may have unexpected results)r5 r r load_shell_contentr r: getr machiner3 r4 r5 r r r r7 distr rX rY ) distro_namedistro_versionflavor
os_releaseos_release_rhelr4 rH foundentryr9 r9 r: get_linux_distro s~
rP c C s | d }d}|dkr8| d d }|dv r |}|S |dv r$d}|S |d kr,d
}|S |d v r4d }|S d}|S |d
v r>|}|S )Nr unknownlinuxrH r ) almalinuxr? aoscarch
azurelinuxcentos
cloudlinuxdebian eurolinuxfedoramariner miraclelinux openeuler opencloudos openmandrivar@ r< rD rockyr> tencentosrB )ubuntu linuxmintmintrc r/ rD )opensusez
opensuse-leapzopensuse-microoszopensuse-tumbleweedsle_hpcz sle-micror= r> )windowsdarwinr r" r$ r )r )infor r
linux_distr9 r9 r: _get_variant` s*
rl c C s< t t t t tt t d} t| | d< | S )N)r r r7 pythonr6 rH r )r r r7 python_versionr r6 rP rl )rj r9 r9 r: r s
r c C sX || vr|S | | du rg S | | }t |tr dd |D }|S t |ts)t|}|gS )a
Gets the C{key} config option from C{yobj} as a list of strings. If the
key is present as a single string it will be returned as a list with one
string arg.
@param yobj: The configuration object.
@param key: The configuration key to get.
@param default: The default to return if key is not found.
@return: The configuration option as a list of strings or default if key
is not found.
Nc S s g | ]}|qS r9 r9 rR r9 r9 r: rO s z'get_cfg_option_list..)ri r rj )r' r( r r` cvalr9 r9 r: get_cfg_option_list s
rp c C s> t |tr
|d}| }|D ]}||vr| S || }q|S )a Return the value of the item at path C{keyp} in C{yobj}.
example:
get_cfg_by_path({'a': {'b': {'num': 4}}}, 'a/b/num') == 4
get_cfg_by_path({'a': {'b': {'num': 4}}}, 'c/d') == None
@param yobj: A dictionary.
@param keyp: A path inside yobj. it can be a '/' delimited string,
or an iterable.
@param default: The default to return if the path does not exist.
@return: The value of the item at keyp."
is not found./)ri rj r8 )r' keypr curtokr9 r9 r: get_cfg_by_path s
ru c C s t | |\}}t|| ||fS r )get_output_cfgredirect_output)cfgmodeoutfmterrfmtr9 r9 r: fixup_output s
r| c
C s t tjdrtd d S |stj}|stj}dd }| rtd|| | dd\}}|dks6|d krDd
}|dkr>d }t
||}n |d kr[t j |d
t j
|d} ttt | j}ntd| |rmt| | || krtd|| t| | d S |rtd|| | dd\}}|dks|d krd
}|dkrd }t
||}n |d krt j |d
t j
|d} ttt | j}ntd| |rt| | d S d S d S )N_CLOUD_INIT_SAVE_STDOUTz5Not redirecting output due to _CLOUD_INIT_SAVE_STDOUTc S s> t d ztdj} W n
ty Y dS w t | dS )a Reconfigure umask and group ID to create output files securely.
This is passed to subprocess.Popen as preexec_fn, so it is executed in
the context of the newly-created process. It:
* sets the umask of the process so created files aren't world-readable
* if an adm group exists in the system, sets that as the process' GID
(so that the created file(s) are owned by root:adm)
admN)r5 umaskgrpgetgrnamgr_gidKeyErrorsetgid)group_idr9 r9 r: set_subprocess_umask_and_gid s
z5redirect_output..set_subprocess_umask_and_gidzRedirecting %s to %s r >>>abwb|T)shellstdin
preexec_fnz"Invalid type for output format: %sz!Invalid type for error format: %s)r r5 environrF rX r sysr? stderrr8 open
subprocessPopenPIPEr r
r r rs dup2fileno)
rz r{ o_outo_errr ry argowithnew_fpprocr9 r9 r: rw sh
rw sourcesc C sR |rt t| } i }| D ]}|r&t|}|st }t|}|||}q |S )aF Merge multiple dicts according to the dict merger rules.
Dict merger rules can be found in cloud-init documentation. If no mergers
have been specified, entries will be recursively added, but no values
get replaced if they already exist. Functionally, this means that the
highest priority keys must be specified first.
Example:
a = {
"a": 1,
"b": 2,
"c": [1, 2, 3],
"d": {
"a": 1,
"b": 2,
},
}
b = {
"a": 10,
"c": [4],
"d": {
"a": 3,
"f": 10,
},
"e": 20,
}
mergemanydict([a, b]) results in:
{
'a': 1,
'b': 2,
'c': [1, 2, 3],
'd': {
'a': 1,
'b': 2,
'f': 10,
},
'e': 20,
}
)r reversedr dict_extract_mergersdefault_mergers constructmerge)r reverse
merged_cfgrx mergers_to_applymergerr9 r9 r:
mergemanydictC s *
r c c s8 t }zt | | V W t | d S t | w r )r5 getcwdchdir)ndircurrr9 r9 r: r { s
r c c s0 t | }z |V W t | d S t | w r )r5 r )n_mskoldr9 r9 r: r s
r c C s dj | |d|dS )Nz{0:{fill}{align}{size}}^)fillalignsize)format)rn r max_lenr9 r9 r: center s r c C s2 t d| zt| W dS ty Y dS w )z
Deletes a directory and all its contents by calling shutil.rmtree
Will ignore FileNotFoundError
@param path: The path of the directory.
"""
zRecursively deleting %sN)rX r shutilrmtreer r r9 r9 r: del_dir s r r c
C st z t |||d\}}}}|| d< || d< || d< || d< W dS tjy9 } z|jtjkr4W Y d}~dS d}~ww ) z
returns boolean indicating success or failure (presense of files)
if files are present, populates 'fill' dictionary with 'user-data' and
'meta-data' entries
)baseexttimeout user-data vendor-data meta-dataznetwork-configTNF) read_seededr" UrlErrorcode NOT_FOUND) r r r r mdudvdnetworkr r9 r9 r: read_optional_seed s r c C s i }| s ddg}nt j| ddt j| ddg}t|}dd |D }d }|D ]}t jt j|drBt j|d} nq,d }|D ]}t jt j|dr]t j|d} nqG|rl|rl||d < ||d
< |S |rr||d < |S ) Nz/var/lib/cloud/data/sslz /var/lib/cloud/instance/data/sslrN sslc S s g | ] }|rt j|r|qS r9 )r5 r isdir)rK dr9 r9 r: rO s z%fetch_ssl_details..zcert.pemzkey.pem cert_filekey_file)r5 r rZ
get_ipath_cur get_cpathr r )paths ssl_detailsssl_cert_pathsr r r r9 r9 r: fetch_ssl_details s: r c
C s |}t | } z/tdt| | t| }|d u r!td |}nt||s1td|t |f |}W |S tj
tt fy } zJd}d }t |drUt
|drUt
|d}nt |drdt
|drdt
|d}|rw|dj|jd |jd |d 7 }n|d
j|d 7 }t| W Y d }~|S d }~ww ) NzKAttempting to load yaml from string of length %s with allowed root types %sz-loaded blob returned None, returning default.z2Yaml load allows %s root types, but got %s insteadzFailed loading yaml blob context_mark problem_markz5. Invalid format at line {line} column {col}: "{err}"r )r^ colrb z. {err})rb )rl rX r r yaml safe_loadri rs r! r YAMLError
ValueErrorhasattrgetattrr r^ columnrY )rd r allowedloaded convertedr msgmarkr9 r9 r: r sL
r
c
C sV | ddkr | dd| }| dd| }| dd| }n*tjr5| d dkr5t| jdkr5| d7 } d | d|f }d | d|f }d | d|f }d }tj|||d
}d } | rat
|j i d } tj|||d
}
d } |
rr|
j } d } z
tj|||d
}
W n tj y } z t
d | W Y d }~nd }~ww |
r|
j } nt
d
| | | |fS )Nz%sr r r r r rq r z%s%s%s)r retriesr z!Error in vendor-data response: %sz Error in vendor-data response)r
r r %NOCLOUD_SEED_URL_APPEND_FORWARD_SLASHr urlparsequeryr" read_file_or_urlokr contentsr rX r )r r r r ud_urlvd_urlmd_urlr md_respr ud_respr r vd_respr r9 r9 r: r sH
r c s t t dd}dd |D } fdd|D }g }|D ];}tj |}z |t||d W q ty@ t d| Y q t
yX } z
t d|| W Y d }~q d }~ww t |S )
z Read configuration directory.Tr c S g | ] }| d r|qS )z.cfg)endswithrK fr9 r9 r: rO 1 z read_conf_d..c s& g | ]}t jt j |r|qS r9 )r5 r r rZ r confdr9 r: rO 4 s & r 1REDACTED config part %s, insufficient permissions Error accessing file %s: [%s]N) r r5 listdirr rZ r r PermissionErrorrX rY r r )r r confscfgsr r r r9 r r: read_conf_d+ s, r c
C s t }i }zt| |d}W n' ty td| Y n ty4 } z
td| | W Y d}~n
d}~ww || d}d|v r]|d }|r\t|tsVt d| t
|f t| }nt
j| drk| d}|r~t
j|r~t||d}|| t|S ) a Read yaml file along with optional ".d" directory, return merged config
Given a yaml file, load the file as a dictionary. Additionally, if there
exists a same-named directory with .d extension, read all files from
that directory in order and return the merged config. The template
file is optional and will be applied to any applicable jinja file
in the configs.
For example, this function can read both /etc/cloud/cloud.cfg and all
files in /etc/cloud/cloud.cfg.d and merge all configs into a single dict.
r r r Nr conf_dz8Config file %s contains 'conf_d' with non-string type %sz.d)r r r rX rY r r ri rj rs r! r r@ r5 r r r
appendleftr )cfgfiler r rx r r confd_cfgr9 r9 r: read_conf_with_confdK s>
r c C s t t| dS )Ncmdline)r read_cc_from_cmdliner r9 r9 r: read_conf_from_cmdlinez r r c C s | d u rt } d| } d}d}t|}t|}t| }g }| |}|dkrU| ||| }|dk r5|}|t| || | dd | ||| }|dks'd|S )Nr z cc:end_ccr z\n
) get_cmdliner r
r r unquotelstripr rZ ) r tag_begintag_endbegin_lend_lclentokensbeginendr9 r9 r: r
s,
r
c C s2 | d}|dks| |d dkr| S | ddS )Nr
r r
z
)r
r )r posr9 r9 r: dos2unix s
r c @ s& e Zd ZU eed< eed< eed< dS )HostnameFqdnInfohostnamefqdn
is_defaultN)r r r rj __annotations__r r9 r9 r9 r: r s
r c C s d}d| v rt | d }t| d|dd }n6d| v r5| d ddkr5| d }| d d|d }n|jd|dj}d| v rF| d }n|j|d \}}t|||S )
a Get hostname and fqdn from config if present and fallback to cloud.
@param cfg: Dictionary of merged user-data configuration (from init.cfg).
@param cloud: Cloud instance from init.cloudify().
@param metadata_only: Boolean, set True to only query meta-data,
returning None if not present in meta-data.
@return: a namedtuple of
, , (str, str, bool).
Values can be none when
metadata_only is True and no cfg or metadata provides hostname info.
is_default is a bool and
it's true only if hostname is localhost and was
returned by util.get_hostname() as a default.
This is used to differentiate with a user-defined
localhost hostname.
Fr r r0 r NT)r
metadata_only)r! )rj r* r8 r
get_hostnamer r )rx cloudr! r r r r9 r9 r: get_hostname_fqdn s$
r$
/etc/hostsc C s d}z=t | D ]3}|d}|dkr|d| }| }|s!q | }t|dk r,q | |dd v r<|d } W |S q W |S tyI Y |S w )a
For each host a single line should be present with
the following information:
IP_address canonical_hostname [aliases...]
Fields of the entry are separated by any number of blanks and/or tab
characters. Text from a "#" character until the end of the line is a
comment, and is ignored. Host names may contain only alphanumeric
characters, minus signs ("-"), and periods ("."). They must begin with
an alphabetic character and end with an alphanumeric character.
Optional aliases provide for name changes, alternate spellings, shorter
hostnames, or generic hostnames (for example, localhost).
N#r r1 r )r rU r
r@ r8 r IOError)r filenamer r^ hashpostoksr9 r9 r: get_fqdn_from_hosts s.
r, z
Resolving URLc
C sP t | }|j}tdu r_t }d}i }|D ]?}z0t|dddtjtj}g ||< |D ]\}} }
} } || d| | d f |
| d q*W q tj tj fyT Y qw |a|r_t
d| z:tt t|jdrx W d W dS W d n1 sw Y t|d}|d d d }
|
tvW S tj tj fy Y d S w )
a determine if a url's network address is resolvable, return a boolean
This also attempts to be resilent against dns redirection.
Note, that normal nsswitch resolution is used here. So in order
to avoid any utilization of 'search' entries in /etc/resolv.conf
we have to append '.'.
The top level 'invalid' domain is invalid per RFC. And example.com
should also not exist. The '__cloud_init_expected_not_found__' entry will
be resolved inside the search list.
N)zdoes-not-exist.example.com.zexample.invalid.!__cloud_init_expected_not_found__r z%s: %sz detected dns redirection: %sz[]T F)r r r _DNS_REDIRECT_IPsetsocket getaddrinfo SOCK_STREAM AI_CANONNAMEr addgaierrorerrorrX r r r r
is_ip_addressnetlocr@ )url
parsed_urlr. badipsbadnames
badresultsinameresult_fam_stype_protocnamesockaddraddrr9 r9 r:
is_resolvable sF
rG c C s t } | S r )r1 gethostname)r r9 r9 r: r" 7 s r" c C s( zt | d W S t jy Y d S w Nr )r1
gethostbyaddrherror)ipr9 r9 r: rJ < s
rJ c C s t | S )z5determine if this url is resolvable (existing or ip).)rG )r: r9 r9 r: is_resolvable_urlC s rM c C sZ | du rdS t d| | D ] }zt|r t d| |W S W q ty* Y qw dS )zc
Search through a list of mirror urls for one that works
This needs to return quickly.
Nz%search for mirror in candidates: '%s'zfound working mirror: '%s')rX r rM r )
candidatescandr9 r9 r: search_for_mirrorH s
rP devicec C sz g }| st dt d S | dr'| d}dd d| d| fD }|S | dkr2t d}|S | d kr;t d}|S )
Nz/dev/msdosfs/*z/dev/iso9660/*LABEL=c S g | ]
}t j|r|qS r9 r5 r r )rK pr9 r9 r: rO c s
z*find_devs_with_freebsd..z
/dev/msdosfs/z
/dev/iso9660/ TYPE=vfat TYPE=iso9660)r
startswithr )criteriaoformattagno_cacher devlistlabelr9 r9 r: find_devs_with_freebsd[ s
r_ c C s g }d }d }d}| r | dr| d}| dr | d}tjg ddgd} | j D ]5}
|s3|r@tjd|
gddgd\}} |rId | |vrIq-|d
krRd |vrRq-|d kr[d |v r[q-|d
|
q-|S )Nr rR zTYPE=sysctl-nz hw.disknamesr rcs mscdlabelr z
label "%s"iso9660zISO filesystemvfat/dev/)rX r r r? r8 r ) rY rZ r[ r\ r r] r^ _type
mscdlabel_outrA devr' r9 r9 r: find_devs_with_netbsdo s*
rl c C s t j g ddgd}g }|j dD ](}|ds q|dkr!q||d d d |d s<||d d d
qd d |D S )
Nr` r rc rP rJ zfd0:r r cdic S g | ]}d | qS rh r9 rK rn r9 r9 r: rO r z*find_devs_with_openbsd..)r r? rstripr8 r r rX )rY rZ r[ r\ r rA r] rO r9 r9 r: find_devs_with_openbsd s
rs c C s~ t j g ddgd}dd t|j ddD }| dkr$d d |D }n| d
v r0d d |D }n| r8td | d
d |D S )N)ra rb z
kern.disksr rc c S s$ g | ]}| d s| ds|qS )r vnrX rq r9 r9 r: rO s z/find_devs_with_dragonflybsd..Tr rW c S r )rm acdru rq r9 r9 r: rO r )zLABEL=CONFIG-2rV c S s g | ] }| d s|qS rv ru rq r9 r9 r: rO r zUnexpected criteria: %sc S ro rp r9 rq r9 r9 r: rO r )r r r? r8 rX r )rY rZ r[ r\ r rA r] r9 r9 r: find_devs_with_dragonflybsd s rx c
C s@ t r t| ||||S t rt| ||||S t r!t| ||||S t r,t| ||||S dg}g }| r:|d| |rC|d| |rL| ddg |rU|d| |r\|| || }z
t
j
|ddgd \}} W n t
j y }
z|
j t
kr~d
}n W Y d }
~
nd }
~
ww g } | D ]
} | } | r| | q| S ) z
find devices matching given criteria (via blkid)
criteria can be *one* of:
TYPE=
LABEL=