| Server IP : 3.138.164.131 / Your IP : 216.73.216.136 Web Server : Apache System : Linux ns1.techtime.me 4.18.0-147.8.1.el8.lve.1.x86_64 #1 SMP Mon Jun 29 09:55:57 EDT 2020 x86_64 User : injazaat ( 1471) PHP Version : 8.1.20 Disable Function : NONE MySQL : OFF | cURL : ON | WGET : ON | Perl : ON | Python : ON | Sudo : OFF | Pkexec : OFF Directory : /lib/python3.6/site-packages/cloudinit/sources/__pycache__/ |
Upload File : |
3
�cd�� � @ s~ d dl Z d dlZd dlZd dlmZ d dlmZ d dlmZ d dlm Z m
Z
d dlm Z d dlm
Z
mZ d dlmZmZ d d lmZmZ eje�Zee jg�Zd3Zd
Z dZ dZ dZ e d Z e e gZ!G dd� de"�Z#G dd� de
j$�Z%G dd� de%�Z&dd� Z'dd� Z(d d � Z)d d � Z*d d!� Z+d"d#� Z,d$d%� Z-d&d'� Z.d(d)� Z/d4d+d,�Z0d-d.� Z1d/d0� Z2e&e
j3ffe%e
j3e
j4ffgZ5d1d2� Z6dS )5� N)�dmi)� ec2_utils)�log)�net�sources)�
url_helper)�util�warnings)�
EventScope� EventType)�EphemeralDHCPv4�NoDHCPLeaseError�
datasource�Ec2� strict_id�warnzlatest/api/tokenZ21600zX-aws-ec2-metadata-tokenz -ttl-secondsc @ s( e Zd ZdZdZdZdZdZdZdZ dS ) �
CloudNamesZaliyunZawsZ brightboxZzstack�e24cloud�unknownzno-ec2-metadataN)
�__name__�
__module__� __qualname__ZALIYUN�AWS� BRIGHTBOX�ZSTACK�E24CLOUD�UNKNOWN�NO_EC2_METADATA� r r �#/usr/lib/python3.6/DataSourceEc2.pyr & s r c s4 e Zd ZdZddgZdZdddgZdZd Zd
Z e
j Z d Z
ejejejejejhiZ� fd d
�Zdd� Zdd� Zdd� Zedd� �Zedd� �Z dd� Z dd� Z d9d d �Z d d � Z d d!� Z!ed"d#� �Z"ed$d%� �Z#d&d'� Z$ed(d)� �Z%e� fd*d+��Z&d,d-� Z'e(fd.d/�Z)d0d1� Z*d2d3� Z+d:d4d5�Z,d;d7d8�Z-� Z.S )<�
DataSourceEc2r zhttp://169.254.169.254zhttp://instance-data.:8773z
2009-04-04z
2021-03-23z
2018-09-24z
2016-09-02�x �2 NFc s t t| �j|||� d | _d S )N)�superr �__init__�metadata_address)�self�sys_cfgZdistro�paths)� __class__r r r$ W s zDataSourceEc2.__init__c C s t � S )z5Return the cloud name as identified during _get_data.)�identify_platform)r& r r r �_get_cloud_name[ s z DataSourceEc2._get_cloud_namec C s t tj| jtt�d�\}}tjd|| j| j � |dkrF| jt
j krFdS | jt
j krVdS | j
r�tj� rrtjd� dS y0t| j�� tjtjd| jd�| _W d Q R X W q� tk
r� dS X ntjtjd| jd�| _| js�dS | jjdd �| _| jjd d �| _| jjd
i �jd i �jd i �| _d
S )Nr z0strict_mode: %s, cloud_name=%s cloud_platform=%s�trueFz1FreeBSD doesn't support running dhclient with -sfzCrawl of metadata service)�logfunc�msg�funcz meta-dataz user-data�dynamiczinstance-identity�documentT)r N)�read_strict_moder �get_cfg_by_pathr' �STRICT_ID_PATH�STRICT_ID_DEFAULT�LOG�debug�
cloud_name�platformr r r �perform_dhcp_setupZ
is_FreeBSDr �fallback_interface�log_time�crawl_metadataZ_crawled_metadatar
�get�metadataZ userdata_raw�identity)r& Z strict_modeZ_sleepr r r � _get_data_ sJ
zDataSourceEc2._get_datac C sN | j s
dS | j jdi �jdi �}x(|jdi �j� D ]\}}d|kr2dS q2W dS )z6Report if this instance type is Ec2 Classic (non-vpc).F�network�
interfaces�macszvpc-idT)r? r> �items)r& Z ifaces_mdZ_macZmac_datar r r �is_classic_instance� s z!DataSourceEc2.is_classic_instancec C s | j s
d S | j jd�S )Nzami-launch-index)r? r> )r& r r r � launch_index� s zDataSourceEc2.launch_indexc C s. t | d�stjj� | _| js(tjj� | _| jS )N�_platform_type)�hasattrr �dsname�lowerrH )r& r r r r9 � s
zDataSourceEc2.platformc C s� d}| j � }x�| jD ]�}|j| j|�}ytj||td�}W n2 tjk
rl } ztj d||� W Y dd}~X qX |j
dkr�tj d|� |S |j
dkrd}tj |||j � qW | j S ) aE Get the best supported api version from the metadata service.
Loop through all extended support metadata versions in order and
return the most-fully featured metadata api version discovered.
If extended_metadata_versions aren't present, return the datasource's
min_metadata_version.
z {0}/{1}/meta-data/instance-id)�url�headers�headers_redactzurl %s raised exception %sN�� z#Found preferred metadata version %si� z0Metadata api version %s not present. Headers: %s)
� _get_headers�extended_metadata_versions�formatr% �uhelp�readurl�AWS_TOKEN_REDACT�UrlErrorr6 r7 �coderM �min_metadata_version)r& Zurl_tmplrM Zapi_verrL Zresp�er. r r r �get_metadata_api_version� s
z&DataSourceEc2.get_metadata_api_versionc C sf | j tjkrXt| dd �sD| j� }tj|| j| jt | j
d�j di �| _ | j j d| j
d �S | j
d S d S )Nr@ )�
headers_cbrN � exception_cbr1 Z
instanceIdz instance-id)r8 r r �getattrrZ �ec2�get_instance_identityr% rP rU �_refresh_stale_aws_token_cbr> r@ r? )r& � api_versionr r r �get_instance_id� s
z DataSourceEc2.get_instance_idc C s� | j tjkrdS g }i }t}d}x*|D ]"}dj||�} |j| � ||| < q&W tjd� d}
d}| j� } y,t j
|| j | j tj
| j| j|td�\}}
W n t jk
r� Y nX |r�|
r�|
| _|| S dS )a Get an API token for EC2 Instance Metadata Service.
On EC2. IMDS will always answer an API token, unless
the instance owner has disabled the IMDS HTTP endpoint or
the network topology conflicts with the configured hop-limit.
N�PUTz{0}/{1}z Fetching Ec2 IMDSv2 API Token)�urls�max_wait�timeout� status_cbr[ r\ �request_methodrN )r8 r r �API_TOKEN_ROUTErR �appendr6 r7 �get_url_paramsrS � wait_for_url�max_wait_seconds�timeout_seconds�warningrP �_imds_exception_cbrU rV �
_api_token) r& �mdurlsrf re rd �url2base�url_pathrh rL �cur�response�
url_paramsr r r �_maybe_fetch_api_token� s<
z$DataSourceEc2._maybe_fetch_api_tokenc C sx | j }| j� }|jdkr dS |jd| j�}dd� |D �}t|�t|�krdtjdtt|�t|� �� t |�rr|}ntj
d� | j}| j |�}| o�| j t
jk�r g }i }dj| jd �}d
} x*|D ]"}
d j|
|�} |j| � |
|| < q�W tj� } tj||j|jtj
t| j| d �\}
}
|
�r ||
}|�r<|| _tjd
| j� n4| j t
jk�rVtj
d� ntjd|ttj� | �� t|�S )Nr F�
metadata_urlsc S s g | ]}t j|�r|�qS r )r Zis_resolvable_url)�.0�xr r r �
<listcomp> s z;DataSourceEc2.wait_for_metadata_service.<locals>.<listcomp>z,Removed the following from metadata urls: %sz+Empty metadata url list! using default listz{ver}/meta-data/instance-id)ZverZGETz{0}/{1})rd re rf rg rN r[ rh zUsing metadata source: '%s'z)IMDS's HTTP endpoint is probably disabledz(Giving up on md from %s after %s seconds) �ds_cfgrk rm r> ry �setr6 r7 �list�lenro rx r8 r r rR rX rj �timerS rl rn rU rP r% Zcritical�int�bool)r& Zmcfgrw rr Zfilteredr% rd rs rt rh rL ru Z
start_time�_r r r �wait_for_metadata_service s\
z'DataSourceEc2.wait_for_metadata_servicec C s� d| j krd S d }| j d }t|t�s6tjd|� d S x6|j� D ]*\}}||krV|}P |dkr@|dkr@|}q@W |d kr�tjd|� d S |}|jd�s�d| }tjj |�r�|S | j
tjj |��}|r�tjd||� |S |dkr�d S |S ) Nzblock-device-mappingz+block-device-mapping not a dictionary: '%s'Z ephemeralZ
ephemeral0z Unable to convert %s to a device�/z/dev/%sz Remapped device name %s => %s) r? �
isinstance�dictr6 r7 rE �
startswith�os�path�existsZ
_remap_device�basename)r& �name�foundZbdmZentnameZdeviceZofoundZremappedr r r �device_name_to_deviceT s8
z#DataSourceEc2.device_name_to_devicec C sP y6| j tjkr&| jjd| jd d �S | jd d S W n tk
rJ d S X d S )NZavailabilityZoneZ placementzavailability-zone)r8 r r r@ r> r? �KeyError)r& r r r �availability_zone� s z DataSourceEc2.availability_zonec C sT | j tjkr6| jjd�}| jr2| r2| jd d� }|S | j}|d k rP|d d� S d S )N�region� ���r� )r8 r r r@ r> r� )r& r� Zazr r r r� � s zDataSourceEc2.regionc C s, |sd S | j tjkr(ttj|tt�|� d S )N)r8 r r �warn_if_necessaryr r3 r4 r5 )r& �cfgZis_new_instancer r r �activate� s zDataSourceEc2.activatec C s� | j tjkr| j S | jdkr*tjd� dS d}td| jkoD| jtj k�}|rjtj
d� t j tj
d| j
d� | j}| jjd�}t|t�r�t||t j| jdd�d �}| j� r�tj| j�| _| jtj jt j � | jtj jt j � n tjd
|� || _ | j S ) z@Return a network config dict for rendering ENI or netplan files.Nz8Unexpected call to network_config when metadata is None.rB zPMetadata 'network' not present: Refreshing stale metadata from prior to upgrade.z Re-crawl of metadata service)r- r. r/ Z apply_full_imds_network_configT)� fallback_nic�full_network_configz%Metadata 'network' key not valid: %s.) �_network_configr �UNSETr? r6 ro r� r8 r r r7 r r< �get_datar; r> r� r� �#convert_ec2_metadata_network_configZget_cfg_option_boolr} rF �copy�deepcopyZdefault_update_eventsr
�NETWORK�addr �BOOT� BOOT_LEGACY)r& �resultZno_network_metadata_on_awsZifaceZnet_mdr r r �network_config� sF
z DataSourceEc2.network_configc s: | j d kr4t| dd �}|r(|| _ d | _n tt| �jS | j S )Nr� )Z_fallback_interfacer] r� r# r r; )r& Z
_legacy_fbnic)r) r r r; � s
z DataSourceEc2.fallback_interfacec
C s� | j � s i S | j� }t}i }| jtjkr6| j}| j}nd }}yltj || j
| j ||d�|d< tj || j
| j ||d�|d< | jtjkr�tj
|| j
| j ||d�}d|i|d< W n$ tk
r� tjtd| j
� i S X ||d< |S ) z�Crawl metadata service when available.
@returns: Dictionary of crawled metadata content containing the keys:
meta-data, user-data and dynamic.
N)r[ rN r\ z user-dataz meta-datazinstance-identityr0 z'Failed reading from metadata address %sZ_metadata_api_version)r� rZ rU r8 r r r` �#_skip_or_refresh_stale_aws_token_cbr^ Zget_instance_userdatar% rP Zget_instance_metadatar_ � Exceptionr Zlogexcr6 )r& ra ZredactZcrawled_metadataZexc_cbZ exc_cb_udr@ r r r r= � sL z DataSourceEc2.crawl_metadatac C s~ | j tjkrdS tjd� t|i}dj| jt�}yt j
||t dd�}W n0 t j k
rv } ztj
d||� dS d}~X nX |jS )z�Request new metadata API token.
@param seconds: The lifetime of the token in seconds
@return: The API token or None if unavailable.
Nz!Refreshing Ec2 metadata API tokenz{}/{}rc )rM rN rh z/Unable to get API token: %s raised exception %s)r8 r r r6 r7 �AWS_TOKEN_REQ_HEADERrR r% ri rS rT rU rV ro �contents)r& ZsecondsZrequest_headerZ token_urlrv rY r r r �_refresh_api_token- s
z DataSourceEc2._refresh_api_tokenc C s$ t jt j||�}|sdS | j||�S )zSCallback will not retry on SKIP_USERDATA_CODES or if no token
is available.F)r^ Zskip_retry_on_codesZSKIP_USERDATA_CODESr` )r& r. � exceptionZretryr r r r� F s
z1DataSourceEc2._skip_or_refresh_stale_aws_token_cbc C s* t |tj�r&|jdkr&tjd� d| _dS )z=Exception handler for Ec2 to refresh token if token is stale.i� z+Clearing cached Ec2 API token due to expiryNT)r� rS rV rW r6 r7 rq )r& r. r� r r r r` P s
z)DataSourceEc2._refresh_stale_aws_token_cbc C sD t |tj�r@|jr@|jdkr@|jdkr2tjd� n
tjd� |�dS )a2 Fail quickly on proper AWS if IMDSv2 rejects API token request
Guidance from Amazon is that if IMDSv2 had disabled token requests
by returning a 403, or cloud-init malformed requests resulting in
other 40X errors, we want the datasource detection to fail quickly
without retries as those symptoms will likely not be resolved by
retries.
Exceptions such as requests.ConnectionError due to IMDS being
temporarily unroutable or unavailable will still retry due to the
callsite wait_for_url.
i� i� zLEc2 IMDS endpoint returned a 403 error. HTTP endpoint is disabled. Aborting.z2Fatal error while requesting Ec2 IMDSv2 API tokensN)r� rS rV rW r6 ro )r& r. r� r r r rp X s
z DataSourceEc2._imds_exception_cb� c C sH | j tjkri S tti}t|kr$|S | js>| j� | _| js>i S t| jiS )z�Return a dict of headers for accessing a url.
If _api_token is unset on AWS, attempt to refresh the token via a PUT
and then return the updated token header.
) r8 r r r� �AWS_TOKEN_TTL_SECONDSri rq r� �AWS_TOKEN_PUT_HEADER)r& rL Zrequest_token_headerr r r rP s s
zDataSourceEc2._get_headers)NN)N)r� )/r r r rJ ry rX rQ Z url_max_waitZ url_timeoutrq r r� r� r: r
r� r ZBOOT_NEW_INSTANCEr� r� ZHOTPLUGZsupported_update_eventsr$ r+ rA rF �propertyrG r9 rZ rb rx r� r� r� r� r� r� r; r= r� r� r� r` rp rP �
__classcell__r r )r) r r 4 sH
1
1F3
C
2
r c s$ e Zd ZdZdZ� fdd�Z� ZS )�DataSourceEc2Localay Datasource run at init-local which sets up network to query metadata.
In init-local, no network is available. This subclass sets up minimal
networking with dhclient on a viable nic so that it can talk to the
metadata service. If the metadata service provides network configuration
then render the network configuration for that instance based on metadata.
Tc s4 t jf}| j|kr&tjd|| j� dS tt| �j� S )Nz+Local Ec2 mode only supported on %s, not %sF)r r r8 r6 r7 r# r� r� )r& Zsupported_platforms)r) r r r� � s
zDataSourceEc2Local.get_data)r r r �__doc__r: r� r� r r )r) r r� � s r� c C s8 yt | �S tk
r2 } ztj|� |S d }~X nX d S )N)�parse_strict_mode�
ValueErrorr6 ro )�cfgval�defaultrY r r r r2 � s
r2 c C s� | dkr d
S | dkrd S | s d S | j d�\}}}|d
krHtd|| f ��|r�y t|�}W q� tk
r� } ztd || f �|�W Y d d }~X q�X nd }||fS )NTr, F�falser r �,zUInvalid mode '%s' in strict_id setting '%s': Expected one of 'true', 'false', 'warn'.z<Invalid sleep '%s' in strict_id setting '%s': not an integer)r, N)r� N)r r )r, r� r )� partitionr� r� )r� �moder� �sleeprY r r r r� � s*
r� c C s^ yt | �\}}W n* tk
r: } ztj|� d S d }~X nX |dkrHd S tjd|d|d� d S )Nr� Z
non_ec2_mdT)r� r� )r� r� r6 ro r Z show_warning)r� r� r� r� rY r r r r� � s
r� c C s4 | d j d�r0| d dks*| d | d kr0tjS d S )N�uuidr^ � uuid_source�
hypervisor�serial)r� r r )�datar r r � identify_aws� s r� c C s | d j d�rtjS d S )Nr� z.brightbox.com)�endswithr r )r� r r r �identify_brightbox� s r� c C s | d j d�rtjS d S )N� asset_tagz
.zstack.io)r� r r )r� r r r �identify_zstack� s r� c C s | d dkrt jS d S )N�vendorr )r r )r� r r r �identify_e24cloud� s r� c C sr t � } ttttdd� f}xT|D ]L}y|| �}|r4|S W q tk
rh } ztjd|| |� W Y d d }~X q X q W d S )Nc S s t jS )N)r r )r{ r r r �<lambda>� s z#identify_platform.<locals>.<lambda>z'calling %s with %s raised exception: %s)�_collect_platform_datar� r� r� r� r� r6 ro )r� ZchecksZcheckerr� rY r r r r* � s
r* c C s� i } yt jd�j� }d| d< W n& tk
rD tjd�}d| d< Y nX |dkrRd}|j� | d< tjd �}|dkrtd}|j� | d
< tjd �}|dkr�d}|j� | d < tjd
�}|r�|ndj� | d< | S )a9 Returns a dictionary of platform info from dmi or /sys/hypervisor.
Keys in the dictionary are as follows:
uuid: system-uuid from dmi or /sys/hypervisor
uuid_source: 'hypervisor' (/sys/hypervisor/uuid) or 'dmi'
serial: dmi 'system-serial-number' (/sys/.../product_serial)
asset_tag: 'dmidecode -s chassis-asset-tag'
vendor: dmi 'system-manufacturer' (/sys/.../sys_vendor)
On Ec2 instances experimentation is that product_serial is upper case,
and product_uuid is lower case. This returns lower case values for both.
z/sys/hypervisor/uuidr� r� z system-uuidr Nr� r� zsystem-serial-numberr� zchassis-asset-tagr� zsystem-manufacturerr� )r Z load_file�stripr� r Z
read_dmi_datarK )r� r� r� r� r� r r r r� s*
r� Tc C s� di d�}|st j� }| d d }|s�x |j� D ]\}}||kr0P q0W ddd|j� i|d�}|j|�} | jd �rxd|d
< ||d |< |S d }
x�t|j� �D ]�\}}|j|�} | s�q�t| jd
|
��d }
d|
d i} d| dd|j� i|d�}| jd ��rd|d
< | |d< t| |�|d< |d �s(|jd� ||d |< q�W t |d �dk�r�x<|d j
� D ],}|d | jd� |d | jdd� �qXW |S )a Convert ec2 metadata to network config version 2 data dict.
@param: network_md: 'network' portion of EC2 metadata.
generally formed as {"interfaces": {"macs": {}} where
'macs' is a dictionary with mac address as key and contents like:
{"device-number": "0", "interface-id": "...", "local-ipv4s": ...}
@param: macs_to_nics: Optional dict of mac addresses and nic names. If
not provided, get_interfaces_by_mac is called to get it from the OS.
@param: fallback_nic: Optionally provide the primary nic interface name.
This nic will be guaranteed to minimally have a dhcp4 configuration.
@param: full_network_config: Boolean set True to configure all networking
presented by IMDS. This includes rendering secondary IPv4 and IPv6
addresses on all NICs and rendering network config on secondary NICs.
If False, only the primary nic will be configured and only with dhcp
(IPv4/IPv6).
@return A dict of network config version 2 based on the metadata and macs.
� )�version� ethernetsrC rD TFZ
macaddress)�dhcp4�dhcp6�matchzset-name�ipv6sr� r� r z
device-numberr� z route-metric�d )r� zdhcp4-overridesr� r� zset-namezdhcp6-overrides� addresseszdhcp4-overridesN) r Zget_interfaces_by_macrE rK r> �sortedr� �get_secondary_addresses�popr� �keys) Z
network_mdZ macs_to_nicsr� r� ZnetcfgZ
macs_metadata�macZnic_nameZ
dev_config� nic_metadataZnic_idxZ
dhcp_overrider r r r� / sR
r� c C s� | j d�}| j d�}g }tt|t�o.t|�dk�rH|jt| d||d�� tt|t�o^t|�dk�rx|jt| d||d�� t|�S )z�Parse interface-specific nic metadata and return any secondary IPs
:return: List of secondary IPv4 or IPv6 addresses to configure on the
interface
z local-ipv4sr� r� zsubnet-ipv4-cidr-blockZ24zsubnet-ipv6-cidr-blockZ128)r> r� r� r r� �extend�_get_secondary_addressesr� )r� r� Zipv4sr� r� r r r r� x s
r� c
C s� g }| j |�}|}| s*t|jd��dkrPd|kr6dnd}tjd|||||� n|jd�d }x(|dd� D ]} |jdj| |d �� qlW |S )
z�Return list of IP addresses as CIDRs for secondary IPs
The CIDR prefix will be default_prefix if cidr_key is absent or not
parseable in nic_metadata.
r� r� Zipv4Zipv6zJCould not parse %s %s for mac %s. %s network config prefix defaults to /%sr� Nz
{ip}/{prefix})�ip�prefix)r> r� �splitr6 ro rj rR )
r� Zcidr_keyr� ZipsZdefault_prefixr� Zcidrr� Zip_typer� r r r r� � s
r� c C s t j| t�S )N)r Zlist_from_depends� datasources)Zdependsr r r �get_datasource_list� s r� )r r r )NNT)7r� r� r� Z cloudinitr r r^ r Zloggingr r r rS r r Zcloudinit.eventr
r Zcloudinit.net.dhcpr r
Z getLoggerr r6 � frozensetZ NOT_FOUNDZSKIP_METADATA_URL_CODESr4 r5 ri r� r� r� rU �objectr Z
DataSourcer r� r2 r� r� r� r� r� r� r* r� r� r� r� ZDEP_FILESYSTEMZ DEP_NETWORKr� r� r r r r �<module> sR
Y!
,
H