/
usr
/
libexec
/
kcare
/
python
/
kcarectl
/
Upload File
HOME
� �;jc @ s d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l Z d d l m Z d d l m Z m Z m Z m Z m Z m Z d d l m Z e r� d d l m Z m Z m Z m Z d d l m Z n d � Z d e f d � � YZ d e f d � � YZ d S( i����N( t NamedTemporaryFile( t autht configt http_utilst ipv6_supportt log_utilst utils( t run_command( t Anyt Dictt Listt Optional( t Selfc C sP t | � } x4 d D], } | d k r5 d j | | � S| d :} q Wd j | � S( sB Render a byte count as a short human-readable string for the logs.t Bt KiBt MiBt GiBg �@s {0:.1f} {1}s {0:.1f} TiB( R R R R ( t floatt format( t num_bytest sizet unit( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyt format_size s t DataPackagec B s� e Z d Z d Z d Z d � Z e d � � Z e d � � Z d � Z d d e d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z d � Z e j d e j � d � � Z d � Z d � Z RS( s� Generic archive package for the patch server uploads pipeline. Based on DataPackage from eportal (delivery_kit.py). Subclasses supply the manifest `data_type`, the `upload_uri` to PUT the archive to and the `max_size` payload limit. t c C s d | _ g | _ d | _ d S( Ni ( t Nonet _tart _errors_buffert _total_payload_size( t self( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyt __init__- s c C s t � d S( N( t NotImplementedError( R ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyt max_size3 s c C s | j � } t | j � S( N( t _ensure_tar_createdt strt name( R t tar( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyt archive_path8 s c C s� d } d } y. t t j | � d t d t �\ } } } Wn t k r[ } t | � } n X| r~ | j d j | | � � n | d k r� | j | d t j | d d ��n d S( Nt catch_stdoutt catch_stderrs! failed to dump stdout of {0}: {1}t data_bytest encodings utf-8( R R t shlext splitt Truet ExceptionR" t log_errorR t add_fileR t bstr( R t arcnamet cmdt stdoutt stderrt _t e( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyt add_stdout> s . c C s� | d k r' | d k r' t d � � n | j � } d } | d k r� t j j | � sq | j d j | � � d St j j | � } n t | � } | j | � s� | j d j | � � d S| r | j | � r | j d j | t | � t | j � t | j � � � d Sy� | r,| j | d | �n1 t j | � } | | _ | j | t j | � � | s�| j | 7_ t j d j | t | � t | j � � d t �n Wn, t k r�} | j d j | | � � n Xd S( Ns" No src_path or data_bytes providedi s file not found: {0}s no available space to store: {0}sP skipping {0}: {1} would exceed the {2} report size limit (already collected {3})R1 s% collected {0}: {1} (report total {2})t print_msgs failed to store {0}: {1}( R t ValueErrorR! t ost patht existsR. R t getsizet lent _check_required_spacet _check_total_payload_limitt log_warningR R R t addt tarfilet TarInfoR t addfilet iot BytesIOR t loginfot FalseR- ( R R1 t src_pathR( t skip_limit_checkR$ t entry_sizet infoR6 ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyR/ N sJ c C so y( t j t j | d d �d d �} Wn- t k rW } | j d j | | � � d SX| j | d | �d S( Nt indenti R) s utf-8s failed to dump {0}: {1}R( ( R R0 t jsont dumpst TypeErrorR. R R/ ( R R1 t dataR( R6 ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyt add_json� s (c C s& t j | j � } | j | j | k S( N( R: t statvfsR% t f_frsizet f_bfree( R RL RT ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyR? � s c C s | j | j | k S( N( R R ( R RL ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyR@ � s c C s( i d d 6| j d 6t t j � � d 6S( Ni t schema_versiont typet time_created( t data_typet intt time( R ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyt make_manifest� s c C sq t j t j | j � d d �d d �} | j � } t j d � } t | � | _ | j | t j | � � d S( NRN i R) s utf-8s manifest.json( R R0 RO RP R] R! RC RD R> R RE RF RG ( R R( R$ RM ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyt _add_manifest� s * c C s3 | j � } t j | d t �| j j | � d S( NR8 ( t stripR t logerrorRI R t append( R t error_msg( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyR. � s c C s3 | j � } t j | d t �| j j | � d S( NR8 ( R_ R t logwarnRI R Ra ( R t warning_msg( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyRA � s c C s; x%d D] } t d d j | d � d t � } | j � yU t j d j | j � d t �t j d | j d | d t � | _ | j � | SWq t k r#} | j d k r� y | j j � Wn t k r� n Xd | _ n t j j | j � rt j | j � n t | t j � s$� q$q Xq Wt j d � � d S( Ns w:xzs w:bz2s w:gzt suffixs .tar.{0}i t deletes Creating DataPackage: {0}R8 R# t modet dereferences% No supported compression method found( s w:xzs w:bz2s w:gz( R R RI t closeR RH R# RC t openR, R R^ R- R R: R; R< t unlinkt isinstancet CompressionError( R t compression_modet tmpfilet err( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyt __enter__� s( " $ c C su | j rD d j | j � d } | j d d t j | � d t �n | j rq | j j � | rq | j � t Sn t S( Ns s errors.logR( RK ( R t joinR/ R R0 R, R Ri t remove_archiveRI ( R t exc_typet exc_valt exc_tbt errors( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyt __exit__� s % t loggerc C s5 | j r1 t j j | j � r1 t j | j � n d S( N( R R: R; R< R% Rk ( R ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyRs � s c C s | j s t d � � n | j S( Ns/ DataPackage should be used as a context manager( R t RuntimeError( R ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyR! � s c C s� | j � j � t j j | j � } d | k rD | | j d � n d } t t j � � | } t j � | j | } t j | j d | d t j � �| S( s Send the package archive to the patch server. Upload errors propagate to the caller (see the eportal precedent): wrap with utils.catch_errors where a silent failure is acceptable. :return: Upload name (package identifier) t .R t upload_urlt auth_string( R! Ri R: R; t basenameR% t findR" t uuidt uuid4R t get_patch_servert upload_uriR t upload_fileR t get_http_auth_string( R R~ t extt upload_nameR| ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyt send� s % N( t __name__t __module__t __doc__RZ R� R t propertyR R% R7 R RI R/ RS R? R@ R] R^ R. RA Rq Rx R t catch_errorsR Rc Rs R! R� ( ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyR " s( ; t KernelAnomalyPackagec B s# e Z d Z d Z e d � � Z RS( s kernel-anomalys /upload/kernel-anomaly/c C s t j S( N( R t$ KERNEL_ANOMALY_REPORT_MAX_SIZE_BYTES( R ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyR s ( R� R� RZ R� R� R ( ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyR� s ( RF RO R: R* RC R\ R� t tempfileR t kcarectlR R R R R R t kcarectl.process_utilsR RI t typingR R R R t typing_extensionsR R t objectR R� ( ( ( s2 /usr/libexec/kcare/python/kcarectl/delivery_kit.pyt <module> s ." �