.dZddlmZddlmZddlmZddlZddlZddlZddlZddl Z ddl Z ddl m Z ddlmZddlmZdd lmZdd lmZdd lmZddlmZdd lmZddlZd Z ddZdZ ddZ ddZy)z5This package provides tools for saving docker images.)absolute_import)division)print_functionN) docker_name) docker_image)save) v1_compat) docker_digest) docker_http) v2_compatc |j|S#t$r)|j|}tj|cYSwxYwN)diff_id ValueErroruncompressed_layerr SHA256)v1_imgblobunzippeds 6lib/third_party/containerregistry/client/v2_2/save_.py_diff_idr(sF* >>$  *((.H    ))*s/AAc fd}|xsi}g}tj|D]\}}tj|j j dd}||dz|j t j|j }t|jdijdg} |j|} | s/tj|} tj| } | ||<|dzt| j| j!D cgc]H} t#| | | vr8t j| j | jds| dzJc} t%|gd } i}t j|j'}|d }|D]2}|d t(j*k(s|j-|d }|||<4|r|| d <|j/| t1j2||dt j4|dycc} w)ahProduce a "docker save" compatible tarball from the DockerImages. Args: tag_to_image: A dictionary of tags to the images they label. tar: the open tarfile into which we are writing the image tarball. tag_to_v1_image: A dictionary of tags to the v1 form of the images they label. If this isn't provided, the image is simply converted. c|jd}tj|}t||_j |t j|y)Nutf8)tarinfofileobj)encodetarfileTarInfolensizeaddfileioBytesIO)filenamecontentscontents_bytesinfotars radd_filez%multi_image_tarball..add_file>sD__V,N ??8 $DN#DIKKbjj&@KArz.jsonrootfsdiff_ids throwawayz /layer.tar)ConfigLayersRepoTagslayers mediaTypedigest LayerSources manifest.jsonT) sort_keysN)six iteritemsr r config_filerjsonloadssetgetr V2FromV22r V1FromV2reversedancestrytoprstrmanifestr FOREIGN_LAYER_MIMEdigest_to_diff_idappendv1_savemulti_image_tarballdumps) tag_to_imager)tag_to_v1_imager* manifeststagimager5cfgdiffsrv2_imglayer_idrF layer_sourcesinput_manifest input_layers input_layerrs ` rrKrK0sB $)r/)mmL1lsE  ! !%"3"3"5"<".write_file. u gghsm    8Ac,|||||yr)r[rerf cached_layerlinkrhs rwrite_file_and_storez"fast..write_file_and_stores|Xs+tr+c tj||y#t$rU}|jtjk(r,tj |tj||n|Yd}~yd}~wwxYw)aCreates a symbolic link dest pointing to source. Unlinks first to remove "old" layers if needed e.g., image A latest has layers 1, 2 and 3 after a while it has layers 1, 2 and 3'. Since in both cases the layers are named 001, 002 and 003, unlinking promises the correct layers are linked in the image directory. Args: source: image directory source. dest: image directory destination. N)ossymlinkOSErrorerrnoEEXISTunlink)sourcedestes rrnzfast..linksXjj  ELL  $ 64  !s A7A A22A7ctj|d5}tj|j d}ddd||k(S#1swY|k(SxYw)Nrbr,)r#rbr rread)rmr5rgcurrent_digests rvalidzfast..validsK u %$++AFFHb9n & V ## & V ##s %A  A max_workers config.jsoncBjjdSNrr;runusedrQs rzfast..u'8'8':'A'A&'Ir+rr5cBjjdSrr5rrs rrzfast..5<<>#8#8#@r+r7cBjjdSrrFrrs rrzfast..5>>#3#:#:6#Br+rz %03d.tar.gz %03d.sha256Nrc*|ddjdSNrrr)rs rrzfast..stABxv.r+) concurrentfuturesThreadPoolExecutorrqpathjoinsubmitrB fs_layersrrEexistsrrI as_completedresult)rQ directorythreadscache_directoryror~executorfuture_to_paramsr;rgidxr3r layer_name digest_namer5 digest_strrmfuturernrhs` @@rfastrs[D  ,$ ,,,AX'',,y-8K KI  "A&Q OOJ Y A@(L OOJ Y HB C F*+77<< =3+>?jGGLLMC,?@kABxv&f //   .   a (qv;j ww||OZ@ 77>>, 'E, ,KoodL*=! * 1 oo2J "L2! * 1  OOJ EJJ E( mm[*-. Qhc;,@$$112BC mmoDaBf v gBf v s IJJcd}tjj|5}i}tjj |d}|j ||fdd}|||<|j |tjj |dfdd|j |tjj |dfd dd }g} tjD]} tjj |d |z} |j || d | }| ||<tjj |d |z} |j || j| }| ||<| j| | f|dz }tjj|D]} | j ddd|| fS#1swY fSxYw)aWProduce a format similar to `fast()`, but with uncompressed blobs. After calling this, the following filesystem will exist: directory/ config.json <-- only *.json, the image's config digest <-- sha256 digest of the image's manifest manifest.json <-- the image's manifest 001.tar <-- the first layer's .tar filesystem delta 001.sha256 <-- the sha256 of 001.tar with a "sha256:" prefix. ... NNN.tar <-- the NNNth layer's .tar filesystem delta NNN.sha256 <-- the sha256 of NNN.tar with a "sha256:" prefix. We pad layer indices to only 3 digits because of a known ceiling on the number of filesystem layers Docker supports. Args: image: a docker image to save. directory: an existing empty directory under which to save the layout. threads: the number of threads to use when performing the upload. Returns: A tuple whose first element is the path to the config file, and whose second element is an ordered list of tuples whose elements are the filenames containing: (.sha256, .tar) respectively. ctj|d5}|j||dddy#1swYyxYwr_rards rrhz uncompressed..write_file*rirjrrcBjjdSrrrs rrzuncompressed..3rr+rr5cBjjdSrrrs rrzuncompressed..8rr+r7cBjjdSrrrs rrzuncompressed..:rr+rrc*|ddjdSrr)rs rrzuncompressed..Fs'!"+,,V4r+z%03d.tarrN) rrrrqrrrrBr.rrIrr)rQrrrhrrr;rgrr3rrrrs` r uncompressedr s< ,,,AX'',,y-8K KI  "A&Q OOJ Y A@(L OOJ Y HB C FENN,-GGLLMC,?@k //   4   a (q77<< :+;rsq<&% 0@7175D3 *PCf . z~Jr+