Tc@sddlZddlZddlZddlZddlZddlZddlZddlmZddl m Z ddl Z e j dddde [ ddlZddlZddlZddlmZdd lmZdd lmZdd lmZmZmZmZdd lmZdd lmZde fdYZ!de fdYZ"de fdYZ#defdYZ$defdYZ%de&fdYZ'dS(iN(tStringIO(t attrgettertignoretmoduletapttcategory(t SourcesList(tAcquireProgress(tInstallProgress(t append_filet create_filet read_filet touch_file(t UBUNTU_PATH(tbuild_skeleton_apttTransactionErrorcBseZdZRS(s)Raised when the transaction fails to run.(t__name__t __module__t__doc__(((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyRstDependencyErrorcBs eZdZdZdZRS(s9Raised when a needed dependency wasn't explicitly marked.cCs ||_dS(N(tpackages(tselfR((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt__init__%scCs-ddjg|jD]}t|^qS(NsMissing dependencies: %ss, (tjoinRtstr(Rtpackage((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt__str__(s(RRRRR(((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyR"s t ChannelErrorcBseZdZRS(s"Raised when channels fail to load.(RRR(((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyR-stLandscapeAcquireProgresscBseZdZRS(cGsdS(sDOverride trying to get the column count of the buffer. We always send the output to a file, not to a terminal, so the default width (80 columns) is fine for us. Overriding this method means that we don't have to care about fcntl.ioctl API differences for different Python versions. N((Rtdummy((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_winch3s(RRR(((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyR1stLandscapeInstallProgresscBs/eZdZdZdZdZdZRS(cCs+tt|j}tj||_|S(sOverride to find out whether dpkg exited or not. The C{run()} method returns os.WEXITSTATUS(res) without checking os.WIFEXITED(res) first, so it can signal that everything is ok, even though something causes dpkg not to exit cleanly. Save whether dpkg exited cleanly into the C{dpkg_exited} attribute. If dpkg exited cleanly the exit code can be used to determine whether there were any errors. If dpkg didn't exit cleanly it should mean that something went wrong. (tsuperRt wait_childtost WIFEXITEDt dpkg_exited(Rtres((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyR!Cs cCs@tt|j}|dkr<tj|_|jt_n|S(s6Fork and override the excepthook in the child process.i(R Rtforktsyst excepthooktold_excepthookt_prevent_dpkg_apport_error(Rtpid((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyR&Ss   cCs:|tkr#tj|||dS|j|||dS(sPrevent dpkg errors from generating Apport crash reports. When dpkg reports an error, a SystemError is raised and cleaned up in C code. However, it seems like the Apport except hook is called before the C code clears the error, generating crash reports even though nothing crashed. This exception hook doesn't call the Apport hook for SystemErrors, but it calls it for all other errors. N(t SystemErrorR't__excepthook__R)(Rtexc_typetexc_objtexc_tb((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyR*]s N(RRtNoneR$R)R!R&R*(((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyR>s   t AptFacadecBs$eZdZdZdZdZd<dZdZdZ dZ dZ d Z d Z d Zd Zed ZdZdZd<dZdZdZdZdZdZdZdZdZedZdZdZ dZ!dZ"dZ#dZ$d Z%d!Z&d"Z'd#Z(d$Z)d%Z*d&Z+d'Z,d(Z-d)Z.d*Z/d+Z0d,Z1d-Z2d.Z3d/Z4d0Z5d1Z6d2Z7d3Z8d4Z9d5Z:d6Z;d7Z<d8Z=d9Z>d:Z?d;Z@RS(=stWrapper for tasks using Apt. This object wraps Apt features, in a way that makes using and testing these features slightly more comfortable. @param root: The root dir of the Apt configuration files. @ivar refetch_package_index: Whether to refetch the package indexes when reloading the channels, or reuse the existing local database. i is/var/lib/dpkg/statuscCs||_g|_|jdk rG|j|jjd|jgntjjd||_t |_ i|_ i|_ g|_ t|_t |_g|_g|_g|_t |_dS(Ns--roottrootdir(t_roott _dpkg_argsR1t_ensure_dir_structuretextendRtcachetCachet_cachetFalset_channels_loadedt _pkg2hasht _hash2pkgt_version_installstsett_package_installst_global_upgradet_version_removalst_version_hold_creationst_version_hold_removalstrefetch_package_index(Rtroot((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyR~s             cCs|jd}|jd|jd|jd|jd}|jd|jd|jdttjj|d d tjj|d |_tjj|jst|jd nttjj|d dS( Nsetc/aptsetc/apt/sources.list.dsvar/cache/apt/archives/partialsvar/lib/apt/lists/partials var/lib/dpkgsvar/lib/dpkg/infosvar/lib/dpkg/updatessvar/lib/dpkg/triggerst availablettstatuss trusted.gpg(t_ensure_sub_dirR R"tpathRt _dpkg_statustexistsR (Rtapt_dirtdpkg_dir((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyR6s      cCs>tjj|j|}tjj|s:tj|n|S(s)Ensure that a dir in the Apt root exists.(R"RLRR4RNtmakedirs(Rtsub_dirt full_path((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyRKscCs |jjS(s/Get all the packages available in the channels.(R>t itervalues(R((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt get_packagesscCs>g|jD]-}|j|r |j|jr |^q S(sqGet all packages in the channels that are locked. For Apt, it means all packages that are held. (RUtis_package_installedt_is_package_heldR(Rtversion((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytget_locked_packagesscCs#g|jD]}|jj^q S(s5Return the name of all the packages that are on hold.(RYRtname(RRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytget_package_holdsscCs6tjddg|jdtj}|j|dS(sfSet the dpkg selection. It basically does "echo $selection | dpkg --set-selections". tdpkgs--set-selectionststdinN(t subprocesstPopenR5tPIPEt communicate(Rt selectiontprocess((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_set_dpkg_selectionss cCs|j|jjddS(sdAdd a dpkg hold for a package. @param version: The version of the package to hold. s holdN(RdRRZ(RRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytset_package_holdscCsB|j| s#|j|j r'dS|j|jjddS(sjRemoves a dpkg hold for a package. @param version: The version of the package to unhold. Ns install(RVRWRRdRZ(RRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytremove_package_holdsc Cs{|jjd|j}|js=|rtjj|ri}|r`|j r`||dt_is_main_architecturetversionstget_package_skeletonR;tget_hashtTrueR<(Rtforce_reload_binariestinternal_sources_listt new_apt_argsRRXthash((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytreload_channelss8      cCs|jr dS|jdS(s6Reload the channels if they haven't been reloaded yet.N(R<Ry(R((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytensure_channels_reloadeds cCs%tjjd}tjj|dS(s@Return the path to the source.list file for the facade channels.sDir::Etc::sourcepartss_landscape-internal-facade.list(tapt_pkgtconfigtfind_dirR"RLR(Rt sources_dir((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyRjscCs|j}d||f}|r<|ddj|7}ntjj|rvt|jd}||krvdSn|d7}t||dS(sAdd a deb URL which points to a repository. @param url: The base URL of the repository. @param codename: The dist in the repository. @param components: The components to be included. s deb %s %ss %st s N(RjRR"RLRNR tsplitR (Rturltcodenamet componentstsources_file_patht sources_linetcurrent_content((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytadd_channel_apt_deb s   cCs(|j||jd|dddS(sAdd a directory with packages as a channel. @param path: The path to the directory containing the packages. A Packages file is created in the directory with information about the deb files. s file://%ss./N(t_create_packages_fileRR1(RRL((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytadd_channel_deb_dirs cCs2|j}tjj|r.tj|ndS(sClear the channels that have been added through the facade. Channels that weren't added through the facade (i.e. /etc/apt/sources.list and /etc/apt/sources.list.d) won't be removed. N(RjR"RLRNtremove(RR((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytclear_channels)s csQdjfdttjD}ttjjd|dS(s0Create a Packages file in a directory with debs.s c3s-|]#}jtjj|VqdS(N(tget_package_stanzaR"RLR(t.0tfilename(Rtdeb_dir(s</usr/lib/python2.7/dist-packages/landscape/package/facade.pys 7stPackagesN(RtsortedR"tlistdirR RL(RRtpackages_contents((RRs</usr/lib/python2.7/dist-packages/landscape/package/facade.pyR4scCsZt}g|D]F}|jsi|jd6|jd6dj|jd6|jd6^qS(sReturn a list of channels configured. A channel is a deb line in sources.list or sources.list.d. It's represented by a dict with baseurl, distribution, components, and type keys. tbaseurlt distributionRRttype(RtdisabledturitdistRtcompsR(RRgtentry((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyRn;s cCs5t}x|D]}|jtqW|jdS(s#Remove all the configured channels.N(Rt set_enabledR;tsave(RRgR((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytreset_channelsGs  c Cst|}tj|}|jjd}|jtjj|}tjj |}t |}t j |j }t j|j } t j|j } tjtj|tjd|fdt|fd|fd| fd| fgS(sReturn a stanza for the package to be included in a Packages file. @param deb_path: The path to the deb package. tcontroltFilenametSizetMD5sumtSHA1tSHA256(Ritapt_insttDebFileRt extractdatatcloseR"RLtbasenametgetsizeR thashlibtmd5t hexdigesttsha1tsha256R{trewrite_sectiont TagSectiontREWRITE_PACKAGE_ORDERR( Rtdeb_pathtdeb_filetdebRRtsizetcontentsRRR((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyRNs   cCstjjdS(s1Return the architecture APT is configured to use.sAPT::Architecture(R{R|tget(R((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytget_archcscCsa|dkrd}ntjjdtjjd|tjjd|}|jjd|S(skSet the architecture that APT should use. Setting multiple architectures isn't supported. RIsAPT::ArchitecturessAPT::Architectures::sAPT::ArchitectureN(R1R{R|RoR@R:Ri(Rt architecturetresult((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytset_archgs  cCst|d|dtS(sReturn a skeleton for the provided package. The skeleton represents the basic structure of the package. @param pkg: Package to build skeleton from. @param with_info: If True, the skeleton will include information useful for sending data to the server. Such information isn't necessary if the skeleton will be used to build a hash. @return: a L{PackageSkeleton} object. Rht with_unicode(RRt(RtpkgRh((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyRrzs cCs|jj|j|fS(siReturn a hash from the given package. @param version: an L{apt.package.Version} object. (R=RR(RRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytget_package_hashscCs |jjS(s=Get the hashes of all the packages available in the channels.(R=tvalues(R((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytget_package_hashesscCs|jj|S(sGet the package having the provided hash. @param hash: The hash the package should have. @return: The L{apt.package.Package} that has the given hash. (R>R(RRx((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytget_package_by_hashscCs||jjkS(s!Is the package version installed?(Rt installed(RRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyRVscCs|jS(s*Is the package available for installation?(t downloadable(RRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytis_package_availablescCs.|jj s|jj rtS||jjkS(s8Is the package an upgrade for another installed package?(Rt is_upgradableRR;(RRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytis_package_upgradescCs#t|dstS|j|jkS(s2Is the package for the facade's main architecture?t shortname(thasattrRtRZR(RR((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyRpscCs|jjtjkS(sIs the package marked as held?(t_pkgtselected_stateR{t SELSTATE_HOLD(RR((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyRWscCs/g|jD]}|jj|kr |^q S(sGet all available packages matching the provided name. @param name: The name the returned packages should have. (RURRZ(RRZRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytget_packages_by_namescCs<|jr tS|j r8|j r8|j r8||jkStS(s]Is the package broken? It's considered broken if it's one that we marked for install, but it's not marked for install, upgrade or downgrade anymore. Before Trusty, checking is_inst_broken was enough, but in Trusty the behaviour changed, so the package simply gets unmarked for installation. (tis_inst_brokenRttmarked_installtmarked_upgradetmarked_downgradeRAR;(RR((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_is_package_brokens     cs tfdjDS(s/Return the packages that are in a broken state.c3s*|] }j|jr|jVqdS(N(RR(RRX(R(s</usr/lib/python2.7/dist-packages/landscape/package/facade.pys s(R@RU(R((Rs</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_get_broken_packagesscCsL|jr|jgS|js%|jr5|j|jgS|jrH|jgSdS(s]Return the versions that will be changed for the package. Apt gives us that a package is going to be changed and have variables set on the package to indicate what will change. We need to convert that into a list of versions that will be either installed or removed, which is what the server expects to get. N(Rt candidateRRRt marked_deleteR1(RR((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_get_changed_versionss    csg|D]}|j|f^q}t}xX|jjD]G|jsVq;n|j}|jfd|Dq;W|j|}|rtg|D]\}|^qnt |dkS(sCheck that the changes Apt will do have all been requested. @raises DependencyError: If some change hasn't been explicitly requested. @return: C{True} if all the changes that Apt will perform have been requested. c3s|]}|fVqdS(N((RRX(R(s</usr/lib/python2.7/dist-packages/landscape/package/facade.pys si( RR@R:t get_changesRpRRkt differenceRtlen(Rtrequested_changesRXt all_changestversions_to_be_changedRqt dependencies((Rs</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_check_changess " %cCs|jj}|jr2|d|j|jf7}nd}|jj|jkr|j|jj}|jsr|jr|jj}||jj kr|jj}nd|}qn||7}|S(sAReturn a string representation of a specific dependency relation.s (%s %s)s but is not installables but %s is to be installed( t target_pkgRZt target_vert comp_typeR:RRRRXR(Rt dep_relationtinfotreasont dep_packageRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_get_unmet_relation_infos    cCs|dk}|jj}xc|D][}xR|jD]D}|j}|jtjksb|j|r2|j| r2|Sq2WqW| S(s+Return whether a dependency is satisfied. For positive dependencies (Pre-Depends, Depends) it means that one of its targets is going to be installed. For negative dependencies (Conflicts, Breaks), it means that none of its targets are going to be installed. tBreakst Conflicts(RR( R:t _depcachet all_targetst parent_pkgt current_stateR{tCURSTATE_INSTALLEDRR(Rt dependencytdep_typet is_positivetdepcachetor_depttargetR((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_is_dependency_satisfieds     c CsM|j}|sdSdg}xt|dtdD]}t}xddddgD]}|jjjj|g}x|D]}|j||rqng}x$|D]} |j |j | qWd |j |f} d d t | } |j | | j |t}qWqWW|s8|j d |j d fq8q8Wdj |S(sGet information about unmet dependencies in the cache state. Go through all the broken packages and say which dependencies haven't been satisfied. @return: A string with dependency information like what you get from apt-get. RIs/The following packages have unmet dependencies:tkeyRZt PreDependstDependsRRs %s: %s: s or Rs %s: %ssUnknown dependency errors (RRRR;Rt_candt depends_listRRtappendRRZRRRt( Rtbroken_packagestall_infoRtfound_dependency_errorRRRtrelation_infosRRt or_divider((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_get_unmet_dependency_info(s0     cCs+dtjd|^q>}|rtdddjgt|D]}|jj ^qnx|jD]}|j |qWx|jD]}|j |qWdS(s> Perform pending hold operations on packages. is0Cannot perform the changes, since the following spackages are not installed: %ss, s#Package holds successfully changed.N( RRDRER1RVRRRRRZReRf(Rt hold_changesRXt not_installed((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_perform_hold_changesgs$  -c Cst}tj\}}tjd}tjd}tj|dtj|dt}z!d}x||jkrld }|dkrt j |j t j d|j|n|d7}y;|jjdt|d||jstdnWnPtjjtfk rQ}|jt|} t|jdd| }qnX|jt|} PqnW|d k r|nWd tj|dtj|dtj|X| S( sd Commit cached APT operations and give feedback on the results as a string. iiisMdpkg process might be in use. Retrying package changes. %d retries remaining.tfetch_progresstinstall_progresssdpkg didn't exit cleanly.s Package operation log: N(RttempfiletmkstempR"tduptdup2Rtmax_dpkg_retriesR1ttimetsleeptdpkg_retry_sleeptloggingtwarningR:tcommitRR$R,RR8tLockFailedExceptiontgetvalueR RtargsR( Rt fetch_outputtfdtinstall_output_patht old_stdoutt old_stderrRt dpkg_triesterrort result_text((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_commit_package_changessL             cCsx|jD]v}||jjkr(q n||j_|jjdt|jj|j|j|jj |j |jj q WdS(Ntauto_fix( R?RRRt mark_installR;RAtaddRoRtprotect(RtfixerRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_preprocess_installss cst}td|jDtfd|jD}x|jD]}|j|jry|j|jjn|j|krqKn|jjdt|j |jj |j |jj |j |jj |j qKW|rtdddjt|ndS(Ncss|]}|jVqdS(N(R(RRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pys sc3s'|]}|jkr|jVqdS(N(R(RRX(tpackage_installs(s</usr/lib/python2.7/dist-packages/landscape/package/facade.pys sR's7Can't perform the changes, since the following packagess are held: %ss, (R@R?RCRWRR)RZt mark_deleteR;RoRR*Rtinstall_protectRRR(RR+theld_package_namestpackage_upgradesRX((R-s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_preprocess_removess& cCs#|jr|jjdtndS(Nt dist_upgrade(RBR:tupgradeRt(R((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_preprocess_global_upgrades cCs|j}||kry|jtWn4tk r_}t|jdd|jqX|j}||krt|jqndS(sQ Attempt to automatically resolve problems with broken packages. is N(RtresolveRtR,RRR(RR+talready_broken_packagestnow_broken_packagesR$((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_resolve_broken_packagess    cCs|j}|j|j| r/|j r/gS|j}tj|jj}|j ||j |j ||j |||S(N( R?R7RCRBRR{tProblemResolverR:RR,R5R2R9(Rtversion_changesR7R+((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_preprocess_package_changess     cCs)|j}|j|sdS|jS(sD Perform pending install/remove/upgrade operations. N(R<RR1R&(RR;((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt_perform_package_changes s cCs|j|j}|j}g}|dk rD|j|n|dk r`|j|nt|dkrdj|SdS(s9 Perform the pending package operations. iRN(R R R=R1RRR(Rthold_result_texttpackage_result_texttresults((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytperform_changess     cCsC|j2|jj|j2|j2|j2t|_|jjdS(s%Clear the pending package operations.N( R?RARoRCRERDR;RBR:(R((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt reset_marks"s  cCs|jj|dS(s"Mark the package for installation.N(R?R(RRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyR(,scCs t|_dS(sUpgrade all installed packages.N(RtRB(R((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytmark_global_upgrade0scCs|jj|dS(sMark the package for removal.N(RCR(RRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt mark_remove4scCs|jj|dS(sMark the package to be held.N(RDR(RRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyt mark_hold8scCs|jj|dS(s*Mark the package to have its hold removed.N(RER(RRX((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pytmark_remove_hold<sN(ARRRRRRMR1RR6RKRURYR[RdReRfR;RyRzRjRRRRRnRRRRRtRrRRRRVRRRpRWRRRRRRRRRR R R R&R,R2R5R9R<R=RARBR(RCRDRERF(((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyR2nsx        *                      #   9         ((RRRR"R^R'Rt cStringIORtoperatorRtwarningstfilterwarningst FutureWarningRRR{taptsources.sourceslistRtapt.progress.textRtapt.progress.baseRtlandscape.lib.fsR R R R tlandscape.constantsR tlandscape.package.skeletonRt ExceptionRRRRRtobjectR2(((s</usr/lib/python2.7/dist-packages/landscape/package/facade.pyts4           "  0