³ò OÉcIc @sçdZddklZddkZddkZddkZddkZddkZddkZddk Z ddk Z d„Z d„Z deifd„ƒYZ d„Zd dd „ƒYZd dd „ƒYZd dd„ƒYZdS(s¬Operations on Iterators of Read Only Remote Paths The main structure will be an iterator that yields RORPaths. Every RORPath has a "raw" form that makes it more amenable to being turned into a file. The raw form of the iterator yields each RORPath in the form of the tuple (index, data_dictionary, files), where files is the number of files attached (usually 1 or 0). After that, if a file is attached, it yields that file. iÿÿÿÿ(t generatorsNcsƒtˆƒ‰ˆdjotˆdˆdƒSndgˆ}|}‡‡fd†‰d„‰‡‡fd†}|ˆ||ƒS(sÜCollate RORPath iterators by index So it takes two or more iterators of rorps and returns an iterator yielding tuples like (rorp1, rorp2) with the same index. If one or the other lacks that index, it will be None iiics~xwtˆƒD]i}|| oW||djoFyˆ|iƒ||?scSs|S(((tx((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyR @s(tmintmaptfilter(R((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt getleastindex=s c3s«x¤ˆ||ƒd|joPnˆ|ƒ}g}x_t|ƒD]Q}||o3||i|jo|i||ƒd||2 iterator case. Profiler says speed is important here. N(NN(NN(RRRR (triter1triter2trelem1trelem2tindex1tindex2((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyRQs@         RcBsqeZdZd„Zd„Zd„Zd„Zd„Zd„Zd„Z d„Z d „Z d „Z d „Z RS( ssLike a tuple, but has .index This is used by CollateIterator above, and can be passed to the IterTreeReducer. cCs||_t|ƒ|_dS(N(R ttupletdata(tselfR tsequence((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt__init__~s cCs t|iƒS(N(RR!(R"((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt__len__‚scCs |i|S(s4This only works for numerical keys (easier this way)(R!(R"tkey((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt __getitem__„scCs|i|ƒdjS(Niÿÿÿÿ(t__cmp__(R"tother((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt__lt__ˆscCs|i|ƒdjS(Ni(R((R"R)((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt__le__‰scCs|i|ƒ S(N(t__eq__(R"R)((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt__ne__ŠscCs|i|ƒdjS(Ni(R((R"R)((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt__gt__‹scCs|i|ƒdjS(Niÿÿÿÿ(R((R"R)((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt__ge__ŒscCsUt|tƒpt‚|i|ijodSn |i|ijodSndSdS(Niÿÿÿÿii(t isinstanceRtAssertionErrorR (R"R)((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyR(Žs cCsft|tƒo'|i|ijo|i|ijSn,t|ƒtijo|i|jSndSdS(N(R0RR R!ttypettypest TupleTypeR(R"R)((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyR,”s 'cCs&dditt|iƒƒ|ifS(Ns(%s).%ss, (tjoinRtstrR!R (R"((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt__str__›s(t__name__t __module__t__doc__R$R%R'R*R+R-R.R/R(R,R7(((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyRws          c cs&|iƒ}|i}x,tt|ƒƒD]}|i|| ƒVq(W|V~|}xÍ|D]Å}|i}|d |d jp–x“tdt|ƒƒD]x}|| || jo]|i|| ƒ}|iƒp4tid|i|i ƒfdƒ|i |ƒn|Vq“q“Wn|V|}qYWdS(s=Given ordered rpiter and rootrp, fill in missing indicies with rpaths For instance, suppose rpiter contains rpaths with indicies (), (1,2), (2,5). Then return iter with rpaths (), (1,), (1,2), (2,), (2,5). This is used when we need to process directories before or after processing a file in that directory. iÿÿÿÿis|Warning: expected %s to be a directory but found %s instead. This is probably caused by a bug in versions 1.0.0 and earlier.iN( RR RRt new_indextisdirtlogtLogtpathtlstatt make_zero_dir(trpitertrootrptfirst_rpt cur_indexRt old_indextrpt filler_rp((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt FillInIterŸs.     tIterTreeReducercBs;eZdZd„Zd„Zd„Zd„Zd„ZRS(sžTree style reducer object for iterator The indicies of a RORPIter form a tree type structure. This class can be used on each element of an iter in sequence and the result will be as if the corresponding tree was reduced. This tries to bridge the gap between the tree nature of directories, and the iterator nature of the connection between hosts and the temporal order in which the files are processed. cCsF||_||_d|_||Œ|_|ig|_d|_dS(sITR initializerN(t branch_classt branch_argsRR t root_branchtbranchestroot_fast_processed(R"RKRL((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyR$Ís    cCsv|i}xf|d}|i}||t|ƒ jo5|iƒ|d=|pdSn|di|ƒq dSq dS(søRun Finish() on all branches index has passed When we pass out of a branch, delete it and process it with the parent. The innermost branches will be the last in the list. Return None if we are out of the entire tree, and 1 otherwise. iÿÿÿÿiN(RNt base_indexRt end_processRtbranch_process(R"R RNtto_be_finishedRP((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pytfinish_branchesÖs    cCs/|i|iŒ}||_|ii|ƒ|S(s;Return branch of type self.branch_class, add to branch list(RKRLRPRNR(R"R tbranch((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt add_branchës cCsh|idjp |iodSnx?|iiƒ}|iƒ|ipPn|idi|ƒq%dS(s,Call at end of sequence to tie everything upNiÿÿÿÿ(R RRORNtpopRQRR(R"RS((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pytFinishòs  cGsI|d}|idjo]||i_|ii|Œo|ii|Œd|_n|ii|Œ||_dSn||ijoti d|fdƒn›||ijo"dpt d|i|f‚ni|i |ƒdjodSn|i d}|i|Œo|i|Œn|i |ƒ}|i|Œ||_dS(s@Process args, where args[0] is current position in iterator Returns true if args successfully processed, false if index is not in the current tree and thus the final result is available. Also note below we set self.index after doing the necessary start processing, in case there is a crash in the middle. iis+Warning, repeated index %s, bad filesystem?isBad index order: %s >= %siÿÿÿÿN(R RRMRPtcan_fast_processt fast_processROt start_processR=R>R1RTRNRV(R"targsR t last_branchRU((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt__call__ûs.     "   (R8R9R:R$RTRVRXR^(((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyRJÂs     t ITRBranchcBsEeZdZdZZd„Zd„Zd„Zd„Z d„Z RS(s÷Helper class for IterTreeReducer above There are five stub functions below: start_process, end_process, branch_process, can_fast_process, and fast_process. A class that subclasses this one will probably fill in these functions to do more. cGsdS(s!Do some initial processing (stub)N((R"R\((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyR[,scCsdS(s4Do any final processing before leaving branch (stub)N((R"((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyRQ0scCsdS(s2Process a branch right after it is finished (stub)N((R"RU((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyRR4scGsdS(s9True if object can be processed without new branch (stub)N(R(R"R\((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyRY8scGsdS(s,Process args without new child branch (stub)N((R"R\((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyRZ<sN( R8R9R:RRPR R[RQRRRYRZ(((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyR_"s     tCacheIndexablecBs5eZdZdd„Zd„Zd„Zd„ZRS(snCache last few indexed elements in iterator This class should be initialized with an iterator yielding .index'd objects. It looks like it is just the same iterator as the one that initialized it. Luckily, it does more, caching the last few elements iterated, which can be retrieved using the .get() method. If the index is not in the cache, return None. cCs(||_||_h|_g|_dS(s8Make new CacheIndexable. Cache_size is max cache lengthN(t cache_sizetitert cache_dicttcache_indicies(R"t indexed_iterRa((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyR$Ms   cCs©|iiƒ}|i}||i|<|ii|ƒt|iƒ|ijoWy|i|id=Wn1tj o%t i d|idfdƒnX|id=n|S(s=Return next elem, add to cache. StopIteration passed upwardsis-Warning: index %s missing from iterator cachei( RbRR RcRdRRRatKeyErrorR=R>(R"t next_elemt next_index((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyRTs   cCs|S(N((R"((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyt__iter__escCsby|i|SWnLtj o@||idjp!tdt||idfƒ‚dSnXdS(s*Return element with index index from cacheisIndex out of order: N(RcRfRdR1treprR(R"R ((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pytgetgs N(R8R9R:RR$RRiRk(((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyR`As     ((((R:t __future__RtosttempfiletUserListR3tGlobalstrpathtiterfileR=RRRRIRJR_R`(((s:/var/lib/python-support/python2.5/rdiff_backup/rorpiter.pyss00 - &( #`