³ò OÉcIc @sFdZddkZddkZddkZddkZddkZddkZddkZddkZde fd„ƒYZ ddd„ƒYZ de fd„ƒYZ d e fd „ƒYZ d dd „ƒYZd dd„ƒYZdefd„ƒYZdefd„ƒYZde fd„ƒYZddd„ƒYZddkZdS(s3Convert an iterator to a file object and vice-versaiÿÿÿÿNtIterFileExceptioncBseZRS((t__name__t __module__(((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRst UnwrapFilecBs)eZdZd„Zd„Zd„ZRS(sAContains some basic methods for parsing a file containing an itercCs ||_dS(N(tfile(tselfR((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyt__init__scCsSt|ƒdjpt‚d}x,tdƒD]}|dt||ƒ}q-W|S(sConvert string to long intili(tlentAssertionErrortrangetord(Rtstlti((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyt_s2l_old!s  cCsÏ|iidƒ}|pd Snt|ƒdjo%d ptd|t|ƒf‚n|dti|dƒ}}|ii|ƒ}|d jo|ti|ƒfSn|d jpt‚||fSd S(sReturn pair (type, data) next in line on the file type is a single character which is either "o" for an object, "f" for file, "c" for a continution of a file, "h" for the close value of a file "e" for an exception, or None if no more data can be read. Data is either the file's data, if type is "c" or "f", or the actual object if the type is "o", "e", or "r" isHeader %s is only %d bytesiitotethtftcN(NN(RRR(RR( RtreadtNoneRRtCtstr2longtcPickletloads(Rtheaderttypetlengthtbuf((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyt_get(s% (RRt__doc__RRR(((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRs  tIterWrappingFilecBs)eZdZd„Zd„Zd„ZRS(s‡An iterator generated from a file. Initialize with a file type object, and then it will return the elements of the file in order. cCsti||ƒd|_dS(N(RRRtcurrently_in_file(RR((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRJscCs|S(N((R((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyt__iter__NscCs’|io|iiƒn|iƒ\}}|p t‚n|djp |djo|Sn/|djot||ƒSntd|ƒ‚dS(NRRRsBad file type %s(R!tcloseRt StopIterationtIterVirtualFileR(RRtdata((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pytnextPs   (RRRRR"R'(((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR Cs  R%cBs>eZdZd„Zdd„Zd„Zd„Zd„ZRS(s Another version of a pretend file This is returned by IterWrappingFile when a file is embedded in the main file that the IterWrappingFile is based around. cCsPti||iƒ||_||_||_d|_|p|iƒndS(s’Initializer initial_data is the data from the first block of the file. iwf is the iter wrapping file that spawned this IterVirtualFile. N( RRRtiwfR!tbufferRtclosedt set_close_val(RR(t initial_data((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRas    iÿÿÿÿcCsÜ|i pt‚|iio„|djoLx-|t|iƒjo|iƒpPq/q/Wt|t|iƒƒ}q»x|iƒpPq{q{t|iƒ}nt|t|iƒƒ}|i| }|i||_|S(s>Read length bytes from the file, updating buffers as necessaryi(R*RR(R!RR)t addtobuffertmin(RRtreal_lent return_val((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRps      cCs—|iipt‚|iiƒ\}}|djod|i_|‚n|djptd|‚|o|i|7_dSn|iƒdSdS(s3Read a chunk from the file and add it to the bufferRRsType is %s instead of ciN(R(R!RRRR)R+(RRR&((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR-‚s    cCsY|iipt‚d|i_|iiƒ\}}|djp t|‚||_dS(s0Read the close value and clear currently_in_fileRN(R(R!RRRt close_value(RRtobject((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR+‘s  cCs8x%|iio|iƒd|_qWd|_|iS(s/Currently just reads whats left and discards itti(R(R!R-R)R*R1(R((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR#™s    (RRRRRR-R+R#(((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR%Zs     tFileWrappingItercBsMeZdZd„Zd„Zd„Zd„Zd„Zd„Zd„Z RS(s,A file interface wrapping around an iterator This is initialized with an iterator, and then converts it into a stream of characters. The object will evaluate as little of the iterator as is necessary to provide the requested bytes. The actual file is a sequence of marshaled objects, each preceded by 8 bytes which identifies the following the type of object, and specifies its length. File objects are not marshalled, but the data is written in chunks of Globals.blocksize, and the following blocks can identify themselves as continuations. cCs1||_tidƒ|_d|_d|_dS(sInitialize with iterRN(titertarrayt array_bufRR!R*(RR5((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR°s  cCsc|i pt‚x-t|iƒ|jo|iƒpPqqW|i| iƒ}|i|4|S(s Return next length bytes in file(R*RRR7R-ttostring(RRtresult((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR·s  cCsÝ|io|idƒn¿y|iiƒ}Wntj o dSnXt|dƒo*t|dƒo||_|idƒnXti|dƒ}|i i dƒ|i i t i t t|ƒƒƒƒ|i i |ƒdS(sUpdates self.buffer, adding a chunk from the iterator. Returns None if we have reached the end of the iterator, otherwise return true. RRR#RiRN(R!t addfromfileR5R'R$RthasattrRtdumpsR7t fromstringRtlong2strtlongR(Rt currentobjtpickle((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR-Ás    %cCs'ti|i|iitigƒ}|djoOd|_ti |i dƒ}di dt i tt|ƒƒƒ|fƒ}n”di |t i tt|ƒƒƒ|fƒ}|djoYti |iiƒdƒ}d|_|di dt i tt|ƒƒƒ|fƒ7}n|ii|ƒdS(sçRead a chunk from the current file and add to array_buf prefix_letter and the length will be prepended to the file data. If there is an exception while reading the file, the exception will be added to array_buf instead. iR3RRN(trobusttcheck_common_errortread_error_handlerR!RtGlobalst blocksizeRRR<tlast_exceptiontjoinRR>R?RR#R7R=(Rt prefix_letterRtexcstrttotaltcstr((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR:Ös    1-  5cCs ||_dS(s Log error when reading from fileN(RGR(RtexcRF((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRDís cCsZd}x9tdƒD]+}t|dƒ\}}t|ƒ|}qW|djpt‚|S(s*Convert long int to string of 7 charactersR3iii(R tdivmodtchrR(RR R R t remainder((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyt_l2s_oldòs cCs d|_dS(Ni(R*(R((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR#ûs( RRRRRR-R:RDRQR#(((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR4¢s      t MiscIterFlushcBseZdZRS(s8Used to signal that a MiscIterToFile should flush buffer(RRR(((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRRþstMiscIterFlushRepeatcBseZdZRS(sµFlush, but then cause Misc Iter to yield this same object Thus if we put together a pipeline of these, one MiscIterFlushRepeat can cause all the segments to flush in sequence. (RRR(((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRSstMiscIterToFilecBsVeZdZddd„Zdd„Zd„Zd„Zd„Zd„Z d„Z RS( sTake an iter and give it a file-ish interface This expands on the FileWrappingIter by understanding how to process RORPaths with file objects attached. It adds a new character "r" to mark these. This is how we send signatures and diffs across the line. As sending each one separately via a read() call would result in a lot of latency, the read()'s are buffered - a read() call with no arguments will return a variable length string (possibly empty). To flush the MiscIterToFile, have the iterator yield a MiscIterFlush class. cCsL|pti|_|pti|_d|_d|_ti ||ƒdS(s›MiscIterToFile initializer max_buffer_bytes is the maximum size of the buffer in bytes. max_buffer_rps is the maximum size of the buffer in rorps. iN( REt conn_bufsizetmax_buffer_bytestpipeline_max_lengthtmax_buffer_rpstrorps_in_bufferRt next_in_lineR4R(RtrpiterRVRX((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRs   cCs÷|i pt‚|djomxCt|iƒ|ijo)|i|ijo|iƒpPq"q"W|ii ƒ}|i2d|_|Snh|djpt‚|i ƒ}x(t|ƒ|jo||i ƒ7}q¯W|ii ||ƒ||SdS(s(Return some number of bytes, including 0iN( R*RRRR7RVRYRXR-R8RR=(RRR9t read_buffer((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR(s$    cCs;|io.|idƒ|ip|id7_q7n|io|i}d|_n8y|iiƒ}Wn!tj o|iƒdSnXt |dƒo*t |dƒo||_|idƒno|t i jodSnW|t i jo|i |ƒdSn2t|tiƒo|i|ƒn|i |ƒdS(s=Add some number of bytes to the buffer. Return false if doneRiiRR#RN(R!R:RYRZR5R'R$taddfinalRR;titerfileRRRStadd_misct isinstancetrpathtRORPathtaddrorp(RR@((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR-;s0            cCs[ti|dƒ}|iidƒ|iititt|ƒƒƒƒ|ii|ƒdS(s0Add an arbitrary pickleable object to the bufferiRN(RR<R7R=RR>R?R(RtobjRA((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR_Vs%cCs´|io1ti|i|idfdƒ}|i|_n1ti|i|idfdƒ}|id7_|iidƒ|iit i t t |ƒƒƒƒ|ii|ƒdS(sAdd a rorp to the bufferiitrN( RRR<tindexR&RZRYR7R=RR>R?R(RtrorpRA((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRc]s !!%cCs-|iidƒ|iitidƒƒdS(s/Signal the end of the iterator to the other endtzlN(R7R=RR>(R((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR]iscCs d|_dS(Ni(R*(R((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR#nsN( RRRRRRR-R_RcR]R#(((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRT s    tFileToMiscItercBsDeZdZd„Zd„Zd„Zd„Zd„Zd„ZRS(s6Take a MiscIterToFile and turn it back into a iteratorcCsti||ƒd|_dS(NR3(R RR(RR((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRsscCs|S(N((R((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR"wscCs£|io|iiƒnd}x|p|iƒ\}}q$W|djo t‚nG|djo|i|ƒSn)|djo|Sntd|fƒ‚dS(s2Return next object in iter, or raise StopIterationRhReRsBad file type %sN(R!R#RRR$tget_rorpR(RRR&((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR'ys    cCsZ|\}}}ti||ƒ}|o.|djp td‚|i|iƒƒn|S(s Return rorp that data representsis Only one file accepted right now(RaRbRtsetfiletget_file(Rt pickled_tupleRft data_dictt num_filesRg((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRj„s cCso|iƒ\}}|djot||ƒSn|djptd|f‚t|tƒpt‚t|ƒS(sRead file object from fileRRsExpected type e, got %s(RR%RR`t Exceptiont ErrorFile(RRR&((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRls  cCsÙ|ip|i|iiƒ7_n|ipdSnt|iƒdjp td‚|idti|idd!ƒ}}|idd|!}|id||_|djo|ti |ƒfSn ||fSdS(sîReturn (type, data or object) pair This is like UnwrapFile._get() but reads in variable length blocks. Also type "z" is allowed, which means end of iterator. An empty read() is not considered to mark the end of remote iter. isUnexpected end of MiscIter fileiitoerhN(NN( RRRRRRRRRR(RRRR&((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR•s   ' ( RRRRR"R'RjRlR(((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRiqs   RqcBs,eZdZd„Zdd„Zd„ZRS(s?File-like that just raises error (used by FileToMiscIter above)cCs ||_dS(s@Initialize new ErrorFile. exc is the exception to raise on readN(RM(RRM((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR«siÿÿÿÿcCs |i‚dS(N(RM(RR ((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR®scCsdS(N(R(R((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyR#¯s(RRRRRR#(((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyRq©s  (((((RRR6ttypesRERRBtlogRaRpRRR R%R4RRRSRTRiRqR^(((s:/var/lib/python-support/python2.5/rdiff_backup/iterfile.pyss$<'H\ f8