³ò OÉcIc @sïdZddklZddkZddkZddkZddkZddkZddkZddk Z de fd„ƒYZ de fd„ƒYZ de fd „ƒYZ d fd „ƒYZd fd „ƒYZde ifd„ƒYZdS(s³Iterate exactly the requested files in a directory Parses includes and excludes to yield correct files. More documentation on what this code does can be found on the man page. iÿÿÿÿ(t generatorsNt SelectErrorcBseZdZRS(s(Some error dealing with the Select class(t__name__t __module__t__doc__(((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR stFilePrefixErrorcBseZdZRS(s?Signals that a specified file doesn't start with correct prefix(RRR(((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR$st GlobbingErrorcBseZdZRS(s3Something has gone wrong when parsing a glob string(RRR(((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR(stSelectcBsbeZdZeideieiBƒZd„Zd$d„Z d„Z d„Z d„Z d„Zd„Zd „Zd „Zd „Zd „Zd „Zd$d„Zd„Zd„Zd„Zd„Zd„Zd„Zd„Zd„Zd„Zd„Zd„Z d„Z!d„Z"d„Z#d„Z$d„Z%d„Z&d „Z'd!„Z(d"„Z)d#„Z*RS(%s.Iterate appropriate RPaths in given directory This class acts as an iterator on account of its next() method. Basically, it just goes through all the files in a directory in order (depth-first) and subjects each file to a bunch of tests (selection functions) in order. The first test that includes or excludes the file means that the file gets included (iterated) or excluded. The default is include, so with no tests we would just iterate all the files in the directory in order. The one complication to this is that sometimes we don't know whether or not to include a directory until we examine its contents. For instance, if we want to include all the **.py files. If /home/ben/foo.py exists, we should also include /home and /home/ben, but if these directories contain no **.py files, they shouldn't be included. For this reason, a test may not include or exclude a directory, but merely "scan" it. If later a file in the directory gets included, so does the directory. As mentioned above, each test takes the form of a selection function. The selection function takes an rpath, and returns: None - means the test has nothing to say about the related file 0 - the file is excluded by the test 1 - the file is included 2 - the test says the file (must be directory) should be scanned Also, a selection function f has a variable f.exclude which should be true iff f could potentially exclude some file. This is used to signal an error if the last function only includes, which would be redundant and presumably isn't what the user intends. s(.*[*?[\\]|ignorecase\:)cCs?t|tiƒpt‚g|_||_|ii|_dS(s0Select initializer. rpath is the root directoryN(t isinstancetrpathtRPathtAssertionErrortselection_functionstpathtprefix(tselftrootrp((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyt__init__Rs  cs^|p ˆi}nˆiiƒˆiˆi|ƒˆ_ˆiiˆ_‡fd†ˆ_ˆS(s¬Initialize more variables, get ready to iterate Selection function sel_func is called on each rpath and is usually self.Select. Returns self just for convenience. csˆS((((R(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pytds(RR tsetdatat Iterate_fasttitertnextt__iter__(Rtsel_func((Rs;/var/lib/python-support/python2.5/rdiff_backup/selection.pytset_iterYs  c #sH‡fd†‰‡‡‡fd†}ˆVˆiƒpdSn|ˆƒg}g}xî|oæy|diƒ\‰}Wn5tj o)|iƒ|o|iƒqVqVnX|djoR|ox|D] }|VqÊW|2nˆVˆiƒo|i|ˆƒƒq?qV|djo$|iˆƒ|i|ˆƒƒqVqVWdS(s*Like Iterate, but don't recur, saving timecs$tiidˆi|f|ƒdS(Nt ListError(tlogtErrorLogt write_if_opentindextNone(texctfilename(R (s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyt error_handleris c3s¢x›ˆi|ƒD]Š}tiˆ|i|fƒ}|ob|iƒoUˆ|ƒ}|djo|dfVqš|djo|iƒo|dfVqšqqWdS(sèGenerate relevant files in directory rpath Returns (rpath, num) where num == 0 means rpath should be generated normally, num == 1 means the rpath is a directory and should be included iff something inside is included. iiiN(tlistdirtrobusttcheck_common_errortappendtlstattisdir(R R!t new_rpathts(RR"R(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pytdiryieldns   Niÿÿÿÿii(R(Rt StopIterationtpopR&(RR RR+tdiryield_stacktdelayed_rp_stacktvalt delayed_rp((RRR"R s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRgs8       ccs||ƒ}|djodSnì|djo?|V|iƒo)x&|i|||ƒD] }|VqVWq n |djot|iƒoc|i|||ƒ}y|iƒ}Wntj o dSnX|V|Vx|D] }|Vq×Wq ndptdt|ƒf‚dS(sReturn iterator yielding rpaths in rpath rec_func is usually the same as this function and is what Iterate uses to find files in subdirectories. It is used in iterate_starting_from. sel_func is the selection function to use on the rpaths. It is usually self.Select. iNiisInvalid selection result %s(R(titerate_in_dirRR,R tstr(Rtrptrec_funcRR*trp2tiidtfirst((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pytIterate“s,       cs2‡fd†}ti|ˆiƒ}|iƒ|S(s'List directory rpath with error loggingcstiidˆ|ƒgS(NR(RRR(R (tdir_rp(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR"±s(R$R%R#tsort(RR:R"t dir_listing((R:s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR#¯s c#su‡fd†}x_|iˆƒD]N}ti|ˆi|gƒ}|o&x#||||ƒD] }|VqZWqqWdS(s&Iterate the rpaths in directory rpath.cs$tiidˆi|f|ƒdS(NR(RRRRR(R R!(R (s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR"ºs N(R#R$R%R&(RR R5RR"R!tnew_rpR4((R s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR2¸scsS‡fd†}titˆgƒ}xtD]}||i|ƒq+W|iƒdS(s<Filter rorp_iter using Select below, removing excluded rorpsc3s>x7|D]/}tiˆiiˆii|i|iƒVqWdS(s<Return rp iter by adding indicies of rorp_iter to self.rpathN(R R tconntbaseRtdata(t rorp_itertrorp(R(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyt getrpiterÈsN(trorpitertIterTreeReducertFilterIterITRBtrp_iterRtFinish(RRARCtITRR4((Rs;/var/lib/python-support/python2.5/rdiff_backup/selection.pyt FilterIterÆs cCskd}x^|iD]S}||ƒ}|djodSq|djo|Sq|djo d}qqWdS(sARun through the selection functions and return dominant val 0/1/2iii(R (RR4tscannedtsftresult((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRÒs     c CsÝd}y€xy|D]q\}}|djo|i|i|dƒƒq|djo|i|i|dƒƒq|djo|i|idƒƒq|djo|i|idƒƒq|djo|i|idƒƒq|djo|i|idƒƒq|djo.|i|i||d|ƒƒ|d 7}q|d jo1t|i|i ||d|ƒƒ|d 7}q|d jo|i|i dƒƒq|d jo|i|i |dƒƒq|d jo|i|i dƒƒq|djo|i|i|d ƒƒq|djo.|i|i||d |ƒƒ|d 7}q|djo1t|i|i ||d |ƒƒ|d 7}q|djo|i|i |d ƒƒq|djo|i|i d ƒƒq|djo|i|id ƒƒq|djo|i|i d |ƒƒq|djo|i|i d|ƒƒqdptd|‚qWWn"tj o}|i|ƒnX|t|ƒjpt‚|iƒ|iƒdS(sÕCreate selection functions based on list of tuples The tuples have the form (option string, additional argument) and are created when the initial commandline arguments are read. The reason for the extra level of processing is that the filelists may only be openable by the main connection, but the selection functions need to be on the backup reader or writer side. When the initial arguments are parsed the right information is sent over the link. is --excludes--exclude-if-presents--exclude-device-filess--exclude-symbolic-linkss--exclude-socketss--exclude-fifoss--exclude-filelistis--exclude-globbing-filelists--exclude-other-filesystemss--exclude-regexps--exclude-special-filess --includes--include-filelists--include-globbing-filelists--include-regexps--include-special-filess--include-symbolic-linkss--max-file-sizes--min-file-sizesBad selection option %sN(tadd_selection_funct glob_get_sftpresence_get_sftdevfiles_get_sftsymlinks_get_sftsockets_get_sft fifos_get_sftfilelist_get_sftmaptfilelist_globbing_get_sfstother_filesystems_get_sft regexp_get_sftspecial_get_sft size_get_sfR Rtparse_catch_errortlentparse_last_excludestparse_rbdir_exclude(Rt argtuplest fileliststfilelists_indextopttargte((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyt ParseArgsÜst                          cCs`t|tƒo!tiid||ifƒn,tttƒotiid|ƒn‚dS(sDeal with selection error excsÜFatal Error: The file specification '%s' cannot match any files in the base directory '%s' Useful file specifications begin with the base directory or some pattern (such as '**') which matches the base directory.s*Fatal Error while processing expression %sN(RRRtLogt FatalErrorRReR(RR ((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR\"s   cCs |i|iddƒdƒdS(s7Add exclusion of rdiff-backup-data dir to front of listsrdiff-backup-dataiiN(srdiff-backup-data(RNtglob_get_tuple_sf(R((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR_2scCsE|io7|idi o%tiid|idifƒndS(s;Exit with error if last selection function isn't an excludeiÿÿÿÿsÈLast selection expression: %s only specifies that files be included. Because the default is to include all files, the expression is redundant. Exiting because this probably isn't what you meant.N(R texcludeRRgRhtname(R((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR^7s   cCs2|o|iid|ƒn|ii|ƒdS(s6Add another selection function at the end or beginningiN(R tinsertR&(RRt add_to_start((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRNCscs’tid|dƒˆi|||ƒ\‰}tid|dƒˆiƒdg‰‡‡‡fd†}|p |dj|_d||_|S(s+Return selection function by reading list of files The format of the filelist is documented in the man page. filelist_fp should be an (open) file object. inc_default should be true if this is an include list, false for an exclude list. filelist_name is just a string used for logging. sReading filelist %sisSorting filelist %sics|xuˆdtˆƒjodSnˆi|ˆˆdƒ\}}|o(ˆdcd7<|djoqqqn|SqdS(Nii(R]Rtfilelist_pair_match(R4tincludetmove_on(tiRt tuple_list(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pytselection_functionYs  s Filelist: (RRgt filelist_readR;RjRk(Rt filelist_fpt inc_defaultt filelist_nametsomething_excludedRs((RqRRrs;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRUHs     c südg‰‡‡‡fd†}dg}}tiodpd}xˆ|iƒi|ƒD]q}|pqXnyˆi||ƒ} Wn"tj o} || ƒqXnX|i| ƒ| dp d}qXqXW|iƒot i dˆdƒn||fS( s=Read filelist from fp, return (tuplelist, something_excluded)icsnˆdcd7<ˆddjoItid|ˆˆifdƒˆddjotiddƒqjndS( sWarn if prefix is incorrectiiis`Warning: file specification '%s' in filelist %s doesn't start with correct prefix %s. Ignoring.iis(Future prefix errors will not be logged.N(RRgR(R (RwRtprefix_warnings(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyt incr_warningsjs  ts isError closing filelist %siN( RtGlobalstnull_separatortreadtsplittfilelist_parse_lineRR&tcloseRRg( RRuRoRwRzRxRrt separatortlinettupleR ((RwRyRs;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRtgs&      c Cs«|d djod}|d}n&|d djod}|d}n|i|iƒpt|ƒ‚n|t|iƒ}ttd„|idƒƒƒ}||fS(s$Parse a single line of a filelist, returning a pair pair will be of form (index, include), where index is another tuple, and include is 1 if the line specifies that we are including a file. The default is given as an argument. prefix is the string that the index is relative to. is+ is- icSs|S(((tx((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR”st/(t startswithRRR]R„tfilterR(RRƒRoR((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR€‚s !cCsá|\}}|djo]||ijodSn||ijodSqÝ|t|iƒ |ijodSqÝdSnh|djoB|it|ƒ |jod SqÝ||ijod SqÝd Sndptd|f‚dS( s:Matches a filelist tuple against a rpath Returns a pair (include, move_on). include is None if the tuple doesn't match either way, and 0/1 if the tuple excludes or includes the rpath. move_on is true if the tuple cannot match a later index, and so we should move on to the next tuple in the index. iisInclude is %s, should be 0 or 1N(Ni(ii(iN(NN(iN(Ni(NN(RRR]R (RR4tpairRRo((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRn—s   ccsÂtid|dƒtiodpd}x|iƒi|ƒD]y}|pqAn|d djo|i|ddƒVqA|d djo|i|dd ƒVqA|i||ƒVqAWd S( sReturn list of selection functions by reading fileobj filelist_fp should be an open file object inc_default is true iff this is an include list list_name is just the name of the list, used for logging See the man page on --[include/exclude]-globbing-filelist sReading globbing filelist %siR{s is+ is- iN(RRgR|R}R~RRO(RRuRvt list_nameR‚Rƒ((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRW°s csYˆdjpˆdjpt‚|iiƒ‰‡‡fd†}ˆ |_d|_|S(s=Return selection function matching files on other filesystemsiics#|iƒˆjodSnˆSdS(N(t getdevlocR(R4(Rot root_devloc(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRÅssMatch other filesystems(R R R‹RjRk(RRoR((RoRŒs;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRXÁs !  cs‚ˆdjpˆdjpt‚yti|ƒ‰Wntid|dƒ‚nX‡‡fd†}ˆ |_d||_|S(s0Return selection function given by regexp_stringiis%Error compiling regular expression %scs#ˆi|iƒoˆSndSdS(N(tsearchR R(R4(tregexpRo(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRÔssRegular expression: %s(R tretcompileRRgRjRk(Rt regexp_stringRoR((RŽRos;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRYÌs!  csNˆdjpˆdjpt‚‡‡fd†}ˆ |_dˆ|_|S(s4Return selection function given by a file if presentiics<|iƒo+|iƒo|iˆƒiƒoˆSndS(N(R(treadableR&R'R(R4(tpresence_filenameRo(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRàssPresence file: %s(R RjRk(RR“RoR((R“Ros;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRPÜs !  cs;‡‡fd†}ˆ |_ˆodpd||_|S(sŸReturns a selection function that uses pred to test RPath is matched if pred returns true on it. Name is a string summarizing the test to the user. csˆ|ƒoˆSndS(N(R(R4(tpredRo(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRñs sinclude sexclude (RjRk(RR”RoRkR((R”Ros;/var/lib/python-support/python2.5/rdiff_backup/selection.pyt gen_get_sfês cCs|itii|dƒS(s2Return a selection function matching all dev filess device files(R•R tRORPathtisdev(RRo((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRQøscCs|itii|dƒS(s1Return a selection function matching all symlinksssymbolic links(R•R R–tissym(RRo((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRRüscCs|itii|dƒS(s0Return a selection function matching all socketss socket files(R•R R–tissock(RRo((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRSscCs|itii|dƒS(s.Return a selection function matching all fifoss fifo files(R•R R–tisfifo(RRo((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRTscs8‡fd†}ˆ |_ˆodpdd|_|S(s=Return sel function matching sockets, symlinks, sockets, devscsD|iƒp'|iƒp|iƒp |iƒoˆSndSdS(N(R˜R™RšR—R(R4(Ro(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR s4RoRjs special files(RjRk(RRoR((Ros;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRZs cswt|ƒ‰ˆdjpt‚|o‡fd†}n‡fd†}d|_d|odpdˆf|_|S(s+Return selection function given by filesizeics|iƒˆjS((tgetsize(R4(tsize(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRscs|iƒˆjS((R›(R4(Rœ(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRsis %s size %dtMaximumtMinimum(tintR RjRk(Rtmin_maxtsizestrR((Rœs;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR[s  !cs«ˆdjpˆdjpt‚|djo‡fd†}n<|ii|ƒp|i|ˆƒ}n|i|ˆƒ}ˆ |_dˆodpd|f|_|S(s.Return selection function given by glob stringiis**csˆS(((R4(Ro(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRssCommand-line %s glob: %sRoRj(R tglob_retmatchtglob_get_filename_sftglob_get_normal_sfRjRk(Rtglob_strRoR((Ros;/var/lib/python-support/python2.5/rdiff_backup/selection.pyROs!  cCsa|i|iƒpt|ƒ‚nttd„|t|iƒidƒƒƒ}|i||ƒS(sýGet a selection function given a normal filename Some of the parsing is better explained in filelist_parse_line. The reason this is split from normal globbing is things are a lot less complicated if no special globbing characters are used. cSs|S(((R…((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR4sR†(R‡RRR„RˆR]RRi(RR!RoR((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR¤)s  "csj‡fd†}‡fd†}|djo |}n|djo |}n| |_dˆf|_|S(s(Return selection function based on tuplecsG|iˆt|iƒ jp|itˆƒ ˆjodSndSdS(Ni(RR]R(R4(R„(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pytinclude_sel_func:scs*|itˆƒ ˆjodSndSdS(Ni(RR]R(R4(R„(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pytexclude_sel_func@siisTuple select %s(RjRk(RR„RoR§R¨R((R„s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRi8s   cs|iƒidƒod„}|tdƒ}n d„}|d|i|ƒƒ‰|idƒdjo||idƒd }n|dd i|i|ƒƒƒ‰‡‡fd †}‡fd †}||iƒpt|ƒ‚n|o|Sn|Sd S( sReturn selection function based on glob_str The basic idea is to turn glob_str into a regular expression, and just use the normal regular expression. There is a complication because the selection function should return '2' (scan) for directories which may contain a file which matches the glob_str. So we break up the glob string into parts, and any file which matches an initial sequence of glob parts gets scanned. Thanks to Donovan Baarda who provided some code which did some things similar to this. s ignorecase:cSsti|titiBƒS((RRtItS(tr((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR[scSsti|tiƒS((RRRª(R«((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR]ss^%s($|/)s**iÿÿÿÿis^(%s)$t|cs>ˆi|iƒodSn ˆi|iƒodSndSdS(Nii(R£R R(R4(t glob_comp_ret scan_comp_re(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR§hs cs#ˆi|iƒodSndSdS(Ni(R£R R(R4(R­(s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR¨msN( tlowerR‡R]t glob_to_retfindtjointglob_get_prefix_resR R(RR¦Rotre_compR§R¨((R­R®s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR¥Ks   csŠ|idƒ‰dˆdd!jotd|ƒ‚nt‡fd†ttˆƒƒƒ}|ddjod|dR?RR@R-(Rt next_rorptnext_rp((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyR½s   (RRRRRR(((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRJªs  RFcBs2eZdZd„Zd„Zd„Zd„ZRS(sÁITRBranch used in above FilterIter class The reason this is necessary is because for directories sometimes we don't know whether a rorp is excluded until we see what is in the directory. cCs)|||_|_d|_d|_dS(sÎInitialize FilterIterITRB. Called by IterTreeReducer. select should be the relevant Select object used to test the rps. rorp_cache is the list rps should be appended to if they aren't excluded. N(RÉt rorp_cacheRtbranch_excludedt base_queue(RRÉRÌ((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRÔs cCs |iƒ S(N(R((RRRËRÊ((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pytcan_fast_processàscCsŽ|iodSn|i|ƒ}|djo>|io |ii|iƒd|_n|ii|ƒn|djptd|f‚dS(s5For ordinary files, just append if select is positiveNiisUnexpected select value %s(RÍRÉRÎRÌR&RR (RRRËRÊR*((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyt fast_processãs    cCsn|i|ƒ}|djo d|_nB|djo|ii|ƒn!|djp t|‚||_dS(Niii(RÉRÍRÌR&R RÎ(RRRËRÊR*((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyt start_processîs  (RRRRRÏRÐRÑ(((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyRFÌs   (Rt __future__RRtFilenameMappingR$R R|RRDt ExceptionRRRRRJt ITRBranchRF(((s;/var/lib/python-support/python2.5/rdiff_backup/selection.pyss Hÿÿ"