summaryrefslogtreecommitdiff
path: root/Lib/robotparser.py
Commit message (Expand)AuthorAgeFilesLines
* [2.7] bpo-32861: robotparser fix incomplete __str__ methods. (GH-5711) (GH-67...Serhiy Storchaka2018-05-151-1/+4
* Fix typos in comments, documentation and test method namesMartin Panter2016-05-081-1/+1
* Issue 21469: Mitigate risk of false positives with robotparser.Raymond Hettinger2014-05-121-2/+12
* #17403: urllib.parse.robotparser normalizes the urls before adding to ruleline.Senthil Kumaran2013-05-291-0/+1
* Merged revisions 83238 via svnmerge fromGeorg Brandl2010-08-011-2/+4
* Merged revisions 83209 via svnmerge fromSenthil Kumaran2010-07-281-1/+6
* Close issue 3437 - missing state change when Allow lines are processed.Skip Montanaro2008-07-271-0/+5
* #1778443 robotparser fixes from Aristotelis MikropoulosBenjamin Peterson2008-07-121-6/+3
* Get rid of _test(), _main(), _debug() and _check(). Tests are no longerSkip Montanaro2008-04-281-93/+12
* fixes 813986Skip Montanaro2007-08-281-0/+5
* Patch #1555098: use str.join() instead of repeated stringGeorg Brandl2007-03-131-9/+6
* Patch #1014237: Consistently return booleans throughout.Martin v. Löwis2004-08-231-10/+10
* Replace str.find()!=1 with the more readable "in" operator.Raymond Hettinger2004-05-041-1/+1
* SF patch #911431: robot.txt must be robots.txtRaymond Hettinger2004-03-131-2/+2
* Get rid of many apply() calls.Guido van Rossum2003-02-271-1/+1
* Remove import of re, it is not usedNeal Norwitz2002-05-311-1/+1
* Patch 560023 adding docstrings. 2.2 Candidate (after verifying modules were ...Raymond Hettinger2002-05-291-0/+17
* Convert a pile of obvious "yes/no" functions to return bool.Tim Peters2002-04-041-6/+6
* Correctly set default entry in all cases.Martin v. Löwis2002-03-181-6/+9
* Patch #499513: use readline() instead of readlines(). Removed theMartin v. Löwis2002-03-181-16/+6
* Correct various errors:Martin v. Löwis2002-02-281-6/+16
* Remove unused import (PyChecker)Andrew M. Kuchling2001-08-131-1/+0
* Whitespace normalization.Tim Peters2001-02-151-1/+1
* The bulk of the credit for these changes goes to Bastian KleineidamSkip Montanaro2001-02-121-34/+89
* String method conversion.Eric S. Raymond2001-02-091-8/+8
* Whitespace normalization.Tim Peters2001-01-211-10/+10
* added __all__ lists to a number of Python modulesSkip Montanaro2001-01-201-0/+2
* rewrite of robotparser.py by Bastian Kleineidam. Closes patch 102229.Skip Montanaro2001-01-201-60/+179
* Skip Montanaro:Guido van Rossum2000-03-271-17/+17
* Give in to tabnannyGuido van Rossum1998-04-061-60/+60
* Skip Montanaro's robots.txt parser.Guido van Rossum1997-01-301-0/+97