Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Commit 7233117

Browse files
author
Skip Montanaro
committed
update norobots link
1 parent 6d06815 commit 7233117

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

Doc/lib/librobotparser.tex

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ \section{\module{robotparser} ---
1515
questions about whether or not a particular user agent can fetch a URL on
1616
the Web site that published the \file{robots.txt} file. For more details on
1717
the structure of \file{robots.txt} files, see
18-
\url{http://info.webcrawler.com/mak/projects/robots/norobots.html}.
18+
\url{http://www.robotstxt.org/wc/norobots.html}.
1919

2020
\begin{classdesc}{RobotFileParser}{}
2121

0 commit comments

Comments
 (0)