Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Commit 0c5d7d4

Browse files
committed
removing crawling random agent strings as some sites appear different to them (minor possibility to screw blind engine)
1 parent fde3e4c commit 0c5d7d4

1 file changed

Lines changed: 0 additions & 14 deletions

File tree

txt/user-agents.txt

Lines changed: 0 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -1,14 +1,6 @@
11
# Copyright (c) 2006-2011 sqlmap developers (http://sqlmap.sourceforge.net/)
22
# See the file 'doc/COPYING' for copying permission
33

4-
Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com)
5-
Baiduspider ( http://www.baidu.com/search/spider.htm)
6-
GameSpyHTTP/1.0
7-
Gigabot/2.0
8-
Googlebot-Image/1.0
9-
Googlebot/2.1 (+http://www.google.com/bot.html)
10-
Jigsaw/2.2.5 W3C_CSS_Validator_JFouffa/2.0
11-
Microsoft Internet Explorer/4.0b1 (Windows 95)
124
Mozilla/4.0 (compatible; MSIE 6.0; Linux i686 ; en) Opera 9.70
135
Mozilla/4.0 (compatible; MSIE 6.0; Mac_PowerPC; en) Opera 9.24
146
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; de) Opera 9.50
@@ -1137,8 +1129,6 @@ Mozilla/6.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:2.0.0.0) Gecko/2006102
11371129
Mozilla/6.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8
11381130
Mozilla/6.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.8 (.NET CLR 3.5.30729)
11391131
Mozilla/6.0 (Windows; U; Windows NT 7.0; en-US; rv:1.9.0.8) Gecko/2009032609 Firefox/3.0.9 (.NET CLR 3.5.30729)
1140-
msnbot/1.0 (+http://search.msn.com/msnbot.htm)
1141-
OmniExplorer_Bot/6.70 (+http://www.omni-explorer.com) WorldIndexer
11421132
Opera 9.4 (Windows NT 5.3; U; en)
11431133
Opera 9.4 (Windows NT 6.1; U; en)
11441134
Opera 9.7 (Windows NT 5.2; U; en)
@@ -1509,7 +1499,3 @@ Opera/9.80 (X11; Linux x86_64; U; it) Presto/2.2.15 Version/10.10
15091499
Opera/9.80 (X11; Linux x86_64; U; pl) Presto/2.7.62 Version/11.00
15101500
Opera/9.80 (X11; U; Linux i686; en-US; rv:1.9.2.3) Presto/2.2.15 Version/10.10
15111501
Opera/9.99 (Windows NT 5.1; U; pl) Presto/9.9.9
1512-
Scooter-3.2.EX
1513-
W3C_Validator/1.432.2.10
1514-
Wget/1.9
1515-
Yahoo!-MMCrawler/3.x (mms dash mmcrawler dash support at yahoo dash inc dot com)

0 commit comments

Comments
 (0)