Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Commit f712d24

Browse files
stamparmstamparm
committed
removed duplicate entries inside common wordlists (tables & columns) and added a script which does that automatically
1 parent c5b1f33 commit f712d24

5 files changed

Lines changed: 758 additions & 788 deletions

File tree

‎extra/shutils/duplicates.py‎

Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
#!/usr/bin/env python
2+
3+
"""
4+
$Id: fingerprint.py 2463 2010-11-30 22:40:25Z inquisb $
5+
6+
Copyright (c) 2006-2010 sqlmap developers (http://sqlmap.sourceforge.net/)
7+
See the file 'doc/COPYING' for copying permission
8+
"""
9+
10+
# Removes duplicate entries in wordlist like files
11+
12+
import sys
13+
14+
if len(sys.argv) > 0:
15+
16+
items = list()
17+
f = open(sys.argv[1], 'r')
18+
19+
for item in f.readlines():
20+
item = item.strip()
21+
if item in items:
22+
if item:
23+
print item
24+
items.append(item)
25+
26+
f.close()
27+
28+
f = open(sys.argv[1], 'w+')
29+
f.writelines("\n".join(items))
30+
f.close()

‎extra/shutils/duplicates.sh‎

Lines changed: 0 additions & 9 deletions
This file was deleted.

‎extra/shutils/id.sh‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,4 +6,4 @@
66
# See the file 'doc/COPYING' for copying permission
77

88
# Adds SVN property 'Id' to project files
9-
find ../../. -type f -name "*.py" -exec svn propset svn:keywords "Id" '{}' \;
9+
find ../../. -type f -name "*.py" -exec svn propset svn:keywords "Id" '{}' \;

0 commit comments

Comments
 (0)