Thanks to visit codestin.com Credit goes to github.com
We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 0379039 commit 8572268Copy full SHA for 8572268
swivel/prep.py
@@ -111,7 +111,6 @@ def create_vocabulary(lines):
111
vocab = [(tok, n) for tok, n in vocab.iteritems() if n >= FLAGS.min_count]
112
vocab.sort(key=lambda kv: (-kv[1], kv[0]))
113
114
- num_words = max(len(vocab), FLAGS.shard_size)
115
num_words = min(len(vocab), FLAGS.max_vocab)
116
if num_words % FLAGS.shard_size != 0:
117
num_words -= num_words % FLAGS.shard_size
0 commit comments