50MCQ Lecture1: Embedding Word
1. What is the main goal of word embeddings?
a) To convert text into integers
b) To represent words in a high-dimensional space
c) To capture semantic meaning of words in a low-dimensional space
d) To remove stop words from text
Answer: c) To capture semantic meaning of words in a low-dimensional space
2. Which of the following is a disadvantage of one-hot vectors?
a) They are simple to implement
b) They do not capture semantic relationships between words
c) They are computationally efficient
d) They are suitable for large vocabularies
Answer: b) They do not capture semantic relationships between words
3. What does "semantic distance" mean in word embeddings?
a) The physical distance between words in a document
b) The similarity in meaning between words
c) The frequency of words in a corpus
d) The length of words in characters
Answer: b) The similarity in meaning between words
4. Which of the following is NOT a basic word embedding method?
a) word2vec
b) GloVe
c) BERT
d) fastText
Answer: c) BERT (BERT is an advanced, contextual embedding method)
5. What is the main goal of the CBOW model?
a) To predict the next word in a sentence
b) To predict the center word given its context words
c) To classify text into categories
d) To generate random word vectors
Answer: b) To predict the center word given its context words
6. What is the role of the context window in CBOW?
a) It defines the number of words to be predicted
b) It specifies the number of words surrounding the center word
c) It determines the size of the vocabulary
d) It limits the number of training examples
Answer: b) It specifies the number of words surrounding the center word
7. Which of the following is a key hyperparameter in CBOW?
a) Learning rate
b) Number of layers in the neural network
c) Size of the word embeddings
d) All of the above
Answer: d) All of the above
8. What is the purpose of the ReLU activation function in CBOW?
a) To normalize the input data
b) To introduce non-linearity into the model
c) To reduce the dimensionality of the word embeddings
d) To calculate the loss function
Answer: b) To introduce non-linearity into the model
9. What does the softmax function do in CBOW?
a) It converts the output into probabilities
b) It calculates the loss function
c) It normalizes the input vectors
d) It reduces the dimensionality of the word embeddings
Answer: a) It converts the output into probabilities
10. Which loss function is commonly used in CBOW?
a) Mean squared error
b) Cross-entropy loss
c) Hinge loss
d) Logistic loss
Answer: b) Cross-entropy loss
11. What is the main advantage of word embeddings over one-hot vectors?
a) They are easier to compute
b) They capture semantic relationships between words
c) They require less memory
d) They are faster to train
Answer: b) They capture semantic relationships between words
12. Which of the following is an example of a semantic analogy?
a) "Paris" is to "France" as "Rome" is to "Italy"
b) "Seen" is to "saw" as "been" is to "was"
c) "Wolf" is to "pack" as "bee" is to "swarm"
d) All of the above
Answer: d) All of the above
13. What is the purpose of intrinsic evaluation in word embeddings?
a) To test the embeddings on external tasks
b) To evaluate the embeddings based on their performance in analogies and
clustering
c) To measure the computational efficiency of the embeddings
d) To compare different embedding methods
Answer: b) To evaluate the embeddings based on their performance in analogies
and clustering
14. Which of the following is an example of extrinsic evaluation?
a) Testing word embeddings on named entity recognition
b) Evaluating word embeddings using semantic analogies
c) Visualizing word embeddings in 2D space
d) Clustering words based on their embeddings
Answer: a) Testing word embeddings on named entity recognition
15. What is the main challenge of extrinsic evaluation?
a) It is computationally expensive
b) It is difficult to interpret the results
c) It requires a large amount of labeled data
d) All of the above
Answer: d) All of the above
16. What is the purpose of tokenization in NLP?
a) To convert text into integers
b) To split text into individual words or tokens
c) To remove punctuation from text
d) To normalize text by converting it to lowercase
Answer: b) To split text into individual words or tokens
17. Which of the following is a common preprocessing step in NLP?
a) Converting text to lowercase
b) Removing special characters
c) Handling numbers and punctuation
d) All of the above
Answer: d) All of the above
18. What is the main advantage of using pre-trained word embeddings?
a) They are faster to train
b) They require less data
c) They capture general language patterns
d) All of the above
Answer: d) All of the above
19. Which of the following is a popular pre-trained word embedding model?
a) word2vec
b) GloVe
c) fastText
d) All of the above
Answer: d) All of the above
20. What is the primary difference between word2vec and GloVe?
a) word2vec uses a neural network, while GloVe uses matrix factorization
b) word2vec is faster to train than GloVe
c) GloVe captures global word co-occurrence statistics, while word2vec
captures local context
d) Both a) and c)
Answer: d) Both a) and c)
21. What is the key advantage of fastText over word2vec?
a) It supports out-of-vocabulary words
b) It is faster to train
c) It captures semantic relationships better
d) It requires less memory
Answer: a) It supports out-of-vocabulary words
22. What is the purpose of the sliding window technique in CBOW?
a) To generate training examples by selecting context words around a center
word
b) To reduce the dimensionality of the word embeddings
c) To calculate the loss function
d) To normalize the input data
Answer: a) To generate training examples by selecting context words around a
center word
23. What is the role of the projection layer in CBOW?
a) To convert context words into a single vector
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To convert context words into a single vector
24. What is the main purpose of the hidden layer in CBOW?
a) To capture non-linear relationships between words
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To capture non-linear relationships between words
25. What is the primary purpose of the output layer in CBOW?
a) To predict the center word
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To predict the center word
26. What is the main advantage of using word embeddings in sentiment
analysis?
a) They capture the sentiment of words
b) They reduce the dimensionality of the input data
c) They improve the accuracy of the model
d) All of the above
Answer: d) All of the above
27. Which of the following is a key challenge in training word embeddings?
a) Choosing the right hyperparameters
b) Handling out-of-vocabulary words
c) Capturing rare words
d) All of the above
Answer: d) All of the above
28. What is the main purpose of the softmax function in CBOW?
a) To convert the output into probabilities
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To convert the output into probabilities
29. What is the main purpose of the cross-entropy loss function in CBOW?
a) To measure the difference between predicted and actual center words
b) To normalize the input data
c) To reduce the dimensionality of the word embeddings
d) To calculate the accuracy of the model
Answer: a) To measure the difference between predicted and actual center
words
30. What is the main advantage of using word embeddings in machine
translation?
a) They capture the meaning of words in different languages
b) They reduce the dimensionality of the input data
c) They improve the accuracy of the model
d) All of the above
Answer:d) All of the above
31. Which of the following is a key challenge in using word embeddings for
machine translation?
a) Handling out-of-vocabulary words
b) Capturing rare words
c) Aligning words in different languages
d) All of the above
Answer: d) All of the above
32. What is the main purpose of the ReLU activation function in CBOW?
a) To introduce non-linearity into the model
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To introduce non-linearity into the model
33. What is the main purpose of the hidden layer in CBOW?
a) To capture non-linear relationships between words
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To capture non-linear relationships between words
34. What is the main purpose of the output layer in CBOW?
a) To predict the center word
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To predict the center word
35. What is the main advantage of using word embeddings in sentiment
analysis?
a) They capture the sentiment of words
b) They reduce the dimensionality of the input data
c) They improve the accuracy of the model
d) All of the above
Answer: d) All of the above
36. Which of the following is a key challenge in training word embeddings?
a) Choosing the right hyperparameters
b) Handling out-of-vocabulary words
c) Capturing rare words
d) All of the above
Answer: d) All of the above
37. What is the main purpose of the softmax function in CBOW?
a) To convert the output into probabilities
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To convert the output into probabilities
38. What is the main purpose of the cross-entropy loss function in CBOW?
a) To measure the difference between predicted and actual center words
b) To normalize the input data
c) To reduce the dimensionality of the word embeddings
d) To calculate the accuracy of the model
Answer: a) To measure the difference between predicted and actual center
words
39. What is the main advantage of using word embeddings in machine
translation?
a) They capture the meaning of words in different languages
b) They reduce the dimensionality of the input data
c) They improve the accuracy of the model
d) All of the above
Answer: d) All of the above
40. Which of the following is a key challenge in using word embeddings for
machine translation?
a) Handling out-of-vocabulary words
b) Capturing rare words
c) Aligning words in different languages
d) All of the above
Answer: d) All of the above
41. What is the main purpose of the ReLU activation function in CBOW?
a) To introduce non-linearity into the model
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To introduce non-linearity into the model
42. What is the main purpose of the hidden layer in CBOW?
a) To capture non-linear relationships between words
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To capture non-linear relationships between words
43. What is the main purpose of the output layer in CBOW?
a) To predict the center word
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To predict the center word
44. What is the main advantage of using word embeddings in sentiment
analysis?
a) They capture the sentiment of words
b) They reduce the dimensionality of the input data
c) They improve the accuracy of the model
d) All of the above
Answer: d) All of the above
45. Which of the following is a key challenge in training word embeddings?
a) Choosing the right hyperparameters
b) Handling out-of-vocabulary words
c) Capturing rare words
d) All of the above
Answer: d) All of the above
46. What is the main purpose of the softmax function in CBOW?
a) To convert the output into probabilities
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To convert the output into probabilities
47. What is the main purpose of the cross-entropy loss function in CBOW?
a) To measure the difference between predicted and actual center words
b) To normalize the input data
c) To reduce the dimensionality of the word embeddings
d) To calculate the accuracy of the model
Answer: a) To measure the difference between predicted and actual center
words
48. What is the main advantage of using word embeddings in machine
translation?
a) They capture the meaning of words in different languages
b) They reduce the dimensionality of the input data
c) They improve the accuracy of the model
d) All of the above
Answer: d) All of the above
49. Which of the following is a key challenge in using word embeddings for
machine translation?
a) Handling out-of-vocabulary words
b) Capturing rare words
c) Aligning words in different languages
d) All of the above
Answer: d) All of the above
50. What is the main purpose of the ReLU activation function in CBOW?
a) To introduce non-linearity into the model
b) To calculate the loss function
c) To normalize the input data
d) To reduce the dimensionality of the word embeddings
Answer: a) To introduce non-linearity into the model
