Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision | ||
courses:rg:2014:mdsm [2014/11/25 21:28] nguyenti |
courses:rg:2014:mdsm [2014/11/29 13:52] (current) popel |
||
---|---|---|---|
Line 1: | Line 1: | ||
- | Q1. Recall | + | You should focus on the first paper (you can skip section 2.3): [[http:// |
- | a. What is the difference between distributional semantic and distributed semantic representation? | + | The second paper [[http:// |
- | b. What is maximum size of word vector | + | |
+ | |||
+ | Q1. | ||
+ | Recall the paper about word representations | ||
+ | Read http://www.quora.com/ | ||
+ | |||
+ | (M_{w,d} is a matrix with w rows and d columns). | ||
+ | What does w, d and k mean? | ||
+ | What are the values | ||
Q2. | Q2. | ||
- | a. Compute the similarity between two words: " | + | a) Compute the similarity between two words " |
+ | Use these raw counts (no Local Mutual Information, | ||
| planet | night | full | shadow | shine | | planet | night | full | shadow | shine | ||
Line 12: | Line 21: | ||
Mars | Mars | ||
| | ||
- | b. | + | b) How do they deal with high dimension of vectors in those papers? |
+ | Can you suggest some (other) techniques of preprocessing vectors with high dimensions? | ||
- | Q3. What are Bag of Word (BOVW) and Bag of Visual Word (BOW)? | + | Q3. |
+ | a) What are Bag of Word (BOVW) and Bag of Visual Word (BOW)? | ||
+ | b) How do they apply BOVW to compute representation of a word (concept) from a large set of images? | ||
+ | |||
+ | Q4 (bonus). | ||
+ | When they construct text-based vectors of words from DM model | ||
+ | they mentioned Local Mutual Information score. (section 3.2, also section 2.1 in the 2nd paper) | ||
+ | So what is that score? Why did they use it? | ||
- | Q4. How do they apply BOVW to compute representation of a word (concept) from a large set of Images? | + | Q5 (bonus). |
+ | Have you ever wished to see beautiful " | ||
+ | Have you ever seen " | ||
+ | " | ||
- | Q5. Have you ever wish to see a beautiful Mermaids. | + | Think about a computational way to show that how they look like? |
- | Have you ever seen " | + | |
- | Can you think a computational way to show that how they look like? | + | |