Leanne Nortje

Unsupervised vs. Transfer Learning for Multimodal One-Shot Matching of Speech and Images

2020

We consider the task of multimodal one-shot speech-image matching.An agent is shown a picture along with a spoken word describing the object in the picture, e.g.cookie, broccoli and ice-cream.After observing one paired speech-image example per …