Verena V. Hafner

Analyzing Multimodal Integration in the Variational Autoencoder from an Information-Theoretic Perspective

2024 · arXiv (Cornell University)

Human perception is inherently multimodal. We integrate, for instance, visual, proprioceptive and tactile information into one experience. Hence, multimodal learning is of importance for building robotic systems that aim at robustly interacting with the real …