• Facilitate the design of haptic effect of movies by using ML models to detect movie events (e.g. explosions, gun shots)
• We developed an audio-vision model enhanced by foundation models
• We collaborated closely with D-BOX and the model achived high performance in human evaluations
• Project featured on Mila’s website