People with aphantasia are offering brain scientists a window into consciousness. This is an audio version of our Feature: Many people have no mental imagery. What’s going on in their brains?

Abstract: The Audio-Visual Question Answering (AVQA) task holds significant potential for applications. Compared to traditional unimodal approaches, the multi-modal input of AVQA makes feature ...

A new study finds that horse whinnies are made of both a high and a low frequency, generated by different parts of the vocal tract. The two-tone sound may help horses convey more complex information.

Abstract: In real-world physiological and psychological scenarios, there often exists a robust complementary correlation between audio and visual signals. Audio-Visual Event Localization (AVEL) aims ...

This repo is the implementation of a research project aimed at enhancing Acoustic Side-Channel Attacks (ASCAs) using a novel combination of Vision Transformers (VTs) and Large Language Models (LLMs).