Multi-sensory information as an improvement for communication systems efficiency  

Lacerda, F., Klintfors, E. & Gustavsson, L.

In the Proceedings of Fonetik 2005, Göteborg, 25-27 May 2005: 83-86.


The paper addresses the issue of extraction of implicit information conveyed by systematic audio-visual contingencies. A group of adult subjects was tested on a simple inference task provided by short film sequences. The video materials were encoded and submitted to processing by two neural networks (NN) that simulated the results of the adult subjects. The results indicated that the adult subjects were extremely efficient at picking up the underlying information structure and that the NN could also perform acceptably on both classification and generalization tasks.

View pdf-version of paper

PERILUS | All issues | 2005 issue | Previous | Next | Phonetics at Stockholm University