Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex

Applications and robotic implementations of auditory processing

Physiological basis of Auditory Streaming in Auditory Cortex

Spectrotemporal analysis in the auditory cortex

Functional organization of early auditory system

Stereausis processing of binaural time-delays

Harmonic templates in pitch perception

VLSI Cochlea Model Chip

Applications and robotic implementations of auditory processing

One of the most exciting aspects of studying auditory function is seeing its tangible benefits in numerous applications ranging from the analysis and efficient coding of speech and music, to the assessment of speech intelligibility, to the development of robust auditory behavior in robots and smart sensors. These applications in turn have provided much inspiration into the nature of auditory perception and have significantly influenced the direction of our experimental research over the years. Several theoretical projects are underway and will likely continue in the next few years:

(1) Sonifying images: The objective of this research is to render sound from images by mapping visual attributes to their auditory counterparts. The correspondence between the two modalities is established by abstractions of the underlying neural processing in both systems.

(2) Perception of musical timbre: This project seeks to develop a metric for the complex percept of musical timbre based exclusively on the representations of different sounds in models of cortical processing. 

(3) Speech coding, enhancement, and detection: The aim is to develop a comprehensive auditory-based representation of the speech signal that would explain its remarkable perceptual robustness, and be valuable in the assessment of its intelligibility, its efficient transmission, and its robust automatic recognition.

Hardware implementations are also underway motivated by the desire to embed auditory capabilities in miniature robots and smart MEMS microphones. The favorite medium of our projects continues to be the analog VLSI  technology, which has proven effective in fabricating extremely low-power neuromorphic structures mimicking cochlear function and sound localization circuits. The primary goal of the next phase is the design and fabrication of multiscale spectrotemporal analyzers resembling the cortical analysis of sound.

Last updated: August 21, 2012

Designed by Shin Chang