MIT Department of Electrical Engineering & Computer Science

E E C S

Retinomorphic Vision Systems: Reverse Engineering the Vertebrate Retina

Kwabena "Buster" Boahen
CNS Program, Caltech

Monday, September 16, 1996
3:00 PM (2:45 refreshments)
Room NE43-518
EECS Special Seminar

Abstract

Neurobiologists have gleaned several handy principles of operation employed by the retina. By exploiting the statistics of natural scenes, the retina filters visual information to obtain a sparse output representation, in space and time. By adapting to the amplitude probability density, and to the amplitude level and rate of change of the visual signal, the retina samples the signal efficiently. To keep the process maximally adaptive, it performs all these operations at the pixel level in real time. To ameliorate the effects of noise and structural perturbations, it performs computation collectively, by distributing and pooling signals over a local neighborhood, in space and time.

Retinomorphic vision systems embody these retinal principles. Their function is determined by top-down constraints, based on information theory, and their structure is determined by bottom-up constraints, based on VLSI design principles---the same forces that, no doubt, shaped the highly evolved piece of tissue that lines the eyeball. Paying attention to structure as well as function results in energy- and area-efficient sensor designs that are ideally suited to perceptive human-made systems, because, unlike video cameras, these retinomorphic designs go beyond simply reproducing the scene, to extracting salient information in real time.

I will talk about vision chips that I designed to model the structure and function of the vertebrate retina. I have measured and analyzed the spatiotemporal dynamics of these retinomorphic chips, and compared the results with measurements from the biological counterparts. By combining synthesis and analysis, I have identified tradeoffs in sensory-system design. These tradeoffs yield insights into how the retina simultaneously optimizes structure and function, and provide a unified view of outer and inner retinal processing. My work has also advanced the state of the art in focal-plane image processing. I will conclude my talk by describing how we can incorporate retinomorphic chips into multichip neuromorphic systems; I will illustrate this procedure by showing a video demonstration of a two-dimensional stereo vision system.

HOSTS: Profs. J. Guttag and J. Shapiro


URL of this page: http://www-eecs.mit.edu/AY96-97/events/3.html
Created: Sep 5, 1996  | Modified: Jun 24, 1997
This announcement is from the MIT EECS 1996-97 archive.  | Current events
To MIT EECS home page  | Your comments and inquiries are welcome.