We present a SNN model that uses spike-latency coding and winner-take-all inhibition to efficiently represent visual objects with as little as 15 spikes per neuron.
Event-Based Vision at the Edge
Neuromorphic event‐based vision sensors are poised to dramatically improve the latency, robustness and power in applications ranging from smart sensing to autonomous driving and assistive technologies for people who are blind.
Soon these sensors may power low vision aids and retinal implants, where the visual scene has to be processed quickly and efficiently before it is displayed. However, novel methods are needed to process the unconventional output of these sensors in order to unlock their potential.
Project Lead:
Postdoctoral Scholar
Project Affiliate:
Research Assistant
Principal Investigator:
Assistant Professor
Faculty Research Grant:
Event-based scene understanding for bionic vision
PI: Michael Beyeler (UCSB)
July 2021 - June 2022
Academic Senate
University of California, Santa Barbara (UCSB)
Publications
Efficient multi-scale representation of visual objects using a biologically plausible spike-latency code and winner-take-all inhibition
Melani Sanchez-Garcia, Tushar Chauhan, Benoit R. Cottereau, Michael Beyeler arXiv:2212.00081
(Note: MSG and TC are co-first authors. BRC and MB are co-last authors.)
Efficient visual object representation using a biologically plausible spike-latency code and winner-take-all inhibition
We present a SNN model that uses spike-latency coding and winner-take-all inhibition to efficiently represent visual stimuli from the Fashion MNIST dataset.
Melani Sanchez-Garcia, Tushar Chauhan, Benoit R. Cottereau, Michael Beyeler NeuroVision Workshop, IEEE/CVF Computer Vision and Pattern Recognition Conference (CVPR) ‘22
A GPU-accelerated cortical neural network model for visually guided robot navigation
We present a cortical neural network model for visually guided navigation that has been embodied on a physical robot exploring a real-world environment. The model includes a rate based motion energy model for area V1, and a spiking neural network model for cortical area MT. The model generates a cortical representation of optic flow, determines the …
Michael Beyeler, Nicolas Oros, Nikil Dutt, Jeffrey L. Krichmar Neural Networks 72: 75-87
