We present VR-SPV, an open-source virtual reality toolbox for simulated prosthetic vision that uses a psychophysically validated computational model to allow sighted participants to ‘see through the eyes’ of a bionic eye user.
Immersive Virtual Reality Simulations of Bionic Vision
Due to the unique requirements of working with bionic eye recipients (e.g., required assistance, increased setup time, travel cost), experimentation with different encoding methods remains challenging and expensive.
Instead, embedding simulated prosthetic vision (SPV) models in immersive virtual reality (VR) allows sighted subjects to act as virtual patients by “seeing” through the eyes of the patient, taking into account their head and eye movements as they explore an immersive virtual environment.
This can speed up the development process by allowing us to test theoretical predictions in high-throughput experiments, the best of which can be validated and improved upon in an iterative process with the bionic eye recipient in the loop.
Project Lead:
PhD Candidate
Project Affiliates:
Postdoctoral Scholar
MS Student
Junior Specialist
Research Assistant
Research Assistant
Research Assistant
Research Assistant
Principal Investigator:
Assistant Professor
R00EY029329:
Virtual prototyping for retinal prosthesis patients
PI: Michael Beyeler (UCSB)
September 2020 - August 2023
National Eye Institute (NEI)
National Institutes of Health (NIH)
Publications
Immersive virtual reality simulations of bionic vision
Justin Kasowski, Michael Beyeler ACM Augmented Humans (AHs) ‘22
Towards immersive virtual reality simulations of bionic vision
We propose to embed biologically realistic models of simulated prosthetic vision in immersive virtual reality so that sighted subjects can act as ‘virtual patients’ in real-world tasks.
Justin Kasowski, Nathan Wu, Michael Beyeler ACM Augmented Humans (AHs) ‘21
