Computational imaging with the human brain
(2022)cite arxiv:2210.03400.Abstract
Brain-computer interfaces (BCIs) are enabling a range of new possibilities
and routes for augmenting human capability. Here, we propose BCIs as a route
towards forms of computation, i.e. computational imaging, that blend the brain
with external silicon processing. We demonstrate ghost imaging of a hidden
scene using the human visual system that is combined with an adaptive
computational imaging scheme. This is achieved through a projection pattern
`carving' technique that relies on real-time feedback from the brain to modify
patterns at the light projector, thus enabling more efficient and higher
resolution imaging. This brain-computer connectivity demonstrates a form of
augmented human computation that could in the future extend the sensing range
of human vision and provide new approaches to the study of the neurophysics of
human perception. As an example, we illustrate a simple experiment whereby
image reconstruction quality is affected by simultaneous conscious processing
and readout of the perceived light intensities.
Description
Computational imaging with the human brain