The New Industrial Collaborations fund fosters research collaborations between industry and academia, helping to identify challenges and aiding the transformation of discoveries. The program requires a matching contribution from a collaborating company in the second year of the project. The following project was funded:

Real-time brain-to-image reconstructions and foundation models for neuroimaging data

• Kenneth Norman, Huo Professor in Computational and Theoretical Neuroscience; Professor of Psychology and Neuroscience; Chair, Department of Psychology
• Sanjeev Arora, Charles C. Fitzmorris Professor in Computer Science
• Jonathan Pillow, Professor of Princeton Neuroscience Institute
• Uri Hasson, Professor of Psychology and Neuroscience
• Industrial Collaborator: Stability AI

Princeton scientists will collaborate with researchers at Stability AI, an open-source generative artificial intelligence (AI) company, to build a system that can visually reconstruct images based on brain activity of patients after a single fMRI brain-imaging session over a timespan of a few seconds. Such a real-time system would, with the patient’s consent, enable researchers to view the patient’s internal mental experience, providing transformative implications for basic science discovery, clinical diagnosis and treatment.