Researchers at the University of California, Los Angeles have created a new optical-neural processor that uses light to help identify deepfake videos quickly and accurately. Unlike conventional systems that typically examine videos one after another using digital hardware, the UCLA technology can analyze 15 or more video streams at the same time.
The key difference is that part of the detection process takes place through the physical propagation of light. This allows many videos to be evaluated simultaneously during a single optical pass rather than requiring each one to move separately through a conventional digital processing pipeline. The technology is detailed in the study titled Scalable, Energy-Efficient Optical-Neural Architecture for Multiplexed Deepfake Video Detection, published in eLight. The researchers designed the optical AI system to serve as a high-throughput, attack-resilient first layer of defense for screening large amounts of manipulated and AI-generated video.
Light-based AI replaces digital decoding
Rapid improvements in generative AI have made synthetic videos increasingly realistic, increasing the need for detection systems that are both accurate and capable of operating at large scale. Many advanced deepfake detectors depend on enormous amounts of digital computation. A single analysis can require hundreds of billions of floating-point operations, and videos are often processed sequentially. As more content must be checked, both the processing time and energy requirements can rise proportionally. Digital detection systems face another problem because attackers can deliberately alter fake videos in subtle ways designed to confuse a detector and make manipulated footage appear authentic. Professor Aydogan Ozcan and his UCLA team developed a hybrid digital-optical system intended to address both challenges.
A lightweight digital encoder first collects compact information about each video, including spatial, spectral, and temporal features. That information is transformed into a phase pattern and displayed on a programmable spatial light modulator. The resulting optical wavefront then travels through a free-space-based, passive optical decoder. At the other end, paired optical detectors directly produce an authenticity score for each video. In effect, the system replaces a computationally demanding digital decoding network with a physical process that can handle many streams in parallel.
Experiments show high accuracy and security
In experiments using visible light, the processor examined 15 Celeb-DF videos simultaneously during each optical pass. It achieved an average detection accuracy of 97.79%, along with a sensitivity of 99.86% and a specificity of 95.72%. Sensitivity measures how successfully the system identifies manipulated videos, making the particularly high sensitivity important for a screening tool designed to keep fake content from slipping through. The 99.86% sensitivity translated to an average false-negative rate of approximately 0.14%. The researchers also pushed the system further by increasing its capacity to 18 videos in a single optical pass. Even at that level, average detection accuracy remained at 96.13%.
The team found that the processor could also become more capable by increasing the physical depth of its passive optical decoder without substantially increasing energy use or inference latency. When researchers added two optimized passive diffractive layers while testing more difficult deepfake manipulations, detection accuracy improved by approximately 6.8%. These phase-only diffractive layers can be manufactured as passive, static optical structures and surfaces. They perform additional calculations through the diffraction of light, meaning they do not require additional electrical power while the system is performing an inference. The optical system also showed resistance to black-box adversarial attacks and provides inherent protection against white-box attacks.
Read nextGoogle Researchers Develop Watermarking System for AI-Designed ProteinsSystem works as a first line of defense
The researchers did not limit their experiments to conventional face swapping deepfakes. They also challenged the processor with videos produced using Google's VEO-3 model. With only minimal fine-tuning, the optical processor achieved 94.80% accuracy and 97.61% sensitivity on previously unseen VEO-3 videos during experiments. The processor also continued working reliably when videos were affected by image noise, blur, JPEG compression, and experimental misalignments.
Rather than replacing sophisticated digital detectors entirely, the UCLA processor is designed to work as a highly sensitive first stage of a larger detection system. Massive volumes of video could initially pass through the parallel optical processor. Content identified as suspicious could then be sent to more computationally demanding digital models for a more detailed final assessment. The authors of this work are Parnian Ghapandar Kashani and Dr. Shiqi Chen, who contributed equally, and Professor Aydogan Ozcan.
