KAIST builds real-time holographic telepresence system

Researchers at KAIST have developed a reference-free holographic telepresence framework that captures and replays 3D light wavefronts from a single camera image. The prototype could move remote communication closer to physically faithful 3D presence, with video-rate performance and low latency.

Why it matters: - The KAIST system aims to transmit measured light fields instead of reconstructed 3D approximations. - That approach could make remote communication look and behave more like a real object in space, with better depth, focus and presence. - The work could affect telepresence, holographic displays, remote collaboration, education, medical communication and industrial inspection.

What happened: - Researchers at KAIST developed a holographic telepresence framework that captures and replays the physical wavefront from a 3D scene in real time. - The team was led by Professor YongKeun Park at Korea Advanced Institute of Science and Technology in South Korea. - The system uses a single camera image to measure a scene's optical wavefront directly. - The prototype demonstrated volumetric refocusing, dynamic reconstruction and video-rate operation at about 28 frames per second. - The median end-to-end latency was about 50 milliseconds.

The details: - Conventional 3D systems usually rebuild scenes from depth maps, point clouds or computer-generated models. - The KAIST method measures the complex optical wavefront, which includes amplitude and phase. - Ordinary cameras capture intensity, not phase, so the team used a pre-characterized geometric phase diffuser. - The diffuser turns the incoming wavefront into a deterministic speckle pattern that can be decoded computationally. - A calibrated physical model and reconstruction algorithms recover the complex wavefront from a single intensity image. - A spatial light modulator then displays the recovered wavefront for optical replay. - The research was published in Opto-Electronic Advances under the title “Video-rate wavefront capture and replay via single-shot reference-free measurement: toward holographic telepresence.” - The paper's DOI is https://doi.org/10.29026/oea.2026.260001.

Between the lines: - The key shift is philosophical as much as technical: the system starts with the light itself, not with a geometric estimate of the scene. - That matters because visual perception depends on how light propagates, not just on object shape. - Reference-beam holography can be sensitive to vibration and alignment, which makes practical telepresence harder. - This reference-free method removes one of the biggest barriers to scaling wavefront-based communication. - The current prototype still has limits, including monochromatic green laser illumination and speckle noise. - The study suggests those limits may be tied to prototype hardware and could improve with better sensor sampling, wider optical bandwidth and temporal averaging.

What's next: - Future versions will need better display quality, color reproduction, miniaturization and speed. - The research points to a path where artificial intelligence, optical engineering, high-speed cameras, advanced spatial light modulators and data compression could work together. - The long-term goal is holographic communication that transmits physical light-field information rather than 2D images or synthetic reconstructions.

The bottom line: - KAIST's system is an early step toward real-time holographic telepresence that could make remote presence feel physically real, not just visually convincing.