Holoportation
Microsoft Research
A key contributor to the Holoportation project, a new type of 3D capture technology that allows high-quality 3D models of people to be reconstructed, compressed, and transmitted anywhere in the world in real-time.
Sergio Orts Escolano
Senior Staff Research Scientist at Google
Pushing the boundaries of Computer Vision, Machine Learning, and AR/VR.
About Me
I am a Senior Research Scientist at Google, where I work on cutting-edge problems in Computer Vision and Machine Learning. Previously, I was a Researcher at Microsoft Research, contributing to the Holoportation project. My academic journey includes a PhD from the University of Alicante, specializing in real-time 3D reconstruction and depth sensing.
My work focuses on bridging the gap between physical and digital worlds through advanced depth estimation, volumetric video, and neural rendering techniques.
Research Interests
- Computer Vision
- Machine Learning & Deep Learning
- Generative AI (GenAI)
- Digital Humans
- Neural Rendering
- Augmented & Virtual Reality (AR/VR)
- Depth Sensing & Estimation
- 3D Reconstruction & Segmentation
- Real-time GPGPU Computing
Selected Projects
Google Research
Working on advanced CV/ML integration for Google products, contributing to open-source initiatives, and exploring novel neural rendering approaches.
Selected Publications
Text to 3D Object Generation for Scalable Room Assembly
ICLR 2025 Workshop SynthData
CHOSEN: Contrastive Hypothesis Selection for Multi-View Depth Refinement
ECCV 2024 Wild3D
Controllable Light Diffusion for Portraits
2023
VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relighting
SIGGRAPH 2022
Neural Light Transport for Relighting and View Synthesis
ACM Transactions on Graphics, 2021