Echo: Phone Capture to a True-Scale 3D Model of a Room
AI products · Creator, sole engineer · in progress
An Android capture app and a Linux pipeline that turn a walk around a room into a measurable 3D model, using a phone with no depth sensor and no cloud service.
The detail
The app locks exposure, white balance and focus for the whole scan, keeps only sharp full-resolution photos, stores each with ARCore's camera pose in metres, and guides the walk with live hints and a coverage map. On the laptop, COLMAP solves the camera positions again from the photos, ARCore's poses scale them to metres, OpenMVS builds a textured mesh for Blender, and Brush trains a Gaussian splat for photo-real viewing.
The first real scan was 219 photos of my room. Checked against 18 photos held out of training, the splat's renders scored a median of 29.4 dB PSNR. The accuracy check against tape measurements and merging several rooms are still to come.
Kotlin, Camera2, ARCore, COLMAP, OpenMVS, Brush, Docker, Python.
What I did
- Built the Android capture app with locked exposure, white balance and focus, sharp-frame selection and a coverage map
- Recorded ARCore camera poses in metres with every photo to give the model true scale
- Built the laptop pipeline from photos to a textured mesh and a Gaussian splat, in Docker on the local GPU
- Checked the splat against 18 held-out photos: median 29.4 dB PSNR
Stack
Kotlin, Android, ARCore, Computer Vision, 3D Reconstruction, Python, Docker, Gaussian Splatting
Case study: https://www.siddhvasudev.com/projects/echo-phone-capture-to-a-true