Lecture 9 Notes:
We always need two optical centers in order to obtain depth data
(either 2 cameras or one-proj-one-cam setup)
Visual Hull Carving / Space Carving
Requires calibrated setups
Background <-> foreground segmentation
Not very robust to noise
Visual Hull Carving
A reconstruction method that creates an approximate shape of an object by combining silhouettes from
multiple camera views
Space Carving
A technique used to reconstruct a 3D shape from multiple images taken from different viewpoints
SFM – Structure from Motion
Creating 3D models from a 2D images taken
from different angles
Properties of good features:
– Fast comparisons
– Scale invariant
– View invariant
– Lighting invariant
Feature descriptors for matching:
– SIFT
– SURF
– ORB
– FREAK
SIFT (Scale-Invariant Feature Transform)
Difference of Gaussians
Neighborhood is divided in 16 sub-blocks
8-bin orientation histograms
128-dimensional
Multi-view Stereo (MVS)
Take results of SfM
– 6DoF Poses of images
– Estimated 3D points
Simultaneous Localization and Mapping (SLAM)
A process where a robot or device creates a map of an unknown environment while simultaneously
tracking its own position within that map.
Similar idea to SFM+MVS
Smaller compute budget
No global optimization
Dynamically extracts keyframes
Output:
– Poses + sparse point cloud
– Various ‘semi-dense methods’