US Patent:
20190051056, Feb 14, 2019
Inventors:
- Menlo Park CA, US
Supun Samarasekera - Skillman NJ, US
Rakesh Kumar - West Windsor NJ, US
Ryan Villamil - Plainsboro NJ, US
Varun Murali - Princeton Junction NJ, US
Gregory Drew Kessler - Yardley PA, US
International Classification:
G06T 19/00
G06K 9/62
G06T 7/136
G06F 17/30
G06K 9/00
G06N 3/08
G01S 17/89
Abstract:
Techniques for augmenting a reality captured by an image capture device are disclosed. In one example, a system includes an image capture device that generates a two-dimensional frame at a local pose. The system further includes a computation engine executing on one or more processors that queries, based on an estimated pose prior, a reference database of three-dimensional mapping information to obtain an estimated view of the three-dimensional mapping information at the estimated pose prior. The computation engine processes the estimated view at the estimated pose prior to generate semantically segmented sub-views of the estimated view. The computation engine correlates, based on at least one of the semantically segmented sub-views of the estimated view, the estimated view to the two-dimensional frame. Based on the correlation, the computation engine generates and outputs data for augmenting a reality represented in at least one frame captured by the image capture device.