Learning to Factorize and Relight a City

Synthetic Hyperlapse

We can also use Google Street View to create a hyperlapse through a city like NYC. By sampling Street View stacks densely enough, we can visualize a virtual trajectory through New York City. Because these stacks may be comprised of views from different points in time, hyperlapses constructed from these stacks will be jarring because the illumination changes significantly between frames. This can be seen in the hyperlapse video in the top row. Instead we can relight all of these stacks to have consistent illumination, resulting in a virtual walk through NYC under a consistent lighting. We show three hyperlapses illuminated under different conditions.

Additional Results

We present additional generated results. Despite training on scenes from New York City, we can relight scenes from entirely new cities and even continents. Other cities coming soon!