Monday, September 28, 2009

How to build Rome in a day



































They came, they saw, they took pictures. And thanks to them -- about 150,000 Flickr users -- a team of computer scientists built Rome in a day.

Using nearly half a million Flickr photos of Rome, Venice, and the Croatian coastal city of Dubrovnik, a team of computer scientists at the University of Washington's Graphics and Imaging Laboratory assembled digital models of the three cities in 3-D.

Their work builds on the algorithms used in Microsoft's Photosynth, which were invented at the same lab, but it's like Photosynth on steroids.

A series of videos on the project Web site lets visitors fly through landmarks like St. Peter's Basilica, the Colosseum and Venice's San Marco Square. For much smaller Dubrovnik, you can see the whole city, including mountains in the distance.

Each video includes clusters of small diamond shapes, which represent each photographer and his or her vantage point.

The team built a new algorithm that proceeds in two steps -- first, by matching the photos by what they had in common, puzzle-style, and then by determining the scene and each photographer's pose. They also designed new software that can more quickly solve the type of large math problems that exist in 3-D reconstruction.

It took 500 computer processors 13 hours to match 150,000 photos for Rome's landmarks, and eight more hours to construct a 3-D image of them. Venice involved 250,000 images, which took 27 hours to match and 38 hours to reconstruct. By contrast, using the algorithms on which Photosynth is based, it would have taken 500 processors at least a year to match 250,000 photos.

Dubrovnik had fewer photos, so matching only took about five hours, but the reconstruction ate up almost 18 hours.

It stands to reason that more photos would take more time, but there were so many similarities among Rome's photos that it was simpler to put them all together into individual landmarks. The team found clumps of photos that went together, yielding fine detail of the front of the Trevi Fountain, for instance. The Colosseum had 2,000 images. For Dubrovnik, however, the team had just 4,600 photos corresponding to the entire "old city" portion, which comprises several narrow streets and tall buildings.

No comments:

Post a Comment