Augmented Reality Scouting for Interactive 3D Reconstruction(4)

showninFigure5.Onlysomesmallcluttercanbeobservedinthebottomoftheresultingmodel.

Thereconstructiontimedependsontheimageresolutionandthenumberofextractedfeatures.Fortheaboveexample,eachpassofthepipelinetakeslessthanoneminuteforuploading,featureextraction, ndingcorrespondences,densematching,andupdatingthe3D

model.

Figure5:Thesescreenshotsshowatestdatasetofanoldbrickwall(with6inputimages).Theimageinthemiddleshowsthereconstruc-tionofthecamerapositionsincludingsparsepoints.Theimageonthebuttonshowsascreenshotofthe nal3Dmodel.

5CONCLUSION

ARscoutingallowson-linegenerationofarbitrary3Dmodelsinurbanenvironments.The rstprototypedeliverspromisingresultsandworkswellwithahandheldultra-mobilePC.Theresulting3Dmodelsarecurrentlyrepresentedbyatextured3Dpointcloud.DuetotheGPSinformation,thereconstructedmodelsareavailableinaglobalcoordinatesystemandcanberegisteredwithavailable3Dgeographicinformationsystems.

Inthenearfutureweplantoreplacethepointcloudmodelswithtruesurfacemeshesgeneratedbyarobustandincrementaldepthmapintegrationtechnique.Wealsointendtotestphysicallydistributedcollaborative3Dmodelingwithmultiplescoutsexplor-ingtheenvironmentsimultaneouslyandreconstructinglargerareas.Wealsointendtoperformadetailedquantitativeanalysisoftheob-tainedmodelsintermsoftheirreconstructionaccuracycomparedagainstconventionaloff-linereconstructiontechniques.

222

ACKNOWLEDGEMENTS

ThisresearchisjointworkbetweenGrazUniversityofTechnology(sponsoredpartiallybytheEuropeanUnionundercontractFP6-2004-IST-4-27571andtheAustrianScienceFundFWFundercon-tractY193)andVRVisResearchCenter(fundedbytheAustriangovernmentresearchprogramK-plus).REFERENCES

[1]A.Akbarzadeh,J.-M.Frahm,P.Mordohai,andetal.Towardsurban

3dreconstructionfromvideo.InInternationalSymposiumon3DDataProcessing,VisualizationandTransmission(3DPVT),2006.

[2]H.Benko,E.Ishak,andS.Feiner.Collaborativemixedrealityvisual-izationofanarchaeologicalexcavation.InProc.oftheInternationalSymposiumonMixedandAugmentedReality(ISMAR2004),2004.[3]S.Feiner,B.MacIntyre,T.H¨ollerer,,andT.Webster.Atouringma-chine:Prototyping3dmobileaugmentedrealitysystemsforexplor-ingtheurbanenvironment.InProc.oftheISWC’97(FirstIEEEInt.

Symp.onWearableComputers),pages208–217,1997.[4]R.M.Haralick,C.Lee,K.Ottenberg,andM.N¨olle.Analysisand

solutionsofthethreepointperspectiveposeestimationproblem.InIEEEComputerSocietyConferenceonComputerVisionandPatternRecognition(CVPR),pages592–598,1991.

[5]C.HarrisandM.Stephens.Acombinedcornerandedgedetector.

Proceedings4thAlveyVisualConference,pages189–192,1988.

[6]R.HartleyandA.Zisserman.MultipleViewGeometryinComputer

Vision.CambridgeUniversityPress,2000.[7]J.Heikkil¨a.Geometriccameracalibrationusingcircularcontrol

points.IEEETransactionsonPatternAnalysisandMachineIntel-ligence(PAMI),22(10):1066–1077,2000.[8]A.Huguet,R.Carceroni,andA.deA.Ara´ujo.Towardsautomatic

3dreconstructionofurbanscenesfromlow-altitudeaerialimages.InProc.ofthe12thInternationalConferenceonImageAnalysisandProcessing(ICIAP’03),2003.

[9]H.Ishii,J.Underkof er,D.Chak,B.Piper,E.Ben-Joseph,L.Yeung,

andZ.Kanji.Augmentedurbanplanningworkbench:Overlayingdrawings,physicalmodelsanddigitalsimulation.InProc.oftheInt.SymposiumonMixedandAugmentedReality(ISMAR),2002.

[10]M.LourakisandA.Argyros.Thedesignandimplementationof

agenericsparsebundleadjustmentsoftwarepackagebasedonthelevenberg-marquardtalgorithm.TechnicalReport340,InstituteofComputerScience-FORTH,Heraklion,Crete,Greece,August2004.[11]D.Nist´er.Anef cientsolutiontothe ve-pointrelativeposeprob-lem.IEEETransactionsonPatternAnalysisandMachineIntelligence

(PAMI),26(6):756–770,2004.

[12]W.PiekarskiandB.Thomas.Tinmith-metro:Newoutdoortechniques

forcreatingcitymodelswithanaugmentedrealitywearablecomputer.In5thInt’lSymposiumonWearableComputers,pages31–38,Zurich,2001.

[13]G.ReitmayrandT.Drummond.Goingout:Robustmodel-based

trackingforoutdooraugmentedreality.InProc.oftheInternationalSymposiumonMixedandAugmentedReality(ISMAR2006),2006.[14]N.Snavely,S.Seitz,andR.Szeliski.Phototourism:Exploringphoto

collectionsin3d.ACMTransactionsonGraphics(SIGGRAPHPro-ceedings),25(3):835–846,2006.

[15]D.WagnerandD.Schmalstieg.Muddlewareforprototypingmixed

realitymultiusergames.InProc.oftheIEEEVirtualReality2007,2007.

[16]X.Wang,S.Totaro,F.Taillandier,A.Hanson,andS.Teller.Recov-eringfacadetextureandmicrostructurefromreal-worldimages.InProc.2ndInternationalWorkshoponTextureAnalysisandSynthesis,pages145–149,2002.

[17]R.Yang,G.Welch,andG.Bishop.Real-timeconsensusbasedscene

reconstructionusingcommoditygraphicshardware.InProceedingsofPaci cGraphics,pages225–234,2002.

[18]C.Zach,M.Sormann,andK.Karner.High-performancemulti-view

reconstruction.InInternationalSymposiumon3DDataProcessing,VisualizationandTransmission(3DPVT),2006.