WO2009124028A3 - Estimating pose of photographic images in 3d earth model using human assistance - Google Patents

Estimating pose of photographic images in 3d earth model using human assistance Download PDF

Info

Publication number
WO2009124028A3
WO2009124028A3 PCT/US2009/038922 US2009038922W WO2009124028A3 WO 2009124028 A3 WO2009124028 A3 WO 2009124028A3 US 2009038922 W US2009038922 W US 2009038922W WO 2009124028 A3 WO2009124028 A3 WO 2009124028A3
Authority
WO
WIPO (PCT)
Prior art keywords
pose
earth
image
human assistance
images
Prior art date
Application number
PCT/US2009/038922
Other languages
French (fr)
Other versions
WO2009124028A2 (en
Inventor
Michael Naimark
William Berne Carter
Paul E. Debevec
James Perry Hoberman
Andrew Jones
Bruce John Lamond
Erik Christopher Loyer
Giuseppe Mattiolo
Original Assignee
University Of Southern California
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University Of Southern California filed Critical University Of Southern California
Priority to EP09728822A priority Critical patent/EP2274711A4/en
Publication of WO2009124028A2 publication Critical patent/WO2009124028A2/en
Publication of WO2009124028A3 publication Critical patent/WO2009124028A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20092—Interactive image processing based on input by user

Abstract

The pose of a photographic image of a portion of Earth may be estimated using human assistance. A 3D graphics engine may render a virtual image of Earth from a controllable viewpoint based on 3D data that is representative of a 3D model of at least a portion of Earth. A user may locate and display a corresponding virtual image of Earth at a viewpoint that approximately corresponds to the pose of the photographic image by manipulating user controls. The photographic image and the corresponding virtual image may be overlaid on one another so that both images can be seen at the same time. The user may adjust the pose of one of the images while overlaid on the other image by manipulating user controls so that both images appear to substantially align with one another. The settings of the user controls may be converted to pose data that is representative of the pose of the photographic image within the 3D model.
PCT/US2009/038922 2008-03-31 2009-03-31 Estimating pose of photographic images in 3d earth model using human assistance WO2009124028A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP09728822A EP2274711A4 (en) 2008-03-31 2009-03-31 Estimating pose of photographic images in 3d earth model using human assistance

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US4111408P 2008-03-31 2008-03-31
US61/041,114 2008-03-31

Publications (2)

Publication Number Publication Date
WO2009124028A2 WO2009124028A2 (en) 2009-10-08
WO2009124028A3 true WO2009124028A3 (en) 2009-12-30

Family

ID=41117342

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2009/038922 WO2009124028A2 (en) 2008-03-31 2009-03-31 Estimating pose of photographic images in 3d earth model using human assistance

Country Status (3)

Country Link
US (1) US20090245691A1 (en)
EP (1) EP2274711A4 (en)
WO (1) WO2009124028A2 (en)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008002630A2 (en) 2006-06-26 2008-01-03 University Of Southern California Seamless image integration into 3d models
US9123159B2 (en) * 2007-11-30 2015-09-01 Microsoft Technology Licensing, Llc Interactive geo-positioning of imagery
IL190539A (en) * 2008-03-31 2015-01-29 Rafael Advanced Defense Sys Methods for transferring points of interest between images with non-parallel viewing directions
WO2009128181A1 (en) * 2008-04-18 2009-10-22 株式会社ソニー・コンピュータエンタテインメント Image display device, method for controlling image display device, and information storage medium
US20100156906A1 (en) * 2008-12-19 2010-06-24 David Montgomery Shot generation from previsualization of a physical environment
US20140192159A1 (en) * 2011-06-14 2014-07-10 Metrologic Instruments, Inc. Camera registration and video integration in 3d geometry model
US8884950B1 (en) * 2011-07-29 2014-11-11 Google Inc. Pose data via user interaction
US9569066B2 (en) * 2011-10-03 2017-02-14 Google Inc. Interface for navigating imagery
US20150153172A1 (en) * 2011-10-31 2015-06-04 Google Inc. Photography Pose Generation and Floorplan Creation
FR2984571B1 (en) * 2011-12-16 2014-01-10 Commissariat Energie Atomique METHOD OF ADJUSTING A PROJECTION SYSTEM OF AN IMAGE ON A PROJECTION SURFACE IN RELIEF
US9881419B1 (en) 2012-02-02 2018-01-30 Bentley Systems, Incorporated Technique for providing an initial pose for a 3-D model
US8869058B1 (en) * 2012-05-25 2014-10-21 Google Inc. Interface elements for specifying pose information for photographs in an online map system
US9256983B2 (en) * 2012-06-28 2016-02-09 Here Global B.V. On demand image overlay
US9256961B2 (en) 2012-06-28 2016-02-09 Here Global B.V. Alternate viewpoint image enhancement
CN103258350A (en) * 2013-03-28 2013-08-21 广东欧珀移动通信有限公司 Method and device for displaying 3D images
US9691175B2 (en) * 2013-04-30 2017-06-27 Bentley Systems, Incorporated 3-D models as a navigable container for 2-D raster images
GB2518673A (en) * 2013-09-30 2015-04-01 Ortery Technologies Inc A method using 3D geometry data for virtual reality presentation and control in 3D space
JP5872594B2 (en) * 2014-01-08 2016-03-01 株式会社東芝 Satellite communication system and antenna adjustment method
US9772281B2 (en) 2014-10-25 2017-09-26 Isle Management Co. Air quality analyzing apparatus
CN104537608A (en) * 2014-12-31 2015-04-22 深圳市中兴移动通信有限公司 Image processing method and device
CN109196558A (en) 2015-09-02 2019-01-11 拇指罗尔有限责任公司 For be directed at image and show a series of alignments image camera system and method
JP6413035B1 (en) * 2018-01-18 2018-10-24 株式会社ほぼ日 Program, information processing apparatus and information processing method
JP7010778B2 (en) * 2018-06-29 2022-01-26 国立大学法人東海国立大学機構 Observation position estimation device, its estimation method, and program
US11100721B1 (en) 2020-11-02 2021-08-24 Bentley Systems, Incorporated Integrating 2D images into a display of a 3D reality mesh to recover lost context

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070110338A1 (en) * 2005-11-17 2007-05-17 Microsoft Corporation Navigating images using image based geometric alignment and object based controls
US20070271235A1 (en) * 2000-02-22 2007-11-22 Metacarta, Inc. Geotext Searching and Displaying Results

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0863326A (en) * 1994-08-22 1996-03-08 Hitachi Ltd Image processing device/method
US5982378A (en) * 1996-08-02 1999-11-09 Spatial Technology Inc. System and method for modeling a three dimensional object
US20050262437A1 (en) * 1999-04-24 2005-11-24 Patterson Dennis M Process for creating and printing customized document at end user computer and printer
EP1297691A2 (en) * 2000-03-07 2003-04-02 Sarnoff Corporation Camera pose estimation
US7728848B2 (en) * 2000-03-28 2010-06-01 DG FastChannel, Inc. Tools for 3D mesh and texture manipulation
US6778171B1 (en) * 2000-04-05 2004-08-17 Eagle New Media Investments, Llc Real world/virtual world correlation system using 3D graphics pipeline
AU2001280040A1 (en) * 2000-07-31 2002-02-13 Galil Medical Ltd. Planning and facilitation systems and methods for cryosurgery
JP3823724B2 (en) * 2000-12-14 2006-09-20 日本電気株式会社 Three-dimensional aerial sightseeing improvement server, method thereof, and recording medium
US20030025694A1 (en) * 2001-06-06 2003-02-06 Punch! Software, Llc Method of rendering bitmap images into three dimensions
JP2003006680A (en) * 2001-06-20 2003-01-10 Zenrin Co Ltd Method for generating three-dimensional electronic map data
JP4065507B2 (en) * 2002-07-31 2008-03-26 キヤノン株式会社 Information presentation apparatus and information processing method
US20040044958A1 (en) * 2002-08-27 2004-03-04 Wolf John P. Systems and methods for inserting a metadata tag in a document
US20040075697A1 (en) * 2002-10-16 2004-04-22 Maudlin Matthew Eric Apparatus, system, method, and program for using GIS data
US7133054B2 (en) * 2004-03-17 2006-11-07 Seadragon Software, Inc. Methods and apparatus for navigating an image
GB0305315D0 (en) * 2003-03-07 2003-04-09 Weber Martin Image processing system
US20050017982A1 (en) * 2003-07-23 2005-01-27 Kane Francis James Dynamic imposter generation with MIP map anti-aliasing
IL158810A0 (en) * 2003-11-10 2004-05-12 Rafael Armament Dev Authority Identifying a target region of a three-dimensional object from a two-dimensional image
GB0328420D0 (en) * 2003-12-08 2004-01-14 Pty Ltd Modelling system
JP2005311844A (en) * 2004-04-23 2005-11-04 Canon Inc Imaging apparatus
US7432936B2 (en) * 2004-12-02 2008-10-07 Avid Technology, Inc. Texture data anti-aliasing method and apparatus
US7706603B2 (en) * 2005-04-19 2010-04-27 Siemens Corporation Fast object detection for augmented reality systems
US20060241859A1 (en) * 2005-04-21 2006-10-26 Microsoft Corporation Virtual earth real-time advertising
US8284254B2 (en) * 2005-08-11 2012-10-09 Sightlogix, Inc. Methods and apparatus for a wide area coordinated surveillance system
US7787011B2 (en) * 2005-09-07 2010-08-31 Fuji Xerox Co., Ltd. System and method for analyzing and monitoring 3-D video streams from multiple cameras
US7725451B2 (en) * 2006-01-23 2010-05-25 Microsoft Corporation Generating clusters of images for search results
US7616217B2 (en) * 2006-04-26 2009-11-10 Google Inc. Dynamic exploration of electronic maps
WO2008002630A2 (en) * 2006-06-26 2008-01-03 University Of Southern California Seamless image integration into 3d models
US7712052B2 (en) * 2006-07-31 2010-05-04 Microsoft Corporation Applications of three-dimensional environments constructed from images

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070271235A1 (en) * 2000-02-22 2007-11-22 Metacarta, Inc. Geotext Searching and Displaying Results
US20070110338A1 (en) * 2005-11-17 2007-05-17 Microsoft Corporation Navigating images using image based geometric alignment and object based controls

Also Published As

Publication number Publication date
EP2274711A4 (en) 2012-12-19
EP2274711A2 (en) 2011-01-19
US20090245691A1 (en) 2009-10-01
WO2009124028A2 (en) 2009-10-08

Similar Documents

Publication Publication Date Title
WO2009124028A3 (en) Estimating pose of photographic images in 3d earth model using human assistance
USD966321S1 (en) Display screen or portion thereof with animated graphical user interface
USD835650S1 (en) Display screen or portion thereof with animated graphical user interface for a baccarat game
USD945469S1 (en) Display screen or portion thereof with animated graphical user interface
USD870768S1 (en) Display screen or portion thereof with animated graphical user interface
USD945478S1 (en) Display screen or portion thereof with animated graphical user interface
USD877761S1 (en) Display screen with animated graphical user interface for a baccarat game
USD807388S1 (en) Display screen or portion thereof with animated graphical user interface
USD846561S1 (en) Display screen or portion thereof with animated graphical user interface
USD779533S1 (en) Display screen or portion thereof with animated graphical user interface
USD797792S1 (en) Display screen or portion thereof with an animated graphical user interface of a programmed computer system
USD774535S1 (en) Electronic copying machine display screen with transitional graphical user interface
USD663315S1 (en) Display screen with graphical user interface
USD708632S1 (en) Display screen or portion thereof with animated graphical user interface
USD697525S1 (en) Display panel or screen with animated graphic user interface
USD784364S1 (en) Display screen or portion thereof with animated graphical user interface
USD706821S1 (en) Portable electronic device displaying an animated graphical user interface
USD709086S1 (en) Display screen or portion thereof with animated graphical user interface
USD765665S1 (en) Display panel or screen with a graphical user interface
USD692019S1 (en) Display screen or portion thereof with animated graphical user interface
USD746855S1 (en) Electronic device display with an animated graphical user interface
WO2010048160A3 (en) Environment property estimation and graphical display
USD685817S1 (en) Display panel or screen with animated graphical user interface
USD701503S1 (en) Portable display device with animated graphical user interface
USD705808S1 (en) Display screen or portion thereof with animated graphical user interface

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09728822

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2009728822

Country of ref document: EP