CA2816801C - Image viewing application and method for orientationally sensitive display devices - Google Patents

Image viewing application and method for orientationally sensitive display devices Download PDF

Info

Publication number
CA2816801C
CA2816801C CA2816801A CA2816801A CA2816801C CA 2816801 C CA2816801 C CA 2816801C CA 2816801 A CA2816801 A CA 2816801A CA 2816801 A CA2816801 A CA 2816801A CA 2816801 C CA2816801 C CA 2816801C
Authority
CA
Canada
Prior art keywords
orientation
location
image
relative
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CA2816801A
Other languages
English (en)
French (fr)
Other versions
CA2816801A1 (en
Inventor
Dorian Averbuch
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Covidien LP
Original Assignee
Covidien LP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Covidien LP filed Critical Covidien LP
Publication of CA2816801A1 publication Critical patent/CA2816801A1/en
Application granted granted Critical
Publication of CA2816801C publication Critical patent/CA2816801C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/08—Volume rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/10—Geometric effects
    • G06T15/20—Perspective computation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/50—Lighting effects
    • G06T15/506—Illumination models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
    • A61B2034/107—Visualisation of planned trajectories or target regions
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2048—Tracking techniques using an accelerometer or inertia sensor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2051—Electromagnetic tracking systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2055—Optical tracking systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/25—User interfaces for surgical systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2215/00—Indexing scheme for image rendering
    • G06T2215/12—Shadow map, environment map
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2215/00—Indexing scheme for image rendering
    • G06T2215/16—Using real world measurements to influence rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Surgery (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computing Systems (AREA)
  • Geometry (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Robotics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Position Input By Displaying (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
CA2816801A 2010-11-02 2011-03-14 Image viewing application and method for orientationally sensitive display devices Expired - Fee Related CA2816801C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US40949510P 2010-11-02 2010-11-02
US61/409,495 2010-11-02
PCT/US2011/028412 WO2012060897A1 (en) 2010-11-02 2011-03-14 Image viewing application and method for orientationally sensitive display devices

Publications (2)

Publication Number Publication Date
CA2816801A1 CA2816801A1 (en) 2012-05-10
CA2816801C true CA2816801C (en) 2016-08-09

Family

ID=45996181

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2816801A Expired - Fee Related CA2816801C (en) 2010-11-02 2011-03-14 Image viewing application and method for orientationally sensitive display devices

Country Status (7)

Country Link
US (2) US9111386B2 (enExample)
EP (1) EP2635182B1 (enExample)
JP (2) JP5908919B2 (enExample)
CN (1) CN103491867B (enExample)
AU (1) AU2011324017A1 (enExample)
CA (1) CA2816801C (enExample)
WO (1) WO2012060897A1 (enExample)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012060897A1 (en) 2010-11-02 2012-05-10 Superdimension, Ltd. Image viewing application and method for orientationally sensitive display devices
US9639666B2 (en) 2013-03-15 2017-05-02 Covidien Lp Pathway planning system and method
EP3474125A1 (en) * 2017-10-23 2019-04-24 Koninklijke Philips N.V. Medical image visualization
CN108211342A (zh) * 2018-01-19 2018-06-29 腾讯科技（深圳）有限公司 视角调整方法和装置、存储介质及电子装置
US11150776B2 (en) 2018-02-02 2021-10-19 Centerline Biomedical, Inc. Graphical user interface for marking anatomic structures

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4442533A (en) * 1981-08-20 1984-04-10 Charles Lescrenier Image plane indicator
JPH05266145A (ja) * 1992-03-16 1993-10-15 Daikin Ind Ltd 画像表示装置および表示方法
US5524188A (en) 1993-03-01 1996-06-04 Halpern Software, Inc. Viewing three dimensional objects by rotational wobble about multiple axes
JPH09204162A (ja) 1996-01-29 1997-08-05 Fujitsu Ltd 表示装置
JP3558104B2 (ja) * 1996-08-05 2004-08-25 ソニー株式会社 ３次元仮想物体表示装置および方法
JP3653196B2 (ja) 1998-06-30 2005-05-25 飛島建設株式会社 仮想現実感を利用した施工支援情報システム。
US7386339B2 (en) 1999-05-18 2008-06-10 Mediguide Ltd. Medical imaging and navigation system
JP2001005522A (ja) 1999-06-23 2001-01-12 Toshiba Corp データ表示装置
JP2001338037A (ja) * 2000-05-29 2001-12-07 Wall:Kk 三次元コンピュータグラフィック画像生成用サーバ
JP2002230588A (ja) * 2001-02-02 2002-08-16 Sony Corp グラフィックス装置及び教育機器
US6798429B2 (en) 2001-03-29 2004-09-28 Intel Corporation Intuitive mobile device interface to virtual spaces
US6987512B2 (en) * 2001-03-29 2006-01-17 Microsoft Corporation 3D navigation techniques
EP1395194B1 (en) 2001-06-13 2007-08-29 Volume Interactions Pte. Ltd. A guide system
US6709397B2 (en) * 2001-10-16 2004-03-23 Envisioneering, L.L.C. Scanning probe
EP1565796A2 (en) * 2002-05-24 2005-08-24 Dynapix Intelligence Imaging Inc. A method and apparatus for 3d image documentation and navigation
US7184025B2 (en) * 2002-05-31 2007-02-27 Microsoft Corporation Altering a display on a viewing device based upon a user controlled orientation of the viewing device
EP1531322A3 (en) * 2003-11-13 2007-09-05 Matsushita Electric Industrial Co., Ltd. Map display apparatus
JP4630672B2 (ja) 2004-01-23 2011-02-09 キヤノン株式会社 アクセス制御装置及びアクセス制御方法及びアクセス制御プログラム
US20080269596A1 (en) * 2004-03-10 2008-10-30 Ian Revie Orthpaedic Monitoring Systems, Methods, Implants and Instruments
US20060173268A1 (en) * 2005-01-28 2006-08-03 General Electric Company Methods and systems for controlling acquisition of images
DE102006001884A1 (de) * 2006-01-13 2007-07-19 Siemens Ag Verfahren zur bildlichen Unterstützung einer Führung eines in einen Hohlraum eines Untersuchungsobjekts mindestens teilweise eingeführten medizinischen Instruments
GB0605817D0 (en) * 2006-03-23 2006-05-03 Imp Innovations Ltd Reconstruction of anterior cruciate ligaments
WO2007115826A2 (en) * 2006-04-12 2007-10-18 Nassir Navab Virtual penetrating mirror device for visualizing of virtual objects within an augmented reality environment
US8672836B2 (en) * 2007-01-31 2014-03-18 The Penn State Research Foundation Method and apparatus for continuous guidance of endoscopy
US20090221908A1 (en) * 2008-03-01 2009-09-03 Neil David Glossop System and Method for Alignment of Instrumentation in Image-Guided Intervention
US8218846B2 (en) * 2008-05-15 2012-07-10 Superdimension, Ltd. Automatic pathway and waypoint generation and navigation method
US8858436B2 (en) * 2008-11-12 2014-10-14 Sonosite, Inc. Systems and methods to identify interventional instruments
US8745536B1 (en) * 2008-11-25 2014-06-03 Perceptive Pixel Inc. Volumetric data exploration using multi-point input controls
US8441441B2 (en) 2009-01-06 2013-05-14 Qualcomm Incorporated User interface for mobile devices
JP5266145B2 (ja) 2009-06-09 2013-08-21 株式会社ケーヒン エンジンの吸気制御装置
US8937592B2 (en) * 2010-05-20 2015-01-20 Samsung Electronics Co., Ltd. Rendition of 3D content on a handheld device
WO2012060897A1 (en) 2010-11-02 2012-05-10 Superdimension, Ltd. Image viewing application and method for orientationally sensitive display devices

Also Published As

Publication number Publication date
US9595131B2 (en) 2017-03-14
JP2016157450A (ja) 2016-09-01
JP6250086B2 (ja) 2017-12-20
US20120105436A1 (en) 2012-05-03
CN103491867B (zh) 2016-01-20
WO2012060897A1 (en) 2012-05-10
CA2816801A1 (en) 2012-05-10
EP2635182B1 (en) 2020-12-02
EP2635182A4 (en) 2017-05-03
CN105326567A (zh) 2016-02-17
US9111386B2 (en) 2015-08-18
JP5908919B2 (ja) 2016-04-26
CN103491867A (zh) 2014-01-01
US20150228116A1 (en) 2015-08-13
AU2011324017A1 (en) 2013-05-30
JP2014501000A (ja) 2014-01-16
EP2635182A1 (en) 2013-09-11

Similar Documents

Publication Publication Date Title
US9595131B2 (en) Image viewing application and method for orientationally sensitive display devices
CA3048999C (en) Virtual operating room layout planning and analysis tool
US10629002B2 (en) Measurements and calibration utilizing colorimetric sensors
CN109643014A (zh) 头戴式显示器追踪
CN105708485A (zh) 用于在成像模态中定位患者的成像布置和方法
FR2908628A1 (fr) Procede et systeme de pilotage d'un instrument medical
CN111339588B (zh) 一种二维图纸与三维模型检查方法、系统及存储介质
CN109840950A (zh) 真实尺寸3d模型聚集
CN105105846B (zh) 一种用来精确引导对一病患进行外科手术的系统
US20200265621A1 (en) System and method of scanning two dimensional floorplans using multiple scanners concurrently
CN108957504A (zh) 室内外连续定位的方法和系统
Schall Mobile augmented reality for human scale interaction with geospatial models: The benefit for industrial applications
US10950054B2 (en) Seamless bridging AR-device and AR-system
CN114366330A (zh) 一种混合现实系统及基于混合现实的标识物配准方法
Murari et al. Cross-Platform immersive visualization and navigation with augmented reality
ES2760906T3 (es) Procedimiento de visualización de al menos una ventana de una escena tridimensional, producto de programa informático y sistema de visualización asociados
US10185787B1 (en) Tool for accurate onsite model visualization that facilitates environment interaction
CN112964255A (zh) 一种标记场景用来定位的方法和装置
CN105326567B (zh) 用于取向灵敏的显示装置的像观察应用和方法
Low et al. Interactive virtual indoor navigation system using visual recognition and pedestrian dead reckoning techniques
WO2022129646A1 (en) Virtual reality environment
Bonanni et al. Handsaw: tangible exploration of volumetric data by direct cut-plane projection
EP4600784A1 (en) Registering coordinate frames for mixed reality
ES2983175T3 (es) Orientación y guía hacia bienes, dispositivos y sensores en edificios
JP6482307B2 (ja) 情報処理装置およびその方法

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20151016

MKLA Lapsed

Effective date: 20210315