WO2010057304A1 - Système de pointage mains libres - Google Patents

Système de pointage mains libres Download PDF

Info

Publication number
WO2010057304A1
WO2010057304A1 PCT/CA2009/001667 CA2009001667W WO2010057304A1 WO 2010057304 A1 WO2010057304 A1 WO 2010057304A1 CA 2009001667 W CA2009001667 W CA 2009001667W WO 2010057304 A1 WO2010057304 A1 WO 2010057304A1
Authority
WO
WIPO (PCT)
Prior art keywords
tracking
movement
target
motion detection
operator
Prior art date
Application number
PCT/CA2009/001667
Other languages
English (en)
Other versions
WO2010057304A8 (fr
Inventor
Christopher M. Schlachta
Rajnikant V. Patel
Ana Luisa Trejos
Michael David Naish
Original Assignee
London Health Sciences Centre Research Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by London Health Sciences Centre Research Inc. filed Critical London Health Sciences Centre Research Inc.
Priority to US13/141,065 priority Critical patent/US9798381B2/en
Priority to CA2747814A priority patent/CA2747814C/fr
Priority to EP09827084.6A priority patent/EP2368168B1/fr
Priority to CN200980154807.8A priority patent/CN102282527B/zh
Publication of WO2010057304A1 publication Critical patent/WO2010057304A1/fr
Publication of WO2010057304A8 publication Critical patent/WO2010057304A8/fr
Priority to US15/699,922 priority patent/US20180067548A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00039—Operational features of endoscopes provided with input arrangements for the user
    • A61B1/0004—Operational features of endoscopes provided with input arrangements for the user for electronic operation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Surgery (AREA)
  • Pathology (AREA)
  • Public Health (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Veterinary Medicine (AREA)
  • Radiology & Medical Imaging (AREA)
  • Optics & Photonics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biophysics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)

Abstract

L’invention concerne un système mains libres de commande du mouvement d’un curseur sur un ou plusieurs dispositifs d’affichage. Un dispositif de poursuite comportant un repère dont on peut suivre la trace, et un ou plusieurs accéléromètres et gyroscopes sont utilisés pour suivre la position et l’accélération du repère par rapport à une cible d’intérêt. Un moyen de traitement traite les signaux de mouvement issus du dispositif de poursuite pour établir l’emplacement du curseur sur le moniteur de l’opérateur, le curseur pouvant également être affiché sur plusieurs moniteurs. Le dispositif de poursuite est porté par l’opérateur, idéalement sur la tête de l’opérateur. Les mouvements de tête de l’opérateur conditionnent le mouvement du curseur.
PCT/CA2009/001667 2008-11-21 2009-11-20 Système de pointage mains libres WO2010057304A1 (fr)

Priority Applications (5)

Application Number Priority Date Filing Date Title
US13/141,065 US9798381B2 (en) 2008-11-21 2009-11-20 Hands-free pointer system
CA2747814A CA2747814C (fr) 2008-11-21 2009-11-20 Systeme de pointage mains libres
EP09827084.6A EP2368168B1 (fr) 2008-11-21 2009-11-20 Système de pointage à mains libres
CN200980154807.8A CN102282527B (zh) 2008-11-21 2009-11-20 无手动指示器系统
US15/699,922 US20180067548A1 (en) 2008-11-21 2017-09-08 Hands-free pointer system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11667508P 2008-11-21 2008-11-21
US61/116,675 2008-11-21

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US13/141,065 A-371-Of-International US9798381B2 (en) 2008-11-21 2009-11-20 Hands-free pointer system
US15/699,922 Continuation US20180067548A1 (en) 2008-11-21 2017-09-08 Hands-free pointer system

Publications (2)

Publication Number Publication Date
WO2010057304A1 true WO2010057304A1 (fr) 2010-05-27
WO2010057304A8 WO2010057304A8 (fr) 2011-08-04

Family

ID=42197785

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2009/001667 WO2010057304A1 (fr) 2008-11-21 2009-11-20 Système de pointage mains libres

Country Status (5)

Country Link
US (2) US9798381B2 (fr)
EP (1) EP2368168B1 (fr)
CN (1) CN102282527B (fr)
CA (1) CA2747814C (fr)
WO (1) WO2010057304A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103443746A (zh) * 2010-12-22 2013-12-11 Z空间股份有限公司 用户控制装置的在空间中的三维跟踪
US8643951B1 (en) 2012-03-15 2014-02-04 Google Inc. Graphical menu and interaction therewith through a viewing window
US9035878B1 (en) 2012-02-29 2015-05-19 Google Inc. Input system
WO2015084227A1 (fr) * 2013-12-06 2015-06-11 Telefonaktiebolaget L M Ericsson (Publ) Affichage monté sur la tête optique, module de portail de télévision et procédés permettant de commander une interface utilisateur graphique
WO2023247306A1 (fr) * 2022-06-20 2023-12-28 International Business Machines Corporation Positionnement contextuel dans un espace virtuel

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2023812B1 (fr) 2006-05-19 2016-01-27 The Queen's Medical Center Système de suivi de mouvement pour imagerie adaptative en temps réel et spectroscopie
US9606209B2 (en) 2011-08-26 2017-03-28 Kineticor, Inc. Methods, systems, and devices for intra-scan motion correction
CN103207734B (zh) * 2012-01-11 2018-03-20 深圳富泰宏精密工业有限公司 电子装置解锁系统及方法
CN103699209A (zh) * 2012-09-27 2014-04-02 联想(北京)有限公司 一种输入设备
US10327708B2 (en) 2013-01-24 2019-06-25 Kineticor, Inc. Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan
US9305365B2 (en) 2013-01-24 2016-04-05 Kineticor, Inc. Systems, devices, and methods for tracking moving targets
US9717461B2 (en) 2013-01-24 2017-08-01 Kineticor, Inc. Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan
WO2014120734A1 (fr) 2013-02-01 2014-08-07 Kineticor, Inc. Système de poursuite de mouvement pour la compensation de mouvement adaptatif en temps réel en imagerie biomédicale
CN103543843A (zh) * 2013-10-09 2014-01-29 中国科学院深圳先进技术研究院 基于加速度传感器的人机接口设备及人机交互方法
US9083860B2 (en) 2013-10-09 2015-07-14 Motorola Solutions, Inc. Method of and apparatus for automatically controlling operation of a user-mounted recording device based on user motion and event context
US10004462B2 (en) 2014-03-24 2018-06-26 Kineticor, Inc. Systems, methods, and devices for removing prospective motion correction from medical imaging scans
JP6291355B2 (ja) * 2014-05-30 2018-03-14 Hoya株式会社 電子内視鏡システム及びこれに用いる頭部ジェスチャ検出型遠隔操作装置
WO2016014718A1 (fr) 2014-07-23 2016-01-28 Kineticor, Inc. Systèmes, dispositifs et procédés de suivi et de compensation de mouvement de patient pendant une imagerie médicale par balayage
US9846522B2 (en) 2014-07-23 2017-12-19 Microsoft Technology Licensing, Llc Alignable user interface
US9943247B2 (en) 2015-07-28 2018-04-17 The University Of Hawai'i Systems, devices, and methods for detecting false movements for motion correction during a medical imaging scan
WO2017091479A1 (fr) 2015-11-23 2017-06-01 Kineticor, Inc. Systèmes, dispositifs, et procédés de surveillance et de compensation d'un mouvement d'un patient durant un balayage d'imagerie médicale
US10429935B2 (en) 2016-02-08 2019-10-01 Comcast Cable Communications, Llc Tremor correction for gesture recognition
CN105807915A (zh) * 2016-02-24 2016-07-27 北京小鸟看看科技有限公司 虚拟鼠标的控制方法、控制装置以及头戴显示设备
JP2017163180A (ja) * 2016-03-07 2017-09-14 富士通株式会社 ずれ判定プログラム、ずれ判定方法、及び、情報処理装置
US20170374333A1 (en) * 2016-06-27 2017-12-28 Wieden + Kennedy, Inc. Real-time motion capture and projection system
US9992487B1 (en) * 2016-08-10 2018-06-05 Integrity Applications Incorporated Stereoscopic viewer
CN107506041A (zh) * 2017-09-11 2017-12-22 武汉大学 一种基于运动传感器的可穿戴式鼠标控制方法
US10814491B2 (en) 2017-10-06 2020-10-27 Synaptive Medical (Barbados) Inc. Wireless hands-free pointer system
KR101862359B1 (ko) * 2017-12-28 2018-06-29 (주)휴톰 수술 시뮬레이션 정보 생성방법 및 프로그램
CN108182695B (zh) * 2017-12-29 2021-10-29 纳恩博（北京）科技有限公司 目标跟踪模型训练方法及装置、电子设备和存储介质
JP7325173B2 (ja) * 2018-10-06 2023-08-14 シスメックス株式会社 手術支援ロボットの遠隔支援方法、および遠隔支援システム
US11265487B2 (en) * 2019-06-05 2022-03-01 Mediatek Inc. Camera view synthesis on head-mounted display for virtual reality and augmented reality

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000047103A2 (fr) * 1999-02-10 2000-08-17 Surgical Insights, Inc. Dispositif de centrage informatise pour chirurgie orthopedique
WO2003096255A2 (fr) * 2002-05-06 2003-11-20 The Johns Hopkins University Systeme de simulation pour procedures medicales
WO2007059477A2 (fr) * 2005-11-11 2007-05-24 The Uab Research Foundation Simulateur de patient virtuel
US20080183190A1 (en) * 2007-01-25 2008-07-31 Warsaw Orthopedic, Inc. Integrated surgical navigational and neuromonitoring system having automated surgical assistance and control

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6714841B1 (en) * 1995-09-15 2004-03-30 Computer Motion, Inc. Head cursor control interface for an automated endoscope system for optimal positioning
US6252579B1 (en) * 1997-08-23 2001-06-26 Immersion Corporation Interface device and method for providing enhanced cursor control with force feedback
US6215471B1 (en) * 1998-04-28 2001-04-10 Deluca Michael Joseph Vision pointer method and apparatus
WO2001056007A1 (fr) * 2000-01-28 2001-08-02 Intersense, Inc. Poursuite a auto-reference
US6753847B2 (en) * 2002-01-25 2004-06-22 Silicon Graphics, Inc. Three dimensional volumetric display input and output configurations
US6982697B2 (en) * 2002-02-07 2006-01-03 Microsoft Corporation System and process for selecting objects in a ubiquitous computing environment
US7113169B2 (en) * 2002-03-18 2006-09-26 The United States Of America As Represented By The Secretary Of The Air Force Apparatus and method for a multiple-user interface to interactive information displays
DE10333543A1 (de) * 2003-07-23 2005-02-24 Siemens Ag Verfahren zur gekoppelten Darstellung intraoperativer sowie interaktiv und iteraktiv re-registrierter präoperativer Bilder in der medizinischen Bildgebung
US7613478B2 (en) * 2004-03-15 2009-11-03 General Electric Company Method and system for portability of clinical images using a high-quality display and portable device
ATE495522T1 (de) * 2006-04-27 2011-01-15 Mobiter Dicta Oy Verfahren, system und einrichtung zur umsetzung von sprache
JP2008102572A (ja) * 2006-10-17 2008-05-01 Sanyo Electric Co Ltd 入力表示装置、表示制御方法および制御プログラム
US20080211768A1 (en) * 2006-12-07 2008-09-04 Randy Breen Inertial Sensor Input Device
US8726194B2 (en) * 2007-07-27 2014-05-13 Qualcomm Incorporated Item selection using enhanced control
TWI334559B (en) * 2007-08-28 2010-12-11 Ind Tech Res Inst Interactive pointing device
US9265589B2 (en) * 2007-11-06 2016-02-23 Medtronic Navigation, Inc. System and method for navigated drill guide
US8432372B2 (en) * 2007-11-30 2013-04-30 Microsoft Corporation User input using proximity sensing
US20090292178A1 (en) * 2008-05-21 2009-11-26 Qualcomm Incorporated System and method of monitoring users during an interactive activity
US20100013812A1 (en) * 2008-07-18 2010-01-21 Wei Gu Systems for Controlling Computers and Devices
US8237601B2 (en) * 2008-10-14 2012-08-07 Sonosite, Inc. Remote control device
US8050891B2 (en) * 2008-10-17 2011-11-01 Zeemote Technology Inc. Sensor mapping

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2000047103A2 (fr) * 1999-02-10 2000-08-17 Surgical Insights, Inc. Dispositif de centrage informatise pour chirurgie orthopedique
WO2003096255A2 (fr) * 2002-05-06 2003-11-20 The Johns Hopkins University Systeme de simulation pour procedures medicales
WO2007059477A2 (fr) * 2005-11-11 2007-05-24 The Uab Research Foundation Simulateur de patient virtuel
US20080183190A1 (en) * 2007-01-25 2008-07-31 Warsaw Orthopedic, Inc. Integrated surgical navigational and neuromonitoring system having automated surgical assistance and control

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2368168A4 *

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103443746A (zh) * 2010-12-22 2013-12-11 Z空间股份有限公司 用户控制装置的在空间中的三维跟踪
CN106774880A (zh) * 2010-12-22 2017-05-31 Z空间股份有限公司 用户控制装置的在空间中的三维跟踪
CN106774880B (zh) * 2010-12-22 2020-02-21 Z空间股份有限公司 用户控制装置的在空间中的三维跟踪
US9035878B1 (en) 2012-02-29 2015-05-19 Google Inc. Input system
US8643951B1 (en) 2012-03-15 2014-02-04 Google Inc. Graphical menu and interaction therewith through a viewing window
WO2015084227A1 (fr) * 2013-12-06 2015-06-11 Telefonaktiebolaget L M Ericsson (Publ) Affichage monté sur la tête optique, module de portail de télévision et procédés permettant de commander une interface utilisateur graphique
CN105899996A (zh) * 2013-12-06 2016-08-24 瑞典爱立信有限公司 光学头戴式显示器、电视入口模块和用于控制图形用户界面的方法
EP3077867A4 (fr) * 2013-12-06 2016-12-21 ERICSSON TELEFON AB L M (publ) Affichage monté sur la tête optique, module de portail de télévision et procédés permettant de commander une interface utilisateur graphique
US10338776B2 (en) 2013-12-06 2019-07-02 Telefonaktiebolaget Lm Ericsson (Publ) Optical head mounted display, television portal module and methods for controlling graphical user interface
WO2023247306A1 (fr) * 2022-06-20 2023-12-28 International Business Machines Corporation Positionnement contextuel dans un espace virtuel

Also Published As

Publication number Publication date
CA2747814C (fr) 2021-08-31
CA2747814A1 (fr) 2010-05-27
EP2368168A1 (fr) 2011-09-28
US20120032882A1 (en) 2012-02-09
US9798381B2 (en) 2017-10-24
CN102282527B (zh) 2014-07-02
WO2010057304A8 (fr) 2011-08-04
EP2368168A4 (fr) 2014-10-15
CN102282527A (zh) 2011-12-14
EP2368168B1 (fr) 2018-07-11
US20180067548A1 (en) 2018-03-08

Similar Documents

Publication Publication Date Title
US20180067548A1 (en) Hands-free pointer system
JP6751456B2 (ja) ロボット外科手術システムで使用するための拡張現実ナビゲーションシステムおよびその使用方法
US11734901B2 (en) Surgeon head-mounted display apparatuses
JP7112471B2 (ja) ナビゲートされるロボット外科手術のための変動する不透明性を有する拡張現実ヘッドセット
US11883117B2 (en) Pose measurement chaining for extended reality surgical navigation in visible and near infrared spectrums
US20220304755A1 (en) Extended reality visualization of optical tool tracking volume for computer assisted navigation in surgery
US11510750B2 (en) Leveraging two-dimensional digital imaging and communication in medicine imagery in three-dimensional extended reality applications
CN110647237A (zh) 在人工现实环境中基于手势的内容共享
US20210169581A1 (en) Extended reality instrument interaction zone for navigated robotic surgery
US11317973B2 (en) Camera tracking bar for computer assisted navigation during surgery
Bigdelou et al. An adaptive solution for intra-operative gesture-based human-machine interaction
IL303037A (en) A system and method of communication through visual feedback
US11382713B2 (en) Navigated surgical system with eye to XR headset display calibration
JP2021528786A (ja) 視線に基づく拡張現実環境のためのインターフェース
US20210169605A1 (en) Augmented reality headset for navigated robotic surgery
EP3903714B1 (fr) Enregistrement d'un outil chirurgical avec un réseau de référence suivi par les caméras d'un casque de réalité étendue pour la navigation assistée pendant une intervention chirurgicale
EP3922203A1 (fr) Suivi d'objets chirurgicaux en lumière visible via l'amorçage de repérage de cadre et l'enregistrement d'images synthétiques
JP2018107603A (ja) センサ情報取得装置、センサ情報取得方法、センサ情報取得プログラム及び医療器具
Ward et al. The WhaSP: a wireless hands-free surgical pointer for minimally invasive surgery
Bianchi Exploration of augmented reality technology for surgical training simulators
Ward et al. Development of a hands-free pointer for instruction during minimally invasive surgery
Dawson Design and Evaluation of A Contact-free Interface for Minimally Invasive Robotics Assisted Surgery
WO2023244267A1 (fr) Systèmes et procédés d'analyse de démarche humaine, de rétroaction et de rééducation en temps réel à l'aide d'un dispositif de réalité étendue
Xu et al. ARTEMIS-FlexTrack: Immersive Surgical Telementoring with Flexible Tool Tracking

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200980154807.8

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09827084

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2747814

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 2009827084

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 13141065

Country of ref document: US