CN106922190B - 用于执行医疗手术并且用于访问和/或操纵医学相关信息的方法和系统 - Google Patents

用于执行医疗手术并且用于访问和/或操纵医学相关信息的方法和系统 Download PDF

Info

Publication number
CN106922190B
CN106922190B CN201580052437.2A CN201580052437A CN106922190B CN 106922190 B CN106922190 B CN 106922190B CN 201580052437 A CN201580052437 A CN 201580052437A CN 106922190 B CN106922190 B CN 106922190B
Authority
CN
China
Prior art keywords
user interface
image
projection surface
physician
hand
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201580052437.2A
Other languages
English (en)
Chinese (zh)
Other versions
CN106922190A (zh
Inventor
尼马·兹拉克内贾德
贝伦格·霍马永
彼得·劳伦斯
戴维·明正·刘
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of British Columbia
Original Assignee
University of British Columbia
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of British Columbia filed Critical University of British Columbia
Publication of CN106922190A publication Critical patent/CN106922190A/zh
Application granted granted Critical
Publication of CN106922190B publication Critical patent/CN106922190B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61G—TRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
    • A61G13/00—Operating tables; Auxiliary appliances therefor
    • A61G13/10—Parts, details or accessories
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Medical Informatics (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • General Business, Economics & Management (AREA)
  • Business, Economics & Management (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Radiology & Medical Imaging (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Multimedia (AREA)
  • Gynecology & Obstetrics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Pathology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • User Interface Of Digital Computer (AREA)
  • Accommodation For Nursing Or Treatment Tables (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
CN201580052437.2A 2014-08-15 2015-08-13 用于执行医疗手术并且用于访问和/或操纵医学相关信息的方法和系统 Expired - Fee Related CN106922190B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201462038157P 2014-08-15 2014-08-15
US62/038,157 2014-08-15
PCT/CA2015/050764 WO2016023123A1 (en) 2014-08-15 2015-08-13 Methods and systems for performing medical procedures and for accessing and/or manipulating medically relevant information

Publications (2)

Publication Number Publication Date
CN106922190A CN106922190A (zh) 2017-07-04
CN106922190B true CN106922190B (zh) 2020-09-18

Family

ID=55303733

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580052437.2A Expired - Fee Related CN106922190B (zh) 2014-08-15 2015-08-13 用于执行医疗手术并且用于访问和/或操纵医学相关信息的方法和系统

Country Status (6)

Country Link
US (1) US10403402B2 (enExample)
EP (1) EP3180721A4 (enExample)
JP (1) JP2017533487A (enExample)
CN (1) CN106922190B (enExample)
CA (1) CA2993876C (enExample)
WO (1) WO2016023123A1 (enExample)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016195684A1 (en) * 2015-06-04 2016-12-08 Siemens Healthcare Gmbh Apparatus and methods for a projection display device on x-ray imaging devices
WO2017070121A1 (en) 2015-10-20 2017-04-27 Magic Leap, Inc. Selecting virtual objects in a three-dimensional space
US10078919B2 (en) 2016-03-31 2018-09-18 Magic Leap, Inc. Interactions with 3D virtual objects using poses and multiple-DOF controllers
JP6880075B2 (ja) * 2016-05-20 2021-06-02 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． ユーザインターフェースメニューのコンテキスト認識
CN113893032B (zh) 2016-07-14 2024-10-15 直观外科手术操作公司 用于远程操作医疗系统中的屏幕菜单的系统和方法
JPWO2018087977A1 (ja) * 2016-11-08 2019-09-26 ソニー株式会社 情報処理装置、情報処理方法、プログラム
US10331276B2 (en) * 2016-12-30 2019-06-25 Intel Corporation Projected interactive display surface interactivity determination
CA3052869A1 (en) 2017-02-17 2018-08-23 Nz Technologies Inc. Methods and systems for touchless control of surgical environment
JP7267209B2 (ja) 2017-06-08 2023-05-01 メドス・インターナショナル・エスエイアールエル 滅菌野及び他の作業環境のためのユーザインターフェースシステム
IT201700114495A1 (it) * 2017-10-11 2019-04-11 General Medical Merate S P A Sistema per il controllo di almeno un movimento di un componente motorizzato di un’apparecchiatura radiologica e apparecchiatura radiologica che lo utilizza
US10506224B2 (en) * 2017-11-07 2019-12-10 Oriental Institute Of Technology Holographic three dimensional imaging projecting medical apparatus
DE102017127791A1 (de) 2017-11-24 2019-05-29 Aesculap Ag Medizinisches Steuersystem und medizinischer Sterilraum mit Steuersystem
US20190215460A1 (en) * 2018-01-09 2019-07-11 Osram Sylvania Inc. User Interface for Control of Building System Components
EP3782531A4 (en) * 2018-04-19 2021-05-26 FUJIFILM Corporation ENDOSCOPE DEVICE, ENDOSCOPE OPERATING PROCESS AND PROGRAM
EP3773219B1 (en) * 2018-05-10 2025-09-03 Siemens Medical Solutions USA, Inc. Visual indicator system for patient bed
US10936163B2 (en) 2018-07-17 2021-03-02 Methodical Mind, Llc. Graphical user interface system
EP3998106B1 (en) 2018-12-17 2024-11-20 Shanghai United Imaging Healthcare Co., Ltd. Systems and methods for determining a region of interest of a subject
CN110507337B (zh) * 2019-08-28 2023-07-11 上海联影医疗科技股份有限公司 一种医学设备控制系统、医学设备控制方法及装置
US10758309B1 (en) * 2019-07-15 2020-09-01 Digital Surgery Limited Methods and systems for using computer-vision to enhance surgical tool control during surgeries
JP2021071894A (ja) * 2019-10-30 2021-05-06 三菱電機株式会社 操作装置、操作方法及びプログラム
CN115280269A (zh) 2019-12-27 2022-11-01 方法思维有限责任公司 图形用户界面系统
KR20220143851A (ko) 2020-01-22 2022-10-25 메쏘디컬 마인드, 엘엘씨. 그래픽 사용자 인터페이스 시스템
EP4294307A1 (en) * 2021-03-26 2023-12-27 C. R. Bard, Inc. Medical device projection system
CN120496788A (zh) * 2021-08-30 2025-08-15 武汉联影医疗科技有限公司 用于控制医学影像设备的界面的系统和方法
US12321667B2 (en) 2022-07-14 2025-06-03 Becton, Dickinson And Company Contactless control of physiological monitors
WO2025069767A1 (ja) * 2023-09-25 2025-04-03 テルモ株式会社 コンピュータプログラム、血管可視化装置、血管可視化システム及び血管可視化方法
KR20250062065A (ko) * 2023-10-30 2025-05-08 주식회사 제이시스메디칼 피부 모니터링 장치, 피부 관리 장치 및 피부 모니터링 기반의 피부 관리 시스템
CN120859792A (zh) * 2025-09-24 2025-10-31 张家港市德仁科教仪器设备有限公司 一种升降解剖台运行控制方法及系统

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103705262A (zh) * 2012-10-05 2014-04-09 西门子公司 用于近距离治疗的导航设备和用于操作该导航设备的方法
CN103902035A (zh) * 2012-12-24 2014-07-02 财团法人工业技术研究院 三维互动装置及其操控方法

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4286556B2 (ja) * 2003-02-24 2009-07-01 株式会社東芝 画像表示装置
WO2007060606A1 (en) 2005-11-25 2007-05-31 Koninklijke Philips Electronics N.V. Touchless manipulation of an image
EP2017756A1 (de) * 2007-07-20 2009-01-21 BrainLAB AG Verfahren zur Anzeige und/oder Bearbeitung bzw. Verarbeitung von Bilddaten medizinischen oder medizintechnischen Ursprungs mit Gestenerkennung
KR101141087B1 (ko) * 2007-09-14 2012-07-12 인텔렉츄얼 벤처스 홀딩 67 엘엘씨 제스처-기반 사용자 상호작용의 프로세싱
US9772689B2 (en) * 2008-03-04 2017-09-26 Qualcomm Incorporated Enhanced gesture-based image manipulation
US8491135B2 (en) * 2010-01-04 2013-07-23 Microvision, Inc. Interactive projection with gesture recognition
EP2691834A4 (en) * 2011-03-28 2015-02-18 Gestsure Technologies Inc GESTURIZED CONTROL FOR MEDICAL INFORMATION SYSTEMS
JP5834690B2 (ja) * 2011-09-22 2015-12-24 カシオ計算機株式会社 投影装置、投影制御方法及びプログラム
JP5966535B2 (ja) * 2012-04-05 2016-08-10 ソニー株式会社 情報処理装置、プログラム及び情報処理方法
US9262068B2 (en) * 2012-05-31 2016-02-16 Opportunity Partners Inc. Interactive surface
EP2867757A4 (en) * 2012-06-30 2015-12-23 Intel Corp 3D GRAPHIC USER INTERFACE
US9369658B2 (en) * 2014-01-20 2016-06-14 Lenovo (Singapore) Pte. Ltd. Image correction of surface projected image

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103705262A (zh) * 2012-10-05 2014-04-09 西门子公司 用于近距离治疗的导航设备和用于操作该导航设备的方法
CN103902035A (zh) * 2012-12-24 2014-07-02 财团法人工业技术研究院 三维互动装置及其操控方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Developing a Touchless User Interface for Intraoperative Image Control during Interventional Radiology Procedures;Justin H.Tan et al.;《Radio Graphics》;20131231;第61-71页 *

Also Published As

Publication number Publication date
CA2993876C (en) 2023-03-07
EP3180721A1 (en) 2017-06-21
JP2017533487A (ja) 2017-11-09
EP3180721A4 (en) 2018-04-04
US10403402B2 (en) 2019-09-03
WO2016023123A1 (en) 2016-02-18
CA2993876A1 (en) 2016-02-18
CN106922190A (zh) 2017-07-04
US20170228104A1 (en) 2017-08-10

Similar Documents

Publication Publication Date Title
CN106922190B (zh) 用于执行医疗手术并且用于访问和/或操纵医学相关信息的方法和系统
US11662830B2 (en) Method and system for interacting with medical information
EP2649409B1 (en) System with 3d user interface integration
WO2018081136A2 (en) Methods and systems for robot-assisted surgery
KR20150022536A (ko) 의료 진단 장치의 사용자 인터페이스 제공 방법 및 장치
JP7229569B2 (ja) 医用画像処理装置および医用画像処理プログラム
JP5900914B1 (ja) コピー映像提供方法、及びそのための超音波装置
EP3454177B1 (en) Method and system for efficient gesture control of equipment
USRE48221E1 (en) System with 3D user interface integration
Gallo et al. Wii Remote-enhanced Hand-Computer interaction for 3D medical image analysis
JP6462358B2 (ja) 医用画像表示端末および医用画像表示プログラム
KR101611484B1 (ko) 의료영상의 제공방법
KR20140145464A (ko) 객체 표시 방법 및 이를 위한 초음파 장치
JP2018147054A (ja) 非接触遠隔ポインター制御装置
KR20170099222A (ko) 객체 표시 방법 및 이를 위한 초음파 장치
JP7279133B2 (ja) 情報処理装置、情報処理方法およびプログラム
JP6902012B2 (ja) 医用画像表示端末および医用画像表示プログラム
De Paolis et al. An Advanced Modality of Visualization and Interaction with Virtual Models of the Human Body
Carey The Implementation of a Glove-Based User Interface

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200918