CA2993876C - Methods and systems for performing medical procedures and for accessing and/or manipulating medically relevant information - Google Patents

Methods and systems for performing medical procedures and for accessing and/or manipulating medically relevant information Download PDF

Info

Publication number
CA2993876C
CA2993876C CA2993876A CA2993876A CA2993876C CA 2993876 C CA2993876 C CA 2993876C CA 2993876 A CA2993876 A CA 2993876A CA 2993876 A CA2993876 A CA 2993876A CA 2993876 C CA2993876 C CA 2993876C
Authority
CA
Canada
Prior art keywords
user interface
image
projection surface
practitioner
location
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2993876A
Other languages
English (en)
French (fr)
Other versions
CA2993876A1 (en
Inventor
Nima Ziraknejad
Behrang HOMAYOON
Peter Lawrence
David Ming-Teh LIU
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of British Columbia
Original Assignee
University of British Columbia
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of British Columbia filed Critical University of British Columbia
Publication of CA2993876A1 publication Critical patent/CA2993876A1/en
Application granted granted Critical
Publication of CA2993876C publication Critical patent/CA2993876C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61G—TRANSPORT, PERSONAL CONVEYANCES, OR ACCOMMODATION SPECIALLY ADAPTED FOR PATIENTS OR DISABLED PERSONS; OPERATING TABLES OR CHAIRS; CHAIRS FOR DENTISTRY; FUNERAL DEVICES
    • A61G13/00—Operating tables; Auxiliary appliances therefor
    • A61G13/10—Parts, details or accessories
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Medical Informatics (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • General Business, Economics & Management (AREA)
  • Business, Economics & Management (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Radiology & Medical Imaging (AREA)
  • Veterinary Medicine (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Multimedia (AREA)
  • Gynecology & Obstetrics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Pathology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • User Interface Of Digital Computer (AREA)
  • Accommodation For Nursing Or Treatment Tables (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
CA2993876A 2014-08-15 2015-08-13 Methods and systems for performing medical procedures and for accessing and/or manipulating medically relevant information Active CA2993876C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201462038157P 2014-08-15 2014-08-15
US62/038,157 2014-08-15
PCT/CA2015/050764 WO2016023123A1 (en) 2014-08-15 2015-08-13 Methods and systems for performing medical procedures and for accessing and/or manipulating medically relevant information

Publications (2)

Publication Number Publication Date
CA2993876A1 CA2993876A1 (en) 2016-02-18
CA2993876C true CA2993876C (en) 2023-03-07

Family

ID=55303733

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2993876A Active CA2993876C (en) 2014-08-15 2015-08-13 Methods and systems for performing medical procedures and for accessing and/or manipulating medically relevant information

Country Status (6)

Country Link
US (1) US10403402B2 (enExample)
EP (1) EP3180721A4 (enExample)
JP (1) JP2017533487A (enExample)
CN (1) CN106922190B (enExample)
CA (1) CA2993876C (enExample)
WO (1) WO2016023123A1 (enExample)

Families Citing this family (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016195684A1 (en) * 2015-06-04 2016-12-08 Siemens Healthcare Gmbh Apparatus and methods for a projection display device on x-ray imaging devices
WO2017070121A1 (en) 2015-10-20 2017-04-27 Magic Leap, Inc. Selecting virtual objects in a three-dimensional space
US10078919B2 (en) 2016-03-31 2018-09-18 Magic Leap, Inc. Interactions with 3D virtual objects using poses and multiple-DOF controllers
JP6880075B2 (ja) * 2016-05-20 2021-06-02 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． ユーザインターフェースメニューのコンテキスト認識
CN113893032B (zh) 2016-07-14 2024-10-15 直观外科手术操作公司 用于远程操作医疗系统中的屏幕菜单的系统和方法
JPWO2018087977A1 (ja) * 2016-11-08 2019-09-26 ソニー株式会社 情報処理装置、情報処理方法、プログラム
US10331276B2 (en) * 2016-12-30 2019-06-25 Intel Corporation Projected interactive display surface interactivity determination
CA3052869A1 (en) 2017-02-17 2018-08-23 Nz Technologies Inc. Methods and systems for touchless control of surgical environment
JP7267209B2 (ja) 2017-06-08 2023-05-01 メドス・インターナショナル・エスエイアールエル 滅菌野及び他の作業環境のためのユーザインターフェースシステム
IT201700114495A1 (it) * 2017-10-11 2019-04-11 General Medical Merate S P A Sistema per il controllo di almeno un movimento di un componente motorizzato di un’apparecchiatura radiologica e apparecchiatura radiologica che lo utilizza
US10506224B2 (en) * 2017-11-07 2019-12-10 Oriental Institute Of Technology Holographic three dimensional imaging projecting medical apparatus
DE102017127791A1 (de) 2017-11-24 2019-05-29 Aesculap Ag Medizinisches Steuersystem und medizinischer Sterilraum mit Steuersystem
US20190215460A1 (en) * 2018-01-09 2019-07-11 Osram Sylvania Inc. User Interface for Control of Building System Components
EP3782531A4 (en) * 2018-04-19 2021-05-26 FUJIFILM Corporation ENDOSCOPE DEVICE, ENDOSCOPE OPERATING PROCESS AND PROGRAM
EP3773219B1 (en) * 2018-05-10 2025-09-03 Siemens Medical Solutions USA, Inc. Visual indicator system for patient bed
US10936163B2 (en) 2018-07-17 2021-03-02 Methodical Mind, Llc. Graphical user interface system
EP3998106B1 (en) 2018-12-17 2024-11-20 Shanghai United Imaging Healthcare Co., Ltd. Systems and methods for determining a region of interest of a subject
CN110507337B (zh) * 2019-08-28 2023-07-11 上海联影医疗科技股份有限公司 一种医学设备控制系统、医学设备控制方法及装置
US10758309B1 (en) * 2019-07-15 2020-09-01 Digital Surgery Limited Methods and systems for using computer-vision to enhance surgical tool control during surgeries
JP2021071894A (ja) * 2019-10-30 2021-05-06 三菱電機株式会社 操作装置、操作方法及びプログラム
CN115280269A (zh) 2019-12-27 2022-11-01 方法思维有限责任公司 图形用户界面系统
KR20220143851A (ko) 2020-01-22 2022-10-25 메쏘디컬 마인드, 엘엘씨. 그래픽 사용자 인터페이스 시스템
EP4294307A1 (en) * 2021-03-26 2023-12-27 C. R. Bard, Inc. Medical device projection system
CN120496788A (zh) * 2021-08-30 2025-08-15 武汉联影医疗科技有限公司 用于控制医学影像设备的界面的系统和方法
US12321667B2 (en) 2022-07-14 2025-06-03 Becton, Dickinson And Company Contactless control of physiological monitors
WO2025069767A1 (ja) * 2023-09-25 2025-04-03 テルモ株式会社 コンピュータプログラム、血管可視化装置、血管可視化システム及び血管可視化方法
KR20250062065A (ko) * 2023-10-30 2025-05-08 주식회사 제이시스메디칼 피부 모니터링 장치, 피부 관리 장치 및 피부 모니터링 기반의 피부 관리 시스템
CN120859792A (zh) * 2025-09-24 2025-10-31 张家港市德仁科教仪器设备有限公司 一种升降解剖台运行控制方法及系统

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4286556B2 (ja) * 2003-02-24 2009-07-01 株式会社東芝 画像表示装置
WO2007060606A1 (en) 2005-11-25 2007-05-31 Koninklijke Philips Electronics N.V. Touchless manipulation of an image
EP2017756A1 (de) * 2007-07-20 2009-01-21 BrainLAB AG Verfahren zur Anzeige und/oder Bearbeitung bzw. Verarbeitung von Bilddaten medizinischen oder medizintechnischen Ursprungs mit Gestenerkennung
KR101141087B1 (ko) * 2007-09-14 2012-07-12 인텔렉츄얼 벤처스 홀딩 67 엘엘씨 제스처-기반 사용자 상호작용의 프로세싱
US9772689B2 (en) * 2008-03-04 2017-09-26 Qualcomm Incorporated Enhanced gesture-based image manipulation
US8491135B2 (en) * 2010-01-04 2013-07-23 Microvision, Inc. Interactive projection with gesture recognition
EP2691834A4 (en) * 2011-03-28 2015-02-18 Gestsure Technologies Inc GESTURIZED CONTROL FOR MEDICAL INFORMATION SYSTEMS
JP5834690B2 (ja) * 2011-09-22 2015-12-24 カシオ計算機株式会社 投影装置、投影制御方法及びプログラム
JP5966535B2 (ja) * 2012-04-05 2016-08-10 ソニー株式会社 情報処理装置、プログラム及び情報処理方法
US9262068B2 (en) * 2012-05-31 2016-02-16 Opportunity Partners Inc. Interactive surface
EP2867757A4 (en) * 2012-06-30 2015-12-23 Intel Corp 3D GRAPHIC USER INTERFACE
US9174068B2 (en) * 2012-10-05 2015-11-03 Siemens Aktiengesellschaft Navigation device for brachytherapy and method for operating the navigation device
TWI454968B (zh) * 2012-12-24 2014-10-01 Ind Tech Res Inst 三維互動裝置及其操控方法
US9369658B2 (en) * 2014-01-20 2016-06-14 Lenovo (Singapore) Pte. Ltd. Image correction of surface projected image

Also Published As

Publication number Publication date
EP3180721A1 (en) 2017-06-21
JP2017533487A (ja) 2017-11-09
CN106922190B (zh) 2020-09-18
EP3180721A4 (en) 2018-04-04
US10403402B2 (en) 2019-09-03
WO2016023123A1 (en) 2016-02-18
CA2993876A1 (en) 2016-02-18
CN106922190A (zh) 2017-07-04
US20170228104A1 (en) 2017-08-10

Similar Documents

Publication Publication Date Title
CA2993876C (en) Methods and systems for performing medical procedures and for accessing and/or manipulating medically relevant information
US11662830B2 (en) Method and system for interacting with medical information
US11272991B2 (en) Methods and systems for touchless control of surgical environment
US20230363833A1 (en) Methods And Systems For Robot-Assisted Surgery
JP7146772B2 (ja) コンテクストオーバレイを提供する拡張現実インターベンションシステム
EP2615525B1 (en) Touch free operation of devices by use of depth sensors
US7889227B2 (en) Intuitive user interface for endoscopic view visualization
JP7229569B2 (ja) 医用画像処理装置および医用画像処理プログラム
EP3454177B1 (en) Method and system for efficient gesture control of equipment
Gallo et al. Wii Remote-enhanced Hand-Computer interaction for 3D medical image analysis
KR101611484B1 (ko) 의료영상의 제공방법
WO2018011105A1 (en) Systems and methods for three dimensional touchless manipulation of medical images
JP6902012B2 (ja) 医用画像表示端末および医用画像表示プログラム
US20160004318A1 (en) System and method of touch-free operation of a picture archiving and communication system

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20200724

EEER Examination request

Effective date: 20200724

EEER Examination request

Effective date: 20200724

EEER Examination request

Effective date: 20200724

EEER Examination request

Effective date: 20200724

EEER Examination request

Effective date: 20200724