WO2021153797A8 - コンピュータプログラム、学習モデルの生成方法、画像処理装置、及び手術支援システム - Google Patents

コンピュータプログラム、学習モデルの生成方法、画像処理装置、及び手術支援システム Download PDF

Info

Publication number
WO2021153797A8
WO2021153797A8 PCT/JP2021/003489 JP2021003489W WO2021153797A8 WO 2021153797 A8 WO2021153797 A8 WO 2021153797A8 JP 2021003489 W JP2021003489 W JP 2021003489W WO 2021153797 A8 WO2021153797 A8 WO 2021153797A8
Authority
WO
WIPO (PCT)
Prior art keywords
trained model
acquired
image processing
computer program
processing device
Prior art date
Application number
PCT/JP2021/003489
Other languages
English (en)
French (fr)
Other versions
WO2021153797A1 (ja
Inventor
尚紀 北村
勇太 熊頭
直 小林
Original Assignee
アナウト株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by アナウト株式会社 filed Critical アナウト株式会社
Priority to CN202180011878.3A priority Critical patent/CN115023193A/zh
Priority to US17/795,408 priority patent/US20230098859A1/en
Priority to JP2021574738A priority patent/JP7153974B2/ja
Publication of WO2021153797A1 publication Critical patent/WO2021153797A1/ja
Publication of WO2021153797A8 publication Critical patent/WO2021153797A8/ja

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A61B1/000096—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope using artificial intelligence
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • A61B1/000094—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002—Operational features of endoscopes
    • A61B1/00043—Operational features of endoscopes provided with output arrangements
    • A61B1/00045—Display arrangement
    • A61B1/0005—Display arrangement combining images e.g. side-by-side, superimposed or tiled
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/313—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for introducing through surgical openings, e.g. laparoscopes
    • A61B1/3132—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for introducing through surgical openings, e.g. laparoscopes for laparoscopy
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/047—Probabilistic or stochastic networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0475—Generative networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/094—Adversarial learning
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/361—Image-producing devices, e.g. surgical cameras

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Surgery (AREA)
  • Biophysics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Theoretical Computer Science (AREA)
  • Medical Informatics (AREA)
  • Pathology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Radiology & Medical Imaging (AREA)
  • Optics & Photonics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Probability & Statistics with Applications (AREA)
  • Image Analysis (AREA)

Abstract

手術対象の状態を容易に把握することができるようにする。　コンピュータに、鏡視下手術の術野を撮像して得られる術野画像を取得し、術野画像を入力した場合、温存臓器と切除臓器との間の結合組織に関する情報を出力するように学習された学習モデルに、取得した術野画像を入力して、術野画像に含まれる結合組織に関する情報を取得し、学習モデルから取得した情報に基づき、温存臓器と切除臓器との間の結合組織を処理する際のナビゲーション情報を出力する処理を実行させる。
PCT/JP2021/003489 2020-01-30 2021-02-01 コンピュータプログラム、学習モデルの生成方法、画像処理装置、及び手術支援システム WO2021153797A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202180011878.3A CN115023193A (zh) 2020-01-30 2021-02-01 计算机程序、学习模型的生成方法、图像处理装置、以及手术辅助系统
US17/795,408 US20230098859A1 (en) 2020-01-30 2021-02-01 Recording Medium, Method for Generating Learning Model, Image Processing Device, and Surgical Operation Assisting System
JP2021574738A JP7153974B2 (ja) 2020-01-30 2021-02-01 コンピュータプログラム、学習モデルの生成方法、及び画像処理装置

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
PCT/JP2020/003481 WO2021152784A1 (ja) 2020-01-30 2020-01-30 手術支援システム
JPPCT/JP2020/003481 2020-01-30

Publications (2)

Publication Number Publication Date
WO2021153797A1 WO2021153797A1 (ja) 2021-08-05
WO2021153797A8 true WO2021153797A8 (ja) 2021-09-23

Family

ID=77078283

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/JP2020/003481 WO2021152784A1 (ja) 2020-01-30 2020-01-30 手術支援システム
PCT/JP2021/003489 WO2021153797A1 (ja) 2020-01-30 2021-02-01 コンピュータプログラム、学習モデルの生成方法、画像処理装置、及び手術支援システム

Family Applications Before (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/003481 WO2021152784A1 (ja) 2020-01-30 2020-01-30 手術支援システム

Country Status (4)

Country Link
US (1) US20230098859A1 (ja)
JP (1) JP7153974B2 (ja)
CN (1) CN115023193A (ja)
WO (2) WO2021152784A1 (ja)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20230281968A1 (en) * 2020-07-30 2023-09-07 Anaut Inc. Recording Medium, Method for Generating Learning Model, Surgical Support Device and Information Processing Method
CN117956939A (zh) * 2021-11-04 2024-04-30 阿瑙特株式会社 计算机程序、学习模型的生成方法、以及信息处理装置
WO2024095674A1 (ja) * 2022-11-04 2024-05-10 富士フイルム株式会社 医療支援装置、内視鏡、医療支援方法、及びプログラム
WO2024122027A1 (ja) * 2022-12-08 2024-06-13 国立研究開発法人国立がん研究センター 画像処理装置、手術支援システム、画像処理方法及びプログラム

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8594841B2 (en) * 2008-12-31 2013-11-26 Intuitive Surgical Operations, Inc. Visual force feedback in a minimally invasive surgical procedure
JP5797124B2 (ja) 2012-01-31 2015-10-21 富士フイルム株式会社 手術支援装置、手術支援方法および手術支援プログラム
WO2017109912A1 (ja) * 2015-12-24 2017-06-29 オリンパス株式会社 医療用マニピュレータシステムとその画像表示方法
CN109414151B (zh) * 2016-05-18 2022-11-25 国立大学法人三重大学 癌症检测装置、癌症检测方法和用于癌症检测的染色剂
US10610302B2 (en) * 2016-09-20 2020-04-07 Siemens Healthcare Gmbh Liver disease assessment in medical imaging
JP6890184B2 (ja) * 2017-09-15 2021-06-18 富士フイルム株式会社 医療画像処理装置及び医療画像処理プログラム
JP6749020B2 (ja) * 2017-11-29 2020-09-02 水野 裕子 内視鏡ナビゲーション装置
JP2019162339A (ja) 2018-03-20 2019-09-26 ソニー株式会社 手術支援システムおよび表示方法
WO2020110278A1 (ja) 2018-11-30 2020-06-04 オリンパス株式会社 情報処理システム、内視鏡システム、学習済みモデル、情報記憶媒体及び情報処理方法

Also Published As

Publication number Publication date
US20230098859A1 (en) 2023-03-30
CN115023193A (zh) 2022-09-06
WO2021152784A1 (ja) 2021-08-05
JPWO2021153797A1 (ja) 2021-08-05
JP7153974B2 (ja) 2022-10-17
WO2021153797A1 (ja) 2021-08-05

Similar Documents

Publication Publication Date Title
WO2021153797A8 (ja) コンピュータプログラム、学習モデルの生成方法、画像処理装置、及び手術支援システム
EP3179948B1 (en) Augmented surgical reality environment
EP3179947B1 (en) An augmented surgical reality environment for a robotic surgical system
Stefanidis et al. Robotic suturing on the FLS model possesses construct validity, is less physically demanding, and is favored by more surgeons compared with laparoscopy
WO2020163845A3 (en) Image-guided surgery system
EP3845187A3 (en) Surgical systems for generating three dimensional constructs of anatomical organs and coupling identified anatomical structures thereto
JP7412528B2 (ja) 外科用ロボットシステムからのデータの修正
US20150366628A1 (en) Augmented surgical reality environment system
Dharia et al. Robotics in reproductive medicine
EP3370603A1 (en) System and method for detecting subsurface blood
JPWO2021153797A5 (ja) コンピュータプログラム、学習モデルの生成方法、及び画像処理装置
WO2019036007A1 (en) SYSTEMS AND METHODS FOR ENHANCING SURGICAL IMAGES AND / OR VIDEOS
WO2009042644A3 (en) Methods and apparatus for assisting cartilage diagnostic and therapeutic procedures
EP3616596A3 (en) Image processor, medical observation device, such as a microscope or an endoscope, and method using pseudo-color image data
MX2023004330A (es) Generador de audio y métodos para generar una señal de audio y entrenamiento de un generador de audio.
Le et al. Robust Surgical Tool Detection in Laparoscopic Surgery using YOLOv8 Model
US11800966B2 (en) Medical system and medical system operating method
Howard et al. Improving precision in navigating laparoscopic surgery instruments toward a planar target using haptic and visual feedback
Mylonas et al. Gaze-contingent motor channelling and haptic constraints for minimally invasive robotic surgery
US20230122835A1 (en) Methods and systems for generating clarified and enhanced intraoperative imaging data
Elzanaty et al. Advances in male reproductive surgery: robotic-assisted vasovasostomy
Marie et al. A 2021 review on recent advancements in robotic-assisted minimally invasive surgery: the Philippines perspective
Owlia et al. Real-time tracking of laparoscopic instruments using kinect for training in virtual reality
Elek et al. Autonomous non-technical surgical skill assessment and workload analysis in laparoscopic cholecystectomy training
KR102347471B1 (ko) 증강 현실을 이용한 모의 수술 시스템 및 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21748041

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021574738

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21748041

Country of ref document: EP

Kind code of ref document: A1