JP2020089710A5 - - Google Patents

Download PDF

Info

Publication number
JP2020089710A5
JP2020089710A5 JP2019100647A JP2019100647A JP2020089710A5 JP 2020089710 A5 JP2020089710 A5 JP 2020089710A5 JP 2019100647 A JP2019100647 A JP 2019100647A JP 2019100647 A JP2019100647 A JP 2019100647A JP 2020089710 A5 JP2020089710 A5 JP 2020089710A5
Authority
JP
Japan
Prior art keywords
prediction
output
image
model
acquired
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2019100647A
Other languages
Japanese (ja)
Other versions
JP2020089710A (en
JP6877486B2 (en
Filing date
Publication date
Application filed filed Critical
Priority to PCT/JP2019/044578 priority Critical patent/WO2020116115A1/en
Priority to US17/252,942 priority patent/US20210407077A1/en
Priority to CN201980043891.XA priority patent/CN112399816B/en
Priority to DE112019006011.2T priority patent/DE112019006011T5/en
Priority to CN202410051899.3A priority patent/CN117814732A/en
Publication of JP2020089710A publication Critical patent/JP2020089710A/en
Publication of JP2020089710A5 publication Critical patent/JP2020089710A5/ja
Priority to JP2021075220A priority patent/JP7155330B2/en
Application granted granted Critical
Publication of JP6877486B2 publication Critical patent/JP6877486B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Description

情報処理装置は、内視鏡画像を取得する画像取得部と、病変領域の内視鏡画像が入力された場合に疾病の診断基準に関する診断基準予測を出力する第1モデルに、前記画像取得部が取得した内視鏡画像を入力して、出力される診断基準予測を取得する第1取得部と、前記第1取得部が取得した診断基準予測を、前記内視鏡画像に基づいて取得した前記疾病の状態に関する診断予測と関連づけて出力する出力部とを備え、前記診断予測は、内視鏡画像が入力された場合に前記疾病が含まれる病変領域に関する領域予測を出力する第2モデルに、前記画像取得部が取得した内視鏡画像を入力して、出力された病変領域に関する領域予測であり、前記第1取得部は、前記画像取得部が取得した内視鏡画像のうち前記第2モデルから出力された領域予測に対応する部分を前記第1モデルに入力して、出力される診断基準予測を取得する。 The information processing apparatus includes an image acquisition unit that acquires an endoscopic image and a first model that outputs a diagnostic standard prediction regarding a diagnostic standard of a disease when an endoscopic image of a lesion area is input. The first acquisition unit that inputs the endoscopic image acquired by the patient and acquires the output diagnostic standard prediction, and the diagnostic standard prediction acquired by the first acquisition unit are acquired based on the endoscopic image. It is provided with an output unit that outputs in association with the diagnosis prediction regarding the state of the disease, and the diagnosis prediction is a second model that outputs the area prediction regarding the lesion area including the disease when an endoscopic image is input. , The endoscopic image acquired by the image acquisition unit is input and the area is predicted regarding the output lesion region, and the first acquisition unit is the first of the endoscopic images acquired by the image acquisition unit. The portion corresponding to the region prediction output from the two models is input to the first model, and the output diagnostic reference prediction is acquired.

Claims (12)

内視鏡画像を取得する画像取得部と、
病変領域の内視鏡画像が入力された場合に疾病の診断基準に関する診断基準予測を出力する第1モデルに、前記画像取得部が取得した内視鏡画像を入力して、出力される診断基準予測を取得する第1取得部と、
前記第1取得部が取得した診断基準予測を、前記内視鏡画像に基づいて取得した前記疾病の状態に関する診断予測と関連づけて出力する出力部とを備え、
前記診断予測は、内視鏡画像が入力された場合に前記疾病が含まれる病変領域に関する領域予測を出力する第2モデルに、前記画像取得部が取得した内視鏡画像を入力して、出力された病変領域に関する領域予測であり、
前記第1取得部は、前記画像取得部が取得した内視鏡画像のうち前記第2モデルから出
力された領域予測に対応する部分を前記第1モデルに入力して、出力される診断基準予測
を取得する
情報処理装置。
An image acquisition unit that acquires endoscopic images,
Diagnostic criteria output by inputting the endoscopic image acquired by the image acquisition unit into the first model that outputs the diagnostic criteria prediction regarding the diagnostic criteria of the disease when the endoscopic image of the lesion area is input. The first acquisition part to acquire the forecast and
It is provided with an output unit that outputs the diagnostic reference prediction acquired by the first acquisition unit in association with the diagnostic prediction regarding the state of the disease acquired based on the endoscopic image .
The diagnostic prediction is output by inputting the endoscopic image acquired by the image acquisition unit into the second model that outputs the area prediction regarding the lesion region including the disease when the endoscopic image is input. Area prediction for the affected lesion area
The first acquisition unit is output from the second model of the endoscopic images acquired by the image acquisition unit.
Diagnostic criteria prediction output by inputting the part corresponding to the forceed area prediction into the first model
Information processing device to acquire .
前記第1取得部は、前記疾病の診断基準に含まれる複数の項目の診断基準予測をそれぞれ出力する複数の第1モデルからそれぞれの項目の診断基準予測を取得する
請求項1に記載の情報処理装置。
The information processing according to claim 1, wherein the first acquisition unit acquires diagnostic standard predictions for each item from a plurality of first models that output diagnostic standard predictions for a plurality of items included in the diagnostic criteria for the disease. apparatus.
前記第1モデルは、機械学習により生成された学習モデルである
請求項1または請求項2に記載の情報処理装置。
The information processing device according to claim 1 or 2, wherein the first model is a learning model generated by machine learning.
前記第1モデルは、前記画像取得部が取得した内視鏡画像に基づいて算出した数値を出力する
請求項1または請求項2に記載の情報処理装置。
The information processing device according to claim 1 or 2, wherein the first model outputs a numerical value calculated based on an endoscopic image acquired by the image acquisition unit.
前記第1取得部の動作停止指示を受け付ける第1受付部を備える
請求項1から請求項4のいずれか一つに記載の情報処理装置。
The information processing apparatus according to any one of claims 1 to 4, further comprising a first reception unit that receives an operation stop instruction of the first acquisition unit.
前記第2モデルは、機械学習により生成された学習モデルである
請求項1から請求項5のいずれか一つに記載の情報処理装置。
The second model is a learning model generated by machine learning.
The information processing device according to any one of claims 1 to 5 .
前記診断予測の取得を停止する指示を受け付ける第2受付部を備える
請求項1から請求項6のいずれか一つに記載の情報処理装置。
A second reception unit that receives an instruction to stop the acquisition of the diagnosis prediction is provided.
The information processing device according to any one of claims 1 to 6 .
前記出力部は、前記画像取得部が取得した内視鏡画像も出力する
請求項1から請求項7のいずれか一つに記載の情報処理装置。
The output unit also outputs an endoscopic image acquired by the image acquisition unit.
The information processing device according to any one of claims 1 to 7 .
前記画像取得部は、内視鏡検査中に撮影された内視鏡画像をリアルタイムで取得し、
前記出力部は、前記画像取得部による内視鏡画像の取得と同期して出力を行なう
請求項1から請求項8のいずれか一つに記載の情報処理装置。
The image acquisition unit acquires an endoscopic image taken during endoscopy in real time.
The information processing device according to any one of claims 1 to 8 , wherein the output unit outputs in synchronization with the acquisition of an endoscopic image by the image acquisition unit.
内視鏡が接続される内視鏡接続部と
前記内視鏡接続部に接続された内視鏡から取得した映像信号に基づいて内視鏡画像を生
成する画像生成部と、
病変領域の内視鏡画像が入力された場合に疾病の診断基準に関する診断基準予測を出力する第1モデルに、前記画像生成部が取得した内視鏡画像を入力して、出力される診断基準予測を取得する第1取得部と、
前記第1取得部が取得した診断基準予測を、前記内視鏡画像に基づいて取得した前記疾病の状態に関する診断予測と関連づけて出力する出力部とを備え、
前記診断予測は、内視鏡画像が入力された場合に前記疾病が含まれる病変領域に関する領域予測を出力する第2モデルに、前記画像生成部が生成した内視鏡画像を入力して、出力された病変領域に関する領域予測であり、
前記第1取得部は、前記画像生成部が生成した内視鏡画像のうち前記第2モデルから出
力された領域予測に対応する部分を前記第1モデルに入力して、出力される診断基準予測
を取得する
内視鏡用プロセッサ。
An endoscope connection unit to which an endoscope is connected, an image generation unit that generates an endoscope image based on an image signal acquired from an endoscope connected to the endoscope connection unit, and an image generation unit.
Diagnostic criteria output by inputting the endoscopic image acquired by the image generator into the first model that outputs the diagnostic criteria prediction regarding the diagnostic criteria of the disease when the endoscopic image of the lesion area is input. The first acquisition part to acquire the forecast and
It is provided with an output unit that outputs the diagnostic reference prediction acquired by the first acquisition unit in association with the diagnostic prediction regarding the state of the disease acquired based on the endoscopic image .
The diagnostic prediction is output by inputting the endoscopic image generated by the image generation unit into the second model that outputs the area prediction regarding the lesion region including the disease when the endoscopic image is input. Area prediction for the affected lesion area
The first acquisition unit is output from the second model of the endoscopic images generated by the image generation unit.
Diagnostic criteria prediction output by inputting the part corresponding to the forceed area prediction into the first model
To get an endoscope processor.
内視鏡画像を取得し、
内視鏡画像が入力された場合に疾病が含まれる病変領域に関する領域予測を出力する第2モデルに、取得した内視鏡画像を入力して、出力された病変領域に関する領域予測を取得し、
病変領域の内視鏡画像が入力された場合に前記疾病の診断基準に関する診断基準予測を出力する第1モデルに、取得した内視鏡画像のうち前記第2モデルから出力された領域予測に対応する部分を入力して、出力される診断基準予測を取得し、
取得した前記診断基準予測を、取得した前記領域予測と関連づけて出力する
処理をコンピュータに実行させる情報処理方法。
Get an endoscopic image and
When the endoscopic image is input, the acquired endoscopic image is input to the second model that outputs the area prediction for the lesion area including the disease, and the area prediction for the output lesion area is acquired.
First model for outputting the diagnostic criteria predictive diagnostic criteria for the disease if the endoscopic image of the lesion region is input, corresponding to the output region prediction from the second model of the endoscopic image acquired Enter the part to be output , get the output diagnostic criterion prediction,
An information processing method for executing the acquired diagnostic criteria predictive, acquisition was a process of outputting in association with the region predicted in the computer.
内視鏡画像を取得し、
内視鏡画像が入力された場合に疾病が含まれる病変領域に関する領域予測を出力する第2モデルに、取得した内視鏡画像を入力して、出力された病変領域に関する領域予測を取得し、
病変領域の内視鏡画像が入力された場合に前記疾病の診断基準に関する診断基準予測を出力する第1モデルに、取得した内視鏡画像のうち前記第2モデルから出力された領域予測に対応する部分を入力して、出力される診断基準予測を取得し、
取得した前記診断基準予測を、取得した前記領域予測と関連づけて出力する
処理をコンピュータに実行させるプログラム。
Get an endoscopic image and
When the endoscopic image is input, the acquired endoscopic image is input to the second model that outputs the area prediction for the lesion area including the disease, and the area prediction for the output lesion area is acquired.
First model for outputting the diagnostic criteria predictive diagnostic criteria for the disease if the endoscopic image of the lesion region is input, corresponding to the output region prediction from the second model of the endoscopic image acquired Enter the part to be output , get the output diagnostic criterion prediction,
The obtained the diagnostic criteria predictive, acquisition and said program for executing a process of outputting in association with domain prediction to a computer.
JP2019100647A 2018-12-04 2019-05-29 Information processing equipment, endoscope processors, information processing methods and programs Active JP6877486B2 (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
US17/252,942 US20210407077A1 (en) 2018-12-04 2019-11-13 Information processing device and model generation method
CN201980043891.XA CN112399816B (en) 2018-12-04 2019-11-13 Information processing apparatus and model generation method
DE112019006011.2T DE112019006011T5 (en) 2018-12-04 2019-11-13 INFORMATION PROCESSING DEVICE AND MODEL GENERATION METHOD
CN202410051899.3A CN117814732A (en) 2018-12-04 2019-11-13 Model generation method
PCT/JP2019/044578 WO2020116115A1 (en) 2018-12-04 2019-11-13 Information processing device and model generation method
JP2021075220A JP7155330B2 (en) 2018-12-04 2021-04-27 Information processing device, endoscope processor, information processing method and program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862775197P 2018-12-04 2018-12-04
US62/775,197 2018-12-04

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2021075220A Division JP7155330B2 (en) 2018-12-04 2021-04-27 Information processing device, endoscope processor, information processing method and program

Publications (3)

Publication Number Publication Date
JP2020089710A JP2020089710A (en) 2020-06-11
JP2020089710A5 true JP2020089710A5 (en) 2021-01-14
JP6877486B2 JP6877486B2 (en) 2021-05-26

Family

ID=71011993

Family Applications (4)

Application Number Title Priority Date Filing Date
JP2019100648A Active JP7015275B2 (en) 2018-12-04 2019-05-29 Model generation method, teacher data generation method, and program
JP2019100647A Active JP6877486B2 (en) 2018-12-04 2019-05-29 Information processing equipment, endoscope processors, information processing methods and programs
JP2019100649A Active JP6872581B2 (en) 2018-12-04 2019-05-29 Information processing equipment, endoscope processors, information processing methods and programs
JP2021075220A Active JP7155330B2 (en) 2018-12-04 2021-04-27 Information processing device, endoscope processor, information processing method and program

Family Applications Before (1)

Application Number Title Priority Date Filing Date
JP2019100648A Active JP7015275B2 (en) 2018-12-04 2019-05-29 Model generation method, teacher data generation method, and program

Family Applications After (2)

Application Number Title Priority Date Filing Date
JP2019100649A Active JP6872581B2 (en) 2018-12-04 2019-05-29 Information processing equipment, endoscope processors, information processing methods and programs
JP2021075220A Active JP7155330B2 (en) 2018-12-04 2021-04-27 Information processing device, endoscope processor, information processing method and program

Country Status (3)

Country Link
JP (4) JP7015275B2 (en)
CN (1) CN112399816B (en)
DE (1) DE112019006011T5 (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7440388B2 (en) 2020-09-28 2024-02-28 株式会社日立製作所 Image diagnosis support device and image processing method
KR102253398B1 (en) * 2020-11-19 2021-05-18 주식회사 웨이센 Method for providing user interface through artificial intelligence-based image processing and user events, and image receiving apparatus using the method
WO2022114357A1 (en) * 2020-11-25 2022-06-02 주식회사 아이도트 Image diagnosis system for lesion
KR102268771B1 (en) * 2020-11-26 2021-06-24 주식회사 웨이센 Method for providing a user interface using the data receiving apparatus based on the image processing of the AI and Apparatus for using the same
KR102505791B1 (en) * 2021-01-11 2023-03-03 한림대학교 산학협력단 Control method, apparatus, and program of lesion determination system acquired through real-time image
JP7413295B2 (en) * 2021-02-05 2024-01-15 株式会社日立製作所 Image processing device, image processing method and program
WO2022200624A2 (en) * 2021-03-26 2022-09-29 Datawalk Spolka Akcyjna Systems and methods for end-to-end machine learning with automated machine learning explainable artificial intelligence
WO2022250031A1 (en) * 2021-05-24 2022-12-01 アナウト株式会社 Information processing device, information processing method, and computer program
WO2023032317A1 (en) * 2021-09-02 2023-03-09 ソニーグループ株式会社 Program, information processing device, and information processing method
CN115206512B (en) * 2022-09-15 2022-11-15 武汉大学人民医院(湖北省人民医院) Hospital information management method and device based on Internet of things

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3823494C2 (en) * 1988-07-11 1997-11-27 En Versorgung Schwaben Ag Method and device for furnace diagnosis and furnace control using the results thereof
JPH08305855A (en) * 1995-05-01 1996-11-22 Nippon Telegr & Teleph Corp <Ntt> Method and device for pattern recognition of image
JPH08249300A (en) * 1995-03-13 1996-09-27 Minolta Co Ltd Neural network and its forming method
JP2000155840A (en) * 1998-11-18 2000-06-06 Olympus Optical Co Ltd Image processing method
JP2003126045A (en) 2001-10-22 2003-05-07 Olympus Optical Co Ltd Diagnostic assistant system
EP1394715A1 (en) * 2002-08-02 2004-03-03 Europroteome AG An expert system for clinicial outcome prediction
US7538761B2 (en) * 2002-12-12 2009-05-26 Olympus Corporation Information processor
JP2004188026A (en) * 2002-12-12 2004-07-08 Olympus Corp Information processing system
EP1636731A2 (en) 2003-06-25 2006-03-22 Siemens Medical Solutions USA, Inc. Systems and methods for automated diagnosis and decision support for breast imaging
JP2005124755A (en) * 2003-10-22 2005-05-19 Olympus Corp Image processor for endoscope
JP4451460B2 (en) * 2007-03-16 2010-04-14 オリンパス株式会社 Endoscopic diagnosis support device
JP5738720B2 (en) * 2011-03-24 2015-06-24 日本メナード化粧品株式会社 Melanin synthesis ability evaluation method and beauty advice method, and melanin synthesis ability evaluation system and beauty advice system using them
JP6027803B2 (en) 2012-07-17 2016-11-16 Hoya株式会社 Image processing apparatus and endoscope apparatus
JP6027065B2 (en) * 2014-08-21 2016-11-16 富士フイルム株式会社 Similar image search device, method of operating similar image search device, and similar image search program
WO2016121811A1 (en) * 2015-01-29 2016-08-04 富士フイルム株式会社 Image processing device, image processing method, and endoscope system
JP6420492B2 (en) * 2015-09-28 2018-11-07 富士フイルム株式会社 Image processing apparatus, endoscope system, and method of operating image processing apparatus
WO2017057572A1 (en) * 2015-09-29 2017-04-06 富士フイルム株式会社 Image processing device, endoscopic system, and image processing method
EP3357405A4 (en) * 2015-09-29 2018-11-07 FUJI-FILM Corporation Image processing device, endoscopic system, and image processing method
JP6580446B2 (en) 2015-10-09 2019-09-25 サイバネットシステム株式会社 Image processing apparatus and image processing method
WO2018020558A1 (en) * 2016-07-25 2018-02-01 オリンパス株式会社 Image processing device, image processing method, and program
EP3590413A4 (en) * 2017-03-01 2020-03-25 Fujifilm Corporation Endoscope system and method for operating same
CN110381807B (en) * 2017-03-03 2022-01-18 富士胶片株式会社 Endoscope system, processor device, and method for operating endoscope system
JP6834019B2 (en) * 2017-10-30 2021-02-24 富士フイルム株式会社 Medical image processing equipment and endoscopic equipment
CN111295127B (en) * 2017-10-31 2022-10-25 富士胶片株式会社 Examination support device, endoscope device, and recording medium
JP6889282B2 (en) * 2017-12-22 2021-06-18 富士フイルム株式会社 Medical image processing equipment and methods, endoscopic systems, processor equipment, diagnostic support equipment and programs
WO2019142243A1 (en) * 2018-01-16 2019-07-25 オリンパス株式会社 Image diagnosis support system and image diagnosis support method
EP3806101A4 (en) * 2018-05-28 2021-07-21 FUJIFILM Corporation Training data collecting device, training data collecting method and program, training system, trained model, and endoscope image processing device

Similar Documents

Publication Publication Date Title
JP2020089710A5 (en)
JP2020089712A5 (en)
US10664968B2 (en) Computer aided diagnosis apparatus and method based on size model of region of interest
JP6222228B2 (en) Image processing apparatus and program
JP2020073081A5 (en)
US20190261957A1 (en) Methods and apparatus for tele-medicine
JP6877486B2 (en) Information processing equipment, endoscope processors, information processing methods and programs
JP2020089711A5 (en) Model generation method, teacher data generation method, and program
JP2016509913A5 (en)
WO2018198327A1 (en) Endoscope diagnosis assist system, endoscope diagnosis assist program, and endoscope diagnosis assist method
JP2015228954A5 (en)
JP6916876B2 (en) Ultrasound imaging device with image selector
EP3592242B1 (en) Blood vessel obstruction diagnosis apparatus
US20170091914A1 (en) Method and system for enhanced visualization of lung sliding by automatically detecting and highlighting lung sliding in images of an ultrasound scan
JP2014171556A5 (en) Medical image diagnostic apparatus, medical image processing apparatus, and control program
JP2015173856A (en) Image processing apparatus and program
JP2014083266A5 (en)
JP7270658B2 (en) Image recording device, method of operating image recording device, and image recording program
JP6821048B2 (en) Image processing device, trained model generation method, and evaluation device
JP7196908B2 (en) Ophthalmic image processing device and ophthalmic image processing program
JPWO2020116351A5 (en)
JP2019208851A5 (en)
JP2020058629A5 (en)
JP2020522334A (en) System and method for identifying and navigating anatomical objects using deep learning networks
JP7183451B2 (en) Systems, devices, and methods for assisting in neck ultrasound