JP2020089710A5 - - Google Patents
Download PDFInfo
- Publication number
- JP2020089710A5 JP2020089710A5 JP2019100647A JP2019100647A JP2020089710A5 JP 2020089710 A5 JP2020089710 A5 JP 2020089710A5 JP 2019100647 A JP2019100647 A JP 2019100647A JP 2019100647 A JP2019100647 A JP 2019100647A JP 2020089710 A5 JP2020089710 A5 JP 2020089710A5
- Authority
- JP
- Japan
- Prior art keywords
- prediction
- output
- image
- model
- acquired
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003902 lesions Effects 0.000 claims description 15
- 201000010099 disease Diseases 0.000 claims description 14
- 230000000875 corresponding Effects 0.000 claims description 5
- 238000003745 diagnosis Methods 0.000 claims description 3
- 238000010801 machine learning Methods 0.000 claims 2
- 238000000034 method Methods 0.000 claims 2
- 238000001839 endoscopy Methods 0.000 claims 1
- 238000003672 processing method Methods 0.000 claims 1
Description
情報処理装置は、内視鏡画像を取得する画像取得部と、病変領域の内視鏡画像が入力された場合に疾病の診断基準に関する診断基準予測を出力する第1モデルに、前記画像取得部が取得した内視鏡画像を入力して、出力される診断基準予測を取得する第1取得部と、前記第1取得部が取得した診断基準予測を、前記内視鏡画像に基づいて取得した前記疾病の状態に関する診断予測と関連づけて出力する出力部とを備え、前記診断予測は、内視鏡画像が入力された場合に前記疾病が含まれる病変領域に関する領域予測を出力する第2モデルに、前記画像取得部が取得した内視鏡画像を入力して、出力された病変領域に関する領域予測であり、前記第1取得部は、前記画像取得部が取得した内視鏡画像のうち前記第2モデルから出力された領域予測に対応する部分を前記第1モデルに入力して、出力される診断基準予測を取得する。 The information processing apparatus includes an image acquisition unit that acquires an endoscopic image and a first model that outputs a diagnostic standard prediction regarding a diagnostic standard of a disease when an endoscopic image of a lesion area is input. The first acquisition unit that inputs the endoscopic image acquired by the patient and acquires the output diagnostic standard prediction, and the diagnostic standard prediction acquired by the first acquisition unit are acquired based on the endoscopic image. It is provided with an output unit that outputs in association with the diagnosis prediction regarding the state of the disease, and the diagnosis prediction is a second model that outputs the area prediction regarding the lesion area including the disease when an endoscopic image is input. , The endoscopic image acquired by the image acquisition unit is input and the area is predicted regarding the output lesion region, and the first acquisition unit is the first of the endoscopic images acquired by the image acquisition unit. The portion corresponding to the region prediction output from the two models is input to the first model, and the output diagnostic reference prediction is acquired.
Claims (12)
病変領域の内視鏡画像が入力された場合に疾病の診断基準に関する診断基準予測を出力する第1モデルに、前記画像取得部が取得した内視鏡画像を入力して、出力される診断基準予測を取得する第1取得部と、
前記第1取得部が取得した診断基準予測を、前記内視鏡画像に基づいて取得した前記疾病の状態に関する診断予測と関連づけて出力する出力部とを備え、
前記診断予測は、内視鏡画像が入力された場合に前記疾病が含まれる病変領域に関する領域予測を出力する第2モデルに、前記画像取得部が取得した内視鏡画像を入力して、出力された病変領域に関する領域予測であり、
前記第1取得部は、前記画像取得部が取得した内視鏡画像のうち前記第2モデルから出
力された領域予測に対応する部分を前記第1モデルに入力して、出力される診断基準予測
を取得する
情報処理装置。 An image acquisition unit that acquires endoscopic images,
Diagnostic criteria output by inputting the endoscopic image acquired by the image acquisition unit into the first model that outputs the diagnostic criteria prediction regarding the diagnostic criteria of the disease when the endoscopic image of the lesion area is input. The first acquisition part to acquire the forecast and
It is provided with an output unit that outputs the diagnostic reference prediction acquired by the first acquisition unit in association with the diagnostic prediction regarding the state of the disease acquired based on the endoscopic image .
The diagnostic prediction is output by inputting the endoscopic image acquired by the image acquisition unit into the second model that outputs the area prediction regarding the lesion region including the disease when the endoscopic image is input. Area prediction for the affected lesion area
The first acquisition unit is output from the second model of the endoscopic images acquired by the image acquisition unit.
Diagnostic criteria prediction output by inputting the part corresponding to the forceed area prediction into the first model
Information processing device to acquire .
請求項1に記載の情報処理装置。 The information processing according to claim 1, wherein the first acquisition unit acquires diagnostic standard predictions for each item from a plurality of first models that output diagnostic standard predictions for a plurality of items included in the diagnostic criteria for the disease. apparatus.
請求項1または請求項2に記載の情報処理装置。 The information processing device according to claim 1 or 2, wherein the first model is a learning model generated by machine learning.
請求項1または請求項2に記載の情報処理装置。 The information processing device according to claim 1 or 2, wherein the first model outputs a numerical value calculated based on an endoscopic image acquired by the image acquisition unit.
請求項1から請求項4のいずれか一つに記載の情報処理装置。 The information processing apparatus according to any one of claims 1 to 4, further comprising a first reception unit that receives an operation stop instruction of the first acquisition unit.
請求項1から請求項5のいずれか一つに記載の情報処理装置。 The second model is a learning model generated by machine learning.
The information processing device according to any one of claims 1 to 5 .
請求項1から請求項6のいずれか一つに記載の情報処理装置。 A second reception unit that receives an instruction to stop the acquisition of the diagnosis prediction is provided.
The information processing device according to any one of claims 1 to 6 .
請求項1から請求項7のいずれか一つに記載の情報処理装置。 The output unit also outputs an endoscopic image acquired by the image acquisition unit.
The information processing device according to any one of claims 1 to 7 .
前記出力部は、前記画像取得部による内視鏡画像の取得と同期して出力を行なう
請求項1から請求項8のいずれか一つに記載の情報処理装置。 The image acquisition unit acquires an endoscopic image taken during endoscopy in real time.
The information processing device according to any one of claims 1 to 8 , wherein the output unit outputs in synchronization with the acquisition of an endoscopic image by the image acquisition unit.
前記内視鏡接続部に接続された内視鏡から取得した映像信号に基づいて内視鏡画像を生
成する画像生成部と、
病変領域の内視鏡画像が入力された場合に疾病の診断基準に関する診断基準予測を出力する第1モデルに、前記画像生成部が取得した内視鏡画像を入力して、出力される診断基準予測を取得する第1取得部と、
前記第1取得部が取得した診断基準予測を、前記内視鏡画像に基づいて取得した前記疾病の状態に関する診断予測と関連づけて出力する出力部とを備え、
前記診断予測は、内視鏡画像が入力された場合に前記疾病が含まれる病変領域に関する領域予測を出力する第2モデルに、前記画像生成部が生成した内視鏡画像を入力して、出力された病変領域に関する領域予測であり、
前記第1取得部は、前記画像生成部が生成した内視鏡画像のうち前記第2モデルから出
力された領域予測に対応する部分を前記第1モデルに入力して、出力される診断基準予測
を取得する
内視鏡用プロセッサ。 An endoscope connection unit to which an endoscope is connected, an image generation unit that generates an endoscope image based on an image signal acquired from an endoscope connected to the endoscope connection unit, and an image generation unit.
Diagnostic criteria output by inputting the endoscopic image acquired by the image generator into the first model that outputs the diagnostic criteria prediction regarding the diagnostic criteria of the disease when the endoscopic image of the lesion area is input. The first acquisition part to acquire the forecast and
It is provided with an output unit that outputs the diagnostic reference prediction acquired by the first acquisition unit in association with the diagnostic prediction regarding the state of the disease acquired based on the endoscopic image .
The diagnostic prediction is output by inputting the endoscopic image generated by the image generation unit into the second model that outputs the area prediction regarding the lesion region including the disease when the endoscopic image is input. Area prediction for the affected lesion area
The first acquisition unit is output from the second model of the endoscopic images generated by the image generation unit.
Diagnostic criteria prediction output by inputting the part corresponding to the forceed area prediction into the first model
To get an endoscope processor.
内視鏡画像が入力された場合に疾病が含まれる病変領域に関する領域予測を出力する第2モデルに、取得した内視鏡画像を入力して、出力された病変領域に関する領域予測を取得し、
病変領域の内視鏡画像が入力された場合に前記疾病の診断基準に関する診断基準予測を出力する第1モデルに、取得した内視鏡画像のうち前記第2モデルから出力された領域予測に対応する部分を入力して、出力される診断基準予測を取得し、
取得した前記診断基準予測を、取得した前記領域予測と関連づけて出力する
処理をコンピュータに実行させる情報処理方法。 Get an endoscopic image and
When the endoscopic image is input, the acquired endoscopic image is input to the second model that outputs the area prediction for the lesion area including the disease, and the area prediction for the output lesion area is acquired.
First model for outputting the diagnostic criteria predictive diagnostic criteria for the disease if the endoscopic image of the lesion region is input, corresponding to the output region prediction from the second model of the endoscopic image acquired Enter the part to be output , get the output diagnostic criterion prediction,
An information processing method for executing the acquired diagnostic criteria predictive, acquisition was a process of outputting in association with the region predicted in the computer.
内視鏡画像が入力された場合に疾病が含まれる病変領域に関する領域予測を出力する第2モデルに、取得した内視鏡画像を入力して、出力された病変領域に関する領域予測を取得し、
病変領域の内視鏡画像が入力された場合に前記疾病の診断基準に関する診断基準予測を出力する第1モデルに、取得した内視鏡画像のうち前記第2モデルから出力された領域予測に対応する部分を入力して、出力される診断基準予測を取得し、
取得した前記診断基準予測を、取得した前記領域予測と関連づけて出力する
処理をコンピュータに実行させるプログラム。 Get an endoscopic image and
When the endoscopic image is input, the acquired endoscopic image is input to the second model that outputs the area prediction for the lesion area including the disease, and the area prediction for the output lesion area is acquired.
First model for outputting the diagnostic criteria predictive diagnostic criteria for the disease if the endoscopic image of the lesion region is input, corresponding to the output region prediction from the second model of the endoscopic image acquired Enter the part to be output , get the output diagnostic criterion prediction,
The obtained the diagnostic criteria predictive, acquisition and said program for executing a process of outputting in association with domain prediction to a computer.
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/252,942 US20210407077A1 (en) | 2018-12-04 | 2019-11-13 | Information processing device and model generation method |
CN201980043891.XA CN112399816B (en) | 2018-12-04 | 2019-11-13 | Information processing apparatus and model generation method |
DE112019006011.2T DE112019006011T5 (en) | 2018-12-04 | 2019-11-13 | INFORMATION PROCESSING DEVICE AND MODEL GENERATION METHOD |
CN202410051899.3A CN117814732A (en) | 2018-12-04 | 2019-11-13 | Model generation method |
PCT/JP2019/044578 WO2020116115A1 (en) | 2018-12-04 | 2019-11-13 | Information processing device and model generation method |
JP2021075220A JP7155330B2 (en) | 2018-12-04 | 2021-04-27 | Information processing device, endoscope processor, information processing method and program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201862775197P | 2018-12-04 | 2018-12-04 | |
US62/775,197 | 2018-12-04 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2021075220A Division JP7155330B2 (en) | 2018-12-04 | 2021-04-27 | Information processing device, endoscope processor, information processing method and program |
Publications (3)
Publication Number | Publication Date |
---|---|
JP2020089710A JP2020089710A (en) | 2020-06-11 |
JP2020089710A5 true JP2020089710A5 (en) | 2021-01-14 |
JP6877486B2 JP6877486B2 (en) | 2021-05-26 |
Family
ID=71011993
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2019100648A Active JP7015275B2 (en) | 2018-12-04 | 2019-05-29 | Model generation method, teacher data generation method, and program |
JP2019100647A Active JP6877486B2 (en) | 2018-12-04 | 2019-05-29 | Information processing equipment, endoscope processors, information processing methods and programs |
JP2019100649A Active JP6872581B2 (en) | 2018-12-04 | 2019-05-29 | Information processing equipment, endoscope processors, information processing methods and programs |
JP2021075220A Active JP7155330B2 (en) | 2018-12-04 | 2021-04-27 | Information processing device, endoscope processor, information processing method and program |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2019100648A Active JP7015275B2 (en) | 2018-12-04 | 2019-05-29 | Model generation method, teacher data generation method, and program |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2019100649A Active JP6872581B2 (en) | 2018-12-04 | 2019-05-29 | Information processing equipment, endoscope processors, information processing methods and programs |
JP2021075220A Active JP7155330B2 (en) | 2018-12-04 | 2021-04-27 | Information processing device, endoscope processor, information processing method and program |
Country Status (3)
Country | Link |
---|---|
JP (4) | JP7015275B2 (en) |
CN (1) | CN112399816B (en) |
DE (1) | DE112019006011T5 (en) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP7440388B2 (en) | 2020-09-28 | 2024-02-28 | 株式会社日立製作所 | Image diagnosis support device and image processing method |
KR102253398B1 (en) * | 2020-11-19 | 2021-05-18 | 주식회사 웨이센 | Method for providing user interface through artificial intelligence-based image processing and user events, and image receiving apparatus using the method |
WO2022114357A1 (en) * | 2020-11-25 | 2022-06-02 | 주식회사 아이도트 | Image diagnosis system for lesion |
KR102268771B1 (en) * | 2020-11-26 | 2021-06-24 | 주식회사 웨이센 | Method for providing a user interface using the data receiving apparatus based on the image processing of the AI and Apparatus for using the same |
KR102505791B1 (en) * | 2021-01-11 | 2023-03-03 | 한림대학교 산학협력단 | Control method, apparatus, and program of lesion determination system acquired through real-time image |
JP7413295B2 (en) * | 2021-02-05 | 2024-01-15 | 株式会社日立製作所 | Image processing device, image processing method and program |
WO2022200624A2 (en) * | 2021-03-26 | 2022-09-29 | Datawalk Spolka Akcyjna | Systems and methods for end-to-end machine learning with automated machine learning explainable artificial intelligence |
WO2022250031A1 (en) * | 2021-05-24 | 2022-12-01 | アナウト株式会社 | Information processing device, information processing method, and computer program |
WO2023032317A1 (en) * | 2021-09-02 | 2023-03-09 | ソニーグループ株式会社 | Program, information processing device, and information processing method |
CN115206512B (en) * | 2022-09-15 | 2022-11-15 | 武汉大学人民医院(湖北省人民医院) | Hospital information management method and device based on Internet of things |
Family Cites Families (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE3823494C2 (en) * | 1988-07-11 | 1997-11-27 | En Versorgung Schwaben Ag | Method and device for furnace diagnosis and furnace control using the results thereof |
JPH08305855A (en) * | 1995-05-01 | 1996-11-22 | Nippon Telegr & Teleph Corp <Ntt> | Method and device for pattern recognition of image |
JPH08249300A (en) * | 1995-03-13 | 1996-09-27 | Minolta Co Ltd | Neural network and its forming method |
JP2000155840A (en) * | 1998-11-18 | 2000-06-06 | Olympus Optical Co Ltd | Image processing method |
JP2003126045A (en) | 2001-10-22 | 2003-05-07 | Olympus Optical Co Ltd | Diagnostic assistant system |
EP1394715A1 (en) * | 2002-08-02 | 2004-03-03 | Europroteome AG | An expert system for clinicial outcome prediction |
US7538761B2 (en) * | 2002-12-12 | 2009-05-26 | Olympus Corporation | Information processor |
JP2004188026A (en) * | 2002-12-12 | 2004-07-08 | Olympus Corp | Information processing system |
EP1636731A2 (en) | 2003-06-25 | 2006-03-22 | Siemens Medical Solutions USA, Inc. | Systems and methods for automated diagnosis and decision support for breast imaging |
JP2005124755A (en) * | 2003-10-22 | 2005-05-19 | Olympus Corp | Image processor for endoscope |
JP4451460B2 (en) * | 2007-03-16 | 2010-04-14 | オリンパス株式会社 | Endoscopic diagnosis support device |
JP5738720B2 (en) * | 2011-03-24 | 2015-06-24 | 日本メナード化粧品株式会社 | Melanin synthesis ability evaluation method and beauty advice method, and melanin synthesis ability evaluation system and beauty advice system using them |
JP6027803B2 (en) | 2012-07-17 | 2016-11-16 | Hoya株式会社 | Image processing apparatus and endoscope apparatus |
JP6027065B2 (en) * | 2014-08-21 | 2016-11-16 | 富士フイルム株式会社 | Similar image search device, method of operating similar image search device, and similar image search program |
WO2016121811A1 (en) * | 2015-01-29 | 2016-08-04 | 富士フイルム株式会社 | Image processing device, image processing method, and endoscope system |
JP6420492B2 (en) * | 2015-09-28 | 2018-11-07 | 富士フイルム株式会社 | Image processing apparatus, endoscope system, and method of operating image processing apparatus |
WO2017057572A1 (en) * | 2015-09-29 | 2017-04-06 | 富士フイルム株式会社 | Image processing device, endoscopic system, and image processing method |
EP3357405A4 (en) * | 2015-09-29 | 2018-11-07 | FUJI-FILM Corporation | Image processing device, endoscopic system, and image processing method |
JP6580446B2 (en) | 2015-10-09 | 2019-09-25 | サイバネットシステム株式会社 | Image processing apparatus and image processing method |
WO2018020558A1 (en) * | 2016-07-25 | 2018-02-01 | オリンパス株式会社 | Image processing device, image processing method, and program |
EP3590413A4 (en) * | 2017-03-01 | 2020-03-25 | Fujifilm Corporation | Endoscope system and method for operating same |
CN110381807B (en) * | 2017-03-03 | 2022-01-18 | 富士胶片株式会社 | Endoscope system, processor device, and method for operating endoscope system |
JP6834019B2 (en) * | 2017-10-30 | 2021-02-24 | 富士フイルム株式会社 | Medical image processing equipment and endoscopic equipment |
CN111295127B (en) * | 2017-10-31 | 2022-10-25 | 富士胶片株式会社 | Examination support device, endoscope device, and recording medium |
JP6889282B2 (en) * | 2017-12-22 | 2021-06-18 | 富士フイルム株式会社 | Medical image processing equipment and methods, endoscopic systems, processor equipment, diagnostic support equipment and programs |
WO2019142243A1 (en) * | 2018-01-16 | 2019-07-25 | オリンパス株式会社 | Image diagnosis support system and image diagnosis support method |
EP3806101A4 (en) * | 2018-05-28 | 2021-07-21 | FUJIFILM Corporation | Training data collecting device, training data collecting method and program, training system, trained model, and endoscope image processing device |
-
2019
- 2019-05-29 JP JP2019100648A patent/JP7015275B2/en active Active
- 2019-05-29 JP JP2019100647A patent/JP6877486B2/en active Active
- 2019-05-29 JP JP2019100649A patent/JP6872581B2/en active Active
- 2019-11-13 DE DE112019006011.2T patent/DE112019006011T5/en active Pending
- 2019-11-13 CN CN201980043891.XA patent/CN112399816B/en active Active
-
2021
- 2021-04-27 JP JP2021075220A patent/JP7155330B2/en active Active
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP2020089710A5 (en) | ||
JP2020089712A5 (en) | ||
US10664968B2 (en) | Computer aided diagnosis apparatus and method based on size model of region of interest | |
JP6222228B2 (en) | Image processing apparatus and program | |
JP2020073081A5 (en) | ||
US20190261957A1 (en) | Methods and apparatus for tele-medicine | |
JP6877486B2 (en) | Information processing equipment, endoscope processors, information processing methods and programs | |
JP2020089711A5 (en) | Model generation method, teacher data generation method, and program | |
JP2016509913A5 (en) | ||
WO2018198327A1 (en) | Endoscope diagnosis assist system, endoscope diagnosis assist program, and endoscope diagnosis assist method | |
JP2015228954A5 (en) | ||
JP6916876B2 (en) | Ultrasound imaging device with image selector | |
EP3592242B1 (en) | Blood vessel obstruction diagnosis apparatus | |
US20170091914A1 (en) | Method and system for enhanced visualization of lung sliding by automatically detecting and highlighting lung sliding in images of an ultrasound scan | |
JP2014171556A5 (en) | Medical image diagnostic apparatus, medical image processing apparatus, and control program | |
JP2015173856A (en) | Image processing apparatus and program | |
JP2014083266A5 (en) | ||
JP7270658B2 (en) | Image recording device, method of operating image recording device, and image recording program | |
JP6821048B2 (en) | Image processing device, trained model generation method, and evaluation device | |
JP7196908B2 (en) | Ophthalmic image processing device and ophthalmic image processing program | |
JPWO2020116351A5 (en) | ||
JP2019208851A5 (en) | ||
JP2020058629A5 (en) | ||
JP2020522334A (en) | System and method for identifying and navigating anatomical objects using deep learning networks | |
JP7183451B2 (en) | Systems, devices, and methods for assisting in neck ultrasound |