WO2021095446A1 - 情報表示システムおよび情報表示方法 - Google Patents

情報表示システムおよび情報表示方法 Download PDF

Info

Publication number
WO2021095446A1
WO2021095446A1 PCT/JP2020/039231 JP2020039231W WO2021095446A1 WO 2021095446 A1 WO2021095446 A1 WO 2021095446A1 JP 2020039231 W JP2020039231 W JP 2020039231W WO 2021095446 A1 WO2021095446 A1 WO 2021095446A1
Authority
WO
WIPO (PCT)
Prior art keywords
subject
image
information
displayed
control unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2020/039231
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
渡邉　幹緒
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujifilm Corp
Original Assignee
Fujifilm Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujifilm Corp filed Critical Fujifilm Corp
Priority to JP2021555959A priority Critical patent/JP7257544B2/ja
Publication of WO2021095446A1 publication Critical patent/WO2021095446A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045—Control thereof
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons

Definitions

  • the present invention relates to an information display system and an information display method for aggregating and displaying medical images and diagnostic information of a subject according to various modality.
  • medical images of a subject are imaged using various modalities such as an endoscopic diagnostic device and an ultrasonic diagnostic device, and a doctor makes a diagnosis based on the medical images captured by the various modalities. It has been.
  • an observation target in the body cavity of a subject is irradiated with illumination light from the endoscope, and the observation target irradiated with the illumination light is imaged by an imaging element of the endoscope to be observed.
  • An endoscopic image is generated and displayed on the monitor.
  • the doctor observes the endoscopic image displayed on the monitor picks up the area of interest that may be an abnormal part, distinguishes whether or not this area of interest is an abnormal part, and distinguishes it from the abnormal part. Treat the differentiated area and create a diagnostic report.
  • Patent documents 1 to 4 are prior art documents related to the present invention.
  • Patent Document 1 in an endoscopic surgical operation apparatus, a monitor screen, a main screen for displaying an observation image of an endoscope, and an image showing the hardness of a living tissue input from a hardness detection unit are provided. It is described that the first sub-screen to be displayed and the second sub-screen to display an image showing the impedance of the living tissue input from the impedance detection unit are divided into three parts.
  • Patent Document 2 describes photographed image data taken from a camera attached to the tip of a flexible endoscope in an endoscopic surgery support system, and a fault around a site to be treated by a subject obtained by the flexible endoscope. It is described that the image data is superimposed and displayed on the display.
  • Patent Document 3 describes that an ultrasonic image as a real-time image and an endoscopic image are divided and displayed in an ultrasonic / endoscopic composite system.
  • Patent Document 4 in a system having a medical image recording device, an electronic endoscope device, and the like, endoscopic observation image data, a report of inspection results, and the like are stored and connected in the medical image recording device 1. It is stated to share the data possessed by other medical devices.
  • the endoscopic image can be displayed on the monitor of the endoscopic diagnostic device, but the medical image and diagnostic information of the subject by other modalities can be displayed on the monitor of the endoscopic diagnostic device.
  • the medical image and diagnostic information of the subject by other modalities can be displayed on the monitor of the endoscopic diagnostic device.
  • a doctor when observing an endoscopic image, a doctor observes the endoscopic image using the monitor of the endoscopic diagnostic device, and when observing the ultrasonic image, uses the monitor of the ultrasonic diagnostic device. I am observing an ultrasound image.
  • the diagnostic report is browsed by using the monitor of the external system in the external system that stores and manages the diagnostic information of the subject. Is being created.
  • doctors could not aggregate and observe medical images and diagnostic information of subjects with various modality, for example, on the monitor of an endoscopic diagnostic device.
  • the doctor confirms the diagnostic information of the subject in advance on the monitor, and depending on the progress of the examination of the subject, the endoscopic diagnostic apparatus. It was not possible to change the content displayed on the monitor during the inspection by.
  • a first object of the present invention is to aggregate and display medical images and diagnostic information of a subject by various modality in one place, and to change the displayed contents according to the progress of the examination of the subject.
  • the purpose is to provide an information display system and an information display method that can be used.
  • the second object of the present invention is, in addition to the above-mentioned first object, it is possible to display important information so that the user can easily recognize it even when a large amount of information is aggregated and displayed.
  • the purpose is to provide an information display system and an information display method.
  • the present invention includes a medical image acquisition unit that acquires a medical image of a subject from one or more modality, and a medical image acquisition unit.
  • a monitor A display control unit for displaying a medical image of a subject in at least one of two or more divided regions in which a display screen of a monitor is divided is provided.
  • the display control unit provides an information display system that changes the content of the medical image of the subject to be displayed on the monitor according to the progress of the examination of the subject.
  • the display control unit displays the diagnostic information of the subject on the monitor, or displays at least one of the medical image of the subject and the diagnostic information of the subject in at least one of two or more divided regions, and the subject is displayed. It is preferable to change the contents of the medical image of the subject and the diagnostic information of the subject to be displayed on the monitor according to the progress of the examination.
  • the medical image of the subject includes the current endoscopic image of the subject.
  • the examination of the subject preferably includes a preparation stage, an endoscope insertion stage, a focus area pick-up stage, a focus area discrimination / treatment stage, and a diagnostic report preparation stage.
  • the display control unit displays at least one of the patient information of the subject and the past diagnostic report of the subject on the monitor in the preparation stage.
  • the display control unit displays the current endoscopic image of the subject in one of the two or more divided regions at the stage of inserting the endoscope, and the past endoscopic image of the subject. , At least one of the biological information of the subject, the insertion shape of the endoscope in the body cavity of the subject, and the support information for moving the endoscope in the body cavity of the subject among two or more divided regions. It is preferable to display it in at least one of the other divided regions.
  • the display control unit displays the biological information of the subject including the heart rate value and the blood pressure value in one of the other divided regions, and at least one of the heart rate value and the blood pressure value sets the upper limit value during the examination of the subject.
  • an arrow pointing to the biological information of the subject is indicated by a division region other than one of the other division regions in which the biological information of the subject is displayed. It is preferable to display on.
  • a region of interest estimation unit that estimates the presence or absence of the region of interest and the position of the region of interest from the current endoscopic image of the subject.
  • the display control unit displays the current endoscopic image of the subject in one of the two or more divided regions at the stage of picking up the region of interest, and among the current endoscopic images of the subject.
  • the blue narrow-band light image in which the vascular structure of the mucosal surface layer in the current endoscopic image of the subject, which is imaged by irradiating the subject with white light and blue narrow-band light is used as a region of interest. It is equipped with an abnormal part discrimination part that distinguishes whether or not the estimated part is presumed to be an abnormal part, the position of the part presumed to be an abnormal part, and the probability of being presumed to be an abnormal part.
  • the display control unit displays the current endoscopic image of the subject in one of two or more divided regions at the stage of discrimination / treatment of the region of interest, and is presumed to be an abnormal region.
  • At least the image showing the position of the part, the probability that the part identified as the abnormal part is estimated as the abnormal part, and the length measurement result showing the length of the part identified as the abnormal part It is preferable to display one in at least one of the other divided regions of the two or more divided regions.
  • the display control unit switches from the current endoscopic image of the subject to the image showing the oxygen saturation in the current endoscopic image of the subject in response to an instruction from the user, and divides the area into one. It is preferable to display it.
  • the display control unit displays an image showing the position of the part that has been identified as an abnormal part when it is identified as an abnormal part or in response to an instruction from the user. It is preferable to overlay the current endoscopic image for display.
  • the display control unit stops overlaying the image showing the position of the part identified as the abnormal part after a certain period of time or in response to the instruction from the user to present the subject. It is preferable to display the endoscopic image of.
  • the display control unit displays an image showing the position of the portion identified as an abnormal portion by surrounding it with a frame line.
  • the display control unit blinks the frame line at regular time intervals.
  • the display control unit indicates the position of the part identified as the abnormal part in the two or more divided regions with the arrow pointing to the image indicating the position of the part identified as the abnormal part. It is preferable to display the image to be displayed in a divided area other than one of the other divided areas in which the image to be represented is displayed.
  • the display control unit blinks the arrow at regular time intervals.
  • the display control unit receives an instruction from the user to start an examination, or an endoscope that outputs an image signal obtained by imaging the subject using illumination light processes the image signal and presents the subject.
  • an endoscope that outputs an image signal obtained by imaging the subject using illumination light processes the image signal and presents the subject.
  • the content displayed in the preparation stage is automatically changed to the content displayed in the insertion stage of the endoscope. It is preferable to switch to.
  • test information feedback unit that feeds back the diagnosis result of the subject, the test time, and test information including the equipment used to the external system.
  • the display control unit divides the display screen of the monitor into a first division area and one or more second division areas having a smaller area than the first division area, and acquires from one of the one or more modality.
  • the medical image of the subject is displayed in the first divided area, and at least one of the medical image of the subject acquired from one or more modality and the diagnostic information of the subject acquired from an external system is displayed as one or more. It is preferable to display it in at least one of the second division regions of the above.
  • the display control unit divides the display screen of the monitor into the first divided area and the two second divided areas, displays the medical image of the subject acquired from one modality in the first divided area, and 1 It is preferable to display at least one of the medical image of the subject acquired from the above modality and the diagnostic information of the subject acquired from the external system in at least one of the two second division regions.
  • the aspect ratio of the display screen of the monitor is 16: 9, and the aspect ratio of the first divided area and the two second divided areas is 5: 4. It is preferable that the first divided area is arranged from the left part to the center part of the display screen of the monitor, and the two second divided areas are arranged in the upper right part and the lower right part of the display screen of the monitor, respectively.
  • the present invention includes a step in which the medical image acquisition unit acquires a medical image of a subject from one or more modality.
  • the display control unit includes a step of displaying the medical image of the subject in at least one of two or more divided regions in which the display screen of the monitor is divided.
  • an information display method that changes the content of a medical image of a subject to be displayed on a monitor according to the progress of an examination of the subject.
  • the diagnostic information acquisition unit includes a step of acquiring diagnostic information of the subject from an external system.
  • the diagnostic information of the subject is displayed on the monitor, or at least one of the medical image of the subject and the diagnostic information of the subject is displayed in at least one of two or more divided regions, and the progress of the examination of the subject is displayed. It is preferable to change the contents of the medical image of the subject and the diagnostic information of the subject to be displayed on the monitor accordingly.
  • the medical image acquisition unit, the diagnostic information acquisition unit, the attention area estimation unit, the abnormality part discrimination unit, the display control unit, and the examination information feedback unit are preferably hardware or a processor that executes a program.
  • the present invention on a monitor having one modality, medical images and diagnostic information of subjects by various modality can be aggregated and observed. Further, according to the present invention, before observing the medical image of the subject, the diagnostic information of the subject can be confirmed in advance on the monitor, or at the time of the inspection by the modality according to the progress of the inspection of the subject. , You can change the content displayed on the monitor. Further, according to the present invention, even when a large amount of information is aggregated and displayed, it is possible to display important information so that the user can easily recognize it.
  • Embodiment shows the structure of the endoscopic diagnostic apparatus to which the information display system of this invention is applied. It is a block diagram of one Embodiment which shows the internal structure of the endoscope, the light source device and the processor device which the endoscope diagnostic apparatus has. 6 is a graph of an embodiment showing emission spectra of purple light V, blue light B, green light G, and red light R emitted from four-color LEDs. It is a conceptual diagram of one Embodiment which shows the display screen of a monitor. It is a conceptual diagram of one Embodiment which shows the procedure of examination of a subject by an endoscopic diagnostic apparatus.
  • Embodiment shows the display screen of a monitor in a preparatory stage. It is a conceptual diagram of one Embodiment which shows the display screen of a monitor in the insertion stage of an endoscope. It is a conceptual diagram of one Embodiment which shows the display screen of a monitor at the stage of picking up a region of interest. It is a conceptual diagram of one Embodiment which shows the display screen of the monitor at the stage of identification / treatment of a region of interest. It is a conceptual diagram of another embodiment which shows the display screen of the monitor in the stage of identification / treatment of a region of interest. It is a conceptual diagram of one Embodiment which shows the display screen of a monitor at the stage of creating a diagnostic report.
  • FIG. 5 is a conceptual diagram of another embodiment showing a display screen of a monitor for calling attention to a doctor.
  • FIG. 5 is a conceptual diagram of another embodiment showing a display screen of a monitor for calling attention to a doctor.
  • FIG. 1 is a conceptual diagram of an embodiment showing the configuration of an endoscopic diagnostic apparatus to which the information display system of the present invention is applied.
  • the endoscope diagnostic device 10 shown in FIG. 1 includes an endoscope 12, a light source device 14, a processor device 16, a monitor 18, and a console 19.
  • the endoscope 12 is optically connected to the light source device 14 and electrically connected to the processor device 16.
  • the endoscope 12 outputs an image signal obtained by imaging a subject using illumination light, and is provided at an insertion portion 12a inserted into the body cavity of the subject and a proximal end portion of the insertion portion 12a. It has an operation portion 12b, a curved portion 12c and a tip portion 12d provided on the tip end side of the insertion portion 12a.
  • the angle knob 12e of the operation unit 12b By operating the angle knob 12e of the operation unit 12b, the bending unit 12c bends. Along with this bending motion, the tip portion 12d is directed in a desired direction.
  • the operation unit 12b is provided with a mode switching SW (switch) 13a in addition to the angle knob 12e.
  • the mode switching SW13a is used for a switching operation between four types of modes: a normal observation mode, a first special observation mode, a second special observation mode, and a third special observation mode.
  • the normal observation mode is a mode for observing a normal image captured by irradiating the subject with white light as the current endoscopic image of the subject.
  • the first special observation mode as the current endoscopic image of the subject, the surface layer of the mucous membrane in the current endoscopic image of the subject is imaged by irradiating the subject with white light and blue narrow band light.
  • This mode is for observing a first special image (blue narrow band light image) in which the vascular structure is emphasized.
  • the blue narrow-band light is not limited to the narrow-band light in the blue wavelength range, and may be narrow-band light in the blue to purple wavelength range.
  • the second special observation mode is a normal part and an abnormal part in the current endoscopic image of the subject, which is generated as the current endoscopic image of the subject, for example, by performing color enhancement processing on the first special image.
  • This is a mode for observing a second special image (color-enhanced image) in which the color difference between the image and the image is emphasized.
  • the third special observation mode is a mode for observing a third special image (oxygen saturation image) showing the oxygen saturation of blood hemoglobin in a normal image as the current endoscopic image of the subject.
  • one or more special observation modes other than the first to third special observation modes may be further included.
  • FIG. 2 is a block diagram of an embodiment showing the internal configurations of the endoscope, the light source device, and the processor device included in the endoscope diagnostic device.
  • the light source device 14 outputs illumination light, and as shown in FIG. 2, V-LED (Violet Light Emitting Diode) 20a, B-LED (Blue Light Emitting Diode) 20b, and G-LED (Green Light Emitting). It is configured by using a four-color LED (light source) including Diode) 20c and R-LED (Red Light Emitting Diode) 20d, a light source control unit 21 that controls the drive of these four-color LEDs 20a to 20d, a dichroic mirror, and the like. It also has an optical path coupling portion 23 that combines the optical paths of the four colors of light emitted from the four color LEDs 20a to 20d.
  • FIG. 3 is a graph of an embodiment showing emission spectra of purple light V, blue light B, green light G, and red light R emitted from four-color LEDs.
  • the V-LED 20a generates purple light V having a center wavelength of 405 ⁇ 10 nm and a wavelength range of 380 to 420 nm.
  • the B-LED 20b generates blue light B having a center wavelength of 460 ⁇ 10 nm and a wavelength range of 420 to 500 nm.
  • the G-LED 20c generates green light G having a wavelength range of 480 to 600 nm.
  • the R-LED 20d generates red light R having a center wavelength of 620 to 630 nm and a wavelength range of 600 to 650 nm.
  • the light source control unit 21 lights all of, for example, V-LED20a, B-LED20b, G-LED20c, and R-LED20d. At that time, it is set so that the amount of emitted purple light V, which has a high absorption rate in the surface blood vessels, is relatively high, and the amount of emitted green light G, which has a high absorption rate in the middle layer blood vessels, is relatively low. , Purple light V, blue light B, green light G, and red light R are irradiated so that the light amount ratio of the four colors is a predetermined ratio.
  • the light source control unit 21 lights, for example, the B-LED20b, the G-LED20c, and the R-LED20d.
  • the light guide (LG) 41 is built in the endoscope 12 and the universal cord (the cord connecting the endoscope 12, the light source device 14, and the processor device 16).
  • the light guide 41 a multimode fiber can be used.
  • An illumination optical system 30a and an imaging optical system 30b are provided at the tip end portion 12d of the endoscope 12.
  • the illumination optical system 30a has an illumination lens 45, and the light coupled by the optical path coupling portion 23 is propagated to the tip portion 12d of the endoscope 12 via the light guide 41 and the illumination lens 45 to observe the inside of the subject.
  • the subject is irradiated.
  • the image pickup optical system 30b has an objective lens 46 and an image pickup sensor 48. The reflected light from the observation target enters the image sensor 48 via the objective lens 46, and the reflected image of the observation target is imaged on the image sensor 48.
  • the image pickup sensor 48 is a color image pickup sensor, which captures a reflected image of a subject and outputs an image signal.
  • a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal-Oxide Semiconductor) image sensor, or the like can be used as the image sensor 48.
  • the image sensor 48 is provided with a color image sensor for obtaining RGB image signals of three colors of R (red), G (green), and B (blue), that is, R pixels provided with an R filter and a G filter. It is an RGB imaging sensor having a G pixel and a B pixel provided with a B filter.
  • a CDS (Correlated Double Sampling) / AGC (Auto Gain Control) circuit 50 and an A / D (Analog / Digital) converter 52 are provided inside the endoscope 12.
  • the image signal output from the image sensor 48 is input to the CDS / AGC circuit 50.
  • the CDS / AGC circuit 50 performs correlated double sampling (CDS), automatic gain control (AGC), and the like on an image signal which is an analog signal.
  • the image signal that has passed through the CDS / AGC circuit 50 is converted from an analog image signal to a digital image signal by the A / D converter 52.
  • the A / D converted digital image signal is input to the processor device 16.
  • the processor device 16 is electrically connected to various modality 80s, an external system 82, and the like, as shown in FIG. 2, in addition to the monitor 18 and the console 19.
  • the processor device 16 processes an image signal to generate a current endoscopic image of the subject, and outputs medical images by various modalities 80 including the current endoscopic image of the subject.
  • a receiving unit 53 a DSP (Digital Signal Processor) 56, a noise removing unit 58, an image processing switching unit 60, a normal image processing unit 62, a special image processing unit 64, a video signal generation unit 66, and a medical image. It has an acquisition unit 68, a diagnostic information acquisition unit 70, a region of interest estimation unit 72, an abnormality unit discrimination unit 74, a display control unit 76, and an inspection information feedback unit 78.
  • DSP Digital Signal Processor
  • the medical image acquisition unit 68, the diagnostic information acquisition unit 70, the attention area estimation unit 72, the abnormality unit identification unit 74, the display control unit 76, the inspection information feedback unit 78, and the monitor 18 are embodiments of the information display system of the present invention.
  • the information display system acquires medical images of each subject (patient) from various modalities 80, and further acquires diagnostic information (medical information) of each subject from various external systems 82, and each of them acquires medical images. Display at least one of medical images and diagnostic information for the subject.
  • the receiving unit 53 receives an RGB image signal which is a digital signal from the endoscope 12.
  • the DSP 56 performs various signal processing such as defect correction processing, offset processing, gain correction processing, linear matrix processing, gamma conversion processing, and demosaic processing on the received image signal.
  • defect correction process the signal of the defective pixel of the image sensor 48 is corrected.
  • offset processing the dark current component is removed from the RGB image signal subjected to the defect correction processing, and an accurate zero level is set.
  • gain correction process the signal level is adjusted by multiplying the RGB image signal after the offset process by a specific gain.
  • the RGB image signal after the gain correction processing is subjected to linear matrix processing for improving color reproducibility. After that, the brightness and saturation are adjusted by the gamma conversion process.
  • the RGB image signal after the linear matrix processing is subjected to demosaic processing (also referred to as isotropic processing or simultaneous processing), and a signal of a color lacking in each pixel is generated by interpolation.
  • demosaic processing also referred to as isotropic processing or simultaneous processing
  • all the pixels have RGB signals of each color.
  • the noise removing unit 58 removes noise from the RGB image signal by performing noise removing processing such as a moving average method and a median filter method on the RGB image signal that has been gamma-corrected by the DSP 56.
  • the RGB image signal from which noise has been removed is input to the image processing switching unit 60.
  • the RGB image signal is input to the normal image processing unit 62, and the first special observation mode, the second special observation mode, or the normal observation mode, or When the third special observation mode is set, the RGB image signal is switched to be input to the special image processing unit 64.
  • the normal image processing unit 62 performs color conversion processing, color enhancement processing, structure enhancement processing, and the like on the RGB image signal.
  • the digital RGB image signal is converted into an RGB image signal that has undergone color conversion processing by performing 3 ⁇ 3 matrix processing, gradation conversion processing, three-dimensional LUT processing, and the like.
  • various color enhancement processes are performed on the RGB image signal that has undergone the color conversion process.
  • Structural enhancement processing such as spatial frequency enhancement is performed on the RGB image signal that has undergone color enhancement processing.
  • the RGB image signal subjected to the structure enhancement processing is input from the normal image processing unit 62 to the video signal generation unit 66 as an RGB image signal of a normal image.
  • the special image processing unit 64 operates when the first special observation mode, the second special observation mode, or the third special observation mode is set.
  • the special image processing unit 64 is for the first special image processing unit 64a that performs image processing for the first special image on the RGB image signal to generate the first special image, and for the second special image. It has a second special image processing unit 64b that performs image processing to generate a second special image, and a third special image processing unit 64c that performs image processing for the third special image to generate a third special image. ..
  • the first special image processing unit 64a colors the RGB image signal of the first special image captured by irradiating the subject with white light and blue narrow band light, for example, in the same manner as the normal image processing unit 62.
  • a conversion process, a color enhancement process, a structure enhancement process, and the like are performed to generate a blue narrow band optical image (first special image) in which the vascular structure of the mucosal surface layer of the subject is emphasized.
  • the second special image processing unit 64b calculates, for example, the signal ratio B / G ratio between the G image signal and the B image signal of the RGB image signal of the first special image, and the signal ratio G between the R image signal and the G image signal. Calculate the / R ratio so that the saturation and hue of the first range where the normal mucous membrane is distributed are the same with respect to the signal ratio B / G and the signal ratio G / R, and the first range and the abnormal part So that at least one of the difference in saturation from the second range in which is distributed and the difference in hue between the first range and the third range in which deep blood vessels existing under the abnormal part are distributed becomes large, for example.
  • the third special image processing unit 64c images by alternately irradiating the first blue light B1, the green light G1 and the red light R1 and the second blue light B2, the green light G2 and the red light R2.
  • From the RGB image signals of the two types of endoscopic images for example, the signal ratio B1 / G2 of the B1 image signal and the G2 image signal, the signal ratio R2 / G2 of the R2 image signal and the G2 image signal, and the G2 image signal and B2.
  • the signal ratio G2 / B2 of the image signal is calculated, and the LUT (Look Up Table) that stores the correlation between these signal ratios and oxygen saturation is referred to, and the blood of the subject is used from the signal ratio.
  • the oxygen saturation of hemoglobin is calculated, and an oxygen saturation image (third special image) that images the oxygen saturation is generated.
  • the RGB image signals of the first special image, the second special image, and the third special image generated by the special image processing unit 64 are input to the video signal generation unit 66.
  • the video signal generation unit 66 converts the RGB image signal input from the normal image processing unit 62 or the special image processing unit 64 into a video signal for displaying as an image that can be displayed on the monitor 18.
  • the video signal is input to the medical image acquisition unit 68 as an endoscopic image (medical image).
  • the medical image acquisition unit 68 acquires a medical image (still image or moving image) of the subject including the current endoscopic image of the subject from one or more modality 80 including the endoscopic diagnostic apparatus 10.
  • the medical image acquisition unit 68 may acquire the medical image of the subject from only one modality, or may acquire the medical image of the subject from two or more modality.
  • the medical image of the subject output from the medical image acquisition unit 68 is input to the attention area estimation unit 72, the abnormal part discrimination unit 74, the display control unit 76, and the examination information feedback unit 78.
  • the modality 80 is various medical devices that capture medical images of a subject, for example, an endoscopic diagnostic device, an ultrasonic diagnostic device, an ultrasonic endoscopic diagnostic device, an X-ray imaging device, and a computed tomography apparatus (CT). ) And magnetic resonance imaging (MRI) and the like. Further, the modality 80 includes a device for acquiring biological information of the subject, a device for acquiring the insertion shape of the endoscope 12 in the body cavity of the subject, and moving the endoscope 12 in the body cavity of the subject. A device or the like for acquiring support information for the purpose may be included.
  • the device for acquiring the biological information of the subject is, for example, a heart rate monitor for acquiring the heart rate value of the subject, a sphygmomanometer for acquiring the blood pressure value of the subject, and the like.
  • the device for acquiring the insertion shape of the endoscope 12 is, for example, an endoscope insertion shape observation device for acquiring the three-dimensional insertion shape of the endoscope 12 in the body cavity of the subject in real time by using magnetism or the like.
  • the device for acquiring the support information is, for example, a learning endoscope image, the name of the organ displayed in the learning endoscope image, the range of the organ (also referred to as an area or a boundary), and the tip of the endoscope 12.
  • the diagnostic endoscopic image of the subject is displayed on the diagnostic endoscopic image. It is a device that estimates the name of an organ, the range of the organ, the position and orientation of the tip portion 12d of the endoscope 12, and acquires such information as the above-mentioned support information.
  • the modality 80 includes, for example, a medical image management system (PACS: Picture Archiving and Communication Systems) that stores and manages medical images of subjects imaged by various modality 80s, and an insertion unit 12a of the endoscope 12.
  • a medical image management system (PACS: Picture Archiving and Communication Systems) that stores and manages medical images of subjects imaged by various modality 80s, and an insertion unit 12a of the endoscope 12.
  • Modality other than the above may be included, such as a device for acquiring the state of expansion and contraction of a double balloon used by being attached to the system.
  • the learning method is not particularly limited as long as it can learn the above relationship from a plurality of learning endoscopic images and generate a trained model.
  • a learning method for example, deep learning (deep learning) using a hierarchical neural network as an example of machine learning (machine learning), which is one of the technologies of artificial intelligence (AI), is used. be able to.
  • machine learning other than deep learning may be used, artificial intelligence technology other than machine learning may be used, or learning methods other than artificial intelligence technology may be used. The same applies to the training methods of other trained models described below.
  • the diagnostic information acquisition unit 70 acquires diagnostic information of the subject from the external system 82.
  • the diagnostic information of the subject output from the diagnostic information acquisition unit 70 is input to the display control unit 76.
  • the external system 82 provides diagnostic information of a subject to an information display system and is used by a doctor to create a diagnostic report.
  • IT Information
  • Technology Information technology
  • the diagnostic information of the subject includes the patient information of the subject (information such as name, address, contact information, etc.), the diagnostic report (information such as medical condition, contraindication information, doctor's findings, progress information, etc.).
  • the attention area estimation unit 72 estimates the presence / absence of the attention area, the position of the attention area, and the like from the current medical image of the subject, for example, a normal image (endoscopic image).
  • the estimation result of the region of interest estimation unit 72 is input to the abnormality portion discrimination unit 74 and the display control unit 76.
  • the area of interest is the part of the subject that may not be the normal part, that is, the part of the subject that may be the abnormal part.
  • the attention area estimation unit 72 describes, for example, the relationship between the learning endoscope image and the presence / absence of the attention area and the position of the attention area displayed in the learning endoscope image in a plurality of learning endoscope images. From the diagnostic endoscopic image of the subject, the presence or absence of the region of interest and the position of the region of interest displayed in this diagnostic endoscopic image can be estimated based on the trained model learned about.
  • the method by which the attention region estimation unit 72 estimates the presence / absence of the attention region, the position of the attention region, and the like from the current medical image of the subject is not particularly limited.
  • the abnormal part discrimination unit 74 determines whether or not the part presumed to be the region of interest is presumed to be the abnormal part from the current medical image of the subject, for example, the first special image, the position of the part presumed to be the abnormal part, and Distinguish the probability of being an abnormal part.
  • the discrimination result of the abnormal part discrimination unit 74 is input to the display control unit 76.
  • the abnormal part discrimination unit 74 determines, for example, whether or not the learning endoscopic image and the portion presumed to be the region of interest displayed in the learning endoscopic image are presumed to be an abnormal part, or presumed to be an abnormal part. For this diagnosis from the diagnostic endoscopic image of the subject based on the learned model in which the relationship between the position of the site and the estimated probability of the abnormal part was learned for multiple learning endoscopic images. It is possible to distinguish whether or not the part estimated to be the region of interest displayed in the endoscopic image is an abnormal part, the position of the part estimated to be an abnormal part, and the probability of being estimated to be an abnormal part. ..
  • the abnormal part discrimination unit 74 determines whether or not the part presumed to be the region of interest is presumed to be the abnormal part from the medical image such as the endoscopic image, and the position and the abnormal part of the part presumed to be the abnormal part.
  • the method of discriminating the estimated probability and the like is not particularly limited.
  • the display control unit 76 controls the monitor 18 to display the medical image of the subject, the diagnostic information of the subject, the estimation information of the region of interest, the identification information of the abnormal portion, and the like.
  • the medical image of the subject, the diagnostic information of the subject, the estimation information of the region of interest, the identification information of the abnormal portion, and the like output from the display control unit 76 are input to the monitor 18.
  • the display control unit 76 displays the medical image of the subject on the monitor 18 without dividing the display screen of the monitor 18, or divides the medical image of the subject into two or more divided display screens of the monitor 18. It can be displayed in at least one of the areas. In this case, the display control unit 76 can sequentially change the content of the medical image of the subject to be displayed on the display screen of the monitor 18 or the divided area according to the progress of the examination of the subject.
  • the number, area, aspect ratio, arrangement, etc. of the divided regions are not particularly limited.
  • the display control unit 76 displays the medical image or diagnostic information of the subject on the monitor 18 without dividing the display screen of the monitor 18, for example, or displays at least one of the medical image and the diagnostic information of the subject on the monitor 18. It can be displayed in at least one of two or more divided areas. In this case, the display control unit 76 can sequentially change the contents of the medical image and the diagnostic information of the subject to be displayed on the display screen of the monitor 18 or the divided area according to the progress of the examination of the subject.
  • the test information feedback unit 78 feeds back the test information including the diagnosis result of the subject by the doctor, the test time, the equipment used, etc. to the external system 82 at the stage of creating the diagnosis report.
  • the test information is not particularly limited as long as it is information related to the test of the subject, and may include various information other than the above, for example, a medical image of the subject.
  • the diagnostic report is a medical examination record of a subject created by a doctor (user) based on examination information and medical images by various modalities 80, and is a medical condition, contraindication information, doctor's findings on the medical condition, and a subject. The treatment for the patient, the progress information of the subject, etc. are recorded.
  • the monitor 18 is, for example, a display device such as a liquid crystal display, and under the control of the display control unit 76, displays medical images of the subject, diagnostic information of the subject, estimation information of the region of interest, identification information of the abnormal portion, and the like.
  • the console 19 is an input device for inputting instructions from a doctor, such as a keyboard and a mouse, and functions as a UI (User Interface) that accepts input operations such as function settings.
  • a doctor such as a keyboard and a mouse
  • UI User Interface
  • the mode switching SW13a sets the normal observation mode, and the insertion portion 12a of the endoscope 12 is inserted into the sample.
  • the V-LED20a, B-LED20b, G-LED20c, and R-LED20d are all lit by the light source control unit 21.
  • the four colors of light emitted from the LEDs 20a to 20d are combined by the optical path coupling portion 23, and the four colors of purple light V, blue light B, green light G, and red light R are mixed to be almost white. It becomes light and is irradiated to the observation target in the subject through the light guide 41 and the illumination lens 45.
  • the reflected light from the observation target is incident on the image sensor 48 via the objective lens 46, and the reflected image of the observation target is imaged on the image sensor 48.
  • the image signal output from the image sensor 48 is converted into a digital image signal by the A / D converter 52 via the CDS / AGC circuit 50.
  • the A / D converted digital image signal is input to the processor device 16 and received by the receiving unit 53.
  • the digital image signal received by the receiving unit 53 is subjected to various signal processing by the DSP 56 to be an RGB image signal of a normal image, and is subjected to noise removal processing by the noise removing unit 58 to be an RGB image signal of the normal image. Noise is removed from.
  • the RGB image signal of the normal image from which noise has been removed is input to the normal image processing unit 62 by the image processing switching unit 60, and image processing for the normal image is performed by the normal image processing unit 62.
  • the RGB image signal of the normal image that has undergone image processing is converted into a video signal for display as a normal image by the video signal generation unit 66.
  • the light source control unit 21 lights all of, for example, the V-LED20a, B-LED20b, G-LED20c, and R-LED20d. At that time, the amount of light emitted from purple light V, which has a high absorption rate in the surface blood vessels, is set to be relatively high, and the amount of light emitted from green light G, which has a high absorption rate into middle layer blood vessels, is set to be relatively low. , Purple light V, blue light B, green light G, and red light R are irradiated so that the light amount ratio of the four colors is a predetermined ratio.
  • the noise removal unit 58 After that, the operation until the noise removal processing is performed by the noise removal unit 58 is the same as in the normal observation mode, and the noise removal unit 58 outputs the RGB image signal of the first special image from which the noise has been removed. It is output.
  • the RGB image signal of the first special image from which noise has been removed is input to the first special image processing unit 64a by the image processing switching unit 60, and the image processing for the first special image is performed by the first special image processing unit 64a. Is given.
  • the RGB image signal of the first special image that has undergone image processing is converted into a video signal for display as the first special image by the video signal generation unit 66.
  • the operation until the image processing for the first special image is performed by the first special image processing unit 64a is the same as in the case of the first special observation mode.
  • the first special image processing unit 64a outputs an RGB image signal of the first special image that has undergone image processing.
  • the RGB image signal of the first special image that has undergone image processing is subjected to image processing for the second special image by the second special image processing unit 64b, and is used as the RGB image signal of the second special image.
  • the RGB image signal of the second special image is converted into a video signal to be displayed as the second special image by the video signal generation unit 66.
  • the light source control unit 21 lights, for example, the B-LED20b, the G-LED20c, and the R-LED20d. At that time, the irradiation of the first blue light B1, the green light G1 and the red light R1 and the irradiation of the second blue light B2, the green light G2 and the red light R2 are alternately repeated at regular intervals. After that, the operation until the noise removal processing is performed by the noise removal unit 58 is the same as in the case of the normal observation mode, and the noise removal unit 58 shows RGB of the two types of endoscopic images from which noise has been removed. An image signal is output.
  • the RGB image signals of the two types of endoscopic images from which noise has been removed are input to the third special image processing unit 64c by the image processing switching unit 60, and for the third special image by the third special image processing unit 64c. Image processing is applied.
  • the RGB image signal of the third special image that has undergone image processing is converted into a video signal for display as the third special image by the video signal generation unit 66.
  • the display control unit 76 can divide the display screen of the monitor 18 into a first division area and one or more second division areas having an area smaller than the first division area.
  • the display control unit 76 displays, for example, a medical image of the subject acquired from one modality of one or more modality 80s in the first division region, and the display control unit 76 displays the medical image of the subject acquired from one or more modality 80s.
  • At least one of the medical image of the subject and the diagnostic information of the subject acquired from the external system 82 can be displayed in at least one of the one or more second division regions.
  • FIG. 4 is a conceptual diagram of an embodiment showing a display screen of a monitor.
  • the display control unit 76 displays, for example, the display screen of the monitor 18 in a first divided area (Area 1) and two second divided areas (Area 2, Area 3) having an area smaller than that of the first divided area. ) Can be divided into three areas.
  • the display control unit 76 displays the medical image of the subject acquired from one of the one or more modality 80s in the first division region, and displays the medical image of the subject acquired from one or more modality 80s.
  • At least one of the medical image and the diagnostic information of the subject acquired from the external system 82 can be displayed in at least one of the two second division regions.
  • the display control unit 76 displays, among the diagnostic information of the subject, information that can be displayed as text information, for example, patient information of the subject, at the lower part of the display screen of the monitor 18. It can be displayed in the third divided area (Area 4) consisting of one or more lines extending in the horizontal direction.
  • the display screen of the monitor 18 is divided into four areas including a first divided area, two second divided areas, and a third divided area.
  • the display control unit 76 is, for example, the current normal state of the subject obtained from the endoscopic diagnostic apparatus 10. It is desirable to display the image in the first division area. As a result, the doctor observes the current normal image of the subject in a relatively large size on the monitor 18 of the endoscopic diagnostic apparatus 10 being used for the examination of the subject, and at the same time, the various modalities 80 are used. Medical images and diagnostic information of subjects can be viewed.
  • each divided area there is no particular limitation on what is displayed in each divided area.
  • medical images or diagnostic information of a subject by various modality 80 other than the endoscopic image may be displayed in the first divided region or may be displayed in the second divided region.
  • at least one of an endoscopic image other than the normal image for example, a first special image, a second special image, and a third special image may be displayed in the first divided area, or may be displayed in the second divided area. You may.
  • the aspect ratio of the display screen of the monitor 18 is 16 (horizontal): 9 (vertical)
  • the aspect ratio of the first divided area and the two second divided areas is 5 (horizontal): 4 (vertical).
  • the first divided area is arranged from the left part to the center part of the display screen of the monitor 18, and the two second divided areas are respectively arranged in the upper right part of the display screen of the monitor 18. And can be placed in the lower right corner.
  • the first divided area may be arranged from the central part to the right part of the display screen of the monitor 18, and the two second divided areas may be arranged in the upper left part and the lower left part of the display screen of the monitor 18, respectively. ..
  • the aspect ratio of the display screen of the monitor 18 is mainly 16: 9.
  • the aspect ratio of the light receiving surface of the imaging sensor of the modality 80 that captures the medical image in other words, the aspect ratio of the medical image is often 5: 4. Therefore, as described above, by using the monitor 18 having an aspect ratio of 16: 9, the aspect ratio of the monitor 18 having an aspect ratio of 16: 9 is 5: 4 without trimming or the like on the display screen of the monitor 18.
  • the medical image and the like can be suitably displayed in each of the three divided regions shown in FIG.
  • the current endoscopic images of the subject are sequentially imaged.
  • the examination of the subject by the endoscopic diagnostic apparatus 10 includes the preparation stage, the insertion stage of the endoscope, the pick-up stage of the region of interest, the discrimination / treatment stage of the region of interest, and the diagnostic report. Including the creation stage.
  • the preparatory stage is a stage in which the doctor prepares before observing the endoscopic image of the subject by the endoscopic diagnostic apparatus 10.
  • the display control unit 76 causes the monitor 18 to display at least one of the diagnostic information of the subject, for example, the patient information of the subject and the past diagnostic report of the subject, as shown in FIG.
  • the display control unit 76 can display a past medical image of the subject, a similar case of the medical condition of the subject, and the like on the monitor 18.
  • the past medical image of the subject is displayed on the display screen of the monitor 18 shown in FIG.
  • the doctor can grasp the medical condition of the subject and confirm the part of the subject to be observed in advance before actually observing the endoscopic image of the subject. ..
  • the insertion stage of the endoscope is a stage in which the doctor inserts the endoscope 12 into the body cavity of the subject and observes the endoscopic image of the subject.
  • the display control unit 76 displays, for example, the current endoscope image of the subject in one of the two or more divided regions, and displays the subject in one of the divided regions. At least one of the past endoscopic images, the biological information of the subject, the insertion shape of the endoscope 12 in the body cavity of the subject, and the support information for moving the endoscope 12 in the body cavity of the subject. Display one in at least one of the other divided areas of the two or more divided areas. In the display screen of the monitor 18 shown in FIG. 7, a normal image is displayed as the current endoscopic image of the subject in the first divided region.
  • the display control unit 76 receives an instruction from the doctor to start the examination, or the endoscope 12 that outputs an image signal obtained by imaging the subject using illumination light processes the image signal to image the subject. Contents to be displayed in the preparation stage to the contents to be displayed in the insertion stage of the endoscope when connected to at least one of the processor device 16 for outputting the current endoscope image and the light source device 14 for outputting the illumination light. Switch to.
  • the attention region pick-up stage is a stage in which the attention region estimation unit 72 picks up a portion presumed to be the attention region in the current endoscopic image of the subject. For example, in response to an instruction from a doctor, the stage shifts from the insertion stage of the endoscope to the pick-up stage of the region of interest.
  • the display control unit 76 displays, for example, the current endoscopic image of the subject in one of the two or more divided regions in the stage of picking up the region of interest, and the subject is displayed. At least one of the image showing the position of the region of interest in the current endoscopic image and the color-enhanced image, and at least one of the other divided regions of the two or more divided regions. Display it. In the display screen of the monitor 18 shown in FIG. 8, a normal image is displayed as the current endoscopic image of the subject in the first divided region.
  • an image showing the position of the region estimated to be the region of interest in the current endoscopic image of the subject is displayed, and the position of the region estimated to be the region of interest is bordered. It is displayed in a state surrounded by, and a color-enhanced image including the position of a portion presumed to be a region of interest is displayed in the second divided region at the lower right.
  • the doctor observes the current endoscopic image of the subject, and at the same time, an image showing the position of the region estimated to be the region of interest in the current endoscopic image of the subject, and color enhancement. At least one of the images can be seen.
  • the abnormal region discrimination unit 74 discriminates whether or not the region presumed to be the region of interest is presumed to be an abnormal region, and the doctor determines the abnormal region according to the discrimination result. It is a stage of diagnosing whether or not the site identified as being a lesion is a lesion and treating the site diagnosed as a lesion.
  • the display control unit 76 displays, for example, the current endoscopic image of the subject in one of the two or more divided regions in the differentiated / treated stage of the region of interest, resulting in an abnormality.
  • An image showing the position of the part identified as an abnormal part, the probability that the part identified as an abnormal part is estimated as an abnormal part, and the part identified as an abnormal part At least one of the length measurement results representing the length is displayed in at least one of the other divided regions among the two or more divided regions.
  • a normal image is displayed as the current endoscopic image of the subject in the first divided region.
  • an image showing the position of the part identified as an abnormal part is displayed in a predetermined color, for example, green, and the second divided area in the lower right part. Is displayed that the probability that the part identified as the abnormal part is presumed to be the abnormal part is 90%.
  • the doctor observes the current endoscopic image of the subject, and at the same time, the image showing the position of the part identified as the abnormal part and the part identified as the abnormal part are displayed. While checking at least one of the length measurement results indicating the probability of being presumed to be an abnormal part and the length of the part identified as an abnormal part, the part identified as an abnormal part is It is possible to diagnose whether or not it is a lesion.
  • the display control unit 76 receives the current endoscopic image of the subject from the current endoscopic image of the subject according to the instruction from the doctor, as shown in FIG. It is possible to switch to an image showing the oxygen saturation in the mirror image and display it in one divided region, for example, the first divided region. Alternatively, the display control unit 76 may display the current endoscopic image of the subject in one divided region and display the oxygen saturation image in at least one of the other divided regions. In the display screen of the monitor 18 shown in FIG. 10, an image showing the oxygen saturation is displayed as the current endoscopic image of the subject in the first divided region.
  • the region estimation unit 72 picks up the region presumed to be the region of interest in the current endoscopic image of the subject, and in the stage of differentiating and treating the region of interest.
  • the process of discriminating whether or not the portion presumed to be the region of interest is presumed to be the abnormal portion by the abnormal portion discriminating unit 74 can be automatically performed. Therefore, the content of the medical image of the subject to be displayed on the monitor 18 can be automatically changed according to the progress of the examination of the subject. In addition, these processes are repeated in each of the plurality of areas of interest.
  • the diagnostic report creation stage is a stage in which the doctor creates a diagnostic report of the subject in the external system 82 based on the test information and the like fed back from the test information feedback unit 78.
  • the test information feedback unit 78 feeds back the test information including the diagnosis result of the subject, the test time, and the equipment used to the external system 82 at the stage of creating the diagnosis report.
  • the doctor can easily create a diagnostic report of the subject as shown in FIG. 11 based on the test information and the like fed back from the test information feedback unit 78.
  • the test information feedback unit 78 may feed back the test information to the external system 82 including the medical image of the subject.
  • the doctor can create a diagnostic report based on the medical image of the subject and the examination information, and for example, the medical image of the subject can be attached to the diagnostic report of the subject.
  • the endoscopic diagnostic apparatus 10 on the monitor 18 included in the endoscopic diagnostic apparatus 10, medical images and diagnostic information of the subject by various modality 80 can be aggregated and observed. Further, before observing the endoscopic image of the subject, the diagnostic information of the subject is confirmed in advance on the monitor 18, and the endoscopic diagnostic apparatus 10 is used depending on the progress of the examination of the subject. At the time of inspection, the content displayed on the monitor 18 can be changed.
  • the display control unit 76 displays the biological information of the subject including the heart rate value and the blood pressure value in one of the other divided regions, for example, the second divided region in the upper right part, and the subject is displayed. If at least one of the heart rate and blood pressure values exceeds the upper limit value or falls below the lower limit value during the examination, an arrow pointing to the biological information of the subject is indicated by two or more in a predetermined color, for example, red.
  • the divided region other than one of the other divided regions in which the biological information of the subject is displayed for example, as shown in FIG. 12, may be displayed in the first divided region, or may be displayed in the lower right. It may be displayed in the second division area of. In this case, the display control unit 76 may blink the arrow at regular time intervals. This allows the physician to immediately recognize that at least one of the subject's heart rate and blood pressure values is abnormal.
  • the display control unit 76 is a portion of the portion that is identified as an abnormal portion when it is identified as an abnormal portion or according to an instruction from the user.
  • An image showing the position is overlaid on the current endoscopic image of the subject and displayed, and after a certain period of time or according to the instruction from the user, the part identified as an abnormal part is identified.
  • the overlay of the image representing the position may be stopped to display the current endoscopic image of the subject.
  • the display control unit 76 displays an image showing the position of the portion identified as the abnormal portion in a predetermined color, for example, a red frame. It may be displayed surrounded by a line. In this case, the display control unit 76 may blink the frame line at regular time intervals. Further, the display control unit 76 estimates that the arrow pointing to the image indicating the position of the portion identified as the abnormal portion is the abnormal portion in the two or more divided regions in a predetermined color, for example, red. When this is done, it may be displayed in a division area other than one of the other division areas in which an image showing the position of the identified portion is displayed. In this case, the display control unit 76 may blink the arrow at regular time intervals.
  • a predetermined color for example, a red frame.
  • the endoscopic diagnostic apparatus 10 can display important information so that the doctor can easily recognize it even when a large amount of information is aggregated and displayed.
  • the information display system of the present invention has been described with an example of incorporating it into the endoscopic diagnostic apparatus 10, the information display system of the present invention is similarly incorporated into various modalities 80 other than the endoscopic diagnostic apparatus. It is possible. Alternatively, the information display system of the present invention may not be incorporated into the modality 80, but may be provided separately from the modality 80, and various modality 80s, an external system 82, and the like may be connected to the information display system of the present invention.
  • a light source control unit 21 for example, a light source control unit 21, a receiving unit 53, a DSP 56, a noise removing unit 58, an image processing switching unit 60, a normal image processing unit 62, and a special image processing unit 64 (first special image processing unit 64a, first 2 Special image processing unit 64b, 3rd special image processing unit 64c), video signal generation unit 66, medical image acquisition unit 68, diagnostic information acquisition unit 70, attention area estimation unit 72, abnormal part identification unit 74, display control unit 76
  • the hardware configuration of the processing unit (Processing Unit) that executes various processes such as the inspection information feedback unit 78 may be dedicated hardware, or various processors or computers that execute programs. You may.
  • the circuit configuration can be changed after manufacturing the CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), etc., which are general-purpose processors that execute software (programs) and function as various processing units.
  • Programmable Logic Device (PLD), ASIC (Application Specific Integrated Circuit), etc. which is a processor, includes a dedicated electric circuit, which is a processor having a circuit configuration designed exclusively for performing specific processing. ..
  • One processing unit may be composed of one of these various processors, or a combination of two or more processors of the same type or different types, for example, a combination of a plurality of FPGAs, or a combination of an FPGA and a CPU. And so on. Further, a plurality of processing units may be configured by one of various processors, or two or more of the plurality of processing units may be collectively configured by using one processor.
  • SoC system on chip
  • circuitry that combines circuit elements such as semiconductor elements.
  • the method of the present invention can be carried out, for example, by a program for causing a computer to execute each of the steps. It is also possible to provide a computer-readable recording medium on which this program is recorded.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Veterinary Medicine (AREA)
  • Pathology (AREA)
  • Public Health (AREA)
  • Biophysics (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Optics & Photonics (AREA)
  • Endoscopes (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
PCT/JP2020/039231 2019-11-11 2020-10-19 情報表示システムおよび情報表示方法 Ceased WO2021095446A1 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2021555959A JP7257544B2 (ja) 2019-11-11 2020-10-19 情報表示システムおよび情報表示方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019-203795 2019-11-11
JP2019203795 2019-11-11

Publications (1)

Publication Number Publication Date
WO2021095446A1 true WO2021095446A1 (ja) 2021-05-20

Family

ID=75912008

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/039231 Ceased WO2021095446A1 (ja) 2019-11-11 2020-10-19 情報表示システムおよび情報表示方法

Country Status (2)

Country Link
JP (1) JP7257544B2 (https=)
WO (1) WO2021095446A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024188160A1 (zh) * 2023-03-13 2024-09-19 武汉迈瑞生物医疗科技有限公司 用于内窥镜系统的成像及显示方法和内窥镜系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1080396A (ja) * 1996-09-09 1998-03-31 Nippon Colin Co Ltd 内視鏡装置
JP2009226170A (ja) * 2008-03-25 2009-10-08 Olympus Medical Systems Corp 医療用画像処理装置
JP2014018333A (ja) * 2012-07-17 2014-02-03 Hoya Corp 画像処理装置及び内視鏡装置
WO2018198327A1 (ja) * 2017-04-28 2018-11-01 オリンパス株式会社 内視鏡診断支援システム、内視鏡診断支援プログラム及び内視鏡診断支援方法
WO2019088121A1 (ja) * 2017-10-30 2019-05-09 公益財団法人がん研究会 画像診断支援装置、資料収集方法、画像診断支援方法および画像診断支援プログラム

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2017073337A1 (ja) * 2015-10-27 2017-11-09 オリンパス株式会社 内視鏡装置及びビデオプロセッサ

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1080396A (ja) * 1996-09-09 1998-03-31 Nippon Colin Co Ltd 内視鏡装置
JP2009226170A (ja) * 2008-03-25 2009-10-08 Olympus Medical Systems Corp 医療用画像処理装置
JP2014018333A (ja) * 2012-07-17 2014-02-03 Hoya Corp 画像処理装置及び内視鏡装置
WO2018198327A1 (ja) * 2017-04-28 2018-11-01 オリンパス株式会社 内視鏡診断支援システム、内視鏡診断支援プログラム及び内視鏡診断支援方法
WO2019088121A1 (ja) * 2017-10-30 2019-05-09 公益財団法人がん研究会 画像診断支援装置、資料収集方法、画像診断支援方法および画像診断支援プログラム

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024188160A1 (zh) * 2023-03-13 2024-09-19 武汉迈瑞生物医疗科技有限公司 用于内窥镜系统的成像及显示方法和内窥镜系统

Also Published As

Publication number Publication date
JP7257544B2 (ja) 2023-04-13
JPWO2021095446A1 (https=) 2021-05-20

Similar Documents

Publication Publication Date Title
JP7346285B2 (ja) 医療画像処理装置、内視鏡システム、医療画像処理装置の作動方法及びプログラム
JP7383105B2 (ja) 医療画像処理装置及び内視鏡システム
US11950760B2 (en) Endoscope apparatus, endoscope operation method, and program
JP7289373B2 (ja) 医療画像処理装置、内視鏡システム、診断支援方法及びプログラム
JP2024153783A (ja) 画像処理装置
CN113613543B (zh) 诊断辅助装置、诊断辅助方法以及记录介质
JP7335399B2 (ja) 医用画像処理装置及び内視鏡システム並びに医用画像処理装置の作動方法
US12564307B2 (en) Image analysis processing apparatus, endoscope system, operation method of image analysis processing apparatus, and non-transitory computer readable medium
JP7387859B2 (ja) 医用画像処理装置、プロセッサ装置、内視鏡システム、医用画像処理装置の作動方法及びプログラム
US20230029239A1 (en) Medical image processing system and method for operating medical image processing system
WO2019220801A1 (ja) 内視鏡画像処理装置、内視鏡画像処理方法、及びプログラム
US20230101620A1 (en) Medical image processing apparatus, endoscope system, method of operating medical image processing apparatus, and non-transitory computer readable medium
US12430820B2 (en) Image processing apparatus
US20230237659A1 (en) Image processing apparatus, endoscope system, operation method of image processing apparatus, and non-transitory computer readable medium
US11998165B2 (en) Image processing device and method of operating same
JP7257544B2 (ja) 情報表示システムおよび情報表示方法
JP7593796B2 (ja) 医用画像処理システム、医用画像処理システムの作動方法
JP7556961B2 (ja) 内視鏡システム、内視鏡システムの作動方法、及び内視鏡システム用プログラム
WO2019202982A1 (ja) 内視鏡装置、内視鏡操作方法、及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20887238

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021555959

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20887238

Country of ref document: EP

Kind code of ref document: A1