WO2019087971A1 - Dispositif de traitement d'image médicale et dispositif d'endoscope - Google Patents

Dispositif de traitement d'image médicale et dispositif d'endoscope Download PDF

Info

Publication number
WO2019087971A1
WO2019087971A1 PCT/JP2018/039920 JP2018039920W WO2019087971A1 WO 2019087971 A1 WO2019087971 A1 WO 2019087971A1 JP 2018039920 W JP2018039920 W JP 2018039920W WO 2019087971 A1 WO2019087971 A1 WO 2019087971A1
Authority
WO
WIPO (PCT)
Prior art keywords
discrimination
medical image
illumination light
unit
image
Prior art date
Application number
PCT/JP2018/039920
Other languages
English (en)
Japanese (ja)
Inventor
加來　俊彦
Original Assignee
富士フイルム株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士フイルム株式会社 filed Critical 富士フイルム株式会社
Priority to JP2019550327A priority Critical patent/JP6834019B2/ja
Publication of WO2019087971A1 publication Critical patent/WO2019087971A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/045—Control thereof

Definitions

  • the present invention relates to a medical image processing apparatus using an analysis result of a medical image, and an endoscope apparatus.
  • medical devices those that acquire images (hereinafter referred to as medical images) including a subject image present the acquired medical images to the doctor. Then, the doctor uses the medical image obtained from the medical device as one of the determination materials to make a diagnosis and the like.
  • the discrimination of the condition of the subject or the like using the medical image at the time of diagnosis is based on the skill and experience of the doctor.
  • the endoscope apparatus described in Patent Document 1 is abnormal using a fluorescence image taken using fluorescence or a narrow band light image taken using light having a specific narrow wavelength band (so-called narrow band light). Locate the area where And the position of the area
  • a notable area including one or more parts where abnormality such as a lesion is recognized by analyzing a medical image (lesion part or a part having a possibility of a lesion) Or, it is an area called an abnormal area etc.
  • an abnormal area it is simply referred to as an abnormal area, and the position etc. is presented to support diagnosis and the like.
  • the doctor or the like distinguishes the type and the degree of progress of the lesion or the like in the abnormal area presented by the medical device, but the type and the degree of progression of the lesion or the like still bear a heavy burden. For this reason, in recent years, in order to further reduce the burden on a doctor or the like, it is required to provide detailed information as a material for discrimination about the type and the degree of progression of a lesion or the like.
  • An object of the present invention is to provide a medical image processing apparatus and an endoscope apparatus capable of presenting more detailed and accurate information on a lesion or the like than ever.
  • a medical image processing apparatus uses a first medical image captured using a first illumination light having a specific spectrum among medical images, and a medical image acquisition unit for acquiring a medical image including a subject image.
  • the first discrimination processing unit that performs a first discrimination process for detecting one or more types of first abnormal regions, and the second illumination light having a spectrum different from that of the first illumination light in the medical image
  • a second discrimination processing unit for performing a second discrimination process of identifying the type of abnormality included in each of the first abnormal areas using the second medical image; first illumination light and second illumination light of the medical image
  • a third discrimination processing unit that performs a third discrimination process of identifying the degree of progression of the abnormality included in the first abnormal area using the third medical image captured using the third illumination light having different spectra.
  • the second discrimination processing unit identifies the type of abnormality included in the first abnormal area by performing the second discrimination processing on the second abnormal area included in the second medical image corresponding to the first abnormal area. Is preferred.
  • the third discrimination processing unit performs the third discrimination processing on the third abnormal region included in the third medical image corresponding to at least one of the first abnormal region or the second abnormal region, whereby the first abnormal region is It is preferable to specify the degree of progression of the abnormality included.
  • the third discrimination processing unit preferably selects the third medical image using the result of the second discrimination processing.
  • determination process part selects the 3rd medical image acquired by the spectrum of 3rd illumination light matched with the result of a 2nd discrimination process.
  • the medical image acquisition unit acquires a medical image for observation other than the first medical image, the second medical image, and the third medical image, and displays the medical image for observation on the display unit.
  • the first discrimination processing unit preferably performs the first discrimination processing
  • the second discrimination processing unit performs the second discrimination processing
  • the third discrimination processing unit preferably performs the third discrimination processing.
  • the medical image acquisition unit sets any one of the first medical image, the second medical image, and the third medical image as a medical image for observation, and while displaying the medical image for observation on the display unit
  • the first discrimination processing unit preferably performs the first discrimination processing
  • the second discrimination processing unit performs the second discrimination processing
  • the third discrimination processing unit preferably performs the third discrimination processing.
  • the setting unit changes settings of each spectrum or combination of the first illumination light, the second illumination light, or the third illumination light.
  • the medical chart acquisition unit includes a medical chart acquisition unit for acquiring a medical chart, and the setting unit sets the information using information included in the medical chart.
  • the setting unit preferably includes, in the type of the abnormality identified in the second discrimination process, a specific lesion determined by the information included in the medical record.
  • a discrimination result correction unit that corrects the result of the second discrimination process or the result of the third discrimination process.
  • reports the result of a 2nd discrimination process, or the result of a 3rd discrimination process as a result of a 1st discrimination process.
  • the endoscope apparatus of the present invention is photographed using an endoscope image acquisition unit for acquiring an endoscope image including a subject image, and a first illumination light having a specific spectrum of the endoscope image.
  • a first discrimination processing unit that performs a first discrimination process of detecting one or more types of first abnormal areas using the first endoscopic image, and a spectrum of the first illumination light in the endoscopic image have different spectra.
  • a second discrimination processing unit that performs a second discrimination process of identifying the type of abnormality included in each of the first abnormal areas using a second endoscopic image captured using a second illumination light; and an endoscope A third medical image captured using a third illumination light having a spectrum different from that of the first illumination light and the second illumination light in the image is used to specify the progression degree of the anomaly included in the first anomaly region.
  • a discrimination processing unit that performs a second discrimination process of identifying the type of abnormality included in each of the first abnormal areas using a second endoscopic image captured using a second illumination light; and an endoscope A third medical image captured using a third illumination light having a spectrum different from that of the first illumination light and the second illumination light in the image is used to specify the progression degree of the anomaly included in the first anomaly region.
  • determination process part selects the spectrum of the illumination light used when acquiring a 3rd medical image using the result of a 2nd discrimination process.
  • the medical image processing apparatus and the endoscope apparatus of the present invention can provide more detailed and accurate information on lesions and the like than ever before.
  • FIG. 1 It is a block diagram of a medical image processing device. It is a block diagram of an endoscope apparatus. It is a graph which shows the spectrum of the illumination light which a light source device can emit. It is a graph which shows the spectrum of the illumination light for observation. It is a graph which shows the spectrum of the illumination light for discrimination of pattern 1.
  • FIG. It is a graph which shows the spectrum of the illumination light for discrimination of pattern 2.
  • FIG. It is a graph which shows the spectrum of the illumination light for discrimination of pattern 3.
  • FIG. It is a graph which shows the spectrum of the illumination light for discrimination of pattern 4.
  • FIG. It is a graph which shows the spectrum of the illumination light for discrimination of pattern 5.
  • FIG. 6 shows the spectrum of the illumination light for discrimination of pattern 6.
  • the medical image processing apparatus 10 includes a medical image acquisition unit 11, a medical image analysis processing unit 12, a display unit 13, a display control unit 15, an input reception unit 16, an overall control unit 17, and a storage unit. It has eighteen.
  • the medical image acquisition unit 11 is a medical image including a subject image directly from the endoscope apparatus 21 or the like which is a medical apparatus, or via a management system such as a PACS (Picture Archiving and Communication System) 22 or other information system.
  • the medical image is a still image or a moving image (so-called test moving image).
  • the medical image acquiring unit 11 can acquire a frame image constituting the moving image as a still image after the examination.
  • displaying the medical image includes reproducing the moving image one or more times in addition to displaying a still image of one representative frame constituting the moving image.
  • the medical device such as the endoscope device 21 or the like receives the imaging instruction of the doctor in addition to the image photographed by the doctor using the medical device such as the endoscope device 21 or the like. Includes images taken automatically regardless of
  • the medical image acquisition unit 11 can acquire a plurality of medical images, it can selectively acquire one or more medical images among these medical images. Further, the medical image acquisition unit 11 can acquire a plurality of medical images acquired in a plurality of different examinations. For example, one or both of a medical image acquired by an examination performed in the past and a medical image acquired by the latest examination can be acquired. That is, the medical image acquisition unit 11 can arbitrarily acquire a medical image.
  • the medical image processing apparatus 10 is connected to the endoscope apparatus 21 and acquires a medical image from the endoscope apparatus 21. That is, in the present embodiment, the medical image is an endoscopic image.
  • the medical image acquisition unit 11 acquires a plurality of endoscopic images (medical images) at least having mutually different imaging conditions.
  • the medical image acquisition unit 11 displays an endoscopic image for observation displayed on the display unit 13 (hereinafter referred to as an endoscopic image for observation 101 (medical image for observation); see FIG. 22).
  • An endoscopic image hereinafter referred to as the first endoscopic image 61; see FIG.
  • the observation endoscopic image 101, the first endoscopic image 61, the second endoscopic image 63, and the third endoscopic image 66 have different imaging conditions from one another in order to match the purpose of use. .
  • the imaging condition is a condition relating to imaging of a medical image, and is, for example, the spectrum of illumination light or the presence or absence or intensity of image processing at the time of generating a medical image.
  • the spectrum of illumination light is an intensity distribution for each wavelength, and includes the concepts of wavelength band and central wavelength.
  • the image processing at the time of generating a medical image is, for example, processing relating to adjustment of a color or the like that emphasizes a specific tissue or a lesion.
  • the endoscope apparatus 21 to which the medical image processing apparatus 10 is connected shoots a subject by irradiating at least one of light of a white wavelength band or light of a specific wavelength band.
  • the endoscope 31 includes an image sensor 41 for imaging a subject using illumination light in which the subject is reflected or scattered, or fluorescence from which the subject or a drug or the like administered to the subject emits light.
  • the image sensor 41 is, for example, a complementary metal-oxide-semiconductor (CMOS) color sensor (a sensor having a color filter).
  • CMOS complementary metal-oxide-semiconductor
  • the light source device 32 includes a light source unit 42 and a light source control unit 47.
  • the light source unit 42 emits a plurality of types of illumination light having different spectra.
  • the light source unit 42 includes, for example, a light emitting device such as a light emitting diode (LED), a laser diode (LD), or a xenon lamp.
  • the light source unit 42 is provided with a prism, a mirror, an optical fiber, an optical filter for adjusting a wavelength band, a light amount, and the like as needed.
  • the light source unit 42 includes a V-LED 43 that emits violet light with a center wavelength of about 405 nm, a B-LED 44 that emits blue light with a center wavelength of about 450 nm, and a green light with a center wavelength of about 540 nm. It comprises a G-LED 45 emitting light and an R-LED 46 with a center wavelength of about 630 nm.
  • the light source control unit 47 controls the light emission source included in the light source unit 42, and generates illumination light used by the endoscope 31 for photographing an object. Further, when the light source unit 42 includes a plurality of light emitting devices, the light source control unit 47 can control the light emission timing and the light emission amount of each light emitting device. Therefore, the light source device 32 can supply the endoscope 31 with a plurality of types of illumination light having different spectra, at any timing and at any intensity. That is, in the present embodiment, the light source device 32 controls two or more of purple light, blue light, green light, red light or light of each color other than white light under the control of the light source control unit 47. Light mixed at an arbitrary intensity ratio can be emitted as illumination light at an arbitrary timing and an arbitrary intensity.
  • the light source device 32 emits violet light (represented by a symbol “V”. The same applies hereinafter) emitted by the V-LED 43 and blue light emitted by the B-LED 44.
  • the green light emitted by the G-LED 45 (represented by the code “G”. The same applies hereinafter) and the red light emitted by the R-LED 46 (indicated by the code “R”) And the same.) And can emit light.
  • the light source control unit 47 arbitrarily controls the light amount of each color light of purple light V, blue light B, green light G, and red light R included in the illumination light according to the purpose of photographing.
  • the light source device 32 when obtaining the observation endoscope image 101, the light source device 32 emits illumination light (hereinafter, referred to as observation illumination light) having the observation spectrum shown in FIG.
  • the observation illumination light is so-called white light.
  • the light source device 32 has, for example, illumination having a spectrum shown in FIG. Light (hereinafter referred to as discrimination illumination light of pattern 1), illumination light having a spectrum shown in FIG. 6 (hereinafter referred to as discrimination illumination light of pattern 2), illumination light having a spectrum shown in FIG. 7 (hereinafter pattern 3) Illumination light having a spectrum shown in FIG.
  • discrimination illumination light for pattern 4 illumination light having a spectrum shown in FIG. 9 (hereinafter referred to as discrimination illumination light for pattern 5) 10), illumination light having the spectrum shown in FIG. 10 (hereinafter referred to as discrimination illumination light for pattern 6), illumination light having the spectrum shown in FIG. 11 (hereinafter referred to as discrimination illumination light for pattern 7), Illumination light having to the spectral or the illumination light having a spectrum shown in FIG. 13 (hereinafter, referred to as differential illumination light pattern 9) emits light switched appropriately.
  • the identification illumination light for pattern 1 (see FIG. 5) is used when acquiring the first endoscopic image 61.
  • the identification illumination light for pattern 2 (see FIG. 6) is used when acquiring the second endoscopic image 63.
  • the illumination light for discrimination of pattern 6 (see FIG. 10), the illumination light for discrimination of pattern 3 (see FIG. 7), and the illumination light for discrimination of pattern 4 (see FIG. 4) form the third endoscopic image 66 Used when acquiring.
  • the discrimination illumination light of pattern 6 is used when acquiring the third endoscopic image 66 for discriminating the degree of progression of the polyp
  • the differentiation illumination light of pattern 3 is ulcerative It is used when acquiring the 3rd endoscopic image 66 for discriminating the degree of progression of colitis
  • the illumination light for discrimination of pattern 4 is the 3rd endoscope for differentiating the degree of progression of Crohn's disease It is used when acquiring the image 66.
  • the light source device 32 can emit light having a specific narrow wavelength band (so-called narrow band light) as illumination light according to the characteristics of the light emitting device or the use of an optical filter. For example, it is possible to emit light in a wavelength band shorter than the green wavelength band, in particular, light in the blue band or purple band in the visible range.
  • narrow band light a specific narrow wavelength band
  • the processor device 33 acquires an endoscopic image from the image sensor 41, or generates an endoscopic image by performing image processing on the endoscopic image acquired from the image sensor 41.
  • the image sensor 41 and the endoscope image generation unit 48 constitute an “endoscope image acquisition unit” in the endoscope apparatus 21.
  • the endoscopic image acquisition unit acquires an endoscopic image including an object image by photographing the object using the illumination light.
  • the medical image processing apparatus 10 is connected to the processor 33. Then, the medical image acquisition unit 11 acquires an endoscope image directly from the endoscope image generation unit 48 of the endoscope apparatus 21.
  • the medical image analysis processing unit 12 performs analysis processing using an endoscopic image which is a medical image acquired by the medical image acquisition unit 11. Specifically, as shown in FIG. 14, it includes a first discrimination processing unit 51, a second discrimination processing unit 52, a third discrimination processing unit 53, and a setting unit 56.
  • the first discrimination processing unit 51 discriminates the presence or absence of the abnormal area 102 using the medical image. Specifically, of the medical images acquired by the medical image acquisition unit 11, the first discrimination processing unit 51 uses one or more of the first medical images captured using the first illumination light having a specific spectrum. A first discrimination process of detecting a plurality of types of abnormal areas 102 is performed.
  • “first illumination light having a specific spectrum” is illumination light for discrimination of pattern 1 and, as shown in FIG. 15, the first medical image is the first endoscopic image 61. is there.
  • the abnormal area 102 in the first endoscopic image 61 is referred to as a “first abnormal area”.
  • the first discrimination processing unit 51 calculates one or a plurality of predetermined feature amounts using the first endoscopic image 61, and detects the abnormal area 102 using the calculated feature amounts.
  • the predetermined feature amount is, for example, color or brightness, shape of a specific tissue or structure such as a blood vessel, length, thickness, depth from a mucosal surface, density, size, distribution, etc., number of branches, etc. , Complexity, disorder of regularity, or other characteristic quantities.
  • the first discrimination processing unit 51 can perform the first discrimination processing by, for example, texture analysis or pattern matching using a regular shape, instead of using the feature amount.
  • a target detected by the first discrimination processing unit 51 as the abnormal area 102 is a feature of a color or shape different from one or more lesions, surrounding tissues, etc.
  • Area, drug-applied area, or treatment is an area including the target of the area etc.).
  • the lesion or the like is, for example, inflammation associated with an inflammatory disease such as ulcerative colitis, Crohn's disease, or a polyp (raised lesion) or the like.
  • polyps are hyperplastic polyp (HP), sessile serrated adenoma / polyp (SSA), adenoma, cancer, etc.
  • HP hyperplastic polyp
  • SSA sessile serrated adenoma / polyp
  • adenoma cancer
  • the area having characteristics of color or shape different from the surrounding tissue or the like is, for example, the subject's redness, atrophy, diverticulum, or a treatment scar.
  • the first discrimination processing unit 51 detects the abnormal area 102 for a part or all of the medical image. That is, the first discrimination processing unit 51 performs the first discrimination processing on a pixel-by-pixel basis, in a case where the endoscope image is divided into small regions, for each small region, or with respect to the entire endoscope image, It can be carried out. In the present embodiment, the first discrimination processing unit 51 determines, for each small area including a predetermined number of pixels, whether the area is the abnormal area 102 or not. Therefore, the first discrimination processing unit 51 can detect the abnormal area 102 at one or more places of the medical image. The first discrimination processing unit 51 can include, in the result of the first discrimination processing, “probability” indicating the certainty of the processing result.
  • the second discrimination processing unit 52 discriminates the type of abnormality included in the first abnormal area (the abnormal area 102 in FIG. 15). Specifically, in the medical image acquired by the medical image acquisition unit 11, the second discrimination processing unit 52 captures a second medical image captured using a second illumination light having a spectrum different from that of the first illumination light. A second discrimination process is performed to identify the type of abnormality included in each first abnormality area.
  • the “second illumination light having a spectrum different from that of the first illumination light” is the illumination light for discrimination of pattern 2 and, as shown in FIG. It is an endoscopic image 63.
  • the second discrimination processing unit 52 performs the second discrimination processing on at least the “second abnormal area included in the second medical image” corresponding to the first abnormal area, whereby the abnormality included in the first abnormal area is Identify the type.
  • the second abnormal area is the abnormal area 102 in the second endoscopic image 63 (second medical image).
  • the second abnormal area (abnormal area 102 in FIG. 16) corresponds to the first abnormal area in the position and the like in the subject.
  • the second discrimination processing unit 52 does not specify the position or the like of the second abnormal area, and the second endoscope
  • the second discrimination process can be performed on the entire image 63 to identify the type of abnormality included in the first abnormal area.
  • the second discrimination processing unit 52 includes one or more type discrimination units according to the number of “types of abnormality” to be discriminated.
  • the type identification unit identifies whether the abnormality included in the abnormal area 102 is a specific lesion.
  • the second discrimination processing unit 52 includes a first type discrimination unit 71, a second type discrimination unit 72, a third type discrimination unit 73, and other type discrimination units ( Not shown).
  • the first type discrimination unit 71 is an abnormality included in the abnormal area 102 detected in the first identification process (in the case where a plurality of abnormal areas 102 are detected, the abnormal area 102 is a specific abnormal area 102 among them. The same applies hereinafter).
  • the second type identification unit 72 identifies whether the abnormality included in the abnormal area 102 detected in the first identification process is “ulcerative colitis”.
  • the third type discrimination unit 73 discriminates whether or not the abnormality included in the abnormal area 102 detected in the first discrimination process is "Crohn's disease”. Similarly, the other type identification unit identifies whether the abnormality included in the abnormal area 102 is a specific lesion.
  • the result of the second discrimination process includes information ("polyp”, “ulcerative colitis”, “Crohn's disease”, etc.) indicating at least the type of abnormality included in the abnormal area 102.
  • the result of the second discrimination process does not necessarily identify the type of abnormality definitely as one, and says “40% probability that it is ulcerative colitis and 40% probability that it is Crohn's disease”
  • it is the information which can narrow down the kind of plausible abnormality together with the probability (probability) showing the certainty of the discrimination result in each kind discrimination part. Therefore, “specifying the type of abnormality” in the second discrimination process means obtaining information that can narrow down the type of abnormality.
  • the third discrimination processing unit 53 discriminates the degree of progression of the abnormality included in the first abnormal area (the abnormal area 102 in FIG. 15). Specifically, in the medical image acquired by the medical image acquisition unit 11, the third discrimination processing unit 53 is photographed using the third illumination light having a spectrum different from that of the first illumination light and the second illumination light. A third discrimination process is performed to specify the degree of progression of the abnormality included in the abnormal area 102 using the third medical image.
  • the “third illumination light having a different spectrum from the first illumination light and the second illumination light” is any of the discrimination illumination light of the patterns 3 to 9, and as shown in FIG.
  • the third medical image is the third endoscopic image 66.
  • the third discrimination processing unit 53 performs the third discrimination processing on the “third abnormal area included in the third medical image” corresponding to at least one of the first abnormal area or the second abnormal area. Identify the degree of progression of the anomaly included in the first anomaly region.
  • the third abnormal area is the abnormal area 102 in the third endoscopic image 66 (third medical image).
  • the third abnormal area (abnormal area 102 in FIG. 18) corresponds to the first abnormal area or the second abnormal area in the position and the like in the subject.
  • the third discrimination processing unit 53 may, for example, determine the position of the third abnormal area, for example, without specifying the position of the third abnormal area.
  • the third discrimination process can be performed on the entire image 66 to identify the type of abnormality included in the first abnormal area.
  • the third discrimination processing unit 53 includes one or more progress degree discrimination units in accordance with the number of “types of abnormality” to be discriminated.
  • the progress discrimination unit discriminates the progress of a specific type of abnormality.
  • the third discrimination processing unit 53 includes a first progression discrimination unit 81, a second progression discrimination unit 82, a third progression discrimination unit 83, and other progressions.
  • a degree discrimination unit (not shown) is provided.
  • the first progression discrimination unit 81 discriminates the progression of the polyp.
  • the second progression discrimination unit 82 discriminates the progression of ulcerative colitis.
  • the third progression discrimination unit 83 discriminates the progression degree of Crohn's disease. The same applies to the other progress discrimination units.
  • the result of the third discrimination process is the degree of progression of a lesion or the like.
  • the medical image is an endoscopic image
  • the degree of progression is discriminated according to a so-called endoscopic findings classification.
  • Endoscopic classification when targeting polyps (including cancer) is, for example, NICE (The Narrow-band imaging International Colorectal Endoscopic) classification, or JNET (The Japan NBI (Narrow Band Imaging) Expert Team) classification. There are classification etc.
  • classification is made into “NICE Type 1”, “NICE Type 2”, or “NICE Type 3” according to the NICE classification.
  • NICE Type 1 represents hyperplastic lesion
  • NICE Type 2 represents adenoma (adenoma) to intramucosal cancer (so-called M cancer)
  • NICE Type 3 represents submucosal invasion cancer (so-called SM cancer) .
  • the endoscopic findings classification of ulcerative colitis includes, for example, Mayo classification, Matts classification, UCEIS (Ulcerative Colitis Endoscopic. Index of Severity) classification, and the like.
  • the degree of progression of ulcerative colitis is classified according to the Mayo classification.
  • the Mayo classification has four grades of Mayo 0 (grade 0), Mayo 1 (grade 1), Mayo 2 (grade 2), and Mayo 3 (grade 3).
  • Mayo0 is a grade that represents normal or inactive (including remission).
  • Mayo 1 is a grade that indicates mildness, and is generally in a state in which redness, blood vessel image obscurity, or mild bleeding tendency is observed.
  • Mayo 2 is a grade that represents moderate disease, and in general, conditions such as marked redness, disappearance of angiogram, hemorrhage, adherence of purulent secretions, mucous membrane prostheses, wrinkles, or partial ulcers etc. It is. Mayo 3 is a grade representing severe (active stage), and in general, it is a state in which obvious spontaneous bleeding, edema, ulcer (including extensive ulcer) and the like are recognized. In the third differential treatment, dysplasia associated with ulcerative colitis is differentiated.
  • the endoscopic findings classification of Crohn's disease includes, for example, SESCD (Simple Endoscopic Score for Crohn's Disease).
  • SESCD Simple Endoscopic Score for Crohn's Disease
  • the degree of progression of Crohn's disease is classified into "SESCD 0", "SESCD 1", “SESCD 2", or "SESCD 3" according to SESCD.
  • the degree of progression for each type of lesion is differentiated, and the degree of progression for one or more lesions is Output as the result of the third discrimination process.
  • the result of the second discrimination process is "probability 40% for ulcerative colitis and 40% probability for Crohn's disease”
  • the degree of progression of ulcerative colitis in the third discrimination process Differentiate the degree of progression of Crohn's disease.
  • the degree of progression of each lesion narrowed down in the second differentiation process is "20% of the probability that Mayo 1 is ulcerative colitis” and "95% of the probability that SESCD 1 is Crohn's disease” Among these results, the result relating to the latter Crohn's disease is output as the result of the third discrimination process.
  • the third discrimination processing unit 53 selects one or more third medical images using the result of the second discrimination processing. Further, the third discrimination processing unit 53 selects the third medical image acquired in the spectrum of the third illumination light associated with the result of the second discrimination processing. For example, when the result of the second discrimination process includes “polyp”, an endoscopic image captured using the discrimination illumination light of pattern 6 is selected and acquired as the third endoscopic image 66.
  • the medical image acquisition part 11 can acquire the medical image which the 2nd discrimination process part 52 and the 3rd discrimination process part 53 may request
  • the first discrimination process, the second discrimination process, and the third discrimination process are performed in the background while displaying the medical image for observation on the display unit 13. That is, while the medical image for observation (in the present embodiment, the endoscopic image for observation 101) is displayed on the display unit 13, the first discrimination processing unit 51 performs the first discrimination processing, and the second discrimination processing The part 52 performs a second discrimination process, and the third discrimination processing unit 53 performs a third discrimination process.
  • the medical image acquisition unit 11 acquires a medical image for observation other than the first medical image, the second medical image, and the third medical image, but the medical image acquisition unit 11 When one of the first medical image, the second medical image, and the third medical image is set as the medical image for observation (the first medical image, the second medical image, or the third medical image for medical observation And also when it is used.
  • the display control unit 15 can appropriately update the observation endoscope image 101 displayed on the display unit 13 while performing the first discrimination process, the second discrimination process, or the third discrimination process.
  • the setting unit 56 can store and change the setting of the type of abnormality (discrimination target) identified in the second discrimination processing or the classification (discrimination content) of the progress degree identified in the third discrimination processing. .
  • the setting unit 56 causes the display unit 13 to display a setting change menu window shown in FIG.
  • a doctor or the like puts a check (“RE”) in the check box 91 using a mouse or the like, the corresponding discrimination target and the discrimination content can be validated.
  • “polyp” and “ulcerative colitis” are activated as discrimination targets
  • “NICE Type 1”, “NICE Type 2”, and “NICE Type 3” are activated for polyps, and ulcers are detected.
  • the second discrimination processing unit 52 discriminates whether the abnormality included in the abnormal area 102 is a polyp and whether it is ulcerative colitis. Further, when the abnormality included in the abnormal area 102 is a polyp, the third discrimination processing unit 53 discriminates the progress degree of the abnormality into “NICE Type 1”, “NICE Type 2”, or “NICE Type 3”. Similarly, when the abnormality included in the abnormal area 102 is ulcerative colitis, the third discrimination processing unit 53 discriminates the progress degree to “Mayo 0”, “Mayo 1”, or “Mayo 2”.
  • the setting unit 56 can set or change each spectrum or combination of the first illumination light, the second illumination light, or the third illumination light. Setting the type of abnormality (differentiation target) to be identified in the second discrimination process, or the classification (discrimination content) of the progress degree to be identified in the third discrimination process, and the first illumination light, the second illumination light, or Setting each spectrum or combination of the third illumination light exerts substantially the same setting effect with respect to the first discrimination process, the second discrimination process, and the third discrimination process.
  • the display unit 13 is a display that displays the medical image acquired by the medical image acquisition unit 11.
  • the display unit 13 displays at least a medical image for observation.
  • the display unit 13 can display one or more of the result of the first discrimination process, the result of the second discrimination process, and the result of the third discrimination process.
  • a monitor or display included in a device or the like connected to the medical image processing apparatus 10 can be shared and used as the display unit 13 of the medical image processing apparatus 10.
  • the display control unit 15 controls the display mode of the medical image for observation or the like on the display unit 13.
  • the abnormal area 102 (first abnormal area) detected by the first discrimination processing unit 51 is superimposed on the observation endoscope image 101 and displayed.
  • the display control unit 15 displays on the display unit 13 the type of abnormality included in the abnormal area 102, characters (character string or message) indicating the progress of abnormality included in the abnormal area 102, and the like.
  • the display control unit 15 may use the sound (including sound), light (partial blinking of the observation endoscope image 101, etc.), display of coordinates, or any other appropriate method, such as an abnormal area.
  • the position of 102, the type of abnormality included in the abnormal area 102, and the degree of progression of abnormality included in the abnormal area 102 can be indicated.
  • the input reception unit 16 receives input from a mouse, a keyboard, and other operation devices connected to the medical image processing apparatus 10. The operation of each part of the medical image processing apparatus 10 can be controlled using these operation devices.
  • the integrated control unit 17 integrally controls the operation of each unit of the medical image processing apparatus 10.
  • the overall control unit 17 controls each unit of the medical image processing apparatus 10 according to the operation input.
  • the storage unit 18 is a storage device (not shown) such as a memory included in the medical image processing apparatus 10 or a medical device such as the endoscope apparatus 21 or a storage device (not shown) included in the PACS 22 as needed.
  • the position of the abnormal area 102, the type of abnormality included in the abnormal area 102, the degree of progress of abnormality included in the abnormal area 102, and the like are stored.
  • the medical image acquisition unit 11 appropriately acquires the observation endoscopic image 101 which is a medical image for observation (step S110), and the display control unit 15 acquires the endoscopic image 101 for observation. Are appropriately displayed on the display unit 13 (step S111).
  • the medical image acquisition unit 11 acquires the first endoscopic image 61, which is a medical image for the first discrimination process (step In step S112, the first discrimination processing unit 51 executes the first discrimination process of discriminating the presence or absence of the abnormal area 102 using the first endoscopic image 61 (step S113).
  • the medical image acquisition unit 11 acquires the second endoscopic image 63 which is a medical image for the second discrimination process (step S114), and the second discrimination processing unit A second discrimination process is performed to discriminate the type of abnormality included in the abnormal area 102 using the second endoscopic image 63 (step S115). Thereafter, the medical image acquisition unit 11 acquires the third endoscopic image 66 which is a medical image for the third discrimination process (step S116), and the third discrimination processing unit 53 obtains the third endoscopic image 66. A third discrimination process of discriminating the degree of progression of the abnormality included in the abnormal area 102 is executed (step S117).
  • the display control unit 15 displays these results on the display unit 13 (step S118). For example, as shown in FIG. 22, the display control unit 15 displays the position of the abnormal area 102 by indicating the outline of the abnormal area 102 in the observation endoscope image 101 or the like. Further, the display control unit 15 displays that the abnormality included in the abnormal area 102 is, for example, “ulcerative colitis” in the specific display column 103 for indicating the result of the second discrimination processing, and the third discrimination In the specific display field 104 for indicating the result of the process, it is displayed that the progress degree is, for example, "Mayo 1".
  • the medical image processing apparatus 10 detects the abnormal area 102 and discriminates the type and the degree of progress of the abnormality included in the detected abnormal area 102
  • the medical image processing apparatus 10 captures an image with illumination light suitable for each of the discrimination.
  • I use medical images.
  • the first discrimination process the first endoscopic image 61 suitable for discrimination of the presence or absence of the abnormal area 102 is used, and in the second discrimination process, for discrimination of the type of abnormality included in the abnormal area 102
  • a suitable second endoscopic image 63 is used, and a third endoscopic image 66 suitable for differentiation of the degree of progression is used in the third discrimination process.
  • the medical image processing apparatus 10 can further provide the type of abnormality included in the abnormal area 102 and accurate information on the progression of the abnormality included in the abnormal area 102. That is, the medical image processing apparatus 10 can provide more detailed information on lesions and the like than in the past, and can support diagnosis and the like more effectively.
  • the first discrimination processing unit 51, the second discrimination processing unit 52, and the third discrimination processing unit 53 in the first embodiment use a so-called AI (Artificial Intelligence) program learned by machine learning or deep learning. Can be configured.
  • AI Artificial Intelligence
  • the medical image acquiring unit 11 In the second discrimination process, when the types of abnormalities are narrowed down to a plurality of types, the medical image acquiring unit 11 respectively obtains the third endoscopic image 66 suitable for the third discrimination process for each type of abnormality.
  • the third discrimination processing unit 53 acquires and discriminates the degree of progress of each type of abnormality. For example, when it is specified that “probability 40% is ulcerative colitis and probability 40% is Crohn's disease” in the second discrimination processing, medical image acquisition unit 11 discriminates the progression degree of ulcerative colitis.
  • the third endoscopic image 66 required and the third endoscopic image 66 necessary for discrimination of the degree of progression of Crohn's disease are obtained, and the third discrimination processing unit 53 calculates each third endoscopic image 66 The degree of progression of ulcerative colitis (the degree of progression when the type of abnormality is ulcerative colitis) and the degree of progression when Crohn's disease is the type of abnormality ) And.
  • the display control unit 15 displays at least the discrimination result with the highest accuracy.
  • the display control unit 15 displays at least the type “Aberrant type“ Crohn's disease ”and the progression“ SESCE1 ”.
  • the medical image analysis processing unit 12 includes the chart acquisition unit 121 in addition to the first discrimination processing unit 51, the second discrimination processing unit 52, the third discrimination processing unit 53, and the setting unit 56. You may have.
  • the chart acquisition unit 121 acquires the chart of the patient to be examined from the medical device such as the endoscope apparatus 21 or the PACS 22 or the like.
  • a medical record is information that records the progress of medical treatment or examination about a patient, and includes, for example, the patient's name, sex and age, disease name, major symptoms, contents of prescription or treatment, or records of medical history etc. .
  • the setting unit 56 specifies the type of abnormality (differentiation target) specified in the second discrimination process or the third discrimination process using information included in the medical chart. It is possible to set classification (differentiated content) of the degree of progress.
  • the setting unit 56 can include, in the type of abnormality identified in the second discrimination process, a specific lesion determined by the information included in the medical record. Specifically, if there is a history of ulcerative colitis, even if ulcerative colitis is not the main lesion that is the main target of the examination, setting unit 56 differentiates ulcerative colitis as a secondary lesion. It is set as an object.
  • the medical image analysis processing unit 12 has a discrimination result correction unit 131. May be provided.
  • the discrimination result correction unit 131 corrects the result of the first discrimination process, the result of the second discrimination process, or the result of the third discrimination process based on the operation input using the input reception unit 16 such as a doctor. By providing the discrimination result correction unit 131, it is possible to correct erroneous discrimination in the first discrimination process, the second discrimination process, or the third discrimination process.
  • a doctor or the like can arbitrarily correct the position, size, range, number, etc., of the abnormal area 102 detected in the first discrimination process. Further, the type of the abnormality identified in the second discrimination process can be arbitrarily selected again, or the doctor or the like can arbitrarily discriminate the degree of progress specified in the third discrimination process.
  • the discrimination result correction unit 131 corrects the result of the first discrimination process
  • the second discrimination processing unit 52 executes the second discrimination process reflecting the result of the first discrimination process after correction
  • the third discrimination The processing unit 53 executes the third discrimination process by reflecting the result of the second discrimination process that reflects the result of the first discrimination process after correction.
  • the discrimination result correction unit 131 corrects the result of the first discrimination process
  • the second discrimination processing unit 52 can redo the second discrimination processing reflecting the result of the first discrimination processing after the correction based on the instruction by the etc.
  • the third discrimination processing unit 53 performs the correction after the modification. It is possible to redo the third discrimination process by reflecting the result of the second discrimination process reflecting the result of the first discrimination process.
  • the third discrimination processing unit 53 executes the third discrimination process, reflecting the result of the second discrimination process after the correction.
  • the discrimination result correction unit 131 corrects the result of the second discrimination process, if the third discrimination process is already completed, the third discrimination is automatically performed or based on an instruction by a doctor etc.
  • the processing unit 53 can redo the third discrimination process by reflecting the result of the second discrimination process after the correction.
  • the medical image analysis processing unit 12 has a discrimination result notification unit 141. May be provided.
  • the discrimination result notifying unit 141 reports the result of the first discrimination process, the result of the second discrimination process, or the result of the third discrimination process at an arbitrary timing.
  • the discrimination result notifying unit 141 reports the result of the first discrimination process in real time after the completion of the first discrimination process, for example, the result of the second discrimination process is real time after the completion of the second discrimination process Alert to
  • the discrimination result notifying unit 141 can display the respective discrimination results as in the first embodiment using the display control unit 15 and the display unit 13, and can also use sound (including sound), light (observation endoscope image 101).
  • the result of the first discrimination process, the result of the second discrimination process, and the result of the third discrimination process can be reported by any other method such as the partial blinking of the character of the symbol, the display of coordinates, and the like.
  • the medical image processing apparatus 10 and the endoscope apparatus 21 are separate apparatuses, but the endoscope apparatus 21 can include the medical image processing apparatus 10.
  • each unit 520 constituting the medical image processing apparatus 10 is provided in the processor apparatus 33.
  • the display unit 13 can share the monitor 34 of the endoscope apparatus 21.
  • the medical image acquisition part 11 is corresponded to the "endoscope image acquisition part" which the image sensor 41 and the endoscope image generation part 48 form. For this reason, it is sufficient to provide the processor 33 with components other than the medical image acquisition unit 11 and the display unit 13.
  • the configuration of the other components is the same as that of the first embodiment.
  • a new endoscope apparatus can be configured as a whole of the medical image processing apparatus 10 of each of the above-described embodiments and the other modifications and the endoscope apparatus 21 of FIG. 2.
  • An endoscope apparatus 510 including the medical image processing apparatus 10 is basically an apparatus for observing a subject in real time. For this reason, the endoscope apparatus 510 can obtain an endoscope image which is a medical image, a first discrimination process, a second discrimination process, a third discrimination process, and a display process of these results, etc. It can be performed in real time while capturing an image, or at any timing caused by the operation of various operation units and the like.
  • the endoscope apparatus 510 captures an object using the observation illumination light, appropriately acquires the observation endoscope image 101 (step S210), and the display control unit 15 performs observation
  • the endoscopic image 101 for endoscope is suitably displayed on the monitor 34 (step S211).
  • the integrated control unit 17 sets the observation endoscope image 101 during the series of imaging of the observation endoscope image 101.
  • the imaging for the first discrimination process is intermittently interrupted at a predetermined timing that does not affect continuous display. That is, the endoscope apparatus 510 appropriately switches the illumination light to the discrimination illumination light of pattern 1 in accordance with the timing of imaging of the image sensor 41 (step S212), and the interval between the frames for imaging the endoscopic image 101 for observation Then, a frame for photographing a subject using the discrimination illumination light of pattern 1 is inserted as appropriate. Thereby, the endoscope apparatus 510 acquires the first endoscopic image 61 for the first discrimination process (step S213), and the first discrimination processing unit 51 uses the first endoscopic image 61. The first discrimination process is executed (step S214).
  • the general control unit 17 determines that the continuous display of the observation endoscope image 101 is not interrupted during the imaging of the series of observation endoscope images 101.
  • the imaging for the second discrimination process is intermittently interrupted. That is, the endoscope apparatus 510 appropriately switches the illumination light to the discrimination illumination light of pattern 2 in accordance with the timing of imaging of the image sensor 41 (step S215), and the interval between the frames for imaging the endoscopic image 101 for observation Then, a frame for photographing a subject using the discrimination illumination light of pattern 2 is inserted as appropriate. Thereby, the endoscope apparatus 510 acquires the second endoscopic image 63 for the second discrimination process (step S216), and the second discrimination processing unit 52 uses the second endoscopic image 63. The second discrimination process is executed (step S217).
  • the integrated control unit 17 intermittently performs the third identification at predetermined timing that does not affect continuous display of the observation endoscope image 101 during capturing of the series of observation endoscope images 101. Interrupt the shooting for processing. That is, the endoscope apparatus 510 appropriately switches to the identification illumination light for a specific pattern having a spectrum suitable for the third identification processing according to the result of the second identification processing (step S218). At this time, the third discrimination processing unit 53 selects the spectrum of the illumination light used when acquiring the third medical image, using the result of the second discrimination processing. As a result of switching the illumination light, a frame for photographing a subject using the illumination light for the third discrimination process is inserted as needed between the frames for photographing the observation endoscope image 101.
  • the endoscope apparatus 510 acquires the third endoscopic image 66 for the third discrimination process (step S219), and the third discrimination processing unit 53 uses the third endoscopic image 66. And execute the third discrimination process (step S220).
  • the display control unit 15 displays at least the result of the third discrimination process on the display unit 13 (step S221).
  • the endoscope apparatus 510 including the medical image processing apparatus 10 may perform the first discrimination process, the second discrimination process, and the third discrimination process in real time to support diagnosis etc. in real time. it can.
  • the endoscope apparatus 510 including the medical image processing apparatus 10 further includes a zoom mechanism 531, a zoom control unit 541, a light amount control unit 542, a motion detection unit 543, an imaging control unit 545, and the like. Is preferred.
  • the zoom mechanism 531 is a mechanical mechanism or an electronic mechanism that changes the imaging magnification.
  • the mechanical mechanism is a so-called optical zoom
  • the electronic mechanism is a so-called electronic zoom.
  • the zoom control unit 541 controls the zoom mechanism 531 to set an imaging magnification.
  • the endoscope apparatus 510 can obtain the imaging magnification using the zoom control unit 541.
  • the light amount control unit 542 is appropriate according to the observation distance (the distance between the tip of the endoscope 31 and the subject, including the substantial distance between the tip of the endoscope 31 and the subject due to the change of the imaging magnification). Set the amount of illumination light.
  • the light source control unit 47 uses the light source unit 42 to emit observation illumination light and discrimination illumination light of each pattern with the light amount set by the light amount control unit 542.
  • the motion detection unit 543 uses the endoscope image such as the observation endoscope image 101 or the like to perform the motion of the subject or the relative motion of the subject and the endoscope 31 (hereinafter simply referred to as “motion”). It detects the direction, speed or movement amount.
  • the imaging control unit 545 controls the frequency of imaging for the first discrimination process, the frequency of imaging for the second discrimination process, or the frequency of imaging for the third discrimination process according to the observation condition.
  • the observation conditions are the imaging magnification at the time of imaging an endoscopic image, the light amount of illumination light, or the situation regarding movement.
  • the shooting control unit 545 can obtain the shooting magnification from the zoom control unit 541, can obtain the light quantity of the illumination light from the light quantity control unit 542, and can obtain the movement from the movement detection unit 543.
  • the photographing control unit 545 sets the photographing frequency for the first discrimination process, the photographing for the second discrimination process, and the photographing condition for the first discrimination process according to the photographing condition, the light amount of the illumination light, and the observation condition combining the motion. Control the frequency of imaging for the third discrimination process.
  • observation condition X1 having a relatively small imaging magnification, a relatively large amount of illumination light, and a relatively large movement is observed with a high frequency of occurrence in a so-called screening situation. It is a condition. Therefore, the imaging control unit 545 relatively increases the frequency of imaging of the observation endoscope image 101 and the frequency of imaging for the first discrimination process, and for the second discrimination process and the third discrimination process. Reduce the frequency of imaging for discrimination processing relatively. This is because, in general, screening mainly aims at general observation of an object or detection of an abnormal area 102.
  • observation condition X2 in which the imaging magnification is relatively large, the amount of illumination light is relatively small, and the movement is relatively small is an observation that occurs frequently when the object is observed in detail for diagnosis etc. It is a condition.
  • the imaging control unit 545 relatively reduces the imaging frequency of the observation endoscope image 101 and the imaging frequency for the first discrimination process, and for the second discrimination process and the third discrimination process. Relatively increase the frequency of shooting. In a situation where the subject is observed in detail for diagnosis etc., it is required that the results of the second discrimination process and the third discrimination process be presented promptly and accurately, following the slight change in appearance of the subject, etc. Because
  • the frequency of imaging of the observation endoscope image 101 As described above, using the observation conditions, the frequency of imaging of the observation endoscope image 101, the frequency of imaging for the first discrimination process, the frequency of imaging for the second discrimination process, and for the third discrimination process If the frequency of photographing is changed, discrimination results such as the result of the third discrimination processing can be presented at an appropriate updating frequency according to the situation of photographing (the purpose of photographing).
  • the frequency of imaging means to increase or decrease the frequency of imaging based on the frequency of specific imaging under the observation condition X1, the observation condition X2, or other observation conditions. . In this modification, the frequency of imaging under observation condition X1 is compared with the frequency of imaging under observation condition X2.
  • the endoscope apparatus 510 includes the medical image processing apparatus 10.
  • the diagnostic support apparatus 610 used in combination with the endoscope apparatus 21 and other modality is The medical image processing apparatus 10 of the said embodiment and the other modification can be included.
  • various inspection devices such as the first inspection device 621, the second inspection device 622, ..., the N-th inspection device 623, etc., including the endoscope device 21, for example, via the arbitrary network 626
  • the medical service support device 630 to be connected can include the medical image processing device 10 of the above-described embodiment and other modified examples.
  • the medical image processing apparatus 10 various apparatuses including the medical image processing apparatus 10, and various apparatuses or systems including the functions of the medical image processing apparatus 10 can be used with various modifications described below. .
  • a normal light image obtained by irradiating light of a plurality of wavelength bands as light of a white band or light of a white band can be used.
  • a specific wavelength band can use a band narrower than the white wavelength band.
  • the specific wavelength band is, for example, a blue band or a green band in the visible range.
  • the specific wavelength band is a blue band or a green band in the visible range
  • the specific wavelength band includes a wavelength band of 390 nm to 450 nm or 530 nm to 550 nm, and light of the specific wavelength band is 390 nm or more It is preferable to have a peak wavelength within a wavelength band of 450 nm or less or 530 nm or more and 550 nm or less.
  • the specific wavelength band is, for example, a red band in the visible range.
  • the specific wavelength band is a red band in the visible range
  • the specific wavelength band includes a wavelength band of 585 nm to 615 nm or 610 nm to 730 nm, and light of the specific wavelength band is 585 nm to 615 nm or 610 nm It is preferable to have a peak wavelength within the wavelength band of not less than 730 nm.
  • the specific wavelength band includes, for example, wavelength bands in which the absorption coefficient is different between oxygenated hemoglobin and reduced hemoglobin, and light of a specific wavelength band is a peak wavelength in the wavelength band where absorption coefficients are different between oxygenated hemoglobin and reduced hemoglobin You can have
  • a specific wavelength band includes wavelength bands whose absorption coefficients are different between oxyhemoglobin and reduced hemoglobin, and light of a specific wavelength band has peak wavelengths in wavelength bands whose absorption coefficients are different between oxyhemoglobin and reduced hemoglobin
  • the specific wavelength band includes the wavelength bands of 400 ⁇ 10 nm, 440 ⁇ 10 nm, 470 ⁇ 10 nm, or 600 nm to 750 nm
  • the light of the specific wavelength band is 400 ⁇ 10 nm, 440 ⁇ 10 nm
  • this in-vivo image can have information of fluorescence emitted from a fluorescent substance in the living body.
  • fluorescence fluorescence obtained by irradiating excitation light having a peak wavelength of 390 nm or more and 470 nm or less into a living body can be used.
  • the above-mentioned specific wavelength band can utilize the wavelength band of infrared light.
  • the specific wavelength band is a wavelength band of 790 nm to 820 nm or 905 nm to 970 nm
  • light of a specific wavelength band preferably has a peak wavelength in a wavelength band of 790 nm or more and 820 nm or less or 905 nm or more and 970 nm or less.
  • the medical image acquisition unit 11 acquires a special light image having a signal of a specific wavelength band based on a normal light image obtained by irradiating light of a plurality of wavelength bands as light of the white band or light of the white band. It can have a special light image acquisition unit. In this case, a special light image can be used as a medical image.
  • a signal of a specific wavelength band can be obtained by an operation based on RGB or CMY color information included in a normal light image.
  • a feature amount image generation unit that generates a feature amount image can be provided.
  • the feature amount image can be used as a medical image.
  • a capsule endoscope can be used as the endoscope 31.
  • the light source device 32 and part of the processor device 33 can be mounted on the capsule endoscope.
  • the hardware-like structure of a processing unit that executes various processes is various processors as shown below.
  • CPU Central Processing Unit
  • PROM Programmable Logic Device
  • a programmable logic device which is a possible processor
  • a dedicated electric circuit which is a processor having a circuit configuration specially designed to execute various processes, are included.
  • One processing unit may be configured of one of these various processors, or configured of a combination of two or more processors of the same type or different types (for example, a plurality of FPGAs or a combination of a CPU and an FPGA) It may be done.
  • a plurality of processing units may be configured by one processor.
  • one processor is configured by a combination of one or more CPUs and software as represented by computers such as clients and servers; There is a form in which this processor functions as a plurality of processing units.
  • SoC system on chip
  • IC integrated circuit
  • circuitry in the form in which circuit elements such as semiconductor elements are combined.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biomedical Technology (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biophysics (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Endoscopes (AREA)

Abstract

L'invention concerne un dispositif de traitement d'image médicale grâce auquel il est possible de présenter des informations concernant une lésion ou similaire plus détaillées et plus précises que celles de l'état de la technique, et un dispositif d'endoscope. Un dispositif de traitement d'image médicale (10) comprend : une unité d'acquisition d'image médicale (11) pour acquérir des images médicales comprenant une image de sujet; une première unité de traitement de discrimination (51) pour effectuer un premier traitement de discrimination pour détecter un ou une pluralité de types de régions d'anomalie à l'aide d'une première image médicale, parmi les images médicales, qui est capturée à l'aide d'une première lumière d'illumination ayant un spectre spécifique; une seconde unité de traitement de discrimination (52) pour effectuer un second traitement de discrimination pour spécifier un type d'anomalie inclus par chaque région d'anomalie à l'aide d'une seconde image médicale, parmi les images médicales, qui est capturée à l'aide d'une seconde lumière d'illumination ayant un spectre différent de celui de la première lumière d'illumination; et une troisième unité de traitement de discrimination (53) pour effectuer un troisième traitement de discrimination pour spécifier le degré de progression d'une anomalie incluse par une région d'anomalie à l'aide d'une troisième image médicale, parmi les images médicales, qui est capturée à l'aide d'une troisième lumière d'illumination ayant un spectre différent de celui de la première lumière d'illumination et de la seconde lumière d'illumination.
PCT/JP2018/039920 2017-10-30 2018-10-26 Dispositif de traitement d'image médicale et dispositif d'endoscope WO2019087971A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2019550327A JP6834019B2 (ja) 2017-10-30 2018-10-26 医療画像処理装置、及び、内視鏡装置

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017-209802 2017-10-30
JP2017209802 2017-10-30

Publications (1)

Publication Number Publication Date
WO2019087971A1 true WO2019087971A1 (fr) 2019-05-09

Family

ID=66333077

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/039920 WO2019087971A1 (fr) 2017-10-30 2018-10-26 Dispositif de traitement d'image médicale et dispositif d'endoscope

Country Status (2)

Country Link
JP (1) JP6834019B2 (fr)
WO (1) WO2019087971A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020089710A (ja) * 2018-12-04 2020-06-11 Hoya株式会社 情報処理装置、内視鏡用プロセッサ、情報処理方法およびプログラム
WO2020116115A1 (fr) * 2018-12-04 2020-06-11 Hoya株式会社 Dispositif de traitement d'informations et procédé de génération de modèle

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006068488A (ja) * 2004-08-31 2006-03-16 Olympus Corp カプセル内視鏡
JP2012016545A (ja) * 2010-07-09 2012-01-26 Fujifilm Corp 内視鏡装置
WO2015045576A1 (fr) * 2013-09-26 2015-04-02 富士フイルム株式会社 Système d'endoscope, dispositif de processeur pour système d'endoscope, procédé de fonctionnement pour système d'endoscope et procédé de fonctionnement pour dispositif de processeur
JP2016077756A (ja) * 2014-10-21 2016-05-16 富士フイルム株式会社 内視鏡システム、プロセッサ装置、内視鏡システムの作動方法、及びプロセッサ装置の作動方法

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010184057A (ja) * 2009-02-13 2010-08-26 Fujifilm Corp 画像処理方法および装置
JP5541914B2 (ja) * 2009-12-28 2014-07-09 オリンパス株式会社 画像処理装置、電子機器、プログラム及び内視鏡装置の作動方法
JP2011250926A (ja) * 2010-06-01 2011-12-15 Fujifilm Corp 電子内視鏡システム
JP5502812B2 (ja) * 2011-07-14 2014-05-28 富士フイルム株式会社 生体情報取得システムおよび生体情報取得システムの作動方法
US9867557B2 (en) * 2012-03-13 2018-01-16 Konica Minolta, Inc. Probe
US20150245769A1 (en) * 2012-09-24 2015-09-03 Konica Minolta, Inc. Optical Measurement Device And Probe System
EP3354188A4 (fr) * 2015-09-24 2019-04-17 Olympus Corporation Dispositif d'endoscopie
JP6581923B2 (ja) * 2016-03-03 2019-09-25 富士フイルム株式会社 画像処理装置とその作動方法および作動プログラム
JP6201095B1 (ja) * 2016-04-27 2017-09-20 雫石　誠 撮像モジュール及び撮像装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006068488A (ja) * 2004-08-31 2006-03-16 Olympus Corp カプセル内視鏡
JP2012016545A (ja) * 2010-07-09 2012-01-26 Fujifilm Corp 内視鏡装置
WO2015045576A1 (fr) * 2013-09-26 2015-04-02 富士フイルム株式会社 Système d'endoscope, dispositif de processeur pour système d'endoscope, procédé de fonctionnement pour système d'endoscope et procédé de fonctionnement pour dispositif de processeur
JP2016077756A (ja) * 2014-10-21 2016-05-16 富士フイルム株式会社 内視鏡システム、プロセッサ装置、内視鏡システムの作動方法、及びプロセッサ装置の作動方法

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2020089710A (ja) * 2018-12-04 2020-06-11 Hoya株式会社 情報処理装置、内視鏡用プロセッサ、情報処理方法およびプログラム
WO2020116115A1 (fr) * 2018-12-04 2020-06-11 Hoya株式会社 Dispositif de traitement d'informations et procédé de génération de modèle
JP2020089711A (ja) * 2018-12-04 2020-06-11 Hoya株式会社 モデルの生成方法およびプログラム
JP2020089712A (ja) * 2018-12-04 2020-06-11 Hoya株式会社 情報処理装置、内視鏡用プロセッサ、情報処理方法およびプログラム
JP7015275B2 (ja) 2018-12-04 2022-02-02 Hoya株式会社 モデルの生成方法、教師データの生成方法、および、プログラム

Also Published As

Publication number Publication date
JP6834019B2 (ja) 2021-02-24
JPWO2019087971A1 (ja) 2020-10-22

Similar Documents

Publication Publication Date Title
JP7296498B2 (ja) 医療画像処理装置、及び、内視鏡装置
US11132795B2 (en) Medical image processing apparatus
JPWO2018159363A1 (ja) 内視鏡システム及びその作動方法
JP6920931B2 (ja) 医療画像処理装置、内視鏡装置、診断支援装置、及び、医療業務支援装置
JP7009636B2 (ja) 内視鏡システム
US11449988B2 (en) Medical image processing apparatus
JP6785990B2 (ja) 医療画像処理装置、及び、内視鏡装置
US20210158528A1 (en) Medical image processing system
WO2019087971A1 (fr) Dispositif de traitement d'image médicale et dispositif d'endoscope
JP6866497B2 (ja) 医療画像処理装置、及び、内視鏡装置
US11830185B2 (en) Medical image processing system and learning method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18873162

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2019550327

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18873162

Country of ref document: EP

Kind code of ref document: A1