WO2012132571A1 - 診断システム - Google Patents
診断システム Download PDFInfo
- Publication number
- WO2012132571A1 WO2012132571A1 PCT/JP2012/053093 JP2012053093W WO2012132571A1 WO 2012132571 A1 WO2012132571 A1 WO 2012132571A1 JP 2012053093 W JP2012053093 W JP 2012053093W WO 2012132571 A1 WO2012132571 A1 WO 2012132571A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- spectral
- lesion
- image data
- spectral image
- Prior art date
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
- A61B1/000094—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope extracting biological structures
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
- A61B1/043—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for fluorescence imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0638—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
- A61B1/0646—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements with illumination filters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
- A61B5/0084—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
- A61B5/14551—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters for measuring blood gases
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/145—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
- A61B5/1455—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
- A61B5/1459—Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters invasive, e.g. introduced into the body by a catheter
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/42—Detecting, measuring or recording for evaluating the gastrointestinal, the endocrine or the exocrine systems
- A61B5/4222—Evaluating particular parts, e.g. particular organs
- A61B5/4238—Evaluating particular parts, e.g. particular organs stomach
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10068—Endoscopic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30092—Stomach; Gastric
Definitions
- the present invention relates to a diagnostic system capable of displaying, with an image, a region that is likely to be a lesion in a living tissue.
- an electronic endoscope having a function as a spectrometer such as that described in Japanese Patent Application Publication JP2004-321792A. According to such an electronic endoscope, it is possible to obtain spectral characteristics (distribution of light absorption rate for each frequency) of a living tissue such as a mucous membrane of a digestive organ such as the stomach or rectum. It is known that the spectral characteristics of substances reflect information on the types and concentrations of substances contained in the vicinity of the surface layer of the biological tissue to be measured. . Among them, it is also known that the spectral characteristics of a substance composed of a composite component is information that superimposes the spectral characteristics of elemental substances constituting the composite substance.
- the spectral characteristics of the biological tissue including the lesioned part are different from the spectral characteristics of the biological tissue including only the healthy part. As described above, since the spectral characteristics change between the healthy part and the lesioned part, it is possible to determine whether or not any lesioned part in the living tissue is included by comparing the spectral characteristics of both.
- an object of the present invention is to provide a diagnostic system capable of displaying an area that is highly likely to be a lesion by an image.
- the diagnostic system of the present invention includes a spectral image capturing means for capturing spectral image data by capturing a spectral image in a predetermined wavelength region within a body cavity, acquiring the spectral image data, and acquiring the spectral image data.
- An image processing means for obtaining an index value indicating a region having a high possibility of being a lesion, generating and outputting a lesion extracted image based on the index value, and a monitor on which the lesion extracted image is displayed.
- the image processing means performs a multiple regression analysis for each pixel of the spectral image using spectral image data as an objective variable, oxygen absorption characteristics of oxygenated hemoglobin and light absorption characteristics of reduced hemoglobin as explanatory variables, An index value is obtained based on the concentrations of conjugated hemoglobin and reduced hemoglobin.
- the inventor of the present invention conducted a multiple regression analysis using spectral image data as an objective variable, light absorption characteristics of oxygenated hemoglobin and light absorption characteristics of reduced hemoglobin as an explanatory variable, and as a result, spectral image data was obtained from oxygenated hemoglobin. It can be explained by using the light absorption property and the light absorption property of reduced hemoglobin and the influence of light scattering, and it has been found that the concentration of oxygenated hemoglobin is higher in the lesioned part than in the healthy part. The present invention utilizes this property. First, for each pixel of a spectral image, spectral image data is used as an objective variable, and oxygen absorption characteristics of oxygenated hemoglobin and light absorption characteristics of reduced hemoglobin are used as explanatory variables.
- an index value is obtained based on the concentrations of oxygenated hemoglobin and reduced hemoglobin, and a lesion extraction image based on the obtained index value is output to a monitor. Therefore, according to such a configuration, it becomes possible to perform disease detection and diagnosis support by displaying, on the monitor, a region where the oxygenated hemoglobin concentration is different from that in the peripheral portion, as a lesion extracted image.
- the image processing means may be configured to obtain a ratio between the oxygenated hemoglobin concentration and the reduced hemoglobin concentration as an index value. With such a configuration, it is possible to accurately determine which region is highly likely to be a lesion.
- the image processing means may be configured to generate a lesion extracted image by assigning a predetermined color based on the index value to each pixel of the spectral image.
- the image processing means includes a comparison means for comparing the index value with a predetermined threshold value, and a binary image generation means for generating a binary image based on the comparison result of the comparison means. It is also possible to have a configuration generated based on a binary image. With such a configuration, it becomes easy to identify a lesioned part and a healthy part.
- the image processing means combines the spectral image data in the blue, green, and red wavelength bands and outputs a color image, and the monitor displays the color image and the lesion extracted image side by side. It is also possible to adopt a configuration. With such a configuration, it is possible to more easily determine which region is likely to be a lesion by comparing the color image of the biological tissue captured by the spectral image capturing unit with the lesion extracted image. .
- the image processing means may be configured to obtain the index value from the spectral image data having a wavelength band of 500 nm to 590 nm which is an absorption wavelength band of oxygenated hemoglobin and reduced hemoglobin. With such a configuration, it is possible to calculate multiple regression coefficients at higher speed and higher accuracy.
- the predetermined wavelength region is 400 to 800 nm
- the spectral image is preferably a plurality of images taken for each predetermined wavelength defined in the range of 1 to 10 nm.
- the diagnostic system of the present invention since a region that is likely to be a lesion is displayed as an image, the diagnostic time is shortened and a necessary range such as excision by surgery can be easily achieved. Confirmation and identification are possible.
- FIG. 1 is a block diagram of a diagnostic system 1 according to an embodiment of the present invention.
- FIG. 2 is a graph showing spectral image data of the gastric mucosa acquired by the diagnostic system 1 according to the embodiment of the present invention.
- FIG. 2A is a graph showing a spectrum of pixels corresponding to a lesioned part of the gastric mucosa
- FIG. 2B is a graph showing a spectrum of pixels corresponding to a healthy part of the gastric mucosa.
- FIG. 3 is a graph showing the absorption characteristics of hemoglobin.
- FIG. 4 is a graph showing the result of performing multiple regression analysis on the spectral image data of the gastric mucosa shown in FIG.
- FIG. 4 is a graph showing the result of performing multiple regression analysis on the spectral image data of the gastric mucosa shown in FIG. FIG.
- FIG. 4A is a graph showing the results of multiple regression analysis for the spectrum of pixels corresponding to the gastric mucosa lesion shown in FIG. 2A
- FIG. 4B corresponds to the healthy part of the gastric mucosa shown in FIG. 2B. It is a graph which shows the result of having performed the multiple regression analysis about the spectrum of the pixel to perform.
- FIG. 5 is a graph showing an example of multiple regression coefficients P1 and P2 obtained by performing multiple regression analysis on the spectral image data of the gastric mucosa shown in FIG.
- FIG. 6 is a graph showing an example of multiple regression coefficients P1 and P2 obtained by performing multiple regression analysis on the spectral image data of the gastric mucosa shown in FIG.
- FIG. 7 is a flowchart showing image generation processing executed by the image processing unit 500 of this embodiment.
- FIG. 8 is a diagram schematically illustrating a color image and a lesion extraction image displayed on the image display device 300 by the image generation processing of FIG.
- FIG. 1 is a block diagram of a diagnostic system 1 according to an embodiment of the present invention.
- the diagnosis system 1 of this embodiment generates an index image that is referred to by a doctor when diagnosing digestive organ diseases such as the stomach and intestines.
- the diagnostic system 1 includes an electronic endoscope 100, an electronic endoscope processor 200, and an image display device 300.
- the electronic endoscope processor 200 includes a light source unit 400 and an image processing unit 500.
- the electronic endoscope 100 has an insertion tube 110 to be inserted into a body cavity, and an objective optical system 121 is provided at a distal end portion (insertion tube distal end portion) 111 of the insertion tube 110.
- An image of the living tissue T around the insertion tube tip 111 by the objective optical system 121 is formed on the light receiving surface of the image sensor 141 built in the insertion tube tip 111.
- the image sensor 141 periodically outputs a video signal corresponding to the image formed on the light receiving surface (for example, every 1/30 seconds).
- the video signal output from the image sensor 141 is sent to the image processing unit 500 of the electronic endoscope processor 200 via the cable 142.
- the image processing unit 500 includes an A / D conversion circuit 510, a temporary storage memory 520, a controller 530, a video memory 540, and a signal processing circuit 550.
- the A / D conversion circuit 510 performs A / D conversion on a video signal input from the imaging element 141 of the electronic endoscope 100 via the cable 142 and outputs digital image data.
- Digital image data output from the A / D conversion circuit 510 is sent to and stored in the temporary storage memory 520.
- the controller 530 processes one or a plurality of image data stored in the temporary storage memory 520 to generate one piece of display image data, and sends this to the video memory 540.
- the controller 530 displays image data for display generated from a single image data, image data for display in which images of a plurality of image data are displayed side by side, or an image obtained by performing image operations on a plurality of image data.
- display image data or the like on which a graph obtained as a result of image calculation is displayed is generated and stored in the video memory 540.
- the signal processing circuit 550 converts display image data stored in the video memory 540 into a video signal in a predetermined format (for example, NTSC format) and outputs the video signal.
- the video signal output from the signal processing circuit 550 is input to the image display device 300.
- an endoscope image or the like captured by the electronic endoscope 100 is displayed on the image display device 300.
- the electronic endoscope 100 is provided with a light guide 131.
- the distal end portion 131 a of the light guide 131 is disposed in the vicinity of the insertion tube distal end portion 111, while the proximal end portion 131 b of the light guide 131 is connected to the electronic endoscope processor 200.
- the electronic endoscope processor 200 includes a light source unit 400 (described later) having a light source 430 that generates white light with a large amount of light, such as a xenon lamp, and the light generated by the light source unit 400 is light. The light is incident on the base end portion 131 b of the guide 131.
- the light incident on the base end portion 131b of the light guide 131 is guided to the tip end portion 131a through the light guide 131 and is emitted from the tip end portion 131a.
- a lens 132 is provided in the vicinity of the distal end portion 131a of the light guide 131 at the distal end portion 111 of the insertion tube of the electronic endoscope 100.
- Light emitted from the distal end portion 131a of the light guide 131 passes through the lens 132.
- the light passes through and illuminates the living tissue T in the vicinity of the distal end portion 111 of the insertion tube.
- the electronic endoscope processor 200 functions as a video processor that processes the video signal output from the imaging device 141 of the electronic endoscope 100 and the vicinity of the insertion tube distal end portion 111 of the electronic endoscope 100. It also has a function as a light source device that supplies illumination light for illuminating the living tissue T to the light guide 131 of the electronic endoscope 100.
- the light source unit 400 of the electronic endoscope processor 200 includes a light source 430, a collimator lens 440, a spectral filter 410, a filter control unit 420, and a condenser lens 450.
- the white light emitted from the light source 430 becomes parallel light by the collimator lens 440, passes through the spectral filter 410, and then enters the base end portion 131 b of the light guide 131 by the condenser lens 450.
- the spectral filter 410 is a disk-type filter that spectrally separates white light incident from the light source 430 into light having a predetermined wavelength (that is, selects a wavelength), and 400, 405, 410,...
- Wavelength of light of a narrow band of 800 nm (bandwidth of about 5 nm) is output.
- the rotation angle of the spectral filter 410 is controlled by a filter control unit 420 connected to the controller 530, and the controller 530 controls the rotation angle of the spectral filter 410 via the filter control unit 420, thereby allowing a predetermined wavelength.
- Light enters the proximal end portion 131 b of the light guide 131 and illuminates the living tissue T in the vicinity of the insertion tube distal end portion 111. Then, the light reflected by the living tissue T forms an image on the light receiving surface of the image sensor 141 as described above, and a video signal is sent to the image processing unit 500 via the cable 142.
- the image processing unit 500 is a device that obtains a plurality of spectral images with a wavelength of 5 nm from an image of the living tissue T obtained via the cable 142. Specifically, when the spectral filter 410 selects and outputs light of a narrow band (bandwidth of about 5 nm) having a center wavelength of 400, 405, 410,. A spectral image is obtained.
- the image processing unit 500 has a function of processing a plurality of spectral images generated by the spectral filter 410 to generate a color image or a lesion extracted image as will be described later. Then, the image processing unit 500 causes the image display device 300 to display the processed spectral image and lesioned part extracted image.
- the image processing unit 500 has a function of generating a lesion extraction image by extracting a region that is highly likely to be a lesion using a plurality of spectral images having different wavelengths. .
- the function for generating the lesion extracted image will be described below.
- FIG. 2 shows spectral image data of the gastric mucosa acquired by the diagnostic system 1 of the embodiment of the present invention, and each waveform is a spectrum of a specific pixel in the spectral image (that is, a luminance value at each wavelength). Is shown.
- FIG. 2A shows the spectrum of pixels corresponding to the lesioned part of the gastric mucosa
- FIG. 2B shows the spectrum of pixels corresponding to the healthy part of the gastric mucosa.
- each pixel of the image sensor 141 emits a different amount of light depending on the angle between the illumination light and the subject (living tissue T) and the distance from the insertion tube tip 111 (FIG. 1) to the living tissue T. Since the light is received, the influence of this light amount difference is corrected and shown.
- the spectrum of the gastric mucosa image shows a substantially M-shaped characteristic having a trough at a wavelength of 500 to 590 nm regardless of whether it is a healthy part or a lesioned part.
- the spectrum of the pixel corresponding to the lesioned part is larger in dispersion (variation) than the spectrum of the pixel corresponding to the healthy part, and has two valleys with wavelengths of about 540 nm and 570 nm. Different from the spectrum of the pixel corresponding to the healthy part. Therefore, it can be seen that the healthy part and the lesioned part can be identified by analyzing the spectrum of each pixel of the spectral image.
- the inventors of the present invention have found a configuration in which a multiple regression analysis is performed on spectral image data, and a healthy part and an abnormal part are quantitatively determined based on a multiple regression coefficient.
- FIG. 3 is a graph showing the absorption characteristics of hemoglobin.
- the solid line indicates the light absorption characteristics of oxygenated hemoglobin
- the dotted line indicates the light absorption characteristics of reduced hemoglobin.
- oxygenated hemoglobin and reduced hemoglobin are common in that they absorb light having a wavelength of 500 to 590 nm (that is, the absorption characteristics increase in the wavelength range of 500 to 590 nm). Is different from that of oxygenated hemoglobin in that it has two peaks at wavelengths of about 540 nm and 570 nm.
- the inventor of the present invention pays attention to the difference in the characteristics, and uses the spectral image data of the gastric mucosa shown in FIG.
- the spectral image data of the gastric mucosa can be explained by using the light absorption characteristics of oxygenated hemoglobin and the light absorption characteristics of reduced hemoglobin, and the lesioned part of oxygenated hemoglobin is compared with the healthy part. It has been found that when the concentration is high, the healthy part and the abnormal part can be identified quantitatively based on the multiple regression coefficient of oxygenated hemoglobin.
- the present embodiment by using the two-dimensional spectral information, not only the absolute evaluation of the spectral characteristics at one point (pixel) but also the change with the peripheral region is relatively compared. As a result, even when absolute evaluation is difficult due to the tissue, structure, individual difference, and disease state of a living body, it is possible to detect a lesion with high accuracy.
- a measurement model of spectral image data acquired in the present embodiment is represented by the following formula 1 based on Lambert-Beer's law (Beer-LambertawLaw).
- A is the absorption coefficient of the medium (living tissue T)
- I O is the radiation intensity of light before entering the medium
- I is the intensity of light when moving through the medium by the distance d
- ⁇ is the molar extinction coefficient
- C is the molar concentration
- ⁇ is the wavelength of light.
- the absorption coefficient A in the case of having n kinds of light-absorbing substances is expressed as the sum of the absorption characteristics of each light-absorbing substance. Therefore, as shown in Equation 3 below, multiple regression analysis is performed using the spectral image data of the gastric mucosa shown in FIG. 2 as the objective variable, the light absorption characteristic of oxygenated hemoglobin, and the light absorption characteristic of reduced hemoglobin as explanatory variables. went.
- X is the data for one pixel of the spectral image of the gastric mucosa, and is the luminance value data of the spectral image obtained by irradiating light of each wavelength in 5 nm increments from the central wavelength of 400 to 800 nm.
- a is the light absorption characteristic of oxygenated hemoglobin in increments of 5 nm from a wavelength of 400 to 800 nm
- b is the light absorption characteristic of reduced hemoglobin in increments of 5 nm from a wavelength of 400 to 800 nm.
- FIG. 4 is a graph showing the results of a multiple regression analysis of the spectral image data of the gastric mucosa shown in FIG.
- FIG. 4A is a graph showing the result of multiple regression analysis of the spectrum of the pixel corresponding to the lesion of the gastric mucosa shown in FIG. It is a graph which shows the result of having performed the multiple regression analysis, after converting a vertical axis
- the solid line is the data series of the spectral image data of the gastric mucosa
- the dotted line is the data series showing the results of the multiple regression analysis
- the alternate long and short dash line is the residual after the multiple regression analysis It is a data series showing (that is, the difference between the result of the multiple regression analysis and the spectral image data).
- the individual waveforms in FIG. 2 that is, the spectrum of a specific pixel in the spectroscopic image
- FIG. 5 is a graph showing a first example of multiple regression coefficients P1 and P2 obtained by performing multiple regression analysis on the spectral image data of the gastric mucosa shown in FIG.
- FIG. 6 is a graph showing a second example of multiple regression coefficients P1 and P2 obtained by performing multiple regression analysis on the spectral image data of the gastric mucosa shown in FIG. 5 and 6, the range of the frame T shows the multiple regression coefficients P1 and P2 of the pixels corresponding to the lesioned part, and the range of the frame N shows the multiple regression coefficients P1 and P2 of the pixels corresponding to the healthy part. Show.
- FIG. 5 is a graph showing a first example of multiple regression coefficients P1 and P2 obtained by performing multiple regression analysis on the spectral image data of the gastric mucosa shown in FIG.
- FIG. 6 is a graph showing a second example of multiple regression coefficients P1 and P2 obtained by performing multiple regression analysis on the spectral image data of the gastric mucosa shown
- the multiple regression coefficients P1 and P2 of the pixels corresponding to the lesioned part have larger variations than the multiple regression coefficients P1 and P2 of the pixels corresponding to the healthy part, and the pixels corresponding to the lesioned part The multiple regression coefficients P1 and P2 were observed to be larger than the multiple regression coefficients P1 and P2 of the pixels corresponding to the healthy part.
- the multiple regression coefficient P1 represents the amount (ie, concentration) of oxygenated hemoglobin
- the multiple regression coefficient P2 is a parameter representing the amount of reduced hemoglobin
- the multiple regression coefficients P1 and P2 of the pixels corresponding to the lesioned part have larger variations than the multiple regression coefficients P1 and P2 of the pixels corresponding to the healthy part, and correspond to the lesioned part.
- the multiple regression coefficient P1 of the pixel was observed to be larger than the multiple regression coefficient P1 of the pixel corresponding to the healthy part.
- the image processing unit 500 of the present embodiment generates a lesion extracted image based on the index value.
- FIG. 7 is a flowchart showing image generation processing executed by the image processing unit 500 of this embodiment.
- FIG. 8 schematically shows a color image and a lesion extracted image displayed on the image display device 300 by the image generation processing of FIG.
- the image generation process is a routine for generating a color image and a lesion extracted image and displaying them on the image display device 300. This routine is executed when the diagnostic system 1 is turned on.
- step S1 the image processing unit 500 sends a control signal for causing the filter control unit 400 to acquire a spectral image.
- the filter control unit 400 controls the rotation angle of the spectral filter 410 and sequentially selects wavelengths of 400, 405, 410,..., 800 nm narrow band (bandwidth of about 5 nm).
- the image processing unit 500 takes a spectral image obtained at each wavelength and records it in the temporary storage memory 520.
- step S2 the process proceeds to step S2.
- step S2 three images having the center wavelengths of 435 nm, 545 nm, and 700 nm are extracted from the spectral image acquired in step S1, and the image having the center wavelength of 435 nm is taken as a blue plane and the image having the center wavelength of 545 nm.
- One color image data is generated in which an image having a center wavelength of 700 nm is stored in a red plane. This color image data is obtained from the spectral image of 435 nm which is the blue wavelength, the spectral image of 545 nm which is the green wavelength and the spectral image of 700 nm which is the red wavelength as described above.
- a color image equivalent to the endoscopic image is obtained.
- the image processing unit 500 sends the generated color image data to the video memory 540 for display on the left side of the screen of the image display device 300 (FIG. 8).
- the process proceeds to step S3.
- step S3 whether or not a trigger input for instructing generation of a lesion extraction image has occurred by operating an operation unit (not shown) of the electronic endoscope processor 200 while step S1 or S2 is being executed. Confirmation is made. If no trigger input has occurred (S3: NO), the process proceeds to step S1, and a spectral image is acquired again. That is, as long as there is no trigger input, the color image obtained from the spectral image is sequentially updated and continuously displayed on the image display device 300. On the other hand, if a trigger input has occurred while steps S1 to S2 are being executed (S3: YES), the process proceeds to step S4.
- step S4 multiple regression analysis is performed on the spectral image acquired in step S1. Specifically, multiple regression coefficients P1 and P2 are obtained using Equation 3 for all pixels of the spectral image acquired in step S1. Next, the process proceeds to step S5.
- step S5 an index value (ratio R) is obtained using Equation 4 for the multiple regression coefficients P1 and P2 of each pixel obtained in step S4.
- step S6 the process proceeds to step S6.
- step S6 a lesion extraction image is generated based on the index value of each pixel obtained in step S5. Specifically, a predetermined color is assigned to each pixel according to the index value of each pixel, and a lesion extraction image is generated.
- a portion having an index value (ratio R) of 0.6 or less is determined as a healthy part and blue is assigned, and a portion greater than 0.6 and 1.0 or less is a boundary between the healthy part and a lesioned part.
- a green part is assigned as a part, and a part larger than 1.0 is judged as a lesion part, and a lesion part extracted image assigned with a yellow color is generated and displayed on the right side of the screen of the image display device 300 (FIG. 8).
- the process proceeds to step S7.
- step S7 the image processing unit 500 causes the image display device 300 to display a message for inquiring whether or not to generate a lesion extracted image again, and input from the operation unit (not shown) of the electronic endoscope processor 200. Accept.
- the process returns to step S1.
- the regeneration of the lesion extracted image is not instructed for a certain time (for example, several seconds) (S7: NO)
- the process proceeds to step S8.
- step S8 the image processing unit 500 causes the image display device 300 to display a message for inquiring whether or not to end the display of the lesion extracted image, and from an operation unit (not shown) of the electronic endoscope processor 200. Accept input.
- the user of the diagnostic system 1 operates the operation unit and selects to end the display of the lesion extracted image (S8: YES)
- this routine ends.
- the display of the lesion extracted image is not instructed for a certain time (for example, several seconds) (S8: NO)
- the process proceeds to step S7.
- a lesion extracted image effective for estimating the position of the lesion is displayed on the image display device 300.
- the doctor can make a diagnosis while identifying the position and range of the lesion part and comparing with the surrounding tissue. It becomes possible.
- an index value is obtained by using Equation 4 for the multiple regression coefficients P1 and P2 of each pixel, and an area having a high possibility of a lesion (based on the index value) ( Pixel).
- the present invention is not limited to the above configuration, and for example, a region (pixel) having a high possibility of a lesion may be specified using the magnitude of the multiple regression coefficient P1 as an index value.
- the image processing unit 500 is configured to perform multiple regression analysis using all spectral image data acquired in 5 nm increments in the wavelength range of 400 to 800 nm.
- the present invention is limited to this configuration. It is not something.
- a narrower range including a wavelength band of 500 nm to 590 nm, which is an absorption wavelength band of oxygenated hemoglobin and deoxyhemoglobin, and a reference value necessary for standardization for each pixel can be used.
- a configuration may be used in which multiple regression analysis is performed using only spectral image data in the wavelength band of 500 nm to 590 nm, which is the absorption wavelength band of oxygenated hemoglobin and reduced hemoglobin.
- the configuration of acquiring the spectral image data in increments of 5 nm is not necessarily required.
- the wavelength interval for acquiring the spectral image data can be selected from a range of 1 to 10 nm, for example.
- the image processing unit 500 generates a lesion extracted image by allocating a predetermined color based on the index value for each pixel of the spectral image. It is not limited to.
- the index value is compared with a predetermined threshold, and when the index value is larger than the predetermined threshold (that is, when a large amount of oxygenated hemoglobin is detected), it is determined that the possibility of a lesion is high, and the pixel It is good also as a structure which extracts a lesion part extraction image and produces
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Surgery (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Pathology (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Public Health (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- Optics & Photonics (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Signal Processing (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Endocrinology (AREA)
- Gastroenterology & Hepatology (AREA)
- Physiology (AREA)
- Endoscopes (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
Description
Claims (7)
- 体腔内において所定波長領域の分光画像を撮影して分光画像データを得る分光画像撮影手段と、
前記分光画像データを取得し、該分光画像データから、病変部である可能性が高い領域を示す指標値を求め、該指標値に基づいた病変部抽出画像を生成して出力する画像処理手段と、
前記病変部抽出画像が表示されるモニタと、
を有し、
前記画像処理手段は、前記分光画像の各画素について、前記分光画像データを目的変数とし、酸素化ヘモグロビンの光の吸収特性及び還元ヘモグロビンの光の吸収特性を説明変数として重回帰分析を行い、酸素化ヘモグロビン及び還元ヘモグロビンの濃度に基づいて前記指標値を求めることを特徴とする診断システム。 - 前記画像処理手段は、前記酸素化ヘモグロビンの濃度と前記還元ヘモグロビンの濃度の比率を前記指標値として求めることを特徴とする請求項1に記載の診断システム。
- 前記画像処理手段は、前記分光画像の各画素について、前記指標値に基づいた所定の色を割り当てることによって前記病変部抽出画像を生成することを特徴とする請求項1又は請求項2に記載の診断システム。
- 前記画像処理手段は、前記指標値を所定の閾値と比較する比較手段と、前記比較手段の比較結果に基づいて2値画像を生成する2値画像生成手段と、を有し、
前記病変部抽出画像は、前記2値画像に基づいて生成されることを特徴とする請求項1又は請求項2に記載の診断システム。 - 前記画像処理手段は、前記分光画像データのうち、青色、緑色、赤色の波長帯域のものを合成してカラー画像を出力し、
前記モニタには、前記カラー画像と前記病変部抽出画像とが並べられて表示される
ことを特徴とする請求項1から請求項4のいずれか一項に記載の診断システム。 - 前記画像処理手段は、前記分光画像データのうち、前記酸素化ヘモグロビンと前記還元ヘモグロビンの吸収波長帯域である500nm~590nmの波長帯域のものから前記指標値を求めることを特徴とする請求項1から請求項5のいずれか一項に記載の診断システム。
- 前記所定波長領域は、400~800nmであり、前記分光画像は、1~10nmの範囲で定められる所定の波長毎に撮影された複数の画像であることを特徴とする請求項1から請求項6のいずれか一項に記載の診断システム。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013507237A JPWO2012132571A1 (ja) | 2011-03-29 | 2012-02-10 | 診断システム |
US14/006,775 US20140010424A1 (en) | 2011-03-29 | 2012-02-10 | Diagnostic system |
CN2012800159534A CN103476320A (zh) | 2011-03-29 | 2012-02-10 | 诊断系统 |
EP12764519.0A EP2692275A4 (en) | 2011-03-29 | 2012-02-10 | DIAGNOSTIC SYSTEM |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2011-072216 | 2011-03-29 | ||
JP2011072216 | 2011-03-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2012132571A1 true WO2012132571A1 (ja) | 2012-10-04 |
Family
ID=46930335
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2012/053093 WO2012132571A1 (ja) | 2011-03-29 | 2012-02-10 | 診断システム |
Country Status (5)
Country | Link |
---|---|
US (1) | US20140010424A1 (ja) |
EP (1) | EP2692275A4 (ja) |
JP (1) | JPWO2012132571A1 (ja) |
CN (1) | CN103476320A (ja) |
WO (1) | WO2012132571A1 (ja) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013172156A1 (ja) * | 2012-05-18 | 2013-11-21 | Hoya株式会社 | 電子内視鏡装置 |
JP2014230647A (ja) * | 2013-05-29 | 2014-12-11 | Hoya株式会社 | 表示装置、表示方法および表示プログラム |
JP2017000836A (ja) * | 2016-09-27 | 2017-01-05 | Hoya株式会社 | 電子内視鏡装置 |
WO2018070474A1 (ja) * | 2016-10-14 | 2018-04-19 | Hoya株式会社 | 内視鏡システム |
JP2018163248A (ja) * | 2017-03-24 | 2018-10-18 | 株式会社Screenホールディングス | 画像取得方法および画像取得装置 |
JP2018198703A (ja) * | 2017-05-26 | 2018-12-20 | 池上通信機株式会社 | 撮像画像処理システム |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5923099B2 (ja) | 2011-09-29 | 2016-05-24 | Hoya株式会社 | 診断システム |
JP6966683B2 (ja) * | 2016-01-19 | 2021-11-17 | ソニー・オリンパスメディカルソリューションズ株式会社 | 医療用光源装置及び医療用観察システム |
CN112717282B (zh) * | 2021-01-14 | 2023-01-10 | 重庆翰恒医疗科技有限公司 | 一种光诊疗装置及全自动光诊疗系统 |
CN113554578B (zh) * | 2021-07-23 | 2024-05-31 | 奥比中光科技集团股份有限公司 | 一种光谱图像的确定方法、装置、终端和存储介质 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003508735A (ja) * | 1999-08-31 | 2003-03-04 | ネイダーランゼ、オルガニザティー、ボー、トゥーゲパストナトゥールウェテンシャッペルーク、オンダーツォーク、ティーエヌオー | 濃度比率決定用撮像装置 |
JP2004321792A (ja) | 2003-04-14 | 2004-11-18 | Optiscan Pty Ltd | 深度制御またはz軸駆動の方法とその装置 |
JP2009066301A (ja) * | 2007-09-14 | 2009-04-02 | Fujifilm Corp | 画像処理装置および内視鏡システム |
JP2009068940A (ja) * | 2007-09-12 | 2009-04-02 | Canon Inc | 測定装置 |
JP2009131617A (ja) * | 2007-11-09 | 2009-06-18 | Fujifilm Corp | 撮像システム、撮像方法、およびプログラム |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5001556A (en) * | 1987-09-30 | 1991-03-19 | Olympus Optical Co., Ltd. | Endoscope apparatus for processing a picture image of an object based on a selected wavelength range |
US7603166B2 (en) * | 1996-09-20 | 2009-10-13 | Board Of Regents University Of Texas System | Method and apparatus for detection of vulnerable atherosclerotic plaque |
JP2793989B2 (ja) * | 1996-09-30 | 1998-09-03 | オリンパス光学工業株式会社 | 内視鏡用光源装置の回転フィルタ |
WO2001037717A2 (en) * | 1999-11-26 | 2001-05-31 | Applied Spectral Imaging Ltd. | System and method for functional brain mapping |
JP4663083B2 (ja) * | 2000-09-11 | 2011-03-30 | オリンパス株式会社 | 内視鏡装置 |
JP2002345733A (ja) * | 2001-05-29 | 2002-12-03 | Fuji Photo Film Co Ltd | 撮像装置 |
CA2631564A1 (en) * | 2004-11-29 | 2006-06-01 | Hypermed, Inc. | Medical hyperspectral imaging for evaluation of tissue and tumor |
US20080009748A1 (en) * | 2006-05-16 | 2008-01-10 | The Regents Of The University Of California | method and apparatus for the determination of intrinsic spectroscopic tumor markers by broadband-frequency domain technology |
WO2010019515A2 (en) * | 2008-08-10 | 2010-02-18 | Board Of Regents, The University Of Texas System | Digital light processing hyperspectral imaging apparatus |
-
2012
- 2012-02-10 US US14/006,775 patent/US20140010424A1/en not_active Abandoned
- 2012-02-10 EP EP12764519.0A patent/EP2692275A4/en not_active Withdrawn
- 2012-02-10 CN CN2012800159534A patent/CN103476320A/zh active Pending
- 2012-02-10 WO PCT/JP2012/053093 patent/WO2012132571A1/ja active Application Filing
- 2012-02-10 JP JP2013507237A patent/JPWO2012132571A1/ja active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003508735A (ja) * | 1999-08-31 | 2003-03-04 | ネイダーランゼ、オルガニザティー、ボー、トゥーゲパストナトゥールウェテンシャッペルーク、オンダーツォーク、ティーエヌオー | 濃度比率決定用撮像装置 |
JP2004321792A (ja) | 2003-04-14 | 2004-11-18 | Optiscan Pty Ltd | 深度制御またはz軸駆動の方法とその装置 |
JP2009068940A (ja) * | 2007-09-12 | 2009-04-02 | Canon Inc | 測定装置 |
JP2009066301A (ja) * | 2007-09-14 | 2009-04-02 | Fujifilm Corp | 画像処理装置および内視鏡システム |
JP2009131617A (ja) * | 2007-11-09 | 2009-06-18 | Fujifilm Corp | 撮像システム、撮像方法、およびプログラム |
Non-Patent Citations (1)
Title |
---|
See also references of EP2692275A4 |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2013172156A1 (ja) * | 2012-05-18 | 2013-11-21 | Hoya株式会社 | 電子内視鏡装置 |
JP2013240401A (ja) * | 2012-05-18 | 2013-12-05 | Hoya Corp | 電子内視鏡装置 |
CN104486983A (zh) * | 2012-05-18 | 2015-04-01 | Hoya株式会社 | 电子内窥镜设备 |
JP2014230647A (ja) * | 2013-05-29 | 2014-12-11 | Hoya株式会社 | 表示装置、表示方法および表示プログラム |
JP2017000836A (ja) * | 2016-09-27 | 2017-01-05 | Hoya株式会社 | 電子内視鏡装置 |
WO2018070474A1 (ja) * | 2016-10-14 | 2018-04-19 | Hoya株式会社 | 内視鏡システム |
JPWO2018070474A1 (ja) * | 2016-10-14 | 2019-06-24 | Hoya株式会社 | 内視鏡システム |
US10905318B2 (en) | 2016-10-14 | 2021-02-02 | Hoya Corporation | Endoscope system |
JP2018163248A (ja) * | 2017-03-24 | 2018-10-18 | 株式会社Screenホールディングス | 画像取得方法および画像取得装置 |
JP2018198703A (ja) * | 2017-05-26 | 2018-12-20 | 池上通信機株式会社 | 撮像画像処理システム |
Also Published As
Publication number | Publication date |
---|---|
JPWO2012132571A1 (ja) | 2014-07-24 |
US20140010424A1 (en) | 2014-01-09 |
CN103476320A (zh) | 2013-12-25 |
EP2692275A1 (en) | 2014-02-05 |
EP2692275A4 (en) | 2014-09-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2012132571A1 (ja) | 診断システム | |
US11224335B2 (en) | Image capturing system and electronic endoscope system | |
JP5923099B2 (ja) | 診断システム | |
AU2015284810B2 (en) | Raman spectroscopy system, apparatus, and method for analyzing, characterizing, and/or diagnosing a type or nature of a sample or a tissue such as an abnormal growth | |
US10244972B2 (en) | Fluorescence observation device, endoscopic system, processor device, and operation method | |
WO2013172156A1 (ja) | 電子内視鏡装置 | |
US9113787B2 (en) | Electronic endoscope system | |
EP2583617A2 (en) | Systems for generating fluorescent light images | |
JP5737899B2 (ja) | 診断システム | |
JP2014230647A (ja) | 表示装置、表示方法および表示プログラム | |
JP2005046634A (ja) | コンパクトな蛍光内視鏡映像システム | |
JP2009300131A (ja) | 生体組織識別装置および方法 | |
WO2018070474A1 (ja) | 内視鏡システム | |
JP2013048646A (ja) | 診断システム | |
JP6650919B2 (ja) | 診断システム及び情報処理装置 | |
JP4109132B2 (ja) | 蛍光判定装置 | |
JP2017000836A (ja) | 電子内視鏡装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12764519 Country of ref document: EP Kind code of ref document: A1 |
|
DPE2 | Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101) | ||
WWE | Wipo information: entry into national phase |
Ref document number: 14006775 Country of ref document: US |
|
ENP | Entry into the national phase |
Ref document number: 2013507237 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012764519 Country of ref document: EP |