WO2016151675A1 - Dispositif d'observation de corps vivant et procédé d'observation de corps vivant - Google Patents

Dispositif d'observation de corps vivant et procédé d'observation de corps vivant Download PDF

Info

Publication number
WO2016151675A1
WO2016151675A1 PCT/JP2015/058477 JP2015058477W WO2016151675A1 WO 2016151675 A1 WO2016151675 A1 WO 2016151675A1 JP 2015058477 W JP2015058477 W JP 2015058477W WO 2016151675 A1 WO2016151675 A1 WO 2016151675A1
Authority
WO
WIPO (PCT)
Prior art keywords
imaging
blood
image
fat
unit
Prior art date
Application number
PCT/JP2015/058477
Other languages
English (en)
Japanese (ja)
Inventor
佐藤　貴之
Original Assignee
オリンパス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オリンパス株式会社 filed Critical オリンパス株式会社
Priority to PCT/JP2015/058477 priority Critical patent/WO2016151675A1/fr
Publication of WO2016151675A1 publication Critical patent/WO2016151675A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor

Definitions

  • the present invention relates to a living body observation apparatus and a living body observation method.
  • NBI narrow band light observation
  • This narrow-band light observation is expected as an alternative observation method of pigment dispersion widely performed for detailed diagnosis of the esophagus region and pit pattern (ductal structure) observation of the large intestine, and the examination time and unnecessary biopsy The reduction is expected to contribute to the efficiency of inspections.
  • a living body observation apparatus capable of preventing damage to nerves surrounding a target organ by making the structure of the tissue on the surface of the target organ such as an extraction target easy to see (for example, patent documents 2).
  • this living body observation apparatus focusing on the fact that the nerve surrounding the target organ is present in the fat layer, the absorption characteristics of ⁇ -carotene contained in fat and hemoglobin in the blood have different wavelength bands. Because of the absorption characteristics, it is possible to irradiate the irradiation light of the corresponding wavelength band to obtain an image that is easy to identify fat, and to perform surgery so as not to damage nerves distributed in the fat layer.
  • the detection of fat is performed by extracting the difference between the image captured by irradiating the light near 480 nm with much absorption of ⁇ -carotene and the light imaged by the light near 510 nm with little absorption of ⁇ -carotene and extracted. realizable.
  • blood is present on the subject due to bleeding during the operation.
  • Hemoglobin contained in blood has absorption characteristics in the wavelength band near 480 nm and 510 nm, so absorption of hemoglobin becomes dominant compared to the absorption of ⁇ -carotene when a large amount of blood is placed on fat , Fat can not be detected accurately (false positive, false negative occurs).
  • blood is detected by comparing an image captured by irradiation with light near 610 nm having a small absorption of hemoglobin with an image captured by irradiation with light near 510 nm having a larger absorption than 610 nm to detect blood as described above. It is desirable to correct fat detection results with blood detection results.
  • JP 2011-224038 A International Publication No. 2013/115323
  • the obtained information is different in the depth direction of the living body. That is, since the image captured by emitting light in the vicinity of 510 nm and the image captured by emitting light in the vicinity of 610 nm are different in the information in the depth direction, blood detection accuracy is lowered, and stable fat detection can not be performed.
  • the present invention has been made in view of the above-described circumstances, and improves the detection accuracy of blood when blood is placed on fat while maintaining smooth observation when there is little blood on fat.
  • One embodiment of the present invention includes a light source unit that emits illumination light to a living tissue, an imaging unit that captures reflected light from the living tissue of the illumination light emitted by the light source unit and acquires an image, and the imaging unit Based on a fat detection unit that detects fat in the acquired image, a blood detection unit that detects blood in the image acquired by the imaging unit, and detection results by the fat detection unit and the blood detection unit Control unit configured to control at least one of the light source unit and the imaging unit, the control unit controlling the image by the blood detection unit in a state where fat is detected in the image by the fat detection unit
  • a living body that switches between a simultaneous first imaging method for simultaneously imaging a plurality of band lights of different wavelength bands and a second imaging method for surface sequential imaging that sequentially images according to the state of blood detected inside Observation equipment It is.
  • the fat detection unit is acquired using the acquired image As a result, fat in the image is detected, and blood in the image is detected by the blood detection unit.
  • the control unit performs the first imaging method and the second imaging method Switch.
  • the first imaging method since plural bands of light having different wavelength bands are simultaneously irradiated, reflected light of plural bands of light can be photographed at the same time, and the frame rate can be improved.
  • the second imaging method since a plurality of band lights of different wavelength bands are sequentially irradiated, the frame rate is lower than that of the first imaging method, but reflected light of extremely close wavelength bands which can not be captured simultaneously. Can take pictures.
  • Beta-carotene is effective in detecting fat because it is abundant in fat
  • hemoglobin is effective in detecting blood because it is rich in blood.
  • the blood detection unit is a hemoglobin based on a ratio between an image signal of a green wavelength band and an image signal of a red wavelength band simultaneously acquired by the imaging unit.
  • hemoglobin may be detected based on a ratio of image signals of two wavelength bands of green having difference in absorbance of hemoglobin sequentially acquired by the imaging unit.
  • the light in the green wavelength band and the red wavelength band both have low absorbance to ⁇ -carotene, and the light in the green wavelength band has higher absorbance to hemoglobin than the light in the red wavelength band. Therefore, in the first imaging method, hemoglobin can be detected by taking these ratios. In this case, since light in the red and green wavelength bands is easily separated and photographed, it can be photographed at the same time, and the frame rate can be improved.
  • light of two green wavelength bands having differences in absorbance for hemoglobin used in the second imaging method also detects hemoglobin by taking the ratio because absorbance for ⁇ -carotene is similarly low. be able to.
  • absorbance for ⁇ -carotene is similarly low. be able to.
  • it is difficult to separate and shoot the light in the two green wavelength bands it is necessary to sequentially capture them, and the frame rate is lowered, but the reflected light is scattered and returned at the same depth position. Therefore, hemoglobin can be detected accurately.
  • the green wavelength band in the first imaging system is a wavelength band near 510 nm
  • the red wavelength band is a wavelength band near 610 nm
  • the green in the second imaging system The wavelength band of may be a wavelength band near a wavelength of 510 nm and a wavelength near a wavelength of 540 nm.
  • the absorption characteristics of ⁇ -carotene are low and the absorption characteristics of hemoglobin are relatively high, and the light of wavelength bands around 510 nm and the absorption characteristics of ⁇ -carotene and hemoglobin are both low.
  • Light in a wavelength band near 610 nm can be simultaneously captured to detect the amount of hemoglobin at a high frame rate without being affected by ⁇ -carotene.
  • the frame rate is the first photographing. Hemoglobin can be detected with high accuracy based on the information of the same depth position although it is lower than the method.
  • the blood detection unit detects the spread of blood in the image acquired by the imaging unit, and the control unit determines that the spread of blood detected by the blood detection unit is predetermined.
  • the second imaging method may be switched.
  • the image processing apparatus further includes a motion detection unit that detects an amount of motion of the imaging unit with respect to the living tissue based on the image acquired by the imaging unit, and the control unit detects the movement by the motion detection unit. If the calculated motion amount is smaller than a predetermined threshold, switching to the second imaging method may be performed. In this way, in a state where the imaging unit is moved with respect to the living tissue to move the observation position, movement of the first imaging method with high frame rate can be smooth even if blood spreading is occurring. Image observation, and in the state where the imaging unit is at rest with respect to the living tissue, when blood spreading occurs, fat detection with reduced influence of blood by the second imaging method is performed. Can.
  • the motion detection unit may identify a global motion vector of the entire image and a local motion vector, and detect a motion amount based on the global motion vector. .
  • the amount of movement is as long as there is no global motion vector for the entire image. The observation by the second imaging method can be performed as a small one.
  • mist detection part which detects existence of generation of mist based on the above-mentioned picture, and when the control part detects that mist has disappeared by the mist detection part, You may switch to the said 2nd imaging
  • the mist detection unit detects that mist is generated in the image, the field of view is poor due to the mist and it is difficult to detect with high accuracy, so the first photographing is performed. Switch to the method, and perform observation with a smooth image of movement with a high frame rate.
  • the mist disappears the visual field is improved, and therefore, when the spread of the blood is large, fat can be detected with the influence of the blood suppressed by the second imaging method.
  • another aspect of the present invention is an illumination step of irradiating illumination light to a living tissue, an imaging step of capturing reflected light of the illumination light emitted by the illumination step in the living tissue, and acquiring an image;
  • the fat is detected in the image obtained in the imaging step, the fat detecting step for detecting fat in the image, the blood detecting step for detecting blood in the image obtained in the imaging step, and the fat in the image obtained by the fat detecting step
  • a simultaneous imaging method for simultaneously imaging a plurality of band lights having different wavelength bands and a plane sequential imaging sequentially It is a living body observation method including the control step which changes with the photography method of a formula.
  • the present invention it is possible to accurately detect a blood vessel present in a living tissue and to selectively detect a blood vessel having a predetermined thickness.
  • FIG. 8 It is a figure which shows the flowchart explaining the biological body observation method by the biological body observation apparatus of FIG. It is a whole block diagram which shows the modification of the biological body observation apparatus of FIG. It is a front view which shows the filter turret with which the biological body observation apparatus of FIG. 8 is equipped. It is a block diagram showing the image processing device with which the living body observation device concerning a 2nd embodiment of the present invention is equipped. It is a block diagram which shows the movement amount detection part with which the biological body observation apparatus of FIG. 10 is equipped. It is a figure which shows an example of the motion vector calculated by the motion amount detection part of FIG. It is a figure which shows the flowchart explaining the biological body observation method by the biological body observation apparatus of FIG.
  • FIG. 1 It is a block diagram which shows the image processing apparatus with which the biological body observation apparatus which concerns on the 3rd Embodiment of this invention is equipped. It is a figure which shows the flowchart explaining the biological body observation method by the biological body observation apparatus of FIG. It is a figure which shows the time change of the evaluation value of average brightness and brightness
  • the living body observation apparatus 1 is an endoscope apparatus, and as shown in FIG. 1, an insertion unit 2 inserted into a living body, a light source unit 3 connected to the insertion unit 2, and A main unit 5 including a signal processing unit 4 and an image display unit 6 displaying an image generated by the signal processing unit 4 are provided.
  • the insertion unit 2 includes an illumination optical system 7 for irradiating the light input from the light source unit 3 toward the subject, and a photographing optical system 8 for photographing reflected light from the subject.
  • the illumination optical system 7 is disposed over the entire length of the insertion portion 2, and the light guide cable 9a for guiding the light incident from the light source portion 3 on the proximal end to the tip 2a and the tip of the insertion portion 2 And a diffusion optical system 9b for emitting light from the front to the front.
  • the photographing optical system 8 includes an objective lens 10 for condensing reflected light of the light irradiated by the illumination optical system 7 in the biological tissue, and an imaging element (imaging unit) 11 for photographing the light condensed by the objective lens 10. Is equipped.
  • the imaging device 11 is a color CCD provided with a filter that transmits blue, green, and red light to each pixel.
  • the light source unit 3 includes a plurality of light emitting diodes (LEDs) L1, L2, L3, L4 for emitting light of different wavelength bands, a mirror 12 and a dichroic mirror 13, and light from the respective light emitting diodes L1, L2, L3, L4 To be incident on the incident end of the light guide cable 9a.
  • LEDs light emitting diodes
  • B wavelength blue wavelength band near 480 nm
  • G1 wavelength green wavelength band near 510 nm
  • G2 wavelength near 540 nm
  • R wavelength the wavelength band of 610 nm
  • ⁇ -carotene contained in fat has an absorption characteristic that is high at the B wavelength and low absorbance at the G1 wavelength, the G2 wavelength, and the R wavelength.
  • hemoglobin which is a component in blood, has a low absorption characteristic at the R wavelength and a higher absorption characteristic than the R wavelength at the G1 wavelength and the G2 wavelength.
  • Hemoglobin has a higher absorption characteristic at the G2 wavelength than at the G1 wavelength.
  • the signal processing unit 4 includes a memory 14 for storing an image signal acquired by the imaging device 11, an image processing unit 15 for performing predetermined image processing on the image signal stored in the memory 14, light emitting diodes L1 and L2, and A control unit 16 is provided to control the light emission timing of L 3 and L 4 and the imaging timing synchronization by the imaging device 11 and the write and read timing of the memory 14.
  • the control unit 16 can switch between two imaging methods.
  • the light emitting diodes L1, L2, and L4 in the light source unit 3 are controlled to synchronize with the period T required for imaging of the imaging element 11, and the B and G wavelengths And R wavelength light is emitted. At this time, the light emitting diode L3 does not emit light, and light of G2 wavelength is not emitted.
  • the first imaging method from the light source unit 3, light of B wavelength having high absorbance of ⁇ -carotene, light of G wavelength having low absorbance of ⁇ -carotene and high absorbance of hemoglobin, ⁇ -carotene and hemoglobin Light of R wavelength with low absorbance is emitted.
  • the light of three wavelengths emitted from the light source unit 3 is irradiated to the living tissue via the light guide cable 9 a and the diffusion optical system 9 b in the insertion unit 2, and the reflected light of the light in the living tissue is the imaging optical system 8.
  • the light is collected by the objective lens 10 of the image pickup device 11 and simultaneously photographed by the image pickup device 11.
  • An image acquired by imaging in one period T is written to the memory 14 each time, read out at the next imaging timing, and sent to the image processing unit 15 in the subsequent stage. For example, after an image acquired by the imaging device 11 is written to the memory 14, it is read at timing when the imaging device 11 acquires the next image. Details of image processing by the image processing unit 15 will be described later.
  • the light emitting diodes L1, L2, L3, and L4 in the light source unit 3 are controlled to synchronize with the first period Ta required for imaging of the imaging device 11B.
  • the light of the wavelength, the G1 wavelength and the R wavelength is emitted, and the emission of the light of the B wavelength, the G2 wavelength and the R wavelength is alternately repeated in synchronization with the next second period Tb.
  • the light source unit 3 emits light of B wavelength having high absorbance of ⁇ -carotene during the first period Ta and light of G wavelength having low absorbance of ⁇ -carotene and high absorbance of hemoglobin. , And light of R wavelength with low absorbance of both ⁇ -carotene and hemoglobin. Also, from the light source unit 3, light of B wavelength having high absorbance of ⁇ -carotene, light of G wavelength having low absorbance of ⁇ -carotene and high absorbance of hemoglobin, and light absorbance of ⁇ -carotene and hemoglobin during the second period Tb Both low R wavelength light is emitted.
  • the light of three wavelengths emitted from the light source unit 3 in the first period Ta and the second period Tb is applied to the living tissue through the light guide cable 9a and the diffusion optical system 9b in the insertion portion 2, Reflected light of light in the living tissue is collected by the objective lens 10 of the photographing optical system 8 and is alternately photographed by the imaging element 11.
  • the image acquired by the imaging in the first period Ta is written to the memory 14 and read out during the next second period Tb and the period (Ta + Tb) until the imaging end of the next first period Ta, and the subsequent stage Is sent to the image processing unit 15 of FIG.
  • the reading is immediately started and is read out in the period (Ta + Tb) until the end of the imaging of the next first period Ta. It is sent to the image processing unit 15 in the latter stage.
  • an image acquired in the first period Ta by the imaging device 11 is written to the memory 14, it is read at timing when the imaging device 11 acquires a next image Tb. Further, the image acquired in the second period Tb by the imaging device 11 is read out at the same timing as the image acquired in the first period Ta immediately after being written in the memory 14 and the image processing unit in the subsequent stage It will be sent to 15.
  • the image processing unit 15 includes a preprocessing unit 17, a ⁇ -carotene detection unit (fat detection unit) 18, a hemoglobin detection unit (blood detection unit) 19, a fat extraction unit 20, and a blood distribution calculation unit 21. , A post-processing unit 22 and a fat emphasizing unit 23.
  • the preprocessing unit 17 is configured to perform OB (optical black) clamp processing, gain correction processing, and WB (white balance) correction processing on the image signal transferred from the memory 14.
  • the pre-processing unit 17 is configured to output the pre-processed image signal to the post-processing unit 22, the ⁇ -carotene detection unit 18, and the hemoglobin detection unit 19.
  • the ⁇ -carotene detection unit 18 detects ⁇ -carotene by calculating the ratio of the signal value of the B wavelength to the signal value of the G1 wavelength in the image signal sent from the pre-processing unit 17, and outputs it as a ⁇ -carotene detection value It is supposed to In the first imaging method, the hemoglobin detection unit 19 detects the hemoglobin by calculating the ratio of the signal value of the G1 wavelength to the signal value of the R wavelength in the image signal sent from the preprocessing unit 17, It is output as a hemoglobin detection value.
  • the hemoglobin detection unit 19 detects hemoglobin by calculating the ratio of the signal value of the G1 wavelength to the signal value of the G2 wavelength in the image signal sent from the preprocessing unit 17 And output as a hemoglobin detection value.
  • the fat extraction unit 20 previously obtains a coefficient K1 represented by the following equation (1) based on the absorption characteristics of hemoglobin in order to perform fat extraction in which the influence of blood is removed.
  • ⁇ ( ⁇ i) is the absorbance of light at the wavelength ⁇ i
  • ⁇ 1 B wavelength
  • ⁇ 2 G1 wavelength
  • ⁇ 4 R wavelength.
  • the fat extraction unit 20 detects the ⁇ -carotene detection value CrValue output from the ⁇ -carotene detection unit 18, the hemoglobin detection value HbValue1 output from the hemoglobin detection unit 19, and the coefficient K1. From this, the fat extraction value BkValue1 is calculated.
  • K1 ( ⁇ ( ⁇ 1) - ⁇ ( ⁇ 2)) / ( ⁇ ( ⁇ 4) - ⁇ ( ⁇ 2)) (1)
  • BkValue1 CrValue / HbValue1 K1 (2)
  • the fat extraction unit 20 previously obtains a coefficient K2 represented by the following equation (3) based on the absorption characteristic of hemoglobin in order to perform fat extraction in which the influence of blood is removed.
  • the fat extraction unit 20 detects the ⁇ -carotene detection value CrValue output from the ⁇ -carotene detection unit 18, the hemoglobin detection value HbValue2 output from the hemoglobin detection unit 19, and the coefficient K2 From this, the fat extraction value BkValue2 is calculated.
  • the post-processing unit 22 is configured to perform tone conversion processing, color processing, and edge enhancement processing on the image signal sent from the pre-processing unit 17.
  • the post-processing unit 22 is configured to output the post-processed image signal to the fat emphasizing unit 23.
  • the fat emphasizing unit 23 performs color emphasis on the image signal input from the post-processing unit 22 based on the fat extraction value extracted by the fat extracting unit 20, and outputs the image signal to the image display unit 6. .
  • the blood distribution calculation unit 21 will be described.
  • the operation of the blood distribution calculation unit 21 is common to the first imaging method and the second imaging method.
  • the blood distribution calculating unit 21 sets a target region for calculating the blood distribution at the center of the image at which the operator gazes, in order to calculate the blood distribution on the image.
  • the area is divided into a plurality of blocks.
  • the target area is divided into 24 blocks. Then, the average value of the detected hemoglobin values in each block is calculated, and it is determined that the block whose average value is larger than a predetermined threshold is that the blood is spread. When the number of blocks determined to have blood spread exceeds a predetermined number, it is determined that the blood spread on the image is large, and the control unit 16 is notified of this.
  • a living body observation method using the living body observation device 1 according to the present embodiment configured as described above will be described below.
  • an illumination step S2 for irradiating illumination light to a living tissue
  • an imaging step S3 for capturing an image by capturing reflected light reflected on the living tissue.
  • the fat detection step S4 for detecting fat in the image
  • the blood detection step S5 for detecting blood in the image
  • the fat detection step at the fat detection step S4 A state is detected (step S6)
  • control steps S7, S8, and S9 for switching between the first imaging method and the second imaging method according to the detected blood state are included.
  • the control unit 16 first controls the light source unit 3, the imaging device 11, the memory 14, and the image processing unit 15 according to the first imaging method (step S1).
  • control unit 16 controls the light emitting diodes L1, L2, and L4 in the light source unit 3 to emit light of the B wavelength, the G1 wavelength, and the R wavelength in synchronization with the period required for imaging of the imaging device 11. . At this time, light of the G2 wavelength is not emitted.
  • light of B wavelength having high absorption characteristics of ⁇ -carotene, absorption light of G-wavelength having low absorption characteristics of ⁇ -carotene and high absorption characteristics of hemoglobin, as well as absorption characteristics of ⁇ -carotene and hemoglobin Light with a low R wavelength is emitted.
  • the light of three wavelengths emitted from the light source unit 3 is irradiated to the living tissue via the light guide cable 9a and the diffusion optical system 9b in the insertion unit 2 (illumination step S2), and the reflected light of the light in the living tissue is The light is collected by the objective lens 10 of the photographing optical system 8.
  • the control unit 16 controls the imaging timing of the imaging element 11 to simultaneously capture these reflected lights (imaging step S3).
  • the control unit 16 writes the image acquired by photographing in one period into the memory 14 each time, reads it at the next photographing timing, and causes the image processing unit 15 to output it.
  • the preprocessing unit 17 subjects the image signal transferred from the memory 14 to preprocessing such as OB clamp processing, gain correction processing, WB correction processing, etc.
  • the image signal is output to the post-processing unit 22, the ⁇ -carotene detection unit 18 and the hemoglobin detection unit 19.
  • tone conversion processing, color processing and edge enhancement processing are performed on the image signal sent from the pre-processing unit 17.
  • the ⁇ -carotene detection unit 18 detects ⁇ -carotene by calculating the ratio of the signal value of the B wavelength of the image signal sent from the pre-processing unit 17 to the signal value of the G1 wavelength (fat detection step) S4).
  • the hemoglobin detection unit 19 the hemoglobin is detected by calculating the ratio between the signal value of the G1 wavelength and the signal value of the R wavelength in the image signal sent from the pre-processing unit 17 (blood detection step S5) .
  • the ⁇ -carotene detection value detected by the ⁇ -carotene detection unit 18 and the hemoglobin detection value detected by the hemoglobin detection unit 19 are sent to the fat extraction unit 20 and are based on the absorption characteristics of hemoglobin at B, G1 and R wavelengths.
  • the fat extraction value is calculated using a coefficient K1 which has been obtained in advance.
  • the fat emphasizing unit 23 performs color emphasis on the image signal input from the post-processing unit 22 based on the fat extraction value extracted by the fat extracting unit 20, and the image in which fat is emphasized is an image display unit Displayed on 6.
  • the operator can easily identify the region where fat is present by confirming the image displayed on the image display unit 6, and surgery is performed so as not to damage the nerve distributed in the fat layer. It can be performed.
  • the display frame rate of the image in the first imaging method is 1 / T.
  • the hemoglobin detection value detected by the hemoglobin detection unit 19 is sent to the blood distribution calculation unit 21, and the spread of blood in the central region of the image is calculated (step S6). If it is determined that the spread of the upper blood is large, the control unit 16 is notified (step S7). When the notification that the spread of the blood calculated by the blood distribution calculation unit 21 is large is sent to the control unit 16, the control unit 16 switches from the first imaging method to the second imaging method (step S9). .
  • step S10 it is determined whether the imaging can be continued (step S10), and when the imaging is continued, the control unit 16 controls the light emitting diodes L1, L2, L3, and L4 in the light source unit 3.
  • the light of the B wavelength, the G1 wavelength and the R wavelength is emitted in synchronization with the first period required for photographing of the imaging device 11 by control, and the B wavelength, the G2 wavelength and R are synchronized with the next second period.
  • the light emission of the wavelength is alternately repeated.
  • light of B wavelength having high absorption characteristics of ⁇ -carotene during the first period light of G1 wavelength having low absorption characteristics of ⁇ -carotene and high absorption characteristics of hemoglobin, ⁇ -carotene and hemoglobin And R light having low absorption characteristics are emitted.
  • light of wavelength B having high absorption characteristics of ⁇ -carotene in the second period light of wavelength G2 having low absorption characteristics of ⁇ -carotene and high absorption characteristics of hemoglobin, ⁇ -carotene and hemoglobin
  • Light of R wavelength with low absorption characteristics is emitted.
  • An image acquired by shooting in the first period is written to the memory 14 and read out and sent to the image processing unit 15 in the next second period and the period until the end of shooting in the next first period. .
  • the reading is immediately started, and is read out in the period until the end of the imaging in the next first period, and the image processing unit 15 Sent.
  • the display frame rate of the image in the second imaging method is 1 / 2T.
  • the image processing unit 15 performs pre-processing, post-processing and ⁇ -carotene detection processing on the image signal read from the memory 14 in the same manner as the first imaging method (fat detection step S4).
  • the hemoglobin detection unit 19 detects the hemoglobin by calculating the ratio between the signal value of the G1 wavelength and the signal value of the G2 wavelength in the image signal sent from the preprocessing unit 17 (blood detection step S5 ), Is output as a hemoglobin detection value.
  • fat extraction unit 20 in order to perform fat extraction in which the influence of blood is removed, fat extraction is performed using a coefficient K2 obtained in advance based on the absorption characteristics of hemoglobin at the B wavelength, G1 wavelength, and G2 wavelength. The value is calculated. Then, in the fat emphasizing unit 23, color emphasis of the image signal input from the post-processing unit 22 is performed based on the fat extraction value extracted by the fat extracting unit 20, and output to the image display unit 6.
  • step S6 when the transmission of the notification is stopped from the state where the notification that the blood spread (step S6) calculated by the blood distribution calculation unit 21 is large is sent (step S7), the control unit 16 performs the second imaging.
  • the mode is switched to the first imaging mode (step S8).
  • the hemoglobin detection unit 19 detects hemoglobin based on the ratio of the signal value of the G1 wavelength to the signal value of the R wavelength.
  • the transition from the first imaging method to the second imaging method is made.
  • detection of hemoglobin is performed by the ratio of the signal value of the G1 wavelength to the signal value of the G2 wavelength.
  • the difference in absorption of hemoglobin is remarkable between the light of the G1 wavelength and the light of the G2 wavelength, and since the light of the wavelength which is very close, information from approximately the same position in the depth direction of the living tissue is It contains.
  • the detection accuracy of blood detected by hemoglobin detected using reflected light of these wavelengths can be improved, and there is an advantage that fat detection with less influence of blood can be performed.
  • the ratio of the signal value of the G1 wavelength to the signal value of the R wavelength is obtained by transitioning from the second imaging method to the first imaging method.
  • the display frame rate is improved from 1 ⁇ 2T to 1 / T instead of the detection of hemoglobin.
  • the light of the G1 wavelength and the light of the R wavelength have a remarkable difference in absorption of hemoglobin, but when compared with the relationship between the G1 wavelength and the G2 wavelength, the wavelengths are distant, so the depth direction of the living tissue Contains information from different locations.
  • the detection accuracy of blood by hemoglobin detected using the reflected light of these wavelengths is lower than in the case of the second imaging method, but the frame rate is improved instead and the movement is smooth. There is an advantage that an easy-to-see image can be displayed.
  • the blood distribution calculation unit 21 calculates the blood distribution in the target area at the center of the image that the operator is considered to be gazing at, but instead, it is possible to use fat other than the center of the image.
  • An area having a high extraction value may be detected, and the area may be set as a target area. Also, an arbitrary area may be set as the target area by the operator.
  • the blood distribution calculation unit 21 stores the average value of the detected hemoglobin values in a storage unit (not shown) for each imaging frame, and calculates the time change of the average value to detect the presence or absence of hemorrhage, and bleeding is present.
  • the spread of blood may be determined from the number of blocks. By doing this, even in the case where a thick blood vessel is present in the target region for which the blood distribution is to be calculated, it is possible to detect the spread of hemorrhage in distinction from the thick blood vessel.
  • the light source unit 3 configured to emit light of different wavelength bands is configured by the plurality of light emitting diodes L1, L2, L3, and L4.
  • a light source unit 27 having a xenon lamp 24 for generating light, a filter turret 25 for rotating a plurality of narrow band filters F1, F2 and F3, and a linear movement mechanism 26 for moving the filter turret 25 in a radial direction You may
  • the filter turret 25 includes a narrow band filter F1 disposed radially inward and narrow band filters F2 and F3 disposed radially outward.
  • the narrow band filters F1 and F2 transmit the B wavelength, the G1 wavelength, and the R wavelength
  • the filter F3 transmits the B wavelength, the G2 wavelength, and the R wavelength.
  • a narrow band-pass filter F1 is disposed on the optical axis from the xenon lamp 24 to the light guide cable 9a, and the filter turret 25 is rotated to perform the illumination of the first imaging method, and the narrow band-pass filter F2 on the optical axis , F3 and rotating the filter turret 25, illumination of the second imaging method can be performed.
  • the narrow band light is generated in the light source unit 3 and the reflected light in the living body tissue is photographed as it is, but instead, the living body tissue is irradiated with wide band light such as white light.
  • a filter that selectively transmits narrow band light may be disposed upstream of the imaging element 11 of the imaging optical system 8.
  • a filter using the above-described filter turret 25 or a wavelength tunable filter such as an etalon may be employed.
  • a motion amount detection unit (motion detection unit) 29 that calculates the motion amount of an image based on the image signal after the image processing unit 30 is processed. And the control unit 16 switches to the second imaging method when the spread of the blood is large and the movement amount of the image detected by the movement amount detection unit 29 is smaller than a predetermined threshold. This is different from the living body observation device 1 according to the first embodiment.
  • the motion amount detection unit 29 is sent from the pre-processing unit 17 and a memory 31 that delays the image signal of G wavelength sent from the pre-processing unit 17 by one frame.
  • a motion vector calculation unit 32 that calculates a motion vector from the G wavelength image signal and the G wavelength image signal stored in the memory 31 that has been stored in the memory 31, and intersects the optical axis based on the calculated motion vector
  • a motion amount calculation unit 33 for calculating the motion amount in the direction to be moved.
  • the motion vector can be calculated by a known block matching method or gradient method.
  • motion vectors are calculated for a plurality of points set at equal intervals on the image, as shown in FIG.
  • the motion amount calculator 33 is configured to calculate the motion amount MV by the following equation (5) based on the motion vector calculated by the motion vector calculator 32.
  • M is the total number of motion vectors
  • vi is a motion vector.
  • the global motion of the entire image can be calculated as the motion amount of the image by calculating the motion amount by averaging all the motion vectors (step S11).
  • step S12 when it is determined by the blood distribution calculation unit 21 that the spread of the blood is large, the first imaging method can be maintained, and a decrease in the display frame rate can be prevented (step S12).
  • the blood distribution calculation unit 21 when it is determined by the blood distribution calculation unit 21 that the spread of the blood is large and the amount of movement of the image is small, that is, when the photographing optical system 8 of the tip 2a of the insertion unit 2 is stationary. Can be switched to the second imaging method, and observation can be performed with priority given to fat extraction less affected by blood (step S12).
  • the image signal of G wavelength is used to detect the amount of movement of the image, but the amount of movement may be calculated using a luminance signal calculated from the image signal of RGB.
  • motion vectors are calculated at a plurality of points arranged at equal intervals, motion vectors of all pixels on an image may be calculated.
  • the motion amount of the image when calculating the motion vector of each position on the image, the presence or absence of a correlation with the motion vector located around the image is determined.
  • the motion amount of the image may be calculated only from the motion vector determined to be. In this case, the motion amount can be calculated using the following equation (6).
  • ci 0 indicates no correlation with peripheral motion vectors
  • the amount of motion of the image is zero, and the motion vector is processed as a zero vector.
  • the motion vector may be, for example, a disturbance due to a forceps operation or the like during the procedure, as well as the movement of a focused portion on a living tissue.
  • the motion vector due to the disturbance is not correlated with the surrounding motion vector.
  • the motion amount of the image can be calculated with high accuracy by excluding the motion vector due to the disturbance based on the correlation with the peripheral motion vector.
  • the correlation with the peripheral motion vector may be, for example, correlation if the magnitude of the difference between the vectors is less than a predetermined threshold, and no correlation if the magnitude is greater than the threshold.
  • the living body observation apparatus 1 includes a mist detection unit 35 that detects the generation of mist based on the image signal after the image processing unit 34, and the control unit 16 When the spread of the blood is large and the mist disappears, switching to the second imaging method is performed. When the mist is detected, the first imaging is performed even when the spread of the blood is large. It differs from the living body observation apparatus 1 according to the first embodiment in that the method is maintained.
  • mist Smoke and water vapor
  • mist detection is performed to switch the imaging method.
  • the mist detection unit 35 determines the average luminance YAve (n), the average saturation SAve (n), and the average D range (dynamic range) DAve (dynamic range) of the central region of the image based on the image signal preprocessed in the preprocessing unit 17.
  • n is calculated and stored in a storage unit (not shown).
  • n indicates the timing at which the image was acquired.
  • the mist detection unit 35 calculates the mist detection evaluation values Vy (n), Vs (n), and Vd (n) based on Expressions (7), (8), and (9).
  • Vy (n) YAve (n) -YAve (nx) (7)
  • Vs (n) SAve (n) -SAve (n-x) (8)
  • Vd (n) DAve (n)-DAve (n-x) (9)
  • YAve (n-x) is the average luminance calculated from an image acquired x frames before the current image
  • SAve (n-x) is acquired x frames before the current image
  • DAve (n ⁇ x) is the average saturation calculated from the image
  • the average D range calculated from the image acquired x frames before the current image An arbitrary number can be set as x.
  • Vy (n) is calculated from the average luminance calculated from the image signal at the current time n and the image signal acquired in the past by x Difference with the average brightness.
  • Vs (n) is the difference between the average saturation calculated from the image signal at the current time n and the average saturation calculated from the image signal acquired in the past by x.
  • Vd (n) is the difference between the average D-range calculated from the image signal at the current time n and the average D-range calculated from the image signal acquired in the past by x.
  • FIG. 16 shows the time change of the average luminance value YAve (n), the average saturation SAve (n) and the average D range DAve (n) of the image when the amount of mist changes.
  • FIG. 18 shows the time change of the average luminance value YAve (n), the average saturation SAve (n) and the average D range DAve (n) of the image when the amount of mist changes.
  • the average luminance value YAve (n) increases as mist is generated and fills the body, and the average saturation SAve (n) and the average D range DAve (n) ) Decreases. Then, as the generation of mist stops and disappears, the average luminance value YAve (n) decreases, and the average saturation SAve (n) and the average D range DAve (n) increase. This is because the mist raises the average luminance value YAve (n) to diffusely reflect the illumination and decreases the average saturation SAve (n) and the average D range DAve (n) because the mist is opaque. .
  • FIGS. 16, 17 and 18 shows evaluation values Vy (n) when the average luminance value YAve (n), the average saturation SAve (n) and the average D range DAve (n) change as described above. , Vs (n), Vd (n) over time. Since these evaluation values are difference values, the characteristics are obtained by differentiating the characteristics of the average luminance value YAve (n), the average saturation SAve (n), and the average D range DAve (n) in the upper row, respectively.
  • the evaluation value Vy (n) of luminance has an upward convex characteristic
  • the evaluation value Vs (n) of saturation and the evaluation value Vd (n) of D range have a downward convex characteristic.
  • the luminance evaluation value Vy (n) has a downward convex characteristic
  • the saturation evaluation value Vs (n) and the D range evaluation value Vd (n) have an upward convex characteristic.
  • the mist detection unit 35 determines the presence or absence of the generation of the mist in the following manner with respect to such changes in the evaluation values Vy (n), Vs (n), Vd (n). It is supposed to be. That is, as shown in FIG. 15, the mist detection unit 35 evaluates the luminance value Vy (n) above a predetermined threshold and evaluates the saturation evaluation value Vs (n) and the D range evaluation value Vd ( It is determined that mist has occurred at the time when n) falls below a predetermined threshold (step S13).
  • the mist detection unit 35 the time when the evaluation value Vy (n) of the luminance value becomes a local minimum smaller than the first threshold, and the evaluation value of the saturation and the evaluation value of the D range each have the first threshold. Detect the time when the maximum value is larger. Then, after these times, the mist detection unit 35 indicates that the evaluation value of the luminance value exceeds the second threshold, and the evaluation value of the saturation and the evaluation value of the D range each fall below the second predetermined threshold. At time n, it is determined that the mist has disappeared (step S14).
  • the control unit 16 performs the first operation even when the spread of the blood is large.
  • the display frame rate can be prevented from being lowered, and the easiness of observation can be improved.
  • the mode is switched to the second imaging method, so fat extraction with little influence of blood is prioritized to detect fat accurately. be able to.
  • Reference Signs List 1 living body observation apparatus 3, 27 light source unit 11 imaging device (imaging unit) 16 control unit 18 ⁇ -carotene detection unit (fat detection unit) 19 Hemoglobin detection unit (blood detection unit) 29 Motion amount detector (Motion detector) 35 mist detection unit S2 illumination step S3 imaging step S4 fat detection step S5 blood detection step S7, S8, S9 control step

Abstract

Le but de la présente invention est de détecter de manière stable la matière grasse tout en maintenant la facilité d'observation dans le cas où la quantité de sang placé sur la matière grasse est faible et tout en améliorant la précision de la détection de sang quand le sang est placé sur la matière grasse. L'invention concerne un dispositif d'observation d'un corps vivant (1) équipé d'une section de source de lumière (3) pour irradier un tissu biologique avec une lumière d'éclairage, une section d'imagerie (11) pour imager la lumière réfléchie dans le tissu biologique pour acquérir une image, une section de détection de matière grasse pour détecter la matière grasse dans l'image acquise, une section de détection du sang pour détecter du sang dans l'image, et une section de contrôle (16) pour contrôler la section de source de lumière (3) et/ou la section d'imagerie (11) sur la base des résultats de détection obtenus par la section de détection de matière grasse et la section de détection du sang, où la section de contrôle (16) rend possible la commutation entre un premier mode d'imagerie de type simultané dans lequel de multiples faisceaux lumineux ayant des bandes de longueur d'onde différentes l'une de l'autre sont imagés simultanément et un second mode d'imagerie de trame de type séquentiel dans lequel les faisceaux lumineux sont imagés de manière séquentielle, en fonction de l'état du sang détecté dans l'image par la section de détection de sang quand la matière grasse est détectée dans l'image par la section de détection de matière grasse.
PCT/JP2015/058477 2015-03-20 2015-03-20 Dispositif d'observation de corps vivant et procédé d'observation de corps vivant WO2016151675A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2015/058477 WO2016151675A1 (fr) 2015-03-20 2015-03-20 Dispositif d'observation de corps vivant et procédé d'observation de corps vivant

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2015/058477 WO2016151675A1 (fr) 2015-03-20 2015-03-20 Dispositif d'observation de corps vivant et procédé d'observation de corps vivant

Publications (1)

Publication Number Publication Date
WO2016151675A1 true WO2016151675A1 (fr) 2016-09-29

Family

ID=56977036

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/058477 WO2016151675A1 (fr) 2015-03-20 2015-03-20 Dispositif d'observation de corps vivant et procédé d'observation de corps vivant

Country Status (1)

Country Link
WO (1) WO2016151675A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018235179A1 (fr) * 2017-06-21 2018-12-27 オリンパス株式会社 Dispositif de traitement d'image, dispositif d'endoscope, procédé de fonctionnement du dispositif de traitement d'image, et programme de traitement d'image
WO2018235178A1 (fr) * 2017-06-21 2018-12-27 オリンパス株式会社 Dispositif de traitement d'image, dispositif d'endoscope, procédé de fonctionnement d'un dispositif de traitement d'image et programme de traitement d'image
CN110826486A (zh) * 2019-11-05 2020-02-21 拉卡拉支付股份有限公司 人脸识别辅助检测方法及装置

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006239206A (ja) * 2005-03-04 2006-09-14 Fujinon Corp 内視鏡装置
WO2013115323A1 (fr) * 2012-01-31 2013-08-08 オリンパス株式会社 Dispositif d'observation biologique

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006239206A (ja) * 2005-03-04 2006-09-14 Fujinon Corp 内視鏡装置
WO2013115323A1 (fr) * 2012-01-31 2013-08-08 オリンパス株式会社 Dispositif d'observation biologique

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018235179A1 (fr) * 2017-06-21 2018-12-27 オリンパス株式会社 Dispositif de traitement d'image, dispositif d'endoscope, procédé de fonctionnement du dispositif de traitement d'image, et programme de traitement d'image
WO2018235178A1 (fr) * 2017-06-21 2018-12-27 オリンパス株式会社 Dispositif de traitement d'image, dispositif d'endoscope, procédé de fonctionnement d'un dispositif de traitement d'image et programme de traitement d'image
CN110769738A (zh) * 2017-06-21 2020-02-07 奥林巴斯株式会社 图像处理装置、内窥镜装置、图像处理装置的工作方法及图像处理程序
CN110769738B (zh) * 2017-06-21 2022-03-08 奥林巴斯株式会社 图像处理装置、内窥镜装置、图像处理装置的工作方法及计算机可读存储介质
CN110826486A (zh) * 2019-11-05 2020-02-21 拉卡拉支付股份有限公司 人脸识别辅助检测方法及装置

Similar Documents

Publication Publication Date Title
JP5395725B2 (ja) 電子内視鏡システム
JP5452300B2 (ja) 電子内視鏡システム、電子内視鏡用のプロセッサ装置、電子内視鏡システムの作動方法、病理観察装置および病理顕微鏡装置
WO2017057574A1 (fr) Appareil de traitement d'image, système d'endoscope, et procédé de traitement d'image
JP4566754B2 (ja) 画像処理装置
JP6336949B2 (ja) 画像処理装置及び画像処理方法、並びに内視鏡システム
WO2013005533A1 (fr) Système d'endoscope, processeur de système d'endoscope et procédé d'affichage d'image
JP6581984B2 (ja) 内視鏡システム
JP5808031B2 (ja) 内視鏡システム
US20180033142A1 (en) Image-processing apparatus, biological observation apparatus, and image-processing method
JP6522539B2 (ja) 内視鏡システム及びその作動方法
US20150257635A1 (en) Observation apparatus
JP6454359B2 (ja) 画像処理装置、画像処理装置の作動方法、画像処理装置の作動プログラムおよび内視鏡装置
JP6188992B1 (ja) 画像解析装置、画像解析システム、画像解析装置の作動方法
US10856805B2 (en) Image processing device, living-body observation device, and image processing method
US20180000334A1 (en) Biological observation apparatus
JPWO2018211885A1 (ja) 画像取得システム、制御装置及び画像取得方法
JP2012010733A (ja) 電子内視鏡システム、電子内視鏡用のプロセッサ装置、画像検索システム、及び検索方法
JP7374280B2 (ja) 内視鏡装置、内視鏡プロセッサ、及び内視鏡装置の作動方法
WO2016151675A1 (fr) Dispositif d'observation de corps vivant et procédé d'observation de corps vivant
JP6203088B2 (ja) 生体観察システム
WO2016121811A1 (fr) Dispositif de traitement d'image, procédé de traitement d'image, et système d'endoscope
JP2010119742A (ja) 内視鏡装置およびその制御方法
JP7163386B2 (ja) 内視鏡装置、内視鏡装置の作動方法及び内視鏡装置の作動プログラム
JP5844447B2 (ja) 電子内視鏡システム、電子内視鏡用のプロセッサ装置、及び電子内視鏡システムの作動方法
JP2021108793A (ja) 医療画像生成装置、医療画像生成方法および医療画像生成プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15886232

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15886232

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP