JP6556076B2 - Endoscopic image signal processing apparatus and method, and program - Google Patents

Description

  The present invention relates to an endoscope image signal processing apparatus, method, and program for quantifying color information of an endoscope image by numerical values.

  In the medical field, diagnosis using an endoscope system including a light source device, an endoscope, and a processor device has been widely performed. In particular, by improving the performance of a color endoscope system, diagnosing a medical condition such as a digestive mucous membrane by observing the color of a captured endoscopic image.

  For example, when the gastric mucosa is infected with Helicobacter pylori, which is considered to be the cause of gastric cancer, it is known that a red inflammation portion appears in a patchy manner on the gastric mucosa. Therefore, the presence or absence of H. pylori infection is confirmed by observing the color of such an inflamed part using an endoscopic image.

  Here, for example, an endoscopic image obtained by imaging the mucous membrane of the stomach contains many red parts, and the color change at the boundary between the normal mucosal tissue and the lesioned part is continuous. It may be difficult to distinguish a color difference from a different mucosal tissue. Further, since the evaluation of the color difference is subjective, there is a problem that the evaluation varies depending on the experience of the observer, and it is difficult to make an objective diagnosis.

  Therefore, various methods for calculating objective evaluation values and the like based on the endoscopic image and providing the evaluation values to the observer have been proposed.

  For example, in Patent Document 1, the hue value and the saturation value of each pixel constituting the endoscopic image are calculated, and the severity of the lesion is calculated based on the hue value and the saturation value to observe the observer. Proposed methods are proposed.

  Patent Document 2 proposes a method of calculating IHb (Index of Hemoglobin) as a numerical value that objectively represents a difference in color tone of an endoscopic image and providing it to an observer.

  Patent Document 3 proposes a method of calculating a feature amount based on a color signal of an endoscopic image and providing the feature amount to an observer.

JP 2014-213094 A JP 2004-188026 A JP 2007-236957 A

  However, for example, when an endoscopic image is generated in an endoscope system including a simultaneous image sensor, demosaic processing is performed on the RAW signal output from the image sensor. When the demosaic process is performed, an interpolation process using RAW signals output from a plurality of elements is performed, so that the color information is different from the color information received by the image sensor. End up. In other words, the color information of the endoscopic image generated using the above-described interpolation process does not accurately represent the color information of the imaging target.

  In Patent Documents 1 to 3, only a method for obtaining numerical information based on an endoscopic image generated using demosaic processing has been proposed.

  In view of the above problems, an object of the present invention is to provide an endoscopic image signal processing apparatus, method, and program capable of acquiring numerical information that more accurately represents color information of an imaging target.

  A first endoscope image signal processing apparatus according to the present invention obtains a RAW signal output from a simultaneous imaging device having a color filter by imaging an imaging target using an endoscope. And a color value information calculation unit that calculates color value information obtained by digitizing the color information of the imaging target using the RAW signal directly.

  In the first endoscopic image signal processing device of the present invention, a demosaic processing unit that performs demosaic processing on a RAW signal to generate an RGB-RAW signal, and a display based on the RGB-RAW signal An endoscopic image generating unit that generates an endoscopic image for use, and the demosaic processing unit, when generating an endoscopic image for display, includes a plurality of simultaneous imaging elements When performing demosaic processing that performs interpolation processing using the RAW signal output from the element and calculating color numerical value information, it is possible to perform demosaic processing that directly uses the RAW signal.

  The first endoscopic image signal processing apparatus of the present invention may further include a color correction processing unit that performs color correction processing on the RGB-RAW signal. The color correction processing unit is for display. Color correction processing can be performed using different parameters when generating an endoscopic image and when calculating color numerical value information.

  In the first endoscopic image signal processing device of the present invention, a demosaic processing unit that generates a RGB-RAW signal by performing demosaic processing on the RAW signal, and imaging based on the RGB-RAW signal. An image numerical information calculation unit that calculates image numerical information obtained by digitizing image information other than the target color information, and the demosaic processing unit includes a simultaneous image sensor when calculating the image numerical information. When performing demosaic processing that performs interpolation processing using RAW signals output from a plurality of constituent elements and calculating color numerical value information, it is possible to perform demosaic processing that directly uses RAW signals.

  The first endoscopic image signal processing apparatus of the present invention may further include a color correction processing unit that performs color correction processing on the RGB-RAW signal. The color correction processing unit includes image numerical information. The color correction process can be performed using different parameters for calculating the color numerical value information and the color numerical value information.

  In the first endoscopic image signal processing device of the present invention, the image numerical information calculation unit can calculate at least one of sharpness information and noise information as image numerical information.

  In the first endoscopic image signal processing device of the present invention, the first demosaicing process is performed to perform the interpolation process using the RAW signals output from the plurality of elements constituting the simultaneous imaging element. A demosaic processing unit that generates an RGB-RAW signal and performs a demosaic process using the RAW signal directly to generate a second RGB-RAW signal, and an internal display unit based on the first RGB-RAW signal An endoscopic image generation unit that generates an endoscopic image, a display control unit that displays an endoscopic image for display on the display unit, and an interest that specifies a region of interest on the endoscopic image displayed on the display unit A color numerical value information calculating unit that calculates color numerical value information using a RAW signal or a second RGB-RAW signal within the region of interest specified on the endoscopic image. Can do.

  In the first endoscopic image signal processing device of the present invention, a color correction processing unit that performs color correction processing on the first RGB-RAW signal and the second RGB-RAW signal in the region of interest. The color correction processing unit can apply color correction processing to the first RGB-RAW signal and the second RGB-RAW signal in the region of interest using different parameters.

  The first endoscopic image signal processing apparatus of the present invention may further include a storage unit that stores the demosaic-processed RAW signal and the demosaic-processed RAW signal.

  Further, the first endoscopic image signal processing device of the present invention may include a shading correction unit that performs shading correction on the RAW signal.

  In the first endoscopic image signal processing device of the present invention, the color numerical value information calculation unit can calculate at least one of hue and saturation of the imaging target as color numerical information.

  In the first endoscopic image signal processing apparatus of the present invention, a simultaneous image pickup device including an RGB color filter can be used.

  The second endoscopic image signal processing device of the present invention acquires a RAW signal output from a simultaneous imaging device having a color filter by imaging an imaging target using an endoscope. And a color value information calculation unit for calculating at least one of hue and saturation of an imaging target as color value information by directly using the RAW signal, and generating an RGB-RAW signal by performing demosaic processing on the RAW signal When the demosaic processing unit generates an endoscopic image for display, the demosaic processing unit performs an interpolation process using RAW signals output from a plurality of elements constituting the simultaneous imaging device. When performing demosaic processing and calculating color numerical information, the demosaic processing using the RAW signal directly is performed, and the color numerical information calculation unit uses the demosaic directly using the RAW signal. It calculates color numerical information using the RGB-RAW signal after sense.

  The third endoscopic image signal processing device of the present invention obtains a RAW signal output from a simultaneous imaging device having a color filter by imaging an imaging target using an endoscope. A color numerical value information calculation unit that calculates at least one of hue and saturation of the imaging target as color numerical value information directly using the RAW signal, and the sharpness of the image of the imaging target based on the RGB-RAW signal An image numerical information calculation unit that calculates at least one of information and noise information as image numerical information, and a demosaic processing unit that performs demosaic processing on the RAW signal to generate an RGB-RAW signal, and a demosaic processing unit However, when calculating numerical image information, a demosaic process that performs interpolation processing using RAW signals output from a plurality of elements constituting the simultaneous imaging element is used. When the color numerical value information is calculated, the demosaic process using the RAW signal directly is performed, and the color numerical information calculation unit uses the RGB-RAW signal after the demosaic process directly using the RAW signal. The information is calculated, and the image numerical information calculation unit calculates the image numerical information using the RGB-RAW signal after the demosaic process for performing the interpolation process.

  A fourth endoscopic image signal processing device according to the present invention is a RAW signal acquisition unit that acquires a RAW signal output from a simultaneous imaging device having a color filter by imaging an imaging target using an endoscope. A color numerical value information calculation unit that calculates at least one of hue and saturation of an imaging target as color numerical value information directly using the RAW signal, and a RAW signal output from a plurality of elements constituting the simultaneous imaging element A demosaic processing unit that generates a first RGB-RAW signal by performing a demosaic process that performs an interpolation process using the, and a demosaic process that directly uses the RAW signal to generate a second RGB-RAW signal; Based on the first RGB-RAW, an endoscope image generation unit that generates an endoscope image for display, a display control unit that displays the endoscope image for display on the display unit, and a display on the display unit The A region-of-interest specifying unit that specifies a region of interest on the endoscopic image, and the color value information calculating unit includes a RAW signal or a second RGB-RAW signal in the region of interest specified on the endoscopic image. Is used to calculate color numerical information.

  According to the operation method of the endoscope image signal processing apparatus of the present invention, the RAW signal output from the simultaneous image pickup device having the color filter is acquired by imaging the imaging target using the endoscope, and the acquisition is performed. By directly using the RAW signal, color numerical value information obtained by digitizing the color information of the imaging target is calculated.

  An endoscope image signal processing program of the present invention is a RAW signal acquisition unit that acquires a RAW signal output from a simultaneous image pickup device having a color filter by imaging a subject to be imaged using a computer. Then, the RAW signal is directly used to function as a color value information calculation unit that calculates color value information obtained by digitizing the color information of the imaging target.

  According to the endoscope image signal processing apparatus, method, and program of the present invention, a RAW signal output from a simultaneous image sensor is acquired, and RAW signals output from a plurality of elements constituting the simultaneous image sensor are used. Without using the interpolation processing, the RAW signal output from each element is directly used to calculate the color value information obtained by digitizing the color information of the imaging target. Therefore, it is possible to eliminate color mixing due to the above-described interpolation processing, and it is possible to acquire color numerical information that more accurately represents color information of an imaging target.

The figure which shows schematic structure of the endoscope system using one Embodiment of the endoscope image signal processing apparatus of this invention. The block diagram which shows the internal structure of the endoscope system of 1st Embodiment. Figure showing the spectrum of white light Diagram showing the spectrum of special light Diagram for explaining demosaic processing The flowchart for demonstrating the effect | action of the endoscope system of 1st Embodiment. The block diagram which shows the internal structure of the endoscope system of 2nd Embodiment. The flowchart for demonstrating the effect | action of the endoscope system of 2nd Embodiment. The block diagram which shows the internal structure of the endoscope system of 3rd Embodiment. The flowchart for demonstrating the effect | action of the endoscope system of 3rd Embodiment. The figure which shows the emission spectrum of purple light V, blue light B, green light G, and red light R The figure for demonstrating the gradation process using the conventional RGB gradation table

  Hereinafter, an endoscope system using a first embodiment of an endoscope image signal processing apparatus and method and a program according to the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram illustrating a schematic configuration of an endoscope system 10 according to the present embodiment.

  The endoscope system 10 according to the present embodiment includes an endoscope 12, a light source device 14, a processor device 16, a monitor 18, and an input device 20. The endoscope 12 is optically connected to the light source device 14 and electrically connected to the processor device 16.

  The endoscope 12 includes an insertion portion 21 to be inserted into a subject, an operation portion 22 provided at a proximal end portion of the insertion portion, a bending portion 23 and a distal end portion 24 provided on the distal end side of the insertion portion 21. Have. The operation section 22 is provided with an angle knob 22a, and the bending section 23 is bent by rotating the angle knob 22a. With this bending operation, the tip 24 is directed in a desired direction.

  Further, the operation unit 22 is provided with a mode switch 22b and a zoom operation unit 22c. The mode switch 22b is used for switching operation between the normal observation mode and the special observation mode. The normal observation mode is a mode in which white light is used for illumination of an imaging target in the subject. The special observation mode is a mode in which special light having a bluish color is used for illumination of the imaging target in the subject, and is a mode in which a change in the color of the mucous membrane due to inflammation or the like and a transparent image of the blood vessel are emphasized. The zoom operation unit 22c is used for a zoom operation for driving a zoom lens 47 (see FIG. 2) in the endoscope 12 to enlarge an imaging target.

  The monitor 18 and the input device 20 are electrically connected to the processor device 16. The monitor 18 displays an endoscopic image captured by the endoscope 12 and color numerical value information described later. The input device 20 accepts input operations such as function settings, and includes a keyboard and a mouse. In addition, you may make it use the monitor 18 and the input device 20 together by using a touch panel.

  FIG. 2 is a block diagram showing an internal configuration of the endoscope system 10 of the present embodiment.

  The light source device 14 includes a blue laser light source 34 that emits blue laser light having a central wavelength of 445 nm, and a blue-violet laser light source 36 that emits blue-violet laser light having a central wavelength of 405 nm. The light sources 34 and 36 are individually controlled by the light source control unit 40, and the light quantity ratio between the emitted light of the blue laser light source 34 and the emitted light of the blue-violet laser light source 36 can be changed.

  The light source controller 40 mainly drives the blue laser light source 34 in the normal observation mode. Note that the blue-violet laser light source 36 may be controlled so that the blue-violet laser light is slightly emitted.

  On the other hand, in the special observation mode, the light source control unit 40 drives both the blue laser light source 34 and the blue-violet laser light source 36, and the light intensity of the blue laser light is higher than the light intensity of the blue-violet laser light. Is also controlled to be larger. Note that the half-value width of the blue laser light or the blue-violet laser light is preferably about ± 2 nm and is preferably blue narrow-band light. Further, as the blue laser light source 34 and the blue-violet laser light source 36, a broad area type InGaN laser diode, InGaAsN laser diode, GaAsN laser diode, or the like can be used. In addition, a light-emitting body such as a light-emitting diode may be used as the light source.

  Laser light emitted from each of the light sources 34 and 36 enters a light guide (LG) 41 via an optical member (not shown) such as a condenser lens. The light guide 41 is accommodated in the universal cord 13 and is optically connected to the endoscope 12.

  The blue laser beam or the blue-violet laser beam is propagated to the distal end portion 24 of the endoscope 12 through the light guide 41. A multimode fiber can be used as the light guide 41.

  The distal end portion 24 of the endoscope 12 has an illumination optical system 24a and an imaging optical system 24b. The illumination optical system 24 a is provided with a phosphor 44 on which blue laser light or blue-violet laser light emitted from the light guide 41 is incident, and an illumination lens 45. The phosphor 44 is excited by being irradiated with blue laser light, and fluorescence is emitted from the phosphor 44. Some of the blue laser light passes through the phosphor 44 as it is. The blue-violet laser light is transmitted without exciting the phosphor 44. The light emitted from the phosphor 44 is irradiated to the imaging target via the illumination lens 45.

  Here, in the normal observation mode, mainly blue laser light is incident on the phosphor 44. Therefore, as shown in FIG. 3, white light WL obtained by combining the blue laser light BL and the fluorescence FL emitted from the phosphor 44 is irradiated to the imaging target. On the other hand, in the special observation mode, both blue-violet laser light and blue laser light are incident on the phosphor 44. Therefore, as shown in FIG. 4, special light SL obtained by combining the blue-violet laser light VL, the blue laser light BL, and the fluorescence FL is irradiated onto the imaging target. In this special observation mode, in addition to blue laser light, blue-violet laser light is included, so the special light is a broadband light that contains a large amount of blue components and has a wavelength range that covers almost the entire visible light range.

The phosphor 44 absorbs a part of the blue laser beam and emits a plurality of types of phosphors that emit green to yellow light (for example, YAG (Yttrium Aluminum Garnet) phosphor or BAM (BaMgAl ₁₀ O ₁₇ )). It is preferable to use a material comprising a phosphor such as If a semiconductor light emitting device is used as an excitation light source for the phosphor 44 as in this embodiment, high intensity white light can be obtained with high luminous efficiency, the intensity of white light can be easily adjusted, and the color of white light can be adjusted. Changes in temperature and chromaticity can be kept small.

  In the present embodiment, the phosphor 44 is provided at the distal end portion 24 of the endoscope 12, but the phosphor 44 may be provided in the light source device 14 instead. In this case, it is preferable to provide a phosphor 44 between the light guide 41 and the blue laser light source 34.

  The imaging optical system 24 b of the endoscope 12 includes an imaging lens 46, a zoom lens 47, and an imaging element 48. Reflected light from the imaging target enters the imaging element 48 via the imaging lens 46 and the zoom lens 47. As a result, a reflected image of the imaging target is formed on the imaging element 48. The zoom lens 47 is moved by operating the zoom operation unit 22c.

  The image sensor 48 is a color image sensor, which captures a reflection image to be imaged and outputs a RAW signal. The image sensor 48 is preferably a CCD (Charge Coupled Device) image sensor, a CMOS (Complementary Metal-Oxide Semiconductor) image sensor, or the like.

  The image sensor 48 of the present embodiment is a simultaneous image sensor in which an RGB color filter is provided on the imaging surface. The R component RAW signal is output from the element provided with the R (red) color filter, the G component RAW signal is output from the element provided with the G (green) color filter, and the color of B (blue) A B-component RAW signal is output from the element provided with the filter. The filter array may be a Bayer array or a honeycomb array.

  Here, the RAW signal referred to in this specification is a signal output from each element of the image sensor 48 and directly representing the color of the color filter provided in each element.

  The image sensor 48 may be an image sensor including C (cyan), M (magenta), Y (yellow), and G (green) CMYG filters on the imaging surface. In the case of an image sensor provided with a CMYG filter, a C component RAW signal is output from an element provided with a C (cyan) color filter, and an M component output from an element provided with an M (magenta) color filter. A RAW signal is output, a Y component RAW signal is output from an element provided with a Y (yellow) color filter, and a G component RAW signal is output from an element provided with a G (green) color filter. .

  The RAW signal output from the image sensor 48 is output to the CDS / AGC circuit 50. The CDS / AGC circuit 50 performs correlated double sampling (CDS) and automatic gain control (AGC) on an image signal that is an analog signal. The RAW signal that has passed through the CDS / AGC circuit 50 is subjected to gamma conversion in the gamma conversion unit 51 and then converted into a digital RAW signal by the A / D conversion unit 52. The A / D converted digital RAW signal is input to the processor unit 16.

  The processor device 16 includes a RAW signal acquisition unit 60, a shading correction unit 61, a demosaic processing unit 62, a color correction processing unit 63, a normal image generation unit 64, a special image generation unit 65, and a color numerical value information calculation unit. 66, a display control unit 67, and a storage unit 68. The processor device 16 includes a computer having a CPU (Central Processing Unit), a semiconductor memory, a hard disk, and the like, and is installed with an embodiment of the endoscope image signal processing program of the present invention. . The above-described units function when the endoscope image signal processing program is executed by the CPU.

  The RAW signal acquisition unit 60 acquires a digital RAW signal output from the endoscope 12. The digital RAW signal acquired by the RAW signal acquisition unit 60 is stored in the storage unit 68. The normal image generation unit 64 and the special image generation unit 65 correspond to an endoscope image generation unit.

  The shading correction unit 61 performs shading correction on the digital RAW signal acquired by the RAW signal acquisition unit 60. As a shading correction method, a known method can be used.

  The demosaic processing unit 62 performs demosaic processing on the digital RAW signal subjected to shading correction. Here, the demosaic process will be described with reference to FIG.

  For example, when the image sensor 48 is a simultaneous image sensor provided with an RGB color filter having a Bayer array, the RGB RAW signal I output from the image sensor 48 has the same array as the RGB color filter as shown in FIG. become. Then, when the RAW signal I is divided for each color component, as shown in FIG. 5, the RAW signal MG for the G component, the RAW signal MR for the R component, and the RAW signal MB for the B component are obtained. It becomes a mosaic.

  The demosaic processing generates image signals IG, IR, and IB for each color component by generating and filling a portion having no RAW signal for each of the mosaic-like RAW signals MG, MR, and MB as shown in FIG. It is processing. Hereinafter, the image signals IG, IR, and IB obtained by the demosaic processing are referred to as RGB-RAW signals.

  The demosaic processing unit 62 of this embodiment performs two types of demosaic processing. Specifically, the demosaic processing unit 62 switches between demosaic processing that performs interpolation processing and demosaic processing that does not perform interpolation processing. Hereinafter, the demosaic process that performs the interpolation process is referred to as a first demosaic process, and the demosaic process that does not perform the interpolation process is referred to as a second demosaic process.

  Here, the interpolation processing referred to in this specification is processing for generating a new RAW signal using RAW signals output from a plurality of elements constituting the image sensor 48. This interpolation process does not include, for example, a process for generating a new RAW signal by the near-rebar method that replaces the adjacent RAW signal with the same color component.

  For example, an interpolation method based on a gradient method, an adaptive color plane interpolation method (ACPI (Adaptive Color Plane Interpolation)), and a linear interpolation method can be used as the interpolation processing of the present embodiment. Instead, other known interpolation processing may be used as long as processing is performed to generate a new RAW signal using RAW signals output from a plurality of elements. Similarly, when the color filter provided in the image sensor 48 is a CMYG color filter, any known interpolation may be used as long as the process generates a new RAW signal using RAW signals output from a plurality of elements. Processing may be used.

  The demosaic processing unit 62 performs a first demosaic process when generating an endoscopic image for display to be displayed on the monitor 18, and the color numerical value information calculation unit 66 digitizes the color information of the imaging target. When calculating numerical information, the second demosaic process is performed.

  In the first demosaic process, the RGB-RAW signals IG, IR, and IB are generated by performing the above-described interpolation process.

  Further, in the second demosaic process, the RGB-RAW signals IG, IR, and IB are generated by generating a new RAW signal by the above-mentioned near-less lever method without performing an interpolation process. The RGB-RAW signals IG, IR and IB obtained by the second demosaic process more accurately represent the color to be imaged. The color numerical value information will be described later in detail. The RGB-RAW signal generated by the first demosaic process is referred to as a first RGB-RAW signal, and the RGB-RAW signal generated by the second demosaic process is referred to as a second RGB-RAW signal.

  The color correction processing unit 63 performs color correction processing on the first and second RGB-RAW signals generated by the demosaic processing unit 62. The color correction processing unit 63 in the present embodiment performs color correction processing using different parameters for generating a display endoscope image (normal image and special image) and calculating color numerical value information. It is. Specifically, when an endoscope image for display is generated, color correction processing is performed using parameters suitable for display on the monitor 18.

  On the other hand, when calculating color numerical value information, color correction processing is performed for converting the second RGB-RAW signal into an image signal such as an XYZ color space or a Lab color space. The RGB image signal is converted into an image signal such as an XYZ color space or a Lab color space in this manner because the image signals in these color spaces more accurately represent the actual color of the imaging target. It is. Note that the color space is not limited to the XYZ space and the Lab color space, and other HSV color spaces may be used.

  The normal image generation unit 64 generates a normal image signal for display by performing preset image processing for a normal image on the first RGB-RAW signal subjected to the color correction processing. . The special image generating unit 65 generates a special image signal for display by performing preset image processing for the special image on the first RGB-RAW signal subjected to the color correction processing. It is.

  The color numerical value information calculation unit 66 calculates color numerical value information obtained by converting the color information of the imaging target into a numerical value based on the image signal converted into the XYZ color space or the Lab color space by the color correction processing unit 63. Thus, by digitizing the color information of the imaging target, the color of the imaging target can be quantified, and objective color information of the imaging target can be obtained.

  Further, as described above, when the color numerical value information calculation unit 66 calculates color numerical information, the demosaic processing unit 62 performs the second demosaic process. That is, since the second demosaic process directly using the RAW signal output from the image sensor 48 is performed without performing the interpolation process using the RAW signal output from the plurality of elements, the color of the imaging target It is possible to calculate color numerical information that more accurately represents the above information.

  Specifically, in the case of an image signal in the XYZ color space, the color numerical value information calculation unit 66 calculates an x value and ay value as numerical information representing the hue and saturation of the imaging target. Here, x = X / (X + Y + Z) and y = Y / (X + Y + Z). As the x value, it is desirable to calculate the average value of the x values of the pixels constituting the image signal. However, the present invention is not limited to this, and a maximum value, minimum value, median value, or the like may be calculated. Similarly, for the y value, it is desirable to calculate the average value of the y values of the respective pixels constituting the image signal. However, the present invention is not limited to this.

  Further, when converted into an image signal in the Lab color space, the a * value and the b * value are calculated as numerical information representing the hue and saturation of the imaging target. As the a * value, it is desirable to calculate the average value of the a * values of the pixels constituting the image signal. However, the present invention is not limited to this. . Similarly, for the b * value, it is desirable to calculate the average value of the b * values of the respective pixels constituting the image signal. Good.

  Further, when the image signal is converted into an image signal in the LSV color space, the H value is calculated as numerical information representing the hue of the imaging target, and the S value is calculated as information representing the saturation. As the H value, it is desirable to calculate the average value of the H values of each pixel constituting the image signal. Similarly, for the S value, it is desirable to calculate the average value of the S values of the pixels constituting the image signal. However, the present invention is not limited to this.

  The display control unit 67 converts the normal image signal or the special image signal output from the normal image generation unit 64 or the special image generation unit 65 into a display image signal that can be displayed on the monitor 18. The monitor 18 displays a normal image or a special image based on the display image signal.

  The display control unit 67 displays the color value information calculated by the color value information calculation unit 66 as text on the monitor 18. The user can recognize objective color information of the imaging target by looking at the numerical color information displayed on the monitor 18.

  Next, the operation of the endoscope system of this embodiment will be described with reference to the flowchart shown in FIG.

  First, the normal observation mode is set, and the insertion portion 21 of the endoscope 12 is inserted into the subject (S10). The RAW signal output from the image sensor 48 by imaging the imaging target with the endoscope 12 is subjected to shading correction, and then subjected to a first demosaic process to generate a first RGB-RAW signal. The

  The first RGB-RAW signal is subjected to image processing for a normal image in the normal image generation unit 64 and then output to the display control unit 67. The display control unit 67 causes the monitor 18 to display a normal image.

  Next, when the user wants to confirm the color numerical information of the normal image currently displayed (S12, YES), the color numerical information is calculated in response to the instruction input, and the color numerical information is displayed and controlled. The text is displayed on the monitor 18 by the unit 67 (S20). At this time, as described above, the demosaic process in the demosaic processing unit 62 is switched from the first demosaic process to the second demosaic process, and a second RGB-RAW signal is generated. The color correction processing in the color correction processing unit 63 is also switched to color conversion processing to an XYZ color space or the like. The instruction input for calculating the color numerical information may be performed by the user using the input device 20, for example. However, the present invention is not limited thereto, and a changeover switch may be provided in the operation unit 22 of the endoscope 12. Good.

  On the other hand, when the user wants to observe a special image while observing a normal image, the special light observation mode is set (S12, NO, S14, YES, S16). The RAW signal output from the image sensor 48 by imaging the imaging target with the endoscope 12 is subjected to shading correction, and then subjected to a first demosaic process to generate a first RGB-RAW signal. The

  The first RGB-RAW signal is subjected to image processing for a special image in the special image generation unit 65, and then output to the display control unit 67. The display control unit 67 causes the monitor 18 to display the special image.

  Next, when the user wants to confirm the color value information of the special image currently displayed (S18, YES), the color value information is calculated in response to the instruction input, and the calculated color value is calculated. Information is displayed as text on the monitor 18 by the display control unit 67 (S20). At this time, the demosaic process in the demosaic processing unit 62 is switched from the first demosaic process to the second demosaic process, and a second RGB-RAW signal is generated. The color correction processing in the color correction processing unit 63 is also switched to color conversion processing to an XYZ color space or the like.

  Next, an endoscope system using the endoscope image signal processing device and method and the second embodiment of the program of the present invention will be described. FIG. 7 is a diagram showing a schematic configuration of the endoscope system 11 of the present embodiment. The endoscope system 11 according to the second embodiment further includes an image numerical value information calculation unit 69 with respect to the endoscope system 10 according to the first embodiment.

  The image numerical information calculation unit 69 calculates image numerical information obtained by digitizing image information other than the color information of the imaging target. Examples of the numerical image information include sharpness numerical information, numerical information indicating the amount of noise, and numerical information on contrast. Note that the numerical information indicating the amount of noise may be obtained by calculating the standard deviation in, for example, a specified region or a region where the image signal value is lower than a preset threshold value. Or you may acquire by calculating the standard deviation of the same coordinate position with respect to the image continuous in a time-axis direction.

  The numerical image information is displayed as text on the monitor 18 by the display control unit 67. Thus, by displaying the image numerical information on the monitor 18 as text, the user can recognize objective information obtained by quantifying the feature amount of the image other than the color information such as the sharpness of the image.

  When calculating the image numerical information by the image numerical information calculation unit 69, unlike the case of calculating the color numerical information, the demosaic processing unit 62 performs a first demosaic process for performing an interpolation process. Further, the color correction processing unit 63 performs the same color correction processing as that for generating an endoscope image for display.

  In addition, about another structure, it is the same as that of the endoscope system 10 of the said 1st Embodiment.

  Next, the operation of the endoscope system 11 of the second embodiment will be described with reference to the flowchart shown in FIG.

  First, the normal observation mode is set, and the insertion portion 21 of the endoscope 12 is inserted into the subject (S30). The RAW signal output from the image sensor 48 by imaging the imaging target with the endoscope 12 is subjected to shading correction, and then subjected to a first demosaic process to generate a first RGB-RAW signal. The

  The first RGB-RAW signal is subjected to image processing for a normal image in the normal image generation unit 64 and then output to the display control unit 67. The display control unit 67 causes the monitor 18 to display a normal image.

  Next, when the user wants to check the color numerical information or image numerical information of the normal image currently displayed (S32, YES), the color numerical information or image numerical information is calculated according to the instruction input. The calculated color numerical value information or image numerical value information is displayed as text on the monitor 18 (S40). At this time, when calculating the color numerical value information, the demosaic process in the demosaic processing unit 62 is switched from the first demosaic process to the second demosaic process, and a second RGB-RAW signal is generated. The color correction processing in the color correction processing unit 63 is also switched to color conversion processing to an XYZ color space or the like.

  On the other hand, when calculating the image numerical information, the demosaic process in the demosaic processing unit 62 is not switched as it is in the first demosaic process. Further, the color correction processing in the color correction processing unit 63 is also subjected to the same color correction processing as the color correction processing in the case of generating a normal image. The instruction input for calculating the numerical color information and the numerical image information may be performed by the user using, for example, the input device 20, but is not limited thereto, and the changeover switch is not limited to the operation unit 22 of the endoscope 12. You may make it provide in.

  On the other hand, when the user wants to observe a special image while observing a normal image, the special light observation mode is set (S32, NO, S34, YES, S36). The RAW signal output from the image sensor 48 by imaging the imaging target with the endoscope 12 is subjected to shading correction, and then subjected to a first demosaic process to generate a first RGB-RAW signal. The

  The first RGB-RAW signal is subjected to image processing for a special image in the special image generation unit 65, and then output to the display control unit 67. The display control unit 67 causes the monitor 18 to display the special image.

  Next, when the user wishes to confirm the color numerical information or image numerical information of the special image currently displayed (S38, YES), the color numerical information or image numerical information is calculated according to the instruction input. The calculated color numerical value information or image numerical value information is displayed as text on the monitor 18 (S40). At this time, when calculating the color numerical value information, the demosaic process in the demosaic processing unit 62 is switched from the first demosaic process to the second demosaic process, and a second RGB-RAW signal is generated. The color correction processing in the color correction processing unit 63 is also switched to color conversion processing to an XYZ color space or the like.

  On the other hand, when calculating the image numerical information, the demosaic process in the demosaic processing unit 62 is not switched as it is in the first demosaic process. Further, the color correction processing in the color correction processing unit 63 is also subjected to the same color correction processing as the color correction processing in the case of generating a special image.

  Next, an endoscope system using the endoscope image signal processing apparatus and method and the third embodiment of the program of the present invention will be described. FIG. 9 is a diagram showing a schematic configuration of the endoscope system 15 of the present embodiment. The endoscope system 15 according to the third embodiment is further provided with a region of interest specifying unit 70 with respect to the endoscope system 10 according to the first embodiment.

  The region of interest specifying unit 70 specifies a region of interest on a normal image or a special image displayed on the monitor 18. The region of interest may be set and input using the input device 20 while the user observes a normal image or a special image, or a lesion is automatically extracted by image processing or the like, and the lesion is used as the region of interest. Also good.

  The position information of the region of interest specified by the region of interest specifying unit 70 is output to the color value information calculating unit 66. The color numerical value information calculation unit 66 calculates color numerical value information in the region of interest based on the input position information of the region of interest. The calculation method of color numerical information is the same as that in the first embodiment.

  Other configurations are the same as those of the endoscope system 10 of the first embodiment.

  Next, the operation of the endoscope system 15 of the third embodiment will be described with reference to the flowchart shown in FIG.

  First, the normal observation mode is set, and the insertion portion 21 of the endoscope 12 is inserted into the subject (S50). The RAW signal output from the image sensor 48 by imaging the imaging target with the endoscope 12 is subjected to shading correction, and then subjected to a first demosaic process to generate a first RGB-RAW signal. The

  The first RGB-RAW signal is subjected to image processing for a normal image in the normal image generation unit 64 and then output to the display control unit 67. The display control unit 67 causes the monitor 18 to display a normal image.

  Next, when the user wants to confirm color numerical value information of a specific region of interest on the currently displayed normal image (S52, YES), the instruction is input. Subsequently, a region of interest is set and input by the user using the input device 20, and the position information is acquired by the region of interest specifying unit 70 (S60).

  The position information of the region of interest acquired by the region of interest specifying unit 70 is output to the color value information calculating unit 66. The color value information calculation unit 66 calculates color value information in the input region of interest (S62). At this time, the demosaic process in the demosaic processing unit 62 is switched from the first demosaic process to the second demosaic process, and a second RGB-RAW signal is generated. The color correction processing in the color correction processing unit 63 is also switched to color conversion processing to an XYZ color space or the like. The calculated color numerical information is output to the display control unit 67, and the display control unit 67 displays the color numerical information on the monitor 18 as text (S64).

  On the other hand, when the user wants to observe a special image while observing a normal image, the special light observation mode is set (S52, NO, S54, YES, S56). The RAW signal output from the image sensor 48 by imaging the imaging target with the endoscope 12 is subjected to shading correction, and then subjected to a first demosaic process to generate a first RGB-RAW signal. The

  The first RGB-RAW signal is subjected to image processing for a special image in the special image generation unit 65, and then output to the display control unit 67. The display control unit 67 causes the monitor 18 to display the special image.

  Next, when the user wants to confirm color numerical value information of a specific region of interest on the currently displayed special image (S58, YES), the instruction is input. Subsequently, a region of interest is set and input by the user using the input device 20, and the position information is acquired by the region of interest specifying unit 70 (S60).

  The position information of the region of interest acquired by the region of interest specifying unit 70 is output to the color value information calculating unit 66. The color value information calculation unit 66 calculates color value information in the input region of interest (S62). At this time, the demosaic process in the demosaic processing unit 62 is switched from the first demosaic process to the second demosaic process, and a second RGB-RAW signal is generated. The color correction processing in the color correction processing unit 63 is also switched to color conversion processing to an XYZ color space or the like. The calculated color numerical value information is output to the display control unit 67, and the display control unit 67 displays the color numerical value information on the monitor 18 as text (S64).

  In the endoscope systems 10, 11, and 15 of the first to third embodiments, color numerical value information is calculated using the second RGB-RAW signal subjected to the second demosaic process. However, the color numerical value information may be calculated using the mosaic-shaped R component, G component, and B component RAW signals before the second demosaic process is performed.

  In the endoscope systems 10, 11, and 15 of the first to third embodiments, the present invention is performed during the diagnosis of the endoscope. However, the present invention is not limited thereto, and after the endoscope diagnosis. The mosaic R component, G component and B component RAW signals stored in the storage unit 68 of the endoscope system 10, 11, 15 before the second demosaic process, or after the second demosaic process Color numerical value information may be calculated using the second RGB-RAW signal. Alternatively, the normal image or the special image may be displayed using the first RGB-RAW signal subjected to the first demosaic process stored in the storage unit 68.

  In the endoscope systems 10, 11, and 15 of the first to third embodiments, the R component, G component, and B component image signals are converted into image signals in the XYZ color space to obtain color numerical information. Although it is calculated, IHb, which is a mucosal hemoglobin index, may be calculated based on the second RGB-RAW signal of the R component and the G component as color numerical value information.

  In the endoscope systems 10, 11, and 15 of the first to third embodiments, the color numerical information is displayed as text. Further, a color bar and chromaticity related to the color numerical information are displayed. You may make it display color image information, such as a figure.

  In the endoscope systems 10, 11, and 15 of the first to third embodiments, the blue light source 34 and the blue-violet laser light source 36 are used as the light sources, and the phosphor 44 is irradiated with the blue laser light. However, the configuration of the light source device 14 is not limited to this, and other configurations may be used.

  Specifically, as in the endoscope system 15 shown in FIG. 11, the light source device 14 includes a V-LED (Violet Light Emitting Diode) 42a, a B-LED (Blue Light Emitting Diode) 42b, and a G-LED (Green A light emitting diode (R) 42c and a red light emitting diode (R-LED) 42d may be provided. The light source device 14 further includes a light source control unit 40 that controls driving of the four color LEDs 42a to 42d and an optical path coupling unit 43 that couples the optical paths of the four color lights emitted from the four color LEDs 42a to 42d. The light coupled by the optical path coupling unit 43 is irradiated into the subject through the light guide 41.

  As shown in FIG. 12, the V-LED 42a generates purple light V having a center wavelength of 405 ± 10 nm and a wavelength range of 380 to 420 nm. The B-LED 42b generates blue light B having a center wavelength of 460 ± 10 nm and a wavelength range of 420 to 500 nm. The G-LED 42c generates green light G having a wavelength range of 480 to 600 nm. The R-LED 42d generates red light R having a center wavelength of 620 to 630 nm and a wavelength range of 600 to 650 nm.

  The light source control unit 40 lights the V-LED 42a, the B-LED 42b, the G-LED 42c, and the R-LED 42d in any of the observation modes of the normal observation mode, the first special light observation mode, and the second special light observation mode. . Accordingly, the observation target is irradiated with light in which four colors of light of purple light V, blue light B, green light G, and red light R are mixed. In the normal observation mode, the light source controller 40 sets the LEDs 42a to 42d so that the light quantity ratio among the violet light V, blue light B, green light G, and red light R is Vc: Bc: Gc: Rc. Control. On the other hand, in the first and second special observation modes, the light source control unit 40 is configured so that the light quantity ratio among the violet light V, the blue light B, the green light G, and the red light R is Vs: Bs: Gs: Rs. Each LED 42a-42d is controlled. The first special light observation mode is used when determining whether or not the sterilization of Helicobacter pylori has been successful, and is a mode for displaying the first special image on the monitor 18. The second special light observation mode is used to determine whether or not the virus is infected with H. pylori, and is a mode for displaying the second special image on the monitor 18.

  In the endoscope systems 10, 11, and 15 of the first to third embodiments, the simultaneous imaging device is used. However, the present invention is applicable to a so-called frame sequential endoscope system. Can be applied.

  In the field sequential endoscope system, in the normal observation mode, a rotary filter in which an R (red) filter, a G (green) filter, and a B (blue) filter are provided along the circumferential direction rotates. Thus, blue light, green light, and red light are sequentially irradiated onto the imaging target.

  A reflected image from an imaging target by irradiation with blue light, green light, and red light is picked up by a monochrome image pickup device, and RGB-RAW signals of B component, G component, and R component are sequentially output from the image pickup device. Note that the RGB-RAW signal here is not obtained by the demosaic processing described above, but is the same in the sense that all pixels have R component, G component, and B component signals, respectively. It will be called a signal.

  In the frame-sequential endoscope system, R-component, G-component, and B-component RGB-RAW signals are acquired in a time division manner, that is, the timing at which the imaging target is imaged differs for each color component. Each of the G-component and B-component RGB-RAW signals is subjected to alignment processing, and a normal image is generated based on the R-component, G-component, and B-component RGB-RAW signals after the alignment processing. .

  However, if the alignment process described above is performed when calculating the color numerical information, color mixture occurs as in the interpolation process of the above-described embodiment, and color numerical information representing the exact color of the imaging target is acquired. Can not do it. Therefore, the color numerical value information is calculated by directly using the RGB-RAW signals of the R component, G component, and B component before the alignment processing.

  Further, in the special light observation mode, by rotating a rotary filter provided with a Bn filter, a G filter, and an R filter that transmit blue narrow-band light having a center wavelength of 415 nm along the circumferential direction, Blue narrow-band light, green light, and red light are sequentially irradiated onto the imaging target.

  A reflected image from an imaging target by irradiation with blue narrow band light, green light, and red light is picked up by a monochrome image pickup device, and RGB-RAW signals of Bn component, G component, and R component are sequentially output from the image pickup device.

  Then, as in the normal observation mode, a special image is generated based on the RGB-RAW signals of the R component, G component, and Bn component after the alignment process, and the R component, G component before the alignment process is performed. Color numerical value information is calculated by directly using RGB-RAW signals of the Bn component and the Bn component.

  In addition, this invention is applicable not only to the endoscope system provided with the insertion part 21 like the endoscope systems 10, 11, and 15 of the first to third embodiments but also to the capsule endoscope. is there.

10, 11, 15 Endoscope system 12 Endoscope 13 Universal code 14 Light source device 15 Endoscope system 16 Processor device 18 Monitor 20 Input device 21 Insertion unit 22 Operation unit 22a Angle knob 22b Mode changeover switch 22c Zoom operation unit 23 Curved portion 24 Tip portion 24a Illumination optical system 24b Imaging optical system 34 Blue laser light source 36 Blue-violet laser light source 40 Light source control unit 41 Light guide 44 Phosphor 45 Illumination lens 46 Imaging lens 47 Zoom lens 48 Imaging element 50 Circuit 51 Gamma conversion unit 52 conversion unit 60 signal acquisition unit 61 shading correction unit 62 demosaic processing unit 63 color correction processing unit 64 normal image generation unit 65 special image generation unit 66 color numerical information calculation unit 67 display control unit 68 storage unit 69 image numerical information calculation unit 70 Region-of-interest specifying part BL Blue laser FL Fluorescent SL Special light VL Blue-violet laser light WL White color I RAW signal IR R component RGB-RAW signal IGG component RGB-RAW signal IB B component RGB-RAW signal MG G component mosaic RAW signal MR R component mosaic RAW signal MB B component mosaic RAW signal

Claims (26)

A RAW signal acquisition unit that acquires a RAW signal output from a simultaneous imaging device having a color filter by imaging an imaging target using an endoscope;
A demosaic processing unit that performs demosaic processing on the RAW signal to generate an RGB-RAW signal;
An endoscope image generation unit that generates an endoscope image for display based on the RGB-RAW signal;
The RGB- and have use of the RAW signal, and a color numerical information calculation unit for calculating a color numerical information obtained by digitizing the color information of the imaging object,
The demosaic processing unit
When generating an endoscopic image for display, performing the demosaic process for performing an interpolation process using RAW signals output from a plurality of elements constituting the simultaneous imaging element,
When calculating the color numerical value information, the demosaicing process is performed by replacing with a RAW signal of an element having a color filter of the same color component adjacent among a plurality of elements constituting the simultaneous imaging element. An endoscopic image signal processing apparatus. A color correction processing unit that performs color correction processing on the RGB-RAW signal;
The color correction processing unit, when generating an endoscopic image and an endoscopic image with at using different parameters subjected to the color correction processing according to claim 1, wherein when calculating the color numerical information for the display Signal processing device. A RAW signal acquisition unit that acquires a RAW signal output from a simultaneous imaging device having a color filter by imaging an imaging target using an endoscope;
A demosaic processing unit that performs demosaic processing on the RAW signal to generate an RGB-RAW signal;
Based on the RGB-RAW signal, an image numerical information calculation unit that calculates image numerical information obtained by quantifying image information other than the color information of the imaging target;
A color value information calculation unit that calculates color value information obtained by digitizing the color information of the imaging target using the RGB-RAW signal,
The demosaic processing unit
When calculating the image numerical information, performing the demosaicing process that performs an interpolation process using RAW signals output from a plurality of elements constituting the simultaneous imaging element,
To calculate the color numerical information, characterized in that the demosaic processing by replacing the RAW signal element having the color filters of the same color component adjacent ones of the plurality of elements constituting the co-type image pickup element An endoscopic image signal processing apparatus. A color correction processing unit that performs color correction processing on the RGB-RAW signal;
The endoscope image signal processing apparatus according to claim 3, wherein the color correction processing unit performs the color correction processing using different parameters depending on whether the image numerical value information is calculated or the color numerical value information is calculated. The endoscope image signal processing apparatus according to claim 3 or 4, wherein the image numerical information calculation unit calculates at least one of sharpness information and noise information as the image numerical information. A RAW signal acquisition unit that acquires a RAW signal output from a simultaneous imaging device having a color filter by imaging an imaging target using an endoscope;
A color value information calculation unit for calculating color value information obtained by digitizing the color information of the imaging target;
A demosaicing process that performs an interpolation process using RAW signals output from a plurality of elements that constitute the simultaneous imaging element is generated to generate a first RGB-RAW signal, and a plurality that constitutes the simultaneous imaging element A demosaic processing unit that generates a second RGB-RAW signal by performing demosaic processing by replacing with a RAW signal of an element having a color filter of the same color component adjacent among the elements ,
An endoscope image generation unit that generates an endoscope image for display based on the first RGB-RAW signal ;
A display control unit for displaying the endoscope image for display on a display unit;
A region of interest specifying unit that specifies a region of interest on the endoscopic image displayed on the display unit,
It said color numerical information calculating unit is characterized that you calculate the color numerical information using the RAW signal or the second RGB-RAW signal in a region of interest specified on the endoscopic image the endoscope image signal processing apparatus. A color correction processing unit configured to perform color correction processing on the first RGB-RAW signal and the second RGB-RAW signal in the region of interest;
The internal vision according to claim 6, wherein the color correction processing unit performs the color correction processing using different parameters for the first RGB-RAW signal and the second RGB-RAW signal in the region of interest. Mirror image signal processing device.   The endoscope image signal processing apparatus according to any one of claims 2 to 7, further comprising a storage unit that stores the RAW signal subjected to the demosaic process and the RAW signal before the demosaic process. Endoscopic image signal processing apparatus shading correction unit according to claim 1 to 8 to any one of claims with a performing shading correction on the RAW signal. The endoscopic image signal processing device according to any one of claims 1 to 9, wherein the color numerical information calculation unit calculates at least one of a hue and saturation of the imaging target as the color numerical information. The simultaneous type imaging device, an endoscopic image signal processing apparatus of claims 1, wherein 10 any one provided with the color filter of RGB. A RAW signal acquisition unit that acquires a RAW signal output from a simultaneous imaging device having a color filter by imaging an imaging target using an endoscope;
A color numerical value information calculation unit for calculating at least one of hue and saturation of the imaging target as color numerical value information;
A demosaic processing unit that performs demosaic processing on the RAW signal to generate an RGB-RAW signal,
When the demosaic processing unit generates an endoscopic image for display, the demosaic processing performs the demosaic processing that performs interpolation processing using RAW signals output from a plurality of elements constituting the simultaneous imaging device, When calculating the color numerical information, the demosaicing process is performed by replacing with a raw signal of an element having a color filter of the same color component adjacent among a plurality of elements constituting the simultaneous imaging element ,
An endoscope image signal processing apparatus, wherein the color numerical value information calculation unit calculates the color numerical value information using an RGB-RAW signal after demosaic processing when calculating the color numerical value information. A RAW signal acquisition unit that acquires a RAW signal output from a simultaneous imaging device having a color filter by imaging an imaging target using an endoscope;
And said have use a RAW signal, the color numerical information calculation unit for calculating at least one as the color numerical information of hue and saturation of the imaging target,
A demosaic processing unit for generating the RGB-RAW signal by performing demosaic processing for the previous SL RAW signal,
An image numerical information calculation unit that calculates at least one of sharpness information and noise information of the image to be imaged as image numerical information based on the RGB-RAW signal ,
When the demosaic processing unit calculates the image numerical information, the demosaic processing is performed to perform interpolation processing using RAW signals output from a plurality of elements constituting the simultaneous imaging device, and the color numerical values When calculating information, the demosaicing process is performed by replacing with a raw signal of an element having a color filter adjacent to the same color component among a plurality of elements constituting the simultaneous imaging element ,
The color value information calculation unit calculates the color value information using an RGB-RAW signal after demosaic processing in the case of calculating the color value information,
The endoscope image signal processing apparatus, wherein the image numerical information calculation unit calculates the image numerical information using an RGB-RAW signal after demosaic processing for performing the interpolation processing. A RAW signal acquisition unit that acquires a RAW signal output from a simultaneous imaging device having a color filter by imaging an imaging target using an endoscope;
By replacing with a RAW signal of an adjacent element having a color filter of the same color component among a plurality of elements constituting the simultaneous imaging element , at least one of hue and saturation of the imaging target is calculated as color numerical information A color numerical value information calculating unit,
A demosaicing process that performs an interpolation process using RAW signals output from a plurality of elements that constitute the simultaneous imaging element is generated to generate a first RGB-RAW signal, and a plurality that constitutes the simultaneous imaging element A demosaic processing unit that generates a second RGB-RAW signal by performing demosaic processing by replacing with a RAW signal of an element having a color filter of the same color component adjacent among the elements ,
An endoscope image generation unit that generates an endoscope image for display based on the first RGB-RAW signal ;
A display control unit for displaying the endoscope image for display on a display unit;
A region of interest specifying unit that specifies a region of interest on the endoscopic image displayed on the display unit,
The color value information calculation unit calculates the color value information using the RAW signal or the second RGB-RAW signal in the region of interest specified on the endoscopic image. Endoscopic image signal processing apparatus. By capturing an image of an imaging target using an endoscope, a RAW signal output from a simultaneous image sensor having a color filter is obtained,
An RGB-RAW signal is generated by performing demosaic processing on the RAW signal,
Based on the RGB-RAW signal, an endoscopic image for display is generated,
And have use the RGB- RAW signal, a method of operating the endoscopic image signal processing apparatus for calculating a color numerical information obtained by digitizing the color information of the imaging object,
When performing the demosaicing process,
When generating an endoscopic image for display, performing the demosaic process for performing an interpolation process using RAW signals output from a plurality of elements constituting the simultaneous imaging element,
When calculating the color numerical value information, the demosaicing process is performed by replacing with a RAW signal of an element having a color filter of the same color component adjacent among a plurality of elements constituting the simultaneous imaging element. operation method of the endoscopic image signal processing apparatus according to. A RAW signal acquisition unit that acquires a RAW signal output from a simultaneous image pickup device having a color filter by imaging an imaging target using an endoscope;
A demosaic processing unit that performs demosaic processing on the RAW signal to generate an RGB-RAW signal;
An endoscope image generation unit that generates an endoscope image for display based on the RGB-RAW signal;
The RGB- and have use of the RAW signal, an endoscopic image signal processing program to function as the color numerical information calculation unit for calculating a color numerical information obtained by digitizing the color information of the imaging object,
The demosaic processing unit
When generating an endoscopic image for display, performing the demosaic process for performing an interpolation process using RAW signals output from a plurality of elements constituting the simultaneous imaging element,
When calculating the color numerical information, the RAW signal is directly used by replacing it with a RAW signal of one element having a color filter of the same color component adjacent among a plurality of elements constituting the simultaneous imaging element. An endoscope image signal processing program characterized by performing the demosaic processing. By capturing an image of an imaging target using an endoscope, a RAW signal output from a simultaneous image sensor having a color filter is obtained,
An RGB-RAW signal is generated by performing demosaic processing on the RAW signal,
Based on the RGB-RAW signal, image numerical information obtained by quantifying image information other than the color information of the imaging target is calculated,
An operation method of an endoscope image signal processing apparatus that calculates color numerical value information obtained by digitizing color information of the imaging target using the RGB-RAW signal,
When applying the demosaic processing unit,
When calculating the image numerical information, performing the demosaicing process that performs an interpolation process using RAW signals output from a plurality of elements constituting the simultaneous imaging element,
When calculating the color numerical value information, the demosaicing process is performed by replacing with a RAW signal of an element having a color filter of the same color component adjacent among a plurality of elements constituting the simultaneous imaging element. An operation method of the endoscope image signal processing apparatus. A RAW signal acquisition unit that acquires a RAW signal output from a simultaneous image pickup device having a color filter by imaging an imaging target using an endoscope;
A demosaic processing unit that performs demosaic processing on the RAW signal to generate an RGB-RAW signal;
Based on the RGB-RAW signal, an image numerical information calculation unit that calculates image numerical information obtained by quantifying image information other than the color information of the imaging target;
An endoscope image signal processing program for functioning as a color value information calculation unit that calculates color value information obtained by digitizing the color information of the imaging target using the RGB-RAW signal,
The demosaic processing unit
When calculating the image numerical information, performing the demosaicing process that performs an interpolation process using RAW signals output from a plurality of elements constituting the simultaneous imaging element,
When calculating the color numerical information, the RAW signal is directly used by replacing it with a RAW signal of an element having a color filter of the same color component adjacent among a plurality of elements constituting the simultaneous imaging element. An endoscope image signal processing program characterized by performing demosaic processing. By capturing an image of an imaging target using an endoscope, a RAW signal output from a simultaneous image sensor having a color filter is obtained,
Calculating color numerical information obtained by digitizing the color information of the imaging target;
A demosaicing process that performs an interpolation process using RAW signals output from a plurality of elements that constitute the simultaneous imaging element is generated to generate a first RGB-RAW signal, and a plurality that constitutes the simultaneous imaging element To generate a second RGB-RAW signal by demosaicing by replacing with a RAW signal of an element having a color filter of the same color component adjacent among the elements of
Based on the first RGB-RAW signal, an endoscope image for display is generated,
Displaying the endoscopic image for display on a display unit;
An operation method of an endoscopic image signal processing device for specifying a region of interest on an endoscopic image displayed on the display unit,
When calculating the color numerical information, the color numerical information is calculated using the RAW signal or the second RGB-RAW signal in the region of interest specified on the endoscopic image. Method of operating an endoscope image signal processing apparatus . A RAW signal acquisition unit that acquires a RAW signal output from a simultaneous image pickup device having a color filter by imaging an imaging target using an endoscope;
A color value information calculation unit for calculating color value information obtained by digitizing the color information of the imaging target;
A demosaicing process that performs an interpolation process using RAW signals output from a plurality of elements that constitute the simultaneous imaging element is generated to generate a first RGB-RAW signal, and a plurality that constitutes the simultaneous imaging element A demosaic processing unit that generates a second RGB-RAW signal by performing demosaic processing by replacing with a RAW signal of an element having a color filter of the same color component adjacent among the elements,
An endoscope image generation unit that generates an endoscope image for display based on the first RGB-RAW signal;
A display control unit for displaying the endoscope image for display on a display unit;
An endoscope image signal processing program for functioning as a region of interest specifying unit that specifies a region of interest on an endoscopic image displayed on the display unit,
The color value information calculation unit calculates the color value information using the RAW signal or the second RGB-RAW signal in the region of interest specified on the endoscopic image. Endoscopic image signal processing program. By capturing an image of an imaging target using an endoscope, a RAW signal output from a simultaneous image sensor having a color filter is obtained,
Calculating at least one of hue and saturation of the imaging target as color numerical information,
An operation method of an endoscope image signal processing apparatus that performs demosaic processing on the RAW signal to generate an RGB-RAW signal,
When generating an endoscopic image for display when performing the demosaic process, the demosaic process for performing an interpolation process using RAW signals output from a plurality of elements constituting the simultaneous imaging element is performed. When the color numerical value information is calculated, the demosaicing process is performed by replacing with a raw signal of an element having a color filter of an adjacent same color component among a plurality of elements constituting the simultaneous imaging element,
An endoscope image signal processing apparatus characterized in that, when calculating the color value information, the color value information is calculated using an RGB-RAW signal after demosaic processing when the color value information is calculated. Actuation method. A RAW signal acquisition unit that acquires a RAW signal output from a simultaneous image pickup device having a color filter by imaging an imaging target using an endoscope;
A color numerical value information calculation unit for calculating at least one of hue and saturation of the imaging target as color numerical value information;
An endoscope image signal processing program for performing a demosaic process on the RAW signal to function as a demosaic processing unit that generates an RGB-RAW signal,
When the demosaic processing unit generates an endoscopic image for display, the demosaic processing performs the demosaic processing that performs interpolation processing using RAW signals output from a plurality of elements constituting the simultaneous imaging device, When calculating the color numerical information, the demosaicing process is performed by replacing with a raw signal of an element having a color filter of the same color component adjacent among a plurality of elements constituting the simultaneous imaging element,
An endoscope image signal processing program, wherein the color numerical value information calculation unit calculates the color numerical value information using an RGB-RAW signal after demosaic processing when calculating the color numerical value information. By capturing an image of an imaging target using an endoscope, a RAW signal output from a simultaneous image sensor having a color filter is obtained,
Using the RAW signal, calculate at least one of the hue and saturation of the imaging target as color numerical information,
An RGB-RAW signal is generated by performing demosaic processing on the RAW signal,
An operation method of an endoscopic image signal processing device that calculates at least one of sharpness information and noise information of the image to be imaged as image numerical information based on the RGB-RAW signal,
When calculating the image numerical information when performing the demosaicing process, the demosaicing process is performed to perform an interpolation process using RAW signals output from a plurality of elements constituting the simultaneous imaging element, When calculating color numerical information, the demosaicing process is performed by replacing with a raw signal of an element having a color filter of the same color component adjacent among a plurality of elements constituting the simultaneous imaging element,
When calculating the color numerical information, the color numerical information is calculated using an RGB-RAW signal after demosaic processing when calculating the color numerical information,
A method of operating an endoscopic image signal processing apparatus, wherein when calculating the image numerical information, the image numerical information is calculated using an RGB-RAW signal after demosaic processing for performing the interpolation processing . A RAW signal acquisition unit that acquires a RAW signal output from a simultaneous image pickup device having a color filter by imaging an imaging target using an endoscope;
A color numerical value information calculating unit that calculates at least one of hue and saturation of the imaging target as color numerical value information using the RAW signal;
A demosaic processing unit that performs demosaic processing on the RAW signal to generate an RGB-RAW signal;
Endoscopic image signal processing for functioning as an image numerical information calculation unit that calculates at least one of sharpness information and noise information of the image to be imaged as image numerical information based on the RGB-RAW signal A program,
When the demosaic processing unit calculates the image numerical information, the demosaic processing is performed to perform interpolation processing using RAW signals output from a plurality of elements constituting the simultaneous imaging device, and the color numerical values When calculating information, the demosaicing process is performed by replacing with a raw signal of an element having a color filter adjacent to the same color component among a plurality of elements constituting the simultaneous imaging element,
The color value information calculation unit calculates the color value information using an RGB-RAW signal after demosaic processing in the case of calculating the color value information,
An endoscope image signal processing program, wherein the image numerical information calculation unit calculates the image numerical information using an RGB-RAW signal after demosaic processing for performing the interpolation processing. By capturing an image of an imaging target using an endoscope, a RAW signal output from a simultaneous image sensor having a color filter is obtained,
By replacing with a RAW signal of an adjacent element having a color filter of the same color component among a plurality of elements constituting the simultaneous imaging element, at least one of hue and saturation of the imaging target is calculated as color numerical information And
A demosaicing process that performs an interpolation process using RAW signals output from a plurality of elements that constitute the simultaneous imaging element is generated to generate a first RGB-RAW signal, and a plurality that constitutes the simultaneous imaging element To generate a second RGB-RAW signal by demosaicing by replacing with a RAW signal of an element having a color filter of the same color component adjacent among the elements of
Based on the first RGB-RAW signal, an endoscope image for display is generated,
Displaying the endoscope image for display on the display unit;
An operation method of an endoscopic image signal processing device for specifying a region of interest on an endoscopic image displayed on the display unit,
When calculating the color numerical information, the color numerical information is calculated using the RAW signal or the second RGB-RAW signal in the region of interest specified on the endoscopic image. An operation method of an endoscope image signal processing apparatus characterized by: A RAW signal acquisition unit that acquires a RAW signal output from a simultaneous image pickup device having a color filter by imaging an imaging target using an endoscope;
By replacing with a RAW signal of an adjacent element having a color filter of the same color component among a plurality of elements constituting the simultaneous imaging element, at least one of hue and saturation of the imaging target is calculated as color numerical information A color numerical value information calculating unit,
A demosaicing process that performs an interpolation process using RAW signals output from a plurality of elements that constitute the simultaneous imaging element is generated to generate a first RGB-RAW signal, and a plurality that constitutes the simultaneous imaging element A demosaic processing unit that generates a second RGB-RAW signal by performing demosaic processing by replacing with a RAW signal of an element having a color filter of the same color component adjacent among the elements,
An endoscope image generation unit that generates an endoscope image for display based on the first RGB-RAW signal;
A display control unit for displaying the endoscope image for display on a display unit;
An endoscope image signal processing program for functioning as a region of interest specifying unit that specifies a region of interest on an endoscopic image displayed on the display unit,
The color value information calculation unit calculates the color value information using the RAW signal or the second RGB-RAW signal in the region of interest specified on the endoscopic image. Endoscopic image signal processing program.