JP2006223481A - Image processing apparatus for endoscope, and endoscopic apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus for an endoscope and an endoscopic apparatus capable of displaying changing a display formation of an index image of processed images and an index image of endoscopic images so as to improve its observability. <P>SOLUTION: The image processing apparatus for an endoscope comprises an original image generating means 4 to process an image signal output from an electronic endoscope 2 and generate a first endoscopic image, a processed image generating means 5 to process the first endoscopic image and generate a second endoscopic image, an image recording means 8A to record at least one of the first endoscopic image and the second endoscopic image based on a release signal generated by a release designating operation, and an index image generating means 51a to generate the index image from the recorded images by the image recording means 8A. The display formation of the first index image and that of the second index image in the index image generating means 51a are different. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention is an endoscope apparatus that outputs an endoscopic image obtained by imaging a subject and a processed image obtained by performing image processing on the endoscopic image, and in particular, an endoscopic image, and / or The present invention relates to an endoscopic image processing apparatus and an endoscopic apparatus that can generate an index image of a processed image and display it on a monitor together with the endoscopic image or the processed image.

Conventionally, an elongated insertion part is inserted into a body cavity, and a solid-state imaging device or the like provided at the distal end of the insertion part is used as an imaging means to observe an organ in the body cavity on a monitor screen for examination or diagnosis. Endoscope devices that can be used are widely used. In recent years, in this endoscope apparatus, an image processing such as color enhancement is performed on a captured endoscopic image or the like using an image processing apparatus provided inside or outside the endoscope apparatus. In order to easily distinguish between a normal site and a lesioned part, a processed image is generated to improve visibility at the time of diagnosis. Also, since it is required to observe the subject from various viewpoints and make a comprehensive judgment at the time of diagnosis, the endoscope image and the processed image are recorded and reduced, and an index image is generated and displayed on the monitor screen. Thus, an endoscope apparatus capable of observing a plurality of images at once has been proposed (see, for example, Patent Document 1). In this proposal, for example, about four index images are displayed at predetermined positions on the monitor together with the endoscopic image or the processed image.
JP 2003-265407 A

  However, in the invention described in Patent Document 1 described above, a reduction rate defined according to the display size of the endoscopic image is used regardless of the location of interest in the endoscopic image, that is, the size of the region of interest. Using this, the entire image is reduced and an index image is generated. Therefore, if the region of interest is small, the index image of the processed image that has been reduced by image processing will occupy most of the region other than the region of interest that is irrelevant to the observation, and the region of interest to be observed will be displayed smaller. As a result, there was a problem that the observability deteriorated.

  Therefore, in the present invention, an endoscope image that can improve the observability by changing the display form of the index image generated from the processed image and the index image generated from the endoscope image. An object is to provide a processing apparatus and an endoscope apparatus.

  An endoscopic image processing apparatus according to the present invention includes an original image generating unit that processes an image signal obtained by imaging an inside of a body cavity of a subject by an endoscope and generates a first endoscopic image; Processing image generating means for processing the endoscope image of the second to generate a second endoscope image, and the first endoscope image and the second endoscope based on the release signal generated by the release instruction operation Image recording means for recording at least one of the mirror images, index image generating means for generating an index image from the image recorded by the image recording means, the first endoscopic image, and / or the second endoscopic image And an image output means for outputting a mirror image and / or an index image. In the index image generation means, a first index image generated from the first endoscope image and a second endoscope Second generated from the image Display mode of the index image is changed.

  Endoscopic image processing apparatus and endoscope capable of improving the observability by changing the display form of the index image generated from the processed image and the index image generated from the endoscopic image An apparatus can be realized.

  Embodiments of the present invention will be described below with reference to the drawings.

(First embodiment)
First, based on FIG. 1, the whole structure of the endoscope apparatus 1 concerning the 1st Embodiment of this invention is demonstrated. FIG. 1 is a schematic diagram illustrating an overall configuration of an endoscope apparatus 1 according to the present embodiment. As shown in FIG. 1, an endoscope apparatus 1 according to the present embodiment includes an electronic endoscope 2 provided with an imaging unit, a video processor 6 as an endoscope image processing apparatus, and the video processor 6. A monitor 7 for displaying an output image signal, a monitor image photographing device 8A as an image recording means for photographing a monitor image (endoscopic image) displayed on the monitor 7, and the video processor 6, It has an image filing device 8B that records image information and the like, and a keyboard 9 that sends an image processing ON / OFF instruction signal and inputs patient data. Further, the video processor 6 includes a light source unit 3 that supplies illumination light to the electronic endoscope 2, and a video signal processing block 4 as an original image generation unit that processes a video signal (image signal) to the imaging unit. In addition, an image processing block 5 is incorporated as a processed image generating means for performing image processing on the output signal from the video signal processing block 4.

  The electronic endoscope 2 has an elongated and movable insertion portion 11, for example, and a thick operation portion 12 is connected to the rear end of the insertion portion 11. A flexible universal cord 13 is extended from the rear end side of the operation portion 12, and the connector 14 at the end of the universal cord 13 can be detachably connected to the connector receiving portion 15 of the video processor 6. it can. The insertion portion 11 is provided with a rigid distal end portion 16 from the distal end side, a bendable bending portion 17 at the rear end adjacent to the distal end portion 16, and a long flexible portion 18 having flexibility. It has been. The user can bend the bending portion 17 in the left-right direction or the up-down direction by rotating the bending operation knob 19 provided in the operation unit 12. The operation unit 12 is provided with an insertion port 20 that communicates with a treatment instrument channel provided in the insertion unit 11. Further, a scope switch 10 such as a freeze switch for giving a freeze instruction, a release switch for giving a release instruction, an observation mode changeover switch or the like is provided on the top of the operation unit 12.

  Similarly to the monitor 7, the monitor image photographing device 8A includes a monitor (not shown) that displays an image and the like, and a photograph photographing device (specifically, a camera) that records the image displayed on the monitor by photographing. Composed.

  Next, the internal configuration of the endoscope apparatus 1 will be described with reference to FIG. FIG. 2 is a block diagram illustrating the internal configuration of the endoscope apparatus 1. As shown in FIG. 2, an illumination lens 21 and an objective optical system 22 are attached to the illumination window and the observation window at the distal end portion 16 of the electronic endoscope 2, respectively. A light guide 23 made of a fiber bundle is disposed on the rear end side of the illumination lens 21. The light guide 23 is inserted through the insertion portion 11, the operation portion 12, and the universal cord 13 and is connected to the connector 14. . By connecting the connector 14 to the video processor 6, illumination light emitted from the light source unit 3 in the video processor 6 is input to the incident end of the light guide 23.

  The light source unit 3 includes a lamp 24 that generates illumination light including visible light. The illumination light emitted from the lamp 24 is arranged in the optical path, and enters the band switching filter 80 through the diaphragm 25 driven by the diaphragm motor 25a. The light that has passed through the band switching filter 80 is incident on the rotary filter 27. The light that has passed through the rotary filter 27 is collected by a condenser lens (not shown) and is incident on the incident end of the light guide 23.

  The rotary filter 27 is moved together with the motor 26 that rotates the rotary filter 27 around the optical axis of the illumination light in a direction perpendicular to the optical path of the illumination light (direction indicated by the arrow P in FIG. 2) by the moving motor 31. The For example, a rack is attached to the motor 26, and the rotation motor 27 and the motor 26 are orthogonal to the optical path of the illumination light by the moving motor 31 provided with a pinion gear (indicated by the arrow P in FIG. 2). In the direction shown).

  Here, the structure and characteristics of the rotary filter 27 and the band switching filter 80 will be described with reference to FIG. FIG. 3 is a diagram for explaining the structure of the filter used in the electronic endoscope 2 and the characteristics of each filter. FIG. 3A is a diagram for explaining the structure of the rotary filter 27, and FIG. ) Is a diagram illustrating the transmission characteristics of the RGB filter 28, FIG. 3C is a diagram illustrating the transmission characteristics of the fluorescence observation filter 29, and FIG. 3D is a diagram illustrating the transmission characteristics of the excitation light cut filter 32. 3E is a diagram for explaining the structure of the band switching filter 80, and FIGS. 3F and 3G are diagrams for explaining the transmission characteristics of the filters arranged in the band switching filter 80. FIG.

  As shown in FIG. 3 (A), the rotation filter 27 has a normal observation RGB filter 28 arranged on a concentric inner peripheral side, and a fluorescence observation filter 29 arranged on a concentric outer peripheral side. One of the filters is selected according to the observation mode, and is inserted into the optical path of the illumination light. The normal observation RGB filter 28 arranged on the inner peripheral side includes an R filter 28a, a G filter 28b, and a B filter 28c. Each filter has a transmission characteristic as shown in FIG. Have. That is, the R filter 28a is set to transmit the red wavelength band of 600 nm to 700 nm, the G filter 28b is set to transmit the green wavelength band of 500 nm to 600 nm, and the B filter 28c is set to transmit the blue wavelength band of 400 nm to 500 nm. Yes. Further, since the RGB filter 28 is also used for infrared light observation, the R filter 28a and the G filter 28b transmit the wavelength band of 790 nm to 820 nm, and the B filter 28c transmits the wavelength band of 900 nm to 980 nm. Each is set. The fluorescence observation filter 29 for fluorescence observation arranged on the outer peripheral side includes a G2 filter 29a, an E filter 29b, and an R2 filter 29c. Each filter has a transmission characteristic as shown in FIG. have. That is, the G2 filter 29a is set to transmit a wavelength band of 540 nm to 560 nm, the E filter 29b is set to transmit a wavelength band of 400 nm to 470 nm, and the R2 filter 29c is set to transmit a wavelength band of 600 nm to 660 nm. The transmission characteristics of the G2 filter 29a and the R2 filter 29c are set to a low level, and green and red color signals (hereinafter referred to as G2 signal and R2 respectively) captured under these narrow-band illumination lights. By combining the fluorescent signal with the fluorescent signal, it is possible to perform color display for fluorescence observation.

  On the other hand, as shown in FIG. 3E, the band switching filter 80 includes a normal / fluorescence observation filter 80a, a narrowband light observation filter 80b, and an infrared light observation filter 80c arranged concentrically. One of the filters is selected according to the observation mode, and is inserted into the optical path of the illumination light. As shown in FIG. 3 (F), the normal / fluorescence observation filter 80a is set to transmit a wavelength band around 400 nm to 660 nm, and the infrared light observation filter 80c is around 780 nm to 950 nm. It is set to transmit the wavelength band. Further, the narrowband light observation filter 80b is formed of a trimodal filter. As shown in FIG. 3G, three discrete bands of 400 nm to 430 nm, 530 nm to 550 nm, and 600 nm to 630 nm are provided. It is set so as to transmit a wide wavelength band.

  In the endoscope apparatus 1 of the present embodiment, the subject is observed in four types of observation modes of normal observation, narrow-band light observation, infrared light observation, and fluorescence observation by adjusting the wavelength band of irradiation light. It is possible. Each observation mode is set by the user operating the observation mode switch of the scope switch 10. When the observation mode switch is operated, an instruction signal is output from the scope switch 10 to the control circuit 40. The control circuit 40 controls the movement motor 31 to move the rotary filter 27 and the like, and switches the filter arranged in the optical path to the RGB filter 28 or the fluorescence observation filter 29. Specifically, when the normal observation mode, the narrow band light observation mode, and the infrared light observation mode are set, the RGB filter 28 disposed on the inner peripheral side of the rotation filter 27 is inserted into the optical path of the illumination light. When the fluorescence observation mode is set, the fluorescence observation filter 29 disposed on the outer peripheral side of the rotary filter 27 is inserted into the optical path of the illumination light. The control circuit 40 controls the motor 81 that drives the band switching filter 80 simultaneously with the moving motor 31 to switch the filter arranged on the optical path. Specifically, when the normal observation mode and the fluorescence observation mode are set, the normal / fluorescence observation filter 80a is inserted in the optical path of the illumination light, and when the narrow band light observation mode is set, the narrow band light observation is performed. When the filter for light 80b is inserted on the optical path of the illumination light and the infrared light observation mode is set, the filter for infrared light observation 80c is inserted on the optical path of the illumination light.

  That is, in the normal observation mode, the illumination light emitted from the lamp 24 is the normal / fluorescence observation filter 80a having the characteristics shown in FIG. 3F, and the RGB filter 28 having the characteristics shown in FIG. , Only light in the red, green, and blue wavelength bands is filtered and sequentially emitted from the light source unit 3 to the light guide 23. In the narrow band light observation mode, the illumination light emitted from the lamp 24 includes the narrow band light observation filter 80b having the characteristics shown in FIG. 3G and the RGB having the characteristics shown in FIG. 3B. By passing through the filter 28, only light in the wavelength bands of 600 nm to 630 nm, 530 nm to 560 nm, and 400 nm to 430 nm is filtered and sequentially emitted from the light source unit 3 to the light guide 23. In the infrared light observation mode, the illumination light emitted from the lamp 24 is an infrared light observation filter 80c having the characteristics shown in FIG. 3F and RGB having the characteristics shown in FIG. By passing through the filter 28, only light in the wavelength bands of 790 nm to 820 nm, 790 nm to 820 nm, and 900 nm to 980 nm is filtered and sequentially emitted from the light source unit 3 to the light guide 23. Further, in the fluorescence observation mode, the illumination light emitted from the lamp 24 is used for the normal / fluorescence observation filter 80a having the characteristics shown in FIG. 3F and the fluorescence observation having the characteristics shown in FIG. By passing through the filter 29, only light in the wavelength bands of 540 nm to 560 nm, 390 nm to 450 nm, and 600 nm to 620 nm is filtered and sequentially emitted from the light source unit 3 to the light guide 23. Here, light in a wavelength band of 390 nm to 450 nm is excitation light for exciting autofluorescence from a living tissue.

  The illumination light incident on the light guide 23 is guided to the distal end portion 16 and passes through the illumination lens 21 attached to the illumination window on the distal end surface, and irradiates a subject such as a region to be inspected. In the normal observation mode, the subject is irradiated with R, G, B plane sequential illumination light, and in the fluorescence observation mode, the subject is irradiated with G2, E, R2 plane sequential illumination light.

  On the other hand, for example, a charge coupled device (hereinafter referred to as a CCD) 30 is disposed at the imaging position of the objective optical system 22 as a solid-state imaging device. An excitation light cut filter 32 is inserted between the distal end side of the CCD 30 and the objective optical system 22 to extract fluorescence by blocking excitation light of 390 nm to 450 nm from the reflected light from the subject. As shown in FIG. 3D, the excitation light cut filter 32 is set so as to transmit a wavelength band of 470 nm or more and is set so as not to overlap with the transmission characteristics of the E filter 29b. When narrowband light observation is selected as the observation mode, another electronic endoscope 2 in which the excitation light cut filter 32 is not disposed on the front surface of the CCD 30 is used for video because light having a wavelength of 400 nm to 430 nm is used. Used by connecting to the processor 6. The surface-sequential illumination light is irradiated, and scattered light, reflected light, and radiated light are generated from the subject. These lights pass through the excitation light cut filter 32, are imaged on the photoelectric conversion surface of the CCD 30 by the objective optical system 22, and are photoelectrically converted by the CCD 30. The CCD driver 33 is controlled by the CPU 56 or the control circuit 40 and has a function of an electronic shutter for variably controlling the charge accumulation time in the CCD 30, and a CCD drive signal is applied to the CCD 30 by the CCD driver 33. In synchronization with the rotation of the rotary filter 27, the signal charges photoelectrically converted and accumulated from the CCD 30 are output as image signals. That is, image signals corresponding to the irradiation light that has passed through the filters of the rotary filter 27 are sequentially output from the CCD 30 to the video processor 6 in time series. Note that the image signals (imaging signals) output in time series are R, B, and G color signals in the normal observation mode, and G2 signals and E that are imaged under the G2 illumination light in the fluorescence observation mode. Fluorescence signal imaged under the excitation light of R2 and a signal imaged under illumination light of the R2 signal. In the narrow-band light observation mode and the infrared light observation mode, the signals are in accordance with the order of the respective illumination lights.

  The time-series image signal photoelectrically converted from the CCD 30 is input into the video signal processing block 4 and input to an amplifier 34 for amplifying it into an electric signal (for example, 0 to 1 volt) within a predetermined range. The The output signal of the amplifier 34 is input to the A / D converter 35 and converted into a digital signal, and the gain is automatically controlled in an auto gain control circuit (hereinafter referred to as an AGC circuit) 36 so as to obtain an appropriate level. The The signal output from the AGC circuit 36 is input to a 1-input 3-output selector 37. The image signals sent in time series are separated into R, G, and B color signals, or G2 signals, fluorescent signals, and R2 signals by the selector 37, and are sequentially input to the white balance adjustment circuit 38.

  In the white balance adjustment circuit 38, in order to correct variations in color tone caused by white balance adjustment, that is, variations in equipment such as transmission characteristics of the optical system (including differences between models and individual differences), a white subject object serving as a reference When the image is picked up, gain adjustment is performed for each color signal so that the levels of the R, G, and B color signals are equal. The electronic endoscope 2 is provided with a scope ID memory 48, and data for white balance adjustment and observation modes that can be supported by the electronic endoscope 2 (normal observation, autofluorescence observation, narrow band light observation, Infrared observation), adaptation sites of the electronic endoscope 2 (upper digestive tract, lower digestive tract, bronchi), correction parameters related to equipment variations of the electronic endoscope 2, and the like are stored. It is also possible to automatically adjust the white balance by reading the white balance adjustment value from the scope ID memory 48 to the white balance adjustment circuit 38. Signals input in time series such as R, G, and B color signals that have undergone white balance adjustment are stored in R, G, and B memories 39r, 39g, and 39b that constitute the memory unit 39, respectively. That is, in the normal observation mode, the R, G, and B color signals are respectively stored in the R, G, and B memories 39r, 39g, and 39b that constitute the memory unit 39, and in the fluorescence observation mode, the G2 signal and the fluorescence signal are stored. , R2 signals are stored in R, G, B memories 39r, 39g, 39b, respectively.

  A / D conversion by the A / D converter 35, switching of the selector 37, white balance adjustment by the white balance adjustment circuit 38, and storage of signals in the R, G, B memories 39r, 39g, 39b of the memory unit 39 (Write) and read are controlled by the control circuit 40. The control circuit 40 sends a reference signal to a synchronization signal generation circuit (abbreviated as SSG in FIG. 2) 41, and the synchronization signal generation circuit 41 generates a synchronization signal synchronized therewith. The control circuit 40 controls the state in which writing to the R, G, and B memories 39r, 39g, and 39b is prohibited, so that a still image display state can be obtained (the internal circuit in the synchronization circuit 53, which will be described later). This is also possible with memory).

  The control circuit 40 also controls the illumination light quantity by driving the aperture motor 25a. That is, the output signal of the A / D converter 35 is output to the photometric circuit 42 in addition to the AGC circuit 36 and photometrically measured, and the photometric signal is output to the control circuit 40. In the control circuit 40, an average value obtained by integrating the photometric signals is compared with a reference value (in the case of appropriate brightness), a dimming signal is output so as to reduce the difference, and the aperture motor 25a is driven. To do. The aperture motor 25a drives the aperture 25 in accordance with the received dimming signal and adjusts the aperture amount (on the illumination optical path) of the aperture 25 so that an appropriate amount of illumination light is emitted. The diaphragm motor 25a is provided with a rotary encoder (not shown) as position detecting means for detecting the diaphragm position (corresponding to the opening amount) of the diaphragm 25, and a detection signal of the rotary encoder is output to the control circuit 40. The The control circuit 40 detects the position of the diaphragm 25 based on this detection signal. Further, the control circuit 40 and the CPU 56 are connected by a signal line capable of transmitting and receiving signals in both directions, and the CPU 56 can also confirm the position of the diaphragm 25 by a signal from the control circuit 40. ing.

  In the normal observation mode, the R, G, and B color signals respectively stored in the R, G, and B memories 39r, 39g, and 39b are output to the IHb processing block 44 that constitutes the image processing block 5. The IHb processing block 44 performs processing such as calculation of a value (hereinafter referred to as IHb) that correlates with the amount of hemoglobin as the amount of pigment that is the amount of blood information. In the present embodiment, the IHb processing block 44 includes an IHb processing circuit unit 45 and an invalid area detection unit 46. The IHb processing circuit unit 45 calculates the IHb amount (value) of each pixel and the average value of the IHb amount (value) in the set region of interest, and simulates the IHb value based on the IHb value of each pixel. A pseudo image generation process for displaying as a color image is performed. The invalid area detection unit 46 detects an invalid area that is not suitable for image processing for the set region of interest. The configuration of the IHb processing block 44 will be described in detail later.

  In the present embodiment, a color misregistration detection circuit 47 that detects color misregistration is provided in order to display an image with little color misregistration when displaying a freeze image. The R, G, and B memories 39r, 39g, and 39b output R, G, and B image data to the color shift detection circuit 47, and the color shift detection circuit 47 receives the received R, G, and B images. The amount of color misregistration is detected by calculating the correlation amount of the data. In addition, when an image freeze instruction is given, an image with the smallest color shift is detected within a set time, and a signal is output to the control circuit 40 so that the image of the field in which the image with the smallest color shift is detected is displayed. To do. The control circuit 40 controls writing to the R, G, and B memories 39r, 39g, and 39b of the memory unit 39 to a prohibited state, and displays the image displayed on the monitor 7 and the monitor of the monitor image photographing device 8A. The still image.

  The frame sequential signal output from the IHb processing block 44 is subjected to γ correction by the γ correction circuit 50 and further subjected to structure enhancement processing in the subsequent image processing circuit 51. Note that the process performed in the subsequent image processing circuit 51 may not be the structure enhancement process, and may be a color tone adjustment process or a color enhancement process, for example. An image signal that has undergone image processing such as structure enhancement processing in the subsequent image processing circuit 51 is output to the character superimposing circuit 52. When a release instruction is given, the image signal after image processing is also output to the index image generation unit 51a. The index image generation unit 51a is configured by a memory or the like, and generates an index image based on an image recorded by a release instruction. The image reduction ratio when writing a signal to the index generation unit 51 a and the index image mask size are the type of the electronic endoscope 2, the type of the CCD 30 in the electronic endoscope 2, and the post-stage image processing circuit 51. It is determined by the enlargement ratio of the image used in the processing, the type of the original image (whether it is the original image or the processed image), and the size of the region of interest. The image signal of the index image generated in the index image generation unit 51 a is superimposed on the image signal output from the subsequent image processing circuit 51 in the index image superimposing circuit 51 b and output to the character superimposing circuit 52. In the character superimposing circuit 52, the patient data and the average value of IHb calculated by the IHb processing circuit unit 45 are superimposed on the received image signal, and then the synchronization circuit 53 converts the frame sequential signal to the synchronized signal. Converted. The synchronization circuit 53 has three frame memories inside. The frame-sequential signal data is sequentially written in these three frame memories, and the signal data written in the three frame memories is read simultaneously, thereby outputting a synchronized signal. For example, in the normal observation mode, R, G, and B frame sequential color signals are written in each of the three frame memories and read simultaneously, thereby outputting synchronized RGB signals. The synchronized signals are respectively input to the three D / A converters of the D / A converter 54, converted into analog signals, and output to the monitor 7, the monitor image photographing device 8A, and the image filing device 8B. The monitor 7 can display a normal image (original image) illuminated and imaged with normal visible light.

  In the fluorescence observation mode, the G2 signal, the fluorescence signal, and the R2 signal read from the R, G, and B memories 39r, 39g, and 39b are converted into the image synthesis circuit 65 and the frame sequential circuit of the IHb processing circuit unit 45, respectively. 66 and the like, and is transmitted to the processing circuit on the rear stage side. For example, an image is displayed on the monitor 7 by a green color signal by the G2 signal, a fluorescent signal colored by the blue color signal, and a red color signal by the R2 signal. Color display for fluorescence. In the narrow-band light observation mode and the infrared light observation mode, an image is displayed in color on the monitor 7 with each color signal.

  The control circuit 40 controls writing to and reading from the frame memory inside the synchronization circuit 53 and D / A conversion in the D / A conversion unit 54. The operations of the γ correction circuit 50, the subsequent image processing circuit 51, and the character superimposing circuit 52 are controlled by the CPU 56. Further, the control circuit 40 and the CPU 56 control each part of the endoscope apparatus 1 in response to various operation instructions from the user described below.

  The user can operate the scope switch 10 to give a freeze instruction or a release instruction. When the freeze switch of the scope switch 10 is operated, a freeze instruction signal is output to the control circuit 40 via the CPU 56, and the control circuit 40 displays a freeze image (still image) on the monitor 7. The R, G and B memories 39r, 39g and 39b are controlled. The freeze instruction can also be given from the keyboard 9 or the front panel 55 of the video processor 6. When the release switch of the scope switch 10 is operated, a release signal is output to the CPU 56. If the freeze image is not displayed, the CPU 56 controls the R, G, and B memories 39r, 39g, and 39b of the memory unit 39 via the control circuit 40 so that the freeze image is displayed. . Further, the CPU 56 outputs a release control signal to the monitor image device 8A, and the monitor image device 8A performs photography according to the release control signal.

  The user can also operate the keyboard 9 or the front panel 55 of the video processor 6 to instruct execution of image processing (image processing ON) or stop of image processing (image processing OFF). When an instruction to execute image processing or stop image processing is given, an instruction signal is output to the CPU 56, and the CPU 56 outputs an IHb calculation circuit 61, an IHb average value calculation circuit 62, a luminance detection circuit 67, an invalid area in the IHb processing block 44. The detection circuit 68 and the like are controlled to execute or stop the image processing according to the instruction signal. Further, the user can instruct to display an IHb image as a processed image by operating a keyboard 9 or a switch (not shown) provided on the front panel 55 of the video processor 6. When an instruction to display an IHb image is given, an instruction signal is output to the CPU 56, and the CPU 56 controls the IHb processing block 44 and the like to display the IHb image on the monitor 7.

  In the endoscope apparatus 1 of the present embodiment, not only the electronic endoscope 2 described above but also different types of electronic endoscopes 2 can be connected to the video processor 6 for use. Endoscopic identification information 43 is stored in the electronic endoscope 2 so that the video processor 6 can perform signal processing for different types of electronic endoscopes 2. Endoscope-specific identification information (hereinafter referred to as endoscope identification information) 43 includes, for example, optical type information such as angle of view and optical zoom, application information (for example, for upper digestive tract or lower digestive tract, etc.) Information on the usage of the endoscope 2), information on the number of pixels of the CCD 30 installed therein, and the like. In the present embodiment, the endoscope identification information 43 is provided in the connector 14, connector receiver 15, and video signal processing block 4 when the endoscope apparatus 2 and the video processor 6 are connected. The video processor 6 performs signal processing based on the information detected and detected by the detection circuit 57 or the like. As a method of detecting the endoscope identification information 43, a method of detecting the endoscope identification information 43 by storing the endoscope identification information 43 in a storage means such as a ROM and reading it, or using a resistance element or the like, the electronic endoscope 2 is used. For example, there is a method in which a different resistance value is provided for each type, and the endoscope identification information 43 is detected based on the resistance value.

  In the present embodiment, among the endoscope identification information 43, type information such as the number of pixels of the CCD 30 provided in the electronic endoscope 2 may be directly detected from a signal path related to the CCD 30. it can. For example, the detection circuit 57 detects the number of pins of the connector 14 via the connector receiving portion 15 on the signal path that guides the signal output from the CCD 30 to the amplifying unit, and the electronic circuit connected to the video processor 6. The type such as the number of pixels of the CCD 30 built in the endoscope 2 can be detected. Rather than detecting the number of pixels of the CCD 30 or the like from the number of pins of the connector 14, a CCD drive signal is applied and the number of pixels (the number of horizontal pixels or the number of vertical pixels) is detected from the number of waveforms of the output signal. You may use the method of doing.

  In addition, when the endoscope apparatus 2 and the video processor 6 are connected, an observation mode stored in the scope ID memory 48 of the electronic endoscope 2 and compatible with the electronic endoscope 2 can be used. Data such as the adjustment site and the correction parameters related to the equipment variation of the electronic endoscope 2 are transmitted to the CPU 56. The scope ID memory 48 uses storage means such as an EEPROM or a flash memory.

  Next, the configuration of the IHb processing block 44 will be described. The IHb processing circuit unit 45 of the IHb processing block 44 includes an IHb calculation circuit 61, an IHb average value calculation circuit 62, a region of interest setting circuit 63, a pseudo image generation circuit 64, an image composition circuit 65, and a frame sequential circuit 66. It consists of. The invalid area detection unit 46 of the IHb processing block 44 includes a luminance detection circuit 67, an invalid area detection circuit 68, and an invalid area display circuit 69.

  First, the IHb processing circuit unit 45 will be described. The region-of-interest setting circuit 63 receives the type type of the CCD 30 detected by the detection circuit 57, and displays the pseudo image display region, that is, the region of interest according to the type of the CCD 30 so that the pseudo image is displayed in an appropriate size. Set the area. Information on the region of interest set by the region of interest setting circuit 63 is output to the IHb calculation circuit 61, the IHb average value calculation circuit 62, and the image composition circuit 65.

  As shown in FIG. 2, the IHb calculation circuit 61 receives the R signal output from the R memory 39r and the G signal output from the G memory 39g in addition to the information on the region of interest. IHb is calculated for the pixels existing in the area excluding the invalid area. The invalid area is set by an invalid area detection circuit 68 described later, and is output to the IHb calculation circuit 61 and the IHb average value calculation circuit 62. In the IHb processing circuit 61, the following equation (1) is specifically calculated to calculate the value of IHb in each pixel.

IHb = 32 × log ₂ (R / G) (1)
R: R image data excluding the invalid region in the region of interest G: G image data excluding the invalid region in the region of interest This equation (1) can be easily realized by a circuit. This can be realized by calculating the image data and the G image data using a divider (not shown) and converting the output result using a logarithmic log conversion table (not shown) constituted by a ROM or the like. Further, the calculation of the above equation (1) may be performed using the CPU 56 or the like.

  The value of IHb calculated by the IHb calculation circuit 61 is output to the IHb average value calculation circuit 62. The IHb average value calculation circuit 62 averages the received IHb value in the region obtained by removing the invalid region from the region of interest set by the region of interest setting circuit 63, and calculates the IHb average value. The value of IHb calculated by the IHb calculation circuit 61 is also output to the pseudo image generation circuit 64. The pseudo image generation circuit 64 generates a pseudo color image from the value of IHb and outputs it to the image synthesis circuit 65 that performs image synthesis. The pseudo image generation circuit 64 also receives a signal corresponding to the invalid area from the invalid area display circuit 69, and generates image data so that the invalid area is displayed in, for example, an achromatic color (gray).

  The image composition circuit 65 receives the pseudo image data generated by the pseudo image generation circuit 64 and the R, G, B image data output from the R, G, B memories 39r, 39g, 39b, and the region of interest. Both image data are synthesized based on the information of the region of interest (specifically, a mask signal) output from the setting circuit 63, and output to the frame sequential circuit 66 that converts the combined image data into a frame sequential signal. Specifically, when the mask signal is “0”, R, G, B image data corresponding to the original image is output, and when the mask signal is “1”, pseudo image data and an image indicating an invalid area are displayed. The image data is combined so that the data is output, and the combined image data is output to the frame sequential circuit 66. Note that the image data indicating the invalid area is displayed in an achromatic color. The frame sequential circuit 66 performs a process of outputting the R, G, and B components of the combined image data in a frame sequential manner. That is, the R, G, and B component image data are output to the γ correction circuit 50 in the frame sequential order.

  In the present embodiment, the information on the region of interest (specifically, the mask signal) set by the region of interest setting circuit 63 is also output to the γ correction circuit 50 and the subsequent image processing circuit 51. Therefore, when specified by the user, it is possible to perform γ correction and structure enhancement on the original image portion around the region of interest. The IHb average value calculated by the IHb average value calculation circuit 62 is output to the character superimposing circuit 52 so that the IHb average value can be displayed on the monitor 7 screen. The user can select display / non-display of the IHb average value via the CPU 56.

  Next, the invalid area detection unit 46 will be described. The luminance detection circuit 67 receives the R, G, B image data output from the R, G, B memories 39r, 39g, 39b, and sets the luminance level for the R, G, B image data in the region of interest. The detection result is output to the invalid area detection circuit 68. The invalid region detection circuit 68 detects (determines) whether or not the region is an invalid region by comparing a preset threshold value with the luminance level received from the luminance detection circuit 67. Two threshold values are set in the invalid area detection circuit 68, one is a threshold value for detecting halation, and the other is a threshold value for detecting dark parts. The threshold for halation detection is set to 200/255, and the threshold for dark portion detection is set to 20/255. Here, the value 255, which is the denominator of both thresholds, indicates the saturation level when quantized with 8 bits. Both the area where the luminance level is equal to or lower than the dark part detection threshold and the area where the luminance level is equal to or higher than the halation detection threshold are determined to be invalid areas.

  The invalid area detection circuit 68 outputs the invalid area detection result to the invalid area display circuit 69. The invalid area display circuit 69 outputs a 0 or 1 signal indicating an invalid area portion to the pseudo image generation circuit 64 so that the invalid area is displayed in, for example, an achromatic color (gray). The invalid area detection circuit 68 also outputs the invalid area detection result to the IHb calculation circuit 61 and the IHb average value calculation circuit 62. Based on the detection information of the invalid area, the IHb calculation circuit 61 does not calculate IHb for the pixels existing in the invalid area even if the pixel is included in the area of interest, and the IHb average value calculation circuit 62 Then, the IHb average value is calculated in a region obtained by removing the invalid region from the region of interest.

  The user can display an endoscopic image (original image) illuminated and imaged with normal visible light on the monitor 7 or display an IHb image (pseudo color image) on the monitor 7. The user operates an instruction switch (not shown) or a keyboard 9 provided on the front panel 55 of the video processor 6 to instruct ON / OFF of display of an IHb image (pseudo color image) and ON / OFF of color enhancement processing. To do. The instruction signal is input to the CPU 56, and the CPU 56 controls the IHb processing block 44 and the like in response to the instruction signal to execute the instructed ON / OFF process.

  An image as shown in FIG. 4 is displayed on the monitor 7 in accordance with a user instruction. 4A and 4B are diagrams for explaining an observation image displayed on the monitor 7. FIG. 4A is a display example of an endoscopic image, FIG. 4B is a display example of a pseudo color image, and FIG. ) Is an image display example when the size of the invalid area is not suitable for image processing. First, in a normal operation state, as shown in FIG. 4A, an endoscopic image is displayed as a moving image in an octagonal endoscopic image display area 7a on the monitor 7. In addition, on the left side of the endoscope image display area 7a, an IHb average value display preparation display 7b is displayed. Specifically, IHb = --- is displayed, and preparations are made to display the IHb average value. It should be noted that the display 7b of the IHb average value display preparation can be hidden.

  Next, when the user instructs to turn on the display of the IHb image (pseudo color image) by operating an instruction switch (not shown) or the keyboard 9 provided on the front panel 55 of the video processor 6, the flowchart of FIG. The determination of whether or not the image processing within the region of interest is possible is performed. FIG. 5 is a flowchart relating to a determination process of whether or not image processing is possible within a region of interest. First, in step S1, the user operates an instruction switch (not shown) and a keyboard 9 provided on the front panel 55 of the video processor 6 to set the position and size of the region of interest. The size of the region of interest can be selected from three sizes: large, medium, and small. Next, in step S2, it is determined whether or not the size of the region of interest set in step S1 is large. If a large size is set, the process proceeds to step S4a, and if any other size is set, the process proceeds to step S3. In step S3, it is determined whether or not the size of the region of interest set in step S1 is medium. If the medium size is set, the process proceeds to step S4b. Otherwise, the process proceeds to step S4c.

  In step S4a, step S4b, and step S4c, a threshold for determining whether or not image processing of the region of interest is possible is set. If the size of the region of interest is set large, the threshold value is set to 40% of the number of pixels belonging to the region of interest in step S4a, and the process proceeds to step S5. If the size of the region of interest is set to medium, the threshold value is set to 30% of the number of pixels belonging to the region of interest in step S4b, and the process proceeds to step S5. If the size of the region of interest is set to be small, the threshold value is set to 20% of the number of pixels belonging to the region of interest in step S4c, and the process proceeds to step S5.

  In step S5, the luminance is calculated for each pixel included in the region of interest set in step S1. The luminance calculation is performed in the luminance detection circuit 67. The luminance detection circuit 67 receives the R, G, B image data output from the R, G, B memories 39r, 39g, 39b, and sets the luminance level for the R, G, B image data in the region of interest. The detection result is output to the invalid area detection circuit 68. Subsequently, in step S6, the number of pixels in the halation and dark areas is calculated. The number of pixels in the halation and dark areas, that is, the number of pixels in the invalid area is calculated by the invalid area detection circuit 68.

  Next, in step S7, the number of pixels in the invalid area calculated in step S6 is compared with the threshold value set in steps S4a to S4c. If the number of pixels in the invalid area is equal to or smaller than the threshold value, it is determined that the image processing in the region of interest is possible, and the process proceeds to step S8 to continue the image processing in the region of interest in the IHb processing circuit unit 45. If the number of pixels in the invalid region is larger than the number of pixels obtained by multiplying the number of pixels included in the region of interest by the threshold value, it is determined that image processing in the region of interest is impossible, and the process proceeds to step S9. In step S9, the image processing in the region of interest is stopped, and in step S10, a notification message such as “brightness is not appropriate” is displayed on the monitor 7 or the like.

  When it is determined that the image processing is possible according to the above-described flowchart, the image processing in the region of interest is continuously performed, and the monitor 7 is obtained by performing the image processing as shown in FIG. A pseudo color image is displayed. That is, the pseudo color image 7e in the region of interest is displayed in the region of interest 7c of the endoscopic image display region 7a, and the invalid region portion is displayed in achromatic color as the invalid region image 7d. In the part other than the region of interest 7c in the endoscope image display region 7a, the original image is displayed as in FIG. Further, the display 7f of the IHb average value can be performed from the display 7b of the IHb average value display preparation in FIG. Furthermore, a color bar 7g indicating the pseudo color range of the pseudo color image 7e is displayed on the right side of the endoscope image display area 7a. FIG. 4B shows the case of the standard range. However, in FIG. 4B, it is simply indicated as Norm. If it is determined that image processing is impossible because the invalid area is large, the monitor 7 includes an invalid area portion in the endoscope image display area 7a as shown in FIG. 4C. The image 7d is displayed in an achromatic color, and the pseudo color image 7e is not displayed. In addition, a notification message 7h indicating that the invalid area is large and image processing could not be performed is also displayed.

  As shown in FIG. 4B, when the pseudo color image 7e is displayed only in the region of interest 7c set in the endoscope image display region 7a or the invalid region image 7d is displayed, the region of interest setting is performed. The circuit 63 generates a mask signal by the action as shown in FIG. 6, and even when the electronic endoscope 2 having the CCD 30 having a different number of pixels or the like is attached to the video processor 6, a processed image such as a pseudo color image is obtained. Can be displayed in an appropriate size. FIG. 6 is a flowchart regarding generation of a mask signal.

  For example, when a pseudo color image is displayed as a processed image, in step S11, the region-of-interest setting circuit 63 determines whether the type of the CCD 30 being used is type 1 based on the detection signal output from the detection circuit 57. To do. If it is determined that it is type 1, the region-of-interest setting circuit 63 generates a mask signal for type 1 and outputs it to the image composition circuit 65 in step S12. The mask signal for type 1 is a binary mask signal that becomes “1” at the timing of displaying a processed image such as a pseudo image, and becomes “0” in other periods. The image composition circuit 65 performs image composition such that a processed image such as a pseudo color image is partially inserted into the original image in accordance with the mask signal, and outputs it to the subsequent stage. Then, the pseudo color image 7e is partially displayed on the monitor 7, as shown in FIG.

  On the other hand, if the region-of-interest setting circuit 63 determines in step S11 that the type of CCD is not type 1, the process proceeds to step S13 to determine whether or not the type of CCD 30 being used is type 2. If it is determined that it is type 2, the region-of-interest setting circuit 63 generates a mask signal for type 2 and outputs it to the image composition circuit 65 in step S14. Also in this case, the pseudo color image 7e substantially the same as that shown in FIG. If the region-of-interest setting circuit 63 determines in step S13 that the type of CCD is not type 2, the process proceeds to step S15 to generate a mask signal corresponding to the other type and output it to the image composition circuit 65. In this manner, images picked up by a plurality of different types of CCDs 30 can be processed, and a pseudo color image can be partially displayed with a size appropriate for the number of pixels of the CCDs 30.

  Further, the display size of the pseudo color image, that is, the size of the region of interest can be selected from three types of large, medium, and small, but depending on the size selected in either type 1 or type 2 A mask signal can be generated. For example, when the type of the CCD 30 is type 1, a mask signal is generated according to the flowchart of FIG. FIG. 7 is a flowchart relating to generation of a mask signal for type 1, which is performed following step S12 in the flowchart of FIG.

  As shown in FIG. 7, when generation of a mask signal for type 1 is started, first, in step S21, it is determined whether or not the set size of the region of interest is large. If it is determined that the size is large, the process proceeds to step S23a. If it is determined that it is other than large, the process proceeds to step S22 to determine whether or not the set size of the region of interest is medium. If it is determined that the size is medium, the process proceeds to step S23b, and if not, the process proceeds to step S23c.

  In step S23a, step S23b, and step S23c, a mask signal corresponding to the size of each region of interest is generated. That is, when the size of the region of interest is set to a large size, in step S23a, for example, a binary mask signal that is “1” in the pixel region of a quarter size of the whole and “0” in other periods. Is output. When the size of the region of interest is set to medium, in step S23b, for example, a binary mask signal that is “1” in the pixel region having a size of 1/6 of the whole and “0” in other periods is output. To do. When the size of the region of interest is set to a small size, in step S23c, for example, a binary mask signal that is “1” in the pixel region having a size of 1/8 of the whole and “0” in other periods is output. To do. After generating the mask signal in steps S23a to S23c, the region-of-interest setting circuit 63 continues to set a threshold (invalid region threshold) for determining whether or not image processing of the region of interest is possible in steps S24a to S24c. To a value corresponding to the size of the region of interest. After setting the threshold value of the invalid area in steps S24a to S24c, in step S25a to step S25c, the reduction ratio when generating the index image is changed to a value corresponding to the set size of the region of interest.

  For example, assuming that full height is selected as the display size of the endoscopic image, when the size of the region of interest is set to a large size, the reduction ratio at the time of generating the index image is set to 3/8 in step S25a. When the index image is generated from the processed image, only the pseudo color image of the region of interest is reduced using the set reduction rate. When the size of the region of interest is set to a large size, the size of the region of interest is 2/3 of the endoscopic image in the length direction, so the size of the generated index image is in the length direction. And 1/4 (= 2/3 × 3/8) of the endoscopic image. If the size of the region of interest is set to medium, the reduction ratio at the time of index image generation is set to ½ in step S25b. When the size of the region of interest is set to medium, the size of the region of interest is ½ of the endoscopic image in the length direction, so the size of the generated index image is in the length direction. And 1/4 (= 1/2 × 1/2) of the endoscopic image. If the size of the region of interest is set to a small size, the reduction ratio at the time of index image generation is set to 3/4 in step S25c. When the size of the region of interest is set to be small, the size of the region of interest is 1/3 of the endoscopic image in the length direction, so the size of the generated index image is in the length direction. And 1/4 of the endoscopic image (= 1/3 × 3/4). Note that the reduction rate of the index image generated from the original image is 1/4, which is the same size as the index image of the processed image. That is, the reduction ratio at the time of generating the index image is set so that the generated index image has the same size regardless of the size of the region of interest.

  The type 2 mask signal is also generated in the same manner as the type 1 mask signal described above. In this way, the pseudo color image can be partially displayed according to the set size of the region of interest.

  To give a specific example, if the size of the region of interest set by the user is large and the position is in the center, for example, if the CCD 30 is type 1 and the number of pixels is 400 × 400, A binary mask signal is generated that is “1” in a 200 × 200 pixel region (that is, ¼ of the entire size) and “0” in other periods. Also, assuming that the CCD 30 is of type 2 and the number of pixels is 800 × 600, the pixel area is 400 × 300 in the central portion (that is, 1/4 of the entire size), and “1” in other periods. A binary mask signal that is 0 ″ is generated. Therefore, in either case of type 1 or type 2, the pseudo color image is in a specified size (for example, 1/4 of the entire size if it is large) at a specified position such as the center of the original image. A mask signal is generated so that is displayed.

  The user can make various settings such as the size selection of the region of interest described above by displaying the menu screen shown in FIG. 8 on the monitor 7 and operating the front panel 55 and the keyboard 9. FIG. 8 is a diagram illustrating a menu screen for performing various settings. The menu screen is composed of two screens. From the first screen, as shown in FIG. 8A, the display size of the endoscopic image, the size of the region of interest, the range of IHb, and the average of IHb Four items can be set: display / non-display of values. From the second screen, as shown in FIG. 8B, the freeze level, the color misalignment detection target image, the character display items on the screen, the photometry method, The following four items can be set.

  The display size of the endoscopic image can be selected from, for example, three types of full height, semi-full height, and medium. The size of the region of interest can also be selected from three types: large, medium, and small. In addition, the IHb range can be selected from Normal and Wide. When Normal is selected, IHb values from 30 to 70 are displayed in 16 levels of pseudo color, and from 10 when Wide is selected. Up to 90 items are displayed in 16 levels of pseudo color.

  The freeze level determines the time for loading an image to be detected in the memory in order to detect color misregistration, and can be selected from seven levels 1-7. The value of level 1 is about 50 msec, and the value of level 7 is about 1 sec. The image to be detected is captured in the memory for a time corresponding to the selected level either before or after the freeze switch is pressed. The color misregistration detection target image can be selected from pre-freeze and color misregistration prevention freeze. When pre-freeze is selected, the image before the freeze switch is pressed is targeted, and when color misregistration prevention freeze is selected. The image after the freeze switch is pressed becomes the target. Character display items on the screen can be selected from full and light. When full is selected, all necessary items are displayed, and when light is selected, only some information is displayed. . The photometric method is a method of adjusting the light amount of the light source so that the brightness of the endoscopic image is in a desired state, and can be selected from average, auto, and peak. If average is selected, the amount of light is adjusted so that the entire image does not become bright.If auto is selected, the amount of light is adjusted so that even if a treatment instrument appears on the screen, the resulting halation will be ignored and it will not become dark. When the peak is selected, the amount of light is adjusted so that halation does not occur when the treatment tool or the like appears on the screen.

  The operation of the endoscope apparatus 1 configured as described above will be described with reference to FIG. Here, an operation when performing pseudo color display of the IHb distribution will be described. FIG. 9 is a flowchart relating to processing operations for displaying an original image and a pseudo color image. Here, the case where the electronic endoscope 2 of the type 1 of the CCD 30 is mounted on the video processor 6 will be described.

When the endoscope apparatus 1 is turned on to be in an operating state, the CPU 56 in the video processor 6 starts monitoring instruction input from the keyboard 9 or the like, and displays an IHb image (pseudo color image) in step S31. It is determined whether or not an instruction to turn on has been input. When it is determined that the instruction to turn on the display of the pseudo color image is not input, in step S32, for example, as shown in FIG. 4A, the original image is displayed in the endoscope image display area 7a of the monitor 7. Display as a video. If it is determined that an instruction to turn on the display of the pseudo color image is input, in step S33, the CPU 56 checks the range for displaying the pseudo color image. Here, it is determined whether the color assignment for displaying the pseudo color image, that is, whether the IHb range set from the menu screen by the user is Normal or Wide. In addition, an instruction to display a color bar corresponding to the determined range on the monitor 7 is given. Next, in step S <b> 34, the CPU 56 controls the region-of-interest setting circuit 63 so as to output information on the region of interest (specifically, a mask signal) to the image composition circuit 65.
Next, in step S35, it is determined whether or not the mask signal output from the region-of-interest setting circuit 63 is 1. The mask signal for type 1 is “1” for displaying the pseudo image and “0” for the other periods. Therefore, if the mask signal is determined to be 1, the process proceeds to step S36. A color image is generated and displayed on the monitor 7.

  The pseudo color image generation and display processing in step S36 will be described with reference to FIG. FIG. 10 is a flowchart relating to generation and display processing of a pseudo color image. When the generation of the pseudo color image is started, first, in step S101, the CPU 56 determines whether or not the processing target pixel is included in the region of interest. If it is determined that it is not included in the region of interest, the process proceeds to step S102, where the R, G, B memory 39r, 39g, 39b converts the R, G, B image data, ie, the original image data into an image composition circuit. Output to 65. The original image data is displayed on the monitor 7 through subsequent image processing.

  If it is determined in step S101 that the processing target pixel is included in the region of interest, the process proceeds to step S103, and the R, G, B memory 39r, 39g, 39b converts the R, G, B image data to luminance. The luminance is output to the detection circuit 67, the luminance is calculated in the luminance detection circuit 67, and the calculation result is output to the invalid area detection circuit 68. Next, in step S104, the invalid region detection circuit 68 determines whether or not the pixel is a pixel in the invalid region based on the luminance calculation result, and the determination result is used as the IHb calculation circuit 61 and the invalid region display circuit 69. And output to the CPU 56. If it is determined in step S104 that the pixel is a pixel in the invalid area, the process proceeds to step S105. In step S105, the invalid area display circuit 69 outputs a 0 or 1 signal indicating the invalid area portion to the pseudo image generation circuit 64 so that the invalid area is displayed in, for example, an achromatic color (gray). The process proceeds to step S107. If it is determined in step S104 that the pixel is not a pixel in the invalid area, the process proceeds to step S106.

  In step S106, the IHb calculation circuit 61 calculates the value of IHb based on the R and G image data received from the R and G memories 39r and 39g, and outputs the value to the pseudo image generation circuit 64. Next, in step S107, the pseudo image generation circuit 64 generates a pseudo color image from the received IHb value, and outputs the image data to the image synthesis circuit 65 that performs image synthesis. Here, when the pseudo image generation circuit 64 receives a signal corresponding to the invalid area from the invalid area display circuit 69, the pseudo image generation circuit 64 generates image data such that the pixel is displayed in, for example, an achromatic color (gray). . Subsequently, in step S108, the image composition circuit 65 outputs the pseudo image data output from the pseudo image generation circuit 64 in step S107 during the period when the mask signal output from the region of interest setting circuit 63 in step S34 is “1”. To the frame sequential circuit 66. The image output to the frame sequential circuit 66 is displayed on the monitor 7 after being subjected to subsequent image processing.

  If it is determined in step S35 that the mask signal output from the region-of-interest setting circuit 63 is not 1, the process proceeds to step S37, where the original image is displayed on the monitor 7. Specifically, the display of the original image is performed as follows. The R, G, and B memories 39r, 39g, and 39b output R, G, and B image data, that is, original image data, to the image composition circuit 65. The image composition circuit 65 outputs the R, G, B image data output from the R, G, B memories 39r, 39g, 39b during the period when the mask signal output from the region of interest setting circuit 63 is “0” in step S34. Is output to the frame sequential circuit 66 that converts the signal into a frame sequential signal. The image output to the frame sequential circuit 66 is displayed on the monitor 7 after being subjected to subsequent image processing.

  For example, as shown in FIG. 4B, the pseudo color image 7e in the region of interest is displayed on the monitor 7 in the region of interest 7c of the endoscope image display region 7a as shown in FIG. The portion is displayed in an achromatic color as the invalid area image 7d. In addition, by the processing in step S37, the original image is displayed in the part other than the region of interest 7c of the endoscope image display region 7a as in FIG. Further, on the right side of the endoscopic image display area 7a, a color bar 7g indicating the pseudo color range in the pseudo color image 7e is displayed according to the instruction in step S33.

  When steps S36 and S37 are completed, it is subsequently determined in step S38 whether or not the structure enhancement processing by the post-stage image processing circuit 51 is ON. If it is determined that the structure enhancement process is in the ON state, the process proceeds to step S39, the structure enhancement process is switched to the OFF state, and then the process returns to step S31. The CPU 56 in the video processor 6 starts from the keyboard 9 or the like. Continue to monitor the instruction input. If it is determined in step S38 that the structure enhancement process is in an OFF state, the structure enhancement process remains in an OFF state, and the process returns to step S31, where the CPU 56 in the video processor 6 inputs an instruction from the keyboard 9 or the like. Continue monitoring.

  As described above, pseudo color display of the IHb distribution can be performed by a series of processes in steps S31 to S39.

  Next, an operation for recording a processed image such as an original image and a pseudo color image will be described. First, an operation for recording an original image will be described with reference to FIG. FIGS. 11A to 11D are diagrams for explaining the transition of the display screen when a release instruction is given in the normal observation state. First, in a state where normal observation is performed, that is, in a state where an original image is displayed as a moving image, as shown in FIG. 11A, a freeze switch which is one of the scope switches 10 is operated to freeze. When an instruction is given, the original image is frozen and a still image is displayed as shown in FIG. Subsequently, when a release switch that is one of the scope switches 10 is operated to give a release instruction, as shown in FIG. 11C, the still image of the original image shown in FIG. It is recorded in the image photographing device 8A and the image filing device 8B. When the image recording is completed, the display returns to the display of the moving image of the original image as shown in FIG. As shown in FIG. 11 (A), when the release switch as one of the scope switches 10 is operated and a release instruction is given in a state where the original image is displayed as a moving image, the above-described freeze instruction is issued. As in the case where the image has been made, a still image is displayed as shown in FIG. 11B, and after the image is recorded as shown in FIG. 11C, a moving image is displayed as shown in FIG. 11D. Return to.

  The image recorded after the release is processed as an index image by the index image generation unit 51a, and is displayed on the monitor 7 with the image reduced, as shown in FIG. 12A and 12B are diagrams illustrating an index image display screen. FIG. 12A is an example of a display screen when the display size of an endoscopic image is full height, and FIG. 12B is an endoscopic image. FIG. 12C shows an example of a display screen when the display size of the endoscope image is medium. FIGS. 12A to 12C are endoscopic images captured using the same electronic endoscope 2 and CCD 30, and only the display size of the endoscopic image is different. The reduction ratio of the index image when displayed on the monitor 7 is changed depending on the display size of the endoscopic image. That is, as shown in FIG. 12A, when the display size of the endoscopic image is full height, the reduction rate of the index image is 1/4, and as shown in FIG. 12B, the endoscopic image When the display size is semi-full height, the index image reduction ratio is 1/3. As shown in FIG. 12C, when the endoscope image display size is medium, the index image reduction ratio is 1 / 2.

  Next, an operation for recording a processed image such as a pseudo color image will be described. First, in a state in which normal observation is performed, that is, in a state where the original image is displayed as a moving image, or in a state where the original image is frozen and a still image is displayed, the pseudo color image display is turned on from the keyboard 9 or the like. Is instructed, the image is frozen and a pseudo color image as shown in FIG. Subsequently, when a release switch which is one of the scope switches 10 is operated to give a release instruction, a pseudo color image is recorded in the monitor image photographing device 8A or the image filing device 8B. Subsequent to the recording of the pseudo color image, when the freeze and release instruction is given for the original image, the original image corresponding to the recorded pseudo color image is recorded in the monitor image photographing device 8A and the image filing device 8B.

  The display transition of the monitor 7 in response to the release instruction will be described with reference to FIGS. 13 and 14 along a series of observation flows. FIGS. 13A to 14C are diagrams illustrating an example of display transition of the monitor 7 being observed. In the present embodiment, when an index image is displayed on the monitor 7, the index image display form is changed and displayed between the original image and the processed image. The change of the display form in the present embodiment is characterized in that the index image reduction ratio and display range of the original image and the processed image are changed and displayed. First, as shown in FIG. 13A, when a release instruction is given in a state where normal observation is performed, that is, a moving image of the original image is displayed on the monitor 7, as shown in FIG. Then, an index image obtained by reducing the original image to 1/4 is displayed. Next, when an instruction to turn on the display of the pseudo color image is given, as shown in FIG. 13C, the region of interest 7c of the endoscope image display region 7a is left with the index image of the original image as it is. In addition, the pseudo color image 7e in the region of interest is displayed, and the invalid region portion is displayed in an achromatic color as the invalid region image 7d. When a release instruction is issued in this state, as shown in FIG. 14A, an index image obtained by reducing only the pseudo color image 7e in the region of interest by ½ is an index of the original image displayed first. The still image of the original image of the same subject as the processed image is displayed in the endoscope image display area 7a. That is, the reduction ratio of the index image of the original image is larger than the reduction ratio of the pseudo color image. When a release instruction is issued in this state, as shown in FIG. 14B, the index image obtained by reducing the original image shown in FIG. Displayed side by side on the index image. In addition, when the release instruction is performed in the state of FIG. 14A, that is, when the original image is recorded subsequent to the recording of the processed image, the original image may be recorded with the same range and the same reduction ratio as the processed image. it can. In this case, as shown in FIG. 14C, the index images obtained by reducing only the original image in the region of interest by half are displayed side by side on the two index images displayed previously.

  In the above observation example, the case where the size of the region of interest is medium is described. However, when the size of the region of interest is small, the region of interest is set to 3/4 as shown in FIG. The reduced image is displayed as the index image of the processed image. If the size of the region of interest is large, an image generated by reducing the region of interest to 3/8 is displayed as an index image of the processed image, as shown in FIG. 15A and 15B are diagrams illustrating an index image display screen. FIG. 15A illustrates an example of a display screen when the size of the region of interest is small, and FIG. 15B illustrates a large size of the region of interest. It is an example of the display screen in a case.

  As described above, in the endoscopic image processing apparatus and the endoscopic apparatus according to the present embodiment, in the pseudo color image (processed image), the index image is generated by reducing only the region of interest, thereby processing the processed image. Compared with an index image generated by reducing the entire image, only a portion necessary for observation can be displayed larger, and the observability is improved.

(Second Embodiment)
Next, a second embodiment of the present invention will be described. This embodiment uses an index according to the type of the monitor 7 connected to the video processor 6, such as a high-vision monitor with an aspect ratio of 16: 9, a conventional monitor with an aspect ratio of 4: 3, and a high-vision monitor with an aspect ratio of 4: 3. The display form of the image is changed. Since the configuration of the endoscope apparatus 1 in the present embodiment is the same as that of the first embodiment, the same components are denoted by the same reference numerals and description thereof is omitted. Here, only the internal configuration of the endoscope apparatus 1 and the display method of the index image, which are features, will be described.

  As shown in FIG. 16, the endoscope apparatus 1 according to the present embodiment has two systems of circuit blocks as image output means in addition to the endoscope apparatus 1 according to the first embodiment. FIG. 16 is a block diagram illustrating an internal configuration of the endoscope apparatus 1 according to the second embodiment. That is, the normal monitor 7 having an aspect ratio of 4: 3, which includes the index image superimposing circuit 51b, the character superimposing circuit 52, the synchronization circuit 53, and the D / A conversion unit 54 described in the first embodiment. In addition to the output circuit block, the index image superimposing circuit 51c, the character superimposing circuit 52a, the synchronizing circuit 53a, and the D / A converting unit 54a are connected to the high-definition monitor 7 having an aspect ratio of 16: 9. It also has an output circuit block, and the connection destination is changed according to the type of the monitor 7.

  When a normal monitor 7 having an aspect ratio of 4: 3 is used, the monitor 7 is connected to the video processor 6 so as to receive and display the output from the D / A converter 54. When full height is selected as the display size of the endoscopic image, as shown in FIG. 17A, the monitor 7 displays the original image on the same screen as the endoscopic image having substantially the same vertical and horizontal lengths. If there is, an index image with a reduction ratio of 1/4 is displayed. 17A and 17B are diagrams for explaining the display screen of the index image on the monitor 7 having different aspect ratios. FIG. 17A shows an example of the display screen on the normal monitor, and FIG. 17B shows the display screen on the high-vision monitor. It is an example.

  On the other hand, when a high-vision monitor with an aspect ratio of 16: 9 is used, the monitor 7 is connected to the video processor 6 so as to receive and display the output from the D / A converter 54a. When full height is selected as the display size of the endoscopic image, as shown in FIG. 17B, the monitor 7 has an endoscopic image similar to that in FIG. Is displayed. In the case of a high-definition monitor, the display screen is wider than the normal monitor, so that the display area other than the endoscopic image becomes larger. Therefore, since the display area of the index image becomes large, the index image can be displayed on the screen at a reduced reduction rate. That is, as shown in FIG. 17B, on the same screen as the endoscopic image, an index image with a reduction ratio of 1/3 is displayed for an original image, and an index image with a reduction ratio of 2/3 is displayed for a processed image. Can be displayed. In addition to reducing the reduction ratio, it is also possible to increase the number of index images to be displayed. Furthermore, the value of the IHb average value obtained by the IHb average value calculation circuit 62 can be displayed for each index image.

  Thus, in the endoscope image processing device and the endoscope device of the present embodiment, the reduction rate of the index image or the number of displayed images can be increased according to the type of the monitor 7, An IHb average value can be displayed for each index image, and the observability is further improved.

  From the above embodiment, there is a feature in the points described in the following additional items.

(Additional Item 1) In an endoscope image processing apparatus for processing an image signal obtained by imaging an inside of a body cavity of a subject with an endoscope,
An image generating means for making a first endoscopic image capable of displaying the image signal obtained by the endoscope;
A region of interest setting means for setting a region of interest in the first endoscopic image;
Image processing means for performing a predetermined process based on the first endoscopic image in the region of interest to be a second endoscopic image that can be displayed;
Image recording means for recording at least one of the first or second endoscopic images based on a release signal by a release instruction operation;
Index image recording generating means for generating first and second index images from the first and second endoscopic images recorded by the image recording means, respectively.
An image processing apparatus for an endoscope, wherein a display form is changed between the first index image and the second index image.

  (Additional Item 2) The endoscope image processing apparatus according to Additional Item 1, wherein the second index image is an image in the region of interest.

  (Additional Item 3) The additional item 1 or the additional item 2, wherein the change of the display form is a change of a reduction ratio between the first index image and the second index image. Endoscope image processing apparatus.

  (Additional Item 4) The endoscope image processing device according to Additional Item 3, wherein the reduction ratio is changed according to a size of the region of interest.

(Additional Item 5) In an endoscope image processing apparatus for processing an image signal obtained by imaging an inside of a body cavity of a subject with an endoscope,
An image generating means for making a first endoscopic image capable of displaying the image signal obtained by the endoscope;
A region of interest setting means for setting a region of interest in the first endoscopic image;
Image processing means for performing a predetermined process based on the first endoscopic image in the region of interest to be a second endoscopic image that can be displayed;
Image recording means for recording at least one of the first or second endoscopic images based on a release signal by a release instruction operation;
Index image recording generating means for generating first and second index images from the first and second endoscopic images recorded by the image recording means, respectively.
An endoscope image processing apparatus, wherein an output method of the endoscopic image and the index image is changed according to a method of a display unit.

  (Additional Item 6) When the method of the display unit is an aspect ratio of 16: 9, the reduction ratio of the second index image is reduced with respect to the aspect ratio of 4: 3, and the calculation is performed by the image processing unit. The endoscope image processing apparatus according to appendix 5, wherein the feature amount is displayed in combination with the second index image.

1 is a schematic diagram illustrating an overall configuration of an endoscope apparatus 1 according to a first embodiment of the present invention. 1 is a block diagram illustrating an internal configuration of an endoscope apparatus 1. FIG. FIG. 3A is a diagram for explaining the structure of a filter used in the electronic endoscope 2 and the characteristics of each filter, FIG. 3A is a diagram for explaining the structure of a rotary filter 27, and FIG. 3B is an RGB filter. FIG. 3C illustrates the transmission characteristic of the fluorescence observation filter 29, FIG. 3D illustrates the transmission characteristic of the excitation light cut filter 32, and FIG. FIG. 3E is a diagram illustrating the structure of the band switching filter 80, and FIGS. 3F and 3G are diagrams illustrating the transmission characteristics of the filters arranged in the band switching filter 80. FIGS. 4A and 4B are diagrams for explaining an observation image displayed on the monitor 7, in which FIG. 4A is a display example of an endoscopic image, FIG. 4B is a display example of a pseudo color image, and FIG. 4C is invalid. It is an example of displaying an image when the size of the region is not suitable for image processing. It is a flowchart regarding the determination process of the image processing possibility in a region of interest. It is a flowchart regarding the production | generation of a mask signal. It is a flowchart regarding the production | generation of the mask signal for Type-1. It is a figure explaining the menu screen for performing various settings. It is a flowchart regarding the processing operation for displaying an original image and a pseudo color image. It is a flowchart regarding the production | generation and display process of a pseudo color image. FIGS. 11A to 11D are diagrams for explaining the transition of the display screen when a release instruction is given in the normal observation state. FIGS. 12A and 12B illustrate an index image display screen. FIG. 12A shows an example of a display screen when the display size of an endoscopic image is full height, and FIG. 12B shows the display size of the endoscopic image. An example of the display screen in the case of the semi-full height, FIG. 12C is an example of the display screen in the case where the display size of the endoscope image is medium. FIGS. 13A to 13C are diagrams illustrating an example of display transition of the monitor 7 being observed. 14A to 14C are diagrams illustrating an example of display transition of the monitor 7 being observed. 15A and 15B are diagrams illustrating the display screen of the index image. FIG. 15A is an example of the display screen when the size of the region of interest is small, and FIG. It is an example of the display screen in a case. It is a block diagram explaining the internal structure of the endoscope apparatus 1 in the 2nd Embodiment of this invention. 17A and 17B are diagrams for explaining the display screen of the index image on the monitor 7 having different aspect ratios. FIG. 17A is an example of the display screen on the normal monitor, and FIG. It is an example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Endoscope apparatus, 2 Electronic endoscope, 3 Light source part, 4 Video signal processing block, 5 Image processing block, 6 Video processor, 7 Monitor, 8A Monitor image imaging device, 8B Image filing apparatus, 9 Keyboard, 10 Scope Switch, 11 Insertion section, 14 Connector, 24 Lamp, 27 Rotation filter, 28 RGB filter, 29 Filter for fluorescence observation, 30 CCD, 34 Amplifier, 35 A / D converter, 36 AGC circuit, 37 Selector, 38 White balance adjustment circuit 39 memory unit, 39r R memory, 39g G memory, 39b B memory 40 control circuit, 44 IHb processing block, 45 IHb processing circuit unit, 46 invalid area detection unit, 47 color misregistration detection circuit, 48 scope ID memory , 50 γ correction circuit, 51 Processing circuit, 51a index image generating unit, 51b, 51c index image superimposing circuit 52, 52a character superimposing circuit, 53, 53a synchronizing circuit, 54, 54a D / A converting unit, 56 CPU, 57 detecting circuit, 61 IHb calculating circuit 62 IHb average value calculation circuit, 63 region of interest setting circuit, 64 pseudo image generation circuit, 65 image composition circuit, 66 frame sequential circuit, 67 luminance detection circuit, 68 invalid region detection circuit, 69 invalid region display circuit, 80 band switching Filter, 80a filter for normal / fluorescence observation, 80b filter for narrow-band light observation, 80c filter agent for infrared light observation, patent attorney Susumu Ito

Claims (7)

In an endoscope image processing apparatus for processing an image signal obtained by imaging an inside of a body cavity of a subject with an endoscope,
Original image generating means for processing the image signal to generate a first endoscopic image;
Processed image generation means for processing the first endoscopic image to generate a second endoscopic image;
Image recording means for recording at least one of the first endoscopic image and the second endoscopic image based on a release signal generated by a release instruction operation;
Index image generating means for generating an index image from the image recorded by the image recording means;
Image output means for outputting the first endoscopic image, and / or the second endoscopic image, and / or the index image,
The display mode of the first index image generated from the first endoscopic image and the second index image generated from the second endoscopic image are changed in the index image generating means. An image processing apparatus for an endoscope.   2. The display mode change according to claim 1, wherein the display mode is changed by making a first reduction rate of the first index image different from a second reduction rate of the second index image. Endoscope image processing apparatus.   The endoscope image processing apparatus according to claim 2, wherein the first reduction ratio is larger than the second reduction ratio.   The processed image generation means processes a region of interest setting means for setting a region of interest in the first endoscopic image, and an image in the region of interest in the first endoscopic image, thereby processing the second The endoscopic image processing apparatus according to any one of claims 1 to 3, further comprising an image processing unit that generates an endoscopic image.   The endoscope image processing apparatus according to claim 4, wherein the second reduction ratio of the second index image is changed according to a size of the region of interest.   The endoscope image processing apparatus includes a plurality of the image output means, and the display form of the first index image and the second index image output from the image output means is the image output. The endoscope image processing device according to claim 1, wherein the endoscope image processing device is different for each unit. An endoscope that has a light source unit that illuminates illumination light and outputs an image signal obtained by imaging light generated from a subject by irradiating the illumination light;
Processing means for performing image processing on the image signal output from the endoscope;
Display means for displaying the image output from the processing means,
The processing means is
Original image generating means for processing the image signal to generate a first endoscopic image;
Processed image generation means for processing the first endoscopic image to generate a second endoscopic image;
Image recording means for recording at least one of the first endoscopic image or the second endoscopic image based on a release signal generated by a release instruction operation;
Index image generating means for generating an index image from the image recorded by the image recording means;
Image output means for outputting the first endoscopic image and / or the second endoscopic image and / or the index image;
An endoscope apparatus, wherein a display form of the first index image displayed on the display means is different from a display form of the second index image displayed on the display means.

Images