JP2005169143A - Electronic endoscope apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To electrically make an enlarged display of a part of an object image without lowering resolution. <P>SOLUTION: This electronic endoscope device is provided with an image converting circuit 17 in a scope 10 and constituted to convert the resolution of the object image formed in a CCD 12, by the image converting circuit 17 when the CCD 12 in the scope 10 has at least the effective number of pixels of a color television system and to display the object image on a monitor 50 with the number of pixels corresponding to the monitor 50. In the case of making the enlarged display of a part of the object image displayed on the monitor 50, the part of the object image formed in the CCD 12 is formed with the number of pixels corresponding to the monitor 50 by the image converting circuit 17 and displayed on the monitor 50. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an electronic endoscope apparatus that includes a video scope and a processor and can display an image in a human organ on a TV monitor. In particular, the present invention relates to a magnifying electronic endoscope apparatus capable of magnifying and displaying a specific portion of an observation image.

  Conventionally, when an observation image formed on an image sensor is displayed on a monitor and it is desired to observe a specific part of the observation image while observing the specific part, the enlarged electronic internal view can enlarge and display the image of the specific part Mirror devices are known. As the magnifying electronic endoscope apparatus, an optical magnifying electronic endoscope apparatus in which a scope having a zoom mechanism is used is generally known, and the distance between the objective lens and the variable power lens in the scope is changed. As a result, a specific portion is enlarged and displayed on the monitor. In such an optical enlarged display, it is possible to observe a specific portion of interest while maintaining a high resolution.

  However, when optically enlarged display is performed, the viewing angle becomes narrower and the depth of focus becomes shallower. Therefore, it is difficult to keep the specific part of interest in the field of view against the movement of the organ itself such as the hand shake or stomach by the operator. On the other hand, instead of optical enlargement display, an electronic endoscope apparatus having an electric enlargement display function for enlarging and displaying a specific portion by image signal processing is also used. In the case of electrical enlargement display, since the depth of focus does not change, a specific portion can be stably captured in the field of view. However, since the specific portion with a small number of pixels is enlarged and displayed by interpolation processing or the like, the resolution of the enlarged image is lowered. Therefore, it is difficult to accurately determine the state of the affected area.

  On the other hand, recently, so-called megapixel imaging devices with more than 1 million pixels have been used in various fields such as digital cameras, and high-quality images can be obtained. However, when displaying a moving image on a monitor, the number of pixels of an image sensor that can be used as a video follows the color television system of the monitor, and only about 410,000 pixels can be used as a video in the NTSC system.

  Therefore, the present invention provides an electronic endoscope apparatus and system capable of electrically enlarging and displaying a specific portion of an observation image without reducing resolution by effectively using pixels of an image sensor. For the purpose.

  The scope of the electronic endoscope apparatus of the present invention has an image sensor, is detachably attached to a processor to which a display device for displaying a subject image is connected, and is formed on the image sensor. Display subject image forming means for forming a display subject image for display on a display device based on an all-pixel subject image constituted by pixels. The display subject image forming means is a subject image in which the resolution of the all-pixel subject image is converted as the display subject image, and is configured with a smaller number of pixels than all the pixels of the image sensor to form a normal display subject image When enlarging and displaying a part of the normal display subject image displayed on the display device based on the image forming unit and the normal display subject image formation unit, the display subject image is a part of the all-pixel subject image, And an enlarged display subject image forming unit that forms an enlarged display subject image including pixels located in a partial region that is a part of the image region of the pixel subject image. The normal display subject image forming unit and the enlarged display subject image forming unit form a normal display subject image and an enlarged display subject image, respectively, by the number of effective pixels or less. When the electrical enlargement display process is executed, a part of the subject image in the normal display is enlarged and displayed without performing the interpolation process. Therefore, even if the normal display is switched to the enlarged display, the subject image is enlarged and displayed without a decrease in resolution due to the interpolation processing.

  For example, the normal display subject image forming means reads the image signal generated in the pixels constituting the normal display subject image from all the pixels of the image sensor constituting the all-pixel subject image, thereby obtaining the normal display subject image. Form.

  For example, the enlarged display subject image forming means forms an enlarged display subject image by reading out an image signal generated in a pixel in a partial area constituting the enlarged display subject image among all the pixels of the imaging device from the imaging device. It is characterized by.

  For example, the display subject image forming unit forms a normal display subject image and an enlarged display subject image when the number of pixels of the image sensor in the scope is larger than the number of effective pixels according to the color television system of the display device.

  For example, when the number of pixels of the image sensor is smaller than the number of effective pixels, the display subject image forming unit displays the entire pixel subject image as it is as a normal display subject image and enlarges and displays a part of the all pixel subject image displayed on the display device. In this case, an enlarged display subject image in which pixels are interpolated is formed by performing an interpolation process on all the pixel subject images.

  As described above, according to the present invention, it is possible to electrically enlarge and display a specific portion of an observation image without reducing the resolution.

  Hereinafter, an electronic endoscope apparatus according to an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram of the entire electronic endoscope apparatus according to the first embodiment. FIG. 2 is a diagram showing display of a subject image.

  The electronic endoscope apparatus includes a scope 10, a processor 20, and a television monitor (display device) 50, and the television monitor 50 is connected to the processor 20. The scope 10 can be detachably connected to the processor 20. When performing surgery or examination, the scope 10 is connected to the processor 20 and inserted into a human organ. The operation of the entire electronic endoscope apparatus is controlled by a CPU (Central Processing Unit) 36 provided in a system control circuit 34 in the processor 20.

  Light emitted from a light source 29 such as a halogen lamp enters the incident end 13 a of the light guide 13 through the diaphragm 30 and the condenser lens 31. The light guide 13 is a fiber bundle (light beam) for guiding the light emitted from the light source 29 from the connection end of the scope 10 to the tip (distal end). The light incident on the incident end 13 a of the light guide 13 is emitted from the emission end 13 b of the light guide 13 and is emitted from the distal end of the scope 10 through the light distribution lens 14. Thereby, the observation site S is irradiated with light. Note that the connection end of the scope 10 indicates the connection side of the scope 10 with the processor 20.

  When the observation site S is irradiated with light, the light reflected by the observation site S passes through the objective lens 11 in the scope 10. As a result, a subject image is formed on a CCD (imaging device) 12. On the light receiving surface of the CCD 12 on which the subject image is formed, photodiodes (not shown) which are photoelectric conversion elements and serve as pixels of the CCD 12 are arranged. In the present embodiment, a single plate type is applied as an imaging method, and a one-chip complementary color filter, which will be described later, is arranged on the photodiode. When the subject image is formed on the light receiving surface of the CCD 12, an analog image signal (charge) corresponding to the color passing through the complementary color filter is generated for each pixel by photoelectric conversion.

  In FIG. 1, a CCD 12 provided in the scope 10 is a CCD having a number of pixels of about 1.2 million, which is a so-called megapixel CCD. The EEPROM 15 stores data related to the characteristics of the scope 10 (such as the number of pixels of the CCD 12) in advance. When the electronic scope 10 is connected to the processor 20, the data related to the characteristics of the electronic scope 10 is stored in the system control circuit. 34.

  In the normal display state in which the subject image is displayed on the monitor 50 as a moving image, the image signal generated in the CCD 12 is processed as described below. In this embodiment, the NTSC system is applied as the color television system, and the resolution of the monitor 50 conforms to the NTSC system.

  The CCD driver 16 is a circuit for driving the CCD 12, and a drive signal output from the CCD driver 16 is sent to the CCD 12 via the image conversion circuit 17. As will be described later, when the CCD 12 is a megapixel CCD, only an image signal generated in about 300,000 pixels out of about 1.2 million pixels of the CCD 12 is read from the CCD 12. That is, an image signal corresponding to a subject image for one frame composed of about 300,000 pixels is controlled by appropriately driving a drive signal for a transfer path (not shown) for charge transfer in the CCD 12 to thin out the pixels. Is sent to the image conversion circuit 17. In the image conversion circuit 17, a drive signal is output to the CCD 12 in accordance with a control signal sent from the system control circuit 34.

  An image signal corresponding to a subject image composed of about 300,000 pixels is read from the CCD 12 and input to the image conversion circuit 17, and then sent to the CCD process circuit 21 in the processor 20. In this embodiment, since the NTSC system is applied, the image signal generated in the CCD 12 is read at 1/30 second intervals for each frame.

  In the CCD process circuit 21, processing such as noise removal is performed on the image signal read from the CCD 12. Further, the image signals read out for one frame are converted into image signals corresponding to the three primary colors red, blue, and green, and separated for each color. When the image signal corresponding to each color is sent to the A / D conversion circuit 22, it is converted from an analog signal to a digital signal. The digitized image signal is temporarily stored in the image memory 23.

  The digital image signal stored in the image memory 23 is read from the image memory 23 and sent to the D / A converter 25. In the D / A converter 25, the digital image signal is converted into an analog signal and sent to the video process circuit 26. In the video process circuit 26, an analog image signal is converted into a video signal (video signal) such as an NTSC (composite video) signal, a Y / C separation signal, or an analog RGB component signal.

  A CRTC (CRT Controller) 24 displays character information such as the name of a patient and an indication mark such as a pointer on the monitor 50, and therefore outputs a character signal corresponding to the character information and the pointer. In the video process circuit 26, the character signal is interposed on the image signal output from the image memory 23. In the system control circuit 34, a control signal for generating a character signal is output to the CRTC 24, and the output timing of the character signal is adjusted so that character information and instruction marks are displayed at predetermined positions. .

  Video signals generated by the video process circuit 26 are sequentially output to the monitor 50 in accordance with the NTSC system. As a result, the subject image (normal display subject image) is displayed as a moving image in the image area NA of the screen of the monitor 50 (see FIG. 2). The subject image displayed at this time uses about 300,000 pixels out of about 410,000 pixels that can be used as the NTSC system. In the following, the usable pixel number of about 410,000 pixels of the CCD 12 according to the color television system of the monitor is referred to as the effective pixel number, and in the case of the NTSC system, it is about 410,000 pixels.

  The system control circuit 34 is provided with a CPU 36, a ROM 37 and a RAM 38, and data read from the EEPROM 15 in the scope 10 is temporarily stored in the RAM 38. The image area NA where the subject image is displayed in the normal display follows the number of pixels of the CCD 12 in the connected scope 10. When the scope 10 is connected, data corresponding to the image area NA is stored in the position memory 35. Is done.

  On the keyboard 51 (input device), data such as patient information is input by the operator. In the normal display state, as shown in FIG. 2, the pointer P is displayed on the monitor 50 as necessary, and the pointer P is moved to change the location (indicated position) on the screen indicated by the pointer P. Is performed on the keyboard 51.

  When the movement key 51E provided on the keyboard 51 is operated, a signal corresponding to the operated movement key 51E is sent to the system control circuit 34. The signal sent from the keyboard 51 has information on the position to which the pointer P is moved. Based on the position information of the pointer P, the control signal is sent to the system control so that the pointer P is displayed at the position intended by the operator. It is sent from the circuit 34 to the CRTC 24. As a result, the pointer P moves in the direction according to the operated movement key 51E. However, the pointer P moves vertically and horizontally on the screen. The function key 51F is a key for switching between the normal display state and the enlarged display state. When the function key 51F is operated with the pointer P displayed at a predetermined position, the function image 51F indicates the subject image pointed by the pointer P. A partially enlarged subject image (enlarged display subject image) is displayed in the image area MA of the monitor 50 (see FIG. 2). At this time, the CCD 12 reads only the image signal generated in the pixels constituting the subject image displayed in the enlarged display state based on the drive signal from the image conversion circuit 17. When the function key 51F of the keyboard 51 is pressed again, it switches to the normal display state, and the normal display subject image is displayed on the monitor 50.

  Regarding the movement of the position of the pointer P by the operation of the keyboard 51, as is known in the art, the pointer P is always within the image area NA where the subject image is displayed (so as not to fall out of the frame). Move. Therefore, the system control circuit 34 determines the pointer P based on the data on the image area NA corresponding to the connected scope 10 stored in the position memory 35 and the signal related to the movement of the pointer P sent from the keyboard 51. Moving.

  The timing generator 28 outputs clock pulses, synchronization signals, and the like to the CCD driver 16, CCD process circuit 21, A / D conversion circuit 22, image memory 23, CRTC 24, D / A converter 25, and video process circuit 26. Is done. Thereby, the input / output timing of the image signal in each circuit is adjusted.

  In the CCD process circuit 21, a luminance signal is generated from the image signal read from the CCD 12 and sent to the system control circuit 34 via the A / D converter 22. In the system control circuit 34, a control signal for controlling the diaphragm 30 is sent to the diaphragm control circuit 33 based on the transmitted luminance signal. When a drive signal for driving the motor 32 is sent from the aperture control circuit 33 to the motor 32, the motor 32 rotates and the aperture 30 opens and closes in conjunction with the rotation of the motor. The diaphragm 30 opens and closes so that the amount of light applied to the observation site S is appropriate.

  FIG. 3 is a diagram schematically showing a part of the pixel array in the CCD 12. The thinning process for displaying the subject image in the normal display on the monitor 50 will be described with reference to FIG. However, the thinning process is performed in which the number of pixels of the CCD 12 is about 1.2 million pixels and the number of pixels is 1/4, which is about 300,000 pixels.

  The complementary color filter CC is a mosaic filter composed of four color filter elements of cyan Cy, magenta Mg, yellow Ye, and green G, and is configured by repeatedly arranging pixel blocks B each of which is an element. The The arrangement of the complementary color filters CC corresponds to the pixel arrangement on the CCD 12, that is, the arrangement of photodiodes. In this embodiment, the interline transfer method is applied as the charge transfer method, and in the vertical direction of the CCD 12, a vertical transfer unit (not shown) is provided between each column of photodiodes. A horizontal transfer unit (not shown) to which charges transferred to the vertical transfer unit are transferred is provided below the photodiode array. FIG. 3 shows a state in which the array of complementary color filters CC is provided on the pixel array.

  Since about 300,000 pixels are thinned out from about 1,200,000 pixels, only one pixel is selected from the four pixels at the positions of four adjacent filter elements of the same color, and only the charge accumulated in that pixel is selected. Transfer to the vertical transfer path. For the remaining three pixels not selected, the accumulated charge is not transferred. Such a process of extracting one pixel from the four pixels is repeatedly executed for each element of the complementary color filter CC.

If each pixel of the pixel array shown in FIG. 3 is denoted by P _ji and each pixel selected by the thinning process is denoted by P ′ _ji , the pixel P ′ _ji is represented by the following four expressions (1) to (4)): It is calculated | required by either formula. Note that the subscript j (0 to 7) indicates the vertical position of the pixels P _ji and P ′ _ji , and the subscript i (0 to 7) indicates the horizontal position of the pixels P _ji and P ′ _ji .

P ′ _ji = P _ji (j <2, i <2) (1)

P ′ _ji = P _{j + 2, i} (j ≧ 2, i <2) (2)

P ′ _ji = P _{j, i + 2} (j <2, i ≧ 2) (3)

P ′ _ji = P _{j + 2, i + 2} (j ≧ 2, i ≧ 2) (4)

For example, a pixel corresponding to cyan Cy ₁₁ is selected from the pixels P ₀₀ , P ₀₂ , P ₂₀ , and P ₂₂ at the positions of cyan Cy ₁₁ , Cy ₁₂ , Cy ₂₁ , and Cy ₂₂ that are adjacent four same color filter elements. P ₀₀ is extracted as a pixel P ′ ₀₀ by the expression (1). Similarly, according to the yellow Ye ₃₃ among the pixels P ₅₄ , P ₅₆ , P ₇₄ , and P ₇₆ at the positions of yellow Y ₃₃ , Ye ₃₄ , Ye ₄₃ , and Ye ₄₄ that are adjacent four filter elements. Pixel P ₅₄ is extracted as pixel P ′ ₃₂ by equation (4).

  By performing such a thinning process on the subject image (all-pixel subject image) formed on the CCD 12, that is, having a total number of pixels of about 1,200,000, the number of pixels becomes about ¼. A subject image is formed which is composed of 10,000 pixels and whose resolution is converted. In the pixel array of the CCD 12, if the number of pixels in the horizontal direction is M, the number of pixels in the vertical direction is N, and the subject image whose resolution is converted is m, the number of pixels in the horizontal direction is n, and the number of pixels in the vertical direction is n. m = M / 2 and n = N / 2.

  In FIG. 3, the number of pixels of the CCD 12 as a megapixel CCD is about 1.2 million pixels, and the number of pixels constituting the subject image after the thinning process is about 300,000 pixels. However, megapixel CCDs having various numbers of pixels are used. An image can be configured with the number of pixels equal to or less than the number of effective pixels for the electronic scope 10 having the electronic scope 10. When the number of pixels of the CCD 12 is U and the number of pixels constituting a subject image in normal display is D, an image composed of all pixels may be converted into an image having a reduction ratio of D / U times. At this time, the expressions (1) to (4) vary depending on the reduction ratio and the arrangement of the filter elements of the complementary color filter. In addition, the thinning-out process of arbitrary integer multiples and rational number multiples is conventionally known.

  FIG. 4 is a diagram showing an enlarged display process in the present embodiment. The enlarged display process will be described with reference to FIG. Here, the position indicated by the pointer P displayed on the monitor 50 is represented by coordinates on the screen, and the horizontal coordinate is X and the vertical coordinate is Y. Normally, the coordinate pointed by the arrow tip of the pointer P is the position coordinate of the pointer P, and the system control circuit 34 points to the pointer P according to the position information of the pointer P that is sent from the movement key 51E. Detect position.

  In the normal display, the subject image is displayed in the image area NA, and the pointer P is moved to the target part of the subject image. If the operator operates the function key 51F when the position indicated by the pointer P is the coordinates (X0, Y0), the following processing is performed.

First, based on the coordinates (X0, Y0) indicated by the pointer P, a pixel P ′ _C corresponding to the location indicated by the pointer P is obtained from the normal display subject image composed of about 300,000 pixels. .

By the way, the normal display subject image formed by the thinning-out processing is based on the subject image (all-pixel subject image) formed in the image forming region (image region) having the total number of pixels of about 1,200,000 of the CCD 12. Also, as shown in FIG. 3, in the thinning-out process, any pixel P _{ji in} the pixel array of the CCD 12 becomes a pixel P ′ _ji constituting a normal display subject image with the resolution converted as it is. Therefore, the pixel P _C (indicating pixel) corresponding to the pixel P ′ _C in the pixel array of the CCD 12 is obtained by any one of the equations (1) to (4). Here, as shown in FIG. 4, a region where the pixel in the CCD12 are arranged, i.e., a region in which a subject image is formed by the image forming area TI, the coordinates of the pixel P _C in the image forming area TI (K, H ).

To enlarge a portion of the subject image in the normal display around the indicated position of the pointer P on the screen to define a partial region PI around the pixel P _C. However, the partial area PI is a partial area in the image forming area TI. An image constituted by all the pixels located in the partial area PI is set as an enlarged display subject image (enlarged display subject image).

In the present embodiment, the size of the area NA in the normal display state and the area MA in the enlarged display on the screen of the monitor 50 are equal. That is, the number of pixels of the enlarged display subject image is approximately 300,000 pixels, which is the same as the number of pixels of the normal display subject image. Therefore, in order to form an enlarged display subject image is determined partial area PI constituted by 300,000 pixels around the pixel P _C. At this time, the number of pixels in the partial area PI is m (= M / 2) in the horizontal direction and n (= N / 2) in the vertical direction.

  Then, as described above, the image signal generated in the pixels in the partial area PI is read from the CCD 12, whereby an enlarged subject image is displayed in the area MA of the monitor 50. Note that the enlargement ratio in the present embodiment is four times.

  FIG. 5 is a diagram showing the position of the pixel Pc in the image forming area TI. The position of the pixel Pc will be described with reference to FIG.

As described above, the partial area PI, around the pixel P _C, there are n pixels in the horizontal direction of m, the vertical direction. That is, regarding the horizontal direction, there are m / 2 pixels in the negative direction (left direction) and the positive direction (right direction) from the designated pixel P _C, and regarding the vertical direction, the pixel P _{C is present.} It is necessary that there are n / 2 pixels in the negative direction (upward direction) and the positive direction (downward direction). Accordingly, when the position of the pixel P _C is in the vicinity of the outer periphery of the image forming area TI in the image forming area TI of the CCD 12, an enlarged display subject image is formed by the number of m × n pixels (predetermined number of pixels). I can't.

For example, as shown in FIG. 5, when the position of the designated pixel P _C (K, H) is closer to the origin (0, 0) than the position of the coordinates (m / 2, n / 2), the area indicated by hatching Is out of the image forming area TI of the CCD 12, and a magnified subject image cannot be formed with m × n pixels.

  Therefore, in this embodiment, when executing the enlargement process, as will be described later, the image forming area TI of the CCD 12 is divided into nine areas, and the partial area PI of the enlarged display subject image is determined according to each area.

  FIG. 6 is a flowchart showing the entire operation of the endoscope apparatus executed by the CPU 36 in the system control circuit 34.

  In step 101, when the power is turned on, the set values relating to the aperture 30, the light source 29, and the like are set to initial values. In step 102, processing related to the scope 10 is performed. In step 103, for example, date display processing is performed. Such an operation of the entire endoscope apparatus is repeatedly performed until the power is turned off, and a subroutine is executed in each of steps 102 to 103.

  FIG. 7 is a diagram showing a subroutine of step 102 in FIG.

  In step 201, it is determined whether or not the scope 10 has been replaced. That is, it is determined whether or not the scope 10 that has been connected so far has been removed and another scope 10 has been newly connected to the processor 20. If it is determined that the scope 10 is newly connected to the processor 20, the process proceeds to step 202. If it is determined that the scope 10 is not newly connected to the processor 20, this subroutine ends and the process returns to step 102. When the process proceeds to step 201 for the first time after step 101 in FIG. 6 is executed (when the process proceeds to step 201 only after the power is turned on), the process proceeds to step 202. In step 202, it is determined whether or not the number of pixels of the CCD 12 is greater than the number of effective pixels based on the data related to the number of pixels of the CCD 12 read from the EEPROM 15 of the scope 10 connected to the processor 20.

  If it is determined in step 202 that the number of pixels of the CCD 12 is larger than the number of effective pixels, the process proceeds to step 203, where thinning processing is performed. That is, an image signal corresponding to a normal display subject image composed of about 300,000 pixels is read from the CCD 12. In step 204, a video signal generated based on the image signal is output from the video process circuit 26 to the monitor 50, whereby a normal display subject image is displayed on the monitor 50. When step 204 is executed, the subroutine ends.

  On the other hand, if it is determined in step 202 that the number of pixels of the CCD 12 is not larger than the number of effective pixels, the process proceeds to step 205. In step 205, since the number of pixels of the CCD 12 is equal to or less than the number of effective pixels, an image signal corresponding to the subject image composed of the total number of pixels of the CCD 12 is read from the CCD 12. In step 206, a video signal corresponding to the subject image composed of all the pixels of the CCD 12 that is equal to or less than the effective number of pixels is output to the monitor 50, whereby the subject image in the normal display is displayed on the monitor 50.

  FIG. 8 is an interrupt routine showing the enlarged display process. FIG. 9 is a diagram showing an image forming area TI in the image sensor 12. When the function key 51F of the keyboard 51 is operated, an interrupt process is started.

  In step 301, it is determined whether or not the operation on the function key 51F of the keyboard 51 is an operation for switching from normal display to enlarged display.

  If it is determined in step 301 that the operation is to switch from normal display to enlarged display, the process proceeds to step 302. In step 302, it is determined whether or not the number of pixels of the CCD 12 in the scope 10 connected to the processor 20 is equal to or greater than the number of effective pixels.

If it is determined in step 302 that the number of pixels of the image sensor 12 is equal to or greater than the number of effective pixels, the process proceeds to step 303. In step 303, the coordinates (X0, Y0) of the designated position of the pointer P on the monitor 50 screen are detected. As shown in FIG. 4, the corresponding pixel P _C (K, H) in the image forming area TI is obtained based on the coordinates (X0, Y0) of the designated position.

In step 304, it is determined whether or not the following equation is satisfied for the coordinate K in the i direction among the pixels P _C (K, H). Here, m is the number of pixels in the horizontal direction constituting the enlarged display subject image and the normal display subject image.

0 ≦ K <m / 2 (5)

As shown in FIG. 9, the image forming area TI of the CCD 12 is divided into nine areas UA1 to UA8 and CA. When the pixel P _C is located in the area CA, a partial area PI composed of m × n pixels is determined with the designated pixel P _C as the center. On the other hand, when the designated pixel P _C is located in the other areas UA1 to UA8, the instruction pixel P _C is converted to a corrected pixel P ′ _C on the circumference of the area CA, and the corrected pixel P ′ _C is used as a center. A partial area PI composed of m × n pixels is defined. In the equation (5), it is determined whether or not the pixel P _C is located in the areas UA1, UA2, and UA3.

If it is determined in step 304 that the expression (5) is satisfied, that is, the pixel P _C is located in any one of the areas UA1, UA2, and UA3, the process proceeds to step 305. In step 305, it is determined whether or not the following equation is satisfied for the coordinate H in the j direction among the pixels P _C (K, H).

0 ≦ H <n / 2 (6)

That is, the pixel P _C is, whether located within the region UA1 is determined.

If it is determined in step 305 that the expression (6) is satisfied, the process proceeds to step 307. If the pixel P _C remains in this position, the partial area PI cannot be determined with the number of pixels m × n. Therefore, in Step 307, the pixel Pc is the pixel P at the position (m / 2, n / 2). Converted to _{m / 2, n / 2} . When step 307 is executed, the process proceeds to step 321.

On the other hand, if it is determined in step 305 that the expression (6) is not satisfied, the process proceeds to step 306. In step 306, it is determined whether or not the following equation is satisfied for the coordinate H in the j direction among the pixels P _C (K, H).

n / 2 ≦ H ≦ N−n / 2 (7)

That is, the pixel P _C whether located within the region UA2 is determined.

If it is determined in step 306 that the expression (7) is satisfied, the process proceeds to step 308. If the pixel P _C remains in this position, the partial area PI cannot be determined by the number of pixels m × n. Therefore, in Step 308, the pixel P _C is at the position (m / 2, H). Converted to _{m / 2, H.} That is, the pixel P _C is converted to a pixel located on the boundary of the region UA2 and area CA. On the other hand, in step 306, (7) is not satisfied, i.e., when the pixel P _C is determined to be located within the region UA3, proceeds to step 309. If the pixel P _C remains in this position, the partial area PI cannot be determined by the number of pixels m × n. Therefore, in Step 309, the pixel P _C is positioned at the position (m / 2, N−n / 2). Conversion into a certain pixel _{Pm / 2, Nn / 2} . When step 308 and step 309 are executed, the process proceeds to step 321 respectively.

On the other hand, in step 304, (7) is not satisfied equation, i.e., when the pixel P _C is determined not to be located in any region UA1, UA2, UA3, the process proceeds to step 310. In step 310, it is determined whether or not the expression (8) is satisfied for the coordinate K in the i direction among the pixels P _C (K, H).

m / 2 ≦ K ≦ M−m / 2 (8)

That is, the pixel P _C is, whether located in any area UA4, UA5 and CA is determined.

If it is determined in step 310 that the expression (8) is satisfied, the process proceeds to step 311. In step 311, it is determined whether or not the expression (9) is satisfied for the coordinate H in the j direction among the pixels P _C (K, H).

0 ≦ H ≦ n / 2 (9)

That is, the pixel P _C is, whether located within the region UA4 is determined. If it is determined that the expression (9) is satisfied, the process proceeds to step 313. If the pixel P _C remains in this position, the partial area PI cannot be determined by the number of pixels m × n. Therefore, in Step 313, the pixel P _C is located at the position (K, n / 2). Converted to _K and _{n / 2} . That is, the pixel P _C is converted to a pixel located on the boundary line between the area CA and the region UA4. When step 313 is executed, the routine proceeds to step 321. On the other hand, if it is determined in step 311 that equation (9) is not satisfied, the routine proceeds to step 312.

In step 312, it is determined whether or not the expression (10) is satisfied for the coordinate H in the j direction among the pixels P _C (K, H).

n / 2 ≦ H ≦ N−n / 2 (10)

That is, the pixel P _C is, whether located within the area CA is determined.

If it is determined in step 312 that the expression (10) is satisfied, the process proceeds to step 314. At step 314, without the pixel P _C is converted, as the pixel P _C (K, H) is determined in the center of the enlarged display object image. On the other hand, in step 312, it is determined that (10) is not satisfied, i.e., when the pixel P _C is determined to be located within the region UA5, the process proceeds to step 315. If the pixel P _C remains in this position, the partial area PI cannot be determined by the number of pixels m × n. Therefore, in Step 315, the pixel P _C is at the position (K, N−n / 2). Conversion into pixels P _{K, Nn / 2} . That is, the pixel P _C is converted to a pixel located on the boundary line between the area CA and the region UA5. When steps 314 and 315 are executed, the process proceeds to step 321 respectively.

On the other hand, in step 310, (10) is not satisfied, that is, when the pixel P _C is determined to be located in any area of the region UA6, UA7, UA8, proceeds to step 316. In step 316, it is determined whether or not the expression (11) is satisfied for the coordinate H in the j direction among the pixels P _C (K, H).

0 ≦ H ≦ n / 2 (11)

That is, the pixel P _C is, whether located within the region UA6 is determined. If it is determined in step 316 that the expression (11) is satisfied, the process proceeds to step 318. In step 318, the pixel P _C is converted to the pixel P _{Mm / 2, n / 2 at} the position (M−m / 2, n / 2). When step 318 is executed, the process proceeds to step 321. On the other hand, if it is determined in step 316 that the expression (11) is not satisfied, the process proceeds to step 317.

In step 317, it is determined whether or not the expression (12) is satisfied for the coordinate H in the j direction among the pixels P _C (K, H).

n / 2 ≦ H ≦ N−n / 2 (12)

That is, it is determined whether or not the image P _C is located in the area UA7.

If it is determined in step 317 that the expression (12) is satisfied, the process proceeds to step 319. In step 319, the pixel P _C is converted into a pixel P _{Mm / 2, H at} the position (M−m / 2, H). That is, the pixel P _C is converted to a pixel located on the boundary line between the area CA and the region UA7. On the other hand, in step 317, (12) is not satisfied, that is, when the pixel P _C is determined to be located within the region UA8, the process proceeds to step 320. In step 320, the pixel P _C is converted to the pixel P _{Mm / 2, Nn / 2 at} the position (M−m / 2, N−n / 2). When steps 319 and 320 are executed, the process proceeds to step 321 respectively.

In step 321, an image generated in the pixel P _C determined in step 314 and a pixel in the partial area PI centered on the position of the converted pixel obtained in steps 307 to 309, 313, 315, and 318 to 320. A signal is read from the CCD 12. An enlarged subject image is displayed on the monitor 50 based on the read image signal. When step 321 is executed, the routine ends.

  On the other hand, if it is determined in step 302 that the number of pixels of the CCD 12 is not greater than the number of effective pixels, the process proceeds to step 322. In step 322, an image signal corresponding to all the pixels of the CCD 12 is read out, and interpolation processing is performed in the image memory 23. As a result, the enlarged subject image subjected to the interpolation process is displayed on the monitor 50. When step 322 is executed, the routine ends.

  If it is determined in step 301 that the operation is not the operation for switching from the normal display to the enlarged display but the operation for switching from the enlarged display to the normal display, the process proceeds to step 323 and the subject image of the normal display is displayed on the monitor 50. When step 323 is executed, the routine ends.

  FIG. 10 is a subroutine of step 323.

  The execution of steps 351 to 355 is the same as the execution of steps 202 to 206 in FIG. That is, it is determined whether or not the number of pixels of the image sensor 12 is equal to or greater than the number of effective pixels. If the number of pixels is equal to or greater than the number of effective pixels, a thinning process is performed and a subject image whose resolution has been converted is displayed on the monitor 50. Is done. On the other hand, if the number of pixels is equal to or less than the number of effective pixels, an image signal corresponding to all the pixels is read from the image sensor 12 as it is, and the subject image is displayed on the monitor 50 without resolution conversion.

  As described above, according to the first embodiment, in the normal display state, a subject image composed of the number of pixels equal to or less than the effective number of pixels (approximately 300,000 pixels) is displayed on the monitor 50, and in the enlarged display state, A subject image composed of pixels in the partial area PI in the image forming area TI of the CCD 12 is displayed on the monitor 50. Since it is not necessary to perform interpolation processing in the enlarged display process, when magnifying the affected part of the subject image of normal display and observing it, an image in which the affected part is enlarged without lowering the resolution is displayed. Can be accurately diagnosed. When the CCD 12 is a mega pixel, the subject image can be displayed on the monitor 50 with the number of pixels close to the number of effective pixels of the monitor 50 even in the normal display state.

  When the number of pixels of the CCD 12 in the scope 10 is equal to or less than the number of effective pixels, a subject image composed of all the pixels of the CCD 12 is displayed on the monitor 50 without converting the resolution in the normal display state. As a result, when the number of pixels of the CCD 12 is small, a normal display image and an enlarged display image are projected as in the conventional case, and a subject image with a remarkably reduced resolution is not displayed in the normal display. That is, in addition to a scope having a megapixel CCD, it is compatible with a conventional scope having a small number of pixels.

  Since the image conversion circuit 17 is provided in the scope 10, it is possible to manufacture the processor 20 corresponding to this scope with almost no change in the circuit configuration of the conventional processor.

  In the present embodiment, a subject image composed of about 300,000 pixels is displayed in normal display. However, if the number of pixels is equal to or less than the number of effective pixels, the number of pixels other than this, for example, approximately the same as the number of effective pixels. The subject image may be composed of 410,000 pixels. Similarly, in the enlarged display, the subject image is not limited to the number of pixels of about 300,000, and the subject image may be configured with the number of pixels equal to or less than the number of effective pixels.

  In normal display, a subject image whose resolution is converted is formed by thinning out a subject image composed of all pixels, but a subject image whose resolution is converted may be formed by other processing. In this case, a relational expression of pixels between the subject image for resolution conversion and the subject image formed on the CCD 12 is determined instead of the equations (1) to (4).

  In the first embodiment, only the image signal generated in the pixels constituting the subject image in the normal display and the enlarged display is output from the CCD 12 to the image conversion circuit 17, but the image signals of all the pixels of the CCD 12 are read out. The image conversion circuit 17 may send only the image signal corresponding to the pixels constituting the subject image to the processor 20. Alternatively, the image conversion circuit 17 may be provided in the processor 20, for example, between the image memory 23 and the D / A converter 25.

  Next, an electronic endoscope apparatus and system thereof according to the second embodiment will be described with reference to FIG. Unlike the first embodiment, the second embodiment performs an enlarged display process by an operator operating a touch panel arranged on the screen of the monitor 50. About others, it is the same as 1st Embodiment, and the same referential mark shows the same component.

  On the screen of the monitor 50, a touch panel TP in which colorless and transparent matrix electrodes are arranged is arranged, and an image of the observation site S is observed through the touch panel TP. The touch panel TP is a device that sends position information on the screen to the processor 20, and when an operator touches the touch panel TP with a finger, a signal related to the position on the screen corresponding to the place touched by the finger is displayed on an interface (not shown). ) To the system control circuit 34. Then, the processor detects a position on the screen (instructed position) corresponding to the place touched by the finger. However, here, an infrared method is applied as a method for detecting a designated place on the screen.

  As in the first embodiment, the position memory 35 stores the display area of the subject image according to the number of pixels of the CCD 12 in the scope 10 as data, and the position on the screen instructed by the operator is stored. It is determined whether it is within the display area (area NA in FIG. 2). If it is within the display area, the enlarged display process is performed as in the first embodiment. On the other hand, when the operator designates a part other than the display area with a finger, the enlarged display process is not executed. When a predetermined location on the touch panel TP is touched by the operator while the enlarged display subject image is displayed on the monitor 50, the display is switched from the enlarged display to the normal display.

  As described above, according to the second embodiment, when the touch panel TP is operated, the normal display subject image is switched to the enlarged display subject image.

  A third embodiment will be described with reference to FIG. Unlike the first embodiment, the third embodiment moves the position of the pointer on the monitor by operating an operation button provided on the scope. Other configurations are the same as those in the first embodiment.

  The scope 10 is provided with a first instruction mark push button 18A, a second instruction mark push button 18B, and a third instruction mark push button 18C which are push buttons. The first to third instruction mark push buttons 18A to 18C are position information input devices for moving the position of the pointer P on the screen of the monitor 50, and move the pointer P up, down, left and right on the screen. When the first to third instruction mark push buttons 18 </ b> A to 18 </ b> C are operated by the operator, information regarding the position to which the pointer P moves is sent to the system control circuit 34.

  In the system control circuit 34, in order to change the position of the pointer P on the monitor 50, a control signal is sent to the CRTC 24 based on signals sent from the first to third instruction mark push buttons 18A to 18C. In the CRTC 24, the output timing of the character signal corresponding to the pointer P is adjusted based on the transmitted control signal.

  FIG. 13 is a view showing a part of the scope 10.

  As shown in FIG. 13, on the processor side of the scope 10, an operation unit 10M including various operation instruments operated by the operator is provided. When the operator performs a treatment, the distal end portion (see FIG. The lever LE for bending the notch is operated with the right hand. The operation portion 10M is provided with an end portion 10K that is convex and has a “K” shape. Among the two surface portions positioned so as to face both sides of the end portion 10K while the operator holds the scope 10 for performing treatment or the like, the first surface 10R1 faces upward, and the other second portion The surface 10R2 is directed downward.

  The first instruction mark push button 18A is provided on the second surface 10R2 at the end portion 10K, and is arranged so that it can be operated with the thumb of the operator. On the other hand, the second and third instruction mark push buttons 18B and 18C are arranged on the first surface 10R1 so that they can be operated by the operator's index finger and middle finger. The first instruction mark push button 18A is arranged at the end 10K so as to face the second and third instruction mark push buttons 18B and 18C, and the operator presses the first instruction mark push button with the thumb of the left hand. However, it is possible to operate the second and third instruction mark push buttons 18B and 18C with the index finger and middle finger of the left hand.

  FIG. 14 is an interrupt routine showing pointer display position movement processing for the first to third instruction mark push buttons 18A to 18C.

  The first instruction mark push button 18A also serves as a switch for switching from the state in which the pointer P is not displayed to the state in which the pointer P is displayed, and the first instruction mark button 18A in a state in which the pointer P is not displayed on the monitor 50. When 18A is operated, this interrupt routine is started.

  In step 401, a control signal is sent from the system control circuit 34 to the CRTC 24 so that the pointer P is displayed on the screen. In step 402, it is determined whether or not the first and second instruction mark push buttons 18A and 18B are simultaneously operated by the operator. However, in the present embodiment, when the pointer P is moved to the right by one coordinate, the first and second instruction mark push buttons 18A and 18B are pressed simultaneously.

  If it is determined in step 402 that the first and second instruction mark push buttons 18A and 18B are operated simultaneously, the process proceeds to step 403. In step 403, it is determined whether or not the pointer P is currently located in the area MA (see FIG. 2) in normal display. If it is determined that the pointer P is located within the area MA, that is, not located on the right boundary line of the area MA and the pointer P can be moved to the right by one coordinate, the process proceeds to step 404 where the pointer P is set to 1. Moves to the right by the coordinates. On the other hand, if it is determined in step 403 that the pointer P is located on the right boundary line of the area MA, the pointer P is displayed in the area MA. .

  If it is determined in step 402 that the first and second instruction mark push buttons 18A and 18B are not operated simultaneously, the process proceeds to step 405. In step 405, it is determined whether or not the first and third instruction mark push buttons 18A and 18C are operated simultaneously. However, in this embodiment, when the pointer P is moved by one coordinate in the left direction, the first and third instruction mark push buttons 18A and 18C are pressed simultaneously.

  If it is determined in step 405 that the first and third instruction mark push buttons 18A and 18C are operated simultaneously, the process proceeds to step 406. In step 406, it is determined whether or not the pointer P is currently located in the area MA. If it is determined that the pointer P is located in the area MA, that is, not located on the left boundary line of the area MA and the pointer P can be moved to the left by one coordinate, the process proceeds to step 407, and the pointer P1 coordinate is obtained. Is moved to the left. On the other hand, if it is determined in step 406 that the pointer P is located on the left boundary line of the area MA, the pointer P is displayed in the area MA, and therefore the movement of the pointer P is not executed, and the process returns to step 402. .

  On the other hand, if it is determined in step 405 that the first and third instruction mark push buttons 18A and 18C are not operated simultaneously, the process proceeds to step 408. In step 408, it is determined whether or not the second instruction mark push button 18B has been operated. However, the operation of the second instruction mark push button 18B is an operation for moving the pointer P downward by one coordinate.

  If it is determined in step 408 that the second instruction mark push button 18B has been operated, the process proceeds to step 409. In step 409, it is determined whether or not the pointer P is currently located in the area MA. If it is determined that the pointer P is located in the area MA, that is, not located on the lower boundary line of the area MA and the pointer P can be moved downward by one coordinate, the process moves to step 410 and the pointer P Is moved downward by one coordinate. On the other hand, if it is determined in step 409 that the pointer P is located on the lower boundary line of the area MA, the pointer P is displayed in the area MA, and thus the movement of the pointer P is not executed, and the process proceeds to step 402. Return.

  On the other hand, if it is determined in step 408 that the second instruction mark push button 18B has not been operated, the process proceeds to step 411. In step 411, it is determined whether or not the third instruction mark push button 18C has been operated. The operation of the third instruction mark push button 18C is an operation for moving the pointer P upward by one coordinate.

  If it is determined in step 411 that the third instruction mark push button 18C has been operated, the process proceeds to step 412. In step 412, it is determined whether or not the pointer P is currently located in the area MA. If it is determined that the pointer P is located in the area MA, that is, not located on the upper boundary line of the area MA and the pointer P can be moved upward by one coordinate, the process proceeds to step 413 and the pointer P is set to 1. Moves up the coordinate. On the other hand, if it is determined that the pointer P is located on the upper boundary line of the area MA, the pointer P is displayed in the area MA, and therefore the movement of the pointer P is not executed, and the process returns to step 402.

  On the other hand, if it is determined in step 411 that the third instruction mark push button 18C has not been operated, the process proceeds to step 414. In step 414, it is determined whether or not the second and third instruction mark push buttons 18B and 18C are operated simultaneously. However, the simultaneous operation of the second and third instruction mark push buttons 18B and 18C is an operation for executing an enlarged display process.

  If it is determined in step 414 that the second and third instruction mark push buttons 18B and 18C have been operated simultaneously, the process proceeds to step 415, where the position of the pointer P is obtained in the system control circuit 34. In step 416, the magnified display subject image is displayed by the enlarged display process, and the pointer P is deleted from the screen. When step 416 is executed, the routine ends. On the other hand, if it is determined in step 414 that the second and third instruction mark push buttons 18B and 18C are not operated simultaneously, the process returns to step 402.

  As described above, according to the third embodiment, the pointer P is moved in the area MA in the normal display by operating the first, second, and third instruction mark push buttons 18A, 18B, and 18C. Since the first to third instruction mark push buttons 18A to 18C are provided at the end portion 10K of the scope 10, the operator can move the pointer P to a desired position while holding the scope 10.

  When the enlarged display process is executed, the operator can switch from the normal display to the enlarged display while holding the scope 10 because the second and third instruction mark push buttons 18B and 18C may be pressed simultaneously. .

  The arrangement of the push buttons may be other than that shown in FIG. 13, and the number of push buttons is not limited to three. The shape of the end portion 10K is not limited as long as a plurality of push buttons can be arranged, and a plurality of buttons may be arranged on the end portion 10K so that the operator can operate the buttons while holding the scope 10.

  In this embodiment, a push button is applied as a position input device for moving the pointer P. However, other position input devices such as a joystick or a trackball may be provided at the end 10K of the scope 10. .

It is a block diagram of the electronic endoscope apparatus which is 1st Embodiment. It is the figure which showed the normal display and expansion display of the image | video displayed on a monitor. It is the figure which showed the thinning process. It is the figure which showed the enlarged display process. It is the figure which showed the image formation area of CCD. It is the main routine which showed operation | movement of the whole electronic endoscope apparatus. This is a subroutine showing scope related processing. It is an interrupt routine showing enlarged display processing. It is a figure showing an image formation area. This is a subroutine of step 323 in FIG. It is a block diagram of the electronic endoscope apparatus which is 2nd Embodiment. It is a block diagram of the electronic endoscope apparatus which is 3rd Embodiment. It is the figure which showed the operation part of the scope. It is a routine showing a pointer movement process.

Explanation of symbols

10 scope 10M operation unit 10K end 10R1 first surface (first surface)
10R2 second surface (second surface)
12 CCD (imaging device)
17 Image conversion circuit (display subject image forming means)
18A First instruction mark push button (first push button)
18B Second indication mark push button (second push button)
18C 3rd instruction mark push button (3rd push button)
20 processor 24 CRTC (instruction mark generating means)
26 Video Process Circuit 28 Timing Generator 34 System Control Circuit 36 CPU
50 TV monitor (display device)
51 Keyboard 51E Movement key 51F Function key P Pointer (instruction mark)
TI Image formation area (image area)
PI subregion TP touch panel P _C pixel (indicated pixel)

Claims (5)

The image sensor is detachably attached to a processor to which a display device for displaying a subject image is connected, and
A display subject image forming unit that forms a display subject image to be displayed on the display device based on an all-pixel subject image formed by all the pixels of the image sensor and formed on the image sensor;
The display subject image forming means;
A normal display subject image forming unit configured to form a normal display subject image, which is a subject image obtained by converting the resolution of the all-pixel subject image as a display subject image, and is configured with a smaller number of pixels than all pixels of the image sensor;
When enlarging and displaying a part of the normal display subject image displayed on the display device based on the normal display subject image forming unit, the display subject image is a part of the all-pixel subject image, An enlarged display subject image forming means for forming an enlarged display subject image composed of pixels located in a partial area that is a part of the image area of the all-pixel subject image;
The scope of an electronic endoscope apparatus, wherein the normal display subject image forming unit and the enlarged display subject image forming unit form the normal display subject image and the enlarged display subject image, respectively, by the number of effective pixels or less.   The normal display subject image forming means reads out an image signal generated in a pixel constituting the normal display subject image from all the pixels of the image sensor constituting the all-pixel subject image from the image sensor, The scope of the electronic endoscope apparatus according to claim 1, wherein a normal display subject image is formed.   The enlarged display subject image forming unit reads out an image signal generated in a pixel in the partial area constituting the enlarged display subject image from all the pixels of the image sensor from the image sensor. The scope of the electronic endoscope apparatus according to claim 1, wherein an image is formed.   When the display subject image forming unit has more pixels than the effective pixels according to the color television system of the display device, the normal display subject image and the enlarged display subject image The scope of the electronic endoscope apparatus according to claim 1, wherein the scope is formed. When the number of pixels of the image sensor is smaller than the number of effective pixels, the display subject image forming unit directly uses the all-pixel subject image as the normal display subject image and displays the all-pixel subject image displayed on the display device. 5. The electronic internal image according to claim 4, wherein when a part of the image is enlarged and displayed, the enlarged display subject image in which pixels are interpolated is formed by performing interpolation processing on the all-pixel subject image. 6. Endoscope scope.

Images