JPH1085179A - Full picture element reading type electronic endoscope system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve picture quality by reading out all the picture elements provided from an imaging device through one time exposure and to improve the delay of image display caused by storage in memories. SOLUTION: A CCD driving circuit 18 and a full picture element double speed reading pulse generating circuit 19 are provided. Concerning video signals provided from a CCD 15 through one time of exposure within the period of 1/60sec, signals on odd-numbered and even-numbered lines are successively read out at the double speed of 1/120sec within the period of next 1/60sec while shielding light with a light chopper 36, the signal data on these odd-numbered lines are stored in a 1st memory 22, and signal data on even-numbered lines are stored in a 2nd memory 23. Then, a mixer circuit 24 mixes pixel data on odd-numbered lines and even-numbered lines and forms images for one frame based on this picture element mixing signal. Thus, the image display can be accelerated just for 1/60sec.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an all-pixel readout type electronic endoscope apparatus, and more particularly to an endoscope apparatus for reading out all pixels of an image stored in an image sensor by one exposure to form a high-quality image. For the configuration for.

[0002]

2. Description of the Related Art In an electronic endoscope apparatus, for example, a CCD (Charge Coupled Device) is used as an image pickup device. In this CCD, an electric signal stored in a pixel unit is read out by a photoelectric conversion element, so that an image signal is read. (Video signal) is obtained. In the simultaneous electronic endoscope device, a color filter is arranged in pixel units on the upper surface of the CCD so that a color image can be obtained.

FIG. 5A shows an arrangement state of the color filters. As shown, for example, Mg (magenta), G (green), and Cy are provided on the imaging surface of the CCD 1.
(Cyan) and Ye (yellow) are arranged in pixel units. Therefore, by the light transmitted through these color filters,
In the CCD 1, accumulated charges are obtained.

FIG. 5B shows a read state by a conventional color difference line sequential mixed read method. In this method, accumulated charges of pixels in upper and lower lines are mixed and read. For example, at the first exposure, a mixed signal of 0 line and 1 line, a mixed signal of 2 lines and 3 lines,..., And a video signal of an odd field (Odd) are read out. 2 lines mixed signal,
A video signal of an even field (Even) such as a mixed signal of three lines and four lines,... Is read out.
Therefore, a mixed signal of two lines of the CCD 1 becomes a signal of one line of the field image.

FIG. 6 shows a signal reading operation in the CCD 1, and the O / O of the field shown in FIG.
1/60 second (vertical synchronization period) as indicated by E signal
An odd field and an even field are obtained every time. Therefore, during the above 1/60 second period, signal accumulation is performed, for example, according to the accumulation (exposure) time t of the electronic shutter shown in FIG. Reading is performed. As a result, as shown in FIG. 7C, n-1 (number) odd (Odd) field signals and n even (Even) field signals are obtained, and the (n-1) odd field signals are obtained. Are the (0 + 1) line and (2 + 3) shown on the left side of FIG.
, A mixed signal of (4 + 5) lines..., And the even field signal of n is (1) shown on the right side of FIG.
+2) lines, (3 + 4) lines...

[0006] The odd field signal and the even field signal are interlaced and formed as an image of one frame, and the image is displayed on a monitor. Of course, various signal processing is performed during the above processing, and a color difference signal and a luminance signal are formed from the mixed signal. Based on these signals, an image of the inside of the object to be observed is displayed on a monitor. Is done.

[0007]

However, in the simultaneous electronic endoscope apparatus, as shown in FIG. 6C, an odd field image and an even field image for forming one frame image are provided. Between 1/60
If there is a time lag of seconds and the endoscope itself shakes or the object moves during this time, there is a problem that the image quality deteriorates. In particular, in the endoscope, a still image is displayed by operating a freeze switch, and thereby a specific observation site can be observed in detail. In this still image, an image of one frame is displayed based on the odd field information and the even field information. If there is a shift (blurring, movement) between the two, the image quality deteriorates (including color shift). Will do.

In some cases, the electronic endoscope apparatus employs an electronic shutter function for changing a signal accumulation time.
According to this, the image quality can be improved by shortening the accumulation time in a bright place. However, as shown in FIG. 6B, there is a time lag of 1/60 second between two accumulations (exposure) for forming one frame image, and the effect of shortening the accumulation time is not necessarily required. There is also a disadvantage that it cannot be enjoyed.

Therefore, although the details will be described later, there has been proposed a device for reading out all the pixel data of the image pickup device obtained by one exposure while using the light blocking means.
Since the data of the odd-numbered lines and the data of the even-numbered lines, which are all the pixel data, are temporarily stored in the dedicated memory once, the image display is delayed by that time (two-field forming time). Therefore, when the endoscope tip is moved, the display following the movement is slightly delayed.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and has as its object to read out all the pixels obtained by an image pickup device by one exposure to improve the image quality and store it in a memory. It is an object of the present invention to provide an all-pixel readout type electronic endoscope apparatus which can reduce a delay in image display due to the above.

[0011]

In order to achieve the above object, an all-pixel read-out type electronic endoscope apparatus according to the present invention comprises: an image pickup device in which a plurality of color filters are arranged in pixel units; The light blocking means for blocking the illumination light so that the exposure period in which the pixel signal is stored and the light blocking period in which the pixel signal is not stored are alternately repeated, and the image signal stored for each pixel by one exposure with this image sensor, First, the image signal of either the odd or even line is read, and then the drive is performed so as to read the image signals of the remaining lines. The reading of both the image signals of the odd line and the even line is performed by the light blocking means. During the light-shielding period during which the light is
A double-speed read control circuit that executes at double speed, a memory that writes and stores the odd-line image signal and the even-line image signal obtained from the image sensor at double speed,
A mixing circuit that forms a pixel mixed signal by mixing the odd-numbered line and the even-numbered line read out from the memory, and forms a field image based on the pixel mixed signal. I do.

First, a case where the operation of reading all pixels from the image pickup element is performed at every 1/60 second vertical synchronizing period as in the prior art (no double-speed reading is performed) will be described. From the image pickup device, for example, charges accumulated by exposure (exposure time is arbitrary) within the first 1/60 second period (vertical synchronization period) are output in the second period (1/60 second). The odd lines of the image sensor (CCD) are read (read from the transfer line), and the remaining even lines are read in the third (at the next exposure) period. In this case, in order to read out the even-numbered lines, the light source light in the second period is blocked by the light blocking unit. That is, during the second period in which the accumulated charges of the odd-numbered lines are sequentially read out, if the charges by the next exposure are accumulated as in the related art, the remaining even-numbered lines cannot be read out.

The video signals of the odd-numbered lines and the even-numbered lines are stored in the memory, and then read out of each line at the same time. The pixel signals are mixed by the mixing circuit in the same manner as the conventional color difference line sequential mixing reading method. A mixed signal is formed. Therefore, an image of one frame is formed based on signals of all pixels obtained by one exposure within a period of 1/60 second, and a high-quality image is obtained.

However, in such an all-pixel readout, since the pixel mixture signal is stored once in the above-mentioned memory, the time required to obtain a pixel mixture signal similar to that of the related art is equivalent to the formation time of 1/1/2 of the field. The signal processing is delayed for a time of 30 seconds. Therefore, in the present invention, the reading from the image pickup device is made a double speed, whereby the delay time is reduced by one.
This is to reduce the time required for forming the field to 1/60 seconds.

[0015]

FIG. 1 shows a circuit configuration of an all-pixel readout type electronic endoscope apparatus as an example of an embodiment. As shown, the electronic endoscope apparatus is a scope. Electronic endoscope 10, connector section circuit (electronic endoscope internal circuit) 11 of this electronic endoscope 10, processor device 12
And a light source device 13. The electronic endoscope 10
Is provided with a CCD 15 having a color filter similar to that described with reference to FIG. 5 and a light guide 16 for guiding the light of the light source device 13 to the distal end. Further, a freeze switch 17 for displaying a still image is provided on the operation unit of the electronic endoscope 10.

In the connector section circuit 11, the CC
A CCD drive circuit 18 for driving D15 and an all-pixel double-speed read pulse generating circuit 19 are provided as a double-speed read control circuit, and a timing generator 20 is further provided. Based on the signal of the timing generator 20, the all-pixel double-speed read pulse generation circuit 19 divides the accumulated data of all the pixels accumulated in the CCD 15 by one exposure into odd-numbered lines and even-numbered lines. A pulse for reading out is generated and supplied to the CCD drive circuit 18. The CCD drive circuit 18 performs control for separately and sequentially reading the odd-line signal and the even-line signal from the CCD 15 based on the read pulse.

An A / D converter 21 for inputting the output signal of the CCD 15, for example, a first memory 22 for storing the odd-line image data, a second memory 23 for storing the even-line image data, a mixing circuit 24, a memory control circuit 25 is provided. That is, the video signal output from the CCD 15 is not output by mixing two lines as in the related art, but is divided into an odd-line video signal and an even-line video signal under the control of the memory control circuit 25. In the state, each memory 2
2, 23 are written. Each writing to the memories 22 and 23 is performed in a period of 1/120 second,
Subsequent readout is performed in 1/60 seconds, which is the vertical synchronization period. The mixing circuit 24 adds and mixes the data of the odd-numbered lines and the data of the even-numbered lines to form a signal equivalent to that of the conventional color difference line sequential mixed reading method.

FIG. 2 shows the contents of image data formed by the circuits from the CCD 15 to the mixing circuit 24 described above. As shown in FIG. 1A, the CCD 15 is provided with horizontal lines from 0 to N corresponding to the number of scanning lines, and the pixel data of the horizontal lines is transferred to a transfer line and read. Is done. Then, data of odd lines (1, 3, 5,...) Of the CCD 15 are stored in the first memory 22 shown in FIG.
The data of the even lines (2,4,6 ... line) is shown in Fig. (C)
Is stored in the second memory 23.

The data in the memories 22 and 23 are subjected to pixel mixing between the lines shown in FIGS. 2B and 2C by the mixing circuit 24, and as shown in FIG. The addition operation data of the line, 2 lines + 3 lines, 4 lines + 5 lines,... Is output as odd-number (Odd) field data. Further, with the readout line in FIG. 9C shifted downward by one line (reading from the position of C1 in FIG. 9), pixel mixing is performed between the lines in FIG. 10B and as shown in FIG. 10E. , 1 line + 2 lines, 3 lines + 4 lines, 5 lines + 6 lines,..., Are output as even field data. The odd number of lines of the CCD 15 is represented by O.
DD, an even number is distinguished as EVEN, an odd number of a field to be interlaced is identified as Odd, and an even number is identified as Even.

Further, in FIG. 1, a first DVP (digital video processor) 26 is provided at a stage subsequent to the mixing circuit 24, and the first DVP 26 performs color signal processing of pixel mixed reading (color difference line sequential mixing reading system). Then, for example, a color difference signal and a luminance signal are formed. Although not shown, other circuits such as an automatic gain control circuit and a gamma processing circuit are arranged at appropriate positions.

In the processor device 12 to which the electronic endoscope 10 is connected, a second DVP 26 connected to the first DVP 26 is provided.
A DVP 28 is provided. In the second DVP 28, control of an image position, enlargement processing, mirror image processing, and the like are performed. In the subsequent stage of the second DVP 28, a third memory 29 for storing odd field data, a fourth memory 30 for storing even field data, a switching circuit 31, a memory control circuit 32, and a D / A converter 33 are provided. That is, the third memory 29 stores the odd field data obtained by converting the data of FIG. 2D into a color difference signal or the like, and the fourth memory 30 stores the data of FIG. Is stored.

A light source 35 is provided in the light source device 13 for connecting the light guide 16 provided in the electronic endoscope 10, and a light chopper is provided between the light source 35 and an incident end of the light guide 16. 36 and a stop 37 are arranged. The optical chopper 36 is configured to rotate, for example, a semicircular plate, and a drive circuit 38 and a servo circuit 39 are connected to rotate the optical chopper 36 once every 1/30 second. Therefore, according to the optical chopper 36, 1/60
In a field O / E signal in a cycle every second, 1 /
The light is output for only 60 seconds, and the light can be blocked for the next 1/60 seconds.

On the other hand, a drive circuit 40 and an iris control circuit 41 are connected to the diaphragm 37, and the drive circuit 40 and the iris control circuit 41 are connected to the first DVP 26.
By driving the aperture 37 based on the luminance signal obtained in the step (1), the output light amount of the light source 35 can be adjusted.

This example is configured as described above, and its operation will be described with reference to FIGS. As shown in FIG. 3A, the field O (Odd) / E (Eve)
n) As a signal, a timing signal for forming one field in 1/60 second is used as in the conventional device. In response to this, the optical chopper 36 is rotated once every 1/30 second, so that Pn-1, Pn,
As indicated by Pn + 1, light is repeatedly output for a period of 1/60 second while interposing a light blocking state of 1/60 second.
This light is emitted from the distal end portion through the light guide 16 into the body to be observed.

By this light irradiation, an image of the inside of the body to be observed is captured by the CCD 15 at the distal end, and the CCD 15 accumulates charges corresponding to the image. The reading of the stored charge is performed by C
The control is performed by a control pulse from the CD drive circuit 18. However, when the electronic shutter function is used, the timing of accumulation or readout may be changed by the control pulse, thereby changing the charge accumulation time and adjusting the exposure amount. it can.

Thus, in the embodiment, under the control of the all-pixel double-speed read pulse generating circuit 19, the accumulated data of all the pixels of the CCD 15 obtained by one exposure is read at double speed. That is, as shown in FIG.
Based on the exposure of the light output Pn-1 in (B), during the next light-shielding period of 1/60 second, the CCD 15 outputs an odd number (OD) of n-1.
D) Line data and even (EVEN) line data are 1
The odd line data is stored in the first memory 22 in response to a 1/120 second write (write enable) signal in FIG. 3E, and the even line data is read in FIG. 3F. Is stored in the second memory 23 by the write signal. Similarly, the data of the odd and even lines are read out in the order of the optical outputs Pn, Pn + 1... And stored in the memories 22 and 23.

Next, the data in the memories 22 and 23 are pixel-mixed by the mixing circuit 24, and, as shown in FIG. 3G, for example, odd-numbered (n-1) -th and odd-numbered line data An odd (Odd) field signal (S) mixed by a combination of data, an even (Even) field signal mixed by a combination of n-1 even line data and n odd line data, an odd line data of n Field signals are sequentially formed, such as odd (Odd) field signals mixed by the combination of even line data. These field signals are subjected to color image processing and temporarily stored in the third memory 29 and the fourth memory 30.
The outputs 9 and 30 are alternately output to the monitor by the switching circuit 31 and displayed by interlaced scanning.

Therefore, in this example, a moving image is displayed as an image in which a part of the image data obtained at the next exposure is mixed.
/ 2, and even if there is blurring or movement during 1/60 seconds, the effect is small.

On the other hand, for a still image, an image is displayed using only data at the same exposure, and the write control operation for the still image is performed by the memory control circuit 25 in FIG. That is, the control operation for this is shown in FIG.
It is set to be executed at the time of the fall of the O / E signal shown in FIG.
At this point, if the freeze operation is turned on by the freeze switch 17, the field O / E signal becomes the falling edge (A1) at this time.
2) The writing (write enable) of the first memory 22 and the second memory 23 is prohibited [FIGS. 3 (E) and 3 (F)].

Accordingly, in the state where the n odd line data obtained by the optical output Pn is written in the first memory 22 and the n even line data is written in the other second memory 23, the next data is written. Is not written. As a result,
As shown in FIG. 3 (G), only odd (Odd) field signals and even (Even) field signals composed of odd and even line data of n are sequentially read out,
These field signals are displayed as a still image by interlaced scanning.

FIG. 4 shows the signal output when reading from the CCD 15 at the same speed (1/60 second) as the conventional one, not at the double speed. In this case, it is shown in FIG. 4 (C). Thus, for example, n-1 odd (ODD) line data and even (EVEN) line data are sequentially read out every 1/60 second, and these odd and even line data are 1
Each memory (22, 23) by write signal of / 60 seconds
Is stored in Then, from the mixing circuit 24, FIG.
A field signal (pixel mixture signal) similar to the above is output [FIG. 4 (D)].

When FIG. 4 is compared with FIG. 3, for example, an Odd field signal indicated by a symbol S obtained by mixing line data of n−1 in FIG.
/ E signal is formed at the position of A1 as shown in FIG.
Then, Odd obtained by mixing the line data of n-1
The field signal S is A1 of the field O / E signal.
It can be seen that it is formed at a position 1/60 second earlier than the position of. Therefore, in this example, the delay caused by storing data in the memories 22 and 23 in the all-pixel reading method is 1 /
It can be shortened by 60 seconds.

In the above embodiment, as described above, the electronic shutter function can be used according to the brightness of the inside of the object to be observed. According to the present invention, the effect of this electronic shutter function is further enhanced. There is also an advantage. In other words, the screen becomes brighter when the tip approaches the affected part, etc.
Although the image quality can be improved by shortening the accumulation time in the CCD 15 by the electronic shutter function, the conventional method forms an image based on a video signal obtained by two exposures. Movement between exposures and blurring will affect image quality. However, in the present invention, since a still image is formed based on a video signal obtained by one exposure, the effect of shortening this one exposure time, that is, the signal accumulation time, directly appears, and the exposure time is reduced. There is an advantage that the image quality is significantly improved by shortening the length.

Further, in consideration of burns of the affected part, it is not preferable to apply strong illumination light from the distal end of the endoscope to the affected part for a long time, and the intensity of the illumination light is limited to some extent. become. However, according to the present invention, the light output is reduced by half compared with the conventional case, so that the illumination light intensity can be increased, and there is an advantage that a more easily viewable image can be formed.

In the above-described embodiment, an image is formed based on only all pixel data at the same exposure in a still image. However, an image can be displayed in a moving image only by data at the same exposure. This can be performed, for example, by arranging a delay memory at the subsequent stage of the first memory 22 in FIG. 1 and storing odd and even line data at the same exposure time in the memory at the same timing. It is possible to get a video.

[0036]

As described above, according to the present invention,
For example, an image signal of an odd-numbered line is read out of an image signal accumulated in an image sensor by one exposure, and then an image signal of an even-numbered line is read out. In the light-shielding period during which light is shielded by the means, reading is performed at twice the memory reading speed, so that all pixels obtained by the image sensor by one exposure can be read to improve image quality, Can be improved by 1/60 second. Therefore, there is an advantage that the time difference between the operation of the distal end portion and the image display is reduced, and the display delay due to the movement of the distal end portion of the endoscope is reduced.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a circuit configuration of an all-pixel readout type electronic endoscope apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram showing image data read from the CCD of FIG. 1 to a mixing circuit.

FIG. 3 is an explanatory diagram showing main operations of the embodiment.

FIG. 4 is an explanatory diagram showing an operation when double-speed reading is not performed in the device of FIG. 1;

5A and 5B show a configuration of a conventional CCD, FIG. 5A is a configuration diagram of a color filter, and FIG. 5B is an explanatory diagram of mixed reading from the CCD.

FIG. 6 is an explanatory diagram showing an operation in a conventional CCD.

[Explanation of symbols]

 1, 15 CCD (image pickup device), 10 electronic endoscope, 11 connector circuit, 12 processor device, 13 light source device, 17 freeze switch, 18 CCD drive circuit, 19 all-pixel double-speed reading Pulse generating circuit, 22, 23, 29, 30 ... memory, 24 ... mixing circuit, 25, 32 ... memory control circuit, 35 ... light source, 36 ... optical chopper.

Claims (1)

[Claims] 1. An image sensor in which a plurality of color filters are arranged in pixel units, and light for blocking illumination light such that an exposure period in which pixel signals are accumulated in the image sensor and a light-shielding period in which no image signal is accumulated are alternately repeated. Blocking means, for an image signal accumulated for each pixel by one exposure by the image pickup device, first read out an image signal of an odd or even line, and then read out an image signal of the remaining lines. A double-speed read control circuit for reading out both the odd-numbered line and the even-numbered line image signals at a speed twice as high as a memory reading speed during a light-shielding period in which light is shielded by the light-shielding means; A memory for writing and storing the odd-numbered line image signal and the even-numbered line image signal obtained at a double speed; and reading the odd-numbered line and the even-numbered image read from the memory. Includes a mixing circuit for forming a pixel mixing signal by mixing the pixel signals of the line, the all pixels readout electronic endoscope apparatus designed to form a field image based on the pixel mixture signal.