JPH09163388A - Image pickup device and image signal processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide the image pickup device and the image signal processing unit to solve problems such that an HDTV television camera is not proper to a hard endoscope television camera because the size is large and the weight is heavy, the wide aspect ratio is not in use, valid image information of the character image is missing when a character is outputted with an image simultaneously. SOLUTION: Picture elements of solid-state image pickup elements 19B, 19R, 19G1, 19G2 are 768 picture elements in the horizontal direction and 494 picture elements in the vertical direction, which are equivalent to an aspect ratio of 4:3. The solid-state image pickup elements 19G1, 19G2 are arranged while being deviated by one picture element in the vertical direction and by one 1/2 picture element pitch in the horizontal direction. The solid-state image pickup elements 19B, 19R are arranged by 172 picture element in the vertical direction with respect to the G solid-state image pickup elements. Thus, the image signal whose aspect ratio is 4:3 with vertical resolution nearly twice vertical resolution of the NTSC system is obtained. A synchronizing signal in compliance with the HDTV studio standards is added to the image signal and the resulting signal is outputted.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus and an image signal processing apparatus, and more particularly to a medical or industrial rigid endoscope for obtaining vertical resolution about twice that of a standard television system such as the NTSC system. The present invention relates to an optimal imaging device and image signal processing device.

[0002]

2. Description of the Related Art A rigid endoscope has a diameter of 10 mm and a length of 300.
The endoscope is composed of a combination of a plurality of lenses in a stainless steel cylinder of about mm. Particularly in the medical field, surgery using this rigid endoscope has been rapidly spread in recent years because of its advantages such as low invasiveness, high safety, and quick recovery after surgery. In surgery using such a rigid endoscope, a subject is usually imaged by an NTSC imaging device (hereinafter, also referred to as a TV camera) attached to the rigid endoscope, and the obtained image signal is displayed on a television receiver. It is done while monitoring.

In order to further improve the safety of the above-mentioned surgery, it is necessary to increase the resolution and quality of the output image signal of the television camera. For this reason, the NTSC system television camera mounted on the rigid endoscope was initially a single-panel type using one solid-state image sensor, but in recent years, three primary colors of light have been independently used to improve image quality. A three-plate type television camera using a single solid-state image pickup element has come into use.

In the NTSC system three-panel television camera, the spatial resolution is increased to about 750 TV lines for the horizontal resolution, but the vertical scanning has an effective scanning line number of 485 for the NTSC system.
The number of lines is about 350 because the number of lines is 2: 1 interlaced scanning. Therefore, in order to realize higher resolution, it is necessary to use a TV camera of a system having a larger number of scanning lines, instead of a TV camera of the NTSC system.

[0005]

As a television camera having a larger number of scanning lines than the NTSC system, the NTSC system has been proposed.
2. Description of the Related Art A television camera of HDTV (High Definition TV) system, such as a high-definition system, having approximately twice as many scanning lines as that of the system is conventionally known. This HDT
V-type TV cameras have been commercialized for broadcasting and commercial use, but require about 5 times the number of pixels for broadcasting stations and about 2.5 times the number of pixels for commercial use as compared to TV cameras for NTSC systems. Therefore, the image sensor has a small optical size of 2/3 inch, which is larger and heavier than 1/3 inch, which is the mainstream of the NTSC consumer TV cameras. turn into. Therefore, as a TV camera for a rigid endoscope in which the TV camera is manually operated, the HDTV TV camera is unsuitable because it is large and heavy.

On the other hand, an image obtained from a rigid endoscope needs to have a circular shape and a wide field of view, so that the image formed on the image sensor is circumscribed in the effective pixel area of the image sensor.
Or, it is set between the circumscribed and the inscribed. Therefore, NTSC
In the case of the television camera of the system, the image obtained from the endoscope is inscribed in the effective pixel area 2 of the image sensor as shown by 1 in FIG. 16A, or as shown by 3 in FIG. Thus, the effective pixel area 2 of the image sensor is set to an intermediate setting between inscribed and circumscribed.

On the other hand, if an HDTV television camera is used for a rigid endoscope, the HDTV system has a wide effective pixel area with an aspect ratio of 16: 9, and thus an image obtained from the endoscope is obtained. Is inscribed in the effective pixel area 5 of the image sensor as shown by 4 in FIG. 16C or inscribed in the effective pixel area 5 of the image sensor as shown by 6 in FIG. 16D. It is set in the middle between circumscribed and. Therefore, as can be seen from FIGS. 16A to 16D, when the HDTV system television camera is used as the rigid endoscope, in the case of FIG. 16C, the unused portion of the effective pixel area 5 of the image sensor is used. In the case of FIG. 7D, too many regions cannot be imaged, and the wide aspect ratio of 16: 9 is completely wasted.

In the conventional image signal processing device, the date,
When outputting characters (characters or symbols) such as time and various mode information of the TV camera at the same time as the image, FIG.
As shown in, the character image 9 is mixed with the effective image and displayed in a part of the effective image area 8 of the vertical blanking area 7 and the effective image area 8 of the screen. Therefore, conventionally, the effective image information of the portion where the character image 9 is mixed is lost. In surgery using a rigid endoscope, not only information in the central portion of the image but also information in the peripheral portion is important for the safety of the surgery, and the above-mentioned lack of effective image information is a problem.

[0009] The present invention has been made in view of the above points,
It has the same aspect ratio as the standard television system, and
An object of the present invention is to provide an image pickup device and an image signal processing device that can output an image signal with improved vertical resolution.

It is another object of the present invention to provide an image pickup device and an image signal processing device capable of outputting an image signal which can be used in an HDTV system device without any change.

Still another object of the present invention is to provide an image pickup apparatus and an image signal processing apparatus capable of displaying a character image without missing an effective image.

[0012]

In order to achieve the above object, the image signal processing apparatus of the present invention comprises a color separation optical system for separating incident light from a subject into at least three primary color lights, and a color separation optical system. Each of the primary color lights is received to obtain a primary color signal, each of which is composed of a plurality of pixels corresponding to the aspect ratio of the standard television system, and is arranged such that the pixel positions in the vertical direction of each have a specific positional relationship. And a plurality of solid-state image pickup devices, and output vertical color signals of the plurality of solid-state image pickup devices have a vertical resolution about twice that of a standard television system, and
The present invention is characterized by having a signal processing means for generating an image signal of a horizontal scanning frequency of the HDTV studio standard, and an adding means for adding a synchronizing signal of the HDTV studio standard to the output image signal of the signal processing means and outputting the signal.

Further, the image pickup apparatus of the present invention includes a color separation optical system for separating incident light from a subject into blue light, red light, first and second green light, and blue light from the color separation optical system. A first pixel composed of a plurality of pixels each of which receives the red light and the first and second green lights separately to obtain a primary color signal and whose horizontal and vertical pixel numbers correspond to the aspect ratio of the standard television system, respectively. To a fourth solid-state image sensor, at least one of the first solid-state image sensor that receives blue light and the second solid-state image sensor that receives red light receives first and second green light. Among the third and fourth solid-state image pickup elements, the third solid-state image pickup element is relatively displaced with respect to the third solid-state image pickup element by 1/2 pixel pitch in the vertical direction, and the third and fourth solid-state image pickup elements are relatively arranged. At least one pixel pitch in the vertical direction Characterized in that the arrangement was.

The image pickup apparatus of the present invention includes a color separation optical system for separating incident light from a subject into blue light, red light and green light, and blue light, red light and green light from the color separation optical system, respectively. First to third solid-state image pickup devices of an all-pixel reading system, each of which is separately received to obtain a primary color signal and is composed of a plurality of pixels whose horizontal and vertical pixel numbers correspond to the aspect ratio of the standard television system. And a second solid-state image sensor for receiving blue light and a second solid-state image sensor for receiving red light are at least perpendicular to the third solid-state image sensor for receiving green light. It is characterized in that the arrangement is shifted by a 1/2 pixel pitch.

In the image pickup apparatus and the image signal processing apparatus of the present invention, the vertical resolution is about twice that of the standard television system, and the HDTV studio standard sync signal is added to the HDTV studio standard horizontal scanning frequency image signal. Since the image signal is output in the same manner as the standard television system, a high-definition image signal having a higher vertical resolution than the standard television system image signal can be displayed with the same aspect ratio 4: 3 as that of the standard television system.

Further, the image signal processing device of the present invention has a color separation optical system, a plurality of solid-state image pickup devices, and a vertical resolution about twice as high as that of a standard television system from output primary color signals of the plurality of solid-state image pickup devices. Also, a signal processing means for generating an image signal of a horizontal scanning frequency of the HDTV studio standard, a first adding means for adding an HDTV studio standard synchronization signal to the output image signal of the signal processing means, and outputting the same. It is characterized by further comprising second adding means for adding a character to the effective image scanning period of the image signal to which the synchronizing signal is added by the adding means and the scanning period other than the vertical blanking period.

In the image signal processing device of the present invention, when displaying an image signal of high definition having a higher vertical resolution than that of the image signal of the standard television system at the same aspect ratio 4: 3 as that of the standard television system. Character data can be displayed in an area other than the effective image scanning period.

[0018]

Next, an embodiment of the present invention will be described. The image pickup device and the image signal processing device according to the first embodiment of the present invention use a plurality of image pickup devices compatible with the NTSC system and have an aspect ratio of 4: 3, which is about twice the vertical resolution of the NTSC system. An image signal having a vertical resolution of 750 TV lines is obtained.

The image pickup apparatus according to the first embodiment has the color separation optical system shown in FIG. 1, and the pixels of a plurality of solid-state image pickup devices constituting the color separation optical system are arranged as shown in FIG. ing. The image signal processing device according to the first embodiment is composed of the image pickup device according to the first embodiment and the signal processing circuit shown in FIGS.

First, the color separation optical system of the image pickup apparatus will be described with reference to FIG. 1. This color separation optical system includes a B prism 10 for extracting a blue (B) light component from incident light,
R prism 1 for extracting a red (R) light component from light transmitted from the B prism 10 through the dichroic film 10a
2, a G prism 14 for extracting a green (G) light component from the transmitted light of the R prism 12, a half mirror 16 provided in the G prism 14, and a dichroic film 10a and a B prism 10 from the B prism 10. The solid-state image pickup device 19B for blue into which the blue light reflected by each surface and extracted is incident through the B trimming filter 13.
And the red light reflected and extracted by the dichroic film 12a of the R prism 12 and the incident surface of the R prism 12, respectively, is reflected by the red solid-state image sensor 19R that is incident through the R trimming filter 15, and the half mirror 16. The first solid-state image sensor for green light 19G1 on which green light is incident through the G trimming filter 17, and the second solid-state image sensor for green light 1 on which green light transmitted through each of the half mirror 16 and the G trimming filter 18 is incident.
It is composed of 9G2.

Each of the solid-state image pickup devices 19B, 19R, 19G1 and 19G2 is composed of a charge coupled device (CCD), and is composed of, for example, 768 pixels in the horizontal direction and 494 pixels in the vertical direction, which corresponds to an aspect ratio of 4: 3 in the NTSC system. Has been done.

Further, the solid-state image pickup devices 19B, 19R, 19
G1 and 19G2 are arranged so as to have the pixel array shown in FIG. In FIG. 2, uppercase letters G, B, and R are pixels read in odd fields, lowercase letters g, b, and r are even pixels, and “G” and “g” are green signals, and “R” and “r”. "Indicates a red signal, and" B "and" b "indicate a blue signal. In addition, capital letters "1" and "2" indicate two G solid-state image pickup devices 19G1.
And 19G2, respectively. Furthermore, “rb” and “RB” are R signal and B
Signals are received simultaneously and separately for each solid-state image sensor 1
Pixels read from 9B and 19R.

Solid-state image pickup devices 19G1 and 19G2 for G
As shown in FIG. 2, the pixels are arranged with a vertical shift of 1 pixel and a horizontal shift of 1/2 pixel pitch. However, since the vertical resolution can only obtain the resolution corresponding to the pixels of the G solid-state image pickup devices 19G1 and 19G2, the B and R solid-state image pickup devices 19B and 19R are connected to one of the G solid-state image pickup devices 19G and 19R to improve the resolution. It is arranged so as to be displaced in the vertical direction by a ½ pixel pitch with respect to the solid-state image pickup device for use.

The luminance signal (Y) that determines the vertical resolution of the image is, for example, Y = 0.212R + 0.701G + 0.087B in the HDTV studio standard (ITU-R recommendation 709) defined by the International Telecommunication Union (ITU). Since it is represented by (1), it is mainly determined by the G signal.
It also depends on the R and B signals. Therefore, the vertical resolution can be improved by effectively utilizing the R solid-state image sensor 19R and the B solid-state image sensor 19B to generate the luminance signal Y. The solid-state image sensor 19 for G
The reason why G1 and 19G2 are shifted from each other in the horizontal direction by 1/2 pixel pitch is to improve the horizontal resolution.

Four solid-state image pickup devices 19B, 19R, 19
Since G1 and 19G2 are driven simultaneously, the same pixel of (m, n) in FIG. 2 is read out at the same time. For example, G1m, n, G2m, n, RBm, n
Four (= Rm, n, Bm, n) are read simultaneously in the odd field.

Each solid-state image pickup device 19B, 19R, 19G1
The readout processing of the image pickup signals from the signals 19G2 and 19G2 is performed by the signal processing circuit shown in FIG. In the figure, B
B pixel data DB and R pixel data DR extracted from the respective solid-state image pickup devices 19B and 19R for R and R and obtained through an A / D converter (not shown) are stored in the field memory 2
5, 26 and the frame synthesizing circuits 27, 28 synthesize the frames and input them to the corresponding vertical high-pass filters 29, 30. The vertical high-pass components extracted from the vertical high-pass filters 29 and 30 are supplied to adders 31 and 32, respectively, and are subjected to addition calculation by the following equation to obtain the vertical high-pass frequency signal V.
H1 and VH2 are generated.

[0027]

[Equation 1] On the other hand, each input digital signal (pixel data) DB, D
R, DG1 and DG2 are supplied to the matrix circuit 33, and the luminance signals Y1, Y2, y1 and y2 are generated by the matrix calculation of the following equations (4) to (7).

Y1m, n = 0.701 G1m, n + {0.212 (Rm, n + Rm + 1, n) / 2} +0.087 (Bm, n + Bm + 1, n) / 2 (4) Y2m, n = 0.701G2m, n + 0 .212Rm, n + 0.087Bm, n (5) y1m, n = 0.701g1m, n + {0.212 (rm, n + rm + 1, n) / 2} +0.087 (bm, n + bm + 1, n) / 2 (6) y2m, n = 0.701g2m, n + 0.212rm, n + 0.087bm, n (7) Further, the matrix circuit 33 has the following equations (8) to (11).
Color difference signals (RY), (BY), (ry) according to the formula
And (by) are generated and output.

(RY) m, n = Rm, n-Ym, n (8) (BY) m, n = Bm, n-Ym, n (9) (ry) m, n = rm, n−ym, n (10) (by) m, n = bm, n−ym, n (11) The luminance signals Y1 and y output from the matrix circuit 33.
1 is supplied to the adder 34 and is added to the signal from the adder 31 to form a wideband high-frequency additional signal Y1 ^* represented by the equation (12).

Y1 ^* m, n = Y1m, n + VH1m, n (12) Also, the luminance signal Y2 output from the matrix circuit 33.
And y2 are supplied to the adder 35 and added with the signal from the adder 32 to be a wideband high-frequency added signal Y2 ^* represented by the equation (13).

Y2 ^* m, n = Y2m, n + VH2m, n (13) The changeover switch 36 selects the high frequency band additional signal Y1 ^* on the basis of the field pulse and the output signal y1 of the matrix circuit 33 on the even field. Select as is. Similarly, the changeover switch 37 selects the high frequency band additional signal Y2 ^* for the odd field and the output signal y2 of the matrix circuit 33 for the even field as it is based on the field pulse.

The double speed conversion circuit 38 uses these changeover switches 3
Based on the output signals of 6 and 37 and the output color difference signal of the matrix circuit 33, the luminance signal Y and the color difference signals RY and B-
Y is generated and output respectively. This double speed conversion circuit 38
The circuit itself is a known circuit, and has a structure as shown in FIG. 4, for example. The luminance signals Y1 ^* and y1, Y2 ^* and y2 from the changeover switches 36 and 37 of FIG.
1, 43 and the matrix circuit 33 of FIG.
The color difference signals (BY) and (by), (RY), and (ry) from the color difference signals are input to the line memories 46 and 50 of FIG. 4, respectively, and the pixel data for one line is stored in each. To be done.

The horizontal scanning frequency of these input signals is H
1/2 of horizontal scanning frequency f _H of DTV studio standard signal
This is double the frequency of 16.875 kHz. The signal readout scanning frequency of the NTSC solid-state image sensor is 15.75.
Although it is kHz, since this value is almost the same as f _H / 2, it can be used without taking any special measures.

The line memories 41, 43, 46 and 50 store the input pixel data for one line respectively, and at the time when the line memories 42, 44, 47 and 48, 5 of the next stage are stored.
1 and 52 are output and stored at high speed respectively. Based on the output control signal of the output control unit 54, the line memory 4
The signals stored in 2, 44, 47 and 48, 51 and 52 are horizontal scanning frequencies f _H of the HDTV studio standard signal.
Is read.

The pixel data read from the line memories 42 and 44 is input to the changeover switch 45, the pixel data read from the line memories 47 and 48 is input to the changeover switch 49, and read from the line memories 51 and 52. The output pixel data is input to the changeover switch 53. The changeover switches 45, 49, and 53 change the input pixel data to 1 by the control signal from the output control unit 54, respectively.
Scan conversion is performed by alternately selecting and outputting each line. The signals thus obtained from the changeover switches 45, 49 and 53 are the horizontal scanning frequency 33.
It becomes a signal of 75 kHz.

Of the signals of the horizontal scanning frequency 33.75 kHz of the HDTV studio standard extracted as described above from the double speed conversion circuit 38 having the above-mentioned configuration, the color difference signal (R
-Y) and (B-Y) are multiplication circuits 6 shown in FIG. 5, respectively.
1 and 62 are input separately and the predetermined coefficient "0.63
5 "and" 0.539 "are multiplied to obtain color difference signals P _R and P _B, and then adders 64 and 65 add a sync signal determined by the HDTV studio standard from the sync signal generation circuit 63. It is output to the output terminals 67 and 68.

At the same time, the horizontal scanning frequency 3 of the HDTV studio standard output from the double speed conversion circuit 38 is output.
The 3.75 kHz luminance signal Y is added to the synchronizing signal defined by the HDTV studio standard from the synchronizing signal generating circuit 63 by the adder 66 and output to the output terminal 69. The luminance signal Y thus obtained is, for example, 15 in the horizontal direction.
36 pixels, 988 vertical pixels, about 4 in NTSC system
This is a high-resolution signal corresponding to twice the number of pixels. Moreover,
Each of the Y, P _R, and P _B signals has an aspect ratio of NTS.
Since it is 4: 3, which is the same as the C system, unlike HDTV signals, pixels that are wasted as a television camera for a rigid endoscope that captures a circular image can be significantly reduced, and an optimal high-resolution television camera is realized. It

According to the first embodiment described above,
Compared to a normal NTSC 3-panel TV camera, only one image pickup element needs to be added, so that it can be realized with a size and weight almost equal to those of the current 3-panel TV camera for rigid endoscopes. Further, for the image signal thus obtained, H
Since the synchronizing signal defined in the DTV studio standard is added and output, the HDTV signal recording device can be used without modification for recording required during surgery. HDTV
The signal recording device includes a W-VHS system VTR and a UNIHI system VTR. In particular, since the W-VHS system VTR is a device developed for consumer use, an inexpensive system configuration is possible.

Next, a second embodiment of the present invention will be described. The image pickup device and the image signal processing device of the second embodiment use a plurality of so-called all-pixel type image pickup devices which are compliant with the NTSC system and which can read all pixels in one field. , The vertical resolution about twice that of the NTSC system is obtained.

The image pickup apparatus according to the second embodiment has the color separation optical system shown in FIG. 6, and the pixels of a plurality of solid-state image pickup devices constituting the color separation optical system are arranged as shown in FIG. ing. The image signal processing device of the second embodiment is composed of the image pickup device of the second embodiment and the signal processing circuit shown in FIG.

First, a solid-state image pickup device (CCD) of the all pixel reading type will be described. All pixel readout method C
The CD is an imaging device developed for a non-interlaced system such as the EDTV-II system or a still image capturing device, and has a configuration shown in FIG. Of the plurality of photosensors 80 corresponding to the pixels arranged in a two-dimensional matrix, each of the plurality of photosensors 80 arranged in the vertical direction is connected to the corresponding vertical transfer CCD 82. The output side of the vertical transfer CCD 82 is connected to the horizontal transfer CCDs 83 and 84. The output sides of the horizontal transfer CCDs 83 and 84 are connected to output terminals via amplifiers 85 and 86. ΦV1, φV2 as vertical transfer clocks,
φV3 is input to the vertical transfer CCD 8 and φH1 and φH2 are used as horizontal transfer clocks for the horizontal transfer CCDs 83 and 8
4 has been entered.

This all-pixel readout type CCD has a normal 2
There are two main differences from the pixel mixed readout CCD. The first difference is that the charge signals from two vertically adjacent photosensors 80 are not mixed by the vertical transfer CCD 82. The second difference is the vertical transfer CCD 8
The charge signal vertically transferred by 2 is transferred and output by the horizontal transfer CCD 83 for reading the pixels of the even lines and the horizontal transfer CCD 84 for reading the pixels of the odd lines, so that two horizontal transfer CCDs are arranged in parallel. This is a necessary point for.

Since one horizontal transfer CCD is added to the normal two-pixel mixed read CCD, the cost will be slightly higher, but the transfer rate of each horizontal transfer CCD is the normal two-pixel mixed read CCD. Since the transfer speed is the same as that of, the technical difficulty is not high. So, for example, with 724 horizontal pixels and 494 vertical effective pixels,
An all-pixel readout type CCD with an aspect ratio of 4: 3 is used to realize an image pickup device that obtains a vertical resolution about twice that of the NTSC type.

As shown in FIG. 6, the color separation optical system of the image pickup apparatus used in the second embodiment includes a B prism 10 for extracting a blue (B) light component from incident light, and a B prism 10
R prism 12 for extracting a red (R) light component from the light transmitted from the prism 10 through the dichroic film 10a
The G prism 20 for extracting a green (G) light component from the transmitted light of the R prism 12, and the blue light reflected by the incident surface of the dichroic film 10a and the B prism from the B prism 10 and extracted, are B trimmed. Blue solid-state image sensor 21B incident through the filter 13
And the solid state image pickup device 21R for red into which the red light reflected and extracted by the dichroic film 12a of the R prism 12 and the incident surface of the R prism 12 enters through the R trimming filter 15, the G prism 20 and the G trimming filter. The solid-state image pickup device 21G for green on which the green light transmitted respectively through 18 is incident.

Solid-state image pickup devices 21B, 21R and 21G
Are composed of CCDs, respectively, and have an aspect ratio of 4: 3 in the NTSC system, for example, 7 in the horizontal direction.
It is composed of 24 pixels and 494 pixels in the vertical direction. The pixel array of these solid-state imaging devices 21B, 21R, and 21G is set to the pixel array shown in FIG. FIG. 7 shows the positional relationship in the horizontal and vertical directions of each sensor viewed from the light incident side of the color separation optical system shown in FIG. In FIG. 7, “R, B” is the pixel arrangement position on the screen of each of the solid-state imaging devices 21B and 21R, and “G” is the solid-state imaging device 21.
The pixel arrangement position of G on the screen is shown, and “n, m” indicates that the pixel position coordinate in the image sensor is (n, m). Also, the order of horizontal pixel positions on the screen for displaying the image obtained by this imaging device is indicated by "k" or the like, and the line order in the vertical direction is indicated by "j" or the like.

First, the vertical direction will be described. As shown in FIG. 7, the solid-state image pickup devices 21B and 21R are vertically displaced from the solid-state image pickup device 21G by 1/2 pixel pitch. As a result, the lines of the solid-state image pickup devices 21B and 21R are located between the lines of the solid-state image pickup device 21G, and the number of lines as a whole is about twice that of the NTSC system, which is about 2 times the vertical resolution of the NTSC system. Double vertical resolution can be obtained.

Next, the horizontal direction will be described with reference to FIG.
As shown in, the solid-state image pickup devices 21B and 21R are arranged so as to be shifted by a 1/2 pixel pitch in the horizontal direction with respect to the solid-state image pickup device 21G. As a result, the pixels of the solid-state imaging devices 21B and 21R are located between the pixels of the solid-state imaging device 21G, and the number of pixels in the horizontal direction is doubled as a whole, and the horizontal resolution can be improved. .

Luminance signal Y which determines the vertical resolution of the image
Is mainly determined by the G signal as described in the first embodiment, but also depends on the R signal and the B signal. Therefore, the R solid-state image sensor 21R and the B solid-state image sensor 2
By effectively using 1B to generate the luminance signal Y,
The vertical resolution can be improved.

Each solid-state image pickup device 21R, 21B and 21G
The process of reading the image pickup signal from is performed by the signal processing circuit shown in FIG. In the figure, the B pixel data DB, the R pixel data DR, and the G pixel data DG extracted from each of the solid-state imaging devices 21B, 21R, and 21G are supplied to the read processing unit 71, where the A / D conversion and the double speed conversion are performed. After that, it is supplied to the matrix circuit 75 to generate the luminance signal Y and the color difference signals R-YL and B-YL.

Here, the low range brightness by the matrix circuit 75 is
Degree signal Y Generation of L will be described. Matrix circuit 7
5 is the position of (2k-1, j) on the screen shown in FIG.
Position, that is, the R and B signals at the G position in the figure
Low frequency component RL_{2k-1, j}, BL_{2k-1, j}Equation (14), (1
Generated as the average value of the surrounding 4 pixels as shown in equation 5)
In addition, this low frequency component RL_{2k-1, j}, BL_{2k-1, j}And bandwidth
, The low frequency component GL of the G signal_{2k-1, j}To (1
6) Generate according to the equation.

[0051]

(Equation 2) Then, the matrix circuit 75 uses the low-frequency components GL, RL, and BL calculated in this way according to the following equation similar to the luminance signal of the HDTV studio standard shown in the equation (1),
The low band luminance signal YL _{2k-1, j} is generated.

YL _{2k-1, j} = 0.212 RL _{2k-1, j} +0.701 GL _{2k-1, j} + 0.087BL _{2k-1, j} (17) Low-frequency luminance signal YL _2k- generated in this way The position of _{1, j on} the screen is the position of G of (2k-1, j) in FIG. The low-frequency luminance signal YL generated in the same manner is located at the other G positions. As shown in FIG. 7, since the position of G on the screen is located only at an odd number in the horizontal direction, the low-frequency luminance signal YL is located only at an odd number in the horizontal direction.

Therefore, at even-numbered pixel positions on the screen in the horizontal direction, the average value of the low-frequency luminance signals YL of two adjacent pixels in the horizontal direction is calculated and interpolated as the low-frequency luminance signal YL ^* . Therefore, the low-frequency luminance signal YL ^* _{2k, j at} the position (2k, j) on the screen is calculated by the following equation (18).

YL ^* _{2k, j} = (YL2k _{-1, j} + YL2k _{+ 1, j} ) / 2 (18) The low-frequency luminance signals YL and YL ^* thus generated
(Hereinafter, unless otherwise specified, a low-frequency luminance signal is collectively referred to as YL), so that an odd field (first
This means that the low-frequency luminance signal YL at all pixel positions in the field) has been generated.

Next, a method of generating the high frequency luminance signal YH will be described. The high band luminance signal YH includes a horizontal high band luminance signal YHH in the horizontal direction of the screen and a vertical high band luminance signal YVH in the vertical direction of the screen. Matrix circuit 75
Generates a horizontal high frequency luminance signal YHH. That is, the matrix circuit 75 generates the horizontal high-frequency luminance signal YHH at the odd-numbered pixel position (position G in FIG. 7) in the horizontal direction of the screen by using the G signal at that pixel position and the G signals on both sides thereof. For example, the horizontal high-frequency luminance signal YHH at the 2k-1th pixel position on the j-th line is generated according to the equation (19).

[0056]

(Equation 3) For the horizontal high-frequency luminance signal YHH at even-numbered pixel positions in the horizontal direction of the screen, the matrix circuit 75 averages the sum of the horizontal high-frequency component RHH of the R signal at that pixel position and the horizontal high-frequency component BHH of the B signal. Generate as a value. Therefore, for example, the horizontal high-frequency luminance signal YHH at the 2k-th pixel position on the j-th line is generated according to the equation (20).

[0057]

(Equation 4) As a result, the horizontal high frequency luminance signal YHH is generated for all pixel positions in the odd field.

Next, a method of generating the vertical high frequency luminance signal YVH will be described. As described above, in the odd field, the low-frequency luminance signal YL and the horizontal high-frequency luminance signal YHH are generated at all pixel positions. However, neither YL nor YHH is present at all pixel positions in the even field. Therefore, even if the luminance signal Y is generated by interpolating the signal in the even field with the signal in the position in the odd field, the vertical resolution is not improved.

Therefore, in this embodiment, in order to improve the vertical resolution, the vertical high frequency component of the luminance signal Y is generated at each pixel position in the even field. That is, the pixel data D of the B signal extracted by the read processing unit 71 of FIG.
B is supplied to the vertical high-pass filter 72, the vertical high-pass component BVH of the B signal is generated by the equation (21), and
The pixel data DR of the R signal extracted from the read processing unit 71 is supplied to the vertical high-pass filter 73 (22).
The vertical high frequency component RVH of the R signal is generated by the equation.

[0060]

(Equation 5) The vertical high-pass components BVH and RVH extracted from the vertical high-pass filters 72 and 73 are respectively supplied to the adder 74 and added to generate a vertical high-pass luminance signal YVH represented by the following equation (23). .

[0061]

(Equation 6) A luminance signal Y having a high vertical resolution is generated from the low-frequency luminance signal YL, the horizontal high-frequency luminance signal YHH, and the vertical high-frequency luminance signal YVH obtained as described above. For odd-numbered fields, the matrix circuit 75 outputs the luminance signal Y obtained by adding the low-frequency luminance signal YL and the horizontal high-frequency luminance signal YHH at the same pixel position. Therefore, j line 2
Each of the (k-1) th and 2kth luminance signals is represented by Expression (24).

[0062]

(Equation 7) On the other hand, for even fields, the matrix circuit 75
The luminance signal Y of the odd field generated by
The vertical high-frequency luminance signal YVH from the adder 74 is added in the adder 76 to generate the luminance signal Y. Therefore, j
The 2k-1th and 2kth luminance signals of the +563 line are represented by the equation (25).

[0063]

(Equation 8) The changeover switch 77 shown in FIG. 8 selects the luminance signal Y represented by the equation (24) output from the matrix circuit 75 as it is in the odd field based on the field pulse and adds it in the adder 76 in the even field. Was (2
The luminance signal Y represented by the equation 5) is selected. This allows
The vertical resolution of the luminance signal Y can be improved.

The matrix circuit 75 uses color difference signals (R-YL) and (B-Y) by using a subtracter (not shown).
L). The output processing unit 78 includes the matrix circuit 7
The color difference signals (R-YL) and (B
-YL) and the luminance signal Y from the changeover switch 77 are respectively received as input signals, and D / A for each of these input signals is received.
The converted color difference signals (R-YL) and (B-YL), which are analog signals, and the luminance signal Y are output.

The color difference signals (R-
YL) and (B-YL) are multiplied by predetermined coefficients “0.635” and “0.539” according to FIG. 5 of the first embodiment, and then a HDTV studio standard synchronization signal is added. The color difference signals P _R and P _B are obtained, and the luminance signal Y is similarly made a luminance signal Y by adding a synchronizing signal of the HDTV studio standard according to the configuration of FIG.

The luminance signal Y obtained in the second embodiment is, for example, 1448 horizontal pixels and 98 vertical pixels.
This is a high-resolution image signal corresponding to about four times as many pixels as the 8-pixel NTSC system.

As described above, according to the second embodiment, as the rigid endoscope television camera, NT is used with the aspect ratio of 4: 3 which is less wasteful of the image area as compared with the HDTV system.
Image signal with vertical resolution about twice that of SC system
It is realized with almost the same size and weight as the SC type RGB three-plate television camera. Further, equipment such as a recording device compatible with the HDTV system can be used without any change.

According to the HDTV studio standard, the number of scanning lines per frame is 1125 and the vertical blanking is 90. On the other hand, in the above embodiment, since the HDTV studio standard sync signal is added to the image signal to obtain the vertical resolution twice as high as that of the NTSC system with the aspect ratio of 4: 3, the image signal is output.
When the number of vertical pixels per frame of the above image signal is set to 988 pixels, 47 pixels per frame (= 11125-
988-90), there is a non-signal period which is neither an effective image scanning line nor vertical blanking.

FIG. 10 is a diagram showing an example of this no-signal period. When the image signal of each of the above-mentioned embodiments is displayed, in addition to the vertical blanking period 90 and the effective image area 91, the 41st period is displayed.
Line 63 to Line 63 and Line 603 to 6
There is a signalless period 92 up to the 26th line.

Here, since some character generator ICs (integrated circuits) currently commercialized have a vertical direction of about 18 bits, a character can be displayed with 36 lines per frame. On the other hand, as described above, since there are about 47 non-signal periods 92, as shown in FIG. 10, for example, the region 93 from the 43rd line to the 60th line and the 605th line to the 622nd line is used. As a result, one line of characters can be displayed.

In FIG. 10, the character is displayed at the upper part of the screen, but the character may be set at the lower part of the screen. However, when recording / reproducing to / from the VTR, there is a switching point of the recording / reproducing head at the bottom of the screen, so it is desirable to avoid scanning lines near the switching point. Further, since the time code is recorded on the 603rd line in the so-called W-VHS type VTR,
The 603rd line should not be used as a character display area.

Since the number of pixels in the vertical direction of the conventional NTSC type image pickup device is at least 485 pixels, in this embodiment, an image having a vertical resolution twice that of the NTSC type is obtained with an aspect ratio of 4: 3. The minimum number of vertical pixels per frame of signal is 970. In this case, the non-signal period becomes maximum, and 65 lines (= 1
125-970-90) no signal period (the respective scanning periods from the 41st line to the 72nd line and from the 603rd line to the 635th line of the scanning line number of the HDTV studio standard). Of course, the no-signal period in this case can be used as the character display area.

Next, a third embodiment of the image signal processing apparatus of the present invention which enables the character display will be described. FIG. 11 shows a third image signal processing apparatus according to the present invention.
FIG. 2 is a block diagram of the embodiment. The color separation optical system of this embodiment has a configuration using, for example, the three solid-state imaging devices 21G, 21R, and 21B shown in FIG.

In FIG. 11, the solid-state image pickup device 21 is based on the read clock generated by the read controller 150 in synchronization with the reference clock CK0 of 74.25 MHz.
Odd line G signal G1 and even line G signal G2 read from G, odd line R signal R1 and even line R signal R2 read from solid-state imaging device 21R, odd line read from solid-state imaging device 21B The B signal B1 and the even line B signal B2 are read by the read processing unit 10 respectively.
Input to 0G, 100R and 100B, where A / D
G signal, R signal and B after conversion and double speed conversion processing are performed.
It is converted into a signal and input to the arithmetic unit 200.

Read processing units 100G, 100R and 10
0B has the same structure, and has a structure shown by 100 in FIG. To explain the operation of the read processing unit 100, the odd line signal and the even line signal are pre-amplified by the preamplifiers (PA) 102 and 104, respectively, and then the signal processing shown in FIG. 11 is performed in synchronization with the reference clock CK0. 18.56 generated by the clock generator 170
Analog-digital conversion is performed by the A / D converters 106 and 108 based on the second clock CK2 of 25 MHz,
Further, the read pulse CKR is supplied to the double speed conversion circuits 110 and 112, and is then written into the internal line memory for each line based on the write pulse CKW generated by the line memory input / output control unit 160 of FIG.
And is subjected to double speed conversion processing.

The odd-numbered line signal and the even-numbered line signal subjected to the double speed conversion are input to the changeover switch 114, where they are generated by the synchronizing signal generator 180 of FIG. 11 in synchronization with the reference clock CK0 of 74.25 MHz. , HD
HDTV is selected alternately based on a line-switching pulse of 16.875 kHz, which is a frequency 1/2 times the horizontal scanning frequency f _H of the TV studio standard signal, and is synthesized in time series.
The signals are output in line order as primary color signals of the horizontal scanning frequency f _H of the studio standard signal. Therefore, the G signal from the read processing unit 100G in FIG. 11, the R signal from the read processing unit 100R, and the B signal from the read processing unit 100B are extracted and input to the arithmetic unit 200 in FIG. It is converted into a luminance signal Y and color difference signals P _B and P _R having a vertical resolution about twice that of the NTSC system.

The arithmetic unit 200 is constructed as shown in the block diagram of FIG. 13, for example. The operation of the arithmetic unit 200 will be described with reference to FIG. 13. The G signal, R signal, and B signal correspond to the arithmetic circuits 202, 206, and 21.
2 is supplied to the above formula (16), formula (14), (15)
After the calculation according to the formula is performed, it is commonly input to the calculation circuit 218, where the low-frequency luminance signal Y is calculated according to the formula (17).
Calculated as L. This low-frequency luminance signal YL is further input to the arithmetic circuit 222 and is calculated according to the equation (18) to be generated as the low-frequency luminance signal YL ^* .

The G signal, the R signal and the B signal are supplied to the corresponding arithmetic circuits 204, 208 and 214, and are calculated as horizontal high frequency components GHH, RHH and BHH, respectively. The horizontal high-frequency components RHH and BHH extracted from the arithmetic circuits 208 and 214 are added by the adder 226, and then supplied to the multiplication circuit 228 to be multiplied by the coefficient ½, thereby obtaining the equation (20). The horizontal high-frequency luminance signal YHH at the even-numbered pixel position in the horizontal direction of the screen represented by The horizontal high-frequency luminance signal YHH output from the multiplication circuit 226 and the horizontal high-frequency component GHH extracted from the arithmetic circuit 204, that is, the horizontal high-frequency luminance signal YHH at an odd-numbered pixel position in the horizontal direction of the screen, After being combined by the combining circuit 220, they are output to the adder 234.

Further, the R signal and the B signal are supplied to the corresponding arithmetic circuits 210 and 216, respectively, and the (2
After being converted into the vertical high-frequency component RVH of the R signal and the vertical high-frequency component BVH of the B signal by the calculation by the equations (2) and (21), they are respectively input to the arithmetic circuit 224 and the above (23).
The calculation according to the formula is performed, and the vertical high-frequency luminance signal YVH is generated. The vertical high-frequency luminance signal YVH is selectively output by the switch circuit 232 only to the even field and supplied to the adder 234.

The adder 234 outputs the horizontal high-frequency luminance signal Y from the synthesizing circuit 220 at even-numbered pixel positions in the horizontal direction of the screen.
HH and arithmetic circuits 218 and 22 by the synthesis circuit 230
The low-frequency luminance signal YL obtained by synthesizing both output low-frequency luminance signals of 2 and the vertical high-frequency luminance signal YVH that has passed through the switch circuit 232 are added and synthesized. ), And in the case of an even field, the luminance signal Y expressed by the equation (25) is generated and output.

On the other hand, the low-frequency component RL of the R signal and the low-frequency component BL of the B signal extracted from the arithmetic circuits 206 and 212.
Are supplied to subtractors 236 and 238, where they are subtracted from the low-frequency luminance signal YL generated according to the equation (17) by the arithmetic circuit 218 to obtain color difference signals (RL-YL) and (BL- YL). The color difference signals (RL-YL) and (BL-YL) are applied to the multiplication circuit 240,
242 according to the coefficients (1 / 1.576) and (1 /
The output is multiplied by 1.826).

Returning to FIG. 11 again, the luminance signal Y of the horizontal scanning frequency of the HDTV studio standard and the two kinds of color difference signals, which are obtained by calculation by the calculation unit 200, are sent to the output processing unit 300, respectively. Supplied, where D /
The A signal is converted into the analog luminance signal Y and the analog color difference signals P _R and P _B , respectively, and the sync signal generator 1
H generated by 80 in synchronization with the reference clock CK0
DTV studio standard composite sync signal C.I. SYNC is added.

FIG. 14 shows a block diagram of an example of the output processing section 300. The D / A converter 302 digital-analog converts the luminance signal Y output from the arithmetic unit 200 based on the reference clock of 74.25 MHz.
Further, the D / A converters 304 and 306 respectively output the color difference signal (RL-YL) /1.5 output from the calculation unit 200.
76, (BL-YL) /1.826 is digital-analog converted based on the first clock CK1 having a frequency of 37.125 MHz generated by the signal processing clock generation section 170 shown in FIG.

The adders 308, 310 and 312 add the analog luminance signal Y and the analog color difference signal (RL-Y) output from the D / A converters 302, 304 and 306, respectively.
L) /1.576, (BL-YL) / 1. 826, and the composite sync signal C.C. The SYNC is added in a predetermined period and the luminance signal Y and the color difference signals P _R and P _B are output.

Returning to FIG. 11, the output processing section 3 will be described.
Luminance signal Y and color difference signals P _R and P _B output from
Of these, the luminance signal Y is supplied to the adder 420. This embodiment is characterized in that it has a character generator (CG) 410 controlled by a central processing unit (CPU) 400 which is a one-chip microprocessor.

The CG 410 has the HDTV studio standard shown in FIG.
The vertical synchronizing signal VD shown in FIG.
Horizontal sync signals H shown in (B), (D), and (F), respectively.
D and D are input respectively, and the vertical start position of the character generation, the horizontal start position, and the data to be displayed (date, time, various modes, etc.) are the CPU 400.
Is controlled by Here, 3 from the rise of VD
Display starts after 7 lines,
The line and the 605th line start the character display. The numbers above the waveforms in FIGS. 15A and 15C indicate the scanning line numbers of the HDTV studio standard.

The adder 420 outputs the output luminance signal (HDTV signal) shown in FIG. 15 (E) from the output processing section 300.
Is added with the character data from the CG 410, and the obtained luminance signal is output. As a result, as shown in FIG. 10, one line of character data is displayed during the no signal period. Therefore, in this embodiment, information such as date and time, various modes, and the like can be displayed or recorded in the recording device without losing the effective image. In addition, an image signal with a vertical resolution of about 4: 3, which has less image area waste compared to the HDTV system, and has a vertical resolution about twice that of the NTSC system is realized with the same size and weight as the current NTSC system RGB three-plate television camera. . Furthermore, HDT
It is possible to use equipment such as a recording device compatible with the V system without any change.

The present invention is not limited to the above-described embodiment, and for example, when the luminance signal Y is obtained, the vertical high frequency components RVH and BVH are added in the odd field and are not added in the even field. Good.

In the embodiment of FIG. 3, both the B pixel data DB and the R pixel data DR are frame-combined, but at least one of them is frame-combined and the first and second vertical signals are generated from the frame composite signal. You may make it extract the high frequency signal of. Further, only one of the vertical high frequency components RVH and BVH may be added. Furthermore,
The vertical high frequency luminance signal YVH is not limited to the expression (23),
It is also possible to calculate by the equation 6).

[0090]

(Equation 9)

[0091]

As described above, according to the present invention,
Since it is possible to display a high-definition image signal having a higher vertical resolution than the image signal of the standard television system with the same aspect ratio 4: 3 as that of the standard television system, a 16: 9 wide screen of the HDTV system is provided. The useless display area can be reduced as compared with the display using the aspect ratio. As a result, according to the present invention, it is possible to inexpensively configure a high-resolution television camera suitable for a rigid endoscope having a size and weight substantially equal to those of the current NTSC 3-panel television camera. Further, in the present invention, since the HDTV system synchronization signal is added and output, equipment such as a recording device compatible with the HDTV system can be used without any change.

Further, according to the present invention, when displaying an image signal of high definition having a higher vertical resolution than the image signal of the standard television system with the same aspect ratio 4: 3 as that of the standard television system, Since character data can be displayed in areas other than the effective image scanning period,
Information such as date, time, various modes, etc. can be displayed as a character without losing the effective image. Therefore, not only the information in the center of the image but also the information in the peripheral area can be displayed by the rigid endoscope, which is important for the safety of surgery. It is particularly suitable when applied to a television camera attached to a rigid endoscope for use during surgery because there is no loss of an effective image.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a first embodiment of an imaging device according to the present invention.

FIG. 2 is a diagram showing an example of pixel positions on a screen of a solid-state image sensor in the image pickup apparatus of FIG.

3 is a block diagram of a first embodiment of an image signal processing device according to the present invention, which has the image pickup device of FIG. 1. FIG.

FIG. 4 is a block diagram of an example of a double speed conversion circuit in FIG.

5 is a block diagram of an output side of an image signal processing device according to the present invention including the image pickup device of FIG. 1. FIG.

FIG. 6 is a configuration diagram of a second embodiment of an imaging device according to the present invention.

7 is a diagram showing an example of pixel positions on a screen of a solid-state image sensor in the image pickup apparatus of FIG.

8 is a block diagram of a second embodiment of an image signal processing apparatus according to the present invention, which has the image pickup apparatus of FIG.

9A and 9B are diagrams illustrating a reading method of a solid-state image sensor in the image pickup apparatus in FIG.

FIG. 10 is a diagram illustrating an example of an image display screen according to a third embodiment of the image signal processing device of the present invention.

FIG. 11 is a block diagram of a third embodiment of an image signal processing device according to the present invention.

FIG. 12 is a block diagram of an example of a read processing unit in FIG.

13 is a block diagram of an example of a calculation unit in FIG.

14 is a block diagram of an example of an output processing unit in FIG.

15 is a signal waveform diagram for explaining the operation of the main part of FIG.

FIG. 16 is a diagram showing a relationship between an NTSC system image and an HDTV system image and an effective pixel area in a rigid endoscope.

FIG. 17 is a diagram showing an example of an image display screen in a conventional image signal processing device.

[Explanation of symbols]

 10 B prism 12 R prism 13 B trimming filter 14, 20 G prism 15 R trimming filter 16 Half mirror 17, 18 G trimming filter 19B, 21B Blue solid-state image sensor 19R, 21R Red solid-state image sensor 19G1, 19G2, 21G Green Solid-state imaging device 25, 26 field memory 27, 28 frame synthesizing circuit 29, 30, 72, 73 vertical high-pass filter 31, 32, 34, 35, 74, 76, 420 adder 33, 75 matrix circuit 36, 37, 77 changeover switch 38 double speed conversion circuit 71 read processing unit 78 output processing unit 92 no signal period 93 character display area 100G, 100R, 100G read processing unit 150 read control unit 160 line memory input / output control unit 170 signal processing clock generation Raw part 180 Synchronous signal generating part 200 Computing part 300 Output processing part 400 Central processing unit (CPU) 410 Character generator (CG)

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Masaji Yoshida, 3-12 Moriya-cho, Kanagawa-ku, Yokohama, Kanagawa, Japan Victor Company of Japan, Ltd. (72) Kosuke Kinoshita 3-chome, Moriya-cho, Kanagawa-ku, Yokohama Address 12 Victor Company of Japan, Ltd.

Claims (7)

[Claims] 1. Aspects of a standard television system for receiving a primary color signal by receiving each primary color light from the color separation optical system and a color separation optical system for separating incident light from a subject into at least three primary color lights. Composed of a plurality of pixels corresponding to the ratio, and a plurality of solid-state image pickup elements arranged so that the pixel positions in the vertical direction thereof have a specific positional relationship, and from the output primary color signals of the plurality of solid-state image pickup elements, It has about twice the vertical resolution of the standard television system and H
It is characterized by further comprising signal processing means for generating an image signal of a horizontal scanning frequency of the DTV studio standard, and adding means for adding the synchronizing signal of the HDTV studio standard to the output image signal of the signal processing means and outputting it. Image signal processing device. 2. The incident light from the subject is blue light, red light,
A color separation optical system that separates the first and second green lights, and the blue light, the red light, and the first and second green lights from the color separation optical system are separately received to obtain primary color signals. The first to fourth solid-state imaging devices each having a plurality of pixels in the horizontal and vertical directions corresponding to the aspect ratio of the standard television system, and the first to receive the blue light. At least one of the solid-state imaging device and the second solid-state imaging device that receives the red light is the third solid-state imaging device that receives the first and second green lights. The solid-state image sensor is arranged to be displaced by at least 1/2 pixel pitch in the vertical direction, and the third and fourth solid-state image sensors are arranged to be displaced by at least one pixel pitch in the vertical direction. Imaging device characterized by Place. 3. A synthesizing unit for synthesizing a frame of at least one of the output image pickup signal of the first solid-state image pickup device and the output image pickup signal of the second solid-state image pickup device of the image pickup apparatus according to claim 2, and the frame synthesizing unit. Extracting means for extracting the first and second high frequency signals in the vertical direction from the output frame composite signal, and receiving the output image pickup signals of the first to fourth solid-state image pickup devices of the image pickup apparatus as input signals, From a matrix circuit that generates two types of color difference signals and also generates a first luminance signal and a second luminance signal, the first high frequency signal, the second high frequency signal, and the matrix circuit. The output first and second
High-frequency band additional signal generation means for generating first and second high-frequency band additional signals based on the luminance signal of the matrix circuit, and one field of the odd field and the even field is the output of the matrix circuit. Selection circuit for selecting the luminance signal and the other field for selecting the first and second high frequency additional signals, the two types of color difference signals output from the matrix circuit, and the output signal of the selection circuit. To double speed conversion to HDTV
A double speed conversion circuit for outputting respectively two kinds of color difference signals and a luminance signal of a studio standard horizontal scanning frequency; and an addition means for adding the HDTV studio standard synchronization signal to the output luminance signal of the double speed conversion circuit An image signal processing device characterized by: 4. The incident light from the subject is blue light, red light,
A color separation optical system for separating into green light, and the blue light, red light, and green light from the color separation optical system are separately received to obtain primary color signals, and the number of pixels in the horizontal and vertical directions is standard. A first to third solid-state image pickup device of an all-pixel read-out system, which comprises a plurality of pixels corresponding to an aspect ratio of a television system, and the first solid-state image pickup device and the red color which receive the blue light. The second solid-state image sensor for receiving light is arranged to be displaced by at least a 1/2 pixel pitch in the vertical direction relative to the third solid-state image sensor for receiving the green light. Imaging device. 5. A read processing unit for receiving each output image pickup signal of the first to third solid-state image pickup devices of the image pickup apparatus according to claim 4 as an input signal and performing a double speed conversion, and an output signal of the read processing unit. A matrix circuit for generating two types of color difference signals and a luminance signal based on the above, and a vertical high frequency range of the output signals of the first and second solid-state image pickup devices output from the read processing unit. A vertical high-frequency luminance signal generation unit that generates components and then adds them to generate a vertical high-frequency luminance signal, and synthesizes the vertical high-frequency luminance signal and the output luminance signal of the matrix circuit, respectively. And an adder that outputs a high-frequency added luminance signal, and one of the odd field and the even field selects the output luminance signal of the matrix circuit, and the other field selects the luminance signal. A selection circuit for selecting an output signal of the adder, the image signal processing apparatus characterized by having adding means for adding synchronizing signals of the HDTV studio standards output luminance signal of the selection circuit. 6. A color separation optical system for separating incident light from a subject into at least three primary color lights, and an aspect of each standard television system for receiving each primary color light from the color separation optical system to obtain a primary color signal. Composed of a plurality of pixels corresponding to the ratio, and a plurality of solid-state image pickup elements arranged so that the pixel positions in the vertical direction thereof have a specific positional relationship, and from the output primary color signals of the plurality of solid-state image pickup elements, It has about twice the vertical resolution of the standard television system and H
Signal processing means for generating an image signal having a horizontal scanning frequency of the DTV studio standard; first adding means for adding the HDTV studio standard synchronization signal to the output image signal of the signal processing means and outputting the image signal; 2. The image signal processing apparatus according to claim 1, further comprising: second adding means for adding a character to a valid image scanning period of the image signal to which the synchronizing signal is added by the adding means and a scanning period other than the vertical blanking period. 7. The second adding means is configured to perform the image in the respective scanning periods from the 41st line to the 72nd line and from the 603rd line to the 635th line of the scanning line number of the HDTV studio standard. The image signal processing device according to claim 6, wherein the character is added to the signal.