JP2003143562A - Method and device for video signal transmission - Google Patents

Abstract

PROBLEM TO BE SOLVED: To divide a signal from a solid-state imaging device into M systems to transmit them in parallel. SOLUTION: The solid-state imaging device is divided into N divided imaging areas in the horizontal direction, and N first video signals obtained by subjecting individual divided imaging areas to prescribed signal processing are written in N divided memory areas of a memory in the same arrangement form as pixels of the solid-state imaging device. At the time of reading the memory, the memory read timing is set to 1/M of the speed for collective read of all pixels of the solid-state imaging device on the basis of the preliminarily set number M of transmission systems, and the first video signals of individual divided memory areas of the memory are read out successively at the timing interval 1/M, and read signals at the same memory read timing are collected from all the divided memory areas to generate a second video signal of one system, and the second video signals of M systems generated at different memory read timings at the timing interval 1/M are transmitted in parallel.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention uses a solid-state image sensor in which a large number of pixels are arranged in a matrix in a horizontal direction and a vertical direction, and a predetermined signal is obtained from an image signal obtained by the solid-state image sensor. The present invention relates to a video signal transmission method and a video signal transmission device for transmitting video signals divided into a plurality of systems in parallel after processing.

[0002]

2. Description of the Related Art With the advent of the digital multimedia era, an ultra-high definition image of an object is captured by a video camera with a built-in ultra-high-definition solid-state image sensor and imaged on the solid-state image sensor in the video camera. The applicant has previously proposed an example of a solid-state imaging device and an image display system capable of displaying a subject image on a large-screen display in Japanese Patent Laid-Open No. 2001-223947.

FIG. 6 is a block diagram for explaining a conventional image display system, and FIG. 7 is an enlarged view of a frame memory in the solid-state image pickup device and the signal processing section shown in FIG.

The conventional image display system shown in FIG.
It is disclosed in the above-mentioned Japanese Patent Laid-Open No. 2001-223947 and will be briefly described here with reference to the same.

A conventional image display system 10 shown in FIG.
At 0, the subject image photographed by the optical lens system 111 in the video camera 110 is separated into three primary colors of red light component (R), green light component (G), and blue light component (B) by the three color separation prism 112. The solid-state image pickup device 113 (113) dedicated to each primary color is used as a subject image by the R, G, and B primary color lights.
R, 113G, 113B) respectively.

Then, a solid-state image pickup device 113 (113R, 1R, 1R, 1) dedicated to each primary color is applied to a subject image by the R, G, B primary color lights.
13G, 113B), after photoelectric conversion by R, G,
The signal processing unit 1 for the image pickup signal corresponding to each primary color light of B
A plurality of high-definition video signals (hereinafter referred to as high-definition signals) are generated by performing predetermined signal processing at 14,
An image for monitor display by one of a plurality of high-definition signals or a composite signal is displayed on the monitor unit 115.

Further, a plurality of high-definition signals output from the signal processing section 114 are transmitted in parallel to the recording / reproducing device 120 side, and the plurality of high-definition signals are recorded in a recording medium such as a magnetic tape in the recording / reproducing device 120. Moreover, a plurality of recorded high-definition signals are reproduced, and the reproduced high-definition signals are transmitted in parallel to the image display device 130 side.

Further, in the image display device 130, a high-definition image is combined and displayed on one screen by a plurality of high-definition signals.

Here, the solid-state image pickup device 113 described above is
When a large number of pixels are arranged in a matrix in the horizontal direction and the vertical direction, the number of pixels is set to be much larger than the number of pixels of the image corresponding to the high-definition system, and the object image is clear and super high definition. The number of pixels in the horizontal direction is set to 3888 and the number of pixels in the vertical direction is set to 2192 in order to form an image every time. Therefore, since the number of pixels (3888 × 2192) of the solid-state image sensor 113 is four times or more the number of pixels (1920 × 1080) of the image corresponding to the existing high-definition system, In order to obtain a moving image of 30 frames per second, it is necessary to set the read speed of all pixels of the solid-state image pickup device 113 to 4 times or more as high as the HDTV signal processing speed of 74.25 MHz.

From the above, the signal processing speed to the solid-state image pickup device 113 is set to 74.25 MHz which is the high-definition signal processing speed.
Although it is necessary to perform signal processing four times or more faster than z, in reality, high-speed signal processing to the solid-state image sensor 113 is difficult due to an increase in high frequency noise and an increase in circuit load. Along with this, it is natural that the conversion speed at the time of digitally A / D converting the analog image pickup signal output from the solid-state image pickup device 113 or the signal processing speed at the time of performing a predetermined signal processing also becomes difficult. .

Therefore, in the above-mentioned publication, as shown in FIG. 7, the solid-state image pickup device 113 is divided into, for example, the number of divisions N = 8.
Is divided into eight in the horizontal direction, and signal processing is performed at a signal processing speed that is close to 1/2 of the high-definition signal processing speed for each of the eight divided image pickup areas 1 to 8.

More specifically, for example, a horizontal drive signal having a frequency of 67.5 KHz and a frequency of 30 Hz are generated based on a high-definition synchronizing signal (horizontal scanning frequency 33.75 KHz, vertical scanning frequency 30 Hz, clock frequency 74.25 MHz). Vertical drive signal, frequency 37.12
The solid-state image pickup device 113 is driven for each of the divided image pickup areas 1 to 8 by a clock of 5 MHz, and for each of the eight divided image pickup signals obtained by photoelectrically converting each subject image formed in the eight divided image pickup areas 1 to 8. In the signal processing unit 114, predetermined signal processing is performed at a signal processing speed close to 1/2 of the high-definition signal processing speed, and eight divided signals are temporarily stored in the frame memory 115 provided therein in the same eight-division mode as described above. I am writing it.

After that, when the signal processing unit 114 outputs according to the number M of transmission systems, the frame memory 115 is divided by the number M of transmission systems that can be processed by the existing signal processing of the high-definition system, and the frame is also divided. Reading is performed by a division method different from the division method at the time of writing to the memory 115. For example, the signal conversion processing is performed so that the frame memory 115 is divided into four vertically and horizontally, and the number of transmission systems is set to M = 4. Corresponding 4 systems (Transmission channel 1-
The high-definition video signal of 4) is transmitted in parallel to the recording / reproducing device 120 side. At this time, the four high-definition video signals read from the frame memory 115 are naturally
This corresponds to the display area divided into four parts on the display screen of the above-mentioned image display device 130.

When the four systems of high-definition video signals are not recorded on the recording medium, the four systems of high-definition video signals are divided into four vertically and horizontally from the signal processing unit 114. It is also possible to directly transmit to the 130 side.

[0015]

By the way, in the above-mentioned conventional image display system 100, the solid-state image pickup device 113 (113R, 113G, 113B) having a large number of pixels.
Although it is possible to perform predetermined signal processing at a signal processing speed that is close to 1/2 of the high-definition signal processing speed by horizontally dividing 8 in the horizontal direction, eight divided imaging signals obtained by the solid-state imaging device 113 are obtained. After performing a predetermined signal processing on the above, the signal conversion processing is performed corresponding to the left, right, upper, and lower display areas on the display screen of the image display device 130, unlike the above-described 8-division method as described in FIG. High-definition video signals of four systems are transmitted in parallel to the recording / reproducing device 120 side or the display device 130 side.

Here, when any one of the systems can be used due to some trouble in parallel transmission of high-definition video signals of four systems from the signal processing unit 114 to the subsequent stage, Since only the display area corresponding to any one system is displayed on the display screen of the display device 130, there is a problem that other display areas of the image to be displayed with high definition are lost. Though
In particular, since only 1/4 of the total image area is displayed, it is impossible to grasp the entire image of the image.

Therefore, even if some trouble occurs in parallel transmission of the video signals divided into a plurality of systems after the predetermined signal processing is performed on the image pickup signal obtained by the solid-state image pickup device, the image quality is slightly improved. There is a demand for a video signal transmission method and a video signal transmission device capable of grasping the entire image even if the image quality is poor.

[0018]

The present invention has been made in view of the above problems, and the first invention uses a solid-state image pickup device in which a large number of pixels are arranged in a matrix in the horizontal and vertical directions. Then, in the video signal transmission method of transmitting the video signals divided into a plurality of systems in parallel after performing a predetermined signal processing on the imaging signal obtained by the solid-state imaging device, the horizontal direction of the solid-state imaging device is changed. The divided image pickup areas are divided by the number of divisions N to form N divided image pickup areas, and each divided image pickup area is photoelectrically converted to N divided image pickup signals obtained by photoelectrically converting each subject image formed in the N divided image pickup areas. A signal processing step of performing a predetermined signal processing at a signal processing speed set to approximately 1 / N of the all-pixel collective reading speed of the solid-state image pickup device to output N first video signals in parallel, First of
The video signal is written in each of N divided memory areas formed in the memory in the same arrangement as the pixel arrangement of the solid-state image pickup device, and further, at the time of reading from the memory, the memory is based on a preset transmission system number M. The read timing is set to 1 / M of the all-pixel collective read speed of the solid-state image pickup device, the first video signal is sequentially read at the 1 / M timing interval for each divided memory area of the memory, and the same. The read signals at the memory read timing are gathered over all the divided memory areas to generate a single system of the second video signal, whereby the 1 / M
And a signal conversion processing step of transmitting, in parallel, the second video signal of M system, which is generated each time the memory read timing is different according to the timing interval.

The second aspect of the present invention uses a solid-state image pickup device in which a large number of pixels are arranged in a matrix in the horizontal and vertical directions, and a predetermined signal is obtained from the image pickup signal obtained by this solid-state image pickup device. In the video signal transmission device that transmits the video signals divided into a plurality of systems in parallel after processing,
The horizontal direction of the solid-state image pickup device is divided by the number of divisions N to form N divided image pickup regions, and N divided image pickup images obtained by photoelectrically converting each subject image formed in the N divided image pickup regions. The signal is subjected to predetermined signal processing at a signal processing speed set to about 1 / N of the all-pixel collective reading speed of the solid-state imaging device for each divided imaging area, and N first video signals are output in parallel. And the N first video signals are written in the N divided memory regions formed in the memory in the same arrangement as the pixel arrangement of the solid-state imaging device, and further read from the memory. Sometimes, the memory read timing is set to 1 / M of the all pixel collective read speed of the solid-state image pickup device based on the number M of transmission systems set in advance.
Set to the first for each divided memory area of the memory.
By sequentially reading the video signals at the timing interval of 1 / M, and collecting read signals of the same memory read timing over all the divided memory areas to generate one system of the second video signal, And a signal conversion processing means for transmitting, in parallel, M-system second video signals generated at each different memory read timing at a timing interval of 1 / M.

[0020]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of a video signal transmitting method and a video signal transmitting apparatus according to the present invention will be described below in detail with reference to FIGS. 1 to 5.

FIG. 1 is a diagram schematically showing a solid-state image sensor used in a video signal transmitting method and a video signal transmitting apparatus according to the present invention.

Before describing the video signal transmitting method and the video signal transmitting apparatus according to the present invention, the ultra-high-definition solid-state imaging device used here will be described first.

As shown in FIG. 1, the solid-state image pickup device 10 of ultra-high definition used in the video signal transmission method and the video signal transmission device according to the present invention is similar to the video camera 110 described in FIG. It is applied to a configured video camera (not shown), and includes three solid-state imaging devices 10 (10R) corresponding to three primary colors of a red light component (R), a green light component (G), and a blue light component (B). , 10G, 10B) are attached to the rear of a three-color separation prism provided via an optical lens system in the video camera.

The above-mentioned ultra-high-definition solid-state image pickup device 10
In the solid-state image sensor 10, the number of pixels arranged in a matrix in the horizontal direction and the number of pixels arranged in the vertical direction are set to be much larger than the number of pixels of the image corresponding to the high-definition system.
Since the number of pixels in the horizontal direction is set to 3840 and the number of pixels in the vertical direction is set to 2160, the total number of pixels of the solid-state imaging device 10 is the number of pixels in the horizontal and vertical directions of the image corresponding to the high-definition system ( Since it is four times as large as that of 1920 × 1080), the read speed of all pixels of the solid-state image pickup device 10 at the same time is 74.25M for the HDTV signal processing speed.
It becomes four times Hz (297 MHz).

Therefore, without reading the pixels of the solid-state image pickup device 10 at the all-pixel collective read speed, the number of divisions N of the solid-state image pickup device 10 in the horizontal direction is the same as that described in the prior art.
Is divided into N to form N divided image pickup regions, and the divided image pickup regions are read at a signal processing speed set to about 1 / N of the all-pixel collective read speed of the solid-state image pickup device 10.

That is, the number N of divisions of the solid-state image pickup device 10 in the horizontal direction is set to 4, for example, without increasing the signal processing speed to the solid-state image pickup device 10 to four times the high-definition signal processing speed of 74.25 MHz. By dividing the solid-state image pickup device 10 into four in the horizontal direction to form divided image pickup regions 1 to 4, the signal processing speed of the solid-state image pickup device 10 for each of the divided image pickup regions 1 to 4 is set to the high-definition signal processing speed 74. 25 MHz
Signal processing is performed with the same settings as.

The division number N of the solid-state image pickup device 10 is an image corresponding to the high-definition image because the number of pixels of the solid-state image pickup device 10 corresponds to the high-definition signal processing speed for each divided image pickup area. It is decided as appropriate by how many times the number of pixels of
In this embodiment, the signal processing speed to the solid-state image sensor 10 is set to the same as the high-definition signal processing speed of 74.25 MHz, but the invention is not limited to this, and depending on the pixel arrangement of the solid-state image sensor 10, the high-definition signal may be generated. The signal processing speed is close to the processing speed, or is set to be equal to or lower than the high-definition signal processing speed.

In the case of the solid-state image pickup device 10 described above, by dividing the horizontal direction into four by the number of divisions N = 4, the number of pixels in the horizontal direction becomes 960 in each of the divided image pickup areas 1 to 4, and the vertical direction is divided. The number of pixels in each of the divided imaging areas 1 to 4 is 2160 without any change, and
1, 2, ... are arranged.

Next, a video signal transmission method and a video signal transmission device according to the present invention will be described with reference to FIGS.

FIG. 2 is a block diagram for explaining a video signal transmission method and a video signal transmission device according to the present invention, and FIG.
3A and 3B are diagrams showing a Y frame memory and a PrPb frame memory provided in the signal conversion circuit shown in FIG.

As shown in FIG. 2, in the video signal transmitting method and the video signal transmitting apparatus 1 according to the present invention, the number of pixels arranged in a matrix in the horizontal direction and the vertical direction is the pixel of the image corresponding to the high-definition system. Using the solid-state image pickup devices 10R, 10G, and 10B that are much larger than the number, the respective image pickup signals obtained by the solid-state image pickup devices 10R, 10G, and 10B are
It is configured to be divided into a plurality of systems and transmitted in parallel.

In the above-described video signal transmission method and video signal transmission device 1 according to the present invention, the optical lens system in the video camera (not shown), R passing through the three-color separation prism,
Object images of the G and B primary colors are respectively formed on the solid-state image pickup devices 10R, 10G, and 10B dedicated to the primary colors.

Here, the three solid-state image pickup devices 10R and 10
In G and 10B, as described above, the divided image pickup areas 1 to 4 are divided into four in the horizontal direction by the division number N = 4.

Further, the three solid-state image pickup devices 10R, 10
G and 10B are four divided image pickup signals obtained by photoelectrically converting the subject images formed in the divided image pickup regions 1 to 4, respectively, and are numbered from the same divided image pickup region of each solid-state image pickup device 10R, 10G, and 10B. The output R signal, G signal, and B signal are combined to generate a set of RGB image pickup signals. Then, the three solid-state imaging devices 10R and 10
G and 10B are divided into four image pickup areas 1 to 4, and four sets of RGB image pickup signals generated correspond to four 3ch. The signals are input in parallel to the A / D converters 11A to 11D. At this time, the three solid-state image pickup devices 10R, 10G, and 10B have a high-definition signal processing speed of 7 for each of the divided image pickup regions 1 to 4.
R signal, G signal, B at the same signal processing speed as 4.25 MH
The signals have been read out.

More specifically, the R signal output from the divided image pickup area 1 of the solid-state image pickup device 10R and the solid-state image pickup device 1 are used.
A set of RGB image pickup signals R1, G1, B in which the G signal output from the 0G split image pickup area 1 and the B signal output from the solid-state image pickup element 10B split image pickup area 1 are combined.
1 is bundled with three signal lines and 3ch. A / D converter 1
1A and RGB image pickup signals (R2, G2, B2) to (R4, G4) from the other divided image pickup areas 2 to 4 are input.
B4) is also connected in the same manner as above, and the A / D converter 11B
Has been input to ~ 11D.

Next, the four 3ch. In the A / D converters 11A to 11D, the solid-state image pickup devices 10R, 10G,
The analog RGB image pickup signals read in parallel from the divided image pickup areas 1 to 4 of 10B are converted into digital RGB image pickup signals.

Then, the solid-state image pickup devices 10R, 10G, 1
The digital RGB image pickup signals R1, G1, B1 corresponding to the divided image pickup area 1 of 0B are output from the A / D converter 11A to the signal processing circuit 12A, and the solid-state image pickup device 10 is also provided.
Digital RGB image pickup signals R2, G2, B2 corresponding to the divided image pickup areas 2 of R, 10G, 10B are output from the A / D converter 11B to the signal processing circuit 12B, and the solid-state image pickup elements 10R, 10G, 10B are also output. Digital RGB image pickup signals R3, G3, B3 corresponding to the divided image pickup area 3 are output from the A / D converter 11C to the signal processing circuit 12C, and further correspond to the divided image pickup area 4 of the solid-state image pickup elements 10R, 10G, 10B. Digital RGB image pickup signal R
4, G4 and B4 are output from the A / D converter 11D to the signal processing circuit 12D.

Next, the above-mentioned four signal processing circuits 12A
12D, the A / D converter 11A corresponding to each of the divided image pickup areas 1 to 4 of the solid-state image pickup elements 10R, 10G, and 10B.
˜11D digital RGB image pickup signals (R1, G1, B1) to (R4, G4, B4) output in parallel are subjected to gamma conversion processing and color difference conversion processing at the same high-definition signal processing speed of 74.25 MHz. The processing is performed at the processing speed, so that the digital RGB image pickup signal becomes the high-definition signal (first video signal), the luminance signal Y,
It has been converted into the color difference signal PrPb.

More specifically, the signal processing circuit 12A obtains high-definition signals Y1 and PrPb1 corresponding to the divided image pickup areas 1 of the solid-state image pickup elements 10R, 10G, and 10B.
In addition, in the signal processing circuit 12B, the solid-state imaging devices 10R,
The high-definition signals Y2 and PrPb2 are obtained corresponding to the divided image pickup areas 2 of G and 10B, and the signal processing circuit 12
In C, the high-definition signals Y3 and PrPb3 are obtained corresponding to the divided image pickup areas 3 of the solid-state image pickup devices 10R, 10G, and 10B, and further, in the solid-state image pickup device 10 in the signal processing circuit 12D.
The high-definition signals Y4 and PrPb4 are obtained corresponding to the divided image pickup areas 4 of R, 10G, and 10B.

After this, four signal processing circuits 12A-12
HD signal (Y1, PrP
b1), (Y2, PrPb2), (Y3, PrPb
3) and (Y4, PrPb4) are input in parallel to the signal conversion circuit 13, which is a main part of the present invention.

Next, the signal conversion circuit 13 described above divides the solid-state image pickup device 10 in the horizontal direction by the number N of divisions and performs predetermined signal processing to obtain N high-definition signals (first image signals). ) Is converted into an M-system high-definition signal (second video signal) corresponding to the number M of transmission systems, and the signal-converted M-system high-definition signal (second video signal) is transmitted in parallel. Therefore, a Y frame memory 14 and a PrPb frame memory 15 are provided inside the signal conversion circuit 13.

Then, in the signal conversion circuit 13, the luminance signal Y1 sent from the four signal processing circuits 12A to 12D.
3 to Y4 are arranged in the divided memory areas 1 to 4 of the Y frame memory 14 as shown in FIG.
The color difference signals PrPb1 to Pr sent from the four signal processing circuits 12A to 12D are written in the same arrangement as the pixel arrangement in the 0G and 10B divided image pickup areas 1 to 4.
As shown in FIG. 3B, the solid-state image sensor 10 is provided in the divided memory areas 1 to 4 of the frame memory 15 for PrPb.
It is written in the same arrangement form as the pixel arrangement form in the divided image pickup areas 1 to 4 of R, 10G, and 10B.

Therefore, the luminance signal Y is generated in the signal conversion circuit 13.
1 to Y4 are written in the Y frame memory 14, and the color difference signals PrPb1 to PrPb4 are written in the PrPb frame memory 15, the number of divisions is N = 4. The signal processing is system = 4.

On the other hand, the signal converting circuit 13 divides the output signal into M systems according to the number M of transmission systems, and divides into M systems (M channels) a high-definition signal (second video signal).
When the data is transmitted in parallel to a recording / reproducing device (not shown), an image display device, or a personal computer via a line, the reading from the Y frame memory 14 and the PrPb frame memory 15 is performed and the memory arrangement at the time of writing to the memory is arranged. Differently from the mode, the signal processing of M systems is performed by dividing into M pieces based on the number M of transmission systems.

Here, the memory read timing in both memories 14 and 15 is set to 1 / M of the all pixel batch read speed of the solid-state image pickup device 10 based on the number M of transmission systems, and the Y frame memory 14 is set. Each divided memory area 1
4 to 4 and the color difference signals PrPb1 to PrPb4 written in each of the divided memory areas 1 to 4 of the PrPb frame memory 15 at the timing of 1 / M described above when reading the memory. By resampling and converting the N-system signal form into the M-system signal form, the luminance signals Y-11 to
Y22 and color difference signals PrPb-11 to PrPb-22 are obtained, and the luminance signals Y-11 to Y22 and the color difference signals PrPb-11 to PrPb-22 after signal conversion are transmitted in parallel to the subsequent stage.

At this time, the Y frame memory 14, PrP
The number of transmission systems M is set in advance so that the memory reading process from the frame memory 15 for b can be performed at a signal processing speed close to the high-speed signal processing speed for each divided area. The number M of transmission systems is set to 4, for example, but the number M of transmission systems is not limited to 4, and transmission is performed in response to a request from the transmission side based on the above-mentioned signal processing conditions of the Hi-Byn system. It suffices that the transmission system number M is such that fractions do not occur in the horizontal direction and the vertical direction with respect to the number of pixels of the solid-state imaging device 10 at times.

Here, the conversion operation of the Y signal in the signal conversion circuit 13 will be specifically described with reference to FIGS.

FIG. 4 is a diagram schematically showing the operation of reading the Y signal written in the Y frame memory in the signal conversion circuit shown in FIG.

As shown in FIGS. 3A and 4, the Y frame memory 14 has substantially the same structural configuration as the solid-state image pickup device 10, and is divided into four pieces by dividing the number of divisions N = 4. Memory areas 1 to 4 are formed, and each divided memory area 1
Similar to the pixel arrangement in each of the divided image pickup areas 1 to 4 of the solid-state image pickup device 10, 960 to 4 have unit memories of 960 in the horizontal direction and 2160 in the vertical direction. The total number of unit memories is set to the same number as the number of pixels (3840 × 2160) of the solid-state image sensor 10.

The signal processing circuits 12A to 12D are provided in the divided memory areas 1 to 4 of the Y frame memory 14, respectively.
The luminance signals Y1 to Y4 sent from the above are written in corresponding unit memories in the same form as the pixel arrangement form in each of the divided image pickup regions 1 to 4 of the solid-state image pickup device 10.

On the other hand, in this embodiment, since the number M of transmission systems is set to 4 in advance as described above, in each of the divided memory areas 1 to 4 of the Y frame memory 14, as shown in FIG. In each of the divided image pickup areas 1 to 1 of the solid-state image pickup device 10.
The four unit memories m1 to m4 corresponding to the left, right, upper, and lower four pixels adjacent to each other in 4 (for example, the pixel rows 11, 12, 21, 22 shown in FIG. 1) are combined, and this combination is perpendicular to the horizontal direction. A plurality of sets are repeatedly arranged in the direction. At this time, the signal components of the unit memories m1 to m4 written in the divided memory areas 1 to 4 of the Y frame memory 14 correspond to the luminance signals Y1 to Y4, respectively.

Further, from each of the divided memory areas 1 to 4 of the Y frame memory 14, each set of unit memories m1 to m4 is
Are sequentially read at a sampling timing of 1 / M = 1/4 of the all-pixel collective read speed of the solid-state imaging device 10 based on the number of transmission systems M = 4. Therefore, when reading to the Y frame memory 14, each set of unit memories m
The unit memories of the same memory read timing among 1 to m4 (for example, the unit memory m1 according to the first memory read timing) are read every other in the horizontal direction and the vertical direction. Memory (for example, m1) is 38 horizontally
40/2 = 1920, 2160/2 = 10 in the vertical direction
Eighty pieces are read.

That is, when reading to the Y frame memory 14, each divided memory area 1 of the Y frame memory 14 is read.
The unit memory m1 within 4 to 4 is sequentially read for each of the divided memory areas 1 to 4 by repeating the first memory read timing in the timing interval of ¼, and the first same memory Luminance signal Y-11 is obtained by gathering together the signals from the unit memory m1 read by repeating the read timing over all the divided memory areas 1 to 4.

Next, the unit memory m2 in each of the divided memory areas 1 to 4 of the Y frame memory 14 repeats the second memory read timing in the 1/4 timing interval to divide each of the divided memory areas 1 to 4. The signals of the unit memory m2 which are sequentially read out every four and are read at the same second memory read timing are gathered over all the divided memory areas 1 to 4 to collect the luminance signal Y. -12 is obtained.

Similarly to the above, the unit memories m3 read out from the divided memory areas 1 to 4 of the Y frame memory 14 at the repetition of the third memory read timing in the 1/4 timing interval. Luminance signal Y
-21 is obtained, and the unit memory m4 read from the divided memory areas 1 to 4 of the Y frame memory 14 at the fourth memory read timing of the 1/4 timing interval repeats the luminance. The signal Y-22 is obtained.

Therefore, the luminance signals Y1 to Y4 written in the divided memory areas 1 to 4 of the Y frame memory 14
Are the luminance signals Y1 to Y described above by the memory reading.
4 luminance signals (Y-11) and (Y-
12), (Y-21), (Y-22), and the luminance signal Y-11 after signal conversion is generated only in each unit memory m1 across each divided memory area 1 to 4. Further, the luminance signal Y-12 is generated only in each unit memory m2 extending over each divided memory area 1 to 4, and the luminance signal Y-12 is generated.
21 is a unit memory m3 extending over the divided memory areas 1 to 4
Further, the luminance signal Y-22 is generated only in each unit memory m4 over the divided memory areas 1 to 4.

At this time, the luminance signal (Y−1) read from each of the divided memory areas 1 to 4 of the Y frame memory 14 is read.
1), (Y-12), (Y-21), and (Y-22) are
It is processed at the same signal processing speed as the HDTV signal processing speed of 74.25 MHz.

Next, the conversion operation of the PrPb signal in the signal conversion circuit 13 will be described with reference to FIG. 3 (b) and FIG.

FIG. 5 is a diagram schematically showing the operation of reading the PrPb signal written in the PbPr frame memory in the signal conversion circuit shown in FIG.

PrPb in the signal conversion circuit 13 described above
Although the signal converting operation is performed in substantially the same manner as the Y signal converting operation in the signal converting circuit 13 described above, here, the color difference signal PrPb is obtained by combining both the Pr component and the Pb component. Is different from the conversion operation of the Y signal in that they are simultaneously converted.

That is, as shown in FIGS. 3 (b) and 5,
The PrPb frame memory 15 also has the same structural form as the solid-state image sensor 10, and is divided into 4 by dividing the number N = 4.
The divided memory areas 1 to 4 are formed, and the divided memory areas 1 to 4 are horizontally arranged in the divided image pickup areas 1 to 4 of the solid-state image pickup device 10 in the same horizontal direction as 960 pixels.
2160 unit memories are arranged in the vertical direction,
The total number of unit memories in the PrPb frame memory 15 is the number of pixels of the solid-state image sensor 10 (3840 × 216).
It is set to the same quantity as 0).

In each of the divided memory areas 1 to 4 of the PrPb frame memory 15, the signal processing circuits 12A to 12A.
The color difference signals PrPb1 to PrPb4 sent from 12D are written in the corresponding combine unit memories cm1 to cm4 described later in the same form as the pixel arrangement form in each of the divided image pickup regions 1 to 4 of the solid-state image pickup device 10.

Also in this PrPb frame memory 15, the number of transmission systems M is set to 4 in advance.
In each of the divided memory areas 1 to 4 of the frame memory for use 15 as shown in FIG. Using 8 unit memories corresponding to 8 pixels, and using 8 unit memories, Pr component and Pb
Four combine unit memories cm1 to cm4, in which the component and the component are combined by two unit memories, are assembled side by side in the left-right and top-bottom directions, and a plurality of sets are repeatedly arranged in the horizontal direction and the vertical direction. . At this time, each divided imaging area 1 of the PrPb frame memory 15
~ Combine unit memory c of each set written in 4
The signal components of m1 to cm4 are color difference signals PrPb1 to
It corresponds to PrPb4, respectively.

Further, the combined unit memories cm1 to cm4 of the respective sets from the respective divided memory areas 1 to 4 of the PrPb frame memory 15 are read out at a time for all pixels of the solid-state image pickup device 10 on the basis of the number of transmission systems M = 4. 1 / M = 1
Sequential reading is performed at a sampling timing of / 4.
Therefore, at the time of reading to the PrPb frame memory 15, the combine unit memory having the same memory read timing among the combine unit memories cm1 to cm4 of each set (for example, the combine unit memory (cm1) at the first memory read timing is the horizontal direction). And every other read in the vertical direction, the combine unit memory (for example, cm1) having the same memory read timing is 3840 / (2 × 2) = 960 in the horizontal direction.
2160/2 = 1080 pieces are read out in the vertical direction.

That is, at the time of reading to the PrPb frame memory 15, the combine unit memory cm1 in each of the divided memory areas 1 to 4 of the PrPb frame memory 15 is
The combine read out sequentially in each of the divided memory areas 1 to 4 by the repetition of the first memory read timing in the 1/4 timing interval, and read in the first repetition of the same memory read timing. The signals of the unit memory cm1 are gathered together over all the divided memory areas 1 to 4 to collect the color difference signal PrPb-11.
Has been obtained.

Next, the combine unit memory cm2 in each of the divided memory areas 1 to 4 of the PrPb frame memory 15 will be described.
Are divided memory areas 1 through 1 by repeating the second memory read timing in the 1/4 timing interval.
The signals of the combine unit memory cm2, which are sequentially read every 4 and are read at the same second memory read timing, are gathered over all the divided memory areas 1 to 4 to collect color difference signals. PrPb-
12 has been obtained.

In the same manner as described above, the divided memory area 1 of the PrPb frame memory 15 is repeated at the third memory read timing of the 1/4 timing interval.
Each combine unit memory cm3 read from within 4
The color difference signal PrPb-21 is obtained by
The color difference signal PrPb-22 is obtained by each combine unit memory cm4 read from the divided memory areas 1 to 4 of the PrPb frame memory 15 at the fourth memory read timing of the four timing intervals. There is.

Therefore, the color difference signal PrP written in the divided memory areas 1 to 4 of the PrPb frame memory 15 is written.
b1 to PrPb4 are color difference signals (PrPb-11), (PrPb-12), which are different in signal form from the color difference signals PrPb1 to PrPb4 described above by memory reading.
This means that the color difference signal PrPb-11 after signal conversion has been converted into (PrPb-21) and (PrPb-22), and the combined unit memory c over the divided memory areas 1 to 4 is used.
m1 only, the color difference signal PrPb-12 is generated only in each combine unit memory cm2 across the divided memory areas 1 to 4, and the color difference signal PrPb-21 is also generated.
Is generated only in each combine unit memory cm3 over each divided memory area 1 to 4, and further, the color difference signal PrPb-2 is generated.
2 is generated only in each combine unit memory cm4 across each divided memory area 1 to 4.

At this time, the color difference signals (PrPb-11), (PrPb-12), (PrPb) read out from the respective divided memory areas 1 to 4 of the PrPb frame memory 15.
-21) and (PrPb-22) are processed at the same signal processing speed as the HDTV signal processing speed of 74.25 MHz.

Thereafter, as shown in FIG. 2, in the signal conversion circuit 13, the luminance signal (Y-11) after signal conversion read from the Y frame memory 14 and the signal read from the PrPb frame memory 15 are read. Color difference signal after conversion (P
rPb-11) is combined to form a high-definition signal (second video signal) of the first system, and similarly, a luminance signal (Y-11) after signal conversion and a color difference signal (PrPb after signal conversion) are similarly obtained.
-12) together with a high-definition signal (second video signal) of the second system, and a luminance signal (Y- after signal conversion).
21) and the color-difference signal (PrPb-21) after signal conversion are combined, and a high-definition signal (second video signal) of the third system
Further, the luminance signal (Y-22) after the signal conversion and the color difference signal (PrPb-22) after the signal conversion are combined into a high-definition signal (second video signal) of the fourth system, and a total of four systems ( High-definition signals (second video signals) of 4 channels are transmitted in parallel in the state of being divided to the latter stage.

From the above, the four systems of high-definition signals (Y-11, PrPb-11) and (Y-1) after signal conversion are obtained.
2, PrPb-12), (Y-21, PrPb-2
1) and (Y-22, PrPb-22) each include a part of the signal component over all of the divided image pickup regions 1 to 4 of the solid-state image pickup device 10, so that the image quality is inferior. In addition to being a signal capable of grasping the entire image, the four-system high-definition signals are video signals capable of displaying an image obtained from the solid-state imaging device 10 in color with the pixel positions being slightly displaced from each other.

With this, the high-definition signal (Y-11, PrPb-1) divided into four systems after the predetermined signal processing is performed on the image pickup signal obtained by the solid-state image pickup device 10.
1), (Y-12, PrPb-12), (Y-21, P
rPb-21) and (Y-22, PrPb-22) are transmitted in parallel and some trouble occurs, and even if only one of the four systems (transmission channel) can be transmitted, the entire image of the image is displayed. You can figure it out.

[0073]

According to the video signal transmission method and the video signal transmission apparatus according to the present invention described in detail above, the solid-state image pickup device in which a large number of pixels are arranged in a matrix in the horizontal and vertical directions is used. After performing predetermined signal processing on the image pickup signal obtained by the image pickup device, when the video signals divided into a plurality of systems are transmitted in parallel, the horizontal direction of the solid-state image pickup device is divided into N divided image pickup regions. , N obtained by performing a predetermined signal processing at a signal processing speed set to about 1 / N of the all-pixel collective reading speed of the solid-state imaging device for each divided imaging area.
A plurality of first video signals are respectively written in N divided memory areas formed in the memory in the same arrangement as the pixel arrangement of the solid-state image sensor, and when read out from the memory, based on a preset number M of transmission systems. The memory read timing is set to 1 of the all pixel batch read speed of the solid-state image sensor.
/ M to set the first for each divided memory area of the memory
By sequentially reading the video signals at timing intervals of 1 / M, and collecting read signals at the same memory read timing over all the divided memory areas to generate one system of the second video signal, Since the M system second video signals generated every time the memory read timing is different according to the M timing interval are transmitted in parallel,
Since each of the M-system second video signals after the signal conversion includes a part of the signal component over the entire divided image pickup area of the solid-state image pickup device, although the image quality is poor, the entire image of the image can be grasped. In addition to being a signal, the M-system second video signal becomes a signal capable of displaying an image obtained from the solid-state imaging device in a state where the pixel positions are slightly displaced from each other.

As a result, after performing a predetermined signal processing on the image pickup signal obtained by the solid-state image pickup device, some trouble occurs when the second video signal divided into the M system is transmitted in parallel, Even if only one system (transmission channel) of the second video signals of the M system can be transmitted, the entire image of the image can be grasped.

[Brief description of drawings]

FIG. 1 is a diagram schematically showing a solid-state image sensor used in a video signal transmission method and a video signal transmission device according to the present invention.

FIG. 2 is a block diagram for explaining a video signal transmission method and a video signal transmission device according to the present invention.

3A and 3B are diagrams showing a Y frame memory and a PrPb frame memory provided in the signal conversion circuit shown in FIG.

4 is a diagram schematically showing the operation of reading the Y signal written in the Y frame memory in the signal conversion circuit shown in FIG.

5 is a circuit diagram illustrating a signal conversion circuit shown in FIG.
FIG. 9 is a diagram schematically showing an operation of reading out the PrPb signal written in the use frame memory.

FIG. 6 is a configuration diagram for explaining a conventional image display system.

7 is an enlarged view of a frame memory in the solid-state imaging device and the signal processing unit shown in FIG.

[Explanation of symbols]

1 ... Video signal transmission device, 10 (10R, 10G, 10
B) ... Solid-state image sensor, 11A to 11D ... 3ch. A / D
Converter, 12A to 12D ... Signal processing circuit, 13 ... Signal conversion circuit, 14 ... Y frame memory, m1 to m4 ... Unit memory, 15 ... PrPb frame memory, cm1 to c
m4 ... Combine unit memory, Y1 to Y4 ... Luminance signal,
Y-11, Y-12, Y-21, Y-22 ... Luminance signal,
PrPb1 to PrPb4 ... Color difference signals, PrPb-11,
PrPb-12, PrPb-21, PrPb-22 ... Color difference signals.

Front page continued (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 9/797 9/815 F term (reference) 5C022 AC01 AC42 AC69 5C053 FA09 FA20 FA30 GA06 GA16 JA08 JA21 KA03 LA02 5C055 AA06 BA03 BA05 CA03 DA08 EA02 EA04 FA17 JA21 5C063 AB03 AB11 AC01 CA23 CA40 DA07 DA13 EB45 5C065 AA01 BB48 CC02 CC03 CC07 CC09 DD19 GG27

Claims (2)

[Claims] 1. A solid-state imaging device, in which a large number of pixels are arranged in a matrix in a horizontal direction and a vertical direction, is used, and after predetermined signal processing is performed on an imaging signal obtained by the solid-state imaging device, A video signal transmission method for transmitting video signals divided into a plurality of systems in parallel, wherein the horizontal direction of the solid-state imaging device is divided by a division number N to form N division imaging regions, and the N divisions are made. With respect to N divided image pickup signals obtained by photoelectrically converting each subject image formed in the image pickup region, at a signal processing speed set to about 1 / N of all pixel batch read-out speed of the solid-state image pickup device for each divided image pickup region. A signal processing step of performing predetermined signal processing to output N first video signals in parallel; and the N first video signals in N divided memory areas formed in a memory, The same layout as the pixel layout Each of the memories is set to 1 / M of the all-pixel collective read speed of the solid-state image sensor based on a preset transmission system number M when writing from the memory. The first video signal is sequentially read at the 1 / M timing interval for each divided memory area, and the read signals of the same memory read timing are gathered together over all the divided memory areas to form one system of the second video signal. The second system of the M system is generated every time the memory read timing is different by the 1 / M timing interval.
And a signal conversion processing step of transmitting video signals in parallel. 2. A solid-state image sensor having a large number of pixels arranged in a matrix in a horizontal direction and a vertical direction is used, and after predetermined signal processing is performed on an image signal obtained by the solid-state image sensor, A video signal transmission device for transmitting video signals divided into a plurality of systems in parallel, wherein the horizontal direction of the solid-state image pickup device is divided by a division number N to form N divisional imaging regions, and the N divisions are performed. With respect to N divided image pickup signals obtained by photoelectrically converting each subject image formed in the image pickup region, at a signal processing speed set to about 1 / N of all pixel batch read-out speed of the solid-state image pickup device for each divided image pickup region. Signal processing means for performing predetermined signal processing to output N first video signals in parallel; and the N first video signals in N divided memory areas formed in a memory, of the solid-state imaging device. Same layout as pixel layout , And at the time of reading from the memory, the memory read timing is set to 1 / M of the all-pixel collective read speed of the solid-state image sensor based on a preset transmission system number M, and each division of the memory is performed. The first video signal is sequentially read at the 1 / M timing interval for each memory area, and read signals having the same memory read timing are gathered over all the divided memory areas to form a second video signal of one system. By generating, the second of the M system generated every time the memory read timing differs by the 1 / M timing interval.
A video signal transmission device, comprising: a signal conversion processing means for transmitting video signals in parallel.