JP2000244871A - Device and method for multi-image recording - Google Patents

Abstract

PROBLEM TO BE SOLVED: To record or retrieve multiple images without using a time code by providing a composition unit which outputs a 1st and a 2nd video signal outputted in order from a 1st and a 2nd camera as an SDI signal and a video recording means which records the SDI signal from the composition unit. SOLUTION: The 1st and 2nd video signals obtained by taking pictures by the 1st camera 10 and 2nd camera 11 are supplied to a controller 20 including the composition unit through a coaxial cable 14. The controller 20 generates an SDI signal of one channel from signals of two channels, i.e., the 1st and 2nd video signals from the 1st camera 10 and 2nd camera 11. Here, the SDI signal is a signal based upon a transmission system determined by the SDI(Serial Digital Interface) standards. The SDI standards make it possible to transmit a video signal and audio signals of four channels through one coaxial cable. The SDI signal generated by this controller 20 is supplied to a digital VCR 30 through a cable 15.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a multi-image recording apparatus and a multi-image recording method for recording multiple images, and more particularly to a technique for improving recording efficiency.

[0002]

2. Description of the Related Art Conventionally, a stereo image processing system has been known as one of multiple image processing systems. The stereo image processing system includes a stereo image processing device, a stereo image recording device, and the like. The stereoscopic image processing apparatus obtains a distance to an object based on the principle of triangulation from two images obtained by a stereo camera (consisting of two cameras) using stereoscopic vision. Recognize the position. An example of the three-dimensional image processing apparatus is described in, for example, Japanese Patent Application Laid-Open No. 9-126758 (title "Vehicle Environment Recognition Apparatus").

On the other hand, a stereo image recording apparatus operates a first camera and a second camera in synchronization with each other, and converts an image captured by the first camera into, for example, a first digital video tape recorder (hereinafter, “digital VTR”). ), And an image captured by the second camera is recorded on the second digital VTR. The two types of images recorded on the two digital VTRs in this way are supplied to, for example, the above-described three-dimensional image processing apparatus, and are used for recognition of the position of an object.

[0004]

As described above, in the conventional multi-image recording apparatus, when recording an image photographed by a plurality of cameras, a plurality of digital VTRs are simultaneously operated and recorded. Therefore, in order to use an image recorded on a plurality of digital VTRs as a multi-image,
A plurality of images taken at the same time must be called simultaneously.

For this reason, in the conventional multi-image recording apparatus, each image is stored with a time code attached thereto, and there is a problem that management of the time code is very troublesome. In addition, in order to store a multi-image, it is necessary to use a tape that is several times as large as a monaural image (an image captured by one camera), which increases the cost of the tape and makes the management of the tape cumbersome. is there.

SUMMARY OF THE INVENTION The present invention has been made to solve such a problem, and it is possible to record and recall multiple images without using a time code. It is an object to provide a multi-image recording device and a multi-image recording method capable of recording an image.

[0007]

The present invention focuses on the fact that a multi-image processing system often handles monochrome images, and in such a case, only a part of the video signal obtained from the camera is used. A video signal from another camera is recorded in an unused portion of the video signal from the camera.

That is, in order to achieve the above object, a multi-image recording apparatus according to a first aspect of the present invention comprises: a first camera; a second camera provided separately from the first camera;
A luminance signal included in a first video signal sequentially output from the first camera and a second luminance signal sequentially output from the second camera.
The image processing apparatus includes a synthesizer that synthesizes the luminance signal included in the video signal so that the luminance signal is output alternately and outputs the SDI signal, and a video recording unit that records the SDI signal from the synthesizer.

More specifically, the multi-image recording apparatus according to the first aspect of the present invention includes a first camera, a second camera spaced apart from the first camera, and a first camera and a second camera. A synchronization signal generator for generating a synchronization signal for operating the two cameras in synchronization with each other; and a first camera sequentially output from the first camera operating in synchronization with the synchronization signal generated by the synchronization signal generator. The luminance signal included in the video signal is a time slot of the luminance signal in the SDI standard, and the second signal that operates in synchronization with the synchronization signal generated by the synchronization signal generator.
A synthesizer for synthesizing the luminance signal included in the second video signal sequentially output from the camera so as to be output in each time slot of the color difference signal in the SDI standard, and outputting the SDI signal as an SDI signal; Video recording means for recording.

[0010] More specifically, the multi-image recording apparatus according to the first aspect of the present invention further comprises a first camera, a second camera provided separately from the first camera, and a first camera. Signal generator for generating a synchronization signal for operating the camera and the second camera in synchronization with each other, and sequentially output from the first camera operating in synchronization with the synchronization signal generated by the synchronization signal generator A first A / D converter for converting a first analog video signal into a first digital video signal; and a second camera sequentially output from the second camera operating in synchronization with the synchronization signal generated by the synchronization signal generator. A second A / D converter for converting an analog video signal into a second digital video signal; and a luminance signal included in the first digital video signal sequentially output from the first A / D converter is a luminance signal time according to the SDI standard. A combiner that combines a luminance signal included in the second digital video signal sequentially output from the second A / D conversion means in a time slot of a chrominance signal in the SDI standard and outputs the signal as an SDI signal. And video recording means for recording the SDI signal from the synthesizer.

A multi-image recording method according to a second aspect of the present invention is similar to the above-described method, except that a video signal sequentially output from each of a first camera and a second camera provided separately is provided. A multi-image recording method for recording as a multi-image, wherein a first image sequentially output from the first camera is provided.
Combining the luminance signal included in the video signal and the luminance signal included in the second video signal sequentially output from the second camera so as to be output alternately, and outputting the synthesized SDI signal; Recording the signal,
It has.

More specifically, the multi-image recording method according to the second aspect of the present invention records, as a multi-image, a video signal sequentially output from each of a first camera and a second camera separately provided. A multi-image recording method for synchronizing the first camera and the second camera, wherein a luminance signal included in a first video signal sequentially output from the synchronizing first camera is based on the SDI standard. In the time slot of the luminance signal, the luminance signal included in the second video signal sequentially output from the second camera operating synchronously is synthesized so as to be output in the time slot of the color difference signal in the SDI standard, and is output as the SDI signal. And recording the output SDI signal.

The multi-image recording method according to the second aspect of the present invention, in more detail, multiplies video signals sequentially output from each of a first camera and a second camera separately provided. 1. A multi-image recording method for recording as an image, comprising: synchronizing the first camera and a second camera; and converting a first analog video signal sequentially output from the synchronously operated first camera into a first digital video. Converting the second analog video signal sequentially output from the second camera operating synchronously to a second digital video signal, and sequentially outputting the second digital video signal. The luminance signal included in one digital video signal is a time slot of the luminance signal in the SDI standard, and the luminance signal included in the sequentially output second digital video signal is No. is SD synthesized as outputted in the time slots of the color difference signal in the SDI standard
Outputting as an I signal;
Recording a signal.

A multi-image recording apparatus according to a third aspect of the present invention has the same purpose as described above, and includes a plurality of cameras and a luminance signal included in a video signal output from each of the plurality of cameras. A combiner that combines the time slots of the luminance signal and the color difference signal in the SDI standard so as to be output in a predetermined order and outputs the SDI signal, and a video recording unit that records the SDI signal from the combiner. Have.

Further, a multi-image recording method according to a fourth aspect of the present invention is the same as the above, and is a multi-image recording method for recording video signals sequentially output from each of a plurality of cameras as a multi-image. A luminance signal included in a video signal output from each of the plurality of cameras is synthesized so as to be output in a predetermined order in a time slot of a luminance signal and a color difference signal in the SDI standard, and is output as an SDI signal. And recording the output SDI signal.

[0016]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 is a perspective view showing the appearance of a stereo image recording apparatus as an example of a multi image recording apparatus according to Embodiment 1 of the present invention. This stereo image recording device
It comprises a first camera 10, a second camera 11, a chassis 12, a control device 20, and a digital VTR 30.
The first camera 10 and the second camera 11 are fixed to the chassis 12 at a predetermined distance (base line length) in order to record a stereo image.

The first camera 10 and the second camera are constituted by monochrome cameras. The reason why a monochrome camera is used is that in order to recognize an object in a stereo image processing system, it is sufficient if the brightness of an image can be recognized. Although a color camera can be used as the first camera 10 and the second camera 11, as described later, a color difference signal for specifying a color among video signals obtained from the camera is not used. Then, it is preferable to use a monochrome camera.

A first video signal (analog signal) obtained by photographing with the first camera 10 is transmitted to the coaxial cable 1.
3 to the control device 20. Similarly, a second video signal (analog signal) obtained by shooting with the second camera 11 is supplied to the control device 20 via the coaxial cable 14.

The control device 20 will be described in detail later.
A two-channel signal such as a first video signal from the camera 10 and a second video signal from the second camera 11 is used to generate a one-channel SDI signal. Here, the SDI signal is an SDI signal used in many digital video devices.
(Serial Digital Interface) This is a signal conforming to the transmission system defined in the standard. According to this SDI standard,
A single coaxial cable can transmit video signals and four-channel audio signals. The SDI generated by the control device 20
The signal is supplied to the digital VTR 30 via the cable 15.

The digital VTR 30 is constituted by, for example, a D-1 format VTR. This digital V
TR is a digital component video signal standard (CCIR Rec. 60), which is one of the digital video signal standards.
1, CCIR Rec. 656) based on a component (so-called 4: 2: 2 component) coding method.

In the SDI standard, a color video signal is divided into a luminance signal (Y signal) and a color difference signal (Cr signal and Cb signal), and the sampling frequency of the color difference signal and the luminance signal is set to 1: 2. This reduces the amount of information handled. FIG. 3 shows the format of the SDI signal according to the SDI standard. As shown in the drawing, the SDI signal has a format in which a Y slot → Cr slot → Y slot → Cb slot →... Appears repeatedly. One set of Y signal, Cr signal and Cb signal corresponds to one pixel.

As described above, in the SDI signal, the information amount of the chrominance signal is the same as that of one luminance signal by thinning out the two chrominance signals, the Cr signal and the Cb signal, to 1/2. By the way, since a monochrome camera is used in this stereo image recording apparatus, a color difference signal does not exist in a video signal obtained from the monochrome camera, and a slot of a color difference signal, that is, each slot of a Cr signal and a Cb signal is fixed data. It has become. Therefore, when recording the SDI signal obtained from the monochrome camera, the portion of each slot of the Cr signal and the Cb signal is wasted.

In the first embodiment of the present invention, the luminance signal (Y1 signal) from the first camera 10 is transmitted to the slot of the Y signal in the SDI signal, and the luminance signal (Y1 signal) from the second camera 11 is transmitted to each slot of the Cr signal and the Cb signal. A luminance signal (Y2 signal) is recorded. As is apparent from FIG. 3, the Y signal from the second camera 11 is assigned to each slot of the Cr signal and the Cb signal.
The capacity to transmit two signals is secured.

FIG. 4 shows a format of an SDI signal used in the stereo image recording apparatus according to the first embodiment. As shown in the drawing, the SDI signal has a format in which the slot of the Y1 signal from the first camera 10 and the slot of the Y2 signal from the second camera 11 appear alternately. Each of the Y1 signal and the Y2 signal corresponds to one pixel. Thereby, in the normal SDI signal, the Y2 signal from the second camera 11 is recorded in the slot where the color difference signal is recorded.
The luminance signal of two channels can be digitally recorded by one uncompressed digital VTR.

Next, the detailed configuration of the control device 20 will be described with reference to the block diagram shown in FIG.
The control device 20 includes a synchronization signal generator 21, a first A / D
It comprises a converter 22, a second A / D converter 23 and a combiner 24.

The synchronizing signal generator 21 generates a synchronizing signal for synchronizing the first camera 10 and the second camera 11 and supplies it to the camera 10 and the second camera 11. The operations of the camera 10 and the second camera 11 are synchronized by the synchronization signal. For example, various timings such as a readout timing of a CCD image sensor included in the first camera and the second camera and an electronic shutter time are synchronized.

The first A / D converter 22 is connected to the first camera 10
Is converted into a 10-bit Y1 signal (digital signal) by sampling a luminance signal (analog signal) included in the first video signal from the VGA, for example, at a sampling frequency of 13.5 MHz. The Y1 signal from the first A / D converter 22 is supplied to a combiner 24.

Similarly, the second A / D converter 23 samples a luminance signal (analog signal) included in the second video signal from the second camera 11 at a sampling frequency of, for example, 13.5 MHz, thereby forming a 10-bit signal. It is converted into a Y2 signal (digital signal). This first A / D converter 2
2 is supplied to a combiner 24.

The combiner 24 combines the Y1 signal from the first A / D converter 22 and the Y2 signal from the second A / D converter 23. As the synthesizer 24, for example, the Y1 signal and the Y2 signal
A multiplexer that multiplexes the signal and outputs the multiplexed signal can be used. The signal synthesized by the synthesizer 24 is shown in FIG.
Is supplied to the digital VTR 30 as an SDI signal having a format as shown in FIG.

As described above, according to the stereo image recording apparatus of the first embodiment, the luminance signals included in the respective video signals from the two cameras are multiplexed,
Since the signal is synthesized with the signal, recording of a stereo image can be performed by one digital VTR. When the image is reproduced, the pixels of the image captured by the first camera 10 and the second camera 11
Since the pixels of the image taken at are read out alternately,
By separating these, two images can be reproduced simultaneously. Since the two reproduced images are images captured by the first camera 10 and the second camera 11 at the same time,
There is no need to manage using time codes.

Further, according to the stereo image recording apparatus according to the first embodiment, generally used 4:
Digital VT using 2: 2 component coding
Since a stereo image can be recorded in R, there is no need to prepare a special VTR for recording a stereo image, and a stereo image processing system can be configured at low cost.

Next, a multi-image recording apparatus according to Embodiment 2 of the present invention will be described. This multi-image recording device,
As shown in FIG. 5, the first camera 10, the second camera 11,
Four cameras, such as a third camera and a fourth camera, are provided. Each camera is constituted by a monochrome camera.
As in the first embodiment, a color camera can be used as each of the cameras. The first to fourth video signals obtained by shooting with each camera are supplied to the control device 20.

The control device 20 will be described in detail later.
The first video signal from the camera 10, the second video signal from the second camera 11, the third video signal from the third camera 16, and the fourth video signal from the fourth camera 17 Generate an SDI signal. The digital VTR 30 is the same as that used in the first embodiment.

FIG. 6 shows the format of the SDI signal used in the multi-image recording apparatus according to the second embodiment. As shown in the figure, the left half (corresponding to the first half of one scanning line when displayed on the display device) has a slot of the Y1 signal from the first camera 10 and a second half of the SDI signal.
The slot of the Y2 signal from the camera 11 appears alternately, and the right half (corresponding to the latter half of one scanning line when displayed on the display device) is the slot of the Y3 signal from the third camera 16 and the It has a format in which Y4 signal slots from four cameras 17 appear alternately.

Each of the Y1, Y2, Y3, and Y4 signals in FIG. 6 corresponds to one pixel. Thereby, in the normal SDI signal, the Y2 signal from the second camera 11 or the fourth camera 17 is stored in the slot where the color difference signal is recorded.
Is recorded, the luminance signal of four channels can be digitally recorded by one uncompressed digital VTR.

When the SDI signal having the format shown in FIG. 6 is displayed on the display, two screens can be simultaneously displayed as shown in FIG. That is, the image corresponding to the Y1 signal can be displayed on the left half, and the image corresponding to the Y3 signal can be displayed on the right half. Further, by switching the display target, an image corresponding to the Y2 signal can be displayed on the left half, and an image corresponding to the Y4 signal can be displayed on the right half. As a result, multi-view stereoscopic vision becomes possible, which is suitable for controlling a car or a robot.

Next, a detailed configuration of the control device 20 will be described with reference to a block diagram shown in FIG.
This control device 20 is different from the first embodiment in
There is a system. Specifically, the control device 20 includes a synchronization signal generator 21, a first A / D converter 22, a second A / D converter 23, a combiner 24, a third A / D converter 25, and a fourth A / D converter.
It comprises a D converter 27, a synthesizer 26 and a synthesizer 28.

The synchronization signal generator 21 is connected to the first camera 10,
A synchronization signal for synchronizing the second camera 11, the third camera 16 and the fourth camera 17 is generated and supplied to each camera 11. The operations of the camera 10 and the second camera 11 are synchronized by the synchronization signal.

The configurations and operations of the first A / D converter 22, the second A / D converter 23, and the combiner 24 are the same as those in the first embodiment. The configurations and operations of the third A / D converter 25, the fourth A / D converter 27, and the combiner 26 are as follows.
The configuration and operation of the first A / D converter 22, the second A / D converter 23 and the combiner 24 are the same.

The combiner 28 combines the luminance signal from the combiner 24 and the luminance signal from the combiner 26. Synthesizer 28
For example, a multiplexer that multiplexes and outputs these two luminance signals can be used. The signal synthesized by the synthesizer 28 is supplied to the digital VTR 30 as an SDI signal having a format as shown in FIG. 6, and is recorded on the digital VTR 30.

As described above, according to the multi-image recording apparatus of the second embodiment, the luminance signals included in the video signals from the four cameras are multiplexed and synthesized into the SDI signal. A single digital VTR can record multiple images. During image reproduction, pixels of an image captured by the first camera 10 and pixels of an image captured by the second camera are alternately read in the first half of the scanning line, and the third camera is read in the second half. Since the pixels of the image captured at 16 and the pixels of the image captured at the fourth camera 17 are alternately read, two images can be reproduced on one screen, and by separating these, four images can be reproduced. Can be played simultaneously. Since the four reproduced images are images captured simultaneously by four cameras, there is no need to manage them using time codes. Further, since the luminance signal is inserted into the slot of the color difference signal of the SDI signal, the amount of tape used can be reduced by half compared with the conventional case.

In the second embodiment, the case where four cameras are used has been described. However, the number of cameras to be used is not limited to four, but may be arbitrary.

In the second embodiment, the S
Although the format of the DI signal is configured as shown in FIG. 6, it is not limited to this. The SDI signal is, for example, as shown in FIG. 8, the Y1 signal from the first camera 10, the second camera 1
The Y2 signal from the first camera, the Y3 signal from the third camera 16 and the Y4 signal from the fourth camera 18 may be configured to be repeated.

The SDI signal may be configured so that, for example, the first half is the Y1 signal from the first camera 10 and the second half is the Y2 signal from the second camera 11, as shown in FIG. Although illustration is omitted, the first half is the third camera 16.
, And the latter part may be the Y4 signal from the fourth camera 17. With this configuration,
As shown in FIG. 7, two images can be displayed on one screen.

[0046]

As described in detail above, according to the present invention,
A multi-image recording apparatus and a multi-image recording method capable of recording and recalling multi-images without using a time code and recording multi-images with the same amount of tape as a monaural image can be provided.

[Brief description of the drawings]

FIG. 1 is an external perspective view of a stereo image recording apparatus according to Embodiment 1 of the present invention.

FIG. 2 is a block diagram showing a detailed configuration of a control device shown in FIG.

FIG. 3 is a diagram showing a format of a video signal according to the SDI standard.

FIG. 4 is a diagram showing a format of an SDI signal used in the stereo image recording device according to the first embodiment of the present invention.

FIG. 5 is a block diagram showing a configuration of a stereo image recording device according to Embodiment 2 of the present invention.

FIG. 6 is a diagram showing a format of an SDI signal used in the multi-image recording apparatus according to Embodiment 2 of the present invention.

7 is a diagram showing a display example when an image is displayed based on an SDI signal of the format shown in FIG. 6;

FIG. 8 is a diagram showing another format of the SDI signal used in the multi-image recording device according to the embodiment of the present invention.

FIG. 9 is a diagram showing still another format of the SDI signal used in the multi-image recording device according to the embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 1st camera 11 2nd camera 12 Chassis 13, 14 Coaxial cable 16 3rd camera 17 4th camera 20 Control device 21 Synchronous signal generator 22 1st A / D converter 23 2nd A / D converter 25 3rd A / D Converter 27 4th A / D converter 24, 26, 28 Synthesizer 30 Digital VTR

Claims (8)

[Claims] A first camera; a second camera provided apart from the first camera; a luminance signal included in a first video signal sequentially output from the first camera; Second output sequentially
A multi-image recording apparatus comprising: a synthesizer that synthesizes so that a luminance signal included in a video signal is output alternately and outputs the SDI signal; and a video recording unit that records the SDI signal from the synthesizer. 2. A first camera, a second camera spaced apart from the first camera, and a synchronization signal for generating a synchronization signal for operating the first camera and the second camera in synchronization with each other. A luminance signal included in a first video signal sequentially output from the first camera that operates in synchronization with a synchronization signal generated by the synchronization signal generator; A luminance signal included in a second video signal sequentially output from the second camera operating in synchronization with the synchronization signal generated by the synchronization signal generator is output in a time slot of a color difference signal in the SDI standard. And a video recording means for recording the SDI signal from the synthesizer. 3. A first camera, a second camera spaced apart from the first camera, and a synchronization signal for generating a synchronization signal for operating the first camera and the second camera in synchronization with each other. A first A / D converter for converting a first analog video signal sequentially output from the first camera operating in synchronization with a synchronization signal generated by the synchronization signal generator into a first digital video signal And a second A / A converter for converting a second analog video signal sequentially output from the second camera operating in synchronization with the synchronization signal generated by the synchronization signal generation means into a second digital video signal.
And a luminance signal included in the first digital video signal sequentially output from the first A / D conversion means is sequentially output from the second A / D conversion means in a time slot of the luminance signal in the SDI standard. A synthesizer for synthesizing a luminance signal included in the second digital video signal so as to be output in each time slot of a chrominance signal in the SDI standard and outputting the SDI signal; and a video recording means for recording the SDI signal from the synthesizer And a multi-image recording apparatus comprising: 4. A multi-image recording method for recording a video signal sequentially output from each of a first camera and a second camera separately provided as a multi-image, wherein the video signals are sequentially output from the first camera. A luminance signal included in the first video signal and a second signal sequentially output from the second camera.
A multi-image recording method, comprising: synthesizing a luminance signal included in a video signal so as to be output alternately; and outputting the combined signal as an SDI signal; and recording the output SDI signal. 5. A multi-image recording method for recording a video signal sequentially output from each of a first camera and a second camera separately provided as a multi-image, wherein the first camera, the second camera, And a luminance signal included in a first video signal sequentially output from the first camera operating synchronously is sequentially output from the second camera operating synchronously in a time slot of the luminance signal in the SDI standard. The luminance signal included in the second video signal
A multi-image recording method, comprising: combining the color difference signals in the DI standard so as to be output in time slots, and outputting the combined signals as an SDI signal; and recording the output SDI signal. 6. A multi-image recording method for recording a video signal sequentially output from each of a first camera and a second camera provided separately as a multi-image, wherein the first camera, the second camera, Synchronously operating; converting a first analog video signal sequentially output from the first camera operating synchronously to a first digital video signal and sequentially outputting the digital digital video signal; sequentially outputting from the second camera operating synchronously Converting the second analog video signal into a second digital video signal and sequentially outputting the second digital video signal; and wherein the luminance signal included in the sequentially output first digital video signal is a time slot of a luminance signal in the SDI standard, Luminance signals included in the sequentially output second digital video signal are output in time slots of color difference signals in the SDI standard. A multi-image recording method comprising the steps of: synthesizing the SDI signal and outputting the SDI signal; and recording the output SDI signal. 7. A plurality of cameras, and a luminance signal included in a video signal output from each of the plurality of cameras is output in a predetermined order in a time slot of a luminance signal and a color difference signal in the SDI standard. And a video recording means for recording the SDI signal from the synthesizer. 8. A multi-image recording method for recording a video signal sequentially output from each of a plurality of cameras as a multi-image, wherein a luminance signal included in the video signal output from each of the plurality of cameras is: A multi-image recording method comprising: synthesizing a time slot of a luminance signal and a color difference signal according to the SDI standard so as to be output in a predetermined order and outputting the SDI signal; and recording the output SDI signal. Method.