JPH1132305A - Video recording and reproducing device and method, video transmitter and method, video receiver and method and video transmitter-receiver and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video recording and reproducing device or the like that properly interpolates a produced missing image. SOLUTION: A video recording and reproducing device 10 is provided with a motion vector detection means 5 that detects a motion vector prior to recording a video signal onto a recording medium 8, a recording means 4 that adds the motion vector to the video signal and records the resulting vector to the recording medium 8, a missing detection means 7 that detects a missing state of an image to be reproduced in the case of reading the video signal from the recording medium 8, an image interpolation means 6 that interpolates a missing image corresponding to the result of detection by the missing detection means 7 based on the motion vector, and a reproduction means that provides an output of the video signal interpolating a missing image by the image interpolation means 6. The video recording and reproducing device 10 adds the motion vector detected by the motion vector detection means 5 to the video signal and records the resulting signal to the recording medium 8 to allow the image interpolation means 6 to interpolate the missing image caused at reproduction of the video signal based on the motion vector.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video recording / reproducing apparatus and method suitably used for a video recording / reproducing apparatus such as an optical disk recording / reproducing apparatus and a video transmitting apparatus such as a videophone, a video transmitting apparatus and method, and a video receiving apparatus. The present invention relates to an apparatus and a method, and an image transmitting and receiving apparatus and a method.

[0002]

2. Description of the Related Art In recent years, with the rapid development of digital technology, video recording / reproducing apparatuses for digitally recording / reproducing video signals and audio signals on recording media such as hard disks and optical disks have been actively developed. In addition, with the development of communication technology, a video transmission device for transmitting a video signal and an audio signal via a transmission medium such as a coaxial cable or an optical cable like a so-called videophone has been actively developed.

[0003]

By the way, in the conventional video recording / reproducing apparatus, when a missing portion occurs in a reproduced image at the time of reproducing a video signal, processing such as simply duplicating the preceding and succeeding frames as is is performed. Interpolation processing has been performed on defective reproduction frames.

However, according to such interpolation processing, a defective reproduction frame is discarded, and a reproduced image is replaced with a frame before and after the defective reproduction frame. However, there has been a problem that the continuity of the image is lost at the time of so-called mode transition in which the image moves a lot, and the viewer feels strange.

Further, in a video transmission device such as a videophone, all the image data cannot be transmitted when the transmission rate of the transmission medium is restricted, so that the reproduced image on the receiving side is incomplete or reproduced. Is often missing, and the continuity of the image is lost.
The receiving side often felt uncomfortable and uncomfortable.

SUMMARY OF THE INVENTION The present invention has been proposed to solve the above-mentioned problems, and when a missing image occurs, an image recording / reproducing apparatus and method capable of appropriately interpolating the image, and a video transmitting apparatus. It is an object of the present invention to provide an image receiving apparatus and method, an image receiving apparatus and method, and an image transmitting and receiving apparatus and method.

[0007]

In order to solve the above problems, a video recording and reproducing apparatus according to the present invention comprises: a motion vector detecting means for detecting a motion vector prior to recording a video signal on a recording medium; Recording means for adding a motion vector to a recording medium, recording a video signal from the recording medium, detecting a loss state of an image to be reproduced, and an image corresponding to a detection result of the loss detection means. An image interpolating means for interpolating the missing of the image based on the motion vector, and a reproducing means for outputting a video signal in which the missing image is interpolated by the image interpolating means.

[0008] According to the video recording / reproducing apparatus, by adding the motion vector detected by the motion vector detecting means to the video signal and recording it on a recording medium, an image generated at the time of reproducing the video signal based on the motion vector is obtained. Are interpolated by the image interpolation means.

In order to solve the above problems, a video recording / reproducing method according to the present invention detects a motion vector prior to recording a video signal on a recording medium and adds the motion vector to the video signal to record the video signal on the recording medium. Then, when a video signal is read from the recording medium, a missing state of an image to be reproduced is detected, the detected missing part of the image is interpolated based on the motion vector, and a video signal in which the missing part of the image is interpolated is output.

According to the video recording / reproducing method, by adding a motion vector to a video signal and recording it on a recording medium,
On the basis of the motion vector, the lack of an image generated at the time of reproducing the video signal is interpolated.

According to another aspect of the present invention, there is provided a video transmitting apparatus comprising: a motion vector detecting unit configured to detect a motion vector prior to transmitting a video signal; The image processing apparatus includes a missing information generating unit that generates information about a video signal of a frame as missing information, and a transmitting unit that adds a motion vector and missing information to the video signal and transmits the video signal.

According to the video transmitting apparatus, before transmitting the video signal, detection of a motion vector and generation of missing information are performed, and these are added to the video signal by the transmitting means and transmitted.

[0013] In order to solve the above-mentioned problems, a video transmission method according to the present invention detects a motion vector before transmitting a video signal, and transmits information on a video signal of a frame that cannot be transmitted when transmitting a video signal. Is generated as missing information, and a motion vector and missing information are added to the video signal and transmitted.

According to the video transmission method, prior to transmission of a video signal, detection of a motion vector and generation of missing information are performed, and these are added to the video signal and transmitted.

Further, in order to solve the above-mentioned problems, the video receiving apparatus according to the present invention comprises: a receiving means for receiving a video signal to which image missing information and a motion vector are added; A detection unit for detecting a vector and an image interpolation unit for interpolating a missing image based on the detected missing information and the motion vector are provided.

According to the video receiving apparatus, the missing information and the motion vector are detected by the detecting means from the video signal received by the receiving means, and the image interpolating means interpolates the missing image using the motion vector based on the missing information. I do.

In order to solve the above problems, a video receiving method according to the present invention receives a video signal to which missing information and a motion vector of an image are added, detects missing information and a motion vector from the received video signal, A missing image is interpolated based on the detected missing information and the motion vector.

According to the video receiving method, the missing information and the motion vector are detected from the received video signal, and the missing image is interpolated based on the detected missing information and the motion vector.

Further, in order to solve the above-mentioned problems, the video transmitting / receiving apparatus according to the present invention comprises: a motion vector detecting means for detecting a motion vector prior to transmitting a video signal; A transmitter comprising: a missing information generating means for generating information about a video signal of an unacceptable frame as missing information; a transmitter having a transmitting means for adding a motion vector and missing information to the video signal and transmitting the missing signal; and adding the missing information and the motion vector. Receiving means for receiving the detected video signal, detecting means for detecting missing information and a motion vector from the received video signal, and image interpolating means for interpolating missing images based on the detected missing information and the motion vector. Equipped receiver.

According to the video transmitting / receiving device, the transmitter adds the missing information and the motion vector to the video signal and transmits the video signal to the receiver, and the receiver detects the missing information and the motion vector from the video signal, A missing image is interpolated based on the detected missing information and the motion vector.

In order to solve the above-mentioned problems, a video transmitting / receiving method according to the present invention detects a motion vector prior to transmitting a video signal, and transmits information on a video signal of a frame that cannot be transmitted when transmitting a video signal. Is generated as missing information, the motion vector and the missing information are added to the video signal and transmitted, the video signal to which the missing information and the motion vector are added is received, and the missing information and the motion vector are detected from the received video signal. , And interpolates the missing image based on the detected missing information and the motion vector.

According to the video transmission / reception method, the missing information and the motion vector are added to the video signal and transmitted, and the receiving side detects the missing information and the motion vector from the video signal, and converts the detected missing information and the motion vector into the detected missing information and the motion vector. The missing image is interpolated based on this.

[0023]

Embodiments of the present invention will be described in detail with reference to the drawings. A video recording / reproducing apparatus 10 to which the present invention is applied shown in FIG. 1 includes a system controller 1 for controlling the entire apparatus, a recording control signal input unit 2, a reproduction control signal input unit 3, and a recording signal processing system 4.
, A signal detection system 5, a reproduction signal processing system 6, and a signal detection system 7. This video recording / reproducing device 1
Reference numeral 0 denotes a recording system for recording a video signal and an audio signal on the recording medium 8 by the system controller 1, the recording control signal input unit 2, the recording signal processing system 4, and the signal detection system 5. The video recording / reproducing device 10 includes a system controller 1, a reproduction control signal input unit 3, a reproduction signal processing system 6,
The signal detection system 7 constitutes a reproduction system for reproducing a video signal and an audio signal from the recording medium 8.

The recording control signal input unit 2 and the reproduction control signal input unit 3 give instructions to the system controller 1 to control each block during recording and reproduction, respectively.

The recording signal processing system 4 receives an externally supplied video signal and audio signal, and performs predetermined processing on each of these signals. The signal detection system 5 detects a motion vector from the video signal input to the recording signal processing system 4 and supplies the motion vector to the recording signal processing system 4. Then, the recording signal processing system 4 adds the motion vector to the video signal that has been subjected to the predetermined processing, and records the video signal on the recording medium 8.

The recording medium 8 according to this embodiment
For example, a hard disk, an optical disk, a memory card, and other various media can be applied, and there is no particular limitation.

On the other hand, the reproduction signal processing system 6 reads out the video signal and the audio signal to which the motion vector has been added from the recording medium 8 and reproduces them. At this time, the signal detection system 7 detects whether or not the reproduced image is missing from the reproduced video signal, and supplies the missing information to the reproduced signal processing system 6. Then, when there is a loss in the reproduced image, the reproduced signal processing system 6 interpolates the lost image using the above-described motion vector, and outputs the interpolated signal to an external block such as a monitor device.

FIG. 2 shows a specific configuration of the recording system of the video recording / reproducing apparatus 10. As shown in FIG. 2, the recording system includes a video / audio input processing unit 16 including a video signal processing unit 11, a camera signal processing unit 12, a tuner unit 13, an audio signal processing unit 14, and a microphone input audio processing unit 15. A video signal switching unit 17 and an audio signal switching unit 18 for selecting a video signal and an audio signal to be recorded on the recording medium 8 from various video signals and audio signals output from the video / audio input processing unit 16; A video signal A / D converter 19 and an audio signal A / D converter 20 for converting an audio signal from analog to digital, a video signal detection control unit 21, an audio signal detection control unit 22, and a video signal band compression processing unit 23 And audio signal band compression processing unit 24 and recording data processing unit 2
5 is provided.

The video / audio input processing section 16 performs predetermined processing as needed on analog video and audio signals supplied from external blocks. Video /
In the audio input processing unit 16, a video signal supplied from an external VTR device or the like is sent to the video signal processing unit 11, a video signal supplied from a video camera device or the like is sent to the camera signal processing unit 12, The video / audio signals supplied from the antenna are input to the tuner unit 13, and the video signals subjected to the predetermined processing in these blocks are supplied to the video signal switching unit 17.

In the video / audio input processing section 16, the audio signal supplied from the VTR device or the like is sent to the audio signal processing section 14, and the audio signal supplied from the microphone or the like of the video camera device is sent to the microphone input audio signal. An image / video supplied from an antenna for television broadcasting or the like is sent to the processing unit 15.
The audio signals are input to the tuner unit 13, and the audio signals subjected to the predetermined processing in these blocks are supplied to the audio signal switching unit 18.

The video signal switching unit 17 selects a video signal to be recorded on the recording medium 8, and thus selects the video signal processing unit 11, the camera signal processing unit 12, and the video signal processing unit 11 of the video / audio input processing unit 16.
The video signals supplied from the tuner section 13 are switched as necessary and supplied to the video signal A / D conversion section 19.

Similarly, the audio signal switching section 18 selects an audio signal to be recorded on the recording medium 8, so that the audio signal processing section 14, the microphone input audio processing section 15, and the tuner section 13 of the video / audio input processing section 16. The audio signals supplied from are switched as necessary and supplied to the audio signal A / D converter 20.

The video signal A / D conversion unit 19 converts the analog video signal supplied from the video signal switching unit 17 into a digital signal, and supplies this digital video signal to the video signal detection control unit 21. When the video signal supplied from the external block is digital, the video / audio input processing unit 16, the video signal switching unit 17, and the video signal A /
What is necessary is just to supply directly to the video signal detection control unit 21 without going through the D conversion unit 19.

Similarly, the audio signal A / D conversion unit 20 converts the analog audio signal supplied from the audio signal switching unit 18 into a digital signal, and supplies the digital audio signal to the audio signal detection control unit 22. I do. Similarly, when the audio signal supplied from the external block is digital, the audio signal detection control is directly performed without passing through the video / audio input processing unit 16, the audio signal switching unit 18, and the audio signal A / D conversion unit 20. What is necessary is just to supply to the part 22.

The video signal detection control section 21 performs predetermined processing on the input video signal as required, and supplies this video signal to the video signal band compression processing section 23. Further, the video signal detection control unit 21 detects a motion vector from the input video signal or the video signal after the above processing, and supplies the motion vector to the recording data processing unit 25.

The audio signal detection control section 22 performs predetermined processing on the input audio signal as necessary, and supplies this audio signal to the audio signal band compression processing section 24.

The video signal band compression processing section 23 compresses the video signal supplied from the video signal detection control section 22 by a predetermined compression method, and supplies the compressed video signal to the recording data processing section 25.

Similarly, the audio signal band compression processing unit 24
The audio signal supplied from the audio signal detection control unit 22 is compressed by a predetermined compression method, and the compressed audio signal is supplied to the recording data processing unit 25.

The recording data processing unit 25 performs predetermined processing on the input video signal, the motion vector for the video signal, and the audio signal, and records the processed signal on the recording medium 8. Specifically, the recording data processing unit 25 records the audio signal and the motion vector on the recording medium 8 while superimposing the audio signal and the motion vector on the video signal.

These series of processes are executed based on a control signal from the system controller 1. The system controller 1 receives a recording operation signal from the recording control signal input unit 2 when the user operates a remote controller 9 having the recording control signal input unit 2 and the reproduction control signal input unit 3 built therein. . System controller 1
Outputs a control signal based on the recording operation signal.

Next, the control flow of the recording system for recording the video / audio signal of the video recording / reproducing apparatus 10 on the recording medium 8 will be described with reference to the flowchart of FIG.

At step S1 after the power is turned on, the system controller 1 performs initial processing, that is, initialization of each block.

In the next step S2, the system controller 1 determines whether or not an operation input has been made by detecting the presence or absence of the recording operation signal output from the remote controller 9 described above. , And if there is an operation input, the process proceeds to step S3.

In step S3, the system controller 1 outputs a control signal to each block of the recording system shown in FIG. 2, and performs control for selecting each input video / audio signal and performing predetermined processing. At this time, the above-described video signal detection control unit 21 detects a motion vector.

In the subsequent step S4, the system controller 1 outputs a control signal to the recording data processing section 25, so that the motion vector and the compressed audio signal are superimposed on the compressed video signal, and Control recording. After the end of the recording process, the system controller 1 returns to step S2, and shifts to a state of waiting for an operation input from the remote controller 9.

Next, FIG. 4 shows a specific configuration of a reproduction system for reproducing the video / audio signal from the recording medium 8.
As shown in FIG. 4, the reproduction system includes a reproduction data processing unit 31 to which data recorded on the recording medium 8 is input,
A video signal band expansion processing unit 32 and an audio signal band expansion processing unit 33 for performing expansion processing on the video signal and the audio signal, a video signal detection control unit 34, an audio signal detection control unit 35, and digitally converting the video signal and the audio signal. A video signal D / A converter 36 and an audio signal D / A converter 37 for performing an analog conversion process, a video signal output processor 38 and an audio signal for performing a process for outputting a video signal and an audio signal to an external block An output processing unit 39 is provided.

The reproduction data processing section 31 reads out the data recorded on the recording medium 8, and reproduces video signal data, motion vector data, and audio signal data from the data. Then, the reproduction data processing unit 31 converts the data of the video signal into the video signal band extension processing unit 3.
Second, the motion vector data is transferred to the video signal detection control unit 34.
Then, the audio signal data is supplied to the audio signal band expansion processing unit 33. Here, the reproduction data processing unit 31
When reproducing the video signal data, it is determined whether or not a missing image has occurred. Then, the reproduction data processing unit 31
When a missing image has occurred, a drop identification signal as the above-described missing information is generated, and the drop identification signal is supplied to the video signal detection control unit 34 together with the motion vector.

The video signal band expansion processing section 32 corresponds to the video signal band compression processing section 23 shown in FIG.
The video signal data supplied from the reproduction data processing unit 31 is subjected to a predetermined decompression process to return to a digital signal before compression, and this signal is supplied to the video signal detection control unit 34.

Similarly, the audio signal band extension processing unit 33
This corresponds to the audio signal band compression processing section 24 shown in FIG. 2, and performs predetermined expansion processing on the audio signal data supplied from the reproduction data processing section 31 to return to the digital signal before compression. To the audio signal detection control unit 35
To supply.

The video signal detection control section 34 performs predetermined processing on the digital video signal supplied from the video signal band expansion processing section 32, and outputs the processed video signal as an analog signal. In the D / A converter 36,
When outputting as a digital signal, it is supplied to each external block as it is. At this time, the video signal detection control unit 3
Reference numeral 4 denotes a case where a drop, that is, a missing image occurs in the video signal output from the video signal band extension processing unit 32 based on the presence or absence of the drop identification signal from the reproduction data processing unit 31. The missing image is interpolated by using the motion vector supplied from 31. The details of the control of the interpolation of the missing image will be described later.

The audio signal detection control unit 35 performs a predetermined process on the digital audio signal supplied from the audio signal band expansion processing unit 33, and outputs the processed audio signal as an analog signal. In the D / A converter 37,
When outputting as a digital signal, it is supplied to each external block as it is.

The video signal D / A converter 36 converts the digital video signal supplied from the video signal detection controller 34 into an analog signal and supplies the analog signal to the video signal output processor 38. The video signal that has been subjected to predetermined processing such as amplification by the video signal output processing unit 38 is output to an external block such as a monitor device.

Similarly, the audio signal D / A converter 37 converts the digital audio signal supplied from the audio signal detection controller 35 into an analog signal and supplies the analog signal to the audio signal output processor 39. The audio signal that has been subjected to the predetermined processing by the audio signal output processing unit 39 is output to an external block such as a monitor device.

These series of processes are executed based on a control signal from the system controller 1. When the user operates the remote controller 9 having the recording control signal input unit 2 and the reproduction control signal input unit 3 therein, the system controller 1 controls the reproduction control signal input unit 3.
Is input. The system controller 1 outputs a control signal based on the reproduction operation signal.

Next, a flow of control of a reproduction system for reproducing a video / audio signal from the recording medium 8 in the video recording / reproducing apparatus 10 will be described with reference to a flowchart of FIG.

In step S11 after the power is turned on, the system controller 1 performs initial processing, that is, initialization of each block.

In the next step S12, the system controller 1 determines whether or not an operation input has been made by detecting the presence or absence of the output of the reproduction operation signal from the remote controller 9 described above.
, And if there is an operation input, the process proceeds to step S13.

In step S13, the system controller 1 outputs a control signal to the reproduction data processing unit 31, so that the reproduction data processing unit 31 reads out the data recorded on the recording medium 8, and from this data, the video signal, The motion vector and the audio signal data are reproduced.

In the following step S14, the reproduction data processing section 31 determines whether or not the reproduction of the video signal is successful. If it is determined that the reproduction is successful, the process proceeds to step S16. If it is determined that the reproduction is not successful, the process proceeds to step S15. Proceed to. Note that this processing is performed by the reproduction data processing unit 31 described above.
Is a process of determining whether or not a missing image has occurred when reproducing data of a video signal. In this embodiment, by detecting a reproduction output level and the like, the reproduction execution state is determined in units of frames. It is determined whether or not a missing image has occurred.

The reproduction data processing section 31 determines in step S15
, The above-described drop identification signal is generated, and this drop identification signal is supplied to the video signal detection control unit 34 together with the motion vector, and the process proceeds to step S16.

In step S16, the video signal detection control section 34 determines whether or not the drop identification signal is supplied. If it is determined that the drop identification signal is not supplied, the video / audio signal is not subjected to the interpolation processing described later. Is performed, and the process returns to step S12 to wait for the next operation input from the remote controller 9. On the other hand, when it is determined that the drop identification signal has been supplied, the video signal detection control unit 34 proceeds to step S17.

The video signal detection control unit 34 determines in step S1
In step 7, the missing image is interpolated using the motion vector supplied from the reproduction data processing unit 31, and the output of the interpolated video signal and audio signal is performed. After that, the process returns to step S12 to wait for the next operation input from the remote controller 9.

Next, the motion vector detection processing in step S3 described in FIG. 3 and the step S3 described in FIG.
17 will be described in detail.

In the case where there is a missing portion in the reproduced image, interpolation has conventionally been performed by processing such as duplicating the previous frame as described above. However, in the present invention, the interpolation is performed before or after the frame with the missing image. A process of creating or restoring a drop image is performed using the motion vector added to the frame, and interpolation is performed using this image.

As described above, the video signal detection control unit 21 detects a motion vector in step S3. At this time, the image (screen) of each frame of the video signal is divided into several regions. , A motion vector is obtained for each of the consecutive frames before and after.

On the other hand, as described above, the video signal detection control section 34 sets the reproduction data processing section 31 in step S17.
The missing image is interpolated using the motion vector supplied from the above.In this case, the motion vector added to the previous frame or the subsequent frame of the frame having the missing image is used for each of the above regions. An interpolated image is created by moving the image of each area according to the obtained motion vector.

In FIG. 6, the video signal detection control section 21 obtains a motion vector from an arbitrary frame (here, the N-th frame is called N frame) and the next frame (here, called N + 1 frame). An example in which the motion vector is used to create an interpolation image will be described. Here, for convenience of description, one frame (one screen) is divided into 168 regions (vertical division into 12 regions,
Although an example in which 14 frames are divided in the horizontal direction is shown, how to divide one frame is not limited to this example.

The video signal detection controller 21 obtains a motion vector for each of the N frame shown in FIG. 6A and the N + 1 frame shown in FIG. 6B. This allows
Between the Nth frame and the N + 1th frame, the flying object 41 moves to the left and the cloud 42 moves to the right. Therefore, as shown in FIG. , The motion vector is not detected in the area of the mountain 43 and the sky 44 which are not moving as the background of the flying object 41 and the cloud 42. The motion vector detected in this manner is recorded on the recording medium 8 while being superimposed on, for example, a video signal of N frames.

On the other hand, when, for example, the (N + 1) -th frame becomes a missing image during reproduction of the recording medium 8, the video signal detection control unit 34 uses the motion vector detected during the reproduction of the N frame as follows. The missing image is interpolated. That is, the video signal detection control unit 34 determines the N-frame image of the flying object 41 and the image of the cloud 42 as shown in FIG.
A predetermined area of N frames is moved by the vector as shown in (C), and a part of N + 1 frames is created (restored). On the other hand, since the mountain 43 and the sky 44 do not move as described above, the N frame is copied as it is for the area. As a result, the same image as the (N + 1) th frame is created as an interpolation image. As a vector detection method at this time, for example, a representative point matching method may be used.

FIG. 7 shows the timing at which the drop identification signal is generated when the video recording / reproducing apparatus 10 reproduces. Here, it is assumed that the recording medium 8 is the hard disk 45 shown in FIG. 7A, and the video signal recorded on the hard disk 45 is reproduced. As shown in FIG.
When the reproduction mode is changed to the track reproduction, a drop frame X as shown in FIG. 7C is generated due to the restriction of the access time accompanying the movement of the magnetic head 46, for example.
Here, it is assumed that four drop frames X have occurred.

At this time, since the reproduction level is reduced as shown in FIG. 7D, the reproduction data processing unit 31 detects this reduction in the reproduction level and outputs the drop identification signal shown in FIG. Output to the video signal detection control unit 34. Then, the video signal detection control unit 34 performs the above-described interpolation processing only while the drop identification signal is being supplied.
FIG. 7F shows an example of the conventional interpolation processing, and FIG. 7G shows an example of the interpolation processing according to the present invention. That is, in the conventional example, as shown in FIG. 7 (F), for example, the interpolation process is performed by repeatedly reproducing the frame A8 before the drop by four frames.
In the present invention, the frame A shown in FIG.
Interpolation processing is performed by creating 9, A10, A11, and A12 and interpolating these frames.

Next, a method of adding the detected motion vector will be described. In the present invention, a case where a motion vector for a frame after the frame is added to a certain frame and a case where a motion vector for both a frame before and after the frame are added to a certain frame There are times when you do. In other words, in the present invention, there are a case where the motion vector for the drop frame is added to the previous frame and a case where it is added to the previous and subsequent frames.

First, FIG. 8 shows an example in which a motion vector for a drop frame is added to the previous frame. In this example, an image (screen) of one frame is divided into 16 (4 × 4) areas to obtain 16 motion vectors, and the motion vectors are converted into video signals 1 by the number of frames in which a drop may occur. Add to frame. For example, when adding a motion vector for two frames to the N frame shown in FIG. 6A, as shown in the upper left column of FIG.
By adding 16 motion vectors between the (N + 1) th frame and 16 motion vectors between the (N + 1) th frame and the (N + 2) th frame to the video signal of the Nth frame, a total of 32 motion vectors are added to the Nth frame. To do.

When a motion vector for four frames is added to the N frame shown in FIG. 6A, as shown in the middle left column of FIG. Motion vectors and N + 1 frames to N
16 motion vectors between +2 frames, 16 motion vectors between N + 2 frames to N + 3 frames, and N + 3
By adding 16 motion vectors between the frame and the N + 4 frame, a total of 64 motion vectors are added to the N frames.

Further, when there are many frames in which a drop can occur, the number of vectors added to the video signal of N frames is increased.

As shown in the middle and right columns of FIG. 8, N + 1 frames, N + 2 frames,... Is added to the frame.

Next, FIG. 9 shows an example in which a motion vector for a drop frame is added to both the previous frame and the subsequent frame. In this example, the screen is 16
, And 16 motion vectors are obtained, and the motion vectors are added to the video signal for a frame in which a drop may occur. In this case, for example, the N shown in FIG.
When adding motion vectors for four frames to a frame, as shown in the upper left column of FIG. 9, two frames are motion vectors for the previous two frames, and two frames are motion vectors for the second two frames.
Add a motion vector for the frame. The addition of the motion vector in this manner is effective in the case of reverse processing such as reverse reproduction.

Also in this case, if the number of frames in which a drop can occur is large, the number of motion vectors to be added is increased accordingly.

When a motion vector is added in accordance with the number of frames in which the above-mentioned drop may occur, the number of added motion vectors may increase, which may cause a load on processing such as data storage. In such a case, the motion vectors are integrated according to the number of frames where a drop can occur. For example, FIG. 8 shows how to create two interpolation frames.
In the example shown in the upper column, 16 × 2 = 32 motion vectors are added to the video signal for one frame.
As shown in FIG. 7 (G), when four interpolation frames are created and the processing load such as data storage becomes heavy, the above-mentioned 16 motion vectors are averaged and integrated per one frame, and one frame is used. If there are eight motion vectors, then 8 × 4 = 32, and the number of vectors is the same as when two frames are added. Further, when eight interpolation frames are created, the average is further integrated to obtain four motion vectors per frame, which is 4 × 8 = 32, and the number of vectors is the same as in each case described above.

FIG. 10 shows a specific example of the averaging integration described above.
Shown in In this example, a total of 16 motion vectors A, B, C,..., P in each region of one screen (one frame) divided into 16 regions shown in FIG. Vectors A ', C', E ', G', I ',
FIG. 10B shows an example of averaging integration of K ′, M ′, and O ′.
FIG. 10 shows an example in which the above 16 motion vectors are averaged and integrated into four motion vectors A ″, C ″, I ″, and K ″.
(C) shows each.

That is, in the example of FIG.
The motion vectors A and B shown in (A) are averaged and integrated with the motion vector A ′, and the motion vectors C and D are converted to the motion vector C ′.
In this manner, the number of vectors in one frame is reduced to half. On the other hand, FIG.
In the example of 0 (C), the motion vectors A, B, E, and F shown in FIG. 10A are averaged and integrated into the motion vector A ", and the motion vectors C, D, G, and H are converted into the motion vector C". By averaging and integrating,..., The number of vectors in one frame is reduced to 1/4. By performing such averaging and integration to reduce the number of motion vectors per frame, it is possible to avoid various inconveniences that occur when the number of frames to be interpolated increases.

In the above-described example, the averaging integration is performed with the integrated area being uniform. However, if the motion vectors in the integrated area are different, an error occurs in the integrated motion vector. For example, when there are 16 motion vectors as shown in FIG. 11 (A), if averaging integration as performed in FIG. 10 (C) is attempted, As a result, the direction of the motion vector (for example, the direction of the motion vector A) is not accurately reflected. In such a case, the integration process is performed between similar regions.

That is, when the motion vectors have the distribution as shown in FIG. 11A, the isolated motion vector A and the motion vector D are respectively changed to the motion vector A ″ and the motion vector A ″ as shown in FIG. D ", and the motion vectors B, C, E, F, G, I, J,
K are integrated as a motion vector B ″. Further, vectors H, L,
The six motion vectors M, N, O, and P are integrated into four vectors as shown in Fig. 11C as a motion vector H ". Such processing is hereinafter referred to as four-vector similar integration.

According to the four-vector similar integration process,
It is possible to create a more accurate interpolation image with a small number of motion vectors. That is, each vector in four adjacent regions is averaged and integrated.
In the case of (B), the vectors A, D, H, and the like among the 16 motion vectors are not reflected.
In the four-vector similar integration shown in (C), regions having more similar motion vectors are integrated to create four motion vectors.
Will be reflected with high accuracy.

Incidentally, each motion vector may be weighted and integrated. For example, among the above 16 regions,
Generally, the probability that a subject is present in the four middle areas is very high, and therefore, the motion vectors F, G, J, and K are more important than the motion vectors of the surrounding areas. And the like.

Further, the motion vector is composed of a case where a vector obtained between frames is used as a motion vector as it is, and a case where a synthesized vector obtained by adding the vectors obtained between frames in accordance with the frame distance is obtained, and this synthesized vector is obtained. A vector may be a motion vector. Less than,
Each of these cases will be described with reference to FIGS.

FIG. 12 shows a case where vectors Q and R for two frames (N + 1 frame, N + 2 frame) are added to the video signal of N frames (hereinafter, referred to as “previous frame addition”). Note that the vectors Q and R in this case are generic names of a plurality of vectors obtained by collecting motion vectors in the above-described divided areas.

Here, in (1) of FIG. 12, a vector obtained between frames is used as a motion vector as it is. In this case, since the frame distance is always one frame, there is an advantage that the magnitude of the vector to be handled does not become a large value. On the other hand, since it is necessary to obtain a vector in advance according to the frame distance, the interpolation process tends to be heavier as the number of frames added to the N frames increases, in other words, as the frame distance increases.

In (2) of FIG. 12, a combined vector obtained by adding the vectors obtained between the frames in accordance with the frame distance is obtained, and this combined vector is set as a motion vector. In this case, since the motion vector can be used directly without performing the vector calculation, the processing at the time of interpolation can be reduced. On the other hand, since the magnitude of the vector changes according to the frame distance, the setting of the frame distance is restricted when the data length is fixed.

FIG. 13 shows a case where vectors Q and R for two frames (N + 1 frame, N frame) are added to a video signal of N + 2 frames (hereinafter, referred to as “post-frame addition”). Note that the vectors Q and R in this case are also generic names of a plurality of vectors obtained by collecting motion vectors in the above-described divided areas.

FIG. 13C shows a case where a vector obtained between frames is used as a motion vector. (4) in FIG. 13 shows a case where a combined vector obtained by adding the vectors obtained between frames according to the frame distance is obtained, and this combined vector is used as a motion vector. Note that (3) and (4) in FIG. 13 correspond to (1) and (2) in FIG. 12 described above, and a description thereof will be omitted.

As described above, in the video recording / reproducing apparatus 10, the optimal interpolation processing can be performed by appropriately selecting the method of creating and adding the motion vector according to the form of the recording medium 8.

Next, an embodiment of a video transmitting / receiving system to which the present invention is applied will be described with reference to the drawings. FIG.
The video transmitting / receiving system 50 to which the present invention shown in FIG.
System controller 51 for controlling the entire system
, A transmission control signal input unit 52 and a reception control signal input unit 5
3, a transmission signal processing system 54, a signal detection system 55, a reception signal processing system 56, a signal detection system 57, and a transmission system 58.

The video transmission / reception system 50 includes a transmission system for transmitting a video signal and an audio signal via the transmission system 58 by the system controller 51, the transmission control signal input unit 52, the transmission signal processing system 54, and the signal detection system 55. Be composed.

The video transmission / reception system 50 comprises a system controller 51, a reception control signal input unit 53, a reception signal processing system 56, and a signal detection system 57. A receiving system for receiving a signal is configured.

The transmission control signal input section 52 and the reception control signal input section 53 give instructions to the system controller 51 to control each block at the time of transmission and at the time of reception, respectively. Note that the system controller 51
Although FIG. 14 shows one block, the transmitting system and the receiving system may include different blocks.

The transmission signal processing system 54 receives a video signal and an audio signal supplied from the outside and performs predetermined processing on these signals. The signal detection system 55 detects a motion vector from the video signal input to the transmission signal processing system 54 and supplies the motion vector to the transmission signal processing system 54. And
The transmission signal processing system 54 adds the motion vector to the video signal that has been subjected to the predetermined processing, and transmits the video signal to the transmission system 58.

Further, at the time of transmission to the transmission system 58, the transmission signal processing system 54 detects a transmission omission of a video signal due to a limitation of a transfer rate to the transmission system 58 or the like on a frame basis. Is generated as a drop identification signal. The transmission signal processing system 54 also adds the drop identification signal to the video signal and sends it to the transmission system 58.

The transmission system 58 in this embodiment
For example, various transmission paths such as a coaxial cable and an optical cable, and a repeater thereof.

On the other hand, the reception signal processing system 56 receives and reproduces the video signal and the audio signal to which the motion vector has been added, transmitted from the transmission system via the transmission system 58. At this time, the signal detection system 57 determines whether or not the drop identification signal has been transmitted from the transmission system. If it is determined that the drop identification signal has been transmitted, the signal detection system 57 transmits missing information indicating that the received video signal has a missing portion. It is supplied to the reception signal processing system 56. And
The reception signal processing system 56 performs interpolation of the missing image based on the missing information using the above-described motion vector, and outputs the interpolated signal to an external block such as a monitor device.

FIG. 15 shows a specific configuration of the transmission system of the video transmission / reception system 50. Most of the configuration of this transmission system is the same as the configuration of the recording system of the video recording / reproducing apparatus 10 shown in FIG. 2, and therefore, the same components are denoted by the same reference numerals and detailed description thereof will be given. Description is omitted. As shown in FIG. 15, the transmission system of the video transmission / reception system 50 includes a video / audio input including a video signal processing unit 11, a camera signal processing unit 12, a tuner unit 13, an audio signal processing unit 14, and a microphone input audio processing unit 15. A processing unit 16; a video signal switching unit 17 for selecting a video signal and an audio signal to be transmitted to the transmission system 58 from each video signal and each audio signal supplied from the video / audio input processing unit 16; A video signal A / D converter 19 and an audio signal A / D converter 20 for performing analog / digital conversion of a video signal and an audio signal, and a video signal detection controller 21
, An audio signal detection control unit 22, a video signal band compression processing unit 23, an audio signal band compression processing unit 24, and a transmission data processing unit 59.

The transmission data processing section 59 includes a video signal supplied from the video signal band compression processing section 23, a motion vector for the video signal supplied from the video signal detection control section 21, and an audio signal band compression processing section 24. A predetermined process is performed on the audio signal supplied from the controller and output to the transmission system 58.
The transmission data processing unit 59 corresponds to the signal detection system 55 shown in FIG. 14, and transmits the drop identification signal for the video signal that cannot be transmitted as described above when transmitting the motion vector and the audio signal. Generate. Then, the transmission data processing section 59 superimposes the drop identification signal, the audio signal and the motion vector on the video signal, and outputs the signal to the transmission system 58.

The control of each of these blocks in the transmission system is performed based on a control signal from the system controller 51. The system controller 51 includes a keyboard, mouse,
Or, by the user operating the remote control etc.,
A transmission operation signal is input from the transmission control signal input unit 52. The system controller 51 outputs a control signal based on the transmission operation signal. Note that the control signal from the system controller 51 may be output based on a reception operation signal from a reception control signal input unit 53 which is a component of the reception system.

Next, the control flow of the transmission system for outputting the video / audio signal of the video transmission / reception system 50 to the transmission system 58 will be described with reference to the flowchart of FIG.

In step S21 after the power is turned on, the system controller 51 performs initial processing, that is, initialization of each block.

In the following step S22, the system controller 51 outputs the transmission operation signal from the transmission control signal input unit 52 or the reception control signal input unit 53
By detecting the presence or absence of the output of the reception operation signal from the CPU, it is determined whether or not there is an operation input, and the process waits in step S22 until there is an operation input, and proceeds to step S23 when there is an operation input.

In step S23, the system controller 51 outputs a control signal to each block of the transmission system shown in FIG. 15, selects each input video / audio signal, and performs a predetermined process. At this time, the video signal detection control unit 21 detects a motion vector.

In the subsequent step S24, the system controller 51 controls the transmission data processing section 59 to calculate the transferable frame of the video signal when outputting the video signal and the audio signal to the transmission system 58. Do. In this embodiment, the number of frames that can be transferred is determined from the amount of data compressed by the compression processing units 23 and 24.

In the next step S25, the transmission data processing section 59 adds a motion vector to the video signal of the frame that cannot be transferred. That is, in the case of the video recording / reproducing apparatus 10 described above, the configuration of the additional vector is changed according to the frame that may be dropped. In the case of the video transmitting / receiving system 50, however, the motion vector added according to the transfer rate is changed. Change the configuration. For example, if only one frame can be transferred to three frames, a motion vector for two frames is added. In step S26, the transmission data processing unit 59 similarly adds a drop identification signal to the video signal of the frame that cannot be transferred, and proceeds to step S27.

As a method of adding the motion vector and the drop identification signal, the same method as that of the video recording / reproducing apparatus 10 described with reference to FIGS. 6 to 13 can be applied. That is, in step S25, the motion vector detected by the video signal detection control unit 21 can be added by the above-described various methods. In this embodiment, the method of adding a motion vector is appropriately changed according to the number of dropped frames.

In step S27, the transmission data processing section 59 performs a transmission process of converting the signals, motion vectors, and the like into data that can be transmitted to the transmission system 58, such as serial conversion, and transmitting the data. When the transmission process is completed, the process returns to step S22, and the system controller 51 shifts to a state of waiting for an operation input from the transmission control signal input unit 52.

Next, a specific configuration of the receiving system of the video transmitting / receiving system 50 is shown in FIG. This receiving system is substantially the same as the reproducing system of the video recording / reproducing apparatus 10 shown in FIG. 4. Therefore, the same components are denoted by the same reference numerals and will not be described in detail. Omitted.

The receiving system of the video transmitting / receiving system 50 is shown in FIG.
As shown in FIG. 7, a reception data processing unit 60 to which the data of the video signal, the audio signal, the drop identification signal, and the motion vector subjected to the serial conversion and the like via the transmission system 58 is input.
A video signal band extension processing unit 32 and an audio signal band extension processing unit 33; a video signal detection control unit 34 and an audio signal detection control unit 35; a video signal D / A conversion unit 36 and an audio signal D / A conversion unit 37, a video signal output processing unit 38 and an audio signal output processing unit 39. That is, the configuration of the receiving system other than the reception data processing unit 60 is the same as the configuration of the reproducing system of the video recording / reproducing apparatus 10.

The reception data processing unit 60 receives the data of the video signal, the audio signal, the drop identification signal, and the motion vector, which have been subjected to serial conversion, through the transmission system 58, and extracts the video and audio signals from the data. The data is converted into compressed data and the like before transmission by the transmission system, and the motion vector and the drop identification signal are extracted. Received data processing unit 60
Supplies the converted video signal data to the video signal band expansion processing unit 32, the audio signal data to the audio signal band expansion processing unit 33, and the motion vector and the drop identification signal to the video signal detection control unit 34, respectively.

Each of these blocks in the receiving system is controlled based on a control signal from the system controller 51. The system controller 51 receives a reception operation signal from the reception control signal input unit 53 when a user operates a keyboard, a mouse, a remote controller, or the like that includes the reception control signal input unit 53. The system controller 51 outputs a control signal based on the reception operation signal. The control signal from the system controller 51 is transmitted to the transmission control signal input unit 5.
2 may be output on the basis of the transmission operation signal.

Next, the control flow of the receiving system for receiving and reproducing the video / audio signal via the transmission system 58 in the video transmitting / receiving system 50 will be described with reference to the flowchart of FIG.

At step S31 after the power is turned on, the system controller 51 performs initial processing, that is, initialization of each block.

In the following step S32, the system controller 51 outputs the reception operation signal from the reception control signal input unit 53 or the transmission control signal input unit 52
By detecting the presence or absence of the output of the transmission operation signal from the CPU, it is determined whether or not an operation input has been made, and the process waits in step S32 until there is an operation input. If the operation input has been made, the transmission system shown in FIG. After the respective blocks are controlled to transmit a video signal or the like, the process proceeds to step S33.

In step S33, the system controller 51 controls the reception data processing unit 60 to transmit the serially converted video signal, audio signal, drop identification signal, and motion vector data transmitted from the transmission system. Is performed.

In the next step S34, the received data processing section 60 determines the presence or absence of a drop identification signal in the received data on a frame basis. If the received data processing unit 60 determines that there is a drop identification signal, the received data processing unit 60 extracts the drop identification signal and the motion vector added thereto, and converts the extracted drop identification signal and motion vector into a video signal. Detection control unit 3
4 and the process proceeds to step S35. On the other hand, when it is determined that there is no drop identification signal, the reception data processing unit 60 performs output processing of the video / audio signal without performing the interpolation processing, and returns to step S32 to return to the reception control signal input unit 53 or The state shifts to a state of waiting for the next operation input from the transmission control signal input unit 52.

The video signal detection control unit 34 determines in step S3
In step 5, the missing image is interpolated using the motion vector supplied from the reception data processing unit 60. Then, thereafter, the process returns to step S32 and the reception control signal input unit 53
Alternatively, the processing shifts to a state of waiting for the next operation input from the transmission control signal input unit 52.

[0122]

As described above in detail, according to the video recording / reproducing apparatus of the present invention, the video signal is recorded on the recording medium by adding the motion vector detected by the motion vector detecting means. Since the loss of the image generated at the time of reproducing the video signal is interpolated by the image interpolation means based on the motion vector, the continuity of the reproduced image is ensured, and when the loss of the image occurs in a portion where the image has a lot of motion, The discomfort felt by the viewer is removed or reduced.

According to the video recording / reproducing method according to the present invention,
Adding a motion vector to the video signal and recording it on a recording medium,
Based on this motion vector, the lack of an image generated during the reproduction of the video signal is interpolated, so that the continuity of the reproduced image is ensured, and the viewer feels when the image is lost in a portion where the image has a lot of motion. The discomfort is removed or reduced.

Further, according to the video transmitting apparatus of the present invention, prior to transmitting the video signal, detection of the motion vector and generation of missing information are performed, and these are added to the video signal by the transmitting means and transmitted. Therefore, by transmitting information about a frame that cannot be transmitted in advance to the receiver, the interpolation processing in the receiver is quickly performed.

According to the video transmission method according to the present invention, prior to the transmission of the video signal, the detection of the motion vector and the generation of the missing information are performed, and these are added to the video signal and transmitted, whereby the reception is performed. It is possible to quickly perform the interpolation processing in the machine.

Further, according to the video receiving apparatus of the present invention, the missing information and the motion vector are detected by the detecting means from the video signal received by the receiving means, and the image interpolating means uses the motion vector based on the missing information. Thus, the continuity of the image is ensured, and the discomfort and discomfort felt by the viewer are removed or greatly reduced.

According to the video receiving method of the present invention, the missing information and the motion vector are detected from the received video signal, and the missing of the image is interpolated based on the detected missing information and the motion vector. Continuity of
The discomfort and discomfort felt by the viewer are removed or greatly reduced.

Further, according to the video transmitting / receiving apparatus of the present invention, the transmitter adds the missing information and the motion vector to the video signal and transmits the video signal to the receiver, and the receiver transmits the missing information and the motion vector. Since the image loss is detected from the video signal and the image loss is interpolated based on the detected loss information and the motion vector, even if all the video signals cannot be transmitted due to a limitation of a transmission system or the like, the image can be received at the receiver. Continuity is ensured, and discomfort and discomfort felt by the viewer are removed or greatly reduced.

According to the video transmitting / receiving method of the present invention, the missing information and the motion vector are added to the video signal and transmitted.
The receiving side detects the missing information and the motion vector from the video signal, and interpolates the missing image based on the detected missing information and the motion vector. Even if there is no such information, the continuity of the image is secured on the receiving side, and the discomfort and discomfort felt by the viewer are removed or greatly reduced.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an overall configuration of a video recording / reproducing apparatus to which the present invention has been applied.

FIG. 2 is a block diagram showing a circuit configuration of a recording system of the apparatus.

FIG. 3 is a flowchart for explaining an operation at the time of recording.

FIG. 4 is a block diagram showing a circuit configuration of a reproduction system of the apparatus.

FIG. 5 is a flowchart for explaining an operation at the time of reproduction.

FIG. 6 is a diagram for explaining a method of detecting a motion vector and a method of creating an interpolation image using the motion vector.

FIG. 7 is a timing chart for explaining missing image interpolation processing during reproduction.

FIG. 8 is a diagram for explaining a method of adding a detected motion vector.

FIG. 9 is a diagram for explaining a method of adding a detected motion vector.

FIG. 10 is a diagram for describing a method of averaging and integrating motion vectors.

FIG. 11 is a diagram for describing a method of averaging and integrating motion vectors.

FIG. 12 is a diagram for explaining a method of adding a detected motion vector.

FIG. 13 is a diagram for explaining a method of adding a detected motion vector.

FIG. 14 is a block diagram showing the overall configuration of a video transmission / reception system to which the present invention has been applied.

FIG. 15 is a block diagram illustrating a circuit configuration of a transmission system of the system.

FIG. 16 is a flowchart illustrating an operation at the time of transmission.

FIG. 17 is a block diagram showing a circuit configuration of a receiving system of the system.

FIG. 18 is a flowchart illustrating an operation at the time of reception.

[Explanation of symbols]

10 video recording / reproducing device, 1 system controller,
4 recording signal processing system, 5 signal detection system, 6 reproduction signal processing system, 7 signal detection system, 8 recording medium, 21 video signal detection control unit, 25 recording data processing unit, 31 reproduction data processing unit, 34 video signal detection control Unit, 50 video transmission / reception system, 51 system controller, 54 transmission signal processing system, 55 signal detection system, 56 reception signal processing system, 5
7 signal detection system, 58 transmission system, 59 transmission data processing unit, 60 reception data processing unit

Claims (40)

[Claims] 1. A motion vector detecting means for detecting a motion vector prior to recording a video signal on a recording medium; a recording means for adding the motion vector to a video signal and recording the video signal on the recording medium; A missing detecting means for detecting a missing state of an image to be reproduced when reading the image from the recording medium; an image interpolating means for interpolating the missing of the image detected by the missing detecting means based on the motion vector; A video recording / reproducing apparatus comprising: a reproducing unit that outputs a video signal in which a missing image has been interpolated by an interpolating unit. 2. The video recording / reproducing apparatus according to claim 1, wherein said motion vector detecting means detects the motion vector from a motion of an image between frames before and after a video signal. 3. The motion vector detecting means, wherein one frame of the video signal is divided into a plurality of regions, and a motion vector is detected for each of the regions from the motion of an image between frames before and after the video signal. The video recording / reproducing device according to claim 1. 4. The method according to claim 1, wherein the motion vector detecting means reduces the number of motion vectors by averaging and integrating the motion vectors of the predetermined areas after detecting the motion vector for each area. 4. The video recording / reproducing device according to 3. 5. The apparatus according to claim 4, wherein the motion vector detecting means averages and integrates motion vectors of areas having substantially the same vector after detecting a motion vector for each area. Video recording and playback device. 6. The recording means adds the motion vector detected from the motion of the image between the preceding and succeeding frames of the video signal to one or both of the preceding and succeeding frames of the video signal and records the motion vector on the recording medium. The video recording / reproducing apparatus according to claim 2, wherein: 7. The recording means according to claim 1, wherein said motion vector detected from the motion of the image between frames before and after the video signal is divided into a plurality of frames before or after the video signal in accordance with the number of frames in which a missing image can occur. 3. The video recording / reproducing apparatus according to claim 2, wherein the video recording / reproducing apparatus is added to a frame and recorded on the recording medium. 8. A method for detecting a motion vector before recording a video signal on a recording medium, adding the motion vector to the video signal, recording the video signal on the recording medium, and reading the video signal from the recording medium. A video recording / reproducing method, comprising: detecting a missing state of an image to be reproduced; interpolating the detected missing image based on the motion vector; and outputting a video signal in which the missing image is interpolated. 9. The video recording / reproducing method according to claim 8, wherein the motion vector is detected from a motion of an image between frames before and after the video signal. 10. The video according to claim 8, wherein one frame of the video signal is divided into a plurality of regions, and a motion vector is detected for each of the regions from the motion of an image between frames before and after the video signal. Recording and playback method. 11. The video recording / reproducing apparatus according to claim 10, wherein after detecting a motion vector for each area, the number of motion vectors is reduced by averaging and integrating motion vectors of predetermined areas. Method. 12. The video recording / reproducing method according to claim 11, wherein after detecting a motion vector for each area, motion vectors of areas having substantially the same vector are averaged and integrated. 13. The method according to claim 1, wherein the motion vector detected from the motion of the image between the preceding and succeeding frames of the video signal is added to one or both of the preceding and succeeding frames of the video signal and recorded on the recording medium. The video recording / reproducing method according to claim 9. 14. The motion vector detected from the motion of an image between frames before and after a video signal is added to one or more frames before or after the video signal according to the number of frames in which a missing image can occur. The video recording / reproducing method according to claim 9, wherein recording is performed on the recording medium. 15. A motion vector detecting means for detecting a motion vector prior to transmitting a video signal, and missing information generation for generating information about a video signal of a frame that cannot be transmitted as missing information when transmitting a video signal. And a transmitting unit for adding the motion vector and the missing information to the video signal and transmitting the video signal. 16. The video transmitting apparatus according to claim 15, wherein said motion vector detecting means detects the motion vector from a motion of an image between frames before and after a video signal. 17. The motion vector detecting means according to claim 1, wherein one frame of the video signal is divided into a plurality of regions, and a motion vector is detected for each of the regions from a motion of an image between frames before and after the video signal. The video transmission device according to claim 15. 18. The method according to claim 18, wherein the motion vector detecting means reduces the number of motion vectors by averaging and integrating the motion vectors of the predetermined areas after detecting the motion vector for each area. 18. The video transmission device according to item 17. 19. The apparatus according to claim 18, wherein the motion vector detecting means averages and integrates motion vectors of areas having substantially the same vector after detecting a motion vector for each area. Video transmission device. 20. The video transmitting apparatus according to claim 15, wherein the transmitting unit transmits the video signal by adding a motion vector for a frame that cannot be transmitted to the video signal. 21. A method for detecting a motion vector prior to transmitting a video signal, generating information about a video signal of a frame that cannot be transmitted as missing information when transmitting the video signal, A video transmission method, wherein the transmission is performed with the missing information added. 22. The video transmission method according to claim 21, wherein the motion vector is detected from a motion of an image between frames before and after the video signal. 23. The video according to claim 21, wherein one frame of the video signal is divided into a plurality of regions, and a motion vector is detected for each of the regions from the motion of an image between frames before and after the video signal. Transmission method. 24. The video transmission method according to claim 23, wherein after detecting a motion vector for each area, the number of motion vectors is reduced by averaging and integrating motion vectors of predetermined areas. . 25. The video transmission method according to claim 24, wherein after detecting a motion vector for each area, motion vectors of areas having substantially the same vector are averaged and integrated. 26. The video transmission method according to claim 21, wherein a motion vector for a frame that cannot be transmitted is added to the video signal and transmitted. 27. A receiving means for receiving a video signal to which missing information and a motion vector of an image are added, a detecting means for detecting the missing information and the motion vector from the received video signal, and the detected missing A video receiving apparatus comprising: image interpolating means for interpolating a missing image based on information and the motion vector. 28. Receiving a video signal to which missing information and a motion vector of an image are added, detecting the missing information and the motion vector from the received video signal, and adding the detected missing information and the motion vector to the video signal. A video receiving method comprising: interpolating a missing image based on the image. 29. Motion vector detecting means for detecting a motion vector prior to transmitting a video signal, and missing information generation for generating information about a video signal of a frame that cannot be transmitted as missing information when transmitting a video signal. Means, a transmitter comprising: a transmitting means for adding the motion vector and the missing information to the video signal for transmission; a receiving means for receiving the video signal to which the missing information and the motion vector are added; A detection unit for detecting the missing information and the motion vector from the video signal, and a receiver including image interpolation means for interpolating a missing image based on the detected missing information and the motion vector. Characteristic video transmission / reception device. 30. The motion vector detecting means of the transmitter detects the motion vector from the motion of an image between frames before and after a video signal.
2. The video transmitting / receiving device according to claim 1. 31. The motion vector detecting means of the transmitter divides one frame of a video signal into a plurality of regions, and detects a motion vector for each of the regions from a motion of an image between preceding and succeeding frames of the video signal. 29. The method of claim 29, wherein
2. The video transmitting / receiving device according to claim 1. 32. The motion vector detecting means of the transmitter, after detecting a motion vector for each area, reduces the number of motion vectors by averaging and integrating motion vectors of predetermined areas. Claim 31
2. The video transmitting / receiving device according to claim 1. 33. The motion vector detecting means of the transmitter, after detecting a motion vector for each area, averages and integrates motion vectors of areas having substantially the same vector. 2. The video transmitting / receiving device according to claim 1. 34. The video transmitting / receiving apparatus according to claim 29, wherein the transmitting unit of the transmitter transmits a video signal by adding a motion vector for a frame that cannot be transmitted to the video signal. 35. A method for detecting a motion vector prior to transmitting a video signal, generating information on a video signal of a frame that cannot be transmitted as missing information when transmitting the video signal, and including the motion vector and the motion vector in the video signal. Transmits the missing information with the missing information, receives the video signal to which the missing information and the motion vector are added, detects the missing information and the motion vector from the received video signal, and detects the missing information. And interpolating missing images based on the motion vector. 36. The video transmitting / receiving method according to claim 35, wherein the motion vector is detected from a motion of an image between frames before and after the video signal. 37. The video according to claim 35, wherein one frame of the video signal is divided into a plurality of regions, and a motion vector is detected for each of the regions from the motion of an image between frames before and after the video signal. Transmission / reception method. 38. The video transmitting / receiving method according to claim 37, wherein after detecting a motion vector for each area, the number of motion vectors is reduced by averaging and integrating the motion vectors of the predetermined areas. . 39. The video transmission / reception method according to claim 38, wherein after detecting a motion vector for each area, motion vectors of areas having substantially the same vector are averaged and integrated. 40. The video transmission / reception method according to claim 35, wherein a motion vector for a frame that cannot be transmitted is added to the video signal and transmitted.