CN102111621B - Video data recovery method, device and system - Google Patents

Abstract

The embodiment of the present invention discloses a method for recovering video data, including: acquiring video data at the same moment and corresponding calibration camera parameters at a different angle from the lost video data; parameters to construct recovery data and use the recovery data to replace the lost video data. The embodiments of the present invention improve the quality of reconstructed images. The embodiment of the present invention also discloses a device and a system for applying the above method.

Description

A method, device and system for restoring video data

technical field

The invention relates to the technical field of communication, in particular to a method, device and system for recovering video data. the

Background technique

Along with the development of the communication network, the codec technology of the video data has also made great progress. The encoded data will be decoded before it can be played normally. If the encoded data is lost during storage or network transmission, decoding errors will occur, causing the decoder to crash and mosaic phenomenon. the

The prior art discloses a compensation method for lost data. The compensation method is based on the time domain, and needs to copy the entire video data macroblock of the previous frame of the current frame with the lost data to the current frame. Specifically, if there is data loss in the data stream, then judge whether to complete the prediction, estimation and compensation of the lost data at the software processing layer, otherwise play the video data; if it is determined that the prediction, estimation and compensation of the lost data are completed at the software processing layer, then judge The real-time requirements of the system; if the system has high requirements for real-time performance, the lost data will be estimated and compensated based on the time domain; Domain compensation; enter the decoder processing layer, the decoder performs spatial domain-based prediction and estimation and time-domain compensation on the received video coded data stream with data loss; the decoder decodes the received video coded data stream, And send it to the playback device for playback, and complete the compensation for the lost data based on the above judgment and selection. the

Like ordinary video encoding data, multi-view video encoding data also suffers from packet loss during network transmission. Since video frames are in units of frames, a partial loss of a certain frame of data is likely to cause the frame of data to be undecodeable. the

In the process of realizing the present invention, the inventor finds that the prior art has at least the following defects:

The lost data compensation method in the prior art is based on the time domain, and it is necessary to copy the video data macroblock of the previous frame of the lost data video frame to the current frame as a whole. The quality of the reconstructed video data is poor, and there is a more obvious block effect. When the entire frame is lost, it cannot be recovered, and the video redundancy information of different viewpoints in space is not utilized. the

Contents of the invention

Embodiments of the present invention provide a method, device and system for restoring video data, which are used to improve the quality of reconstructed images. the

Embodiments of the present invention provide a method for recovering video data, including:

Decode and play the video data of each angle of view sent by the received video sender, and detect the latest received P frame in the video data in real time; obtain the motion vector of each macroblock of the P frame, and use the P frame image In the inter prediction mode, the area where the macroblock whose motion vector is zero is located updates the static area;

When the loss of video data is detected, obtain the video data at the same moment as the angle of view of the lost video data and the corresponding calibration camera parameters;

Construct restoration data according to the acquired video data and corresponding calibration camera parameters, and use the restoration data to replace the lost video data. the

Embodiments of the present invention also provide a device for recovering video data, including:

The acquisition module is used to acquire the video data at the same moment as the angle of view of the lost video data and the corresponding calibration camera parameters;

A recovery module, configured to construct recovery data according to the video data acquired by the acquisition module and corresponding calibration camera parameters, and use the recovery data to replace the lost video data;

The update module, when decoding and playing the video data sent by the received video sending end, detects the latest received P frame in the video data in real time; obtains the motion vector of each macroblock of the P frame, and uses P In the inter prediction mode of the frame image, the area where the macroblock whose motion vector is zero is located is updated as a static area for use by the recovery module. the

Embodiments of the present invention also provide a system for recovering video data, including:

The video sending end is used to send video data of various angles of view and calibrate the camera parameters to the video receiving end;

The video receiving end is used to receive video data and calibration camera parameters from various angles of view of the video sending end, decode and play the received video data, detect the latest received P frame in the video data in real time, and obtain the latest received The motion vector of each macroblock of the P frame, using the area where the macroblock whose motion vector is zero under the inter-frame prediction mode of the P frame image is used to update the static area, when the video data loss is detected, the acquisition and the lost For video data with different viewing angles at the same moment, recovery data is constructed according to the acquired video data and corresponding calibration camera parameters, and the lost video data is replaced by the recovery data. the

Compared with the prior art, the embodiment of the present invention has the following advantages: the embodiment of the present invention utilizes the video data of various angles of view and the calibration camera parameters to construct recovery data, and replaces the lost video data with the obtained recovery data, eliminating the need for recovery data. The blocking effect, which utilizes the redundant information of the video from different viewpoints in space, improves the quality of the reconstructed image. the

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments of the present invention or the prior art. Obviously, the accompanying drawings in the following description These are only some embodiments of the present invention, and those skilled in the art can also obtain other drawings based on these drawings without any creative effort. the

Fig. 1 is a kind of flow chart of the method for recovering video data in the embodiment of the present invention;

Fig. 2 is a kind of flow chart of the method for recovering video data in the embodiment of the present invention two;

Fig. 3 is a kind of flow chart of the method for recovering video data in the embodiment of the present invention three;

FIG. 4 is a schematic diagram of a frame structure of a multi-view system in Embodiment 4 of the present invention;

Fig. 5 is a kind of flow chart of the method for recovering video data in the embodiment of the present invention four;

Fig. 6 is a schematic structural diagram of a device for recovering video data in Embodiment 5 of the present invention;

Fig. 7 is a schematic structural diagram of a device for recovering video data in Embodiment 6 of the present invention;

Fig. 8 is a schematic structural diagram of a device for recovering video data in Embodiment 7 of the present invention;

FIG. 9 is a schematic structural diagram of a system for recovering video data in Embodiment 8 of the present invention. the

Detailed ways

In the technical solution provided by the embodiment of the present invention, the core idea is that when video data loss is detected, according to the received calibration camera parameters from the video sending end and the video data at the same moment with a different angle of view from the lost video data, use the intermediate The view generation method constructs the restored data, and uses the static area comparison method to optimize the constructed restored data, and uses the optimized restored data to replace the lost video data. the

The following will clearly and completely describe the technical solutions of the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention. the

As shown in Figure 1, it is a flow chart of a method for recovering video data in Embodiment 1 of the present invention, including the following steps:

Step 101, obtain the video data at the same moment different from the angle of view of the lost video data and the corresponding calibration camera parameters. the

Specifically, video data and calibration camera parameters of various viewing angles from the video sending end may be received, and when video data loss is detected, video data and corresponding calibration camera parameters at a different viewing angle from the lost video data are acquired at the same moment. Among them, the calibration camera parameters include camera internal parameters and camera external parameters, and the camera internal parameters include (lens) normalized focal length on the horizontal axis, (lens) normalized focal length on the vertical axis, nonlinear distortion parameters on the horizontal axis, vertical Axis nonlinear distortion parameters, horizontal axis offset and vertical axis offset and other parameters; camera external parameters include coordinate parameters of the camera relative to the external world, such as x, y, z, deflection, etc., which basically determine the position of a rigid body required parameters. the

Step 102: Construct restoration data according to the acquired video data and corresponding calibration camera parameters, and use the restoration data to replace the lost video data. the

Specifically, the above constructing the recovery data according to the acquired video data and the corresponding calibration camera parameters specifically includes: constructing at least two reconstruction frames according to the acquired video data and the corresponding calibration camera parameters, and acquiring the distance from the lost video The latest video frame of the same viewing angle that can be correctly decoded; compare the similarity between each reconstructed frame and the acquired video frame in the static area, and use the reconstructed frame with the highest similarity as the restored data. the

The above-mentioned comparison of the similarity between each reconstructed frame and the acquired video frame in the static area specifically includes: calculating the absolute value difference between the brightness values of the pixel points in the static area between each reconstructed frame and the acquired video frame sum, and the reconstructed frame with the smallest sum of absolute value differences is taken as the reconstructed frame with the highest similarity. the

The embodiment of the present invention utilizes the video data of various angles of view and the calibration camera parameters to construct recovery data, and replaces the lost video data with the obtained recovery data, which eliminates the block effect of the recovery data, and utilizes video redundancy information of different viewpoints in space, Improved the quality of reconstructed images. the

The method for recovering video data in the embodiment of the present invention is applied to a system including a video sending end and a video receiving end, wherein the video sending end is composed of a camera acquisition device and an encoder, and parameters of the camera need to be calibrated, including internal parameters and external parameters; The video receiving end receives video data through the network, and decodes the received video data. the

The method for restoring video data in the embodiment of the present invention will be described in detail below in combination with the above application scenarios. the

As shown in Figure 2, it is a flow chart of a method for recovering video data in Embodiment 2 of the present invention, including the following steps:

In step 201, the video sending end calibrates the cameras of each viewing angle. the

Specifically, the input-output relationship of the camera can be determined, and the graduation value of the camera can be assigned; the static characteristic index of the camera can also be determined; system errors can also be eliminated, and the accuracy of the camera or system can be improved. the

In step 202, the video sending end sends the calibrated camera parameters and video data of each viewing angle to the video receiving end. the

Step 203, the video receiving end detects the loss of video data, obtains the video data at the same moment with a different viewing angle from the lost video data, constructs at least two reconstruction frames according to the obtained video data and the corresponding calibration camera parameters, and obtains the distance loss The video data is the closest correctly decoded video frame of the same view. the

Specifically, according to the principle of camera projection, the coordinates of the actual object can be converted to the coordinates of the video image, that is, X _p = M ₁ *M ₂ *X _w , where X _p is the coordinate of the image, and M ₁ is the internal parameter of the camera , M ₂ is the camera external parameters, X _w the actual object coordinates. In the embodiment of the present invention, a reconstruction frame is constructed using an intermediate view generation method, and several video frames are recovered from the video frames at the same time at a different viewing angle from the lost video data, and the video frames are used as the reconstruction frame.

For example, given the images of viewpoint 1 and viewpoint 3, since there is a mapping relationship between the actual object coordinates and image coordinates, the viewpoint 1 can be calculated by using the formula X _p = M ₁ *M ₂ *X _w when the calibration camera parameters are obtained and the image of viewpoint 2 between viewpoint 3.

Step 204, the video receiving end detects the P frame of the same viewing angle closest to the lost video data, obtains the motion vector of each macroblock of the P frame, and stores the macroblock whose motion vector is zero in the inter prediction mode of the P frame image The area where it is located serves as the static area of this perspective. the

Specifically, each image frame may be further divided into macroblocks, including macroblocks in the intra-frame prediction mode of the P-frame image and macroblocks in the inter-frame prediction mode of the P-frame image. For the macroblock under the intra-frame prediction mode of the P frame image, it can be determined that the area where the macroblock is located is not in the static area; for the macroblock under the inter-frame prediction mode of the P frame image, during the decoding process of video data, it can be The motion vector of each macroblock is obtained. When the motion vector of the macroblock is zero, it means that the macroblock is the same as the macroblock at the same position in the previous frame, and it can be determined that the area of the macroblock is located in the static area. the

Step 205 , the video receiving end compares the degree of similarity between each reconstructed frame and the acquired video frame in the static area, takes the reconstructed frame with the highest degree of similarity as the recovery data, and uses the recovery data to replace the lost video data. the

Specifically, the smaller the image change degree in the static area, the higher the similarity between the reconstructed frame and the previous frame of this view in the static area, and the better the reconstructed image quality of the reconstructed frame, which can be selected as the final restored data instead of the lost video data. In the specific implementation process, the sum of the absolute value differences between each reconstructed frame and the acquired video frame's pixel brightness values in the static area can be calculated, and the reconstructed frame with the smallest absolute value difference is regarded as the highest similarity reconstruction frame. the

The embodiment of the present invention utilizes spatial redundancy information and temporal image information to construct restoration data, optimizes the constructed restoration data, replaces lost video data with the optimized restoration data, and eliminates the block effect of restoration data , the quality of the reconstructed image is improved, and the static area needs to be selected only when video data loss is detected, and there are few changes to the prior art. the

As shown in Figure 3, it is a flow chart of a method for recovering video data in Embodiment 3 of the present invention, including the following steps:

In step 301, the video sending end calibrates the cameras of each viewing angle. the

In step 302, the video sending end sends the calibrated camera parameters and video data of each viewing angle to the video receiving end. the

In step 303, the video receiving end decodes and plays the received video data, and detects the latest received P frame in the video data in real time. the

In step 304, the video receiving end acquires the motion vector of each macroblock of the newly received P frame, and updates the static area using the area where the macroblock whose motion vector is zero in the inter prediction mode of the P frame image is located. the

Step 305, the video receiving end detects the loss of video data, obtains the video data at the same time as the angle of view of the lost video data, constructs at least two reconstruction frames according to the obtained video data and the corresponding calibration camera parameters, and obtains the distance loss The nearest video frame of the video data that can be correctly decoded from the same view. the

Step 306, the video receiving end calculates the sum of the absolute value differences between each reconstructed frame and the acquired video frame in the pixel point brightness value in the static area, and takes the reconstructed frame with the smallest absolute value difference sum as the restored data, and Use this recovered data to replace lost video data. the

The embodiment of the present invention utilizes spatial redundancy information and temporal image information to construct restoration data, optimizes the constructed restoration data, replaces lost video data with the optimized restoration data, and eliminates the block effect of restoration data , which improves the quality of the reconstructed image. the

As shown in FIG. 4 , it is a schematic diagram of the frame structure of the multi-viewpoint system in Embodiment 4 of the present invention, including 5 viewpoints, and each viewpoint is coded and decoded separately, assuming that the P[4][3] frame in the figure is lost. the

As shown in Figure 5, it is a flow chart of a method for recovering video data in Embodiment 4 of the present invention, including the following steps:

In step 401, the video sending end calibrates the cameras of 5 viewing angles. the

Step 402, the video sending end sends the calibrated camera parameters and video data of the five viewing angles to the video receiving end. the

Step 403, the video receiver detects that the P[4][3] frame is missing, and according to the calibration camera parameters and the P[1][3] frame, P[2 ][3] frame, P[3][3] frame and P[5][3] frame to construct a reconstructed frame. the

Specifically, the video receiver can use P[3][3] and P[5][3] to restore the reconstructed frame P _r35 , and use P[2][3] and P[5][3] to restore the reconstructed frame P _r25 , use P[1][3] and P[5][3] to restore the reconstructed frame P _r15 .

Step 404, the video receiving end detects the P frame of the same viewing angle that is closest to the P[4][3] frame and can be correctly decoded, obtains the motion vector of each macroblock of the P frame, and sets the inter-frame prediction mode of the P frame image The area where the macroblock whose lower motion vector is zero is located is the static area. the

Step 405, the video receiving end compares the similarity of each reconstructed frame with the video frame of the same angle of view that is closest to the P[4][3] frame and can be correctly decoded in the static area, and replaces P[4] with the reconstructed frame with the highest similarity [3] frame. the

Specifically, since the video frame of the same viewing angle that is closest to the P[4][3] frame and can be correctly decoded is the I[4][1] frame, therefore, for the reconstructed frame P _r35 , P _r35 and I[4 ][1] The sum SAD _r35 of the absolute difference of the brightness values of the pixels in the static area; for the reconstructed frame P _r25 , the brightness of P _r25 and I[4][1] pixels in the static area can be calculated The sum of absolute differences SAD _r25 of values; for the reconstructed frame P _r15 , the sum of absolute differences SAD _r15 of brightness values of pixels in the static area between P _r15 and I[4][1] can be calculated.

Compare the size relationship among SAD _r15 , SAD _r25 and SAD _r35 , and select the reconstructed frame with the smallest sum of absolute value differences as the reconstructed frame with the highest similarity to replace the P[4][3] frame.

The embodiment of the present invention utilizes spatial redundancy information and temporal image information to construct restoration data, optimizes the constructed restoration data, replaces lost video data with the optimized restoration data, and eliminates the block effect of restoration data , the quality of the reconstructed image is improved, and the static area needs to be selected only when video data loss is detected, and there are few changes to the prior art. the

Embodiments of the present invention provide a method for restoring video data and various application scenarios in the foregoing implementation manners. Correspondingly, embodiments of the present invention also provide devices and systems for applying the above method for restoring video data. the

As shown in Figure 6, it is a schematic structural diagram of a device for restoring video data in Embodiment 5 of the present invention, including:

The acquiring module 510 is configured to acquire the video data at the same moment and the corresponding calibration camera parameters at a different viewing angle from the lost video data. the

The recovery module 520 is configured to construct recovery data according to the video data acquired by the acquisition module 510 and corresponding calibration camera parameters, and use the recovery data to replace the lost video data. the

The embodiment of the present invention utilizes the video data of various angles of view and the calibration camera parameters to construct recovery data, and replaces the lost video data with the obtained recovery data, which eliminates the block effect of the recovery data, and utilizes video redundancy information of different viewpoints in space, Improved the quality of reconstructed images. the

As shown in Figure 7, it is a schematic structural diagram of a device for restoring video data in Embodiment 6 of the present invention, including:

The acquiring module 610 is configured to acquire the video data at the same moment and the corresponding calibration camera parameters at a different viewing angle from the lost video data. the

The restoration module 620 is configured to construct restoration data according to the video data acquired by the acquisition module 610 and corresponding calibration camera parameters, and use the restoration data to replace the lost video data. the

The recovery module 620 mentioned above specifically includes:

The construction sub-module 621 is configured to construct at least two reconstruction frames according to the video data acquired by the acquisition module 610 and corresponding calibration camera parameters. the

The obtaining submodule 622 is configured to obtain a video frame of the same viewing angle that is closest to the lost video data and can be correctly decoded. the

The comparison sub-module 623 is used to compare the similarity of each reconstruction frame constructed by the construction sub-module 621 with the video frame obtained by the acquisition sub-module 622 in the static area. the

The above comparison sub-module 623 is specifically configured to calculate the sum of the absolute value differences of the brightness values of the pixels in the static area between the respective reconstructed frames and the acquired video frame, and calculate the sum of the absolute value differences and the smallest reconstructed frame as the reconstructed frame with the highest similarity. the

The restoration submodule 624 is configured to use the reconstructed frame with the highest similarity obtained by the comparison submodule 623 as the restoration data, and use the restoration data to replace the lost video data. the

The above recovery module 620 also includes:

The detection sub-module 625 is configured to detect the P frame of the same viewing angle closest to the lost video data, obtain the motion vector of each macroblock of the P frame, and convert the motion vector of the P frame image in the inter-frame prediction mode to The area where the zero macroblock is located is used as the static area of the viewing angle for use by the comparison sub-module 623 . the

The embodiment of the present invention utilizes spatial redundancy information and temporal image information to construct restoration data, optimizes the constructed restoration data, replaces lost video data with the optimized restoration data, and eliminates the block effect of restoration data , the quality of the reconstructed image is improved, and the static area needs to be selected only when video data loss is detected, and there are few changes to the prior art. the

As shown in Figure 8, it is a schematic structural diagram of a device for restoring video data in Embodiment 7 of the present invention, including:

The acquiring module 710 is configured to acquire the video data at the same moment and the corresponding calibration camera parameters at a different viewing angle from the lost video data. the

The restoration module 720 is configured to construct restoration data according to the video data acquired by the acquisition module 710 and corresponding calibration camera parameters, and use the restoration data to replace the lost video data. the

The recovery module 720 mentioned above specifically includes:

The construction sub-module 721 is configured to construct at least two reconstruction frames according to the video data acquired by the acquisition module 710 and corresponding calibration camera parameters. the

The obtaining sub-module 722 is configured to obtain a video frame of the same viewing angle that is closest to the lost video data and can be correctly decoded. the

The comparison sub-module 723 is used to compare the similarity of each reconstruction frame constructed by the construction sub-module 721 with the video frame obtained by the acquisition sub-module 722 in the static area. the

The above comparison sub-module 723 is specifically configured to calculate the sum of the absolute value differences of the brightness values of the pixels in the static area between the respective reconstructed frames and the acquired video frames, and calculate the sum of the absolute value differences and the smallest reconstructed frame as the reconstructed frame with the highest similarity. the

The restoration submodule 724 is configured to use the reconstructed frame with the highest similarity obtained by the comparison submodule 723 as the restoration data, and use the restoration data to replace the lost video data. the

The updating module 730 detects the latest received P frame in the video data in real time when the video data is decoded and played; obtains the motion vector of each macroblock of the P frame, and uses the interframe of the P frame image In the prediction mode, the area where the macroblock whose motion vector is zero is located is updated as a static area for use by the restoration module 720 . the

The embodiment of the present invention utilizes spatial redundancy information and temporal image information to construct restoration data, optimizes the constructed restoration data, replaces lost video data with the optimized restoration data, and eliminates the block effect of restoration data , which improves the quality of the reconstructed image. the

As shown in Figure 9, it is a schematic structural diagram of a system for recovering video data in Embodiment 8 of the present invention, including:

The video sending end 810 is configured to send video data of various viewing angles and calibration camera parameters to the video receiving end 820 . the

The above-mentioned video sending end 810 is also used to set the cameras of various viewing angles. the

The video receiving end 820 is used to receive video data and calibration camera parameters from various angles of view of the video sending end 810, and when the loss of video data is detected, obtain the video data at the same moment different from the angle of view of the lost video data, Construct restoration data according to the acquired video data and corresponding calibration camera parameters, and use the restoration data to replace the lost video data. the

The embodiment of the present invention utilizes spatial redundancy information and temporal image information to construct restoration data, optimizes the constructed restoration data, replaces lost video data with the optimized restoration data, and eliminates the block effect of restoration data , which improves the quality of the reconstructed image. the

Through the description of the above embodiments, those skilled in the art can clearly understand that the present invention can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is a better implementation Way. Based on this understanding, the technical solution of the embodiment of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for Make a terminal device (which may be a mobile phone, a personal computer, a server, or a network device, etc.) execute the methods described in various embodiments of the present invention. the

The above descriptions are only preferred implementations of the present invention. It should be pointed out that for those skilled in the art, some improvements and modifications can be made without departing from the principle of the embodiments of the present invention. These improvements and Retouching should also be considered within the protection scope of the present invention. the

Those skilled in the art can understand that the modules in the device in the embodiment can be distributed in the device in the embodiment according to the description in the embodiment, or can be located in one or more devices different from the embodiment according to corresponding changes. The modules in the above embodiments can be integrated or deployed separately; they can be combined into one module, or further split into multiple sub-modules. the

The serial numbers of the above embodiments of the present invention are for description only, and do not represent the advantages and disadvantages of the embodiments. the

The above disclosures are only a few specific embodiments of the present invention, however, the present invention is not limited thereto, and any changes conceivable by those skilled in the art shall fall within the protection scope of the present invention. the

Claims (9)

1. a method of recovering video data is characterized in that, comprising:

The video data at each visual angle of the video sending end transmission that receives is play in decoding, and detects in real time the up-to-date P frame that receives in the described video data; Obtain the motion vector of each macro block of described P frame, using motion vector under the inter-frame forecast mode of P two field picture is the area update static region at zero macro block place;

When detecting video data loss, obtain the video data of the synchronization different from the visual angle of the video data of losing and corresponding calibrating camera parameters;

Recover data according to the described video data that obtains and corresponding calibrating camera parameters structure, and use described recovery data to replace the described video data of losing.

2. the method for claim 1 is characterized in that, the video data that described basis is obtained and corresponding calibrating camera parameters structure recover data, specifically comprise:

According to the described video data that obtains and corresponding at least two reconstruction frames of calibrating camera parameters structure, and obtain the frame of video at the nearest same visual angle that can be correctly decoded of the described video data of losing of distance;

Relatively each reconstruction frames and the described frame of video of obtaining are at the similarity degree of static region, and the reconstruction frames that similarity degree is the highest is as described recovery data.

3. method as claimed in claim 2 is characterized in that, each reconstruction frames of described comparison and the similarity degree of the frame of video of obtaining at static region specifically comprise:

Calculate the absolute value differences sum of the brightness value of described each reconstruction frames and the pixel of the described frame of video of obtaining in described static region, with the reconstruction frames of described absolute value differences sum minimum as the highest reconstruction frames of described similarity degree.

4. method as claimed in claim 2 is characterized in that, each reconstruction frames of described comparison and the frame of video obtained also comprised before the similarity degree of static region:

Detecting the P frame at the nearest same visual angle of the described video data of losing of distance, obtain the motion vector of each macro block of described P frame, is that the zone at zero macro block place is as the static region at this visual angle with motion vector under the inter-frame forecast mode of P two field picture.

5. a device that recovers video data is characterized in that, comprising:

Acquisition module is used for obtaining the video data of the synchronization different from the visual angle of the video data of losing and corresponding calibrating camera parameters;

Recover module, the video data and the corresponding calibrating camera parameters that are used for obtaining according to described acquisition module are constructed the recovery data, and use described recovery data to replace the described video data of losing;

Update module when the video data that the video sending end that receives is sent is decoded broadcast, detects the up-to-date P frame that receives in the described video data in real time; Obtain the motion vector of each macro block of described P frame, using motion vector under the inter-frame forecast mode of P two field picture is the area update static region at zero macro block place, for described recovery module.

6. device as claimed in claim 5 is characterized in that, described recovery module specifically comprises:

The constructor module is for the video data that obtains according to described acquisition module and corresponding at least two reconstruction frames of calibrating camera parameters structure;

Obtain submodule, be used for obtaining the frame of video at the nearest same visual angle that can be correctly decoded of the described video data of losing of distance;

Comparison sub-module is used for each reconstruction frames of more described constructor module structure and describedly obtains frame of video that submodule obtains at the similarity degree of static region;

Recover submodule, be used for the highest reconstruction frames of similarity degree that described comparison sub-module is obtained as described recovery data, and use described recovery data to replace the described video data of losing.

7. device as claimed in claim 6 is characterized in that,

Described comparison sub-module, the concrete absolute value differences sum that is used for calculating the brightness value of described each reconstruction frames and the pixel of the described frame of video of obtaining in described static region, with the reconstruction frames of described absolute value differences sum minimum as the highest reconstruction frames of described similarity degree.

8. device as claimed in claim 6 is characterized in that, described recovery module also comprises:

Detection sub-module, P frame for detection of the nearest same visual angle of the described video data of losing of distance, obtain the motion vector of each macro block of described P frame, be that the zone at zero macro block place is as the static region at this visual angle, for described comparison sub-module with motion vector under the inter-frame forecast mode of P two field picture.

9. a system of recovering video data is characterized in that, comprising:

Video sending end is for the video data from each visual angle to video receiver and the calibrating camera parameters that send;

Video receiver, be used for receiving video data and calibrating camera parameters from each visual angle of described video sending end, to the video data that the receives broadcast of decoding, detect in real time the up-to-date P frame that receives in this video data, obtain the motion vector of each macro block of the up-to-date P frame that receives, using motion vector under the inter-frame forecast mode of P two field picture is the area update static region at zero macro block place, when detecting video data loss, obtain the video data of the synchronization different from the visual angle of the described video data of losing, recover data according to the described video data that obtains and corresponding calibrating camera parameters structure, and use described recovery data to replace the described video data of losing.

Images