CN102111621B - Video data recovery method, device and system - Google Patents

Video data recovery method, device and system Download PDF

Info

Publication number
CN102111621B
CN102111621B CN 200910243708 CN200910243708A CN102111621B CN 102111621 B CN102111621 B CN 102111621B CN 200910243708 CN200910243708 CN 200910243708 CN 200910243708 A CN200910243708 A CN 200910243708A CN 102111621 B CN102111621 B CN 102111621B
Authority
CN
China
Prior art keywords
video data
video
frame
data
visual angle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN 200910243708
Other languages
Chinese (zh)
Other versions
CN102111621A (en
Inventor
黄晓伟
袁潮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN 200910243708 priority Critical patent/CN102111621B/en
Publication of CN102111621A publication Critical patent/CN102111621A/en
Application granted granted Critical
Publication of CN102111621B publication Critical patent/CN102111621B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The embodiment of the invention discloses a video data recovery method, which comprises the following steps of: acquiring video data at the same moment and a visual angle different from that of lost video data and corresponding calibrated camera parameters; and structuring recovery data according to the acquired video data and the corresponding calibrated camera parameters, and replacing the lost video data by using the recovery data. The embodiment of the invention improves the quality of a restructured image. The embodiment of the invention also discloses a device and a system using the method.

Description

A kind of methods, devices and systems that recover video data
Technical field
The present invention relates to communication technical field, relate in particular to a kind of methods, devices and systems that recover video data.
Background technology
Along with the development of communication network, the encoding and decoding technique of video data has also been made significant headway.Coded data can be decoded first when playing, and then just can carry out normal play, if coded data is lost in storage or network transmission process, decoding is made a mistake, and causes the decoder collapse and mosaic phenomenon occurs.
Prior art discloses a kind of compensation method to obliterated data, and this compensation method is based on time domain, the macroblock of video data integral body of the previous frame of the present frame of obliterated data need to be copied to present frame.Particularly, if there is loss of data in the data flow, judges whether that then finishing the obliterated data prediction at the software processing layer estimates and compensation, otherwise video data is play; Estimate and compensation if determine the prediction of finishing obliterated data at the software processing layer, then judge the requirement of real-time of system; If system is high to requirement of real-time, then obliterated data is carried out estimating and compensation based on the prediction of time domain, if system is not high to requirement of real-time, then obliterated data is carried out estimating and based on the compensation of time domain based on the prediction in spatial domain; Enter the decoder processes layer, decoder carries out estimating and based on the compensation of time domain based on the prediction in spatial domain to the encoded video data stream that has loss of data that receives; Decoder is decoded to the encoded video data stream that receives, and sends to playing device and play, and selects based on above-mentioned judgement, finishes the compensation to obliterated data.
The same with the ordinary video coded data, the situation of packet loss also can appear in the multiple view video coding data when carrying out Internet Transmission.Because frame of video is take frame as unit, so the partial loss of a certain frame data probably causes these frame data to decode.
The inventor finds that there is following defective at least in prior art in realizing process of the present invention:
Obliterated data compensation method of the prior art is based on time domain, the macroblock of video data integral body of the frame of video previous frame of obliterated data need to be copied to present frame, and the video frequency data quality of reconstruction is poor, and obvious block effect is arranged.When whole LOF, can't recover, do not utilize the video redundant information of different points of view on the space.
Summary of the invention
The embodiment of the invention provides a kind of methods, devices and systems that recover video data, is used for improving the quality of reconstructed image.
The embodiment of the invention provides a kind of method of recovering video data, comprising:
The video data at each visual angle of the video sending end transmission that receives is play in decoding, and detects in real time the up-to-date P frame that receives in the described video data; Obtain the motion vector of each macro block of described P frame, using motion vector under the inter-frame forecast mode of P two field picture is the area update static region at zero macro block place;
When detecting video data loss, obtain the video data of the synchronization different from the visual angle of the video data of losing and corresponding calibrating camera parameters;
Recover data according to the described video data that obtains and corresponding calibrating camera parameters structure, and use described recovery data to replace the described video data of losing.
The embodiment of the invention also provides a kind of device that recovers video data, comprising:
Acquisition module is used for obtaining the video data of the synchronization different from the visual angle of the video data of losing and corresponding calibrating camera parameters;
Recover module, the video data and the corresponding calibrating camera parameters that are used for obtaining according to described acquisition module are constructed the recovery data, and use described recovery data to replace the described video data of losing;
Update module when the video data that the video sending end that receives is sent is decoded broadcast, detects the up-to-date P frame that receives in the described video data in real time; Obtain the motion vector of each macro block of described P frame, using motion vector under the inter-frame forecast mode of P two field picture is the area update static region at zero macro block place, for described recovery module.
The embodiment of the invention also provides a kind of system of recovering video data, comprising:
Video sending end is for the video data from each visual angle to video receiver and the calibrating camera parameters that send;
Video receiver, be used for receiving video data and calibrating camera parameters from each visual angle of described video sending end, to the video data that the receives broadcast of decoding, detect in real time the up-to-date P frame that receives in this video data, obtain the motion vector of each macro block of the up-to-date P frame that receives, using motion vector under the inter-frame forecast mode of P two field picture is the area update static region at zero macro block place, when detecting video data loss, obtain the video data of the synchronization different from the visual angle of the described video data of losing, recover data according to the described video data that obtains and corresponding calibrating camera parameters structure, and use described recovery data to replace the described video data of losing.
Compared with prior art, the embodiment of the invention has the following advantages: the embodiment of the invention utilizes the video data at each visual angle and calibrating camera parameters structure to recover data, and replace the video data lost with the recovery data that obtain, eliminated the block effect that recovers data, utilize the video redundant information of different points of view on the space, improved reconstructed image quality.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art, the below will do to introduce simply to the accompanying drawing of required use in the embodiment of the invention or the description of the Prior Art, apparently, accompanying drawing in the following describes only is some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1 is a kind of method flow diagram that recovers video data in the embodiment of the invention one;
Fig. 2 is a kind of method flow diagram that recovers video data in the embodiment of the invention two;
Fig. 3 is a kind of method flow diagram that recovers video data in the embodiment of the invention three;
Fig. 4 is the frame structure schematic diagram of the many view system in the embodiment of the invention four;
Fig. 5 is a kind of method flow diagram that recovers video data in the embodiment of the invention four;
Fig. 6 is a kind of apparatus structure schematic diagram that recovers video data in the embodiment of the invention five;
Fig. 7 is a kind of apparatus structure schematic diagram that recovers video data in the embodiment of the invention six;
Fig. 8 is a kind of apparatus structure schematic diagram that recovers video data in the embodiment of the invention seven;
Fig. 9 is a kind of system configuration schematic diagram that recovers video data in the embodiment of the invention eight.
Embodiment
In the technical scheme that the embodiment of the invention provides, its core concept is for when detecting video data loss, according to the video data from the calibrating camera parameters of video sending end and the synchronization different from the video data visual angle of losing that receives, use medial view to generate method construct and recover data, and use the static region comparative approach that the recovery data of structure are carried out preferably, use the recovery data that preferably obtain to replace the video data of losing.
Below in conjunction with the accompanying drawing in the embodiment of the invention, the technical scheme of the embodiment of the invention is clearly and completely described, obviously, described embodiment is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills belong to the scope of protection of the invention not making the every other embodiment that obtains under the creative work prerequisite.
As shown in Figure 1, a kind of method flow diagram that recovers video data in the embodiment of the invention one may further comprise the steps:
Step 101 is obtained the video data of the synchronization different from the visual angle of the video data of losing and corresponding calibrating camera parameters.
Particularly, can receive video data and calibrating camera parameters from each visual angle of video sending end, when detecting video data loss, obtain the video data of the synchronization different from the visual angle of the video data of losing and corresponding calibrating camera parameters.Wherein, calibrating camera parameters comprises intrinsic parameters of the camera and video camera external parameter, and intrinsic parameters of the camera comprises (lens) normalization focal length on the trunnion axis, the parameters such as (lens) normalization focal length, trunnion axis nonlinear distortion variable element, vertical axis nonlinear distortion variable element, trunnion axis side-play amount and vertical axis side-play amount on the vertical axis; The video camera external parameter comprises video camera with respect to the coordinate parameters in the external world, and such as x, y, z, deflection etc. are to determine the needed parameter of rigid body basically.
Step 102 is recovered data according to the video data that obtains and corresponding calibrating camera parameters structure, and is used these recovery data to replace the described video data of losing.
Particularly, the video data that above-mentioned basis is obtained and corresponding calibrating camera parameters structure recover data, specifically comprise: according to the described video data that obtains and corresponding at least two reconstruction frames of calibrating camera parameters structure, and obtain the frame of video at the nearest same visual angle that can be correctly decoded of the described video data of losing of distance; Relatively each reconstruction frames and the described frame of video of obtaining are at the similarity degree of static region, and the reconstruction frames that similarity degree is the highest is as described recovery data.
Each reconstruction frames of above-mentioned comparison and the similarity degree of the frame of video of obtaining at static region, specifically comprise: calculate the absolute value differences sum of the brightness value of described each reconstruction frames and the pixel of the described frame of video of obtaining in described static region, with the reconstruction frames of described absolute value differences sum minimum as the highest reconstruction frames of described similarity degree.
The embodiment of the invention utilizes the video data at each visual angle and calibrating camera parameters structure to recover data, and replace the video data lost with the recovery data that obtain, eliminated the block effect that recovers data, utilize the video redundant information of different points of view on the space, improved the quality of reconstructed image.
The method of the recovery video data in the embodiment of the invention is applied to comprise the system of video sending end and video receiver, wherein, video sending end is made of camera acquisition device and encoder, needs the parameter of calibrating camera, comprises inner parameter and external parameter; Video receiver passes through the network receiving video data, and the video data that receives is decoded.
Below in conjunction with above-mentioned application scenarios the method for the recovery video data in the embodiment of the invention is carried out detailed, concrete description.
As shown in Figure 2, a kind of method flow diagram that recovers video data in the embodiment of the invention two may further comprise the steps:
Step 201, video sending end is demarcated the video camera at each visual angle.
Particularly, can determine the input/output relation of video camera, give the scale division value of video camera; Also can determine the static characteristic index of video camera; Can also eliminate systematic error, improve the correctness of video camera or system.
Step 202, video sending end is delivered to video receiver with calibrating camera parameters and the video data transmitting at each visual angle.
Step 203, video receiver detects video data loss, obtain the video data of the synchronization different from the visual angle of the video data of losing, according to the video data that obtains and corresponding at least two reconstruction frames of calibrating camera parameters structure, and obtain the frame of video at the same visual angle that can be correctly decoded nearest apart from the video data of losing.
Particularly, according to the principle of video camera projection projection, the coordinate of actual object can be transformed into the coordinate of video image, i.e. X p=M 1* M 2* X w, wherein, X pBe the coordinate of image, M 1Be intrinsic parameters of the camera, M 2Be video camera external parameter, X wThe actual object coordinate.The embodiment of the invention uses medial view to generate the method construct reconstruction frames, recovers several frame of video from the frame of video of the synchronization different from the visual angle of the video data of losing, with this frame of video as reconstruction frames.
For example, the image of known viewpoint 1 and viewpoint 3 because there are the relation of hinting obliquely in actual object coordinate and image coordinate, can in the situation that obtains calibrating camera parameters, utilize formula X p=M 1* M 2* X wCalculate the image of the viewpoint 2 between viewpoint 1 and the viewpoint 3.
Step 204, video receiver detects the P frame at the same visual angle nearest apart from the video data of losing, obtaining the motion vector of each macro block of this P frame, is that the zone at zero macro block place is as the static region at this visual angle with motion vector under the inter-frame forecast mode of P two field picture.
Particularly, every two field picture can Further Division be macro block, comprises the macro block under the inter-frame forecast mode of macro block under the intra prediction mode of P two field picture and P two field picture.For the macro block under the intra prediction mode of P two field picture, can determine that the zone at this macro block place is not in static region; For the macro block under the inter-frame forecast mode of P two field picture, in the decode procedure of video data, can obtain the motion vector of each macro block, when the motion vector of macro block is zero, illustrate that this macro block is identical with the macro block of former frame same position, can determine that the zone of this macro block is positioned at static region.
Step 205, each reconstruction frames of video receiver comparison and the similarity degree of the frame of video of obtaining at static region, the reconstruction frames that similarity degree is the highest are as the recovery data, and the video data that uses this recovery data replacement to lose.
Particularly, the image change degree of static region is less, and then frame is higher in the similarity of static region before reconstruction frames and this visual angle, and the picture quality that reconstruction frames is rebuild is better, can select this reconstruction frames to replace the video data of losing as final recovery data.In concrete implementation procedure, can calculate the absolute value differences sum of each reconstruction frames and the brightness value of the pixel of frame of video in static region that obtain, with the reconstruction frames of absolute value differences sum minimum as the highest reconstruction frames of similarity degree.
The embodiment of the invention utilizes redundant information and the temporal image information structure on the space to recover data, and to the structure the recovery data carry out preferably, replace the video data lost with the recovery data that preferably obtain, eliminated the block effect that recovers data, improved the quality of reconstructed image, and only when having detected video data loss, just need to select static region, change less to prior art.
As shown in Figure 3, a kind of method flow diagram that recovers video data in the embodiment of the invention three may further comprise the steps:
Step 301, video sending end is demarcated the video camera at each visual angle.
Step 302, video sending end is delivered to video receiver with calibrating camera parameters and the video data transmitting at each visual angle.
Step 303, video receiver detects the up-to-date P frame that receives in this video data in real time to the video data that the receives broadcast of decoding.
Step 304, video receiver are obtained the motion vector of each macro block of the up-to-date P frame that receives, and using motion vector under the inter-frame forecast mode of P two field picture is the area update static region at zero macro block place.
Step 305, video receiver detects video data loss, obtain the video data of the synchronization different from the visual angle of the video data of losing, according to the video data that obtains and corresponding at least two reconstruction frames of calibrating camera parameters structure, and obtain the frame of video at the same visual angle that can be correctly decoded nearest apart from the video data of losing.
Step 306, video receiver calculates the absolute value differences sum of each reconstruction frames and the brightness value of the pixel of frame of video in static region that obtain, with the reconstruction frames of this absolute value differences sum minimum as recovering data, and the video data that uses this recoverys data replacement to lose.
The embodiment of the invention utilizes redundant information and the temporal image information structure on the space to recover data, and to the structure the recovery data carry out preferably, with the video data that the recovery data replacement that preferably obtains is lost, eliminated the block effect that recovers data, improved the quality of reconstructed image.
As shown in Figure 4, be the frame structure schematic diagram of the many view system in the embodiment of the invention four, comprise 5 viewpoints, the P[4 among the figure is supposed in the independent encoding and decoding of each viewpoint] [3] LOF.
As shown in Figure 5, a kind of method flow diagram that recovers video data in the embodiment of the invention four may further comprise the steps:
Step 401, video sending end is demarcated the video camera at 5 visual angles.
Step 402, video sending end is delivered to video receiver with calibrating camera parameters and the video data transmitting at 5 visual angles.
Step 403, video receiver detects P[4] [3] LOF, according to calibrating camera parameters and from P[4] P[1 of the different synchronization in [3] frame visual angle] [3] frame, P[2] [3] frame, P[3] [3] frame and P[5] [3] frame, the structure reconstruction frames.
Particularly, video receiver can utilize P[3] [3] and P[5] [3] recover reconstruction frames P R35, utilize P[2] and [3] and P[5] [3] recover reconstruction frames P R25, utilize P[1] and [3] and P[5] [3] recover reconstruction frames P R15
Step 404, video receiver detects the P frame at the nearest same visual angle that can be correctly decoded of distance P [4] [3] frame, obtaining the motion vector of each macro block of this P frame, is that the zone at zero macro block place is as static region with motion vector under the inter-frame forecast mode of P two field picture.
Step 405, the frame of video at the same visual angle that can be correctly decoded that video receiver each reconstruction frames of comparison and distance P [4] [3] frame are nearest is at the similarity degree of static region, the reconstruction frames that similarity degree is the highest replaces P[4] [3] frame.
Particularly, because the frame of video at the nearest same visual angle that can be correctly decoded of distance P [4] [3] frame is I[4] [1] frame, therefore, for reconstruction frames P R35, can calculate P R35And I[4] the absolute difference sum SAD of brightness value of [1] pixel in static region R35For reconstruction frames P R25, can calculate P R25And I[4] the absolute difference sum SAD of brightness value of [1] pixel in static region R25For reconstruction frames P R15, can calculate P R15And I[4] the absolute difference sum SAD of brightness value of [1] pixel in static region R15
Compare SAD R15, SAD R25And SAD R35Between magnitude relationship, select the reconstruction frames of absolute value differences sum minimum to replace P[4 as the highest reconstruction frames of similarity degree] [3] frame.
The embodiment of the invention utilizes redundant information and the temporal image information structure on the space to recover data, and to the structure the recovery data carry out preferably, replace the video data lost with the recovery data that preferably obtain, eliminated the block effect that recovers data, improved the quality of reconstructed image, and only when having detected video data loss, just need to select static region, change less to prior art.
The embodiment of the invention provides method and the plurality of application scenes of recovering video data in the above-described embodiment, and correspondingly, the embodiment of the invention also provides device and the system of the method for using above-mentioned recovery video data.
As shown in Figure 6, a kind of apparatus structure schematic diagram that recovers video data in the embodiment of the invention five comprises:
Acquisition module 510 is used for obtaining the video data of the synchronization different from the visual angle of the video data of losing and corresponding calibrating camera parameters.
Recover module 520, the video data and the corresponding calibrating camera parameters that are used for obtaining according to acquisition module 510 are constructed the recovery data, and use described recovery data to replace the described video data of losing.
The embodiment of the invention utilizes the video data at each visual angle and calibrating camera parameters structure to recover data, and replace the video data lost with the recovery data that obtain, eliminated the block effect that recovers data, utilize the video redundant information of different points of view on the space, improved the quality of reconstructed image.
As shown in Figure 7, a kind of apparatus structure schematic diagram that recovers video data in the embodiment of the invention six comprises:
Acquisition module 610 is used for obtaining the video data of the synchronization different from the visual angle of the video data of losing and corresponding calibrating camera parameters.
Recover module 620, the video data and the corresponding calibrating camera parameters that are used for obtaining according to acquisition module 610 are constructed the recovery data, and use described recovery data to replace the described video data of losing.
Above-mentioned recovery module 620 specifically comprises:
Constructor module 621 is for the video data that obtains according to described acquisition module 610 and corresponding at least two reconstruction frames of calibrating camera parameters structure.
Obtain submodule 622, be used for obtaining the frame of video at the nearest same visual angle that can be correctly decoded of the described video data of losing of distance.
Comparison sub-module 623 is used for each reconstruction frames of more described constructor module 621 structures and describedly obtains frame of video that submodule 622 obtains at the similarity degree of static region.
Above-mentioned comparison sub-module 623, the concrete absolute value differences sum that is used for calculating the brightness value of described each reconstruction frames and the pixel of the described frame of video of obtaining in described static region, with the reconstruction frames of described absolute value differences sum minimum as the highest reconstruction frames of described similarity degree.
Recover submodule 624, be used for the highest reconstruction frames of similarity degree that described comparison sub-module 623 is obtained as described recovery data, and use described recovery data to replace the described video data of losing.
Above-mentioned recovery module 620 also comprises:
Detection sub-module 625, P frame for detection of the nearest same visual angle of the described video data of losing of distance, obtain the motion vector of each macro block of described P frame, be that the zone at zero macro block place is as the static region at this visual angle, for described comparison sub-module 623 with motion vector under the inter-frame forecast mode of P two field picture.
The embodiment of the invention utilizes redundant information and the temporal image information structure on the space to recover data, and to the structure the recovery data carry out preferably, replace the video data lost with the recovery data that preferably obtain, eliminated the block effect that recovers data, improved the quality of reconstructed image, and only when having detected video data loss, just need to select static region, change less to prior art.
As shown in Figure 8, a kind of apparatus structure schematic diagram that recovers video data in the embodiment of the invention seven comprises:
Acquisition module 710 is used for obtaining the video data of the synchronization different from the visual angle of the video data of losing and corresponding calibrating camera parameters.
Recover module 720, the video data and the corresponding calibrating camera parameters that are used for obtaining according to acquisition module 710 are constructed the recovery data, and use described recovery data to replace the described video data of losing.
Above-mentioned recovery module 720 specifically comprises:
Constructor module 721 is for the video data that obtains according to described acquisition module 710 and corresponding at least two reconstruction frames of calibrating camera parameters structure.
Obtain submodule 722, be used for obtaining the frame of video at the nearest same visual angle that can be correctly decoded of the described video data of losing of distance.
Comparison sub-module 723 is used for each reconstruction frames of more described constructor module 721 structures and describedly obtains frame of video that submodule 722 obtains at the similarity degree of static region.
Above-mentioned comparison sub-module 723, the concrete absolute value differences sum that is used for calculating the brightness value of described each reconstruction frames and the pixel of the described frame of video of obtaining in described static region, with the reconstruction frames of described absolute value differences sum minimum as the highest reconstruction frames of described similarity degree.
Recover submodule 724, be used for the highest reconstruction frames of similarity degree that described comparison sub-module 723 is obtained as described recovery data, and use described recovery data to replace the described video data of losing.
Update module 730 when described video data being decoded broadcast, detects the up-to-date P frame that receives in the described video data in real time; Obtain the motion vector of each macro block of described P frame, using motion vector under the inter-frame forecast mode of P two field picture is the area update static region at zero macro block place, for described recovery module 720.
The embodiment of the invention utilizes redundant information and the temporal image information structure on the space to recover data, and to the structure the recovery data carry out preferably, with the video data that the recovery data replacement that preferably obtains is lost, eliminated the block effect that recovers data, improved the quality of reconstructed image.
As shown in Figure 9, a kind of system configuration schematic diagram that recovers video data in the embodiment of the invention eight comprises:
Video sending end 810 is used for to video data and the calibrating camera parameters at video receiver 820 each visual angles of transmission.
Above-mentioned video sending end 810 is also for the video camera of setting each visual angle.
Video receiver 820, be used for receiving video data and calibrating camera parameters from each visual angle of video sending end 810, when detecting video data loss, obtain the video data of the synchronization different from the visual angle of the described video data of losing, recover data according to the described video data that obtains and corresponding calibrating camera parameters structure, and use described recovery data to replace the described video data of losing.
The embodiment of the invention utilizes redundant information and the temporal image information structure on the space to recover data, and to the structure the recovery data carry out preferably, with the video data that the recovery data replacement that preferably obtains is lost, eliminated the block effect that recovers data, improved the quality of reconstructed image.
Through the above description of the embodiments, those skilled in the art can be well understood to the present invention and can realize by the mode that software adds essential general hardware platform, can certainly pass through hardware, but the former is better execution mode in a lot of situation.Based on such understanding, the part that the technical scheme of the embodiment of the invention contributes to prior art in essence in other words can embody with the form of software product, this computer software product is stored in the storage medium, comprise that some instructions are with so that a station terminal equipment (can be mobile phone, personal computer, server, the perhaps network equipment etc.) carry out the described method of each embodiment of the present invention.
The above only is preferred implementation of the present invention; should be pointed out that for those skilled in the art, under the prerequisite that does not break away from embodiment of the invention principle; can also make some improvements and modifications, these improvements and modifications also should be looked protection scope of the present invention.
It will be appreciated by those skilled in the art that the module in the device among the embodiment can be distributed in the device of embodiment according to the embodiment description, also can carry out respective change and be arranged in the one or more devices that are different from present embodiment.The module of above-described embodiment can be integrated in one, and also can separate deployment; A module can be merged into, also a plurality of submodules can be further split into.
The invention described above embodiment sequence number does not represent the quality of embodiment just to description.
More than disclosed only be several specific embodiment of the present invention, still, the present invention is not limited thereto, the changes that any person skilled in the art can think of all should fall into protection scope of the present invention.

Claims (9)

1. a method of recovering video data is characterized in that, comprising:
The video data at each visual angle of the video sending end transmission that receives is play in decoding, and detects in real time the up-to-date P frame that receives in the described video data; Obtain the motion vector of each macro block of described P frame, using motion vector under the inter-frame forecast mode of P two field picture is the area update static region at zero macro block place;
When detecting video data loss, obtain the video data of the synchronization different from the visual angle of the video data of losing and corresponding calibrating camera parameters;
Recover data according to the described video data that obtains and corresponding calibrating camera parameters structure, and use described recovery data to replace the described video data of losing.
2. the method for claim 1 is characterized in that, the video data that described basis is obtained and corresponding calibrating camera parameters structure recover data, specifically comprise:
According to the described video data that obtains and corresponding at least two reconstruction frames of calibrating camera parameters structure, and obtain the frame of video at the nearest same visual angle that can be correctly decoded of the described video data of losing of distance;
Relatively each reconstruction frames and the described frame of video of obtaining are at the similarity degree of static region, and the reconstruction frames that similarity degree is the highest is as described recovery data.
3. method as claimed in claim 2 is characterized in that, each reconstruction frames of described comparison and the similarity degree of the frame of video of obtaining at static region specifically comprise:
Calculate the absolute value differences sum of the brightness value of described each reconstruction frames and the pixel of the described frame of video of obtaining in described static region, with the reconstruction frames of described absolute value differences sum minimum as the highest reconstruction frames of described similarity degree.
4. method as claimed in claim 2 is characterized in that, each reconstruction frames of described comparison and the frame of video obtained also comprised before the similarity degree of static region:
Detecting the P frame at the nearest same visual angle of the described video data of losing of distance, obtain the motion vector of each macro block of described P frame, is that the zone at zero macro block place is as the static region at this visual angle with motion vector under the inter-frame forecast mode of P two field picture.
5. a device that recovers video data is characterized in that, comprising:
Acquisition module is used for obtaining the video data of the synchronization different from the visual angle of the video data of losing and corresponding calibrating camera parameters;
Recover module, the video data and the corresponding calibrating camera parameters that are used for obtaining according to described acquisition module are constructed the recovery data, and use described recovery data to replace the described video data of losing;
Update module when the video data that the video sending end that receives is sent is decoded broadcast, detects the up-to-date P frame that receives in the described video data in real time; Obtain the motion vector of each macro block of described P frame, using motion vector under the inter-frame forecast mode of P two field picture is the area update static region at zero macro block place, for described recovery module.
6. device as claimed in claim 5 is characterized in that, described recovery module specifically comprises:
The constructor module is for the video data that obtains according to described acquisition module and corresponding at least two reconstruction frames of calibrating camera parameters structure;
Obtain submodule, be used for obtaining the frame of video at the nearest same visual angle that can be correctly decoded of the described video data of losing of distance;
Comparison sub-module is used for each reconstruction frames of more described constructor module structure and describedly obtains frame of video that submodule obtains at the similarity degree of static region;
Recover submodule, be used for the highest reconstruction frames of similarity degree that described comparison sub-module is obtained as described recovery data, and use described recovery data to replace the described video data of losing.
7. device as claimed in claim 6 is characterized in that,
Described comparison sub-module, the concrete absolute value differences sum that is used for calculating the brightness value of described each reconstruction frames and the pixel of the described frame of video of obtaining in described static region, with the reconstruction frames of described absolute value differences sum minimum as the highest reconstruction frames of described similarity degree.
8. device as claimed in claim 6 is characterized in that, described recovery module also comprises:
Detection sub-module, P frame for detection of the nearest same visual angle of the described video data of losing of distance, obtain the motion vector of each macro block of described P frame, be that the zone at zero macro block place is as the static region at this visual angle, for described comparison sub-module with motion vector under the inter-frame forecast mode of P two field picture.
9. a system of recovering video data is characterized in that, comprising:
Video sending end is for the video data from each visual angle to video receiver and the calibrating camera parameters that send;
Video receiver, be used for receiving video data and calibrating camera parameters from each visual angle of described video sending end, to the video data that the receives broadcast of decoding, detect in real time the up-to-date P frame that receives in this video data, obtain the motion vector of each macro block of the up-to-date P frame that receives, using motion vector under the inter-frame forecast mode of P two field picture is the area update static region at zero macro block place, when detecting video data loss, obtain the video data of the synchronization different from the visual angle of the described video data of losing, recover data according to the described video data that obtains and corresponding calibrating camera parameters structure, and use described recovery data to replace the described video data of losing.
CN 200910243708 2009-12-23 2009-12-23 Video data recovery method, device and system Active CN102111621B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200910243708 CN102111621B (en) 2009-12-23 2009-12-23 Video data recovery method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200910243708 CN102111621B (en) 2009-12-23 2009-12-23 Video data recovery method, device and system

Publications (2)

Publication Number Publication Date
CN102111621A CN102111621A (en) 2011-06-29
CN102111621B true CN102111621B (en) 2013-03-13

Family

ID=44175627

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200910243708 Active CN102111621B (en) 2009-12-23 2009-12-23 Video data recovery method, device and system

Country Status (1)

Country Link
CN (1) CN102111621B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105721740B (en) * 2016-01-25 2018-12-07 四川长虹电器股份有限公司 The compensation method of flat panel TV moving image

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101080741A (en) * 2005-07-15 2007-11-28 松下电器产业株式会社 Device and method for composing image
CN101142824A (en) * 2005-03-31 2008-03-12 世宗大学校产学协力团 Apparatus and method for encoding multi-view video using camera parameters, apparatus and method for generating multi-view video using camera parameters, and recoding medium storing program for implem

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101142824A (en) * 2005-03-31 2008-03-12 世宗大学校产学协力团 Apparatus and method for encoding multi-view video using camera parameters, apparatus and method for generating multi-view video using camera parameters, and recoding medium storing program for implem
CN101080741A (en) * 2005-07-15 2007-11-28 松下电器产业株式会社 Device and method for composing image

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
费跃等.基于自动多视点显示的立体视频错误隐藏算法.《杭州电子科技大学学报》.2007,第27卷(第05期),73-79. *

Also Published As

Publication number Publication date
CN102111621A (en) 2011-06-29

Similar Documents

Publication Publication Date Title
CN104363451B (en) Image prediction method and relevant apparatus
US9510010B2 (en) Method for decoding images based upon partition information determinations and apparatus for decoding using same
US20170366817A1 (en) Image coding device and image decoding device
KR100285599B1 (en) Device and method for texture padding for motion estimation in alternate line encoding
CN110636312A (en) Video encoding and decoding method and device and storage medium
JPWO2008093714A1 (en) Image quality evaluation method, image quality evaluation apparatus, and image quality evaluation program
US8199817B2 (en) Method for error concealment in decoding of moving picture and decoding apparatus using the same
US20120288209A1 (en) Image processing apparatus and image processing method
KR100640498B1 (en) Apparatus and method for concealing error of frame
CN104363461B (en) The error concealing method of frame of video and apply its video encoding/decoding method
CN102111621B (en) Video data recovery method, device and system
Gharavi et al. Spatial interpolation algorithm for error concealment
CN205812229U (en) A kind of head-mounted display, picture output device and processing system for video
US20140119445A1 (en) Method of concealing picture header errors in digital video decoding
WO2016131270A1 (en) Error concealment method and apparatus
KR20040041224A (en) Error compansation method and apparatus for moving picture
KR100587274B1 (en) method for concealing error in MPEG-2 decompression system
JPH11275590A (en) Inter-image compression coder and coding method
CN103313064A (en) Method for concealing time-domain errors on basis of inter-frame modes and movement repair
GB2316567A (en) Concealing errors in a block-based image signal bit stream
Carreira et al. Error concealment-aware encoding for robust video transmission
CN106791642B (en) Video data recovery method and device
CN113132721B (en) Video coding method and device, readable storage medium and electronic equipment
CN1993997A (en) Error concealment technique for inter-coded sequences
Garcia-V et al. Image processing for error concealment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant