CN108632613B - Hierarchical distributed video coding method and system based on DISCOVER framework - Google Patents
Hierarchical distributed video coding method and system based on DISCOVER framework Download PDFInfo
- Publication number
- CN108632613B CN108632613B CN201810488010.2A CN201810488010A CN108632613B CN 108632613 B CN108632613 B CN 108632613B CN 201810488010 A CN201810488010 A CN 201810488010A CN 108632613 B CN108632613 B CN 108632613B
- Authority
- CN
- China
- Prior art keywords
- frame
- video
- coding
- entropy
- decoding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/395—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability involving distributed video coding [DVC], e.g. Wyner-Ziv video coding or Slepian-Wolf video coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/13—Adaptive entropy coding, e.g. adaptive variable length coding [AVLC] or context adaptive binary arithmetic coding [CABAC]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention provides a hierarchical distributed video coding method and a system based on a DISCOVER framework, which introduces hierarchical video coding into the DISCOVER distributed video coding framework to realize hierarchical transmission in distributed video coding and decoding, wherein the hierarchical transmission comprises a basic layer coding framework and an enhancement layer coding framework, the two parts of frameworks are connected with a control module by an entropy calculator module, and the coding framework automatically controls the video resolution of transmission; when the entropy calculator module calculates that the information amount of the video frame is small, namely the entropy of the video image does not exceed the set proportion value of the entropy of the video background image, the encoding end only carries out base layer encoding, and the decoding end only carries out the base layer; when the entropy calculator module calculates that the information amount of the video frame is large, namely the entropy of the video image exceeds the set proportion value of the entropy of the video background image, the entropy calculator activates the enhancement layer information coding, and the decoding end activates the enhancement layer information decoding. The hierarchical distributed video coding method based on the DISCOVER framework can improve the video coding efficiency and finally achieve the purpose of reducing the energy consumption of the sensor nodes.
Description
Technical Field
The invention relates to a hierarchical distributed video coding method and system based on a DISCOVER framework, aims at an improved scheme of multimedia data transmission in a wireless sensor network, solves the problem of fast transmission of videos on the premise of meeting the application of a decoding end, and belongs to the technical field of video sensor networks.
Background
The rapid development of wireless multimedia network communication technology in recent years has led to numerous new video application fields, such as mobile videophones, wireless PC cameras, wireless video surveillance, wireless multimedia sensor networks, and the like. Conventional video coding standards are increasingly difficult to apply in wireless multimedia sensor networks due to the storage capacity, computing and communication capabilities, and the need for simple coding at the video terminals. In this context, the distributed video coding and decoding method is timely and timely, and attracts the attention of related researchers in an efficient coding mode.
The Internet network is a packet switching network, lacks QoS guarantee, and causes packet delay or loss due to network channel change when video transmission is performed, but scalable coding in the extension of the MPEG-2 standard well solves the problem. The method can adjust the information service quality according to the receiving condition information fed back by the receiving end, can automatically adapt to the network channel to adjust the service quality, and realizes the maximum utilization of the network bandwidth.
The classical distributed video coding mode comprises Slepian-Wolf lossless source coding and Wyner-Ziv lossy source coding, and the distributed video coding method is formed on the basis of the Slepian-Wolf lossless source coding and the Wyner-Ziv lossy source coding, so that the situation that the coding complexity is 5-10 times of the decoding complexity is changed, and the distributed video coding method has higher compression efficiency and better robustness compared with the traditional coding.
At present, a more classical distributed video coding and decoding framework mainly comprises space domain Wyner-Ziv video coding (Wyner-Ziv video coding) provided by Bernd Girod and the like, frequency domain Wyner-Ziv video coding (Wyner-Ziv video coding) and hierarchical Wyner-Ziv video coding (Layered Wyner-Ziv video coding) provided by PRISM and Zixiang Xiong and the like in 2003, such as University of California and Rohit Puri of Berkeley. Distributed video coding based on wavelet transform and distributed video coding based on multi-view have also gained much attention from related researchers in recent years. Most of the currently used distributed video encoding and decoding methods divide the frame into a key frame (K frame) and a Wyner-ziv frame (WZ frame), and then adopt the traditional intra-frame encoding and decoding mode for the K frame and the combination of intra-frame encoding and inter-frame decoding for the WZ frame. And performing DCT (discrete cosine transform) on the WZ frame to reduce high-frequency components in the image, quantizing the high-frequency components into intervals, sending the intervals into an encoder for encoding, and finally reconstructing the WZ frame by utilizing the side information generated by motion interpolation and estimation during the decoding of the K frame and a decoder at a decoding end.
The above method is certainly suitable for video coding with stable information amount, but for the case of information amount change, the adaptive encoding cannot be performed, which results in a certain waste of efficiency.
Disclosure of Invention
In view of the above problems, an object of the present invention is to provide a method and a system for scalable and distributed video coding based on a DISCOVER frame, which integrate the conventional spatial scalable coding and DISCOVER video coding schemes, and add an image entropy calculator module for determining whether to activate enhancement layer coding, thereby improving flexibility of coding and decoding, and solving the problems that the conventional coding and decoding always transmit at a fixed rate, cannot make corresponding transmission rate changes according to complicated and variable network conditions, and has greatly limited practicability.
The technical solution of the invention is as follows:
a hierarchical distributed video coding method based on a DISCOVER framework introduces hierarchical video coding into the DISCOVER distributed video coding framework to realize hierarchical transmission in distributed video coding and decoding, and comprises a base layer coding framework and an enhancement layer coding framework, wherein the two parts of the frameworks are connected with a control module through an entropy calculator module, and the coding framework automatically controls the video resolution of transmission; when the entropy calculator module calculates that the information amount of the video frame is small, namely the entropy of the video image does not exceed the set proportion value of the entropy of the video background image, the encoding end only carries out base layer encoding, and the decoding end only carries out the base layer; when the entropy calculator module calculates that the information amount of the video frame is large, namely the entropy of the video image exceeds the set proportion value of the entropy of the video background image, the entropy calculator activates the enhancement layer information coding, and the decoding end activates the enhancement layer information decoding.
Further, the method specifically comprises the following steps,
s1, video acquisition is carried out;
s2, encoding the collected video, entering key frame judgment, wherein odd frames are key frames, even frames are WZ frames, original video code streams of the key frames and the WZ frames pass through a down sampler to obtain video resolution meeting the requirement of a decoding end, called as a base layer, and after up sampling, key frames of the base layer are subtracted from the original video code streams of the key frames to obtain a key frame enhancement layer, wherein the specific process is as follows:
s21, dividing a key frame K frame and a WZ frame of a video sequence, namely Wyner-Ziv frames, of the collected video, respectively encoding the K frame and the WZ frame in different encoding modes, wherein the WZ frame is converted to a step S22, and the K frame is converted to a step S23;
s22, DCT transformation is carried out on the WZ frame, and after quantization and LDPCA coding, the check information is stored in a buffer, and once the coding end receives a feedback request from the decoding end, information transmission is carried out immediately;
s23, carrying out intra-frame coding based on H.264 standard on the K frames after down-sampling;
s3, decoding the base layer;
and S4, decoding the enhancement layer.
Further, in step S3, specifically,
s31, decoding the K frames, entering an entropy calculator, comparing the K frames with an entropy threshold, and entering S32 if the K frames are larger than the entropy threshold; if the entropy is smaller than the entropy threshold value, entering S33;
s32, the controller opens the base layer decoder to enter the layered coding;
s33, decoding the K frames and putting the K frames into a frame buffer; if S32 is executed, S34 is executed continuously, and if S32 is not executed, S36 is directly entered;
s34, the decoder end generates an estimated value, namely side information, for each WZ frame by a motion compensation frame interpolation method through front and rear related frames;
s35, decoding and reconstructing the WZ frame by using the relevant noise model, and restoring the WZ frame by IDCT;
and S36, combining the decoded WZ frame and the K frame to recover the base layer video.
Further, in step S32, the opening hierarchical coding specifically includes:
s321, decoding the K frame, and performing up-sampling on the K frame through an up-sampler;
s322, subtracting the original frame of the K frame from the frame after the up sampler to obtain enhancement layer information;
and S323, carrying out enhancement layer encoder encoding on the enhancement layer information, and sending the enhancement layer information to the mixer through transmission.
Further, in step S4, specifically,
s41, upsampling the K frame, and summing the upsampled K frame with an enhancement layer encoder to generate an enhancement layer key frame;
s42, generating enhancement layer side information through the front key frame and the rear key frame;
s43, upsampling the WZ frame, and recovering the enhanced layer WZ frame according to the enhanced layer side information;
and S44, combining the WZ frame and the K frame of the enhancement layer to recover the video of the enhancement layer.
Further, the entropy calculator module calculates that the information amount of the video frame is small, namely the entropy of the video image does not exceed the set proportion value of the entropy of the video background image by 10%, and the entropy calculator module calculates that the information amount of the video frame is large, namely the entropy of the video image exceeds the set proportion value of the entropy of the video background image by 10%.
A system adopting the DISCOVER framework-based hierarchical distributed video coding method comprises an encoding end and a decoding end,
and (3) a coding end: after video acquisition, dividing each frame of the acquired video into a base layer and an enhancement layer, wherein the acquired original video code stream passes through a down sampler to obtain video resolution meeting the requirements of a decoding end, namely the base layer, and the base layer performs subtraction operation with the original video code stream after up sampling to obtain the enhancement layer; dividing a basic layer into a WZ frame and a K frame, and the specific process comprises the following steps: dividing a key frame K frame and a WZ frame of a video sequence, namely Wyner-Ziv frames, of the collected video, and coding the K frame and the WZ frame respectively in different coding modes; DCT transformation is carried out on WZ frames, and after quantization and LDPCA coding, the check information is stored in a buffer, and once a coding end receives a feedback request from a decoding end, information transmission is carried out immediately; carrying out intra-frame coding based on the H.264 standard on the K frame;
and a decoding end: the base layer and the enhancement layer are decoded.
The invention has the beneficial effects that:
the method and the system for the hierarchical distributed video coding based on the DISCOVER framework can improve the video coding efficiency and finally achieve the purpose of reducing the energy consumption of the sensor nodes. The coding framework provided by the invention can more effectively reduce the consumption of transmission nodes due to the improvement of the utilization rate of information. When the video information entropy is small, the coding system can carry out coding at a resolution lower than that of the traditional DISCOVER coding framework; and when the information amount of the video frame is large, the decoding end recovers the video frame with higher resolution by activating the enhancement layer coding. The enhancement layer coding enabling time is set to be far shorter than the sleep time, so that the energy consumption can be effectively saved.
The invention grades the video resolution by a spatial scalable coding mode, adopts DISCOVER coding when the entropy is smaller, and increases the enhancement layer coding information when the entropy is larger, so that the decoding end recovers the high-resolution video, thereby solving the problem that the traditional DISCOVER distributed coding has a basic distributed coding framework, but the coding mode does not grade the video space, which causes the low utilization rate of the transmitted video information.
Drawings
Fig. 1 is a schematic flowchart of a hierarchical distributed video coding method based on a DISCOVER framework according to an embodiment of the present invention;
fig. 2 is an illustrative block diagram of the embodiment a hierarchical distributed video coding system based on the DISCOVER framework.
Detailed Description
Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
Examples
A hierarchical distributed video coding method based on a DISCOVER framework introduces hierarchical video coding into the DISCOVER distributed video coding framework to realize hierarchical transmission in distributed video coding and decoding, and comprises a base layer coding framework and an enhancement layer coding framework, wherein the two parts of the frameworks are connected with a control module through an entropy calculator module, and the coding framework automatically controls the video resolution of transmission; when the entropy calculator module calculates that the information amount of the video frame is small, namely the entropy of the video image does not exceed a set proportion value 10 of the entropy of the video background image, the encoding end only carries out base layer encoding, the decoding end only carries out base layer decoding, and the resolution of the decoded video frame of the decoding section is low; when the entropy calculator module calculates that the information amount of the video frame is large, namely the entropy of the video image does not exceed the set proportion value 10 of the entropy of the video background image, the entropy calculator activates the enhancement layer information coding, and the decoding end activates the enhancement layer information decoding. The decoded segment decoded video frame has high resolution.
The hierarchical distributed video coding method based on the DISCOVER framework can improve the video coding efficiency and finally achieve the purpose of reducing the energy consumption of the sensor nodes. The coding framework provided by the invention can more effectively reduce the consumption of transmission nodes due to the improvement of the utilization rate of information. When the video information entropy is small, the coding system can carry out coding at a resolution lower than that of the traditional DISCOVER coding framework; and when the information amount of the video frame is large, the decoding end recovers the video frame with higher resolution by activating the enhancement layer coding. The enhancement layer coding enabling time is set to be far shorter than the sleep time, so that the energy consumption can be effectively saved.
The method for coding the hierarchical distributed video based on the DISCOVER framework specifically comprises the following steps,
s1, video acquisition is carried out;
s2, encoding the collected video, entering key frame judgment, wherein odd frames are key frames, even frames are WZ frames, original video code streams of the key frames and the WZ frames pass through a down sampler to obtain video resolution meeting the requirement of a decoding end, called as a base layer, and after up sampling, key frames of the base layer are subtracted from the original video code streams of the key frames to obtain a key frame enhancement layer, wherein the specific process is as follows:
s2, encoding the collected video, and dividing the basic layer into WZ frames and K frames, wherein the specific process is as follows:
s21, dividing a key frame K frame and a WZ frame of a video sequence, namely Wyner-Ziv frames, of the collected video, wherein the ratio of the K frame to the WZ frame is related to the size of a GOP (group of pictures), and because the two frames have different requirements, the adopted coding modes are different; coding the K frame and the WZ frame respectively by adopting different coding modes, wherein the WZ frame is shifted to a step S22, and the K frame is shifted to a step S23;
s22, performing DCT (Discrete Cosine Transform) on the WZ frame, and storing Check information in a buffer after quantization and LDPCA (Low-Density Parity-Check accumulated Codes) coding, wherein once the coding end receives a feedback request from the decoding end, the information is transmitted immediately;
s23, carrying out intra-frame coding based on H.264 standard on the K frames after down-sampling;
and S3, decoding the base layer. In step S3, specifically, the step,
s31, decoding the K frames, entering an entropy calculator, comparing the K frames with an entropy threshold, and entering S32 if the K frames are larger than the entropy threshold; if the entropy is smaller than the entropy threshold value, entering S33;
s32, the controller opens the base layer decoder to enter the layered coding; in step S32, the step of opening the hierarchical code specifically includes:
s321, decoding the K frame, and performing up-sampling on the K frame through an up-sampler;
s322, subtracting the original frame of the K frame from the frame after the up sampler to obtain enhancement layer information;
and S323, carrying out enhancement layer encoder encoding on the enhancement layer information, and sending the enhancement layer information to the mixer through transmission.
S33, decoding the K frames and putting the K frames into a frame buffer; if S32 is executed, S34 is executed continuously, and if S32 is not executed, S36 is directly entered;
s34, the decoder end generates an estimated value, namely side information, for each WZ frame by a motion compensation frame interpolation method through front and rear related frames;
s35, decoding and reconstructing the WZ frame by using the relevant noise model, and restoring the WZ frame by IDCT;
and S36, combining the decoded WZ frame and the K frame to recover the base layer video.
And S4, decoding the enhancement layer. In step S4, specifically, the step,
s41, upsampling the K frame, and summing the upsampled K frame with an enhancement layer encoder to generate an enhancement layer key frame;
s42, generating enhancement layer side information through the front key frame and the rear key frame;
s43, upsampling the WZ frame, and recovering the enhanced layer WZ frame according to the enhanced layer side information;
and S44, combining the WZ frame and the K frame of the enhancement layer to recover the video of the enhancement layer.
Embodiments separate the video transmission nodes into two states-a weak operating state and a strong operating state. The weak working state means that when the entropy calculator module calculates the amount of video frame information is small (people are few or vehicles are few, etc.), the low video resolution can meet the application requirement, and at the moment, the encoding end only carries out base layer encoding; the strong working state refers to that when the information amount of the video frames obtained by the entropy calculator module is high (more people or more vehicles and the like), the enhancement layer information coding is activated, so that the decoding end can decode the high-resolution video, and the video acquisition requirement is met. For example, on the urban traffic line, the strong working state is the time period with dense traffic flow, which is mostly expressed in 7:00-9:00 and 16:00-19:00, and the other time periods are expressed in the weak working state. The coding mode reduces the coding complexity of the coding end, can effectively reduce the coding energy consumption in a weak working state, can meet the requirements of transmission nodes in a strong working state, and realizes the transmission of videos according to the requirements.
The embodiment method adopts a DISCOVER coding system and the traditional spatial scalable coding to be fused, and realizes a controllable mode of the resolution of the scalable distributed coding. The method is mainly used for meeting the requirements of the wireless sensor node on image transmission: and in a weak working state, a lower transmission code rate is used, the energy consumption of the sensor node is reduced, and the resolution ratio is adjusted according to the requirement.
The scalable distributed video coding method based on the DISCOVER framework in the embodiment uses the traditional spatial scalable coding and DISCOVER video coding as reference, and adds an entropy calculator module for judging whether to activate an enhancement layer coded image on the basis of fusing the two, so that the three aspects form the whole framework of scalable distributed video coding and decoding. In the actual encoding and decoding process, when the information amount of the base layer frame reaches the entropy threshold value, the enhancement layer encoding is activated. An image entropy calculator module is added for judging whether the enhancement layer coding is activated or not, so that the whole coding framework is more flexible.
The embodiment method introduces the hierarchical video coding into a DISCOVER distributed video coding framework, realizes the hierarchical transmission in the distributed video coding and decoding, and meets the requirement of users on the video resolution. It consists of two major parts: the base layer coding frame and the enhancement layer coding frame are connected through the entropy calculator module and the control module.
In an embodiment, the entropy calculator module at the decoding end is a calculation unit, which can realize the calculation of the information amount transmitted each frame, and when the information amount exceeds the threshold, it sends a signal to the controllers at the encoding end and the decoding end to start the encoding and decoding of the enhancement layer, so as to realize the hierarchical control of the encoding.
The whole video coding and decoding frame is added with a part of an image entropy calculator, the part is used for activating the coding of the enhancement layer, an entropy threshold value is set according to the requirement of a decoding end, and when the frame information amount of the base layer reaches the threshold value, the coding of the enhancement layer is activated. The generated enhancement layer information enters a decoding end through a transmission network, the base layer information reaches the resolution of the enhancement layer through up-sampling, and the base layer information and the enhancement layer are added to obtain a high-resolution image. In the embodiment, the decoding mode of the enhancement layer generates side information for the enhancement layer key frame, assists the enhancement layer WZ frame video recovery, and recovers the high-resolution video through frame reordering.
Embodiments also provide a system using any one of the above-mentioned scalable distributed video coding method based on the DISCOVER framework, as shown in fig. 2, including an encoding side and a decoding side,
and (3) a coding end: after video acquisition, dividing each frame of the acquired video into a base layer and an enhancement layer, wherein the acquired original video code stream passes through a down sampler to obtain video resolution meeting the requirements of a decoding end, namely the base layer, and the base layer performs subtraction operation with the original video code stream after up sampling to obtain the enhancement layer; dividing a basic layer into a WZ frame and a K frame, and the specific process comprises the following steps: dividing a key frame K frame and a WZ frame of a video sequence, namely Wyner-Ziv frames, of the collected video, and coding the K frame and the WZ frame respectively in different coding modes; DCT transformation is carried out on WZ frames, and after quantization and LDPCA coding, the check information is stored in a buffer, and once a coding end receives a feedback request from a decoding end, information transmission is carried out immediately; carrying out intra-frame coding based on the H.264 standard on the K frame;
and a decoding end: the base layer and the enhancement layer are decoded.
In the embodiment, each frame of the video is divided into a base layer and an enhancement layer, an original video code stream passes through a down-sampler to obtain a video resolution which can basically meet the basic requirement of a decoding end, the base layer is called as the base layer, and the base layer is subjected to up-sampling and then is subjected to subtraction operation with the original video to obtain enhancement layer information.
The base layer will be divided into two categories again: WZ frame and K frame, the K frame adopts H.264 intraframe coding mode, and the WZ frame is transmitted into the decoding end through transmission network after the operations of DCT transformation, quantization and the like are carried out. And generating the side information of the WZ frame by the K frame through DCT, and finally finishing the video decoding of the base layer. The base layer is divided into WZ frames and K frames, the coding energy consumption is effectively reduced in a common time interval, the requirement of a transmission node is met in a key monitoring time period, and the video is transmitted according to the requirement.
Claims (3)
1. A method for coding a hierarchical distributed video based on a DISCOVER framework is characterized in that: the method comprises the steps that hierarchical video coding is introduced into a DISCOVER distributed video coding framework, hierarchical transmission in distributed video coding and decoding is achieved, the distributed video coding and decoding framework comprises a base layer coding framework and an enhancement layer coding framework, the two parts of frameworks are connected with a control module through an entropy calculator module, and the coding framework controls the video resolution of transmission by itself; when the entropy calculator module calculates that the information amount of the video frame is small, namely the entropy of the video image does not exceed the set proportion value of the entropy of the video background image, the encoding end only carries out base layer encoding, and the decoding end only carries out the base layer; when the entropy calculator module calculates that the information amount of the video frame is large, namely the entropy of the video image exceeds a set proportion value of the entropy of the video background image, the entropy calculator activates the information coding of the enhancement layer, and the decoding end activates the information decoding of the enhancement layer; the method specifically comprises the following steps of,
s1, video acquisition is carried out;
s2, encoding the collected video, entering key frame judgment, wherein odd frames are key frames, even frames are WZ frames, original video code streams of the key frames and the WZ frames pass through a down sampler to obtain video resolution meeting the requirement of a decoding end, called as a base layer, and after up sampling, key frames of the base layer are subtracted from the original video code streams of the key frames to obtain a key frame enhancement layer, wherein the specific process is as follows:
s21, dividing a key frame K frame and a WZ frame of a video sequence, namely Wyner-Ziv frames, of the collected video, respectively encoding the K frame and the WZ frame in different encoding modes, wherein the WZ frame is converted to a step S22, and the K frame is converted to a step S23;
s22, DCT transformation is carried out on the WZ frame, and after quantization and LDPCA coding, the check information is stored in a buffer, and once the coding end receives a feedback request from the decoding end, information transmission is carried out immediately;
s23, carrying out intra-frame coding based on H.264 standard on the K frames after down-sampling;
s3, decoding the base layer; in step S3, specifically, the step,
s31, decoding the K frames, entering an entropy calculator, comparing the K frames with an entropy threshold, and entering S32 if the K frames are larger than the entropy threshold; if the entropy is smaller than the entropy threshold value, entering S33;
s32, the controller opens the base layer decoder to enter the layered coding; in step S32, the step of opening the hierarchical code specifically includes:
s321, decoding the K frame, and performing up-sampling on the K frame through an up-sampler;
s322, subtracting the original frame of the K frame from the frame after the up sampler to obtain enhancement layer information;
s323, carrying out enhancement layer encoder encoding on the enhancement layer information, and sending the enhancement layer information into a mixer through transmission;
s33, decoding the K frames and putting the K frames into a frame buffer; if S32 is executed, S34 is executed continuously, and if S32 is not executed, S36 is directly entered;
s34, the decoder end generates an estimated value, namely side information, for each WZ frame by a motion compensation frame interpolation method through front and rear related frames;
s35, decoding and reconstructing the WZ frame by using the relevant noise model, and restoring the WZ frame by IDCT;
s36, combining the decoded WZ frame and the decoded K frame to recover a video;
s4, decoding the enhancement layer; in step S4, specifically, the step,
s41, upsampling the K frame, and summing the upsampled K frame with an enhancement layer encoder to generate an enhancement layer key frame;
s42, generating enhancement layer side information through the front key frame and the rear key frame;
s43, upsampling the WZ frame, and recovering the enhanced layer WZ frame according to the enhanced layer side information;
and S44, combining the WZ frame and the K frame of the enhancement layer to recover the video of the enhancement layer.
2. The DISCOVER framework based hierarchical distributed video coding method of claim 1, characterized in that: the entropy calculator module calculates that the information amount of the video frame is small, namely the entropy of the video image does not exceed the set proportion value of the entropy of the video background image by 10%, and the entropy calculator module calculates that the information amount of the video frame is large, namely the entropy of the video image exceeds the set proportion value of the entropy of the video background image by 10%.
3. A system employing the DISCOVER framework based hierarchical distributed video coding method of claim 1 or 2, characterized in that: comprises an encoding end and a decoding end,
and (3) a coding end: after video acquisition, dividing each frame of the acquired video into a base layer and an enhancement layer, wherein the acquired original video code stream passes through a down sampler to obtain video resolution meeting the requirements of a decoding end, namely the base layer, and the base layer performs subtraction operation with the original video code stream after up sampling to obtain the enhancement layer; dividing a basic layer into a WZ frame and a K frame, and the specific process comprises the following steps: dividing a key frame K frame and a WZ frame of a video sequence, namely Wyner-Ziv frames, of the collected video, and coding the K frame and the WZ frame respectively in different coding modes; DCT transformation is carried out on WZ frames, and after quantization and LDPCA coding, the check information is stored in a buffer, and once a coding end receives a feedback request from a decoding end, information transmission is carried out immediately; carrying out intra-frame coding based on the H.264 standard on the K frame;
and a decoding end: the base layer and the enhancement layer are decoded.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810488010.2A CN108632613B (en) | 2018-05-21 | 2018-05-21 | Hierarchical distributed video coding method and system based on DISCOVER framework |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810488010.2A CN108632613B (en) | 2018-05-21 | 2018-05-21 | Hierarchical distributed video coding method and system based on DISCOVER framework |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108632613A CN108632613A (en) | 2018-10-09 |
| CN108632613B true CN108632613B (en) | 2020-10-16 |
Family
ID=63693985
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810488010.2A Active CN108632613B (en) | 2018-05-21 | 2018-05-21 | Hierarchical distributed video coding method and system based on DISCOVER framework |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108632613B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110113610B (en) * | 2019-04-23 | 2021-04-20 | 西安万像电子科技有限公司 | Data transmission method and device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101163241A (en) * | 2007-09-06 | 2008-04-16 | 武汉大学 | Video sequence coding/decoding structure |
| CN102769747A (en) * | 2012-06-29 | 2012-11-07 | 中山大学 | Parallel iteration-based grading and distributed video coding/decoding method and system |
| CN103002280A (en) * | 2012-10-08 | 2013-03-27 | 中国矿业大学 | Distributed encoding/decoding method and system based on HVS/ROI (human vision system and region of interest) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8340192B2 (en) * | 2007-05-25 | 2012-12-25 | Microsoft Corporation | Wyner-Ziv coding with multiple side information |
| US20100142620A1 (en) * | 2008-12-04 | 2010-06-10 | Electronics And Telecommunications Research | Method of generating side information by correcting motion field error in distributed video coding and dvc decoder using the same |
| US20120075440A1 (en) * | 2010-09-28 | 2012-03-29 | Qualcomm Incorporated | Entropy based image separation |
| CN103002283A (en) * | 2012-11-20 | 2013-03-27 | 南京邮电大学 | Multi-view distributed video compression side information generation method |
| JP6269137B2 (en) * | 2014-02-13 | 2018-01-31 | 沖電気工業株式会社 | Moving picture decoding apparatus and program |
-
2018
- 2018-05-21 CN CN201810488010.2A patent/CN108632613B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101163241A (en) * | 2007-09-06 | 2008-04-16 | 武汉大学 | Video sequence coding/decoding structure |
| CN102769747A (en) * | 2012-06-29 | 2012-11-07 | 中山大学 | Parallel iteration-based grading and distributed video coding/decoding method and system |
| CN103002280A (en) * | 2012-10-08 | 2013-03-27 | 中国矿业大学 | Distributed encoding/decoding method and system based on HVS/ROI (human vision system and region of interest) |
Non-Patent Citations (2)
| Title |
|---|
| 基于SVD的无线多媒体传感器网络图像压缩机制;韩崇 孙力娟;《东南大学学报( 自然科学版)》;20120930;全文 * |
| 面向多媒体传感器网络的视频;孙力娟，马子平，肖甫;《中国图象图形学报》;20110731;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108632613A (en) | 2018-10-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101854548B (en) | Wireless multimedia sensor network-oriented video compression method | |
| KR100725407B1 (en) | Method and apparatus for video signal encoding and decoding with directional intra residual prediction | |
| CN101835042B (en) | Wyner-Ziv video coding system controlled on the basis of non feedback speed rate and method | |
| CN101188757B (en) | Method and apparatus for scalable video encoding and decoding | |
| CN101835044B (en) | Grouping method in frequency domain distributed video coding | |
| CN102256133B (en) | Distributed video coding and decoding method based on side information refining | |
| KR20070026317A (en) | Bi-directional predicting method for video coding/decoding | |
| CN102291561A (en) | Reducing use of periodic key frames in video conferencing | |
| CN100455020C (en) | Screen coding method under low code rate | |
| CN102271256B (en) | Mode decision based adaptive GOP (group of pictures) distributed video coding and decoding method | |
| CN102572428B (en) | Side information estimating method oriented to distributed coding and decoding of multimedia sensor network | |
| CN103002283A (en) | Multi-view distributed video compression side information generation method | |
| CN103442228B (en) | Code-transferring method and transcoder thereof in from standard H.264/AVC to the fast frame of HEVC standard | |
| CN103002280A (en) | Distributed encoding/decoding method and system based on HVS/ROI (human vision system and region of interest) | |
| CN102595132A (en) | Distributed video encoding and decoding method applied to wireless sensor network | |
| CN1694536A (en) | Video encoder using average histogram difference and method for controlling the same | |
| CN111726614A (en) | HEVC (high efficiency video coding) optimization method based on spatial domain downsampling and deep learning reconstruction | |
| CN102833536A (en) | Distributed video encoding and decoding method facing to wireless sensor network | |
| CN101888547B (en) | Direct mode selection based H.264/AVC (Advanced Video Coding) fast transcoding method and device | |
| CN108632613B (en) | Hierarchical distributed video coding method and system based on DISCOVER framework | |
| Guo et al. | Distributed video coding using wavelet | |
| Sun et al. | The improved SP frame coding technique for the JVT standard | |
| Wang et al. | A low complexity compressed sensing-based codec for consumer depth video sensors | |
| Chiu et al. | Distributed video coding: a promising solution for distributed wireless video sensors or not? | |
| CN104135662A (en) | Improved H.264 compressed encoding method for video file under limited bandwidth and emission rate condition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 210003 Gulou District, Jiangsu, Nanjing new model road, No. 66 Applicant after: NANJING University OF POSTS AND TELECOMMUNICATIONS Address before: Yuen Road Qixia District of Nanjing City, Jiangsu Province, No. 9 210003 Applicant before: NANJING University OF POSTS AND TELECOMMUNICATIONS |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |