CN108881915B - Device and method for playing video based on DSC (differential scanning sequence) coding technology - Google Patents
Device and method for playing video based on DSC (differential scanning sequence) coding technology Download PDFInfo
- Publication number
- CN108881915B CN108881915B CN201810758800.8A CN201810758800A CN108881915B CN 108881915 B CN108881915 B CN 108881915B CN 201810758800 A CN201810758800 A CN 201810758800A CN 108881915 B CN108881915 B CN 108881915B
- Authority
- CN
- China
- Prior art keywords
- dsc
- image
- sub
- module
- coding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/436—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
Abstract
The invention relates to a video playing device based on DSC coding technology, wherein an image partitioning control module of the device is used for partitioning each video image of a YCoCg reversible color space into a plurality of sub-images according to slices, and the plurality of sub-images form a sub-image group; the DSC parallel coding module comprises a plurality of DSC coding sub-modules which run in parallel, and each DSC coding sub-module respectively carries out DSC coding processing on a selected sub-image in the sub-image group in the same DSC coding processing time period to obtain DSC compressed image data of the corresponding sub-image; and the image merging control module recombines the DSC compressed image data of all the sub-images to form a complete DSC compressed video image for video playing. The invention can make part of old equipment play video with higher resolution than before without changing hardware.
Description
Technical Field
The invention relates to the technical field of liquid crystal module display and test, in particular to a device and a method for video playing based on a DSC (display stream compression) encoding technology.
Technical Field
With the development and popularization of high-definition display technology, video images with 2K and 4K or even higher distribution rates are widely applied to the display field. In the prior art, 2K and 4K video images with even higher distribution rates are directly transmitted to a receiving end for display, but the display requirement of high quality and low delay means larger amount of data transmission and higher bandwidth requirement, namely, faster speed and more complicated physical link and interface design. On one hand, some old devices cannot meet the bandwidth requirement of supporting high resolution; on the other hand, the bandwidth requirement due to the ultra-high resolution is increased, which leads to the substantial increase of the cost and power consumption.
Disclosure of Invention
The invention aims to provide a device and a method for playing video based on DSC coding technology, which can enable part of old equipment to play video with higher resolution than before without changing hardware; and the display device can also be a display device with higher resolution, so that the cost and the power consumption are reduced.
To achieve the object, the present invention provides a device for video playback based on DSC coding technique, which is characterized in that: the system comprises an RGB-to-YCoCg conversion module, an image block control module, a DSC parallel coding module, a parallel coding synchronization control module and an image merging control module;
the RGB-to-YCoCg conversion module is used for converting video image data of an RGB color space into video image data of a YCoCg reversible color space;
the image partitioning control module is used for partitioning each video image of the YCoCg reversible color space into a plurality of sub-images according to slices, and the sub-images form a sub-image group;
the DSC parallel coding module comprises a plurality of DSC coding sub-modules which run in parallel, each DSC coding sub-module respectively performs DSC coding processing on a selected sub-image in the sub-image group in the same DSC coding processing time period to obtain DSC compressed image data of the corresponding sub-image, the DSC parallel coding module performs DSC coding processing on all sub-images in the sub-image group through a plurality of DSC coding processing time periods, wherein the DSC coding sub-module which is not allocated to the sub-image stops working in the last DSC coding processing time period of the DSC parallel coding module;
the image merging control module is used for recombining the DSC compressed image data of all the sub-images to form a complete DSC compressed video image for video playing;
and the parallel coding synchronous control module is used for controlling the DSC coding processing time period, and after all DSC coding sub-modules finish the DSC coding processing of the respectively selected sub-images, the DSC parallel coding module enters the processing process of the next DSC coding processing time period.
A video playing method using the device is characterized by comprising the following steps:
step 1: the RGB-to-YCoCg conversion module converts the video image data of the RGB color space into video image data of a YCoCg reversible color space;
step 2: the image partitioning control module divides each video image of the YCoCg reversible color space into a plurality of sub-images according to slices, and the sub-images form a sub-image group;
and step 3: each DSC coding sub-module of the DSC parallel coding module respectively performs DSC coding processing on a selected sub-image in the sub-image group in the same DSC coding processing time period to obtain DSC compressed image data of the corresponding sub-image, and the DSC parallel coding module performs DSC coding processing on all sub-images in the sub-image group through a plurality of DSC coding processing time periods, wherein in the last DSC coding processing time period of the DSC parallel coding module, the DSC coding sub-module which is not allocated to the sub-image stops working;
and the parallel coding synchronous control module controls the DSC coding processing time period, and after all DSC coding sub-modules finish the DSC coding processing of the respectively selected sub-images, the DSC parallel coding module enters the processing process of the next DSC coding processing time period.
And 4, step 4: and the image merging control module recombines the DSC compressed image data of all the sub-images to form a complete DSC compressed video image for video playing.
The technical scheme of the invention can divide the picture in one frame into a plurality of blocks to carry out parallel DSC coding processing, thereby realizing smooth playing of the video, simultaneously, the invention comprises a synchronization mechanism, which can ensure the synchronization of parallel processing modules, thereby ensuring the parallel processing of different parts of the same frame, and in addition, the invention comprises a double buf (buffer space) buffer mechanism, thereby realizing the lossless switching of the video frame.
The invention provides the visual lossless compression video quality by encoding and compressing the video data in real time, and can compress a 6bpp (bits per component) video into 25% of the original video, compress an 8bpp video into 33% of the original video and compress a 12bpp video into 50% of the original video, thereby enabling part of old equipment to play a video with higher resolution than before without changing hardware; meanwhile, the design complexity is reduced, the hardware requirement is reduced, and the cost and the power consumption are reduced for a display device with high resolution.
The device and the method designed by the invention are suitable for all equipment supporting high-definition video and image display and module detection processing, can support the dot screen test of modules with resolutions of 4k, 8k and above, and can also support the real-time display of high-definition video with 90hz refresh rate, and do not need to buffer the whole frame data (the improved algorithm is rapid in parallel processing, and does not need to use a buffer because of the condition that data cannot be processed), thereby reducing the throughput. In addition, the invention optimizes and adjusts the structure of the existing DSC algorithm, provides parallel pipeline processing of grouping after the original image data is blocked, modifies the linking relation among different functional modules, enables the original modules which work in series to execute in parallel, improves the operation speed, reduces the data interaction among devices, and has the characteristics of easy realization, low cost, high practicability and the like.
Drawings
FIG. 1 is a block diagram of the present invention.
Fig. 2 is a block diagram of the DSC coding submodule according to the present invention.
The device comprises a 1-video receiving module, a 2-RGB-to-YCoCg conversion module, a 3-image block control module, a 4-DSC parallel coding module, a 4.1-DSC coding sub-module, a 4.2-pixel value prediction module, a 4.3-residual error and pixel reconstruction module, a 4.4-entropy coding module, a 4.5-code rate control module, a 4.6-image segmentation module, a 4.7-image boundary judgment module, a 4.8-index color history record reconstruction module, a 5-parallel coding synchronous control module, a 6-post-coding double-buf storage module, a 7-video sending module, an 8-pre-coding double-buf storage module and a 9-image combination control module, wherein the 1-video receiving module, the 2-RGB-YCoCg conversion module, the 3-image
Detailed Description
The invention is described in further detail below with reference to the following figures and specific examples:
the invention relates to a device for playing video based on DSC coding technology, as shown in figure 1, it includes RGB (red, green, blue three-color) to YCoCg conversion module 2(YCoCg is a color space expression method, Y is Luminine or Luma, expressing brightness, Co, Cg is Chroma or Chroma, o is orange, expressing the difference between RGB input signal orange and RGB signal brightness value, g is green, expressing the difference between RGB input signal green and RGB signal brightness value), image block control module 3, DSC parallel coding module 4, parallel coding synchronization control module 5, image merging control module 9, video receiving module 1, video transmitting module 7, double-buf storage module 8 before coding and double-buf storage module 6 after coding;
the output end of the video receiving module 1 is connected with the input end of the RGB-to-YCoCg conversion module 2, the output end of the RGB-to-YCoCg conversion module 2 is connected with the input end of the pre-coding double-buf storage module 8, the output end of the pre-coding double-buf storage module 8 is connected with the input end of the image block control module 3, the output end of the image partitioning control module 3 is connected with the input end of the DSC parallel coding module 4, the output end of the DSC parallel coding module 4 is connected with the input end of the image merging control module 9, the output end of the image combination control module 9 is connected with the input end of the coded double-buf storage module 6, the output end of the coded double-buf storage module 6 is connected with the input end of the video transmission module 7, the DSC parallel coding module 4 feeds all DSC coded state information back to the pre-code double-buf storage module 8, and the coded double-buf storage module 6 feeds the stored state information back to the DSC parallel coding module 4;
the RGB-to-YCoCg conversion module 2 is configured to convert the video image data of the RGB color space into video image data of a YCoCg reversible color space, Y representing luminance, and Co, Cg representing chrominance. Because the human visual system is more sensitive to brightness and chrominance, the brightness information and the chrominance information of the video image are separated, different coding compression ratios can be realized, and coding compression can be more effectively carried out. After conversion, the Y color component falls in the [0,1] interval, the Co and Cg color components fall in the [ -1,1] interval, the Co and Cg are further subjected to positive numeralization, and the Co and Cg color components finally fall in the [0,2] interval;
the image partitioning control module 3 is configured to divide each video image of the YCoCg reversible color space into a plurality of sub-images per slice (slice), where the plurality of sub-images form a sub-image group; the division ratio of the division according to the slices is determined by the compressed picture parameter set information of the display module which finally displays the original image (each liquid crystal module has pps information similar to a use instruction, and the length and the width of the slice and the module resolution are recorded in the pps information; for example, a cell phone screen with a resolution 1440 × 2560, most defined tile sizes are 720 × 8 to 1 tile;
the DSC parallel encoding module 4 includes multiple DSC encoding sub-modules 4.1 (in this embodiment, 2K resolution 2560 × 1440 video images are processed, so 6 groups of DSC encoding modules are used, and other resolutions can correspondingly increase or decrease the number of DSC encoding sub-modules), each DSC encoding sub-module 4.1 performs DSC encoding processing on a sub-image selected (randomly selected or selected in the row and column order of the sub-images, as long as the following relationships are satisfied) in the same DSC encoding processing time period to obtain DSC compressed image data of the corresponding sub-image, the DSC parallel encoding module 4 performs DSC encoding processing on all sub-images in the sub-image group through multiple DSC encoding processing time periods, in the last DSC coding processing time period of the DSC parallel coding module 4, the DSC coding sub-modules 4.1 which are not assigned to the sub-images stop working; the design can greatly improve the coding rate of a whole video image, and the maximum coding rate can be improved to 6 times. The image merging control module 9 is configured to recombine the DSC compressed image data of all the sub-images to form a complete DSC compressed video image for video playing;
the parallel coding synchronization control module 5 is configured to control the DSC coding processing time period, and after all DSC coding sub-modules 4.1 complete the DSC coding processing on each selected sub-image, the DSC parallel coding module 4 enters the processing procedure of the next DSC coding processing time period.
In the above technical solution, the before-coding double-buf storage module 8 includes a first before-coding buf storage space and a second before-coding buf storage space, video image data is written in the first before-coding buf storage space, a video image in the second before-coding buf storage space remains unchanged, and the image blocking control module 3 reads the video image data stored in the second before-coding buf storage space in the order of image frames; until all DSC codes of the images stored in the before-second-code buf storage space are finished, switching to writing video image data into the before-second-code buf storage space; at this time, the image in the first pre-coding buf storage space remains unchanged, and the image blocking control module 3 reads the video image data stored in the first pre-coding buf storage space according to the sequence of the image frames (the DSC coding compression rate is not less than the video input rate, and the time for writing one frame is enough for the DSC to finish processing the data in the other 1 buf).
When the data input into the pre-coding double buf storage module 8 is video data, the data stored in the second pre-coding buf storage space is an all-black image in the initial condition. In the digital circuit, the default value of the initial value in buf is 0, namely, a completely black image, which is consistent with the process from black screen to bright screen when the display device is powered on.
In the above technical solution, the video receiving module 1 is configured to receive a high Definition video signal (supporting multiple high Definition video interface protocols, including but not limited to dp (displayport), mipi (mobile industry Processor interface), and hdmi (high Definition Multimedia interface)) transmitted by an external video source;
the video sending module 7 is configured to display and play the DSC compressed image recombined by the image merging control module 9.
In the above technical solution, the encoded dual-buf storage module 6 includes a first encoded buf storage space and a second encoded buf storage space, the image merging control module 9 writes the reconstructed DSC compressed image data into the first encoded buf storage space, at this time, the image data in the second encoded buf storage space remains unchanged, and the video sending module 7 reads the image in the second encoded buf storage space for display;
after the DSC parallel encoding module 4 completes encoding of the whole picture, waiting for the video transmission module 7 to read out the last 1 data in the second encoded buf storage space, and then switching to writing DSC compressed image data into the second encoded buf storage space, where the video data in the first encoded buf storage space is unchanged, and the video transmission module 7 reads the image in the first encoded buf storage space for display.
In the above technical solution, each DSC coding sub-module 4.1 in the DSC parallel coding module 4 includes an image segmentation module 4.6, a pixel value prediction module 4.2, a residual and pixel reconstruction module 4.3, an entropy coding module 4.4, and a code rate control module 4.5, as shown in fig. 2;
the image segmentation module 4.6 is configured to averagely divide each row of pixel points in the selected sub-image into a plurality of pixel groups; each row of pixel points (namely all pixel points in the row) in each sub-image is averagely divided into a plurality of pixel groups (each pixel Group comprises three adjacent pixel points in the row) in a mode that three adjacent pixel points are taken as a Group; grouping each row of pixel points of each sub-image according to a group of three adjacent pixel points;
the pixel value prediction module 4.2 is used for performing parallel pixel value prediction on each pixel point in each pixel group of the selected sub-image to obtain a pixel prediction value of each pixel point in each pixel group of the selected sub-image;
the residual and pixel reconstruction module 4.3 is used for subtracting the pixel predicted value of each pixel point in each pixel group of the selected sub-image from the original pixel value of the corresponding pixel point to obtain the residual of each pixel point of the selected sub-image, carrying out parallel quantization on the residual of each pixel point, and replacing the original pixel value of the corresponding pixel point with the result of the residual quantization of each pixel point to realize the reconstruction of each pixel point of the selected sub-image; the residual error and pixel reconstruction module 4.3 carries out parallel quantization on the residual error of each pixel point of each sub-image according to the corresponding quantization parameter; quantization is implemented by looking up a table, for example, if the calculation result of the luminance component is 0 to 15 values, the corresponding quantization factors are: 0. 0,1, 2, 3, 4, 5, 6, 7.
The entropy coding module 4.4 is configured to entropy code (vlc) the reconstructed sub-image of the pixel points;
and the code rate control module (rc)4.5 is used for dynamically adjusting the number of bytes required by the pixels of the sub-images in entropy coding by using the quantization coefficients in the entropy coding of the sub-images during entropy coding to form DSC compressed image data.
In the above technical solution, the pixel value Prediction module 4.2 performs pixel value Prediction on each group of pixel points of the sub-image by using a median Prediction (MPP) mode, so as to realize independent median Prediction on each group of pixel points of the sub-image.
In the above technical solution, the pixel value Prediction module 4.2 predicts the pixel values of the pixel points in each pixel group of the first line of the sub-image according to an improved Median-Adaptive Prediction initial value mode (MAP, Modified media-Adaptive Prediction);
the pixel value prediction module 4.2 predicts the pixel values of the first group of pixel points of the rest rows of the sub-image by adopting an improved median adaptive prediction initial value giving mode;
the pixel value prediction module 4.2 determines the prediction forms of the pixel values of the groups of pixels behind the first group of pixels in the rest rows of the sub-image by the entropy coding calculation result reconstructed by the previous group of pixels of the current group of pixels, so as to realize the partition combination prediction of the groups of pixels of each sub-image, wherein the prediction forms of the pixel values of the second group of pixels in the rest rows of the sub-image are determined by the entropy coding calculation result reconstructed by the first group of pixels in the row (the specific determination rule is shown in table 1). The pixel value Prediction form comprises a median Prediction form, an improved median adaptive Prediction initialization value mode and a Block Prediction form (Block Prediction). The above prediction modes are independent of each other, so that the parallel implementation can be realized, and the code rate control operation and the entropy coding and pixel value prediction are processed in parallel, namely, the pixel value prediction processing can be carried out on the current group of pixels while the previous group of pixels of the current group of pixels is subjected to reconstruction, entropy coding and code rate control, so that two thirds of processing time is saved.
Table 1: VLC codeword transmission rules
In the above technical solution, each DSC coding sub-module 4.1 further includes an image boundary judgment (flat) module 4.7 and an index color history record reconstruction module 4.8, where the image boundary judgment module 4.7 is configured to perform image boundary judgment processing on a sub-image, and then transmit an image boundary judgment result of the sub-image to the pixel value prediction module 4.2 and the code rate control module 2.5, so that the pixel value prediction module 2.2 adapts to a boundary condition of a current pixel when performing pixel prediction and code rate control by the code rate control module 4.5. Since the image boundary determining module 2.7 extracts information from the future data to generate the quantization coefficients required by the current data, the module can process in parallel as the prediction module, thereby saving processing time.
The index color history reconstruction (ich) module 4.8 is configured to perform index color history reconstruction on each group of pixels behind the first group of pixels in the remaining rows of the sub-image, compare a result of the index color history reconstruction with a reconstruction result after the independent median prediction of the corresponding pixels and a reconstruction result after the partition combination prediction of each group of pixels of each sub-image, and select a reconstruction result closer to the corresponding pixels for subsequent entropy coding.
In the above technical solution, each functional module can be implemented in an FPGA (field programmable gate array).
A video playing method using the device comprises the following steps:
step 1: the RGB-to-YCoCg conversion module 2 converts the video image data of the RGB color space into video image data of a YCoCg reversible color space;
step 2: the image partitioning control module 3 divides each video image of the YCoCg reversible color space into a plurality of sub-images according to the image, and the plurality of sub-images form a sub-image group;
and step 3: each DSC coding sub-module 4.1 of the DSC parallel coding module 4 respectively carries out DSC coding processing on a selected sub-image in the sub-image group in the same DSC coding processing time period to obtain DSC compressed image data of the corresponding sub-image, the DSC parallel coding module (4) carries out DSC coding processing on all sub-images in the sub-image group through a plurality of DSC coding processing time periods, wherein the DSC coding sub-module 4.1 which is not allocated to the sub-image stops working in the last DSC coding processing time period of the DSC parallel coding module 4;
the parallel coding synchronization control module 5 controls the DSC coding processing time period, and after all DSC coding sub-modules 4.1 complete the DSC coding processing of the respectively selected sub-images, the DSC parallel coding module 4 enters the processing procedure of the next DSC coding processing time period.
And 4, step 4: the image merging control module 9 recombines the DSC compressed image data of all sub-images to form a complete DSC compressed video image for video playback.
Details not described in this specification are within the skill of the art that are well known to those skilled in the art.
Claims (10)
1. A device based on DSC coding technique video playing is characterized in that: the system comprises an RGB-to-YCoCg conversion module (2), an image block control module (3), a DSC parallel coding module (4), a parallel coding synchronous control module (5) and an image merging control module (9);
the RGB-to-YCoCg conversion module (2) is used for converting video image data of an RGB color space into video image data of a YCoCg reversible color space;
the image partitioning control module (3) is used for partitioning each video image of the YCoCg reversible color space into a plurality of sub-images according to slices, and the plurality of sub-images form a sub-image group;
the DSC parallel coding module (4) comprises a plurality of DSC coding sub-modules (4.1) which run in parallel, each DSC coding sub-module (4.1) respectively carries out DSC coding processing on a selected sub-image in the sub-image group in the same DSC coding processing time period to obtain DSC compressed image data of the corresponding sub-image, the DSC parallel coding module (4) carries out DSC coding processing on all sub-images in the sub-image group through a plurality of DSC coding processing time periods, wherein in the last DSC coding processing time period of the DSC parallel coding module (4), the DSC coding sub-modules (4.1) which are not distributed to the sub-images stop working;
the image combination control module (9) is used for recombining the DSC compressed image data of all the sub-images to form a complete DSC compressed video image for video playing;
the parallel coding synchronous control module (5) is used for controlling the DSC coding processing time period, and after all DSC coding sub-modules (4.1) finish the DSC coding processing of respectively selected sub-images, the DSC parallel coding module (4) enters the processing process of the next DSC coding processing time period;
each DSC coding sub-module (4.1) comprises a pixel value prediction module (4.2) and an image segmentation module (4.6), wherein the image segmentation module (4.6) is used for averagely dividing each row of pixel points in the selected sub-image into a plurality of pixel groups, and the pixel value prediction module (4.2) conducts parallel pixel value prediction on each pixel point in each pixel group of the selected sub-image; and predicting pixel values of pixel points in each pixel group in the first row of the sub-image according to an improved median adaptive prediction initial value assigning mode.
2. The apparatus for video playback based on DSC encoding technology according to claim 1, wherein: the video image coding method further comprises a double-buf-before-coding storage module (8), wherein the double-buf-before-coding storage module (8) comprises a first-before-coding buf storage space and a second-before-coding buf storage space, video image data are written into the first-before-coding buf storage space, video images in the second-before-coding buf storage space are kept unchanged, and the image blocking control module (3) reads the video image data stored in the second-before-coding buf storage space according to the sequence of image frames; until all DSC codes of the images stored in the before-second-code buf storage space are finished, switching to writing video image data into the before-second-code buf storage space; at the moment, the image in the first pre-coding buf storage space is kept unchanged, and the image blocking control module (3) reads the video image data stored in the first pre-coding buf storage space according to the sequence of the image frames.
3. The apparatus for video playback based on DSC encoding technology according to claim 2, wherein: when the data input into the pre-coding double-buf storage module (8) is video data, the data stored in the second pre-coding buf storage space is an all-black image in the initial condition.
4. The apparatus for video playback based on DSC encoding technology according to claim 2, wherein: the device also comprises a video receiving module (1) and a video sending module (7), wherein the video receiving module (1) is used for receiving video signals transmitted by an external video source;
and the video sending module (7) is used for displaying and playing the DSC compressed image recombined by the image combination control module (9).
5. The device for video playback based on DSC encoding technology according to claim 4, wherein: the image merging control module (9) writes the recombined DSC compressed image data into the first coded buf storage space, at the moment, the image data in the second coded buf storage space is kept unchanged, and the video sending module (7) reads the image in the second coded buf storage space for display;
and when the DSC parallel coding module (4) completes coding of the whole picture, waiting for the video sending module (7) to read out the last 1 data in the second coded buf storage space, switching to writing DSC compressed image data into the second coded buf storage space, keeping the video data in the first coded buf storage space unchanged, and reading the image in the first coded buf storage space by the video sending module (7) for displaying.
6. The apparatus for video playback based on DSC encoding technology according to claim 1, wherein: each DSC coding sub-module (4.1) in the DSC parallel coding module (4) also comprises a residual error and pixel reconstruction module (4.3), an entropy coding module (4.4) and a code rate control module (4.5);
the pixel value prediction module (4.2) is used for performing parallel pixel value prediction on each pixel point in each pixel group of the selected sub-image to obtain a pixel prediction value of each pixel point in each pixel group of the selected sub-image;
the residual and pixel reconstruction module (4.3) is used for subtracting the pixel predicted value of each pixel point in each pixel group of the selected sub-image from the original pixel value of the corresponding pixel point to obtain the residual of each pixel point of the selected sub-image, carrying out parallel quantization on the residual of each pixel point, and replacing the original pixel value of the corresponding pixel point with the result of the residual quantization of each pixel point to realize the reconstruction of each pixel point of the selected sub-image;
the entropy coding module (4.4) is used for entropy coding the reconstructed sub-image of the pixel point;
and the code rate control module (4.5) is used for dynamically adjusting the number of bytes required by the pixels of the sub-images in entropy coding by using the quantization coefficients in the entropy coding of the sub-images during entropy coding to form DSC compressed image data.
7. The apparatus for video playback based on DSC encoding technology according to claim 6, wherein: the pixel value prediction module (4.2) predicts the pixel values of all groups of pixel points of the sub-images in a median prediction mode, and realizes independent median prediction of all groups of pixel points of the sub-images.
8. The apparatus for video playback based on DSC encoding technology according to claim 6, wherein: the pixel value prediction module (4.2) predicts pixel values of pixel points in each pixel group in the first row of the sub-image according to an improved median adaptive prediction initial value giving mode;
the pixel value prediction module (4.2) predicts the pixel values of the first group of pixel points of the rest rows of the sub-images by adopting an improved median adaptive prediction initial value giving mode;
the pixel value prediction module (4.2) determines the pixel value prediction forms of all groups of pixel points behind the first group of pixel points in the rest rows of the sub-image by the entropy coding calculation result after the reconstruction of the previous group of pixel points of the current group of pixel points, and realizes the partition combination prediction of all groups of pixel points of each sub-image, wherein the pixel value prediction forms of the second group of pixel points in the rest rows of the sub-image are determined by the entropy coding calculation result after the reconstruction of the first group of pixel points in the row.
9. The apparatus for video playback based on DSC encoding technology according to claim 6, wherein: each DSC coding submodule (4.1) also comprises an image boundary judgment module (4.7) and an index color historical record reconstruction module (4.8), wherein the image boundary judgment module (4.7) is used for judging and processing the image boundary of the sub-image, and then the image boundary judgment result of the sub-image is transmitted to the pixel value prediction module (4.2) and the code rate control module (2.5), so that the boundary condition of the current pixel is adapted when the pixel value prediction module (2.2) performs pixel prediction and the code rate control module (4.5) performs code rate control;
and the index color historical record reconstruction module (4.8) is used for reconstructing index color historical records of all groups of pixel points behind the first group of pixel points in the rest rows of the sub-images, comparing the reconstructed result of the index color historical records with the reconstructed result after the independent median value prediction of the corresponding pixel points and the reconstructed result after the partition combination prediction of all groups of pixel points of each sub-image, and selecting the reconstructed result which is closer to the corresponding pixel points for subsequent entropy coding processing.
10. A video playback method using the apparatus of claim 1, comprising the steps of:
step 1: an RGB-to-YCoCg conversion module (2) converts video image data of an RGB color space into video image data of a YCoCg reversible color space;
step 2: the image partitioning control module (3) divides each video image of the YCoCg reversible color space into a plurality of sub-images according to slices, and the sub-images form a sub-image group;
and step 3: each DSC encoding sub-module (4.1) of the DSC parallel encoding module (4) respectively performs DSC encoding processing on a selected sub-image in the sub-image group in the same DSC encoding processing time period to obtain DSC compressed image data of the corresponding sub-image, the DSC parallel encoding module (4) performs DSC encoding processing on all sub-images in the sub-image group through a plurality of DSC encoding processing time periods, wherein in the last DSC encoding processing time period of the DSC parallel encoding module (4), the DSC encoding sub-module (4.1) which is not allocated to the sub-image stops working;
the parallel coding synchronous control module (5) controls the DSC coding processing time period, and after all DSC coding sub-modules (4.1) finish the DSC coding processing of the respectively selected sub-images, the DSC parallel coding module (4) enters the processing process of the next DSC coding processing time period;
and 4, step 4: the image merging control module (9) recombines the DSC compressed image data of all the sub-images to form a complete DSC compressed video image for video playing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810758800.8A CN108881915B (en) | 2018-07-11 | 2018-07-11 | Device and method for playing video based on DSC (differential scanning sequence) coding technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810758800.8A CN108881915B (en) | 2018-07-11 | 2018-07-11 | Device and method for playing video based on DSC (differential scanning sequence) coding technology |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108881915A CN108881915A (en) | 2018-11-23 |
| CN108881915B true CN108881915B (en) | 2020-09-04 |
Family
ID=64301168
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810758800.8A Active CN108881915B (en) | 2018-07-11 | 2018-07-11 | Device and method for playing video based on DSC (differential scanning sequence) coding technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108881915B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109618157A (en) * | 2018-12-29 | 2019-04-12 | 东南大学 | A kind of system for implementing hardware and method of video display stream compressed encoding |
| WO2020191516A1 (en) * | 2019-03-22 | 2020-10-01 | 华为技术有限公司 | Image data processing apparatus and method |
| CN113727117B (en) * | 2021-11-01 | 2022-02-15 | 武汉精测电子集团股份有限公司 | DP-based compressed data stream transmission method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104704828A (en) * | 2012-10-03 | 2015-06-10 | 美国博通公司 | Bounded rate near-lossless and lossless image compression |
| CN106664406A (en) * | 2014-08-08 | 2017-05-10 | 高通股份有限公司 | System and method for determining buffer fullness for display stream compression |
| KR20170131805A (en) * | 2016-05-20 | 2017-11-30 | 삼성디스플레이 주식회사 | Image compression device and image decompression device |
| CN108141591A (en) * | 2015-10-21 | 2018-06-08 | 高通股份有限公司 | For non-4:4:The entropy coding technology of the display stream compression (DSC) of 4 coloration sub-samplings |
-
2018
- 2018-07-11 CN CN201810758800.8A patent/CN108881915B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104704828A (en) * | 2012-10-03 | 2015-06-10 | 美国博通公司 | Bounded rate near-lossless and lossless image compression |
| CN106664406A (en) * | 2014-08-08 | 2017-05-10 | 高通股份有限公司 | System and method for determining buffer fullness for display stream compression |
| CN108141591A (en) * | 2015-10-21 | 2018-06-08 | 高通股份有限公司 | For non-4:4:The entropy coding technology of the display stream compression (DSC) of 4 coloration sub-samplings |
| KR20170131805A (en) * | 2016-05-20 | 2017-11-30 | 삼성디스플레이 주식회사 | Image compression device and image decompression device |
Non-Patent Citations (2)
| Title |
|---|
| VESA DSC1.1 编码器IP核心;hardent;《https://www.hardent.com/pdf/Hardent_VESA_DSC_encoder_IP_v1_1.pdf https://www.hardent.com/pdf/Hardent_VESA_DSC_encoder_IP_v1_1_Test_Equipment.pdf》;20171231;第1-2页及附图 * |
| 视频显示流压缩的技术与标准;朱秀昌，唐贵进;《Journal of Data Acquisition and Processing》;20170531;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108881915A (en) | 2018-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7356478B2 (en) | Method and apparatus for encoding and decoding color pictures | |
| US11212539B2 (en) | Efficient lossless compression of captured raw image information systems and methods | |
| CN101142821B (en) | New compression format and apparatus using the new compression format for temporarily storing image data in a frame memory | |
| CN106937113B (en) | Image compression method and device based on mixed chroma sampling rate | |
| US20160350056A1 (en) | Low latency screen mirroring | |
| CN108881915B (en) | Device and method for playing video based on DSC (differential scanning sequence) coding technology | |
| RU2710873C2 (en) | Method and device for colour image decoding | |
| KR20180021869A (en) | Method and device for encoding and decoding HDR color pictures | |
| US20180302651A1 (en) | Midpoint prediction error diffusion for display stream compression | |
| CN105072353B (en) | A kind of image decoding based on more GPU spells prosecutor method | |
| US11445160B2 (en) | Image processing device and method for operating image processing device | |
| CN209982615U (en) | Apparatus for color space 4:4:4 transmission | |
| US10304213B2 (en) | Near lossless compression scheme and system for processing high dynamic range (HDR) images | |
| KR100834439B1 (en) | Compression and decompression device of graphic data and therefor method | |
| CN108965877A (en) | The device and method of video real-time display is realized based on DSC compression algorithm | |
| CN105472442A (en) | Out-chip buffer compression system for superhigh-definition frame rate up-conversion | |
| US20210250575A1 (en) | Image processing device | |
| CN101406034B (en) | Compression scheme using qualifier watermarking and apparatus using the compression scheme for temporarily storing image data in a frame memory | |
| US11715239B2 (en) | Systems and methods for scalable throughput entropy coders | |
| KR20200065367A (en) | Image processing device and frame buffer compressor | |
| CN106954074B (en) | Video data processing method and device | |
| CN114339263A (en) | Lossless processing method for video data | |
| KR102523959B1 (en) | Image processing device and method for operating image processing device | |
| US20110242112A1 (en) | Display device and driving circuit thereof | |
| CN106954073B (en) | Video data input and output method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |