WO2021007742A1

WO2021007742A1 - Compression method for obtaining video file, decompression method, system, and storage medium

Info

Publication number: WO2021007742A1
Application number: PCT/CN2019/095965
Authority: WO
Inventors: 周新生; 李翔; 阮俊瑾; 张灵; 潘永靖
Original assignee: 上海极清慧视科技有限公司
Priority date: 2019-07-15
Filing date: 2019-07-15
Publication date: 2021-01-21
Also published as: CN111406404B; CN111406404A

Abstract

The present application relates to the technical field of image processing, and particularly provides a compression method for obtaining a video file, a decompression method, a system, and a storage medium. The compression method comprises: obtaining, in a temporal order, multiple pieces of image data to be compressed; separately mapping a color value of each pixel in each piece of image data to each pixel position in multiple image blocks on the basis of a color attribute of each pixel in the image data; and compressing image blocks corresponding to each piece of image data in the multiple pieces of image data and having the same color attribute to obtain a video file. The solution provided in the present application can effectively reduce the data rate while ensuring high-fidelity image quality. Because the compression method in the present application can effectively reduce the data volume, a 8K video can be encoded by means of a 4K encoder in the prior art. At present, an uplink stable peak value of 5G is 90 Mbps, so that the 8K video can be transmitted in real time by 5G and high-fidelity image quality can be achieved.

Description

Compression method, decompression method, system and storage medium for obtaining video files

Technical field

This application relates to the field of image processing technology, and in particular to a compression method, decompression method, system and storage medium for obtaining video files.

Background technique

As people's playback quality of multimedia playback data becomes higher and higher, the amount of multimedia playback data is also increasing. For multimedia playback data with a large amount of data, after compressing and encoding it in a traditional way, the amount of data still cannot be controlled within a range that can be stably transmitted. In order to enable the stable transmission of multimedia playback data, usually the multimedia playback data can only be further compressed, but this method will cause serious loss of color information and cannot meet the demand for high image quality. Therefore, people expect a better compression method to achieve high-fidelity effects for multimedia playback data with a large amount of data while ensuring transmission stability.

Summary of the invention

In view of the above-mentioned shortcomings of the prior art, the purpose of this application is to provide a compression method, decompression method, system and storage medium for obtaining video files to solve the problem of difficulty in transmitting ultra-high-definition video data in the prior art.

In order to achieve the above and other related purposes, the first aspect of this application provides a compression method for obtaining a video file, which includes the following steps: obtaining a plurality of image data to be compressed in a chronological order; the image data is used to display UHD4K Video images of and above pixels; based on the color attribute of each pixel in the image data, the color value of each pixel in each image data is mapped to each pixel position in multiple image blocks; Each image block corresponding to the image data and having the same color attribute is compressed to obtain a video file.

In some embodiments of the first aspect of the present application, in the case where each pixel in the image data represents a single color attribute, the color attribute of each pixel in the image data is The step of mapping the color value of the pixel to each pixel position in the plurality of image blocks includes: traversing the image data according to the color format set based on the Bayer format in the image data; wherein, during the traversal, based on the According to the color attribute of each pixel in the color format, the color value of each pixel is extracted from the image data and mapped to the pixel position in the corresponding image block.

In some implementations of the first aspect of the present application, when each pixel in the image data represents an RGB color attribute; in the image data, each pixel in each image data is The step of mapping the color value of the pixel to each pixel position in a plurality of image blocks includes: traversing the image data according to a color format set based on the pixel row format in the image data; wherein, during the traversal, based on For the color attribute of each pixel in the color format, the color principal component or color fitting component of each pixel is extracted from the image data, and mapped to the pixel position in the corresponding image block.

In some implementation manners of the first aspect of the present application, the step of compressing image blocks corresponding to each of the multiple image data and having the same color attribute includes: according to the color format The multiple image blocks corresponding to multiple image data are sequentially input to a first encoder for compression processing.

In some implementations of the first aspect of the present application, the step of compressing image blocks corresponding to each of the multiple image data and having the same color attribute includes: under synchronous control, using The multiple second encoders respectively perform compression processing on multiple image blocks with the same color attribute.

In some implementations of the first aspect of the present application, the video file obtained by the compression processing using multiple second encoders includes synchronization information set for decompressing the video file to restore multiple image data.

The second aspect of the present application also provides a method for decompressing a video file, including: obtaining a video file; decompressing the video file according to the compression method used for the video file to obtain multiple image blocks Wherein, according to the color attribute of each image block, the obtained multiple image blocks correspond to each of the multiple image data to be generated; according to the color attribute, each of the corresponding image blocks The color value of the pixel position is mapped to the pixel of the image data; based on the color value of each pixel in the image data, a video image for displaying UHD 4K and above pixels is generated.

In some implementation manners of the second aspect of the present application, the step of decompressing the video file according to a compression mode to obtain multiple image blocks includes: using multiple second decoders under synchronous control The video file is decompressed according to the color attributes respectively; wherein, each second decoder outputs a plurality of image blocks with the same color attribute; wherein, each image block corresponds to a piece of image data to be generated.

In some implementations of the second aspect of the present application, each second decoder determines the correspondence between a plurality of image blocks to be decompressed and a piece of image data to be generated according to the synchronization information in the video file relationship.

In some implementation manners of the second aspect of the present application, the step of decompressing the video file in a compression mode to obtain a plurality of image blocks includes: using a first decoder to perform processing on the received video file The decompression process obtains multiple groups of image blocks divided according to different color attributes in the color format; wherein, each image block in each group of image blocks corresponds to a piece of image data to be generated.

In some implementation manners of the second aspect of the present application, the step of mapping the color value of each pixel position in the corresponding image block to the pixel of the image data according to the color attribute includes: according to the color format, Traverse the pixel position in the image block of each color attribute, and during the traversal, map the color value of the corresponding pixel position in each image block to the pixel position in the corresponding image data to generate image data; wherein, the image data The color value of each pixel position in represents a single color attribute.

In some implementation manners of the second aspect of the present application, the step of generating a video image for displaying UHD 4K and above pixels based on the color value of each pixel obtained by mapping in the image data further includes: In the color format, each pixel position in the obtained image data is interpolated to obtain a video image containing RGB color attributes in each pixel.

The third aspect of the present application also provides a compression device, including: a communication interface for communicating with an external decompression device; a memory for storing at least one program and image data to be compressed; a processor for coordination The communication interface and the memory are used to execute the program, and during execution, the image data is compressed according to the compression method for obtaining a video file described in the first aspect of the present application to obtain a video file.

The fourth aspect of the present application also provides a decompression device, including: a communication interface for communicating with an external compression device; a memory for storing at least one program and a video file to be decompressed; and a processor for The communication interface and the memory are coordinated to execute the program, and during execution, the video file is decompressed according to the video file decompression method as described in the second aspect of the present application, so as to play the video file.

The fifth aspect of the present application also provides a video transmission system, including: the compression device as described in the third aspect of the application; and the decompression device as described in the fourth aspect of the application.

The sixth aspect of the present application also provides a computer-readable storage medium, including: storing at least one program; when called, the at least one program executes the video file acquisition program described in any one of the first aspects of the present application Compression method; or, when the at least one program is called, the method for decompressing a video file as described in the second aspect of the present application is executed.

As mentioned above, the compression method, decompression method, system and storage medium for obtaining video files of this application have the following beneficial effects: The compression method, decompression method, system and storage medium for obtaining video files provided by this application can be effective Reduce the code stream while ensuring high-fidelity picture quality. In this application, the amount of data added by multiple image blocks is much lower than the amount of data after compression processing is performed using traditional methods. Among them, compared with the YUV222 format, it has only half the data volume; compared with the YUV444 format, it has only 1/3 of the data volume, but the amount of information carried by the compression method of this application is equivalent to that of the YUV444 format . Taking 8K video as an example, the image block of each color attribute is equivalent to 4K video YUV400 format with only brightness information, and compared with YUV422 format, the data volume is only half. Since the compression method in this application can effectively reduce the amount of data, 8k video can be encoded by a 4K encoder in the prior art. In the same way, with the compression method of the present application, 4K video can also be encoded by a 2K video encoder, or 16k video can be processed by an 8K video encoder. Moreover, with the compression method of the present application, RGB video images or Bayer format images can be directly used for compression without conversion to YUV format. In addition, the bit stream rate generated by the compression method of this application can be controlled at about half of YUV422, that is, 24 to 80 Mbps. The current stable uplink peak of 5G is 90 Mbps, so 5G real-time transmission of 8K video can be realized, and it has High fidelity picture quality.

Description of the drawings

FIG. 1 shows a flowchart of an embodiment of the compression method in this application;

FIG. 2 shows a schematic diagram of image data in an embodiment of this application;

FIG. 3 shows a schematic diagram of an embodiment of a mapping method for mapping the color value of each pixel in each image data to each pixel position in multiple image blocks in this application;

FIG. 4 shows a schematic diagram of an embodiment in which each pixel in the image data in this application represents RGB color attributes;

FIG. 5 shows a schematic diagram of another embodiment of the mapping method of mapping the color value of each pixel in each image data to each pixel position in multiple image blocks in this application;

FIG. 6 shows a schematic diagram of an embodiment of using a first encoder to perform compression processing in this application;

FIG. 7 shows a schematic diagram of another embodiment of using a first encoder to perform compression processing in this application;

FIG. 8 shows a schematic diagram of another embodiment in which each pixel in the image data in this application represents RGB color attributes;

FIG. 9 shows a schematic diagram of another embodiment when the compression device in this application does not know the principal component in each pixel in advance;

Figure 10 shows an implementation of a mapping method for mapping the color value of each pixel in each image data to each pixel position in multiple image blocks when the compression device in this application does not know the principal component in each pixel in advance Example diagram;

FIG. 11 shows a schematic diagram of another embodiment when the compression device in this application does not know the principal component in each pixel in advance;

Figure 12 shows another mapping method for mapping the color value of each pixel in each image data to each pixel position in multiple image blocks when the compression device in this application does not know the principal component in each pixel in advance. Schematic diagram of the embodiment;

FIG. 13 shows a schematic diagram of another embodiment when the compression device in this application does not know the principal component in each pixel in advance;

Figure 14 shows another mapping method for mapping the color value of each pixel in each image data to each pixel position in multiple image blocks when the compression device in this application does not know the principal component in each pixel in advance Schematic diagram of the embodiment.

FIG. 15 shows a flowchart of the decompression method in an embodiment;

FIG. 16 shows a schematic diagram of an embodiment of using a first decoder to perform decompression processing in this application;

FIG. 17 is a schematic diagram of another embodiment of using a first decoder to perform decompression processing in this application;

FIG. 18 shows a schematic diagram of an embodiment in which the decompression device in this application maps the color value of each pixel position in the corresponding image block to the pixel of the image data;

Figure 19 shows a schematic diagram of an embodiment of the compression device in this application;

FIG. 20 shows a schematic diagram of an embodiment of the decompression device in this application;

FIG. 21 shows a schematic structural diagram of the video transmission system in this application in an embodiment.

Detailed ways

The following specific examples illustrate the implementation of the present application. Those familiar with the technology can easily understand the other advantages and effects of the present application from the content disclosed in this specification.

Although the terms first, second, etc. are used herein to describe various elements in some instances, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, the first decoder may be referred to as the second decoder, and similarly, the second decoder may be referred to as the first decoder without departing from the scope of the various described embodiments. Both the first decoder and the decoder are describing a threshold, but unless the context clearly indicates otherwise, they are not the same decoder.

Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to also include the plural forms, unless the context dictates to the contrary. It should be further understood that the terms "comprising" and "including" indicate the existence of the described features, steps, operations, elements, components, items, types, and/or groups, but do not exclude one or more other features, steps, operations, The existence, appearance or addition of elements, components, items, categories, and/or groups. The terms "or" and "and/or" used herein are interpreted as inclusive, or mean any one or any combination. Therefore, "A, B or C" or "A, B and/or C" means "any of the following: A; B; C; A and B; A and C; B and C; A, B and C" . An exception to this definition will only occur when the combination of elements, functions, steps or operations is inherently mutually exclusive in some way.

With the continuous improvement of users' requirements for the playback quality of multimedia playback data, for example, in scenarios such as program live broadcasts, video conferences, or security monitoring, technicians need to transmit multimedia playback data with better stability and higher fidelity. However, as people's playback quality of multimedia playback data becomes higher and higher, the amount of multimedia playback data is also increasing. For multimedia playback data with a large amount of data, the code stream after compression and encoding using traditional methods is also relatively large, and it is usually necessary to convert RGB images into YUV format and then perform compression encoding. Taking 30 frames of 8K as an example, if the YUV444 format is used as an example, the data volume will reach 7680×4320×24bit×30fps≈3GByte/s. If the YUV422 format is used, although the color components are lost by half, the data volume still reaches 2Gbyte/ s. Under this kind of data volume, if the existing technology is used for compression encoding, the code stream is 48-160Mbps. Even if the latest 5G technology is adopted, the average value of the uplink speed of 5GCPE is 80-90Mbps, which still cannot meet the requirements of stable transmission. Requirements. On the other hand, in some embodiments, most of the compression of multimedia playback data adopts the YUV422 or YUV420 format, and the color information is seriously lost, which cannot meet the demand for high image quality. People expect to have a better compression method that can achieve high-fidelity effects for multimedia playback data with a large amount of data, even at low bit rates.

For this reason, this application provides a compression method for obtaining video files to solve the above-mentioned problems and make the playback of high-definition videos smoother and with higher fidelity. The compression method is mainly implemented by an image compression device, where the compression device may be a terminal device or a server. Here, the terminal equipment includes, but is not limited to, camera equipment, personal electronic terminal equipment, and the like.

It should be understood that the camera equipment includes a camera device, a storage device, a processing device, and may also include an interface device. The camera device is used to acquire image data, wherein the image data is composed of multiple image data set based on colors. The imaging device includes at least a lens composed of a lens group, a light sensing device, etc., where the light sensing device includes, for example, a CCD device, a CMOS device, and the like. The storage device may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The storage device also includes a memory controller, which can control access to the memory by other components of the device, such as a CPU and a peripheral interface. The storage device is used to store at least one program and image data to be encoded. The program stored in the storage device includes an operating system, a communication module (or instruction set), a graphics module (or instruction set), a text input module (or instruction set), and an application (or instruction set). The program in the storage device also includes an instruction set for performing an encoding operation on the image data in time sequence based on the technical solution provided by the compression method. The processing device includes, but is not limited to: CPU, GPU, FPGA (Field-Programmable Gate Array), ISP (Image Signal Processing image processing chip), or other including at least data stored in a storage device dedicated to processing A program processing chip (such as AI dedicated chip), etc. The processing device calls and executes at least one program stored in the storage device to perform compression processing on the stored image data according to the compression method. The interface device includes, but is not limited to: a data line interface and a network interface; among them, examples of the data line interface include at least one of the following: serial interfaces such as USB, and parallel interfaces such as bus interfaces. Examples of network interfaces include at least one of the following: short-range wireless network interfaces such as Bluetooth-based network interfaces and WiFi network interfaces, such as wireless network interfaces of mobile networks based on 3G, 4G, or 5G protocols, such as wired network interfaces that include network cards Wait. In some scenarios, the camera device is set on a pan-tilt above the road to monitor vehicle violations, such as speeding, red light running, etc. In other scenarios, the camera device is configured on a minimally invasive medical device, and the camera device is set at the front end of the hose through an optical fiber or other dedicated data cable. In other scenes, the camera device is configured on a high-speed moving track of a stadium to capture high-definition pictures of competitive games.

It should be understood that the electronic terminal equipment for personal use includes desktop computers, notebook computers, tablet computers, and editing equipment dedicated to the production of TV programs, movies, TV series, and the like. The electronic terminal equipment includes a storage device and a processing device. Wherein, the storage device and the processing device may be the same or similar to the corresponding devices in the aforementioned camera equipment, and will not be described in detail here. The electronic terminal equipment may also include a camera device for capturing image data. Here, in some examples, the hardware and software modules of the camera device may be the same as or similar to the corresponding device in the aforementioned camera device, and will not be repeated here. In still other examples, the electronic terminal device may further include an image acquisition interface for acquiring image data. The image acquisition interface may be a network interface, a data line interface, or a program interface. Wherein, the network interface and the data line interface can be the same or similar to the corresponding devices in the aforementioned camera equipment, and will not be described in detail here. For example, through the network interface, the processing device of the electronic terminal equipment downloads image data from the Internet. For another example, through the program interface, the processing device of the electronic terminal device obtains the image data displayed by the drawing software on the display screen. Wherein, the drawing software is PS software, or screenshot software, for example. For another example, through the data line interface, the processing device of the electronic terminal device obtains one frame of image data in the unedited high-definition video from the storage device.

The server includes but is not limited to a single server, a server cluster, a distributed server, a server based on cloud technology, and the like. Wherein, the server includes a storage device, a processing device, an image acquisition interface, and the like. The storage device and the processing device may be configured in the same physical server device, or be configured in multiple physical server devices according to the division of labor of each physical server device. The image acquisition interface may be a network interface or a data line interface. The storage device, processing device, image acquisition interface, etc. included in the server may be the same as the corresponding devices mentioned in the aforementioned terminal equipment; or specifically set for the server based on the server's throughput, processing capacity, and storage requirements The corresponding devices. For example, the storage device may also include a solid state drive or the like. For example, the processing device may also include a CPU dedicated to a server or the like. The image acquisition interface in the server acquires image data and encoding instructions from the Internet, and the processing device executes the compression method described in this application on the acquired image data based on the encoding instructions.

The video file can be stored in a storage medium, and the video file can also be transmitted to a compression device using a communication transmission mode of 60 Mbps and above. Wherein, the transmission method includes, but is not limited to: a wireless transmission method based on the 5G communication protocol, or optical fiber transmission.

Based on the requirements for compressing and encoding image data generated in any of the above scenarios, the present application provides a compression method for obtaining video files. Please refer to FIG. 1, which is shown as a flowchart of the compression method in an embodiment.

In step S110, multiple pieces of image data to be compressed are acquired in chronological order; the image data is used to display UHD 4K and above pixel video images.

The image data includes, but is not limited to: ultra-high-definition images (such as 4K images or 8K images), and images that have been compressed and decompressed. For example, the image data is a high-definition image from an original video captured by a high-definition camera. In another example, the image data is a high-definition image transmitted through a dedicated data channel. For another example, the image data is an image that comes from the Internet and needs to be re-encoded. Wherein, the format of the image data can be Bayer format, or RGB image generated after Debayer, or format such as YUV. For example, the image data is in Bayer format directly generated by the sensor of a high-definition camera. For another example, the Bayer format generated by the sensor of a high-definition camera undergoes Debayer, that is, the other two color components are fitted to the color components of each pixel in the Bayer format to generate an RGB image, and the RGB image is used as the image to be processed data.

It should be understood that Debayer is mosaic processing, a digital image processing algorithm, whose purpose is to reconstruct a full-color image from the incomplete color samples output by the photosensitive element covered with a color filter array (CFA). . This method is also called color filter array interpolation (CFA interpolation) or color reconstruction (Color reconstruction).

It should be understood that a video file is composed of several frames of image data. Therefore, the compression device acquires several frames of image data to be processed in chronological order, so as to sequentially process several frames of image data in chronological order.

It should be understood that UHD is Ultra High Definition, that is, Ultra High Definition. UHD 4k and above refers to video images with a resolution of 4K pixels and above, such as 8k pixels, 16k pixels, etc. For ease of understanding, this embodiment takes 8K pixels as an example for description, but the principle of the solution can also be used to compress 4k pixels, 16k pixels or even higher-definition video images.

Here, the image data used to display a video image of UHD 4K and above pixels may be the aforementioned Bayer format image data or the RGB format image data. Among them, the image data in the RGB format includes image data in the RGB format itself and image data in other formats (such as YUV format, etc.) that can be converted into the RGB format.

Please continue to refer to FIG. 1. In step S120, the compression device maps the color value of each pixel in each image data to each pixel position in multiple image blocks based on the color attribute of each pixel in the image data. .

It should be understood that the pixel is the basic unit of image display. Each pixel has different color attributes according to the format of the image data in which it is located. For example, for image data in Bayer format, the color attribute of the pixel is a single color component; for image data in RGB format, the color attribute of the pixel includes three colors of red (R), green (G), and blue (B) Weight. Since human eyes are more sensitive to green than other colors, usually the number of G components is twice the number of other color components. Therefore, in some embodiments, the G component is represented by a Gr component or a Gb component. Among them, each pixel has a color value corresponding to its color attribute. For example, when the image data is in Bayer format, please refer to FIG. 2, which shows a schematic diagram of image data in an embodiment of this application. As shown in the figure, each square represents a pixel, and each pixel There is only a single color component of R or G or B, where the G component is represented by the Gr component and the Gb component. The color value of each pixel in the image data is the brightness value of the single color component, that is, the color value of each pixel; When the image data is in the RGB format, the color value of each pixel in the image data includes the brightness value of each color component in the pixel.

For ease of understanding, a single image data is used as an example. It should be understood that the method for processing multiple image data is to process multiple image data separately according to the processing method for single image data, and provide the processed results to step S130 respectively.

In this embodiment, the compression device divides the image data into a plurality of image blocks based on color attributes, in order to ensure the correlation between each pixel in the image data and each pixel in the image block, so that it can be decoded. To restore the image data, the compression device maps the color value of each pixel in each image data to each pixel position in a plurality of image blocks.

In an exemplary embodiment, in the case that each pixel in the image data represents a single color attribute, the step S120 includes: traversing according to the color format set based on the Bayer format in the image data The image data; wherein, during the traversal, based on the color attribute of each pixel in the color format, the color value of each pixel is extracted from the image data and mapped to the pixel position in the corresponding image block.

Please continue to refer to FIG. 2. Each pixel in the image data represents a single color attribute. In this embodiment, 4 (2×2) pixels are determined as the color format 101, because when Bayer data is scanned, the odd lines usually output G, R, G, R..., and the even lines output B, G, B, G..., so there are 4 pixel data with different color attributes in one color format 101. Using the relative positions of the pixel data of different color attributes in the pixel unit as the pixel row format, the image data is traversed to extract each pixel data and form multiple image blocks.

In some embodiments, please refer to FIG. 3, which shows a schematic diagram of an embodiment of a mapping method for mapping the color value of each pixel in each image data to each pixel position in a plurality of image blocks in this application. As shown in the figure, in this embodiment, the odd-numbered rows in the image data are Gr, R, Gr, R..., and the even-numbered rows are B, Gb, B, Gb..., here, the odd-numbered rows of Gr, R, B and Gb of even rows are determined as a color format 101. For ease of understanding, the coordinates of all pixels in the color format 101 where the pixels in the first row and first column are defined are the origin (0, 0), that is, the color format 101 includes Gr(0,0), R(0 , 0), B (0, 0) and Gb (0, 0). As shown in FIG. 3, using the color format 101 as a reference, the coordinate of each pixel in the color format shifted by 1 unit to the right in the horizontal direction of the color format 101 is determined as (0, 1), and Each pixel coordinate in the color format that is offset by 2 units to the right in the horizontal direction of the color format 101 is determined to be (0, 2), which will be offset by 3 units to the right in the horizontal direction of the color format 101 The coordinates of each pixel in the color format of the unit are determined to be (0, 3)...; in the same way, based on the color format 101, the vertical direction of the color format 101 will be offset downward by 1 unit The coordinate of each pixel in the color format is determined as (1, 0), and the coordinate of each pixel in the color format that is offset down by 2 units in the vertical direction of the color format 101 is determined as (2, 0), and The coordinates of each pixel in the color format that is offset 3 units downward in the vertical direction of the color format 101 are determined to be (3, 0).... By traversing the entire image data according to this rule, each pixel in the image data has its position information, so that the position information can be used to restore the image data during decoding.

After determining the position information of each pixel, the compression device extracts the color value of each pixel from the image data based on the color attribute of each pixel. Here, the compression device divides all pixel data in the image data into multiple image blocks based on color attributes, and each image block contains only one color attribute. Please continue to refer to FIG. 3, since the color attributes in this embodiment include R, Gr, Gb, and B, these four attributes, so in this embodiment, all the pixel data in the image data is divided into R, Gr, Gb, and B. Four image blocks of Gr, Gb, and B. For example, Gr(0,0) is divided into image blocks with Gr color attribute, and Gr(0,1) is divided into image blocks with Gr color attribute and is offset to the right in the horizontal direction of Gr(0,0) Shifted by 1 unit, Gr(0,2) is divided into the image block of the Gr color attribute and shifted by 2 units to the right in the horizontal direction of Gr(0,0), Gr(0,3) is divided into In the image block of the Gr color attribute and offset 3 units to the right in the horizontal direction of Gr(0,0); Gr(1,0) is divided into the image block of the Gr color attribute and is in Gr(0,0) ) Is shifted downward by 1 unit in the vertical direction, Gr(2,0) is divided into the image block of the Gr color attribute and shifted downward by 2 units in the vertical direction of Gr(0,0), Gr (3, 0) is divided into the image block of the Gr color attribute and is shifted downward by 3 units in the vertical direction of Gr(0, 0)... The same is true for each pixel of the R, Gb, and B color attributes One is divided into each image block accordingly, and each pixel position in each image block has a corresponding relationship with its pixel position in the image data, which will not be repeated here.

In another exemplary embodiment, please refer to FIG. 4, which shows a schematic diagram of an embodiment in which each pixel in the image data in this application represents RGB color attributes. As shown in the figure, the image data acquired by the compression device is an RGB image. For example, the image data is passed through Debayer based on the Bayer format, that is, the other two are fitted to the color components of each pixel shown in Figure 2. These color components generate RGB images. Here, in the case that each pixel in the image data represents an RGB color attribute, the step S120 includes: traversing the image data according to a color format set based on the pixel row format in the image data; Wherein, during the traversal, based on the color attribute of each pixel in the color format, the color principal component or color fitting component of each pixel is extracted from the image data, and mapped to the pixel position in the corresponding image block.

It should be understood that since the data output by the sensor of the image capturing device is usually in Bayer format, each pixel has only a single component. The encoder cannot directly encode the Bayer format, and the display device cannot directly display images in the Bayer format. Therefore, it is usually necessary to debayer the Bayer format to form an RGB format. However, the amount of data processed by Debayer is very large, which is three times that of the Bayer format, which causes the code stream to be too large and affects the transmission efficiency. Therefore, in some embodiments, the RGB format is also converted to the YUV format, that is, into the luminance and chrominance format, and then the chrominance is reduced, thereby reducing the amount of data. Among them, YUV422 will reduce the data volume by 1/3, and YUV420 will reduce the data volume by 1/2, but the data volume is still 2 times and 1.5 times that of Bayer format respectively. At the same time, the method of converting the format to YUV422 or YUV420 will also cause serious color information loss, which cannot meet the demand for high image quality.

Please continue to refer to FIG. 4, in this embodiment, each pixel in the image data has three color components, where the bolded part in each pixel represents the principal component in the pixel, and each pixel The non-black bolded part in represents the other two components fitted based on the principal components in the pixel. Four (2×2) pixels are determined as a color format 101. Since each pixel in a color format 101 has three color components, in order to save and reduce the code stream after compression, only in each Extract a color component from the pixel.

In some embodiments, the compression device knows the principal component in each pixel in advance, and directly determines the principal component in each pixel as the color component to be extracted. In some other embodiments, the compression device cannot know the principal component in each pixel in advance, and may determine a certain component in each pixel as the color component to be extracted according to a preset rule. Here, the preset rules are exemplified but not limited to: extracting G and R according to odd rows and extracting B and G rules for even rows; or extracting G and B according to odd rows and extracting R and G rules for even rows; Or extract R and G according to odd lines, and extract G and B from even lines; or extract B and G according to odd lines and extract G and R from even lines. Wherein, when the G component is expressed as the Gr component and the Gb component, the preset rule may also be exemplified but not limited to: extracting Gr and R according to odd lines, and extracting B and Gb according to even lines; or extracting according to odd lines Gb, B, rules for extracting R and Gr from even rows; or rules for extracting R and Gr from odd rows and Gb and B from even rows; or rules for extracting B and Gb from odd rows and Gr and R from even rows. It should be understood that due to the limited recognition of images by human eyes, any of the above-mentioned extraction methods has a negligible impact on the final imaging effect.

Please continue to refer to FIG. 4. In this embodiment, the compression device knows the principal component in each pixel in advance. Here, the compression device determines the principal component in each pixel as the color component to be extracted, and the color format 101 is determined as odd lines Gr, R, and even lines B, Gb.

Please refer to FIG. 5, which shows a schematic diagram of another embodiment of the mapping method for mapping the color value of each pixel in each image data to each pixel position in multiple image blocks in this application. As shown in the figure, for ease of understanding, the coordinates of all pixels in the color format 101 where the pixels in the first row and first column of the image data are defined are the origin (0, 0), that is, the color format 101 includes R Gr B (0, 0), R G B (0, 0), R G B (0, 0), and R Gb B (0, 0). As shown in FIG. 5, using the color format 101 as a reference, the coordinates of each pixel in the color format shifted by 1 unit to the right in the horizontal direction of the color format 101 are determined as (0, 1), and Each pixel coordinate in the color format that is offset by 2 units to the right in the horizontal direction of the color format 101 is determined to be (0, 2), which will be offset by 3 units to the right in the horizontal direction of the color format 101 The coordinates of each pixel in the color format of the unit are determined as (0, 3)...; in the same way, based on the color format 101, the vertical direction of the color format 101 will be offset downward by 1 unit The coordinate of each pixel in the color format is determined as (1, 0), and the coordinate of each pixel in the color format that is offset down by 2 units in the vertical direction of the color format 101 is determined as (2, 0), and The coordinates of each pixel in the color format that is offset 3 units downward in the vertical direction of the color format 101 are determined to be (3, 0).... By traversing the entire image data according to this rule, each pixel in the image data has its position information, so that the position information can be used to restore the image data during decoding.

After determining the position information of each pixel, the compression device extracts the color value of each pixel from the image data based on the color attribute of each pixel. Since the compression device knows the principal components in each pixel in advance, the compression device only needs to extract the principal components in each pixel. Here, the compression device divides all the principal components in the image data into multiple image blocks based on color attributes, and each image block contains only one color attribute. Please continue to refer to FIG. 5. Since the color attributes in this embodiment include R, Gr, Gb, and B, these four attributes, so in this embodiment, all pixel data in the image data is divided into R, Gr, Gb, and B. Four image blocks of Gr, Gb, and B. For example, Gr(0,0) is divided into image blocks with Gr color attribute, and Gr(0,1) is divided into image blocks with Gr color attribute and is offset to the right in the horizontal direction of Gr(0,0) Shifted by 1 unit, Gr(0,2) is divided into the image block of the Gr color attribute and shifted by 2 units to the right in the horizontal direction of Gr(0,0), Gr(0,3) is divided into Gr color attribute image block and offset 3 units to the right in the horizontal direction of Gr(0,0); Gr(1,0) is divided into Gr color attribute image block and in Gr(0,0) ) Is shifted downward by 1 unit in the vertical direction, Gr(2,0) is divided into the image block of the Gr color attribute and shifted downward by 2 units in the vertical direction of Gr(0,0), Gr (3,0) is divided into the image block of the Gr color attribute and is offset 3 units downward in the vertical direction of Gr(0,0)...Similarly, each pixel of the R, Gb, B color attributes is also the same One is divided into each image block accordingly, and each pixel position in each image block has a corresponding relationship with its pixel position in the image data, which will not be repeated here.

In other embodiments, the compression device does not know the principal component in each pixel in advance. Here, according to the rules of extracting Gr and R according to odd lines, and extracting B and Gb according to even lines; extracting Gb and B according to odd lines and extracting R and Gr according to even lines; extracting R and Gr according to odd lines and extracting even lines The rules of Gb and B; the rules for extracting B and Gb from odd rows and Gr and R from even rows are illustrated as examples.

Please refer to FIG. 8, which shows a schematic diagram of another embodiment in which each pixel in the image data in this application represents RGB color attributes. In this embodiment, the compression device does not know the principal component in each pixel in advance. Here, the rules of extracting Gr and R in odd rows and extracting B and Gb in even rows determine the color components to be extracted, and then the color format is determined as odd rows Gr and R, and even rows B and Gb. Since the color format is the odd-numbered lines Gr and R, and the even-numbered lines B and Gb are the same as the compression method of the embodiment shown in FIG. 5, the description will not be repeated.

Please refer to FIG. 9, which shows a schematic diagram of another embodiment when the compression device in this application does not know the principal component in each pixel in advance. In this embodiment, the color components to be extracted are determined according to the rules of extracting Gb and B for odd rows and R and Gr for even rows, then the color format 101 is determined as odd rows Gb and B, and even rows R and Gr.

Please refer to FIG. 10, which shows the mapping of the color value of each pixel in each image data to each pixel position in multiple image blocks when the compression device in this application does not know the principal component in each pixel in advance Schematic diagram of an embodiment of the method. As shown in the figure, for ease of understanding, the coordinates of all pixels in the color format 101 where the pixels in the first row and first column of the image data are defined are the origin (0, 0), that is, the color format 101 includes R Gb B (0, 0), R G B (0, 0), R G B (0, 0), and R Gr B (0, 0). As shown in FIG. 10, using the color format 101 as a reference, the coordinates of each pixel in the color format shifted by 1 unit to the right in the horizontal direction of the color format 101 are determined as (0, 1), and Each pixel coordinate in the color format that is offset by 2 units to the right in the horizontal direction of the color format 101 is determined to be (0, 2), which will be offset by 3 units to the right in the horizontal direction of the color format 101 The coordinates of each pixel in the color format of the unit are determined to be (0, 3)...; in the same way, based on the color format 101, the vertical direction of the color format 101 will be offset downward by 1 unit The coordinate of each pixel in the color format is determined as (1, 0), and the coordinate of each pixel in the color format that is offset down by 2 units in the vertical direction of the color format 101 is determined as (2, 0), and The coordinates of each pixel in the color format that is offset 3 units downward in the vertical direction of the color format 101 are determined to be (3, 0).... By traversing the entire image data according to this rule, each pixel in the image data has its position information, so that the position information can be used to restore the image data during decoding.

After determining the position information of each pixel, the compression device extracts the color value of each pixel from the image data based on the color attribute of each pixel and divides it into multiple image blocks, and each image block contains only one type Color attributes. Please continue to refer to FIG. 10, since the color attributes in this embodiment include R, Gr, Gb, and B, four attributes, so in this embodiment, all pixel data in the image data is divided into R, Gr, Gb, and B based on the color attributes. Four image blocks of Gr, Gb, and B. For example, Gb(0,0) is assigned to the image block of the Gb color attribute, and Gb(0,1) is assigned to the image block of the Gb color attribute and is offset to the right in the horizontal direction of Gb(0,0) Shifted by 1 unit, Gb(0,2) is divided into the image block of Gb color attribute and shifted by 2 units to the right in the horizontal direction of Gb(0,0), Gb(0,3) is divided into Gb color attribute image block and offset 3 units to the right in the horizontal direction of Gb(0,0); Gb(1,0) is divided into Gb color attribute image block and is in Gb(0,0) ) Is shifted downward by 1 unit in the vertical direction, Gb(2,0) is divided into the image blocks of the Gb color attribute and shifted downward by 2 units in the vertical direction of Gb(0,0), Gb (3, 0) is divided into the image block of the Gb color attribute and is shifted downward by 3 units in the vertical direction of Gb (0, 0)...Similarly, each pixel of the B, R, and Gr color attributes is also the same One is divided into each image block accordingly, and each pixel position in each image block has a corresponding relationship with its pixel position in the image data, which will not be repeated here.

Please refer to FIG. 11, which shows a schematic diagram of another embodiment when the compression device in this application does not know the principal component in each pixel in advance. In this embodiment, the color components to be extracted are determined according to the rules of extracting R and Gr for odd rows and Gb and B for even rows, then the color format 101 is determined as odd rows R and Gr, and even rows Gb and B.

Please refer to FIG. 12, which shows a mapping that maps the color value of each pixel in each image data to each pixel position in multiple image blocks when the compression device in this application does not know the principal component in each pixel in advance Schematic diagram of another embodiment of the method. As shown in the figure, for ease of understanding, the coordinates of all pixels in the color format 101 where the pixels in the first row and first column of the image data are defined are the origin (0, 0), that is, the color format 101 includes R G B (0, 0), R Gr B (0, 0), R Gb B (0, 0), and R G B (0, 0). As shown in FIG. 10, using the color format 101 as a reference, the coordinates of each pixel in the color format shifted by 1 unit to the right in the horizontal direction of the color format 101 are determined as (0, 1), and Each pixel coordinate in the color format that is offset by 2 units to the right in the horizontal direction of the color format 101 is determined to be (0, 2), which will be offset by 3 units to the right in the horizontal direction of the color format 101 The coordinates of each pixel in the color format of the unit are determined as (0, 3)...; in the same way, based on the color format 101, the vertical direction of the color format 101 will be offset downward by 1 unit The coordinate of each pixel in the color format is determined as (1, 0), and the coordinate of each pixel in the color format that is offset down by 2 units in the vertical direction of the color format 101 is determined as (2, 0), and The coordinates of each pixel in the color format that is offset 3 units downward in the vertical direction of the color format 101 are determined to be (3, 0).... By traversing the entire image data according to this rule, each pixel in the image data has its position information, so that the position information can be used to restore the image data during decoding.

After determining the position information of each pixel, the compression device extracts the color value of each pixel from the image data based on the color attribute of each pixel and divides it into multiple image blocks, and each image block contains only one type Color attributes. Please continue to refer to FIG. 10, since the color attributes in this embodiment include R, Gr, Gb, and B, four attributes, so in this embodiment, all pixel data in the image data is divided into R, Gr, Gb, and B based on the color attributes. Four image blocks of Gr, Gb, and B. For example, R(0,0) is divided into image blocks with R color attributes, and R(0,1) is divided into image blocks with R color attributes and is offset to the right in the horizontal direction of R(0,0) Shifted by 1 unit, R(0,2) is divided into the image block of the R color attribute and shifted by 2 units to the right in the horizontal direction of R(0,0), R(0,3) is divided into In the image block of the R color attribute and offset by 3 units to the right in the horizontal direction of R(0,0); R(1,0) is divided into the image block of the R color attribute and is in R(0,0) ) Is shifted downward by 1 unit in the vertical direction, R(2,0) is divided into the image blocks of the R color attribute and shifted downward by 2 units in the vertical direction of R(0,0), R (3, 0) is divided into the image block of the R color attribute and shifted downward by 3 units in the vertical direction of R(0, 0)... Similarly, the pixels of the Gr, Gb, and B color attributes are also the same One is divided into each image block accordingly, and each pixel position in each image block has a corresponding relationship with its pixel position in the image data, which will not be repeated here.

Please refer to FIG. 13, which shows a schematic diagram of another embodiment when the compression device in this application does not know the principal components in each pixel in advance. In this embodiment, the color components to be extracted are determined according to the rules of extracting B and Gb for odd rows and Gr and R for even rows, then the color format 101 is determined as odd rows B and Gb, and even rows Gr and R.

Please refer to Figure 14, which shows the mapping of the color value of each pixel in each image data to each pixel position in multiple image blocks when the compression device in this application does not know the principal component in each pixel in advance Schematic diagram of another embodiment of the method. As shown in the figure, for ease of understanding, the coordinates of all pixels in the color format 101 where the pixels in the first row and first column of the image data are defined are the origin (0, 0), that is, the color format 101 includes R G B (0, 0), R Gb B (0, 0), R Gr B (0, 0), and R G B (0, 0). As shown in FIG. 14, using the color format 101 as a reference, the coordinate of each pixel in the color format shifted by 1 unit to the right in the horizontal direction of the color format 101 is determined as (0, 1), and Each pixel coordinate in the color format that is offset by 2 units to the right in the horizontal direction of the color format 101 is determined to be (0, 2), which will be offset by 3 units to the right in the horizontal direction of the color format 101 The coordinates of each pixel in the color format of the unit are determined to be (0, 3)...; in the same way, based on the color format 101, the vertical direction of the color format 101 will be offset downward by 1 unit The coordinate of each pixel in the color format is determined as (1, 0), and the coordinate of each pixel in the color format that is offset down by 2 units in the vertical direction of the color format 101 is determined as (2, 0), and The coordinates of each pixel in the color format that is offset 3 units downward in the vertical direction of the color format 101 are determined to be (3, 0).... By traversing the entire image data according to this rule, each pixel in the image data has its position information, so that the position information can be used to restore the image data during decoding.

After determining the position information of each pixel, the compression device extracts the color value of each pixel from the image data based on the color attribute of each pixel and divides it into multiple image blocks, and each image block contains only one type Color attributes. Please continue to refer to FIG. 10, since the color attributes in this embodiment include R, Gr, Gb, and B, four attributes, so in this embodiment, all pixel data in the image data is divided into R, Gr, Gb, and B based on the color attributes. Four image blocks of Gr, Gb, and B. For example, B(0,0) is assigned to the image block of the B color attribute, and B(0,1) is assigned to the image block of the B color attribute and is offset to the right in the horizontal direction of B(0,0) Shifted by 1 unit, B(0,2) is divided into the image block of B color attribute and shifted to the right by 2 units in the horizontal direction of B(0,0), B(0,3) is divided into In the image block of the B color attribute and offset 3 units to the right in the horizontal direction of B(0,0); B(1,0) is divided into the image block of the B color attribute and is in the B(0,0) ) Is shifted downward by 1 unit in the vertical direction, B(2,0) is divided into the image block of B color attribute and shifted downward by 2 units in the vertical direction of B(0,0), B (3, 0) is divided into the image block of the B color attribute and shifted downward by 3 units in the vertical direction of B(0, 0)...Similarly, each pixel of the Gb, Gr, R color attributes is also the same One is divided into each image block accordingly, and each pixel position in each image block has a corresponding relationship with its pixel position in the image data, which will not be repeated here.

It should be understood that in the foregoing embodiments, for ease of understanding, the mapping relationship is determined in the form of coordinates. However, in some embodiments, each pixel is extracted from the image data based on the color attribute of each pixel in the color format. The method of mapping the color value of, and the pixel position in the corresponding image block is not limited to determining the mapping relationship by coordinates, and may also include any information that can be identified by the compression device for determining the mapping relationship, such as a serial number.

In step S130, the compression device compresses image blocks corresponding to each of the multiple image data and having the same color attribute to obtain a video file. Here, the multiple image blocks obtained in step S120 are input to the encoder for encoding. Wherein, the coding standards may include, but are not limited to: H.265 or AVS2, which is the second-generation digital audio and video coding and decoding technology standards.

In some embodiments, the encoder may be integrated in the compression device. For example, the processing device of the compression device coordinates the encoder to perform step S130 after performing steps S110 and S120. Alternatively, the encoder may also be an independent terminal device or a server. The encoder includes a processing module that can perform logic control and digital operations, and a storage module for storing intermediate data generated during the operation of the processing module. Wherein, the processing module includes, for example, any one or a combination of the following: FPGA, MCU, CPU, etc. The storage module includes, for example, any one or a combination of the following: volatile memories such as registers, stacks, and caches.

It should be understood that a video encoder is a program or device capable of compressing digital video. Generally, the data in Bayer format cannot enter the encoder directly because each pixel has only a single color attribute and lacks the color attributes of the other two bits. The Bayer format data needs to be Debayer to generate RGB format, or converted to YUV format before entering the encoder for encoding. In this embodiment, because the pixels in each image block only include a single color attribute, the insufficient number of bits can be temporarily filled with 0 when entering the encoder, so that the image block can be compatible with existing The encoder in the technology, on the other hand, facilitates the calculation of the encoder and ensures the processing efficiency of the encoder.

In an exemplary embodiment, a plurality of image blocks may be processed separately by an encoder. Here, the step S130 includes: according to the color attributes in the color format, the multiple image data corresponding to the A plurality of image blocks are sequentially input to a first encoder for compression processing.

Please refer to FIG. 6, which shows a schematic diagram of an embodiment of using a first encoder for compression processing in this application. As shown in the figure, the figure shows multiple image blocks generated from the image data of 4 different frames of ①, ②, ③, and ④, and each image block in each serial number only includes a single color attribute. Here, a plurality of image blocks are input into a first encoder in a preset order for compression encoding. Wherein, the preset order includes, but is not limited to: based on the time when the image data corresponding to the image block is acquired, or based on the color attribute of the image block.

In some embodiments, the preset order is determined based on the time when the image data corresponding to the image block is acquired. Please refer to FIG. 7, which shows a schematic diagram of another embodiment in which a first encoder is used for compression processing in this application. As shown in the figure, in this embodiment, the four image blocks with sequence number ① are first input to the first encoder 102 for compression processing, and then the four image blocks with sequence number ② are input to the first encoder 102 for compression processing. Compression processing, then the four image blocks with the sequence number ③ are input to the first encoder 102 for compression processing, and finally the four image blocks with the sequence number ④ are input to the first encoder 102 for compression processing.

In other embodiments, the preset order is determined based on the color attributes of the image blocks. Please continue to refer to FIG. 6 and first input the image blocks with the color attribute Gr to the first encoder 102 for compression processing. Then input the image block with the color attribute of R to the first encoder 102 for compression processing, then input the image block with the color attribute of B to the first encoder 102 for compression processing, and finally input the image block with the color attribute of Gb The first encoder 102 performs compression processing. Since the color difference between adjacent frames is small, the method in this embodiment can greatly reduce the amount of calculation and improve the compression efficiency.

In an exemplary embodiment, in order to improve the efficiency of compression processing, multiple image blocks may be processed respectively by multiple encoders. Here, the step S130 includes: under synchronous control, using multiple second The encoder separately compresses multiple image blocks with the same color attribute.

In some embodiments, in order to distinguish image blocks generated from image data of different frames, the step S130 further includes: the video file obtained by performing compression processing using multiple second encoders includes a video file used to decompress the video file. The synchronization information set for restoring multiple image data. Here, the second encoder generates synchronization information for each image block. The synchronization information includes but is not limited to a time stamp, sequence number, etc., for example: images of the same frame have the same time stamp, and images of different frames The images have different time stamps, so that the image block with the same time stamp can be restored into one image data at the decoding end. For another example, the images of the same frame have the same serial number, and the images of different frames have different serial numbers, so that the image blocks of the same serial number can be restored into one piece of image data at the decoding end. Among them, due to the error in the time mechanism of different second encoders, a synchronization server can be used to synchronize the time of multiple second encoders to coordinate the time mechanism of multiple second encoders to keep consistent or to control the error. Within the acceptable range. Wherein, the server includes, but is not limited to, an NTP (Network Time Protocol) server, etc. In some other embodiments, based on the synchronization protocol, one of the multiple second encoders can be used to synchronize other second encoders to coordinate the other second encoders to be in the same time mechanism. Or control the error within an acceptable range. Wherein, the synchronization protocol includes but is not limited to the 1588 protocol and the like.

In an exemplary embodiment, the image data is in Bayer format or other formats than RGB format, such as YUV format. It is necessary to convert the image data into RGB or Bayer format, and then perform compression processing on it according to the above-mentioned compression processing method. The compression processing method will not be repeated here.

The image data compressed by the technical idea provided by the above-mentioned compression method can be stored on a storage medium, or data transmission between devices or within devices can be performed by using a communication transmission method of 60 Mbps and above. For example, in a camcorder with integrated recording and playback, the hardware constituting the compression device compresses the captured image data into corresponding compressed image data under the instruction of the software, and saves it in the storage device. When the user operates the camcorder to play the compressed image data, the hardware constituting the decompression device decompresses the compressed image data under the instruction scheduling of the software, and plays it (or called display). For another example, a camera device that can perform the compression method compresses the captured image data data into corresponding compressed image data (such as a compressed file or code stream), and uses a wireless transmission method based on the 5G communication protocol and optical fiber transmission The compressed image data is transmitted to a server in a transmission mode, and the decompression device provided in the server decompresses the compressed image data and plays it (or called display).

The compression method of this application can ensure the clarity of ultra-high-definition video while ensuring the stability of transmission. The amount of data compressed and encoded by the compression method of this application can realize the transmission of 8K images by the current 4K encoder. The problem of difficulty in transmitting ultra-high-definition video in the prior art is solved.

In the embodiment of the second aspect of the present application, a method for decompressing a video file is also provided. The decompression method is mainly performed by an image decompression device, where the decompression device may be a terminal device, Or server. Here, the terminal device may be a terminal device, a server, or the like.

Wherein, the terminal equipment includes, but is not limited to, playback equipment, personal electronic terminal equipment, and the like. The playback device includes a storage device, a processing device, and may also include an interface device. Wherein, the storage device may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The storage device also includes a memory controller, which can control access to the memory by other components of the device, such as a CPU and a peripheral interface. The storage device is used to store at least one program and image data to be decompressed. The program stored in the storage device includes an operating system, a communication module (or instruction set), a graphics module (or instruction set), a text input module (or instruction set), and an application (or instruction set). The program in the storage device further includes an instruction set for performing a decompression operation on the image data in time sequence based on the technical solution provided by the decompression method. The processing device includes, but is not limited to: CPU, GPU, FPGA (Field-Programmable Gate Array), ISP (Image Signal Processing image processing chip), or other including at least data stored in a storage device dedicated to processing A program processing chip (such as AI dedicated chip), etc. The processing device calls and executes at least one program stored in the storage device to perform decompression processing on the stored image data according to the decompression method. Among them, the use of processing devices such as FPGA that can process matrix data in parallel is more suitable for efficient and real-time decompression processing of the acquired image data. The interface device includes, but is not limited to: a data line interface and a network interface; examples of the data line interface include: display interfaces such as VGA interface and HDMI interface, serial interfaces such as USB, and parallel interfaces such as data bus. Examples of network interfaces include at least one of the following: short-range wireless network interfaces such as Bluetooth-based network interfaces and WiFi network interfaces, such as wireless network interfaces of mobile networks based on 3G, 4G, or 5G protocols, such as wired network interfaces that include network cards Wait. The playback device also includes a display device for displaying the image data obtained by decompression. The display device at least includes a display screen, a display screen controller, etc., where the display screen includes, for example, a liquid crystal display screen, a curved display screen, a touch screen, and the like. The display screen controller includes, for example, a processor dedicated to the display device, a processor integrated with the processor in the processing device, and the like. In some scenarios, the playback device is set up with a traffic command center for decompressing and displaying the compressed image data transmitted from the camera device. In other scenarios, the playback device is configured on a computer device that is communicatively connected to the minimally invasive medical device, which is connected to the minimally invasive medical device through an optical fiber or other dedicated data line, and connects the current minimally invasive medical device The compressed image data is decompressed and played. In other scenarios, the playback device is configured in the computer room of the TV forwarding center, and is used to decompress and play the compressed image data transmitted by the camera device installed on the stadium for video editing. In other scenarios, the playback device is a set-top box, which is used to decompress the code stream in the corresponding TV channel in the TV signal and output it to the TV for display.

The electronic terminal equipment for personal use includes desktop computers, notebook computers, tablet computers, and editing equipment dedicated to the production of TV programs, movies, TV series, and the like. The electronic terminal equipment includes a storage device and a processing device. Wherein, the storage device and the processing device may be the same or similar to the corresponding devices in the aforementioned camera equipment, and will not be described in detail here. The electronic terminal equipment may also include a display device for displaying image data obtained by decompression. Here, in some examples, the hardware and software modules of the electronic terminal may be the same as or similar to the corresponding devices in the aforementioned playback device, and will not be repeated here. In still other examples, the electronic terminal device may further include an image acquisition interface for acquiring compressed image data derived from compression. The image acquisition interface may be a network interface, a data line interface, or a program interface. Wherein, the network interface and the data line interface can be the same or similar to the corresponding devices in the aforementioned playback device, and will not be described in detail here. For example, through the network interface, the processing device of the electronic terminal device downloads compressed image data from the Internet. For another example, through the data line interface, the processing device of the electronic terminal device obtains the edited file from the storage device.

The server includes but is not limited to a single server, a server cluster, a distributed server, a server based on cloud technology, and the like. Wherein, the server includes a storage device, a processing device, an image acquisition interface, and the like. The storage device and the processing device may be configured in the same physical server device, or be configured in multiple physical server devices according to the division of labor of each physical server device. The image acquisition interface may be a network interface or a data line interface. The storage device, processing device, image acquisition interface, etc. included in the server may be the same as the corresponding devices mentioned in the aforementioned terminal equipment; or specifically set for the server based on the server's throughput, processing capacity, and storage requirements The corresponding devices. For example, the storage device may also include a solid state drive or the like. For example, the processing device may also include a CPU dedicated to a server or the like. The image acquisition interface in the server acquires compressed image data and playback instructions from the Internet, and the processing device executes the decompression method described in this application on the acquired compressed image data based on the playback instructions.

Based on the demand for decompressing image data generated in any of the above scenarios, this application provides a decompression method for obtaining a video file. Please refer to FIG. 15, which shows the flow of the decompression method in an embodiment. Figure.

In step S210, a video file is obtained. Wherein, the video file is obtained by compressing graphics data according to the compression method in this application.

In some embodiments, the video file may come from a storage medium, or the video file may be transmitted to the decompression device using a communication transmission mode of 60 Mbps and above. Wherein, the transmission method includes, but is not limited to: a wireless transmission method based on the 5G communication protocol, or optical fiber transmission.

In step S220, the video file is decompressed according to the compression method used for the video file to obtain multiple image blocks; wherein, according to the color attribute of each image block, the obtained multiple image blocks are Each of the multiple pieces of image data to be generated corresponds to each piece of image data.

Here, the video file obtained in step S210 is input to the decoder for decoding. Wherein, the decoding standard may include, but is not limited to: H.265 or AVS2, which is the second-generation digital audio and video coding and decoding technology standard.

In some embodiments, the decoder may be integrated in the decompression device. For example, the processing device of the decompression device coordinates the decoder to perform step S220 after performing step S210. Alternatively, the decoder may also be an independent terminal device or a server. The decoder includes a processing module capable of performing logic control and digital operations, and a storage module for storing intermediate data generated during the operation of the processing module. Wherein, the processing module includes, for example, any one or a combination of the following: FPGA, MCU, CPU, etc. The storage module includes, for example, any one or a combination of the following: volatile memories such as registers, stacks, and caches.

In an exemplary embodiment, multiple image blocks may be processed separately by one decoder. Here, the step S220 includes: decompressing the received video file with the first decoder to obtain the basis Groups of image blocks divided by different color attributes in the color format. Wherein, each image block in each group of image blocks corresponds to a piece of image data to be generated.

Here, the first decoder performs decompression processing on the received video file according to the compression coding method of the image block by the encoder during compression coding. And after obtaining multiple sets of image blocks through the first decoder, the first decoder determines the correspondence between the multiple image blocks according to the obtained image block order and compression coding rules, so that the multiple The image block generates image data.

In some embodiments, please refer to FIG. 16, which shows a schematic diagram of an embodiment in which a first decoder is used for decompression processing in this application. In this embodiment, during the compression encoding, the encoder compresses and encodes multiple image blocks based on the time rule when the image data corresponding to the image block is acquired. Therefore, as shown in Figure 16, the first decoder sequentially obtains the image block with the Gr color attribute numbered ①, the image block with the R color attribute numbered ①, and the image block with the B color attribute numbered ①. , The image block with the Gb color attribute numbered ①, the image block with the Gr color attribute numbered ②, the image block with the R color attribute numbered ②... Here, the corresponding relationship between multiple image blocks is determined according to the rules of the encoder when performing compression encoding, such as the image block with the Gr color attribute number ①, the image block with the R color attribute number ①, and the number ① The B color attribute image block and the Gb color attribute image block numbered ① are all from the same image data, the Gr color attribute image block numbered ②, the R color attribute image block numbered ②, and the number is ② The image block of the B color attribute of, and the image block of the Gb color attribute of number ② are all from the same image data and the order is after ①, etc.

In other embodiments, please refer to FIG. 17, which shows a schematic diagram of another embodiment in which a first decoder is used for decompression processing in this application. In this embodiment, during compression encoding, the encoder compresses and encodes multiple image blocks based on the rules of the color attributes of the image blocks. Therefore, as shown in FIG. 17, the first decoder sequentially obtains the image block with the Gr color attribute number ①, the image block with the Gr color attribute number ②, and the image block with the Gr color attribute number ③. , The image block with the Gr color attribute numbered ④, the image block with the R color attribute numbered ①, the image block with the R color attribute numbered ②... Here, the corresponding relationship between multiple image blocks is determined according to the rules of the encoder when performing compression encoding, such as the image block with the Gr color attribute number ①, the image block with the R color attribute number ①, and the number ① The B color attribute image block and the Gb color attribute image block numbered ① are all from the same image data, the Gr color attribute image block numbered ②, the R color attribute image block numbered ②, and the number is ② The image block of the B color attribute of, and the image block of the Gb color attribute of number ② are all from the same image data and the order is after ①, etc.

In another exemplary embodiment, in order to improve the efficiency of the decompression processing, multiple decoders may be used to process multiple image blocks respectively. Here, the step S220 includes: using multiple image blocks under synchronous control. Each of the second decoders decompresses the video file according to the color attributes; wherein, each second decoder outputs a plurality of image blocks with the same color attribute; wherein, each image block is related to the one to be generated The image data corresponds. In some embodiments, in order to distinguish image blocks generated from image data of different frames, each second decoder determines the number of image blocks to be decompressed and an image to be generated according to the synchronization information in the video file. Correspondence between data.

Here, the second decoder generates a synchronization information for each image block. The synchronization information includes but is not limited to a time stamp, sequence number, etc., for example: images of the same frame have the same time stamp, and images of different frames The images have different time stamps, so that the image block with the same time stamp can be restored into one image data at the decoding end. For another example, the images of the same frame have the same serial number, and the images of different frames have different serial numbers, so that the image blocks of the same serial number can be restored into one piece of image data at the decoding end. Among them, due to the error in the time mechanism of different second decoders, a synchronization server can be used to synchronize the time of multiple second decoders to coordinate the time mechanism of multiple second decoders to keep the same or to control the error. Within the acceptable range. Wherein, the server includes, but is not limited to, an NTP (Network Time Protocol) server, etc. In some other embodiments, based on the synchronization protocol, one of the multiple second decoders can be used to synchronize other second decoders to coordinate the other second decoders to be in the same time mechanism. Or control the error within an acceptable range. Wherein, the synchronization protocol includes but is not limited to the 1588 protocol and the like.

Please continue to refer to FIG. 15, after obtaining multiple image blocks through the aforementioned decompression method, the decompression device provides the obtained multiple image blocks to step S230.

In step S230, the color value of each pixel position in the corresponding image block is mapped to the pixel of the image data according to the color attribute.

It should be understood that the pixel is the basic unit of image display. Each pixel has different color attributes according to the format of the image data in which it is located. For example, for image data in Bayer format, the color attribute of the pixel is a single color component; for image data in RGB format, the color attribute of the pixel includes three colors of red (R), green (G), and blue (B) Weight. Since human eyes are more sensitive to green than other colors, usually the number of G components is twice the number of other color components. Therefore, in some embodiments, the G component is represented by a Gr component or a Gb component. Among them, each pixel has a color value corresponding to its color attribute. For example, when the image data is in Bayer format, each pixel has only a single color component of R or G or B, where the G component is represented by the Gr component and the Gb component, and the color value of each pixel in the image data is The brightness value of a single color component is the color value of each pixel; when the image data is in RGB format, the color value of each pixel in the image data includes the brightness value of each color component in the pixel.

In an exemplary embodiment, please refer to FIG. 18, which shows a schematic diagram of an embodiment in which the decompression device in this application maps the color value of each pixel position in the corresponding image block to the pixel of the image data. Here, after the decompression device obtains multiple image blocks, according to the mapping relationship between the pixel position in the image block and the pixel position in the image data corresponding to the image block, the color value of each pixel in the image block Mapping to the pixel position in the corresponding image data, thereby restoring multiple image blocks into image data. As shown in FIG. 18, each pixel in the multiple image blocks of the decompression device is mapped to the image data according to its position information, wherein the pixels with the same position information and different color attributes are arranged according to their color format when compressed. For example: Gr(0,0), R(0,0), B(0,0), Gb(0,0) are all mapped to the (0,0) position in the image data. At the same time, according to the compression When the odd-numbered lines extract Gr, R, and the even-numbered lines extract the format of B, Gb, arrange Gr(0,0), R(0,0), B(0,0), Gb(0,0) according to the color format . In the same way, other pixels in the image block are also mapped to the image data according to the above method. Therefore, the step S230 also includes: traversing the pixel position in the image block of each color attribute according to the color format, and during the traversal, mapping the color value of the corresponding pixel position in each image block to the corresponding image data Pixel positions to generate image data; wherein the color value of each pixel position in the image data represents a single color attribute. Here, the decompression device processes a plurality of image blocks separately according to the above method, and sends the generated plurality of image data to step S240 in sequence.

It should be understood that the color format in this embodiment is determined according to the color format during compression, and the method for determining the color format has been explained in the implementation of the first aspect of the present application, so it will not be repeated here.

In step S240, based on the color value of each pixel in the image data, a video image for displaying UHD 4K and above pixels is generated.

Here, the image data provided in step S230 is equivalent to image data in the Bayer format. In some embodiments, to facilitate display, the decompression device processes the image data provided in step S230 to Debayer, etc., to generate an RGB image for display. Therefore, here, the step S240 further includes: performing interpolation processing on each pixel position in the obtained image data according to the color format to obtain a video image containing RGB color attributes in each pixel. Among them, the RGB image includes image data in the RGB format itself and image data in other formats (such as YUV format, etc.) that can be converted into the RGB format.

Please refer to FIG. 19, which shows a schematic diagram of an embodiment of the compression device in this application. As shown in the figure, the compression device includes: a communication interface for communicating with an external decompression device; a memory for storing at least one The program and the image data to be compressed; the processor, which is used to coordinate the communication interface and the memory to execute the program. During the execution, the method for obtaining a video file according to any one of the embodiments of the first aspect of the present application will be The image data is compressed to obtain a video file.

Among them, the memory includes non-volatile memory, storage server, etc. Wherein, the non-volatile memory is, for example, a solid state hard disk or a U disk. The storage server is used to store various information related to power consumption and power supply. The communication interface includes network interface, data line interface and so on. The network interface includes, but is not limited to: an Ethernet network interface device, a mobile network (3G, 4G, 5G, etc.)-based network interface device, a short-range communication (WiFi, Bluetooth, etc.)-based network interface device, etc. The data line interface includes but is not limited to: USB interface, RS232, etc. The communication interface is connected to various sensor devices, third-party systems, the Internet and other data. The processor is connected to the communication interface and the memory, and it includes at least one of a CPU or a chip integrated with the CPU, a programmable logic device (FPGA), and a multi-core processor. The processor also includes memory, registers, and other memories used to temporarily store data.

The communication interface is used to communicate with an external decompression device. Here, the communication interface includes, for example, a network card, which communicates with the decompression device via the Internet or a dedicated network built. For example, the communication interface sends the video file compressed and processed by the compression device to the decompression device.

The memory is used to store at least one program and image data to be compressed. Here, the memory includes, for example, a memory card provided in a compression device.

The processor is configured to call the at least one program to coordinate the communication interface and the memory to execute the compression method mentioned in any of the foregoing examples.

Please refer to FIG. 20, which shows a schematic diagram of an embodiment of the decompression device in this application. As shown in the figure, the decompression device includes: a communication interface for communicating with an external compression device; a memory for storing at least A program and the video file to be decompressed; a processor for coordinating the communication interface and the memory to execute the program, during execution according to the decompression of the video file as described in any of the embodiments of the second aspect of the present application The method decompresses the video file so as to play the video file.

Among them, the memory includes non-volatile memory, storage server, etc. Wherein, the non-volatile memory is, for example, a solid state hard disk or a U disk. The storage server is used to store various information related to power consumption and power supply. The communication interface includes network interface, data line interface and so on. The network interface includes, but is not limited to: an Ethernet network interface device, a mobile network (3G, 4G, 5G, etc.)-based network interface device, a short-range communication (WiFi, Bluetooth, etc.)-based network interface device, etc. The data line interface includes but is not limited to: USB interface, RS232, etc. The communication interface is connected to various sensor devices, third-party systems, the Internet and other data. The processor is connected to the communication interface and the memory, and includes: at least one of a CPU or a chip integrated with the CPU, a programmable logic device (FPGA), and a multi-core processor. The processor also includes memory, registers, and other memories used to temporarily store data.

The communication interface is used to communicate with an external compression device. Here, the communication interface includes, for example, a network card, which communicates with the compression device through the Internet or a dedicated network built. For example, the communication interface receives the video file compressed and processed by the compression device, and provides the video file to the processor.

The memory is used to store at least one program and a video file to be decompressed. Here, the memory includes, for example, a memory card provided in a decompression device.

The processor is configured to call the at least one program to coordinate the communication interface and the memory to execute the decompression method mentioned in any of the foregoing examples, so as to perform decompression processing on the video file to play the video file.

Based on any of the above-mentioned compression and decompression methods, this application also provides a video transmission system. Please refer to FIG. 21, which shows a schematic structural diagram of the video transmission system in an embodiment of this application. The video transmission system includes any one of the aforementioned compression equipment and decompression equipment.

Here, the video transmission system includes a communication interface, a memory, and a processor. Wherein, the communication interface may include a network interface, a data line interface, or a program interface. During compression, the image data in the camera device or the Internet is acquired through the communication interface of the compression device, and the processing device executes the compression operation by calling the program stored in the memory to compress and encode the acquired image data into a video file , And stored in the storage device. When the video transmission system displays the video file based on a user operation, the processing device performs a decompression operation by calling a program in the storage device, and displays the image data obtained after decompression on the display screen. Wherein, the compression and decompression operations in the video transmission system can be performed based on the corresponding methods provided in this application, and will not be repeated here.

It should be noted that through the description of the above implementation manners, those skilled in the art can clearly understand that part or all of this application can be implemented by means of software in combination with a necessary general hardware platform. If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can also be stored in a computer readable storage medium. Based on this understanding, the present application also provides a computer-readable storage medium that stores at least one program that, when executed, implements any of the aforementioned compression methods or decompression methods.

Based on this understanding, the technical solution of the present application essentially or the part that contributes to the prior art can be embodied in the form of a software product. The computer software product can include one or more machine executable instructions stored thereon. A machine-readable medium, when these instructions are executed by one or more machines, such as a computer, a computer network, or other electronic devices, can cause the one or more machines to perform operations according to the embodiments of the present application. For example, the steps in the compression method or decompression method. Machine-readable media may include, but are not limited to, floppy disks, optical disks, CD-ROM (compact disk-read only memory), magneto-optical disks, ROM (read only memory), RAM (random access memory), EPROM (erasable Except programmable read-only memory), EEPROM (electrically erasable programmable read-only memory), magnetic or optical cards, flash memory, or other types of media/machine-readable media suitable for storing machine-executable instructions.

In addition, any connection is properly termed a computer-readable medium. For example, if the instruction is sent from a website, server or other remote source using coaxial cable, fiber optic cable, twisted pair, digital subscriber line (DSL), or wireless technologies such as infrared, radio, and microwave, the Coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of the medium. However, it should be understood that computer readable and writable storage media and data storage media do not include connections, carrier waves, signals, or other transient media, but are intended for non-transitory, tangible storage media. For example, the magnetic disks and optical disks used in the application include compact disks (CD), laser disks, optical disks, digital versatile disks (DVD), floppy disks, and Blu-ray disks. Disks usually copy data magnetically, while optical disks use lasers for optical Copy data locally.

It should be understood that, in the various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, rather than corresponding to the embodiments of the present application. The implementation process constitutes any limitation.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In summary, the video file compression method provided in this application can effectively reduce the code stream while ensuring high-fidelity image quality. In this application, the amount of data added by multiple image blocks is much lower than the amount of data after compression processing is performed using traditional methods. Among them, compared with the YUV222 format, it has only half the data volume; compared with the YUV444 format, it has only 1/3 of the data volume, but the amount of information carried by the compression method of this application is equivalent to that of the YUV444 format . Taking 8K video as an example, the image block of each color attribute is equivalent to 4K video YUV400 format with only brightness information, and compared with YUV422 format, the data volume is only half. Since the compression method in this application can effectively reduce the amount of data, 8k video can be encoded by an encoder in the existing technology. In the same way, with the compression method of the present application, 4K video can also be encoded by a 2K video encoder, or 16k video can be processed by an 8K video encoder. In addition, the bit stream rate generated by the compression method of this application can be controlled at about half of YUV422, that is, 24 to 80 Mbps. The current stable uplink peak of 5G is 90 Mbps, so 5G real-time transmission of 8K video can be realized, and it has High fidelity picture quality.

The foregoing embodiments only exemplarily illustrate the principles and effects of the present application, and are not used to limit the present application. Anyone familiar with this technology can modify or change the above-mentioned embodiments without departing from the spirit and scope of this application. Therefore, all equivalent modifications or changes completed by those with ordinary knowledge in the technical field without departing from the spirit and technical ideas disclosed in this application should still be covered by the claims of this application.

Claims

A compression method for obtaining video files, characterized in that it comprises the following steps:

Acquire multiple pieces of image data to be compressed in chronological order; the image data is used to display UHD 4K and above pixel video images;

Mapping the color value of each pixel in each image data to each pixel position in a plurality of image blocks based on the color attribute of each pixel in the image data;

Compress the image blocks corresponding to each image data in the multiple image data and have the same color attribute to obtain a video file.
The method for obtaining a video file according to claim 1, wherein in the case that each pixel in the image data represents a single color attribute, the color attribute of each pixel in the image data is The steps of mapping the color value of each pixel in the image data to each pixel position in a plurality of image blocks respectively include:

Traverse the image data according to the color format set based on the Bayer format in the image data;

Wherein, during the traversal, based on the color attribute of each pixel in the color format, the color value of each pixel is extracted from the image data and mapped to the pixel position in the corresponding image block.
The compression method for obtaining a video file according to claim 1, wherein each pixel in the image data represents an RGB color attribute; the color attribute of each pixel in the image data is The steps of mapping the color value of each pixel in the image data to each pixel position in a plurality of image blocks respectively include:

Traverse the image data according to the color format set based on the pixel row format in the image data;

Wherein, during the traversal, based on the color attribute of each pixel in the color format, the color principal component or color fitting component of each pixel is extracted from the image data, and mapped to the pixel position in the corresponding image block.
The compression method for obtaining a video file according to claim 2 or 3, wherein the step of compressing image blocks corresponding to each image data in the plurality of image data and having the same color attribute comprises:

According to the color attributes in the color format, multiple image blocks corresponding to multiple image data are sequentially input to a first encoder for compression processing.
The compression method for obtaining a video file according to any one of claims 1-3, wherein the image block corresponding to each image data in the plurality of image data and having the same color attribute is compressed The steps include:

Under synchronous control, multiple second encoders are used to compress multiple image blocks of the same color attribute respectively.
The compression method for obtaining a video file according to claim 5, characterized in that the video file obtained by the compression processing using a plurality of second encoders includes a setting for decompressing the video file to restore multiple image data Synchronization information.
A method for decompressing video files, which is characterized in that it comprises:

Obtain a video file;

The video file is decompressed according to the compression method used for the video file to obtain multiple image blocks; wherein, according to the color attribute of each image block, the obtained multiple image blocks and the multiple images to be generated Each piece of image data in the image data corresponds to;

Mapping the color value of each pixel position in each corresponding image block to the pixel of the image data according to the color attribute;

Based on the color value of each pixel in the image data, a video image for displaying UHD 4K and above pixels is generated.
The method for decompressing a video file according to claim 7, wherein the step of decompressing the video file according to a compression mode to obtain a plurality of image blocks comprises:

Under synchronous control, a plurality of second decoders are used to decompress the video file according to the color attributes respectively; wherein, each second decoder outputs a plurality of image blocks with the same color attribute; wherein, each image The block corresponds to a piece of image data to be generated.
The method for decompressing a video file according to claim 8, wherein each second decoder determines the number of image blocks to be decompressed and a piece of image data to be generated according to the synchronization information in the video file Correspondence between.
The method for decompressing a video file according to claim 7, wherein the step of decompressing the video file according to a compression mode to obtain a plurality of image blocks comprises:

Use the first decoder to decompress the received video file to obtain multiple groups of image blocks divided according to different color attributes in the color format; wherein, each image block in each group of image blocks is related to the to-be-generated Corresponding to one of the image data.
The method for decompressing a video file according to claim 7, wherein the step of mapping the color value of each pixel position in each corresponding image block to the pixel of the image data according to the color attribute comprises:

According to the color format, traverse the pixel position in the image block of each color attribute, and during the traversal, map the color value of the corresponding pixel position in each image block to the pixel position in the corresponding image data to generate image data; Wherein, the color value of each pixel position in the image data represents a single color attribute.
The method for decompressing a video file according to claim 11, wherein the step of generating a video image for displaying UHD 4K and above pixels based on the color value of each pixel obtained by mapping in the image data further comprises :

According to the color format, interpolation processing is performed on each pixel position in the obtained image data to obtain a video image containing RGB color attributes in each pixel.
A compression device, characterized in that it comprises

Communication interface, used to communicate with external decompression equipment;

A memory for storing at least one program and image data to be compressed;

The processor is used for coordinating the communication interface and the memory to execute the program, and during the execution, the image data is compressed according to the method for obtaining a video file according to any one of claims 1-6 to obtain a video file.
A decompression device, characterized by comprising:

Communication interface, used to communicate with external compression equipment;

A memory for storing at least one program and a video file to be decompressed;

The processor is used for coordinating the communication interface and the memory to execute the program, and during the execution, the video file is decompressed according to the video file decompression method of any one of claims 7-12 for playback The video file.
A video transmission system is characterized in that it comprises:

The compression device according to claim 13; and

The decompression device according to claim 14.
A computer-readable storage medium, comprising: storing at least one program; when called, the at least one program executes the method for obtaining a video file according to any one of claims 1-6; or When the at least one program is called, the method for decompressing a video file according to any one of claims 7-12 is executed.