WO2021217623A1

WO2021217623A1 - Multimedia data processing method and device, and storage medium

Info

Publication number: WO2021217623A1
Application number: PCT/CN2020/088431
Authority: WO
Inventors: 龙余斌; 罗飞
Original assignee: 深圳市大疆创新科技有限公司
Priority date: 2020-04-30
Filing date: 2020-04-30
Publication date: 2021-11-04

Abstract

A multimedia data processing method and device, and a storage medium. Said method comprises: acquiring a first multimedia data set to be processed; encoding first multimedia data in the first multimedia data set, so as to determine an offset of the first multimedia data; and determining a second multimedia data set according to the offset of the first multimedia data, so as to process the first multimedia data according to the second multimedia data set. By means of the embodiment, the storage space and transmission time of the multimedia data can be effectively reduced, and the efficiency of processing the multimedia data is improved.

Description

Multimedia data processing method, equipment and storage medium

Technical field

The embodiments of the present invention relate to the field of data processing, and in particular, to a multimedia data processing method, device, and storage medium.

Background technique

With the development of science and technology, people have higher and higher requirements for multimedia data processing. For example, due to possible defects in the technology of the multimedia data processing equipment, abnormal multimedia data may occur when the multimedia data processing equipment obtains multimedia data such as image data, video data, and audio data. At present, when processing abnormal multimedia data, it is usually necessary to store abnormal multimedia data. However, because the amount of multimedia data is too large, the storage space that needs to be consumed is too large, resulting in too long transmission time, which increases the difficulty of implementation, affects the efficiency of data processing, and leads to an increase in product costs and a decrease in user experience.

Summary of the invention

The embodiments of the present invention provide a multimedia data processing method, equipment, and storage medium, which can effectively reduce the storage space and transmission time of multimedia data, and improve the efficiency of multimedia data processing.

In the first aspect, an embodiment of the present invention provides a multimedia data processing method, including:

Acquiring the first multimedia data set to be processed;

Encoding the first multimedia data in the first multimedia data set to determine the offset of the first multimedia data;

Determine a second multimedia data set according to the offset of the first multimedia data, so as to process the first multimedia data according to the second multimedia data set.

In the second aspect, an embodiment of the present invention provides a multimedia data processing device, including: a memory and a processor;

The memory is used to store programs;

The processor is used to call the program, and when the program is executed, it is used to perform the following operations:

Acquiring the first multimedia data set to be processed;

In a third aspect, an embodiment of the present invention provides a computer-readable storage medium that stores a computer program that, when executed by a processor, implements the multimedia data processing method described in the first aspect above .

In the embodiment of the present invention, the first multimedia data set to be processed is acquired, and the first multimedia data in the first multimedia data set is encoded to determine the offset of the first multimedia data , And determining the second multimedia data set according to the offset of the first multimedia data, so as to process the first multimedia data according to the second multimedia data set. Through this implementation, the storage space and transmission time of multimedia data are effectively reduced, and the efficiency of multimedia data processing is improved.

Description of the drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings that need to be used in the embodiments. Obviously, the drawings in the following description are only some of the present invention. Embodiments, for those of ordinary skill in the art, without creative work, other drawings can be obtained based on these drawings.

Figure 1 is a schematic diagram of a multimedia data processing system provided by an embodiment of the present invention;

2 is a schematic flowchart of a multimedia data processing method provided by an embodiment of the present invention;

Fig. 3 is a schematic diagram of an image data set provided by an embodiment of the present invention;

4 is a schematic diagram of another image data collection provided by an embodiment of the present invention;

FIG. 5 is a query flowchart of a dead pixel table provided by an embodiment of the present invention;

FIG. 6 is a block diagram of a module for processing a dead pixel table provided by an embodiment of the present invention;

Fig. 7 is a schematic structural diagram of a multimedia data processing device provided by an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present disclosure.

In the following, some embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the case of no conflict, the following embodiments and features in the embodiments can be combined with each other.

The multimedia data processing method proposed in the embodiment of the present invention can be applied to a multimedia data processing device. In some embodiments, the multimedia data processing equipment can be installed on equipment such as drones and unmanned vehicles; in some embodiments, the multimedia data processing equipment can be spatially independent from the drone, For example, the multimedia data processing equipment can be installed in remote control equipment, smart terminals (such as mobile phones, tablet computers, etc.). In some embodiments, a communication connection is established between the multimedia data processing device and the drone.

The multimedia data processing method, equipment and storage medium provided by the embodiments of the present invention can be applied to temperature measurement through infrared cameras, cameras, mobile phones and other shooting devices mounted on drones, unmanned vehicles, robots, and other equipment. Scenes such as inspections, photos and videos. Of course, the embodiments of the present invention can also be applied to other scenarios than the above-mentioned job scenarios, and there is no specific limitation here. The multimedia data processing system provided by the embodiment of the present invention will be schematically described below by taking a scene of a photographing device mounted on a drone as an example with reference to FIG. 1.

Please refer to FIG. 1, which is a schematic diagram of a multimedia data processing system according to an embodiment of the present invention. The multimedia data processing system includes: a multimedia data processing device 11 and an unmanned aerial vehicle 12 on which a photographing device is mounted. Among them, the unmanned aerial vehicle 12 and the multimedia data processing device 11 may establish a communication connection through a wireless communication connection. Among them, in some scenarios, the UAV 12 and the multimedia data processing device 11 may also establish a communication connection through a wired communication connection. In some embodiments, the multimedia data processing device 11 may be set on the drone 12, and the drone 12 includes a power system 121, and the power system 121 is used to provide power for the drone 12 to move. . In other embodiments, the drone 12 and the multimedia data processing device 11 are independent of each other, and the multimedia data processing device 11 may include one of a remote control device, a smart phone, a tablet computer, a laptop computer, and a wearable device, or Among them, the multimedia data processing device 11 may even be another terminal device independent of the remote control device of the drone 12, and the terminal device can be communicatively connected with the remote control device of the drone 12. In other embodiments, the multimedia data processing device 11 may be independent of the drone 12, for example, the multimedia data processing device 11 is set in a cloud server and establishes a communication connection with the drone 12 through a wireless communication connection. It should be understood that Figure 1 and the related description in this article only use drones as an application example of the multimedia data processing method, which should not be regarded as a specific limitation on the application of the multimedia data processing method.

The multimedia data processing device 11 can obtain the first multimedia data set to be processed collected by the camera mounted on the drone 12, and compare the first multimedia data in the first multimedia data set. Encoding is performed to determine the offset of the first multimedia data, and a second multimedia data set is determined according to the offset of the first multimedia data, so as to determine the offset of the first multimedia data according to the The data set processes the first multimedia data. Through this implementation, the storage space and transmission time of multimedia data are effectively reduced, and the efficiency of multimedia data processing is improved.

The multimedia data processing method provided by the embodiments of the present invention will be schematically described below with reference to the accompanying drawings.

Please refer to FIG. 2 for details. FIG. 2 is a schematic flowchart of a multimedia data processing method according to an embodiment of the present invention. The method may be executed by a multimedia data processing device, wherein the specific explanation of the multimedia data processing device is as described above. Specifically, the method of the embodiment of the present invention includes the following steps.

S201: Acquire a first multimedia data set to be processed.

In the embodiment of the present invention, the multimedia data processing device may obtain the first multimedia data set to be processed. In some embodiments, the first multimedia data in the first multimedia data set includes but is not limited to image data, video data, audio data, etc., in one example, the first multimedia data The data can include the pixels of the pixels in the image.

In an embodiment, the multimedia data may be collected by photographing devices such as infrared cameras, visible light cameras, cameras, and mobile phones.

S202: Encode the first multimedia data in the first multimedia data set to determine the offset of the first multimedia data.

In the embodiment of the present invention, the multimedia data processing device may encode the first multimedia data in the first multimedia data set to determine the offset of the first multimedia data.

In an embodiment, the first multimedia data includes image data, and the multimedia data processing device is encoding the first multimedia data in the first multimedia data set to determine the first multimedia data. When the multimedia data is offset, the image resolution of the first image data set to be processed can be obtained, and the first image data in the first image data set can be encoded according to the image resolution to Determine the offset of the first image data.

In one embodiment, when acquiring the first image data set to be processed, the multimedia data processing device may acquire the image coordinates of the abnormal image data of the image to be processed, and determine the image data corresponding to the image coordinates of the abnormal image data Compose the first image data set.

For example, assuming that the image coordinates of the abnormal image data of the image to be processed obtained by the multimedia data processing device are (x1, y1), (x2, y2), (x3, y3), the image coordinates of the abnormal image data can be determined Image data corresponding to (x1, y1), (x2, y2), (x3, y3) constitute the first image data set.

In one embodiment, when acquiring the first image data set to be processed, the multimedia data processing device may acquire the abnormal image data mark of the image to be processed, and determine that the image data corresponding to the abnormal image data mark constitutes the first image data set. A collection of image data. In some embodiments, the abnormal image data mark includes, but is not limited to, any one or more characters such as numbers, letters, and text. In an example, the abnormal image data mark may be 1.

For example, assuming that the abnormal image data is abnormal pixels, that is, dead pixels, if the abnormal pixels are marked as 1, the multimedia data processing device may determine that abnormal pixels with the abnormal pixels marked as 1 form the first image data set.

In an embodiment, when the multimedia data processing device encodes the first image data in the first image data set according to the image resolution to determine the offset of the first image data, it may be based on The image resolution determines the position information of the first image data in the first image data set, and determines the offset of the first image data according to the position information.

In one embodiment, when the multimedia data processing device determines the position information of the first image data in the first image data set according to the image resolution, it may determine the position information according to the image resolution The image coordinates of the first image data, and the position information of the first image data in the first image data set is determined according to the image coordinates of the first image data.

For example, assuming that the image resolution of the first image data set is 4x4, the multimedia data processing device to be processed can determine the image coordinates (x1, x2) of the first image data according to the image resolution of 4x4, and according to the first image The image coordinates (x1, x2) of the image data determine the position information of the first image data in the first image data set.

In one embodiment, when the multimedia data processing device determines the offset of the first image data according to the position information, it may determine the position mark of the first image data according to the position information, and according to the The position mark of the first image data determines the offset of the first image data. In some embodiments, the position mark includes, but is not limited to, any one or more characters such as numbers, letters, and words.

Figure 3 is used as an example for description. Figure 3 is a schematic diagram of an image data collection provided by an embodiment of the present invention. 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, assuming that the abnormal image data of the image to be processed is marked as 1, then the abnormality of the image to be processed can be determined The position information corresponding to the image data mark 1 corresponds to the position marks 0, 4, 9, and 11 respectively, so the multimedia data processing device can determine that the position marks of the first image data are 0, 4, 9, and 11.

In one embodiment, when the multimedia data processing device determines the offset of the first image data according to the position mark of the first image data, it may determine that the first image data set is in the first image data set according to the position information. The first position of the first image data in the predetermined position sequence is marked as the offset of the first image data, and the first image data of the next image data of the first image data is determined in the predetermined position sequence. Two position markers, and determining that the difference between the second position marker and the first position marker is the offset of the next image data.

Take Figure 3 as an example. Assuming that the position markers of the first image data are {0, 4, 9, 11} respectively, and the predetermined position sequence is from left to right and top to bottom, the multimedia data processing device can determine In FIG. 3, the first position mark "0" of the first image data in the predetermined position sequence is the offset of the first image data, and the second image data of the next image data of the first image data is determined in accordance with the predetermined position sequence. The second position mark is "4", so it can be determined that the difference between the second position mark "4" and the first position mark "0" 4-0=4 is the offset of the next image data of the first image data, In turn, it can be calculated that the offset of the third image data in Figure 3 is 9-4=5, and the offset of the fourth image data is 11-9=2. Therefore, the first image in Figure 3 can be determined The offset of the data is {0, 4, 5, 2} respectively. It should be understood that, in another embodiment, the predetermined position sequence may be determined in other ways as required. FIG. 3 and the related description in this article only use the position mark of the image as an example of multimedia data processing, which should not be regarded as a specific limitation on multimedia data processing.

It can be seen that calculating the offset of the first image data through this implementation manner helps to encode the first image data based on the offset, thereby reducing the amount of data, saving storage space and time-consuming transmission.

In an embodiment, the multimedia data further includes audio data; the multimedia data processing device is encoding the first multimedia data in the first multimedia data set to determine the first multimedia data When determining the offset of the data, the first audio data in the first audio data set to be processed may be acquired, and the first audio data may be encoded to determine the offset of the first audio data.

In one embodiment, when the multimedia data processing device encodes the first audio data to determine the offset of the first audio data, it can obtain the volume value of the first audio data, and according to the The volume value of the first audio data determines the offset of the first audio data.

In one embodiment, when the multimedia data processing device determines the offset of the first audio data according to the volume value of the first audio data, it may determine the first volume value of the first audio data in a preset order Is the offset of the first audio data, and the second volume value of the next audio data of the first audio data is determined according to the preset order, and the second volume value and the The difference of the first volume value is the offset value of the next volume data.

For example, assuming that the volume value set of the first audio data is determined to be {a, b, c, d} in a preset order, the multimedia data processing device can determine the offset of the first audio data according to the first volume value a The amount is a. Since the second volume value of the next audio data of the first audio data is b, it can be determined that the difference between the second volume value b and the first volume value a is the next value of the first audio data. The offset value of the volume data, in the same way, the difference cb between the third volume value c and the second volume value b, and the difference dc between the fourth volume value d and the third volume value c can be obtained, thereby obtaining the first audio data The offset of is {a,ba,cb,dc}.

It can be seen that by calculating the offset and encoding the audio data based on the offset, it is helpful to reduce the amount of data, save storage space and time-consuming transmission, and improve encoding efficiency.

S203: Determine a second multimedia data set according to the offset of the first multimedia data, so as to process the first multimedia data according to the second multimedia data set.

In the embodiment of the present invention, the multimedia data processing device may determine the second multimedia data set according to the offset of the first multimedia data, so as to compare the first multimedia data according to the second multimedia data set. Media data is processed.

In some embodiments, the first multimedia data set and the second multimedia data set include a bad point table or a corrected grid table. In some embodiments, the bad point table or a corrected grid table The table is determined based on the offset. By storing the offset in the dead pixel table or the corrected grid table, it helps to reduce the amount of data stored in the dead pixel table or the corrected grid table.

Specifically, Figure 4 is used as an example for description. Figure 4 is a schematic diagram of another image data set provided by an embodiment of the present invention. And the blue component is replaced by pixels. Take the red component as an example. Suppose you need to select a point in the 5x5 area around point A to replace point A. First, you need to calibrate to determine which point to replace each pixel in the image. Assuming that the calibration display coordinates (x, y) point A is marked as 1, and it is necessary to replace the point P marked as 1 with the coordinates (x-2, y-2) in the upper left corner of the area. The coordinates (x, y) and the coordinates of point P (x-2, y-2), the calculated offset is (-2, -2), therefore, the offset (-2, -2) can be stored To the chromatic aberration correction grid table. In the same way, the same operation is performed for other pixels, so that the offset of the replacement point of each pixel is stored in the chromatic aberration correction grid table. Assuming that the resolution of the red component of the image is 2000x1500, storing a coordinate value in the prior art requires 22bits, and the data size of the entire chromatic aberration correction grid table is: 22x2000x1500≈63Mb; and the offset storage scheme in the present invention is adopted, That is to say, there is no need to store the coordinate value (x-2, y-2), but the offset (-2, -2). Because the offset of a coordinate only needs 6bits, the data of the entire chromatic aberration correction grid table The amount is: 6 x 2000 x 1500≈17Mb. It can be seen that using the multimedia data processing method of the present invention, the storage space of the chromatic aberration correction grid table is reduced by 73%. Therefore, through this implementation manner, the amount of data that needs to be stored in the correction grid table can be effectively reduced, which helps to improve the processing efficiency of multimedia data.

It should be understood that FIG. 4 and the related description in this article only take the correction grid table as an example of multimedia data processing, which should not be regarded as a specific limitation on multimedia data processing.

In one embodiment, when the multimedia data processing device processes the first multimedia data according to the second multimedia data set, it may decode the second multimedia data set to obtain the The offset of the first multimedia data, and according to the offset of the first multimedia data, the address jump data, and the end identifier of the second multimedia data set, One multimedia data is processed.

In some embodiments, the address jump data is configured to handle an offset that exceeds a predefined value, and the end identifier of the second multimedia data set is used to indicate the second multimedia data set The second multimedia data in the end.

In an embodiment, the first multimedia data set and the second multimedia data set include a dead point table; the multimedia data processing device is configured to jump to the address according to the offset of the first multimedia data. Transfer data and the end identifier of the second multimedia data set. When processing the first multimedia data, the second dead point table can be decoded to obtain the information about the dead points in the first dead point table. Offset, and according to the offset of the dead point in the first dead point table, the address jump data, and the end identifier of the second dead point table, the bad points in the first dead point table are Click for correction processing. In some embodiments, the dead pixels refer to abnormal pixels. In some embodiments, the first dead point table includes pixels corresponding to the image coordinates of the dead points or pixels corresponding to the dead point mark, and the offset is determined by encoding the dead points in the first dead point table. Get the second dead pixel table. In some embodiments, the end identifier includes, but is not limited to, any one or more characters such as numbers, letters, and text. In an example, the end identifier may be 0.

Correcting the dead pixels in the first dead point table by the offset can effectively reduce the amount of data in the dead point table, reduce the transmission time and storage space of the dead point table, and help improve processing efficiency.

In one embodiment, the definition of the dead pixel table is shown in Table 1 below. In some embodiments, the dead pixel data bit width may be 18 bits; in other embodiments, the dead pixel data bit width It can be adjusted according to the dead pixel data and storage space, and there is no specific limitation here.

Table 1

As shown in Table 1, set the data that can indicate the offset as 18'h00001～18'h3FFEF, and the rest can be used as reserved bits or function flag bits. In one embodiment, if the offset between the two dead pixels is greater than 18'h3FFEF, the address jump data 18'h3FFF0 of the dead pixels needs to be used to indicate that there is no next dead pixel in 18'h3FFF0. Therefore, the addressing jump data 18'h3FFF0 of the dead pixel is configured to process an offset that exceeds a predefined range, that is, multiple offsets are used to represent an offset that exceeds the predefined range.

For example, assuming that the offset between two dead pixels is 19'h4FFF0, the offset exceeds the predefined range 18'h00001～18'h3FFEF, and two data are needed to represent 19'h4FFF0, according to Table 1. It can be seen that the addressing jump data of the dead pixels is set to 18'h3FFF0, so the addressing jump data in Table 1 can be used to calculate 19'h4FFF0–18'h3FFF0=18'h10000, which shows that 18'h3FFF0 can be used And 18'h10000 to represent 19'h4FFF0.

In some embodiments, the reserved bits as described in Table 1 are reserved for subsequent use when defining other functions, which helps to prepare for the subsequent expansion of other functions.

In the embodiment of Table 1, 18'h00000 is defined as indicating that the current dot is a dead pixel, and 18'h3FFFF is defined as the end identifier of the dead dot table. It should be understood that the definition of data in Table 1 can be set according to actual needs or preferences, and should not be regarded as a specific limitation here. For example, in some embodiments, 0 can be defined as the end identifier of the bad dot table, and 18'h3FFFF can be defined as indicating that the current dot is a bad dot.

In one embodiment, the multimedia data processing device can decode the second dead point table to obtain the offset of the dead point in the first dead point table. When it is detected that the offset of the current point is different from the predefined dead point When the table data matches, the current point can be corrected according to the offset of the current point and the addressing jump data.

In one embodiment, the multimedia data processing device can read data from the current dead point table address to detect whether the current point data (for example, the offset) matches the predefined data representing the dead point, and if it matches, then determine The current point is a bad point, and the current point is corrected. Furthermore, the address of the current point is increased by 1, and the next point is detected.

It can be specifically illustrated in FIG. 5 as an example. FIG. 5 is a flowchart of a dead pixel table query provided by an embodiment of the present invention. As shown in FIG. 5, the dead pixel table address is obtained by decoding the second dead pixel table, and Read the current dot data (such as offset) from the current dot table address. If the data of the current dot is 18'h00000, then the data of the current dot can be determined as shown in Table 1. The data matching defined in which indicates that the current point is a dead point is to determine that the current point is a dead point in the first dead point table, and correct the current point.

In one embodiment, if the multimedia data processing device detects that the dead point data (for example, offset) of the current point does not match the predefined data representing the dead point, it can detect the dead point data (for example, offset) of the current point. Quantity) Whether it matches the offset of the next dead point in the first dead point table and the current dead point. If it matches, you can jump to the number of pixels corresponding to the offset of the current point according to the offset of the current point, And correct the current point.

Take Figure 5 as an example, suppose the offset between the next dead pixel and the current dead pixel is 18'h00001～18'h3FFEF. If the dead pixel data of the current point is read as 18'h00002, then the current point can be judged as bad. The point data does not match the data indicating the dead pixels defined in Table 1, but it meets the range of 18'h00001～18'h3FFEF defined in Table 1, so 18'h00002 pixels can be jumped to the current point. Corrective treatment.

In one embodiment, if the multimedia data processing device detects that the offset of the current point does not match the offset between the next dead point in the first dead point table and the current dead point, it can detect whether the offset of the current point satisfies Pre-defined addressing jump data, if it is met, jump to the number of pixels corresponding to the addressing jump data, and add 1 to the dead point table address of the current point to detect the next point; if it is not met, then Check whether the dead point data of the current point is the end mark of the dead point table, if it is the end mark of the dead point table, then end; if it is not the end mark of the dead point table, add 1 to the address of the current point dead point table to detect Whether the next point is a dead point.

Taking Figure 5 as an example, if the dead pixel data of the current point is 19'h4FFF0, it can be determined that the dead pixel data 19'h4FFF0 of the current point does not meet the range of 18'h00001～18'h3FFEF, and the current point is further detected The dead pixel data 19'h4FFF0 meets the addressing jump data 18'h3FFF0 defined in Table 1, so according to the addressing jump data, 19'h4FFF0–18'h3FFF0=18'h10000 is calculated, and 18'h3FFF0 jumps are obtained. The dead pixel data after the pixel is 18'h10000.

In one embodiment, after the multimedia data processing device performs correction processing on the current point, it can add 1 to the bad point table address of the current point and continue to detect the next point until the end mark of the second bad point table appears, then confirm Complete the correction processing of the dead pixels in the first dead pixel table.

It should be understood that FIG. 5 and the related description in this article are only used as an example of the decoding process of the dead pixel table, which should not be regarded as a specific limitation on the decoding process of the dead pixel table, and the dead pixels can be performed in other ways. The decoding process of the table.

In an embodiment, the first dead pixel table encoding protocol can be applied to a static dead pixel correction module of a zoom camera. The block diagram of the module is shown in FIG. 6, which is a processing method provided by an embodiment of the present invention. The block diagram of the point table. As shown in Figure 6, the modules for processing the dead pixel table include a flash memory (Flash) module 61, a micro controller unit (MCU) module 62, and a field programmable gate array (Field Programmable Gate Array, FPGA) module. 63. The FPGA module 63 includes a block RAM module 631 and a dead pixel correction module 632.

In one embodiment, the micro-control unit module 62 extracts the original dead pixel table from the flash memory module 61, and encodes it according to the protocol defined in the present invention to obtain the dead pixel table storing the offset of the dead pixel. The micro control unit module 62 transmits the encoded dead pixel table to the field programmable gate array module 63 through the bus. After the field programmable gate array module 63 receives the dead pixel table, it stores it in its own block memory module 631. The bad pixel correction module 632 extracts a bad pixel table from the block memory module 631, decodes it, and performs a bad pixel correction process.

It should be understood that FIG. 6 and the related description in this article are only used as an example of the processing module of the dead-point table, which should not be regarded as a specific limitation of the processing module of the dead-point table. The processing module of the dead-point table may also be other Way.

In the embodiment of the present invention, the multimedia data processing device may obtain the first multimedia data set to be processed, and encode the first multimedia data in the first multimedia data set to determine the first multimedia data set. The offset of the data, and the second multimedia data set is determined according to the offset of the first multimedia data, so as to process the first multimedia data according to the second multimedia data set. Through this implementation, the storage space and transmission time of multimedia data are effectively reduced, and the efficiency of multimedia data processing is improved.

For example, if you define a dead pixel table with the same size as the image, assuming the image resolution is 5184x3888, using IIC transmission, and the transmission bandwidth is 400Kbps, the required storage space is 5184 x 3888 x 1bit=2.4MB, and the transmission consumes It is 2.4MB/400Kbps=48 seconds. When using the multimedia data processing method of the present invention, the data bit width of the dead pixel table is 18bits, assuming that the number of dead pixels is 5120, using IIC transmission, the transmission bandwidth is 400Kbps, and the required storage space is 5120 x 18bit=90Kb, The transmission time is 90Kb/400Kbps=0.225 seconds. It can be seen that by using the multimedia data processing method of the present invention, storage space and transmission time are reduced by 99.53%. Therefore, the multimedia data processing method of the present invention can effectively reduce the storage space and transmission time of the multimedia data, which helps to improve the processing efficiency of the multimedia data.

Please refer to FIG. 7, which is a schematic structural diagram of a multimedia data processing device according to an embodiment of the present invention. Specifically, the multimedia data processing device includes a memory 701, a processor 702, and a data interface 703. It should be understood that FIG. 7 and the related description in this text are only used as an example of the multimedia data processing device, which should not be regarded as a specific limitation of the multimedia data processing device, and the multimedia data processing device may also include other components.

The memory 701 may include a volatile memory (volatile memory); the memory 701 may also include a non-volatile memory (non-volatile memory); the memory 701 may also include a combination of the foregoing types of memories. The processor 702 may be a central processing unit (CPU). The processor 702 may further include a hardware multimedia data processing device. The foregoing hardware multimedia data processing device may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. For example, it may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), or any combination thereof.

Further, the memory 701 is used to store a program, and when the program is executed, the processor 702 can call the program stored in the memory 701 to perform the following steps:

Acquiring the first multimedia data set to be processed;

Further, the first multimedia data includes image data; the processor 702 encodes the first multimedia data in the first multimedia data set to determine the first multimedia data When the offset of the data, it is specifically used for:

Acquiring the image resolution of the first image data set to be processed;

The first image data in the first image data set is encoded according to the image resolution to determine the offset of the first image data.

Further, when the processor 702 encodes the first image data in the first image data set according to the image resolution to determine the offset of the first image data, it is specifically configured to:

Determine the position information of the first image data in the first image data set according to the image resolution;

The offset of the first image data is determined according to the position information.

Further, when the processor 702 determines the position information of the first image data in the first image data set according to the image resolution, it is specifically configured to:

Determine the image coordinates of the first image data according to the image resolution;

According to the image coordinates of the first image data, the position information of the first image data in the first image data set is determined.

Further, when the processor 702 determines the offset of the first image data according to the position information, it is specifically configured to:

Determining a location mark of the first image data according to the location information;

Determine the offset of the first image data according to the position mark of the first image data.

Further, when the processor 702 determines the offset of the first image data according to the position mark of the first image data, it is specifically configured to:

Determining, according to the position information, a first position mark of the first image data in a predetermined position sequence in the first image data set as the offset of the first image data;

Determining the second position mark of the next image data of the first image data according to the predetermined position sequence;

It is determined that the difference between the second position mark and the first position mark is the offset of the next image data.

Further, the first multimedia data set and the second multimedia data set include a bad point table or a corrected grid table.

Further, the multimedia data includes audio data; the processor 702 encodes the first multimedia data in the first multimedia data set to determine the offset of the first multimedia data When measuring, it is specifically used for:

Acquiring first audio data in the first audio data set to be processed;

The first audio data is encoded to determine the offset of the first audio data.

Further, when the processor 702 encodes the first audio data to determine the offset of the first audio data, it is specifically configured to:

Acquiring the volume value of the first audio data;

The offset of the first audio data is determined according to the volume value of the first audio data.

Further, when the processor 702 determines the offset of the first audio data according to the volume value of the first audio data, it is specifically configured to:

Determining, according to a preset sequence, that the first volume value of the first audio data is the offset of the first audio data;

Determining the second volume value of the next audio data of the first audio data according to the preset order;

It is determined that the difference between the second volume value and the first volume value is an offset value of the next volume data.

Further, when the processor 702 processes the first multimedia data according to the second multimedia data set, it is specifically configured to:

Decode the second multimedia data set to obtain the offset of the first multimedia data;

The first multimedia data is processed according to the offset of the first multimedia data, the address jump data, and the end identifier of the second multimedia data set.

Further, the first multimedia data set and the second multimedia data set include a dead point table; the processor 702 according to the offset of the first multimedia data, addressing jump data, and The end identifier of the second multimedia data set is specifically used when processing the first multimedia data:

Decoding the second dead point table to obtain the offset of the dead point in the first dead point table;

According to the offset of the dead point in the first dead point table, the address jump data, and the end identifier of the second dead point table, corrective processing is performed on the dead point in the first dead point table.

Further, the address jump data is configured to handle an offset exceeding a predefined value.

Further, when the processor 702 obtains the first image data set to be processed, it is specifically configured to:

Acquiring the image coordinates of the abnormal image data of the image to be processed;

It is determined that image data corresponding to the image coordinates of the abnormal image data constitutes the first image data set.

Obtain the abnormal image data mark of the image to be processed;

It is determined that the image data corresponding to the abnormal image data mark constitutes the first image data set.

In the embodiment of the present invention, a computer-readable storage medium is also provided. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the multimedia described in the embodiment of the present invention The data processing method can also implement the multimedia data processing device corresponding to the embodiment of the present invention described in FIG. 7, and will not be repeated here.

The computer-readable storage medium may be an internal storage unit of the device described in any of the foregoing embodiments, such as a hard disk or memory of the device. The computer-readable storage medium may also be an external storage device of the device, such as a plug-in hard disk equipped on the device, a Smart Media Card (SMC), or a Secure Digital (SD) card. , Flash Card, etc. Further, the computer-readable storage medium may also include both an internal storage unit of the device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the device. The computer-readable storage medium can also be used to temporarily store data that has been output or will be output.

A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments. Wherein, the storage medium can be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

The above-disclosed are only some embodiments of the present invention, which of course cannot be used to limit the scope of rights of the present invention. Therefore, equivalent changes made according to the claims of the present invention still fall within the scope of the present invention.

Claims

A multimedia data processing method, characterized in that it comprises:

Acquiring the first multimedia data set to be processed;

Encoding the first multimedia data in the first multimedia data set to determine the offset of the first multimedia data;

Determine a second multimedia data set according to the offset of the first multimedia data, so as to process the first multimedia data according to the second multimedia data set.
The method according to claim 1, wherein the first multimedia data includes image data; and the first multimedia data in the first multimedia data set is encoded to determine The offset of the first multimedia data includes:

Acquiring the image resolution of the first image data set to be processed;

The first image data in the first image data set is encoded according to the image resolution to determine the offset of the first image data.
The method according to claim 2, wherein the first image data in the first image data set is encoded according to the image resolution to determine the offset of the first image data ,include:

Determine the position information of the first image data in the first image data set according to the image resolution;

The offset of the first image data is determined according to the position information.
The method according to claim 3, wherein the determining the position information of the first image data in the first image data set according to the image resolution comprises:

Determine the image coordinates of the first image data according to the image resolution;

According to the image coordinates of the first image data, the position information of the first image data in the first image data set is determined.
The method according to claim 3, wherein the determining the offset of the first image data according to the position information comprises:

Determining a location mark of the first image data according to the location information;

Determine the offset of the first image data according to the position mark of the first image data.
The method according to claim 5, wherein the determining the offset of the first image data according to the position mark of the first image data comprises:

Determining, according to the position information, a first position mark of the first image data in a predetermined position sequence in the first image data set as the offset of the first image data;

Determining the second position mark of the next image data of the first image data according to the predetermined position sequence;

It is determined that the difference between the second position mark and the first position mark is the offset of the next image data.
The method according to any one of claims 1 to 6, wherein the first multimedia data set and the second multimedia data set include a bad point table or a corrected grid table.
The method according to claim 1, wherein the multimedia data includes audio data; and the first multimedia data in the first multimedia data set is encoded to determine the first multimedia data The offset of multimedia data, including:

Acquiring first audio data in the first audio data set to be processed;

The first audio data is encoded to determine the offset of the first audio data.
The method according to claim 8, wherein the encoding the first audio data to determine the offset of the first audio data comprises:

Acquiring the volume value of the first audio data;

The offset of the first audio data is determined according to the volume value of the first audio data.
The method according to claim 8, wherein the determining the offset of the first audio data according to the volume value of the first audio data comprises:

Determining the first volume value of the first audio data as the offset of the first audio data according to a preset sequence;

Determining the second volume value of the next audio data of the first audio data according to the preset order;

It is determined that the difference between the second volume value and the first volume value is an offset value of the next volume data.
The method according to claim 1, wherein the processing the first multimedia data according to the second multimedia data set comprises:

Decode the second multimedia data set to obtain the offset of the first multimedia data;

The first multimedia data is processed according to the offset of the first multimedia data, the address jump data, and the end identifier of the second multimedia data set.
The method according to claim 11, wherein the first multimedia data set and the second multimedia data set include a bad point table; the offset according to the first multimedia data , Addressing the jump data and the end identifier of the second multimedia data set, and processing the first multimedia data, including:

Decoding the second dead point table to obtain the offset of the dead point in the first dead point table;

According to the offset of the dead point in the first dead point table, the address jump data, and the end identifier of the second dead point table, corrective processing is performed on the dead point in the first dead point table.
According to the method of claim 11 or 12, the address jump data is configured to handle an offset exceeding a predefined value.
The method according to claim 2, wherein said acquiring the first image data set to be processed comprises:

Acquiring the image coordinates of the abnormal image data of the image to be processed;

It is determined that image data corresponding to the image coordinates of the abnormal image data constitutes the first image data set.
The method according to claim 2, wherein said acquiring the first image data set to be processed comprises:

Obtain the abnormal image data mark of the image to be processed;

It is determined that the image data corresponding to the abnormal image data mark constitutes the first image data set.
A multimedia data processing device, which is characterized by comprising: a memory and a processor;

The memory is used to store programs;

The processor is used to call the program, and when the program is executed, it is used to perform the following operations:

Acquiring the first multimedia data set to be processed;

Encoding the first multimedia data in the first multimedia data set to determine the offset of the first multimedia data;

Determine a second multimedia data set according to the offset of the first multimedia data, so as to process the first multimedia data according to the second multimedia data set.
The device according to claim 16, wherein the first multimedia data comprises image data; the processor encodes the first multimedia data in the first multimedia data set, When determining the offset of the first multimedia data, it is specifically used to:

Acquiring the image resolution of the first image data set to be processed;

The first image data in the first image data set is encoded according to the image resolution to determine the offset of the first image data.
The device according to claim 17, wherein the processor encodes the first image data in the first image data set according to the image resolution to determine the bias of the first image data When moving, it is specifically used for:

Determine the position information of the first image data in the first image data set according to the image resolution;

The offset of the first image data is determined according to the position information.
The device according to claim 18, wherein when the processor determines the position information of the first image data in the first image data set according to the image resolution, it is specifically configured to:

Determine the image coordinates of the first image data according to the image resolution;

According to the image coordinates of the first image data, the position information of the first image data in the first image data set is determined.
The device according to claim 18, wherein when the processor determines the offset of the first image data according to the position information, it is specifically configured to:

Determining a location mark of the first image data according to the location information;

Determine the offset of the first image data according to the position mark of the first image data.
The device according to claim 20, wherein the processor is specifically configured to: when determining the offset of the first image data according to the position mark of the first image data:

Determining, according to the position information, a first position mark of the first image data in a predetermined position sequence in the first image data set as the offset of the first image data;

Determining the second position mark of the next image data of the first image data according to the predetermined position sequence;

It is determined that the difference between the second position mark and the first position mark is the offset of the next image data.
The device according to any one of claims 16-21, wherein the first multimedia data set and the second multimedia data set comprise a bad point table or a corrected grid table.
The device according to claim 16, wherein the multimedia data comprises audio data; and the processor encodes the first multimedia data in the first multimedia data set to determine the The offset of the first multimedia data is specifically used for:

Acquiring first audio data in the first audio data set to be processed;

The first audio data is encoded to determine the offset of the first audio data.
The device according to claim 23, wherein when the processor encodes the first audio data to determine the offset of the first audio data, it is specifically configured to:

Acquiring the volume value of the first audio data;

The offset of the first audio data is determined according to the volume value of the first audio data.
The device according to claim 23, wherein when the processor determines the offset of the first audio data according to the volume value of the first audio data, it is specifically configured to:

Determining, according to a preset sequence, that the first volume value of the first audio data is the offset of the first audio data;

Determining the second volume value of the next audio data of the first audio data according to the preset order;

It is determined that the difference between the second volume value and the first volume value is an offset value of the next volume data.
The device according to claim 16, wherein when the processor processes the first multimedia data according to the second multimedia data set, it is specifically configured to:

Decode the second multimedia data set to obtain the offset of the first multimedia data;

The first multimedia data is processed according to the offset of the first multimedia data, the address jump data, and the end identifier of the second multimedia data set.
The device according to claim 26, wherein the first multimedia data set and the second multimedia data set include a bad point table; and the processor is based on the bias of the first multimedia data The shift amount, the addressing jump data, and the end identifier of the second multimedia data set are specifically used when processing the first multimedia data:

Decoding the second dead point table to obtain the offset of the dead point in the first dead point table;

According to the offset of the dead point in the first dead point table, the address jump data, and the end identifier of the second dead point table, corrective processing is performed on the dead point in the first dead point table.
The device according to claim 26 or 27, the address jump data is configured to handle an offset exceeding a predefined value.
The device according to claim 17, wherein when the processor obtains the first image data set to be processed, it is specifically configured to:

Acquiring the image coordinates of the abnormal image data of the image to be processed;

It is determined that image data corresponding to the image coordinates of the abnormal image data constitutes the first image data set.
The device according to claim 17, wherein when the processor obtains the first image data set to be processed, it is specifically configured to:

Obtain the abnormal image data mark of the image to be processed;

It is determined that the image data corresponding to the abnormal image data mark constitutes the first image data set.
A computer-readable storage medium storing a computer program, wherein the computer program is executed by a processor to implement the method according to any one of claims 1 to 15.