WO2014015688A1

WO2014015688A1 - Method, device and system for processing multimedia data

Info

Publication number: WO2014015688A1
Application number: PCT/CN2013/074634
Authority: WO
Inventors: 李昭早
Original assignee: 华为技术有限公司
Priority date: 2012-07-25
Filing date: 2013-04-24
Publication date: 2014-01-30
Also published as: CN102801969A

Abstract

Disclosed are a method, device and system for processing multimedia data, which belong to the field of information technology. The method comprises: each coding device in a plurality of coding devices coding multimedia data by means of a multi-path coding channel to obtain multi-path coded data; and packetizing the multi-path coded data and sending the packetized data to a corresponding direct memory access (DMA) cache in a transmission device, and unpacking the packetized data in the DMA cache and transmitting the unpacked data by the transmission device. By adopting the method of cascading a plurality of coding devices and a transmission device, the present invention realizes apportioning multi-path video coding among the plurality of coding devices, which can solve the problem of excessive load of a single coding device. By adopting a DMA transmission mechanism, not only the stability of code stream transmission of each coding device can be ensured, but also the multithread parallel processing of a code stream can be realized. By adopting the method of packetization sending, the efficiency of DMA transmission is improved, and the power consumption of the CPU is lowered.

Description

Method, device and system for processing multimedia data The present application claims priority to Chinese patent application filed on July 25, 2012 by the Chinese Patent Office, Application No. 201210258841.3, entitled "Method, Apparatus and System for Processing Multimedia Data" The entire contents of which are incorporated herein by reference. Technical field

The present invention relates to the field of information technology, and in particular, to a method, device and system for processing multimedia data. Background technique

With the rapid development of multimedia technology, video has entered the high-definition era, and its application range has become wider and wider. It is a video application with a wide range of applications by processing multimedia data and encoding it to achieve multi-channel video surveillance. In order to provide users with clearer video images and high-definition video images, how to encode and transmit multimedia data has become a key issue in multi-channel video surveillance applications.

In the prior art, when encoding and transmitting multimedia data, multi-channel multimedia data is collected by a single chip, and the collected multimedia data is encoded to obtain encoded data, and then the encoded data is transmitted to an external storage device or transmitted through a network.

In the process of implementing the present invention, the inventors have found that the prior art has at least the following problems: Since the prior art processes multimedia data, its data acquisition, data encoding, and code stream transmission processes are all implemented on one chip, for multiple paths. In the case of video surveillance, the amount of data of the multimedia data is large, which results in excessive chip coding load in the prior art, and thus the processing efficiency of the multimedia data is low. Summary of the invention

In order to solve the problems of the prior art, embodiments of the present invention provide a method, apparatus, and system for processing multimedia data. The technical solution is as follows:

In a first aspect, a method for processing multimedia data is provided, the method comprising: encoding, by each of a plurality of encoding devices, multimedia data through a multi-pass encoding channel Packing the multiplexed encoded data, and transmitting the packed data to a corresponding DMA (Direct Memory Access) cache in the transmission device, and disassembling the packed data in the DMA cache by the transmitting device And transfer the disassembled data.

With reference to the first aspect, in a first possible implementation manner of the first aspect, the packetizing the multiple encoded data includes:

Acquiring the encoded data outputted by each coding channel in turn, and packaging the obtained encoded data of each coding channel into a data packet;

Or, the encoded data outputted by each coding channel is sequentially obtained, and after the obtained encoded data reaches a threshold, the obtained encoded data is packaged into one data packet.

In conjunction with the first aspect or the first possible implementation of the first aspect, in a second possible implementation manner of the first aspect, the packet data is sent to a corresponding direct memory access DMA buffer in the transmission device, Specifically include:

Querying the empty queue of the corresponding DMA cache, and acquiring the address of the empty queue; sending the packetized data to the empty queue of the corresponding DMA buffer according to the address of the empty queue, and converting the empty queue to A data queue, the address of the data queue is the same as the address of the empty queue.

In conjunction with the second possible implementation of the first aspect, in a third possible implementation manner of the first aspect, the sending, according to the address of the empty queue, the packet data to the empty queue of the corresponding DMA cache After the empty queue is converted into a data queue, the method further includes:

Sending a data transmission completion notification to the transmission device, where the data transmission completion notification carries an address of the data queue, so that the transmission device disassembles the package in the corresponding DMA buffer according to the address of the data queue data.

With the second possible implementation of the first aspect or the third possible implementation of the first aspect, in a fourth possible implementation manner of the first aspect, the After the data is sent to the empty queue of the corresponding DMA cache, and after the empty queue is converted into the data queue, the method further includes:

Receiving, by the transmitting device, a data transmission completion notification sent after the disassembled data transmission, where the data transmission completion notification carries an address of the data queue;

Release the data queue of the corresponding DMA cache according to the address of the data queue, and turn the data queue into an empty queue. In a second aspect, an encoding apparatus is provided, the apparatus comprising:

An encoding module, configured to encode multimedia data through a multi-pass encoding channel to obtain multiplexed encoded data;

a packet module, configured to package the multiplexed data encoded by the coding module, where the first sending module is configured to send the packaged data obtained by the packaging module to a corresponding direct memory access DMA buffer in the transmission device, The transmitting device disassembles the packed data in the DMA buffer and transmits the disassembled data.

With reference to the second aspect, in a first possible implementation manner of the second aspect, the packetizing module is specifically configured to sequentially obtain the encoded data output by each coding channel, and obtain the encoded data output by each coding channel. The packets are respectively packaged into one data packet; or, the encoded data output by each coding channel is sequentially obtained, and after the obtained encoded data reaches a threshold, the obtained encoded data is packaged into one data packet.

With reference to the second aspect, or the first possible implementation manner of the second aspect, in the second possible implementation manner of the second aspect, the first sending module includes:

a query unit, configured to query an empty queue of the corresponding DMA cache;

An obtaining unit, configured to obtain an address of an empty queue that is queried by the query unit;

a sending unit, configured to send the packetized data to the empty queue of the corresponding DMA buffer according to the address of the empty queue acquired by the acquiring unit, to convert the empty queue into a data queue, where the address of the data queue is The addresses of the empty queues are the same.

With reference to the second possible implementation of the second aspect, in a third possible implementation manner of the second aspect, the device further includes:

a second sending module, configured to send a data transmission completion notification to the transmission device, where the data transmission completion notification carries an address of the data queue, so that the transmission device disassembles the address according to an address of the data queue The packed data in the corresponding DMA buffer.

With reference to the second possible implementation of the second aspect, or the third possible implementation of the second aspect, in a fourth possible implementation manner of the second aspect, the apparatus,

a receiving module, configured to receive, by the transmitting device, a data transmission completion notification sent after the disassembled data transmission, where the data transmission completion notification carries an address of the data queue;

And a release module, configured to release the data queue of the corresponding DMA cache according to an address of the data queue received by the receiving module, to convert the data queue into an empty queue.

In a third aspect, a method for processing multimedia data is provided, the method comprising: Transmitting means acquiring, by the each of the plurality of encoding devices, the packed data sent to the corresponding direct memory access DMA buffer in the transmitting device;

Disassembling the packed data in the DMA buffer, and transmitting the disassembled data; wherein the packed data is that each of the encoding devices encodes the multimedia data through the multi-pass encoding channel to obtain the multi-channel encoded data. And data obtained by packing the multiplexed encoded data.

With reference to the third aspect, in a first possible implementation manner of the third aspect, the transmitting device acquires, by each of the plurality of encoding devices, the packet sent to the corresponding direct memory access DMA buffer in the transmitting device Before the data, it also includes:

Receiving, by the receiving device, a data transmission completion notification, where the data transmission completion notification carries an address of the data queue of the corresponding DMA buffer, the data queue stores the packed data; and the transmission device acquires multiple coding devices The packet data sent by each of the encoding devices to the corresponding direct memory access DMA buffer in the transmitting device includes:

Obtaining, according to the address of the data queue of the corresponding DMA buffer carried in the data transmission completion notification, the packet data sent by each of the plurality of encoding devices to the corresponding direct memory access DMA buffer in the transmitting device.

With the first possible implementation of the third aspect, in the second possible implementation manner of the third aspect, after the disassembling the data, the method further includes:

Sending a data transmission completion notification to the corresponding coding apparatus, where the data transmission completion notification carries the address of the data queue, so that the coding apparatus releases the data queue of the corresponding DMA buffer according to the address of the data queue. Turn the data queue into an empty queue.

In a fourth aspect, a transmission device is provided, the device comprising:

An obtaining module, configured to acquire, by using each of the plurality of encoding devices, the packed data sent by the corresponding direct memory access DMA buffer in the transmitting device; wherein the packed data is multi-channel for each encoding device After the encoding channel encodes the multimedia data to obtain the multiplexed encoded data, the data obtained by packing the multiplexed encoded data;

a disassembling module, configured to disassemble the packaged data in the DMA cache acquired by the obtaining module;

a transmission module, configured to transmit data disassembled by the disassembly module.

With reference to the fourth aspect, in a first possible implementation manner of the fourth aspect, the device further includes:

a receiving module, configured to receive a data transmission completion notification sent by the encoding device, where the data is sent The address of the data queue of the corresponding DMA cache is carried in the notification, and the packaged data is stored in the data queue;

The acquiring module is configured to acquire, according to the address of the data queue of the corresponding DMA cache carried in the data sending completion notification, each encoding device of the plurality of encoding devices to the corresponding direct memory in the transmitting device Access the packed data sent by the DMA cache.

With reference to the first possible implementation of the fourth aspect, in a second possible implementation manner of the fourth aspect, the device,

a sending module, configured to send a data transmission completion notification to the corresponding encoding device, where the data transmission completion notification carries an address of the data queue, so that the encoding device releases the corresponding DMA according to the address of the data queue The cached data queue causes the data queue to be converted to an empty queue.

In a fifth aspect, a system for processing multimedia data is provided, the system comprising: a plurality of encoding devices and a transmitting device;

Each of the plurality of encoding devices is an encoding device as described above;

The transmission device is a transmission device as described above.

The beneficial effects brought by the technical solutions provided by the embodiments of the present invention are:

By cascading a plurality of encoding devices and a transmitting device, the multi-channel video encoding is distributed to a plurality of encoding devices, thereby solving the problem that the encoding power of the single encoding device is too heavy; in addition, by adopting a DMA transmission mechanism, The encoding device controls to send the packed data to the corresponding DMA buffer in the transmitting device, so that the encoding device can uniformly manage the queue in the DMA buffer in the transmitting device, not only can ensure the stability of the code stream transmission of each encoding device, but also can The multi-thread parallel processing code stream is realized, thereby improving the processing efficiency of the multimedia data. DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Other drawings may also be obtained from those of ordinary skill in the art in light of the inventive work.

FIG. 1 is a flowchart of a method for processing multimedia data according to an embodiment of the present invention;

2 is a flow chart of another method for processing multimedia data according to an embodiment of the present invention; FIG. 3 is a flowchart of a method for processing multimedia data according to another embodiment of the present invention; FIG. 4 is another embodiment of the present invention; A schematic diagram of the structure of the first encoding device provided; FIG. 5 is a schematic structural diagram of a second encoding apparatus according to another embodiment of the present invention; FIG.

6 is a schematic structural diagram of a third encoding apparatus according to another embodiment of the present invention;

FIG. 7 is a schematic structural diagram of a fourth encoding apparatus according to another embodiment of the present invention; FIG.

FIG. 8 is a schematic structural diagram of a first transmission apparatus according to another embodiment of the present invention; FIG.

FIG. 9 is a schematic structural diagram of a second transmission apparatus according to another embodiment of the present invention; FIG.

FIG. 10 is a schematic structural diagram of a third transmission apparatus according to another embodiment of the present invention; FIG. 11 is a schematic structural diagram of a system for processing multimedia data according to another embodiment of the present invention. detailed description

The embodiments of the present invention will be further described in detail below with reference to the accompanying drawings. The embodiment of the present invention provides a method for processing multimedia data. The method for performing the method by the encoding device is taken as an example. Referring to FIG. 1 , the process of the method provided by the embodiment of the present invention is as follows:

101: each of the plurality of encoding devices encodes the multimedia data through the multi-pass encoding channel to obtain the multiplexed encoded data;

102: Packet the multi-coded data, and send the packed data to a corresponding DMA buffer in the transmission device, and the transport device disassembles the packed data in the DMA buffer and transmits the disassembled data.

Wherein, the multi-channel encoded data is packaged, including but not limited to:

Further, the packet data is sent to the corresponding direct memory access DMA buffer in the transmission device, which specifically includes:

Query the empty queue of the corresponding DMA buffer, and obtain the address of the empty queue;

The packed data is sent to the empty queue of the corresponding DMA buffer according to the address of the empty queue, so that the empty queue is converted into the data queue, and the address of the data queue is the same as the address of the empty queue.

Further, after the packet data is sent to the empty queue of the corresponding DMA buffer according to the address of the empty queue, after the empty queue is converted into the data queue, the method further includes: The data transmission completion notification is sent to the transmission device, and the data transmission completion notification carries the address of the data queue, so that the transmission device disassembles the packaged data in the corresponding DMA buffer according to the address of the data queue.

The packet is sent to the empty queue of the corresponding DMA buffer according to the address of the empty queue, and after the empty queue is converted into the data queue, the method further includes:

The receiving transmission device notifies the data transmission completion after the disassembled data transmission, and the data transmission completion notification carries the address of the data queue;

The data queue of the corresponding DMA buffer is released according to the address of the data queue, and the data queue is turned into an empty queue.

For example, referring to FIG. 2, the method of the method provided by the embodiment of the present invention is as follows:

201: The transmitting device acquires the packed data sent by each of the plurality of encoding devices to the corresponding direct memory access DMA buffer in the transmitting device;

202: Disassemble the packed data in the DMA buffer and transmit the disassembled data.

Further, before the transmitting device acquires the packed data sent by each of the plurality of encoding devices to the direct memory access DMA buffer corresponding to the transmitting device, the transmitting device further includes:

Receiving a data transmission completion notification sent by the encoding device, the data transmission completion notification carries the address of the corresponding DMA buffer data queue, and the data queue stores the packed data;

The transmitting device acquires the packetized data sent by each of the plurality of encoding devices to the corresponding direct memory access DMA buffer in the transmitting device, and specifically includes:

The packed data sent by each of the plurality of encoding devices to the corresponding direct memory access DMA buffer in the transmitting device is acquired according to the address of the data queue of the corresponding DMA buffer carried in the data transmission completion notification.

Further, after transmitting the disassembled data, the method further includes:

The data transmission completion notification is sent to the corresponding coding apparatus, and the data transmission completion notification carries the address of the data queue, so that the coding apparatus releases the corresponding DMA buffer data queue according to the address of the data queue, and the data queue is turned into an empty queue.

The method provided by the embodiment of the present invention achieves the problem that the multi-channel video coding is over-committed by using a plurality of coding devices and the transmission device to be cascaded, thereby solving the problem that the coding load of the single-encoding device is too heavy; By using a DMA transfer mechanism, and by the encoding device to control the transmission of the packed data to the corresponding DMA buffer in the transmission device, the encoding device can uniformly manage the queues in the DMA buffer in the transmission device, and can not only ensure the code stream of each encoding device. Transmission stability, and It is also possible to implement multi-thread parallel processing of the code stream, thereby improving the processing efficiency of the multimedia data.

In order to clarify the method provided by the foregoing embodiment, the method for processing multimedia data is exemplified by taking the following embodiments as an example. For details, refer to the following embodiments: Another embodiment of the present invention provides a process. The method for the multimedia data is combined with the content of the foregoing embodiment. For the convenience of the description, the method for processing the multimedia data is implemented by using two encoding devices and one transmitting device as an example, and the method provided by the embodiment of the present invention is exemplified in detail. Referring to FIG. 3, the process of the method provided by the embodiment of the present invention is specifically as follows:

301: each of the two encoding devices encodes the multimedia data through the multi-pass encoding channel to obtain the multi-channel encoded data.

For this step, the manner in which the encoding device encodes the multimedia data can be implemented by encoding the multimedia data according to the existing encoding chip, which is not specifically limited in this embodiment. For example, each encoding device corresponds to four encoding channels, and the multimedia data is encoded by each encoding channel to obtain four encoded data.

302: each encoding device packages the multi-coded data, and sends the packed data to a corresponding DMA buffer in the transmission device;

The DMA buffer is a DMA buffer in the transmission device. In order to enable each encoding device to transmit the packetized data to the transmission device, in the method provided in this embodiment, the DMA corresponding to each encoding device may be separately set in the transmission device. Cache, that is, one encoding device corresponds to one DMA buffer in the transmitting device, and the number of encoding devices is the same as the number of DMA buffers in the transmitting device, so that different encoding devices send their packed data to their respective DMA buffers. in. In addition, it is also possible to set only one DMA buffer at the transmission device and distinguish which part of the DMA buffer each encoding device corresponds to, thereby also enabling the encoding device to send its packed data to the corresponding in the DMA buffer. position. Of course, the corresponding relationship between the encoding device and the DMA buffer may be other methods, which is not specifically limited in this embodiment.

Specifically, when each encoding device packages the multi-pass encoding, the packaging manner adopted includes, but is not limited to, one of the following two methods:

The first mode: sequentially obtaining the encoded data outputted by each coding channel, and packaging the obtained encoded data of each coding channel into a data packet;

For this method, the encoding device has three encoding channels as an example, and the encoding device obtains the encoded data obtained by encoding the first encoding channel, and packs it into a data packet, and then acquires the second encoding. The coded channel encodes the encoded data, and packs it into a data packet, and then obtains the encoded data obtained by the third coding channel coding, and packs it into a data packet. Alternatively, the encoded data obtained by encoding the 3 channels of the coding channel are respectively obtained, and then the obtained 3 channels of the encoded data are respectively packaged into one data packet.

The second method: sequentially obtains the encoded data outputted by each coding channel, and after the obtained encoded data reaches the threshold, packages the obtained encoded data into a data packet.

For the method, when the encoded data output by each coding channel is sequentially acquired, the specific process is: if one coding channel outputs no encoded data at the time of acquiring the encoded data, immediately jumps to the next coding channel to obtain the encoded data; When one code channel receives the coded data at the time of acquiring the coded data, the coded data is immediately taken out; and the data is sequentially taken from each code channel. For example, when there are three coding channels in the coding device, respectively, channel 1, channel 2 and channel 3, data is taken from channel 1 first, and if channel 1 has coded data at this time, the coded data in channel 1 is obtained, and Skip to the next channel to continue to obtain the encoded data; if channel 1 has no encoded data at this time, immediately jump to the next channel to obtain the encoded data; sequentially loop the encoded data from the 3 channels until the size of the encoded data is obtained. The threshold is reached, and the obtained encoded data is packaged into one data packet. The specific threshold size may be 100 megabytes, 150 megabytes or other values. This embodiment does not specifically limit the threshold size.

Further, when the encoding device sends the packaged data to the corresponding DMA buffer in the transmission device, the empty queue of the corresponding DMA buffer may be queried first, and the address of the empty queue is obtained; and the packaged data is sent to the address according to the address of the empty queue. In the empty queue of the corresponding DMA buffer, the empty queue is converted into a data queue, and the address of the data queue is the same as the address of the empty queue. Of course, in addition to the foregoing sending manner, the encoding device may also send the packed data to the DMA buffer by using another sending manner. This embodiment does not specifically limit the sending manner in which the packed data is sent to the corresponding DMA buffer in the transmitting device.

Regardless of which packaging method is used to obtain the packed data, and which transmission method is used to transmit it, for the first packing mode described above, the encoding device packs the encoded data outputted by each encoding channel into one data packet respectively. It can be sent to the corresponding DMA buffer in the transmission device immediately. Since the encoded data outputted by each coding channel is separately packaged into one data packet, it is transmitted immediately, so that the output of each coding channel can be guaranteed. The encoded data can be transmitted in time; for the second packing mode, after the size of the acquired encoded data reaches a threshold, the encoding device packs the obtained encoded data into a data packet, and then sends the encoded data to a corresponding device in the transmission device. DMA In the buffer, since the encoding device packs the encoded data reaching the threshold into one data packet for transmission, the transmission of the large data is realized, which not only can reduce the data transmission efficiency and the number of transmissions, but also reduce the waste due to multiple data transmission. The CPU (Central Processing Unit) is consumed.

303: The transmitting device acquires the packed data sent by the encoding device to the corresponding DMA buffer in the transmitting device.

For this step, the manner in which the transmitting device obtains the packetized data sent by the encoding device to the corresponding DMA buffer in the transmitting device includes but is not limited to one of the following two methods:

The first mode: the transmitting device actively acquires the packaged data sent by the encoding device to the corresponding DMA buffer in the transmitting device every preset period;

For this method, taking the preset period as 5 seconds as an example, the transmission device acquires data from the DMA buffer in the transmission device every 5 seconds, taking the DMA buffer with 10 queues as an example, and the 10 queues are sequentially numbered 1 To 10. The transmission device traverses all queues in the DMA buffer every 5 seconds. If the transmitting device queries the queue 5 as a data queue, including the packed data sent by the encoding device to the corresponding DMA buffer in the transmitting device, the packed data is immediately acquired and disassembled. The preset period size may be other sizes in addition to the above 5 seconds. This embodiment does not limit the specific size of the preset period.

The second mode: triggering, by a preset trigger condition, the transmitting device to passively acquire the packed data sent by the encoding device to the corresponding DMA buffer in the transmitting device;

In this manner, after the encoding device sends the packet data to the empty queue of the corresponding DMA buffer by using the preset trigger condition, the data transmission completion notification is sent to the transmission device, and the data queue is carried in the data transmission completion notification. As an example, the transmission device receives the data transmission completion notification sent by the coding device, and the trigger transmission device acquires the packaged data in the data queue corresponding to the DMA buffer according to the address of the data queue. In addition, after the encoding device sends the data transmission completion notification to the transmission device as a preset trigger condition, other trigger conditions may be preset. In this embodiment, the trigger transmission device does not passively acquire the corresponding DMA in the transmission device from the encoding device. The trigger condition for the packaged data sent by the cache is limited.

Of course, in addition to the two methods for the foregoing transmission device to obtain the packetized data, the transmission device may obtain the packetized data by using other acquisition methods. In this embodiment, the acquisition device does not acquire the method for obtaining the packaged data by the encoding device to the corresponding DMA buffer in the transmission device. Specific restrictions are made.

304: The transmitting device disassembles the packed data in the DMA buffer and transmits the disassembled data. For this step, after the transmission device obtains the packetized data through the above-mentioned step 303, the packetized data is disassembled, and the specific disassembly method can be implemented according to the existing unpacking mode, which is not specifically limited in this embodiment. Regardless of which disassembly method is used to disassemble the packed data, each encoded data can be disassembled, and the disassembled encoded data is transmitted, for example, the disassembled data is transmitted to the storage space. Save the file or transfer it to the network.

Further, after the transmission device transmits the disassembled data, the data queue storing the packaged data corresponding to the disassembled data can be released, thereby realizing resource reuse. In a specific implementation, after the transmission device completes the disassembled data transmission, the transmission device sends a data transmission completion notification to the corresponding coding device, and carries the address of the data queue in the data transmission completion notification, so that the coding device is enabled. The data queue corresponding to the DMA buffer in the transmission device is released according to the address of the data queue, even if the data queue is turned into an empty queue for subsequent reuse. Of course, in addition to the manner in which the foregoing transmission device notifies the encoding device to release the data queue, other notification manners may be adopted, which is not specifically limited in this embodiment.

In addition, since each encoding device corresponds to a DMA buffer in one transmission device, or corresponds to a part of a DMA buffer, in order to enable the transmission device to specify which encoding device the data queue to be released currently corresponds to, which embodiment, the embodiment In the above step 303, when the encoding device transmits a data transmission completion notification to the transmission device, the identifier of the encoding device carrying the packetized data may be notified by the data transmission completion, so that the transmission device distinguishes which one is by the identifier. The encoding device transmits the packed data to the transmitting device, that is, which encoding device the data queue currently to be released corresponds to. The specific identifier of the encoding device may be the number, MAC address or other identifier of the encoding device. This embodiment does not limit the specific identifier of the encoding device. The coding device number is used as an example of the coding device, and the coding device numbered 1 transmits the packet data to the transmission device, and then transmits a data transmission completion notification to the transmission device. In addition to carrying the address of the data queue storing the packed data, carrying the number 1 of the encoding device that transmits the packed data, the transmitting device sends the encoded data in the data queue to the encoding device numbered 1 after the packet data is disassembled and transmitted. Returning the transmission completion notification of the address carrying the data queue, so that the coding device numbered 1 releases the data queue corresponding to the address of the data queue carried in the data transmission completion notification, even if the data queue is turned into an empty queue, and the empty queue can be Continue to use the next time you send the packaged data.

It should be noted that the above content is only described by using two encoding devices and one transmission device to process multimedia data. In actual applications, the number of encoding devices may be other numbers, which may be set according to actual coding requirements. This embodiment does not limit the specific number of encoding devices. Set. When the number of the encoding devices is one, an encoding device and a transmitting device can implement the processing of the multimedia data by using the foregoing method. The specific implementation process is consistent with the foregoing steps 301 to 304, and details are not described herein again.

The method provided in this embodiment achieves the problem that the multi-channel video coding is distributed to multiple coding devices by using multiple coding devices and the transmission device to be cascaded, thereby solving the problem that the coding load of the single coding device is too heavy; The DMA transmission mechanism is adopted, and the encoding device controls the transmission of the packet data to the corresponding DMA buffer in the transmission device, so that the encoding device can uniformly manage the queues in the DMA buffer in the transmission device, and can not only ensure the code stream transmission of each encoding device. The stability, but also enables multi-threaded parallel processing of the code stream, thereby improving the processing efficiency of multimedia data. Another embodiment of the present invention provides an encoding apparatus for performing the functions of the encoding apparatus in the method for processing multimedia data provided by the above embodiments. Referring to FIG. 4, the apparatus includes:

The encoding module 41 is configured to encode the multimedia data through the multi-pass encoding channel to obtain the multi-channel encoded data;

The packetizing module 42 is configured to package the multiplexed encoded data obtained by the encoding module 41, and the first sending module 43 is configured to send the packed data obtained by the packing module 42 to the corresponding direct memory access DMA buffer in the transmitting device, The transmitting device disassembles the packed data in the DMA buffer and transmits the disassembled data.

Further, the packing module 42 is specifically configured to sequentially obtain the encoded data output by each encoding channel, and package the encoded data output by each encoded channel into one data packet respectively; or, sequentially obtain the encoding of each encoding channel output. Data, and after the size of the obtained encoded data reaches a threshold, the obtained encoded data is packaged into one data packet.

Referring to FIG. 5, the first sending module 43 specifically includes:

a query unit 431, configured to query an empty queue of the corresponding DMA buffer;

The obtaining unit 432 is configured to obtain an address of the empty queue that is queried by the query unit 431.

The sending unit 433 is configured to send the packed data to the empty queue of the corresponding DMA buffer according to the address of the empty queue acquired by the obtaining unit 432, and convert the empty queue into a data queue, where the address of the data queue is the same as the address of the empty queue.

Referring to Figure 6, the device further includes:

The second sending module 44 is configured to send a data transmission completion notification to the transmission device, where the data transmission completion notification carries the address of the data queue, so that the transmission device disassembles the corresponding data according to the address of the data queue. Packed data in the DMA cache.

Referring to Figure 7, the device also includes:

The receiving module 45 is configured to receive, by the transmitting device, a data transmission completion notification sent after the disassembled data transmission, and the data transmission completion notification carries the address of the data queue;

The release module 46 is configured to release the data queue of the corresponding DMA cache according to the address of the data queue received by the receiving module 45, so that the data queue is converted into an empty queue.

The encoding apparatus provided in this embodiment realizes that the multi-channel video coding is distributed to a plurality of encoding apparatuses by means of cascading a plurality of encoding apparatuses and the transmitting apparatus, thereby solving the problem that the encoding power of the single encoding apparatus is too heavy; The DMA transmission mechanism is adopted, and the encoding device controls the transmission of the packet data to the corresponding DMA buffer in the transmission device, so that the encoding device can uniformly manage the queues in the DMA buffer in the transmission device, and can not only ensure the code stream transmission of each encoding device. The stability, but also enables multi-threaded parallel processing of the code stream, thereby improving the processing efficiency of multimedia data. Another embodiment of the present invention provides a transmission apparatus for performing the functions performed by the transmission apparatus in the method of processing multimedia data provided by the above embodiments. Referring to FIG. 8, the apparatus includes: an obtaining module 81, configured to acquire packetized data sent by each of the plurality of encoding devices to a corresponding direct memory access DMA buffer in the transmitting device; wherein the packed data is each encoding device After the multimedia data is encoded by the multi-pass encoding channel to obtain the multi-channel encoded data, the data obtained by packing the multi-channel encoded data is obtained;

The disassembling module 82 is configured to disassemble the packed data in the DMA cache acquired by the obtaining module 81;

The transmission module 83 is configured to transmit the disassembled data of the disassembly module 82.

Referring to Figure 9, the device further includes:

The receiving module 84 is configured to receive a data transmission completion notification sent by the encoding device, where the data transmission completion notification carries an address of a corresponding DMA buffer data queue, and the data queue stores the packet data;

The obtaining module 81 is configured to acquire, according to the address of the data queue of the corresponding DMA cache carried in the data sending completion notification, the packed data sent by each of the plurality of encoding devices to the corresponding direct memory access DMA buffer in the transmitting device. .

Referring to Figure 10, the device further includes:

The sending module 85 is configured to send a data transmission completion notification to the corresponding encoding device, where the data transmission is The completion notification carries the address of the data queue, so that the encoding device releases the data queue of the corresponding DMA buffer according to the address of the data queue, so that the data queue is converted into an empty queue.

The transmission device provided in this embodiment realizes that the multi-channel video coding is distributed to a plurality of coding devices by means of a plurality of coding devices and the cascade thereof, thereby solving the problem that the coding load of the single coding device is excessively heavy; The DMA transmission mechanism is adopted, and the encoding device controls the transmission of the packed data to the corresponding DMA buffer in the transmission device, so that the encoding device can uniformly manage the queues in the DMA buffer in the transmission device, and not only can ensure the code stream transmission of each encoding device. The stability, but also enables multi-threaded parallel processing of the code stream, thereby improving the processing efficiency of multimedia data. Another embodiment of the present invention provides a system for processing multimedia data. Referring to FIG. 11, the system includes:

a plurality of encoding devices 1101 and a transmitting device 1102;

The encoding device 1101 is the encoding device provided by the above embodiment;

Transmission device 1102 is a transmission device as provided by the above embodiments.

The system provided in this embodiment realizes the problem that the multi-channel video coding is distributed to multiple coding devices by means of cascading a plurality of coding devices and the transmission device, thereby solving the problem that the coding load of the single coding device is too heavy; a DMA transfer mechanism, and the encoding device controls the sending of the packed data to the corresponding DMA buffer in the transmitting device, so that the encoding device can uniformly manage the queues in the DMA buffer in the transmitting device, and can not only ensure the code stream transmission of each encoding device. Stability, but also enable multi-threaded parallel processing of the code stream, thereby improving the processing efficiency of multimedia data.

It should be noted that, in the system provided by the foregoing embodiment, the transmission device may be cascaded with one coding device, or may be cascaded with multiple coding devices. When multiple coding devices are cascaded with the transmission device, the media data is processed. For details, refer to the foregoing method embodiments, and details are not described herein again. The encoding device and the transmitting device provided in the above embodiments are only illustrated by the division of the above functional modules when processing the multimedia data. In actual applications, the function allocation may be completed by different functional modules as needed. The internal structure of the device is divided into different functional modules to perform all or part of the functions described above. In addition, the coding apparatus, the transmission apparatus, the system for processing the multimedia data, and the method for processing the multimedia data are in the same concept, and the specific implementation process is described in detail in the method embodiment, and details are not described herein again.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

Those skilled in the art can understand that all or part of the steps of implementing the above embodiments can be The completion of the hardware may also be performed by a program to instruct related hardware. The program may be stored in a computer readable storage medium. The storage medium mentioned above may be a read only memory, a magnetic disk or an optical disk.

The above is only the preferred embodiment of the present invention, and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., which are within the spirit and scope of the present invention, should be included in the protection of the present invention. Within the scope.

Claims

claims

1. A method for processing multimedia data, characterized in that the method includes:

Each encoding device in the plurality of encoding devices encodes the multimedia data through multiple encoding channels to obtain multi-channel encoded data;

The multi-channel encoded data is packaged, and the packaged data is sent to the corresponding direct memory access DMA cache in the transmission device. The transmission device disassembles the packaged data in the DMA cache and transmits the disassembled data. The data.

2. The method according to claim 1, characterized in that the packaging of the multi-channel encoded data specifically includes:

Obtain the encoding data output by each encoding channel in turn, and package the obtained encoding data output by each encoding channel into a data packet;

Or, obtain the encoded data output by each encoding channel in turn, and after the size of the obtained encoded data reaches the threshold, package the obtained encoded data into a data packet.

3. The method according to claim 1 or 2, characterized in that said sending the packaged data to the corresponding direct memory access DMA cache in the transmission device specifically includes:

Query the empty queue of the corresponding DMA cache and obtain the address of the empty queue;

Send the packaged data to the corresponding empty queue of the DMA cache according to the address of the empty queue, so that the empty queue is converted into a data queue, and the address of the data queue is the same as the address of the empty queue.

4. The method according to claim 3, characterized in that, after the packed data is sent to the corresponding empty queue of the DMA cache according to the address of the empty queue, the empty queue is converted into a data queue. , Also includes:

Send a data transmission completion notification to the transmission device. The data transmission completion notification carries the address of the data queue, so that the transmission device can disassemble the packets in the corresponding DMA cache according to the address of the data queue. data.

5. The method according to claim 3 or 4, characterized in that: the method according to the empty queue The address sends the packed data to the empty queue of the corresponding DMA cache, and after converting the empty queue into a data queue, it also includes:

Receive a data transmission completion notification sent by the transmission device after the disassembled data is transmitted, where the data transmission completion notification carries the address of the data queue;

The corresponding DMA cached data queue is released according to the address of the data queue, so that the data queue is converted into an empty queue.

6. An encoding device, characterized in that the device includes:

An encoding module, used to encode multimedia data through multiple encoding channels to obtain multi-channel encoded data;

A packaging module, used to package the multi-channel encoded data encoded by the encoding module;

The first sending module is used to send the packaged data obtained by the packaging module to the corresponding direct memory access DMA cache in the transmission device. The transmission device disassembles the packaged data in the DMA cache and transmits it. Disassembled data.

7. The device according to claim 6, characterized in that the packaging module is specifically used to obtain the encoded data output by each encoding channel in sequence, and package the obtained encoded data output by each encoding channel into one data pack;

Alternatively, the encoded data output by each encoding channel is obtained in turn, and after the size of the obtained encoded data reaches the threshold, the obtained encoded data is packaged into a data packet.

8. The device according to claim 6 or 7, characterized in that the first sending module specifically includes:

A query unit, used to query the corresponding empty queue of the DMA cache;

An acquisition unit, used to acquire the address of the empty queue queried by the query unit;

A sending unit, configured to send the packaged data to the corresponding empty queue of the DMA cache according to the address of the empty queue obtained by the acquisition unit, so that the empty queue is converted into a data queue, and the address of the data queue is the same as the address of the empty queue. The addresses of the empty queues are the same.

9. The device according to claim 8, characterized in that, the device further includes: a second sending module, configured to send a data sending completion notification to the transmission device, and the data sending module The transmission completion notification carries the address of the data queue, so that the transmission device decomposes the packaged data in the corresponding DMA cache according to the address of the data queue.

10. The device according to claim 8 or 9, characterized in that, the device further includes: a receiving module, configured to receive a data transmission completion notification sent by the transmission device after the disassembled data is transmitted, so The data transmission completion notification carries the address of the data queue;

A release module, configured to release the corresponding DMA cached data queue according to the address of the data queue received by the receiving module, so that the data queue becomes an empty queue.

11. A method for processing multimedia data, characterized in that the method includes:

The transmission device obtains the packaged data sent by each encoding device in the plurality of encoding devices to the corresponding direct memory access DMA cache in the transmission device;

The packaged data in the DMA cache is disassembled and the disassembled data is transmitted; wherein, the packaged data is obtained after each encoding device encodes multimedia data through multiple encoding channels to obtain multi-channel encoded data. , data obtained by packaging the multi-channel encoded data.

12. The method according to claim 11, characterized in that, before the transmission device obtains the packaged data sent by each encoding device in the plurality of encoding devices to the corresponding direct memory access DMA cache in the transmission device, include:

Receive a data transmission completion notification sent by the encoding device, the data transmission completion notification carries the address of the corresponding DMA buffered data queue, and the data queue stores packaged data; the transmission device obtains multiple encoding devices Each encoding device in the transmission device caches the packaged data sent to the corresponding direct memory access DMA, specifically including:

According to the address of the data queue of the corresponding DMA cache carried in the data transmission completion notification, the packaged data sent by each encoding device in the plurality of encoding devices to the corresponding direct memory access DMA cache in the transmission device is obtained.

13. The method according to claim 12, characterized in that, after transmitting the disassembled data, it further includes:

Send a data transmission completion notification to the corresponding encoding device. The data transmission completion notification carries the address of the data queue, so that the encoding device releases the pair according to the address of the data queue. The data queue corresponding to the DMA cache is converted into an empty queue.

14. A transmission device, characterized in that the device includes:

An acquisition module, configured to acquire the packaged data sent by each encoding device in the multiple encoding devices to the corresponding direct memory access DMA cache in the transmission device; wherein the packaged data is sent by each encoding device through multiple channels. After the encoding channel encodes the multimedia data to obtain multi-channel encoded data, the multi-channel encoded data is packaged to obtain the data;

A disassembly module, used to disassemble the packaged data in the DMA cache obtained by the acquisition module;

The transmission module is used to transmit the disassembled data of the disassembly module.

15. The device according to claim 14, characterized in that, the device further includes: a receiving module, configured to receive a data transmission completion notification sent by the encoding device, and the data transmission completion notification carries the corresponding The address of the DMA cached data queue in which packed data is stored;

The acquisition module is specifically configured to obtain the corresponding direct memory of each encoding device in the transmission device according to the address of the corresponding DMA cached data queue carried in the data transmission completion notification. Access the DMA buffer to send packed data.

16. The device according to claim 15, characterized in that, the device further includes: a sending module, configured to send a data transmission completion notification to the corresponding encoding device, and the data transmission completion notification carries the data The address of the queue causes the encoding device to release the corresponding DMA cached data queue according to the address of the data queue, so that the data queue becomes an empty queue.

17. A system for processing multimedia data, characterized in that the system includes: multiple encoding devices and a transmission device;

Wherein, each encoding device in the plurality of encoding devices is the encoding device according to any one of claims 6 to 10;

The transmission device is as described in any one of claims 14 to 16.