CN111093109A - Media data playing processing method and media playing equipment - Google Patents
Media data playing processing method and media playing equipment Download PDFInfo
- Publication number
- CN111093109A CN111093109A CN201811244359.8A CN201811244359A CN111093109A CN 111093109 A CN111093109 A CN 111093109A CN 201811244359 A CN201811244359 A CN 201811244359A CN 111093109 A CN111093109 A CN 111093109A
- Authority
- CN
- China
- Prior art keywords
- data
- media data
- digital format
- module
- playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 14
- 238000006243 chemical reaction Methods 0.000 claims abstract description 36
- 238000012545 processing Methods 0.000 claims abstract description 25
- 238000000034 method Methods 0.000 claims abstract description 22
- 230000005540 biological transmission Effects 0.000 claims description 14
- 230000003139 buffering effect Effects 0.000 claims description 13
- 230000006835 compression Effects 0.000 abstract description 3
- 238000007906 compression Methods 0.000 abstract description 3
- 230000006870 function Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 238000005070 sampling Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4392—Processing of audio elementary streams involving audio buffer management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
The application provides a media data playing processing method and a media playing device, the method is applied to the media playing device, the media playing device comprises a DSP module and a mainboard module which are interconnected through a bus, and an analog-to-digital conversion module connected with the DSP module, the method comprises the following steps: the analog-to-digital conversion module converts the received media data transmitted by the acquisition equipment from an analog format to a digital format and transmits the media data in the digital format to the DSP module; the DSP module transmits the acquired media data in the digital format to the mainboard module through a bus; the main board module copies the received media data in the digital format to a play cache region, and plays the media data copied to the play cache region. The problem of poor restoration degree during playing caused by compression processing of media data is solved.
Description
Technical Field
The present application relates to the technical field of media data processing, and in particular, to a media data playing processing method and a media playing device.
Background
The media data includes audio data, video data, and the like. In some occasions, the collection and playing of the media data can be realized on the media playing device and the media playing device respectively, after the media data are collected by the media playing device, the media data are transmitted to the media playing device, and the media data are played after being processed by the media playing device.
In the existing media data playing and processing technology, media playing equipment compresses and encodes collected media data and transmits the compressed and encoded media data to the media playing equipment, so that the media playing equipment receives a media data code stream, and the media data code stream needs to be decoded, restored and played.
In the above manner, since the media playing device receives the media data code stream that has been subjected to the compression processing, the compression processing may cause information loss of the media data, resulting in a problem of poor restoration degree during playing.
Disclosure of Invention
In view of this, the present application provides a media data playing processing method and a media playing device, which solve the problem of poor restoration degree during playing due to compressed processing of media data.
A first aspect of the present application provides a media data playing processing method, which is applied to a media playing device, where the media playing device includes a DSP module and a motherboard module that are interconnected via a bus, and an analog-to-digital conversion module connected to the DSP module, and the method includes:
the analog-to-digital conversion module converts the received media data transmitted by the acquisition equipment from an analog format to a digital format and transmits the media data in the digital format to the DSP module;
the DSP module transmits the acquired media data in the digital format to the mainboard module through a bus;
the main board module copies the received media data in the digital format to a play cache region, and plays the media data copied to the play cache region.
According to an embodiment of the present application, the copying, by the motherboard module, the received media data in the digital format to the play buffer includes:
the main board module determines data characteristic information related to the received media data in the frame digital format according to the received interrupt information; the interrupt information is sent by the DSP module when the transmission of the media data in the frame digital format to the mainboard module is finished and is used for indicating that the transmission of the media data in the frame digital format is finished;
and the mainboard module copies the received media data in the frame digital format to a play buffer area according to the data characteristic information.
According to an embodiment of the present application, the determining, by the motherboard module, data characteristic information related to media data in a frame digital format according to the interrupt information includes:
the main board module determines that a target semaphore is received according to the interrupt information, wherein the target semaphore is sent by the DSP module when the DSP module finishes transmitting the media data in the frame digital format to the main board module;
the mainboard module determines data characteristic information corresponding to the target semaphore from data characteristic information prestored in the mainboard module according to the target semaphore;
and the mainboard module determines the determined data characteristic information as the data characteristic information related to the media data in the frame digital format.
According to one embodiment of the present application, the data characteristic information at least includes a data address, data format information, and status information;
the main board module copies the received media data in the frame digital format to a play buffer area according to the data characteristic information, and the method comprises the following steps:
the motherboard module determines whether the status information indicates a set status,
if not, setting a playing format required by the mainboard module when the media data in the frame digital format is played according to the data format information, determining the set playing format as the playing format corresponding to the state information, modifying the state information from an unset state to a set state, addressing the media data in the frame digital format according to the data address, and copying the media data in the frame digital format to the playing buffer area;
if yes, addressing the media data in the frame digital format according to the data address, and copying the media data in the frame digital format to the playing buffer area.
According to one embodiment of the application, the play buffer area comprises an audio buffer area for buffering audio data and a video buffer area for buffering video data;
the playing the media data copied to the playing buffer includes:
according to the set playing format corresponding to the state information and synchronously playing the media data in the frame digital format with the video data cached in the video buffer area; wherein, the media data in frame digital format is the audio data copied to the audio buffer;
alternatively, the first and second electrodes may be,
according to the set playing format corresponding to the state information and synchronously playing the media data in the frame digital format with the audio data cached in the audio buffer zone; wherein the media data in one frame digital format is video data that has been copied into a video buffer.
According to an embodiment of the present application, the data characteristic information further includes a data size of the media data in a frame digital format;
after addressing the media data in the frame digital format according to the data address, the method further comprises:
the mainboard module calculates a target address according to the data address and the data size;
and the mainboard module modifies the data address in the data characteristic information into the target address so that the data address can address the media data in the next frame digital format of the media data in the frame digital format.
A second aspect of the present application provides a media playback apparatus, including: a DSP module and a mainboard module which are interconnected through a bus, and an analog-to-digital conversion module which is connected with the DSP module,
the analog-to-digital conversion module is used for converting the received media data transmitted by the acquisition equipment from an analog format to a digital format and transmitting the media data in the digital format to the DSP module;
the DSP module is used for transmitting the acquired media data in the digital format to the mainboard module through a bus;
the main board module is used for copying the received media data in the digital format to a play cache region and playing the media data copied to the play cache region.
According to one embodiment of the application, the mainboard module comprises a processor, a memory, an interrupt controller and a playing device; the processor is connected with the memory, the interrupt controller and the playing device;
the memory is used for storing the media data in the digital format and the data characteristic information corresponding to the media data in the digital format, which are transmitted to the main board module by the DSP module;
the interrupt controller is used for receiving interrupt information sent by the DSP module when the DSP module finishes transmitting the media data in the frame digital format to the mainboard module and triggering the processor to read the interrupt information, and the interrupt information is used for indicating that the transmission of the media data in the frame digital format is finished;
the processor is used for determining data characteristic information related to the media data in the frame digital format according to the interrupt information read from the interrupt controller, and copying the received media data in the frame digital format into a play buffer area according to the data characteristic information;
the playing device is used for playing the media data copied to the playing buffer area.
According to an embodiment of the present application, the DSP module is further configured to send a target semaphore to the motherboard module each time a frame of media data in a digital format is transmitted, where the target semaphore is used to indicate data characteristic information related to the frame of media data in the digital format;
the processor, when determining the data characteristic information related to the media data in the frame digital format according to the interruption information, is specifically configured to:
determining that a target semaphore is received according to the interrupt information, wherein the target semaphore is sent by the DSP module when the DSP module finishes transmitting the media data in the frame of digital format to the mainboard module;
determining data characteristic information corresponding to the target semaphore from data characteristic information prestored in the mainboard module according to the target semaphore;
and determining the determined data characteristic information as the data characteristic information related to the media data in the frame digital format.
According to one embodiment of the present application, the data characteristic information at least includes a data address, data format information, and status information;
when copying the received media data in the frame digital format to a play buffer according to the data characteristic information, the processor is specifically configured to:
determining whether the status information indicates a set status,
if not, setting a playing format required by the mainboard module when the media data in the frame digital format is played according to the data format information, determining the set playing format as the playing format corresponding to the state information, modifying the state information from an unset state to a set state, addressing the media data in the frame digital format according to the data address, and copying the media data in the frame digital format to the playing buffer area;
if yes, addressing the media data in the frame digital format according to the data address, and copying the media data in the frame digital format to the playing buffer area.
According to one embodiment of the application, the play buffer area comprises an audio buffer area for buffering audio data and a video buffer area for buffering video data;
when the playing apparatus is configured to play the media data copied to the play cache region, the playing apparatus is specifically configured to:
according to the set playing format corresponding to the state information and synchronously playing the media data in the frame digital format with the video data cached in the video buffer area; wherein, the media data in frame digital format is the audio data copied to the audio buffer;
alternatively, the first and second electrodes may be,
according to the set playing format corresponding to the state information and synchronously playing the media data in the frame digital format with the audio data cached in the audio buffer zone; wherein the media data in one frame digital format is video data that has been copied into a video buffer.
According to an embodiment of the present application, the data characteristic information further includes a data size of the media data in a frame digital format;
after the processor is configured to address the media data in the frame digital format according to the data address, the processor is further configured to:
calculating a target address according to the data address and the data size;
and modifying the data address in the data characteristic information into the target address so that the data address can address the media data in the next frame digital format of the media data in the frame digital format.
According to an embodiment of the present application, further comprising: a DMA controller;
the DMA controller is connected with the memory and the bus and is used for transferring the media data in the digital format transmitted to the mainboard module by the DSP module into the memory.
Compared with the prior art, the embodiment of the application has the following beneficial effects:
in the embodiment of the application, the media playing device receives the media data in the analog format transmitted by the acquisition device, the analog-to-digital conversion module performs analog-to-digital conversion on the media data to obtain the media data in the digital format, the DSP module transmits the media data in the digital format to the motherboard module through the bus, and the motherboard module performs corresponding playing processing on the media data in the digital format to ensure that the media data can be played by the motherboard module in time.
Drawings
Fig. 1 is a schematic flowchart of a media data playing processing method according to an embodiment of the present application;
fig. 2 is a block diagram of a media playing device according to an embodiment of the present application;
fig. 3 is a schematic flow chart of video frame playing according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in this application and the appended claims, the singular forms "a", "an", and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
It is to be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information, without departing from the scope of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.
In order to make the description of the present application clearer and more concise, some technical terms in the present application are explained below:
YUV format: the luminance parameter and the chrominance parameter are represented separately in a pixel format, Y representing the luminance parameter and UV representing the chrominance parameter. The brightness parameter and the chroma parameter are expressed separately, so that not only can mutual interference be avoided, but also the sampling rate of chroma can be reduced without greatly influencing the image quality.
And (3) SDK: the acronym Software Development Kit, includes a collection of related documents, paradigms, and tools that broadly refer to assisting in the Development of a certain class of Software.
Interrupting: a technology for making processor to process emergency in time includes such steps as receiving interrupt information to indicate that it is needed to process the emergency, pausing the execution of current program, serving the emergency, and returning to the paused position for executing original program.
DMA: the abbreviation Direct Memory Access translates to Direct Memory Access, a technique for directly accessing Memory data without going through a processor.
The following describes the media data playing processing method in detail, but should not be limited thereto. In one embodiment, the media data playing processing method is applied to a media playing device, where the media playing device includes a DSP module and a motherboard module interconnected by a bus, and an analog-to-digital conversion module connected to the DSP module, and referring to fig. 1, the method may include the following steps:
s100: the analog-to-digital conversion module converts the received media data transmitted by the acquisition equipment from an analog format to a digital format and transmits the media data in the digital format to the DSP module;
s200: the DSP module transmits the acquired media data in the digital format to the mainboard module through a bus;
s300: the main board module copies the received media data in the digital format to a play cache region, and plays the media data copied to the play cache region.
The media playing device of the embodiment of the application can be used for playing at least one of video data, audio data and the like, and can be a single media playing device or a multimedia playing device. The media playing device may be integrated with other functions besides the media data playing function, and is not limited specifically.
The main board module may be integrated with an operating system, such as a Linux system, a Windows system, an MAC system, etc., and manage and play related software and hardware resources through the operating system, and certainly may also manage other resources on the device. In different operating systems, the details of the media data playing process may be different, and may be adjusted adaptively according to actual situations. Taking the motherboard module as a terminal device of the integrated linux system as an example, the motherboard module can communicate with the DSP module through the DRIVERs DRIVER and SDK, for example, receive interrupt information written by the DSP module.
In step S100, the analog-to-digital conversion module converts the received media data from the acquisition device to a digital format from an analog format, and transmits the media data in the digital format to the DSP module.
The acquisition device can be an audio acquisition device, or a video acquisition device, or a multimedia playing device capable of acquiring audio data and video data, etc. The analog-to-digital conversion module of the media playing device and the acquisition device may be connected through an analog signal transmission line, for example, a BNC cable, etc.
In the embodiment of the application, the acquisition device can transmit the acquired media data in the original analog format to the media playing device without compressing the media data. The media playing device receives the media data in the analog format, and the media data does not need to be decompressed when being played.
The analog-to-digital conversion module executes analog-to-digital conversion processing on the received media data, converts the media data from an analog format to a digital format, and transmits the media data in the digital format to the DSP module. The media data in digital format after the analog-to-digital conversion is played by the subsequent mainboard module. The specific type of the analog-to-digital conversion module is not limited, and the analog-to-digital conversion module may be any AD chip capable of implementing analog-to-digital conversion processing, and of course, the AD chip with higher processing speed and higher precision is preferred.
It is understood that other processing modules may be connected to the front end of the analog-to-digital conversion module or between the analog-to-digital conversion module and the DSP module, which may be determined according to the needs, and is not limited specifically.
In step S200, the DSP module transmits the acquired media data in digital format to the motherboard module through the bus.
The bus may be, for example, a PCI (Peripheral Component Interconnect) bus or a PCI Express (extended PCI) bus, and may be, but is not limited to, another type of bus. Compared with network communication, the bus communication has the advantage of small time delay, and is beneficial to real-time playing of media data.
The DSP module is communicated with the mainboard module through a bus, and the media data in the digital format acquired by the DSP module can be timely transmitted to the mainboard module. When the DSP module transmits the acquired media data in the digital format to the mainboard module, the DSP module can also transmit information such as interrupt information, target semaphore and the like at the same time. It will be appreciated that the DSP module may also perform certain signal processing, such as filtering, etc., on the media data prior to transmission of the media data.
In step S300, the main board module copies the received media data in digital format to the play buffer, and plays the media data copied to the play buffer.
If the media data is audio data, the main board module may copy the received audio data to an audio buffer area for buffering the audio data to be played, and an audio playing device, such as a speaker, may be integrated on the main board module, and the audio playing device may read the audio data buffered in the audio buffer area for playing.
If the media data is video data, the main board module may copy the received video data to a video cache area for caching the video data to be played, and a video playing device such as a display may be integrated on the main board module, and the video playing device may read the video data cached in the video cache area for playing.
It is understood that when the media playing device supports audio and video playing, the audio data and the video data can also be played synchronously.
In the embodiment of the application, the media playing device receives the media data in the analog format transmitted by the acquisition device, the analog-to-digital conversion module performs analog-to-digital conversion on the media data to obtain the media data in the digital format, the DSP module transmits the media data in the digital format to the motherboard module through the bus, and the motherboard module performs corresponding playing processing on the media data in the digital format to ensure that the media data can be played by the motherboard module in time.
Fig. 2 shows a media playing device according to an embodiment of the present application, where the media playing device 10 includes: a mainboard module 100, a DSP module 300, an analog-to-digital conversion module 200, and a bus 400; the motherboard module 100 and the DSP module 300 are interconnected by a bus 400, and the analog-to-digital conversion module 200 is connected to the DSP module 300. The media playing device is obtained by improving the existing media playing device, and the DSP module 300, the analog-to-digital conversion module 200 and the bus 400 are added to implement the media data playing processing method according to the embodiment of the present application.
The analog-to-digital conversion module 200 is configured to implement the step S100, the DSP module 300 is configured to implement the step S200, and the motherboard module 100 is configured to implement the step S300.
Specifically, with continued reference to fig. 2, the motherboard module 400 may include a processor 101, a memory 102, a playing device 105, and the like, where the memory 102 may store a program, the processor may call and run the program in the memory to implement the steps of copying the media data in digital format to the play buffer, and the playing device 105 may be configured to play the media data copied to the play buffer. Further, the motherboard module may further include an interrupt controller 104, a DMA controller 103, and the like, and may also include other functional modules.
In one embodiment, in step S300, the copying, by the motherboard module, the received media data in the digital format to the play buffer includes:
s301: the main board module determines data characteristic information related to the received media data in the frame digital format according to the received interrupt information; the interrupt information is sent by the DSP module when the transmission of the media data in the frame digital format to the mainboard module is finished and is used for indicating that the transmission of the media data in the frame digital format is finished;
s302: and the mainboard module copies the received media data in the frame digital format to a play buffer area according to the data characteristic information.
The frame stream of the media data that is not compressed and transmitted from the acquisition device to the media playing device may be a frame stream that is transmitted after acquiring a frame, or a frame stream that is transmitted after acquiring a plurality of frames of media data stored in the acquisition device, and is not particularly limited as long as the media data that needs to be played can be transmitted at a certain frame transmission rate. In the media playing device, each frame of media data in analog format is received by the analog-to-digital conversion module, the analog-to-digital conversion module performs analog-to-digital conversion on the received frame of media data in analog format and transmits the converted frame of media data to the DSP module, and the DSP module transmits the received media data in digital format to the mainboard module in real time.
And the DSP module sends interruption information to the mainboard module when the media data in the frame digital format is transmitted each time, wherein the interruption information is used for indicating that the transmission of the media data in the frame digital format is completed.
The DSP module can be preset with a storage address required for storing each frame of received media data to the mainboard module. Specifically, when the receiving of more than two types of media data is supported, the corresponding relationship between the type of the media data and the storage address may be preset, and when the DSP module receives a frame of media data in a digital format, the corresponding storage address may be determined according to the type of the frame of media data in the digital format and the corresponding relationship, and the DMA module is notified to store the frame of media data in the digital format in the storage location corresponding to the storage address of the motherboard module.
When the main board module receives the interrupt information, it indicates that the DSP module has transmitted the media data in the frame digital format to the main board module, and the main board module needs to perform playing processing on the received media data in the frame digital format. The processor of the main board module can pause the current processing to respond to the interrupt information and execute the playing processing to the received media data in the frame digital format, so that the media data in the frame digital format can be played in time.
In step S301, the motherboard module determines data characteristic information related to the received media data in the frame digital format according to the received interrupt information.
The data characteristic information may include, for example, a data address addressable to a storage location of the frame of digital media data in the motherboard module, but may also include other information, such as, without limitation, data format information about the format of the frame of digital media data.
Optionally, the data characteristic information may be recorded in the interrupt information, that is, the interrupt information sent by the DSP module to the motherboard module carries the data characteristic information, and the data characteristic information about the media data in the frame digital format may be obtained by analyzing the interrupt information.
Optionally, the data characteristic information may also be preset in the motherboard module, and after the motherboard module receives the interrupt information, the motherboard module determines the data characteristic information corresponding to the interrupt information from the preset data characteristic information.
Specifically, taking the data feature information including the data address as an example, the storage address required when storing each frame of media data and the data address required when copying the frame of media data may be negotiated by the motherboard module and the DSP module in advance, for example, a same address is negotiated first, the storage address is incremented by a specified size (for example, the data size of the media data in the frame format) every time the media data in the frame format is transmitted, and the corresponding data address is incremented by the specified size every time the media data in the frame format is copied, so that the storage address and the data address of each frame of media data are matched. The main board module can determine the data address corresponding to the interrupt information after receiving the interrupt information, and addresses the storage position of the media data in a frame digital format corresponding to the interrupt information according to the data address.
In step S302, the main board module copies the received media data in the frame digital format to a play buffer according to the data feature information.
After the main board module determines the data characteristic information, the main board module addresses the storage position of the media data in the frame digital format and copies the media data in the frame digital format to the playing buffer area. When the media data are video data, the media data can be played through hardware such as a display card, a display screen and the like; when the media data is audio data, the media data can be played through hardware such as a sound card, a loudspeaker and the like. Of course, the playing of the media data can also be completed through the cooperation of the related application programs.
It can be understood that, when the main board module copies the media data in the frame digital format from the storage location, the media data may be sent to the play buffer for playing after being subjected to certain data processing. The data processing may include: the data format conversion process (for example, converting YUV format of video data into RGB format) and the like are not limited.
In this embodiment, when the DSP module finishes transmitting the media data in the frame digital format to the motherboard module, the motherboard module receives the interrupt information indicating that the transmission of the media data in the frame digital format is finished, and because the interrupt is performed, the motherboard module immediately responds to the interrupt information to perform the playing processing on the media data in the frame digital format, which is beneficial to the timely playing of the media data.
Specifically, referring to fig. 2, the motherboard module 100 may include a processor 101, a memory 102, a DMA controller 103, an interrupt controller 104, and a playback device 105. The processor 101, the DMA controller 103, the interrupt controller 104, and the playback device 105 are all connected to the bus 400, and communicate with each other via the bus 400. The playing device 105 may include a sound card and a speaker for implementing audio playing, and a display card and a display screen for implementing video playing. Portions of the memory 102 may be configured as memory to cache relevant data during processing by the processor 101.
The DSP module 300 communicates with the DMA controller 103, the interrupt controller 104, and the like through the bus 400. The DSP module 202 transmits each frame of received media data to the DMA controller 103 via the bus 400 in sequence, stores the media data into the memory of the motherboard module 100 via the DMA controller 103, and sends an interrupt message to the interrupt controller 104 when a frame of media data in a digital format is transmitted. The interrupt controller 104 receives the interrupt information and triggers the processor 101 to read the interrupt information, so as to determine the data characteristic information related to the media data in frame format, and copy the media data in frame format to the playing buffer according to the data characteristic information for playing through the playing device 105.
In one embodiment, in step S301, the determining, by the motherboard module, data characteristic information related to media data in one frame of digital format according to the interrupt information may include:
s3011: the main board module determines that a target semaphore is received according to the interrupt information, wherein the target semaphore is sent by the DSP module when the DSP module finishes transmitting the media data in the frame digital format to the main board module;
s3012: the mainboard module determines data characteristic information corresponding to the target semaphore from data characteristic information prestored in the mainboard module according to the target semaphore;
s3013: and the mainboard module determines the determined data characteristic information as the data characteristic information related to the media data in the frame digital format.
After the DSP module finishes transmitting the media data in the format of one frame of digital, the interrupt information is written into an interrupt register of an interrupt controller of the mainboard module, and the interrupt controller triggers a processor of the mainboard module to read the interrupt information, so that the event that the DSP module finishes transmitting the media data in the format of one frame of digital can be determined.
In step S3011, the motherboard module determines that the target semaphore is received according to the interrupt information. The interruption information can indicate that an event that the DSP module finishes transmitting the media data in the frame digital format to the mainboard module occurs, and the target semaphore is sent when the DSP module finishes transmitting the media data in the frame digital format to the mainboard module. In other words, when the DSP module finishes transmitting the media data in one frame of digital format, the interrupt information and the target semaphore are sent to the motherboard module, so that the motherboard module can determine that the corresponding target semaphore is received when receiving the interrupt information. The main board module can find the target semaphore through semaphore polling and execute processing corresponding to the target semaphore.
In step S3012, the motherboard module determines, according to the target semaphore, data characteristic information corresponding to the target semaphore from data characteristic information pre-stored in the motherboard module.
The corresponding relation between the target semaphore and the data characteristic information can be preset in the mainboard module. For example, the target semaphore is an input variable of a function, and the data characteristic information obtaining operation may be set in the function, and when the target semaphore is received, the function may be executed to obtain the corresponding data characteristic information. For another example, a list of the semaphore and the corresponding data feature information may be preset in the motherboard module, and the data feature information corresponding to the target semaphore may be found in the list according to the target semaphore.
In step S3013, the motherboard module determines the determined data characteristic information as data characteristic information related to the media data in the frame digital format.
Under the condition that the main board module supports more than two kinds of media data to be played, different types of media data can correspond to different data characteristic information, and the main board module needs to determine the data characteristic information corresponding to the received media data in the frame digital format, so that corresponding playing processing is performed. The main board module can preset the corresponding relation between the semaphore and the data characteristic information, and when the interrupt information is received, the data characteristic information of the media data corresponding to one frame of digital format is determined through the target semaphore.
Since the interrupt resource is precious in the motherboard module and generally needs to be used for other purposes, if each type of media data is allocated with a corresponding interrupt resource, the problem of shortage of interrupt resources may be caused.
In this embodiment, when the main board module receives the interrupt information, the main board module immediately responds to the interrupt information to execute processing corresponding to the target semaphore, and makes up for the defect that the semaphore cannot be responded in time by using the timeliness of the interrupt response, so that the interrupt resource of the main board module can be saved while media data can be played in time.
In one embodiment, the data characteristic information includes at least data address, data format information, and status information. In step S302, the main board module copies the received media data in the frame digital format to a play buffer according to the data feature information, which may include the following steps:
s3021: the motherboard module determines whether the status information indicates a set status,
s3022: if not, setting a playing format required by the mainboard module when the media data in the frame digital format is played according to the data format information, determining the set playing format as the playing format corresponding to the state information, modifying the state information from an unset state to a set state, addressing the media data in the frame digital format according to the data address, and copying the media data in the frame digital format to the playing buffer area;
s3023: if yes, addressing the media data in the frame digital format according to the data address, and copying the media data in the frame digital format to the playing buffer area.
The status information may reflect whether the play format has been set. The default state of the state information is configured as an unset state, if the target semaphore appears for the first time, the state information in the data characteristic information corresponding to the target semaphore indicates the unset state, a playing format required by the main board module when the main board module plays the media data corresponding to the frame digital format needs to be set, and the playing format required by the main board module when the main board module plays the media data corresponding to the frame digital format is set according to the data format information. When the setting is completed, the set playback format is determined to be the playback format corresponding to the state information, and the state information is modified from the unset state to the set state. And then, the playing format is directly played according to the playing format corresponding to the state information without setting the playing format.
When the media data is video data, the data format information may include at least one of the following parameters: image size, image resolution, image format. When the media data is audio data, the data format information may include at least one of the following parameters: sampling rate, sampling bit rate, number of sampling channels. Of course, the data format information corresponding to the two media data is not limited to this, and may be determined according to the playing requirement. In addition, when the media data is of other types, the data format information may be configured accordingly, and is not limited in particular.
After the playing format is set or when the state information indicates that the state is set, the currently received media data corresponding to one frame of digital format is addressed according to the data address in the data characteristic information corresponding to the target semaphore, and the media data corresponding to the frame of digital format is copied to the playing buffer area. Then, the main board module can play the media data in the frame digital format in the play buffer according to the set play format.
In one embodiment, the play buffer includes an audio buffer for buffering audio data and a video buffer for buffering video data. In step S300, the playing the media data copied to the play buffer may include:
according to the set playing format corresponding to the state information and synchronously playing the media data in the frame digital format with the video data cached in the video buffer area; wherein, the media data in frame digital format is the audio data copied to the audio buffer;
alternatively, the first and second electrodes may be,
according to the set playing format corresponding to the state information and synchronously playing the media data in the frame digital format with the audio data cached in the audio buffer zone; wherein the media data in one frame digital format is video data that has been copied into a video buffer.
In the main board module, the media data can be copied to a buffer area (a video buffer area or an audio buffer area) of the multimedia play library by using a callback function called by an audio play thread of the multimedia play library. And the audio playing thread of the multimedia playing library can be utilized to simultaneously send the video data cached in the video cache region and the audio data cached in the audio cache region to the playing device for playing, so that the synchronous playing of the audio and video data is realized.
In one embodiment, the data characteristic information further includes a data size of the media data in a frame digital format. In step S3022 or S3023, after the media data in the frame digital format is addressed according to the data address, the method further includes the following steps:
s3031: the mainboard module calculates a target address according to the data address and the data size;
s3032: and the mainboard module modifies the data address in the data characteristic information into the target address so that the data address can address the media data in the next frame digital format of the media data in the frame digital format.
The storage address required for storing each frame of media data and the data address required for copying the frame of media data can be negotiated by the motherboard module and the DSP module in advance, for example, a same address is negotiated first, the storage address is managed by the DSP module or the DMA module, and the data address is managed by the motherboard module.
When the media data in the frame digital format is transmitted, the DSP module or the DMA module increases the storage address by the data size, and when the media data in the frame digital format is copied, the mainboard module increases the corresponding data address by the data size, so that the storage address and the data address of each frame of media data are matched.
The way of the main board module incrementing the corresponding data address by the data size may be implemented by using the above steps S3031 and S3032. The way that the DSP module or the DMA module increments the memory address by the data size comprises the steps of:
calculating a target storage address according to the recorded storage address and the data size;
modifying the recorded storage address to the target storage address so that the storage address can be used for positioning the storage position of the media data in the next frame digital format of the media data in the frame digital format.
When the DSP module transmits the media data with the frame digital format to the mainboard module, the media data with the frame digital format can be stored to the storage position pointed by the storage address through the DMA module. And when the mainboard module determines the data address, reading the media data from the corresponding storage position according to the data address and copying the media data to the play cache region.
An example of the process of executing video data playing processing by the main board module is provided below, referring to fig. 3, before the main board module starts receiving video data, the multimedia playing library may be initialized and the playing mode is started, and then starts receiving video data; when the interrupt information arrives, the main board module receives the first frame of video data transmitted by the DSP module, can determine that a target semaphore corresponding to the first frame of video data is received according to the interrupt information, and can determine data characteristic information corresponding to the target semaphore from data characteristic information prestored in the main board module according to the target semaphore, wherein the data characteristic information comprises a data address, data format information, state information and the like; the state information indicates that the state is not set, so that the setting of the playing format is carried out, including setting the width, height, format and the like of the layer, a YUV display layer corresponding to the playing format is created, the first frame of video data in the internal memory of the main board module is copied to a video cache region in the multimedia playing library according to the data address, the video data in the video cache region is read to the YUV display layer for display, and whether the playing is continued or not is judged; if the video data is continued, copying the frame of video data to a video cache region in the multimedia play library when determining that the frame of video data transmitted by the DSP module is received again, modifying the video data displayed on the YUV display layer into the video data in the video cache region so as to display the video data on the YUV display layer, and returning to the step of whether the playing is continued or not until the playing is not continued, and releasing the YUV display layer.
The application also provides a media playing device. In one embodiment, referring to fig. 2, the media playing device 10 includes: a DSP module 300 and a motherboard module 100 interconnected by a bus 400, and an analog-to-digital conversion module 200 connected to the DSP module 300.
The analog-to-digital conversion module 200 is configured to convert the received media data from the acquisition device to a digital format from an analog format, and transmit the media data in the digital format to the DSP module 300;
the DSP module 300 is configured to transmit the acquired media data in digital format to the motherboard module 100 through the bus 400;
the main board module 100 is configured to copy the received media data in digital format to a play buffer, and play the media data copied to the play buffer.
In one embodiment, with continued reference to FIG. 2, the motherboard module 100 includes a processor 101, a memory 102, an interrupt controller 104, a playback device 105; the processor 101 is connected with the memory 102, the interrupt controller 104 and the playing device 105;
the memory 102 is used for storing the media data in the digital format transmitted from the DSP module 300 to the motherboard module 100 and the data characteristic information corresponding to the media data in the digital format;
the interrupt controller 104 is configured to receive interrupt information sent by the DSP module 300 when the transmission of media data in a frame of digital format to the motherboard module 100 is completed and trigger the processor 101 to read the interrupt information, where the interrupt information is used to indicate that the transmission of media data in the frame of digital format is completed;
the processor 101 is configured to determine data feature information related to the media data in the frame digital format according to the interrupt information read from the interrupt controller 104, and copy the received media data in the frame digital format into a play buffer according to the data feature information;
the playing device 105 is used for playing the media data copied to the playing buffer.
In one embodiment, the DSP module 400 is further configured to send a target semaphore to the motherboard module 100 every time a frame of media data in digital format is transmitted, where the target semaphore is used to indicate data characteristic information related to the frame of media data in digital format;
the processor 101 is specifically configured to, when determining the data characteristic information related to the media data in the frame digital format according to the interruption information:
determining that a target semaphore is received according to the interrupt information, wherein the target semaphore is sent by the DSP module when the DSP module finishes transmitting the media data in the frame of digital format to the mainboard module;
determining data characteristic information corresponding to the target semaphore from data characteristic information prestored in the mainboard module according to the target semaphore;
and determining the determined data characteristic information as the data characteristic information related to the media data in the frame digital format.
In one embodiment, the data characteristic information includes at least data address, data format information, and status information;
when the processor 101 copies the received media data in the frame digital format to the play buffer according to the data feature information, it is specifically configured to:
determining whether the status information indicates a set status,
if not, setting a playing format required by the mainboard module when the media data in the frame digital format is played according to the data format information, determining the set playing format as the playing format corresponding to the state information, modifying the state information from an unset state to a set state, addressing the media data in the frame digital format according to the data address, and copying the media data in the frame digital format to the playing buffer area;
if yes, addressing the media data in the frame digital format according to the data address, and copying the media data in the frame digital format to the playing buffer area.
In one embodiment, the play buffer comprises an audio buffer for buffering audio data and a video buffer for buffering video data;
when the playing device 105 is configured to play the media data copied to the play buffer, it is specifically configured to:
according to the set playing format corresponding to the state information and synchronously playing the media data in the frame digital format with the video data cached in the video buffer area; wherein, the media data in frame digital format is the audio data copied to the audio buffer;
alternatively, the first and second electrodes may be,
according to the set playing format corresponding to the state information and synchronously playing the media data in the frame digital format with the audio data cached in the audio buffer zone; wherein the media data in one frame digital format is video data that has been copied into a video buffer.
In one embodiment, the data characteristic information further includes a data size of the media data in a frame digital format;
after the processor 101 is configured to address the media data in the frame digital format according to the data address, it is further configured to:
calculating a target address according to the data address and the data size;
and modifying the data address in the data characteristic information into the target address so that the data address can address the media data in the next frame digital format of the media data in the frame digital format.
In one embodiment, with continued reference to fig. 2, the master template 100 further comprises: a DMA controller 103;
the DMA controller 103 is connected to the memory 102 and the bus 400, and is configured to dump the media data in the digital format transmitted from the DSP module 300 to the motherboard module 100 into the memory 102.
For the apparatus embodiment, since it basically corresponds to the method embodiment, reference may be made to the partial description of the method embodiment for relevant points. The above-described apparatus embodiments are merely illustrative, wherein the units illustrated as separate components may or may not be physically separate.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the scope of protection of the present application.
Claims (13)
1. A media data playing processing method is characterized in that the method is applied to media playing equipment, the media playing equipment comprises a DSP module and a mainboard module which are interconnected through a bus, and an analog-to-digital conversion module connected with the DSP module, and the method comprises the following steps:
the analog-to-digital conversion module converts the received media data transmitted by the acquisition equipment from an analog format to a digital format and transmits the media data in the digital format to the DSP module;
the DSP module transmits the acquired media data in the digital format to the mainboard module through a bus;
the main board module copies the received media data in the digital format to a play cache region, and plays the media data copied to the play cache region.
2. The method for processing media data playing of claim 1, wherein the main board module copies the received media data in digital format to a playing buffer, and comprises:
the main board module determines data characteristic information related to the received media data in the frame digital format according to the received interrupt information; the interrupt information is sent by the DSP module when the transmission of the media data in the frame digital format to the mainboard module is finished and is used for indicating that the transmission of the media data in the frame digital format is finished;
and the mainboard module copies the received media data in the frame digital format to a play buffer area according to the data characteristic information.
3. The method as claimed in claim 2, wherein the determining, by the motherboard module, data characteristic information related to the media data in one frame digital format according to the interrupt information comprises:
the main board module determines that a target semaphore is received according to the interrupt information, wherein the target semaphore is sent by the DSP module when the DSP module finishes transmitting the media data in the frame digital format to the main board module;
the mainboard module determines data characteristic information corresponding to the target semaphore from data characteristic information prestored in the mainboard module according to the target semaphore;
and the mainboard module determines the determined data characteristic information as the data characteristic information related to the media data in the frame digital format.
4. The media data playback processing method of claim 2, wherein the data characteristic information at least includes data address, data format information, and status information;
the main board module copies the received media data in the frame digital format to a play buffer area according to the data characteristic information, and the method comprises the following steps:
the motherboard module determines whether the status information indicates a set status,
if not, setting a playing format required by the mainboard module when the media data in the frame digital format is played according to the data format information, determining the set playing format as the playing format corresponding to the state information, modifying the state information from an unset state to a set state, addressing the media data in the frame digital format according to the data address, and copying the media data in the frame digital format to the playing buffer area;
if yes, addressing the media data in the frame digital format according to the data address, and copying the media data in the frame digital format to the playing buffer area.
5. The media data playback processing method according to claim 4, wherein the playback buffer includes an audio buffer for buffering audio data and a video buffer for buffering video data;
the playing the media data copied to the playing buffer includes:
according to the set playing format corresponding to the state information and synchronously playing the media data in the frame digital format with the video data cached in the video buffer area; wherein, the media data in frame digital format is the audio data copied to the audio buffer;
alternatively, the first and second electrodes may be,
according to the set playing format corresponding to the state information and synchronously playing the media data in the frame digital format with the audio data cached in the audio buffer zone; wherein the media data in one frame digital format is video data that has been copied into a video buffer.
6. The media data playback processing method of claim 4, wherein the data characteristic information further includes a data size of the media data in a frame digital format;
after addressing the media data in the frame digital format according to the data address, the method further comprises:
the mainboard module calculates a target address according to the data address and the data size;
and the mainboard module modifies the data address in the data characteristic information into the target address so that the data address can address the media data in the next frame digital format of the media data in the frame digital format.
7. A media playback apparatus, comprising: a DSP module and a mainboard module which are interconnected through a bus, and an analog-to-digital conversion module which is connected with the DSP module,
the analog-to-digital conversion module is used for converting the received media data transmitted by the acquisition equipment from an analog format to a digital format and transmitting the media data in the digital format to the DSP module;
the DSP module is used for transmitting the acquired media data in the digital format to the mainboard module through a bus;
the main board module is used for copying the received media data in the digital format to a play cache region and playing the media data copied to the play cache region.
8. The media playback device of claim 7, wherein the motherboard module comprises a processor, a memory, an interrupt controller, a playback apparatus; the processor is connected with the memory, the interrupt controller and the playing device;
the memory is used for storing the media data in the digital format and the data characteristic information corresponding to the media data in the digital format, which are transmitted to the main board module by the DSP module;
the interrupt controller is used for receiving interrupt information sent by the DSP module when the DSP module finishes transmitting the media data in the frame digital format to the mainboard module and triggering the processor to read the interrupt information, and the interrupt information is used for indicating that the transmission of the media data in the frame digital format is finished;
the processor is used for determining data characteristic information related to the media data in the frame digital format according to the interrupt information read from the interrupt controller, and copying the received media data in the frame digital format into a play buffer area according to the data characteristic information;
the playing device is used for playing the media data copied to the playing buffer area.
9. The media playback device of claim 8, wherein the DSP module is further configured to send a target semaphore to the motherboard module each time a frame of digital media data is transmitted, the target semaphore being used to indicate data characteristic information associated with the frame of digital media data;
the processor, when determining the data characteristic information related to the media data in the frame digital format according to the interruption information, is specifically configured to:
determining that a target semaphore is received according to the interrupt information, wherein the target semaphore is sent by the DSP module when the DSP module finishes transmitting the media data in the frame of digital format to the mainboard module;
determining data characteristic information corresponding to the target semaphore from data characteristic information prestored in the mainboard module according to the target semaphore;
and determining the determined data characteristic information as the data characteristic information related to the media data in the frame digital format.
10. The media playback device of claim 8, wherein the data characteristic information includes at least a data address, data format information, and status information;
when copying the received media data in the frame digital format to a play buffer according to the data characteristic information, the processor is specifically configured to:
determining whether the status information indicates a set status,
if not, setting a playing format required by the mainboard module when the media data in the frame digital format is played according to the data format information, determining the set playing format as the playing format corresponding to the state information, modifying the state information from an unset state to a set state, addressing the media data in the frame digital format according to the data address, and copying the media data in the frame digital format to the playing buffer area;
if yes, addressing the media data in the frame digital format according to the data address, and copying the media data in the frame digital format to the playing buffer area.
11. The media playback device of claim 10, wherein the playback buffer includes an audio buffer for buffering audio data and a video buffer for buffering video data;
when the playing apparatus is configured to play the media data copied to the play cache region, the playing apparatus is specifically configured to:
according to the set playing format corresponding to the state information and synchronously playing the media data in the frame digital format with the video data cached in the video buffer area; wherein, the media data in frame digital format is the audio data copied to the audio buffer;
alternatively, the first and second electrodes may be,
according to the set playing format corresponding to the state information and synchronously playing the media data in the frame digital format with the audio data cached in the audio buffer zone; wherein the media data in one frame digital format is video data that has been copied into a video buffer.
12. The media playback device of claim 10, wherein the data characteristic information further includes a data size of the media data in a frame digital format;
after the processor is configured to address the media data in the frame digital format according to the data address, the processor is further configured to:
calculating a target address according to the data address and the data size;
and modifying the data address in the data characteristic information into the target address so that the data address can address the media data in the next frame digital format of the media data in the frame digital format.
13. The media playback device of claim 7, further comprising: a DMA controller;
the DMA controller is connected with the memory and the bus and is used for transferring the media data in the digital format transmitted to the mainboard module by the DSP module into the memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811244359.8A CN111093109B (en) | 2018-10-24 | 2018-10-24 | Media data playing processing method and media playing equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811244359.8A CN111093109B (en) | 2018-10-24 | 2018-10-24 | Media data playing processing method and media playing equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111093109A true CN111093109A (en) | 2020-05-01 |
| CN111093109B CN111093109B (en) | 2022-07-29 |
Family
ID=70392254
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811244359.8A Active CN111093109B (en) | 2018-10-24 | 2018-10-24 | Media data playing processing method and media playing equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111093109B (en) |
Citations (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1993006553A1 (en) * | 1991-09-18 | 1993-04-01 | International Business Machines Corporation | Multi-media signal processor computer system |
| CN1330369A (en) * | 2000-06-15 | 2002-01-09 | 财团法人工业技术研究院 | Universal digital video-audio recorder-playback |
| US6434161B1 (en) * | 1998-02-25 | 2002-08-13 | 3Com Corporation | UART with direct memory access buffering of data and method therefor |
| US20050078938A1 (en) * | 2003-07-11 | 2005-04-14 | Henri Crohas | Digital system for recording video signals |
| CN2722386Y (en) * | 2004-03-23 | 2005-08-31 | 广州矽金塔电子有限公司 | Multi-media player |
| CN1897110A (en) * | 2005-07-13 | 2007-01-17 | 孙浩 | High-quality audio-frequency signal coverting playback device with solid memory as media |
| CN1909065A (en) * | 2005-08-02 | 2007-02-07 | 乐金电子（昆山）电脑有限公司 | PCM data buffer and method |
| CN200976655Y (en) * | 2006-01-11 | 2007-11-14 | 四川世纪双虹显示器件有限公司 | Video image collecting circuit for flat-panel display |
| US7307977B1 (en) * | 2002-10-01 | 2007-12-11 | Comsys Communication & Signal Processing Ltd. | Information transfer and interrupt event scheduling scheme for a communications transceiver incorporating multiple processing elements |
| CN101262571A (en) * | 2008-03-28 | 2008-09-10 | 江苏跃进电器有限责任公司 | A decoding method for digital multimedia broadcast receiver |
| US20090055005A1 (en) * | 2007-08-23 | 2009-02-26 | Horizon Semiconductors Ltd. | Audio Processor |
| CN201532774U (en) * | 2009-09-30 | 2010-07-21 | 无锡硅动力微电子股份有限公司 | Digital audio playing chip based on single DSP |
| CN201976211U (en) * | 2010-12-16 | 2011-09-14 | 深圳市和宏实业有限公司 | Digital media adapter |
| CN202101760U (en) * | 2010-11-12 | 2012-01-04 | 山西省电力公司忻州供电分公司 | Thermal infrared image collector |
| CN102419956A (en) * | 2012-01-06 | 2012-04-18 | 矽恩微电子(厦门)有限公司 | Light-emitting diode (LED) display screen drive chip capable of continuously playing images |
| US20120246352A1 (en) * | 2011-03-24 | 2012-09-27 | Kil-Yeon Lim | Data processing systems for audio signals and methods of operating same |
| CN104012104A (en) * | 2011-12-30 | 2014-08-27 | 英特尔公司 | Playback of video content based on frame-level ratings |
| CN104581522A (en) * | 2013-10-24 | 2015-04-29 | 西安群丰电子信息科技有限公司 | High-definition lossless audio playing system (HDAP) |
| CN105281783A (en) * | 2015-09-25 | 2016-01-27 | 中国船舶重工集团公司第七二六研究所 | Signal decoding unit based on FPGA (Field Programmable Gate Array) and DSP (Digital Signal Processor) and realization method for signal decoding unit based on FPGA and DSP |
| CN105430334A (en) * | 2015-11-19 | 2016-03-23 | 青岛中科软件股份有限公司 | Video image acquisition and processing system based on DSP (Digital Signal Processor) and FPGA (Field Programmable Gate Array) |
| CN105900439A (en) * | 2014-01-08 | 2016-08-24 | 三星电子株式会社 | Method and apparatus for reproducing multimedia data |
| CN105898454A (en) * | 2015-11-20 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Signal processing device and multimedia playback device |
| CN106024047A (en) * | 2016-04-20 | 2016-10-12 | 深圳市聚视音科技有限公司 | Lossless and high-fidelity music playing and audio processor based on DSP (digital signal processing) |
| CN106792070A (en) * | 2016-12-19 | 2017-05-31 | 广东威创视讯科技股份有限公司 | A kind of audio, video data DMA transfer method and device |
| CN107277683A (en) * | 2016-04-07 | 2017-10-20 | 深圳市三诺数字科技有限公司 | A kind of audio amplifier system and method |
-
2018
- 2018-10-24 CN CN201811244359.8A patent/CN111093109B/en active Active
Patent Citations (25)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1993006553A1 (en) * | 1991-09-18 | 1993-04-01 | International Business Machines Corporation | Multi-media signal processor computer system |
| US6434161B1 (en) * | 1998-02-25 | 2002-08-13 | 3Com Corporation | UART with direct memory access buffering of data and method therefor |
| CN1330369A (en) * | 2000-06-15 | 2002-01-09 | 财团法人工业技术研究院 | Universal digital video-audio recorder-playback |
| US7307977B1 (en) * | 2002-10-01 | 2007-12-11 | Comsys Communication & Signal Processing Ltd. | Information transfer and interrupt event scheduling scheme for a communications transceiver incorporating multiple processing elements |
| US20050078938A1 (en) * | 2003-07-11 | 2005-04-14 | Henri Crohas | Digital system for recording video signals |
| CN2722386Y (en) * | 2004-03-23 | 2005-08-31 | 广州矽金塔电子有限公司 | Multi-media player |
| CN1897110A (en) * | 2005-07-13 | 2007-01-17 | 孙浩 | High-quality audio-frequency signal coverting playback device with solid memory as media |
| CN1909065A (en) * | 2005-08-02 | 2007-02-07 | 乐金电子（昆山）电脑有限公司 | PCM data buffer and method |
| CN200976655Y (en) * | 2006-01-11 | 2007-11-14 | 四川世纪双虹显示器件有限公司 | Video image collecting circuit for flat-panel display |
| US20090055005A1 (en) * | 2007-08-23 | 2009-02-26 | Horizon Semiconductors Ltd. | Audio Processor |
| CN101262571A (en) * | 2008-03-28 | 2008-09-10 | 江苏跃进电器有限责任公司 | A decoding method for digital multimedia broadcast receiver |
| CN201532774U (en) * | 2009-09-30 | 2010-07-21 | 无锡硅动力微电子股份有限公司 | Digital audio playing chip based on single DSP |
| CN202101760U (en) * | 2010-11-12 | 2012-01-04 | 山西省电力公司忻州供电分公司 | Thermal infrared image collector |
| CN201976211U (en) * | 2010-12-16 | 2011-09-14 | 深圳市和宏实业有限公司 | Digital media adapter |
| US20120246352A1 (en) * | 2011-03-24 | 2012-09-27 | Kil-Yeon Lim | Data processing systems for audio signals and methods of operating same |
| CN104012104A (en) * | 2011-12-30 | 2014-08-27 | 英特尔公司 | Playback of video content based on frame-level ratings |
| CN102419956A (en) * | 2012-01-06 | 2012-04-18 | 矽恩微电子(厦门)有限公司 | Light-emitting diode (LED) display screen drive chip capable of continuously playing images |
| CN104581522A (en) * | 2013-10-24 | 2015-04-29 | 西安群丰电子信息科技有限公司 | High-definition lossless audio playing system (HDAP) |
| CN105900439A (en) * | 2014-01-08 | 2016-08-24 | 三星电子株式会社 | Method and apparatus for reproducing multimedia data |
| CN105281783A (en) * | 2015-09-25 | 2016-01-27 | 中国船舶重工集团公司第七二六研究所 | Signal decoding unit based on FPGA (Field Programmable Gate Array) and DSP (Digital Signal Processor) and realization method for signal decoding unit based on FPGA and DSP |
| CN105430334A (en) * | 2015-11-19 | 2016-03-23 | 青岛中科软件股份有限公司 | Video image acquisition and processing system based on DSP (Digital Signal Processor) and FPGA (Field Programmable Gate Array) |
| CN105898454A (en) * | 2015-11-20 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Signal processing device and multimedia playback device |
| CN107277683A (en) * | 2016-04-07 | 2017-10-20 | 深圳市三诺数字科技有限公司 | A kind of audio amplifier system and method |
| CN106024047A (en) * | 2016-04-20 | 2016-10-12 | 深圳市聚视音科技有限公司 | Lossless and high-fidelity music playing and audio processor based on DSP (digital signal processing) |
| CN106792070A (en) * | 2016-12-19 | 2017-05-31 | 广东威创视讯科技股份有限公司 | A kind of audio, video data DMA transfer method and device |
Non-Patent Citations (2)
| Title |
|---|
| 洪家平: "基于DSP芯片的音频信号数字处理接口", 《电声技术》 * |
| 高倩等: "基于DSP的数字音频解码系统的优化设计", 《南通职业大学学报》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111093109B (en) | 2022-07-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6278478B1 (en) | End-to-end network encoding architecture | |
| US20080151058A1 (en) | Method for Acquiring Video Data by Using Camera Mobile Phone as Computer Camera | |
| US7626637B2 (en) | Method and apparatus for capturing full-screen frames | |
| CN106331733A (en) | Desktop cloud terminal's audio and video data real-time processing method and system | |
| CN115665342B (en) | Image processing method, image processing circuit, electronic device, and readable storage medium | |
| CN112714352B (en) | Screen recording method and device, computing equipment and readable storage medium | |
| US11562772B2 (en) | Video processing method, electronic device, and storage medium | |
| US6446155B1 (en) | Resource bus interface | |
| KR20080018396A (en) | Computer-readable medium for recording mobile application and personal computer application for displaying display information of mobile communications terminal in external display device | |
| CN113068042A (en) | Video compression method, system and device | |
| US8130317B2 (en) | Method and system for performing interleaved to planar transformation operations in a mobile terminal having a video display | |
| CN111093109B (en) | Media data playing processing method and media playing equipment | |
| CN112738620A (en) | Media resource screen projection method, equipment and system | |
| CN113347450B (en) | Method, device and system for sharing audio and video equipment by multiple applications | |
| CN114840282B (en) | Screen recording method and screen recording device of intelligent interaction panel | |
| CA2627064C (en) | Multiplexing video using a dsp | |
| JP4826798B2 (en) | Video encoding system, method and program | |
| CN113691815A (en) | Video data processing method, device and computer readable storage medium | |
| CN112764643A (en) | Method, system, equipment and storage medium for remotely controlling multi-screen computer | |
| CN112312067A (en) | Method, device and equipment for pre-monitoring input video signal | |
| CN110706718A (en) | Audio peripheral denoising processing method and system based on desktop virtualization | |
| CN116405733B (en) | Data transmission method and electronic equipment | |
| WO2022265126A1 (en) | Method and device for improving video editing speed in adaptive media streaming environment | |
| CN114189741B (en) | Image processing method and related device | |
| CN109743521B (en) | Video data transmission method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |