CN104754409A - Multimedia video playing system applied to Android platform and multimedia video playing method applied to multimedia video playing system of Android platform - Google Patents
Multimedia video playing system applied to Android platform and multimedia video playing method applied to multimedia video playing system of Android platform Download PDFInfo
- Publication number
- CN104754409A CN104754409A CN201310742914.0A CN201310742914A CN104754409A CN 104754409 A CN104754409 A CN 104754409A CN 201310742914 A CN201310742914 A CN 201310742914A CN 104754409 A CN104754409 A CN 104754409A
- Authority
- CN
- China
- Prior art keywords
- video
- android platform
- omxcodec
- multimedia
- show layers
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
- H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
Abstract
The invention provides a multimedia video playing system applied to an Android platform and a multimedia video playing method applied to the multimedia video playing system of the Android platform. According to the invention, two buffer groups (input and output) are provided for a file parser, an OMXCodec, a video decoder, a display image layer module, a Stagefright and an image synthesis module to use through a memory allocator, thereby being capable of avoiding problems in the prior art that the number of buffer groups is large, a requirement for the memory size is high in playing, a large amount of data copy exists among different buffer groups, CPU resources are occupied, and the overall playing performance is affected.
Description
Technical field
The present invention relates to multimedia video play-back technology field, particularly a kind of multimedia video Play System and method being applied to Android platform.
Background technology
In intelligent mobile phone terminal field, multimedia video playing function has become a requisite demand, and user is also improving gradually for the demand of mobile phone terminal image quality simultaneously.The HD video of current 1080P resolution (1920 × 1080) is very general, and this multimedia video ability to play for mobile phone terminal also been proposed higher requirement.
Concrete, please refer to Fig. 1, it is the existing mount structure schematic diagram being applied to the multimedia video Play System of Android platform.As shown in Figure 1, the existing multimedia video Play System being applied to Android platform comprises: document parser 10, OMXCodec11, Video Decoder 12, show layers module 13, Stagefright14, image follower 15, Surfaceflinger16, GPU17 and LCD18.Concrete, described document parser 10 pairs of video file formats are resolved, and isolate the video data of each frame; Video Decoder is packaged into OMX IL standard interface by described OMXCodec11, carries out unified management; Described Video Decoder 12 pairs of video datas are decoded; Described show layers module 13 provides show layers; The broadcasting of described Stagefright14 to whole broadcasting link controls and dispatches; Described image follower 15 provides video data; Described Surfaceflinger16 controls the superposition of each show layers; Described GPU17 carries out the synthesis superposition of view data; Described LCD18 display video.
5 buffer(buffer memorys are related to altogether in above-mentioned whole data flow) group, concrete is as follows:
Inbuffer0, it is by OMXCodec11 directly from system assignment buffer group, and this buffer group is discontinuous in physical space.Concrete, after document parser 10 gets this buffer group from OMXCodec11, the video requency frame data of decoding that needs current in video file to be read in this buffer group (thus forming inbuffer0) and sends back to OMXCodec11.
Inbuffer1, it distributes buffer group by Video Decoder 12, and this buffer group is continuous in physical space.Concrete, the data copy in inbuffer0 to (thus forming inbuffer1) in this buffer group, and is given Video Decoder 12 and is decoded by OMXCodec11.
Outbuffer0, it distributes buffer group by Video Decoder 12, and this buffer group is continuous in physical space.Concrete, this buffer group is for depositing the output image data (thus forming outbuffer0) of Video Decoder 12.
Outbuffer1, it is the buffer group of being distributed from Installed System Memory by show layers module 13, and this buffer group is discontinuous in physical space.Concrete, after OMXCodec11 gets this buffer group to show layers module 13, the view data that Video Decoder 12 exports to be copied in this buffer group (thus forming outbuffer1), then gives Surfaceflinger16 by image follower 15 and carry out unified management.All outbuffer1 finally transfer to GPU17 to carry out aliasing computing, and GPU17, with MMU module, does not therefore need physics continuous print memory headroom.
Framebuffer, it is the buffer group just distributed when starting shooting by the driving of LCD18, and this buffer group is continuous in physical space.Data in outbuffer1 superpose with other layer by GPU17, finally output to (thus forming Framebuffer) in this buffer group, and LCD18 obtains data from this Framebuffer and carries out refreshing display.
Above-described buffer group reality is all made up of 2 buffer, carries out pingpang handoff.
For the existing this multimedia video Play System being applied to Android platform there is following multiple shortcoming in it:
1, different buffer(buffer memorys) there is a large amount of data copy between group, take cpu resource, affect overall broadcast performance;
2, buffer(buffer memory) to organize number ratio more, higher to the demand of memory size during broadcasting;
3, the video data exported must be undertaken synthesizing by GPU and just can be shown on LCD, increases the expense of time and power consumption aspect;
4, the Framebuffer of LCD adopts the mechanism of table tennis buffer, must ensure that previous buffer has refreshed when switching, and that is only just can carry out at the sync point of each refreshing the operation switching buffer, can cause like this and block and postpone.
Summary of the invention
The object of the present invention is to provide a kind of the multimedia video Play System and the method that are applied to Android platform, to solve one or more problem existed in prior art.
For solving the problems of the technologies described above, the invention provides a kind of multimedia video Play System being applied to Android platform, described in be applied to Android platform multimedia video Play System comprise: document parser, the OMXCodec be connected with described document parser, the Video Decoder be connected with described OMXCodec, the show layers module be connected with described OMXCodec, the Stagefright be connected with described OMXCodec, the image synthesis unit be connected with described Stagefright and the memory allocator with described OMXCodec and show layers model calling; Wherein,
Described document parser, in order to resolve video file format, isolates the video data of each frame;
Described OMXCodec, in order to Video Decoder to be packaged into OMX IL standard interface, carries out unified management;
Described Video Decoder is in order to decode to video data;
Described show layers module is in order to provide show layers;
Described Stagefright is in order to control the broadcasting of whole broadcasting link and to dispatch;
Described image synthesis unit is in order to carry out synthesis superposition to Video Layer data and user interface map layer data;
Described memory allocator uses for document parser, OMXCodec, Video Decoder, show layers module, Stagefright and image synthesis unit in order to provide two buffer groups.
Optionally, be applied in the multimedia video Play System of Android platform described, described memory allocator provides inbuffer0 and outbuffer0, and wherein, inbuffer0 is used by document parser and Video Decoder; Outbuffer0 is used by Video Decoder, OMXCodec, show layers module, Stagefright and image synthesis unit.
Optionally, be applied in the multimedia video Play System of Android platform described, inbuffer0 is responsible for distributing from memory allocator by OMXCodec; Outbuffer0 is distributed from memory allocator by show layers module in charge.
Optionally, be applied in the multimedia video Play System of Android platform described, outbuffer0 is made up of 3 buffer.
Optionally, be applied in the multimedia video Play System of Android platform described, two buffer groups that described memory allocator provides are continuously in physical space.
Optionally, be applied in the multimedia video Play System of Android platform described, also comprise post processing of image module, described post processing of image module is supplied to OMXCodec after carrying out format analysis processing and convergent-divergent process in order to the video data exported Video Decoder.
Optionally, be applied in the multimedia video Play System of Android platform described, described image synthesis unit comprises: image follower, Surfaceflinger and LCD, wherein,
Described image follower is in order to provide video data;
Described Surfaceflinger is in order to control the superposition of each show layers;
Described LCD to be superposed with the synthesis of user interface layer in order to be carried out video data place layer by overlay function and to show the video after synthesizing.
The present invention also provides one such application in the multimedia video playing method of the multimedia video Play System of Android platform, described in be applied to Android platform multimedia video playing method comprise:
Document parser is resolved video file format, isolates the video data of each frame;
Video Decoder is decoded to video data;
Video Decoder is packaged into OMX IL standard interface by OMXCodec, carries out unified management;
Show layers module provides show layers;
The broadcasting of Stagefright to whole broadcasting link controls and dispatches;
Image synthesis unit carries out synthesis superposition to Video Layer data and user interface map layer data; Wherein,
Memory allocator provides two buffer groups to use for document parser, OMXCodec, Video Decoder, show layers module, Stagefright and image synthesis unit.
Optionally, be applied in the multimedia video playing method of Android platform described, memory allocator provides inbuffer0 and outbuffer0, and wherein, inbuffer0 is used by document parser and Video Decoder; Outbuffer0 is used by Video Decoder, OMXCodec, show layers module, Stagefright and image synthesis unit.
Optionally, be applied in the multimedia video playing method of Android platform described, inbuffer0 is responsible for distributing from memory allocator by OMXCodec; Outbuffer0 is distributed from memory allocator by show layers module in charge.
Optionally, be applied in the multimedia video playing method of Android platform described, outbuffer0 is made up of 3 buffer.
Optionally, be applied in the multimedia video playing method of Android platform described, two buffer groups that memory allocator provides are continuously in physical space.
Optionally, be applied in the multimedia video playing method of Android platform described, after Video Decoder is decoded to video data, also comprise:
Post processing of image module carries out format analysis processing and convergent-divergent process to the video data that Video Decoder exports.
Optionally, be applied in the multimedia video playing method of Android platform described, image synthesis unit carries out synthesis superposition to Video Layer data and user interface map layer data, comprising:
Image follower provides video data;
Surfaceflinger controls the superposition of each show layers;
LCD carries out video data place layer by overlay function and to superpose with the synthesis of user interface layer and to show the video after synthesizing.
In the multimedia video Play System being applied to Android platform provided by the invention and method, there is provided two buffer groups (input and output) for document parser by memory allocator, OMXCodec, Video Decoder, show layers module, Stagefright and image synthesis unit use, buffer(buffer memory in prior art can be avoided thus) to organize number ratio more, buffer(buffer memorys higher and different to the demand of memory size during broadcasting) there is a large amount of data copy between group, take cpu resource, affect the problem of overall broadcast performance.Further, the outbuffer0 that memory allocator provides adopts 3 buffer, the mechanism adopting table tennis buffer in prior art can be avoided thus, must ensure that previous buffer has refreshed when switching, that is only just can carry out at the sync point of each refreshing the operation switching buffer, the problem of blocking and postponing can be caused like this.Further, carried out the synthesis superposition of video data by overlay function, the video data exported in prior art can be avoided thus must to be undertaken synthesizing by GPU and just can be shown on LCD, increase the problem of the expense of time and power consumption aspect.
Accompanying drawing explanation
Fig. 1 is the existing mount structure schematic diagram being applied to the multimedia video Play System of Android platform;
Fig. 2 is the mount structure schematic diagram being applied to the multimedia video Play System of Android platform of the embodiment of the present invention;
Fig. 3 exports the comparison schematic diagram missing refresh point when buffer group is made up of 2 buffer and is made up of 3 buffer.
Embodiment
The multimedia video Play System being applied to Android platform proposed the present invention below in conjunction with the drawings and specific embodiments and method are described in further detail.According to the following describes and claims, advantages and features of the invention will be clearer.It should be noted that, accompanying drawing all adopts the form that simplifies very much and all uses non-ratio accurately, only in order to object that is convenient, the aid illustration embodiment of the present invention lucidly.
Embodiments provide a kind of multimedia video Play System being applied to Android platform, described in be applied to Android platform multimedia video Play System comprise: document parser, the OMXCodec be connected with described document parser, the Video Decoder be connected with described OMXCodec, the show layers module be connected with described OMXCodec, the Stagefright be connected with described OMXCodec, the image synthesis unit be connected with described Stagefright and the memory allocator with described OMXCodec and show layers model calling; Wherein,
Described document parser, in order to resolve video file format, isolates the video data of each frame;
Described OMXCodec, in order to Video Decoder to be packaged into OMX IL standard interface, carries out unified management;
Described Video Decoder is in order to decode to video data;
Described show layers module is in order to provide show layers;
Described Stagefright is in order to control the broadcasting of whole broadcasting link and to dispatch;
Described image synthesis unit is in order to carry out synthesis superposition to Video Layer data and user interface map layer data;
Described memory allocator uses for document parser, OMXCodec, Video Decoder, show layers module, Stagefright and image synthesis unit in order to provide two buffer groups.
Accordingly, the embodiment of the present invention also provides one such application in the multimedia video playing method of the multimedia video Play System of Android platform, described in be applied to Android platform multimedia video playing method comprise:
Document parser is resolved video file format, isolates the video data of each frame;
Video Decoder is decoded to video data;
Video Decoder is packaged into OMX IL standard interface by OMXCodec, carries out unified management;
Show layers module provides show layers;
The broadcasting of Stagefright to whole broadcasting link controls and dispatches;
Image synthesis unit carries out synthesis superposition to Video Layer data and user interface map layer data; Wherein,
Memory allocator provides two buffer groups to use for document parser, OMXCodec, Video Decoder, show layers module, Stagefright and image synthesis unit.
Concrete, please refer to Fig. 2, it is the mount structure schematic diagram being applied to the multimedia video Play System of Android platform of the embodiment of the present invention.As shown in Figure 2, in the present embodiment, the multimedia video Play System being applied to Android platform described in comprises: document parser 20, the OMXCodec21 be connected with described document parser 20, the Video Decoder 22 be connected with described OMXCodec21, the show layers module 23 be connected with described OMXCodec21, the Stagefright24 be connected with described OMXCodec21, the image synthesis unit be connected with described Stagefright24 and the memory allocator 28 be connected with described OMXCodec21 and show layers module 23; Wherein, described image synthesis unit comprises image follower 25, Surfaceflinger26 and LCD27, concrete,
Described document parser 20, in order to resolve video file format, isolates the video data of each frame;
Described OMXCodec21, in order to Video Decoder to be packaged into OMX IL standard interface, carries out unified management;
Described Video Decoder 22 is in order to decode to video data;
Described show layers module 23 is in order to provide show layers;
Described Stagefright24 is in order to control the broadcasting of whole broadcasting link and to dispatch;
Described image follower 25 is in order to provide video data;
Described Surfaceflinger26 is in order to control the superposition of each show layers;
Described LCD27 to be superposed with the synthesis of user interface layer in order to be carried out video data place layer by overlay function and to show the video after synthesizing;
Described memory allocator 28 uses for document parser 20, OMXCodec21, Video Decoder 22, show layers module 23, Stagefright24, image follower 25, Surfaceflinger26 and LCD27 in order to provide two buffer groups.
In the present embodiment, two buffer groups that described memory allocator 28 provides are continuously in physical space, thus, regardless of document parser 20, OMXCodec21, Video Decoder 22, show layers module 23, Stagefright24, image follower 25, Surfaceflinger26 and LCD27 for the demand of buffer group be: for continuous or discontinuous in physical space, all can be met.In the present embodiment, the buffer memory that described memory allocator 28 distributes is: system space or headspace.Concrete, for contiguous memory (buffer memory) demand of bulk, directly distribute from headspace, because system may exist a lot of memory fragmentation after long-play, be easy to cause distributing unsuccessfully.Fritter internal memory (buffer memory) just distributes from Installed System Memory pond, distributes from headspace just in case distribute to transfer to unsuccessfully again.
In the embodiment of the present application, described memory allocator 28 uses for document parser 20, OMXCodec21, Video Decoder 22, show layers module 23, Stagefright24, image follower 25, Surfaceflinger26 and LCD27 in order to provide two buffer groups.And when specifically distributing, be achieved by OMXCodec21 and show layers module 23.Concrete, memory allocator 28 provides inbuffer0 and outbuffer0, and wherein, inbuffer0 is responsible for distributing from memory allocator 28 by OMXCodec21; Outbuffer0 is responsible for distributing from memory allocator 28 by show layers module 23.Concrete, inbuffer0 is used by document parser 20 and Video Decoder 22; Outbuffer0 is used by Video Decoder 22, OMXCodec21, show layers module 23, Stagefright24, image follower 25, Surfaceflinger26 and LCD27.Because document parser 20 and Video Decoder 22 all use inbuffer0, avoid a large amount of data copy between the two thus; Same, because Video Decoder 22, OMXCodec21, show layers module 23, Stagefright24, image follower 25, Surfaceflinger26 and LCD27 all use outbuffer0, it also avoid data copy a large amount of between each module.
Further, the outbuffer0 that memory allocator 28 provides is made up of 3 buffer, the mechanism adopting table tennis buffer in prior art can be avoided thus, must ensure that previous buffer has refreshed when switching, that is only just can carry out at the sync point of each refreshing the operation switching buffer, the problem of blocking and postponing can be caused like this.Concrete, please refer to Fig. 3, it is export the comparison schematic diagram missing refresh point when buffer group is made up of 2 buffer and is made up of 3 buffer.As shown in Figure 3, LCD carries out Refresh Data with fixing frame per second, under the pattern that output buffer group is made up of 2 buffer, if the time of Video Decoder 22 a certain frame process is slightly long, miss refresh point, a whole cycle all can be in the state of obstruction, until next refresh point just can carry out buffer switching so below.Exporting under buffer group (outbuffer0) pattern that is made up of 3 buffer, though Video Decoder 22 processing time slightly length miss refresh point, also have vacant buffer to export, the process of next frame can not be affected.
In the present embodiment, carry out video data place layer mainly through the overlay function of LCD27 to superpose with the synthesis of user interface layer and to show the video after synthesizing.Concrete, outbuffer0 is directly outputted in the secondary layer of LCD, carried out the aliasing of master map layer and secondary layer by LCD.The secondary layer of LCD is independent of master map layer, so dynamic appointment obtains the memory headroom of refresh data.Therefore, only need one group in whole output link and export buffer(and outbuffer0), distributed by show layers module 23, physics is continuous.Video Decoder 22 is toward output video data in this buffer group, and the secondary layer of LCD then obtains refresh data from this buffer group.Thus, GPU is without the need to carrying out synthetic operation for show layers again, and GPU can be in sleep state, is only upgraded the display data of needs by the secondary layer of LCD, thus can greatly reduce power consumption and resource occupation.
Further, the multimedia video Play System being applied to Android platform in the embodiment of the present application also comprises: post processing of image module 29, described post processing of image module 29 is supplied to OMXCodec21 after carrying out format analysis processing and convergent-divergent process in order to the video data exported Video Decoder 22, shows requirement to meet to LCD27.Further, post processing of image module 39 and Video Decoder 22 can form streamline and export, and namely post processing of image module 29 is while process previous frame data, and Video Decoder 22 just can start the decoding of next frame data.
As fully visible, in the multimedia video Play System being applied to Android platform provided in the embodiment of the present invention and method, there is provided two buffer groups (input and output) for document parser by memory allocator, OMXCodec, Video Decoder, show layers module, Stagefright and image synthesis unit use, buffer(buffer memory in prior art can be avoided thus) to organize number ratio more, buffer(buffer memorys higher and different to the demand of memory size during broadcasting) there is a large amount of data copy between group, take cpu resource, affect the problem of overall broadcast performance.Further, the outbuffer0 that memory allocator provides adopts 3 buffer, the mechanism adopting table tennis buffer in prior art can be avoided thus, must ensure that previous buffer has refreshed when switching, that is only just can carry out at the sync point of each refreshing the operation switching buffer, the problem of blocking and postponing can be caused like this.Further, carried out the synthesis superposition of video data by overlay function, the video data exported in prior art can be avoided thus must to be undertaken synthesizing by GPU and just can be shown on LCD, increase the problem of the expense of time and power consumption aspect.
Foregoing description is only the description to present pre-ferred embodiments, any restriction not to the scope of the invention, and any change that the those of ordinary skill in field of the present invention does according to above-mentioned disclosure, modification, all belong to the protection range of claims.
Claims (14)
1. one kind is applied to the multimedia video Play System of Android platform, it is characterized in that, comprising: document parser, the OMXCodec be connected with described document parser, the Video Decoder be connected with described OMXCodec, the show layers module be connected with described OMXCodec, the Stagefright be connected with described OMXCodec, the image synthesis unit be connected with described Stagefright and the memory allocator with described OMXCodec and show layers model calling; Wherein,
Described document parser, in order to resolve video file format, isolates the video data of each frame;
Described OMXCodec, in order to Video Decoder to be packaged into OMX IL standard interface, carries out unified management;
Described Video Decoder is in order to decode to video data;
Described show layers module is in order to provide show layers;
Described Stagefright is in order to control the broadcasting of whole broadcasting link and to dispatch;
Described image synthesis unit is in order to carry out synthesis superposition to Video Layer data and user interface map layer data;
Described memory allocator uses for document parser, OMXCodec, Video Decoder, show layers module, Stagefright and image synthesis unit in order to provide two buffer groups.
2. be applied to the multimedia video Play System of Android platform as claimed in claim 1, it is characterized in that, described memory allocator provides inbuffer0 and outbuffer0, and wherein, inbuffer0 is used by document parser and Video Decoder; Outbuffer0 is used by Video Decoder, OMXCodec, show layers module, Stagefright and image synthesis unit.
3. be applied to the multimedia video Play System of Android platform as claimed in claim 2, it is characterized in that, inbuffer0 is responsible for distributing from memory allocator by OMXCodec; Outbuffer0 is distributed from memory allocator by show layers module in charge.
4. be applied to the multimedia video Play System of Android platform as claimed in claim 2, it is characterized in that, outbuffer0 is made up of 3 buffer.
5. be applied to the multimedia video Play System of Android platform as claimed in claim 1, it is characterized in that, two buffer groups that described memory allocator provides are continuously in physical space.
6. the multimedia video Play System being applied to Android platform according to any one of Claims 1 to 5, it is characterized in that, also comprise post processing of image module, described post processing of image module is supplied to OMXCodec after carrying out format analysis processing and convergent-divergent process in order to the video data exported Video Decoder.
7. the multimedia video Play System being applied to Android platform according to any one of Claims 1 to 5, it is characterized in that, described image synthesis unit comprises: image follower, Surfaceflinger and LCD, wherein,
Described image follower is in order to provide video data;
Described Surfaceflinger is in order to control the superposition of each show layers;
Described LCD to be superposed with the synthesis of user interface layer in order to be carried out video data place layer by overlay function and to show the video after synthesizing.
8. the multimedia video playing method being applied to the multimedia video Play System of Android platform according to any one of claim 1 ~ 7, is characterized in that, comprising:
Document parser is resolved video file format, isolates the video data of each frame;
Video Decoder is decoded to video data;
Video Decoder is packaged into OMX IL standard interface by OMXCodec, carries out unified management;
Show layers module provides show layers;
The broadcasting of Stagefright to whole broadcasting link controls and dispatches;
Image synthesis unit carries out synthesis superposition to Video Layer data and user interface map layer data; Wherein,
Memory allocator provides two buffer groups to use for document parser, OMXCodec, Video Decoder, show layers module, Stagefright and image synthesis unit.
9. be applied to the multimedia video playing method of Android platform as claimed in claim 8, it is characterized in that, memory allocator provides inbuffer0 and outbuffer0, and wherein, inbuffer0 is used by document parser and Video Decoder; Outbuffer0 is used by Video Decoder, OMXCodec, show layers module, Stagefright and image synthesis unit.
10. be applied to the multimedia video playing method of Android platform as claimed in claim 9, it is characterized in that, inbuffer0 is responsible for distributing from memory allocator by OMXCodec; Outbuffer0 is distributed from memory allocator by show layers module in charge.
11. multimedia video playing methods being applied to Android platform as claimed in claim 9, it is characterized in that, outbuffer0 is made up of 3 buffer.
12. multimedia video playing methods being applied to Android platform as claimed in claim 8, it is characterized in that, two buffer groups that memory allocator provides are continuously in physical space.
13. multimedia video playing methods being applied to Android platform according to any one of claim 8 ~ 12, is characterized in that, after Video Decoder is decoded to video data, also comprise:
Post processing of image module carries out format analysis processing and convergent-divergent process to the video data that Video Decoder exports.
14. multimedia video playing methods being applied to Android platform according to any one of claim 8 ~ 12, is characterized in that, image synthesis unit carries out synthesis superposition to Video Layer data and user interface map layer data, comprising:
Image follower provides video data;
Surfaceflinger controls the superposition of each show layers;
LCD carries out video data place layer by overlay function and to superpose with the synthesis of user interface layer and to show the video after synthesizing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310742914.0A CN104754409A (en) | 2013-12-27 | 2013-12-27 | Multimedia video playing system applied to Android platform and multimedia video playing method applied to multimedia video playing system of Android platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310742914.0A CN104754409A (en) | 2013-12-27 | 2013-12-27 | Multimedia video playing system applied to Android platform and multimedia video playing method applied to multimedia video playing system of Android platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104754409A true CN104754409A (en) | 2015-07-01 |
Family
ID=53593405
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310742914.0A Pending CN104754409A (en) | 2013-12-27 | 2013-12-27 | Multimedia video playing system applied to Android platform and multimedia video playing method applied to multimedia video playing system of Android platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104754409A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105741819A (en) * | 2016-03-01 | 2016-07-06 | 晨星半导体股份有限公司 | Image layer processing method and device |
| CN105812832A (en) * | 2016-04-01 | 2016-07-27 | 中国科学院信息工程研究所 | Method for obtaining video data in video Apps based on Android multimedia framework |
| CN106055294A (en) * | 2016-05-23 | 2016-10-26 | 福州瑞芯微电子股份有限公司 | Layer composition optimization method and apparatus |
| WO2017173576A1 (en) * | 2016-04-05 | 2017-10-12 | 华为技术有限公司 | Display method and terminal |
| CN109640168A (en) * | 2018-11-27 | 2019-04-16 | Oppo广东移动通信有限公司 | Method for processing video frequency, device, electronic equipment and computer-readable medium |
| CN112486606A (en) * | 2020-11-19 | 2021-03-12 | 湖南麒麟信安科技股份有限公司 | Cloud desktop display optimization method and system based on Android system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1253453A (en) * | 1998-05-28 | 2000-05-17 | 松下电器产业株式会社 | Storage controller used on U. S. high level TV standard committee video decoder |
| US20090208185A1 (en) * | 1998-07-30 | 2009-08-20 | Tivo Inc. | Multiple output digital video recording system |
| CN102547146A (en) * | 2010-12-29 | 2012-07-04 | 新奥特（北京）视频技术有限公司 | System and method for interacting subtitle data |
| CN102768849A (en) * | 2012-08-02 | 2012-11-07 | 广州市花都区中山大学国光电子与通信研究院 | Music playing system based on wireless audio data transmission |
-
2013
- 2013-12-27 CN CN201310742914.0A patent/CN104754409A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1253453A (en) * | 1998-05-28 | 2000-05-17 | 松下电器产业株式会社 | Storage controller used on U. S. high level TV standard committee video decoder |
| US20090208185A1 (en) * | 1998-07-30 | 2009-08-20 | Tivo Inc. | Multiple output digital video recording system |
| CN102547146A (en) * | 2010-12-29 | 2012-07-04 | 新奥特（北京）视频技术有限公司 | System and method for interacting subtitle data |
| CN102768849A (en) * | 2012-08-02 | 2012-11-07 | 广州市花都区中山大学国光电子与通信研究院 | Music playing system based on wireless audio data transmission |
Non-Patent Citations (1)
| Title |
|---|
| 张维婷: "Android多媒体系统设计实现与低功耗优化", 《中国优秀硕士学位论文全文数据库》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105741819A (en) * | 2016-03-01 | 2016-07-06 | 晨星半导体股份有限公司 | Image layer processing method and device |
| CN105741819B (en) * | 2016-03-01 | 2018-07-13 | 晨星半导体股份有限公司 | A kind of figure layer process method and device |
| CN105812832A (en) * | 2016-04-01 | 2016-07-27 | 中国科学院信息工程研究所 | Method for obtaining video data in video Apps based on Android multimedia framework |
| CN105812832B (en) * | 2016-04-01 | 2019-04-30 | 中国科学院信息工程研究所 | Video data acquisition methods in video class App based on Android multimedia framework |
| WO2017173576A1 (en) * | 2016-04-05 | 2017-10-12 | 华为技术有限公司 | Display method and terminal |
| CN106055294A (en) * | 2016-05-23 | 2016-10-26 | 福州瑞芯微电子股份有限公司 | Layer composition optimization method and apparatus |
| CN106055294B (en) * | 2016-05-23 | 2019-02-01 | 福州瑞芯微电子股份有限公司 | A kind of figure layer synthesis optimizing method and apparatus |
| CN109640168A (en) * | 2018-11-27 | 2019-04-16 | Oppo广东移动通信有限公司 | Method for processing video frequency, device, electronic equipment and computer-readable medium |
| US11706484B2 (en) | 2018-11-27 | 2023-07-18 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Video processing method, electronic device and computer-readable medium |
| CN112486606A (en) * | 2020-11-19 | 2021-03-12 | 湖南麒麟信安科技股份有限公司 | Cloud desktop display optimization method and system based on Android system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104754409A (en) | Multimedia video playing system applied to Android platform and multimedia video playing method applied to multimedia video playing system of Android platform | |
| CN103870055B (en) | It is integrated with display device and its driving method of touch screen | |
| US8484391B2 (en) | Configurable buffer allocation for multi-format video processing | |
| CN102208171B (en) | Local detail playing method on portable high-definition video player | |
| CN103581505B (en) | Digital video signal processing device and method | |
| CN103377030B (en) | image rotation control method and device | |
| CN103618869B (en) | Many picture video joining methods and device | |
| CN1981519A (en) | Method and system for displaying a sequence of image frames | |
| CN109313609A (en) | The system and method to interweave for odd mode storage channel | |
| CN205069079U (en) | Multi -functional LED display screen control system | |
| CN109819315A (en) | Playback method, device, terminal and the storage medium of HEVC video | |
| CN202855261U (en) | Asynchronous LED display screen full-color synchronous play control system | |
| CN103123589B (en) | A kind of starting up's method and apparatus of mobile terminal | |
| CN205862772U (en) | The LCD TV splicing apparatus of a kind of built-in hybrid matrix and liquid crystal-spliced system | |
| CN116324962A (en) | Method and device for switching display panel FPS | |
| CN113994363A (en) | Method and apparatus for wave slot management | |
| CN106796535A (en) | Image display method, device, electronic equipment and computer program product | |
| CN102682741B (en) | Multi-display control system and implementation method of multi-display control system | |
| CN101729903B (en) | Method, system and multimedia processor for reading reference frame data | |
| CN114979761A (en) | Display method and system of video player based on universal SOC | |
| CN101930713A (en) | Storage unit framework of display device and reading method thereof | |
| CN116700943A (en) | Video playing system and method and electronic equipment | |
| CN203205058U (en) | Embedded general measurement and control equipment exploitation platform having audio and video functions | |
| CN203013216U (en) | LED display screen control device | |
| CN106027925B (en) | display control method and device of OSD menu |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150701 |
|
| WD01 | Invention patent application deemed withdrawn after publication |