CN106658171A - Video decoding data transmission method and device - Google Patents
Video decoding data transmission method and device Download PDFInfo
- Publication number
- CN106658171A CN106658171A CN201611200772.5A CN201611200772A CN106658171A CN 106658171 A CN106658171 A CN 106658171A CN 201611200772 A CN201611200772 A CN 201611200772A CN 106658171 A CN106658171 A CN 106658171A
- Authority
- CN
- China
- Prior art keywords
- video data
- decoded video
- handle structure
- privately owned
- window buffer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 50
- 230000005540 biological transmission Effects 0.000 title claims abstract description 27
- 239000000872 buffer Substances 0.000 claims abstract description 102
- 238000012546 transfer Methods 0.000 claims description 4
- 238000009877 rendering Methods 0.000 claims description 3
- 230000015654 memory Effects 0.000 abstract description 26
- 230000006870 function Effects 0.000 abstract description 16
- 230000008569 process Effects 0.000 description 13
- 238000004891 communication Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 5
- 230000005236 sound signal Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000002093 peripheral effect Effects 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 230000000712 assembly Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- KLDZYURQCUYZBL-UHFFFAOYSA-N 2-[3-[(2-hydroxyphenyl)methylideneamino]propyliminomethyl]phenol Chemical compound OC1=CC=CC=C1C=NCCCN=CC1=CC=CC=C1O KLDZYURQCUYZBL-UHFFFAOYSA-N 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000012512 characterization method Methods 0.000 description 1
- 239000007795 chemical reaction product Substances 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 201000001098 delayed sleep phase syndrome Diseases 0.000 description 1
- 208000033921 delayed sleep phase type circadian rhythm sleep disease Diseases 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000013467 fragmentation Methods 0.000 description 1
- 238000006062 fragmentation reaction Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000008595 infiltration Effects 0.000 description 1
- 238000001764 infiltration Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000005728 strengthening Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 239000011800 void material Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N21/4431—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB characterized by the use of Application Program Interface [API] libraries
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N21/4438—Window management, e.g. event handling following interaction with the user interface
Abstract
The present disclosure relates to a video decoding data transmission method and device, the method includes: creating an ION shared memory containing a file identifier through a channel management function; constructing a private handle structure object according to the file identifier and creating a local window buffer according to the private handle structure object and the ION shared memory; when video decoding data are received, filling the video decoding data into the local window buffer; transferring the private handle structure object corresponding to the local window buffer filled with the video decoding data to a video library; and the video library accesses the video decoding data in the local window buffer according to the received private handle structure object corresponding to the local window buffer. The method can reduce the copy times among the memories.
Description
Technical field
It relates to mobile terminal technology technical field, in particular to a kind of decoded video data transmission method
And a kind of decoded video data transmitting device.
Background technology
With developing rapidly for integrated circuit technique and communication network technology, mobile terminal gradually has powerful place
Reason ability and communication function.At present, mobile terminal is changed into an integrated information processing platform from simple call instrument, into
For infiltration extensively, popularization is rapid, it is huge to affect, deeply to the end product of human society life every aspect.
Under the background that mobile phone users amount is increased rapidly, increasing user selects to be regarded using mobile terminal
Frequency is watched.With reference to shown in Fig. 1, existing video decoding process for example can include：Source file is copied by Inport first
To in decoding storehouse, decoded using half wave decoder, decoding data to video library is copied by Outport after the completion of decoding
In；During broadcasting, then decoding data is copied in GPU (Graphics Processing Unit, graphic process unit), Jing process
After could play.Occupancy of the aforesaid way for CPU is very big, and when playing the video of 720P, the occupancy of CPU is 70%
More than；When playing the video of 1080P, the occupancy of CPU may be to more than 90%.Therefore, technical scheme of the prior art is also
In place of presence has much room for improvement.
It should be noted that information is only used for strengthening the reason of background of this disclosure disclosed in above-mentioned background section
Solution, therefore can include not constituting the information to prior art known to persons of ordinary skill in the art.
The content of the invention
The purpose of the disclosure is to provide a kind of decoded video data transmission method and a kind of transmission of decoded video data
Device, and then restriction and defect due to correlation technique are at least overcome to a certain extent and caused one or more is asked
Topic.
According to an aspect of this disclosure, there is provided a kind of decoded video data transmission method, including：
By ION shared drive of the channel management function creation one comprising file identifier；
Privately owned handle structure object is built according to the file identifier and according to the privately owned handle structure object and
The ION shared drives create native window buffer；
When decoded video data is received, the decoded video data is filled into the native window buffer；
By the corresponding privately owned handle structure pair of the native window buffer filled by the decoded video data
In as being transferred to a video library；
The video library is visited according to the corresponding privately owned handle structure object of the native window buffer for receiving
Ask the decoded video data in the native window buffer.
In a kind of exemplary embodiment of the disclosure, privately owned handle structure object is built simultaneously according to the file identifier
Creating native window buffer according to the privately owned handle structure object and the ION shared drives includes：
Some privately owned handle structure objects are built according to the file identifier；
Some native window cachings are created according to some privately owned handle structure objects and the ION shared drives
Device；Wherein,
Each privately owned handle structure object is corresponded with each native window buffer.
In a kind of exemplary embodiment of the disclosure, the decoded video data transmission method also includes：
A shared data-interface is created using the native window buffer；
The shared data interface is according to the corresponding privately owned handle structure object acquisition of the native window buffer
Decoded video data in the native window buffer is simultaneously rendered on a display device.
In a kind of exemplary embodiment of the disclosure, the shared data interface includes open GL or vector
One or more in pattern algorithm storehouse.
In a kind of exemplary embodiment of the disclosure, the decoded video data is yuv data.
According to another aspect of the disclosure, there is provided a kind of decoded video data transmitting device, including：
ION shared drive creation modules：For being shared by ION of the channel management function creation one comprising file identifier
Internal memory；
Native window buffer creation module：For building privately owned handle structure object and root according to the file identifier
Native window buffer is created according to the privately owned handle structure object and the ION shared drives；
Database population module：For when decoded video data is received, the decoded video data is filled to described
In native window buffer；
Privately owned handle structure object transfer module：For the native window filled by the decoded video data to be delayed
The corresponding privately owned handle structure object of storage is transferred in a video library；
Decoded video data access modules：For the video library according to the native window buffer correspondence for receiving
Described privately owned handle structure object accesses described in the decoded video data in native window buffer.
In a kind of exemplary embodiment of the disclosure, privately owned handle structure object is built simultaneously according to the file identifier
Creating native window buffer according to the privately owned handle structure object and the ION shared drives includes：
Some privately owned handle structure objects are built according to the file identifier；
Some native window cachings are created according to some privately owned handle structure objects and the ION shared drives
Device；Wherein,
Each privately owned handle structure object is corresponded with each native window buffer.
In a kind of exemplary embodiment of the disclosure, the decoded video data transmitting device also includes：
Shared data interface creation module：For creating a shared data-interface using the native window buffer；
Decoded video data rendering module：It is corresponding according to the native window buffer for the shared data interface
Decoded video data in native window buffer described in the privately owned handle structure object acquisition simultaneously renders to a display device
On.
In a kind of exemplary embodiment of the disclosure, the shared data interface includes open GL or vector
One or more in pattern algorithm storehouse.
In a kind of exemplary embodiment of the disclosure, the decoded video data is yuv data.
According to another aspect of the disclosure, there is provided a kind of mobile terminal, including：
Processor；And
Memorizer, for storing the executable instruction of the processor；
Wherein described processor is configured to perform following operation via the executable instruction is performed：
By ION shared drive of the channel management function creation one comprising file identifier；
Privately owned handle structure object is built according to the file identifier and according to the privately owned handle structure object and
The ION shared drives create native window buffer；
When decoded video data is received, the decoded video data is filled into the native window buffer；
By the corresponding privately owned handle structure pair of the native window buffer filled by the decoded video data
In as being transferred to a video library；
The video library is visited according to the corresponding privately owned handle structure object of the native window buffer for receiving
Ask the decoded video data in the native window buffer.
A kind of decoded video data transmission method of the disclosure and device, are total to by creating an ION comprising file identifier
Enjoy internal memory and create native window buffer；Then the decoded video data for receiving is filled into native window buffer；
When video library needs to access the decoded video data, can directly according to the corresponding privately owned handle structure of native window buffer
The decoded video data in object accesses native window buffer；This is directly accessed by using privately owned handle structure object
Decoded video data in ground window buffer, reduces the memory copying between video frequency output to video library, reduces CPU
Pressure, improve the overall performance of system.
Other decoded video data transmission methods of the disclosure and device, it is further by create ION shared drives and
Shared data interface, reduces the memory copying between CPU to GPU, improves overall broadcasting speed.
It should be appreciated that the general description of the above and detailed description hereinafter are only exemplary and explanatory, not
The disclosure can be limited.
Description of the drawings
Accompanying drawing herein is merged in description and constitutes the part of this specification, shows the enforcement for meeting the disclosure
Example, and be used to explain the principle of the disclosure together with description.It should be evident that drawings in the following description are only the disclosure
Some embodiments, for those of ordinary skill in the art, on the premise of not paying creative work, can be with basis
These accompanying drawings obtain other accompanying drawings.
Fig. 1 schematically shows the flow chart that a kind of existing video decoding is played.
Fig. 2 schematically shows a kind of method flow diagram of decoded video data transmission.
Fig. 3 schematically shows the method flow diagram for creating native window buffer.
Fig. 4 schematically shows the method flow diagram of another kind of decoded video data transmission.
Fig. 5 schematically shows a kind of device block diagram of decoded video data transmission.
Fig. 6 schematically shows a kind of using above-mentioned decoded video data transmission method or decoded video data transmitting device
The structured flowchart of mobile terminal.
Specific embodiment
Example embodiment is described more fully with referring now to accompanying drawing.However, example embodiment can be with various shapes
Formula is implemented, and is not understood as limited to example set forth herein；Conversely, thesing embodiments are provided so that the disclosure will more
Fully and completely, and by the design of example embodiment those skilled in the art is comprehensively conveyed to.Described feature, knot
Structure or characteristic can be combined in any suitable manner in one or more embodiments.In the following description, there is provided perhaps
Many details are so as to providing fully understanding for embodiment of this disclosure.It will be appreciated, however, by one skilled in the art that can
Omit one or more in the specific detail to put into practice the technical scheme of the disclosure, or other sides can be adopted
Method, constituent element, device, step etc..In other cases, be not shown in detail or describe known solution a presumptuous guest usurps the role of the host avoiding and
So that each side of the disclosure thicken.
Additionally, accompanying drawing is only the schematic illustrations of the disclosure, it is not necessarily drawn to scale.Identical accompanying drawing mark in figure
Note represents same or similar part, thus will omit repetition thereof.Some block diagrams shown in accompanying drawing are work(
Energy entity, not necessarily must be corresponding with physically or logically independent entity.These work(can be realized using software form
Energy entity, or these functional entitys are realized in one or more hardware modules or integrated circuit, or at heterogeneous networks and/or place
These functional entitys are realized in reason device device and/or microcontroller device.
A kind of video data decoding transmission method is provide firstly in this example embodiment.With reference to shown in Fig. 2, the video
Data solution decoding transmission method may comprise steps of：
Step S210. is by ION shared drive of the channel management function creation one comprising file identifier.
Step S220. builds privately owned handle structure object and according to the privately owned handle structure according to the file identifier
Object and the ION shared drives create native window buffer.
Step S230. fills the decoded video data to the native window when decoded video data is received
In buffer.
Step S240. is by the corresponding privately owned sentence of the native window buffer filled by the decoded video data
Handle structure object is transferred in a video library.
Video library described in step S250. is according to the corresponding privately owned handle knot of the native window buffer for receiving
The decoded video data in native window buffer described in structure object accesses.
Above-mentioned video data decoding method, by creating ION shared drives and directly being visited using privately owned handle structure object
The decoded video data in native window buffer is asked, the memory copying between video frequency output to video library is reduced, is reduced
The pressure of CPU, improves the overall performance of system.
Below, each step of decoded video data transmission method in this example embodiment will be described in detail.
In step S210, by ION shared drive of the channel management function creation one comprising file identifier.
In this example embodiment, channel management function (ioctl) is to the I/O passages of equipment in device driver
The function being managed；Wherein, I/O passages being managed can include being controlled some characteristics of equipment, for example may be used
Being Transmission bit rate, rotating speed of motor of serial ports etc..The parameter of ioctl for example can include int ioctl (int fd,
int cmd,…)；Wherein, fd can for example include that user program opens the file identification returned using open functions during equipment
Symbol, cmd can for example include control command of the user program to equipment；Ellipsis for example can be some supplementary parameters, supplement
The number of parameter can be 1 or 0, be determined by cmd；Above-mentioned ION shared drives for example can be that google exists
The common memory manager that Android4.0ICS is introduced to solve memory fragmentation management, it can more merge Kernel (behaviour
Make system kernel)；ION shared drives are similar with PMEM, can manage one or more memory pools, and some of which can be in Boot
Allocate in advance when Time (starting time), in case to special hardware (such as GPU and display controller etc. can be included
Deng) use；ION shared drives can manage these pool (memory pool) by heaps (heap or heap memory)；ION shares
Internal memory can be carried out internal memory between the module between the process (process) of userspace (user control) or in kernel
It is shared.For example：
In this example, ION shared drives are created by ioctl so that the decoding being stored in native window buffer
Video data can be shared by corresponding file identifier.Further, above-mentioned decoded video data can be YUV numbers
According to；Wherein, YUV for example can be a kind of colour coding method adopted by eurovision system, may belong to PAL, also may be used
With the color space adopted including PAL and SECAM simulation colors television system；In modern color television system, generally adopt
Three pipe colour cameras or colored CCD camera carry out capture, then obtain colour picture signal Jing color separations, amplify respectively
Obtain RGB after correction, then luminance signal Y and two colour difference signal B-Y (i.e. U), R-Y are obtained (i.e. through matrixer
V), last transmitting terminal is respectively encoded three signals of brightness and aberration, is sent with same channel；The table of above-mentioned color
Show that method can be interpreted that YUV color spaces are represented.Wherein, for example can be that its is bright using the importance of YUV color spaces
Degree signal Y and carrier chrominance signal U, V are detached.
In step S220, privately owned handle structure object is built and according to the privately owned handle according to the file identifier
Structure objects and the ION shared drives create native window buffer.With reference to shown in Fig. 3, the step can also include step
Rapid S2202～S2204.Wherein：
In step S2202, some privately owned handle structure objects are built according to the file identifier；In step S2204
In, create some native window buffers according to some privately owned handle structure objects and the ION shared drives.
Wherein, above-mentioned each privately owned handle structure object is corresponded with each native window buffer.
In this example embodiment, handle (handle) can be defined as：In file I/O, if will be from one
File reads data, and application program first has to call operation system function and transmits filename, and selects one to arrive this document
Path is opening file；Aforesaid operations system function fetches a serial number, i.e. file handle (file handle), this document
Handle is unique basis of characterization for the file opened；A block number evidence is read from file, application program needs to call letter
Number ReadFile, and the address by file handle in internal memory and the byte number to be copied send operating system to；Buffer is (slow
Rushing depositor, it is also possible to referred to as buffer) CPU that can make high speed operation and the peripheral hardware for working at a slow speed rise and coordinate and buffer to make
With, realize data transmit synchronization.For example：
In this example, some privately owned handle structure object (private_ can be created according to above-mentioned file identifier
Handle_t), and according to above-mentioned ION shared drives and some some window buffers of privately owned handle structure Object Creation
(NativeWindowBuffer), a memory pool is formed so that buffer can share.
In step S230, when decoded video data is received, the decoded video data is filled to described
In ground window buffer.
In this example embodiment, after the completion of video decoding, decoded video data is exported to ION and is total to by Outport
In enjoying internal memory, ION shared drives fill decoded video data to above-mentioned memory pool when above-mentioned decoded video data is received
In arbitrary native window buffer (NativeWindowBuffer) in.Wherein, above-mentioned Outport for example can be defined as
The hardware port of output data, for example, can be expressed as：void outport(int port,int value).Additionally, at this
In disclosed other exemplary embodiments, other definition can also be done to Outport according to practical situation, this exemplary enforcement
Particular determination is not done to this in example.
In step S240, by the corresponding private of the native window buffer filled by the decoded video data
There is handle structure object to be transferred in a video library.
In step s 250, the video library is according to the corresponding privately owned sentence of the native window buffer for receiving
The decoded video data in native window buffer described in handle structure object accesses.
In this example embodiment, after above-mentioned decoded video data is filled into native window buffer, by the window
The corresponding privately owned handle structure object of mouth buffer is transferred in a video library, when video library needs to access the decoded video data
When, first corresponding native window buffer, Ran Houzai are found in memory pool according to the privately owned handle structure object for receiving
Access the decoded video data.Additionally, in other exemplary embodiments of the disclosure, it can also be passed through according to practical situation
His mode to be accessed in decoded video data, this exemplary embodiment and this is not done particular determination.
Further, with reference to shown in Fig. 4, in other exemplary embodiments of the disclosure, the decoded video data transmission
Method can also include step S410 and step S420.Wherein：
In step S410, using the native window buffer a shared data-interface is created；In the step s 420, institute
State shared data interface local window according to the corresponding privately owned handle structure object acquisition of the native window buffer
Decoded video data in mouthful buffer is simultaneously rendered on a display device.
In this example embodiment, shared data interface (EGLImage) can for example represent one kind by EGL client API
The shared resource type that (Application Programming Interface, application programming interface) is created；Shared number
2D Image Sharing data can be for example created according to interface, it is also possible to create any type of shared data；Shared data interface can
In to include open GL, vector graphics algorithms library etc.；Wherein, open GL (OpenGL, Open
Graphics Library) for example can be defined as one across programming language, cross-platform DLL specification it is professional
Graphic package interface；Two dimension or 3-D view can also be used for, be that One function is powerful, call convenient underlying graphics storehouse；
Vector graphics algorithms library (OpenVG, Open Vector Graphics) for example can be defined as such as Flash and SVG
Vector graphics algorithms library provide bottom hardware accelerate interface exempt from authorize expense, cross-platform routine interface API；OpenVG's
Initial target is mainly directed towards the portable, hand-held device for needing high-quality vector graphics algorithm speed technology, in small screen device
On realize dynamite user interface and text display effect, and support hardware-accelerated with extremely low processor power rank
It is lower to realize smooth interactive performance.In this example, a shared data-interface is created using above-mentioned native window buffer；When broadcasting
Put when stating decoding video data, it is right that shared data interface finds first according to above-mentioned privately owned handle structure object in memory pool
The native window buffer answered, then reentrying the decoded video data and is rendered on a display device.Additionally, at this
In disclosed other exemplary embodiments, also decoded video data is rendered to using other modes show according to practical situation
On equipment, particular determination is not done to this in this exemplary embodiment.
Although additionally, describe each step of method in the disclosure with particular order in the accompanying drawings, this does not really want
Asking or imply must perform these steps according to the particular order, or the step having to carry out shown in whole could be realized
Desired result.It is additional or alternative, it is convenient to omit some steps, multiple steps are merged into into a step and is performed, and/
Or a step is decomposed into into execution of multiple steps etc..
This example embodiment additionally provides a kind of decoded video data transmitting device.With reference to shown in Fig. 5, the video decoding
Output device can include：ION shared drives creation module 510, native window buffer creation module 520, data fill mould
Block 530, privately owned handle structure object transfer module 540 and decoded video data access modules 550.Wherein：
ION shared drives creation module 510 can be used for including file identifier by channel management function creation one
ION shared drives.
Native window buffer creation module 520 can be used for building privately owned handle structure pair according to the file identifier
As and native window buffer created according to the privately owned handle structure object and the ION shared drives.
Database population module 530 can be used for when decoded video data is received, by decoded video data filling
Into the native window buffer.
Privately owned handle structure object transfer module 540 can be used for described local by what is filled by the decoded video data
The corresponding privately owned handle structure object of window buffer is transferred in a video library.
Decoded video data access modules 550 can be used for the video library according to the native window caching for receiving
The decoded video data in native window buffer described in the corresponding privately owned handle structure object accesses of device.
In this example embodiment, privately owned handle structure object is built and according to the private according to the file identifier
Having handle structure object and the ION shared drives to create native window buffer includes：According to the file identifier structure
Build some privately owned handle structure objects；If being created according to some privately owned handle structure objects and the ION shared drives
Dry native window buffer；Wherein, each privately owned handle structure object is corresponded with each native window buffer.
In this example embodiment, the decoded video data transmitting device also includes：
Shared data interface creation module can be used for creating a shared data-interface using the native window buffer.
Decoded video data rendering module can be used for the shared data interface according to the native window buffer pair
Decoded video data in native window buffer described in the described privately owned handle structure object acquisition answered simultaneously renders to a display
On equipment.
In this example embodiment, the shared data interface includes open GL or vector graphics algorithms library
In one or more.
In this example embodiment, the decoded video data is yuv data.
The detail of each module is passed in corresponding decoded video data in above-mentioned decoded video data transmitting device
Carry out thinking description in detail in transmission method, therefore here is omitted.
Although it should be noted that some modules or list of the equipment for action executing are referred in above-detailed
Unit, but this division is not enforceable.In fact, according to embodiment of the present disclosure, it is above-described two or more
The feature and function of module either unit can embody in a module or unit.Conversely, an above-described mould
The feature and function of block either unit can be to be embodied by multiple modules or unit with Further Division.
With reference to Fig. 6, the mobile terminal 600 transmitted using above-mentioned decoded video data can include following one or more groups
Part：Process assembly 602, memorizer 604, power supply module 606, multimedia groupware 608, audio-frequency assembly 610, input/output (I/O)
Interface 612, sensor cluster 614, and communication component 616.
The integrated operation of the generally control mobile terminal 600 of process assembly 602, such as with display, call, data are led to
Letter, the associated operation of camera operation and record operation.Process assembly 602 can include one or more processors 620 to hold
Row instruction, to complete all or part of step of above-mentioned method.Additionally, process assembly 602 can include one or more moulds
Block, the interaction being easy between process assembly 602 and other assemblies.For example, process assembly 602 can include multi-media module, with
Facilitate the interaction between multimedia groupware 604 and process assembly 602.
Memorizer 604 is configured to store various types of data to support the operation in equipment 600.These data are shown
Example includes the instruction of any application program for operating on mobile terminal 600 or method, contact data, telephone directory number
According to, message, picture, video etc..Memorizer 604 can by any kind of volatibility or non-volatile memory device or they
Combination realize that such as static RAM (SRAM), Electrically Erasable Read Only Memory (EEPROM) is erasable
Programmable read only memory (EPROM), programmable read only memory (PROM), read only memory (ROM), magnetic memory, quick flashing
Memorizer, disk or CD.
Power supply module 606 provides electric power for the various assemblies of mobile terminal 600.Power supply module 606 can include power supply pipe
Reason system, one or more power supplys, and other generate, manage and distribute the component that electric power is associated with for mobile terminal 600.
Multimedia groupware 608 is included in the screen of one output interface of offer between the mobile terminal 600 and user.
In certain embodiments, screen can include liquid crystal display (LCD) and touch panel (TP).If screen includes touch surface
Plate, screen may be implemented as touch screen, to receive the input signal from user.Touch panel is touched including one or more
Sensor is with the gesture on sensing touch, slip and touch panel.The touch sensor can not only sensing touch or slip
The border of action, but also the detection persistent period related to the touch or slide and pressure.In certain embodiments,
Multimedia groupware 608 includes a front-facing camera and/or post-positioned pick-up head.When equipment 600 is in operator scheme, mould is such as shot
When formula or video mode, front-facing camera and/or post-positioned pick-up head can receive outside multi-medium data.Each preposition shooting
Head and post-positioned pick-up head can be a fixed optical lens systems or with focusing and optical zoom capabilities.
Audio-frequency assembly 610 is configured to output and/or input audio signal.For example, audio-frequency assembly 610 includes a Mike
Wind (MIC), when mobile terminal 600 is in operator scheme, such as call model, logging mode and speech recognition mode, mike
It is configured to receive external audio signal.The audio signal for being received can be further stored in memorizer 604 or via logical
Letter component 616 sends.In certain embodiments, audio-frequency assembly 610 also includes a speaker, for exports audio signal.
, to provide interface between process assembly 602 and peripheral interface module, above-mentioned peripheral interface module can for I/O interfaces 612
To be keyboard, click wheel, button etc..These buttons may include but be not limited to：Home button, volume button, start button and lock
Determine button.
Sensor cluster 614 includes one or more sensors, for providing the state of various aspects for mobile terminal 600
Assessment.For example, sensor cluster 614 can detect the opening/closed mode of equipment 600, such as relative localization of component, institute
Display and keypad that component is mobile terminal 600 are stated, sensor cluster 614 can also detect mobile terminal 600 or mobile
The position change of 600 1 components of terminal, user is presence or absence of with what mobile terminal 600 was contacted, the orientation of mobile terminal 600
Or the temperature change of acceleration/deceleration and mobile terminal 600.Sensor cluster 614 can include proximity transducer, be configured to
The presence of object near detecting when without any physical contact.Sensor cluster 614 can also include optical sensor, such as
CMOS or ccd image sensor, for used in imaging applications.In certain embodiments, the sensor cluster 614 can be with
Including acceleration transducer, gyro sensor, Magnetic Sensor, pressure transducer or temperature sensor.
Communication component 616 is configured to facilitate the communication of wired or wireless way between mobile terminal 600 and other equipment.
Mobile terminal 600 can be accessed based on the wireless network of communication standard, such as WiFi, 2G or 6G, or combinations thereof.Show at one
In example property embodiment, communication component 616 receives broadcast singal or the broadcast from external broadcasting management system via broadcast channel
Relevant information.In one exemplary embodiment, the communication component 616 also includes near-field communication (NFC) module, short to promote
Cheng Tongxin.For example, RF identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra broadband can be based in NFC module
(UWB) technology, bluetooth (BT) technology and other technologies are realizing.
In the exemplary embodiment, mobile terminal 600 can be by one or more application specific integrated circuits (ASIC), number
Word signal processor (DSP), digital signal processing appts (DSPD), PLD (PLD), field programmable gate array
(FPGA), controller, microcontroller, microprocessor or other electronic components realizations, for performing said method.
Through the above description of the embodiments, those skilled in the art is it can be readily appreciated that example described herein is implemented
Mode can be realized by software, it is also possible to be realized by way of software is with reference to necessary hardware.Therefore, according to the disclosure
The technical scheme of embodiment can be embodied in the form of software product, the software product can be stored in one it is non-volatile
Property storage medium (can be CD-ROM, USB flash disk, portable hard drive etc.) in or network on, including some instructions are so that a calculating
Equipment (can be personal computer, server, mobile terminal or network equipment etc.) is performed according to disclosure embodiment
Method.
Those skilled in the art will readily occur to its of the disclosure after considering description and putting into practice invention disclosed herein
Its embodiment.The application is intended to any modification, purposes or the adaptations of the disclosure, these modifications, purposes or
Person's adaptations follow the general principle of the disclosure and including the undocumented common knowledge in the art of the disclosure
Or conventional techniques.Description and embodiments are considered only as exemplary, and the true scope of the disclosure and spirit are by appended
Claim is pointed out.
Claims (11)
1. a kind of decoded video data transmission method, it is characterised in that include：
By ION shared drive of the channel management function creation one comprising file identifier；
Privately owned handle structure object is built and according to the privately owned handle structure object and described according to the file identifier
ION shared drives create native window buffer；
When decoded video data is received, the decoded video data is filled into the native window buffer；
The corresponding privately owned handle structure object of the native window buffer filled by the decoded video data is passed
In being handed to a video library；
The video library is according to the corresponding privately owned handle structure object accesses institute of the native window buffer for receiving
State the decoded video data in native window buffer.
2. decoded video data transmission method according to claim 1, it is characterised in that according to the file identifier structure
Build privately owned handle structure object and native window is created according to the privately owned handle structure object and the ION shared drives and delay
Storage includes：
Some privately owned handle structure objects are built according to the file identifier；
Some native window buffers are created according to some privately owned handle structure objects and the ION shared drives；Its
In,
Each privately owned handle structure object is corresponded with each native window buffer.
3. decoded video data transmission method according to claim 1, it is characterised in that the decoded video data transmission
Method also includes：
A shared data-interface is created using the native window buffer；
The shared data interface is according to the corresponding privately owned handle structure object acquisition of the native window buffer
Decoded video data in native window buffer is simultaneously rendered on a display device.
4. decoded video data transmission method according to claim 3, it is characterised in that the shared data interface includes
One or more in open GL or vector graphics algorithms library.
5. the decoded video data transmission method according to any one in Claims 1 to 4, it is characterised in that described to regard
Frequency decoding data is yuv data.
6. a kind of decoded video data transmitting device, it is characterised in that include：
ION shared drive creation modules：For shared interior by ION of the channel management function creation one comprising file identifier
Deposit；
Native window buffer creation module：For building privately owned handle structure object and according to institute according to the file identifier
State privately owned handle structure object and the ION shared drives create native window buffer；
Database population module：For when decoded video data is received, the decoded video data is filled to described local
In window buffer；
Privately owned handle structure object transfer module：For by the native window buffer filled by the decoded video data
The corresponding privately owned handle structure object is transferred in a video library；
Decoded video data access modules：For the video library according to the corresponding institute of the native window buffer for receiving
State the decoded video data in native window buffer described in privately owned handle structure object accesses.
7. decoded video data transmitting device according to claim 6, it is characterised in that according to the file identifier structure
Build privately owned handle structure object and native window is created according to the privately owned handle structure object and the ION shared drives and delay
Storage includes：
Some privately owned handle structure objects are built according to the file identifier；
Some native window buffers are created according to some privately owned handle structure objects and the ION shared drives；Its
In,
Each privately owned handle structure object is corresponded with each native window buffer.
8. decoded video data transmitting device according to claim 6, it is characterised in that the decoded video data transmission
Device also includes：
Shared data interface creation module：For creating a shared data-interface using the native window buffer；
Decoded video data rendering module：For the shared data interface according to the native window buffer is corresponding
Decoded video data in native window buffer described in privately owned handle structure object acquisition is simultaneously rendered on a display device.
9. decoded video data transmitting device according to claim 8, it is characterised in that the shared data interface includes
One or more in open GL or vector graphics algorithms library.
10. the decoded video data transmitting device according to any one in claim 6～9, it is characterised in that described to regard
Frequency decoding data is yuv data.
11. a kind of mobile terminals, it is characterised in that include：
Processor；And
Memorizer, for storing the executable instruction of the processor；
Wherein described processor is configured to perform following operation via the executable instruction is performed：
By ION shared drive of the channel management function creation one comprising file identifier；
Privately owned handle structure object is built and according to the privately owned handle structure object and described according to the file identifier
ION shared drives create native window buffer；
When decoded video data is received, the decoded video data is filled into the native window buffer；
The corresponding privately owned handle structure object of the native window buffer filled by the decoded video data is passed
In being handed to a video library；
The video library is according to the corresponding privately owned handle structure object accesses institute of the native window buffer for receiving
State the decoded video data in native window buffer.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611200772.5A CN106658171A (en) | 2016-12-22 | 2016-12-22 | Video decoding data transmission method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611200772.5A CN106658171A (en) | 2016-12-22 | 2016-12-22 | Video decoding data transmission method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106658171A true CN106658171A (en) | 2017-05-10 |
Family
ID=58826489
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611200772.5A Pending CN106658171A (en) | 2016-12-22 | 2016-12-22 | Video decoding data transmission method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106658171A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102630007A (en) * | 2012-03-31 | 2012-08-08 | 中船重工(武汉)凌久高科有限公司 | Method for processing TCP (transmission control protocol) video data stream |
| CN103281528A (en) * | 2013-04-10 | 2013-09-04 | 深圳康佳通信科技有限公司 | Streaming media decoding method, system and mobile terminal |
| CN105530479A (en) * | 2015-12-28 | 2016-04-27 | 深圳市科漫达智能管理科技有限公司 | Video data processing method and system based on mobile terminal |
-
2016
- 2016-12-22 CN CN201611200772.5A patent/CN106658171A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102630007A (en) * | 2012-03-31 | 2012-08-08 | 中船重工(武汉)凌久高科有限公司 | Method for processing TCP (transmission control protocol) video data stream |
| CN103281528A (en) * | 2013-04-10 | 2013-09-04 | 深圳康佳通信科技有限公司 | Streaming media decoding method, system and mobile terminal |
| CN105530479A (en) * | 2015-12-28 | 2016-04-27 | 深圳市科漫达智能管理科技有限公司 | Video data processing method and system based on mobile terminal |
Non-Patent Citations (2)
| Title |
|---|
| KRISFEI: "ION基本概念介绍", 《CSDN》 * |
| THOMAS M. ZENG: "The Android ION memory allocator", 《HTTPS://LWN.NET/ARTICLES/480055/》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2018095173A1 (en) | Face switching method, device, anchor terminal and audience terminal | |
| WO2021134069A1 (en) | Projection, control, and management of user device applications using a connected resource | |
| WO2021093583A1 (en) | Video stream processing method and apparatus, terminal device, and computer readable storage medium | |
| EP3151548A1 (en) | Video recording method and device | |
| CN110785996B (en) | Dynamic control of camera resources in a device with multiple displays | |
| CN110070496B (en) | Method and device for generating image special effect and hardware device | |
| WO2023051185A1 (en) | Image processing method and apparatus, and electronic device and storage medium | |
| CN112346695A (en) | Method for controlling equipment through voice and electronic equipment | |
| CN112527174B (en) | Information processing method and electronic equipment | |
| EP3780634A1 (en) | Lending of local processing capability of interconnected terminals | |
| CN112527222A (en) | Information processing method and electronic equipment | |
| WO2023071603A1 (en) | Video fusion method and apparatus, electronic device, and storage medium | |
| US20240119082A1 (en) | Method, apparatus, device, readable storage medium and product for media content processing | |
| CN114677386A (en) | Special effect image processing method and device, electronic equipment and storage medium | |
| US20220303503A1 (en) | Parameters for overlay handling for immersive teleconferencing and telepresence for remote terminals | |
| CN113411537B (en) | Video call method, device, terminal and storage medium | |
| CN114570020A (en) | Data processing method and system | |
| US20210152857A1 (en) | Method, system and device for sharing contents | |
| WO2023134509A1 (en) | Video stream pushing method and apparatus, and terminal device and storage medium | |
| CN106658171A (en) | Video decoding data transmission method and device | |
| WO2023093792A1 (en) | Image frame rendering method and related apparatus | |
| CN109636917B (en) | Three-dimensional model generation method, device and hardware device | |
| CN109300177B (en) | Picture processing method and device | |
| KR20230156788A (en) | Asset reusability for lightfield/holographic media | |
| US8463052B2 (en) | Electronic apparatus and image search method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |