CN106797388A - Cross-system multi-medium data decoding method, device, electronic equipment and computer program product - Google Patents
Cross-system multi-medium data decoding method, device, electronic equipment and computer program product Download PDFInfo
- Publication number
- CN106797388A CN106797388A CN201680002827.3A CN201680002827A CN106797388A CN 106797388 A CN106797388 A CN 106797388A CN 201680002827 A CN201680002827 A CN 201680002827A CN 106797388 A CN106797388 A CN 106797388A
- Authority
- CN
- China
- Prior art keywords
- decoding
- encoding
- medium data
- operating system
- coding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/544—Buffers; Shared memory; Pipes
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
This application provides cross-system multi-medium data decoding method, device, electronic equipment and computer program product, methods described includes：In the first operating system, the encoding and decoding request to multi-medium data encoding and decoding treatment is obtained, the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment；The multi-medium data is sent to shared drive；The coding and decoding instruction of encoding and decoding treatment is carried out to the multi-medium data according to encoding and decoding request generation, the coding and decoding instruction includes offset address of the multi-medium data in the shared drive；The coding and decoding instruction is based on into cross-system communication to send to the second operating system；In second operating system, the offset address in the coding and decoding instruction obtains the multi-medium data by the shared drive；Encoding and decoding treatment is carried out to the multi-medium data according to the coding and decoding instruction, the shared drive is in readable and writable state to first operating system and second operating system.The application improves virtualization system performance, shortens cross-system multi-medium data encoding and decoding process time.
Description
Technical field
The application is related to technical field of virtualization, more particularly to cross-system multi-medium data decoding method, device, electronics
Equipment and computer program product.
Background technology
Mobile terminal has turned into the important tool of user's routine work life, promotes mobile Internet quick in mobile terminal
While development, the information for containing rich and variedization due to mobile terminal is (for example：The access of business data, Bussiness Communications, society
Hand over network, financial management, game etc.), new focus of the mobile terminal into the network crime.For information security, protection privacy,
Mobile virtual chemical conversion is for following developing direction of mobile terminal.
Fig. 1 is shown based on Qemu/KVM (Kernel-based Virtual Machine, the virtual machine based on kernel)
Technology realize virtualization system configuration diagram, in bottom be system hardware layer, mainly including processor, internal memory and
Input-output equipment etc..On hardware layer be virtualization layer, operation be monitor of virtual machine (be abbreviated as VMM or
Hypervisor).The Major Function of monitor of virtual machine is：Real physical hardware platform is managed, and is each client virtual
Machine (i.e. client computer) provides corresponding virtual hardware platform.Multiple operating systems can be run in virtualization system framework, for example
(SuSE) Linux OS or Android operation system etc., wherein a host operating system (Host OS) is generally included, and
One or more Client OS (Guest OS), host operating system runs on host (Host), in main frame behaviour
Make to run one or more client computer in system, each client computer is run as the application program of host operating system, and it can be with
To run on the Client OS analog hardware equipment in the client computer so that Client OS is used, in each client
Various application programs can be run in the Client OS of machine operation.In virtualization system framework, multiple operating systems it
Between the CPU of hardware layer offer, internal memory and input-output equipment can be provided.
The isolation brought by Intel Virtualization Technology can realize the isolation of multiple operating systems on single terminal end, it is to avoid each behaviour
The process made in system has a negative impact to other operating systems, and typical application scenarios are in mobile phone by Intel Virtualization Technology
Deng the separation that business system and ps are realized on mobile device, take precautions against process on ps to enterprise bring it is potential
Harm, meets the need of enterprise that some have safety requirements to " from carrying device " (BYOD, Bring Your Own Device)
Ask.
The deep development used in life with multimedia application, each virtual machine of terminal has been required for multimedia to compile
Decoder, in the prior art Client OS software codec is generally realized by CPU, this kind of code encoding/decoding mode can be accounted for
With the ample resources of current client CPU, power consumption is big；And Client OS can only realize software codec by CPU,
Causing the video file of many forms cannot support, play not smooth.When a certain Client OS needs other client computer
Operating system or host operating system assist to complete to need respectively each client actions when multi-medium data encoding and decoding are processed
The buffering area of the multimedia framework in system or host operating system distributes corresponding physical storage area in internal memory, and
A certain Client OS need other systems assist carry out cross-system multi-medium data encoding and decoding process when, it is necessary to should
Copy content in the corresponding physical storage area of buffering area of Client OS multimedia framework carries out encoding and decoding to assistance
In the corresponding physical storage area of buffering area of the operating system multimedia framework for the treatment of, need to process after the completion of encoding and decoding treatment
Result copies back the corresponding physical store of buffering area of the Client OS multimedia framework for initiating encoding and decoding treatment request
Area.
The deficiencies in the prior art are：
The encoding and decoding that cross-system carries out multi-medium data are related to mass data in different physical store intervals when processing
Copy, on the one hand takes the computing resource and storage resource of a large amount of virtualization system frameworks, causes the reduction of virtualization system performance,
On the other hand cross-system multi-medium data encoding and decoding process time is extended.
The content of the invention
The embodiment of the present application proposes cross-system multi-medium data decoding method, device, electronic equipment and computer journey
Sequence product, is mainly used to lift virtualization system performance, shortens multi-medium data encoding and decoding process time.
In one aspect, the embodiment of the present application provides a kind of cross-system multi-medium data decoding method, and its feature exists
In methods described includes：
In the first operating system, the encoding and decoding request to multi-medium data encoding and decoding treatment is obtained, the encoding and decoding please
Seek the multi-medium data including needing to carry out encoding and decoding treatment；The multi-medium data is sent to shared drive；According to described
Encoding and decoding request generation carries out the coding and decoding instruction of encoding and decoding treatment to the multi-medium data, and the coding and decoding instruction includes institute
State offset address of the multi-medium data in the shared drive；The coding and decoding instruction is based on into cross-system communication to send to second
Operating system；
In second operating system, the offset address in the coding and decoding instruction is obtained by the shared drive
The multi-medium data；Encoding and decoding treatment, the shared drive are carried out to the multi-medium data according to the coding and decoding instruction
Readable and writable state is in first operating system and second operating system.
In another aspect, the embodiment of the present application provides a kind of cross-system multi-medium data coding and decoding device, its feature
It is that described device includes：Front-end module, in the first operating system, obtaining to multi-medium data encoding and decoding treatment
Encoding and decoding are asked, and the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment；By the multi-medium data
Send to shared drive；The encoding and decoding that the multi-medium data carries out encoding and decoding treatment are referred to according to encoding and decoding request generation
Order, the coding and decoding instruction includes offset address of the multi-medium data in the shared drive；By the coding and decoding instruction
Sent to the second operating system based on cross-system communication；
Rear module, in second operating system, the offset address in the coding and decoding instruction to be by institute
State shared drive and obtain the multi-medium data；The multi-medium data is carried out at encoding and decoding according to the coding and decoding instruction
Reason, the shared drive is in readable and writable state to first operating system and second operating system.
In another aspect, the embodiment of the present application provides a kind of electronic equipment, it is characterised in that the electronic equipment bag
Include：Memory, one or more processors；And one or more modules, one or more of modules are stored in described
In memory, and it is configured to by one or more of computing devices, one or more of modules are included for performing
The instruction of each step in any above method.
In another aspect, the embodiment of the present application provides a kind of computer program being used in combination with electronic equipment and produces
Product, the computer program product includes the computer program being embedded in computer-readable storage medium, the computer
Program includes the instruction for making the electronic equipment perform each step in any above method.
The embodiment of the present application has the beneficial effect that：
In the application, in the first operating system, when needing to carry out multi-medium data encoding and decoding treatment, can be by many matchmakers
Volume data is sent to the second operating system by shared drive, to complete the volume of the multi-medium data in the second operating system
Decoding process, in the application, by the biography of multi-medium data in Sharing Memory Realization cross-system multi-medium data encoding-decoding process
Pass, reduce data copy number of times, on the one hand saved the computing resource and storage resource of virtualization system framework, lifting is virtual
Change systematic function, on the other hand shorten cross-system multi-medium data encoding and decoding process time.
Brief description of the drawings
The specific embodiment of the application is described below with reference to accompanying drawings, wherein：
Fig. 1 shows virtualization system configuration diagram in the prior art；
Fig. 2 shows the schematic flow sheet of cross-system multi-medium data decoding method in the embodiment of the present application one；
Fig. 3 shows a kind of virtualization system of cross-system multi-medium data decoding method application in the embodiment of the present application one
System configuration diagram；
Fig. 4 shows another virtualization of cross-system multi-medium data decoding method application in the embodiment of the present application one
System architecture schematic diagram；
Fig. 5 shows another virtualization of cross-system multi-medium data decoding method application in the embodiment of the present application one
System architecture schematic diagram；
Fig. 6 shows the structural representation of cross-system multi-medium data coding and decoding device in the embodiment of the present application two；
Fig. 7 shows the structural representation of electronic equipment in the embodiment of the present application three.
Specific embodiment
In order that the technical scheme and advantage of the application become more apparent, below in conjunction with accompanying drawing to the exemplary of the application
Embodiment is described in more detail, it is clear that described embodiment is only a part of embodiment of the application, rather than
The exhaustion of all embodiments.And in the case where not conflicting, the feature in embodiment and embodiment in this explanation can be mutual
It is combined.
Inventor notices during invention：The encoding and decoding that cross-system carries out multi-medium data are related to a large amount of numbers when processing
According in the interval copy of different physical stores, the computing resource and storage on the one hand taking a large amount of virtualization system frameworks are provided
Source, causes the reduction of virtualization system performance, on the other hand extends cross-system multi-medium data encoding and decoding process time.
For above-mentioned deficiency, this application provides a kind of cross-system multi-medium data decoding method, in the first operation system
In system, when needing to carry out multi-medium data encoding and decoding treatment, multi-medium data can be sent to second by shared drive
Operating system, is processed with the encoding and decoding that the multi-medium data is completed in the second operating system, in the application, in shared
The transmission for realizing multi-medium data in cross-system multi-medium data encoding-decoding process is deposited, data copy number of times is reduced, on the one hand
Saved the computing resource and storage resource of virtualization system framework, lifted virtualization system performance, on the other hand shorten across
Multimedia system data encoding and decoding process time.
For the ease of the implementation of the application, illustrated with example below.
Embodiment one：
When virtualization system framework starts, Qemu can divide one piece of specific address space in internal memory, used as described
The read-write shared drive of each operating system in virtualization architecture, for example, can create described shared by way of system is called
Internal memory.Further can also the shared memory headroom further be divided to support the access of multiple processes or thread.
The size of the shared drive can be set by developer, and adapt to may relate in the virtualization system framework across
System transfers.
When Client OS starts, its multimedia framework can obtain the phase from Client OS inner nuclear layer
Close configuration information to be initialized, and then obtain the address space for mapping to Client OS of the shared drive, this
Can also set up Synchronization Control passage with Qemu outward.
In host operating system, the multimedia framework that Qemu can trigger in host operating system carries out similar client computer behaviour
Make the initialization of system, to obtain the address space that the shared drive maps to host operating system, and then with it is interdepartmental altogether
Enjoy internal memory and set up connection.
Fig. 2 shows cross-system multi-medium data decoding method schematic flow sheet in the embodiment of the present application one, such as Fig. 2 institutes
Show, the cross-system multi-medium data decoding method includes：
Step 101, in the first operating system, obtains the encoding and decoding request to multi-medium data encoding and decoding treatment, described
Encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment；The multi-medium data is sent to shared drive；
The coding and decoding instruction of encoding and decoding treatment is carried out to the multi-medium data according to encoding and decoding request generation, the encoding and decoding refer to
Order includes offset address of the multi-medium data in the shared drive；The coding and decoding instruction is based on cross-system communication hair
Deliver to the second operating system；
Step 102, in second operating system, the offset address in the coding and decoding instruction is by described shared
Internal memory obtains the multi-medium data；Encoding and decoding treatment is carried out to the multi-medium data according to the coding and decoding instruction, it is described
Shared drive is in readable and writable state to first operating system and second operating system；
In step 103, in the second operating system, the encoding and decoding result of the multi-medium data is fed back to described
Shared drive；In the first operating system, the encoding and decoding result is obtained by the shared drive.
In a step 101, after the application program in the first operating system initiates the request of multi-medium data encoding and decoding treatment,
The multi-medium data that encoding and decoding treatment is carried out the need for the request is included is stored in the first operating system and the second operation system
In the shared drive that system can be read and write.The multi-medium data can be actually needed the multimedia number for carrying out encoding and decoding treatment
According to being actually needed data for carrying out encoding and decoding treatment etc. in such as video file or audio file, or be actually needed
Carry out position and other information of the multi-medium data of encoding and decoding treatment in internal memory, such as data form, time tag, number
According to size etc..
It is that the first operating system is assigned with the buffering processed for multi-medium data encoding and decoding in virtualization system framework
Area (Buffer), when the corresponding physical memory of the buffering area is that the first operating system and the second operating system can be read and write
During shared drive, the buffering that the multi-medium data in the first operating system is written as address of cache its distribution can be directly based upon
Area.Kernel layers of first operating system can map to shared drive the user's space of the first operating system；First operation
The shared drive that system can write data to it performs skew record, that is, record the memory block of presently written multi-medium data
Offset address of the first address relative to the first address of whole shared section key.
The coding and decoding instruction of encoding and decoding treatment is carried out to the multi-medium data further according to encoding and decoding request generation,
The coding and decoding instruction is indicated and needs what kind of encoding and decoding treatment is the second operating system carry out to the multi-medium data for transmitting, can
With including encoding and decoding command functions and relevant parameter etc..Also, by the multi-medium data on the skew ground of the shared drive
Location is together sent to the second operating system in being included in the coding and decoding instruction.The coding and decoding instruction can based on QEMU PIPE,
The cross-system communication mode such as Socket or shared drive is sent to the second operating system.
In some embodiments, the coding and decoding instruction is sent to the second operating system based on shared drive mode.
Because the cross-system communication mode based on shared drive compares the modes such as QEMU PIPE, Socket more rapidly, therefore base
Transmit coding and decoding instruction faster between the first operating system and the second operating system in shared drive mode, further shorten across
The time of multimedia system data encoding and decoding treatment.
In some embodiments, it is described to send to shared drive the multi-medium data, including：By the multimedia
Data is activation is to unshared internal memory；Multi-medium data in the unshared internal memory is copied to shared drive.
When the corresponding physical memory of the buffering area distributed for the first operating system only can be direct by the first operating system
Read-write, and when can not read and write by the second operating system, i.e., when the corresponding physical memory of described buffering area is for unshared internal memory, by the
After one operating system needs the multi-medium data for carrying out encoding and decoding treatment to be stored in the corresponding physical memory of the buffering area, then by institute
Multi-medium data is stated to be copied in the shared drive that the first operating system and the second operating system can be read and write.
It should be appreciated that in these cases, if the coding and decoding instruction carries out cross-system biography also by shared drive mode
It is defeated, then in being also required to for the coding and decoding instruction first to write the unshared internal memory of the first operating system, then will it is described it is unshared in
The coding and decoding instruction deposited is copied in shared drive, so that the second operating system is obtained.
In a step 102, kernel layers of the second operating system can map to the second operating system with shared drive
User's space.When the second operating system is after the coding and decoding instruction is obtained, can be according to the skew in the coding and decoding instruction
Address, multi-medium data is read to the relevant position of shared drive, and then according to the coding and decoding instruction to the multimedia number
According to encoding and decoding treatment is carried out, result is obtained.Specifically, in the second operating system, can be according to the coding and decoding instruction
Call the driver of codec and processed with driving corresponding codec to complete encoding and decoding；Can be referred to according to the encoding and decoding
Order loading codec component completes encoding and decoding treatment；Can also be by the OpenMAX integrated layers in the second operating system
(OpenMAX IL, OpenMAX Integration Layer) is carried out according to the coding and decoding instruction to the multi-medium data
Encoding and decoding are processed.The form of coding and decoding instruction described in above-mentioned various different situations and comprising particular content be likely to can phase
Should difference.
It should be appreciated that when coding and decoding instruction is to be transferred to the second operation system by the first operating system based on shared drive mode
During system, first operating system also needs to send skew of the coding and decoding instruction in shared drive to the second operating system
Address, so that second operating system is referred to according to the offset address of the coding and decoding instruction by obtaining encoding and decoding in shared drive
Order, further obtains multi-medium data.
In step 103, in the second operating system, the encoding and decoding of multi-medium data are carried out according to the coding and decoding instruction
After treatment, result is obtained, the result is transferred in the first operating system again by shared drive.For example will
In the encoding and decoding result write-in shared drive, and record position (first address of the result in shared drive
Offset address), the offset address is based on the cross-system communication modes such as QEMU PIPE, Socket or shared drive and is sent
Into the first operating system, allow the first operating system by the offset address of the result to the corresponding of shared drive
Read data in position.The result can be by the multi-medium data after encoding and decoding treatment, such as decoded video
Video in audio file or voice data etc. after file or compression, or by many matchmakers after encoding and decoding treatment
Position and other information of the volume data in internal memory, such as data form, time tag, size of data etc..
Above-mentioned first operating system is the Client OS in virtualization system framework, and second operating system is
Host operating system in virtualization system framework.
In some embodiments, the step 101 is in the first operating system, to obtain multimedia framework and call volume
Decoder carries out the encoding and decoding request of multi-medium data encoding and decoding treatment, and the encoding and decoding request includes needing to carry out at encoding and decoding
The multi-medium data of reason；Encoding and decoding request is sent to shared drive；According to encoding and decoding request generation to described many
Media data carries out the coding and decoding instruction of encoding and decoding treatment, and the coding and decoding instruction includes the multi-medium data described shared
The offset address of internal memory；The coding and decoding instruction is based on into cross-system communication to send to the second operating system；The step 102
For in the second operating system, the offset address in the coding and decoding instruction obtains many matchmakers by the shared drive
Volume data；The driver for calling the codec according to the coding and decoding instruction carries out encoding and decoding to the multi-medium data
Treatment, the shared drive is in readable and writable state to first operating system and second operating system.
Fig. 3 shows a kind of virtualization system of cross-system multi-medium data decoding method application in the embodiment of the present application one
System configuration diagram,, at least to include a Client OS in the virtualization system framework, described first operates for it
System is Client OS, and second operating system is for as a example by host operating system.In the Client OS
Operation has multimedia application, such as video player etc., when the multimedia application is needed to some multimedia numbers
During according to carrying out encoding and decoding treatment, can be asked to the encoding and decoding of multimedia framework transmitting multimedia data, for example, be broadcast in video player
Video data decoding can be issued when putting HD video to multimedia framework to ask.
In a step 101, the multimedia application for being run in Client OS is being needed to some multimedia numbers
During according to carrying out encoding and decoding treatment, can be asked to the encoding and decoding of multimedia framework transmitting multimedia data, multimedia framework can be according to more
The type of media data, form or resolution ratio etc. carry out respective handling for the appropriate codec of its selection.When multimedia frame
When frame judges that the multi-medium data needs to carry out respective handling by hardware compression device, call hard in Client OS
The generation of part codec carries out the instruction of hardware compression to the multi-medium data.In the present embodiment in Client OS
Multimedia framework can be OpenMAX or other existing multimedia frameworks, when the multimedia framework be OpenMAX
When, it has one or more hardware compression device assembly Component, and multimedia framework is by calling each hardware compression
Device assembly generation carries out the instruction of hardware compression treatment to multi-medium data.
Do not exist real hardware compression device in Client OS, but in Client OS inner nuclear layer
In run hardware compression device driver front end, when hardware compression device driver front end receiver to multimedia framework adjust
With hardware compression device assembly to carry out carrying out the instruction of hardware compression treatment to the multi-medium data after, it would be desirable to carry out
The multi-medium data write-in shared drive of hardware compression treatment, and the skew ground by the multi-medium data in shared drive
Described instruction is transferred to be run in host operating system inner nuclear layer by location comprising in the instruction by cross-system communication mode
Hardware compression device driver rear end.
In a step 102, the hardware compression device driver rear end run in host operating system inner nuclear layer, works as reception
What hardware compression device driver front end sent in Client OS is carried out at hardware compression to multi-medium data
After the instruction of reason, according to the offset address included in the instruction, by obtaining multi-medium data in shared drive, and in main frame behaviour
Make the driver of operation hardware compression device in system, completed to the multi-medium data with by real hardware compression device
Hardware compression treatment.The hardware compression device driver can be V4L2Driver etc..
In the present embodiment, after above-mentioned steps 102, step 103 can also be included, by the multimedia number after treatment
The Client OS is fed back according to based on shared drive；In Client OS, by the multimedia after the treatment
Multimedia framework described in data feedback.
After the hardware compression device of host operating system completes encoding and decoding treatment to the multi-medium data, main frame behaviour
Making the hardware compression device driver rear end in system can will carry out the data after encoding and decoding treatment by shared drive biography
It is handed to the hardware compression device driver front end in Client OS.Hardware compression device in Client OS
Driver front end can be fed back to multimedia framework after the data after receiving encoding and decoding treatment, so as to multimedia framework
Data feedback after encoding and decoding are processed initiates the multimedia application of former encoding and decoding request.
In the present embodiment, so that the encoding and decoding are as hardware compression as an example, i.e., many matchmakers in Client OS
Body framework determines the encoding and decoding request for hardware compression is asked, it is necessary to call hardware compression device in host operating system
Driver driving the hardware compression device to carry out corresponding hardware compression treatment, it will be appreciated that work as Client OS
In multimedia framework determine encoding and decoding request for software codec ask when, again may be by shared drive by leading
Machine operating system carries out corresponding software codec treatment.
In some embodiments, the step 101 is in the first operating system OpenMAX integrated layers, to obtain adaptation
What layer sent carries out the encoding and decoding request of encoding and decoding treatment to multi-medium data, and the encoding and decoding request includes that needs carry out volume solution
The multi-medium data of code treatment；The multi-medium data is sent to shared drive；According to encoding and decoding request generation to institute
Stating multi-medium data carries out the coding and decoding instruction of encoding and decoding treatment, and the coding and decoding instruction includes the multi-medium data described
The offset address of shared drive；The coding and decoding instruction is based on into cross-system communication to send to the second operating system；The step
102 are, in the second operating system OpenMAX integrated layers, the offset address in the coding and decoding instruction is by described shared
Internal memory obtains the multi-medium data；The multi-medium data is entered according to the component that the coding and decoding instruction loads codec
Row encoding and decoding are processed, and the shared drive is in readable and writable to first operating system and second operating system
State.
Fig. 4 shows another virtualization of cross-system multi-medium data decoding method application in the embodiment of the present application one
System architecture schematic diagram, the technical scheme that present embodiment is provided is applicable for use with the operation system of OpenMAX multimedia frameworks
System., at least to include a Client OS in the virtualization system framework, first operating system is client for it
Machine operating system, second operating system is for as a example by host operating system.Operation has many matchmakers in the Client OS
Body application program, such as video player etc., when the multimedia application needs to carry out volume solution to some multi-medium datas
During code treatment, can be asked to the encoding and decoding of multimedia framework transmitting multimedia data, for example, play HD video in video player
Shi Huixiang multimedia frameworks issue video data decoding request.
In a step 101, multi-medium data is compiled when the multimedia application in Client OS is issued
Decoding process encoding and decoding request after, the Client OS adaptation layer can according to the type of multi-medium data,
Form or resolution ratio etc. are its selection appropriate software or hardware compression device.Support that the codec of same form can be with
It is multiple, wherein hardware compression device and software codec can be included, can be according to default rule when codec is adapted to
The codec being best suitable for then is selected, for example：For resolution requirement it is low multimedia file selection software codec, be differentiate
Rate requirement multimedia file selection hardware compression device high etc..Received in the OpenMAX integrated layers of Client OS suitable
After the encoding and decoding request sent with layer, generate the encoding and decoding and ask corresponding coding and decoding instruction, by multi-medium data write-in altogether
Enjoy internal memory, and offset address by the multi-medium data in shared drive is included in the coding and decoding instruction, by across
Be transferred to the coding and decoding instruction in host operating system by system communication mode.In the present embodiment, can only by adaptation
The multi-medium data of hardware compression device device passes to host operating system based on shared drive, to being adapted to software codec
The multi-medium data of device is still carried out using the software codec in the Client OS to the multimedia file
Encoding and decoding；The multi-medium data that all encoding and decoding are asked can also be based on shared drive and pass to host operating system.
In a step 102, after host operating system obtains the coding and decoding instruction that Client OS sends, according to described
The offset address included in coding and decoding instruction obtains the multi-medium data by shared drive, in host operating system
In OpenMAX integrated layers, volume solution is carried out to the multi-medium data according to the component that the coding and decoding instruction loads codec
Code treatment.
In some embodiments, in the OpenMAX integrated layers and host operating system of Client OS
OpenMAX front ends and OpenMAX rear ends are separately operable in OpenMAX integrated layers, have been in the adaptation layer of Client OS
It is appropriate according to determining by the OpenMAX front ends after the encoding and decoding request of application program have matched appropriate codec
The encoding and decoding request generation coding and decoding instruction of codec, shared drive is write by multi-medium data, and by the multimedia number
It is included in the coding and decoding instruction according to the offset address in shared drive, by cross-system communication mode by the encoding and decoding
Instruction is transferred to the OpenMAX rear ends in host operating system.OpenMAX rear ends in host operating system receive
It is many by being obtained in shared drive according to the offset address included in the instruction after the coding and decoding instruction that OpenMAX front ends send
Media data, the coding and decoding instruction loads corresponding codec to described in host operating system OpenMAX integrated layers
Multi-medium data carries out encoding and decoding treatment.
In the present embodiment, after above-mentioned steps 102, step 103 can also be included, by the multimedia number after treatment
The Client OS is fed back according to based on shared drive；In Client OS, by the multimedia after the treatment
Adaptation layer described in data feedback.
Software is loaded in host operating system OpenMAX integrated layers or hardware compression device is complete to the multi-medium data
Into after encoding and decoding treatment, can be based on for the data after carrying out encoding and decoding treatment by OpenMAX rear ends by host operating system
Shared drive is transferred to the OpenMAX front ends in Client OS, and the OpenMAX front ends of Client OS are connecing
After receiving the data after encoding and decoding treatment, adaptation layer can be fed back to, and then be fed back to many matchmakers for initiating former encoding and decoding request
Body application program.Additionally, loading software or hardware compression device to many matchmakers in host operating system OpenMAX integrated layers
Volume data is completed after encoding and decoding treatment, it is also possible to which result is sent directly to the multimedia application in host operating system
Program carries out subsequent operation.
In some embodiments, the step 101 is in the first operating system, to obtain multimedia application and enter
The encoding and decoding request of row multi-medium data encoding and decoding treatment, the encoding and decoding request includes needing to carry out many matchmakers of encoding and decoding treatment
Volume data；The multi-medium data is sent to shared drive；According to encoding and decoding request generation to the multi-medium data
The coding and decoding instruction of encoding and decoding treatment is carried out, the coding and decoding instruction includes the multi-medium data in the inclined of the shared drive
Move address；The coding and decoding instruction is based on into cross-system communication to send to the second operating system；The step 102 is, second
In operating system, the offset address in the coding and decoding instruction obtains the multi-medium data by the shared drive；Will
The coding and decoding instruction and the multi-medium data send the OpenMAX integrated layers into the second operating system, so that described
OpenMAX integrated layers in two operating systems carry out encoding and decoding treatment according to the coding and decoding instruction to the multi-medium data.
Fig. 5 shows another virtualization of cross-system multi-medium data decoding method application in the embodiment of the present application one
System architecture schematic diagram, the technical scheme that present embodiment is provided is applicable for use with Android multimedia framework standards, institute
Stating multimedia framework specifically may include Stagefright+OpenMAX or Opencore+OpenMAX.It is with the virtualization
At least include a Client OS in system architecture, first operating system is Client OS, described the
Two operating systems are for as a example by host operating system.Operation has multimedia application in the Client OS, for example, regard
Frequency player etc., when the multimedia application needs to carry out some multi-medium datas encoding and decoding treatment, can be to many matchmakers
The encoding and decoding of body framework transmitting multimedia data ask, for example video player play HD video when can be to multimedia framework under
Hair video data decoding request.
In a step 101, the multimedia application for being run in Client OS is being needed to some multimedia numbers
During according to carrying out encoding and decoding treatment, can be asked to the encoding and decoding of multimedia framework transmitting multimedia data, the encoding and decoding request include
Need to carry out the multi-medium data of encoding and decoding treatment.In Client OS, without running complete multimedia framework root
The multi-medium data is processed according to encoding and decoding request, it is only necessary to referred to according to encoding and decoding request generation encoding and decoding
Order, shared drive is write by multi-medium data, and offset address by the multi-medium data in shared drive is included in institute
State in coding and decoding instruction, the coding and decoding instruction is transferred in host operating system by cross-system communication mode.
In a step 102, complete OpenMAX integrated layers have been run in host operating system, client computer behaviour is being received
After making coding and decoding instruction of the system based on shared drive transmission, according to the offset address included in the coding and decoding instruction by sharing
Internal memory obtains the multi-medium data, and the coding and decoding instruction is sent to main frame together with the multi-medium data for treating encoding and decoding treatment
OpenMAX integrated layers in operating system, are entered according to the coding and decoding instruction by OpenMAX integrated layers to the multi-medium data
Row encoding and decoding are processed, and can include that the various software codec device assemblies of loading carry out software codec treatment；Can also include adding
Various hardware compression device assemblies are carried, drives corresponding hardware compression device to carry out hardware compression treatment.
In some embodiments, in the step 101, in the OMX of Client OS Stagefright frameworks
In adaptation layer, obtaining multimedia application carries out the encoding and decoding request of multi-medium data encoding and decoding treatment, and the encoding and decoding please
Seek the multi-medium data including needing to carry out encoding and decoding treatment；The multi-medium data is entered according to encoding and decoding request generation
The coding and decoding instruction of row encoding and decoding treatment, the coding and decoding instruction includes skew of the multi-medium data in the shared drive
Address；The coding and decoding instruction is based on into cross-system communication to send to host operating system；In the step 102, in main frame
In operating system OMX adaptation layers, the offset address in the coding and decoding instruction obtains the multimedia number by shared drive
According to；The coding and decoding instruction and the multi-medium data are sent into the OpenMAX integrated layers into host operating system, so that institute
The OpenMAX integrated layers stated in host operating system are carried out at encoding and decoding according to the coding and decoding instruction to the multi-medium data
Reason.
So that virtualization system framework uses Android multimedia frameworks (Stagefright+OpenMAX) as an example, main frame behaviour
Make the Stagefright in system and Client OS and be separately operable OMX adaptation layers, draw respectively in the adaptation layer
With class OMXClient.Wherein in the OMX adaptation layers of host operating system, AwesomePlayer can call OMX
Client::Connect functions, MediaPlayerService is obtained by binder mechanism, is then passed through
MediaPlayerService creates the example of OMX, makes the OMXClient in host operating system as the entrance of OMX, can be with
The service that OMX is provided is obtained by binder mechanism.
In Client OS, created in the OMX adaptation layers of Stagefright frameworks in the Client OS
New class OMXClient front ends, the OMXClient front ends can be to class mediaplayer, class mediacodec, Huo Zheqi
Other classes in his Android system multimedia framework provide the class OMXClient interfaces of standard, when in Client OS
After the OMXClient front ends get the encoding and decoding request that multimedia application carries out multi-medium data encoding and decoding treatment,
According to encoding and decoding request generation coding and decoding instruction, multi-medium data is write into shared drive, and by the multi-medium data
Offset address in shared drive is included in the coding and decoding instruction, is referred to the encoding and decoding by cross-system communication mode
Order is transferred to the OMXClient rear ends in host operating system OMX adaptation layers, and the OMXClient rear ends can be according to described
The offset address included in coding and decoding instruction obtains the multi-medium data by shared drive, and by the coding and decoding instruction together with
Treat encoding and decoding treatment multi-medium data by Binder mechanism be sent to MediaPlayerService,
Other Service in MediaCodecService or Android system multimedia framework.In present embodiment, will be described
OMXClient rear ends make transmission in Client OS extremely as the entrance of host operating system OMX adaptation layers OMX
The coding and decoding instruction and multi-medium data of OMXClient front ends can be sent to host operating system via OMXClient rear ends
The complete OpenMAX integrated layers of middle operation, and then complete the encoding and decoding treatment of hardware or software.
In the present embodiment, can also be determined to carry out encoding and decoding to the multi-medium data according to encoding and decoding request
The information of the codec for the treatment of and then the coding and decoding instruction of the correspondence codec is generated, above-mentioned steps 102 can be, root
The multi-medium data is obtained by the shared drive according to the offset address in the coding and decoding instruction；By the coding and decoding instruction
The OpenMAX integrated layers into host operating system are sent with the multi-medium data, so that in the host operating system
OpenMAX integrated layers carry out volume solution according to the component that the coding and decoding instruction loads the codec to the multi-medium data
Code treatment.
For Stagefright frameworks, can be supported with storage client operating system in the configuration file for pre-setting
All codecs, including various hardware compression devices and software codec.In the OMX adaptation layers of Client OS
After OMXClient front ends get the encoding and decoding request of multimedia application transmission, Stagefright frameworks can be according to need
The multi-medium data for carrying out encoding and decoding treatment determines the applicable codec of the multi-medium data, such as according to multimedia number
According to type, form or resolution ratio etc. be its selection appropriate software or hardware compression device, and generate the encoding and decoding
The corresponding coding and decoding instruction of device.
Client actions are got in the Stagefright framework OMX adaptation layer OMXClient rear ends of host operating system
After the coding and decoding instruction that system sends, the offset address in the coding and decoding instruction obtains described many by the shared drive
Media data, the OpenMAX integrated layers into host operating system are sent by the coding and decoding instruction and the multi-medium data,
So that the OpenMAX integrated layers according to the appropriate software of the encoding and decoding request of loading or hardware compression device assembly to institute
Stating multi-medium data carries out encoding and decoding treatment.
In the present embodiment, after above-mentioned steps 102, step 103 can also be included, by the multimedia number after treatment
The Client OS is fed back according to based on shared drive；In Client OS, by the multimedia after the treatment
Multimedia application described in data feedback.
Encoding and decoding are completed to the multi-medium data in the software or hardware compression device of host operating system and processes it
Afterwards, the OMXClient rear ends in host operating system OMX adaptation layers can will carry out the data after encoding and decoding treatment based on shared
Internal memory is transferred to the OMXClient front ends in Client OS multimedia framework OMX adaptation layers, Client OS
OMXClient front ends in OMX adaptation layers, the former volume of initiation can be fed back to after the data after receiving encoding and decoding treatment and are solved
The multimedia application of code request.
In the above-described embodiment, for multimedia creates host operating system, Client OS when Qemu starts
Addressable shared drive, creates the file node of the block shared drive in host operating system, and the block is shared interior
Deposit and map to Client OS, for example, be mapped as Client OS PCI (Peripheral Component
Interconnect, Peripheral Component Interconnect standard) equipment memory headroom.Multimedia front end (example in Client OS
As codec drives front end, OpenMAX front ends or OMXClient front ends) carried out initially by inner nuclear layer acquisition configuration information
The shared memory space of Qemu distribution is obtained after change, that is, has obtained first ground of the shared drive in Client OS
Location.Multimedia rear end in host operating system is (such as after codec drives rear end, OpenMAX rear ends or OMXClient
End) start after, monitor the connection request of its corresponding front end, when front end and rear end are attached, multimedia rear end is according to preceding
The file node mapping for stating the shared drive of Qemu establishments obtains shared memory space, that is, obtained the shared drive in main frame
First address in operating system.Afterwards, the front-end and back-end set up after connection can each operated by above-mentioned shared drive
First address and identical offset address in system, by the same block space in shared drive realize multi-medium data or
The cross-system transmission of coding and decoding instruction.
In the present embodiment, there is provided a kind of cross-system multi-medium data decoding method, in the first operating system, when need
When encoding and decoding treatment is carried out to multi-medium data, multi-medium data can be sent to the second operating system by shared drive,
Processed with the encoding and decoding for completing in the second operating system the multi-medium data, in the application, by Sharing Memory Realization across
The transmission of multi-medium data, reduces data copy number of times in multimedia system data encoding-decoding process, has on the one hand saved void
The computing resource and storage resource of planization system architecture, lift virtualization system performance, on the other hand shorten many matchmakers of cross-system
Volume data encoding and decoding process time.The application is also based on shared drive mode in the first operating system and the second operating system
Between transmit coding and decoding instruction, further shorten the time of cross-system multi-medium data encoding and decoding treatment；It is former in the first operating system
When the physical storage area of the buffering area of distribution is unshared internal memory, the data copy of unshared internal memory to shared drive can be write
In in order to the second operating system read；In addition this motion also discloses the kernel of the first operating system and the second operating system
The adaptation layer of layer, OpenMAX integrated layers or multimedia framework can transmit multimedia based on Sharing Memory Realization cross-system
Data encoding and decoding are asked, and can be adjusted according to user's request, more flexible.
Embodiment two：
A kind of cross-system multi-medium data encoding and decoding dress is additionally provided based on same inventive concept, in the embodiment of the present application
Put, because the principle of these device solve problems is similar to cross-system multi-medium data decoding method, therefore these devices
Implementation may refer to the implementation of method, repeats part and repeats no more.As shown in fig. 6, the cross-system multi-medium data encoding and decoding
Device 200 includes：
Front-end module 201, please to the encoding and decoding of multi-medium data encoding and decoding treatment in the first operating system, obtaining
Ask, the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment；The multi-medium data is sent to altogether
Enjoy internal memory；The coding and decoding instruction of encoding and decoding treatment is carried out to the multi-medium data according to encoding and decoding request generation, it is described
Coding and decoding instruction includes offset address of the multi-medium data in the shared drive；The coding and decoding instruction is based on interdepartmental
System communication is sent to the second operating system；
Rear module 202, in second operating system, offset address in the coding and decoding instruction by
The shared drive obtains the multi-medium data；The multi-medium data is carried out at encoding and decoding according to the coding and decoding instruction
Reason, the shared drive is in readable and writable state to first operating system and second operating system.
In some embodiments, it is described that the coding and decoding instruction is based on cross-system communication transmission to the second operation system
System, including：The coding and decoding instruction is sent to the second operating system based on shared drive mode.
In some embodiments, it is described to send to shared drive the multi-medium data, including：By the multimedia
Data is activation is to unshared internal memory；Multi-medium data in the unshared internal memory is copied to shared drive.
In some embodiments, it is described in the first operating system, obtain the volume to multi-medium data encoding and decoding treatment
Decoding request, the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment, including：
In the first operating system, obtain multimedia framework and call the codec to carry out multi-medium data encoding and decoding treatment
Encoding and decoding are asked, and the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment；
It is described that encoding and decoding treatment is carried out to the multi-medium data according to the coding and decoding instruction, including：
The driver for calling the codec according to the coding and decoding instruction carries out volume solution to the multi-medium data
Code treatment.
In some embodiments, the front-end module 201 is specifically in the first operating system OpenMAX integrated layers
In, the encoding and decoding that encoding and decoding treatment is carried out to the multi-medium data request that adaptation layer sends is obtained, the encoding and decoding request includes
Need to carry out the multi-medium data of encoding and decoding treatment；The multi-medium data is sent to shared drive；According to the encoding and decoding
Request generation carries out the coding and decoding instruction of encoding and decoding treatment to the multi-medium data, and the coding and decoding instruction includes many matchmakers
Offset address of the volume data in the shared drive；The coding and decoding instruction is based on into cross-system communication to send to the second operation system
System；
The rear module 202 is specifically in the second operating system OpenMAX integrated layers, according to the volume
Offset address in solution code instruction obtains the multi-medium data by the shared drive；Institute is loaded according to the coding and decoding instruction
Stating the component of codec carries out encoding and decoding treatment to the multi-medium data, and the shared drive is to first operating system
Readable and writable state is in second operating system.
In some embodiments, it is described in the first operating system, obtain the volume to multi-medium data encoding and decoding treatment
Decoding request, the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment, including：
In the first operating system, the encoding and decoding that acquisition multimedia application carries out multi-medium data encoding and decoding treatment please
Ask, the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment；
It is described that encoding and decoding treatment is carried out to the multi-medium data according to the coding and decoding instruction, including：
The coding and decoding instruction and the multi-medium data are sent into the OpenMAX integrated layers into the second operating system,
So that the OpenMAX integrated layers in second operating system are compiled according to the coding and decoding instruction to the multi-medium data
Decoding process.
In some embodiments, the rear module 202 is additionally operable to, it is described according to the coding and decoding instruction to described
Multi-medium data is carried out after encoding and decoding treatment, the encoding and decoding result of the multi-medium data is fed back to described shared interior
Deposit；
The front-end module 201 is additionally operable to, and in the first operating system, the encoding and decoding is obtained by the shared drive
Reason result.
Embodiment three：
Based on same inventive concept, a kind of electronic equipment is additionally provided in the embodiment of the present application, due to its principle with it is interdepartmental
System multi-medium data decoding method is similar, therefore its implementation may refer to the implementation of method, repeats part and repeats no more.As schemed
Shown in 7, the electronic equipment 300 includes：Memory 301, one or more processors 302；And one or more modules, institute
State one or more modules to be stored in the memory, and be configured to by one or more of computing devices, institute
Stating one or more modules includes the instruction for being used to perform each step in any above method.
In the present embodiment, the electronic equipment can be mobile phone, panel computer, robot or other smart machines.
Example IV：
Based on same inventive concept, the embodiment of the present application additionally provides a kind of computer journey being used in combination with electronic equipment
Sequence product, the computer program product includes the computer program being embedded in computer-readable storage medium, the meter
Calculation machine program includes the instruction for making the electronic equipment perform each step in any above method.
For convenience of description, each several part of apparatus described above is divided into various modules and describes respectively with function.Certainly, exist
Implement the function of each module or unit can be realized in same or multiple softwares or hardware during the application.
It should be understood by those skilled in the art that, embodiments herein can be provided as method, system or computer program
Product.Therefore, the application can be using the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware
Apply the form of example.And, the application can be used and wherein include the computer of computer usable program code at one or more
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) is produced
The form of product.
The application is the flow with reference to method, equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram are described.It should be understood that every first-class during flow chart and/or block diagram can be realized by computer program instructions
The combination of flow and/or square frame in journey and/or square frame and flow chart and/or block diagram.These computer programs can be provided
The processor of all-purpose computer, special-purpose computer, Embedded Processor or other programmable data processing devices is instructed to produce
A raw machine so that produced for reality by the instruction of computer or the computing device of other programmable data processing devices
The device of the function of being specified in present one flow of flow chart or multiple one square frame of flow and/or block diagram or multiple square frames.
These computer program instructions may be alternatively stored in can guide computer or other programmable data processing devices with spy
In determining the computer-readable memory that mode works so that instruction of the storage in the computer-readable memory is produced and include finger
Make the manufacture of device, the command device realize in one flow of flow chart or multiple one square frame of flow and/or block diagram or
The function of being specified in multiple square frames.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that in meter
Series of operation steps is performed on calculation machine or other programmable devices to produce computer implemented treatment, so as in computer or
The instruction performed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in individual square frame or multiple square frames.
Although having been described for the preferred embodiment of the application, those skilled in the art once know basic creation
Property concept, then can make other change and modification to these embodiments.So, appended claims are intended to be construed to include excellent
Select embodiment and fall into having altered and changing for the application scope.
Claims (16)
1. a kind of cross operating system multi-medium data decoding method, it is characterised in that methods described includes：
In the first operating system, the encoding and decoding request to multi-medium data encoding and decoding treatment, the encoding and decoding request bag are obtained
Include the multi-medium data for needing to carry out encoding and decoding treatment；The multi-medium data is sent to shared drive；Solution is compiled according to described
Code request generation carries out the coding and decoding instruction of encoding and decoding treatment to the multi-medium data, and the coding and decoding instruction includes described many
Offset address of the media data in the shared drive；The coding and decoding instruction is based on into cross-system communication to send to the second operation
System；
In second operating system, the offset address in the coding and decoding instruction is described in the shared drive is obtained
Multi-medium data；Encoding and decoding treatment is carried out to the multi-medium data according to the coding and decoding instruction, the shared drive is to institute
State the first operating system and second operating system is in readable and writable state.
2. method according to claim 1, it is characterised in that described the coding and decoding instruction is based on cross-system to communicate hair
The second operating system is delivered to, including：
The coding and decoding instruction is sent to the second operating system based on shared drive mode.
3. the method for claim 1, it is characterised in that described to send to shared drive, bag the multi-medium data
Include：
The multi-medium data is sent to unshared internal memory；
Multi-medium data in the unshared internal memory is copied to shared drive.
4. method according to claim 1, it is characterised in that described in the first operating system, obtains to multimedia number
The encoding and decoding processed according to encoding and decoding are asked, and the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment, wraps
Include：
In the first operating system, obtain multimedia framework and call the codec to carry out the volume solution of multi-medium data encoding and decoding treatment
Code request, the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment；
It is described that encoding and decoding treatment is carried out to the multi-medium data according to the coding and decoding instruction, including：
The driver for calling the codec according to the coding and decoding instruction is carried out at encoding and decoding to the multi-medium data
Reason.
5. the method for claim 1, it is characterised in that methods described includes：
In the first operating system OpenMAX integrated layers, obtain adaptation layer transmission carries out encoding and decoding treatment to multi-medium data
Encoding and decoding request, encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment；By the multimedia number
According to transmission to shared drive；The encoding and decoding of encoding and decoding treatment are carried out to the multi-medium data according to encoding and decoding request generation
Instruction, the coding and decoding instruction includes offset address of the multi-medium data in the shared drive；The encoding and decoding are referred to
Order is sent to the second operating system based on cross-system communication；
In the second operating system OpenMAX integrated layers, the offset address in the coding and decoding instruction is by described common
Enjoy internal memory and obtain the multi-medium data；The component of the codec is loaded to the multimedia according to the coding and decoding instruction
Data carry out encoding and decoding treatment, and the shared drive is in readable to first operating system and second operating system
With can write state.
6. method according to claim 1, it is characterised in that described in the first operating system, obtains to multimedia number
The encoding and decoding processed according to encoding and decoding are asked, and the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment, wraps
Include：
In the first operating system, obtaining multimedia application carries out the encoding and decoding request of multi-medium data encoding and decoding treatment,
The encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment；
It is described that encoding and decoding treatment is carried out to the multi-medium data according to the coding and decoding instruction, including：
The coding and decoding instruction and the multi-medium data are sent into the OpenMAX integrated layers into the second operating system, so that
OpenMAX integrated layers in second operating system carry out encoding and decoding according to the coding and decoding instruction to the multi-medium data
Treatment.
7. method according to claim 1, it is characterised in that it is described according to the coding and decoding instruction to the multimedia
Data are carried out after encoding and decoding treatment, are also included：
The encoding and decoding result of the multi-medium data is fed back into the shared drive；
In the first operating system, the encoding and decoding result is obtained by the shared drive.
8. a kind of cross operating system multi-medium data coding and decoding device, it is characterised in that described device includes：
Front-end module, it is described in the first operating system, obtaining the encoding and decoding request to multi-medium data encoding and decoding treatment
Encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment；The multi-medium data is sent to shared drive；
The coding and decoding instruction of encoding and decoding treatment is carried out to the multi-medium data according to encoding and decoding request generation, the encoding and decoding refer to
Order includes offset address of the multi-medium data in the shared drive；The coding and decoding instruction is based on cross-system communication hair
Deliver to the second operating system；
Rear module, in second operating system, the offset address in the coding and decoding instruction to be by described common
Enjoy internal memory and obtain the multi-medium data；Encoding and decoding treatment, institute are carried out to the multi-medium data according to the coding and decoding instruction
State shared drive and readable and writable state is in first operating system and second operating system.
9. device according to claim 8, it is characterised in that described the coding and decoding instruction is based on cross-system to communicate hair
The second operating system is delivered to, including：
The coding and decoding instruction is sent to the second operating system based on shared drive mode.
10. device as claimed in claim 8, it is characterised in that described to send to shared drive, bag the multi-medium data
Include：
The multi-medium data is sent to unshared internal memory；
Multi-medium data in the unshared internal memory is copied to shared drive.
11. devices according to claim 8, it is characterised in that described in the first operating system, obtain to multimedia number
The encoding and decoding processed according to encoding and decoding are asked, and the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment, wraps
Include：
In the first operating system, obtain multimedia framework and call the codec to carry out the volume solution of multi-medium data encoding and decoding treatment
Code request, the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment；
It is described that encoding and decoding treatment is carried out to the multi-medium data according to the coding and decoding instruction, including：
The driver for calling the codec according to the coding and decoding instruction is carried out at encoding and decoding to the multi-medium data
Reason.
12. devices as claimed in claim 8, it is characterised in that：
The front-end module specifically for, in the first operating system OpenMAX integrated layers, obtain adaptation layer send to many matchmakers
Volume data carries out the encoding and decoding request of encoding and decoding treatment, and the encoding and decoding request includes needing to carry out the multimedia of encoding and decoding treatment
Data；The multi-medium data is sent to shared drive；The multi-medium data is entered according to encoding and decoding request generation
The coding and decoding instruction of row encoding and decoding treatment, the coding and decoding instruction includes skew of the multi-medium data in the shared drive
Address；The coding and decoding instruction is based on into cross-system communication to send to the second operating system；
The rear module is specifically in the second operating system OpenMAX integrated layers, according to the coding and decoding instruction
In offset address the multi-medium data is obtained by the shared drive；The encoding and decoding are loaded according to the coding and decoding instruction
The component of device carries out encoding and decoding treatment to the multi-medium data, and the shared drive is to first operating system and described
Two operating systems are in readable and writable state.
13. devices according to claim 8, it is characterised in that described in the first operating system, obtain to multimedia number
The encoding and decoding processed according to encoding and decoding are asked, and the encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment, wraps
Include：
In the first operating system, obtaining multimedia application carries out the encoding and decoding request of multi-medium data encoding and decoding treatment,
The encoding and decoding request includes needing to carry out the multi-medium data of encoding and decoding treatment；
It is described that encoding and decoding treatment is carried out to the multi-medium data according to the coding and decoding instruction, including：
The coding and decoding instruction and the multi-medium data are sent into the OpenMAX integrated layers into the second operating system, so that
OpenMAX integrated layers in second operating system carry out encoding and decoding according to the coding and decoding instruction to the multi-medium data
Treatment.
14. devices according to claim 8, it is characterised in that：
The rear module is additionally operable to, and encoding and decoding treatment is carried out to the multi-medium data according to the coding and decoding instruction described
Afterwards, the encoding and decoding result of the multi-medium data is fed back into the shared drive；
The front-end module is additionally operable to, and in the first operating system, the encoding and decoding result is obtained by the shared drive.
15. a kind of electronic equipment, it is characterised in that the electronic equipment includes：
Memory, one or more processors；And one or more modules, one or more of modules are stored in described
In memory, and it is configured to by one or more of computing devices, one or more of modules are included for performing
In claim 1 to 7 in any methods described each step instruction.
A kind of 16. computer program products being used in combination with electronic equipment, the computer program product includes being embedded in meter
Computer program in the readable storage medium of calculation machine, the computer program is included for making the electronic equipment perform claim
It is required that the instruction of each step in 1 to 7 in any methods described.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CN2016/113276 WO2018119955A1 (en) | 2016-12-29 | 2016-12-29 | Cross-system multimedia data coding and decoding method, apparatus, electronic device and computer program product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106797388A true CN106797388A (en) | 2017-05-31 |
| CN106797388B CN106797388B (en) | 2020-11-10 |
Family
ID=58952955
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201680002827.3A Active CN106797388B (en) | 2016-12-29 | 2016-12-29 | Cross-system multimedia data encoding and decoding method and device, electronic equipment and computer program product |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106797388B (en) |
| WO (1) | WO2018119955A1 (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107809671A (en) * | 2017-11-20 | 2018-03-16 | 深圳市青葡萄科技有限公司 | Video is redirected to the method and system of server decoding under a kind of virtualized environment |
| CN107911700A (en) * | 2017-10-31 | 2018-04-13 | 深信服科技股份有限公司 | A kind of hardware coding/decoding method, decoding device and storage medium based on virtualization |
| CN109150930A (en) * | 2017-06-15 | 2019-01-04 | 北京金山云网络技术有限公司 | Configuration information loading method and device, method for processing business and device |
| CN110022497A (en) * | 2018-01-10 | 2019-07-16 | 中兴通讯股份有限公司 | Video broadcasting method and device, terminal device and computer readable storage medium |
| CN112581650A (en) * | 2020-11-12 | 2021-03-30 | 江苏北斗星通汽车电子有限公司 | Video data processing method and device based on intelligent cabin and electronic terminal |
| CN112788343A (en) * | 2021-02-23 | 2021-05-11 | 北京睿芯高通量科技有限公司 | Software and hardware coding cooperation system and method for video processing server and electronic device |
| CN112995753A (en) * | 2019-12-16 | 2021-06-18 | 中兴通讯股份有限公司 | Media stream distribution method, CDN node server, CDN system and readable storage medium |
| CN114157919A (en) * | 2020-09-07 | 2022-03-08 | 华为云计算技术有限公司 | Data processing method and system, cloud terminal, server and computing equipment |
| CN114579072A (en) * | 2022-03-02 | 2022-06-03 | 南京芯驰半导体科技有限公司 | Display screen projection method and device across multiple operating systems |
| WO2022199328A1 (en) * | 2021-03-26 | 2022-09-29 | 山东英信计算机技术有限公司 | Encoding and decoding method, apparatus and device based on erasure pool, and storage medium |
| WO2023093474A1 (en) * | 2021-11-24 | 2023-06-01 | 北京字跳网络技术有限公司 | Multimedia processing method and apparatus, and device and medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110096624B (en) * | 2019-04-26 | 2023-03-21 | 深圳前海微众银行股份有限公司 | Encoding and decoding method and device, computer equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100472451C (en) * | 2006-04-20 | 2009-03-25 | 联想(北京)有限公司 | Dummy machine system and its hardware access method |
| CN101847105A (en) * | 2009-03-26 | 2010-09-29 | 联想(北京)有限公司 | Computer and internal memory sharing method of a plurality of operation systems |
| CN104023266A (en) * | 2014-05-27 | 2014-09-03 | 烽火通信科技股份有限公司 | Use method of communication coding-decoding assembly of android system |
| CN102981887B (en) * | 2011-09-06 | 2016-07-06 | 联想(北京)有限公司 | Data processing method and electronic equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6907494B2 (en) * | 2002-10-10 | 2005-06-14 | International Business Machines Corporation | Method and system of managing virtualized physical memory in a memory controller and processor system |
| US20060070069A1 (en) * | 2004-09-30 | 2006-03-30 | International Business Machines Corporation | System and method for sharing resources between real-time and virtualizing operating systems |
| WO2011008205A1 (en) * | 2009-07-15 | 2011-01-20 | Hewlett-Packard Development Company, L.P. | Shared video management subsystem |
-
2016
- 2016-12-29 WO PCT/CN2016/113276 patent/WO2018119955A1/en active Application Filing
- 2016-12-29 CN CN201680002827.3A patent/CN106797388B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100472451C (en) * | 2006-04-20 | 2009-03-25 | 联想(北京)有限公司 | Dummy machine system and its hardware access method |
| CN101847105A (en) * | 2009-03-26 | 2010-09-29 | 联想(北京)有限公司 | Computer and internal memory sharing method of a plurality of operation systems |
| CN102981887B (en) * | 2011-09-06 | 2016-07-06 | 联想(北京)有限公司 | Data processing method and electronic equipment |
| CN104023266A (en) * | 2014-05-27 | 2014-09-03 | 烽火通信科技股份有限公司 | Use method of communication coding-decoding assembly of android system |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109150930A (en) * | 2017-06-15 | 2019-01-04 | 北京金山云网络技术有限公司 | Configuration information loading method and device, method for processing business and device |
| CN109150930B (en) * | 2017-06-15 | 2020-12-18 | 北京金山云网络技术有限公司 | Configuration information loading method and device and service processing method and device |
| CN107911700A (en) * | 2017-10-31 | 2018-04-13 | 深信服科技股份有限公司 | A kind of hardware coding/decoding method, decoding device and storage medium based on virtualization |
| CN107911700B (en) * | 2017-10-31 | 2020-07-03 | 深信服科技股份有限公司 | Virtualization-based hardware decoding method, decoding equipment and storage medium |
| CN107809671A (en) * | 2017-11-20 | 2018-03-16 | 深圳市青葡萄科技有限公司 | Video is redirected to the method and system of server decoding under a kind of virtualized environment |
| CN110022497A (en) * | 2018-01-10 | 2019-07-16 | 中兴通讯股份有限公司 | Video broadcasting method and device, terminal device and computer readable storage medium |
| CN112995753A (en) * | 2019-12-16 | 2021-06-18 | 中兴通讯股份有限公司 | Media stream distribution method, CDN node server, CDN system and readable storage medium |
| CN112995753B (en) * | 2019-12-16 | 2024-03-22 | 中兴通讯股份有限公司 | Media stream distribution method, CDN node server, CDN system and readable storage medium |
| CN114157919A (en) * | 2020-09-07 | 2022-03-08 | 华为云计算技术有限公司 | Data processing method and system, cloud terminal, server and computing equipment |
| CN112581650A (en) * | 2020-11-12 | 2021-03-30 | 江苏北斗星通汽车电子有限公司 | Video data processing method and device based on intelligent cabin and electronic terminal |
| CN112788343A (en) * | 2021-02-23 | 2021-05-11 | 北京睿芯高通量科技有限公司 | Software and hardware coding cooperation system and method for video processing server and electronic device |
| WO2022199328A1 (en) * | 2021-03-26 | 2022-09-29 | 山东英信计算机技术有限公司 | Encoding and decoding method, apparatus and device based on erasure pool, and storage medium |
| WO2023093474A1 (en) * | 2021-11-24 | 2023-06-01 | 北京字跳网络技术有限公司 | Multimedia processing method and apparatus, and device and medium |
| CN114579072A (en) * | 2022-03-02 | 2022-06-03 | 南京芯驰半导体科技有限公司 | Display screen projection method and device across multiple operating systems |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106797388B (en) | 2020-11-10 |
| WO2018119955A1 (en) | 2018-07-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106797388A (en) | Cross-system multi-medium data decoding method, device, electronic equipment and computer program product | |
| US11429442B2 (en) | Parallel and distributed computing using multiple virtual machines | |
| CN1797345B (en) | Systems and methods for virtualizing graphics subsystems | |
| CN107783818A (en) | Deep learning task processing method, device, equipment and storage medium | |
| CN101517536B (en) | With the function level instant translation engine of Multiple Optimization | |
| US10877793B2 (en) | Extending the base address register by modifying the number of read-only bits associated with a device to be presented to a guest operating system | |
| US20150088982A1 (en) | Load balanced inter-device messaging | |
| US10318331B2 (en) | Method and apparatus for live-migrating virtual machines | |
| US9311169B2 (en) | Server based graphics processing techniques | |
| CN105830026A (en) | Apparatus and method for scheduling graphics processing unit workloads from virtual machines | |
| US9959134B2 (en) | Request processing using VM functions | |
| US9542715B2 (en) | Memory space mapping techniques for server based graphics processing | |
| CN106797398B (en) | For providing the method and system of virtual desktop serve to client | |
| JP2016524257A (en) | System and method for providing secure access control to a graphics processing unit | |
| US9805439B2 (en) | Memory space mapping techniques for server based graphics processing | |
| US20200042341A1 (en) | Secure access of virtual machine memory suitable for ai assisted automotive applications | |
| CN106797470A (en) | Multiple operating system multi-medium data decoding method, device, electronic equipment and computer program product | |
| US20210158131A1 (en) | Hierarchical partitioning of operators | |
| US20130204924A1 (en) | Methods and apparatuses for providing application level device transparency via device devirtualization | |
| US20180203726A1 (en) | Virtual machine migration method and apparatus | |
| US9553761B2 (en) | Dynamic server to server configuration and initialization | |
| US20140055470A1 (en) | Host Context Techniques for Server Based Graphics Processing | |
| CN106716998B (en) | Multiple operating system multi-medium data decoding method, device and electronic equipment | |
| US20160246629A1 (en) | Gpu based virtual system device identification | |
| US10733005B1 (en) | Providing access to mobile applications by heterogeneous devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |