US20180052700A1 - Facilitation of guest application display from host operating system - Google Patents

Facilitation of guest application display from host operating system Download PDF

Info

Publication number
US20180052700A1
US20180052700A1 US15/730,538 US201715730538A US2018052700A1 US 20180052700 A1 US20180052700 A1 US 20180052700A1 US 201715730538 A US201715730538 A US 201715730538A US 2018052700 A1 US2018052700 A1 US 2018052700A1
Authority
US
United States
Prior art keywords
operating system
guest application
application
buffer
guest
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/730,538
Inventor
Jinkui Ren
Dongxiao XU
Xiantao Zhang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Intel Corp
Original Assignee
Intel Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intel Corp filed Critical Intel Corp
Priority to US15/730,538 priority Critical patent/US20180052700A1/en
Publication of US20180052700A1 publication Critical patent/US20180052700A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45541Bare-metal, i.e. hypervisor runs directly on hardware
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/452Remote windowing, e.g. X-Window System, desktop virtualisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45537Provision of facilities of other operating environments, e.g. WINE
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5005Allocation of resources, e.g. of the central processing unit [CPU] to service a request
    • G06F9/5011Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals
    • G06F9/5016Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resources being hardware resources other than CPUs, Servers and Terminals the resource being the memory
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45579I/O management, e.g. providing access to device drivers or storage
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45558Hypervisor-specific management and integration aspects
    • G06F2009/45583Memory management, e.g. access or allocation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Definitions

  • the present disclosure relates to the field of data processing, in particular, to apparatuses, methods and storage media associated with facilitating display of guest applications in a host operating system.
  • OS operating system
  • users of these devices may wish to execute applications that were developed to execute in different environments and/or under differed OSes.
  • a user of a mobile phone executing under a version of the Android® OS may, in some circumstances, wish to execute a guest application that was not originally written to operate on an Android device, such as a Windows® application.
  • guest applications may, in some scenarios, be executed within an emulator that allows the guest application to execute as if it were executing in its expected OS and environment.
  • an emulator that allows the guest application to execute as if it were executing in its expected OS and environment.
  • the computing device may find it difficult to obtain access to screen produced by the guest application in order to draw them on the device.
  • a memory copy scheme is used to get past these limitations.
  • the host OS may utilize two buffers, a front buffer and a back buffer, allow drawing of guest application frames on the back buffer, and switch between the two when the drawing of each frame is complete.
  • the host OS may not know when drawing of a frame is complete, because the guest application is performing its drawing within an emulated environment (and does not necessarily know that the host operating system is waiting for a completed frame).
  • the host OS may, in some scenarios, periodically poll the guest application to determine when a frame is complete.
  • the host OS may then perform a copy of the guest application's local drawing buffer to the host OS's back buffer, and then perform a buffer switch to allow the guest-application-drawn frame to appear on the screen of the computing device.
  • this technique may provide for the guest application to draw to the computing device screen, the polling and copying of drawing buffer memory introduce substantial processing costs that are undesirable.
  • FIG. 1 illustrates an example arrangement for a computing device configured to facilitate display of guest applications in a host OS in accordance with various embodiments.
  • FIG. 2 illustrates an example arrangement for a buffer provision application facilitating display of guest applications in the host OS in accordance with various embodiments.
  • FIG. 3 illustrates an example illustration of drawing buffer composition, in accordance with various embodiments.
  • FIG. 4 illustrates an example process for a buffer provision application facilitating display of guest applications in a host OS in accordance with various embodiments.
  • FIG. 5 illustrates an example process for the buffer provision application providing a buffer to a guest application in accordance with various embodiments.
  • FIG. 6 illustrates an example process for a guest screen to be rendered in accordance with various embodiments.
  • FIG. 7 illustrates an example computing environment suitable for practicing various aspects of the present disclosure in accordance with various embodiments.
  • FIG. 8 illustrates an example storage medium with instructions configured to enable an apparatus to practice various aspects of the present disclosure in accordance with various embodiments.
  • phrase “A and/or B” means (A), (B), or (A and B).
  • phrase “A, B, and/or C” means (A), (B), (C), (A and B), (A and C), (B and C), or (A, B and C).
  • logic and module may refer to, be part of, or include an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and/or memory (shared, dedicated, or group) that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.
  • ASIC Application Specific Integrated Circuit
  • processor shared, dedicated, or group
  • memory shared, dedicated, or group
  • logic may refer to, be part of, or include a System on a Chip, as described below.
  • a buffer provision application may be configured to facilitate display of a guest application executing in a host operating system (“host OS”).
  • host OS may operate on a computing device and allow for the execution of applications.
  • a guest application may be configured to execute in a guest operating system (“guest OS”) other than the host OS.
  • the host OS may provide for execution of the guest application, such as through use of an emulator configured to emulate a guest OS environment for the guest application.
  • the BFA may be configured to provide a drawing buffer for use by the guest application.
  • the drawing buffer may, in various embodiments, be caused to be allocated within the host OS by the BFA (or by a helper application of the BFA).
  • the BFA may then cause the allocated buffer to be provided to the guest application so that the guest application may draw frame data directly to the drawing buffer. Because the drawing buffer was allocated to be available and known to the BFA, however, the BFA may then facilitate access to the drawing buffer by the host OS when compositing drawing buffer data with other drawing data of the host OS. In various embodiments, by performing this allocation and provision of the drawing buffer, a need for the overhead issues discussed above may be reduced. In particular, the BFA may reduce a need for polling of the guest application to determine when frames are drawn and/or copying of frame data from a drawing buffer of the guest application. Particular non-limiting embodiments and implementation examples are provided below.
  • the computing device 105 may include various types of computing device, including, but not limited to, mobile devices, mobile phones, laptop computers, desktop computers, embedded systems, etc.
  • the computing device 105 may include device memory 160 , which may include various types of removable or permanent memory (or storage) as may be understood.
  • a host OS 120 may execute from within the device memory 160 .
  • the host OS 120 may, in some embodiments, be a version of the AndroidTM operating system, but in various embodiments, may include, but is not limited to, other operating systems configured to operate on mobile or non-mobile computing devices, such as iOSTM, WindowsTM, Fire OSTM, and other OSes.
  • the host OS 120 may be configured to support execution of one or more applications, such as a buffer provision application 150 (“BPA 150 ”), which may be configured to facilitate display of guest application 150 in the host OS 120 , as described herein.
  • BPA 150 buffer provision application 150
  • the host OS 120 may also be configured to support execution of a software compositor application 130 (“SWC 130 ”) which may be configured to perform composition of drawing data, as described herein. Particular activities of the BPA 150 and SWC 130 are described below.
  • the computing device 105 may also include a guest application 150 .
  • the guest application 150 may be configured to execute on a different operating system than the host OS 120 .
  • the guest application 150 may be an application configured to execute in a WindowsTM operating system.
  • the computing device 105 may include hardware logic for performing one or more techniques described herein.
  • the host OS 20 may include a hardware compositor 140 (“HWC 140 ”) which may be configured to perform composition of drawing data, as described herein. It may be noted that, while particular features are illustrated in the examples herein as being performed by hardware and/or software, these are merely provided as examples and should not necessarily be read as requiring any particular locus for embodiments described herein.
  • the BPA 100 may be configured to operate alongside other applications 105 , on the computing device 105 .
  • the guest application 150 and the BPA 100 may be implemented in different programming languages.
  • the host OS may be the AndroidTM OS with the BPA 100 implemented in JavaTM, while the guest application may be a WindowsTM application implemented in C++.
  • different programming languages may be utilized while incorporating aspects of embodiments described herein; further, in some embodiments, the BPA 100 and guest application 150 may be implemented, in whole or in part, utilizing the same programming language.
  • the particular OS and programming language examples described herein with reference to FIG. 1 are therefore provided as such, as examples, and no particular implementation is thus intended.
  • the BPA 100 may be configured to execute in a different process that the guest application 150 , as illustrated.
  • process may include various techniques for operation of separate applications executing on a computing device, including, but not limited to, separate processes, threads, methods, operation on separate processors, operation on separate processor cores, etc.
  • the guest application 150 and BPA 100 may execute, in whole or in part, on a common thread or process.
  • the guest application 150 may execute on the computing device as facilitated by an emulator 260 .
  • the emulator 260 may, in various embodiments, be configured to provide the guest application 150 with an environment in which to execute that appears to the guest application 150 to be a guest OS (other than the host OS 120 ) in which the guest application is configured to execute, as may be understood.
  • the emulator 260 may be configured interoperate with host OS 120 applications through the use of an emulator service 240 , which may include an application or other code that may be configured to execute in the same process as the guest application 150 .
  • the emulator service 240 may be configured to allocate memory out of the device memory 160 within the host OS 120 for use by the emulator 260 .
  • the emulator 160 may provide this memory to the guest application 150 for the guest application 150 to use as if it were guest OS memory.
  • the BPA 100 may be configured to interoperate with a emulator helper 230 , which may include an application or other code that may be configured to bind to the emulator service 240 to allow for the provision of data or other information to the emulator 260 .
  • the guest application 150 may be configured to draw one or more graphical frames of frame data to a drawing buffer in order to provide a graphical interface to a user of the computing device 105 .
  • the BPA 100 may be configured to cause allocation of a drawing buffer 210 and to provide that drawing buffer 210 to the guest application 150 for drawing of frame data.
  • the BPA 100 may be configured to create a drawing buffer 210 that is local to the BPA 100 . In some embodiments, this drawing buffer 210 may be unallocated at the time of creation by the BPA 100 . In some such embodiments, the BPA 100 may create the drawing buffer 210 as a drawing buffer reference 220 , which may later be allocated in device memory 160 , such as described herein.
  • the BPA 100 may be configured to create the drawing buffer 210 within a queue of drawing buffers 212 , as may be understood.
  • the BPA 100 may be configured to dequeue the drawing buffer 210 after creation (as well as prior to allocation) so that it may not be utilized by the BPA 100 or other processes of the host OS 120 for display to any display of the computing device 105 .
  • the BPA 100 may cause allocation of the drawing buffer 210 by sending the drawing buffer reference 220 to the emulator helper 230 , which may be executing in the same process as the BPA 100 .
  • the emulator helper 230 may, in turn, send the drawing buffer reference 220 to the emulator service 240 , which may be configured to allocate memory to the drawing buffer 210 , as illustrated.
  • the emulator service 240 may be configured in turn, to provide the now-allocated drawing buffer 210 to the guest application 150 .
  • the drawing buffer 210 may be provided to the guest application 150 as a standard video graphics array (“VGA”) buffer, as may be understood.
  • VGA video graphics array
  • the drawing buffer 210 is illustrated in the guest application 150 with a dotted line, to illustrate that while the drawing buffer 210 is perceived as a local buffer by the guest application 150 , the drawing buffer was created by and is directly accessible to, the BPA 100 .
  • the guest application 150 may proceed with drawing frame data to the drawing buffer 210 .
  • This frame data may then be accessible to the BPA 100 , and thus to other processes of the host OS 120 on the computing device 105 .
  • the BPA 100 may be configured to enqueue the (now allocated) drawing buffer 210 .
  • this enqueued buffer which appears to the computing device as a host OS 120 application drawing buffer, may then be used by the host OS to display frame data from the guest application 150 .
  • FIG. 3 illustrates an example illustration of drawing data composition, in accordance with various embodiments.
  • the techniques illustrated in FIG. 3 may be utilized to combine frame data from an application, and in particular the guest application 150 , with other frame data, such as host OS 120 drawing data.
  • the guest application 150 may draw to the drawing buffer 210 (again, illustrated with a dotted line) in order to draw an application screen 310 associated with the guest application 150 .
  • This application screen 310 may thus be drawn to a drawing buffer available to the host OS 120 , as discussed above.
  • the host OS 120 may additionally have access to various OS-associated drawing data, such as a status bar 340 , a control bar 330 , and a background 320 .
  • the host OS 120 may utilize this drawing data to display host OS 120 user interface elements and functionality.
  • FIG. 3 illustrates, through the use of the BPA 100 , the application screen 310 of the guest application 150 may be available just as drawing data of the host OS 120 is, and thus the application screen 310 may be composited with the host OS drawing data.
  • various techniques may be utilized for compositing the application screen 310 of the guest application 150 with the drawing data of the host OS 120 .
  • these techniques may include drawing data composition techniques utilized in various implementations of AndroidTM OSes.
  • the host OS 120 may utilize the SWC 130 to composite the host OS 120 drawing data, including the status bar 340 , control bar 330 , and background 320 , into a frame buffer 3260 , where they may exist as screen data 325 .
  • the computing device 105 under control of the host OS 120 , may copy the screen data 325 (as a copy 328 ) to a display buffer 350 , from which the display 110 may directly render a screen.
  • the computing device 105 may also directly composite the application screen 315 from the drawing buffer 210 as a copy 318 over the copy of the screen data 318 .
  • the BPA 100 may provide for faster and more efficient provisioning of the application screen to the display buffer 350 , and thus to the display 110 of the computing device 105 .
  • FIG. 4 illustrates an example process 400 for a buffer provision application facilitating display of guest applications in a host OS in accordance with various embodiments. While FIG. 4 illustrates particular operations in a particular order, in various embodiments the operations may be combined, split into parts, and/or omitted. In various embodiments, operations of process 400 (as well as sub-processes) may be performed by one or more of the BPA 100 , SWC 130 , and/or HWC 140 . In other embodiments, operations may be performed by different entities than those illustrated. The process may begin at operation 410 , where the BPA 100 may create a drawing buffer 210 .
  • the created drawing buffer 210 may include only a drawing buffer reference 220 at the time of creation, while in other embodiments the created drawing buffer 210 may be allocated by the BPA 100 at the time of creation.
  • the BPA 100 may dequeue the drawing buffer 210 from the drawing buffer queue 212 .
  • the BPA 100 may provide the buffer to the guest application 150 , in order that the guest application 150 may utilize the drawing buffer 210 for drawing frame data. Particular embodiments of operation 430 are described below with reference to process 500 of FIG. 5 .
  • the BPA 100 may enqueue the drawing buffer which may have been allocated during operation 430 if it was not allocated prior.
  • the guest application 150 may cause its frame data to be rendered so that its application screen 310 may be rendered. Particular embodiments of operation 450 are described below with reference to process 600 of FIG. 6 . The process may then end.
  • FIG. 5 illustrates an example process 500 for the buffer provision application 100 to provide a drawing buffer 210 to the guest application 150 in accordance with various embodiments. While FIG. 5 illustrates particular operations in a particular order, in various embodiments the operations may be combined, split into parts, and/or omitted. In various embodiments, operations of process 500 (as well as sub-processes) may be performed by one or more of the BPA 100 , emulator helper 230 , emulator service 240 , and/or emulator 260 . In other embodiments, operations may be performed by different entities than those illustrated. The process may begin at operation 510 , where the BPA 100 may send the drawing buffer reference 220 to the emulator helper 230 which may be executing in the same process as the BPA 100 .
  • the drawing buffer 210 that is referred to by the drawing buffer reference 220 may or may not be allocated during performance of operation 510 .
  • the emulator helper 230 may provide the drawing buffer reference 220 to the emulator service 240 , which may be executing in a different process than the emulator helper 230 and BPA 100 .
  • the emulator helper 230 may send the drawing buffer reference 220 to the emulator service 240 through a binding, as may be understood.
  • the emulator service 240 may allocate the drawing buffer 210 in device memory 160 at a particular memory address. In various embodiments, various known techniques may be utilized for performing this allocation, as may be understood. In embodiments where the BPA 100 (or other entity) previously allocated the drawing buffer 210 , no allocation may be performed at operation 530 .
  • the emulator service 240 may provide the address for the allocated buffer to the emulator 260 . The emulator 260 may then, in turn, provide the allocated buffer to the guest application as a standard VGA frame buffer, through which the guest application 150 may draw frame data. The process may then end.
  • FIG. 6 illustrates an example process 600 for a guest screen to be rendered in accordance with various embodiments. While FIG. 6 illustrates particular operations in a particular order, in various embodiments the operations may be combined, split into parts, and/or omitted. In various embodiments, operations of process 600 (as well as sub-processes) may be performed by one or more of the SWC 130 and/or HWC 140 . In other embodiments, operations may be performed by different entities than those illustrated or may be performed entirely in software or hardware.
  • the process may begin at operation 610 , where the host OS 120 may draw host OS 120 drawing data to one or more host OS 120 drawing buffers (not illustrated). Next, at operation 620 , the SWC may composite the host OS 120 drawing buffers at the frame buffer 360 , as discussed above.
  • the guest application 150 may draw frame data to the drawing buffer 210 as if it were a VGA buffer that was local to the guest application 150 .
  • the HWC 140 may composite the frame data from the drawing buffer 120 with the data from the frame buffer 360 into the display buffer 350 .
  • the contents of the display buffer 350 may be rendered on the display 110 of the computing device 105 .
  • the process may then repeat at operation 310 as the host OS 120 and the guest application 150 continue to generate new frames of graphical data. It may be recognized that, while particular techniques for rendering guest application 150 frame data and host OS 120 drawing data are illustrated, in other embodiments, other rendering techniques may be utilized.
  • computer 700 may include one or more processors or processor cores 702 , and system memory 704 .
  • processors or processor cores 702 may be considered synonymous, unless the context clearly requires otherwise.
  • computer 700 may include mass storage devices 706 (such as diskette, hard drive, compact disc read only memory (CD-ROM) and so forth), input/output devices 708 (such as display, keyboard, cursor control, remote control, gaming controller, image capture device, and so forth) and communication interfaces 710 (such as network interface cards, modems, infrared receivers, radio receivers (e.g., Bluetooth, WiFi, Near Field Communications, Radio-frequency identification, and so forth).
  • the elements may be coupled to each other via system bus 712 , which may represent one or more buses. In the case of multiple buses, they may be bridged by one or more bus bridges (not shown).
  • system memory 704 and mass storage devices 706 may be employed to store a working copy and a permanent copy of the programming instructions implementing one or more of the modules shown in FIGS. 1-3 , and/or the operations associated with techniques shown in FIGS. 4-6 , collectively referred to as computing logic 722 .
  • the various elements may be implemented by assembler instructions supported by processor(s) 702 or high-level languages, such as, for example, C, that can be compiled into such instructions.
  • the permanent copy of the programming instructions may be placed into permanent storage devices 706 in the factory, or in the field, through, for example, a distribution medium (not shown), such as a compact disc (CD), or through communication interface 710 (from a distribution server (not shown)). That is, one or more distribution media having an implementation of the agent program may be employed to distribute the agent and program various computing devices.
  • the programming instructions may be stored in one or more computer readable non-transitory storage media.
  • the programming instructions may be encoded in transitory storage media, such as signals.
  • FIG. 8 illustrates an example least one computer-readable storage medium 802 having instructions configured to practice all or selected ones of the operations associated with the techniques earlier described, in accordance with various embodiments.
  • least one computer-readable storage medium 802 may include a number of programming instructions 804 .
  • Programming instructions 804 may be configured to enable a device, e.g., computer 700 , in response to execution of the programming instructions, to perform, e.g., various operations of processes of FIGS. 4-6 , e.g., but not limited to, to the various operations performed to perform facilitation of drawing of guest application frame data.
  • programming instructions 804 may be disposed on multiple least one computer-readable storage media 802 instead.
  • processors 702 may be packaged together with computational logic 722 configured to practice aspects of processes of FIGS. 4-6 .
  • at least one of processors 702 may be packaged together with computational logic 722 configured to practice aspects of processes of FIGS. 4-6 to form a System in Package (SiP).
  • SiP System in Package
  • at least one of processors 702 may be integrated on the same die with computational logic 722 configured to practice aspects of processes of FIGS. 4-6 .
  • processors 702 may be packaged together with computational logic 722 configured to practice aspects of processes of FIGS. 4-6 to form a System on Chip (SoC).
  • SoC System on Chip
  • the SoC may be utilized in, e.g., but not limited to, a computing tablet.
  • a computing tablet e.g., WiFi, Blue Tooth, Blue Tooth Low Energy, Near Field Communications, Radio-frequency identification (RFID), etc.
  • RFID Radio-frequency identification
  • Computer-readable media including at least one computer-readable media
  • methods, apparatuses, systems and devices for performing the above-described techniques are illustrative examples of embodiments disclosed herein. Additionally, other devices in the above-described interactions may be configured to perform various disclosed techniques. Particular examples of embodiments, described herein include, but are not limited to, the following:
  • Example 1 includes an apparatus to facilitate display of a guest application running in a guest operating system.
  • the apparatus includes: one or more computing processors; a host operating system to be operated on the computing processors and a buffer provision application, to be operated within the host operating system.
  • the buffer provision application is to cause allocation of a drawing buffer within the host operating system for use by the guest application and provide the drawing buffer for use by the guest application to draw one or more user interface elements.
  • Example 2 includes the apparatus of example 1, further including an emulator to be operated by the one or more processors to facilitate execution of the guest application within the host operating system.
  • Example 3 includes the apparatus of example 2, wherein the buffer provision application to provide the drawing buffer to the emulator.
  • Example 4 includes the apparatus of example 3, wherein the emulator is further to provide the drawing buffer to the guest application as a buffer in an execution in the guest operating system .
  • Example 5 includes the apparatus of any of examples 1-4, wherein the buffer provision application to provide a reference to the drawing buffer.
  • Example 6 includes the apparatus of any of examples 1-4, wherein the buffer provision application to provide a drawing buffer that can be directly written into by the guest application.
  • Example 7 includes the apparatus of any of examples 1-4, wherein the buffer provision application to dequeue the drawing buffer from a buffer queue, the drawing buffer being available to the buffer provision application.
  • Example 8 includes the apparatus of example 7, wherein the buffer provision application is further to enqueue the drawing buffer to the buffer queue after provision of the drawing buffer to the guest application.
  • Example 9 includes the apparatus of any of examples 1-4, wherein the host operating system is the Android operating system.
  • Example 10 includes the apparatus of example 9, wherein the guest operating system is a Windows operating system.
  • Example 11 includes a method for facilitating display of a guest application running in a guest operating system.
  • the method includes causing, by a buffer provision application of a computing device, allocation of a drawing buffer within a host operating system for use by a guest application and providing, by the buffer provision application, the drawing buffer for use by the guest application to draw one or more user interface elements.
  • Example 12 includes the method of example 11, further including facilitating, by an emulator of the computing device, execution of the guest application within the host operating system.
  • Example 13 includes the method of example 12, wherein providing the drawing buffer includes providing the drawing buffer to the emulator.
  • Example 14 includes the method of example 13, wherein providing the drawing buffer includes the emulator providing the drawing buffer to the guest application as a buffer in an execution in the guest operating system .
  • Example 15 includes the method of any of examples 11-14, wherein providing the drawing buffer includes providing a reference to the drawing buffer.
  • Example 16 includes the method of any of examples 11-14, wherein providing the drawing buffer includes providing the drawing buffer to be directly written into by the guest application.
  • Example 17 includes the method of any of examples 11-14, wherein causing allocation of the drawing buffer includes dequeuing a drawing buffer from a buffer queue available to the buffer provision application.
  • Example 18 includes the method of example 17, further including enqueuing, by the buffer provision application or an emulator service of the computing device, the drawing buffer to the buffer queue after provision of the drawing buffer to the guest application.
  • Example 19 includes the method of any of examples 11-14, wherein the host operating system is the Android operating system.
  • Example 20 includes the method of example 19, wherein the guest operating system is a Windows operating system.
  • Example 21 includes one or more computer-readable media containing instructions written thereon for facilitating display of a guest application running in a guest operating system.
  • the instructions are to, in response to execution on a computing device, cause the computing device to cause allocation of a drawing buffer within a host operating system for use by a guest application and provide the drawing buffer for use by the guest application to draw one or more user interface elements.
  • Example 22 includes the computer-readable media of example 21, wherein the instructions are further to cause the computing device to facilitate execution of the guest application within the host operating system using an emulator.
  • Example 23 includes the computer-readable media of example 22, wherein provide the drawing buffer includes provide the drawing buffer to the emulator.
  • Example 24 includes the computer-readable media of example 23, wherein provide the drawing buffer includes the provide, using the emulator, the drawing buffer to the guest application as a buffer in an execution in the guest operating system .
  • Example 25 includes the computer-readable media of any of examples 21-24, wherein provide the drawing buffer includes provide a reference to the drawing buffer.
  • Example 26 includes the computer-readable media of any of examples 21-24, wherein provide the drawing buffer includes provide the drawing buffer to be directly written into by the guest application.
  • Example 27 includes the computer-readable media of any of examples 21-24, wherein cause allocation of the drawing buffer includes dequeue a drawing buffer from a buffer queue.
  • Example 28 includes the computer-readable media of example 27, wherein the instructions are further to cause the computing device to enqueue the drawing buffer to the buffer queue after provision of the drawing buffer to the guest application.
  • Example 29 includes the computer-readable media of any of examples 21-24, wherein the host operating system is the Android operating system.
  • Example 30 includes the computer-readable media of example 29, wherein the guest operating system is a Windows operating system.
  • Example 31 includes an apparatus to facilitate display of a guest application running in a guest operating system.
  • the apparatus includes means for causing allocation of a drawing buffer within a host operating system for use by a guest application and means for providing the drawing buffer for use by the guest application to draw one or more user interface elements.
  • Example 32 includes the apparatus of example 31, further including means for facilitating execution of the guest application within the host operating system.
  • Example 33 includes the apparatus of example 32, wherein means for providing the drawing buffer includes means for providing the drawing buffer to the emulator.
  • Example 34 includes the apparatus of example 33, wherein means for providing the drawing buffer includes means for providing the drawing buffer to the guest application as a buffer in an execution in the guest operating system .
  • Example 35 includes the apparatus of any of examples 31-34, wherein means for providing the drawing buffer includes means for providing a reference to the drawing buffer.
  • Example 36 includes the apparatus of any of examples 31-34, wherein means for providing the drawing buffer includes means for providing the drawing buffer to be directly written into by the guest application.
  • Example 37 includes the apparatus of any of examples 31-34, wherein means for causing allocation of the drawing buffer includes means for dequeuing a drawing buffer from a buffer queue.
  • Example 38 includes the apparatus of example 37, further including means for enqueuing the drawing buffer to the buffer queue after provision of the drawing buffer to the guest application.
  • Example 39 includes the apparatus of any of examples 31-34, wherein the host operating system is the Android operating system.
  • Example 40 includes the apparatus of example 39, wherein the guest operating system is a Windows operating system.

Abstract

Apparatuses, methods, and computer-readable media for buffer provision application (“BFA”) are described. The BPA may facilitate display of a guest application executing in a host operating system (“host OS”). The host OS may provide for execution of a guest application, such as through use of an emulator configured to emulate a guest OS environment. The BFA may provide a drawing buffer for use by the guest application. The drawing buffer may be caused to be allocated within the host OS by the BFA. The BFA may then cause the allocated buffer to be provided to the guest application so that the guest application may draw frame data directly to the drawing buffer. The BFA may then facilitate access to the drawing buffer by the host OS when compositing drawing buffer data with other drawing data of the host OS. Other embodiments may be described and claimed.

Description

    TECHNICAL FIELD
  • The present disclosure relates to the field of data processing, in particular, to apparatuses, methods and storage media associated with facilitating display of guest applications in a host operating system.
  • BACKGROUND
  • The background description provided herein is for the purpose of generally presenting the context of the disclosure. Unless otherwise indicated herein, the materials described in this section are not prior art to the claims in this application and are not admitted to be prior art by inclusion in this section.
  • Many computing device environments, for example, mobile devices, offer the ability to execute applications. In many devices, the device runs a particular operating system (“OS”) and execution environment and allows execution of applications that are made for that OS and environment. However, in some scenarios, users of these devices may wish to execute applications that were developed to execute in different environments and/or under differed OSes. For example, a user of a mobile phone executing under a version of the Android® OS may, in some circumstances, wish to execute a guest application that was not originally written to operate on an Android device, such as a Windows® application.
  • These guest applications may, in some scenarios, be executed within an emulator that allows the guest application to execute as if it were executing in its expected OS and environment. However, there may be difficulties experienced when attempting to allow the guest application to draw to a screen of the computing device. In various scenarios, because the guest application is not running under the host OS of the computing device, the computing device may find it difficult to obtain access to screen produced by the guest application in order to draw them on the device.
  • In some techniques, a memory copy scheme is used to get past these limitations. In many situations, the host OS may utilize two buffers, a front buffer and a back buffer, allow drawing of guest application frames on the back buffer, and switch between the two when the drawing of each frame is complete. However, the host OS may not know when drawing of a frame is complete, because the guest application is performing its drawing within an emulated environment (and does not necessarily know that the host operating system is waiting for a completed frame). Thus, the host OS may, in some scenarios, periodically poll the guest application to determine when a frame is complete. Upon such indication, the host OS may then perform a copy of the guest application's local drawing buffer to the host OS's back buffer, and then perform a buffer switch to allow the guest-application-drawn frame to appear on the screen of the computing device. However, while this technique may provide for the guest application to draw to the computing device screen, the polling and copying of drawing buffer memory introduce substantial processing costs that are undesirable.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Embodiments will be readily understood by the following detailed description in conjunction with the accompanying drawings. To facilitate this description, like reference numerals designate like structural elements. Embodiments are illustrated by way of example, and not by way of limitation, in the Figures of the accompanying drawings.
  • FIG. 1 illustrates an example arrangement for a computing device configured to facilitate display of guest applications in a host OS in accordance with various embodiments.
  • FIG. 2 illustrates an example arrangement for a buffer provision application facilitating display of guest applications in the host OS in accordance with various embodiments.
  • FIG. 3 illustrates an example illustration of drawing buffer composition, in accordance with various embodiments.
  • FIG. 4 illustrates an example process for a buffer provision application facilitating display of guest applications in a host OS in accordance with various embodiments.
  • FIG. 5 illustrates an example process for the buffer provision application providing a buffer to a guest application in accordance with various embodiments.
  • FIG. 6 illustrates an example process for a guest screen to be rendered in accordance with various embodiments.
  • FIG. 7 illustrates an example computing environment suitable for practicing various aspects of the present disclosure in accordance with various embodiments.
  • FIG. 8 illustrates an example storage medium with instructions configured to enable an apparatus to practice various aspects of the present disclosure in accordance with various embodiments.
  • DETAILED DESCRIPTION
  • In the following detailed description, reference is made to the accompanying drawings which form a part hereof wherein like numerals designate like parts throughout, and in which is shown by way of illustration embodiments that may be practiced. It is to be understood that other embodiments may be utilized and structural or logical changes may be made without departing from the scope of the present disclosure. Therefore, the following detailed description is not to be taken in a limiting sense, and the scope of embodiments is defined by the appended claims and their equivalents.
  • Various operations may be described as multiple discrete actions or operations in turn, in a manner that is most helpful in understanding the claimed subject matter. However, the order of description should not be construed as to imply that these operations are necessarily order dependent. In particular, these operations may not be performed in the order of presentation. Operations described may be performed in a different order than the described embodiment. Various additional operations may be performed and/or described operations may be omitted in additional embodiments.
  • For the purposes of the present disclosure, the phrase “A and/or B” means (A), (B), or (A and B). For the purposes of the present disclosure, the phrase “A, B, and/or C” means (A), (B), (C), (A and B), (A and C), (B and C), or (A, B and C).
  • The description may use the phrases “in an embodiment,” or “in embodiments,” which may each refer to one or more of the same or different embodiments. Furthermore, the terms “comprising,” “including,” “having,” and the like, as used with respect to embodiments of the present disclosure, are synonymous.
  • As used herein, the term “logic” and “module” may refer to, be part of, or include an Application Specific Integrated Circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and/or memory (shared, dedicated, or group) that execute one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality. As described herein, the term “logic” and “module” may refer to, be part of, or include a System on a Chip, as described below.
  • In various embodiments, a buffer provision application (“BFA”) may be configured to facilitate display of a guest application executing in a host operating system (“host OS”). In various embodiments, a host operating system may operate on a computing device and allow for the execution of applications. In various embodiments, a guest application may be configured to execute in a guest operating system (“guest OS”) other than the host OS. The host OS may provide for execution of the guest application, such as through use of an emulator configured to emulate a guest OS environment for the guest application. In various embodiments, the BFA may be configured to provide a drawing buffer for use by the guest application. The drawing buffer may, in various embodiments, be caused to be allocated within the host OS by the BFA (or by a helper application of the BFA). The BFA may then cause the allocated buffer to be provided to the guest application so that the guest application may draw frame data directly to the drawing buffer. Because the drawing buffer was allocated to be available and known to the BFA, however, the BFA may then facilitate access to the drawing buffer by the host OS when compositing drawing buffer data with other drawing data of the host OS. In various embodiments, by performing this allocation and provision of the drawing buffer, a need for the overhead issues discussed above may be reduced. In particular, the BFA may reduce a need for polling of the guest application to determine when frames are drawn and/or copying of frame data from a drawing buffer of the guest application. Particular non-limiting embodiments and implementation examples are provided below.
  • Referring now to FIG. 1, an example arrangement for a computing device 105 configured to facilitate display of a guest application 150 in accordance with various embodiments. In various embodiments, the computing device 105 may include various types of computing device, including, but not limited to, mobile devices, mobile phones, laptop computers, desktop computers, embedded systems, etc. The computing device 105 may include device memory 160, which may include various types of removable or permanent memory (or storage) as may be understood. A host OS 120 may execute from within the device memory 160. The host OS 120 may, in some embodiments, be a version of the Android™ operating system, but in various embodiments, may include, but is not limited to, other operating systems configured to operate on mobile or non-mobile computing devices, such as iOS™, Windows™, Fire OS™, and other OSes. In various embodiments, the host OS 120 may be configured to support execution of one or more applications, such as a buffer provision application 150 (“BPA 150”), which may be configured to facilitate display of guest application 150 in the host OS 120, as described herein. The host OS 120 may also be configured to support execution of a software compositor application 130 (“SWC 130”) which may be configured to perform composition of drawing data, as described herein. Particular activities of the BPA 150 and SWC 130 are described below.
  • The computing device 105 may also include a guest application 150. In various embodiments, the guest application 150 may be configured to execute on a different operating system than the host OS 120. For example, in some embodiments, the guest application 150 may be an application configured to execute in a Windows™ operating system. Additionally, in various embodiments, the computing device 105 may include hardware logic for performing one or more techniques described herein. In particular, the host OS 20 may include a hardware compositor 140 (“HWC 140”) which may be configured to perform composition of drawing data, as described herein. It may be noted that, while particular features are illustrated in the examples herein as being performed by hardware and/or software, these are merely provided as examples and should not necessarily be read as requiring any particular locus for embodiments described herein.
  • Referring now to FIG. 2, an example arrangement for the BPA 100 facilitating display of guest applications in the host OS 120 is illustrated in accordance with various embodiments. In various embodiments, the BPA 100 may be configured to operate alongside other applications 105, on the computing device 105. In some embodiments, the guest application 150 and the BPA 100 may be implemented in different programming languages. For example, in the example illustrated in FIG. 1, the host OS may be the Android™ OS with the BPA 100 implemented in Java™, while the guest application may be a Windows™ application implemented in C++. In other implementations, different programming languages may be utilized while incorporating aspects of embodiments described herein; further, in some embodiments, the BPA 100 and guest application 150 may be implemented, in whole or in part, utilizing the same programming language. The particular OS and programming language examples described herein with reference to FIG. 1 are therefore provided as such, as examples, and no particular implementation is thus intended.
  • In various embodiments, the BPA 100 may be configured to execute in a different process that the guest application 150, as illustrated. In various embodiments, while the term “process” is utilized herein, such usage may include various techniques for operation of separate applications executing on a computing device, including, but not limited to, separate processes, threads, methods, operation on separate processors, operation on separate processor cores, etc. Additionally, in various embodiments, the guest application 150 and BPA 100 may execute, in whole or in part, on a common thread or process. In various embodiments, such as illustrated in FIG. 1, the guest application 150 may execute on the computing device as facilitated by an emulator 260. The emulator 260 may, in various embodiments, be configured to provide the guest application 150 with an environment in which to execute that appears to the guest application 150 to be a guest OS (other than the host OS 120) in which the guest application is configured to execute, as may be understood. In various embodiments, the emulator 260 may be configured interoperate with host OS 120 applications through the use of an emulator service 240, which may include an application or other code that may be configured to execute in the same process as the guest application 150. In some embodiments, the emulator service 240 may be configured to allocate memory out of the device memory 160 within the host OS 120 for use by the emulator 260. In some embodiments, the emulator 160 may provide this memory to the guest application 150 for the guest application 150 to use as if it were guest OS memory. In various embodiments, other memory allocation methods may be utilized to provide memory for usage by the guest application 150, as may be understood. Additionally, in various embodiments, the BPA 100 may be configured to interoperate with a emulator helper 230, which may include an application or other code that may be configured to bind to the emulator service 240 to allow for the provision of data or other information to the emulator 260.
  • In various embodiments, the guest application 150 may be configured to draw one or more graphical frames of frame data to a drawing buffer in order to provide a graphical interface to a user of the computing device 105. In various embodiments the BPA 100 may be configured to cause allocation of a drawing buffer 210 and to provide that drawing buffer 210 to the guest application 150 for drawing of frame data. In various embodiments, the BPA 100 may be configured to create a drawing buffer 210 that is local to the BPA 100. In some embodiments, this drawing buffer 210 may be unallocated at the time of creation by the BPA 100. In some such embodiments, the BPA 100 may create the drawing buffer 210 as a drawing buffer reference 220, which may later be allocated in device memory 160, such as described herein. In various embodiments, the BPA 100 may be configured to create the drawing buffer 210 within a queue of drawing buffers 212, as may be understood. The BPA 100 may be configured to dequeue the drawing buffer 210 after creation (as well as prior to allocation) so that it may not be utilized by the BPA 100 or other processes of the host OS 120 for display to any display of the computing device 105.
  • In various embodiments, the BPA 100 may cause allocation of the drawing buffer 210 by sending the drawing buffer reference 220 to the emulator helper 230, which may be executing in the same process as the BPA 100. The emulator helper 230 may, in turn, send the drawing buffer reference 220 to the emulator service 240, which may be configured to allocate memory to the drawing buffer 210, as illustrated. The emulator service 240 may be configured in turn, to provide the now-allocated drawing buffer 210 to the guest application 150. For example if the guest application 150 is a Windows™ application, the drawing buffer 210 may be provided to the guest application 150 as a standard video graphics array (“VGA”) buffer, as may be understood. For the purposes of clearer illustration, the drawing buffer 210 is illustrated in the guest application 150 with a dotted line, to illustrate that while the drawing buffer 210 is perceived as a local buffer by the guest application 150, the drawing buffer was created by and is directly accessible to, the BPA 100.
  • At the time of provision of the drawing buffer 210 to the guest application 150, the guest application 150 may proceed with drawing frame data to the drawing buffer 210. This frame data may then be accessible to the BPA 100, and thus to other processes of the host OS 120 on the computing device 105. Thus, the BPA 100 may be configured to enqueue the (now allocated) drawing buffer 210. In various embodiments, this enqueued buffer, which appears to the computing device as a host OS 120 application drawing buffer, may then be used by the host OS to display frame data from the guest application 150.
  • FIG. 3 illustrates an example illustration of drawing data composition, in accordance with various embodiments. In various embodiments, the techniques illustrated in FIG. 3 may be utilized to combine frame data from an application, and in particular the guest application 150, with other frame data, such as host OS 120 drawing data. Thus, as illustrated in FIG. 3, the guest application 150 may draw to the drawing buffer 210 (again, illustrated with a dotted line) in order to draw an application screen 310 associated with the guest application 150. This application screen 310 may thus be drawn to a drawing buffer available to the host OS 120, as discussed above. Additionally, the host OS 120 may additionally have access to various OS-associated drawing data, such as a status bar 340, a control bar 330, and a background 320. In various embodiments the host OS 120 may utilize this drawing data to display host OS 120 user interface elements and functionality. As FIG. 3 illustrates, through the use of the BPA 100, the application screen 310 of the guest application 150 may be available just as drawing data of the host OS 120 is, and thus the application screen 310 may be composited with the host OS drawing data.
  • In various embodiments, various techniques may be utilized for compositing the application screen 310 of the guest application 150 with the drawing data of the host OS 120. In some embodiments, these techniques may include drawing data composition techniques utilized in various implementations of Android™ OSes. In various embodiments, the host OS 120 may utilize the SWC 130 to composite the host OS 120 drawing data, including the status bar 340, control bar 330, and background 320, into a frame buffer3260, where they may exist as screen data 325. Next, using the HWC 140, the computing device 105, under control of the host OS 120, may copy the screen data 325 (as a copy 328) to a display buffer 350, from which the display 110 may directly render a screen. The computing device 105 may also directly composite the application screen 315 from the drawing buffer 210 as a copy 318 over the copy of the screen data 318. In various embodiments, by providing the application screen 310 for direct, hardware-based composition with host OS screen data 325, the BPA 100 may provide for faster and more efficient provisioning of the application screen to the display buffer 350, and thus to the display 110 of the computing device 105.
  • FIG. 4 illustrates an example process 400 for a buffer provision application facilitating display of guest applications in a host OS in accordance with various embodiments. While FIG. 4 illustrates particular operations in a particular order, in various embodiments the operations may be combined, split into parts, and/or omitted. In various embodiments, operations of process 400 (as well as sub-processes) may be performed by one or more of the BPA 100, SWC 130, and/or HWC 140. In other embodiments, operations may be performed by different entities than those illustrated. The process may begin at operation 410, where the BPA 100 may create a drawing buffer 210. In various embodiments, the created drawing buffer 210 may include only a drawing buffer reference 220 at the time of creation, while in other embodiments the created drawing buffer 210 may be allocated by the BPA 100 at the time of creation. Next, at operation 420, the BPA 100 may dequeue the drawing buffer 210 from the drawing buffer queue 212.
  • At operation 430, the BPA 100 may provide the buffer to the guest application 150, in order that the guest application 150 may utilize the drawing buffer 210 for drawing frame data. Particular embodiments of operation 430 are described below with reference to process 500 of FIG. 5. Next, at operation 440, the BPA 100 may enqueue the drawing buffer which may have been allocated during operation 430 if it was not allocated prior. Next, at operation 450, the guest application 150 may cause its frame data to be rendered so that its application screen 310 may be rendered. Particular embodiments of operation 450 are described below with reference to process 600 of FIG. 6. The process may then end.
  • FIG. 5 illustrates an example process 500 for the buffer provision application 100 to provide a drawing buffer 210 to the guest application 150 in accordance with various embodiments. While FIG. 5 illustrates particular operations in a particular order, in various embodiments the operations may be combined, split into parts, and/or omitted. In various embodiments, operations of process 500 (as well as sub-processes) may be performed by one or more of the BPA 100, emulator helper 230, emulator service 240, and/or emulator 260. In other embodiments, operations may be performed by different entities than those illustrated. The process may begin at operation 510, where the BPA 100 may send the drawing buffer reference 220 to the emulator helper 230 which may be executing in the same process as the BPA 100. In various embodiments, the drawing buffer 210 that is referred to by the drawing buffer reference 220 may or may not be allocated during performance of operation 510. Next, at operation 520, the emulator helper 230 may provide the drawing buffer reference 220 to the emulator service 240, which may be executing in a different process than the emulator helper 230 and BPA 100. In various embodiments, the emulator helper 230 may send the drawing buffer reference 220 to the emulator service 240 through a binding, as may be understood.
  • Next, at operation 530, the emulator service 240 may allocate the drawing buffer 210 in device memory 160 at a particular memory address. In various embodiments, various known techniques may be utilized for performing this allocation, as may be understood. In embodiments where the BPA 100 (or other entity) previously allocated the drawing buffer 210, no allocation may be performed at operation 530. Next, at operation 540, the emulator service 240 may provide the address for the allocated buffer to the emulator 260. The emulator 260 may then, in turn, provide the allocated buffer to the guest application as a standard VGA frame buffer, through which the guest application 150 may draw frame data. The process may then end.
  • FIG. 6 illustrates an example process 600 for a guest screen to be rendered in accordance with various embodiments. While FIG. 6 illustrates particular operations in a particular order, in various embodiments the operations may be combined, split into parts, and/or omitted. In various embodiments, operations of process 600 (as well as sub-processes) may be performed by one or more of the SWC 130 and/or HWC 140. In other embodiments, operations may be performed by different entities than those illustrated or may be performed entirely in software or hardware. The process may begin at operation 610, where the host OS 120 may draw host OS 120 drawing data to one or more host OS 120 drawing buffers (not illustrated). Next, at operation 620, the SWC may composite the host OS 120 drawing buffers at the frame buffer 360, as discussed above. Next at operation 630, the guest application 150 may draw frame data to the drawing buffer 210 as if it were a VGA buffer that was local to the guest application 150. Next, at operation 640, the HWC 140 may composite the frame data from the drawing buffer 120 with the data from the frame buffer 360 into the display buffer 350. Next, at operation 650, the contents of the display buffer 350 may be rendered on the display 110 of the computing device 105. The process may then repeat at operation 310 as the host OS 120 and the guest application 150 continue to generate new frames of graphical data. It may be recognized that, while particular techniques for rendering guest application 150 frame data and host OS 120 drawing data are illustrated, in other embodiments, other rendering techniques may be utilized.
  • Referring now to FIG. 7, an example computer suitable for practicing various aspects of the present disclosure, including processes of FIGS. 4-6, is illustrated in accordance with various embodiments. As shown, computer 700 may include one or more processors or processor cores 702, and system memory 704. For the purpose of this application, including the claims, the terms “processor” and “processor cores” may be considered synonymous, unless the context clearly requires otherwise. Additionally, computer 700 may include mass storage devices 706 (such as diskette, hard drive, compact disc read only memory (CD-ROM) and so forth), input/output devices 708 (such as display, keyboard, cursor control, remote control, gaming controller, image capture device, and so forth) and communication interfaces 710 (such as network interface cards, modems, infrared receivers, radio receivers (e.g., Bluetooth, WiFi, Near Field Communications, Radio-frequency identification, and so forth). The elements may be coupled to each other via system bus 712, which may represent one or more buses. In the case of multiple buses, they may be bridged by one or more bus bridges (not shown).
  • Each of these elements may perform its conventional functions known in the art. In particular, system memory 704 and mass storage devices 706 may be employed to store a working copy and a permanent copy of the programming instructions implementing one or more of the modules shown in FIGS. 1-3, and/or the operations associated with techniques shown in FIGS. 4-6, collectively referred to as computing logic 722. The various elements may be implemented by assembler instructions supported by processor(s) 702 or high-level languages, such as, for example, C, that can be compiled into such instructions.
  • The permanent copy of the programming instructions may be placed into permanent storage devices 706 in the factory, or in the field, through, for example, a distribution medium (not shown), such as a compact disc (CD), or through communication interface 710 (from a distribution server (not shown)). That is, one or more distribution media having an implementation of the agent program may be employed to distribute the agent and program various computing devices. In embodiments, the programming instructions may be stored in one or more computer readable non-transitory storage media. In other embodiments, the programming instructions may be encoded in transitory storage media, such as signals.
  • The number, capability and/or capacity of these elements 710-712 may vary. Their constitutions are otherwise known, and accordingly will not be further described.
  • FIG. 8 illustrates an example least one computer-readable storage medium 802 having instructions configured to practice all or selected ones of the operations associated with the techniques earlier described, in accordance with various embodiments. As illustrated, least one computer-readable storage medium 802 may include a number of programming instructions 804. Programming instructions 804 may be configured to enable a device, e.g., computer 700, in response to execution of the programming instructions, to perform, e.g., various operations of processes of FIGS. 4-6, e.g., but not limited to, to the various operations performed to perform facilitation of drawing of guest application frame data. In alternate embodiments, programming instructions 804 may be disposed on multiple least one computer-readable storage media 802 instead.
  • Referring back to FIG. 7, for one embodiment, at least one of processors 702 may be packaged together with computational logic 722 configured to practice aspects of processes of FIGS. 4-6. For one embodiment, at least one of processors 702 may be packaged together with computational logic 722 configured to practice aspects of processes of FIGS. 4-6 to form a System in Package (SiP). For one embodiment, at least one of processors 702 may be integrated on the same die with computational logic 722 configured to practice aspects of processes of FIGS. 4-6. For one embodiment, at least one of processors 702 may be packaged together with computational logic 722 configured to practice aspects of processes of FIGS. 4-6 to form a System on Chip (SoC). For at least one embodiment, the SoC may be utilized in, e.g., but not limited to, a computing tablet. (e.g., WiFi, Blue Tooth, Blue Tooth Low Energy, Near Field Communications, Radio-frequency identification (RFID), etc.) and other components as necessary to meet functional and non-functional requirements of the system.
  • Computer-readable media (including at least one computer-readable media), methods, apparatuses, systems and devices for performing the above-described techniques are illustrative examples of embodiments disclosed herein. Additionally, other devices in the above-described interactions may be configured to perform various disclosed techniques. Particular examples of embodiments, described herein include, but are not limited to, the following:
  • Example 1 includes an apparatus to facilitate display of a guest application running in a guest operating system. The apparatus includes: one or more computing processors; a host operating system to be operated on the computing processors and a buffer provision application, to be operated within the host operating system. The buffer provision application is to cause allocation of a drawing buffer within the host operating system for use by the guest application and provide the drawing buffer for use by the guest application to draw one or more user interface elements.
  • Example 2 includes the apparatus of example 1, further including an emulator to be operated by the one or more processors to facilitate execution of the guest application within the host operating system.
  • Example 3 includes the apparatus of example 2, wherein the buffer provision application to provide the drawing buffer to the emulator.
  • Example 4 includes the apparatus of example 3, wherein the emulator is further to provide the drawing buffer to the guest application as a buffer in an execution in the guest operating system .
  • Example 5 includes the apparatus of any of examples 1-4, wherein the buffer provision application to provide a reference to the drawing buffer.
  • Example 6 includes the apparatus of any of examples 1-4, wherein the buffer provision application to provide a drawing buffer that can be directly written into by the guest application.
  • Example 7 includes the apparatus of any of examples 1-4, wherein the buffer provision application to dequeue the drawing buffer from a buffer queue, the drawing buffer being available to the buffer provision application.
  • Example 8 includes the apparatus of example 7, wherein the buffer provision application is further to enqueue the drawing buffer to the buffer queue after provision of the drawing buffer to the guest application.
  • Example 9 includes the apparatus of any of examples 1-4, wherein the host operating system is the Android operating system.
  • Example 10 includes the apparatus of example 9, wherein the guest operating system is a Windows operating system.
  • Example 11 includes a method for facilitating display of a guest application running in a guest operating system. The method includes causing, by a buffer provision application of a computing device, allocation of a drawing buffer within a host operating system for use by a guest application and providing, by the buffer provision application, the drawing buffer for use by the guest application to draw one or more user interface elements.
  • Example 12 includes the method of example 11, further including facilitating, by an emulator of the computing device, execution of the guest application within the host operating system.
  • Example 13 includes the method of example 12, wherein providing the drawing buffer includes providing the drawing buffer to the emulator.
  • Example 14 includes the method of example 13, wherein providing the drawing buffer includes the emulator providing the drawing buffer to the guest application as a buffer in an execution in the guest operating system .
  • Example 15 includes the method of any of examples 11-14, wherein providing the drawing buffer includes providing a reference to the drawing buffer.
  • Example 16 includes the method of any of examples 11-14, wherein providing the drawing buffer includes providing the drawing buffer to be directly written into by the guest application.
  • Example 17 includes the method of any of examples 11-14, wherein causing allocation of the drawing buffer includes dequeuing a drawing buffer from a buffer queue available to the buffer provision application.
  • Example 18 includes the method of example 17, further including enqueuing, by the buffer provision application or an emulator service of the computing device, the drawing buffer to the buffer queue after provision of the drawing buffer to the guest application.
  • Example 19 includes the method of any of examples 11-14, wherein the host operating system is the Android operating system.
  • Example 20 includes the method of example 19, wherein the guest operating system is a Windows operating system.
  • Example 21 includes one or more computer-readable media containing instructions written thereon for facilitating display of a guest application running in a guest operating system. The instructions are to, in response to execution on a computing device, cause the computing device to cause allocation of a drawing buffer within a host operating system for use by a guest application and provide the drawing buffer for use by the guest application to draw one or more user interface elements.
  • Example 22 includes the computer-readable media of example 21, wherein the instructions are further to cause the computing device to facilitate execution of the guest application within the host operating system using an emulator.
  • Example 23 includes the computer-readable media of example 22, wherein provide the drawing buffer includes provide the drawing buffer to the emulator.
  • Example 24 includes the computer-readable media of example 23, wherein provide the drawing buffer includes the provide, using the emulator, the drawing buffer to the guest application as a buffer in an execution in the guest operating system .
  • Example 25 includes the computer-readable media of any of examples 21-24, wherein provide the drawing buffer includes provide a reference to the drawing buffer.
  • Example 26 includes the computer-readable media of any of examples 21-24, wherein provide the drawing buffer includes provide the drawing buffer to be directly written into by the guest application.
  • Example 27 includes the computer-readable media of any of examples 21-24, wherein cause allocation of the drawing buffer includes dequeue a drawing buffer from a buffer queue.
  • Example 28 includes the computer-readable media of example 27, wherein the instructions are further to cause the computing device to enqueue the drawing buffer to the buffer queue after provision of the drawing buffer to the guest application.
  • Example 29 includes the computer-readable media of any of examples 21-24, wherein the host operating system is the Android operating system.
  • Example 30 includes the computer-readable media of example 29, wherein the guest operating system is a Windows operating system.
  • Example 31 includes an apparatus to facilitate display of a guest application running in a guest operating system. The apparatus includes means for causing allocation of a drawing buffer within a host operating system for use by a guest application and means for providing the drawing buffer for use by the guest application to draw one or more user interface elements.
  • Example 32 includes the apparatus of example 31, further including means for facilitating execution of the guest application within the host operating system.
  • Example 33 includes the apparatus of example 32, wherein means for providing the drawing buffer includes means for providing the drawing buffer to the emulator.
  • Example 34 includes the apparatus of example 33, wherein means for providing the drawing buffer includes means for providing the drawing buffer to the guest application as a buffer in an execution in the guest operating system .
  • Example 35 includes the apparatus of any of examples 31-34, wherein means for providing the drawing buffer includes means for providing a reference to the drawing buffer.
  • Example 36 includes the apparatus of any of examples 31-34, wherein means for providing the drawing buffer includes means for providing the drawing buffer to be directly written into by the guest application.
  • Example 37 includes the apparatus of any of examples 31-34, wherein means for causing allocation of the drawing buffer includes means for dequeuing a drawing buffer from a buffer queue.
  • Example 38 includes the apparatus of example 37, further including means for enqueuing the drawing buffer to the buffer queue after provision of the drawing buffer to the guest application.
  • Example 39 includes the apparatus of any of examples 31-34, wherein the host operating system is the Android operating system.
  • Example 40 includes the apparatus of example 39, wherein the guest operating system is a Windows operating system.
  • Although certain embodiments have been illustrated and described herein for purposes of description, a wide variety of alternate and/or equivalent embodiments or implementations calculated to achieve the same purposes may be substituted for the embodiments shown and described without departing from the scope of the present disclosure. This application is intended to cover any adaptations or variations of the embodiments discussed herein. Therefore, it is manifestly intended that embodiments described herein be limited only by the claims.
  • Where the disclosure recites “a” or “a first” element or the equivalent thereof, such disclosure includes one or more such elements, neither requiring nor excluding two or more such elements. Further, ordinal indicators (e.g., first, second or third) for identified elements are used to distinguish between the elements, and do not indicate or imply a required or limited number of such elements, nor do they indicate a particular position or order of such elements unless otherwise specifically stated.

Claims (13)

1-32. (canceled)
33. An apparatus for computing, comprising:
a computer processor;
a host operating system to be operated on the computer processor to manage execution of applications;
a guest application designed to be executed under management of another operating system other than the host operating system; and
an emulator to be operated by the computer processor under management of the host operating system, to facilitate execution of the guest application on the apparatus, including access to a frame buffer of the host operating system by the guest application.
34. The apparatus of claim 33, wherein access to a frame buffer of the hosting operating system by the guest application includes access to drawing data in the frame buffer of the host operating system by the guest application to composite an application screen of the guest application.
35. The apparatus of claim 33, wherein the host operating system is the Window operating system.
36. The apparatus of claim 33, wherein the apparatus is a selected one of a mobile device, a mobile phone, a laptop computer, a desktop computer, or an embedded system.
37. A method for computing, comprising:
providing an emulator to supplement a host operating system of a computer system; and
operating the emulator under management of the host operating system, to facilitate executing a guest application on the computer system, including accessing a frame buffer of the host operating system by the guest application;
wherein the guest application is designed to be executed under management of another operating system other than the host operating system.
38. The method of claim 37, wherein accessing a frame buffer of the hosting operating system by the guest application includes accessing drawing data in the frame buffer of the host operating system by the guest application while compositing an application screen of the guest application.
39. The method of claim 37, wherein the host operating system is the Window operating system.
40. The method of claim 37, wherein the computer system is a selected one of a mobile device, a mobile phone, a laptop computer, a desktop computer, or an embedded system.
41. One or more non-transitory computer-readable media (CRM) comprising a plurality of instructions to cause a computer system, in response to execution of the instructions by the computer system, to operate an emulator under management of a host operating system of the computer system, to supplement the host operating system of the computer system, to facilitate execution of a guest application on the computer system;
wherein the guest application is designed to be executed under management of another operating system other than the host operating system; and
wherein to facilitate execution of the guest application on the computer system, includes access of a frame buffer of the host operating system by the guest application.
42. The one or more non-transitory CRM) of claim 41, wherein access of a frame buffer of the hosting operating system by the guest application includes access of drawing data in the frame buffer of the host operating system by the guest application to composite an application screen of the guest application.
43. The one or more non-transitory CRM) of claim 41, wherein the host operating system is the Window operating system.
44. The one or more non-transitory CRM) of claim 41, wherein the computer system is a selected one of a mobile device, a mobile phone, a laptop computer, a desktop computer, or an embedded system.
US15/730,538 2014-09-26 2017-10-11 Facilitation of guest application display from host operating system Abandoned US20180052700A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/730,538 US20180052700A1 (en) 2014-09-26 2017-10-11 Facilitation of guest application display from host operating system

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
PCT/CN2014/087490 WO2016045070A1 (en) 2014-09-26 2014-09-26 Facilitation of guest application display from host operating system
US201514778525A 2015-09-18 2015-09-18
US15/730,538 US20180052700A1 (en) 2014-09-26 2017-10-11 Facilitation of guest application display from host operating system

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
US14/778,525 Continuation US9798562B2 (en) 2014-09-26 2014-09-26 Facilitation of guest application display from host operating system
PCT/CN2014/087490 Continuation WO2016045070A1 (en) 2014-09-26 2014-09-26 Facilitation of guest application display from host operating system

Publications (1)

Publication Number Publication Date
US20180052700A1 true US20180052700A1 (en) 2018-02-22

Family

ID=55580117

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/778,525 Active 2035-05-11 US9798562B2 (en) 2014-09-26 2014-09-26 Facilitation of guest application display from host operating system
US15/730,538 Abandoned US20180052700A1 (en) 2014-09-26 2017-10-11 Facilitation of guest application display from host operating system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US14/778,525 Active 2035-05-11 US9798562B2 (en) 2014-09-26 2014-09-26 Facilitation of guest application display from host operating system

Country Status (4)

Country Link
US (2) US9798562B2 (en)
EP (2) EP3974976A1 (en)
CN (1) CN106575226B (en)
WO (1) WO2016045070A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9582849B2 (en) * 2013-10-28 2017-02-28 Vmware, Inc. Method and system to virtualize graphic processing services
CN109240677B (en) 2017-07-07 2020-10-16 阿里巴巴集团控股有限公司 Layer processing method and device
US11757891B1 (en) * 2019-10-29 2023-09-12 Meta Platforms, Inc. Using a host application to authorize a user of a client device to perform an action within a guest application

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140063028A1 (en) * 2012-05-02 2014-03-06 Nvidia Corporation Memory Space Mapping Techniques for Server Based Graphics Processing
US20150116310A1 (en) * 2013-10-28 2015-04-30 Vmware, Inc. Method and system to virtualize graphic processing services
US20150277861A1 (en) * 2013-12-30 2015-10-01 Unisys Corporation Just-in-time dynamic translation for translation, compilation, and execution of non-native instructions
US9171028B1 (en) * 2013-06-11 2015-10-27 Google Inc. Method of maintaining a large set of taint labels

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9047102B2 (en) * 2010-10-01 2015-06-02 Z124 Instant remote rendering
US7644407B2 (en) * 2004-03-05 2010-01-05 Intel Corporation Method, apparatus and system for seamlessly sharing a graphics device amongst virtual machines
US8117554B1 (en) * 2006-04-25 2012-02-14 Parallels Holdings, Ltd. Seamless integration of non-native widgets and windows with dynamically scalable resolution into native operating system
CN101490648A (en) 2006-07-25 2009-07-22 Nxp股份有限公司 Mobile device comprising an operating system emulator
CN101667123B (en) 2009-09-24 2013-05-08 中兴通讯股份有限公司 Realization method of irregular window and mobile handheld device
CN102135866B (en) * 2010-10-29 2013-07-17 华南理工大学 Display optimization method based on Xen safety computer
TW201301118A (en) * 2011-06-30 2013-01-01 Gcca Inc Cloud-based communication device and smart mobile device using cloud-based communication device
CN103327117B (en) * 2013-07-05 2017-02-08 百度在线网络技术(北京)有限公司 Cross-system running method and device for application programs

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140063028A1 (en) * 2012-05-02 2014-03-06 Nvidia Corporation Memory Space Mapping Techniques for Server Based Graphics Processing
US9171028B1 (en) * 2013-06-11 2015-10-27 Google Inc. Method of maintaining a large set of taint labels
US20150116310A1 (en) * 2013-10-28 2015-04-30 Vmware, Inc. Method and system to virtualize graphic processing services
US20150277861A1 (en) * 2013-12-30 2015-10-01 Unisys Corporation Just-in-time dynamic translation for translation, compilation, and execution of non-native instructions

Also Published As

Publication number Publication date
CN106575226B (en) 2021-04-20
EP3198406A4 (en) 2018-05-30
EP3974976A1 (en) 2022-03-30
EP3198406B1 (en) 2022-02-23
WO2016045070A1 (en) 2016-03-31
CN106575226A (en) 2017-04-19
EP3198406A1 (en) 2017-08-02
US9798562B2 (en) 2017-10-24
US20160291995A1 (en) 2016-10-06

Similar Documents

Publication Publication Date Title
US11386519B2 (en) Container access to graphics processing unit resources
US9459922B2 (en) Assigning a first portion of physical computing resources to a first logical partition and a second portion of the physical computing resources to a second logical portion
EP3161628B1 (en) Intelligent gpu scheduling in a virtualization environment
US20200409732A1 (en) Sharing multimedia physical functions in a virtualized environment on a processing unit
WO2018119951A1 (en) Gpu virtualization method, device, system, and electronic apparatus, and computer program product
US10970129B2 (en) Intelligent GPU scheduling in a virtualization environment
US20080077917A1 (en) Virtual machine system and a method for sharing a graphics card amongst virtual machines
US10275558B2 (en) Technologies for providing FPGA infrastructure-as-a-service computing capabilities
US20180219797A1 (en) Technologies for pooling accelerator over fabric
US8838726B2 (en) Selective use of shared memory for remote desktop application
CN109324903B (en) Display resource scheduling method and device for embedded system
CN103455376A (en) Managing use of a field programmable gate array by multiple processes in an operating system
US10002016B2 (en) Configuration of virtual machines in view of response time constraints
WO2023179388A1 (en) Hot migration method for virtual machine instance
US20180052700A1 (en) Facilitation of guest application display from host operating system
US11954520B2 (en) Micro kernel scheduling method and apparatus
US20170329644A1 (en) Computer-readable recording medium having stored therein program, information processing apparatus, information processing system, and method for processing information
CN113419845A (en) Calculation acceleration method and device, calculation system, electronic equipment and computer readable storage medium
US9176910B2 (en) Sending a next request to a resource before a completion interrupt for a previous request
CN108235822B (en) Virtual SIM card implementation method and device, storage medium and electronic equipment
CN111443983B (en) Application program virtualization method and device, electronic equipment and storage medium
CN115396081A (en) Signal transmission method, signal transmission device, storage medium and electronic equipment

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION