WO2018107354A1

WO2018107354A1 - Display method, apparatus, and electronic device used for multiple operating systems

Info

Publication number: WO2018107354A1
Application number: PCT/CN2016/109625
Authority: WO
Inventors: 李岩刚
Original assignee: 深圳前海达闼云端智能科技有限公司
Priority date: 2016-12-13
Filing date: 2016-12-13
Publication date: 2018-06-21
Also published as: CN107003875A

Abstract

Provided are a display method, apparatus, and electronic device used for multiple operating systems, used in the technical field of virtualization technology; in said method, a display window is allocated for each activated client operating system (102); in a client operating system, when it is detected that the client operating system switches to foreground operation, setting the corresponding display window to a display state and loading to the display window the image data needing to be displayed (601); in the main operating system, obtaining the image data of the display window in a display state and displaying by means of a display system (602); when each client operating system switches to foreground operation, the window corresponding thereto is in a display state, and when the client operating system has entered the background, the corresponding display window is in a hidden state; the main operating system displays the image data of the display window in a display state. Thus operating systems in the background are prevented from displaying, reducing consumption of the corresponding resources.

Description

Display method, device and electronic device for multiple operating systems

Technical field

The present invention relates to the field of virtualization technologies, and in particular, to a display method, apparatus, and electronic device for multiple operating systems.

Background technique

A virtual machine is a complete computer system that runs through a software and has full hardware system functionality running in a fully isolated environment. The virtual machine can run the guest operating system and its related applications, and the embedded system that provides the operating environment for the virtual machine also runs the software and hardware related to the main operating system. The virtual machine runs as an application of the primary operating system and emulates the hardware device for use while the guest operating system is running.

Since multiple virtual machines can be deployed in an embedded system, there can be multiple guest operating systems and only one primary operating system. All guest operating systems and main operating systems share hardware, memory, and input and output devices provided by hardware devices.

When the guest operating system displays, it applies for a display window native window in the main operating system. The native window is used as the output window of the guest operating system, that is, the pixels used by the guest operating system are displayed on the window. If the main operating system provides a GPU (Graphics Process Unit), the guest operating system virtualizes a vGPU (Virtual Graphics Process Unit) in the virtual machine and provides GPU-enabled images in its user space. The library graphics library simulates hardware image accelerators to accelerate the processing of image processing in guest operating systems. Alternatively, the guest operating system provides a simulated image library in its user space that completes the image processing process by calling an image library in the host operating system. The display pixels of the guest operating system processed by the virtual image library are finally displayed in the native window that it applies to the main operating system.

In the process of implementing the present invention, the inventors of the present invention found that: in the above method, in the single During the bit time period, the user can only operate on one operating system through the input device of the system. At this time, other guest operating systems or main operating systems displayed on the display device of the system, because there is no input, if the system currently has no active tasks, it can only be idle, resulting in waste of resources.

Summary of the invention

The embodiment of the invention provides a display method, device and electronic device for multiple operating systems, which are mainly used for reducing resource waste in multiple operating systems.

In a first aspect, an embodiment of the present invention provides a display method for multiple operating systems, including:

In the main operating system, a display window is allocated for each activated guest operating system;

In the guest operating system, when the guest operating system is detected to switch to the foreground, the corresponding display window is set to the display state, and the image data to be displayed is loaded into the display window;

In the main operating system, image data in a display window in a display state is acquired and displayed through a display system.

In a second aspect, an embodiment of the present invention provides a display device for multiple operating systems, including:

An allocation module, configured to allocate a display window corresponding to each activated guest operating system in the main operating system;

a processing module, configured to, in the guest operating system, set a corresponding display window to a display state when the guest operating system is switched to the foreground, and load the image data to be displayed into the display window;

The display module is configured to acquire image data in a display window in a display state and display it through a display system in the main operating system.

In a third aspect, an embodiment of the present invention provides an electronic device, where the electronic device includes:

a memory, one or more processors; a memory coupled to the processor via a communication bus; a processor configured to execute instructions in the memory; the storage medium having stored therein for performing the steps of the method of the first aspect of the claims instruction.

In a fourth aspect, an embodiment of the present invention provides a computer program product for use in conjunction with an electronic device including a display, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer The program mechanism includes instructions for performing the various steps in the method of the first aspect described above.

The benefits are as follows:

In the embodiment of the present invention, when the guest operating system switches to the foreground, the corresponding window is in the display state, and when the guest operating system enters the background, the corresponding display window is hidden; and the main operating system is in the display state. The image data in the status display window is displayed. In this way, the operating system in the background can be prevented from being displayed, thereby reducing the consumption of corresponding resources.

DRAWINGS

Specific embodiments of the present invention will be described below with reference to the accompanying drawings, in which:

FIG. 1 is a schematic diagram of a startup process of multiple operating systems according to an embodiment of the present invention; FIG.

2 is a schematic structural diagram of a display window corresponding to a multi-client operating system according to an embodiment of the present invention;

3 is a schematic structural diagram of a multi-operating system according to an embodiment of the present invention;

4 is a schematic diagram of a rendering process of a display window corresponding to a guest operating system according to an embodiment of the present invention;

FIG. 5 is a schematic flowchart of allocating and revoking a display state lock according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic flowchart of a display method for multiple operating systems according to an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of a display device for multiple operating systems according to an embodiment of the present invention; FIG.

FIG. 8 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

detailed description

The embodiments of the present invention are further described in detail with reference to the accompanying drawings, in which FIG. An exhaustive example. And in the case of no conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other.

In the existing multi-operating system switching process, each operating system is displayed on the display device of the system at the same time, but at the same time, the user can only operate one of the operating systems through the input device of the system, that is, only one current operating system, for no The active task is not the current operating system, it can only be idle, resulting in waste of resources.

Based on this, an embodiment of the present invention provides a display method for multiple operating systems. When a client operating system switches to the foreground, its corresponding window is in a display state, and when the guest operating system enters the background, the corresponding The display window is hidden; the main operating system displays the image data in the display window in the displayed state. In this way, the operating system in the background can be prevented from being displayed, thereby reducing the consumption of corresponding resources.

The invention provides a display method for multiple operating systems, and the multiple operating systems are directed to a main operating system and at least one guest operating system. Of all operating systems, only one is the current operating system. The currently running operating system is in the foreground, and the non-current running operating system is in the background.

In addition, each operating system maintains a status record table for recording the status of the corresponding operating system, wherein the status is running in the foreground or running in the background.

The display method for multiple operating systems provided by the embodiment of the present invention can realize that when the guest operating system switches to the foreground, its corresponding window is in a display state, and when the guest operating system enters the background, its corresponding display window The state is hidden; the main operating system displays the image data in the display window in the displayed state. This will prevent the operating system in the background from entering. The line is displayed, thereby reducing the consumption of the corresponding resources.

The startup process of the multiple operating system can be seen in Figure 1.

101, start the main operating system.

102. In the main operating system, a display window is allocated for each activated guest operating system.

Specifically, a display window may be allocated for the activated guest operating system when it is detected that the guest operating system is booted.

The display window is the local window of the main operating system. And the display window can do the following: display, hide, attribute query.

(1) When the display window is set to the display state, the display system of the main operating system synthesizes the pixels in the display buffer of the window with the pixels of other windows in the display system, and then displays them.

(2) When the display window is set to the hidden state, the display system of the main operating system ignores the pixels in the display buffer of the window, and does not synthesize with the pixels of other windows in the display system.

(3) Attribute query provides the length and width of the display window, pixel format and other content.

In the specific implementation, the corresponding display window of the multi-client operating system, the corresponding structure on the main operating system is as shown in FIG. 2 .

103, start each guest operating system.

104. Set the display window corresponding to the guest operating system after startup to a hidden state, and set the guest operating system after startup to a sleep state, and put the guest operating system after startup into the background, and perform customer operations after startup. In the status record table of the system maintenance, the status of the guest operating system after the startup is recorded as running in the background.

105. After all guest operating systems are booted, the primary operating system is set to sleep.

After the above steps 101 to 105, multiple operating systems are started, wherein the main operating system is located in the foreground, and the status of the main operating system is recorded in the status record table maintained by the main operating system as the foreground. Run and the primary operating system is the current operating system. The guest operating systems are all in the background. The status records of the operating systems maintained by each guest operating system record the status of the corresponding operating system in the background, and all guest operating systems are non-current operating systems. At the same time, all operating systems are in a sleep state.

For example, after the startup of multiple operating systems as shown in Figure 3, each operating system maintains a status record table. This table records whether the operating system is currently running in the foreground or in the background. In the main operating system, a display window is assigned for each booted guest operating system.

If the main operating system supports the operation of the image processing unit, each guest operating system has a corresponding rendering engine for its service. The rendering engine communicates with virtual machines that support guest operating systems and operates in accordance with the operations of the customer display subsystem in the guest operating system. Each layer in the client display subsystem corresponds to each rendering thread in the rendering engine, and the data or pixels that the layer needs to draw are passed to the corresponding rendering thread through the virtual machine. When the display system synthesizes all the layers, the rendering threads in the rendering engine are drawn in the order of layer composition, and the display data in the respective threads is drawn into the display window corresponding to the guest operating system, as shown in FIG. 4 Show.

In addition, the main operating system provides a service program that displays state locks for the current operating system. The service program displaying the state lock shall have at least the following functions: assigning a display state lock and revoking a display state lock.

Specifically, in the guest operating system, when it is detected that the guest operating system switches to the foreground, the application sets the display state lock; the display state lock is used to request to lock the display system to the running state; in the main operating system, it is monitored When the guest operating system requests to display a state lock, the system is locked to the running state. When the display state lock is assigned, the display system remains powered and active, even after the display system power down command is triggered.

In the guest operating system, when the user's interaction is not monitored for more than the preset duration, the application cancels the display state lock; in the main operating system, the client operating system is requested to cancel the display. When the state is locked, the state lock set for the display system is revoked. When the display state lock is revoked, the display system will enter the power-down state. The process is shown in Figure 5.

When multiple operating systems are started, the current operating system (which can be the main operating system or the guest operating system) may need to call the non-current operating system. In this case, multiple operations can be implemented through the process shown in Figure 6. The display of the system.

601. In the guest operating system, when monitoring that the guest operating system switches to the foreground, the corresponding display window is set to the display state, and the image data to be displayed is loaded into the display window.

In the specific implementation, in addition to setting the corresponding display window to the display state, and loading the image data to be displayed outside the display window, the guest operating system switched to the foreground is also set to the running state, and the client switching to the foreground is switched. In the status record table maintained by the operating system, the status of the guest operating system that is switched to the foreground is recorded as the foreground operation.

This embodiment is not limited to 1) setting the corresponding display window to the display state, 2) setting the guest operating system switched to the foreground to the running state, and 3) recording the state of the guest operating system switched to the foreground as the foreground running between The order of execution.

At the same time, in the guest operating system, when it is detected that the guest operating system switches to the foreground, the application sets the display state lock. In the main operating system, when the guest operating system requests to display the status lock, the display system is locked to the running state. This can prevent the display system from entering the hibernation program when the main operating system is running in the background, and ensure that the guest operating system can display the display system of the main operating system in time.

Since there is only one operating system running in the foreground, before the step 601 is executed, the display window corresponding to the operating system of the foreground operating system before the switching is set to a hidden state, and the operating system of the foreground operating system before the switching is set to the sleep state. The operating system running in the foreground before switching is placed in the background. In the status record table maintained by the operating system in the foreground before the switch, the status is recorded as running in the background.

This embodiment is not limited to 1) setting the display window corresponding to the foreground operating system before the switch to the hidden state, 2) setting the foreground operating system before the switch to the sleep state, and 3) setting the foreground operating system before the switch. The order of execution between the backgrounds.

This embodiment is also not limited to 4) the foreground operating system state before the record switching is the background running and (1) the display window corresponding to the foreground operating system before the switching is set to the hidden state and 2) the foreground running operation before the switching The system is set to the order of execution between sleep states. However, 4) Recording the operating system status before the switchover is running in the background. 3) Execute the operating system before the switch is placed in the background.

If the operating system running in the foreground before the switch is the guest operating system, the host operating system provides a service program for displaying the state lock. The method provided in this embodiment is to be switched to run in the background, that is, the operating system in the foreground before the switch does not need to display the state lock service. Therefore, after the step is executed, the operating system of the foreground operating system before the switchover is also cancelled. Show status lock.

602. In the main operating system, acquire image data in a display window in a display state and display it through a display system.

Through

steps

601 and 602, each client operating system can display the corresponding window when it switches to the foreground, and when the guest operating system enters the background, the corresponding display window is hidden; and the main operating system will be The image data in the display window in the display state is displayed. In this way, the operating system in the background can be prevented from being displayed, thereby reducing the consumption of corresponding resources.

Since there is only one main operating system in multiple operating systems, the current operating system can be a primary operating system or a guest operating system.

If the current operating system is the main operating system, the operating system is switched to the guest operating system.

If the current operating system is a guest operating system, the switching operating system may be the primary operating system or other guest operating systems.

For the above situation, the display side for multiple operating systems provided by the embodiment is separately described below. The implementation process of the law is explained again.

(1) When the foreground operating system before the switchover runs the operating system as the main operating system, the operating system switched to the foreground is the guest operating system.

The implementation scenario corresponding to this situation may be: the main operating system is running in the foreground, all the guest operating systems are running in the background, and the guest operating system 1 that the host operating system expects to switch to.

For this implementation scenario, when the switchover occurs, the display window corresponding to the main operating system is set to the hidden state, the main operating system is set to the sleep state, and the main operating system is placed in the background. Setting the display window corresponding to the guest operating system 1 to the display state, setting the guest operating system 1 to the running state, placing the guest operating system 1 in the foreground, and the guest operating system 1 applying to set the display state lock. In the main operating system, When the guest operating system requests to display the status lock, the display system is locked to the running state.

After the switchover, the guest operating system 1 is woken up, enters the running state from the sleep state, and its displayed pixels are displayed through its corresponding display window. The guest operating system 1 can now monopolize the input device and respond to the user's input through the display system.

When the current running guest operating system 1 has no active user input, the display system of the guest operating system 1 enters the user's non-interactive state, and the virtual machine can be used to cancel the display state lock, and then the system enters the user's non-interactive state, and then closes. Show system idling, reducing resource waste.

(2) The current operating system is the guest operating system, and the operating system is switched to be the main operating system.

The implementation scenario corresponding to the situation may be: the guest operating system 2 is running in the foreground, and other guest operating systems and the main operating system are running in the background. The guest operating system 2 expects to switch to the primary operating system.

For this implementation scenario, when the handover occurs, the display window corresponding to the guest operating system 2 is set to the hidden state, the guest operating system 2 is set to the sleep state, the guest operating system 2 is placed in the background, and the display of the guest operating system 2 is cancelled. State lock. Display corresponding to the main operating system The window is set to display state, the main operating system is set to the running state, and the main operating system is placed in the foreground.

(3) The current operating system is a guest operating system, and the operating system is switched to another guest operating system.

The implementation scenario corresponding to the situation may be: the guest operating system 3 is running in the foreground, and other guest operating systems and the main operating system are running in the background. The guest operating system 3 expects to switch to other guest operating systems 4.

For this implementation scenario, when the handover occurs, the display window corresponding to the guest operating system 3 is set to the hidden state, the guest operating system 3 is set to the sleep state, the guest operating system 3 is placed in the background, and the display of the guest operating system 3 is cancelled. State lock. The display window corresponding to the guest operating system 4 is set to the display state, the guest operating system 4 is set to the running state, the guest operating system 4 is placed in the foreground, and the display operating state lock is assigned to the guest operating system 4.

The method for displaying multiple operating systems provided by this embodiment, by assigning a display window corresponding to each activated guest operating system in the main operating system, in the guest operating system, monitoring the switching of the guest operating system to When the foreground is running, the corresponding display window is set to the display state, and the image data to be displayed is loaded into the display window; in the main operating system, the image data in the display window in the display state is acquired and displayed through the display system. The following functions are implemented: for a display device, only one operating system (current operating system) is using the display device at a time. Other operating systems (non-current operating systems), at this moment, if there is no active task, the system is in a dormant state. If there is an active task, because there is no display system that can be used, the user is in a background that the user cannot interact with. status.

At the same time, the display system is activated by displaying the status lock. When all operating systems do not use the display device, the display system can be put to sleep by releasing the display state lock.

Beneficial effects:

In the embodiment of the present invention, when the guest operating system switches to the foreground, the corresponding window is in a display state, and when the guest operating system enters the background, the corresponding display window is in a hidden state; and the main operating system is in a display state. The image data in the display window is displayed. In this way, the operating system in the background can be prevented from being displayed, thereby reducing the consumption of corresponding resources.

Based on the same inventive concept, the present embodiment provides a display device for multiple operating systems, and the principle of the problem for the display device for multiple operating systems is similar to that for a multi-operating system, so the use For the implementation of a display device for multiple operating systems, reference may be made to the implementation of a display method for multiple operating systems, and the repeated description is not repeated.

Referring to FIG. 7, the display device for multiple operating systems includes:

The distribution module 701 is configured to allocate, in the main operating system, a display window corresponding to each activated guest operating system;

The processing module 702 is configured to: when the guest operating system is switched to the foreground, in the guest operating system, set the corresponding display window to the display state, and load the image data to be displayed into the display window;

The display module 703 is configured to acquire image data in a display window in a display state and display it through a display system in the main operating system.

Optionally, the allocating module 701 is configured to allocate a display window for the activated guest operating system when detecting that the guest operating system is started.

Optionally, the device further includes:

The setting module is configured to set the corresponding display window to a hidden state when monitoring that the guest operating system switches to the background.

Optionally, the device further includes:

The first application module is configured to apply for setting a display state lock in the guest operating system when monitoring that the guest operating system switches to the foreground operation;

A display state lock is used to request that the display system be locked into a running state;

The locking module is configured to lock the display system to the running state when the guest operating system requests to display the status lock in the main operating system.

Optionally, the device further includes:

a second application module, configured to, in the guest operating system, apply to cancel the display state lock when the interaction of the user is not monitored for more than a preset duration;

The undo module is used to cancel the state lock set for the display system when the guest operating system requests to cancel the display state lock in the main operating system.

Beneficial effects:

In another aspect, an embodiment of the present invention further provides an electronic device. Referring to FIG. 8, the electronic device includes:

a memory 801, one or more processors 802; and a transceiver component 803, the memory, the processor, and the transceiver component 803 are connected by a communication bus (in the embodiment of the present invention, the communication bus is an I/O bus); The storage medium stores therein instructions for executing the respective steps in the display method for the multiple operating systems described in any of the above. It is not difficult to understand that, in the specific implementation, in order to achieve the basic object of the present invention, the above-described transceiver component 803 is not necessarily required.

In still another aspect, an embodiment of the present invention provides a computer program product for use in conjunction with an electronic device including a display, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, Computer program mechanism includes means for performing the above Any of the instructions for each step in the display method of the multiple operating system.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

Although a preferred embodiment of the invention has been described, one of ordinary skill in the art will recognize Additional changes and modifications to these embodiments can be made in the basic inventive concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and the modifications and

Claims

A display method for a multi-operating system, comprising:

In the main operating system, a display window is allocated for each activated guest operating system;

In the guest operating system, when the guest operating system is detected to switch to the foreground, the corresponding display window is set to the display state, and the image data to be displayed is loaded into the display window;

In the main operating system, image data in a display window in a display state is acquired and displayed through a display system.
The method according to claim 1, wherein the assigning a display window corresponding to each activated guest operating system means: assigning a guest operating system to the startup when detecting the startup of the guest operating system Display window.
The method of claim 1 further comprising:

When it is detected that the guest operating system switches to the background, the corresponding display window is set to the hidden state.
The method according to claim 1, wherein the method further comprises: in the guest operating system, applying for setting a display state lock when monitoring that the guest operating system switches to the foreground operation;

The display state lock is used to request to lock the display system to an operating state;

In the main operating system, when the guest operating system requests to display the status lock, the display system is locked to the running state.
The method according to claim 4, wherein the method further comprises: in the guest operating system, applying for revoking the display state lock when the interaction of the user is not detected for more than a preset duration;

In the main operating system, when the guest operating system is requested to cancel the display state lock, the state lock set for the display system is revoked.
A display device for a multi-operating system, comprising:

An allocation module, configured to allocate a display window corresponding to each activated guest operating system in the main operating system;

a processing module, configured to, in the guest operating system, set a corresponding display window to a display state when the guest operating system is switched to the foreground, and load the image data to be displayed into the display window;

The display module is configured to acquire image data in a display window in a display state and display it through a display system in the main operating system.
The device according to claim 6, wherein the allocating module is configured to allocate a display window for the activated guest operating system when detecting that the guest operating system is started.
The device according to claim 6, wherein the device further comprises:

The setting module is configured to set the corresponding display window to a hidden state when monitoring that the guest operating system switches to the background.
The device according to claim 6, wherein the device further comprises:

The first application module is configured to apply for setting a display state lock in the guest operating system when monitoring that the guest operating system switches to the foreground operation;

The display state lock is used to request to lock the display system to an operating state;

The locking module is configured to lock the display system to the running state when the guest operating system requests to display the status lock in the main operating system.
The device according to claim 9, wherein the device further comprises:

a second application module, configured to, in the guest operating system, apply to cancel the display state lock when the interaction of the user is not monitored for more than a preset duration;

The undo module is used to cancel the state lock set for the display system when the guest operating system requests to cancel the display state lock in the main operating system.
An electronic device, comprising:

a memory, one or more processors; a memory coupled to the processor via a communication bus; a processor configured to execute instructions in the memory; the storage medium storing the method of any one of claims 1 to 5 Instructions for each step.
A computer program product for use in conjunction with an electronic device including a display, the computer program product comprising a computer readable storage medium and a computer program mechanism embodied therein, the computer program mechanism comprising for performing claim 1 5 instructions for each of the steps in any of the methods.