CN112965771A - Virtual screen construction method, computing device and storage medium - Google Patents
Virtual screen construction method, computing device and storage medium Download PDFInfo
- Publication number
- CN112965771A CN112965771A CN202110231746.3A CN202110231746A CN112965771A CN 112965771 A CN112965771 A CN 112965771A CN 202110231746 A CN202110231746 A CN 202110231746A CN 112965771 A CN112965771 A CN 112965771A
- Authority
- CN
- China
- Prior art keywords
- screen
- virtual screen
- management module
- virtual
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000010276 construction Methods 0.000 title claims abstract description 18
- 238000000034 method Methods 0.000 claims abstract description 55
- 238000004891 communication Methods 0.000 claims description 34
- 238000007726 management method Methods 0.000 description 103
- 230000008569 process Effects 0.000 description 10
- 238000012545 processing Methods 0.000 description 10
- 230000006870 function Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000002093 peripheral effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000007723 transport mechanism Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Digital Computer Display Output (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention discloses a virtual screen construction method, which is suitable for being executed in computing equipment, wherein an image display system and a plurality of applications run in the computing equipment, the image display system comprises a window management module and a screen management module, and the method comprises the following steps: the screen management module sets screen parameters of the virtual screen and constructs the virtual screen according to the screen parameters; the window management module constructs a display window for each running application to obtain a plurality of display windows; and drawing the constructed multiple display windows in the virtual screen by the screen management module so that the computing device continues to run the application. The invention also discloses a computing device and a computer readable storage medium.
Description
Technical Field
The invention relates to the field of computer operating systems, in particular to a virtual screen construction method, computing equipment and a storage medium.
Background
With the development of computer technology, computers have great progress in display and interaction, and the computers can display the running conditions of systems and applications through an external physical display, so that users can conveniently check and continue to operate the computers.
However, in the prior art, if the computer is not externally connected with a physical display, the computer is difficult to continue to run when encountering operations requiring rendering display in the process of running an operating system and applications. In this case, the computer cannot perform graphics-related operations, as only the physical display can continue to operate, if it is reconnected.
For this reason, a virtual screen building method is required.
Disclosure of Invention
To this end, the present invention provides a virtual screen construction method in an attempt to solve or at least alleviate the above-existing problems.
According to an aspect of the present invention, there is provided a virtual screen building method adapted to be executed in a computing device in which an image display system and a plurality of applications are run, the image display system including a window management module and a screen management module, the method including the steps of: the screen management module sets screen parameters of the virtual screen and constructs the virtual screen according to the screen parameters; the window management module constructs a display window for each running application to obtain a plurality of display windows; and drawing the constructed multiple display windows in the virtual screen by the screen management module so that the computing device continues to run the application.
Optionally, in a method according to the present invention, the computing device further comprises a communication interface adapted to connect to the physical screen, the screen management module comprises a mode option, the mode option comprises a physical screen and a virtual screen, and the method further comprises: the screen management module determines whether the computing equipment is connected with a physical screen or not according to the communication interface; if the computing equipment is determined to be connected with the physical screen, the screen management module sets the mode option as the physical screen; and acquiring screen parameters of the physical screen, and drawing a display window in the physical screen according to the display window constructed by the window management module.
Optionally, in the method according to the present invention, further comprising: if the computing equipment is determined not to be connected with the physical screen, the screen management module sets the mode option as a virtual screen; setting screen parameters of the virtual screen, and constructing the virtual screen according to the virtual screen parameters.
Optionally, in the method according to the present invention, the screen management module sets model parameters of the virtual screen, and the constructing of the virtual screen according to the screen parameters includes the steps of: setting the height, width and refreshing frequency of a virtual screen; and constructing the size of the virtual screen according to the width and the height of the virtual screen, and determining the frequency of drawing the display window by the virtual screen according to the refreshing frequency.
Optionally, in the method according to the present invention, the constructing, by the window management module, a display window for each running application includes the steps of: determining a display window according to the running state of the application; and adding a label of the virtual screen to the display window so that the window management module can draw the display window.
Optionally, in the method according to the present invention, the step of drawing the constructed multiple display windows in the virtual screen by the screen management module includes: acquiring a display window and identifying a label of the display window; and if the label is identified to be the virtual screen, drawing the display window in the virtual screen.
Optionally, in a method according to the present invention, the computing device includes a memory, and drawing the display window in the virtual screen includes: obtaining the allocated memory block from a memory of the computing device, wherein the content block is used for storing display window data; performing association operation on the memory block and a virtual screen; drawing a display window in the memory block subjected to the association operation; and combining the display windows drawn in all the memory blocks associated with the virtual screen to obtain the memory block of the virtual screen, wherein all the display windows drawn by the current virtual screen are stored in the content block of the virtual screen.
Optionally, in the method according to the present invention, further comprising: when the screen management module constructs a virtual screen and draws a display window in the virtual screen, the screen management module receives a screen capturing instruction from a user; the screen management module acquires stored display information from the memory block of the virtual screen according to the screen capturing instruction, wherein the display information comprises a display window drawn by the current virtual screen; and storing the display information in a screenshot picture, and storing the screenshot picture in a memory.
Optionally, in a method according to the present invention, the image display system further includes a power management module, and the method further includes: when the screen management module constructs a virtual screen and draws a display window in the virtual screen, the power supply management module receives a virtual screen control instruction from a user, wherein the virtual screen control instruction comprises closing the virtual screen and opening the virtual screen; and the power supply management module closes or opens the virtual screen according to the virtual screen control instruction.
Optionally, in the method according to the present invention, further comprising: the power management module monitors a communication interface suitable for being connected with a physical screen; and when the situation that the computing equipment is connected with a physical screen through the communication interface is monitored, transferring a display window drawn by the virtual screen into the physical screen for displaying.
According to another aspect of the present invention, there is provided a computing device comprising: one or more processors; a memory; an image display system; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any one of the methods of a virtual screen construction method according to the present invention.
According to yet another aspect of the present invention, there is provided a computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform any one of a virtual screen construction method according to the present invention.
A virtual screen construction method in the invention is suitable for being executed in a computing device. An image display system and a plurality of applications run in the computing device, and the image display system comprises a window management module and a screen management module. The screen management module establishes the virtual screen according to the screen parameters by setting the screen parameters of the virtual screen, so that the computer can draw and display the display window of the application in the virtual screen conveniently and continue to operate without hindrance.
And further, before the virtual screen is constructed, whether the computer is connected with a physical screen is detected, and if the computer is connected with the physical screen, a display window for displaying the application can be drawn in the physical screen. The image display system also comprises a power supply management module, and when the power supply management module monitors that a physical screen is connected through a communication interface of a computer in the process of displaying by using the virtual screen, a display window drawn by the virtual screen is transferred into the physical screen to be displayed, so that the compatibility between the physical screen and the virtual screen and the intelligent switching between the physical screen and the virtual screen can be realized. The power management module also receives a virtual screen control instruction of a user, wherein the virtual screen control instruction comprises closing the virtual screen and opening the virtual screen, so that the power management module controls the closing or opening of the virtual screen according to the requirement of the user.
Drawings
To the accomplishment of the foregoing and related ends, certain illustrative aspects are described herein in connection with the following description and the annexed drawings, which are indicative of various ways in which the principles disclosed herein may be practiced, and all aspects and equivalents thereof are intended to be within the scope of the claimed subject matter. The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description read in conjunction with the accompanying drawings. Throughout this disclosure, like reference numerals generally refer to like parts or elements.
FIG. 1 shows a schematic diagram 100 of an image display system operating in a computing device, according to an exemplary embodiment of the invention;
FIG. 2 illustrates a block diagram of a computing device 200, according to an exemplary embodiment of the invention; and
FIG. 3 shows a flowchart of a virtual screen construction method 300 according to an exemplary embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art. Like reference numerals generally refer to like parts or elements.
FIG. 1 shows a schematic diagram 100 of an image display system operating in a computing device according to an exemplary embodiment of the invention. As shown in fig. 1, the image display system 100 includes a window management module 110, a screen management module 120, and a power management module 130, wherein the screen management module 120 is communicatively connected to the window management module 110 and the power management module 130.
The computing device on which the image display system 100 resides includes a communication interface for connecting to a physical screen. The screen management module 120 determines whether the computing device is connected to a physical screen according to the communication interface before constructing the virtual screen, and sets screen parameters of the virtual screen if the computing device is not connected to the physical screen. The screen parameters of the virtual screen may be set with reference to the screen parameters of the physical screen, but the set parameters may be adjusted according to the needs of the computing device running the image display system 100 and the application.
The virtual screen is a screen which does not use a screen which exists physically as a medium and simulates an actual screen in the virtual memory to display a display window to be displayed, and the virtual memory can be realized as a storage space constructed by the display storage of the display card. The screen parameters include a function parameter, an identification parameter, a type parameter, and a configuration parameter. The functional parameters include switch states and scaling parameters. The switch state controls the virtual screen to be opened and closed, when the switch state is opened, the virtual screen is in the opening state, and when the switch state is closed, the virtual screen is in the closing state. The zoom parameter (scale) controls whether the virtual screen can be zoomed.
The identification parameters include a display screen identification (edid) and corresponding manufacturer information (manufacturer). The display screen identification is the unique identification which both the physical screen and the virtual screen have, and is used as the identification of the display. The manufacturer information is the manufacturer corresponding to the display screen identification. The type parameter (connector _ type) is a type of display, including VGA, HDMI, DP, and eDP. The screen management module 120 sets it according to actual needs.
The configuration parameters (mode _ modeinfo) include a clock frequency (clock), a height (hdisplay), a width (vdisplay), a height synchronization signal start (hsync _ start), a height synchronization signal end (hsync _ end), a tilt (hskew), a horizontal synchronization signal start (vsync _ start), a horizontal synchronization signal end (vsync _ end), a refresh frequency (vrefresh), and a flag (flags) of the display. Wherein the height and width define a height and width, respectively, of the virtual screen, the refresh frequency determining a frequency at which display windows are drawn in the virtual screen, the virtual screen refreshing the display content at the frequency. Each of the configuration parameters determines a set of configuration parameters for the virtual screen. The screen management module 120 may also obtain various parameters of the physical screen connected to the communication interface, and establish multiple sets of configuration parameters to store the parameters of different physical screens.
According to an embodiment of the present invention, the set of configuration parameters of a virtual screen created by the screen management module 120 is as follows:
drmModeModeInfo mode；
strcpy (mode. name, "1920x 1080"); // name of configuration parameter
Clock 148500; // clock frequency
Hdisplay 1920; // height
Hsync _ start 2008; // high synchronization Signal Start
Hsync _ end 2052; end of high synchronization signal
Hskew ═ 0; // gradient
Vdisplay 1080; width// width
Vsync _ start 1084; // horizontal sync signal start
Vsync _ end 1089; // horizontal sync signal end
Vrefresh 60; // Refresh frequency
Flag ═ 5; // flag bit
The window management module 110 builds a display window for each application running in the computing device, resulting in multiple display windows. The screen management module 120 also draws a plurality of display windows in the virtual screen according to the refresh frequency. The power management module 130, to which the screen management module 120 is communicatively coupled, accepts virtual screen control instructions from a user when the virtual screen is used by the computing device, the virtual screen control instructions including closing the virtual screen and opening the virtual screen. When the power management module 130 receives a control instruction for closing the virtual screen, the control screen management module 120 modifies the on-off state in the functional parameters to be closed, and then the virtual screen can be closed; when the power management module 130 receives a control instruction for turning on the virtual screen, the control screen management module 120 changes the on-off state in the functional parameters from off to on, so as to turn on the virtual screen.
The image display system 100 of the present invention is suitable for operation in a computing device. FIG. 2 illustrates a block diagram of a computing device 200, according to an exemplary embodiment of the invention. As shown in FIG. 2, in a basic configuration 202, a computing device 200 typically includes a system memory 206 and one or more processors 204. A memory bus 208 may be used for communication between the processor 204 and the system memory 206.
Depending on the desired configuration, the processor 204 may be any type of processing, including but not limited to: a microprocessor (μ P), a microcontroller (μ C), a Digital Signal Processor (DSP), or any combination thereof. The processor 204 may include one or more levels of cache, such as a level one cache 210 and a level two cache 212, a processor core 214, and registers 216. Example processor cores 214 may include Arithmetic Logic Units (ALUs), Floating Point Units (FPUs), digital signal processing cores (DSP cores), or any combination thereof. The example memory controller 218 may be used with the processor 204, or in some implementations the memory controller 218 may be an internal part of the processor 204.
Depending on the desired configuration, system memory 206 may be any type of memory, including but not limited to: volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.), or any combination thereof. System memory 206 may include an operating system 220, one or more programs 222, and program data 224. In some embodiments, the program 222 may be arranged to execute the instructions 223 of the method 300 according to the invention on an operating system by one or more processors 204 using the program data 224. The operating system 220 includes an image display system 221. The image display system 221 is the image display system 100 shown in the figure of the present invention.
Computing device 200 may also include a storage interface bus 234. The storage interface bus 234 enables communication from the storage devices 232 (e.g., removable storage 236 and non-removable storage 238) to the basic configuration 202 via the bus/interface controller 230. At least a portion of the operating system 220, applications 222, and data 224 may be stored on removable storage 236 and/or non-removable storage 238, and loaded into system memory 206 via storage interface bus 234 and executed by the one or more processors 204 when the computing device 200 is powered on or the applications 222 are to be executed.
Computing device 200 may also include an interface bus 240 that facilitates communication from various interface devices (e.g., output devices 242, peripheral interfaces 244, and communication devices 246) to the basic configuration 202 via the bus/interface controller 230. The example output device 242 includes a graphics processing unit 248 and an audio processing unit 250. They may be configured to facilitate communication with various external devices, such as a display or speakers, via one or more a/V ports 252. Example peripheral interfaces 244 can include a serial interface controller 254 and a parallel interface controller 256, which can be configured to facilitate communications with external devices such as input devices (e.g., keyboard, mouse, pen, voice input device, touch input device) or other peripherals (e.g., printer, scanner, etc.) via one or more I/O ports 258. An example communication device 246 may include a network controller 260, which may be arranged to facilitate communications with one or more other computing devices 262 over a network communication link via one or more communication ports 264.
A network communication link may be one example of a communication medium. Communication media may typically be embodied by computer readable instructions, data structures, program modules, and may include any information delivery media, such as carrier waves or other transport mechanisms, in a modulated data signal. A "modulated data signal" may be a signal that has one or more of its data set or its changes made in such a manner as to encode information in the signal. By way of non-limiting example, communication media may include wired media such as a wired network or private-wired network, and various wireless media such as acoustic, Radio Frequency (RF), microwave, Infrared (IR), or other wireless media. The term computer readable media as used herein may include both storage media and communication media.
In a computing device 200 according to the present invention, the application 222 includes program instructions for performing a virtual screen construction method 300 that can instruct the processor 204 to perform portions of the steps of the virtual screen construction method 300 that is run in a computing device 200 according to the present invention, such that the portions of the computing device 200 implement the construction of virtual screens by performing a virtual screen construction method 300 according to the present invention.
Computing device 200 may be implemented as a server, e.g., file server 240, database 250, a server, an application server, etc., which may be a device such as a Personal Digital Assistant (PDA), a wireless web-browsing device, an application-specific device, or a hybrid device that include any of the above functions. Which may be implemented as a personal computer including both desktop and notebook computer configurations, and in some embodiments, the computing device 200 is configured to perform a virtual screen construction method 300.
FIG. 3 shows a flowchart of a virtual screen construction method 300 according to an exemplary embodiment of the present invention. The method 300 is suitable for execution in the computing device 200. As shown in fig. 3, a virtual screen construction method 300 begins in step S310, and the screen management module 120 sets screen parameters of a virtual screen and constructs the virtual screen according to the screen parameters.
The screen management module 120 first determines whether a physical screen is connected to the computing device according to the communication interface before building the virtual screen. When the physical screen is connected to the computing equipment, the physical screen is preferentially used for displaying, and the virtual screen does not need to be constructed. If it is determined that the computing device is connected to a physical screen, the screen management module 120 sets the mode option to the physical screen. The mode options of the screen management module 120 include a physical screen and a virtual screen. Then, the screen management module 120 obtains the screen parameters of the physical screen, and draws a display window in the physical screen according to the display window constructed by the window management module 110. The screen parameter items of the physical screen and the virtual screen are the same, but when the virtual screen is constructed by the screen management module 120, different parameters from those of the physical screen can be set according to needs, and the set parameter values are more flexible, so that various requirements of display tasks can be met conveniently.
According to one embodiment of the invention, when a physical screen is connected to the computing device, the window management module 110 constructs a display window of an application for display in the physical screen. And sending the constructed display windows to a driver corresponding to the connected physical device for processing through a verification (valid) interface. The driver can process a certain number of display windows at the same time, and when the number of the received display windows is greater than the processing capacity, the window management module 110 is instructed to add the labels of the physical screens to the display windows and send the labels to the screen management module 120, so that the screen management module 120 processes the display windows by recognizing the labels of the physical screens, combines the display windows into one display window and sends the display window to the driver for processing through a presentation interface.
According to an exemplary embodiment of the present invention, the window management module 110 is constructed with 5 display windows when a physical screen is connected to the computing device. The processing power of the driver corresponding to the physical screen to which the computing device is connected is 3 display windows, i.e., the driver can process 3 display windows simultaneously. At this time, after the window management module 110 sends the 5 display windows to the driver through the verification (valid) interface, the driver instructs the window management module 110 to add a label of a physical screen to the display window, and sends the label to the screen management module 120, so that the screen management module 120 combines the display windows into one display window through the label identified to the physical screen and sends the display window to the driver through the submission (Present) interface for processing.
If the computing device is not connected to a physical screen, the screen management module 120 sets the mode option to a virtual screen. The image display system 100 further includes a power management module 130. Subsequently, the screen management module 120 checks whether the power management module 130 receives a virtual screen control instruction for closing the virtual screen of the user, and if the corresponding control instruction for controlling the virtual screen to close is not received, sets the screen parameters of the virtual screen.
The screen parameters include a function parameter, an identification parameter, a type parameter, and a configuration parameter. The configuration parameters include the height, width and refresh frequency of the virtual screen. According to an embodiment of the present invention, in the function parameters of a virtual screen established by the screen management module 120, the on-off state is on, and the zooming parameter is to support zooming; the display screen is identified as screen1, and the manufacturer information is tx; the type parameter is VGA; the configuration parameters are as follows:
drmModeModeInfo mode；
strcpy (mode. name, "1920x 1080"); // name of configuration parameter
Clock 148500; // clock frequency
Hdisplay 1920; // height
Hsync _ start 2008; // high synchronization Signal Start
Hsync _ end 2052; end of high synchronization signal
Hskew ═ 0; // gradient
Vdisplay 1080; width// width
Vsync _ start 1084; // horizontal sync signal start
Vsync _ end 1089; // horizontal sync signal end
Vrefresh 60; // Refresh frequency
Flag ═ 5; // flag bit
Next, the screen management module 120 constructs a virtual screen according to the parameters: and constructing the size of the virtual screen according to the width and the height of the virtual screen, and determining the frequency of drawing the display window by the virtual screen according to the refreshing frequency.
Subsequently, step S320 is executed, and the window management module 110 constructs a display window for each running application, resulting in a plurality of display windows. The window management module 110 determines a display window according to the operation state of the application. The running state of the application may be obtained from an operating system running in the computing device. Subsequently, since the computing device is not connected to a physical screen, there is no corresponding driver to process the display window. Therefore, when the window management module 110 needs to send the display window to the driver through the valid interface, the window management module 110 directly adds a label of the virtual screen to the display window, so that the window management module 110 draws the display window.
Subsequently, step S330 is executed, and the screen management module 120 draws the constructed multiple display windows in the virtual screen, so that the computing device continues to run the application. The screen management module 120 obtains the display windows and identifies the tags thereof, and if the result of identifying the tags is a virtual screen, the display windows are processed and rendered, and are not sent to the driver through the Present interface, and are directly displayed in the virtual screen. Therefore, the computing equipment can smoothly complete image processing and display related work, and when the running state of the application executing the image related task needs to be known, the image rendering and display result can be checked through screen capture operation.
The computing device comprises a storage, and the storage can be realized as a storage of a display card which is arranged in the computing device and used as a virtual display memory. The computing device further includes an image data manager configured to allocate the display memory, for example, separate a memory block from the display memory, so that the screen management module stores corresponding display information after performing a drawing operation of a display window in the memory block.
The screen management module draws the display window in the virtual screen and comprises the following steps: and acquiring a memory block allocated by the image data manager from a memory of the computing device, and associating the memory block with the virtual screen so as to enable the virtual screen to display a display window in the memory block. And then, drawing the display window in the memory block after the association operation, executing the drawing statement corresponding to the display window, and finishing the drawing of the display window. And finally, the screen management module merges the display windows drawn in all the memory blocks associated with the virtual screen to obtain the memory blocks of the virtual screen, and all the display windows drawn by the current virtual screen are stored in the content blocks of the virtual screen. Because the virtual screen is the same as the physical screen, when displaying the display window of the application, the display information can only be read from one memory block, and therefore, the memory blocks of multiple display windows need to be processed in advance and merged into the memory block of one virtual screen, so that the virtual screen can simultaneously display all the display windows in the memory block.
According to one embodiment of the invention, when the screen management module constructs the virtual screen and draws the display window in the virtual screen, the screen management module receives a screen capturing instruction from a user, and the screen capturing instruction instructs the screen management module to perform screen capturing operation on the content displayed by the current virtual screen, so that the user can view the current system and application running state. And then, the screen management module acquires the stored display information from the memory block of the virtual screen according to the screen capturing instruction, wherein the display information comprises all display windows drawn by the current virtual screen, stores the display information in a form of screen capturing pictures, and stores the screen capturing pictures in a memory so as to be convenient for a user to view.
According to an embodiment of the present invention, when the screen management module 120 constructs a virtual screen and draws a display window therein, the power management module 130 receives a virtual screen control instruction from a user. The user can send a virtual screen control instruction through an input device or the like connected with the computing device to control the virtual screen to be opened and closed.
The virtual screen control command includes closing the virtual screen and opening the virtual screen, and the power management module 130 closes or opens the virtual screen according to the virtual screen control command. When the power management module 130 receives a control instruction for closing the virtual screen, the control screen management module 120 modifies the on-off state in the functional parameters to be closed, and then the virtual screen can be closed; when the power management module 130 receives a control instruction for turning on the virtual screen, the control screen management module 120 changes the on-off state in the functional parameters from off to on, so as to turn on the virtual screen.
According to an embodiment of the present invention, the power management module 130 further monitors a communication interface adapted to connect to a physical screen, and when it is monitored that the computing device is connected to the physical screen through the communication interface, the display window drawn by the virtual screen is transferred to the physical screen for displaying. Therefore, in the process of displaying by using the virtual screen in the computing equipment, the physical screen can be switched to the physical screen in time to display after being accessed, the seamless switching of the display screen is carried out, and the applicability to the physical screen and the virtual screen is improved. Meanwhile, the virtual screen is released in time, computer resources are saved, and system and application operating efficiency is improved.
A virtual screen construction method in the invention is suitable for being executed in a computing device. An image display system and a plurality of applications run in the computing device, and the image display system comprises a window management module and a screen management module. The screen management module establishes the virtual screen according to the screen parameters by setting the screen parameters of the virtual screen, so that the computer can draw and display the display window of the application in the virtual screen conveniently and continue to operate without hindrance.
And further, before the virtual screen is constructed, whether the computer is connected with a physical screen is detected, and if the computer is connected with the physical screen, a display window for displaying the application can be drawn in the physical screen. The image display system also comprises a power supply management module, and when the power supply management module monitors that a physical screen is connected through a communication interface of a computer in the process of displaying by using the virtual screen, a display window drawn by the virtual screen is transferred into the physical screen to be displayed, so that the compatibility between the physical screen and the virtual screen and the intelligent switching between the physical screen and the virtual screen can be realized. The power management module also receives a virtual screen control instruction of a user, wherein the virtual screen control instruction comprises closing the virtual screen and opening the virtual screen, so that the power management module controls the closing or opening of the virtual screen according to the requirement of the user.
In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
A9, the method of any one of a1-A8, wherein the image display system further comprises a power management module, the method further comprising:
when the screen management module constructs a virtual screen and draws a display window in the virtual screen, the power supply management module receives a virtual screen control instruction from a user, wherein the virtual screen control instruction comprises a virtual screen closing instruction and a virtual screen opening instruction;
and the power supply management module closes or opens the virtual screen according to the virtual screen control instruction.
A10, the method of a9, further comprising:
the power management module monitors a communication interface suitable for being connected with a physical screen;
and when the situation that the computing equipment is connected with a physical screen through the communication interface is monitored, transferring a display window drawn by the virtual screen into the physical screen for displaying.
Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.
Those skilled in the art will appreciate that the modules or units or groups of devices in the examples disclosed herein may be arranged in a device as described in this embodiment, or alternatively may be located in one or more devices different from the devices in this example. The modules in the foregoing examples may be combined into one module or may be further divided into multiple sub-modules.
Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. Modules or units or groups in embodiments may be combined into one module or unit or group and may furthermore be divided into sub-modules or sub-units or sub-groups. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.
Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.
Furthermore, some of the described embodiments are described herein as a method or combination of method elements that can be performed by a processor of a computer system or by other means of performing the described functions. A processor having the necessary instructions for carrying out the method or method elements thus forms a means for carrying out the method or method elements. Further, the elements of the apparatus embodiments described herein are examples of the following apparatus: the apparatus is used to implement the functions performed by the elements for the purpose of carrying out the invention.
The various techniques described herein may be implemented in connection with hardware or software or, alternatively, with a combination of both. Thus, the methods and apparatus of the present invention, or certain aspects or portions thereof, may take the form of program code (i.e., instructions) embodied in tangible media, such as floppy diskettes, CD-ROMs, hard drives, or any other machine-readable storage medium, wherein, when the program is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the invention.
In the case of program code execution on programmable computers, the computing device will generally include a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device. Wherein the memory is configured to store program code; the processor is configured to execute the method for determining the apparatus shutdown state of the present invention according to instructions in the program code stored in the memory.
By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer-readable media includes both computer storage media and communication media. Computer storage media store information such as computer readable instructions, data structures, program modules or other data. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. Combinations of any of the above are also included within the scope of computer readable media.
As used herein, unless otherwise specified the use of the ordinal adjectives "first", "second", "third", etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this description, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as described herein. Furthermore, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter. Accordingly, many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the appended claims. The present invention has been disclosed in an illustrative rather than a restrictive sense, and the scope of the present invention is defined by the appended claims.
Claims (10)
1. A virtual screen construction method adapted to be executed in a computing device in which an image display system and a plurality of applications are run, the image display system including a window management module and a screen management module, the method comprising the steps of:
the screen management module sets screen parameters of a virtual screen and constructs the virtual screen according to the screen parameters;
the window management module constructs a display window for each running application to obtain a plurality of display windows;
and the screen management module draws the constructed display windows in a virtual screen so that the computing equipment can continuously run the application.
2. The method of claim 1, wherein the computing device further comprises a communication interface adapted to connect to a physical screen, the screen management module comprising mode options comprising a physical screen and a virtual screen, the method further comprising:
the screen management module determines whether the computing equipment is connected with a physical screen according to the communication interface;
if the computing equipment is determined to be connected with a physical screen, the screen management module sets the mode option as the physical screen;
and acquiring screen parameters of the physical screen, and drawing a display window in the physical screen according to the display window constructed by the window management module.
3. The method of claim 2, further comprising:
if the computing equipment is determined not to be connected with a physical screen, the screen management module sets the mode option as a virtual screen;
setting screen parameters of the virtual screen, and constructing the virtual screen according to the virtual screen parameters.
4. The method of claim 1, wherein the screen management module sets model parameters of a virtual screen, and the constructing of the virtual screen according to the screen parameters comprises the steps of:
setting the height, width and refreshing frequency of the virtual screen;
and constructing the size of a virtual screen according to the width and the height of the virtual screen, and determining the frequency of drawing the display window by the virtual screen according to the refreshing frequency.
5. The method of claim 4, wherein the window management module building a display window for each application running comprises the steps of:
determining a display window according to the running state of the application;
and adding a label of a virtual screen to the display window so that the window management module can draw the display window.
6. The method of claim 5, wherein the screen management module draws the constructed plurality of display windows in a virtual screen comprising the steps of:
acquiring the display window and identifying the label of the display window;
and if the label is identified to be a virtual screen, drawing the display window in the virtual screen.
7. The method of claim 6, wherein the computing device includes a memory, and drawing the display window in the virtual screen comprises:
obtaining an allocated memory block from a memory of a computing device, the content block being used to store display window data;
performing association operation on the memory block and the virtual screen;
drawing a display window in the memory block subjected to the association operation;
and combining the display windows drawn in all the memory blocks associated with the virtual screen to obtain the memory block of the virtual screen, wherein the display window drawn by the current virtual screen is stored in the content block of the virtual screen.
8. The method of claim 7, further comprising:
when the screen management module constructs a virtual screen and draws a display window in the virtual screen, the screen management module receives a screen capturing instruction from a user;
the screen management module acquires stored display information from the memory block of the virtual screen according to the screen capturing instruction, wherein the display information comprises all display windows drawn by the current virtual screen;
and storing the display information in a screenshot picture, and storing the screenshot picture in a memory.
9. A computing device, comprising:
one or more processors;
a memory;
the image display system of any one of claims 1-8; and
one or more apparatuses comprising instructions for performing any of the methods of claims 1-8.
10. A computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computing device, cause the computing device to perform any of the methods of claims 1-8.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110231746.3A CN112965771B (en) | 2021-03-02 | 2021-03-02 | Virtual screen construction method, computing device and storage medium |
| PCT/CN2021/124289 WO2022183742A1 (en) | 2021-03-02 | 2021-10-18 | Virtual screen construction method, computing device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110231746.3A CN112965771B (en) | 2021-03-02 | 2021-03-02 | Virtual screen construction method, computing device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112965771A true CN112965771A (en) | 2021-06-15 |
| CN112965771B CN112965771B (en) | 2024-02-23 |
Family
ID=76277477
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110231746.3A Active CN112965771B (en) | 2021-03-02 | 2021-03-02 | Virtual screen construction method, computing device and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112965771B (en) |
| WO (1) | WO2022183742A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114327723A (en) * | 2021-12-28 | 2022-04-12 | 阿波罗智联(北京)科技有限公司 | Application processing method, device and equipment based on virtual screen and storage medium |
| CN114489421A (en) * | 2021-12-08 | 2022-05-13 | 统信软件技术有限公司 | Virtual screen generation method, computing device and storage medium |
| WO2022183742A1 (en) * | 2021-03-02 | 2022-09-09 | 统信软件技术有限公司 | Virtual screen construction method, computing device, and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1941066A (en) * | 2005-09-28 | 2007-04-04 | 联想(北京)有限公司 | Multiple display device system and method for automatically setting display-mode |
| US20090091537A1 (en) * | 2007-10-03 | 2009-04-09 | Intentec Corporation | Electronic device with automatic switching input interfaces and switching method thereof |
| US20100293504A1 (en) * | 2009-05-15 | 2010-11-18 | Kabushiki Kaisha Toshiba | Information processing apparatus, display control method, and program |
| CN102495711A (en) * | 2011-11-15 | 2012-06-13 | 中兴通讯股份有限公司 | Virtual multi-screen implementation method and device |
| US20140245194A1 (en) * | 2013-02-28 | 2014-08-28 | Apple Inc. | System and method for virtual displays |
| CN110471734A (en) * | 2019-08-19 | 2019-11-19 | 东软集团股份有限公司 | A kind of display control method and device |
| CN111736942A (en) * | 2020-08-20 | 2020-10-02 | 北京爱奇艺智能科技有限公司 | Multi-application scene display method and device in VR system and VR equipment |
| CN112015359A (en) * | 2019-05-28 | 2020-12-01 | 华为技术有限公司 | Display method and electronic equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112965771B (en) * | 2021-03-02 | 2024-02-23 | 北京深之度科技有限公司 | Virtual screen construction method, computing device and storage medium |
-
2021
- 2021-03-02 CN CN202110231746.3A patent/CN112965771B/en active Active
- 2021-10-18 WO PCT/CN2021/124289 patent/WO2022183742A1/en unknown
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1941066A (en) * | 2005-09-28 | 2007-04-04 | 联想(北京)有限公司 | Multiple display device system and method for automatically setting display-mode |
| US20090091537A1 (en) * | 2007-10-03 | 2009-04-09 | Intentec Corporation | Electronic device with automatic switching input interfaces and switching method thereof |
| US20100293504A1 (en) * | 2009-05-15 | 2010-11-18 | Kabushiki Kaisha Toshiba | Information processing apparatus, display control method, and program |
| CN102495711A (en) * | 2011-11-15 | 2012-06-13 | 中兴通讯股份有限公司 | Virtual multi-screen implementation method and device |
| US20140245194A1 (en) * | 2013-02-28 | 2014-08-28 | Apple Inc. | System and method for virtual displays |
| CN112015359A (en) * | 2019-05-28 | 2020-12-01 | 华为技术有限公司 | Display method and electronic equipment |
| CN110471734A (en) * | 2019-08-19 | 2019-11-19 | 东软集团股份有限公司 | A kind of display control method and device |
| CN111736942A (en) * | 2020-08-20 | 2020-10-02 | 北京爱奇艺智能科技有限公司 | Multi-application scene display method and device in VR system and VR equipment |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022183742A1 (en) * | 2021-03-02 | 2022-09-09 | 统信软件技术有限公司 | Virtual screen construction method, computing device, and storage medium |
| CN114489421A (en) * | 2021-12-08 | 2022-05-13 | 统信软件技术有限公司 | Virtual screen generation method, computing device and storage medium |
| CN114327723A (en) * | 2021-12-28 | 2022-04-12 | 阿波罗智联(北京)科技有限公司 | Application processing method, device and equipment based on virtual screen and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022183742A1 (en) | 2022-09-09 |
| CN112965771B (en) | 2024-02-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112965771B (en) | Virtual screen construction method, computing device and storage medium | |
| US8384738B2 (en) | Compositing windowing system | |
| CN105786424B (en) | The method that the quick split screen display available of the single-screen of embedded system solves | |
| CN109683841B (en) | Control display method and computing device in multi-display environment | |
| EP3726357B1 (en) | Electronic apparatus and controlling method thereof | |
| WO2023143280A1 (en) | Method for rendering image and related apparatus | |
| US20060288299A1 (en) | System and method for performing an interface save/restore procedure | |
| CN1279430C (en) | Digital document processing | |
| JPH03206552A (en) | Display processing system | |
| US20170192673A1 (en) | Information processing apparatus, information processing method, and information processing program | |
| CN109828733B (en) | Method and computing device for respectively and independently displaying multiple display terminals | |
| WO2023174328A1 (en) | Screen control method and apparatus, electronic device, and storage medium | |
| CN113885758B (en) | Virtual screen generation method, computing device and storage medium | |
| CN114489552B (en) | Remote display control system, remote control interface display method and computing equipment | |
| CN114510307B (en) | Dynamic wallpaper implementation method, computing device and storage medium | |
| CN112037339B (en) | Image processing method, apparatus and storage medium | |
| KR20100084338A (en) | Method and apparatus for image drawing | |
| CN117078499B (en) | Dual-graphics-card rendering processing method and device, computing equipment and readable storage medium | |
| US9134946B2 (en) | Electronic apparatus and method for data transmission from an electronic apparatus to a display device | |
| CN104516694B (en) | Image display method and electronic equipment | |
| JP6716409B2 (en) | Information processing equipment | |
| JPH0348929A (en) | Display control system | |
| CN117971058A (en) | Digital board calling method and device, electronic equipment and storage medium | |
| CN114237535A (en) | Split screen display implementation method and device and computing equipment | |
| CN111522520A (en) | Processing method, device, equipment and storage medium of software imitation paper |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20210615 Assignee: Tongxin Software Technology Co.,Ltd. Assignor: BEIJING SHENZHIDU TECHNOLOGY Co.,Ltd. Contract record no.: X2021980009936 Denomination of invention: A virtual screen construction method, computing device and storage medium License type: Common License Record date: 20210927 |
|
| EE01 | Entry into force of recordation of patent licensing contract | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |