CN111258693B - Remote display method and device - Google Patents
Remote display method and device Download PDFInfo
- Publication number
- CN111258693B CN111258693B CN202010034053.0A CN202010034053A CN111258693B CN 111258693 B CN111258693 B CN 111258693B CN 202010034053 A CN202010034053 A CN 202010034053A CN 111258693 B CN111258693 B CN 111258693B
- Authority
- CN
- China
- Prior art keywords
- type
- window element
- remote
- remote display
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000009877 rendering Methods 0.000 claims description 44
- 230000006870 function Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 13
- 238000004891 communication Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Abstract
The embodiment of the invention provides a remote display method and a device, wherein the method comprises the following steps: determining each window element contained in the cloud intelligent device application window; determining a suitable remote display type of each window element; determining a client display mode matched with each window element according to the suitable remote display type of each window element; and remotely displaying each window element according to the display mode of the client matched with each window element. According to the embodiment of the invention, different window elements contained in the cloud intelligent device application window can be displayed on the client device in a matched remote display mode.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a remote display method and apparatus.
Background
Cloud computing and mobile devices together constitute a powerful user tool. Cloud computing provides access to vast processing power and storage resources at a large number of locations, while mobile devices provide the ability to access and interact with cloud computing resources from anywhere at any time. Based on the theoretical basis, the concept of a cloud mobile phone is proposed.
Cloud mobile phones, as their name suggests, are mobile phones that are virtualized in a cloud server, rather than a real physical mobile phone. The construction principle of the cloud mobile phone is as follows: and installing an android mobile phone system on the cloud server, and then virtualizing the cloud mobile phone, similar to installing a windows system on a desktop computer. Because the mobile phone is a mobile phone virtualized in the cloud server, a user needs to operate the mobile phone by using a client device, and corresponding control software needs to be installed on the client device. For example, if the cloud mobile phone is to be operated by a PC or a mobile phone, a corresponding application needs to be installed on the PC or the mobile phone, and then the cloud mobile phone is operated by opening the application. In addition, the cloud mobile phone can be operated in a webpage login mode.
Because the cloud mobile phone is a mobile phone which is virtualized at the cloud server, the cloud mobile phone does not have real input and output devices such as a mouse, a keyboard, a touch screen, a display device and the like. Therefore, if one wants to browse or view the related content in the cloud mobile phone, the related content needs to be displayed by means of the client device. At present, when the client device is used for displaying the related content of the cloud mobile phone, the cloud mobile phone application is often remotely displayed in a default display mode, so that the problems of poor display effect or unreasonable bandwidth utilization can be caused.
Disclosure of Invention
Aiming at the problems in the prior art, the embodiment of the invention provides a remote display method and a remote display device.
In a first aspect, an embodiment of the present invention provides a remote display method, including: determining each window element contained in the cloud intelligent device application window;
determining a suitable remote display type of each window element;
determining a client display mode matched with each window element according to the suitable remote display type of each window element;
and remotely displaying each window element according to the display mode of the client matched with each window element.
Further, the determining the suitable remote display type of each window element specifically includes:
judging each window element respectively, if judging that the texture loading amount of the window element exceeds a preset threshold, determining that the remote display type suitable for the window element is a first type, otherwise, determining that the remote display type suitable for the window element is a second type;
the first type is a type of remote display through live broadcast, and the second type is a type of remote display through remote rendering.
Further, the determining the suitable remote display type of each window element specifically includes:
judging each window element respectively, if judging that the window element needs to directly call a preset function related to rendering, determining that the remote display type suitable for the window element is a second type, otherwise, determining that the remote display type suitable for the window element is a first type;
the first type is a type of remote display through live broadcast, and the second type is a type of remote display through remote rendering.
Further, the remote display of each window element according to the client display mode matched with each window element specifically includes:
determining attribute information of each window element;
creating a proxy window at the client;
and displaying each window element in the proxy window according to the attribute information of each window element and the display mode of the client matched with each window element.
In a second aspect, an embodiment of the present invention further provides a remote display device, including:
the first determining module is used for determining window elements contained in the cloud intelligent device application window;
the second determining module is used for determining the suitable remote display type of each window element;
the third determining module is used for determining a client display mode matched with each window element according to the remote display type suitable for each window element;
and the display control module is used for remotely displaying the window elements according to the display modes of the clients matched with the window elements.
Further, the second determining module is specifically configured to:
judging each window element respectively, if judging that the texture loading amount of the window element exceeds a preset threshold, determining that the remote display type suitable for the window element is a first type, otherwise, determining that the remote display type suitable for the window element is a second type;
the first type is a type of remote display through live broadcast, and the second type is a type of remote display through remote rendering.
Further, the second determining module is specifically configured to:
judging each window element respectively, if judging that the window element needs to directly call a preset function related to rendering, determining that the remote display type suitable for the window element is a second type, otherwise, determining that the remote display type suitable for the window element is a first type;
the first type is a type of remote display through live broadcast, and the second type is a type of remote display through remote rendering.
In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor implements the steps of the remote display method according to the first aspect when the processor executes the program.
In a fourth aspect, embodiments of the present invention also provide a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the remote display method according to the first aspect.
In a fifth aspect, embodiments of the present invention also provide a computer program product having stored thereon executable instructions which when executed by a processor cause the processor to perform the steps of the remote display method according to the first aspect.
According to the remote display method and device provided by the embodiment of the invention, the window elements contained in the application window of the cloud intelligent device are classified, so that the suitable remote display type of each window element is determined, and further, different display modes are adopted for displaying when the client device carries out remote display according to the suitable remote display type of each window element, so that different window elements contained in the application window of the cloud intelligent device can be displayed on the client device in a matched remote display mode.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions of the prior art, the following description will briefly explain the drawings used in the embodiments or the description of the prior art, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flow chart of a remote display method according to an embodiment of the invention;
FIG. 2 is a schematic diagram of a remote display device according to an embodiment of the invention;
fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Before introducing the content of the embodiment of the invention, two concepts of the cloud-end intelligent device and the client end need to be briefly described. The cloud intelligent device is a virtual machine virtualized on a cloud server, and the client is a client (such as a smart phone, a mobile device, an automobile, a personal computer, a tablet personal computer, a personal digital assistant and the like) capable of remotely operating the cloud intelligent device. The cloud intelligent device and the client generally establish communication through a distributed network, and because the cloud intelligent device is a virtual machine and has no input/output device, when an application on the cloud intelligent device is operated, input and output operations need to be performed by means of the input/output device of the client device, for example, input operations (such as clicking, sliding and other input operations) are performed on the application on the cloud intelligent device through the client, and output operations (such as performing output operations of content display and the like of related applications on the cloud intelligent device) are performed on the application on the cloud intelligent device through the client. The remote display method introduced in the following embodiment of the present invention is: and carrying out remote display of the related content of the cloud intelligent equipment at the client. The remote display method provided by the invention will be described in detail by specific embodiments.
Fig. 1 shows a flowchart of a remote display method according to an embodiment of the present invention. As shown in fig. 1, the remote display method provided by the embodiment of the invention includes the following steps:
step 101: determining each window element contained in the cloud intelligent device application window;
in this step, the cloud intelligent device may be an intelligent device such as a cloud mobile phone, a cloud computer, a cloud watch, etc., which is not limited in this embodiment.
In this step, the window element applies elements such as a video frame map, a bullet screen UI, characters, a game interface, a status bar, and a task bar included in the window. Because the applicable remote display types of different window elements are different, the applicable remote display modes can be respectively selected for the different window elements in the application window. For example, an application window includes two window elements, namely a video frame image and a barrage UI, and a live broadcast display mode can be adopted for the window element of the video frame image in the application window, and a rendering display mode can be adopted for the window element of the barrage UI.
In this step, it is necessary to determine each window element included in the cloud intelligent device application window, for example, if the cloud intelligent device application window is an application window of a barrage video scene, the window elements included in the cloud intelligent device application window include a video frame map and a barrage UI. For another example, assume that the cloud smart device application window is an application window of a game scene, and the window elements included in the cloud smart device application window include a game interface, a status bar and a navigation bar.
Step 102: determining a suitable remote display type of each window element;
in this step, a suitable remote display type of each window element is determined, for example, for the application window of the bullet screen video scene, where the suitable remote display type of the window element, i.e., the video frame diagram, is live broadcast display, and the suitable remote display type of the window element, i.e., the bullet screen UI, is remote rendering. This is because the video frame map has a large data load (also called texture load) and is not suitable for remote rendering, otherwise it occupies a large bandwidth, while the bullet screen UI has a small data load (only a part of text) and only changes the position of the bullet screen most of the time, so that only some simple update commands need to be executed, and thus it is more suitable for remote rendering.
In this step, determining the suitable remote display type of each window element refers to determining the suitable display type of each window element when the client device remotely displays the window element, and particularly determining the suitable display type of each window element included in the cloud intelligent device application window when the client device remotely displays the window element in a mobile network environment, where the suitable display type when the client device remotely displays the window element refers to a display type that requires relatively low bandwidth and does not affect the display effect too much. Remote display types herein may include live and remote rendering. For example, for some application windows, the application window includes three window elements, namely, a status bar above, a navigation bar below, and an operation desktop in the middle, the status bar and the navigation bar are suitable for being displayed in a remote rendering mode due to a small data updating amount, and for the middle operation desktop, the operation desktop is suitable for being displayed in a remote broadcasting mode due to a large data updating amount.
In this step, it should be noted that the cloud intelligent device is a virtual machine virtualized on the cloud server, and the client device is a remote device (such as a smart phone, a mobile device, an automobile, a personal computer, a tablet computer, a personal digital assistant, etc.) capable of remotely operating the cloud intelligent device. The cloud intelligent device and the client device generally establish communication through the distributed network, and because the cloud intelligent device is a virtual machine and has no input/output device, when an application on the cloud intelligent device is operated, input and output operations need to be performed by means of the input/output device of the client device, for example, input operations (such as clicking playing) are performed on the application on the cloud intelligent device through the remote device, and meanwhile, in the process, an output result (playing content) of the operated application on the cloud intelligent device is returned to the client device through the distributed network for display.
Step 103: determining a client display mode matched with each window element according to the suitable remote display type of each window element;
in this step, after determining the suitable remote display type of each window element, determining the client display mode matched with each window element according to the suitable remote display type of each window element. For example, judging each window element respectively, and if the remote display type suitable for the window element is a live broadcast display type, selecting a client display mode matched with the window element as a live broadcast display mode; and if the remote display type suitable for the window element is the remote rendering display type, selecting a client display mode matched with the window element as the remote rendering display mode.
Step 104: and remotely displaying each window element according to the display mode of the client matched with each window element.
In this step, after determining the client display mode matching each window element, remote display is performed on each window element according to the client display mode matching each window element. It should be noted that, because each window element included in the cloud intelligent device application window is displayed in different display modes, when the client device displays, each window element needs to be combined, and when the client device combines, the content of the window element needs to be reasonably displayed according to the size, the position, the transparency and other attributes of each window element. For example, when a window element, i.e., a bullet screen UI, is displayed on a client device, the application window of a bullet screen video scene needs to be displayed according to its size, position, transparency, and other attributes.
According to the technical scheme, in the remote display method provided by the embodiment of the invention, the window elements contained in the application window of the cloud intelligent device are classified, so that the suitable remote display types of the window elements are determined, and further, different display modes are adopted for displaying when the client device is in remote display according to the suitable remote display types of the window elements, so that the different window elements contained in the application window of the cloud intelligent device can be displayed on the client device in the matched remote display modes.
Based on the content of the foregoing embodiment, in this embodiment, the determining, in the step 102, the suitable remote display type of each window element may be specifically implemented by the following manner:
judging each window element respectively, if judging that the texture loading amount of the window element exceeds a preset threshold, determining that the remote display type suitable for the window element is a first type, otherwise, determining that the remote display type suitable for the window element is a second type;
the first type is a type of remote display through live broadcast, and the second type is a type of remote display through remote rendering.
In this embodiment, it should be noted that, the live mode is characterized by a large bandwidth and low definition, and the remote rendering mode is characterized by a lower bandwidth than the live mode when the texture content is small, but a higher bandwidth when the texture is very large. Based on the characteristics of the two remote display modes, in this embodiment, when determining the suitable remote display type of each window element, whether the remote display mode adopting remote rendering is suitable or the remote display mode adopting live broadcast is suitable may be determined by determining whether the texture loading amount of each window element exceeds a preset threshold. For example, when the texture load exceeds a preset threshold of 2MB, it is determined that the display mode using live broadcasting is appropriate, and when the texture load is less than or equal to the preset threshold of 2MB, it is determined that the display mode using remote rendering is appropriate. Therefore, the embodiment comprehensively utilizes the advantages of the live broadcast mode and the remote rendering mode, and particularly can realize low-bandwidth high-definition display under a mobile network.
Based on the content of the foregoing embodiment, in this embodiment, the determining, in the step 102, the suitable remote display type of each window element may be specifically implemented by the following manner:
judging each window element respectively, if judging that the window element needs to directly call a preset function related to rendering, determining that the remote display type suitable for the window element is a second type, otherwise, determining that the remote display type suitable for the window element is a first type;
the first type is a type of remote display through live broadcast, and the second type is a type of remote display through remote rendering.
In this embodiment, the preset function related to rendering may be an opengl related function, where opengl (open graphics library ) is a cross-language, cross-platform Application Programming Interface (API) for rendering 2D, 3D vector graphics, and the opengl related function refers to an API interface function related to rendering.
In this embodiment, when determining the suitable remote display type of each window element, the suitable remote display type may be determined by determining whether the active application in the cloud intelligent device needs to directly call the opengl related function. For example, for a window element of a barrage UI, since it will generally directly call an opengl related function, and a window element of a video frame map will generally not directly call an opengl related function, according to this feature, the remote display type suitable for the window element is determined by determining whether the window element needs to directly call the opengl related function. When judging that the window element needs to directly call the opengl related function, the window element is indicated to belong to the application of the infrequently loaded data class, so that the suitable remote display type can be determined to be remote rendering. When judging that the window element does not need to directly call the opengl related function, the window element is indicated to belong to the application of frequently loading data class, so that the suitable remote display type can be determined to be live broadcast.
Based on the content of the foregoing embodiment, in this embodiment, the determining, in step 103, a client display manner matched with each window element according to the remote display type suitable for each window element may be specifically implemented by the following manner:
judging each window element respectively, and if the remote display type suitable for the window element is the first type, selecting a client display mode matched with the window element as a live broadcast display mode; and if the remote display type suitable for the window element is the second type, selecting a client display mode matched with the window element as a remote rendering display mode.
Based on the content of the foregoing embodiment, in this embodiment, the step 104 includes performing remote display on each window element according to a client display mode matched with each window element, and specifically includes:
determining attribute information of each window element;
creating a proxy window at the client;
and displaying each window element in the proxy window according to the attribute information of each window element and the display mode of the client matched with each window element.
In this embodiment, the attribute information of the window element refers to the size, position, type, transparency, and the like of the window element.
In this embodiment, the process of creating the proxy window at the client is: and acquiring the attributes such as the length and width, the type and the like of the window from the cloud, and creating a proxy window at the client through the display memory corresponding to the local application window of the client. The display content in the window, such as buttons, pictures, characters and the like, is also obtained from the server, is laid out according to the length, the width, the position, the transparency and the like of the window, and finally, the content of all the windows is drawn on a display memory after textures are generated, and is displayed locally. The corresponding relation between the proxy window and the application window on the cloud intelligent device is one-to-one, namely, one proxy window corresponds to one application window on the cloud intelligent device.
In this embodiment, it is necessary to detect the window elements included in the application window on the cloud intelligent device, and the size, position, transparency and other attribute information of the window elements, so as to ensure that when the window elements are displayed on the client device, each window element can be displayed on the client device in a combined manner according to the attribute information of each window element. When the client device displays the window, the client device is required to create a corresponding proxy window, and then the window elements are displayed in combination in the corresponding proxy window according to the attribute information of the window elements and the client display mode matched with the window elements.
As can be seen from the above description, in this embodiment, the operation object is changed from a coarse-grained application window to a fine-grained window element, and a corresponding display mode is selected according to a display type suitable for the window element. For example, for a barrage video scene, a video frame is displayed in a live manner, and a barrage UI window element is displayed in a remote rendering manner, so that the embodiment comprehensively utilizes the advantages of a live manner and a remote rendering manner, and particularly under a mobile network, can realize low-bandwidth high-definition display.
Fig. 2 is a schematic structural diagram of a remote display device according to an embodiment of the present invention. As shown in fig. 2, a remote display device provided in an embodiment of the present invention includes: a first determination module 21, a second determination module 22, a third determination module 23, and a display control module 24, wherein:
the first determining module 21 is configured to determine each window element included in the cloud intelligent device application window;
a second determining module 22, configured to determine a remote display type suitable for each window element;
a third determining module 23, configured to determine a client display mode matched with each window element according to a remote display type suitable for each window element;
and the display control module 24 is used for remotely displaying each window element according to the display mode of the client matched with each window element.
Further, based on the content of the foregoing embodiment, in this embodiment, the second determining module is specifically configured to:
judging each window element respectively, if judging that the texture loading amount of the window element exceeds a preset threshold, determining that the remote display type suitable for the window element is a first type, otherwise, determining that the remote display type suitable for the window element is a second type;
the first type is a type of remote display through live broadcast, and the second type is a type of remote display through remote rendering.
Further, based on the content of the foregoing embodiment, in this embodiment, the second determining module is specifically configured to:
judging each window element respectively, if judging that the window element needs to directly call a preset function related to rendering, determining that the remote display type suitable for the window element is a second type, otherwise, determining that the remote display type suitable for the window element is a first type;
the first type is a type of remote display through live broadcast, and the second type is a type of remote display through remote rendering.
Further, based on the content of the foregoing embodiment, in this embodiment, the third determining module is specifically configured to:
judging each window element respectively, and if the remote display type suitable for the window element is the first type, selecting a client display mode matched with the window element as a live broadcast display mode; and if the remote display type suitable for the window element is the second type, selecting a client display mode matched with the window element as a remote rendering display mode.
Further, based on the content of the foregoing embodiment, in this embodiment, the display control module is specifically configured to:
determining attribute information of each window element;
creating a proxy window at the client;
and displaying each window element in the proxy window according to the attribute information of each window element and the display mode of the client matched with each window element.
The remote display device provided by the embodiment of the invention can be used for executing the remote display method described in the above embodiment, and the working principle and the beneficial effects of the remote display device are similar, so that the detailed description is omitted herein, and the specific content can be seen from the description of the above embodiment.
Based on the same inventive concept, a further embodiment of the present invention provides an electronic device, see fig. 3, comprising in particular: a processor 301, a memory 302, a communication interface 303, and a communication bus 304;
wherein, the processor 301, the memory 302, and the communication interface 303 complete communication with each other through the communication bus 304;
the processor 301 is configured to invoke a computer program in the memory 302, where the processor executes the computer program to implement all the steps of the remote display method described above, for example, the processor executes the computer program to implement the following procedures: determining each window element contained in the cloud intelligent device application window; determining a suitable remote display type of each window element; determining a client display mode matched with each window element according to the suitable remote display type of each window element; and remotely displaying each window element according to the display mode of the client matched with each window element.
It will be appreciated that the refinement and expansion functions that the computer program may perform are as described with reference to the above embodiments.
Based on the same inventive concept, a further embodiment of the present invention provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements all the steps of the above remote display method, for example, the processor implementing the following procedure when executing the computer program: determining each window element contained in the cloud intelligent device application window; determining a suitable remote display type of each window element; determining a client display mode matched with each window element according to the suitable remote display type of each window element; and remotely displaying each window element according to the display mode of the client matched with each window element.
It will be appreciated that the refinement and expansion functions that the computer program may perform are as described with reference to the above embodiments.
Based on the same inventive concept, a further embodiment of the present invention provides a computer program product having stored thereon executable instructions that when executed by a processor cause the processor to perform all the steps of the above-described remote display method, for example, the instructions when executed by the processor cause the processor to perform the following procedure: determining each window element contained in the cloud intelligent device application window; determining a suitable remote display type of each window element; determining a client display mode matched with each window element according to the suitable remote display type of each window element; and remotely displaying each window element according to the display mode of the client matched with each window element.
Further, the logic instructions in the memory described above may be implemented in the form of software functional units and stored in a computer-readable storage medium when sold or used as a stand-alone product. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, randomAccess Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The apparatus embodiments described above are merely illustrative, wherein the elements illustrated as separate elements may or may not be physically separate, and the elements shown as elements may or may not be physical elements, may be located in one place, or may be distributed over a plurality of network elements. Some or all of the modules can be selected according to actual needs to achieve the purpose of the embodiment of the invention. Those of ordinary skill in the art will understand and implement the present invention without undue burden.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on such understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform the remote display method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (9)
1. A remote display method, comprising:
determining each window element contained in the cloud intelligent device application window;
determining a suitable remote display type of each window element;
determining a client display mode matched with each window element according to the suitable remote display type of each window element; the remote display type is a display type suitable for each window element when the client device remotely displays, and comprises a live broadcast display type and a remote rendering display type; if the remote display type suitable for the window element is a live broadcast display type, selecting a client display mode matched with the window element as a live broadcast display mode; if the remote display type suitable for the window element is the remote rendering display type, selecting a client display mode matched with the window element as a remote rendering display mode;
and remotely displaying each window element according to the display mode of the client matched with each window element.
2. The remote display method according to claim 1, wherein the determining the suitable remote display type for each window element specifically includes:
judging each window element respectively, if judging that the texture loading amount of the window element exceeds a preset threshold, determining that the remote display type suitable for the window element is a first type, otherwise, determining that the remote display type suitable for the window element is a second type;
the first type is a type of remote display through live broadcast, and the second type is a type of remote display through remote rendering.
3. The remote display method according to claim 1, wherein the determining the suitable remote display type for each window element specifically includes:
judging each window element respectively, if judging that the window element needs to directly call a preset function related to rendering, determining that the remote display type suitable for the window element is a second type, otherwise, determining that the remote display type suitable for the window element is a first type;
the first type is a type of remote display through live broadcast, and the second type is a type of remote display through remote rendering.
4. A remote display method according to claim 2 or 3, wherein the remote display of each window element according to a client display mode matched with each window element specifically includes:
determining attribute information of each window element;
creating a proxy window at the client;
and displaying each window element in the proxy window according to the attribute information of each window element and the display mode of the client matched with each window element.
5. A remote display device, comprising:
the first determining module is used for determining window elements contained in the cloud intelligent device application window;
the second determining module is used for determining the suitable remote display type of each window element;
the third determining module is used for determining a client display mode matched with each window element according to the remote display type suitable for each window element; the remote display type is a display type suitable for each window element when the client device remotely displays, and comprises a live broadcast display type and a remote rendering display type; if the remote display type suitable for the window element is a live broadcast display type, selecting a client display mode matched with the window element as a live broadcast display mode; if the remote display type suitable for the window element is the remote rendering display type, selecting a client display mode matched with the window element as a remote rendering display mode;
and the display control module is used for remotely displaying the window elements according to the display modes of the clients matched with the window elements.
6. The remote display device according to claim 5, wherein the second determining module is specifically configured to:
judging each window element respectively, if judging that the texture loading amount of the window element exceeds a preset threshold, determining that the remote display type suitable for the window element is a first type, otherwise, determining that the remote display type suitable for the window element is a second type;
the first type is a type of remote display through live broadcast, and the second type is a type of remote display through remote rendering.
7. The remote display device according to claim 5, wherein the second determining module is specifically configured to:
judging each window element respectively, if judging that the window element needs to directly call a preset function related to rendering, determining that the remote display type suitable for the window element is a second type, otherwise, determining that the remote display type suitable for the window element is a first type;
the first type is a type of remote display through live broadcast, and the second type is a type of remote display through remote rendering.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the remote display method of any one of claims 1 to 4 when the program is executed by the processor.
9. A non-transitory computer readable storage medium having stored thereon a computer program, which when executed by a processor, implements the steps of the remote display method according to any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010034053.0A CN111258693B (en) | 2020-01-13 | 2020-01-13 | Remote display method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010034053.0A CN111258693B (en) | 2020-01-13 | 2020-01-13 | Remote display method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111258693A CN111258693A (en) | 2020-06-09 |
| CN111258693B true CN111258693B (en) | 2024-04-09 |
Family
ID=70950374
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010034053.0A Active CN111258693B (en) | 2020-01-13 | 2020-01-13 | Remote display method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111258693B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111814220B (en) * | 2020-07-03 | 2021-03-26 | 重庆丰鼎科技有限责任公司 | CAE cloud simulation implementation method |
| CN112202825A (en) * | 2020-12-09 | 2021-01-08 | 江苏北弓智能科技有限公司 | Remote mobile cloud desktop transmission system and method |
| CN114567659B (en) * | 2022-02-25 | 2023-11-14 | 北京百度网讯科技有限公司 | Cloud mobile phone control method, device, equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015000054A1 (en) * | 2013-07-02 | 2015-01-08 | Youi Labs Inc. | System and method for streamlining user interface development |
| CN105979339A (en) * | 2016-05-25 | 2016-09-28 | 腾讯科技（深圳）有限公司 | Window display method and client |
| CN107015746A (en) * | 2017-03-06 | 2017-08-04 | 北京潘达互娱科技有限公司 | A kind of interface element processing method and processing device |
| CN107741806A (en) * | 2011-07-29 | 2018-02-27 | 谷歌有限责任公司 | System and method for rendering user interface element according to device type |
| WO2019072096A1 (en) * | 2017-10-10 | 2019-04-18 | 腾讯科技（深圳）有限公司 | Interactive method, device, system and computer readable storage medium in live video streaming |
-
2020
- 2020-01-13 CN CN202010034053.0A patent/CN111258693B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107741806A (en) * | 2011-07-29 | 2018-02-27 | 谷歌有限责任公司 | System and method for rendering user interface element according to device type |
| WO2015000054A1 (en) * | 2013-07-02 | 2015-01-08 | Youi Labs Inc. | System and method for streamlining user interface development |
| CN105979339A (en) * | 2016-05-25 | 2016-09-28 | 腾讯科技（深圳）有限公司 | Window display method and client |
| CN107015746A (en) * | 2017-03-06 | 2017-08-04 | 北京潘达互娱科技有限公司 | A kind of interface element processing method and processing device |
| WO2019072096A1 (en) * | 2017-10-10 | 2019-04-18 | 腾讯科技（深圳）有限公司 | Interactive method, device, system and computer readable storage medium in live video streaming |
Non-Patent Citations (2)
| Title |
|---|
| 李春雷 ; 倪俊芳 ; .基于Open GL对STL文件描述实体的渲染技术研究.苏州大学学报(工科版).2006,(第04期),全文. * |
| 罗俊松 ; 邓飞 ; 卢涵宇 ; 罗俊凯 ; .基于Qt的三维可视化技术研究.计算机测量与控制.2013,(第03期),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111258693A (en) | 2020-06-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111258693B (en) | Remote display method and device | |
| JP6092381B2 (en) | Method, system, and computer-readable storage medium for providing access to a remote application via a web client | |
| KR101159359B1 (en) | Method and system for a target device display simulation | |
| CN111273880B (en) | Remote display method and device based on cloud intelligent equipment | |
| CN110377263B (en) | Image synthesis method, image synthesis device, electronic equipment and storage medium | |
| US20170285883A1 (en) | User interface displaying and processing method and user interface displaying and processing device | |
| CN113368492A (en) | Rendering method and device | |
| US20170359280A1 (en) | Audio/video processing method and device | |
| CN113655975B (en) | Image display method, image display device, electronic apparatus, and medium | |
| GB2524047A (en) | Improvements in and relating to rendering of graphics on a display device | |
| CN106648602B (en) | Page loading method | |
| WO2009080285A1 (en) | A method, module and device for displaying graphical information | |
| CN112799801A (en) | Method, device, equipment and medium for drawing simulation mouse pointer | |
| CN112614210A (en) | Engineering drawing display method, system and related device | |
| CN115861510A (en) | Object rendering method, device, electronic equipment, storage medium and program product | |
| CN115988265A (en) | Rendering method and device of display picture and terminal equipment | |
| CN111708533B (en) | Method and device for setting mouse display state in application thin client | |
| CN114020396A (en) | Display method of application program and data generation method of application program | |
| Zielinski et al. | Enabling closed-source applications for virtual reality via opengl intercept-based techniques | |
| CN111243069B (en) | Scene switching method and system of Unity3D engine | |
| CN114429513A (en) | Method and device for determining visible element, storage medium and electronic equipment | |
| CN113934500A (en) | Rendering method, rendering device, storage medium and electronic equipment | |
| CN114904274A (en) | Picture rendering method and device of cloud game, electronic equipment and storage medium | |
| CN111143018A (en) | Front-end image rendering method and device and electronic equipment | |
| CA2741743C (en) | Hardware accelerated caret rendering |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Room 332, 3 / F, Building 102, 28 xinjiekouwei street, Xicheng District, Beijing 100088 Applicant after: Qianxin Technology Group Co.,Ltd. Applicant after: Qianxin Wangshen information technology (Beijing) Co.,Ltd. Address before: Room 332, 3 / F, Building 102, 28 xinjiekouwei street, Xicheng District, Beijing 100088 Applicant before: Qianxin Technology Group Co.,Ltd. Applicant before: LEGENDSEC INFORMATION TECHNOLOGY (BEIJING) Inc. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |