CN111273880A - Remote display method and device based on cloud intelligent equipment - Google Patents
Remote display method and device based on cloud intelligent equipment Download PDFInfo
- Publication number
- CN111273880A CN111273880A CN202010034051.1A CN202010034051A CN111273880A CN 111273880 A CN111273880 A CN 111273880A CN 202010034051 A CN202010034051 A CN 202010034051A CN 111273880 A CN111273880 A CN 111273880A
- Authority
- CN
- China
- Prior art keywords
- type
- application
- cloud
- remote
- remote display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The embodiment of the invention provides a remote display method and a remote display device based on cloud intelligent equipment, wherein the method comprises the following steps: determining a remote display type suitable for active application in cloud intelligent equipment; selecting a remote equipment display mode matched with the remote display type according to the remote display type; and displaying the activity application according to the display mode of the remote equipment. According to the embodiment of the invention, the matched remote equipment display mode is dynamically selected according to the remote display type suitable for the activity application in the cloud intelligent equipment, so that the activity application in the cloud intelligent equipment can be displayed in a more matched display mode when the remote equipment remotely displays.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a remote display method and device based on cloud intelligent equipment.
Background
Together, cloud computing and mobile devices constitute a powerful user tool. Cloud computing provides access to storage resources at large processing power and large locations, while mobile devices provide the ability to access and interact with cloud computing resources from anywhere at any time. Based on the theoretical basis, the concept of the cloud mobile phone is proposed.
As the name suggests, the cloud mobile phone is a mobile phone virtualized in a cloud server, and is not a mobile phone in a real physical sense. The building principle of the cloud mobile phone is as follows: the android mobile phone system is installed on the cloud server, similar to the way that a windows system is installed on a desktop computer, and then the cloud mobile phone is virtualized. Because the mobile phone is virtualized in the cloud server, the user needs a client (operating end) installed on the remote device to operate the mobile phone when the user wants to operate the mobile phone. The client here may be a client installed on a PC, an APP installed on a mobile phone, or the like. For example, if a cloud mobile phone is operated through a PC or a mobile phone, a corresponding application needs to be installed at the PC end or the mobile phone end, and then the cloud mobile phone is operated by opening the application. In addition, the cloud mobile phone can be operated in a webpage login mode.
The cloud mobile phone is a mobile phone virtualized at a cloud server side, so the cloud mobile phone does not have some real input and output devices, such as a mouse, a keyboard, a touch screen, a display device and the like. Therefore, if the user wants to browse or watch the related content in the cloud mobile phone, the related content needs to be displayed by means of the remote device where the client is located. At present, when the remote equipment displays the relevant content of the cloud mobile phone, one display mode is often adopted by default for all cloud mobile phone applications for remote display, so that the problems of poor display effect or unreasonable bandwidth utilization can be caused.
Disclosure of Invention
Aiming at the problems in the prior art, the embodiment of the invention provides a remote display method and device based on cloud intelligent equipment.
In a first aspect, an embodiment of the present invention provides a remote display method based on a cloud-end smart device, including:
determining a remote display type suitable for active application in cloud intelligent equipment; the active application is an application in an open state in the cloud intelligent device;
selecting a remote equipment display mode matched with the remote display type according to the remote display type;
and displaying the activity application according to the display mode of the remote equipment.
Further, the determining of the remote display type suitable for the active application in the cloud-end intelligent device specifically includes:
determining a remote display type suitable for the activity application according to the type of the activity application in the cloud intelligent equipment;
if the type of the activity application is a video type application, determining that a remote display type suitable for the activity application is a first type;
if the type of the activity application is game application, determining that the suitable remote display type of the activity application is a second type;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
Further, the determining of the remote display type suitable for the active application in the cloud-end intelligent device specifically includes:
inquiring a preset data table according to an identification of a movable application in cloud intelligent equipment, and determining a remote display type suitable for the movable application; the preset data table stores mapping relations between the identifications of various applications in the cloud intelligent device and the suitable first type or second type in advance;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
Further, the determining of the remote display type suitable for the active application in the cloud-end intelligent device specifically includes:
acquiring a scene interface of an activity application in cloud intelligent equipment;
inputting the scene interface into a preset application type prediction model, and predicting an application type corresponding to the scene interface;
determining the predicted application type as a remote display type suitable for the active application in the cloud intelligent device;
the preset application type prediction model is obtained by training based on a machine learning algorithm, wherein a scene interface of a first type of application and a scene interface of a second type of application which are acquired in advance are used as sample input data, and an application type corresponding to the scene interface in the sample input data is used as sample output data;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
Further, the determining of the remote display type suitable for the active application in the cloud-end intelligent device specifically includes:
judging whether the texture loading capacity of the active application in the cloud intelligent equipment exceeds a preset threshold value, if so, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a first type, and otherwise, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a second type;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
Further, the determining of the remote display type suitable for the active application in the cloud-end intelligent device specifically includes:
judging whether the active application in the cloud intelligent equipment needs to directly call a preset function related to rendering, if so, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a second type, and otherwise, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a first type;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
In a second aspect, an embodiment of the present invention further provides a remote display apparatus based on a cloud-end smart device, including:
the determining module is used for determining a remote display type suitable for the activity application in the cloud intelligent equipment; the active application is an application in an open state in the cloud intelligent device;
the selection module is used for selecting a remote equipment display mode matched with the remote display type according to the remote display type;
and the display control module is used for displaying the activity application according to the display mode of the remote equipment.
In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the steps of the cloud-based intelligent device-based remote display method according to the first aspect.
In a fourth aspect, an embodiment of the present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the cloud-based remote display method according to the first aspect.
In a fifth aspect, an embodiment of the present invention further provides a computer program product, where the computer program product has executable instructions stored thereon, and when the instructions are executed by a processor, the processor implements the steps of the cloud-based smart device remote display method according to the first aspect.
According to the technical scheme, the cloud-based remote display method and the cloud-based remote display device provided by the embodiment of the invention have the advantages that the matched remote device display mode is dynamically selected according to the remote display type suitable for the activity application in the cloud-based intelligent device, so that the activity application in the cloud-based intelligent device can be displayed in a more matched display mode when the remote device remotely displays.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a flowchart of a remote display method based on a cloud-end smart device according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a remote display device based on a cloud-based smart device according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Before the content of the embodiment of the present invention is introduced, two concepts of the lower cloud-end smart device and the client-side need to be briefly described. The cloud intelligent device is a virtual machine which is virtualized on the cloud server, and the client refers to a client (such as a smart phone, a mobile device, an automobile, a personal computer, a tablet computer, a personal digital assistant and the like) which can remotely operate the cloud intelligent device. The cloud intelligent device and the client generally establish communication through a distributed network, and since the cloud intelligent device is a virtual machine and has no input/output device, when operating the application on the cloud intelligent device, input and output operations need to be performed by means of the input/output device of the client device, for example, input operations (such as input operations of clicking, sliding and the like) are performed on the application on the cloud intelligent device through the client, and output operations (such as content display and the like of related applications on the cloud intelligent device) are performed on the application on the cloud intelligent device through the client. The remote display method described in the following embodiments of the present invention is: and remotely displaying the related content of the cloud intelligent equipment at the client. The remote display method based on the cloud-end intelligent device provided by the invention is described in detail through specific embodiments.
Fig. 1 shows a flowchart of a remote display method based on a cloud-end smart device according to an embodiment of the present invention. As shown in fig. 1, the remote display method based on the cloud-end smart device provided by the embodiment of the present invention includes the following steps:
step 101: determining a remote display type suitable for active application in cloud intelligent equipment;
in this step, the cloud-end smart device may be a cloud mobile phone, a cloud computer, a cloud watch, or other smart devices, which is not limited in this embodiment. In this step, the active application in the cloud-side intelligent device refers to an application in an open state in the cloud-side intelligent device, and may also be understood as an application in which a user is operating in the cloud-side intelligent device. For example, suppose that a user is opening a video playing APP in the cloud-end smart device for playing a video, at this time, the video playing APP is an active application in the cloud-end smart device. For another example, suppose that a user is opening a game APP in the cloud-end smart device for playing a game, at this time, the game APP is an active application in the cloud-end smart device.
In this step, determining a remote display type suitable for the active application in the cloud-end smart device refers to determining a display type suitable for the active application in the mobile phone when the remote device remotely displays the active application, and particularly, determining a display type suitable for the active application in the cloud-end smart device when the remote device remotely displays the active application in the mobile network environment, where the display type suitable for the active application in the cloud-end smart device remotely displays the active application in the mobile network environment refers to a display type that requires a relatively low bandwidth in the display process and does not greatly affect the display effect. The remote display type here may include live and remote rendering. For example, if the active application in the cloud-side smart device is a game-type application, the suitable remote display type is remote rendering, and if the active application in the cloud-side smart device is a video-type application, the suitable remote display type is live broadcasting. The reason is that the texture load of the game application is low, and the bandwidth can be saved by adopting a remote rendering display mode, while the texture load of the video application is high, and if the remote rendering display mode is adopted, a large bandwidth is needed, and the realization of the video application is particularly difficult for a mobile network.
In this step, it should be noted that the cloud-side smart device is a virtual machine virtualized on the cloud server, and the remote device refers to a remote device (such as a smart phone, a mobile device, an automobile, a personal computer, a tablet computer, a personal digital assistant, and the like) capable of remotely operating the cloud-side smart device. The cloud intelligent device and the remote device generally establish communication through a distributed network, and since the cloud intelligent device is a virtual machine and has no input/output device, when the application on the cloud intelligent device is operated, the input/output device of the remote device needs to be used for input and output operations, for example, the remote device performs input operations (such as click playing) on the application on the cloud intelligent device, and in the process, an output result (playing content) of the operated application on the cloud intelligent device is returned to the remote device through the distributed network to be displayed.
Step 102: selecting a remote equipment display mode matched with the remote display type according to the remote display type;
in this step, a remote device display mode matched with the remote display type is selected according to the remote display type, for example, when the remote display type is determined to be a live type, the remote display type is indicated to be a live application, and therefore the selected matched remote device display mode is a live display mode; when the remote display type is the second type, the remote display type is an application suitable for remote rendering, and therefore the selected matched remote device display mode is a remote rendering display mode.
Step 103: and displaying the activity application according to the display mode of the remote equipment.
In this step, the active application is displayed on the remote device of the cloud-side smart device according to the remote device display mode selected in step 102. For example, when the display mode of the remote device selected in step 102 is a live broadcast display mode, the screen display content of the cloud-end intelligent device active application is collected in a pixel mode, compressed, encoded and transmitted, and decoded and displayed on the remote device; and when the remote equipment display mode selected in the step 102 is a remote rendering display mode, acquiring textures and drawing instructions applied by the cloud intelligent equipment activity, and executing a GPU command by the remote equipment.
As can be seen from the foregoing technical solutions, in the remote display method based on the cloud-side intelligent device provided in the embodiments of the present invention, a remote display type suitable for an active application in the cloud-side intelligent device is first determined, then a remote device display mode matched with the remote display type is selected according to the remote display type, and finally the active application is displayed according to the remote device display mode. Therefore, the matched remote equipment display mode is dynamically selected according to the remote display type suitable for the activity application in the cloud intelligent equipment, so that the activity application in the cloud intelligent equipment can be displayed in a more matched display mode when the remote equipment remotely displays.
Based on the content of the foregoing embodiment, in this embodiment, the step 101 of determining the remote display type suitable for the activity application in the cloud-end smart device may specifically be implemented in the following manner:
determining a remote display type suitable for the activity application according to the type of the activity application in the cloud intelligent equipment;
if the type of the activity application is a video type application, determining that a remote display type suitable for the activity application is a first type;
if the type of the activity application is game application, determining that the suitable remote display type of the activity application is a second type;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
In this embodiment, it should be noted that the remote live broadcasting mode is characterized by a larger bandwidth and a lower definition, and the remote rendering mode is characterized by a lower bandwidth than the live broadcasting mode when the texture content is small, but a higher bandwidth when the texture content is very large. Based on the characteristics of the two remote display modes, in this embodiment, when the remote display type suitable for the activity application in the cloud-side intelligent device is determined, the remote display type suitable for the activity application can be determined according to the type of the activity application in the cloud-side intelligent device; for example, if the type of the active application is a video application, it indicates that the texture amount required to be transmitted is large, and since the remote live broadcast mode has a characteristic of large bandwidth, it can be determined that the remote display type suitable for the video application is remote live broadcast; if the type of the active application is game application, it is indicated that the texture quantity required to be transmitted is small, and because the remote rendering mode has the characteristic that the bandwidth is lower than that of a live mode when the texture content is small, the remote display type suitable for the game application can be determined to be remote rendering. Therefore, the advantages of the live broadcast mode and the remote rendering mode are comprehensively utilized, different remote display modes are selected according to different types of the activity application, and low-bandwidth smooth display can be achieved.
Based on the content of the foregoing embodiment, in this embodiment, the step 101 of determining the remote display type suitable for the activity application in the cloud-end smart device may specifically be implemented in the following manner:
inquiring a preset data table according to an identification of a movable application in cloud intelligent equipment, and determining a remote display type suitable for the movable application; the preset data table stores mapping relations between the identifications of various applications in the cloud intelligent device and the suitable first type or second type in advance;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
In this embodiment, the remote display type suitable for the active application in the cloud-end intelligent device is determined according to a preset data table, and since the preset data table stores the mapping relationship between the identifier of each application in the cloud-end intelligent device and the suitable first type or second type in advance, when the remote display type suitable for the active application in the cloud-end intelligent device is determined, whether the suitable remote display type is remote rendering or live broadcasting can be obtained by inquiring the preset data table.
In this embodiment, it should be noted that the preset data table may be previously established manually or may be previously established by a machine learning method. For example, a mapping relationship between the identifier of the video application and the live broadcast display type may be established in the preset data table manually in advance, and a mapping relationship between the identifier of the game application and the remote rendering type may be established, so that it may be obtained subsequently in a manner of querying the preset data table whether the remote display type suitable for the active application in the cloud-end intelligent device is remote rendering or live broadcast.
Based on the content of the foregoing embodiment, in this embodiment, the step 101 of determining the remote display type suitable for the activity application in the cloud-end smart device may specifically be implemented in the following manner:
acquiring a scene interface of an activity application in cloud intelligent equipment;
inputting the scene interface into a preset application type prediction model, and predicting an application type corresponding to the scene interface;
determining the predicted application type as a remote display type suitable for the active application in the cloud intelligent device;
the preset application type prediction model is obtained by training based on a machine learning algorithm, wherein a scene interface of a first type of application and a scene interface of a second type of application which are acquired in advance are used as sample input data, and an application type corresponding to the scene interface in the sample input data is used as sample output data;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
In this embodiment, when determining the remote display type suitable for the activity application in the cloud-side intelligent device, the determination and the identification are performed according to the scene interface of the activity application in the cloud-side intelligent device, for example, when the scene interface of the activity application in the cloud-side intelligent device is a game scene interface, it may be determined that the suitable remote display type is remote rendering; for another example, when a scene interface of an active application in the cloud-end smart device is a video playing scene interface, it may be determined that a suitable remote display type is live broadcast.
In this embodiment, when determining a remote display type suitable for an active application in the cloud-side intelligent device according to a scene interface, processing may be performed in a machine learning manner, specifically, a scene interface of the active application in the cloud-side intelligent device may be obtained first, then the scene interface is input into a preset application type prediction model, an application type corresponding to the scene interface is predicted, and finally the predicted application type is determined as the remote display type suitable for the active application in the cloud-side intelligent device; the preset application type prediction model is obtained by training based on a machine learning algorithm, wherein a scene interface of a first type of application and a scene interface of a second type of application which are acquired in advance are used as sample input data, and an application type corresponding to the scene interface in the sample input data is used as sample output data. It should be noted that, in order to improve the prediction accuracy, when preparing sample input data, it is necessary to prepare as many scene interfaces belonging to a first type of application as possible (for example, scene interfaces capable of capturing various game-class applications) and as many scene interfaces belonging to a second type of application as possible (for example, scene interfaces capable of capturing various video-class applications), so as to help improve the accuracy of prediction by using the prediction model subsequently.
Based on the content of the foregoing embodiment, in this embodiment, the step 101 of determining the remote display type suitable for the activity application in the cloud-end smart device may specifically be implemented in the following manner:
judging whether the texture loading capacity of the active application in the cloud intelligent equipment exceeds a preset threshold value, if so, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a first type, and otherwise, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a second type;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
In this embodiment, it should be noted that the live broadcasting mode is characterized by a larger bandwidth and a lower definition, and the remote rendering mode is characterized by a lower bandwidth than the live broadcasting mode when the texture content is small, but a higher bandwidth when the texture content is very large. Based on the characteristics of the two remote display modes, in this embodiment, when determining the remote display type suitable for the active application in the cloud-end intelligent device, it may be determined whether the remote display mode adopting remote rendering is suitable or the remote display mode adopting live broadcast is suitable by determining whether the texture load of the active application in the cloud-end intelligent device exceeds a preset threshold. For example, when the texture load exceeds a preset threshold of 2MB, it is determined that a live-rendering display mode is appropriate, and when the texture load is less than or equal to the preset threshold of 2MB, it is determined that a remote-rendering display mode is appropriate. Therefore, the embodiment comprehensively utilizes the advantages of the live broadcast mode and the remote rendering mode, and particularly can realize smooth display with low bandwidth in a mobile network.
Based on the content of the foregoing embodiment, in this embodiment, the step 101 of determining the remote display type suitable for the activity application in the cloud-end smart device may specifically be implemented in the following manner:
judging whether the active application in the cloud intelligent equipment needs to directly call a preset function related to rendering, if so, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a second type, and otherwise, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a first type;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
In this embodiment, the preset function related to rendering may be an opengl (Open Graphics Library) function, where opengl is a cross-language and cross-platform Application Programming Interface (API) for rendering 2D and 3D vector Graphics, and the opengl function refers to an API interface function related to rendering.
In this embodiment, when determining the remote display type suitable for the active application in the cloud-side intelligent device, the suitable remote display type can be determined by determining whether the active application in the cloud-side intelligent device needs to directly call the opengl-related function. For example, game-like applications are generally more suitable in remote rendering, while video-like applications are generally more suitable in live rendering. The game application generally calls opengl related functions directly, and the video application generally does not call opengl related functions directly, so that according to the characteristics, the remote display type suitable for the active application in the cloud intelligent device is determined by judging whether the active application in the cloud intelligent device needs to call the opengl related functions directly or not. When judging that the active application in the cloud intelligent device directly calls the opengl related function, it is indicated that the active application in the cloud intelligent device belongs to the game application, and therefore the appropriate remote display type can be determined to be remote rendering. When judging that the active application in the cloud intelligent device does not need to directly call opengl-related functions, it is indicated that the active application in the cloud intelligent device belongs to video-class applications, and therefore it can be determined that the suitable remote display type is live broadcast.
Based on the content of the foregoing embodiment, in this embodiment, the step 101 of determining the remote display type suitable for the activity application in the cloud-end smart device may specifically be implemented in the following manner:
judging whether a window created by the active application in the cloud intelligent equipment is a window of a specified type, if so, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a second type, and otherwise, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a first type; the specified type window is a specific window created for rendering processing;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
In this embodiment, since some game applications may create some specific windows when performing rendering processing, it is possible to determine a remote display type suitable for an active application in a mobile phone by determining whether a window created by the active application in the cloud-based smart device is a window of a specified type. For example, when it is determined that the window created by the active application in the cloud-side smart device is the window of the designated type, it is described that the active application in the cloud-side smart device belongs to the application of the game class, and therefore it can be determined that the suitable remote display type is remote rendering. When the window created by the active application in the cloud intelligent device is judged and known not to be the window of the designated type, the active application in the cloud intelligent device belongs to the application of the video type, and therefore the appropriate remote display type of the active application can be determined to be live broadcast.
Therefore, the embodiment simultaneously supports the remote display schemes of the two modes, and can automatically switch according to the remote display mode suitable for the detected application. The embodiment comprehensively utilizes the advantages of a live broadcast mode and a remote rendering mode, and particularly can realize smooth display with low bandwidth in a mobile network.
Fig. 2 is a schematic structural diagram of a remote display apparatus based on a cloud-end smart device according to an embodiment of the present invention. As shown in fig. 2, a remote display apparatus based on a cloud-end smart device provided in an embodiment of the present invention includes: a determining module 21, a selecting module 22 and a display control module 23, wherein:
the determining module 21 is configured to determine a remote display type suitable for an active application in the cloud-end smart device; the active application is an application in an open state in the cloud intelligent device;
the selecting module 22 is configured to select a remote device display mode matched with the remote display type according to the remote display type;
and the display control module 23 is configured to display the active application according to the remote device display mode.
Based on the content of the foregoing embodiment, in this embodiment, the determining module 21 is specifically configured to:
determining a remote display type suitable for the activity application according to the type of the activity application in the cloud intelligent equipment;
if the type of the activity application is a video type application, determining that a remote display type suitable for the activity application is a first type;
if the type of the activity application is game application, determining that the suitable remote display type of the activity application is a second type;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
Based on the content of the foregoing embodiment, in this embodiment, the determining module 21 is specifically configured to:
inquiring a preset data table according to an identification of a movable application in cloud intelligent equipment, and determining a remote display type suitable for the movable application; the preset data table stores mapping relations between the identifications of various applications in the cloud intelligent device and the suitable first type or second type in advance;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
Based on the content of the foregoing embodiment, in this embodiment, the determining module 21 is specifically configured to:
acquiring a scene interface of an activity application in cloud intelligent equipment;
inputting the scene interface into a preset application type prediction model, and predicting an application type corresponding to the scene interface;
determining the predicted application type as a remote display type suitable for the active application in the cloud intelligent device;
the preset application type prediction model is obtained by training based on a machine learning algorithm, wherein a scene interface of a first type of application and a scene interface of a second type of application which are acquired in advance are used as sample input data, and an application type corresponding to the scene interface in the sample input data is used as sample output data;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
Based on the content of the foregoing embodiment, in this embodiment, the determining module 21 is specifically configured to:
judging whether the texture loading capacity of the active application in the cloud intelligent equipment exceeds a preset threshold value, if so, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a first type, and otherwise, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a second type;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
Based on the content of the foregoing embodiment, in this embodiment, the determining module 21 is specifically configured to:
judging whether the active application in the cloud intelligent equipment needs to directly call a preset function related to rendering, if so, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a second type, and otherwise, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a first type;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
Since the remote display apparatus based on the cloud-end smart device provided by the embodiment of the present invention can be used for executing the remote display method based on the cloud-end smart device described in the above embodiment, the working principle and the beneficial effect are similar, so detailed descriptions are omitted here, and specific contents can be referred to the description of the above embodiment.
Based on the same inventive concept, another embodiment of the present invention provides an electronic device, which specifically includes the following components, with reference to fig. 3: a processor 301, a memory 302, a communication interface 303, and a communication bus 304;
the processor 301, the memory 302 and the communication interface 303 complete mutual communication through the communication bus 304;
the processor 301 is configured to call a computer program in the memory 302, and when the processor executes the computer program, the processor implements all the steps of the above remote display method based on the cloud-end smart device, for example, when the processor executes the computer program, the processor implements the following processes: determining a remote display type suitable for active application in cloud intelligent equipment; selecting a remote equipment display mode matched with the remote display type according to the remote display type; and displaying the activity application according to the display mode of the remote equipment.
It will be appreciated that the detailed functions and extended functions that the computer program may perform may be as described with reference to the above embodiments.
Based on the same inventive concept, another embodiment of the present invention provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements all the steps of the cloud-based remote display method, for example, when the processor executes the computer program, the processor implements the following processes: determining a remote display type suitable for active application in cloud intelligent equipment; selecting a remote equipment display mode matched with the remote display type according to the remote display type; and displaying the activity application according to the display mode of the remote equipment.
It will be appreciated that the detailed functions and extended functions that the computer program may perform may be as described with reference to the above embodiments.
Based on the same inventive concept, another embodiment of the present invention provides a computer program product, having executable instructions stored thereon, which when executed by a processor, cause the processor to implement all the steps of the cloud-based remote display method as described above. For example, the instructions, when executed by the processor, cause the processor to perform the following: determining a remote display type suitable for active application in cloud intelligent equipment; selecting a remote equipment display mode matched with the remote display type according to the remote display type; and displaying the activity application according to the display mode of the remote equipment.
In addition, the logic instructions in the memory may be implemented in the form of software functional units and may be stored in a computer readable storage medium when sold or used as a stand-alone product. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment of the present invention. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. Based on such understanding, the foregoing technical solutions may be substantially implemented or contributed by the present technology to form a software product, where the computer software product may be stored in a computer readable storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, and the like, and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device) to execute the cloud-based remote display method according to the embodiments or some portions of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A remote display method based on cloud intelligent equipment is characterized by comprising the following steps:
determining a remote display type suitable for active application in cloud intelligent equipment; the active application is an application in an open state in the cloud intelligent device;
selecting a remote equipment display mode matched with the remote display type according to the remote display type;
and displaying the activity application according to the display mode of the remote equipment.
2. The cloud-based remote display method of claim 1, wherein the determining of the remote display type suitable for the active application in the cloud-based smart device specifically comprises:
determining a remote display type suitable for the activity application according to the type of the activity application in the cloud intelligent equipment;
if the type of the activity application is a video type application, determining that a remote display type suitable for the activity application is a first type;
if the type of the activity application is game application, determining that the suitable remote display type of the activity application is a second type;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
3. The cloud-based remote display method of claim 1, wherein the determining of the remote display type suitable for the active application in the cloud-based smart device specifically comprises:
inquiring a preset data table according to an identification of a movable application in cloud intelligent equipment, and determining a remote display type suitable for the movable application; the preset data table stores mapping relations between the identifications of various applications in the cloud intelligent device and the suitable first type or second type in advance;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
4. The cloud-based remote display method of claim 1, wherein the determining of the remote display type suitable for the active application in the cloud-based smart device specifically comprises:
acquiring a scene interface of an activity application in cloud intelligent equipment;
inputting the scene interface into a preset application type prediction model, and predicting an application type corresponding to the scene interface;
determining the predicted application type as a remote display type suitable for the active application in the cloud intelligent device;
the preset application type prediction model is obtained by training based on a machine learning algorithm, wherein a scene interface of a first type of application and a scene interface of a second type of application which are acquired in advance are used as sample input data, and an application type corresponding to the scene interface in the sample input data is used as sample output data;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
5. The cloud-based remote display method of claim 1, wherein the determining of the remote display type suitable for the active application in the cloud-based smart device specifically comprises:
judging whether the texture loading capacity of the active application in the cloud intelligent equipment exceeds a preset threshold value, if so, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a first type, and otherwise, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a second type;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
6. The cloud-based remote display method of claim 1, wherein the determining of the remote display type suitable for the active application in the cloud-based smart device specifically comprises:
judging whether the active application in the cloud intelligent equipment needs to directly call a preset function related to rendering, if so, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a second type, and otherwise, determining that the remote display type suitable for the active application in the cloud intelligent equipment is a first type;
the first type is a type displayed through live broadcasting, and the second type is a type displayed through remote rendering.
7. The utility model provides a remote display device based on high in clouds smart machine which characterized in that includes:
the determining module is used for determining a remote display type suitable for the activity application in the cloud intelligent equipment; the active application is an application in an open state in the cloud intelligent device;
the selection module is used for selecting a remote equipment display mode matched with the remote display type according to the remote display type;
and the display control module is used for displaying the activity application according to the display mode of the remote equipment.
8. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor executes the program to implement the steps of the cloud-based remote display method according to any one of claims 1 to 6.
9. A non-transitory computer readable storage medium, having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the cloud-based remote display method according to any one of claims 1 to 6.
10. A computer program product having executable instructions stored thereon, wherein the instructions, when executed by a processor, cause the processor to perform the steps of the cloud-based remote display method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010034051.1A CN111273880B (en) | 2020-01-13 | 2020-01-13 | Remote display method and device based on cloud intelligent equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010034051.1A CN111273880B (en) | 2020-01-13 | 2020-01-13 | Remote display method and device based on cloud intelligent equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111273880A true CN111273880A (en) | 2020-06-12 |
| CN111273880B CN111273880B (en) | 2023-09-08 |
Family
ID=70998927
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010034051.1A Active CN111273880B (en) | 2020-01-13 | 2020-01-13 | Remote display method and device based on cloud intelligent equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111273880B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112929246A (en) * | 2021-01-29 | 2021-06-08 | 百度在线网络技术（北京）有限公司 | Processing method of operation instruction, storage medium, program product and user terminal |
| WO2022048255A1 (en) * | 2020-09-07 | 2022-03-10 | 华为云计算技术有限公司 | Data processing method and system, cloud terminal, server, and computing device |
| WO2023277251A1 (en) * | 2021-06-29 | 2023-01-05 | Samsung Electronics Co., Ltd. | A method and system to suggest and control operations on a handheld device for remote display |
| TWI796887B (en) * | 2021-12-21 | 2023-03-21 | 宏碁股份有限公司 | Graphic resource allocation method and graphic resource allocation system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108052368A (en) * | 2017-12-28 | 2018-05-18 | 维沃移动通信有限公司 | A kind of application display interface control method and mobile terminal |
| CN108762934A (en) * | 2018-06-02 | 2018-11-06 | 北京泽塔云科技股份有限公司 | Remote graphics Transmission system, method and Cloud Server |
| US20190221001A1 (en) * | 2018-01-18 | 2019-07-18 | Oath Inc. | Computer vision on broadcast video |
| GB201909447D0 (en) * | 2019-07-01 | 2019-08-14 | Sony Interactive Entertainment Inc | Method and device for generating video frames |
| CN110413365A (en) * | 2019-07-29 | 2019-11-05 | 锐捷网络股份有限公司 | A kind of fusion dispatching method and device |
-
2020
- 2020-01-13 CN CN202010034051.1A patent/CN111273880B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108052368A (en) * | 2017-12-28 | 2018-05-18 | 维沃移动通信有限公司 | A kind of application display interface control method and mobile terminal |
| US20190221001A1 (en) * | 2018-01-18 | 2019-07-18 | Oath Inc. | Computer vision on broadcast video |
| CN108762934A (en) * | 2018-06-02 | 2018-11-06 | 北京泽塔云科技股份有限公司 | Remote graphics Transmission system, method and Cloud Server |
| GB201909447D0 (en) * | 2019-07-01 | 2019-08-14 | Sony Interactive Entertainment Inc | Method and device for generating video frames |
| CN110413365A (en) * | 2019-07-29 | 2019-11-05 | 锐捷网络股份有限公司 | A kind of fusion dispatching method and device |
Non-Patent Citations (3)
| Title |
|---|
| MIKE JIA: "Optimal Cloudlet Placement and User to Cloudlet Allocation in Wireless Metropolitan Area Networks" * |
| 姜邦杰;吴俊敏;朱小东;李科君;罗琳;张朋飞;胡蝶;: "基于KVM的远程声卡显卡虚拟化技术" * |
| 罗俊松: "基于Qt 的三维可视化技术研究" * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022048255A1 (en) * | 2020-09-07 | 2022-03-10 | 华为云计算技术有限公司 | Data processing method and system, cloud terminal, server, and computing device |
| CN112929246A (en) * | 2021-01-29 | 2021-06-08 | 百度在线网络技术（北京）有限公司 | Processing method of operation instruction, storage medium, program product and user terminal |
| WO2023277251A1 (en) * | 2021-06-29 | 2023-01-05 | Samsung Electronics Co., Ltd. | A method and system to suggest and control operations on a handheld device for remote display |
| TWI796887B (en) * | 2021-12-21 | 2023-03-21 | 宏碁股份有限公司 | Graphic resource allocation method and graphic resource allocation system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111273880B (en) | 2023-09-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111273880B (en) | Remote display method and device based on cloud intelligent equipment | |
| US10268336B2 (en) | User interface displaying and processing method and user interface displaying and processing device | |
| WO2019114185A1 (en) | App remote control method and related devices | |
| US20230215076A1 (en) | Image frame display method, apparatus, device, storage medium, and program product | |
| CN112257135A (en) | Model loading method and device based on multithreading, storage medium and terminal | |
| CN109309842B (en) | Live broadcast data processing method and device, computer equipment and storage medium | |
| CN111258693B (en) | Remote display method and device | |
| CN113808231B (en) | Information processing method and device, image rendering method and device, and electronic device | |
| US20220076476A1 (en) | Method for generating user avatar, related apparatus and computer program product | |
| CN110694267A (en) | Cloud game implementation method and device | |
| EP2827597B1 (en) | Adaptive content delivery | |
| CN108810132B (en) | Animation display method, device, terminal, server and storage medium | |
| CN109302523B (en) | Mobile phone performance evaluation method for mobile phone side and server side | |
| CN110189385B (en) | Model training and picture compression and decompression method and device, medium and electronic equipment | |
| US20160255135A1 (en) | Method and apparatus for displaying processing status | |
| CN113470092B (en) | Terrain rendering method and device, electronic equipment and storage medium | |
| CN111698210B (en) | Cloud mobile phone handle data processing method and system and storage medium | |
| CN111143017B (en) | Cloud operation system interaction processing method, client and cloud operation system | |
| CN110012003B (en) | Cloud application screen capturing method and device | |
| CN115861510A (en) | Object rendering method, device, electronic equipment, storage medium and program product | |
| CN115908687A (en) | Method and device for training rendering network, method and device for rendering network, and electronic equipment | |
| CN114020396A (en) | Display method of application program and data generation method of application program | |
| CN114748873A (en) | Interface rendering method, device, equipment and storage medium | |
| CN111243069B (en) | Scene switching method and system of Unity3D engine | |
| CN113836455A (en) | Special effect rendering method, device, equipment, storage medium and computer program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Room 332, 3 / F, Building 102, 28 xinjiekouwei street, Xicheng District, Beijing 100088 Applicant after: Qianxin Technology Group Co.,Ltd. Applicant after: Qianxin Wangshen information technology (Beijing) Co.,Ltd. Address before: Room 332, 3 / F, Building 102, 28 xinjiekouwei street, Xicheng District, Beijing 100088 Applicant before: Qianxin Technology Group Co.,Ltd. Applicant before: LEGENDSEC INFORMATION TECHNOLOGY (BEIJING) Inc. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |