CN111479013B - Screen display method and device, cloud server and system - Google Patents

Screen display method and device, cloud server and system Download PDF

Info

Publication number
CN111479013B
CN111479013B CN202010257830.8A CN202010257830A CN111479013B CN 111479013 B CN111479013 B CN 111479013B CN 202010257830 A CN202010257830 A CN 202010257830A CN 111479013 B CN111479013 B CN 111479013B
Authority
CN
China
Prior art keywords
information
video stream
user equipment
cloud server
receiving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010257830.8A
Other languages
Chinese (zh)
Other versions
CN111479013A (en
Inventor
甄成刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHENZHEN ZOOKING SOFTWARE Co.,Ltd.
Original Assignee
Beijing Zhangku Times Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zhangku Times Technology Co ltd filed Critical Beijing Zhangku Times Technology Co ltd
Priority to CN202010257830.8A priority Critical patent/CN111479013B/en
Publication of CN111479013A publication Critical patent/CN111479013A/en
Application granted granted Critical
Publication of CN111479013B publication Critical patent/CN111479013B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469—User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/55—Push-based network services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging

Abstract

The invention discloses a screen display method, a screen display device, a cloud server and a screen display system, and relates to the field of communication. The method and the device are invented for solving the problems that the application range of the existing scheme for not unlocking and using the application program/browsing the content is limited and the user experience is poor. The method comprises the following steps: s10, user equipment receives first operation of a user on an information element displayed on a screen locking interface of the user equipment, wherein the information element comprises at least one of an application icon, an application detail interface and a general graphic element; s20, the user equipment sends first operation information corresponding to the first operation to a pre-connected cloud server; s30, after receiving the first operation information, the cloud server transforms a view corresponding to the first operation information to generate a first video stream, and sends the first video stream to the user equipment; and S40, the user equipment receives the first video stream sent by the cloud server and displays the first video stream on a screen locking interface.

Description

Screen display method and device, cloud server and system
Technical Field
The invention relates to the field of communication, in particular to a screen display method, a screen display device, a cloud server and a screen display system.
Background
In recent years, with the popularization of smart terminals (such as smart phones), in order to prevent users or others from mistakenly touching and pressing to cause wrong operations, a lock screen is generally arranged on the smart terminal. The intelligent terminal user needs to find the application program or the content by lightening and unlocking the screen when the intelligent terminal user wants to use the application program or browse the content, and the application program or the content can be used or browsed only after the application program or the content is triggered. The method has the disadvantages of complex operation, low efficiency and inconvenient use.
The prior art presents several solutions to the above-mentioned problems. For example, chinese patent application (CN 104317484A) proposes a screen locking system with an application screen, in which a user can operate a corresponding application program without unlocking, but this solution requires setting different display screens including a screen locking interface main screen, a switch screen and an application screen, and is a direct operation on an installation program inside an intelligent terminal, and thus the visible solution is complex and has a limited applicable range. The solution proposed by another chinese invention patent (CN 104899056A) for operating application directly without unlocking is also only for application installed inside the intelligent terminal.
Therefore, the existing solution only performs direct operation without unlocking for the installed application programs of the intelligent terminal, and the intelligent terminal of the user can only install the application programs with limited number, so that the application range is limited, and some application programs installed by the local computer need authentication, so that the starting is limited in the screen locking state, and the user experience is poor. Under the condition that the screen locking operation is only performed on the installed application program, even if the intelligent terminal has the function of operating the application program without unlocking, if the application program required by the user is not pre-installed in the intelligent terminal or the user identity authentication is required, the function of operating the application program without unlocking cannot be used, and the purpose of facilitating the user cannot be achieved.
Disclosure of Invention
In view of the above, the main purpose of the present invention is to solve the problems of limited application range and poor user experience of the existing solution for not unlocking and using an application program/browsing contents.
In one aspect, an embodiment of the present invention provides a screen display method, where the method includes the following steps:
s10, user equipment receives first operation of a user on an information element displayed on a screen locking interface of the user equipment, wherein the information element comprises at least one of an application icon, an application detail interface and a general graphic element;
s20, the user equipment sends first operation information corresponding to the first operation to a pre-connected cloud server;
s30, after receiving the first operation information, the cloud server transforms a view corresponding to the first operation information to generate a first video stream, and sends the first video stream to the user equipment;
and S40, the user equipment receives the first video stream sent by the cloud server and displays the first video stream on a screen locking interface.
On the other hand, the embodiment of the invention provides a screen display method, which is applied to user equipment and comprises the following steps:
A10. receiving a first operation of a user on an information element displayed on a screen locking interface of the user equipment, wherein the information element comprises at least one of an application icon, an application detail interface and a general graphic element;
A20. sending first operation information corresponding to the first operation to a pre-connected cloud server, enabling the cloud server to convert a view corresponding to the first operation information to generate a first video stream, and then returning the first video stream;
A30. and receiving a first video stream sent by the cloud server, and displaying the first video stream on a screen locking interface.
On the other hand, the embodiment of the invention provides a screen display method, which is applied to a cloud server and comprises the following steps:
B10. receiving first operation information sent by user equipment connected in advance, wherein the first operation information corresponds to first operation of an information element displayed on a screen locking interface of the user equipment by a user, and the information element comprises at least one of an application icon, an application detail interface and a general graphic element;
B20. and transforming the view corresponding to the first operation information to generate a first video stream, and sending the first video stream to the user equipment, so that the user equipment displays the first video stream on a screen locking interface.
In another aspect, an embodiment of the present invention provides a screen display system, including:
the system comprises user equipment and a display unit, wherein the user equipment is used for receiving first operation of an information element displayed by a screen locking interface of the user equipment by a user, and the information element comprises at least one of an application icon, an application detail interface and a general graphic element; sending first operation information corresponding to the first operation to a cloud server; and receiving a first video stream sent by the cloud server according to the first operation information, and displaying the first video stream on a screen locking interface.
The cloud server is connected with the user equipment and used for receiving the first operation information, converting the view corresponding to the first operation information to generate a first video stream, and sending the first video stream to the user equipment.
In another aspect, there is provided a screen display device including:
the first operation unit is used for receiving a first operation of a user on an information element displayed on a screen locking interface of the user equipment, wherein the information element comprises at least one of an application icon, an application detail interface and a general graphic element;
the first operation sending unit is connected with the first operation unit and used for sending first operation information corresponding to the first operation to a pre-connected cloud server, so that the cloud server transforms a view corresponding to the first operation information to generate a first video stream and returns the first video stream;
the first video receiving unit is used for receiving a first video stream sent by the cloud server and displaying the first video stream on a screen locking interface.
In another aspect, a cloud server is provided, including:
the device comprises a first operation receiving unit, a second operation receiving unit and a display unit, wherein the first operation receiving unit is used for receiving first operation information sent by user equipment which is connected in advance, the first operation information corresponds to a first operation of an information element displayed on a screen locking interface of the user equipment by a user, and the information element comprises at least one of an application icon, an application detail interface and a general graphic element;
and the first video generation unit is connected with the first operation receiving unit and used for converting the view corresponding to the first operation information into a first video stream and sending the first video stream to the user equipment so that the user equipment displays the first video stream on a screen locking interface.
In summary, according to the screen display method, the screen display device, the cloud server and the screen display system provided by the invention, the cloud server pushes the video stream to the user equipment, so that the user equipment can quickly use the application program or browse the content in the screen locking environment, the use efficiency is improved, and the scene requirements of the user are met. In addition, the application program or the browsing content can be built in the user equipment or arranged on the cloud server, so that the application range is greatly expanded, and the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a first flowchart of a screen display method according to embodiment 1 of the present invention;
fig. 2 is a frame diagram of a screen display system according to embodiment 1 of the present invention;
FIG. 3 is a flowchart illustrating a screen display method according to embodiment 1 of the present invention;
fig. 4 is a flowchart of a screen display method provided in embodiment 1 of the present invention;
FIG. 5 is a fourth flowchart of a screen display method according to embodiment 1 of the present invention;
fig. 6 is a fifth flowchart of a screen display method provided in embodiment 1 of the present invention;
fig. 7 is a sixth flowchart of a screen display method according to embodiment 1 of the present invention;
fig. 8 is a seventh flowchart of a screen display method according to embodiment 1 of the present invention;
fig. 9 is an eighth flowchart of a screen display method provided in embodiment 1 of the present invention;
FIG. 10 is a flowchart of a screen display method according to embodiment 2 of the present invention;
FIG. 11 is a flowchart of a screen display method according to embodiment 3 of the present invention;
FIG. 12 is a flowchart of a screen display method according to embodiment 4 of the present invention;
FIG. 13 is a flowchart of a screen display method according to embodiment 5 of the present invention;
fig. 14 is a schematic structural diagram of a screen display system according to embodiment 6 of the present invention;
fig. 15 is a schematic structural diagram of a screen display device according to embodiment 7 of the present invention;
fig. 16 is a schematic structural diagram of a cloud server according to embodiment 8 of the present invention.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it is to be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example 1
As shown in fig. 1, the present invention provides a screen display method, including the steps of:
step 101, a user device receives a first operation of a user on an information element displayed on a screen locking interface of the user device, wherein the information element comprises at least one of an application icon, an application detail interface and a general graphic element.
Specifically, after triggering the user equipment to turn on the screen, the user operates an information element displayed on the screen locking interface of the user equipment in an unlocked state, where the information element is an interface element displayed in the screen locking state, and as described above, the information element may include but is not limited to at least one of an application icon, an application detail interface, and a general purpose graphic element. The user device senses a first operation through a sensor of the user device itself, and the first operation may include, but is not limited to, clicking, sliding, holding and the like.
The general graphic element is an element icon preset by an operating system, such as in an address book
Figure 760708DEST_PATH_IMAGE001
、
Figure 68061DEST_PATH_IMAGE002
、
Figure 378957DEST_PATH_IMAGE003
Etc. the icons.
Step 102, the user equipment sends first operation information corresponding to the first operation to a pre-connected cloud server.
According to the preferred embodiment of the present invention, step 102 specifically includes: the user equipment judges whether the first operation meets a preset rule or not; and if so, the user equipment sends first operation information corresponding to the first operation to the cloud server.
Specifically, a plurality of operations (for example, clicking, sliding, holding, etc.) are stored in advance in a memory of the user equipment, and when the first operation matches any one of the plurality of operations stored in advance, it is determined that the first operation meets the preset rule.
For example, when a user arrives at a bus station, the user wants to know the pre-arrival condition of the vehicle at a mobile phone terminal quickly, the user can click the 'bus inquiry' application icon on the screen locking interface under the condition of not unlocking the screen, if a plurality of operations including clicking of the application icon under the screen locking interface are prestored in the mobile phone, the operation can be judged to accord with the preset rule, so that operation information corresponding to the operation of clicking the 'bus inquiry' application icon is sent to the cloud server, and the operation information is information for opening the application by the user.
Step 103, after receiving the first operation information, the cloud server transforms a view corresponding to the first operation information to generate a first video stream, and sends the first video stream to the user equipment.
In this embodiment, a first operation of the information element displayed on the lock screen interface by the user may result in a series of view transformations, and the cloud server simulates the first operation of the user, that is, opening of an application by the user, operation of the application by the user, or operation of an icon corresponding to the general-purpose graphic element by the user, and generates a first video stream.
For example, in a normal unlocked state, when a user clicks on the "bus inquiry" application icon, the screen of the user device displays a picture of the process of opening the application, i.e., there is a series of view changes. In the invention, in a screen locking state, when a user clicks a 'bus inquiry' application icon, the cloud server transforms the view simulating the application to generate a first video stream so as to simulate the operation of opening the application by the user.
According to the preferred embodiment of the present invention, as shown in fig. 2, the cloud server is connected to a plurality of cloud virtual terminals in advance, and the cloud virtual terminals may be virtual terminals having certain physical hardware, for example, virtual android phones. Step 103 specifically includes the following substeps: after receiving the first operation information, the cloud server determines a second target virtual terminal corresponding to the first operation information from a plurality of cloud virtual terminals connected with the cloud server in advance; the cloud server transforms the view corresponding to the first operation information through a second target virtual terminal to generate a first video stream; the cloud server sends the first video stream to the user equipment.
In this embodiment, the second target virtual terminal is backed up with user equipment information and application information of the corresponding device in advance. The number of the cloud virtual terminals is multiple, so that personalized requirements of different users can be met, and the detailed description is further provided below. In addition, the cloud virtual terminal is mainly used for virtualizing the use environment of the user equipment, receiving and simulating the operation of the user on the application, only simulating the application without considering the application authority of the user, and generating the video stream in real time, so that the operation of the user on the application under the screen locking can be quickly simulated, the application range is wide, and great convenience is provided for the user. The generating process may include: the cloud server simulates an operation process corresponding to the first operation information, and records the simulated operation process to obtain a first video stream. The simulation process comprises the following steps: the cloud server determines a second target virtual terminal corresponding to the first operation information from a plurality of cloud virtual terminals connected with the cloud server in advance; and the cloud server simulates an operation process corresponding to the first operation information through the second target virtual terminal.
In this embodiment, the first video stream generated by the cloud server may be a common video stream, or may be a video stream with a trigger point set, and specifically, a trigger point for executing a corresponding operation is preset on each operation control in the first video stream.
And 104, the user equipment receives the first video stream sent by the cloud server and displays the first video stream on a screen locking interface.
In this embodiment, in order to improve the information transmission rate and/or security, the first video stream may be processed first and then transmitted, in which case step 103 includes: the cloud server carries out comprehensive processing on the first video stream to obtain a processed first video stream; the comprehensive treatment comprises the following steps: at least one of encoding and encrypting; the cloud server sends the processed first video stream to the user equipment; step 104 comprises: the method comprises the steps that user equipment receives a processed first video stream sent by a cloud server; and the user equipment acquires the first video stream according to the processed first video stream and displays the first video stream on the screen locking interface.
In this embodiment, through the process of displaying the first video stream in step 104, the screen locking interface may be replaced with the first video stream for the user equipment and then displayed; the first video stream may also be displayed for the user device on an upper layer of the lock screen interface.
Further, as shown in fig. 3, the screen display method provided in this embodiment further includes:
step 105, the user equipment receives a third operation performed by the user on the first video stream;
step 106, after acquiring corresponding third operation information according to the position of the third operation, the user equipment sends the third operation information to the cloud server;
step 107, after receiving the third operation information, the cloud server determines a fourth target virtual terminal corresponding to the third operation information from the plurality of cloud virtual terminals connected in advance, and converts a view corresponding to the third operation information through the fourth target virtual terminal to generate a third video stream;
step 108, the cloud server sends the third video stream to the user equipment;
and step 109, after the user equipment receives the third video stream, displaying the third video stream on the screen locking interface.
In this embodiment, when a user operates a first video stream, operation information of user equipment is transmitted to a target virtual terminal through a cloud server, and then the target virtual terminal responds to the operation information in an opened application, so that view transformation caused by the operation information is pushed to the user equipment through the cloud server in a video stream form for display.
Further, as shown in fig. 4, the screen display method provided in the embodiment of the present invention further includes:
step 110, the cloud server sends the recommended application information to the user equipment.
And step 111, after receiving the recommended application information, the user equipment displays the recommended application information on a screen locking interface.
In this embodiment, the cloud server may actively recommend the application information to the user equipment, so that the user may browse or download the application information as needed. At this time, the recommended application information may be sent by the cloud virtual terminal corresponding to the user equipment through the cloud server, or may be sent by the cloud server itself actively, which is not limited herein.
At this time, as shown in fig. 5, the screen display method further includes:
step 112, after receiving an information acquisition request input by a user according to the recommended application information, the user equipment sends the information acquisition request to a cloud server;
step 113, after receiving the information acquisition request, the cloud server determines a fifth target virtual terminal corresponding to the information acquisition request from a plurality of cloud virtual terminals connected in advance, and converts a view corresponding to the information acquisition request through the fifth target virtual terminal to generate a fourth video stream;
step 114, the cloud server sends the fourth video stream to the user equipment;
and step 115, after the user equipment receives the fourth video stream, displaying the fourth video stream on a screen locking interface.
Alternatively, as shown in fig. 6, the screen display method further includes:
step 116, the user equipment receives an information acquisition request input by the user according to the recommended application information;
step 117, the user equipment acquires an application detail page corresponding to the information acquisition request from a preset application market;
the user device unlocks 118 and jumps to the application details page.
In this embodiment, after the user views the recommended application information displayed by the user equipment, if the user wants to acquire the recommended application information, the user may acquire a corresponding video stream through the cloud server, as in steps 112 to 115; or may be obtained and jumped through an application market preset by the user equipment, as in steps 116 to 118.
In this embodiment, after the user opens the recommended application, when the user operates, an information acquisition request of a touch screen of the user is transmitted to the target virtual terminal through the cloud server, then the target virtual terminal responds in the opened application, and view transformation caused by a generated behavior is pushed to the user equipment through the cloud server in a video stream mode for display.
Further, as shown in fig. 7, the screen display method provided in this embodiment may further include:
step 119, the cloud server sends a hyperlink or an advertisement to the user equipment;
and step 120, after the user equipment receives the hyperlink or the advertisement, displaying the hyperlink or the advertisement on a screen locking interface.
In this embodiment, the cloud server may actively recommend hyperlinks or advertisements to the user device, so that the user can open or browse as needed. At this time, the recommended hyperlink or advertisement may be sent by the cloud virtual terminal corresponding to the user equipment through the cloud server, or may be sent by the cloud server itself actively, which is not limited herein.
At this time, as shown in fig. 8, the screen display method may further include:
step 121, when the user clicks the hyperlink or the advertisement, the user equipment opens the hyperlink or the advertisement on the screen locking interface.
In this embodiment, after the user views the recommended hyperlink or advertisement displayed by the user equipment, if the user wants to obtain the recommended hyperlink or advertisement, the user equipment can directly click to open the user equipment on the screen locking interface.
In this embodiment, the cloud server pushes some application information to the user equipment and displays the application information on the lock screen according to the preference of the user. If the user is interested in a certain application, the corresponding application information can be clicked. The user equipment is connected with the cloud server, the equipment information is sent to the cloud server, the cloud server selects the cloud virtual terminal and opens the application according to the equipment information, the cloud virtual terminal generates a video stream, and the generated video stream is pushed to the user equipment through the cloud server to be displayed.
According to the embodiment of the invention, the application can be tried out and then selectively installed without installing the application. The invention greatly expands the application range in the screen locking state, is not limited to the application installed by the user equipment, but can operate the uninstalled application in the screen locking state, and greatly improves the user experience.
Further, as shown in fig. 9, when the application information is updated, the screen display method may further include:
step 122, the user equipment sends the equipment information of the user equipment and the updated application information to the cloud server;
step 123, after receiving the device information and the updated application information, the cloud server determines a first target virtual terminal corresponding to the device information and the updated application information from the plurality of cloud virtual terminals connected in advance, and backs up the device information and the updated application information through the first target virtual terminal.
In this embodiment, in order to improve user experience, when an application built in the user equipment is updated, the application information stored by the cloud server through the cloud virtual terminal may be updated through steps 122 to 123, so that the real-time performance of the application information stored by the cloud virtual terminal is improved.
In this embodiment, all information of one user equipment may be stored in one cloud virtual terminal, or different information of one user equipment may be stored in different cloud virtual terminals, which is not limited herein. That is, each target virtual terminal may be one cloud virtual terminal or may be a plurality of cloud virtual terminals.
The user equipment can be a smart phone, a tablet computer and the like.
In this embodiment, each video stream may be a common video stream, or may be a video stream with a trigger point set, and specifically, a trigger point for executing a corresponding operation is preset on each operation control in the video stream.
In summary, the screen display method provided by the invention enables the user equipment to quickly use the application program or browse the content in the screen locking environment in a manner of pushing the video stream to the user equipment through the cloud server, improves the use efficiency, and meets the scene requirements of the user. In addition, the application program or the browsing content can be built in the user equipment or arranged on the cloud server, so that the application range is greatly expanded, and the user experience is improved.
Example 2
As shown in fig. 10, the present invention provides a screen display method, which is similar to that shown in fig. 1, except that, before step 101, it further includes:
in step 124, the user equipment receives a screen locking setting instruction input by the user.
Step 125, the user equipment sends the device information of the user equipment and the application information corresponding to the screen locking setting instruction to the cloud server.
And step 126, after receiving the device information and the application information, the cloud server determines a first target virtual terminal corresponding to the device information and the application information from a plurality of pre-connected cloud virtual terminals, backs up the device information and the application information through the first target virtual terminal, and after the back-up is successful, the cloud server returns a back-up success message to the user equipment.
And step 127, after receiving the backup success message, the user equipment displays an application icon corresponding to the application information on the screen locking interface according to the backup success message.
Specifically, in this embodiment, the user sets some applications that can be directly opened in the screen lock state through the screen lock setting instruction according to the preference of the user. After the user sets the applications, the user equipment transmits the equipment information and the application information to the cloud server, and the cloud server selects the corresponding cloud virtual terminal (i.e., the first target virtual terminal) to backup the information. And after the first target virtual terminal is successfully backed up, informing the user equipment, and displaying the set application to a screen locking interface by the user equipment.
For example, when a user needs to browse information, videos, pictures and the like in fragmentation time, such as on a subway, the user can set favorite information, videos, pictures and the like on a screen locking interface, so that the favorite application of the user can be quickly opened in a screen locking state, personalized requirements of the user are met, and user experience is further improved.
According to the method, the user equipment sends the operation information to the cloud server when clicking the application icon or other identification information displayed on the lock screen, the cloud server informs the cloud virtual terminal to open the corresponding application and simulates to generate a real-time video stream, the video stream is pushed to the user equipment through the cloud server, and the user equipment decodes and displays the video stream.
In this embodiment, each video stream may be a common video stream, or may be a video stream with a trigger point set, and specifically, a trigger point for executing a corresponding operation is preset on each operation control in the video stream.
In summary, the screen display method provided by the invention enables the user equipment to quickly use the application program or browse the content in the screen locking environment in a manner of pushing the video stream to the user equipment through the cloud server, improves the use efficiency, and meets the scene requirements of the user. In addition, the application program or the browsing content can be built in the user equipment or arranged on the cloud server, so that the application range is greatly expanded, and the user experience is improved.
Example 3
As shown in fig. 11, the present invention provides a screen display method, which is similar to that shown in fig. 1, except that when a trigger point for executing a corresponding operation is preset on each operation control in a first video stream, the method further includes:
in step 128, the user equipment receives a second operation performed by the user on the first video stream.
In step 129, after determining the target trigger point corresponding to the second operation, the user equipment sends trigger point information corresponding to the target trigger point to the cloud server.
In step 130, after receiving the trigger point information, the cloud server determines a third target virtual terminal corresponding to the trigger point information from the plurality of cloud virtual terminals connected in advance, and transforms a view corresponding to the trigger point information through the third target virtual terminal to generate a second video stream.
Step 131, the cloud server sends the second video stream to the user equipment.
Step 132, after receiving the second video stream, the user equipment displays the second video stream on the screen locking interface.
In this embodiment, when a user touches a trigger point of a first video stream, trigger point information of user equipment is transmitted to a target virtual terminal through a cloud server, then the target virtual terminal responds to the trigger point event in an open application, and view transformation caused by a generated behavior is pushed to the user equipment through the cloud server in a video stream form for display.
In this embodiment, each video stream may be a common video stream, or may be a video stream with a trigger point set, and specifically, a trigger point for executing a corresponding operation is preset on each operation control in the video stream.
In summary, the screen display method provided by the invention enables the user equipment to quickly use the application program or browse the content in the screen locking environment in a manner of pushing the video stream to the user equipment through the cloud server, improves the use efficiency, and meets the scene requirements of the user. In addition, the application program or the browsing content can be built in the user equipment or arranged on the cloud server, so that the application range is greatly expanded, and the user experience is improved.
Example 4
As shown in fig. 12, the present invention provides a screen display method applied to a user equipment, including:
step 1201, receiving a first operation of a user on an information element displayed on a screen locking interface of user equipment, wherein the information element comprises at least one of an application icon, an application detail interface and a general graphic element;
step 1202, sending first operation information corresponding to a first operation to a pre-connected cloud server, so that the cloud server transforms a view corresponding to the first operation information to generate a first video stream and returns the first video stream;
step 1203, receiving a first video stream sent by the cloud server, and displaying the first video stream on the screen locking interface.
In this embodiment, the process of implementing the screen display through steps 1201 to 1203 is similar to the process provided in embodiment 1 of the present invention, and is not repeated here.
In this embodiment, the process of sending the first operation information corresponding to the first operation to the pre-connected cloud server in step 1202 may be to first determine whether the first operation meets a preset rule; and if so, sending first operation information corresponding to the first operation to a pre-connected cloud server.
In this embodiment, the video stream returned by the cloud server may be a video stream after comprehensive processing, where the comprehensive processing includes at least one of encoding and encryption; at this time, the video stream received by the user equipment is a processed first video stream, and step 1203 includes obtaining the first video stream according to the processed first video stream and displaying the first video stream on the screen locking interface.
In this embodiment, the manner of displaying the first video stream in step 1203 may be to replace the screen locking interface with the first video stream for displaying, or to display the first video stream on the upper layer of the screen locking interface, which is not described herein again.
Further, before step 1201, the screen display method provided in this embodiment further includes:
step 1204, receiving a screen locking setting instruction input by a user;
step 1205, sending the device information of the user equipment and the application information corresponding to the screen locking setting instruction to the cloud server, so that the cloud server determines a first target virtual terminal corresponding to the device information and the application information from a plurality of pre-connected cloud virtual terminals, backs up the device information and the application information through the first target virtual terminal, and returns a back-up success message after the back-up is successful;
and 1206, after receiving the backup success message, displaying an application icon corresponding to the application information on the screen locking interface according to the backup success message.
In this embodiment, when the screen display method further includes steps 1204 to 1206, the process of implementing the screen display is similar to that provided in embodiment 2 of the present invention, and is not described in detail herein.
In this embodiment, the first video stream may be a normal video stream, or may be a video stream with a trigger point set, and specifically, a trigger point for executing a corresponding operation is preset on each operation control in the first video stream.
Further, when a trigger point is set in the first video stream, the screen display method provided in this embodiment further includes:
step 1207, receiving a second operation performed by the user on the first video stream;
step 1208, after determining a target trigger point corresponding to the second operation, sending trigger point information corresponding to the target trigger point to the cloud server, so that the cloud server determines a third target virtual terminal corresponding to the trigger point information from the plurality of pre-connected cloud virtual terminals, converts a view corresponding to the trigger point information into a second video stream through the third target virtual terminal, and returns the second video stream;
step 1209, after receiving the second video stream, displaying the second video stream on the screen locking interface.
In this embodiment, when a user touches a trigger point of a first video stream, trigger point information of user equipment is transmitted to a target virtual terminal through a cloud server, then the target virtual terminal responds to the trigger point event in an open application, and view transformation caused by a generated behavior is pushed to the user equipment through the cloud server in a video stream form for display. The specific process is similar to that provided in embodiment 3 of the present invention, and is not described in detail herein.
Further, the screen display method provided by this embodiment may further include:
step 1210, receiving a third operation performed by the user on the first video stream;
step 1211, after obtaining corresponding third operation information according to the position of the third operation, sending the third operation information to the cloud server, so that the cloud server determines a fourth target virtual terminal corresponding to the third operation information from the plurality of cloud virtual terminals connected in advance, and converts a view corresponding to the third operation information into a third video stream through the fourth target virtual terminal and returns the third video stream;
and step 1212, after receiving the third video stream, displaying the third video stream on the screen locking interface.
In this embodiment, when a user operates a first video stream, operation information of user equipment is transmitted to a target virtual terminal through a cloud server, and then the target virtual terminal responds to the operation information in an opened application, so that view transformation caused by the operation information is pushed to the user equipment through the cloud server in a video stream form for display. The specific process is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
Further, the screen display method provided by this embodiment may further include:
and step 1213, after receiving the recommended application information, the advertisement or the hyperlink sent by the cloud server, displaying on a screen locking interface.
In this embodiment, the cloud server may actively recommend application information, hyperlinks or advertisements to the user device, so that the user can open or browse as required. At this time, the recommended application information, hyperlink or advertisement may be sent by the cloud virtual terminal corresponding to the user equipment through the cloud server, or may be sent by the cloud server itself actively, which is not limited herein. The specific process is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
At this time, the screen display method provided in this embodiment may further include:
step 1214, after receiving an information acquisition request input by a user according to the recommended application information, sending the information acquisition request to a cloud server, so that the cloud server determines a fifth target virtual terminal corresponding to the information acquisition request from a plurality of pre-connected cloud virtual terminals, converts a view corresponding to the information acquisition request by using the fifth target virtual terminal to generate a fourth video stream, and returns the fourth video stream;
and 1215, after receiving the fourth video stream, displaying the fourth video stream on the screen locking interface.
Or, the screen display method may further include:
step 1216, receiving an information acquisition request input by the user according to the recommended application information;
step 1217, acquiring an application detail page corresponding to the information acquisition request from a preset application market;
at step 1218, unlock and jump to the application details page.
In this embodiment, after the user views the recommended application information displayed by the user equipment, if the user wants to obtain the recommended application information, the user may obtain the corresponding video stream through the cloud server, as in steps 1214 to 1215; it can also get and jump through the application market preset by the user equipment, as in steps 1216 to 1218. The specific process is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
At this time, the screen display method provided in this embodiment may further include:
when the user clicks on the hyperlink or the advertisement, the user equipment opens the hyperlink or the advertisement on the screen locking interface, step 1219.
In this embodiment, in order to improve the video transmission rate and/or security, the cloud server may further perform processing such as encoding and encryption on the video stream before transmitting the video stream, where the received video stream is a processed video stream and needs to be reversely processed and then displayed when displaying.
Further, the screen display method provided by this embodiment may further include, when the application information is updated:
step 1220, the device information and the updated application information are sent to the cloud server, so that the cloud server updates the corresponding backup information.
In this embodiment, the video stream is displayed, which may be replacing the screen locking interface with the video stream, or displaying the video stream on the upper layer of the screen locking interface, and is not limited herein.
In this embodiment, each video stream may be a common video stream, or may be a video stream with a trigger point set, and specifically, a trigger point for executing a corresponding operation is preset on each operation control in the video stream.
In summary, the screen display method provided by the invention enables the user equipment to quickly use the application program or browse the content in the screen locking environment in a manner of pushing the video stream to the user equipment through the cloud server, improves the use efficiency, and meets the scene requirements of the user. In addition, the application program or the browsing content can be built in the user equipment or arranged on the cloud server, so that the application range is greatly expanded, and the user experience is improved.
Example 5
As shown in fig. 13, the present invention provides a screen display method applied to a cloud server, including:
step 1301, receiving first operation information sent by a user device connected in advance, wherein the first operation information corresponds to a first operation of a user on an information element displayed on a screen locking interface of the user device, and the information element comprises at least one of an application icon, an application detail interface and a general graphic element;
step 1302, transforming the view corresponding to the first operation information to generate a first video stream, and sending the first video stream to the user equipment, so that the user equipment displays the first video stream on the screen locking interface.
In this embodiment, step 1302 includes: determining a second target virtual terminal corresponding to the first operation information from a plurality of cloud virtual terminals connected with the cloud server in advance; transforming the view corresponding to the first operation information through a second target virtual terminal to generate a first video stream; the first video stream is transmitted to the user device.
In this embodiment, the process of implementing screen display through step 1301 and step 1302 is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
In this embodiment, in order to improve the security and/or the transmission rate of the data, before the first video stream is transmitted, the first video stream may be comprehensively processed to obtain a processed first video stream; the processed first video stream is then transmitted. The comprehensive treatment comprises the following steps: and at least one of encoding and encrypting. In this case, the user equipment needs to perform inverse processing before displaying the video stream.
In this embodiment, the process of generating the first video stream may be an operation process corresponding to the simulated first operation information, and the simulated operation process is recorded to obtain the first video stream. The simulation process comprises the following steps: determining a second target virtual terminal corresponding to the first operation information from a plurality of cloud virtual terminals connected in advance; and simulating an operation process corresponding to the first operation information through the second target virtual terminal.
Further, before step 1301, the screen display method provided in this embodiment further includes:
step 1303, receiving device information of the user device sent by the user device and application information corresponding to a screen locking setting instruction input by a user;
step 1304, determining a first target virtual terminal corresponding to the device information and the application information from a plurality of cloud virtual terminals connected in advance;
step 1305, backing up the device information and the application information through the first target virtual terminal;
step 1306, after the backup is successful, a backup success message is returned to the user equipment, so that the user equipment displays an application icon corresponding to the application information on the screen locking interface according to the backup success message.
In this embodiment, the process of implementing the screen display through steps 1301-.
In this embodiment, the first video stream may be a normal video stream, or may be a video stream with a trigger point set, and specifically, a trigger point for executing a corresponding operation is preset on each operation control in the first video stream.
When the trigger point is set on the first video stream, further, the screen display method provided in this embodiment may further include:
step 1307, receiving trigger point information corresponding to the target trigger point sent by the user equipment, where the target trigger point corresponds to a second operation performed by the user on the first video stream;
step 1308, determining a third target virtual terminal corresponding to the trigger point information from a plurality of cloud virtual terminals connected in advance;
step 1309, transforming, by the third target virtual terminal, the view corresponding to the trigger point information to generate a second video stream;
step 1310, sending the second video stream to the user equipment, so that the user equipment displays the second video stream on the screen locking interface.
In this embodiment, when a user touches a trigger point of a first video stream, trigger point information of user equipment is transmitted to a target virtual terminal through a cloud server, then the target virtual terminal responds to the trigger point event in an open application, and view transformation caused by a generated behavior is pushed to the user equipment through the cloud server in a video stream form for display. The specific process is similar to that provided in embodiment 3 of the present invention, and is not described in detail herein.
Further, the screen display method provided by this embodiment may further include:
step 1313, after receiving the third operation information, determining a fourth target virtual terminal corresponding to the third operation information from the plurality of cloud virtual terminals connected in advance, and converting a view corresponding to the third operation information by the fourth target virtual terminal to generate a third video stream; the third operation information corresponds to a third operation performed by the user on the first video stream;
step 1314, sending the third video stream to the user equipment;
and 1315, after the third video stream is received, displaying the third video stream on the screen locking interface.
In this embodiment, when a user operates a first video stream, operation information of user equipment is transmitted to a target virtual terminal through a cloud server, and then the target virtual terminal responds to the operation information in an opened application, so that view transformation caused by the operation information is pushed to the user equipment through the cloud server in a video stream form for display. The specific process is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
Further, the screen display method provided by this embodiment may further include:
step 1316, the recommended application information, hyperlink or advertisement is sent to the user device.
In this embodiment, the cloud server may actively recommend application information, hyperlinks or advertisements to the user device, so that the user can open or browse as required. At this time, the recommended application information, hyperlink or advertisement may be sent by the cloud virtual terminal corresponding to the user equipment through the cloud server, or may be sent by the cloud server itself actively, which is not limited herein. The specific process is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
In this embodiment, the video stream may be a normal video stream or a video stream with a trigger point set, and specifically, a trigger point for executing a corresponding operation is preset on each operation control in the video stream.
At this time, the screen display method may further include:
step 1317, receiving an information acquisition request sent by the user equipment, where the information acquisition request is input by the user according to the recommended application information;
step 1318, determining a fifth target virtual terminal corresponding to the information acquisition request from the plurality of cloud virtual terminals connected in advance, and transforming the view corresponding to the information acquisition request by the fifth target virtual terminal to generate a fourth video stream;
step 1319, sending the fourth video stream to the user equipment, so that the user equipment displays the fourth video stream on the screen locking interface.
In this embodiment, after the user views the recommended application information displayed by the user equipment, if the user wants to acquire the recommended application information, the user equipment may acquire and jump through an application market preset by the user equipment, or acquire a corresponding video stream through the cloud server, as in steps 1317 to 1319.
Further, the screen display method provided in this embodiment may further include, when the application information of the user equipment is updated:
step 1320, receiving the device information and the updated application information sent by the user equipment, determining a first target virtual terminal corresponding to the device information and the updated application information from the plurality of cloud virtual terminals connected in advance, and backing up the device information and the updated application information through the first target virtual terminal.
In summary, the screen display method provided by the invention enables the user equipment to quickly use the application program or browse the content in the screen locking environment in a manner of pushing the video stream to the user equipment through the cloud server, improves the use efficiency, and meets the scene requirements of the user. In addition, the application program or the browsing content can be built in the user equipment or arranged on the cloud server, so that the application range is greatly expanded, and the user experience is improved.
Example 6
As shown in fig. 14, the present invention provides a screen display system including:
the user equipment 1401 is used for receiving a first operation of a user on an information element displayed on a screen locking interface of the user equipment, wherein the information element comprises at least one of an application icon, an application detail interface and a general graphic element; sending first operation information corresponding to the first operation to a cloud server; and receiving a first video stream sent by the cloud server according to the first operation information, and displaying the first video stream on a screen locking interface.
The cloud server 1402 is connected to the user equipment, and is configured to, after receiving the first operation information, transform the view corresponding to the first operation information to generate a first video stream, and send the first video stream to the user equipment.
In this embodiment, the process of implementing screen display by the user equipment 1401 and the cloud server 1402 is similar to that provided in embodiment 1 of the present invention, and is not described in detail here. Before the user equipment sends the first operation information to the cloud server, whether the first operation meets a preset rule or not can be judged, and no limitation is made herein; the specific process that the cloud server transforms the view corresponding to the first operation information to generate a first video stream, and sends the first video stream to the user equipment may include: after receiving the first operation information, the cloud server determines a second target virtual terminal corresponding to the first operation information from a plurality of cloud virtual terminals connected with the cloud server in advance; the cloud server transforms the view corresponding to the first operation information through a second target virtual terminal to generate a first video stream; the cloud server sends the first video stream to the user equipment.
In this embodiment, the video stream returned by the cloud server may be a video stream after comprehensive processing, where the comprehensive processing includes at least one of encoding and encryption; at this time, the video stream received by the user equipment is the processed first video stream, and at this time, the user equipment is further configured to obtain the first video stream according to the processed first video stream and display the first video stream on the screen locking interface.
In this embodiment, the manner in which the user equipment displays the first video stream may be that the screen locking interface is replaced with the first video stream and then displayed, or that the first video stream is displayed on an upper layer of the screen locking interface, which is not described herein any more.
In this embodiment, the simulating, by the cloud server, an operation process corresponding to the first operation information includes: the cloud server determines a second target virtual terminal corresponding to the first operation information from a plurality of cloud virtual terminals connected with the cloud server in advance; and the cloud server simulates an operation process corresponding to the first operation information through the second target virtual terminal.
Further, in the screen display device provided by this embodiment, the user device is further configured to receive a screen locking setting instruction input by a user; sending the device information of the user equipment and the application information corresponding to the screen locking setting instruction to a cloud server; and receiving a backup success message returned by the cloud server according to the screen locking setting instruction, and displaying an application icon corresponding to the application information on a screen locking interface according to the backup success message.
The cloud server is further used for determining a first target virtual terminal corresponding to the device information and the application information from a plurality of cloud virtual terminals connected in advance after receiving the device information and the application information, backing up the device information and the application information through the first target virtual terminal, and returning a backup success message to the user equipment after the backup is successful.
In this embodiment, the process of implementing message backup by the user equipment and the cloud server is similar to that provided in embodiment 2 of the present invention, and is not described in detail herein.
Further, when a trigger point for executing a corresponding operation is preset on each operation control in the first video stream, in the screen display system of this embodiment, the user equipment is further configured to receive a second operation performed by the user on the first video stream; after determining a target trigger point corresponding to the second operation, sending trigger point information corresponding to the target trigger point to the cloud server; receiving a second video stream sent by the cloud server according to the trigger point information, and displaying the second video stream on a screen locking interface;
the cloud server is further used for determining a third target virtual terminal corresponding to the trigger point information from a plurality of cloud virtual terminals connected in advance after receiving the trigger point information, and converting a view corresponding to the trigger point information through the third target virtual terminal to generate a second video stream; the second video stream is sent to the user device.
In this embodiment, a process of implementing screen display when a trigger point is set in a first video stream is similar to that provided in embodiment 3 of the present invention, and details are not repeated here.
Further, the user equipment in the screen display system provided by this embodiment is further configured to receive a third operation performed by the user on the first video stream; after corresponding third operation information is obtained according to the position of the third operation, the third operation information is sent to the cloud server; after receiving a third video stream sent by the cloud server according to the third operation information, displaying the third video stream on the screen locking interface;
the cloud server is further used for determining a fourth target virtual terminal corresponding to the third operation information from a plurality of pre-connected cloud virtual terminals after receiving the third operation information, and converting a view corresponding to the third operation information through the fourth target virtual terminal to generate a third video stream; and transmitting the third video stream to the user equipment.
In this embodiment, when a user operates a first video stream, operation information of user equipment is transmitted to a target virtual terminal through a cloud server, and then the target virtual terminal responds to the operation information in an opened application, so that view transformation caused by the operation information is pushed to the user equipment through the cloud server in a video stream form for display. The specific process is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
Further, the cloud server in the screen display system provided by the embodiment is further configured to send recommendation application information, a hyperlink, or an advertisement to the user equipment;
and the user equipment is also used for receiving the recommended application information, the hyperlink or the advertisement sent by the cloud server and displaying the information on the screen locking interface.
In this embodiment, the cloud server may actively recommend application information, hyperlinks or advertisements to the user device, so that the user can open or browse as required. At this time, the recommended application information, hyperlink or advertisement may be sent by the cloud virtual terminal corresponding to the user equipment through the cloud server, or may be sent by the cloud server itself actively, which is not limited herein. The specific process is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
Further, when the cloud server in the screen display system provided by this embodiment is used to send the recommended application information to the user equipment,
the user equipment is also used for receiving an information acquisition request input by the user according to the recommended application information and then sending the information acquisition request to the cloud server; and after receiving a fourth video stream sent by the cloud server according to the information acquisition request, displaying the fourth video stream on a screen locking interface.
The cloud server is further used for determining a fifth target virtual terminal corresponding to the information acquisition request from a plurality of cloud virtual terminals connected in advance after receiving the information acquisition request, and converting a view corresponding to the information acquisition request through the fifth target virtual terminal to generate a fourth video stream; and transmitting the fourth video stream to the user equipment.
In this embodiment, after the user views the recommended application information displayed by the user equipment, if the user wants to acquire the recommended application information, the corresponding video stream may be acquired through the cloud server. The specific process is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
Further, when the cloud server in the screen display system provided by this embodiment is used to send the recommended application information to the user equipment,
the user equipment is also used for receiving an information acquisition request input by the user according to the recommended application information; acquiring an application detail page corresponding to an information acquisition request from a preset application market; unlock and jump to the application detail page.
In this embodiment, after the user views the recommended application information displayed by the user equipment, if the user wants to acquire the recommended application information, the user can also acquire and jump through an application market preset by the user equipment. The specific process is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
In this embodiment, the video stream may be a normal video stream or a video stream with a trigger point set, and specifically, a trigger point for executing a corresponding operation is preset on each operation control in the video stream.
Further, the user equipment in the screen display system provided by the embodiment is further used for opening the hyperlink or the advertisement on the screen locking interface when the user clicks the hyperlink or the advertisement. The specific process is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
Further, the user equipment in the screen display system provided by the embodiment is further configured to send the equipment information of the user equipment and the updated application information to the cloud server;
the cloud server is further used for determining a first target virtual terminal corresponding to the device information and the updated application information from a plurality of cloud virtual terminals connected in advance after receiving the device information and the updated application information, and backing up the device information and the updated application information through the first target virtual terminal. The specific process is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
In summary, the screen display system provided by the invention enables the user equipment to quickly use the application program or browse the content in the screen locking environment in a manner of pushing the video stream to the user equipment through the cloud server, improves the use efficiency, and meets the scene requirements of the user. In addition, the application program or the browsing content can be built in the user equipment or arranged on the cloud server, so that the application range is greatly expanded, and the user experience is improved.
Example 7
As shown in fig. 15, the present invention provides a screen display device including:
the first operation unit 1501 is configured to receive a first operation of a user on an information element displayed on a lock screen interface of the user equipment, where the information element includes at least one of an application icon, an application detail interface, and a general purpose graphic element;
a first operation sending unit 1502, connected to the first operation unit, configured to send first operation information corresponding to a first operation to a pre-connected cloud server, so that the cloud server transforms a view corresponding to the first operation information to generate a first video stream and returns the first video stream;
the first video receiving unit 1503 is configured to receive a first video stream sent by the cloud server, and display the first video stream on a screen locking interface.
In this embodiment, the process of implementing the screen display through the first operation unit 1501, the first operation sending unit 1502 and the first video receiving unit 1503 is similar to that provided in embodiment 4 of the present invention, and is not repeated here. Before the user equipment sends the first operation information to the cloud server, whether the first operation meets a preset rule or not can be judged, and no limitation is made herein; the video stream returned by the cloud server can be a video stream after comprehensive processing, and the comprehensive processing comprises at least one of encoding and encryption; at this time, the video stream received by the user equipment is the processed first video stream, and at this time, the first video receiving unit is specifically configured to obtain the first video stream according to the processed first video stream and display the first video stream on the screen locking interface.
In this embodiment, the manner of displaying the first video stream may be to replace the screen locking interface with the first video stream for display, or may be to display the first video stream on an upper layer of the screen locking interface, which is not described herein any more.
Further, the screen display device provided in this embodiment may further include:
the screen locking instruction unit is used for receiving a screen locking setting instruction input by a user;
the screen locking instruction sending unit is connected with the screen locking instruction unit and used for sending the equipment information of the user equipment and the application information corresponding to the screen locking setting instruction to the cloud server, so that the cloud server determines a first target virtual terminal corresponding to the equipment information and the application information from a plurality of pre-connected cloud virtual terminals, backups the equipment information and the application information through the first target virtual terminal, and returns a backup success message after the backups are successful;
and the application display unit is connected with the first operation unit and used for displaying the application icon corresponding to the application information on the screen locking interface according to the backup success message after receiving the backup success message.
In this embodiment, when the screen display device further includes a screen locking instruction unit, a screen locking instruction sending unit, and an application display unit, a process of implementing screen display is similar to that provided in embodiment 4 of the present invention, and is not described in detail herein.
Further, when a trigger point for executing a corresponding operation is preset on each operation control in the first video stream, the screen display apparatus provided in this embodiment may further include:
the second operation unit is used for receiving a second operation performed by the user on the first video stream;
the trigger information sending unit is connected with the second operation unit and used for sending trigger point information corresponding to the target trigger point to the cloud server after the target trigger point corresponding to the second operation is determined, so that the cloud server determines a third target virtual terminal corresponding to the trigger point information from a plurality of pre-connected cloud virtual terminals, converts a view corresponding to the trigger point information into a second video stream through the third target virtual terminal and returns the second video stream;
and the second video display unit is used for displaying the second video stream on the screen locking interface after receiving the second video stream.
In this embodiment, when a user touches a trigger point of a first video stream, trigger point information of user equipment is transmitted to a target virtual terminal through a cloud server, then the target virtual terminal responds to the trigger point event in an open application, and view transformation caused by a generated behavior is pushed to the user equipment through the cloud server in a video stream form for display. The specific process is similar to that provided in embodiment 4 of the present invention, and is not described in detail herein.
Further, the screen display device provided in this embodiment may further include:
a third operation unit, configured to receive a third operation performed by a user on the first video stream;
the third operation sending unit is connected with the third operation unit and used for sending third operation information to the cloud server after the corresponding third operation information is obtained according to the position of the third operation, so that the cloud server determines a fourth target virtual terminal corresponding to the third operation information from a plurality of pre-connected cloud virtual terminals, converts a view corresponding to the third operation information into a third video stream through the fourth target virtual terminal and returns the third video stream;
and the third video display unit is used for displaying the third video stream on the screen locking interface after receiving the third video stream.
In this embodiment, when a user operates a first video stream, operation information of user equipment is transmitted to a target virtual terminal through a cloud server, and then the target virtual terminal responds to the operation information in an opened application, so that view transformation caused by the operation information is pushed to the user equipment through the cloud server in a video stream form for display. The specific process is similar to that provided in embodiment 4 of the present invention, and is not described in detail herein.
Further, the screen display device provided in this embodiment may further include:
and the recommendation information receiving unit is used for receiving the recommendation application information sent by the cloud server and then displaying the recommendation application information on the screen locking interface.
In this embodiment, the cloud server may actively recommend the application information to the user equipment, so that the user may browse or download the application information as needed. At this time, the recommended application information may be sent by the cloud virtual terminal corresponding to the user equipment through the cloud server, or may be sent by the cloud server itself actively, which is not limited herein. The process is similar to that provided in embodiment 4 of the present invention, and is not described in detail herein.
Further, the screen display device provided in this embodiment may further include:
the first request receiving unit is used for receiving an information acquisition request input by a user according to the recommended application information, sending the information acquisition request to the cloud server, enabling the cloud server to determine a fifth target virtual terminal corresponding to the information acquisition request from a plurality of pre-connected cloud virtual terminals, converting a view corresponding to the information acquisition request through the fifth target virtual terminal to generate a fourth video stream, and returning the fourth video stream;
and the fourth video receiving unit is used for displaying the fourth video stream on the screen locking interface after receiving the fourth video stream.
Alternatively, the screen display device provided in this embodiment may further include:
the second request receiving unit is used for receiving an information acquisition request input by the user according to the recommended application information;
the detail page acquisition unit is connected with the second request receiving unit and is used for acquiring the application detail page corresponding to the information acquisition request from a preset application market;
and the unlocking unit is connected with the detail page acquisition unit and used for unlocking and jumping to the application detail page.
In this embodiment, after the user views the recommended application information displayed by the user equipment, if the user wants to acquire the recommended application information, the user can acquire a corresponding video stream through the cloud server; or can be acquired and jumped through an application market preset by the user equipment. The specific process is similar to that provided in embodiment 4 of the present invention, and is not described in detail herein.
Further, the screen display device provided in this embodiment may further include:
and the advertisement receiving unit is used for displaying the hyperlink or the advertisement on the screen locking interface after receiving the hyperlink or the advertisement sent by the cloud server.
In this embodiment, the cloud server may actively recommend hyperlinks or advertisements to the user device, so that the user can open or browse as needed. At this time, the recommended hyperlink or advertisement may be sent by the cloud virtual terminal corresponding to the user equipment through the cloud server, or may be sent by the cloud server itself actively, which is not limited herein.
Further, the screen display device provided in this embodiment may further include:
the device comprises an update sending unit and a backup unit, wherein the update sending unit is used for sending the device information of the user equipment and the updated application information to the cloud server, so that after the cloud server receives the device information and the updated application information, a first target virtual terminal corresponding to the device information and the updated application information is determined from a plurality of cloud virtual terminals connected in advance, and the device information and the updated application information are backed up through the first target virtual terminal.
In this embodiment, the video stream may be a normal video stream or a video stream with a trigger point set, and specifically, a trigger point for executing a corresponding operation is preset on each operation control in the video stream.
In summary, the screen display apparatus provided by the present invention, in a manner of pushing a video stream to the user equipment through the cloud server, enables the user equipment to quickly use an application program or browse content in a screen-locked environment, improves the usage efficiency, and meets the user scene requirements. In addition, the application program or the browsing content can be built in the user equipment or arranged on the cloud server, so that the application range is greatly expanded, and the user experience is improved.
Example 8
As shown in fig. 16, the present invention provides a cloud server, including:
the first operation receiving unit 1601 is configured to receive first operation information sent by a user equipment connected in advance, where the first operation information corresponds to a first operation performed by a user on an information element displayed on a screen locking interface of the user equipment, and the information element includes at least one of an application icon, an application detail interface, and a general graphical element;
the first video generating unit 1602, connected to the first operation receiving unit, is configured to generate a first video stream by transforming the view corresponding to the first operation information, and send the first video stream to the user equipment, so that the user equipment displays the first video stream on the screen lock interface.
In this embodiment, the process of implementing screen display by the first operation receiving unit 1601 and the first video generating unit 1602 is similar to that provided in embodiment 5 of the present invention, and is not repeated here.
Further, the cloud server provided in this embodiment may further include:
the screen locking instruction receiving unit is used for receiving equipment information of the user equipment sent by the user equipment and application information corresponding to a screen locking setting instruction input by a user;
the first terminal selection unit is connected with the screen locking instruction receiving unit and used for determining a first target virtual terminal corresponding to the device information and the application information from a plurality of cloud virtual terminals which are connected in advance;
the backup unit is connected with the first terminal selection unit and used for backing up the equipment information and the application information through the first target virtual terminal;
and the backup message sending unit is connected with the backup unit and used for returning a backup success message to the user equipment after the backup is successful, so that the user equipment displays the application icon corresponding to the application information on the screen locking interface according to the backup success message.
In this embodiment, the process of implementing screen display by the above units is similar to that provided in embodiment 5 of the present invention, and is not described in detail here.
Further, the first video generating unit in the cloud server provided by this embodiment includes:
the second terminal determining module is used for determining a second target virtual terminal corresponding to the first operation information from a plurality of cloud virtual terminals connected with the cloud server in advance;
the first video generation module is connected with the second terminal determination module and used for converting the view corresponding to the first operation information through the second target virtual terminal to generate a first video stream;
and the first video sending module is connected with the first video generating module and used for sending the first video stream to the user equipment.
In this embodiment, a process of generating the first video stream through the modules is similar to that provided in embodiment 1 of the present invention, and is not described in detail herein.
Further, in the cloud server provided in this embodiment, when a trigger point for executing a corresponding operation is preset on each operation control in the first video stream, the method further includes:
a second operation receiving unit, configured to receive trigger point information corresponding to a target trigger point sent by a user equipment, where the target trigger point corresponds to a second operation performed by a user on a first video stream;
the third terminal determining unit is connected with the second operation receiving unit and used for determining a third target virtual terminal corresponding to the trigger point information from a plurality of cloud virtual terminals connected in advance;
the second video generating unit is connected with the third terminal determining unit and used for converting the view corresponding to the trigger point information through a third target virtual terminal to generate a second video stream;
and the second video sending unit is connected with the second video generating unit and used for sending the second video stream to the user equipment so that the user equipment can display the second video stream on the screen locking interface.
In this embodiment, when a user touches a trigger point of a first video stream, trigger point information of user equipment is transmitted to a target virtual terminal through a cloud server, then the target virtual terminal responds to the trigger point event in an open application, and view transformation caused by a generated behavior is pushed to the user equipment through the cloud server in a video stream form for display. The specific process is similar to that provided in embodiment 5 of the present invention, and is not described in detail herein.
Further, the cloud server provided in this embodiment further includes:
a third operation receiving unit configured to receive third operation information that corresponds to a position of a third operation performed by a user on the first video stream;
the third video generation unit is connected with the third operation receiving unit and used for determining a fourth target virtual terminal corresponding to the third operation information from a plurality of cloud virtual terminals connected in advance and converting a view corresponding to the third operation information through the fourth target virtual terminal to generate a third video stream;
and the third video sending unit is connected with the third video generating unit and used for sending the third video stream to the user equipment so that the user equipment can display the third video stream on the screen locking interface.
In this embodiment, when the user performs the third operation on the first video stream, the specific operation process is similar to that provided in embodiment 5 of the present invention, and details are not repeated here.
Further, the cloud server provided in this embodiment further includes:
and the recommending unit is used for sending the recommended application information, the hyperlink or the advertisement to the user equipment, so that the user equipment displays the recommended application information, the hyperlink or the advertisement on a screen locking interface.
The above process is similar to that provided in embodiment 5 of the present invention, and is not described in detail herein.
At this time, the cloud server further includes:
the request receiving unit is used for receiving an information acquisition request sent by user equipment, wherein the information acquisition request is input by a user according to the recommended application information;
the fourth video generation unit is connected with the request receiving unit and used for determining a fifth target virtual terminal corresponding to the information acquisition request from a plurality of cloud virtual terminals connected in advance and converting the view corresponding to the information acquisition request through the fifth target virtual terminal to generate a fourth video stream;
and the fourth video sending unit is connected with the fourth video generating unit and used for sending the fourth video stream to the user equipment so that the user equipment can display the fourth video stream on the screen locking interface.
The above process is similar to that provided in embodiment 5 of the present invention, and is not described in detail herein.
In this embodiment, the user equipment may further send the device information and the updated application information when the application information is updated, and at this time, the cloud server further includes:
and the backup updating module is used for determining a first target virtual terminal corresponding to the device information and the updated application information from a plurality of pre-connected cloud virtual terminals after receiving the device information and the updated application information, and backing up the device information and the updated application information through the first target virtual terminal.
In this embodiment, the video stream sent to the user equipment may be an original video stream or a video stream that has undergone an integrated process, where the integrated process includes at least one of encoding and encryption. The process of generating the video stream can be an operation process corresponding to the simulation operation information, and the simulated operation process is recorded to obtain the video stream; the simulation can be performed locally or through a target virtual terminal corresponding to a plurality of cloud virtual terminals connected in advance, which is not repeated herein.
In summary, the cloud server provided by the invention enables the user equipment to quickly use the application program or browse the content in the screen locking environment in a manner of pushing the video stream to the user equipment through the cloud server, so that the use efficiency is improved, and the user scene requirements are met. In addition, the application program or the browsing content can be built in the user equipment or arranged on the cloud server, so that the application range is greatly expanded, and the user experience is improved.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (50)

1. A method for on-screen display, the method comprising the steps of:
s10, user equipment receives first operation of a user on an information element displayed on a screen locking interface of the user equipment, wherein the information element comprises at least one of an application icon, an application detail interface and a general graphic element;
s20, the user equipment sends first operation information corresponding to the first operation to a pre-connected cloud server;
s30, after receiving the first operation information, the cloud server transforms a view corresponding to the first operation information to generate a first video stream, and sends the first video stream to the user equipment;
and S40, the user equipment receives the first video stream sent by the cloud server and displays the first video stream on a screen locking interface.
2. The screen display method of claim 1, wherein prior to step S10, the method further comprises the steps of:
s00, receiving a screen locking setting instruction input by a user by the user equipment;
s01, the user equipment sends equipment information of the user equipment and application information corresponding to the screen locking setting instruction to the cloud server;
s02, after receiving the equipment information and the application information, the cloud server determines a first target virtual terminal corresponding to the equipment information and the application information from a plurality of pre-connected cloud virtual terminals, backups the equipment information and the application information through the first target virtual terminal, and after the backups are successful, the cloud server returns a backup success message to the user equipment;
and S03, after receiving the backup success message, the user equipment displays an application icon corresponding to the application information on a screen locking interface according to the backup success message.
3. The screen display method of claim 1, wherein step S20 specifically includes:
s21, the user equipment judges whether the first operation meets a preset rule or not;
and S22, if the first operation information is consistent with the first operation information, the user equipment sends first operation information corresponding to the first operation to the cloud server.
4. The screen display method of claim 1, wherein step S30 specifically includes:
s31, after receiving the first operation information, the cloud server determines a second target virtual terminal corresponding to the first operation information from a plurality of cloud virtual terminals connected with the cloud server in advance;
s32, the cloud server transforms the view corresponding to the first operation information through the second target virtual terminal to generate the first video stream;
and S33, the cloud server sends the first video stream to the user equipment.
5. The screen display method of any one of claims 1 to 4,
and each operation control in the first video stream is preset with a trigger point for executing corresponding operation.
6. The screen display method of claim 5, further comprising the steps of:
s50, the user equipment receives a second operation of a user on the first video stream;
s60, after the user equipment determines the target trigger point corresponding to the second operation, sending trigger point information corresponding to the target trigger point to the cloud server;
s70, after receiving the trigger point information, the cloud server determines a third target virtual terminal corresponding to the trigger point information from a plurality of pre-connected cloud virtual terminals, and converts a view corresponding to the trigger point information through the third target virtual terminal to generate a second video stream;
s80, the cloud server sends the second video stream to the user equipment;
and S90, after receiving the second video stream, the user equipment displays the second video stream on a screen locking interface.
7. The screen display method of any one of claims 1-4, further comprising the steps of:
s91, the user equipment receives a third operation performed by a user on the first video stream;
s92, after acquiring corresponding third operation information according to the position of the third operation, the user equipment sends the third operation information to the cloud server;
s93, after receiving the third operation information, the cloud server determines a fourth target virtual terminal corresponding to the third operation information from a plurality of pre-connected cloud virtual terminals, and converts a view corresponding to the third operation information through the fourth target virtual terminal to generate a third video stream;
s94, the cloud server sends the third video stream to the user equipment;
and S95, after receiving the third video stream, the user equipment displays the third video stream on a screen locking interface.
8. The screen display method of any of claims 1-4, further comprising:
s96, the cloud server sends recommended application information to the user equipment;
and S97, after receiving the recommended application information, the user equipment displays the recommended application information on a screen locking interface.
9. The screen display method of claim 8, further comprising:
s98, after receiving an information acquisition request input by a user according to the recommended application information, the user equipment sends the information acquisition request to the cloud server;
s99, after receiving the information acquisition request, the cloud server determines a fifth target virtual terminal corresponding to the information acquisition request from a plurality of pre-connected cloud virtual terminals, and converts a view corresponding to the information acquisition request through the fifth target virtual terminal to generate a fourth video stream;
s100, the cloud server sends the fourth video stream to the user equipment;
and S101, after the user equipment receives the fourth video stream, displaying the fourth video stream on a screen locking interface.
10. The screen display method of claim 8, further comprising:
s102, the user equipment receives an information acquisition request input by a user according to the recommended application information;
s103, the user equipment acquires an application detail page corresponding to the information acquisition request from a preset application market;
s104, the user equipment is unlocked and jumps to the application detail page.
11. The screen display method of any of claims 1-4, further comprising:
s105, the cloud server sends a hyperlink or an advertisement to the user equipment;
and S106, after receiving the hyperlink or the advertisement, the user equipment displays the hyperlink or the advertisement on a screen locking interface.
12. The screen display method of claim 11, further comprising:
s107, when the user clicks the hyperlink or the advertisement, the user equipment opens the hyperlink or the advertisement on a screen locking interface.
13. The screen display method of any one of claims 1 to 4,
the S30 includes:
s34, the cloud server carries out comprehensive processing on the first video stream to obtain a processed first video stream; the comprehensive treatment comprises the following steps: at least one of encoding and encrypting;
s35, the cloud server sends the processed first video stream to the user equipment;
the S40 includes:
s41, the user equipment receives the processed first video stream sent by the cloud server;
and S42, the user equipment acquires the first video stream according to the processed first video stream and displays the first video stream on a screen locking interface.
14. The screen display method according to any one of claims 1 to 4, wherein said S30 includes:
and the cloud server simulates an operation process corresponding to the first operation information and records the simulated operation process to obtain the first video stream.
15. The screen display method of claim 14, wherein the cloud server simulates an operation process corresponding to the first operation information, and comprises:
the cloud server determines a second target virtual terminal corresponding to the first operation information from a plurality of cloud virtual terminals connected with the cloud server in advance;
and the cloud server simulates an operation process corresponding to the first operation information through the second target virtual terminal.
16. The screen display method according to any one of claims 1 to 4, wherein said S40 includes:
replacing the screen locking interface by the user equipment with the first video stream and then displaying the first video stream; alternatively, the first and second electrodes may be,
and the user equipment displays the first video stream on the upper layer of the screen locking interface.
17. The screen display method of claim 2, wherein the updating of the application information further comprises:
s108, the user equipment sends the equipment information of the user equipment and the updated application information to the cloud server;
and S109, after receiving the device information and the updated application information, the cloud server determines a first target virtual terminal corresponding to the device information and the updated application information from a plurality of pre-connected cloud virtual terminals, and backs up the device information and the updated application information through the first target virtual terminal.
18. A screen display method applied to user equipment is characterized by comprising the following steps:
A10. receiving a first operation of a user on an information element displayed on a screen locking interface of the user equipment, wherein the information element comprises at least one of an application icon, an application detail interface and a general graphic element;
A20. sending first operation information corresponding to the first operation to a pre-connected cloud server, enabling the cloud server to convert a view corresponding to the first operation information to generate a first video stream, and then returning the first video stream;
A30. and receiving a first video stream sent by the cloud server, and displaying the first video stream on a screen locking interface.
19. The screen display method of claim 18, wherein prior to step a10, the method further comprises the steps of:
A00. receiving a screen locking setting instruction input by a user;
A01. sending the device information of the user equipment and the application information corresponding to the screen locking setting instruction to the cloud server, enabling the cloud server to determine a first target virtual terminal corresponding to the device information and the application information from a plurality of pre-connected cloud virtual terminals, backing up the device information and the application information through the first target virtual terminal, and returning a backup success message after the backup is successful;
A02. and after receiving the backup success message, displaying an application icon corresponding to the application information on a screen locking interface according to the backup success message.
20. The screen display method of claim 18 or 19,
and each operation control in the first video stream is preset with a trigger point for executing corresponding operation.
21. The screen display method of claim 20, further comprising the steps of:
A40. receiving a second operation performed by a user on the first video stream;
A50. after a target trigger point corresponding to the second operation is determined, sending trigger point information corresponding to the target trigger point to the cloud server, so that the cloud server determines a third target virtual terminal corresponding to the trigger point information from a plurality of pre-connected cloud virtual terminals, converts a view corresponding to the trigger point information into a second video stream through the third target virtual terminal, and returns the second video stream;
A60. and after receiving the second video stream, displaying the second video stream on a screen locking interface.
22. The screen display method of claim 18 or 19, further comprising the steps of:
A70. receiving a third operation performed by a user on the first video stream;
A80. after acquiring corresponding third operation information according to the position of the third operation, sending the third operation information to the cloud server, so that the cloud server determines a fourth target virtual terminal corresponding to the third operation information from a plurality of pre-connected cloud virtual terminals, converts a view corresponding to the third operation information into a third video stream through the fourth target virtual terminal, and returns the third video stream;
A90. and after receiving the third video stream, displaying the third video stream on a screen locking interface.
23. The screen display method of claim 18 or 19, further comprising the steps of:
A91. and after receiving the recommended application information, the advertisement or the hyperlink sent by the cloud server, displaying the recommended application information, the advertisement or the hyperlink on a screen locking interface.
24. The screen display method of claim 23, further comprising the steps of:
A92. after receiving an information acquisition request input by a user according to the recommended application information, sending the information acquisition request to the cloud server, enabling the cloud server to determine a fifth target virtual terminal corresponding to the information acquisition request from a plurality of pre-connected cloud virtual terminals, converting a view corresponding to the information acquisition request through the fifth target virtual terminal to generate a fourth video stream, and returning the fourth video stream;
A93. and after receiving the fourth video stream, displaying the fourth video stream on a screen locking interface.
25. The screen display method of claim 23, further comprising the steps of:
A94. receiving an information acquisition request input by a user according to the recommended application information;
A95. acquiring an application detail page corresponding to the information acquisition request from a preset application market;
A96. and unlocking and jumping to the application detail page.
26. A screen display method is applied to a cloud server and is characterized by comprising the following steps:
B10. receiving first operation information sent by user equipment connected in advance, wherein the first operation information corresponds to first operation of an information element displayed on a screen locking interface of the user equipment by a user, and the information element comprises at least one of an application icon, an application detail interface and a general graphic element;
B20. and transforming the view corresponding to the first operation information to generate a first video stream, and sending the first video stream to the user equipment, so that the user equipment displays the first video stream on a screen locking interface.
27. The screen display method of claim 26, wherein prior to step B10, the method further comprises the steps of:
B00. receiving device information of the user equipment sent by the user equipment and application information corresponding to a screen locking setting instruction input by a user;
B01. determining a first target virtual terminal corresponding to the device information and the application information from a plurality of cloud virtual terminals connected in advance;
B02. backing up the equipment information and the application information through the first target virtual terminal;
B03. and after the backup is successful, returning a backup success message to the user equipment, and enabling the user equipment to display an application icon corresponding to the application information on a screen locking interface according to the backup success message.
28. The screen display method of claim 26, wherein the B20, comprising:
B21. determining a second target virtual terminal corresponding to the first operation information from a plurality of cloud virtual terminals connected with the cloud server in advance;
B22. transforming the view corresponding to the first operation information through the second target virtual terminal to generate the first video stream;
B23. and sending the first video stream to the user equipment.
29. The screen display method of any one of claims 26 to 28,
and each operation control in the first video stream is preset with a trigger point for executing corresponding operation.
30. The screen display method of claim 29, further comprising:
B30. receiving trigger point information corresponding to a target trigger point sent by the user equipment, wherein the target trigger point corresponds to a second operation performed by the user on the first video stream;
B40. determining a third target virtual terminal corresponding to the trigger point information from a plurality of pre-connected cloud virtual terminals;
B50. transforming the view corresponding to the trigger point information by the third target virtual terminal to generate a second video stream;
B60. and sending the second video stream to the user equipment, so that the user equipment displays the second video stream on a screen locking interface.
31. The screen display method of any of claims 26-28, further comprising:
B70. and sending recommended application information, a hyperlink or an advertisement to the user equipment, so that the user equipment displays the recommended application information, the hyperlink or the advertisement on a screen locking interface.
32. An on-screen display system, the system comprising:
the system comprises user equipment and a display unit, wherein the user equipment is used for receiving first operation of an information element displayed by a screen locking interface of the user equipment by a user, and the information element comprises at least one of an application icon, an application detail interface and a general graphic element; sending first operation information corresponding to the first operation to a cloud server; receiving a first video stream sent by the cloud server according to the first operation information, and displaying the first video stream on a screen locking interface;
the cloud server is connected with the user equipment and used for receiving the first operation information, converting the view corresponding to the first operation information to generate a first video stream, and sending the first video stream to the user equipment.
33. The screen display system of claim 32,
the user equipment is also used for receiving a screen locking setting instruction input by a user; sending the device information of the user equipment and the application information corresponding to the screen locking setting instruction to the cloud server; receiving a backup success message returned by the cloud server according to the screen locking setting instruction, and displaying an application icon corresponding to the application information on a screen locking interface according to the backup success message;
the cloud server is further configured to determine a first target virtual terminal corresponding to the device information and the application information from a plurality of cloud virtual terminals connected in advance after receiving the device information and the application information, backup the device information and the application information through the first target virtual terminal, and return a backup success message to the user equipment after the backup is successful.
34. The screen display system of claim 32 or 33, wherein when a trigger point for executing the corresponding operation is preset on each operation control in the first video stream,
the user equipment is further used for receiving a second operation performed by a user on the first video stream; after a target trigger point corresponding to the second operation is determined, sending trigger point information corresponding to the target trigger point to the cloud server; receiving a second video stream sent by the cloud server according to the trigger point information, and displaying the second video stream on a screen locking interface;
the cloud server is further configured to determine a third target virtual terminal corresponding to the trigger point information from a plurality of cloud virtual terminals connected in advance after receiving the trigger point information, and transform a view corresponding to the trigger point information through the third target virtual terminal to generate a second video stream; and sending the second video stream to the user equipment.
35. The screen display system of claim 32 or 33,
the user equipment is further used for receiving a third operation performed by a user on the first video stream; after corresponding third operation information is obtained according to the position of the third operation, the third operation information is sent to the cloud server; after receiving a third video stream sent by the cloud server according to the third operation information, displaying the third video stream on a screen locking interface;
the cloud server is further configured to determine a fourth target virtual terminal corresponding to the third operation information from a plurality of cloud virtual terminals connected in advance after receiving the third operation information, and generate a third video stream by transforming a view corresponding to the third operation information through the fourth target virtual terminal; and sending the third video stream to the user equipment.
36. The screen display system of claim 32 or 33,
the cloud server is further used for sending recommendation application information, hyperlinks or advertisements to the user equipment;
the user equipment is further used for receiving the recommended application information, the hyperlink or the advertisement sent by the cloud server and displaying the recommended application information, the hyperlink or the advertisement on a screen locking interface.
37. The screen display system of claim 36, wherein the cloud server, when configured to send the recommended application information to the user device,
the user equipment is further used for receiving an information acquisition request input by a user according to the recommended application information and then sending the information acquisition request to the cloud server; after receiving a fourth video stream sent by the cloud server according to the information acquisition request, displaying the fourth video stream on a screen locking interface;
the cloud server is further configured to determine a fifth target virtual terminal corresponding to the information acquisition request from a plurality of cloud virtual terminals connected in advance after receiving the information acquisition request, and convert a view corresponding to the information acquisition request through the fifth target virtual terminal to generate a fourth video stream; and sending the fourth video stream to the user equipment.
38. The screen display system of claim 36, wherein the cloud server, when configured to send the recommended application information to the user device,
the user equipment is also used for receiving an information acquisition request input by the user according to the recommended application information; acquiring an application detail page corresponding to the information acquisition request from a preset application market; and unlocking and jumping to the application detail page.
39. An on-screen display device for a user device, comprising:
the first operation unit is used for receiving a first operation of a user on an information element displayed on a screen locking interface of the user equipment, wherein the information element comprises at least one of an application icon, an application detail interface and a general graphic element;
the first operation sending unit is connected with the first operation unit and used for sending first operation information corresponding to the first operation to a pre-connected cloud server, so that the cloud server transforms a view corresponding to the first operation information to generate a first video stream and returns the first video stream;
the first video receiving unit is used for receiving a first video stream sent by the cloud server and displaying the first video stream on a screen locking interface.
40. The screen display device of claim 39, further comprising:
the screen locking instruction unit is used for receiving a screen locking setting instruction input by a user;
a screen locking instruction sending unit connected with the screen locking instruction unit and used for sending the device information of the user equipment and the application information corresponding to the screen locking setting instruction to the cloud server, so that the cloud server determines a first target virtual terminal corresponding to the device information and the application information from a plurality of pre-connected cloud virtual terminals, backs up the device information and the application information through the first target virtual terminal, and returns a back-up success message after the back-up is successful;
and the application display unit is connected with the first operation unit and used for displaying the application icon corresponding to the application information on a screen locking interface according to the backup success message after receiving the backup success message.
41. The screen display device according to claim 39 or 40, wherein when a trigger point for executing a corresponding operation is preset on each operation control in the first video stream, the device further comprises:
the second operation unit is used for receiving a second operation performed by a user on the first video stream;
a trigger information sending unit, connected to the second operation unit, configured to send trigger point information corresponding to the target trigger point to the cloud server after determining the target trigger point corresponding to the second operation, so that the cloud server determines a third target virtual terminal corresponding to the trigger point information from a plurality of pre-connected cloud virtual terminals, and converts a view corresponding to the trigger point information into a second video stream through the third target virtual terminal and returns the second video stream;
and the second video display unit is used for displaying the second video stream on a screen locking interface after receiving the second video stream.
42. The screen display device of claim 39 or 40, wherein the device further comprises:
a third operation unit, configured to receive a third operation performed by a user on the first video stream;
a third operation sending unit, connected to the third operation unit, configured to send third operation information to the cloud server after obtaining corresponding third operation information according to a position of the third operation, so that the cloud server determines a fourth target virtual terminal corresponding to the third operation information from a plurality of cloud virtual terminals connected in advance, converts a view corresponding to the third operation information into a third video stream through the fourth target virtual terminal, and returns the third video stream;
and the third video display unit is used for displaying the third video stream on a screen locking interface after receiving the third video stream.
43. The screen display device of claim 39 or 40, wherein the device further comprises:
and the recommendation information receiving unit is used for receiving the recommendation application information sent by the cloud server and then displaying the recommendation application information on a screen locking interface.
44. The screen display device of claim 43, further comprising:
the first request receiving unit is used for receiving an information acquisition request input by a user according to the recommended application information, sending the information acquisition request to the cloud server, enabling the cloud server to determine a fifth target virtual terminal corresponding to the information acquisition request from a plurality of pre-connected cloud virtual terminals, converting a view corresponding to the information acquisition request through the fifth target virtual terminal to generate a fourth video stream, and returning the fourth video stream;
and the fourth video receiving unit is used for displaying the fourth video stream on a screen locking interface after receiving the fourth video stream.
45. The screen display device of claim 43, further comprising:
the second request receiving unit is used for receiving an information acquisition request input by the user according to the recommended application information;
the detail page acquisition unit is connected with the second request receiving unit and is used for acquiring the application detail page corresponding to the information acquisition request from a preset application market;
and the unlocking unit is connected with the detail page acquisition unit and used for unlocking and jumping to the application detail page.
46. The screen display device of claim 39 or 40, wherein the device further comprises:
and the advertisement receiving unit is used for displaying the hyperlink or the advertisement on a screen locking interface after receiving the hyperlink or the advertisement sent by the cloud server.
47. A cloud server, comprising:
the device comprises a first operation receiving unit, a second operation receiving unit and a display unit, wherein the first operation receiving unit is used for receiving first operation information sent by user equipment which is connected in advance, the first operation information corresponds to a first operation of an information element displayed on a screen locking interface of the user equipment by a user, and the information element comprises at least one of an application icon, an application detail interface and a general graphic element;
and the first video generation unit is connected with the first operation receiving unit and used for converting the view corresponding to the first operation information into a first video stream and sending the first video stream to the user equipment so that the user equipment displays the first video stream on a screen locking interface.
48. The cloud server of claim 47, further comprising:
the screen locking instruction receiving unit is used for receiving the equipment information of the user equipment sent by the user equipment and the application information corresponding to the screen locking setting instruction input by the user;
the first terminal selection unit is connected with the screen locking instruction receiving unit and used for determining a first target virtual terminal corresponding to the equipment information and the application information from a plurality of cloud virtual terminals connected in advance;
the backup unit is connected with the first terminal selection unit and used for backing up the equipment information and the application information through the first target virtual terminal;
and the backup message sending unit is connected with the backup unit and used for returning a backup success message to the user equipment after the backup is successful, so that the user equipment displays the application icon corresponding to the application information on a screen locking interface according to the backup success message.
49. The cloud server of claim 47 or 48, wherein said first video generation unit comprises:
a second terminal determining module, configured to determine a second target virtual terminal corresponding to the first operation information from a plurality of cloud virtual terminals pre-connected to the cloud server;
the first video generation module is connected with the second terminal determination module and used for converting the view corresponding to the first operation information through the second target virtual terminal to generate the first video stream;
and the first video sending module is connected with the first video generating module and used for sending the first video stream to the user equipment.
50. The cloud server according to claim 47 or 48, wherein when a trigger point for executing a corresponding operation is preset on each operation control in the first video stream, the method further comprises:
a second operation receiving unit, configured to receive trigger point information corresponding to a target trigger point sent by the user equipment, where the target trigger point corresponds to a second operation performed by a user on the first video stream;
a third terminal determining unit, connected to the second operation receiving unit, configured to determine a third target virtual terminal corresponding to the trigger point information from a plurality of cloud virtual terminals connected in advance;
a second video generating unit, connected to the third terminal determining unit, configured to transform the view corresponding to the trigger point information by using the third target virtual terminal to generate a second video stream;
and the second video sending unit is connected with the second video generating unit and used for sending the second video stream to the user equipment so that the user equipment can display the second video stream on a screen locking interface.
CN202010257830.8A 2020-04-03 2020-04-03 Screen display method and device, cloud server and system Active CN111479013B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010257830.8A CN111479013B (en) 2020-04-03 2020-04-03 Screen display method and device, cloud server and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010257830.8A CN111479013B (en) 2020-04-03 2020-04-03 Screen display method and device, cloud server and system

Publications (2)

Publication Number Publication Date
CN111479013A CN111479013A (en) 2020-07-31
CN111479013B true CN111479013B (en) 2020-10-27

Family

ID=71749706

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010257830.8A Active CN111479013B (en) 2020-04-03 2020-04-03 Screen display method and device, cloud server and system

Country Status (1)

Country Link
CN (1) CN111479013B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104092831A (en) * 2014-07-23 2014-10-08 天津华永无线科技有限公司 System and method for displaying content on lock screen of mobile phone
CN104885049A (en) * 2014-03-12 2015-09-02 华为终端有限公司 A lock screen method and mobile terminal
CN109547630A (en) * 2018-11-12 2019-03-29 深圳紫牛信息科技有限公司 Cloud mobile phone application method, device, computer equipment and storage medium when screen locking

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10637724B2 (en) * 2006-09-25 2020-04-28 Remot3.It, Inc. Managing network connected devices
CN102893249A (en) * 2012-07-30 2013-01-23 华为技术有限公司 Method and device of unlocking terminal
KR101491015B1 (en) * 2013-06-07 2015-02-06 에스케이플래닛 주식회사 System for managing cloud storages, method of managing cloud storages and apparatus for the same
CN105320501A (en) * 2014-06-24 2016-02-10 北京云端时代科技有限公司 Remote screen locking and unlocking method and device
KR102332468B1 (en) * 2014-07-24 2021-11-30 삼성전자주식회사 Method for controlling function and electronic device thereof
US20190303420A1 (en) * 2016-12-15 2019-10-03 Rovi Guides, Inc. Systems and methods for determining one or more user devices suitable for displaying media assets matching a search query
CN107105048B (en) * 2017-05-10 2020-03-17 广州杰赛科技股份有限公司 Teaching control method and system based on cloud technology

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104885049A (en) * 2014-03-12 2015-09-02 华为终端有限公司 A lock screen method and mobile terminal
CN104092831A (en) * 2014-07-23 2014-10-08 天津华永无线科技有限公司 System and method for displaying content on lock screen of mobile phone
CN109547630A (en) * 2018-11-12 2019-03-29 深圳紫牛信息科技有限公司 Cloud mobile phone application method, device, computer equipment and storage medium when screen locking

Also Published As

Publication number Publication date
CN111479013A (en) 2020-07-31

Similar Documents

Publication Publication Date Title
EP3247094B1 (en) Operation method and system of mobile terminal
CN106127076B (en) A kind of inspection method and mobile terminal of photograph album photo
CN109600672B (en) Video content pushing method and device
US11743331B2 (en) System, mobile terminal and method for storing data into web storage using wireless LAN
CN103379370A (en) Intelligent television system, intelligent television, mobile device and input operation method
CN105824657A (en) Method for displaying application program and mobile terminal
CN111901896A (en) Information sharing method, information sharing device, electronic equipment and storage medium
CN102883226A (en) Method for providing program information on video displaying window and equipment thereof
CN105827816B (en) A kind of the split screen method and mobile terminal of terminal screen
EP2790142A1 (en) Terminal apparatus, server and method of controlling the same
CN106649518B (en) Method and device for processing dynamic information data
CN111694490B (en) Setting method and device and electronic equipment
CN108664279A (en) A kind of method and apparatus based on the application of fingerprint recognition synchronous averaging
CN111479013B (en) Screen display method and device, cloud server and system
CN110798701A (en) Video update pushing method and terminal
US20150161666A1 (en) Operation method of portable electronic apparatus
CN107066864B (en) Application icon display method and device
CN112989851A (en) NFC card activation method and device and electronic equipment
CN112995406A (en) Display method and device and electronic equipment
CN111817944A (en) Picture sharing method and device and electronic equipment
CN106375862A (en) GIF picture acquisition method and apparatus, and terminal
CN113709300B (en) Display method and device
CN107968799B (en) Information acquisition method, terminal equipment and system
CN115407916A (en) Interface display method and device, electronic equipment and storage medium
CN114518811A (en) Scroll screen-based information interaction method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20220318

Address after: 518000 9th floor, Caixun technology building, 3176 Keyuan South Road, Gaoxin community, Yuehai street, Nanshan District, Shenzhen City, Guangdong Province

Patentee after: SHENZHEN ZOOKING SOFTWARE Co.,Ltd.

Address before: 2171, floor 1, zone a, No. 205, dongxiaojing Industrial Park, Dongba Township, Chaoyang District, Beijing 100018

Patentee before: Beijing zhangku times Technology Co.,Ltd.

TR01 Transfer of patent right