CN111930328A - Application data display method, device and system - Google Patents
Application data display method, device and system Download PDFInfo
- Publication number
- CN111930328A CN111930328A CN202010797870.1A CN202010797870A CN111930328A CN 111930328 A CN111930328 A CN 111930328A CN 202010797870 A CN202010797870 A CN 202010797870A CN 111930328 A CN111930328 A CN 111930328A
- Authority
- CN
- China
- Prior art keywords
- data
- terminal
- interface data
- functional interface
- control interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 77
- 230000006870 function Effects 0.000 claims abstract description 65
- 238000009877 rendering Methods 0.000 claims description 24
- 230000008569 process Effects 0.000 claims description 8
- 238000010586 diagram Methods 0.000 description 9
- 230000009471 action Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 239000000243 solution Substances 0.000 description 5
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The application discloses a display method, device and system of application data. Wherein, the method comprises the following steps: the first terminal receives application data of a server, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; and the first terminal displays the control interface data and sends the functional interface data to the second terminal for display. The method and the device solve the technical problems that in the related art, the control interface and the function interface are displayed on the same terminal, so that the display is not clear, and the operation experience of a user is influenced.
Description
Technical Field
The present application relates to the field of application control, and in particular, to a method, an apparatus, and a system for displaying application data.
Background
In the related art, when application data is controlled, functional interface data of the application data and interface data of the control application data are generally displayed on the same terminal, for example, when a certain game is operated, the functional interface data of the game and a corresponding control interface are displayed on the same terminal, but the display mode has the technical problems that the functional interface data and the control interface data are not clear and intuitive when displayed, and the operation experience of a user is influenced.
In view of the above problems, no effective solution has been proposed.
Disclosure of Invention
The embodiment of the application provides a display method, device and system of application data, so as to at least solve the technical problems that in the related art, the display is unclear and the user operation experience is influenced because a control interface and a function interface are displayed on the same terminal.
According to an aspect of an embodiment of the present application, there is provided an application data display method, including: the first terminal receives application data of a server, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; and the first terminal displays the control interface data and sends the functional interface data to the second terminal for display.
Optionally, after the first terminal displays the control interface data, the method further includes: the first terminal sends a control event to the server, wherein the control event is generated based on the control interface data and the function interface data.
Optionally, before the first terminal sends the control event to the server, the method further includes: detecting an operation event of a target object on a control interface corresponding to the functional interface data; a control event is generated based on the operational event.
Optionally, the receiving, by the first terminal, application data of the server includes: the server sends the initial function interface data to an image processing equipment set; processing the initial functional interface data by the image processing equipment set to obtain functional interface data; the image processing equipment set encodes the functional interface data, generates first encoded data and sends the first encoded data to the first terminal.
Optionally, the sending, by the first terminal, the functional interface data to the second terminal for displaying includes: the first terminal decodes the received first coded data to obtain first decoded data; the first terminal encodes the first decoded data again to obtain second encoded data and sends the second encoded data to the second terminal; and the second terminal decodes the second coded data to obtain second decoded data and displays the second decoded data on the second terminal.
Optionally, after the first terminal receives the application data of the server, the method includes: and the first terminal receives the switching instruction of the target object, sends the control interface data to the second terminal for displaying, and displays the functional interface data extracted from the application data.
According to another aspect of the embodiments of the present application, there is also provided a method for displaying application data, including: the first terminal receives application data of a server, wherein the application data at least comprises: functional interface data; and the first terminal displays control interface data corresponding to the functional interface data and sends the functional interface data to the second terminal for display.
Optionally, the control interface data corresponding to the functional interface data is control interface data pre-stored locally by the first terminal.
Optionally, the control interface data corresponding to the functional interface data is control interface data acquired from the application data.
According to another aspect of the embodiments of the present application, there is also provided a method for displaying application data, including: the server sends application data to the first terminal, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; the server displays the control interface data on the first terminal; and the server displays the functional interface data on the second terminal.
Optionally, the sending, by the server, the application data to the first terminal includes: the server sends the initial function interface data to an image processing equipment set; processing the initial functional interface data by the image processing equipment set to obtain functional interface data; the image processing device set sends the functional interface data to the first terminal.
Optionally, the processing the initial functional interface data by the image processing device set to obtain functional interface data includes: the server sends a rendering task request of the initial function interface data to an image processing equipment set; and the image processing equipment sets and executes the rendering task request to obtain the functional interface data.
Optionally, the method for requesting a rendering task includes, after the rendering task request carries identification information of a terminal and the image processing device performs the rendering task request in a set to obtain functional interface data, the method includes: the image processing equipment set encodes the functional interface data to generate first encoded data; the image processing equipment set stores the corresponding relation between the identification information of the first terminal and the first terminal in advance; and the image processing equipment set sends the first coded data to the first terminal corresponding to the identification information according to the corresponding relation.
According to another aspect of the embodiments of the present application, there is also provided a method for displaying application data, including: the first terminal receives application data of a server, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; the first terminal displays any one of the functional interface data and the control interface data, and sends other data to the second terminal for display, wherein the other data are as follows: among the functional interface data and the control interface data, data other than any one of the data displayed at the first terminal.
According to another aspect of the embodiments of the present application, there is also provided an apparatus for displaying application data, the apparatus being applied to a first terminal, the apparatus including: a data receiving module, configured to receive, by a first terminal, application data of a server, where the application data includes: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; and the display module is used for displaying the control interface data and sending the functional interface data to the second terminal for displaying.
According to another aspect of the embodiments of the present application, there is also provided a display system of application data, including: the server is used for sending application data to the first terminal, wherein the application data comprises: functional interface data and control interface data; the first terminal is used for displaying the control interface data and sending the functional interface data to the second terminal; and the second terminal is used for displaying the functional interface data.
According to another aspect of the embodiments of the present application, there is also provided a non-volatile storage medium, where the non-volatile storage medium includes a stored program, and when the program runs, a device in which the non-volatile storage medium is located is controlled to execute any one of the display methods of the application data.
According to another aspect of the embodiments of the present application, there is also provided a processor for executing a program stored in a memory, wherein the program executes any one of the display methods of application data.
In this embodiment of the present application, a manner of separately displaying a function interface and a control interface is adopted, and application data of a server is received through a first terminal, where the application data includes: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; the first terminal displays the control interface data and sends the function interface data to the second terminal for displaying, so that the technical effect that the control interface and the function interface are respectively displayed on the two terminals is achieved, and the technical problems that display is unclear and user operation experience is influenced due to the fact that the control interface and the function interface are displayed on the same terminal in the related art are solved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1a is a schematic structural diagram of a cloud game system according to the related art;
FIG. 1b is a flowchart illustrating a method for displaying application data according to an embodiment of the present application;
fig. 1c is a schematic structural diagram of a cloud game system according to an embodiment of the present application;
FIG. 1d is a schematic view of an alternative gaming terminal control interface showing a virtual handle on a screen according to an embodiment of the present application;
fig. 1e is a schematic diagram of a framework of an alternative first terminal according to an embodiment of the present application;
FIG. 2 is a flowchart illustrating a method for displaying application data according to an embodiment of the present application;
FIG. 3 is a flow chart illustrating another method for displaying application data according to an embodiment of the present application;
FIG. 4 is a flow chart illustrating another method for displaying application data according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a display device for displaying application data according to the present application;
fig. 6 is a schematic structural diagram of a display system for application data according to an embodiment of the present application.
Detailed Description
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In accordance with an embodiment of the present application, there is provided a method embodiment of a method for displaying application data, it being noted that the steps illustrated in the flowchart of the drawings may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowchart, in some cases the steps illustrated or described may be performed in an order different than presented herein.
To facilitate understanding of the embodiment of the present application, taking a cloud game scenario as an example, the technical terms involved in the embodiment of the present application are now explained as follows:
cloud gaming (Cloud gaming), also known as game on demand (gaming), is an online gaming technology based on Cloud computing technology. Cloud gaming technology enables a high-quality game to be run by a terminal thin client (thin client) with relatively limited graphics processing and data computing capabilities. In a cloud game scene, a game is not in a player game terminal but runs in a cloud server, a user can control VM (virtual machine)/PM (physical machine) on the cloud server through the game terminal, the cloud server renders the game scene into a video and audio stream, the video and audio stream is transmitted to the player game terminal through a network and displayed to the user through a display screen, visual lossy/lossless transmission of computer images such as texts, graphs and diagrams in a standard network and a reverse control function of the user on the VM/PM are achieved, and extremely-sophisticated experience which is completely the same as that of a remote user using a computer locally is provided for the remote user. The player game terminal does not need to have strong graphic operation and data processing capacity, and only needs to have basic streaming media playing capacity and capacity of acquiring player input instructions and sending the instructions to the cloud server. Fig. 1a is a cloud game system in the related art, and as shown in fig. 1a, the system includes: cloud server, game terminal.
Specifically, the game control method executed by the system comprises keyboard and mouse control, gamepad control, touch screen control and the like. The cloud games can be divided into two categories of hand games and end games, wherein the games of the hand games are mostly controlled by a touch screen, the games are controlled by the touch screen of a mobile phone, and control events of the touch screen of the game terminal are injected into a mobile phone operating system of the VM/PM and then into the cloud games. Most games of the end games are controlled by a keyboard mouse and a joystick, the game terminal is usually controlled by a keyboard mouse or a joystick connected to the game terminal, and the control event of the keyboard mouse or the joystick of the terminal is transmitted to the cloud and then injected into a desktop operating system of the VM/PM and further into the cloud games.
However, in the control method, the game picture and the control interface of the game are generally directly displayed on the same terminal, so that the control method has the technical problems that the operation is not flexible, and the display of the game picture or the control interface is not intuitive.
Fig. 1b is a display method of application data according to an embodiment of the present application, as shown in fig. 1b, the method includes the following steps:
step S102, the first terminal receives application data of a server, and the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; the control interface data may be expressed as a control interface providing an interface to a target application to which the application data corresponds, for example, a control for controlling the target application is shown in the control interface, where each control or a combination of controls corresponds to a function or an action of the target application.
And step S104, the first terminal displays the control interface data and sends the functional interface data to the second terminal for display.
In the method for displaying application data, first, the first terminal receives application data of a server, and the application data includes: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; then, the first terminal displays the control interface data and sends the function interface data to the second terminal for displaying, so that the technical effect that the control interface and the function interface are respectively displayed on the two terminals is achieved, and the technical problems that display is not clear and user operation experience is affected due to the fact that the control interface and the function interface are displayed on the same terminal in the related art are solved.
It is easy to note that the control interface data is at least used to control the implementation of functions in the functional interface data. In some embodiments, functions or actions not shown in the functional interface may also be controlled, i.e., the control interface data may also control underlying functions or actions in the target application.
Optionally, after the first terminal displays the control interface data, in order to control the function interface to implement its function, the first terminal needs to send a control event to the server, where the control event is generated based on the control interface data and the function interface data. It is easy to note that, before the first terminal sends the control event to the server, the control event needs to be determined first, and the manner of determining the control event includes but is not limited to: detecting an operation event of a target object on a control interface corresponding to the functional interface data; a control event is generated based on the operational event. For example, a leftward sliding motion (i.e., an operation event) on the control interface on the touch screen of the first terminal by the user is detected, and then based on the leftward sliding motion, a sliding instruction is generated, which is a control event.
In some optional embodiments of the present application, the first terminal may directly receive the application data from the server side, or the first terminal may indirectly receive the application data from the server, and specifically, the server sends the initial function interface data to the image processing device set; processing the initial functional interface data by the image processing equipment set to obtain functional interface data; the image processing equipment set encodes the functional interface data, generates first encoded data and sends the first encoded data to the first terminal. The initial interface data may be a login interface, a preparation interface, a notification interface, and the like of the application data.
It should be noted that, the image processing apparatus set processes the initial functional interface data to obtain functional interface data, and the processing method includes, but is not limited to: the server sends a rendering task request of the initial function interface data to an image processing equipment set; and the image processing equipment sets and executes the rendering task request to obtain the functional interface data.
In some optional embodiments of the application, when the display method of the application data is applied to the field of cloud games, the first terminal may be a game terminal, the server may be a cloud server, the second terminal may be a display device, and the image processing device set may employ a graphics processing unit POOL (GPU POOL), specifically, the graphics processing unit POOL may receive rendering instructions from the server, then render game interface data, and output a rendered game interface, where the graphics processing unit POOL may allocate corresponding resources for each rendering instruction, and it needs to be noted that a manner of allocating resources includes, but is not limited to: the allocation is performed according to a rule preset by the user, for example, the preset rule can be allocating a resource for a login interface in a game interface, allocating b resource for a notification interface, allocating c resource for a preparation interface, wherein, the relation of the resource file size can be a < b < c, or corresponding resources can be allocated according to different users, or dynamic allocation can be implemented according to game interface data, for example, according to the distribution of the size, color, type (text, picture, video) and the like of the game picture data, the embodiment of the present application also provides another cloud game system, as shown in fig. 1c, the cloud game system comprises a cloud server, an image processor pool and a game terminal, wherein a plurality of VM/PMs run in the cloud server, a control event driving module 2 is arranged in each VM/PM, and the game terminal sends a control event to each VM/PM; and the VM/PM transmits game handle control information to the game terminal, and the VM/PM transmits game image data to the game terminal through the image processor pool.
In order to facilitate control, in some optional embodiments of the present application, the game terminal may be an intelligent terminal device configured with a display screen, such as a smart phone, a tablet computer, and a notebook computer, and the display screen has a touch function. For convenience, the screen mentioned in the embodiment of the present application is a display screen with a touch function. The game terminal can be simulated as a game handle, a control interface of the virtual handle can be displayed on a screen of the game terminal, and fig. 1d is a schematic diagram of an optional control interface of the virtual handle displayed on the screen of the game terminal, as shown in fig. 1d, the control interface includes a plurality of keys, for example, an up-down key, a left-right key, and the like.
After the image processing device set encodes the functional interface data, generates first encoded data and sends the first encoded data to the first terminal, the first terminal can send the functional interface data to the second terminal for display, and it is easy to notice that in order to save file resources occupied by the functional interface data, the first terminal can decode the received first encoded data to obtain first decoded data; then, coding the first decoding data again to obtain second coding data, and sending the second coding data to a second terminal; and the second terminal decodes the second coded data to obtain second decoded data and displays the second decoded data on the second terminal.
In some optional embodiments of the present application, when the application data is game data, the first terminal is a game terminal for operating a game, as shown in fig. 1e, the game terminal mainly includes a receiving module 01, a sending module 03, an image processing module 04, a decoding module 05, a control event driving module 06, a screen 07, an acquisition module 08, and a display window 09 of a game screen, and the right side of the game terminal is connected to a display device.
The game terminal receives the encoded game picture data sent by the image processor pool, decodes the encoded game picture data to obtain the game picture data, and specifically, the receiving module 01 in the game terminal sends the encoded game picture data to the decoding module 05 after receiving the encoded game picture data from the image processor pool; the decoding module 05 decodes the encoded game picture data, restores the game picture data, and sends the game picture data to the image processing module 04, and then the game terminal re-encodes the restored game picture data to generate encoded data, and sends the encoded data to the receiving module 02.
It should be noted that, before the encoded game screen data sent by the image processor pool is sent to the game terminal, the VM/PM may send a rendering task of the game screen generated by the game program to the image processor pool, where the rendering task carries identification information of the game terminal, such as an ID of the terminal; the method comprises the steps that an image processor pool executes rendering tasks and generates game picture data, specifically, after receiving the rendering tasks of game pictures generated by a game program, a VM/PM can send the rendering tasks to the image processor pool to execute, in order to distinguish received game terminals, the rendering tasks carry game terminal IDs, and it is easy to notice that the image processor pool can be preset with corresponding relations between the game terminal IDs and addresses of the game terminals; and after finishing the rendering task, the image processor pool generates game picture data, encodes the game picture data and sends the encoded game picture data to the game terminal corresponding to the game terminal ID.
It is easy to note that the image processing module 04 of the game terminal re-encodes the restored game screen data to generate encoded data, and transmits the encoded data to the receiving module, and the capture module 08 directly uses the restored game screen.
The receiving module 02 decodes the received encoded data to obtain image data, and sends the image data to a display device for display. An image processing module in the game terminal generates image data of a control interface of the virtual gamepad and displays the generated image data of the control interface on a screen. In this way, the game player can see the control interface of the virtual gamepad on the display device.
To this end, the game user can see the control interface of the virtual gamepad on the screen of the game terminal, and can see the game picture on the display device connected with the game terminal.
The game terminal generates a control event according to an operation action executed by a game user on a screen, and sends the generated control event to the VM/PM through the sending module 03; the VM/PM injects the received control events into a game program, and a game user realizes the control of the game on the cloud server by executing operation actions on a screen of the game terminal. The control event driving module 06 of the game terminal acquires the operation action executed by the game user on the screen, generates a control event corresponding to the operation action, and sends the generated control event to the control event driving module 2 on the VM/PM; the control event driving module 2 injects the control event into the operating system of the VM/PM, and then into the game program, so as to realize the control of the game.
It should be noted that the process from the generation of the game terminal to the injection of the game program includes the following steps, where the control event may include a touch screen event and a gamepad key event, specifically:
step A, a game user operates on a screen of a game terminal to generate a touch screen event;
step B, converting the touch screen event into a game handle key event;
step C, injecting a game handle key event into a game program;
in specific implementation, the above process has two implementation modes:
firstly, the substep A and the substep B are both realized at a game terminal, and the substep C is realized at a cloud server;
and secondly, the substep A is realized at a game terminal, and the substep B and the substep C are realized at a cloud server.
When the first implementation manner is the above-mentioned first implementation manner, that is, the sub-step B is implemented in the game terminal, the virtual handle driving module is disposed in the game terminal, and the sub-step B is completed by the virtual handle driving module. In this case, the game terminal is further provided with a virtual handle management module, and the virtual handle management module is preset with game handle control information, wherein the game handle control information includes control interface information of the virtual game handle. Therefore, the image processing module in the game terminal can acquire the control interface information of the virtual gamepad from the virtual gamepad management module, generate the image data of the control interface of the gamepad according to the acquired control interface information of the virtual gamepad, and further send the image data of the control interface to the display device for display.
When the second implementation manner is adopted, that is, the sub-step B is implemented in the cloud server, the virtual handle driving module is arranged in the cloud server, and the sub-step B is completed by the virtual handle driving module in the cloud server. In this scenario, the cloud server is further provided with a virtual handle management module, and gamepad control information is preset in the virtual handle management module, wherein the gamepad control information includes control interface information of the virtual gamepad. The VM/PM in the cloud server can generate image data of the control interface of the gamepad according to the control interface information of the virtual gamepad in the virtual gamepad management module, send the image data of the control interface of the gamepad to the image processing module of the game terminal, and send the image data of the control interface to the screen for display through the image processing module.
In other optional embodiments of the present application, in order to meet different requirements of a user, the function interface and the control interface may be switched and displayed, and specifically, after receiving application data of the server, the first terminal may receive a switching instruction of a target object, send the control interface data to the second terminal for display, and display the function interface data extracted from the application data.
Fig. 2 is another display method of application data according to an embodiment of the present application, as shown in fig. 2, the method includes the following steps:
s202, the first terminal receives application data of the server, and the application data at least comprises: functional interface data;
and S204, the first terminal displays the control interface data corresponding to the functional interface data and sends the functional interface data to the second terminal for display.
In the method, first, a first terminal receives application data of a server, wherein the application data at least comprises: functional interface data; and then, the first terminal displays the control interface data corresponding to the functional interface data and sends the functional interface data to the second terminal for display, so that the technical effect of respectively displaying the control interface and the functional interface on the two terminals is realized, and the technical problems that the display is unclear and the user operation experience is influenced because the control interface and the functional interface are displayed on the same terminal in the related technology are solved.
The control interface data corresponding to the functional interface data may be control interface data pre-stored locally by the first terminal, or control interface data acquired from application data.
Fig. 3 is a diagram illustrating another application data display method according to an embodiment of the present application, as shown in fig. 3, the method includes the following steps:
s302, the server sends application data to the first terminal, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data;
s304, the server displays the control interface data on the first terminal;
s306, the server displays the functional interface data on the second terminal.
In the method, firstly, a server sends application data to a first terminal, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; then, the server displays the control interface data on the first terminal; and finally, the server displays the functional interface data on the second terminal, so that the technical effect of respectively displaying the control interface and the functional interface on the two terminals is realized, and the technical problems that the display is unclear and the user operation experience is influenced because the control interface and the functional interface are displayed on the same terminal in the related art are solved.
In some optional embodiments of the present application, the server may directly send the application data to the first terminal, or send the application data to the first terminal after processing by the intermediate device, and specifically, the server sends the initial function interface data to the image processing device set; processing the initial functional interface data by the image processing equipment set to obtain functional interface data; the image processing device set sends the functional interface data to the first terminal.
It should be noted that, the image processing apparatus set processes the initial functional interface data to obtain functional interface data, and the processing method includes, but is not limited to: the server sends a rendering task request of the initial function interface data to an image processing equipment set; and the image processing equipment sets and executes the rendering task request to obtain the functional interface data.
In order to distinguish whether a terminal of a receiving end is a target terminal, the image processing device set may pre-store a corresponding relationship between identification information of a first terminal and the first terminal, in some optional embodiments of the present application, a rendering task request may carry the identification information of the terminal, the image processing device set executes the rendering task request, after obtaining functional interface data, the image processing device set encodes the functional interface data, and after generating first encoded data; the set of image processing devices may transmit the first encoded data to a target terminal, e.g., a first terminal, to which the identification information corresponds in correspondence.
Fig. 4 is a diagram illustrating another application data display method according to an embodiment of the present application, as shown in fig. 4, the method includes the following steps:
s402, the first terminal receives application data of the server, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data;
s404, the first terminal displays any one of the functional interface data and the control interface data and sends other data to the second terminal for displaying, wherein the other data are as follows: among the functional interface data and the control interface data, data other than any one of the data displayed at the first terminal.
In the method, first, a first terminal receives application data of a server, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; then, the first terminal displays any one of the functional interface data and the control interface data, and sends other data to the second terminal for displaying, wherein the other data are: in the functional interface data and the control interface data, the data except any one data displayed on the first terminal is used, so that the technical effect of respectively displaying the control interface and the functional interface on the two terminals is realized, and the technical problems that the display is not clear and the user operation experience is influenced because the control interface and the functional interface are displayed on the same terminal in the related technology are solved.
Fig. 5 is a display device for application data according to the present application, which is applied to a first terminal, as shown in fig. 5, and includes:
a data receiving module 40, configured to receive, by the first terminal, application data of the server, where the application data includes: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data;
and the display module 42 is configured to display the control interface data, and send the function interface data to the second terminal for displaying.
In the apparatus, the data receiving module 40 is configured to receive, by the first terminal, application data of the server, where the application data includes: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; the display module 42 is configured to display the control interface data and send the function interface data to the second terminal for displaying, so as to achieve a technical effect of displaying the control interface and the function interface at the two terminals respectively, and further solve technical problems that display is unclear and user operation experience is affected because the control interface and the function interface are displayed at the same terminal in the related art.
Fig. 6 is a display system of application data according to an embodiment of the present application, the system including:
the server 001 is configured to send application data to the first terminal, where the application data includes: functional interface data and control interface data;
the first terminal 002 is used for displaying the control interface data and sending the functional interface data to the second terminal;
and the second terminal 003 is used for displaying the functional interface data.
In the system, the server 001 is configured to send application data to the first terminal, where the application data includes: functional interface data and control interface data; the first terminal 002 is used for displaying the control interface data and sending the functional interface data to the second terminal; the second terminal 003 is configured to display the functional interface data, so that a technical effect of displaying the control interface and the functional interface at the two terminals respectively is achieved, and further technical problems that display is unclear and user operation experience is affected due to the fact that the control interface and the functional interface are displayed at the same terminal in the related art are solved.
The embodiment of the application also provides a nonvolatile storage medium, wherein the nonvolatile storage medium comprises a stored program, and when the program runs, the device where the nonvolatile storage medium is located is controlled to execute any application data display method.
Specifically, the nonvolatile storage medium is used for storing program instructions for executing the following functions, and the following functions are realized:
the first terminal receives application data of a server, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; and the first terminal displays the control interface data and sends the functional interface data to the second terminal for display.
The embodiment of the application also provides a processor, wherein the processor is used for running the program stored in the memory, and the program executes any application data display method during running.
Specifically, the processor is configured to call a program instruction in the memory, and implement the following functions:
the first terminal receives application data of a server, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data; and the first terminal displays the control interface data and sends the functional interface data to the second terminal for display.
The above-mentioned serial numbers of the embodiments of the present application are merely for description and do not represent the merits of the embodiments.
In the above embodiments of the present application, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units may be a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The foregoing is only a preferred embodiment of the present application and it should be noted that those skilled in the art can make several improvements and modifications without departing from the principle of the present application, and these improvements and modifications should also be considered as the protection scope of the present application.
Claims (18)
1. A method for displaying application data, comprising:
the method comprises the steps that a first terminal receives application data of a server, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data;
and the first terminal displays the control interface data and sends the function interface data to a second terminal for display.
2. The method of claim 1, wherein after the first terminal displays the control interface data, the method further comprises: the first terminal sends a control event to the server, wherein the control event is generated based on the control interface data and the function interface data.
3. The method of claim 2, wherein before the first terminal sends the control event to the server, the method further comprises:
detecting an operation event of a target object on a functional interface corresponding to the functional interface data;
generating the control event based on the operational event.
4. The method of claim 1, wherein the first terminal receives application data of the server, comprising:
the server sends the initial function interface data to an image processing equipment set;
the image processing equipment set processes the initial functional interface data to obtain the functional interface data;
and the image processing equipment set encodes the functional interface data, generates first encoded data and sends the first encoded data to the first terminal.
5. The method of claim 4, wherein the first terminal sending the function interface data to a second terminal for display comprises:
the first terminal decodes the received first coded data to obtain first decoded data;
the first terminal encodes the first decoding data again to obtain second encoding data, and sends the second encoding data to the second terminal;
and the second terminal decodes the second coded data to obtain second decoded data and displays the second decoded data on the second terminal.
6. The method according to claim 1, wherein after the first terminal receives the application data of the server, the method comprises:
and the first terminal receives a switching instruction of a target object, sends the control interface data to a second terminal for displaying, and displays the functional interface data extracted from the application data.
7. A method for displaying application data, comprising:
the method comprises the steps that a first terminal receives application data of a server, wherein the application data at least comprises: functional interface data;
and the first terminal displays the control interface data corresponding to the functional interface data and sends the functional interface data to the second terminal for display.
8. The method according to claim 7, wherein the control interface data corresponding to the function interface data is control interface data pre-stored locally by the first terminal.
9. The method according to claim 7, wherein the control interface data corresponding to the function interface data is control interface data obtained from the application data.
10. A method for displaying application data, comprising:
the server sends application data to the first terminal, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data;
the server displays the control interface data on the first terminal;
and the server displays the functional interface data on the second terminal.
11. The method of claim 10, wherein the server sending the application data to the first terminal comprises:
the server sends the initial function interface data to an image processing equipment set;
the image processing equipment set processes the initial functional interface data to obtain the functional interface data;
and the image processing equipment set sends the functional interface data to the first terminal.
12. The method of claim 11, wherein the processing of the initial functional interface data by the set of image processing devices to obtain the functional interface data comprises:
the server sends the rendering task request of the initial function interface data to the image processing equipment set;
and the image processing equipment sets and executes the rendering task request to obtain the functional interface data.
13. The method according to claim 12, wherein the rendering task request carries identification information of the terminal, and after the image processing device performs the rendering task request to obtain the functional interface data, the method includes:
the image processing equipment set encodes the functional interface data to generate first encoded data; the image processing equipment set stores the corresponding relation between the identification information of the first terminal and the first terminal in advance;
and the image processing equipment set sends the first coded data to the first terminal corresponding to the identification information according to the corresponding relation.
14. A method for displaying application data, comprising:
the method comprises the steps that a first terminal receives application data of a server, wherein the application data comprises: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data;
the first terminal displays any one of the functional interface data and the control interface data, and sends other data to the second terminal for displaying, wherein the other data are as follows: and in the functional interface data and the control interface data, data other than the arbitrary one data displayed at the first terminal.
15. An apparatus for displaying application data, the apparatus being applied to a first terminal, the apparatus comprising:
a data receiving module, configured to receive application data of a server, where the application data includes: functional interface data and control interface data, wherein the control interface data is at least used for controlling the functions displayed by the functional interface data;
and the display module is used for displaying the control interface data and sending the functional interface data to a second terminal for displaying.
16. A display system for application data, comprising:
the server is used for sending application data to the first terminal, wherein the application data comprises: functional interface data and control interface data;
the first terminal is used for displaying the control interface data and sending the function interface data to the second terminal;
and the second terminal is used for displaying the functional interface data.
17. A non-volatile storage medium, comprising a stored program, wherein when the program runs, a device in which the non-volatile storage medium is located is controlled to execute the application data display method according to any one of claims 1 to 14.
18. A processor for executing a program stored in a memory, wherein the program executes to perform a method of displaying application data according to any one of claims 1 to 14.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010797870.1A CN111930328B (en) | 2020-08-10 | 2020-08-10 | Application data display method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010797870.1A CN111930328B (en) | 2020-08-10 | 2020-08-10 | Application data display method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111930328A true CN111930328A (en) | 2020-11-13 |
| CN111930328B CN111930328B (en) | 2024-03-15 |
Family
ID=73307340
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010797870.1A Active CN111930328B (en) | 2020-08-10 | 2020-08-10 | Application data display method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111930328B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112770159A (en) * | 2020-12-30 | 2021-05-07 | 北京字节跳动网络技术有限公司 | Multi-screen interaction system, method, device, equipment and storage medium |
Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20090055885A (en) * | 2007-11-29 | 2009-06-03 | 주식회사 엔씨소프트 | Method for providing on-line game playing image |
| US20150087414A1 (en) * | 2013-09-26 | 2015-03-26 | Cellco Partnership D/B/A Verizon Wireless | Cloud gaming implemented using a mobile device and a display device |
| US20170050110A1 (en) * | 2015-08-19 | 2017-02-23 | Sony Computer Entertainment America Llc | Local application quick start with cloud transitioning |
| US20170354878A1 (en) * | 2016-06-13 | 2017-12-14 | Sony Interactive Entertainment America Llc | Browser-based cloud gaming |
| CN108829320A (en) * | 2018-06-21 | 2018-11-16 | Oppo广东移动通信有限公司 | Exchange method, device, storage medium, mobile terminal and interactive system |
| CN109126122A (en) * | 2017-06-16 | 2019-01-04 | 上海拆名晃信息科技有限公司 | A kind of cloud game network system realization for virtual reality |
| CN110180166A (en) * | 2019-07-16 | 2019-08-30 | 南昌黑鲨科技有限公司 | Control system and method based on cloud game scene |
| CN110227259A (en) * | 2018-03-06 | 2019-09-13 | 华为技术有限公司 | A kind of method, apparatus of data processing, server and system |
| CN110368686A (en) * | 2019-07-03 | 2019-10-25 | 上海闻泰信息技术有限公司 | Cloud game implementation method, device, cloud server, terminal and medium |
| CN110548284A (en) * | 2019-08-13 | 2019-12-10 | 广州点云科技有限公司 | split screen interaction method and device based on cloud game |
| CN110572469A (en) * | 2019-09-18 | 2019-12-13 | 北京视博云科技有限公司 | Data transmission method, input device, cloud server and cloud game system |
| CN110841278A (en) * | 2019-11-14 | 2020-02-28 | 珠海金山网络游戏科技有限公司 | Cloud game implementation method and device |
| CN110943959A (en) * | 2018-09-21 | 2020-03-31 | 华为技术有限公司 | Business processing method, cloud management platform, terminal and storage medium |
| CN111068317A (en) * | 2019-10-31 | 2020-04-28 | 咪咕互动娱乐有限公司 | Cloud game control method, server and readable storage medium |
| CN111084983A (en) * | 2019-11-25 | 2020-05-01 | 腾讯科技（深圳）有限公司 | Cloud game service method, device, equipment and storage medium |
| CN111202980A (en) * | 2019-12-31 | 2020-05-29 | 咪咕互动娱乐有限公司 | Information transmission method, streaming media cloud platform and computer readable storage medium |
| CN111467791A (en) * | 2020-04-13 | 2020-07-31 | 西安万像电子科技有限公司 | Target object control method, device and system |
| CN111467790A (en) * | 2020-04-13 | 2020-07-31 | 西安万像电子科技有限公司 | Target object control method, device and system |
| CN111494936A (en) * | 2020-02-12 | 2020-08-07 | 阿里巴巴集团控股有限公司 | Picture rendering method, device, system and storage medium |
-
2020
- 2020-08-10 CN CN202010797870.1A patent/CN111930328B/en active Active
Patent Citations (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20090055885A (en) * | 2007-11-29 | 2009-06-03 | 주식회사 엔씨소프트 | Method for providing on-line game playing image |
| US20150087414A1 (en) * | 2013-09-26 | 2015-03-26 | Cellco Partnership D/B/A Verizon Wireless | Cloud gaming implemented using a mobile device and a display device |
| US20170050110A1 (en) * | 2015-08-19 | 2017-02-23 | Sony Computer Entertainment America Llc | Local application quick start with cloud transitioning |
| US20170354878A1 (en) * | 2016-06-13 | 2017-12-14 | Sony Interactive Entertainment America Llc | Browser-based cloud gaming |
| CN109126122A (en) * | 2017-06-16 | 2019-01-04 | 上海拆名晃信息科技有限公司 | A kind of cloud game network system realization for virtual reality |
| CN110227259A (en) * | 2018-03-06 | 2019-09-13 | 华为技术有限公司 | A kind of method, apparatus of data processing, server and system |
| CN108829320A (en) * | 2018-06-21 | 2018-11-16 | Oppo广东移动通信有限公司 | Exchange method, device, storage medium, mobile terminal and interactive system |
| CN110943959A (en) * | 2018-09-21 | 2020-03-31 | 华为技术有限公司 | Business processing method, cloud management platform, terminal and storage medium |
| CN110368686A (en) * | 2019-07-03 | 2019-10-25 | 上海闻泰信息技术有限公司 | Cloud game implementation method, device, cloud server, terminal and medium |
| CN110180166A (en) * | 2019-07-16 | 2019-08-30 | 南昌黑鲨科技有限公司 | Control system and method based on cloud game scene |
| CN110548284A (en) * | 2019-08-13 | 2019-12-10 | 广州点云科技有限公司 | split screen interaction method and device based on cloud game |
| CN110572469A (en) * | 2019-09-18 | 2019-12-13 | 北京视博云科技有限公司 | Data transmission method, input device, cloud server and cloud game system |
| CN111068317A (en) * | 2019-10-31 | 2020-04-28 | 咪咕互动娱乐有限公司 | Cloud game control method, server and readable storage medium |
| CN110841278A (en) * | 2019-11-14 | 2020-02-28 | 珠海金山网络游戏科技有限公司 | Cloud game implementation method and device |
| CN111084983A (en) * | 2019-11-25 | 2020-05-01 | 腾讯科技（深圳）有限公司 | Cloud game service method, device, equipment and storage medium |
| CN111202980A (en) * | 2019-12-31 | 2020-05-29 | 咪咕互动娱乐有限公司 | Information transmission method, streaming media cloud platform and computer readable storage medium |
| CN111494936A (en) * | 2020-02-12 | 2020-08-07 | 阿里巴巴集团控股有限公司 | Picture rendering method, device, system and storage medium |
| CN111467791A (en) * | 2020-04-13 | 2020-07-31 | 西安万像电子科技有限公司 | Target object control method, device and system |
| CN111467790A (en) * | 2020-04-13 | 2020-07-31 | 西安万像电子科技有限公司 | Target object control method, device and system |
Non-Patent Citations (3)
| Title |
|---|
| RUN WU: "Towards cloudlet-based mobile cloud gaming", 《IEEE XPLORE》 * |
| 周宣锐;: "一种基于瘦客户端的云游戏系统优化方法", 电子测试, no. 10 * |
| 秦开怀: "基于高性能图形并行计算的手机3D游戏解决方案", 《中国体视学与图像分析》, vol. 15, no. 2 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112770159A (en) * | 2020-12-30 | 2021-05-07 | 北京字节跳动网络技术有限公司 | Multi-screen interaction system, method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111930328B (en) | 2024-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109309842B (en) | Live broadcast data processing method and device, computer equipment and storage medium | |
| CN111552450A (en) | Screen projection method and device | |
| CN113209632B (en) | Cloud game processing method, device, equipment and storage medium | |
| WO2022257699A1 (en) | Image picture display method and apparatus, device, storage medium and program product | |
| US8892633B2 (en) | Apparatus and method for transmitting and receiving a user interface in a communication system | |
| CN111467790B (en) | Target object control method, device and system | |
| CN102375687A (en) | Cloning or extending a computer desktop on a wireless display surface | |
| CN112905289A (en) | Application picture display method, device, terminal, screen projection system and medium | |
| CN102460407A (en) | Virtual desktop services | |
| CN104144351A (en) | Video playing method and device applying virtualization platform | |
| CN111478930B (en) | STB cloud method, system, thin STB, virtual STB, platform and storage medium | |
| CN115065684B (en) | Data processing method, apparatus, device and medium | |
| CN111672132B (en) | Game control method, game control device, server, and storage medium | |
| CN111880845A (en) | Method, system and device for controlling target application | |
| CN101908033A (en) | Method and device for multiuser to remotely use multiple master computers | |
| CN111467791A (en) | Target object control method, device and system | |
| CN112354176A (en) | Cloud game implementation method, cloud game implementation device, storage medium and electronic equipment | |
| CN107643930A (en) | Using operation method and Cloud Server | |
| CN115445194A (en) | Rendering method, device and equipment of game and storage medium | |
| CN111870962A (en) | Cloud game data processing method and system | |
| CN111930328B (en) | Application data display method, device and system | |
| CN114598931A (en) | Streaming method, system, device and medium for multi-open cloud game | |
| CN115364477A (en) | Cloud game control method and device, electronic equipment and storage medium | |
| CN111953838B (en) | Call dialing method, display device and mobile terminal | |
| CN107004018B (en) | Data processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |