CN110393921B - Cloud game processing method and device, terminal, server and storage medium - Google Patents

Cloud game processing method and device, terminal, server and storage medium Download PDF

Info

Publication number
CN110393921B
CN110393921B CN201910742746.2A CN201910742746A CN110393921B CN 110393921 B CN110393921 B CN 110393921B CN 201910742746 A CN201910742746 A CN 201910742746A CN 110393921 B CN110393921 B CN 110393921B
Authority
CN
China
Prior art keywords
data
terminal
rendering
server
text data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910742746.2A
Other languages
Chinese (zh)
Other versions
CN110393921A (en
Inventor
周扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201910742746.2A priority Critical patent/CN110393921B/en
Publication of CN110393921A publication Critical patent/CN110393921A/en
Application granted granted Critical
Publication of CN110393921B publication Critical patent/CN110393921B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35Details of game servers
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35Details of game servers
    • A63F13/358Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/85Providing additional services to players
    • A63F13/87Communicating with other players during game play, e.g. by e-mail or chat
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality

Abstract

The embodiment of the invention discloses a processing method, a processing device, a terminal, a server and a storage medium of a cloud game, wherein the method comprises the following steps: the method comprises the steps of receiving text data and first video stream data of the cloud game sent by a server, rendering the text data according to a negotiated rendering strategy to obtain second video stream data, performing superposition processing on the first video stream data and the second video stream data to obtain target video stream data of the cloud game, and outputting the target video stream data of the cloud game, wherein the first video stream data are obtained by processing game data of the cloud game by the server according to the negotiated rendering strategy. By implementing the method, the terminal and the server can comprehensively process data generated by the cloud game, and the requirements of the running cloud game on the performance of the server and the communication quality are reduced.

Description

Cloud game processing method and device, terminal, server and storage medium
Technical Field
The invention relates to the technical field of computers, in particular to a cloud game processing method, a cloud game processing device, a cloud game terminal, a cloud game server and a storage medium.
Background
The cloud game is a game mode based on cloud computing, all games run in corresponding servers in a running mode of the cloud game, and rendered game pictures are compressed by the servers and then transmitted to terminals bearing the games through a network. The terminal does not need any high-end processor and display card, and can acquire the corresponding game picture only by basic video decompression capacity.
Compared with the traditional game mode, the cloud game can greatly reduce the performance requirement on terminals (mobile phones, computers, tablet computers and the like) bearing the game. But the requirement for the server is higher, and when the network communication quality is poor, the delay of the terminal receiving the game picture is higher, and the game experience of the user is reduced.
Disclosure of Invention
The embodiment of the invention provides a cloud game processing method and device, a terminal, a server and a storage medium, which can enable the terminal and the server to comprehensively process data generated by a cloud game and reduce the requirements of running the cloud game on the performance of the server and the communication quality.
In a first aspect, an embodiment of the present invention provides a cloud game processing method, where the method includes:
receiving text data and first video streaming data of a cloud game sent by a server, wherein the first video streaming data is obtained by processing game data of the cloud game by the server according to a negotiated rendering strategy;
rendering the text data according to the negotiated rendering strategy to obtain second video stream data;
overlapping the first video streaming data and the second video streaming data to obtain target video streaming data of the cloud game;
and outputting target video streaming data of the cloud game.
In a second aspect, an embodiment of the present invention provides a processing apparatus for a cloud game, where the apparatus includes:
the system comprises a receiving module, a processing module and a display module, wherein the receiving module is used for receiving text data and first video streaming data of the cloud game, which are sent by a server, and the first video streaming data are obtained by processing the game data of the cloud game by the server according to a negotiated rendering strategy;
the rendering module is used for rendering the text data according to the negotiated rendering strategy to obtain second video stream data;
the superposition module is used for carrying out superposition processing on the first video streaming data and the second video streaming data to obtain target video streaming data of the cloud game;
and the output module is used for outputting the target video stream data of the cloud game.
In a third aspect, an embodiment of the present invention provides a terminal, including a processor, adapted to implement one or more instructions; and a computer readable storage medium storing one or more first instructions adapted to be loaded by the processor and to perform the method of the first aspect.
In a fourth aspect, the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and the computer program includes program instructions, which, when executed by a processor, cause the processor to execute the method of the first aspect.
In a fifth aspect, an embodiment of the present invention provides a cloud game processing method, where the method includes:
the method comprises the steps of obtaining game data of the cloud game, wherein the game data comprise text data and image data;
screening the text data of the cloud game according to the negotiated rendering strategy to obtain screened text data;
rendering the remaining text data and the image data which are not screened according to the negotiated rendering strategy to obtain first video stream data;
and sending the screened text data and the first video stream data to the terminal, so that the terminal renders the screened text data to obtain second video stream data, and obtaining target video stream data according to the first video data and the second video stream data.
In a sixth aspect, an embodiment of the present invention provides a processing apparatus for a cloud game, where the apparatus includes:
the cloud game system comprises an acquisition module, a storage module and a processing module, wherein the acquisition module is used for acquiring game data of a cloud game, and the game data comprises text data and image data;
the screening module is used for screening the text data of the cloud game according to the negotiated rendering strategy to obtain screened text data;
the rendering module is used for rendering the remaining unscreened text data and the image data according to the negotiated rendering strategy to obtain first video stream data;
and the sending module is used for sending the screened text data and the first video stream data to the terminal, so that the terminal renders the screened text data to obtain second video stream data, and target video stream data is obtained according to the first video data and the second video stream data.
In a seventh aspect, an embodiment of the present invention provides a server, including a processor, adapted to implement one or more instructions; and a computer readable storage medium storing one or more second instructions adapted to be loaded by the processor and to perform the method of the fifth aspect.
In an eighth aspect, the embodiment of the present invention provides a computer-readable storage medium, which is characterized in that the computer-readable storage medium stores a computer program, and the computer program includes program instructions, which, when executed by a processor, cause the processor to execute the method of the fifth aspect.
In a ninth aspect, an embodiment of the present invention provides a cloud game processing system, where the system includes a server and a terminal;
the server is used for acquiring game data of the cloud game, wherein the game data comprises text data and image data; screening the text data of the cloud game according to the negotiated rendering strategy to obtain screened text data; rendering the remaining text data and the image data which are not screened according to the negotiated rendering strategy to obtain first video stream data; sending the screened text data and the first video stream data to the terminal, rendering the screened text data by the terminal to obtain second video stream data, and obtaining target video stream data according to the first video data and the second video stream data;
the terminal is used for receiving text data and first video streaming data of the cloud game, which are sent by the server, wherein the first video streaming data are obtained by processing the game data of the cloud game by the server according to the negotiated rendering strategy; rendering the text data according to the negotiated rendering strategy to obtain second video stream data; overlapping the first video stream data and the second video stream data to obtain target video stream data of the cloud game; and outputting target video streaming data of the cloud game.
In the embodiment of the invention, a terminal receives text data and first video stream data of a cloud game sent by a server, and renders the text data according to a negotiated rendering strategy to obtain second video stream data; the terminal performs superposition processing on the first video streaming data and the second video streaming data to obtain target video streaming data of the cloud game, and outputs the target video streaming data of the cloud game, wherein the first video streaming data is obtained by processing game data of the cloud game by the server according to the negotiated rendering strategy. By the implementation of the mode, the terminal and the server can comprehensively process data generated by the cloud game, and the requirements of the running cloud game on the performance of the server and the communication quality are reduced.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic diagram illustrating a structure and an operation principle of a cloud game processing system according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a cloud game interface according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a cloud game processing system according to an embodiment of the present invention;
fig. 4 is a schematic flowchart of a processing method of a cloud game according to an embodiment of the present invention;
fig. 5 is a schematic diagram illustrating a process of overlaying video stream data according to an embodiment of the present invention;
FIG. 6 is a schematic diagram of a process for generating a game screen according to an embodiment of the present invention;
fig. 7 is a schematic diagram of another cloud game processing method provided by the embodiment of the invention;
fig. 8 is a flowchart illustrating a rendering policy negotiation method according to an embodiment of the present invention;
FIG. 9 is a schematic view of a game interface of another cloud game provided by an embodiment of the invention;
fig. 10 is a schematic structural diagram of a cloud game client according to an embodiment of the present invention;
fig. 11 is a schematic structural diagram of a cloud game server according to an embodiment of the present invention;
fig. 12 is a schematic view illustrating an interaction flow between a cloud game server and a cloud game client according to an embodiment of the present invention;
fig. 13 is a schematic view illustrating an interaction flow between a cloud game server and a cloud game client according to another embodiment of the present invention;
fig. 14 is a flowchart illustrating a processing method of another cloud game according to an embodiment of the present invention;
fig. 15 is a schematic structural diagram of a cloud game processing apparatus according to an embodiment of the present invention;
fig. 16 is a schematic structural diagram of a processing device of another cloud game provided in an embodiment of the present invention;
fig. 17 is a schematic structural diagram of a terminal according to an embodiment of the present invention;
fig. 18 is a schematic structural diagram of a server according to an embodiment of the present invention.
Detailed Description
The technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention.
Cloud games, which may also be referred to as game-on-demand, are an online game technology based on cloud computing technology. Cloud game technology enables light-end equipment with relatively limited graphics processing and data computing capabilities to run high-quality games. In a cloud game scene, a game is run not at a terminal used by a user for playing the game, but in a cloud server, the game scene is rendered into a video and audio stream by the cloud server, and the video and audio stream is transmitted to the terminal through a network. The terminal does not need to have strong graphic operation and data processing capacity, and only needs to have basic streaming media playing capacity and capacity of acquiring user input instructions and sending the instructions to the cloud server. As shown in fig. 1, the system includes a terminal 101 and a server 102, and the terminal 101 and the server 102 establish a communication connection through a network. The specific working process comprises the steps that a user inputs control operation in the terminal 101, the terminal 101 generates an operation instruction according to the control operation input by the user and sends the operation instruction to the server 102, the server 102 analyzes the received operation instruction to obtain game data corresponding to the operation instruction, furthermore, the server performs picture rendering according to the game data to generate corresponding video stream data and sends the video stream data to the terminal 101 after encoding, and the terminal 101 decodes the received video stream data to obtain a game picture.
In the current cloud game running scheme, the server undertakes the running work of the game, and the terminal only needs to acquire the video stream data transmitted by the server and display the received video stream data, so that the game picture can be displayed. However, the video stream data transmitted from the server to the terminal includes not only the image screen of the game itself but also a text screen such as a screen formed based on chat information of the game user. The character pictures are compressed together with the image pictures, because the character display density is higher, the character display is not clear under the condition of low resolution, if the characters are to be displayed clearly, the server needs to render a high-definition game picture, and further, the performance requirement of the rendered game picture on the server is increased, and the requirements of the transmission game picture on the communication bandwidth are increased. As shown in fig. 2, which is a schematic view of a display interface of an existing cloud game in a low resolution mode, an image frame 201 of the cloud game in fig. 2 has a corresponding outline in the low resolution mode, which does not greatly affect the game experience of a user, but because the density between characters in a character frame 202 is too high, the character frame 202 cannot be clearly displayed, so that the user is difficult to recognize the characters in the game.
Based on this, the embodiment of the present invention provides a cloud game processing scheme, which can process different types of data in a cloud game in different processing manners, and reduce requirements on server performance and communication quality in a cloud game operation process.
Based on the above description, an embodiment of the present invention provides a cloud game processing system, please refer to fig. 3, in which the system includes a terminal 301 and a server 302, and the terminal 301 and the server 302 establish a communication connection through a network. The specific working flow is that a user inputs a control operation in a terminal 301, the terminal 301 generates an operation instruction according to the control operation and sends the operation instruction to a server 302, the server 302 analyzes the operation instruction and obtains game data corresponding to the operation instruction, further, the server 302 splits the game data to obtain two parts of data, namely image data and text data, the server 302 renders the image data to generate first video streaming data and sends the first video streaming data and the text data to the terminal 301, the terminal 301 renders the text data to generate second video streaming data, and superimposes the first video streaming data and the second video streaming data to obtain target video streaming data, wherein the first video streaming data is composed of multi-frame image pictures, and the second video streaming data is composed of multi-frame text pictures, the target video stream data is constituted by a plurality of frames of game pictures. The text data may specifically be chat information between users, user nicknames, guide characters, and the like, and the image data may specifically be a human image, a scene image, and the like.
In summary, the method provided by the embodiment of the invention can enable the server to render the image data required by low definition and the terminal to render the text data required by high definition, thereby reducing the performance requirement of the running cloud game on the server, reducing the data volume of the video stream data transmitted to the terminal by the server, and further reducing the requirement of the running cloud game on the communication bandwidth.
Based on the description of the embodiment of the processing system of the cloud game, the embodiment of the present invention provides a processing method of a cloud game, which may be applied to the processing system of the cloud game shown in fig. 3, and may be specifically executed by the terminal shown in fig. 3. Referring to fig. 4, the processing procedure of the cloud game may include the following steps S401 to S404:
s401, the terminal receives text data and first video streaming data of the cloud game sent by the server.
In the embodiment of the invention, the first video stream data is obtained by processing the game data of the cloud game by the server according to the negotiated rendering strategy; the text data comprises chat information, role nicknames, operation instructions and the like among game users, the types of the text data can comprise input text type, role nickname type and system prompting type, the input text type text data can comprise chat information among cloud game users, the role nickname type text data can comprise names of roles in the cloud game, and the system prompting type text data can comprise system-owned characters in the cloud game, such as operation instructions, novice prompts and the like.
In specific implementation, the text data received by the terminal may be text data screened by the server according to the negotiated rendering strategy. The negotiated rendering policy defines a type of text data that the terminal needs to receive, and may be specifically determined by the server according to a performance parameter sent by the terminal, where the performance parameter is used to reflect a rendering capability of the terminal, such as a chip type, a memory size, a graphics card type, and the like. The specific negotiation process of the rendering policy may include that the server sends a parameter configuration table to the terminal, where the parameter configuration table includes performance parameters required for rendering text data, and specifically may be performance parameters required for rendering each type of text data; the terminal determines the type of the text data which supports rendering according to the parameter configuration table, and sends the type to the server, and the server determines the negotiated rendering strategy according to the received type, namely determines the type of the text data which needs to be sent to the terminal and the rendering mode aiming at the type of the text data, such as font attribute, position attribute, display mode and the like.
For example, the performance parameters required for rendering the text data of the input text type are as follows: the memory is more than 100 million, and the performance parameters required for rendering the nickname type text data of the roles are as follows: the memory is more than 120 million, and the performance parameters required by the prompt text data of the rendering system are as follows: the method comprises the steps that the memory is larger than 150 million, the terminal detects performance parameters of the terminal to obtain the memory of the terminal, the terminal determines the types of rendered text data supported by the terminal to be input text type and role nickname type, the types are sent to a server, and the server screens out the input text type text data and the role nickname type text data from the text data in the cloud games to send to the terminal after receiving the types sent by the terminal. And the terminal receives the text data sent by the server.
In an implementation manner, the text data in the cloud game may be text data generated by the server according to an operation instruction uploaded by the terminal, specifically, if the terminal detects a preset trigger operation input to the cloud game, the terminal generates the operation instruction according to the preset trigger operation, the preset trigger operation may be a text input operation or a picture update operation input by a user, the operation instruction generated by the terminal is used for acquiring a resource in the server, and after the terminal sends the operation instruction to the server, the text data and the first video stream data of the cloud game sent by the server are received.
S402, rendering the text data by the terminal according to the negotiated rendering strategy to obtain second video stream data.
In the embodiment of the invention, after the terminal acquires the text data and the first video stream data sent by the server, the text data is rendered according to the negotiated rendering strategy to obtain the second video stream data. The negotiated rendering strategy is specifically determined by the server according to the performance parameters sent by the terminal. The negotiated rendering strategy defines a rendering mode of the text data, including font attributes, position attributes and a display mode of the text data. The font attributes include font size, font format, font interval and the like of characters in the text data, the position attributes include appearance positions, disappearance positions and the like of the characters in the text data, the display mode includes appearance time, display resolution and the like of the text data, and specifically, the characters in the text data are displayed in the geometric resolution of the second frame of the second video stream data. And after determining the rendering strategy, the server sends the rendering strategy to the terminal, the terminal receives the rendering strategy sent by the server and determines the rendering strategy as the negotiated rendering strategy, and the terminal renders the text data according to the negotiated rendering strategy to obtain second video stream data.
It should be noted that the specific time when the server sends the parameter configuration table to the terminal may be when receiving a management instruction for the cloud game sent by the terminal, where the management instruction includes an opening instruction or a game operation parameter change instruction, the opening instruction is used to open the cloud game, and the operation parameter change instruction is used to adjust an operation parameter in an operation process of the cloud game, that is, when a user opens the cloud game in the terminal, or when the user adjusts a parameter (for example, resolution) in the operation process of the cloud game, the server receives the management instruction generated by the terminal according to the above operation, and sends the parameter configuration table to the terminal.
S403, the terminal performs superposition processing on the first video streaming data and the second video streaming data to obtain target video streaming data of the cloud game.
In the embodiment of the invention, after the terminal obtains the first video stream data and the second video stream data, the first video stream data and the second video stream data are superposed to obtain the target video stream data of the cloud game. Specifically, the terminal acquires a first time stamp corresponding to first video stream data and a second time stamp corresponding to second video stream data, and aligns and overlaps each frame of picture in the first video stream and the second video stream according to the first time stamp and the second time stamp to obtain target video stream data of the cloud game, wherein the first time stamp includes the time of each frame of picture in the first video stream data, and the second time stamp includes the time of each frame of picture in the second video stream data.
Fig. 5 is a schematic diagram of a video stream data overlapping flow, specifically, a terminal performs aligned overlapping on a first video stream and a second video stream, and fig. 5 specifically shows a process of overlapping a text picture 501 in the first video stream data and an image picture 502 in the second video stream data. Wherein the time of the text picture is the same as the time of the image picture. The server sends the rendered image picture 502 and the rendered text data to the terminal, the terminal receives and renders the text data to obtain a text picture 501, and the terminal superposes the text picture 501 and the image picture 502 to obtain a final target picture 503, wherein the target picture is a frame of picture in target video stream data.
Compared with the conventional game screen generation method, as shown in fig. 6, the server renders all text data and image data to obtain a text screen 601 and an image screen 602, and superimposes the text screen and the image target to obtain a target screen 603, and then sends the target screen 603 to the terminal, so that the terminal displays the target screen 603. In the traditional scheme, because the same rendering mode is adopted, the definition of a character part and an image part in a rendered game picture is the same. In the scheme provided by the embodiment of the invention, the server only renders the image data to obtain the image picture, and the terminal renders the text data to obtain the text picture, so that the data size of video stream data transmitted to the terminal by the server can be reduced, and the requirements of cloud games on the performance of the server and the communication quality are further reduced.
S404, the terminal outputs target video stream data of the cloud game.
In the embodiment of the invention, after the terminal obtains the target video stream data of the cloud game, the target video data is output and displayed, and the terminal interacts with the user and the server in real time to update the displayed target video stream data.
In the embodiment of the invention, a terminal receives text data and first video stream data of a cloud game sent by a server, and renders the text data according to a negotiated rendering strategy to obtain second video stream data; the terminal performs superposition processing on the first video streaming data and the second video streaming data to obtain target video streaming data of the cloud game, and outputs the target video streaming data of the cloud game, wherein the first video streaming data is obtained by processing game data of the cloud game by the server according to the negotiated rendering strategy. By the implementation of the mode, the terminal and the server can comprehensively process data generated by the cloud game, and the requirements of the running cloud game on the performance of the server and the communication quality are reduced.
Based on the description of the embodiment of the processing system of the cloud game, the embodiment of the present invention provides another processing method of the cloud game, which may be applied to the processing system of the cloud game shown in fig. 3, and specifically may be executed by the server shown in fig. 3. Referring to fig. 7, the processing procedure of the cloud game may include the following steps S701 to S704:
s701, the server acquires game data of the cloud game.
In the embodiment of the invention, the game data comprises text data and image data, the text data comprises chat information, role nicknames, operation instructions and the like among game users, the types of the text data can comprise input text type, role nickname type and system prompt type, the input text type text data can comprise the chat information among cloud game users, the role nickname type text data can comprise names of roles in the cloud game, and the system prompt type text data can comprise self-contained characters of a system in the cloud game, such as operation instructions, novice prompts and the like.
In an implementation manner, the game data of the cloud game acquired by the server may be specifically determined by the received operation instruction, specifically, the user inputs a preset trigger operation in the terminal, the terminal generates the operation instruction according to the preset trigger operation and sends the operation instruction to the server, and the server receives the operation instruction and acquires the game data corresponding to the operation instruction. The preset trigger operation may be a text input operation, a screen update operation, or the like performed by a user. The text input operation may specifically be that a user inputs chat information or inputs an operation instruction through a terminal, and the screen update operation may specifically be that the user operates a character in the cloud game to move, operates a game screen to switch, and so on.
S702, the server screens the text data of the cloud game according to the negotiated rendering strategy to obtain the screened text data.
In the embodiment of the invention, after the server acquires the text data and the image data of the cloud game, the text data of the cloud game is screened according to the negotiated rendering strategy to obtain the screened text data.
In a specific implementation, the negotiated rendering policy defines a type of a text that needs to be screened by the server, where a specific negotiation process of the negotiated rendering policy may be that the server sends a parameter configuration table to the terminal, where the parameter configuration table includes a performance configuration required for rendering text data; receiving a synchronization result returned by the terminal according to the parameter configuration table, wherein the synchronization result comprises the type of the text data which is rendered by the terminal; the server determines a negotiated rendering strategy for the text data of the cloud game according to the synchronization result. Specifically, the parameter configuration table includes performance parameters required for rendering text data, and may specifically be configured for parameters required for rendering each type of text data, for example, the parameter configuration required for rendering input text font text data is: the memory is more than 100 million, and parameters needed for rendering character nickname type text data are configured as follows: the memory is more than 120 million, and parameters needed by the prompt text data of the rendering system are configured as follows: the memory is larger than 150 million, the terminal detects the performance parameters of the terminal, determines the type of the text data supporting rendering according to the performance parameters, sends the type to the server, and the server determines the negotiated rendering strategy according to the received type and sends the negotiated rendering strategy to the terminal.
Further, the negotiated rendering strategy also defines a rendering mode of the terminal for the screened text data, including a font attribute, a position attribute and a display mode of the text data. The font attributes include font size, font format, font interval and the like of characters in the text data, the position attributes include appearance positions, disappearance positions and the like of the characters in the text data, the display mode includes appearance time, display resolution and the like of the text data, and specifically, the characters in the text data are displayed in the geometric resolution of the second frame of the second video stream data.
And S703, rendering the remaining text data and image data which are not screened by the server according to the negotiated rendering strategy to obtain first video stream data.
In the embodiment of the invention, after the server screens the text data according to the negotiated rendering strategy, the remaining text data and image data which are not screened in the text data are rendered according to the negotiated rendering strategy to obtain first video stream data, wherein the negotiated rendering strategy further defines font attributes, position attributes and display modes of the remaining text data which are not rendered, and position attributes and display modes of the image data. And rendering the remaining text data and image data which are not screened by the server according to the rendering strategy to obtain first video stream data, namely rendering the data in the text format or the image format to obtain the data in the video format.
S704, the server sends the screened text data and the first video stream data to a terminal.
In the embodiment of the invention, after the server obtains the text data and the first video stream data, the server can send the screened text data and the first video stream data to the terminal, so that the terminal renders the screened text data to obtain the second video stream data, and obtains the target video stream data according to the first video data and the second video stream data. Before sending the first video stream data, the server may further perform encoding compression on the first video data, and send the encoded and compressed video stream data to the terminal, so as to reduce the data volume of the video stream data.
In the embodiment of the invention, a server acquires game data of a cloud game, and screens text data in the game data according to a negotiated rendering strategy to obtain screened text data; the server renders the remaining text data and image data which are not screened according to the negotiated rendering strategy to obtain first video stream data; and sending the screened text data and the first video stream data to the terminal, so that the terminal renders the screened text data to obtain second video stream data, and obtaining target video stream data according to the first video data and the second video stream data. By the implementation of the mode, the server and the terminal can comprehensively process data generated by the cloud game, and the requirements of the running cloud game on the performance of the server and the communication quality are reduced.
Based on the description of the embodiment of the processing system of the cloud game, the embodiment of the present invention provides a rendering policy negotiation method, which is specifically used for negotiating a rendering policy for game data in the cloud game, and may be specifically executed by interaction between a terminal and a server shown in fig. 3. Referring to fig. 8, the rendering policy negotiation process may include the following steps S801 to S806:
s801, the server receives a management instruction for the cloud game sent by the terminal.
In the embodiment of the invention, the management instruction for the cloud game comprises a starting instruction or a game operation parameter changing instruction, wherein the starting instruction is used for starting the cloud game, and the operation parameter changing instruction is used for adjusting the operation parameters of the cloud game in the operation process. Specifically, a user can input management operation for the cloud game in the terminal, the terminal generates a management instruction for the cloud game according to the received management operation, and sends the management instruction to the server, and the server receives the management instruction for the cloud game. The opening instruction can be generated by the terminal according to the opening operation input by the user for the cloud game; the operation parameter change instruction may be specifically generated by the terminal according to an operation (such as a display resolution) of the operation parameter change input by the user for the cloud game. After receiving a management instruction for the cloud game sent by the terminal, the server may generate a corresponding parameter configuration table according to the management instruction.
S802, the server sends the parameter configuration table to the terminal.
In the embodiment of the invention, after receiving the management instruction for the cloud game, the server sends the parameter configuration table to the terminal, wherein the parameter configuration table specifically comprises performance parameters required for rendering each type of text data. The type of the text data can comprise an input text type, a role nickname type and a system prompt type, the input text type text data can comprise chat information among cloud game users, the role nickname type text data can comprise names of roles in the cloud game, and the system prompt type text data can comprise self-contained characters of a system in the cloud game, such as operation instructions, novice prompts and the like. Each type of text data corresponds to different performance parameter requirements, for example, the performance parameter requirements corresponding to the input text font type text data are as follows: the memory is more than 100 million, and the performance parameter requirements needed by the character nickname type text data are as follows: the memory is more than 120 million, and the performance parameter requirements required by the prompt text data of the system are as follows: the memory is greater than 150 megabits.
S803, the terminal receives the parameter configuration table sent by the server and determines the synchronization result according to the parameter configuration table.
In the embodiment of the present invention, the synchronization result includes the type of the text data that the terminal supports rendering, and may be specifically divided into a case where all types of text data are supported, or a case where some types of text data are supported, or a case where all types of text data are not supported, and may be specifically determined by the actual performance parameter of the terminal.
S804, the terminal sends the synchronization result to the server.
S805, the server receives the synchronization result.
S806, the server determines the negotiated rendering strategy according to the synchronization result.
In the embodiment of the invention, after the server receives the synchronization result returned by the terminal, the server determines the negotiated rendering strategy according to the synchronization result. Wherein the negotiated rendering policy defines the type of text data that the server needs to filter.
In an implementation manner, the terminal supports rendering work on all types of text data, the server may determine that the rendering policy is to render only image data in the game data, perform solid color and fuzzy processing on a text data display area, and send each type of text data to the terminal, so that the terminal renders each type of text data, thereby reducing the data size of the generated video stream. It should be noted that the rendering policy may be changed according to an operation input by a user, for example, when the user selects a high-definition display cloud game, the terminal cannot support text rendering due to poor performance, the server sends text data to the terminal, when the user selects smooth display, the terminal supports rendering of part of the text data, and the server sends the part of the text data to the terminal. For example, the input text font text data is sent to the terminal, or the prompt text font text data is sent to the terminal, so that the terminal renders the part of the text data. Optionally, the server may also negotiate a rendering policy according to a cloud game display mode selected by the user, where the display mode includes ultra-clear display, high-definition display, smooth display, and the like, for example, if the user selects the high-definition display cloud game, the server renders all game data of the cloud game, which may cause a generated video stream file to be large, and has a high requirement on a communication bandwidth, and then the server sends the text data to the terminal for rendering. If the image quality selected by the user is smooth, the video stream file generated by the server according to the game data is small, the game data can be completely rendered to obtain video stream data, and the video stream data is sent to the terminal, so that the terminal displays the video stream data.
In one implementation mode, the terminal can only support rendering work on partial types of text data, for example, rendering work on input type text data and system prompt type text data, the server can determine a rendering strategy that the server renders the nickname type text data and the image data of the role, and performs pure color and fuzzy processing on the display areas of the input text data and the system prompt type text data. And sending the input text data in the character form and the system prompt text data to the terminal, so that the terminal renders the input text data in the character form and the system prompt text data. As shown in fig. 9, which is a schematic view of a game interface of a cloud game, in fig. 9, a display area of input text font data is fixed at a lower right 901 of the game interface, and a display area of system prompt text data is fixed at an upper right 902 of the game interface, so that requirements on terminal performance for rendering the input text font data and the system prompt text data are low, the terminal supports rendering the input text font data and the system prompt text data, since nickname text data exists above a game character and needs to move along with the movement of the game character, the requirements on terminal performance for rendering the nickname text data are high, the terminal does not support rendering the nickname text data, the rendering strategy negotiated by the terminal and the server is to send the input text font text data and the system prompt text data to the terminal, the terminal renders the input text data in the character form and the prompt text data in the system, and the server renders the text data in the character nickname and the image data.
In one implementation, rendering of all types of text data is not supported by the terminal, and the server will perform rendering of all game data by itself.
Further, the negotiated rendering strategy also defines rendering modes of the terminal for the screened text data, including font attributes, position attributes and display modes of the text data; and defining font attributes, position attributes and display modes of the remaining text data which are not rendered, and position attributes and display modes of the image data.
In an implementation scenario, a terminal specifically carries a cloud game client, where the cloud game client specifically includes a user input module 1001, a communication module 1002, a screen decoding module 1003, a text rendering module 1004, a screen mixing module 1005, and a screen output module 1006, and the user input module 1001 is specifically configured to obtain an operation input by a user, such as a touch operation, a tap operation, a click operation, and the like. The communication module 1002 is configured to interact with a server, and specifically, may send an operation instruction generated based on an operation input by a user or a target type of a text that a client supports rendering to the server, and receive text information, a rendering policy, or first video stream data sent by the server. The picture decoding module 1003 is configured to decode the received first video stream data. The text rendering module 1004 is configured to render the received text data to obtain second video stream data. The picture mixing module 1004 is configured to perform overlay processing on the first video stream data and the second video stream data to obtain target video stream data of the cloud game. The screen output module 1006 is used for outputting the target video stream data. The server is a cloud game server, and specifically includes a rendering module 1101, a client communication module 1102, a storage module 1103, and a server communication module 1104. The rendering module 1101 is configured to determine a range of game data that needs to be rendered by the cloud game server based on a target type of the text data supporting rendering fed back by the cloud game client, screen out the text data of the target type, and send the text data to the client, and render the remaining game data that is not screened based on a rendering policy, so as to obtain first video stream data. The client communication module 1102 is configured to send the first video stream data, the text data to the client, and receive a target type of the text data supporting rendering returned by the client. The storage module 1103 is used for storing game data required for rendering. The server communication module 1104 is used for interacting with the central server, and specifically for acquiring game data such as user data and chat characters, wherein the central server stores game data uploaded by all cloud game users.
In an implementation scenario, an interaction flow of the cloud game server and the cloud game client for performing rendering policy negotiation is shown in fig. 12, where (i) a rendering module in the cloud game server sends a parameter configuration table to a communication module in the cloud game server. And secondly, a communication module in the cloud game server sends a parameter configuration table to the cloud game client. And thirdly, the rendering module in the client receives the parameter configuration table. And fourthly, the rendering module in the client determines a synchronization result according to the parameter configuration table, wherein the synchronization result comprises the type of the text data which is rendered by the terminal. And fifthly, the rendering module in the client sends the synchronization result to the communication module in the client. And sixthly, the communication module in the client sends the synchronization result to the server, so that the rendering module in the server makes a rendering strategy according to the synchronization result.
In the embodiment of the invention, the server determines the rendering strategy aiming at the game data in the cloud game based on the performance of the terminal, and updates the rendering strategy when receiving the management instruction sent by the terminal, so that the applicability of the rendering strategy is stronger, and the running intelligence of the cloud game is improved.
Based on the description of the embodiment of the processing system of the cloud game, the embodiment of the present invention provides another processing method of the cloud game, and the method may be applied to the processing system of the cloud game shown in fig. 3, and specifically may be performed by the terminal and the server shown in fig. 13 in an interactive manner. Referring to fig. 13, the processing procedure of the cloud game may include the following steps S1301 to S1307:
s1301, the server receives an operation instruction sent by the terminal.
S1302, the server obtains game data corresponding to the operation instruction, wherein the game data comprises text data and image data.
Specifically, the game data may be obtained from a game local file in which the game data of the user is stored and a central server in which the game data of all users in the cloud game is stored.
S1303, the server screens the text data according to the negotiated rendering strategy to obtain screened text data, and renders the remaining text data and image data which are not screened according to the negotiated rendering strategy to obtain first video stream data.
And S1304, the server sends the screened text data and the first video stream data to the terminal.
Specifically, the first video stream data sent by the server may specifically be encoded first video stream data, and the server encodes the first video stream data and sends the encoded first video stream data and the screened text data to the terminal.
And S1305, rendering the text data by the terminal according to the negotiated rendering strategy to obtain second video stream data.
S1306, the terminal performs superposition processing on the first video streaming data and the second video streaming data to obtain target video streaming data of the cloud game.
And S1307, outputting target video stream data of the cloud game by the terminal.
In an implementation scenario, a terminal specifically bears a cloud game client, a server is a cloud game server, and an interaction flow of video rendering between the cloud game server and the cloud game client is shown in fig. 14. The cloud game server obtains game data corresponding to the operation instruction, and specifically can obtain the game data from a game local file and a central server, wherein the game local file stores the game data of the user, the central server stores the game data of all users in the cloud game, and the game data comprises text data and image data. And thirdly, the cloud game server screens the text data according to the negotiated rendering strategy to obtain screened text data, and renders the remaining text data and image data which are not screened according to the negotiated rendering strategy to obtain first video stream data, and the cloud game server encodes the first video stream data. And fourthly, the cloud game server sends the screened text data and the coded first video streaming data to the cloud game client through the communication module. And the cloud game client renders the text data according to the negotiated rendering strategy to obtain second video stream data, and decodes the first video stream data. And sixthly, the cloud game client performs superposition processing on the first video streaming data and the second video streaming data to obtain target video streaming data of the cloud game, and outputs the target video streaming data of the cloud game.
In the embodiment of the invention, the server and the terminal comprehensively process the data generated by the cloud game, so that the requirements of the cloud game on the performance of the server and the communication quality are reduced.
Based on the description of the embodiment of the cloud game processing method, the embodiment of the invention also discloses a cloud game processing device, which can be applied to the cloud game processing system shown in fig. 3, and specifically, the cloud game processing device can be operated on a cloud game terminal in the cloud game processing system shown in fig. 3. The cloud game processing device may be a computer program (including program code) running on a cloud game processing server, or may be a physical device included in the cloud game processing server. The processing device of the cloud game may perform the method shown in fig. 4. Referring to fig. 15, the cloud game processing device 150 includes: a receiving module 1501, a rendering module 1502, a superimposing module 1503, and an output module 1504, a generating module 1505, and a sending module 1506, wherein:
the receiving module 1501 is configured to receive text data and first video stream data of a cloud game, which are sent by a server, where the first video stream data are obtained by processing game data of the cloud game by the server according to a negotiated rendering policy;
a rendering module 1502, configured to render the text data according to the negotiated rendering policy to obtain second video stream data;
the superposition module 1503 is configured to perform superposition processing on the first video stream data and the second video stream data to obtain target video stream data of the cloud game;
an output module 1504, configured to output target video stream data of the cloud game.
In one implementation, the superposition module 1503 is specifically configured to:
acquiring a first time stamp corresponding to the first video stream data and a second time stamp corresponding to the second video stream data, wherein the first time stamp comprises the time of each frame of picture in the first video stream data, and the second time stamp comprises the time of each frame of picture in the second video stream data;
and aligning and superposing each frame of picture in the first video stream data and the second video stream data according to the first time stamp and the second time stamp to obtain target video stream data of the cloud game.
In one implementation, the generating module 1505 is configured to generate an operation instruction according to a preset trigger operation if the preset trigger operation for the cloud game input is detected, where the preset trigger operation includes a text input operation and/or a picture update operation, and the operation instruction is used to acquire a resource in a server;
the sending module 1505 is used for sending the operation instruction to the server.
In one implementation, the sending module 1505 is further configured to send performance parameters of itself to the server;
the receiving module 1501 is further configured to receive a negotiated rendering policy returned by the server according to the performance parameter, where the negotiated rendering policy defines a font attribute, a position attribute, and a display mode of the text data.
In the embodiment of the present invention, the receiving module 1501 receives text data and first video stream data of a cloud game sent by a server, and the rendering module 1502 renders the text data according to the negotiated rendering policy to obtain second video stream data; the superposition module 1503 superposes the first video streaming data and the second video streaming data to obtain target video streaming data of the cloud game; an output module 1504, configured to output target video stream data of the cloud game, where the first video stream data is obtained by processing, by the server, game data of the cloud game according to the negotiated rendering policy. By the implementation of the mode, the server and the terminal can comprehensively process data generated by the cloud game, and the requirements of the running cloud game on the performance of the server and the communication quality are reduced.
Based on the description of the embodiment of the cloud game processing method, the embodiment of the invention also discloses another cloud game processing device, which can be applied to the cloud game processing system shown in fig. 3, and specifically, the cloud game processing device can be operated on a cloud game server in the cloud game processing system shown in fig. 3. The cloud game processing device may be a computer program (including program code) running on a cloud game processing server, or may be a physical device included in the cloud game processing server. The processing device of the cloud game may perform the method shown in fig. 7. Referring to fig. 16, the processing device 160 of the cloud game includes: an obtaining module 1601, a screening module 1602, a rendering module 1603, a sending module 1604, a receiving module 1605, and a determining module 1606, wherein:
an obtaining module 1601, configured to obtain game data of a cloud game, where the game data includes text data and image data;
a screening module 1602, configured to screen the text data of the cloud game according to the negotiated rendering policy to obtain screened text data;
a rendering module 1603, configured to render the remaining unscreened text data and image data according to the negotiated rendering policy to obtain first video stream data;
a sending module 1604, configured to send the screened text data and the first video stream data to the terminal, so that the terminal renders the screened text data to obtain second video stream data, and obtains target video stream data according to the first video data and the second video stream data.
Sending a parameter configuration table to a terminal, wherein the parameter configuration table comprises performance configurations required by rendering each type of text data;
receiving a synchronization result returned by the terminal according to the parameter configuration table, wherein the synchronization result comprises the type of the text data which is rendered by the terminal;
determining a negotiated rendering policy for the text data of the cloud game according to the synchronization result.
In one implementation, the sending module 1604 sends a parameter configuration table to the terminal, the parameter configuration table including performance configurations required for rendering each type of text data;
the receiving module 1605 is configured to receive a synchronization result returned by the terminal according to the parameter configuration table, where the synchronization result includes a type of text data that the terminal supports rendering;
the determining module 1606 is configured to determine a negotiated rendering policy for text data of the cloud game according to the synchronization result.
In one implementation, the type of the text data includes at least one of an input text type, a character nickname type, and a system prompt type, and the screening module 1602 is specifically configured to:
and selecting one or more types of text data from the input text type data, the role nickname type text data and the system prompt type text data according to the negotiated rendering strategy to be used as screened text data.
In an implementation manner, the receiving module 1605 is further configured to receive a management instruction for the cloud game sent by the terminal, where the management instruction includes a start instruction or a game operation parameter change instruction, the start instruction is used to start the cloud game, and the operation parameter change instruction is used to adjust an operation parameter of the cloud game in an operation process.
In the embodiment of the present invention, the obtaining module 1601 is configured to obtain game data of a cloud game, where the game data includes text data and image data; the screening module 1602 screens the text data of the cloud game according to the negotiated rendering strategy to obtain screened text data; rendering module 1603 renders the remaining unscreened text data and the image data according to the negotiated rendering strategy to obtain first video stream data; the sending module sends the screened text data and the first video stream data to the terminal, so that the terminal renders the screened text data to obtain second video stream data, and target video stream data is obtained according to the first video data and the second video stream data. By the implementation of the mode, the server and the terminal can comprehensively process data generated by the cloud game, and the requirements of the running cloud game on the performance of the server and the communication quality are reduced.
Based on the description of the method embodiment and the device embodiment, the embodiment of the invention also provides a terminal; the terminal can be applied to a processing system of a cloud game shown in fig. 3. Referring to fig. 17, the internal structure of the terminal includes at least a processor 1701, an input device 1702, an output device 1703, and a computer storage medium 1704. The processor 1701, the input device 1702, the output device 1703 and the computer storage medium 1704 in the terminal may be connected by a bus or other means, and fig. 17 shown in the embodiment of the present invention is exemplified by being connected by the bus 1705.
The computer storage medium 1704 is used to store a computer program comprising program instructions, and the processor 1701 is used to execute the program instructions stored by the computer storage medium 1704. The processor 1701 (or CPU) is a computing core and a control core of the terminal, and is adapted to implement one or more instructions, and specifically, is adapted to load and execute one or more instructions to implement corresponding method processes or corresponding functions;
in one implementation, the processor 1701 may be configured to receive text data and first video stream data of a cloud game sent by a server, render the text data according to a negotiated rendering policy to obtain second video stream data, perform overlay processing on the first video stream data and the second video stream data to obtain target video stream data of the cloud game, and output the target video stream data of the cloud game, where the first video stream data is obtained by processing game data of the cloud game by the server according to the negotiated rendering policy.
The embodiment of the invention also provides a computer storage medium (Memory), which is a Memory device in the terminal and is used for storing programs and data. It is understood that the computer storage medium herein may include a built-in storage medium in the terminal, and may also include an extended storage medium supported by the terminal. The computer storage medium provides a storage space that stores an operating system of the terminal. Also stored in the memory space are one or more instructions, which may be one or more computer programs (including program code), suitable for loading and execution by the processor 1701. It should be noted that the computer storage medium herein may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as at least one disk memory; and optionally at least one computer storage medium located remotely from the processor.
In one implementation, one or more first instructions stored in a computer storage medium may be loaded and executed by the processor 1701 to implement the corresponding steps of the method in the face retrieval embodiments described above; in particular implementations, one or more first instructions in the computer storage medium are loaded by the processor 1701 and perform the following steps:
receiving text data and first video streaming data of a cloud game sent by a server, wherein the first video streaming data is obtained by processing game data of the cloud game by the server according to a negotiated rendering strategy;
rendering the text data according to the negotiated rendering strategy to obtain second video stream data;
overlapping the first video stream data and the second video stream data to obtain target video stream data of the cloud game;
and outputting target video streaming data of the cloud game.
In one implementation, the one or more first instructions are loaded by the processor 1701 and specifically perform the following steps:
acquiring a first time stamp corresponding to the first video stream data and a second time stamp corresponding to the second video stream data, wherein the first time stamp comprises the time of each frame of picture in the first video stream data, and the second time stamp comprises the time of each frame of picture in the second video stream data;
and aligning and overlapping each frame of picture in the first video streaming data and the second video streaming data according to the first time stamp and the second time stamp to obtain target video streaming data of the cloud game.
In one implementation, the one or more first instructions are loaded by the processor 1701 and specifically perform the following:
if preset trigger operation aiming at cloud game input is detected, generating an operation instruction according to the preset trigger operation, wherein the preset trigger operation comprises text input operation and/or picture updating operation, and the operation instruction is used for acquiring resources in a server;
and sending the operation instruction to the server.
In one implementation, the one or more first instructions are loaded by the processor 1701 and specifically perform the following steps:
sending the performance parameters of the server to the server;
and receiving a negotiated rendering strategy returned by the server according to the performance parameters, wherein the negotiated rendering strategy defines the font attribute, the position attribute and the display mode of the text data.
In the embodiment of the invention, a terminal receives text data and first video stream data of a cloud game sent by a server, and renders the text data according to a negotiated rendering strategy to obtain second video stream data; the terminal performs superposition processing on the first video streaming data and the second video streaming data to obtain target video streaming data of the cloud game, and outputs the target video streaming data of the cloud game, wherein the first video streaming data is obtained by processing game data of the cloud game by the server according to the negotiated rendering strategy. By the implementation of the mode, the terminal and the server can comprehensively process data generated by the cloud game, and the requirements of the running cloud game on the performance of the server and the communication quality are reduced.
Based on the description of the method embodiment and the device embodiment, the embodiment of the invention also provides a server; the server can be applied to a processing system of a cloud game shown in fig. 3. Referring to fig. 18, the internal structure of the terminal includes at least a processor 1801, an input device 1802, an output device 1803, and a computer storage medium 1804. The processor 1801, the input device 1802, the output device 1803, and the computer storage medium 1804 in the terminal may be connected by a bus or other means, and in fig. 18 shown in the embodiment of the present invention, the connection by the bus 1805 is taken as an example.
The computer storage media 1804 is used to store computer programs comprising program instructions, and the processor 1801 is used to execute the program instructions stored by the computer storage media 1804. The processor 1801 (or called CPU) is a computing core and a control core of the terminal, and is adapted to implement one or more instructions, and specifically, adapted to load and execute one or more instructions so as to implement a corresponding method flow or a corresponding function;
in an implementation manner, the processor 1801 according to an embodiment of the present invention may be configured to obtain game data of a cloud game, where the game data includes text data and image data;
screening the text data of the cloud game according to the negotiated rendering strategy to obtain screened text data;
rendering the remaining text data and the image data which are not screened according to the negotiated rendering strategy to obtain first video stream data;
and sending the screened text data and the first video stream data to the terminal, rendering the screened text data by the terminal to obtain second video stream data, and obtaining target video stream data according to the first video data and the second video stream data.
The embodiment of the invention also provides a computer storage medium (Memory), which is a Memory device in the terminal and is used for storing programs and data. It is understood that the computer storage medium herein may include a built-in storage medium in the terminal, and may also include an extended storage medium supported by the terminal. The computer storage medium provides a storage space that stores an operating system of the terminal. Also stored in this memory space is one or more instructions, which may be one or more computer programs (including program code), adapted to be loaded and executed by the processor 1801. The computer storage medium may be a high-speed RAM memory, or may be a non-volatile memory (non-volatile memory), such as at least one disk memory; and optionally at least one computer storage medium located remotely from the processor.
In one implementation, one or more first instructions stored in a computer storage medium may be loaded and executed by the processor 1801 to implement the corresponding steps of the method in the above-described face retrieval embodiment; in a specific implementation, one or more first instructions in the computer storage medium are loaded by the processor 1801 and execute the following steps:
acquiring game data of a cloud game, wherein the game data comprises text data and image data;
screening the text data of the cloud game according to the negotiated rendering strategy to obtain screened text data;
rendering the remaining unscreened text data and the image data according to the negotiated rendering strategy to obtain first video stream data;
and sending the screened text data and the first video stream data to the terminal, so that the terminal renders the screened text data to obtain second video stream data, and obtaining target video stream data according to the first video data and the second video stream data.
In one implementation, the one or more first instructions are loaded by the processor 1801 and specifically perform the following steps:
sending a parameter configuration table to a terminal, wherein the parameter configuration table comprises performance configurations required by rendering each type of text data;
receiving a synchronization result returned by the terminal according to the parameter configuration table, wherein the synchronization result comprises the type of the text data which the terminal supports to render;
determining a negotiated rendering strategy for the text data of the cloud game according to the synchronization result.
In one implementation, the one or more first instructions are loaded by the processor 1801 and specifically perform the following steps:
and selecting one or more types of text data from the input text type data, the role nickname type text data and the system prompt type text data according to the negotiated rendering strategy to be used as screened text data.
In one implementation, the one or more first instructions are loaded by the processor 1801 and specifically perform the following steps:
the method comprises the steps of receiving a management instruction aiming at the cloud game sent by a terminal, wherein the management instruction comprises a starting instruction or a game operation parameter changing instruction, the starting instruction is used for starting the cloud game, and the operation parameter changing instruction is used for adjusting operation parameters in the operation process of the cloud game.
In the embodiment of the invention, a server acquires game data of a cloud game, and screens text data in the game data according to a negotiated rendering strategy to obtain screened text data; the server renders the remaining text data and image data which are not screened according to the negotiated rendering strategy to obtain first video stream data; and sending the screened text data and the first video stream data to the terminal, so that the terminal renders the screened text data to obtain second video stream data, and obtaining target video stream data according to the first video data and the second video stream data. By the implementation of the mode, the server and the terminal can comprehensively process data generated by the cloud game, and the requirements of the running cloud game on the performance of the server and the communication quality are reduced.
The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.

Claims (9)

1. A processing method of a cloud game is characterized by comprising the following steps:
the method comprises the steps that a terminal sends performance parameters of the terminal to a server, wherein the performance parameters are used for reflecting the rendering capability of the terminal;
the terminal receives a parameter configuration table returned by the server according to the performance parameters, wherein the parameter configuration table comprises performance configurations required by rendering each type of text data;
the terminal determines the type of the text data which supports rendering according to the parameter configuration table, and returns a synchronization result to the server, wherein the synchronization result comprises the type;
the server determines a negotiated rendering strategy according to the synchronization result, wherein the negotiated rendering strategy comprises the type of text data needing to be sent to the terminal, the negotiated rendering strategy defines the rendering mode of the screened text data and comprises the font attribute, the position attribute and the display mode of the text data, and the negotiated rendering strategy also defines the font attribute, the position attribute and the display mode of the remaining text data which are not rendered and the position attribute and the display mode of the image data;
the terminal receives the negotiated rendering strategy returned by the server, wherein the negotiated rendering strategy supports changing according to the operation input by the user or the cloud game display mode selected by the user;
the server processes game data of the cloud game according to the negotiated rendering strategy to obtain screened text data and first video stream data;
the terminal receives the screened text data and the first video stream data sent by the server;
the terminal renders the text data according to the negotiated rendering strategy to obtain second video stream data;
the terminal performs superposition processing on the first video streaming data and the second video streaming data to obtain target video streaming data of the cloud game;
and the terminal outputs target video streaming data of the cloud game.
2. The method of claim 1, wherein the terminal performs overlay processing on the first video stream data and the second video stream data to obtain target video stream data of the cloud game, and comprises:
the terminal acquires a first time stamp corresponding to the first video stream data and a second time stamp corresponding to the second video stream data, wherein the first time stamp comprises the time of each frame of picture in the first video stream data, and the second time stamp comprises the time of each frame of picture in the second video stream data;
and the terminal aligns and superposes each frame of picture in the first video streaming data and the second video streaming data according to the first time stamp and the second time stamp to obtain target video streaming data of the cloud game.
3. The method according to claim 1, wherein before the terminal receives the filtered text data and the first video stream data sent by the server, the method further comprises:
if the terminal detects a preset trigger operation aiming at cloud game input, generating an operation instruction according to the preset trigger operation, wherein the preset trigger operation comprises a text input operation and/or a picture updating operation, and the operation instruction is used for acquiring resources in a server;
and the terminal sends the operation instruction to the server.
4. The method of claim 1, wherein the game data includes text data, and the type of the text data includes at least one of an input text type, a character nickname type, and a system prompt type;
the server processes the game data of the cloud game according to the negotiated rendering strategy to obtain screened text data, and the method comprises the following steps:
and the server selects one or more types of text data from the input text type data, the role nickname type text data and the system prompt type text data according to the negotiated rendering strategy to be used as screened text data.
5. The method according to claim 1, wherein before the terminal receives the parameter configuration table returned by the server according to the performance parameter, the method further comprises:
the terminal sends a management instruction aiming at the cloud game to the server, the management instruction comprises a starting instruction or a game operation parameter changing instruction, the starting instruction is used for starting the cloud game, and the operation parameter changing instruction is used for adjusting operation parameters in the cloud game operation process.
6. A cloud gaming processing apparatus, the apparatus comprising:
the system comprises a sending module, a rendering module and a display module, wherein the sending module is used for sending performance parameters of a terminal to a server by the terminal, and the performance parameters are used for reflecting the rendering capability of the terminal;
a receiving module, configured to receive, by the terminal, a parameter configuration table returned by the server according to the performance parameter, where the parameter configuration table includes performance configurations required for rendering each type of text data;
the processing module is used for the terminal to determine the type of the text data which supports rendering according to the parameter configuration table and return a synchronization result to the server, wherein the synchronization result comprises the type;
the processing module is further configured to determine, by the server, a negotiated rendering policy according to the synchronization result, where the negotiated rendering policy includes a type of text data that needs to be sent to the terminal, the negotiated rendering policy defines a rendering manner of the screened text data, and includes a font attribute, a position attribute, and a display manner of the text data, and the negotiated rendering policy further defines a font attribute, a position attribute, and a display manner of remaining text data that is not rendered, and a position attribute and a display manner of the image data;
the receiving module is used for receiving the negotiated rendering strategy returned by the server by the terminal, and the negotiated rendering strategy supports changing according to the operation input by the user or the cloud game display mode selected by the user;
the processing module is further configured to process, by the server according to the negotiated rendering policy, the game data of the cloud game to obtain screened text data and first video stream data;
the receiving module is further configured to receive, by the terminal, the screened text data and the first video stream data sent by the server;
the rendering module is used for rendering the text data by the terminal according to the negotiated rendering strategy to obtain second video stream data;
the superposition module is used for carrying out superposition processing on the first video streaming data and the second video streaming data by the terminal to obtain target video streaming data of the cloud game;
and the output module is used for outputting the target video stream data of the cloud game by the terminal.
7. The cloud game processing system is characterized by comprising a server and a terminal;
the server is used for receiving the performance parameters of the terminal sent by the terminal, and the performance parameters are used for reflecting the rendering capability of the terminal; sending a parameter configuration table to the terminal according to the performance parameters, wherein the parameter configuration table comprises performance configurations required by rendering each type of text data; receiving a synchronization result returned by the terminal according to the parameter configuration table, wherein the synchronization result comprises the type of the text data which is rendered by the terminal; determining a negotiated rendering strategy aiming at the text data of the cloud game according to the synchronization result, and sending the negotiated rendering strategy to the terminal; the negotiated rendering strategy comprises the type of text data needing to be sent to the terminal, defines the rendering mode of the screened text data, including the font attribute, the position attribute and the display mode of the text data, and also defines the font attribute, the position attribute and the display mode of the remaining text data which are not rendered, and the position attribute and the display mode of the image data; the negotiated rendering strategy supports changing according to the operation input by the user or the cloud game display mode selected by the user; acquiring game data of a cloud game, wherein the game data comprises text data and image data; screening the text data of the cloud game according to the negotiated rendering strategy to obtain screened text data; rendering the remaining text data and the image data which are not screened according to the negotiated rendering strategy to obtain first video stream data; sending the screened text data and the first video stream data to the terminal, so that the terminal renders the screened text data to obtain second video stream data, and obtaining target video stream data according to the first video data and the second video stream data;
the terminal is used for receiving text data and first video streaming data of the cloud game, which are sent by the server, wherein the first video streaming data are obtained by processing the game data of the cloud game by the server according to the negotiated rendering strategy; rendering the text data according to the negotiated rendering strategy to obtain second video stream data; overlapping the first video streaming data and the second video streaming data to obtain target video streaming data of the cloud game; and outputting target video streaming data of the cloud game.
8. A computer device, comprising:
a processor adapted to execute a computer program;
a computer-readable storage medium in which a computer program is stored, the computer program, when executed by the processor, implementing the processing method of the cloud game according to any one of claims 1 to 5.
9. A computer-readable storage medium storing one or more instructions adapted to be loaded by a processor and to perform the processing method of the cloud game according to any one of claims 1 to 5.
CN201910742746.2A 2019-08-08 2019-08-08 Cloud game processing method and device, terminal, server and storage medium Active CN110393921B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910742746.2A CN110393921B (en) 2019-08-08 2019-08-08 Cloud game processing method and device, terminal, server and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910742746.2A CN110393921B (en) 2019-08-08 2019-08-08 Cloud game processing method and device, terminal, server and storage medium

Publications (2)

Publication Number Publication Date
CN110393921A CN110393921A (en) 2019-11-01
CN110393921B true CN110393921B (en) 2022-08-26

Family

ID=68328020

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910742746.2A Active CN110393921B (en) 2019-08-08 2019-08-08 Cloud game processing method and device, terminal, server and storage medium

Country Status (1)

Country Link
CN (1) CN110393921B (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9892564B1 (en) 2017-03-30 2018-02-13 Novarad Corporation Augmenting real-time views of a patient with three-dimensional data
CN110947177B (en) * 2019-11-14 2023-10-17 咪咕互动娱乐有限公司 Cloud game teaching interaction method, system and equipment and computer readable storage medium thereof
CN111202980B (en) * 2019-12-31 2023-10-17 咪咕互动娱乐有限公司 Information transmission method, streaming media cloud platform and computer readable storage medium
CN111803940B (en) * 2020-01-14 2022-05-31 厦门雅基软件有限公司 Game processing method and device, electronic equipment and computer-readable storage medium
CN112436973B (en) * 2020-02-11 2022-04-19 上海哔哩哔哩科技有限公司 Automatic service experience index testing method and equipment for cloud game
CN111494936A (en) * 2020-02-12 2020-08-07 阿里巴巴集团控股有限公司 Picture rendering method, device, system and storage medium
CN111314764B (en) * 2020-03-04 2022-05-20 南方电网科学研究院有限责任公司 Synchronization method of cross-screen animation in distributed rendering environment
CN114554277B (en) * 2020-11-24 2024-02-09 腾讯科技(深圳)有限公司 Multimedia processing method, device, server and computer readable storage medium
CN112337092B (en) * 2020-12-01 2021-10-26 腾讯科技(深圳)有限公司 Cloud game processing method, device, equipment and storage medium
CN112836469A (en) * 2021-01-27 2021-05-25 北京百家科技集团有限公司 Information rendering method and device
CN113423018B (en) * 2021-08-24 2021-11-02 腾讯科技(深圳)有限公司 Game data processing method, device and storage medium
CN113469883B (en) * 2021-06-30 2022-05-06 完美世界(北京)软件科技发展有限公司 Rendering method and device of dynamic resolution, electronic equipment and readable storage medium
CN113440838A (en) * 2021-08-31 2021-09-28 炫彩互动网络科技有限公司 End-to-end image rendering fusion method and system
CN116567320A (en) * 2022-01-27 2023-08-08 腾讯科技(深圳)有限公司 Video processing coordination method, device, equipment and storage medium
CN114205359A (en) * 2022-01-27 2022-03-18 腾讯科技(深圳)有限公司 Video rendering coordination method, device and equipment
CN116761018B (en) * 2023-08-18 2023-10-17 湖南马栏山视频先进技术研究院有限公司 Real-time rendering system based on cloud platform

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140056673A (en) * 2012-10-30 2014-05-12 에스케이플래닛 주식회사 Method for providing game based on cloud steaming, system thereof, client terminal thereof, service apparatus thereof and computer recordable medium storing the method
WO2015099613A1 (en) * 2013-12-26 2015-07-02 Singapore University Of Technology And Design A method and apparatus for reducing data bandwidth between a cloud server and a thin client
CN105850099A (en) * 2013-10-23 2016-08-10 英派尔科技开发有限公司 Local management for intermediary graphics rendition
CN107948731A (en) * 2017-10-31 2018-04-20 深信服科技股份有限公司 Video stream merging method, server and computer-readable recording medium
CN109960552A (en) * 2017-12-26 2019-07-02 浙江宇视科技有限公司 A kind of web interface differentiation rendering method and device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102957671A (en) * 2011-08-23 2013-03-06 中国移动通信集团公司 Equipment, system and method for online games on mobile terminal
WO2014203837A1 (en) * 2013-06-17 2014-12-24 Square Enix Holdings Co., Ltd. Image processing apparatus, image processing system, image processing method and storage medium
EP3397363B1 (en) * 2015-12-30 2020-02-05 Sony Interactive Entertainment America LLC User save data management in cloud gaming
CN105653066B (en) * 2016-01-29 2019-03-15 腾讯科技(深圳)有限公司 A kind of method and apparatus of input method processing
CN107027046B (en) * 2017-04-13 2020-03-10 广州华多网络科技有限公司 Audio and video processing method and device for assisting live broadcast
CN108401192B (en) * 2018-04-25 2022-02-22 腾讯科技(深圳)有限公司 Video stream processing method and device, computer equipment and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140056673A (en) * 2012-10-30 2014-05-12 에스케이플래닛 주식회사 Method for providing game based on cloud steaming, system thereof, client terminal thereof, service apparatus thereof and computer recordable medium storing the method
CN105850099A (en) * 2013-10-23 2016-08-10 英派尔科技开发有限公司 Local management for intermediary graphics rendition
WO2015099613A1 (en) * 2013-12-26 2015-07-02 Singapore University Of Technology And Design A method and apparatus for reducing data bandwidth between a cloud server and a thin client
CN107948731A (en) * 2017-10-31 2018-04-20 深信服科技股份有限公司 Video stream merging method, server and computer-readable recording medium
CN109960552A (en) * 2017-12-26 2019-07-02 浙江宇视科技有限公司 A kind of web interface differentiation rendering method and device

Also Published As

Publication number Publication date
CN110393921A (en) 2019-11-01

Similar Documents

Publication Publication Date Title
CN110393921B (en) Cloud game processing method and device, terminal, server and storage medium
US20210274251A1 (en) Video Processing Method, Electronic Device and Computer-Readable Medium
US20220014819A1 (en) Video image processing
CN112235626B (en) Video rendering method and device, electronic equipment and storage medium
US20140087877A1 (en) Compositing interactive video game graphics with pre-recorded background video content
CN109644294B (en) Live broadcast sharing method, related equipment and system
KR20080085008A (en) Method and system for enabling a user to play a large screen game by means of a mobile device
EP3089025B1 (en) Information processing device, program, and transfer system
CN102053867B (en) Method and device for dynamically switching pictures
CN112905289A (en) Application picture display method, device, terminal, screen projection system and medium
US11425466B2 (en) Data transmission method and device
US11917329B2 (en) Display device and video communication data processing method
CN110795097A (en) Page processing method and device, computer equipment and storage medium
CN112019907A (en) Live broadcast picture distribution method, computer equipment and readable storage medium
CN114845136B (en) Video synthesis method, device, equipment and storage medium
CN112712575A (en) Sticker template image generation method and device, anchor terminal equipment and storage medium
CN112073788A (en) Video data processing method and device and display equipment
CN114201095A (en) Control method and device for live interface, storage medium and electronic equipment
CN113645476B (en) Picture processing method and device, electronic equipment and storage medium
CN111930233B (en) Panoramic video image display method and display device
CN113473196A (en) Screen projection data processing method and display device
CN113489938A (en) Virtual conference control method, intelligent device and terminal device
CN113453069B (en) Display device and thumbnail generation method
CN112019906A (en) Live broadcast method, computer equipment and readable storage medium
CN111766958B (en) Input method implementation method, device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant