WO2024082901A1 - 云游戏的数据处理方法、装置、电子设备、计算机可读存储介质及计算机程序产品 - Google Patents

云游戏的数据处理方法、装置、电子设备、计算机可读存储介质及计算机程序产品 Download PDF

Info

Publication number
WO2024082901A1
WO2024082901A1 PCT/CN2023/119521 CN2023119521W WO2024082901A1 WO 2024082901 A1 WO2024082901 A1 WO 2024082901A1 CN 2023119521 W CN2023119521 W CN 2023119521W WO 2024082901 A1 WO2024082901 A1 WO 2024082901A1
Authority
WO
WIPO (PCT)
Prior art keywords
target object
screen frame
game screen
displayed
cloud
Prior art date
Application number
PCT/CN2023/119521
Other languages
English (en)
French (fr)
Inventor
吴峰凯
Original Assignee
腾讯科技（深圳）有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 腾讯科技（深圳）有限公司 filed Critical 腾讯科技（深圳）有限公司
Priority to US18/584,546 priority Critical patent/US20240189713A1/en
Publication of WO2024082901A1 publication Critical patent/WO2024082901A1/zh

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35—Details of game servers
    • A63F13/355—Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/04—Texture mapping
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80—Special adaptations for executing a specific game genre or game mode
    • A63F13/837—Shooting of targets

Definitions

  • the present application relates to the field of data processing technology, and in particular to a data processing method, device, electronic device, computer-readable storage medium and computer program product for cloud gaming.
  • Cloud gaming means that the game is run on a cloud server, and the game screen generated by the cloud server is transmitted to various terminals through video technology.
  • the terminal uses peripherals such as a mouse, handle or touch screen to trigger the corresponding event and transmit it back to the cloud server to generate a new game screen.
  • cloud gaming technology is based on video streaming, that is, the game screen rendered by the game on the cloud device is transmitted to the terminal via video streaming, and the terminal displays the game screen based on the video stream.
  • video streaming that is, the game screen rendered by the game on the cloud device is transmitted to the terminal via video streaming, and the terminal displays the game screen based on the video stream.
  • the game screen displayed by the terminal based on the video stream has the problem of blurry pictures.
  • the embodiments of the present application provide a data processing method, device, electronic device, computer-readable storage medium and computer program product for a cloud game, which can improve the display clarity of the game screen of the cloud game.
  • the present application provides a data processing method for a cloud game, including:
  • display data sent by a cloud device of the cloud game is obtained;
  • the display data includes a game screen frame to be displayed, and a first position of a target object in the game screen frame in the game screen frame;
  • the target object is drawn on the displayed game screen frame based on the first position.
  • the present application provides a data processing device for a cloud game, including:
  • An acquisition unit is configured to acquire display data sent by a cloud device of the cloud game during a game process of the cloud game;
  • the display data includes a game screen frame to be displayed and a first position of a target object in the game screen frame in the game screen frame;
  • a display unit configured to display the game screen frame and display a target control of the target object on the displayed game screen frame
  • the processing unit is configured to draw the target object on the displayed game screen frame based on the first position in response to a trigger operation on the target control.
  • An embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory is configured to store a computer program, and when the processor is configured to execute the computer program stored in the memory, the data processing method for cloud games provided in the embodiment of the present application is implemented.
  • An embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored.
  • the computer program is executed by a processor, the data processing method for cloud games provided in the embodiment of the present application is implemented.
  • An embodiment of the present application provides a computer program product or a computer program, which includes computer executable instructions.
  • the computer executable instructions are executed by a processor, the cloud game data processing method provided by the embodiment of the present application is implemented.
  • the display data sent by the cloud device of the cloud game is obtained, so as to display the game screen frame contained in the display data, and display the target control of the target object on the game screen frame.
  • the target object is drawn on the displayed game screen frame in response to the trigger operation for the target control based on the first position of the target object contained in the display data in the game screen frame.
  • the target object when displaying the game screen frame of the cloud game in the embodiment of the present application, can be drawn for display for the target object in the game screen frame, and the clarity of the drawn target object is higher than the clarity of the target object in the game screen frame sent by the cloud device, thereby improving the display clarity of the game screen of the cloud game.
  • FIG1 is a schematic diagram of the structure of a data processing system for a cloud game provided in an embodiment of the present application
  • FIG2 is a schematic diagram of a flow chart of a data processing method for a cloud game provided in an embodiment of the present application
  • FIG3 is a schematic diagram of the effect of a game screen provided by an embodiment of the present application.
  • FIG4 is a schematic diagram of a data processing flow of a cloud game provided in an embodiment of the present application.
  • FIG5 is a flow chart of a data processing method for a cloud game provided in an embodiment of the present application.
  • FIG6 is a schematic diagram of the effect of the model data provided in an embodiment of the present application.
  • FIG7 is a schematic diagram of the effect of model drawing provided in an embodiment of the present application.
  • FIG8 is a schematic diagram of a data processing process of a cloud game provided in an embodiment of the present application.
  • FIG9 is a schematic diagram of the structure of a data processing device for a cloud game provided in an embodiment of the present application.
  • FIG. 10 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
  • the embodiment of the present application proposes a data processing solution for cloud gaming.
  • the display data sent by the cloud device of the cloud gaming is obtained, so as to display the game screen frame contained in the display data, and display the target control of the target object on the game screen frame.
  • the target object is drawn on the displayed game screen frame in response to the trigger operation for the target control, based on the first position of the target object contained in the display data in the game screen frame.
  • the embodiment of the present application can draw the target object for display with respect to the target object in the game screen frame, and the clarity of the drawn target object is higher than the clarity of the target object in the game screen frame sent by the cloud device, thereby improving the display clarity of the game screen of the cloud gaming.
  • the embodiments of the present application can be applied to a data processing system for a cloud game.
  • the data processing system for the cloud game may include a cloud device and a terminal ( Figure 1 exemplarily shows terminal 1 and terminal 2).
  • the cloud device can be a background processing device for the cloud game, which can be used to provide cloud game services to users. For example, it can generate game screen frames based on user operation events of the terminal. The user operation event can be generated by the terminal based on the detected user operation.
  • the event generated by the user operation event can be used to indicate the change of the game screen, so that the cloud device generates a game screen frame to be displayed based on the indication of the user operation event, and sends the display data including the game screen to be displayed to the terminal, so that the terminal can display the game screen.
  • the cloud device can send display data to the terminal, and the display data can include the game screen frame to be displayed.
  • the terminal can display the game screen of the cloud game, that is, it can display the game screen frame contained based on the display data sent by the display cloud device, and the terminal can be used to receive the user operation of the user in the cloud game, and send the generated user operation event to the cloud device.
  • the terminal can also execute the above-mentioned data processing scheme for the cloud game, so that the target control for the target object that needs to be clearly displayed can be displayed on the received game screen frame to be displayed.
  • the target control for the target object that needs to be clearly displayed can be displayed on the received game screen frame to be displayed.
  • the target object in the game screen frame generated by the cloud device is usually blurry, which affects the user's cloud gaming experience.
  • the target control corresponding to the target object can be triggered.
  • the terminal responds to the trigger operation of the target control for the target object and draws the target object on the displayed game screen frame.
  • the clarity of the drawn target object is higher than the clarity of the target object in the game screen frame sent by the cloud device, so that the user can view the target object more clearly, thereby improving the display clarity of the game screen during the cloud gaming process, thereby improving the gaming experience during the cloud gaming process.
  • the embodiments of the present application can be applied to the field of cloud technology, specifically to the field of cloud computing, such as processing data during the game of a cloud game through a cloud device.
  • Cloud computing is a computing model that distributes computing tasks across a resource pool consisting of a large number of computers, enabling various application systems to obtain computing power, storage space, and information services as needed.
  • the network that provides resources is called a "cloud".
  • the resources in the "cloud” appear to the user to be infinitely expandable, and can be obtained at any time, used on demand, expanded at any time, and paid for on a per-use basis.
  • a cloud computing resource pool (referred to as a cloud platform, which can be called an Infrastructure as a Service (IaaS) platform) will be established, and various types of virtual resources will be deployed in the resource pool for external customers to choose to use.
  • the cloud computing resource pool mainly includes: computing devices (virtualized machines, including operating systems), storage devices, and network devices.
  • PaaS Platform as a Service
  • SaaS Software as a Service
  • PaaS can also be deployed directly on IaaS.
  • PaaS is a platform for software operation, such as databases, web containers, etc.
  • SaaS is a variety of business software, such as web portals, SMS mass senders, etc.
  • SaaS and PaaS are upper layers relative to IaaS.
  • the embodiments of the present application can also be applied to the field of artificial intelligence technology.
  • Artificial Intelligence is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.
  • artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a similar way to human intelligence.
  • Artificial intelligence is to study the design principles and implementation methods of various intelligent machines so that the machines have the functions of perception, reasoning and decision-making.
  • Artificial intelligence technology is a comprehensive discipline that covers a wide range of fields, including both hardware-level and software-level technologies.
  • Basic artificial intelligence technologies generally include sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operating/interactive systems, mechatronics, and other technologies.
  • Artificial intelligence software technologies mainly include computer vision technology, speech processing technology, natural language processing technology, and machine learning/deep learning.
  • the present application can display a prompt interface, pop-up window or output voice prompt information, and the prompt interface, pop-up window or voice prompt information is used to remind the user that its relevant data is currently being collected, so that the present application only starts to execute the relevant steps of obtaining the user's relevant data after obtaining the user's confirmation operation on the prompt interface or pop-up window, otherwise (i.e. If no confirmation operation is obtained from the user on the prompt interface or pop-up window, the relevant steps of obtaining the user's relevant data are terminated, that is, the user's relevant data is not obtained.
  • all user data collected by this application is collected with the user's consent and authorization, and the collection, use and processing of relevant user data must comply with the relevant laws, regulations and standards of relevant countries and regions.
  • the technical solution of the present application can be used in electronic devices.
  • the electronic device can be a terminal (such as terminal 1 and terminal 2 shown in Figure 1), or a server, or other devices for data processing, which is not limited in the present application.
  • the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms.
  • Terminals include but are not limited to mobile phones, computers, intelligent voice interaction devices, smart home appliances, vehicle-mounted terminals, aircraft, smart speakers, smart home appliances, etc.
  • the terminal and the server can be directly or indirectly connected via wired or wireless communication, which is not limited in the embodiments of the present application.
  • the embodiment of the present application proposes a data processing method for cloud games.
  • Figure 2 is a flow chart of the data processing method for cloud games provided by the embodiment of the present application.
  • the method can be executed by the above-mentioned electronic device.
  • the data processing method for cloud games can include the following steps.
  • cloud gaming is a gaming method based on cloud computing.
  • the game processing process is mainly concentrated on the server side (such as cloud devices), and the rendered game screen is compressed and transmitted to the terminal corresponding to the game player through the network, so that the terminal can display the rendered game screen sent by the cloud device.
  • the cloud game can be a game corresponding to various platforms such as mobile games and terminal games. It is understandable that when the user clicks on the control for indicating entry into the cloud game on the terminal and successfully enters the cloud game, it means that the game is in the process of the cloud game.
  • the cloud device can respond to the user operation events sent by the terminal, continuously generate the game screen frames of the cloud game and send them to the terminal for display.
  • the display data includes a game screen frame to be displayed and a first position of a target object in the game screen frame.
  • the target object may be an object that needs to be clearly displayed in the game screen frame, that is, the target object can be clearly displayed by drawing the target object.
  • the game screen frame may be a frame of game screen rendered by a cloud device during the game process of the cloud game.
  • Cloud games may be based on video streams, and the user's terminal may continuously receive and display multiple game screen frames from the cloud device, thereby forming a constantly changing game screen, each of which is rendered by the cloud device.
  • the target object that needs to be clearly displayed may generally be some objects that are easily blurred in the game screen but need to be clearly displayed.
  • the object that needs to be clearly displayed may be a key object in the game screen, such as some treasure chests, virtual object models, etc. in the game process.
  • the object that needs to be clearly displayed may be a preset object, and the object that needs to be clearly displayed generally has corresponding three-dimensional model data, that is, when the cloud device generates the game screen frame, it can generally render the corresponding object based on the three-dimensional model data of the object, thereby obtaining a game screen frame containing the object.
  • the first position can be used to indicate the position of the target object that needs to be clearly displayed.
  • the first position can be represented as the position coordinate information of the reference point of the target object, and the position coordinate information can be two-dimensional coordinate information (including horizontal coordinates and vertical coordinates).
  • the first position can be represented as the center position of the target object.
  • the first position may be the position coordinate information of the target object, such as the horizontal and vertical coordinates of the center position.
  • the first position may be the position coordinate information corresponding to the rightmost position of the target object.
  • the first position of the target object may also be represented as the regional position information of the area where the target object is located.
  • the area where the target object is located may be used to indicate an area that just frames the target object with a certain area shape.
  • the area where the target object is located may be a rectangular area.
  • the first position of the target object may be represented as the regional position information of the rectangular area, such as the position coordinate information of the upper left corner vertex of the rectangular area and the length and width of the rectangular area.
  • the display data includes the above-mentioned first position; if the game screen frame to be displayed contained in the display data does not include an object that needs to be clearly displayed, the display data does not include the above-mentioned first position.
  • S202 Display a game screen frame, and display a target control of a target object on the displayed game screen frame.
  • the display data is parsed to obtain the game screen frame included in the display data and the first position of the target object, thereby displaying the game screen frame.
  • the target control of the target object is also displayed on the displayed game screen frame.
  • the target control of the target object can be triggered to cause the electronic device to draw the target object, thereby displaying the drawn target object, and the clarity of the drawn target object is often higher than the clarity of the target object in the game screen frame sent by the cloud device, thereby improving the display clarity of the target object in the game screen frame, that is, improving the display clarity of the game screen frame.
  • a target control of a target object may be displayed on a displayed game screen frame in the following manner: the target control is displayed at a second position associated with a first position on the displayed game screen frame.
  • the second position may be a position for displaying a target control for the target object, and the second position may be associated with the first position of the target object on the game screen frame.
  • the target control may be a control for controlling the clear display of the target object, that is, the target object may be drawn by triggering the target control to achieve clear display of the target object.
  • the second position may represent the position coordinate information associated with the position coordinate information of the first position.
  • the second position may be the same as the first position, that is, the second position may also be the position coordinate information of the reference point of the target object; the second position may also be different from the first position, in which case the position coordinate information of the second position may be calculated from the position coordinate information of the first position, such as by adding or subtracting corresponding values from the horizontal and vertical coordinates of the position coordinate information of the first position, which is equivalent to the second position being a position that maintains a target distance from the first position in the target direction, for example, the second position may be a position to the right of the first position and 10 pixels away from the first position.
  • the second position may be the position coordinate information associated with the area where the target object is located.
  • the second position may be the position coordinate information of the upper left corner vertex of the rectangular area where the target object is located, or the position coordinate information of the second position may be calculated by the position coordinate information of the upper left corner vertex of the rectangular area where the target object is located, and this is not limited here.
  • the control i.e., target control
  • the target control can be displayed as an icon, so that the object indicated by the icon can be drawn for clear display.
  • the target control can be displayed as a magnifying glass icon to prompt that the object corresponding to the magnifying glass icon can be drawn for clear display.
  • the target control of the target object can be displayed in multiple positions, which improves the display effect and the diversity of the display mode of the target control, thereby improving the user's cloud gaming experience.
  • the target control of the target object can be triggered to cause the electronic device to draw the target object, thereby displaying the drawn target object.
  • the clarity of the drawn target object is often higher than the clarity of the target object in the game screen frame sent by the cloud device, thereby improving the display clarity of the target object in the game screen frame. Clarity, that is, improving the display clarity of the game screen frame.
  • whether the target control needs to be displayed can be determined by the following steps: detecting whether the game screen frame to be displayed included in the display data sent by the cloud device contains an object that needs to be clearly displayed. If it contains an object that needs to be clearly displayed, the game screen frame is displayed, and the target control is displayed at the second position indicated by the first position on the displayed game screen frame according to the first position included in the display data; if it does not contain an object that needs to be clearly displayed, the game screen frame is displayed, and the target control does not need to be displayed.
  • detecting whether the game screen frame to be displayed included in the display data sent by the cloud device contains an object that needs to be clearly displayed can be determined by detecting whether the display data contains the first position of the target object that needs to be clearly displayed in the game screen frame. If the display data contains the first position of the object that needs to be clearly displayed, it means that the game screen frame to be displayed contains the object that needs to be clearly displayed. If the display data does not contain the first position of the object that needs to be clearly displayed, it means that the game screen frame to be displayed does not contain the object that needs to be clearly displayed. That is to say, if the game screen frame contains objects that need to be displayed clearly, then when displaying the game screen frame, it is also necessary to display the target controls for the objects that need to be displayed clearly. If the game screen frame does not contain objects that need to be displayed clearly, the game screen frame can be displayed directly without the need to display the target controls additionally.
  • Figure 3 is a schematic diagram of the effect of the game screen frame provided in an embodiment of the present application.
  • Figure 3 may be a game screen frame of a shooting cloud game.
  • 301 in Figure 3 shows a target object that needs to be clearly displayed.
  • a target control as shown in 302 in Figure 3
  • the target object shown in 301 can be clearly displayed by drawing the target object.
  • the embodiments of the present application can also determine the object boundary of the target object in the game screen frame, and then add a marker stroke to the object boundary and add a target control at the second position indicated by the first position. In this way, the function of clearly displaying the target object by drawing the target object can be more highlighted, thereby improving the user's cloud gaming experience.
  • the above-mentioned display of the target control on the displayed game screen frame can be processed by a target control management component, which can be used to determine the display position (i.e., the second position) of the target control to be displayed, and can also determine the icon style of the target control, etc., which is not limited here. Then, by updating the target control management component, the display position and icon style of the displayed target control can be updated.
  • the management of the target control is achieved through an independent component, avoiding the processing logic for the display of the target control from affecting the game process of the cloud game, and reasonably allocating the processing resources of the hardware device to improve the user's cloud game experience.
  • S203 In response to a trigger operation on a target control, a target object is drawn on a displayed game screen frame based on the first position.
  • drawing the target object may refer to drawing a three-dimensional model of the target object.
  • the trigger operation for the target control can be used to indicate a clearly displayed target object, and then the terminal responds to the trigger operation for the target control, and then the three-dimensional model of the target object can be drawn and displayed on the game screen frame based on the first position.
  • the clarity of the three-dimensional model of the target object is higher than the target object displayed in the game screen frame, thereby improving the display clarity of the target object in the game screen frame, that is, improving the display clarity of the game screen frame.
  • the trigger operation mentioned in the embodiment of the present application can be any operation that can trigger the corresponding function, such as single-click, double-click, drag, etc.
  • the trigger operation for the target control can be a touch operation for the target control.
  • the terminal can detect the trigger operation for the target control.
  • the trigger operation for the target control can also be a shortcut key operation for indicating a clear display object. For example, when a game screen frame containing the target control is displayed, the user clicks a shortcut key for indicating a clear display object, and the terminal can detect the trigger operation for the target control.
  • drawing a three-dimensional model of a target object on a displayed game screen frame may include the following steps: obtaining instruction information for drawing a three-dimensional model; and drawing a three-dimensional model on a displayed game screen frame according to the instruction information. Draw a 3D model of the target object on it.
  • the instruction information for drawing a three-dimensional model is used to indicate how to draw a three-dimensional model of an object.
  • the instruction information for drawing a three-dimensional model may include multiple drawing instructions for drawing a three-dimensional model, so that the three-dimensional model of the object can be drawn using the drawing instructions.
  • the above-mentioned drawing of the three-dimensional model of the target object on the displayed game screen frame according to the instructions of the instruction information may include the following steps: obtaining the model data of the target object according to the instructions of the instruction information; drawing the three-dimensional model of the target object on the displayed game screen frame according to the model data of the target object according to the instructions of the instruction information.
  • the model data of the target object can be data for drawing a three-dimensional model of the target object.
  • the model data of the target object can include vertex data, texture data, color data, normal data, etc. of the three-dimensional model corresponding to the target object, which is not limited here.
  • the three-dimensional model of the object is usually composed of multiple vertices (also called model key points), and the vertex data can be used to indicate the position information of each vertex (model key point) of the three-dimensional model of the object.
  • the texture data can be used to indicate the texture image corresponding to each model triangle face in the multiple model triangle faces (also called triangle face mesh) formed by the multiple vertices included in the model data.
  • the model triangle face can be determined based on three vertices.
  • the model structure of the three-dimensional model of the object can be determined.
  • the color data can be used to indicate the edge between each vertex or the color corresponding to each model triangle face.
  • the normal data can be used to indicate the direction of each vertex or model triangle face.
  • the model data of the object can be processed according to the instructions of the indication information to draw the three-dimensional model of the target object.
  • the model data of the target object may include model key points and texture images of the target object. Then, according to the instruction of the instruction information and based on the model data of the target object, drawing the three-dimensional model of the target object on the displayed game screen frame may include the following steps:
  • the model triangle of the target object is constructed based on the model key points of the target object.
  • the model triangle can be determined based on three vertices.
  • the model structure of the three-dimensional model of the object can be determined.
  • the texture image is drawn on the model triangular surface of the constructed target object to obtain the drawn three-dimensional model of the target object.
  • the texture image can be used to indicate the texture to be drawn on any model triangular surface.
  • the texture image drawn on the model triangular surface can be indicated by the above-mentioned texture data, so that the corresponding texture image can be drawn on each model triangular surface, which is equivalent to drawing the texture on the constructed model structure, thereby obtaining the three-dimensional model of the target object.
  • Displaying a three-dimensional model of the target object on the displayed game screen frame can display the target object with higher definition, so that the user can view the target object more clearly and improve the gaming experience.
  • the three-dimensional model when a three-dimensional model of a target object is displayed on a game screen frame, the three-dimensional model may be displayed according to a certain model ratio.
  • the model ratio may be the same as the size of the target object in the game screen frame, or may be a size ratio determined according to the size of the display area of the terminal, that is, the model ratio of the displayed three-dimensional model is adapted to the size of the display area of the terminal. In this way, the display resource utilization and display effect can be improved.
  • drawing the target object on the displayed game screen frame may include the following steps: determining a third position on the displayed game screen frame that is associated with the first position; drawing the target object at the third position on the displayed game screen frame.
  • the third position is associated with the first position, and the third position may be the same as or different from the first position, and the third position may be the same as or different from the second position, that is, the third position may be any position in the game screen frame, such as the third position may be the center position of the display area of the terminal, or the position of the target object in the game screen frame, and there is no limitation here.
  • the drawn target object can be displayed flexibly, and the freedom of the display position of the target object is improved; for example, the user can also move the display position of the drawn target object by dragging and other operations, thereby improving the user's cloud gaming experience. Experience.
  • the drawn three-dimensional model when displaying the drawn three-dimensional model, it can be directly displayed at the first position of the target object of the game screen frame (i.e., the drawn three-dimensional model is used to replace the target object in the game screen frame), or the game screen frame sent by the cloud device can be used as the background, so as to display the drawn three-dimensional model on the game screen frame.
  • the game screen frame used as the background can also be blurred or masked, so as to highlight the drawn three-dimensional model.
  • the drawn three-dimensional model when displaying the drawn three-dimensional model, can also be displayed on the game screen in the form of a pop-up page. The size of the pop-up page can be smaller than the display area size of the game screen frame.
  • the background of the three-dimensional model displayed in the pop-up page can be determined according to a preset background image, or it can be determined according to a screenshot of a certain area where the target object in the game screen frame is located, which is not limited here.
  • the model scale of the three-dimensional model is the same as the size of the target object in the game screen frame, and the position where the three-dimensional model is displayed can be the position of the target object in the game screen frame.
  • the three-dimensional model is displayed on the game screen frame, it can be intuitively seen that a clearer three-dimensional model is displayed at the original position of the target object, which improves the clarity of the target object, that is, improves the display clarity of the game screen frame, thereby improving the user's cloud gaming experience.
  • the model scale of the three-dimensional model can be a scale that matches the size of the display area of the terminal, and the position for displaying the three-dimensional model can be the center position of the display area of the terminal.
  • the displayed game screen frame is used as the background.
  • the game screen frame used as the background can also be blurred or masked, so that the user can focus on the displayed three-dimensional model, so that the user can see the details of the target object more clearly, thereby improving the user experience.
  • the display data can be obtained (as shown in step S401), and the display data can include the game screen frame to be displayed. It is thus possible to detect whether the game screen frame contains an object that needs to be clearly displayed (as shown in step S402), such as detecting whether there is a first position of an object that needs to be clearly displayed in the display data or detecting whether there is an object identifier of an object that needs to be clearly displayed in the display data.
  • the game screen frame can be displayed (as shown in step S403); if the game screen frame contains an object that needs to be clearly displayed, the game screen frame can be displayed, and the target control of the object is displayed on the displayed game screen frame (as shown in step S404). Then, when a trigger operation for the target control is detected, a three-dimensional model of the object can be drawn on the game screen frame in response to the trigger operation for the target control (as shown in step S405).
  • the display data sent by the cloud device of the cloud game is obtained, so as to display the game screen frame contained in the display data, and display the target control of the target object on the game screen frame.
  • the target object is drawn on the displayed game screen frame in response to the trigger operation for the target control based on the first position of the target object contained in the display data in the game screen frame.
  • the target object when displaying the game screen frame of the cloud game in the embodiment of the present application, can be drawn for display for the target object in the game screen frame, and the clarity of the drawn target object is higher than the clarity of the target object in the game screen frame sent by the cloud device, thereby improving the display clarity of the game screen of the cloud game.
  • Figure 5 is a flow chart of a data processing method for a cloud game provided in an embodiment of the present application.
  • the method can be executed by the above-mentioned electronic device.
  • the data processing method can include the following steps.
  • the game screen frames to be displayed in the display data can be rendered by the cloud device.
  • the cloud device can render in a corresponding manner according to the platform of the terminal to be displayed.
  • the Direct3D graphics rendering interface can be used to call different GPU drivers for rendering.
  • the OpenGL graphics rendering interface can be used to call different GPU drivers for rendering, thereby Get the game screen frame.
  • the game screen frame to be displayed sent by the cloud device can be sent in the format of compressed video
  • obtaining the game screen frame to be displayed in the display data sent by the cloud device of the cloud game can include the following steps: obtaining the compressed video data sent by the cloud device of the cloud game, performing video decompression processing on the compressed video data, and obtaining the game screen frame to be displayed.
  • the compressed video data can be obtained by performing video compression processing on the drawn game screen frame after the cloud device draws the game screen frame, thereby improving the transmission efficiency of the game screen frame and ensuring the smoothness of the screen conversion during the game process.
  • S502 Display a game screen frame, and display a target control at a second position indicated by the first position on the displayed game screen frame.
  • step S502 can refer to the relevant description of the above-mentioned step S202, and will not be repeated here.
  • the above-mentioned instruction information for drawing the three-dimensional model can be obtained from the cloud device, and the instruction information pulled from the cloud device can be converted into a format to obtain the instruction information adapted for the cloud game, which can specifically include the following steps: pulling the initial instruction information for drawing the three-dimensional model from the cloud device; converting the format of the initial instruction information to obtain the instruction information adapted for the cloud game, and storing the instruction information.
  • the initial instruction information directly pulled from the cloud device can be a set of instruction information in a universal format, so that after the terminal receives the initial instruction information in the universal format, the initial instruction information can be converted into a format to obtain the instruction information adapted for the cloud game.
  • the indication information adapted for the cloud game is the indication information adapted for the platform corresponding to the terminal running the cloud game. If the cloud game is a terminal game (such as a Windows game), the indication information adapted for the cloud game may be the indication information adapted for the Windows game. If the cloud game is a mobile game (such as a mobile game), the indication information adapted for the cloud game may be the indication information adapted for the mobile game. In some embodiments, the timing of pulling the initial indication information may be when the cloud game starts the game, or when a trigger operation for the target control is detected, which is not limited here.
  • the above-mentioned obtaining the instruction information for drawing the three-dimensional model in response to the trigger operation on the target control may include the following steps: obtaining the stored instruction information in response to the trigger operation on the target control.
  • the instruction information for drawing the three-dimensional model can be pre-stored in the storage area of the terminal, and when the three-dimensional model of the target object needs to be drawn, the stored instruction information is obtained from the storage area, and the instruction information is adapted to the cloud game, thereby improving the efficiency of drawing the three-dimensional model.
  • the model data of the above-mentioned target object can also be pulled from the cloud device.
  • the embodiment of the present application may also include the following steps: pulling the model data of at least one object and the object identification of at least one object in the cloud game from the cloud device; associating and storing the object identification and model data of each object in the at least one object respectively; the model data of the object is used to draw a three-dimensional model of the object.
  • the at least one object may be an object that needs to be clearly displayed during the cloud game
  • the object that needs to be clearly displayed may be a preset object
  • the object that needs to be clearly displayed may be all or part of the objects in which three-dimensional model data is stored in the cloud device, and there is no limitation here.
  • Each object may have a corresponding object identifier, so that the object identifier and the model data of the object may be stored in association, so that the model data of the target object may be quickly obtained from the storage area, and the three-dimensional model of the target object may be drawn according to the model data of the target object through the indication of the indication information.
  • the timing of pulling the model data of at least one object and the object identifier of at least one object in the cloud game from the cloud device may be when the cloud game starts, or when a trigger operation for the target control is detected, and there is no limitation here. In this way, the model data for drawing the three-dimensional model can be quickly obtained through the object identifier, which can improve the efficiency of three-dimensional model drawing.
  • the display data may also include an object identifier of the target object, so that the model data of the target object can be obtained through the object identifier of the target object.
  • Operation, drawing a three-dimensional model of the target object on the displayed game screen frame can specifically include the following steps: in response to a trigger operation for a target control, obtaining model data stored in association with the object identification of the target object; based on the obtained model data, drawing the three-dimensional model of the target object on the displayed game screen frame.
  • the object identification and model data of the object are stored in association, so that after the object identification of the target object is determined, the model data of the target object can be quickly obtained from the storage area.
  • the three-dimensional model of the target object is drawn on the displayed game screen frame.
  • the three-dimensional model of the target object can also be drawn according to the instructions of the instruction information and the obtained model data, which will not be elaborated here.
  • the cloud device may include a data interception component.
  • the data interception component When the cloud device detects a data pull instruction sent by the terminal, the data interception component is called to obtain the model data of at least one object that needs to be clearly displayed and the instruction information for drawing the model, and then the obtained model data of at least one object that needs to be clearly displayed and the instruction information for drawing the model are sent to the terminal.
  • the data pull instruction can be an instruction to instruct to pull the model data of at least one object, or it can be an instruction to instruct to pull the instruction information, which is not limited here.
  • the data interception component can be used to intercept the model data involved in the cloud game and the instruction information for drawing the model. It is understandable that the cloud game can access terminals and channels of different platforms, and there is no source code.
  • the data interception component can be used to hook the graphics drawing interface to pre-save the model data of the object in the cloud game.
  • the model data includes the object's vertex data, texture data, normal data, color data, etc., which are not limited here.
  • the graphics drawing interface which can also be called drawing instructions, is a set of public program access standards. Intercepting the instruction information for drawing a three-dimensional model is to intercept the drawing instructions, also known as intercepting the graphics drawing interface and parameters.
  • the data interception component can be renderdoc (a data interception component) and gapid (a data interception component), etc., so that the data in the cloud game rendered by D3D (a graphics drawing interface) and OpenGL (a graphics drawing interface) can be intercepted respectively, and then sent to the terminal.
  • D3D a graphics drawing interface
  • OpenGL a graphics drawing interface
  • the cloud device can also transfer the indication information intercepted by the data interception component to convert the indication information into initial indication information in a universal format, so that the initial indication information in a universal format can be sent to terminals of various platforms, so that the terminals can perform format conversion based on the initial indication information in the universal format, and obtain indication information that can be used to draw models directly on the terminals, so that the cloud device does not need to send indication information in different formats to terminals of different platforms, thereby improving the efficiency and accuracy of pulling indication information and reducing the processing resources occupied by the cloud device.
  • the initial indication information in the universal format can be converted between the indication information adapted to various platforms supported by the cloud game, such as Direct3D (a graphics drawing interface), OpenGL (a graphics drawing interface), Metal (a graphics drawing interface), Vulkan (a graphics drawing interface), etc.
  • Direct3D adapted to Windows games
  • OpenGL adapted to mobile games
  • a universal drawing interface i.e. indication information, also called drawing interface, graphics drawing interface, drawing instruction
  • the terminal has Mac (an operating system) and iOS (an operating system), it is converted into Metal (a drawing instruction); if the terminal has Windows (an operating system), it is converted into Direct3D (a drawing instruction); if the terminal has Android (an operating system) or Linux (an operating system), it is converted into OpenGL (a drawing instruction) or Vulkan (a drawing instruction).
  • the model data captured by the cloud device may include the model data of the three-dimensional model (3D model) of the object, and the model data may include the vertex data, texture data, normal data, color data, etc. of the object.
  • the instruction information may include multiple drawing instructions, and terminals of different platforms may use drawing instructions of corresponding formats for drawing.
  • drawing the target three-dimensional model the drawing of the three-dimensional model may be achieved by calling the multiple drawing instructions.
  • the multiple drawing instructions may include: cache creation instructions, data cache instructions, Texture creation instructions, shader creation instructions, drawing index instructions.
  • the cache creation instruction can be used to determine the cache handle of the model data of the target object.
  • the cache creation instruction can be CreateBuffer (a drawing instruction)
  • the cache creation instruction can be glCreateBuffer (a drawing instruction).
  • the data cache instruction can be loaded the model data of the target object into the cache area.
  • the data cache instruction can be IASetVertexBuffers (a drawing instruction)
  • the data cache instruction can be glBufferData (a drawing instruction).
  • the texture creation instruction is used to determine the texture image that needs to be added to each model triangle face of the target object.
  • the texture creation instruction can be CreateTexture2D (a drawing instruction), and for a mobile game, the texture creation instruction can be glTexImage2D (a drawing instruction). Then, a drawing program that can be executed by the graphics processing unit (GPU) of the terminal is created through a shader creation instruction, so that the graphics processor can determine the storage location of the data required to draw the three-dimensional model.
  • the shader creation instruction can be CreateVertextShader (a drawing instruction)
  • the shader creation instruction can be glShaderSource (a drawing instruction).
  • the drawing index instruction is called to determine which vertices of the three-dimensional model the graphics drawing processor needs to draw, thereby realizing the model drawing of the three-dimensional model of the target object.
  • the drawing index instruction can be DrawIndexed (a drawing instruction)
  • the drawing index instruction can be glDrawElement (a drawing instruction).
  • FIG. 7 is a schematic diagram of the effect of model drawing provided by an embodiment of the present application.
  • 701 in FIG. 7 it is a game screen frame, and a three-dimensional model of an object may be included in the game screen frame.
  • 702 in FIG. 7 it is the model structure of the three-dimensional model of the object, and then the texture image is drawn on each triangular face of the three-dimensional model, and the three-dimensional model shown in 701 in FIG. 7 can be obtained.
  • 703 in FIG. 7 it is the vertex data and normal data in the model data of the object. Based on the vertex data and the normal data, the model structure of the three-dimensional model shown in 702 in FIG. 7 can be determined.
  • S504 In response to a target instruction for the displayed three-dimensional model of the target object, perform an operation indicated by the target instruction on the three-dimensional model.
  • the target instruction is one of a zoom-in instruction and a zoom-out instruction.
  • the zoom-in instruction is used to instruct to zoom in on the three-dimensional model
  • the zoom-out instruction is used to instruct to zoom out on the three-dimensional model. In this way, for the three-dimensional model of the target object, the three-dimensional model can be zoomed in or out through the target instruction, so that the terminal can zoom in or out the three-dimensional model accordingly.
  • the game screen frame where the target object is located belongs to the screen frame when the scene is switched during the game.
  • the scene switch is used to indicate the transformation of the game screen triggered by the user operation, such as the movement of the virtual character or the transformation of the game screen caused by the perspective switch during the game.
  • the cloud device continuously sends the game screen frame to the terminal in the form of a video stream to achieve the switching of the game scene.
  • the game screen frame containing the target object belongs to the screen frame when the scene is switched during the game.
  • the target control can be displayed for the object that needs to be clearly displayed in the game screen frame when the scene is switched, so as to trigger the clear display of the target object. This is because generally speaking, when the scene is switched, the target object is more likely to be blurred.
  • the game screen frame contains the target object that needs to be clearly displayed, and the game screen frame belongs to the screen frame when the scene is switched, the target control corresponding to the target object is displayed on the game screen frame, thereby achieving a clear display for the target object, improving data processing efficiency, and improving the clarity of the target object in the game screen.
  • the three-dimensional model of the target object drawn by the terminal may not belong to the game screen frame, and the scaling and display of the three-dimensional model does not affect the display of the game screen frame sent by the cloud device, that is, when the three-dimensional model of the target object is scaled and displayed, the target object in the displayed game screen frame may not change accordingly.
  • a zoom-in control for instructing to zoom in on the target object, or a zoom-out control for instructing to zoom out on the target object, or both the zoom-in control and the zoom-out control may be displayed simultaneously, so that the zoom-in control of the three-dimensional model may be touched. Issue a zoom-in command, or trigger a zoom-out command through a touch operation of a zoom-out control of a 3D model. For example, when a user clicks on a zoom-in control, the 3D model can be zoomed in at a certain zoom ratio; when a user clicks on a zoom-out control, the 3D model can be zoomed out at a certain zoom ratio.
  • the zoom display can also be controlled by gesture operations, such as zooming in with two fingers (triggering a zoom-in instruction) or zooming out with two fingers (triggering a zoom-out instruction), etc.
  • the zoom display can also be controlled by keyboard and mouse operations, such as pressing and holding the target button while sliding the mouse wheel to achieve zoom display of the displayed three-dimensional model.
  • the zoom display is for the three-dimensional model of the target object rather than the object in the game screen frame sent by the cloud device, the three-dimensional model of the target object will not become blurred when the target object is zoomed and displayed, thereby ensuring the clarity of the target object.
  • the drawing of the three-dimensional model is based on the camera position and rotation direction, that is, the three-dimensional model can be translated, scaled and rotated.
  • the terminal will generate a user operation event based on the rotation operation of the three-dimensional model (such as moving the mouse left and right) and transmit it to the cloud device.
  • the cloud device can call a graphics drawing interface such as Direct3D (a graphics drawing interface) and OpenGL (a graphics drawing interface) to update the angle information of the three-dimensional model to be drawn, such as the angle information matrix.
  • Direct3D a graphics drawing interface
  • OpenGL a graphics drawing interface
  • the terminal when displaying the three-dimensional model, can update the angle information of the three-dimensional model to be drawn based on the rotation operation of the three-dimensional model (such as moving the mouse left and right), thereby drawing and displaying the rotated three-dimensional model.
  • Figure 8 is a schematic diagram of the data processing process of the cloud game provided by the embodiment of the present application.
  • the user operation event from the terminal can be received through the server (as shown in 801 in Figure 8), and different servers can be used for data processing for users of different platforms.
  • Windows (an operating system) server can be used for processing
  • Linux (an operating system) server can be used to run Android (an operating system) container for data processing
  • the server can call the corresponding graphics processor GPU (as shown in 803 in Figure 8) through the graphics drawing interface of the corresponding platform (as shown in 802 in Figure 8) to draw the image and obtain the game screen frame (as shown in 804 in Figure 8), for example, Direct3D drawing interface can be used for drawing for terminal games, and OpenGL drawing interface can be used for drawing for mobile games.
  • the game screen frame is compressed (as shown in 805 in Figure 8) to facilitate sending the compressed game screen frame (i.e., compressed video data) to the terminal.
  • the data of the graphics drawing interface can be intercepted in advance to obtain the model data of at least one object that needs to be clearly displayed during the cloud game (as shown in 806 in Figure 8), and the instruction information for drawing the three-dimensional model can be intercepted (as shown in 807 in Figure 8), so as to perform instruction transfer on the intercepted instruction information (as shown in 808 in Figure 8) to obtain the instruction information in a general format, and then send the intercepted model data and instruction information of at least one object to the terminal.
  • the terminal After receiving the model data and instruction information of at least one object sent by the cloud device, the terminal can store the model data (as shown in 809 in Figure 8) and translate the instruction information (as shown in 810 in Figure 8) respectively.
  • the storage of the model data can be stored in association with the object identifier of each object and the corresponding model data.
  • the instruction information translation is used to indicate that the instruction information in the general format sent by the cloud device is translated into instruction information suitable for cloud games, that is, the format conversion of the instruction information in the general format sent by the cloud device is performed.
  • the terminal when the terminal receives the compressed video data sent by the cloud device, it can decompress the compressed video data (as shown in 811 in FIG. 8 ) to obtain the game screen frame to be displayed.
  • the terminal can display the game screen frame, and through the target control management component (as shown in 812 in FIG. 8 ), display the target control corresponding to the object that needs to be clearly displayed when displaying the game screen frame, and then in response to the trigger operation for the target control, draw the three-dimensional model of the target object according to the indication information adapted to the cloud game (as shown in 813 in FIG. 8 ), and then display the game screen (as shown in 814 in FIG. 8 ), and the clarity of the target object in the game screen is improved to a certain extent, which helps to improve the gaming experience.
  • the display data sent by the cloud device of the cloud game is obtained.
  • the target object is drawn on the game screen frame in response to the trigger operation for the target control, based on the first position of the target object in the game screen frame contained in the display data. Therefore, compared with the related art in which the game screen is displayed only based on the video stream sent by the cloud device, when displaying the game screen frame of the cloud game, the target object can be drawn for display with respect to the target object in the game screen frame, and the clarity of the drawn target object is higher than the clarity of the target object in the game screen frame sent by the cloud device, thereby improving the display clarity of the game screen of the cloud game.
  • the data processing device of the cloud game can be set in the above-mentioned electronic device.
  • the data processing device of the cloud game described in the embodiment of the present application may include: an acquisition unit 901, configured to acquire display data sent by the cloud device of the cloud game during the game process of the cloud game; the display data includes a game screen frame to be displayed, and the first position of the target object in the game screen frame in the game screen frame; a display unit 902, configured to display the game screen frame, and display the target control of the target object on the displayed game screen frame; a processing unit 903, configured to draw the target object on the displayed game screen frame based on the first position in response to a trigger operation for the target control.
  • the display unit 902 is further configured to display a target control of the target object at a second position associated with the first position on the displayed game screen frame.
  • the processing unit 903 is further configured to determine a third position on the displayed game screen frame that is associated with the first position; and draw the target object at the third position on the displayed game screen frame.
  • the processing unit 903 is further configured to draw a three-dimensional model of the target object on the displayed game screen frame.
  • the processing unit 903 is further configured to obtain instruction information for drawing the three-dimensional model; and draw the three-dimensional model of the target object on the displayed game screen frame according to the instruction of the instruction information.
  • the processing unit 903 is further configured to obtain the model data of the target object according to the instructions of the indication information; and draw the three-dimensional model of the target object on the displayed game screen frame according to the model data of the target object according to the instructions of the indication information.
  • the model data of the target object includes model key points and a texture image of the target object; the processing unit 903 is further configured to construct the model triangular faces of the target object based on the model key points of the target object in accordance with the instructions of the instruction information; draw the texture image on the constructed model triangular faces of the target object in accordance with the instructions of the instruction information to obtain a drawn three-dimensional model of the target object; and display the three-dimensional model of the target object on the displayed game screen frame.
  • the processing unit 903 is further configured to pull initial indication information for drawing the three-dimensional model from the cloud device; convert the format of the initial indication information to obtain the indication information adapted for the cloud game, and store the indication information; the acquisition unit 901 is further configured to acquire the stored indication information.
  • the processing unit 903 is further configured to pull model data of at least one object in the cloud game and an object identifier of the at least one object from the cloud device, wherein the model data of the object is used to draw a three-dimensional model of the object; and to associate and store the object identifier and model data of each object in the at least one object.
  • the display data includes an object identifier of the target object; the processing unit 903 is further configured to obtain a stored information associated with the object identifier of the target object in response to a trigger operation on the target control. stored model data; and based on the acquired model data, drawing the three-dimensional model of the target object on the displayed game screen frame.
  • the processing unit 903 is further configured to, in response to a target instruction for the drawn target object, perform an operation indicated by the target instruction on the drawn target object, wherein the target instruction is one of a zoom-in instruction and a zoom-out instruction;
  • the game screen frame where the target object is located belongs to a screen frame when a scene is switched during the game process.
  • FIG 10 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
  • the electronic device described in this embodiment includes: a processor 1001 and a memory 1002.
  • the electronic device may also include a network interface or a power supply module.
  • the processor 1001 and the memory 1002 may exchange data.
  • the processor 1001 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • a general-purpose processor may be a microprocessor or any conventional processor, etc.
  • the above-mentioned network interface may include an input device and/or an output device.
  • the input device may be a control panel, a microphone, a receiver, etc.
  • the output device may be a display screen, a transmitter, etc., which are not listed here one by one.
  • the above-mentioned memory 1002 may include a read-only memory and a random access memory, and provide computer programs and data to the processor 1001.
  • a portion of the memory 1002 may also include a non-volatile random access memory.
  • the processor 1001 is configured to call a computer program to execute: during the game process of the cloud game, obtain the display data sent by the cloud device of the cloud game; the display data includes the game screen frame to be displayed, and the first position of the target object in the game screen frame in the game screen frame; display the game screen frame, and display the target control of the target object on the displayed game screen frame; in response to the trigger operation for the target control, based on the first position, draw the target object on the displayed game screen frame.
  • the processor 1001 is further configured to call a computer program to execute: displaying a target control of the target object at a second position associated with the first position on the displayed game screen frame.
  • the processor 1001 is further configured to call a computer program to execute: determining a third position associated with the first position on the displayed game screen frame; and drawing the target object at the third position on the displayed game screen frame.
  • the processor 1001 is further configured to call a computer program to execute: drawing a three-dimensional model of the target object on the displayed game screen frame.
  • the processor 1001 is further configured to call a computer program to execute: obtaining instruction information for drawing the three-dimensional model; and drawing the three-dimensional model of the target object on the displayed game screen frame according to the instruction information.
  • the processor 1001 is further configured to call a computer program to execute: obtaining the model data of the target object as indicated by the instruction information; and drawing the three-dimensional model of the target object on the displayed game screen frame based on the model data of the target object as indicated by the instruction information.
  • the model data of the target object includes model key points and texture images of the target object; the processor 1001 is further configured to call a computer program to execute: constructing the model triangular surfaces of the target object based on the model key points of the target object according to the instructions of the instruction information; drawing the texture image on the constructed model triangular surfaces of the target object according to the instructions of the instruction information to obtain a drawn three-dimensional model of the target object; and displaying the three-dimensional model of the target object on the displayed game screen frame.
  • the processor 1001 is further configured to call a computer program to execute: Pulling initial indication information for drawing the three-dimensional model; converting the format of the initial indication information to obtain the indication information adapted for the cloud game, and storing the indication information; the processor 1001 is also configured to obtain the stored indication information.
  • the processor 1001 is further configured to call a computer program to execute: pulling model data of at least one object in the cloud game and an object identifier of the at least one object from the cloud device, wherein the model data of the object is used to draw a three-dimensional model of the object; and respectively associatively storing the object identifier and model data of each object in the at least one object.
  • the display data includes an object identification of the target object; the processor 1001 is further configured to call a computer program to execute: in response to a trigger operation on the target control, obtain model data stored in association with the object identification of the target object; based on the obtained model data, draw a three-dimensional model of the target object on the displayed game screen frame.
  • the processor 1001 is further configured to call a computer program to execute: in response to a target instruction for the drawn target object, perform an operation indicated by the target instruction on the drawn target object, wherein the target instruction is one of a zoom-in instruction and a zoom-out instruction.
  • the game screen frame where the target object is located belongs to a screen frame when a scene is switched during the game process.
  • the embodiment of the present application further provides a computer-readable storage medium, which stores a computer program.
  • a computer program When the computer program is executed by a processor, the method provided in the embodiment of the present application is implemented, which is not described in detail here.
  • the computer-readable storage medium involved in the embodiments of the present application may be non-volatile or volatile.
  • the computer-readable storage medium may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function, etc.; the data storage area may store data created according to the use of blockchain nodes, etc.
  • the blockchain referred to in this application is a new application mode of computer technologies such as distributed data storage, point-to-point transmission, consensus mechanism, encryption algorithm, etc.
  • Blockchain is essentially a decentralized database, a string of data blocks generated by cryptographic methods, each of which contains a batch of network transaction information, which is used to verify the validity of its information (anti-counterfeiting) and generate the next block.
  • Blockchain can include the underlying blockchain platform, the platform product service layer, and the application service layer.
  • the computer program may be stored in a computer-readable storage medium.
  • the computer-readable storage medium may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
  • the embodiment of the present application also provides a computer program product or a computer program, which includes computer executable instructions, and when the computer executable instructions are executed by a processor, some or all of the steps in the method provided in the embodiment of the present application can be implemented.
  • the computer executable instructions are stored in a computer-readable storage medium.
  • the processor of the computer device i.e., the above-mentioned electronic device
  • the computer device may be a terminal or a server.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供了一种云游戏的数据处理方法、装置、电子设备、计算机可读存储介质及计算机程序产品，可应用于数据处理技术领域。其中方法包括：在云游戏的游戏过程中，获取云游戏的云端设备发送的显示数据；显示数据包含待显示的游戏画面帧、及游戏画面帧中目标物体在游戏画面帧中的第一位置；显示游戏画面帧，并在显示的游戏画面帧上显示目标物体的目标控件；响应于针对目标控件的触发操作，在显示的游戏画面帧上绘制目标物体。本申请还可应用于云计算、人工智能、智慧交通、辅助驾驶、智能家电等各种场景。

Description

云游戏的数据处理方法、装置、电子设备、计算机可读存储介质及计算机程序产品
相关申请的交叉引用
本申请基于申请号为202211277162.0、申请日为2022年10月18日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本申请涉及数据处理技术领域，尤其涉及一种云游戏的数据处理方法、装置、电子设备、计算机可读存储介质及计算机程序产品。
背景技术
云游戏是指游戏运行在云端服务器上，通过视频技术把云端服务器生成的游戏画面传输到各种终端显示，终端利用鼠标、手柄或触摸屏等外设触发相应的事件传回到云端服务器以生成新的游戏画面。相关技术中，云游戏技术都是基于视频流的，即：将游戏在云端设备渲染出的游戏画面以视频流传输给终端，终端基于视频流来显示游戏画面。但是，由于视频编码压缩等原因，终端基于视频流显示的游戏画面存在画面模糊的问题。
发明内容
本申请实施例提供一种云游戏的数据处理方法、装置、电子设备、计算机可读存储介质及计算机程序产品，能够提高云游戏的游戏画面的显示清晰度。
本申请实施例提供一种云游戏的数据处理方法，包括：
在云游戏的游戏过程中，获取所述云游戏的云端设备发送的显示数据；所述显示数据包含待显示的游戏画面帧、及所述游戏画面帧中目标物体在所述游戏画面帧中的第一位置；
显示所述游戏画面帧，并在显示的所述游戏画面帧上显示所述目标物体的目标控件；
响应于针对所述目标控件的触发操作，基于所述第一位置，在显示的所述游戏画面帧上绘制所述目标物体。
本申请实施例提供一种云游戏的数据处理装置，包括：
获取单元，配置为在云游戏的游戏过程中，获取所述云游戏的云端设备发送的显示数据；所述显示数据包含待显示的游戏画面帧、及所述游戏画面帧中目标物体在所述游戏画面帧中的第一位置；
显示单元，配置为显示所述游戏画面帧，并在显示的所述游戏画面帧上显示所述目标物体的目标控件；
处理单元，配置为响应于针对所述目标控件的触发操作，基于所述第一位置，在显示的所述游戏画面帧上绘制所述目标物体。
本申请实施例提供一种电子设备，电子设备包括处理器、存储器，其中，存储器配置为存储计算机程序，处理器配置为执行该存储器中存储的计算机程序时，实现本申请实施例提供的云游戏的数据处理方法。
本申请实施例提供一种计算机可读存储介质，计算机可读存储介质中存储有计算机程序，该计算机程序被处理器执行时，实现本申请实施例提供的云游戏的数据处理方法。
本申请实施例提供了一种计算机程序产品或计算机程序，该计算机程序产品或计算机程序包括计算机可执行指令，该计算机可执行指令被处理器执行时，实现本申请实施例提供的云游戏的数据处理方法。
采用本申请实施例，在云游戏的游戏过程中，获取云游戏的云端设备发送的显示数据，从而显示该显示数据中包含的游戏画面帧，并在游戏画面帧上显示目标物体的目标控件，当接收到针对目标控件的触发操作时，则响应于针对目标控件的触发操作，基于显示数据中包含的目标物体在游戏画面帧中的第一位置，在显示的游戏画面帧上绘制目标物体。由此，相较于相关技术中仅基于云端设备发送的视频流进行游戏画面显示，本申请实施例中在显示云游戏的游戏画面帧时，针对游戏画面帧中的目标物体，能够绘制目标物体来显示，所绘制的目标物体的清晰度是高于云端设备发送的游戏画面帧中的目标物体的清晰度的，由此提高了云游戏的游戏画面的显示清晰度。
附图说明
图1是本申请实施例提供的云游戏的数据处理系统的结构示意图；
图2是本申请实施例提供的云游戏的数据处理方法的流程示意图；
图3是本申请实施例提供的游戏画面的效果示意图；
图4是本申请实施例提供的云游戏的数据处理流程的示意图；
图5是本申请实施例提供的云游戏的数据处理方法的流程示意图；
图6是本申请实施例提供的模型数据的效果示意图；
图7是本申请实施例提供的模型绘制的效果示意图；
图8是本申请实施例提供的云游戏的数据处理过程的示意图；
图9是本申请实施例提供的云游戏的数据处理装置的结构示意图；
图10是本申请实施例提供的电子设备的结构示意图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
本申请实施例提出一种云游戏的数据处理方案，在云游戏的游戏过程中，获取云游戏的云端设备发送的显示数据，从而显示该显示数据中包含的游戏画面帧，并在游戏画面帧上显示目标物体的目标控件，当接收到针对目标控件的触发操作时，则响应于针对目标控件的触发操作，基于显示数据中包含的目标物体在游戏画面帧中的第一位置，在显示的游戏画面帧上绘制目标物体。由此，相较于相关技术中仅基于云端设备发送的视频流进行游戏画面显示，本申请实施例中在显示云游戏的游戏画面帧时，针对游戏画面帧中的目标物体，能够绘制目标物体来显示，所绘制的目标物体的清晰度是高于云端设备发送的游戏画面帧中的目标物体的清晰度的，由此提高了云游戏的游戏画面的显示清晰度。
在一些实施例中，本申请实施例可以应用于一个云游戏的数据处理系统。请参见图1，图1是本申请实施例提供的云游戏的数据处理系统的结构示意图，该云游戏的数据处理系统可以包括云端设备和终端(图1示例性示出了终端1和终端2)。该云端设备可以为云游戏的后台处理设备，可以用于为用户提供云游戏服务，如可以根据终端的用户操作事件渲染生成游戏画面帧，该用户操作事件可以为终端基于检测到的用户操作生 成的事件，该用户操作事件可以用于指示游戏画面的改变，从而云端设备基于用户操作事件的指示渲染生成待显示的游戏画面帧，并将包含该待显示的游戏画面在内的显示数据发送至终端，以便于终端显示游戏画面。例如，该云端设备可以向终端发送显示数据，该显示数据中可以包含待显示的游戏画面帧。该终端可以显示云游戏的游戏画面，即可以基于显示云端设备发送的显示数据显示包含的游戏画面帧，并且终端可以用于接收用户在该云游戏中的用户操作，并将生成的用户操作事件发送至云端设备。该终端还可以执行上述云游戏的数据处理方案，从而可以在接收到的待显示的游戏画面帧上显示针对需要清晰显示的目标物体的目标控件。一般情况下，若云游戏过程中的游戏画面变动大(如游戏中的人物在快速运动)，或目标物体小，则云端设备生成的游戏画面帧中的目标物体通常比较模糊，从而影响用户的云游戏体验，但通过本申请提出的数据处理方案，当用户想要查看清晰的目标物体时，可以触发该目标物体对应的目标控件，终端响应于针对目标物体的目标控件的触发操作，在显示的游戏画面帧上绘制目标物体，该绘制的目标物体的清晰度相较于云端设备发送的游戏画面帧中的目标物体的清晰度更高，以便于用户能够更清晰地查看目标物体，由此可以提升云游戏过程中的游戏画面的显示清晰度，进而提升云游戏过程中的游戏体验。
在一些实施例中，本申请实施例可以应用于云技术领域，具体可以应用于云计算领域，如通过云端设备对云游戏的游戏过程中的数据进行处理。云计算(cloud computing)是一种计算模式，它将计算任务分布在大量计算机构成的资源池上，使各种应用系统能够根据需要获取计算力、存储空间和信息服务。提供资源的网络被称为“云”。“云”中的资源在使用者看来是可以无限扩展的，并且可以随时获取，按需使用，随时扩展，按使用付费。
作为云计算的基础能力提供商，会建立云计算资源池(简称云平台，可称为基础设施即服务(Infrastructure as a Service，IaaS)平台，在资源池中部署多种类型的虚拟资源，供外部客户选择使用。云计算资源池中主要包括：计算设备(为虚拟化机器，包含操作系统)、存储设备、网络设备。
按照逻辑功能划分，在IaaS层上可以部署平台即服务(Platform as a Service，PaaS)层，PaaS层之上再部署软件即服务(Software as a Service，SaaS)层，也可以直接将SaaS部署在IaaS上。PaaS为软件运行的平台，如数据库、web容器等。SaaS为各式各样的业务软件，如web门户网站、短信群发器等。一般来说，SaaS和PaaS相对于IaaS是上层。
在一些实施例中，本申请实施例还可以应用于人工智能技术领域，人工智能(Artificial Intelligence，AI)是利用数字计算机或者数字计算机控制的机器模拟、延伸和扩展人的智能，感知环境、获取知识并使用知识获得最佳结果的理论、方法、技术及应用系统。换句话说，人工智能是计算机科学的一个综合技术，它企图了解智能的实质，并生产出一种新的能以人类智能相似的方式做出反应的智能机器。人工智能也就是研究各种智能机器的设计原理与实现方法，使机器具有感知、推理与决策的功能。
人工智能技术是一门综合学科，涉及领域广泛，既有硬件层面的技术也有软件层面的技术。人工智能基础技术一般包括如传感器、专用人工智能芯片、云计算、分布式存储、大数据处理技术、操作/交互系统、机电一体化等技术。人工智能软件技术主要包括计算机视觉技术、语音处理技术、自然语言处理技术以及机器学习/深度学习等几大方向。
需要进行说明的是，本申请在收集用户的相关数据之前以及在收集用户的相关数据的过程中，都可以显示提示界面、弹窗或输出语音提示信息，该提示界面、弹窗或语音提示信息用于提示用户当前正在搜集其相关数据，使得本申请仅仅在获取到用户对该提示界面或者弹窗发出的确认操作后，才开始执行获取用户相关数据的相关步骤，否则(即 未获取到用户对该提示界面或者弹窗发出的确认操作时)，结束获取用户相关数据的相关步骤，即不获取用户的相关数据。换句话说，本申请所采集的所有用户数据都是在用户同意并授权的情况下进行采集的，且相关用户数据的收集、使用和处理需要遵守相关国家和地区的相关法律法规和标准。
本申请的技术方案可运用在电子设备中。该电子设备可以是终端(例如图1所示的终端1、终端2)，也可以是服务器，或者也可以是用于进行数据处理的其他设备，本申请不做限定。在一些实施例中。服务器可以是独立的物理服务器，也可以是多个物理服务器构成的服务器集群或者分布式系统，还可以是提供云服务、云数据库、云计算、云函数、云存储、网络服务、云通信、中间件服务、域名服务、安全服务、内容分发网络(Content Delivery Network，CDN)、以及大数据和人工智能平台等基础云计算服务的云服务器。终端包括但不限于手机、电脑、智能语音交互设备、智能家电、车载终端、飞行器、智能音箱、智能家电等。终端以及服务器可以通过有线或无线通信方式进行直接或间接地连接，本申请实施例对此不做限制。
可以理解，上述场景仅是作为示例，并不构成对于本申请实施例提供的技术方案的应用场景的限定，本申请的技术方案还可应用于其他场景。例如，本领域普通技术人员可知，随着系统架构的演变和新业务场景的出现，本申请实施例提供的技术方案对于类似的技术问题，同样适用。
基于上述的描述，本申请实施例提出一种云游戏的数据处理方法。请参见图2，图2是本申请实施例提供的云游戏的数据处理方法的流程示意图。该方法可以由上述的电子设备执行。该云游戏的数据处理方法可以包括以下步骤。
S201、在云游戏的游戏过程中，获取云游戏的云端设备发送的显示数据。
其中，云游戏是以云计算为基础的游戏方式，在云游戏的运行模式下，游戏处理过程主要集中在服务器端(如云端设备)运行，并将渲染完毕后的游戏画面压缩后通过网络传送给游戏玩家对应的终端，以便于终端可以对云端设备发送的渲染后的游戏画面进行显示。该云游戏可以为手游、端游等各种平台对应的游戏。可以理解的是，当用户在终端点击用于指示进入云游戏的控件，并成功进入云游戏后，则表示正在云游戏的游戏过程中，在游戏过程中，云端设备可以响应于终端发送的用户操作事件，不断生成云游戏的游戏画面帧并发送至终端进行显示。
该显示数据包含待显示的游戏画面帧、及游戏画面帧中目标物体在游戏画面帧中的第一位置。该目标物体可以是游戏画面帧中需要清晰显示的物体，即能够通过绘制该目标物体，来对目标物体进行清晰显示。
该游戏画面帧可以为在云游戏的游戏过程中云端设备渲染得到的一帧游戏画面。云游戏可以是基于视频流的，用户的终端可以不断接收并显示来自云端设备的多个游戏画面帧，从而形成不断变化的游戏画面，其中的每个游戏画面帧均是由云端设备所进行渲染得到的。
该需要清晰显示的目标物体通常可以是一些在游戏画面中容易模糊但又需要清晰显示的物体，如需要清晰显示的物体可以为游戏画面中的关键物体，例如游戏过程中的一些宝箱、虚拟对象模型等等。在一些实施例中，该需要清晰显示的物体可以为预设的物体，该需要清晰显示的物体通常具有对应的三维模型数据，也就是说，云端设备在生成该游戏画面帧时，通常可以基于物体的三维模型数据渲染得到对应的物体，从而得到含有该物体的游戏画面帧。
该第一位置可以用于指示需要清晰显示的目标物体所在的位置。在一些实施例中，该第一位置可以表示为该目标物体的参考点的位置坐标信息，该位置坐标信息可以为二维坐标信息(包括横坐标和纵坐标)。如该第一位置可以表征为该目标物体的中心位置 的位置坐标信息，如中心位置的横坐标和纵坐标，又如该第一位置可以为该目标物体的最右侧的位置所对应的位置坐标信息。在一些实施例中，该目标物体的第一位置还可以表示为该目标物体所在区域的区域位置信息，目标物体所在区域可以用于指示以一定区域形状刚好框选住该目标物体的区域，如该目标物体所在区域可以为一个矩形区域，则该目标物体的第一位置可以表示为该矩形区域的区域位置信息，如表示为该矩形区域的左上角顶点的位置坐标信息以及矩形区域的长和宽。
可以理解的是，若显示数据所包含的待显示的游戏画面帧中包括需要清晰显示的物体，则该显示数据包括上述第一位置；若显示数据所包含的待显示的游戏画面帧中不包括需要清晰显示的物体，则该显示数据中不包括上述第一位置。
S202、显示游戏画面帧，并在显示的游戏画面帧上显示目标物体的目标控件。
这里，在获取到云端设备发送的云游戏的显示数据之后，对显示数据进行解析，得到显示数据中包括的游戏画面帧以及目标物体的第一位置，从而显示该游戏画面帧。需要说明的是，在显示游戏画面帧时，还在显示的游戏画面帧上显示目标物体的目标控件。当用户想要查看更清晰的目标物体时，可以通过触发该目标物体的目标控件，可以使得电子设备对目标物体进行绘制，从而显示绘制的目标物体，而绘制的目标物体的清晰度往往高于云端设备发送的游戏画面帧中的目标物体的清晰度，由此提高的游戏画面帧中目标物体的显示清晰度，也即提高了游戏画面帧的显示清晰度。
在一些实施例中，可通过如下方式在显示的游戏画面帧上显示目标物体的目标控件：在显示的游戏画面帧上第一位置关联的第二位置处显示目标控件。
其中，该第二位置可以为用于显示针对目标物体的目标控件的位置，该第二位置可以和目标物体在游戏画面帧上的第一位置相关联。该目标控件可以为用于控制清晰显示目标物体的控件，即可以通过触发该目标控件，对目标物体进行绘制，实现对目标物体的清晰显示。
在一些实施例中，若该第一位置表示为目标物体的参考点的位置坐标信息，则第二位置可以表示与第一位置的位置坐标信息关联的位置坐标信息。该第二位置可以与第一位置相同，即第二位置也可以为目标物体的参考点的位置坐标信息；该第二位置还可以与第一位置不同，则该第二位置的位置坐标信息可以通过第一位置的位置坐标信息进行计算得到，如可以在第一位置的位置坐标信息的横纵坐标上分别加减对应的数值，即相当于第二位置可以为在目标方向上与该第一位置保持目标距离的位置，例如第二位置可为在第一位置的右侧且距离第一位置10个像素的位置。
在一些实施例中，若该第一位置表示为该目标物体所在区域的区域位置信息，则该第二位置可以为目标物体所在区域关联的位置坐标信息。例如第二位置可以为目标物体所在的矩形区域的左上角顶点的位置坐标信息，又如该第二位置的位置坐标信息可以通过目标物体所在的矩形区域的左上角顶点的位置坐标信息进行计算得到，此处不做限制。
本申请实施例中提到的控件(即目标控件)可以等同于功能项，可以有多种呈现形式，如图形按钮、进度条、菜单、列表、图标等，本申请实施例对此不做限制。例如，该目标控件可以显示为一个图标，从而可以提示该图标所指示的物体可以绘制以进行清晰显示。例如，该目标控件可以显示为一个放大镜图标，以提示该放大镜图标所对应的物体可以绘制以进行清晰显示。
应用上述实施例，能够采用多种位置来显示目标物体的目标控件，提高了目标控件的显示效果以及显示方式的多样性，进而提高用户的云游戏体验。且当用户想要查看更清晰的目标物体时，可以通过触发该目标物体的目标控件，可以使得电子设备对目标物体进行绘制，从而显示绘制的目标物体，而绘制的目标物体的清晰度往往高于云端设备发送的游戏画面帧中的目标物体的清晰度，由此提高了游戏画面帧中目标物体的显示清 晰度，也即提高了游戏画面帧的显示清晰度。
在一些实施例中，可以通过以下步骤确定是否需要显示目标控件：检测云端设备发送的显示数据所包括的待显示的游戏画面帧中是否包含需要清晰显示的物体，若包含需要清晰显示的物体，则显示游戏画面帧，并根据显示数据中包含的第一位置在显示的游戏画面帧上第一位置指示的第二位置处显示目标控件；若不包含需要清晰显示的物体，则显示游戏画面帧，且不需要显示目标控件。其中，检测云端设备发送的显示数据所包括的待显示的游戏画面帧中是否包含需要清晰显示的物体，可以通过检测显示数据中是否包含游戏画面帧中需要清晰显示的目标物体在游戏画面帧中的第一位置进行确定，若显示数据中包含需要清晰显示的物体的第一位置，则表示待显示的游戏画面帧中包含需要清晰显示的物体，若显示数据中不包含需要清晰显示的物体的第一位置，则表示待显示的游戏画面帧中不包含需要清晰显示的物体。也就是说，若在游戏画面帧中包含了需要清晰显示的物体，则在显示游戏画面帧时，还需要显示针对需要清晰显示的物体的目标控件，若在游戏画面帧中不包含需要清晰显示的物体，则可以直接显示游戏画面帧，不需要额外显示目标控件。
例如，请参见图3，图3是本申请实施例提供的游戏画面帧的效果示意图，可以看到，图3所示可以为一个射击云游戏的游戏画面帧，在该游戏画面帧中，图3中的301所示为一个需要进行清晰显示的目标物体，则在该需要清晰显示的目标物体附近存在一个目标控件(如图3中的302所示)，以便于提示用户301所示目标物体能够通过绘制目标物体来进行清晰显示。
在一些实施例中，本申请实施例还可以确定目标物体在游戏画面帧中的物体边界，进而可以通过对物体边界添加标记描边，并且在第一位置指示的第二位置处添加目标控件，由此，能够更能突出目标物体具有通过绘制目标物体来进行清晰显示的功能，提高用户的云游戏体验。
在一些实施例中，上述在显示的游戏画面帧上显示目标控件，可以由目标控件管理组件进行处理，该目标控件管理组件可以用于确定需要显示的目标控件的显示位置(即第二位置)，还可以确定目标控件的图标样式等等，此处不做限制。进而可以通过对该目标控件管理组件进行更新，实现对显示的目标控件的显示位置与图标样式的更新，由此，通过独立的组件实现对目标控件的管理，避免针对目标控件的显示的处理逻辑对云游戏的游戏过程进行影响，合理分配的硬件设备的处理资源，提高用户的云游戏体验。
S203、响应于针对目标控件的触发操作，基于第一位置，在显示的游戏画面帧上绘制目标物体。
其中，绘制目标物体可以指的是绘制目标物体的三维模型。针对目标控件的触发操作可以用于指示显示清晰的目标物体，进而终端响应于针对该目标控件的触发操作，则可以基于第一位置，在游戏画面帧上绘制并显示目标物体的三维模型，该目标物体的三维模型的清晰度高于游戏画面帧中所显示的目标物体，由此提高了游戏画面帧中目标物体的显示清晰度，也即提高了游戏画面帧的显示清晰度。需要说明的是，本申请实施例中提到的触发操作可以是任意可触发相应功能的操作，如单击、双击、拖拽等。
在一些实施例中，针对该目标控件的触发操作可以为针对目标控件的触控操作，例如，当用户单击目标控件时，则终端可以检测到针对目标控件的触发操作；针对该目标控件的触发操作也可以为用于指示清晰显示物体的快捷键操作，例如，在包含该目标控件的游戏画面帧显示时，用户点击用于指示清晰显示物体的快捷键，则终端可以检测到针对目标控件的触发操作。
在一些实施例中，在显示的游戏画面帧上绘制目标物体的三维模型，可以包括以下步骤：获取用于绘制三维模型的指示信息；按照指示信息的指示，在显示的游戏画面帧 上绘制目标物体的三维模型。
需要说明的是，该用于绘制三维模型的指示信息用于指示如何绘制得到物体的三维模型。例如，该用于绘制三维模型的指示信息可以包括多个用于绘制三维模型的绘制指令，从而可以利用该绘制指令绘制得到物体的三维模型。
在一些实施例中，上述按照指示信息的指示，在显示的游戏画面帧上绘制目标物体的三维模型，可以包括以下步骤：按照指示信息的指示，获取目标物体的模型数据；按照指示信息的指示，根据目标物体的模型数据，在显示的游戏画面帧上绘制目标物体的三维模型。
需要说明的是，该目标物体的模型数据可以为用于绘制目标物体的三维模型的数据。例如，该目标物体的模型数据可以包含目标物体对应的三维模型的顶点数据、纹理数据、颜色数据、法线数据等等，此处不做限制。其中，物体的三维模型通常由多个顶点(也称模型关键点)组成，顶点数据可以用于指示物体的三维模型的每个顶点(模型关键点)的位置信息。纹理数据可以用于指示由模型数据所包括的多个顶点形成的多个模型三角面(也称三角面片mesh)中的每个模型三角面所对应的纹理图像，模型三角面可以基于三个顶点进行确定，通过构建目标物体的模型三角面可以确定出物体的三维模型的模型结构。该颜色数据可以用于指示每个顶点之间的边或者每个模型三角面对应的颜色。法线数据可以用于指示各个顶点或者模型三角面的朝向。由此可以按照指示信息的指示，对物体的模型数据进行处理以绘制得到目标物体的三维模型。
在一些实施例中，如上述，目标物体的模型数据可以包含目标物体的模型关键点及纹理图像，则按照指示信息的指示，根据目标物体的模型数据，在显示的游戏画面帧上绘制目标物体的三维模型，可以包括以下步骤：
①按照指示信息的指示，基于目标物体的模型关键点构建目标物体的模型三角面。其中，模型三角面可以基于三个顶点进行确定，通过构建目标物体的模型三角面，可以确定出物体的三维模型的模型结构。
②按照指示信息的指示，在构建的目标物体的模型三角面上绘制纹理图像，得到绘制的目标物体的三维模型。其中，该纹理图像可以用于指示任一模型三角面上需要绘制的纹理，在模型三角面上绘制的纹理图像可以通过上述的纹理数据进行指示，从而可以在每个模型三角面上绘制对应的纹理图像，相当于在构建的模型结构上绘制纹理，从而得到目标物体的三维模型。
③在显示的游戏画面帧上显示目标物体的三维模型。在游戏画面帧上显示三维模型，可以显示清晰度更高的目标物体，使得用户能够查看到更清晰的目标物体，提升游戏体验。
在一些实施例中，在游戏画面帧上显示目标物体的三维模型时，可以显示按照一定模型比例显示该三维模型。例如，该模型比例可以为与游戏画面帧中的目标物体的大小相同的比例，也可以为根据终端的显示区域大小所确定的大小比例，即显示的三维模型的模型比例与终端的显示区域大小适配。如此，能够提高显示资源利用率以及显示效果。
在一些实施例中，基于第一位置，在显示的所述游戏画面帧上绘制所述目标物体，可以包括以下步骤：确定显示的游戏画面帧上、与第一位置关联的第三位置；在显示的游戏画面帧上的第三位置处绘制目标物体。这里，第三位置与第一位置相关联，该第三位置可以和第一位置相同，也可以和第一位置不同，该第三位置可以和第二位置相同，也可以和第二位置不同，即该第三位置可以为游戏画面帧中的任意位置，如第三位置可以为终端的显示区域的中心位置，也可以为该游戏画面帧中目标物体所在位置，此处不做限制。如此，可以灵活显示绘制的目标物体，提高目标物体的显示位置的自由度；例如，用户还可以通过拖拽等操作，移动绘制的目标物体的显示位置，提高用户的云游戏 体验。
在一些实施例中，在显示绘制得到的三维模型时，可以直接在游戏画面帧的目标物体的第一位置处显示(即采用绘制的三维模型替换游戏画面帧中的目标物体)，也可以将云端设备发送的游戏画面帧作为背景，从而在游戏画面帧上显示绘制得到的三维模型。例如，作为背景的游戏画面帧还可以进行虚化或蒙层等处理，从而更突出绘制的三维模型。在一些实施例中，在显示绘制得到的三维模型时，还可以弹窗页面的形式在游戏画面上显示所绘制的三维模型，弹窗页面的大小可以小于游戏画面帧的显示区域大小，弹窗页面中所显示的三维模型的背景可以根据预设的背景图像进行确定，也可以根据游戏画面帧中的目标物体所在的一定区域的截图，此处不做限制。
例如，在一些示例中，该三维模型的模型比例与游戏画面帧中的目标物体的大小相同，且显示三维模型的位置可以为该游戏画面帧中的目标物体所在位置，则在游戏画面帧上显示该三维模型后，可以直观地看到原本目标物体所在位置显示了一个更为清晰的三维模型，提升了目标物体的清晰度，也即提升了游戏画面帧的显示清晰度，由此可以提升用户的云游戏体验。
又如，在一些示例中，该三维模型的模型比例可以为与终端的显示区域大小适配的比例，显示三维模型的位置可以为终端的显示区域的中心位置，则在显示三维模型时，将显示的游戏画面帧作为背景，例如，该作为背景的游戏画面帧还可以进行虚化或蒙层等处理，进而可以让用户将注意力集中在显示的三维模型上，从而可以让用户更清楚地看到目标物体的细节，从而可以提升用户体验。
此处结合图示对该数据处理过程进行阐述，请参见图4，图4是本申请实施例提供的云游戏的数据处理流程的示意图。首先可以获取显示数据(如步骤S401所示)，该显示数据中可以包含待显示的游戏画面帧。从而可以检测游戏画面帧中是否包含需要清晰显示的物体(如步骤S402所示)，如可以检测显示数据中是否存在需要清晰显示的物体的第一位置或者检测显示数据中是否存在需要清晰显示的物体的物体标识。若游戏画面帧中不包含需要清晰显示的物体，则可以显示游戏画面帧(如步骤S403所示)；若游戏画面帧中包含需要清晰显示的物体，则可以显示游戏画面帧，并在显示的游戏画面帧上显示该物体的目标控件(如步骤S404所示)。进而当检测到针对目标控件的触发操作时，可以响应于针对目标控件的触发操作，在游戏画面帧上绘制物体的三维模型(如步骤S405所示)。
采用本申请实施例，在云游戏的游戏过程中，获取云游戏的云端设备发送的显示数据，从而显示该显示数据中包含的游戏画面帧，并在游戏画面帧上显示目标物体的目标控件，当接收到针对目标控件的触发操作时，则响应于针对目标控件的触发操作，基于显示数据中包含的目标物体在游戏画面帧中的第一位置，在显示的游戏画面帧上绘制目标物体。由此，相较于相关技术中仅基于云端设备发送的视频流进行游戏画面显示，本申请实施例中在显示云游戏的游戏画面帧时，针对游戏画面帧中的目标物体，能够绘制目标物体来显示，所绘制的目标物体的清晰度是高于云端设备发送的游戏画面帧中的目标物体的清晰度的，由此提高了云游戏的游戏画面的显示清晰度。
请参见图5，图5是本申请实施例提供的云游戏的数据处理方法的流程示意图。该方法可以由上述的电子设备执行。该数据处理方法可以包括以下步骤。
S501、在云游戏的游戏过程中，获取云游戏的云端设备发送的显示数据。
在一些实施例中，如上述，该显示数据中待显示的游戏画面帧可以由云端设备所渲染得到。例如，云端设备可以根据所需显示的终端的平台采用对应的方式进行渲染，如针对Windows游戏，可以采用Direct3D的图形绘制接口调用不同GPU驱动绘制，又如，针对Android手游，可以采用OpenGL的图形绘制接口调用不同GPU驱动绘制，从而 得到游戏画面帧。
在一些实施例中，云端设备发送的待显示的游戏画面帧，可以以压缩视频的格式进行发送，则获取云游戏的云端设备发送的显示数据中待显示的游戏画面帧可以包括以下步骤：获取云游戏的云端设备发送的压缩视频数据，对压缩视频数据进行视频解压处理，得到待显示的游戏画面帧。可以理解的是，该压缩视频数据可以在云端设备绘制得到游戏画面帧后，对绘制得到的游戏画面帧进行视频压缩处理得到的，由此可以提升游戏画面帧的传输的效率，保证游戏过程的画面转换的流畅性。
S502、显示游戏画面帧，并在显示的游戏画面帧上第一位置指示的第二位置处显示目标控件。
其中，步骤S502可以参照上述步骤S202的相关描述，此处不做赘述。
S503、响应于针对目标控件的触发操作，基于第一位置，在显示的游戏画面帧上绘制目标物体的三维模型。
在一些实施例中，上述用于绘制三维模型的指示信息可从云端设备拉取得到，并且可以对从云端设备拉取到的指示信息进行格式转换，得到云游戏适配的指示信息，具体可以包括以下步骤：向云端设备拉取用于绘制三维模型的初始指示信息；对初始指示信息进行格式转换，得到云游戏适配的指示信息，并存储指示信息。其中，为了适配应用于不同平台的云游戏，从云端设备直接拉取的初始指示信息可以为一套通用格式的指示信息，从而便于在终端接收到该通用格式的初始指示信息后，对初始指示信息进行格式转换，以得到云游戏适配的指示信息。
云游戏适配的指示信息为运行该云游戏的终端所对应的平台适配的指示信息，如该云游戏为端游(如Windows游戏)，则该云游戏适配的指示信息可以为与Windows游戏适配的指示信息，又如该云游戏为手游(如手机游戏)，则该云游戏适配的指示信息可以为与手游适配的指示信息。在一些实施例中，拉取初始指示信息的时机可以为在该云游戏开始游戏时，也可以为在检测到针对目标控件的触发操作时，此处不做限制。
那么，上述响应于针对目标控件的触发操作，获取用于绘制三维模型的指示信息，可以包括以下步骤：响应于针对目标控件的触发操作，获取存储的指示信息。也就是说，用于绘制三维模型的指示信息可以预先存储于终端的存储区域中，当需要绘制目标物体的三维模型时，则从存储区域中获取存储的指示信息，并且该指示信息是适配于云游戏的指示信息，由此可以提升三维模型绘制的效率。
在一些实施例中，上述目标物体的模型数据也可以从云端设备拉取得到，那么，本申请实施例还可以包括以下步骤：向云端设备拉取云游戏中至少一个物体的模型数据和至少一个物体的物体标识；分别对至少一个物体中每个物体的物体标识和模型数据进行关联存储；该物体的模型数据用于绘制该物体的三维模型。
其中，该至少一个物体可以为在云游戏的过程中需要清晰显示的物体，该需要清晰显示的物体可以为预设的物体，该需要清晰显示的物体可以为云端设备中存储有三维模型数据的全部或部分物体，此处不做限制。每个物体均可以有对应的物体标识，从而可以将物体标识和物体的模型数据关联存储，以便于可以从存储区域中快速获取到目标物体的模型数据，从而通过指示信息的指示，根据目标物体的模型数据绘制的目标物体的三维模型。在一些实施例中，向云端设备拉取云游戏中至少一个物体的模型数据和至少一个物体的物体标识的时机可以为在该云游戏开始游戏时，也可以为在检测到针对目标控件的触发操作时，此处不做限制。如此，通过物体标识能够快速获取用于绘制三维模型的模型数据，可以提升三维模型绘制的效率。
在一些实施例中，上述显示数据中还可以包括目标物体的物体标识，由此可以通过目标物体的物体标识去获取到目标物体的模型数据。那么，响应于针对目标控件的触发 操作，在显示的游戏画面帧上绘制目标物体的三维模型，具体可以包括以下步骤：响应于针对目标控件的触发操作，获取与目标物体的物体标识关联存储的模型数据；基于获取的模型数据，在显示的游戏画面帧上绘制目标物体的三维模型。如上述，物体的物体标识与模型数据是关联存储的，由此可以在确定了目标物体的物体标识后，快速从存储区域中获取到目标物体的模型数据。基于获取的模型数据，在显示的游戏画面帧上绘制目标物体的三维模型，具体还可以按照指示信息的指示，根据获取的模型数据，绘制目标物体的三维模型，此处不做赘述。
在一些实施例中，云端设备中可以包括一个数据截取组件，当云端设备检测到终端发送的数据拉取指令时，调用该数据截取组件获取需要清晰显示的至少一个物体的模型数据以及用于绘制模型的指示信息，然后将获取到的获取需要清晰显示的至少一个物体的模型数据和用于绘制模型的指示信息发至终端。该数据拉取指令可以为指示拉取至少一个物体的模型数据的指令，也可以为指示拉取指示信息的的指令，此处不做限制。该数据截取组件可以用于截取云游戏所涉及的模型数据和用于绘制模型的指示信息。可以理解的是，云游戏可以接入不同平台的终端和渠道，且没有源代码，则获取物体的模型的模型数据时，可以通过数据截取组件hook(钩取)图形绘制接口，来预先保存云游戏中的物体的模型数据，该模型数据包括物体的顶点数据、纹理数据、法线数据、颜色数据等等，此处不做限制。其中，图形绘制接口也可以叫绘制指令，是一套公开的程序访问标准，则截取用于绘制三维模型的指示信息也就是截取该绘制指令，也称截取图形绘制接口和参数。
例如，该数据截取组件可以为renderdoc(一种数据截取组件)和gapid(一种数据截取组件)等等，从而可以分别把用D3D(一种图形绘制接口)和OpenGL(一种图形绘制接口)渲染的云游戏里的数据进行截取，然后发送至终端。
在一些实施例中，云端设备还可以对通过数据截取组件截取的指示信息进行信息中转，以使得将指示信息转换为通用格式的初始指示信息，从而可以将通用格式的初始指示信息发送至各个平台的终端，以便于终端可以基于该通用格式的初始指示信息进行格式转化，得到能够直接在终端进行模型绘制的指示信息，从而云端设备可以不需要针对不同平台的终端发送不同格式的指示信息，提升指示信息的拉取效率和准确性，减少云端设备的处理资源的占用。
该通用格式的初始指示信息，可以与该云游戏能够支持的各种平台适配的指示信息之间进行格式转换，如可以和Direct3D(一种图形绘制接口)、OpenGL(一种图形绘制接口)、Metal(一种图形绘制接口)、Vulkan(一种图形绘制接口)等等指示信息之间进行格式转换。例如，可以在云端设备把Direct3D(适配于Windows游戏)和OpenGL(适配于手游)转换成通用绘制接口(即指示信息，也称绘制接口、图形绘制接口、绘制指令)，以便于在终端经过格式转换得到适配于对应平台的绘制接口，比如终端具有Mac(一种操作系统)和iOS(一种操作系统)，就转换成Metal(一种绘制指令)，终端具有Windows(一种操作系统)，则转成Direct3D(一种绘制指令)，终端具有Android(一种操作系统)或Linux(一种操作系统)，则转成OpenGL(一种绘制指令)或Vulkan(一种绘制指令)。
请参见图6，图6是本申请实施例提供的模型数据的效果示意图。如图6所示，云端设备所抓取的模型数据可以包括物体的三维模型(3D模型)的模型数据，模型数据可以包括物体的顶点数据、纹理数据、法线数据、颜色数据等。
在一些实施例中，该指示信息可以包含多个绘制指令，针对不同平台的终端可以采用对应格式的绘制指令进行绘制。则在绘制目标三维模型时，可以通过调用该多个绘制指令实现三维模型的绘制。该多个绘制指令可以包括：缓存创建指令、数据缓存指令、 纹理创建指令、着色器创建指令、绘制索引指令。
例如，可以通过缓存创建指令，确定目标物体的模型数据的缓存句柄，如针对端游，该缓存创建指令可以为CreateBuffer(一种绘制指令)，针对手游，该缓存创建指令可以为glCreateBuffer(一种绘制指令)。然后调用数据缓存指令将目标物体的模型数据加载至缓存区域中，如针对端游，该数据缓存指令可以为IASetVertexBuffers(一种绘制指令)，针对手游，该数据缓存指令可以为glBufferData(一种绘制指令)。然后通过纹理创建指令确定目标物体的每个模型三角面上需要添加的纹理图像，如针对端游，该纹理创建指令可以为CreateTexture2D(一种绘制指令)，针对手游，该纹理创建指令可以为glTexImage2D(一种绘制指令)。进而通过着色器创建指令创建终端的图形处理器(Graphics Processing Unit，GPU)能够执行的绘制程序，以便于图形处理器能够确定绘制三维模型所需的数据的存储位置，如针对端游，该着色器创建指令可以为CreateVertextShader(一种绘制指令)，针对手游，该着色器创建指令可以为glShaderSource(一种绘制指令)。最后调用绘制索引指令确定图形绘制处理器需要绘制三维模型的哪些顶点，从而实现对目标物体的三维模型的模型绘制，如针对端游，该绘制索引指令可以为DrawIndexed(一种绘制指令)，针对手游，该绘制索引指令可以为glDrawElement(一种绘制指令)。
例如，请参见图7，图7是本申请实施例提供的模型绘制的效果示意图，如图7中的701所示为一个游戏画面帧，在该游戏画面帧上可以包括一个物体的三维模型。如图7中的702所示，为该物体的三维模型的模型结构，进而在该三维模型的每个三角面上绘制纹理图像，则可以得到如图7中的701所示的三维模型。如图7中的703所示，为该物体的模型数据中的顶点数据和法线数据，可以基于顶点数据和法线数据，能够确定出如图7中的702所示的三维模型的模型结构。
S504、响应于针对显示的目标物体的三维模型的目标指令，对三维模型进行目标指令所指示的操作。
其中，目标指令为放大指令和缩小指令中之一。放大指令用于指示对三维模型进行放大，缩小指令用于指示对三维模型进行缩小。如此，针对目标物体的三维模型，可以通过目标指令实现对三维模型的放大或缩小，从而终端可以对应地对三维模型进行放大显示或者缩小显示。
在一些实施例中，目标物体所在的游戏画面帧属于游戏过程中进行场景切换时的画面帧。其中，场景切换用于指示基于用户操作所触发的游戏画面的变换，如游戏过程中的虚拟人物的移动或视角切换导致的游戏画面的变换，云端设备按照视频流的方式不断向终端发送游戏画面帧，以实现游戏场景的切换。则包含该目标物体的游戏画面帧属于游戏过程中进行场景切换时的画面帧。由此可以对场景切换时的游戏画面帧中的需要清晰显示的物体显示目标控件，以便于触发对目标物体的清晰显示，这是因为通常来说在进行场景切换时，目标物体更容易出现模糊的情况，则通过该方式可以在游戏画面帧包含需要清晰显示的目标物体，且游戏画面帧属于场景切换时的画面帧时，在游戏画面帧上显示目标物体对应的目标控件，从而实现针对目标物体的清晰显示，提升数据处理效率，并且提高游戏画面中的目标物体的清晰度。
可以理解的是，终端绘制得到的目标物体的三维模型可以不属于该游戏画面帧，针对该三维模型的缩放显示，不影响云端设备发送的游戏画面帧的显示情况，即在对目标物体的三维模型进行缩放显示时，所显示的游戏画面帧中的目标物体可以不随之变化。
在一些实施例中，在显示目标物体的三维模型时，还可以显示用于指示对该目标物体进行放大的放大控件，或者显示用于指示对该目标物体的进行缩小的缩小控件，或者同时显示放大控件以及缩小控件，从而可以通过针对三维模型的放大控件的触控操作触 发放大指令，或通过三维模型的缩小控件的触控操作触发缩小指令。例如，当用户点击放大控件时，可以对三维模型按照一定放大比例进行放大显示；当用户点击缩小控件时，可以对三维模型按照一定缩小比例进行缩小显示。
在一些实施例中，该缩放显示还可以通过手势操作来控制，如双指距离放大(触发放大指令)或双指距离缩小(触发缩小指令)等等。
在一些实施例中，该缩放显示还可以通过键鼠操作来控制，如可以为按住目标按键的同时滑动鼠标滚轮实现对所显示的三维模型的缩放显示。
可以理解的是，由于该缩放显示针对的是目标物体的三维模型，而不是由云端设备发送的游戏画面帧中的物体，则在对目标物体进行缩放显示时，目标物体的三维模型不会变得模糊，以此可以保证目标物体的清晰度。
在一些实施例中，三维模型(三维模型)的绘制是有摄像头位置和旋转方向的，也就是可以对三维模型进行平移，缩放和旋转，通常来说，终端将基于针对三维模型的旋转操作(比如鼠标左右移动)生成用户操作事件传到云端设备，云端设备可以调用图形绘制接口如Direct3D(一种图形绘制接口)、OpenGL(一种图形绘制接口)更新三维模型要绘制的角度信息，如角度信息矩阵。本申请实施例，在显示该三维模型时，终端可以基于针对该三维模型的旋转操作(如鼠标左右移动)，更新三维模型要绘制的角度信息，从而绘制并显示旋转后的三维模型。
此处结合图示对该云游戏的数据处理过程进行阐述，请参见图8，图8是本申请实施例提供的云游戏的数据处理过程的示意图。例如，首先可以通过服务器(如图8中的801所示)接收来自终端的用户操作事件，针对不同平台的用户可以采用不同的服务器进行数据处理，如针对端游可以采用Windows(一种操作系统)服务器进行处理，针对手游可以采用Linux(一种操作系统)服务器运行Android(一种操作系统)容器进行数据处理；进而服务器可以通过对应平台的图形绘制接口(如图8中的802所示)，调用对应图形处理器GPU(如图8中的803所示)进行图像绘制，得到游戏画面帧(如图8中的804所示)，例如针对端游可以采用Direct3D绘制接口进行绘制，针对手游可以采用OpenGL绘制接口进行绘制。然后对游戏画面帧进行视频压缩(如图8中的805所示)，以便于将压缩后的游戏画面帧(即压缩视频数据)发送至终端。
在云端设备中，可以预先截取图形绘制接口的数据得到云游戏过程中需要清晰显示的至少一个物体的模型数据(如图8中的806所示)，并且可以截取到用于绘制三维模型的指示信息(如图8中的807所示)，从而对截取到的指示信息进行指令中转(如图8中的808所示)，以得到通用格式的指示信息，进而将截取的至少一个物体的模型数据和指示信息发送至终端。终端在接收到云端设备发送的至少一个物体的模型数据和指示信息，可以分别进行模型数据存储(如图8中的809所示)和指示信息翻译(如图8中的810所示)。其中模型数据的存储可以为每个物体的物体标识与对应的模型数据关联存储。指示信息翻译用于指示将云端设备发送的通用格式的指示信息，翻译为适配于云游戏的指示信息，也就是对云端设备发送的通用格式的指示信息进行格式转换。
进而终端在接收到云端设备发送的压缩视频数据时，可以对该压缩视频数据进行视频解压(如图8中的811所示)，得到待显示的游戏画面帧。终端可以显示该游戏画面帧，并且通过目标控件管理组件(如图8中的812所示)，在显示游戏画面帧时显示需要清晰显示的物体的所对应的目标控件，进而在响应于针对目标控件的触发操作，根据适配于云游戏的指示信息(如图8中的813所示)绘制目标物体的三维模型，进而显示游戏画面(如图8中的814所示)，该游戏画面中的目标物体的清晰度得到了一定程度的提升，有助于提升游戏体验。
采用本申请实施例，在云游戏的游戏过程中，获取云游戏的云端设备发送的显示数 据，从而显示该显示数据中包含的游戏画面帧，并在游戏画面帧上显示目标物体的目标控件，当接收到针对目标控件的触发操作时，则响应于针对目标控件的触发操作，基于显示数据中包含的目标物体在游戏画面帧中的第一位置，在显示的游戏画面帧上绘制目标物体。由此，相较于相关技术中仅基于云端设备发送的视频流进行游戏画面显示，本申请实施例中在显示云游戏的游戏画面帧时，针对游戏画面帧中的目标物体，能够绘制目标物体来显示，所绘制的目标物体的清晰度是高于云端设备发送的游戏画面帧中的目标物体的清晰度的，由此提高了云游戏的游戏画面的显示清晰度。
请参见图9，图9是本申请实施例提供的云游戏的数据处理装置的结构示意图。在一些实施例中，该云游戏的数据处理装置可以设置于上述电子设备中。如图9所示，本申请实施例中所描述的云游戏的数据处理装置可以包括：获取单元901，配置为在云游戏的游戏过程中，获取所述云游戏的云端设备发送的显示数据；所述显示数据包含待显示的游戏画面帧、及所述游戏画面帧中目标物体在所述游戏画面帧中的第一位置；显示单元902，配置为显示所述游戏画面帧，并在显示的所述游戏画面帧上显示所述目标物体的目标控件；处理单元903，配置为响应于针对所述目标控件的触发操作，基于所述第一位置，在显示的所述游戏画面帧上绘制所述目标物体。
在一种实现方式中，所述显示单元902还配置为在显示的所述游戏画面帧上所述第一位置关联的第二位置处，显示所述目标物体的目标控件。
在一种实现方式中，所述处理单元903，还配置为确定显示的所述游戏画面帧上、与所述第一位置关联的第三位置；在显示的所述游戏画面帧上的所述第三位置处绘制所述目标物体。
在一种实现方式中，所述处理单元903，还配置为在显示的所述游戏画面帧上绘制所述目标物体的三维模型。
在一种实现方式中，所述处理单元903，还配置为获取用于绘制所述三维模型的指示信息；按照所述指示信息的指示，在显示的所述游戏画面帧上绘制所述目标物体的三维模型。
在一种实现方式中，所述处理单元903，还配置为按照所述指示信息的指示，获取所述目标物体的模型数据；按照所述指示信息的指示，根据所述目标物体的模型数据，在显示的所述游戏画面帧上绘制所述目标物体的三维模型。
在一种实现方式中，所述目标物体的模型数据包含所述目标物体的模型关键点及纹理图像；所述处理单元903，还配置为按照所述指示信息的指示，基于所述目标物体的模型关键点构建所述目标物体的模型三角面；按照所述指示信息的指示，在构建的所述目标物体的模型三角面上绘制所述纹理图像，得到绘制的所述目标物体的三维模型；在显示的所述游戏画面帧上显示所述目标物体的三维模型。
在一种实现方式中，所述处理单元903，还配置为向所述云端设备拉取用于绘制所述三维模型的初始指示信息；对所述初始指示信息进行格式转换，得到所述云游戏适配的所述指示信息，并存储所述指示信息；所述获取单元901，还配置为获取存储的所述指示信息。
在一种实现方式中，处理单元所述903，还配置为向所述云端设备拉取所述云游戏中至少一个物体的模型数据和所述至少一个物体的物体标识，所述物体的模型数据用于绘制所述物体的三维模型；分别对所述至少一个物体中每个物体的物体标识和模型数据进行关联存储。
在一种实现方式中，所述显示数据包含所述目标物体的物体标识；所述处理单元903，还配置为响应于针对所述目标控件的触发操作，获取与所述目标物体的物体标识关联存 储的模型数据；基于获取的模型数据，在显示的所述游戏画面帧上绘制所述目标物体的三维模型。
在一种实现方式中，所述处理单元903，还配置为响应于针对绘制的所述目标物体的目标指令，对绘制的所述目标物体进行所述目标指令所指示的操作，所述目标指令为放大指令和缩小指令中之一；
在一种实现方式中，所述目标物体所在的所述游戏画面帧属于所述游戏过程中进行场景切换时的画面帧。
请参见图10，图10是本申请实施例提供的电子设备的结构示意图。本实施例中所描述的电子设备，包括：处理器1001、存储器1002。例如，该电子设备还可包括网络接口或供电模块等结构。上述处理器1001、存储器1002之间可以交互数据。
上述处理器1001可以是中央处理单元(Central Processing Unit，CPU)，该处理器还可以是其他通用处理器、数字信号处理器(Digital Signal Processor，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现成可编程门阵列(Field-Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。
上述网络接口可以包括输入设备和/或输出设备，例如该输入设备是可以是控制面板、麦克风、接收器等，输出设备可以是显示屏、发送器等，此处不一一列举。
上述存储器1002可以包括只读存储器和随机存取存储器，并向处理器1001提供计算机程序和数据。存储器1002的一部分还可以包括非易失性随机存取存储器。其中，处理器1001配置为调用计算机程序执行：在云游戏的游戏过程中，获取所述云游戏的云端设备发送的显示数据；所述显示数据包含待显示的游戏画面帧、及所述游戏画面帧中目标物体在所述游戏画面帧中的第一位置；显示所述游戏画面帧，并在显示的所述游戏画面帧上显示所述目标物体的目标控件；响应于针对所述目标控件的触发操作，基于所述第一位置，在显示的所述游戏画面帧上绘制所述目标物体。
在一种实现方式中，处理器1001，还配置为调用计算机程序执行：在显示的所述游戏画面帧上所述第一位置关联的第二位置处，显示所述目标物体的目标控件。
在一种实现方式中，处理器1001，还配置为调用计算机程序执行：确定显示的所述游戏画面帧上、与所述第一位置关联的第三位置；在显示的所述游戏画面帧上的所述第三位置处绘制所述目标物体。
在一种实现方式中，处理器1001，还配置为调用计算机程序执行：在显示的所述游戏画面帧上绘制所述目标物体的三维模型。
在一种实现方式中，处理器1001，还配置为调用计算机程序执行：获取用于绘制所述三维模型的指示信息；按照所述指示信息的指示，在显示的所述游戏画面帧上绘制所述目标物体的三维模型。
在一种实现方式中，处理器1001，还配置为调用计算机程序执行：按照所述指示信息的指示，获取所述目标物体的模型数据；按照所述指示信息的指示，根据所述目标物体的模型数据，在显示的所述游戏画面帧上绘制所述目标物体的三维模型。
在一种实现方式中，所述目标物体的模型数据包含所述目标物体的模型关键点及纹理图像；处理器1001，还配置为调用计算机程序执行：按照所述指示信息的指示，基于所述目标物体的模型关键点构建所述目标物体的模型三角面；按照所述指示信息的指示，在构建的所述目标物体的模型三角面上绘制所述纹理图像，得到绘制的所述目标物体的三维模型；在显示的所述游戏画面帧上显示所述目标物体的三维模型。
在一种实现方式中，处理器1001，还配置为调用计算机程序执行：向所述云端设备 拉取用于绘制所述三维模型的初始指示信息；对所述初始指示信息进行格式转换，得到所述云游戏适配的所述指示信息，并存储所述指示信息；处理器1001，还配置为获取存储的所述指示信息。
在一种实现方式中，处理器1001，还配置为调用计算机程序执行：向所述云端设备拉取所述云游戏中至少一个物体的模型数据和所述至少一个物体的物体标识，所述物体的模型数据用于绘制所述物体的三维模型；分别对所述至少一个物体中每个物体的物体标识和模型数据进行关联存储。
在一种实现方式中，所述显示数据包含所述目标物体的物体标识；处理器1001，还配置为调用计算机程序执行：响应于针对所述目标控件的触发操作，获取与所述目标物体的物体标识关联存储的模型数据；基于获取的模型数据，在显示的所述游戏画面帧上绘制所述目标物体的三维模型。
在一种实现方式中，处理器1001，还配置为调用计算机程序执行：响应于针对绘制的所述目标物体的目标指令，对绘制的所述目标物体进行所述目标指令所指示的操作，所述目标指令为放大指令和缩小指令中之一。
在一种实现方式中，所述目标物体所在的所述游戏画面帧属于所述游戏过程中进行场景切换时的画面帧。
在一些实施例中，该计算机程序被处理器执行时还可实现上述实施例中方法的其他步骤，这里不再赘述。
本申请实施例还提供了一种计算机可读存储介质，所述计算机可读存储介质存储有计算机程序，所述计算机程序被处理器执行时，实现本申请实施例提供的方法，此处不赘述。
在一些实施例中，本申请实施例涉及的计算机可读存储介质可以是非易失性的，也可以是易失性的。
在一些实施例中，该计算机可读存储介质可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序等；存储数据区可存储根据区块链节点的使用所创建的数据等。其中，本申请所指区块链是分布式数据存储、点对点传输、共识机制、加密算法等计算机技术的新型应用模式。区块链(Blockchain)，本质上是一个去中心化的数据库，是一串使用密码学方法相关联产生的数据块，每一个数据块中包含了一批次网络交易的信息，用于验证其信息的有效性(防伪)和生成下一个区块。区块链可以包括区块链底层平台、平台产品服务层以及应用服务层等。
需要说明的是，对于前述的各个方法实施例，为了简单描述，故将其都表述为一系列的动作组合，但是本领域技术人员应该知悉，本申请并不受所描述的动作顺序的限制，因为依据本申请，某一些步骤可以采用其他顺序或者同时进行。其次，本领域技术人员也应该知悉，说明书中所描述的实施例均属于优选实施例，所涉及的动作和模块并不一定是本申请所必须的。
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过计算机程序来指令相关的硬件来完成，该计算机程序可以存储于一计算机可读存储介质中，计算机可读存储介质可以包括：闪存盘、只读存储器(Read-Only Memory，ROM)、随机存取器(Random Access Memory，RAM)、磁盘或光盘等。
本申请实施例还提供了一种计算机程序产品或计算机程序，该计算机程序产品或计算机程序包括计算机可执行指令，该计算机可执行指令被处理器执行时可实现本申请实施例提供的方法中的部分或全部步骤。例如，该计算机可执行指令存储在计算机可读存储介质中。计算机设备(即上述的电子设备)的处理器从计算机可读存储介质读取该计算机可执行指令，处理器执行该计算机可执行指令，使得该计算机设备执行上述各方法 的实施例中所执行的步骤。例如，该计算机设备可以为终端，或者可以为服务器。
以上对本申请实施例所提供的云游戏的数据处理方法、装置、电子设备、计算机可读存储介质及计算机程序产品进行了详细介绍，本文中应用了具体个例对本申请的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本申请的方法及其核心思想；同时，对于本领域的一般技术人员，依据本申请的思想，在具体实施方式及应用范围上均会有改变之处，综上所述，本说明书内容不应理解为对本申请的限制。

Claims (16)

  1. 一种云游戏的数据处理方法，所述方法由电子设备执行，所述方法包括：
    在云游戏的游戏过程中，获取所述云游戏的云端设备发送的显示数据；所述显示数据包含待显示的游戏画面帧、及所述游戏画面帧中目标物体在所述游戏画面帧中的第一位置；
    显示所述游戏画面帧，并在显示的所述游戏画面帧上显示所述目标物体的目标控件；
    响应于针对所述目标控件的触发操作，基于所述第一位置，在显示的所述游戏画面帧上绘制所述目标物体。
  2. 根据权利要求1所述的方法，其中，所述在显示的所述游戏画面帧上显示所述目标物体的目标控件，包括：
    在显示的所述游戏画面帧上所述第一位置关联的第二位置处，显示所述目标物体的目标控件。
  3. 根据权利要求1-2任一项所述的方法，其中，所述基于所述第一位置，在显示的所述游戏画面帧上绘制所述目标物体，包括：
    确定显示的所述游戏画面帧上、与所述第一位置关联的第三位置；
    在显示的所述游戏画面帧上的所述第三位置处绘制所述目标物体。
  4. 根据权利要求1-3任一项所述的方法，其中，所述在显示的所述游戏画面帧上绘制所述目标物体，包括：
    在显示的所述游戏画面帧上绘制所述目标物体的三维模型。
  5. 根据权利要求4所述的方法，其中，所述在显示的所述游戏画面帧上绘制所述目标物体的三维模型，包括：
    获取用于绘制所述三维模型的指示信息；
    按照所述指示信息的指示，在显示的所述游戏画面帧上绘制所述目标物体的三维模型。
  6. 根据权利要求5所述的方法，其中，所述按照所述指示信息的指示，在显示的所述游戏画面帧上绘制所述目标物体的三维模型，包括：
    按照所述指示信息的指示，获取所述目标物体的模型数据；
    按照所述指示信息的指示，根据所述目标物体的模型数据，在显示的所述游戏画面帧上绘制所述目标物体的三维模型。
  7. 根据权利要求6所述的方法，其中，所述目标物体的模型数据包含所述目标物体的模型关键点及纹理图像；
    所述按照所述指示信息的指示，根据所述目标物体的模型数据，在显示的所述游戏画面帧上绘制所述目标物体的三维模型，包括：
    按照所述指示信息的指示，基于所述目标物体的模型关键点构建所述目标物体的模型三角面；
    按照所述指示信息的指示，在构建的所述目标物体的模型三角面上绘制所述纹理图像，得到绘制的所述目标物体的三维模型；
    在显示的所述游戏画面帧上显示所述目标物体的三维模型。
  8. 根据权利要求5所述的方法，其中，所述获取用于绘制所述三维模型的指示信息之前，所述方法还包括：
    向所述云端设备拉取用于绘制所述三维模型的初始指示信息；
    对所述初始指示信息进行格式转换，得到所述云游戏适配的所述指示信息，并存储所述指示信息；
    所述获取用于绘制所述三维模型的指示信息，包括：
    获取存储的所述指示信息。
  9. 根据权利要求1-8任一项所述的方法，其中，所述方法还包括：
    向所述云端设备拉取所述云游戏中至少一个物体的模型数据和所述至少一个物体的物体标识，所述物体的模型数据用于绘制所述物体的三维模型；
    分别对所述至少一个物体中每个物体的物体标识和模型数据进行关联存储。
  10. 根据权利要求9所述的方法，其中，所述显示数据包含所述目标物体的物体标识；所述响应于针对所述目标控件的触发操作，在显示的所述游戏画面帧上绘制所述目标物体，包括：
    响应于针对所述目标控件的触发操作，获取与所述目标物体的物体标识关联存储的模型数据；
    基于获取的模型数据，在显示的所述游戏画面帧上绘制所述目标物体的三维模型。
  11. 根据权利要求1-10任一项所述的方法，其中，所述方法还包括：
    响应于针对绘制的所述目标物体的目标指令，对绘制的所述目标物体进行所述目标指令所指示的操作，所述目标指令为放大指令和缩小指令中之一。
  12. 根据权利要求1-11任一项所述的方法，其中，所述目标物体所在的所述游戏画面帧属于所述游戏过程中进行场景切换时的画面帧。
  13. 一种数据处理装置，所述装置包括：
    获取单元，配置为在云游戏的游戏过程中，获取所述云游戏的云端设备发送的显示数据；所述显示数据包含待显示的游戏画面帧、及所述游戏画面帧中目标物体在所述游戏画面帧中的第一位置；
    显示单元，配置为显示所述游戏画面帧，并在显示的所述游戏画面帧上显示所述目标物体的目标控件；
    处理单元，配置为响应于针对所述目标控件的触发操作，基于所述第一位置，在显示的所述游戏画面帧上绘制所述目标物体。
  14. 一种电子设备，包括处理器、存储器，其中，所述存储器配置为存储计算机程序，所述处理器配置为执行所述存储器中存储的计算机程序时，执行如权利要求1-12任一项所述的方法。
  15. 一种计算机可读存储介质，所述计算机可读存储介质存储有计算机程序，所述计算机程序被处理器执行时，使所述处理器执行如权利要求1-12任一项所述的方法。
  16. 一种计算机程序产品，包括计算机可执行指令，所述计算机可执行指令被处理器执行时，实现如权利要求1-12任一项所述的方法。
PCT/CN2023/119521 2022-10-18 2023-09-18 云游戏的数据处理方法、装置、电子设备、计算机可读存储介质及计算机程序产品 WO2024082901A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US18/584,546 US20240189713A1 (en) 2022-10-18 2024-02-22 Cloud Gaming Image Processing and Streaming Methods and Systems

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211277162.0 2022-10-18
CN202211277162.0A CN116966545A (zh) 2022-10-18 2022-10-18 云游戏的数据处理方法、相关设备、介质及程序产品

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/584,546 Continuation US20240189713A1 (en) 2022-10-18 2024-02-22 Cloud Gaming Image Processing and Streaming Methods and Systems

Publications (1)

Publication Number Publication Date
WO2024082901A1 true WO2024082901A1 (zh) 2024-04-25

Family

ID=88478397

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/119521 WO2024082901A1 (zh) 2022-10-18 2023-09-18 云游戏的数据处理方法、装置、电子设备、计算机可读存储介质及计算机程序产品

Country Status (3)

Country Link
US (1) US20240189713A1 (zh)
CN (1) CN116966545A (zh)
WO (1) WO2024082901A1 (zh)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111773721A (zh) * 2020-08-10 2020-10-16 网易（杭州）网络有限公司 游戏中的画面显示方法及装置、电子设备、存储介质
CN113559518A (zh) * 2021-07-30 2021-10-29 网易（杭州）网络有限公司 虚拟模型的交互检测方法、装置、电子设备及存储介质
CN113827969A (zh) * 2021-09-27 2021-12-24 网易（杭州）网络有限公司 一种游戏对象的交互方法和装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111773721A (zh) * 2020-08-10 2020-10-16 网易（杭州）网络有限公司 游戏中的画面显示方法及装置、电子设备、存储介质
CN113559518A (zh) * 2021-07-30 2021-10-29 网易（杭州）网络有限公司 虚拟模型的交互检测方法、装置、电子设备及存储介质
CN113827969A (zh) * 2021-09-27 2021-12-24 网易（杭州）网络有限公司 一种游戏对象的交互方法和装置

Also Published As

Publication number Publication date
CN116966545A (zh) 2023-10-31
US20240189713A1 (en) 2024-06-13

Similar Documents

Publication Publication Date Title
CN107145355B (zh) 页面布局的调整方法及装置、存储介质、处理器和终端
CN113244614B (zh) 图像画面展示方法、装置、设备及存储介质
JP2024505995A (ja) 特殊効果展示方法、装置、機器および媒体
CN113126862B (zh) 截屏方法、装置、电子设备以及可读存储介质
CN106843794B (zh) 一种基于安卓的分屏显示方法和系统
CN111467790A (zh) 目标对象的控制方法及装置、系统
RU2768526C2 (ru) Реальное присутствие рукописного ввода для сотрудничества в реальном времени
CN111467791A (zh) 目标对象的控制方法及装置、系统
CN111142967B (zh) 一种增强现实显示的方法、装置、电子设备和存储介质
CN114570020A (zh) 数据处理方法以及系统
WO2024067320A1 (zh) 虚拟物体的渲染方法、装置、设备及存储介质
CN109064537A (zh) 基于3d渲染引擎的图像生成方法以及装置
WO2024082901A1 (zh) 云游戏的数据处理方法、装置、电子设备、计算机可读存储介质及计算机程序产品
CN112565883A (zh) 一种用于虚拟现实场景的视频渲染处理系统和计算机设备
CN114067035A (zh) 渲染控制方法、设备以及系统
CN107615229B (zh) 用户界面装置和用户界面装置的画面显示方法
CN114863008B (zh) 图像处理方法、装置、电子设备及存储介质
CN103870971B (zh) 一种基于移动平台的构建三维网站的方法及其系统
CN114449355B (zh) 一种直播互动的方法、装置、设备及存储介质
US11910068B2 (en) Panoramic render of 3D video
CN113836455A (zh) 特效渲染方法、装置、设备、存储介质及计算机程序产品
CN115705668A (zh) 一种视图绘制的方法、装置及存储介质
CN115373558A (zh) 投屏方法、装置、设备及存储介质
CN110941389A (zh) 一种焦点触发ar信息点的方法及装置
CN113034653A (zh) 一种动画渲染方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23878895

Country of ref document: EP

Kind code of ref document: A1