CN111544886B - Picture display method and related device - Google Patents

Picture display method and related device Download PDF

Info

Publication number
CN111544886B
CN111544886B CN202010362392.1A CN202010362392A CN111544886B CN 111544886 B CN111544886 B CN 111544886B CN 202010362392 A CN202010362392 A CN 202010362392A CN 111544886 B CN111544886 B CN 111544886B
Authority
CN
China
Prior art keywords
resolution
terminal
aspect ratio
rendering
game
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010362392.1A
Other languages
Chinese (zh)
Other versions
CN111544886A (en
Inventor
龚志鹏
许敏华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN202010362392.1A priority Critical patent/CN111544886B/en
Publication of CN111544886A publication Critical patent/CN111544886A/en
Application granted granted Critical
Publication of CN111544886B publication Critical patent/CN111544886B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/52Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/31Communication aspects specific to video games, e.g. between several handheld game devices at close range

Abstract

The application discloses a picture display method and a related device, which can be applied to cloud game scenes. Obtaining the resolution of the terminal; then, determining rendering parameters according to the corresponding relation between the terminal resolution and the initial resolution; further rendering according to the rendering parameters to obtain a game rendering picture; coding operation is carried out on the game rendering picture to obtain coded data; and further transmitting the encoded data to the terminal equipment, so that the terminal equipment decodes the encoded data to obtain a game rendering picture. Therefore, the picture display in the cloud service process is realized, and the cloud service equipment can be realized without configuring a large number of matching processes due to the adoption of a dynamic matching mode, so that the system resources of the cloud service are saved, and the picture display accuracy of the terminal equipment is ensured.

Description

Picture display method and related device
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method for displaying a screen and a related apparatus.
Background
With the development of cloud technology, more and more cloud applications are emerging in people's lives. In a cloud game scene, a game runs in a virtual machine/container at a server end, a game picture is captured and sent to an encoder for encoding, then the encoded game picture is transmitted to a client end through a network, and then the encoded game picture is decoded, rendered and displayed, so that the running of a cloud game is realized; however, in this process, the resolution of the virtual screen in the virtual machine/container and the resolution of the mobile phone are often inconsistent, which may cause display errors.
Generally, in order to ensure the adaptability of screen display in the running process of cloud applications, a certain number of virtual machines/containers with various resolution ratios can be pulled up in advance at a server, and then the virtual machines/containers are distributed to corresponding virtual machines/containers according to the resolution ratios to play games when a mobile phone client is connected, so that the occurrence of display errors is improved.
However, as the resolution ratio of the mobile phone is large, a plurality of virtual machines/containers need to be pulled up, if corresponding virtual processes are configured one by one, resource waste of the cloud server is caused, and for the resolution ratio of the mobile phone which is not recorded, the situation of display mismatch is easy to occur, and the accuracy of picture display is affected.
Disclosure of Invention
In view of this, the present application provides a method for displaying a picture, which can effectively improve the accuracy of a picture displaying process and save system resources of a cloud service device.
A first aspect of the present application provides a method for displaying a picture, which may be applied to a system or a program including a picture display function in a cloud service device, and specifically includes: acquiring terminal resolution, wherein the terminal resolution is obtained based on terminal equipment configuration;
determining rendering parameters according to the corresponding relation between the terminal resolution and an initial resolution, wherein the initial resolution is used for indicating the resolution of a virtual screen for running a game, and the rendering parameters are used for indicating the change condition of the initial resolution based on the terminal resolution;
rendering according to the rendering parameters to obtain a game rendering picture;
performing encoding operation on the game rendering picture to obtain encoded data;
and transmitting the coded data to the terminal equipment, so that the terminal equipment decodes the coded data to obtain the game rendering picture.
Optionally, in some possible implementation manners of the present application, the determining a rendering parameter according to a correspondence between the terminal resolution and the initial resolution includes:
determining a first aspect ratio of the initial resolution and a second aspect ratio of the terminal resolution;
determining a change edge according to a magnitude relation between the first aspect ratio and the second aspect ratio to obtain the rendering parameter, where the change edge is used to indicate that an interface corresponding to the initial resolution is more redundant than an interface corresponding to the display resolution.
Optionally, in some possible implementation manners of the present application, the determining a change edge according to a magnitude relationship between the first aspect ratio and the second aspect ratio to obtain the rendering parameter includes:
if the first aspect ratio is larger than the second aspect ratio, determining the wide side as the change side;
and determining the rendering parameters according to the corresponding high side and the change side in the first aspect ratio.
Optionally, in some possible implementation manners of the present application, the determining a change edge according to a magnitude relationship between the first aspect ratio and the second aspect ratio to obtain the rendering parameter includes:
if the first aspect ratio is smaller than the second aspect ratio, determining the long side as the change side;
and determining the rendering parameters according to the corresponding broadside and the change side in the first aspect ratio.
Optionally, in some possible implementations of the present application, the encoding the game rendering picture to obtain encoded data includes:
acquiring a display interface range corresponding to the virtual screen;
cutting the display interface range according to the game rendering picture;
and carrying out coding operation on the picture corresponding to the cut display interface range to obtain the coded data.
Optionally, in some possible implementations of the present application, the encoding the game rendering picture to obtain encoded data includes:
capturing interface display content corresponding to the game rendering picture;
and carrying out coding operation according to the interface display content to obtain the coded data.
Optionally, in some possible implementation manners of the present application, the obtaining the resolution of the terminal includes:
acquiring an application data packet sent by the terminal;
determining an application identifier according to the application data packet;
determining a corresponding application virtual machine according to the application identifier;
and analyzing the application data packet based on the application virtual machine to obtain the resolution of the terminal.
Optionally, in some possible implementation manners of the present application, the determining, according to the application identifier, a corresponding application virtual machine includes:
determining a plurality of corresponding candidate virtual machines according to the application identifiers;
and determining the application virtual machine according to the load information of the candidate virtual machine.
Optionally, in some possible implementations of the present application, the method further includes:
recording a terminal identifier corresponding to the terminal;
and configuring the corresponding relation between the terminal identification and the coded data to obtain a call table, wherein the call table is used for indicating the interface display of the terminal.
Optionally, in some possible implementation manners of the present application, the configuring a corresponding relationship between the terminal identifier and the encoded data to obtain a call table includes:
determining a target application operated by the terminal;
updating the terminal identification according to the target application;
and configuring the corresponding relation between the updated terminal identification and the encoded data to obtain the call list.
A second aspect of the present application provides an image display apparatus comprising: the terminal comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring terminal resolution, and the terminal resolution is obtained based on terminal equipment configuration;
a determining unit, configured to determine a rendering parameter according to a corresponding relationship between the terminal resolution and an initial resolution, where the initial resolution is used to indicate a resolution of a virtual screen on which a game is running, and the rendering parameter is used to indicate a change condition of the initial resolution with the terminal resolution as a reference;
the rendering unit is used for rendering according to the rendering parameters to obtain a game rendering picture;
the encoding unit is used for performing encoding operation on the game rendering picture to obtain encoded data;
and the transmission unit is used for transmitting the coded data to the terminal equipment so that the terminal equipment decodes the coded data to obtain the game rendering picture.
Optionally, in some possible implementations of the present application, the determining unit is specifically configured to determine a first aspect ratio of the initial resolution and a second aspect ratio of the terminal resolution;
the determining unit is specifically configured to determine a changing edge according to a magnitude relationship between the first aspect ratio and the second aspect ratio to obtain the rendering parameter, where the changing edge is used to indicate an excess portion of the interface corresponding to the initial resolution compared with the interface corresponding to the display resolution.
Optionally, in some possible implementation manners of the present application, the determining unit is specifically configured to determine that the wide side is the changed side if the first aspect ratio is greater than the second aspect ratio;
the determining unit is specifically configured to determine the rendering parameter according to a corresponding high side and the changed side in the first aspect ratio.
Optionally, in some possible implementation manners of the present application, the determining unit is specifically configured to determine that the long side is the changed side if the first aspect ratio is smaller than the second aspect ratio;
the determining unit is specifically configured to determine the rendering parameter according to the corresponding width side and the change side in the first aspect ratio.
Optionally, in some possible implementation manners of the present application, the encoding unit is specifically configured to obtain a display interface range corresponding to the virtual screen;
the encoding unit is specifically used for cutting the display interface range according to the game rendering picture;
the encoding unit is specifically configured to perform an encoding operation on the picture corresponding to the cut display interface range to obtain the encoded data.
Optionally, in some possible implementation manners of the present application, the encoding unit is specifically configured to capture interface display content corresponding to the game rendering picture;
the encoding unit is specifically configured to perform an encoding operation according to the interface display content to obtain the encoded data.
Optionally, in some possible implementation manners of the present application, the obtaining unit is specifically configured to obtain an application data packet sent by the terminal;
the obtaining unit is specifically configured to determine an application identifier according to the application data packet;
the obtaining unit is specifically configured to determine a corresponding application virtual machine according to the application identifier;
the obtaining unit is specifically configured to analyze the application data packet based on the application virtual machine to obtain the resolution of the terminal.
Optionally, in some possible implementation manners of the present application, the obtaining unit is specifically configured to determine, according to the application identifier, a plurality of corresponding candidate virtual machines;
the obtaining unit is specifically configured to determine the application virtual machine according to the load information of the candidate virtual machine.
Optionally, in some possible implementation manners of the present application, the obtaining unit is specifically configured to record a terminal identifier corresponding to the terminal;
the obtaining unit is specifically configured to configure a corresponding relationship between the terminal identifier and the encoded data to obtain a call table, where the call table is used to indicate interface display of the terminal.
Optionally, in some possible implementation manners of the present application, the obtaining unit is specifically configured to determine a target application run by the terminal;
the obtaining unit is specifically configured to update the terminal identifier according to the target application;
the obtaining unit is specifically configured to configure a corresponding relationship between the updated terminal identifier and the encoded data, so as to obtain the call table.
A third aspect of the present application provides a method for displaying a screen, including: responding to an operation instruction to obtain the resolution of the terminal;
sending the terminal resolution to cloud service equipment;
receiving encoded data sent by the cloud service equipment, wherein the encoded data are used for indicating a game rendering picture rendered by the cloud service equipment based on rendering parameters, the rendering parameters are used for indicating a change condition of an initial resolution with the terminal resolution as a reference, and the initial resolution is used for indicating the resolution of a virtual screen of a game run by the cloud service equipment;
decoding the coded data to obtain the game rendering picture;
and adjusting the game rendering picture based on a screen interface corresponding to the resolution of the terminal so as to display the game.
A fourth aspect of the present application provides an image display device, comprising: an acquisition unit configured to acquire a terminal resolution in response to an operation instruction;
a sending unit, configured to send the terminal resolution to a cloud service device;
a receiving unit, configured to receive encoded data sent by the cloud service device, where the encoded data is used to indicate a game rendering picture rendered by the cloud service device based on a rendering parameter, the rendering parameter is used to indicate a change condition of an initial resolution based on the terminal resolution, and the initial resolution is used to indicate a resolution of a virtual screen on which the cloud service device runs a game;
the decoding unit is used for decoding the coded data to obtain the game rendering picture;
and the display unit is used for adjusting the game rendering picture based on the screen interface corresponding to the resolution of the terminal so as to display the game.
A fifth aspect of the present application provides a computer device comprising: a memory, a processor, and a bus system; the memory is used for storing program codes; the processor is configured to execute the method for displaying a screen according to any one of the first aspect or the first aspect, or the method for displaying a screen according to the second aspect, according to instructions in the program code.
A sixth aspect of the present application provides a computer-readable storage medium, which stores instructions that, when executed on a computer, cause the computer to perform the method for screen display according to the first aspect or any one of the first aspects, or the method for screen display according to the second aspect.
According to the technical scheme, the embodiment of the application has the following advantages:
the terminal resolution is obtained by obtaining the terminal resolution, wherein the terminal resolution is obtained based on the configuration of the terminal equipment; then, determining rendering parameters according to the corresponding relation between the terminal resolution and the initial resolution, wherein the initial resolution is used for indicating the resolution of a virtual screen for running the game, and the rendering parameters are used for indicating the change condition of the initial resolution based on the terminal resolution; further rendering according to the rendering parameters to obtain a game rendering picture; coding operation is carried out on the game rendering picture to obtain coded data; and further transmitting the encoded data to the terminal equipment, so that the terminal equipment decodes the encoded data to obtain a game rendering picture. Therefore, the picture display in the cloud service process is realized, and the cloud service equipment can be realized without configuring a large number of matching processes due to the adoption of a dynamic matching mode, so that the system resources of the cloud service are saved, and the picture display accuracy of the terminal equipment is ensured.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a diagram of a network architecture for operation of a visual display system;
fig. 2 is a flowchart of a screen display according to an embodiment of the present disclosure;
fig. 3 is a flowchart of a method for displaying a frame according to an embodiment of the present disclosure;
fig. 4 is a scene schematic diagram of a method for displaying a picture according to an embodiment of the present disclosure;
fig. 5 is a schematic view of another scene of a method for displaying a picture according to an embodiment of the present application;
FIG. 6 is a flowchart of another method for displaying a frame according to an embodiment of the present disclosure;
fig. 7 is a scene schematic diagram of another method for displaying a picture according to an embodiment of the present application;
fig. 8 is a schematic structural diagram of an image display device according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of another image display device according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of a terminal device according to an embodiment of the present application.
Detailed Description
The embodiment of the application provides a picture display method and a related device, which can be applied to a system or a program containing a picture display function in terminal equipment, and the terminal resolution is obtained by acquiring the terminal resolution, wherein the terminal resolution is obtained based on the configuration of the terminal equipment; then, determining rendering parameters according to the corresponding relation between the terminal resolution and the initial resolution, wherein the initial resolution is used for indicating the resolution of a virtual screen for running the game, and the rendering parameters are used for indicating the change condition of the initial resolution based on the terminal resolution; further rendering according to the rendering parameters to obtain a game rendering picture; coding operation is carried out on the game rendering picture to obtain coded data; and further transmitting the encoded data to the terminal equipment, so that the terminal equipment decodes the encoded data to obtain a game rendering picture. Therefore, the picture display in the cloud service process is realized, and the cloud service equipment can be realized without configuring a large number of matching processes due to the adoption of a dynamic matching mode, so that the system resources of the cloud service are saved, and the picture display accuracy of the terminal equipment is ensured.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present application and in the drawings described above, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "corresponding" and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It should be understood that the picture display method provided by the present application may be applied to a system or program including functions in a terminal device, for example, a hand-trip resolution plug-in, specifically, the picture display system may operate in a network architecture as shown in fig. 1, which is a network architecture diagram of the picture display system, as can be seen from the figure, the picture display system may provide a picture display process with a plurality of information sources, the terminal device establishes a connection with a server through a network and sends resolution information of a running cloud application to the server, and the server performs a dynamic picture display process after receiving the resolution information sent by the terminal device, so as to obtain encoded data that can be uniformly distributed in the terminal device and send the encoded data to the terminal device; it will be appreciated that a variety of terminal devices are shown in fig. 1, for example: in an actual scene, there may be more or fewer types of terminal devices participating in the process of displaying a screen, and the specific number and types are determined according to the actual scene, which is not limited herein, and in addition, fig. 1 shows one server, but in the actual scene, there may also be participation of multiple servers, especially in a scene of multi-content application interaction, and the specific number of servers is determined according to the actual scene.
In this embodiment, the server may be an independent physical server, a server cluster or a distributed system formed by a plurality of physical servers, or a cloud server providing basic cloud computing services such as a cloud service, a cloud database, cloud computing, a cloud function, cloud storage, a network service, cloud communication, a middleware service, a domain name service, a security service, a CDN, a big data and artificial intelligence platform, and the like. The terminal may be, but is not limited to, a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, and the like. The terminal and the server may be directly or indirectly connected through wired or wireless communication, and the application is not limited herein.
It is understood that the above-mentioned screen display system may be operated in a personal mobile terminal, for example: the application, such as a hand-trip resolution plug-in, can also run on a server, and can also run on a third-party device to provide picture display so as to obtain a picture display processing result of an information source; the specific screen display system may be operated in the above-mentioned device in the form of a program, may also be operated as a system component in the above-mentioned device, and may also be used as one of cloud service programs, and the specific operation mode is determined by an actual scene, and is not limited herein.
With the development of cloud technology, more and more cloud applications are emerging in people's lives. In a cloud game scene, a game runs in a virtual machine/container at a server end, a game picture is captured and sent to an encoder for encoding, then the encoded game picture is transmitted to a client end through a network, and then the encoded game picture is decoded, rendered and displayed, so that the running of a cloud game is realized; however, in this process, the resolution of the virtual screen in the virtual machine/container and the resolution of the mobile phone are often inconsistent, which may cause display errors.
Cloud gaming (Cloud gaming), also known as game on demand (gaming), is an online gaming technology based on Cloud computing technology. Cloud game technology enables light-end devices (thin clients) with relatively limited graphics processing and data computing capabilities to run high-quality games. In a cloud game scene, a game is not operated in a player game terminal but in a cloud server, and the cloud server renders the game scene into a video and audio stream which is transmitted to the player game terminal through a network. The player game terminal does not need to have strong graphic operation and data processing capacity, and only needs to have basic streaming media playing capacity and capacity of acquiring player input instructions and sending the instructions to the cloud server.
Generally, in order to ensure the adaptability of the picture display during the running process of the cloud application, a certain number of virtual machines/containers with various resolution ratios can be pulled up in advance at the server, wherein the resolution here is the number of pixels displayed on a solid screen or a virtual screen, for example, the resolution of 160 × 128 means that the horizontal direction contains 160 pixels and the vertical direction contains 128 pixels. After the virtual machine is set, the virtual machine is distributed to the corresponding virtual machine/container according to the resolution ratio to play the game when the mobile phone client is connected, so that the situation of display errors is improved.
However, as the resolution ratio of the mobile phone is large, a plurality of virtual machines/containers need to be pulled up, and if corresponding virtual processes are configured one by one, resource waste of the server is caused; and the situation that the special resolution cannot be matched may occur, because the game picture needs to be stretched to fill the full screen after being transmitted to the mobile phone client, the stretching ratio is calculated according to the mobile phone resolution during stretching, and if the ratio is inconsistent, blank areas are caused. For example, the server game resolution is 720 × 1280(9:16), the mobile phone resolution is 1080 × 2160(9:18), the screen is enlarged to 1080 × 1920(9:16) at the mobile phone client side according to the resolution ratio (9:16), and due to the fact that the height of the enlarged screen is not consistent with the height of the mobile phone, that is, 2160 and 1920 are 240, blank areas are left on two sides of the screen, and the application range and accuracy of the screen display are affected.
In order to solve the above problem, the present application provides a method for displaying a picture, which is applied to a process framework of picture display shown in fig. 2, as shown in fig. 2, for a process framework of picture display provided in an embodiment of the present application, first, as shown in step (1), a terminal device sends a terminal resolution under a currently running cloud application to a server, then, as shown in step (2), a cloud service device performs resolution adjustment according to an initial resolution and a terminal resolution preset in a virtual machine of the cloud service device, so as to obtain a display resolution that can be adapted to an interface of the terminal device, further, as shown in step (3), coding processing is performed to obtain coded data, and as shown in step (4), the coded data is sent to the terminal device, so as to implement a picture display process in a cloud service.
It can be understood that the method provided by the present application may be a program written as a processing logic in a hardware system, or may be a screen display device, and the processing logic is implemented in an integrated or external manner. As an implementation manner, the image display apparatus obtains a terminal resolution, where the terminal resolution is obtained based on a terminal device configuration; then, determining rendering parameters according to the corresponding relation between the terminal resolution and the initial resolution, wherein the initial resolution is used for indicating the resolution of a virtual screen for running the game, and the rendering parameters are used for indicating the change condition of the initial resolution based on the terminal resolution; further rendering according to the rendering parameters to obtain a game rendering picture; coding operation is carried out on the game rendering picture to obtain coded data; and further transmitting the encoded data to the terminal equipment, so that the terminal equipment decodes the encoded data to obtain a game rendering picture. Therefore, the picture display in the cloud service process is realized, and the cloud service equipment can be realized without configuring a large number of matching processes due to the adoption of a dynamic matching mode, so that the system resources of the cloud service are saved, and the picture display accuracy of the terminal equipment is ensured.
With reference to the above flow architecture, the following introduces a method for displaying a screen in the present application, please refer to fig. 3, where fig. 3 is a flow chart of a method for displaying a screen provided in an embodiment of the present application, which can be applied to a cloud service device, and the embodiment of the present application at least includes the following steps:
301. and acquiring the resolution of the terminal.
In this embodiment, a virtual screen of a virtual machine that processes a target game in the cloud service device runs at an initial resolution, for example: the resolution of the operation in the virtual machine is 720 x 1280, and then the initial resolution is 720 x 1280; the terminal resolution is the resolution of the display interface of the target game in the terminal device, the resolution is configured correspondingly based on different terminal devices, and the terminal resolution is different from the initial resolution due to the difference of the terminal resolutions configured by different terminal devices, for example, the terminal resolutions corresponding to different types of terminal devices are different. When the display interface of the display content of the target game in the terminal device cannot be fully distributed on the screen of the terminal device or the interface area designated by the user, for example, the initial resolution is 720 x 1280(9:16), and the terminal resolution is 1080 x 2160(9:18), the screen at the terminal is enlarged to 1080 x 1920(9:16) according to the resolution ratio (9:16), and since the height of the enlarged screen is not consistent with the height of the mobile phone, that is, 2160-1920 is 240, blank areas are generated on both sides of the screen, at this time, the screen display method provided by the present embodiment can be performed.
Optionally, since the cloud service device may provide a picture display process of a plurality of different virtual machines, at this time, the cloud service device may determine the resolution according to the application identifier sent by the terminal device. Specifically, the cloud service device first obtains an application data packet sent by the terminal device, wherein the application data packet includes a name of a corresponding game, a resolution of a terminal screen interface and the like; the application identification is then determined from the application data packet, for example: the name, category, etc. of the game; further, the cloud service device determines a corresponding application virtual machine according to the application identifier, for example: if the application identifier indicates that the game type is a shooting game, distributing the picture display process corresponding to the application identifier to a virtual machine for processing the shooting game; after the corresponding virtual machine is determined, the application data packet can be analyzed based on the virtual machine, so that the subsequent resolution adjustment process is carried out. By adopting different virtual machines to process different game applications, the running smoothness of the virtual machines can be ensured, and the stability of subsequent resolution adjustment is improved.
Further, because the load imbalance exists in the different virtual machines corresponding to the same application, at this time, a plurality of corresponding virtual machines under the same application can be screened. Specifically, the cloud service equipment firstly determines a plurality of corresponding candidate virtual machines according to the application identifier; and then determining the application virtual machine according to the load information of the candidate virtual machine, for example: and screening the application virtual machines with idle loads. Therefore, the normal operation of the subsequent resolution adjustment process is ensured, and the running stability of the virtual machine is improved.
302. And determining rendering parameters according to the corresponding relation between the terminal resolution and the initial resolution.
In this embodiment, the rendering parameter is used to indicate a change condition of the initial resolution based on the terminal resolution, that is, the initial resolution is referred to the terminal resolution, and the resolution is adjusted to make an aspect ratio of the initial resolution and the terminal resolution consistent, where the aspect ratio is a ratio of the number of pixels of the resolution in the horizontal direction and the vertical direction.
Specifically, the process of referring the initial resolution to the terminal resolution may be performed based on the aspect ratio, that is, the initial resolution is adjusted to be the same as or similar to the terminal resolution. Firstly, the cloud service equipment determines a first aspect ratio of an initial resolution and a second aspect ratio of a terminal resolution; for example, assuming that the terminal resolution is Wphone Hphone and the initial resolution is Wscreen Hscreen, the first aspect ratio is ratio1, where ratio1 is Wscreen/Hscreen, and the second aspect ratio is ratio2, where ratio1 is Wphone/Hphone; due to the fact that the width sides and the long sides of the width-to-height ratios are not in proportion to each other, the changing sides can be determined according to the size relation between the first width-to-height ratio and the second width-to-height ratio, and accordingly rendering parameters are obtained, wherein the changing sides are used for indicating the redundant parts of the interface corresponding to the initial resolution ratio and the interface corresponding to the display resolution ratio.
In a possible scenario, as shown in fig. 4, a scenario diagram of a method for displaying a picture provided in an embodiment of the present application is shown; the figure indicates a scene with a variable side being a wide side, wherein the scene comprises a virtual interface a1 (initial resolution) corresponding to the cloud service equipment, a virtual interface a2 (terminal resolution) corresponding to the terminal equipment resolution, and an excess part A3 of the virtual interface corresponding to the cloud service equipment relative to the virtual interface corresponding to the terminal equipment resolution; specifically, in the scene, if the first aspect ratio is greater than the second aspect ratio, the broadside is determined to be a changed side; rendering parameters are then determined from the corresponding high and varying edges in the first aspect ratio. The rendering process related to the rendering parameters can be performed by referring to the following formula:
Wvideo=Hscreen*ratio2
Hvideo=Hscreen
wherein Wvideo is the resolution width after the initial resolution conversion, namely the width of the display resolution; hvideo is high resolution after the initial resolution is converted, namely high display resolution; hscreen is high in initial resolution; ratio2 is the aspect ratio of the terminal resolution; hscreen ratio2 indicates the amount of change of the change edge, i.e., the broadside.
In a possible scenario, as shown in fig. 5, a scenario diagram of another method for displaying a picture provided in the embodiment of the present application is shown; the figure indicates a scene with a change side as a long side, wherein the scene comprises a virtual interface B1 (initial resolution) corresponding to the cloud service equipment, a virtual interface B2 (terminal resolution) corresponding to the terminal equipment resolution, and an excess part B3 of the virtual interface corresponding to the cloud service equipment relative to the virtual interface corresponding to the terminal equipment resolution; specifically, if the first aspect ratio is smaller than the second aspect ratio, the cloud service device determines that the long edge is a changed edge; rendering parameters are then determined from the corresponding high and varying edges in the first aspect ratio. The rendering process related to the rendering parameters can be performed by referring to the following formula:
Wvideo=Wscreen
Hvideo=Wscreen/ratio2
wherein Wvideo is the resolution width after the initial resolution is transformed; hvideo is high resolution after the initial resolution is converted; wscreen is a box of initial resolution; ratio2 is the aspect ratio of the terminal resolution; wscreen ratio2 indicates the amount of change in the edge, i.e., the long edge.
It can be understood that, in the above two scenarios, the initial resolution is calculated after being aligned with reference to the terminal resolution, wherein a process of enlarging or reducing the initial resolution is designed, that is, the scenarios in which both of the above scenarios occur should also be included in the technical solution of the present application.
303. Rendering according to the rendering parameters to obtain a game rendering picture.
In this embodiment, the resolution of the game rendering picture is Wvideo × Hvideo; the process of configuring according to the rendering parameters, that is, the process of determining and transforming the rendering parameters in step 302, may specifically be implemented in the following code form:
Figure BDA0002475567330000131
further, the aspect ratio of the virtual interface of the cloud service device adjusted by the above calculation is:
Wvideo/Hvideo=ratio2
and obtaining the resolution of the game rendering picture as Wvideo Hvideo, so that the resolution of the virtual interface of the virtual machine is adjusted based on the resolution, and the game rendering picture is determined.
304. And carrying out encoding operation on the game rendering picture to obtain encoded data.
In this embodiment, the encoded data is interface display content data corresponding to the game rendering screen, so that the terminal device performs a decoding operation on the encoded data, thereby performing content playing of the cloud application.
Optionally, the determination process of the encoded data may be obtained by cutting based on interface content played by the cloud service device. Namely, the cloud service equipment determines the display interface range of the virtual screen corresponding to the virtual machine; and then cutting the interface display range according to the game rendering picture, namely cutting to obtain the display interface range containing the game rendering picture, or cutting to remove the display interface range not containing the game rendering picture, for example, cutting away blank area parts, thereby obtaining the coded data.
Correspondingly, the determination process of the coded data can also be performed based on the capture of the interface display content corresponding to the game rendering picture. Namely, the cloud service equipment captures interface display content corresponding to the game rendering picture; and then, coding operation is carried out according to the interface display content to obtain coded data, namely, a part containing the interface content corresponding to the game rendering picture is grabbed.
Optionally, because of the correspondence between the cloud service device and the terminal device, a terminal identifier corresponding to the terminal may also be recorded; configuring the corresponding relation between the terminal identification and the display resolution to obtain a call list; therefore, when the cloud service equipment receives the picture display request sent by the terminal equipment again, the table can be called directly, and then the display resolution ratio is called according to the terminal identification, so that the picture display efficiency is improved.
In addition, the call list can also record the target application operated by the terminal equipment and associate the target application with the terminal identifier, so that the terminal equipment can quickly acquire the coded data corresponding to the application when operating the target application, and the efficiency of picture display is improved.
305. And transmitting the encoded data to the terminal equipment, so that the terminal equipment decodes the encoded data to obtain a game rendering picture.
In this embodiment, the cloud service device transmits the encoded data to the terminal device. Specifically, the cloud service device may be a cloud server, or may be a set of one or more of a plurality of virtual machines or containers running in the cloud server; in addition, the cloud service provided by the cloud service device includes, but is not limited to, cloud games, cloud conferences, and other application scenarios requiring video adaptation. Further, in a cloud game scenario, the game applicable to this embodiment includes a game at a mobile phone end or a game at a computer end, or a game process in other terminal devices. For example, it is suitable for people in royal glory and hand games such as peace and elite; or crossing fire lines, end tours in underground cities and warriors, and the like.
It is understood that since the encoded data is transmitted to the terminal device via the network and decoded, and then adjusted according to the screen size of the terminal device, i.e., from wydeo Hvideo to Wphone, the picture can be rendered in full screen without blank space because of the wydeo/Hvideo/Wphone.
It should be noted that the application is not only applied to display of a cloud game picture, but also applied to other cloud application scenes in which picture display is required, and the specific application form depends on the actual scene.
With the above embodiments, the terminal resolution is obtained by obtaining the terminal resolution, where the terminal resolution is obtained based on the terminal device configuration; then, determining rendering parameters according to the corresponding relation between the terminal resolution and the initial resolution, wherein the initial resolution is used for indicating the resolution of a virtual screen for running the game, and the rendering parameters are used for indicating the change condition of the initial resolution based on the terminal resolution; further rendering according to the rendering parameters to obtain a game rendering picture; coding operation is carried out on the game rendering picture to obtain coded data; and further transmitting the encoded data to the terminal equipment, so that the terminal equipment decodes the encoded data to obtain a game rendering picture. Therefore, the picture display in the cloud service process is realized, and the cloud service equipment can be realized without configuring a large number of matching processes due to the adoption of a dynamic matching mode, so that the system resources of the cloud service are saved, and the picture display accuracy of the terminal equipment is ensured.
Referring to fig. 6, fig. 6 is a flowchart of another method for displaying a picture according to an embodiment of the present disclosure, where the cloud game is introduced as a specific scene, and the embodiment of the present disclosure at least includes the following steps:
601. the terminal device determines a terminal resolution.
In this embodiment, the process of determining the resolution of the terminal by the terminal device may be triggered in response to an operation instruction, specifically, the operation instruction may be a start instruction of a cloud game; or triggering of a virtual key with an optimization function in the cloud game process, wherein the specific triggering form is determined by an actual scene and is not limited here.
In a possible scenario, since a user may not need a high-quality resolution picture when the cloud game is not in a battle process, the operation instruction may be associated with a virtual key for battle start at this time, as shown in fig. 7, a scene diagram of another picture display method provided in the embodiment of the present application is shown; the figure shows a virtual button C1 for battle start, which triggers the process of picture display when the user clicks the button, on one hand, the game experience of the user is guaranteed; and on the other hand, the processing resource of the cloud service equipment is saved.
It is understood that the virtual key may be a key for starting a battle, or may be a separate virtual key for indicating a screen display, which is merely an example.
602. And the terminal equipment sends the terminal resolution to the cloud service equipment.
603. The cloud service device determines rendering parameters.
604. And the cloud service equipment performs picture rendering to obtain a game rendering picture.
605. The cloud service equipment carries out encoding to obtain encoded data.
606. And the cloud service equipment sends the coded data to the terminal equipment.
In this embodiment, steps 602-606 are similar to steps 301-305 in the embodiment shown in fig. 3, and specific features may be referred to, which are not described herein again.
607. The terminal equipment performs decoding operation.
In this embodiment, the decoding process of the terminal device is performed relative to the encoding process of the cloud service device, that is, the terminal device and the cloud service device adopt similar encoding and decoding logic, so that the correspondence and the identifiability of data are ensured.
608. And the terminal equipment executes the cloud service process through the cloud service equipment.
In this embodiment, after the terminal device and the cloud service device establish the connection based on the display resolution, the subsequent data packet is directly processed by the display resolution, and the full-screen display process or the display process of the designated area of the terminal can be realized.
With the adoption of the embodiment, the size of the rendering window of the game is adjusted according to the resolution ratio of the terminal equipment, and the full-screen rendering is achieved by cutting through the encoder, so that the user experience is improved. Meanwhile, the server only needs to start the virtual machine/container in a small resolution ratio, and resource waste of the server is reduced.
In order to better implement the above-mentioned aspects of the embodiments of the present application, the following also provides related apparatuses for implementing the above-mentioned aspects. Referring to fig. 8, fig. 8 is a schematic structural diagram of a screen display device according to an embodiment of the present application, where the screen display device 800 includes:
an obtaining unit 801, configured to obtain a terminal resolution, where the terminal resolution is obtained based on a terminal device configuration;
a determining unit 802, configured to determine a rendering parameter according to a corresponding relationship between the terminal resolution and an initial resolution, where the initial resolution is used to indicate a resolution of a virtual screen on which a game is running, and the rendering parameter is used to indicate a change condition of the initial resolution with the terminal resolution as a reference;
a rendering unit 803, configured to perform rendering according to the rendering parameter to obtain a game rendering screen;
an encoding unit 804, configured to perform an encoding operation on the game rendering screen to obtain encoded data;
a transmission unit 805, configured to transmit the encoded data to the terminal device, so that the terminal device decodes the encoded data to obtain the game rendering screen.
Optionally, in some possible implementations of the present application, the determining unit 802 is specifically configured to determine a first aspect ratio of the initial resolution and a second aspect ratio of the terminal resolution;
the determining unit 802 is specifically configured to determine a changing edge according to a size relationship between the first aspect ratio and the second aspect ratio to obtain the rendering parameter, where the changing edge is used to indicate an excess portion of the interface corresponding to the initial resolution compared to the interface corresponding to the display resolution.
Optionally, in some possible implementations of the present application, the determining unit 802 is specifically configured to determine, if the first aspect ratio is greater than the second aspect ratio, a broadside as the changed side;
the determining unit 802 is specifically configured to determine the rendering parameter according to the corresponding high side and the changed side in the first aspect ratio.
Optionally, in some possible implementation manners of the present application, the determining unit 802 is specifically configured to determine that a long side is the changed side if the first aspect ratio is smaller than the second aspect ratio;
the determining unit 802 is specifically configured to determine the rendering parameter according to the corresponding width and the changed side in the first aspect ratio.
Optionally, in some possible implementation manners of the present application, the encoding unit 804 is specifically configured to obtain a display interface range corresponding to the virtual screen;
the encoding unit 804 is specifically configured to clip the display interface range according to the game rendering image;
the encoding unit 804 is specifically configured to perform an encoding operation on the picture corresponding to the cut display interface range to obtain the encoded data.
Optionally, in some possible implementation manners of the present application, the encoding unit 804 is specifically configured to capture interface display content corresponding to the game rendering picture;
the encoding unit 804 is specifically configured to perform an encoding operation according to the interface display content to obtain the encoded data.
Optionally, in some possible implementation manners of the present application, the obtaining unit 801 is specifically configured to obtain an application data packet sent by the terminal;
the obtaining unit 801 is specifically configured to determine an application identifier according to the application data packet;
the obtaining unit 801 is specifically configured to determine a corresponding application virtual machine according to the application identifier;
the obtaining unit 801 is specifically configured to analyze the application data packet based on the application virtual machine to obtain the resolution of the terminal.
Optionally, in some possible implementation manners of the present application, the obtaining unit 801 is specifically configured to determine a plurality of corresponding candidate virtual machines according to the application identifier;
the obtaining unit 801 is specifically configured to determine the application virtual machine according to the load information of the candidate virtual machine.
Optionally, in some possible implementation manners of the present application, the obtaining unit 801 is specifically configured to record a terminal identifier corresponding to the terminal;
the obtaining unit 801 is specifically configured to configure a corresponding relationship between the terminal identifier and the encoded data to obtain a call table, where the call table is used to indicate interface display of the terminal.
Optionally, in some possible implementation manners of the present application, the obtaining unit 801 is specifically configured to determine a target application run by the terminal;
the obtaining unit 801 is specifically configured to update the terminal identifier according to the target application;
the obtaining unit 801 is specifically configured to configure a corresponding relationship between the updated terminal identifier and the encoded data, so as to obtain the call table.
The terminal resolution is obtained by obtaining the terminal resolution, wherein the terminal resolution is obtained based on the configuration of the terminal equipment; then, determining rendering parameters according to the corresponding relation between the terminal resolution and the initial resolution, wherein the initial resolution is used for indicating the resolution of a virtual screen for running the game, and the rendering parameters are used for indicating the change condition of the initial resolution based on the terminal resolution; further rendering according to the rendering parameters to obtain a game rendering picture; coding operation is carried out on the game rendering picture to obtain coded data; and further transmitting the encoded data to the terminal equipment, so that the terminal equipment decodes the encoded data to obtain a game rendering picture. Therefore, the picture display in the cloud service process is realized, and the cloud service equipment can be realized without configuring a large number of matching processes due to the adoption of a dynamic matching mode, so that the system resources of the cloud service are saved, and the picture display accuracy of the terminal equipment is ensured.
Referring to fig. 9, fig. 9 is a schematic structural diagram of another image display device according to an embodiment of the present application, where the image display device 900 includes:
an acquisition unit 901 configured to acquire a terminal resolution in response to an operation instruction;
a sending unit 902, configured to send the terminal resolution to a cloud service device;
a receiving unit 903, configured to receive encoded data sent by the cloud service device, where the encoded data is used to indicate a game rendering picture rendered by the cloud service device based on a rendering parameter, the rendering parameter is used to indicate a change condition of an initial resolution with reference to the terminal resolution, and the initial resolution is used to indicate a resolution of a virtual screen on which the cloud service device runs a game;
a decoding unit 904, configured to decode the encoded data to obtain the game rendering screen;
the display unit 905 is configured to adjust the game rendering picture based on a screen interface corresponding to the terminal resolution, so as to display the game.
An embodiment of the present application further provides a terminal device, as shown in fig. 10, which is a schematic structural diagram of another terminal device provided in the embodiment of the present application, and for convenience of description, only a portion related to the embodiment of the present application is shown, and details of the specific technology are not disclosed, please refer to a method portion in the embodiment of the present application. The terminal may be any terminal device including a mobile phone, a tablet computer, a Personal Digital Assistant (PDA), a point of sale (POS), a vehicle-mounted computer, and the like, taking the terminal as the mobile phone as an example:
fig. 10 is a block diagram illustrating a partial structure of a mobile phone related to a terminal provided in an embodiment of the present application. Referring to fig. 10, the cellular phone includes: radio Frequency (RF) circuitry 1010, memory 1020, input unit 1030, display unit 1040, sensor 1050, audio circuitry 1060, wireless fidelity (WiFi) module 1070, processor 1080, and power supply 1080. Those skilled in the art will appreciate that the handset configuration shown in fig. 10 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The following describes each component of the mobile phone in detail with reference to fig. 10:
RF circuit 1010 may be used for receiving and transmitting signals during information transmission and reception or during a call, and in particular, for processing downlink information of a base station after receiving the downlink information to processor 1080; in addition, the data for designing uplink is transmitted to the base station. In general, RF circuit 1010 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuitry 1010 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to global system for mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Message Service (SMS), etc.
The memory 1020 can be used for storing software programs and modules, and the processor 1080 executes various functional applications and data processing of the mobile phone by operating the software programs and modules stored in the memory 1020. The memory 1020 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 1020 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The input unit 1030 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone. Specifically, the input unit 1030 may include a touch panel 1031 and other input devices 1032. The touch panel 1031, also referred to as a touch screen, may collect touch operations by a user (e.g., operations by a user on or near the touch panel 1031 using any suitable object or accessory such as a finger, a stylus, etc., and spaced touch operations within a certain range on the touch panel 1031) and drive corresponding connection devices according to a preset program. Alternatively, the touch panel 1031 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 1080, and can receive and execute commands sent by the processor 1080. In addition, the touch panel 1031 may be implemented by various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. The input unit 1030 may include other input devices 1032 in addition to the touch panel 1031. In particular, other input devices 1032 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a track ball, a mouse, a joystick, or the like.
The display unit 1040 may be used to display information input by a user or information provided to the user and various menus of the cellular phone. The display unit 1040 may include a display panel 1041, and optionally, the display panel 1041 may be configured in the form of a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), or the like. Further, the touch panel 1031 can cover the display panel 1041, and when the touch panel 1031 detects a touch operation on or near the touch panel 1031, the touch operation is transmitted to the processor 1080 to determine the type of the touch event, and then the processor 1080 provides a corresponding visual output on the display panel 1041 according to the type of the touch event. Although in fig. 10, the touch panel 1031 and the display panel 1041 are two separate components to implement the input and output functions of the mobile phone, in some embodiments, the touch panel 1031 and the display panel 1041 may be integrated to implement the input and output functions of the mobile phone.
The handset may also include at least one sensor 1050, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of ambient light, and the proximity sensor may turn off the display panel 1041 and/or the backlight when the mobile phone moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.
Audio circuitry 1060, speaker 1061, microphone 1062 may provide an audio interface between the user and the handset. The audio circuit 1060 can transmit the electrical signal converted from the received audio data to the speaker 1061, and the electrical signal is converted into a sound signal by the speaker 1061 and output; on the other hand, the microphone 1062 converts the collected sound signal into an electrical signal, which is received by the audio circuit 1060 and converted into audio data, which is then processed by the audio data output processor 1080 and then sent to, for example, another cellular phone via the RF circuit 1010, or output to the memory 1020 for further processing.
WiFi belongs to short-distance wireless transmission technology, and the mobile phone can help the user to send and receive e-mail, browse web pages, access streaming media, etc. through the WiFi module 1070, which provides wireless broadband internet access for the user. Although fig. 10 shows the WiFi module 1070, it is understood that it does not belong to the essential constitution of the handset, and may be omitted entirely as needed within the scope not changing the essence of the invention.
The processor 1080 is a control center of the mobile phone, connects various parts of the whole mobile phone by using various interfaces and lines, and executes various functions of the mobile phone and processes data by operating or executing software programs and/or modules stored in the memory 1020 and calling data stored in the memory 1020, thereby integrally monitoring the mobile phone. Optionally, processor 1080 may include one or more processing units; optionally, processor 1080 may integrate an application processor, which primarily handles operating systems, user interfaces, application programs, etc., and a modem processor, which primarily handles wireless communications. It is to be appreciated that the modem processor described above may not be integrated into processor 1080.
The handset also includes a power supply 1080 (e.g., a battery) for powering the various components, and optionally, the power supply may be logically connected to the processor 1080 via a power management system, so as to implement functions of managing charging, discharging, and power consumption via the power management system.
Although not shown, the mobile phone may further include a camera, a bluetooth module, etc., which are not described herein.
In the embodiment of the present application, the processor 1080 included in the terminal further has a function of executing the steps of the page processing method.
An embodiment of the present application further provides a computer-readable storage medium, in which a screen display instruction is stored, and when the computer-readable storage medium runs on a computer, the computer is enabled to perform the steps performed by the screen display apparatus in the method described in the foregoing embodiments shown in fig. 2 to 7.
The embodiment of the present application further provides a computer program product including a screen display instruction, which, when running on a computer, causes the computer to perform the steps performed by the screen display apparatus in the method described in the foregoing embodiments shown in fig. 2 to 7.
The embodiment of the present application further provides a screen display system, where the screen display system may include the screen display apparatus in the embodiment described in fig. 8 or fig. 9, or the terminal device described in fig. 10.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed to by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a screen display device, or a network device) to perform all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.

Claims (12)

1. A picture display method is applied to a cloud game server and comprises the following steps:
acquiring terminal resolution, wherein the terminal resolution is obtained based on terminal equipment configuration;
determining rendering parameters according to the corresponding relation between the terminal resolution and the initial resolution, wherein the rendering parameters comprise: determining a first aspect ratio of the initial resolution and a second aspect ratio of the terminal resolution; determining a change edge according to a magnitude relation between the first aspect ratio and the second aspect ratio to obtain the rendering parameter, specifically including: if the first aspect ratio is larger than the second aspect ratio, determining the wide side as the change side; determining the rendering parameters according to the corresponding high side and the change side in the first aspect ratio; the change edge is used for indicating that the interface corresponding to the initial resolution is compared with the redundant part of the interface corresponding to the display resolution, and the aspect ratio of the display resolution to the terminal resolution is consistent; the initial resolution is used for indicating the resolution of a virtual screen for running a game, and the rendering parameter is used for indicating the change condition of the initial resolution by taking the terminal resolution as a reference, so that the aspect ratio of the initial resolution and the terminal resolution is consistent;
rendering according to the rendering parameters to obtain a game rendering picture;
performing an encoding operation on the game rendering picture to obtain encoded data, including: acquiring a display interface range corresponding to the virtual screen; cutting the display interface range according to the game rendering picture, and specifically comprising the following steps: cutting to obtain a display interface range containing the game rendering picture, or cutting to obtain a display interface range not containing the game rendering picture; coding the picture corresponding to the cut display interface range to obtain the coded data;
and transmitting the coded data to the terminal equipment, so that the terminal equipment decodes the coded data to obtain the game rendering picture.
2. The method of claim 1, wherein determining a changed edge according to a magnitude relationship between the first aspect ratio and the second aspect ratio to obtain the rendering parameter further comprises:
if the first aspect ratio is smaller than the second aspect ratio, determining the long side as the change side;
and determining the rendering parameters according to the corresponding broadside and the change side in the first aspect ratio.
3. The method of claim 1, wherein the encoding the game rendering to obtain encoded data comprises:
capturing interface display content corresponding to the game rendering picture;
and carrying out coding operation according to the interface display content to obtain the coded data.
4. The method of claim 1, wherein the obtaining the terminal resolution comprises:
acquiring an application data packet sent by the terminal;
determining an application identifier according to the application data packet;
determining a corresponding application virtual machine according to the application identifier;
and analyzing the application data packet based on the application virtual machine to obtain the resolution of the terminal.
5. The method of claim 4, wherein determining the corresponding application virtual machine according to the application identifier comprises:
determining a plurality of corresponding candidate virtual machines according to the application identifiers;
and determining the application virtual machine according to the load information of the candidate virtual machine.
6. The method of claim 1, further comprising:
recording a terminal identifier corresponding to the terminal;
and configuring the corresponding relation between the terminal identification and the coded data to obtain a call table, wherein the call table is used for indicating the interface display of the terminal.
7. The method according to claim 6, wherein the configuring the correspondence between the terminal identifier and the encoded data to obtain a call table comprises:
determining a target application operated by the terminal;
updating the terminal identification according to the target application;
and configuring the corresponding relation between the updated terminal identification and the encoded data to obtain the call list.
8. A method for displaying a screen, comprising:
responding to an operation instruction to obtain the resolution of the terminal;
sending the terminal resolution to cloud service equipment;
receiving coded data sent by the cloud service equipment, wherein the coded data are used for indicating the cloud service equipment to cut a display interface range corresponding to a virtual screen based on a game rendering picture rendered according to rendering parameters, and then the picture corresponding to the display interface range is obtained; cutting a display interface range corresponding to the virtual screen, specifically comprising: cutting to obtain a display interface range containing the game rendering picture, or cutting to obtain a display interface range not containing the game rendering picture; the rendering parameter is used for indicating the change condition of an initial resolution by taking the terminal resolution as a reference, so that the aspect ratio of the initial resolution and the terminal resolution is consistent; the initial resolution is used for indicating the resolution of a virtual screen of the cloud service device running a game; the rendering parameters are determined according to the corresponding relation between the terminal resolution and the initial resolution, and comprise: determining a first aspect ratio of the initial resolution and a second aspect ratio of the terminal resolution; determining a change edge according to a magnitude relation between the first aspect ratio and the second aspect ratio to obtain the rendering parameter, specifically including: if the first aspect ratio is larger than the second aspect ratio, determining the wide side as the change side; determining the rendering parameters according to a corresponding high side and the changing side in the first aspect ratio, wherein the changing side is used for indicating that the interface corresponding to the initial resolution is compared with the redundant part of the interface corresponding to the display resolution, and the display resolution is consistent with the aspect ratio of the terminal resolution;
decoding the coded data to obtain the game rendering picture;
and adjusting the game rendering picture based on a screen interface corresponding to the resolution of the terminal so as to display the game.
9. An apparatus for displaying a screen, comprising:
the terminal comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring terminal resolution, and the terminal resolution is obtained based on terminal equipment configuration;
a determining unit, configured to determine a rendering parameter according to a corresponding relationship between the terminal resolution and an initial resolution, where the initial resolution is used to indicate a resolution of a virtual screen on which a game is running, and the rendering parameter is used to indicate a change condition of the initial resolution with the terminal resolution as a reference, so that an aspect ratio of the initial resolution to the terminal resolution is consistent;
the rendering unit is used for rendering according to the rendering parameters to obtain a game rendering picture;
the encoding unit is used for performing encoding operation on the game rendering picture to obtain encoded data;
the transmission unit is used for transmitting the coded data to the terminal equipment so that the terminal equipment decodes the coded data to obtain the game rendering picture;
the encoding unit is specifically used for acquiring a display interface range corresponding to the virtual screen; cutting the display interface range according to the game rendering picture, and specifically comprising the following steps: cutting to obtain a display interface range containing the game rendering picture, or cutting to obtain a display interface range not containing the game rendering picture; coding the picture corresponding to the cut display interface range to obtain the coded data;
the determining unit is specifically configured to determine a first aspect ratio of the initial resolution and a second aspect ratio of the terminal resolution; determining a change edge according to a magnitude relation between the first aspect ratio and the second aspect ratio to obtain the rendering parameter, specifically including: if the first aspect ratio is larger than the second aspect ratio, determining the wide side as the change side; determining the rendering parameters according to the corresponding high side and the change side in the first aspect ratio; the changing edge is used for indicating that the interface corresponding to the initial resolution is compared with the redundant part of the interface corresponding to the display resolution, and the aspect ratio of the display resolution to the terminal resolution is consistent.
10. An apparatus for displaying a screen, comprising:
an acquisition unit configured to acquire a terminal resolution in response to an operation instruction;
a sending unit, configured to send the terminal resolution to a cloud service device;
the receiving unit is used for receiving coded data sent by the cloud service equipment, and the coded data is used for indicating the cloud service equipment to cut a display interface range corresponding to a virtual screen based on a game rendering picture rendered according to rendering parameters; cutting a display interface range corresponding to the virtual screen, specifically comprising: cutting to obtain a display interface range containing the game rendering picture, or cutting to obtain a display interface range not containing the game rendering picture; the rendering parameter is used for indicating the change condition of an initial resolution by taking the terminal resolution as a reference, so that the aspect ratio of the initial resolution and the terminal resolution is consistent; the initial resolution is used for indicating the resolution of a virtual screen of the cloud service device running a game; the rendering parameters are determined according to the corresponding relation between the terminal resolution and the initial resolution, and comprise: determining a first aspect ratio of the initial resolution and a second aspect ratio of the terminal resolution; determining a change edge according to a magnitude relation between the first aspect ratio and the second aspect ratio to obtain the rendering parameter, specifically including: if the first aspect ratio is larger than the second aspect ratio, determining the wide side as the change side; determining the rendering parameters according to a corresponding high side and the changing side in the first aspect ratio, wherein the changing side is used for indicating that the interface corresponding to the initial resolution is compared with the redundant part of the interface corresponding to the display resolution, and the display resolution is consistent with the aspect ratio of the terminal resolution;
the decoding unit is used for decoding the coded data to obtain the game rendering picture;
and the display unit is used for adjusting the game rendering picture based on the screen interface corresponding to the resolution of the terminal so as to display the game.
11. A computer device, the computer device comprising a processor and a memory:
the memory is used for storing program codes; the processor is configured to execute the method for displaying a screen according to any one of claims 1 to 7 or the method for displaying a screen according to claim 8 according to instructions in the program code.
12. A computer-readable storage medium having stored therein instructions which, when run on a computer, cause the computer to perform the method for screen display of any one of the above claims 1 to 7, or the method for screen display of claim 8.
CN202010362392.1A 2020-04-30 2020-04-30 Picture display method and related device Active CN111544886B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010362392.1A CN111544886B (en) 2020-04-30 2020-04-30 Picture display method and related device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010362392.1A CN111544886B (en) 2020-04-30 2020-04-30 Picture display method and related device

Publications (2)

Publication Number Publication Date
CN111544886A CN111544886A (en) 2020-08-18
CN111544886B true CN111544886B (en) 2021-07-09

Family

ID=72006316

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010362392.1A Active CN111544886B (en) 2020-04-30 2020-04-30 Picture display method and related device

Country Status (1)

Country Link
CN (1) CN111544886B (en)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112023402B (en) * 2020-09-02 2021-07-27 腾讯科技(深圳)有限公司 Game data processing method, device, equipment and medium
CN112422868A (en) * 2020-10-14 2021-02-26 西安万像电子科技有限公司 Data processing method, terminal device and server
CN114022590B (en) * 2020-12-30 2023-03-24 万翼科技有限公司 Picture rendering method and related equipment
CN112370784B (en) * 2021-01-15 2021-04-09 腾讯科技(深圳)有限公司 Virtual scene display method, device, equipment and storage medium
CN112791399B (en) * 2021-02-08 2021-08-31 腾讯科技(深圳)有限公司 Method, device, system, medium and electronic equipment for displaying cloud game picture
CN113015021B (en) * 2021-03-12 2022-04-08 腾讯科技(深圳)有限公司 Cloud game implementation method, device, medium and electronic equipment
CN113082703A (en) * 2021-04-23 2021-07-09 杭州雾联科技有限公司 Cursor display method, device and medium
CN113101654A (en) * 2021-05-11 2021-07-13 江苏视博云信息技术有限公司 Cloud game picture display method and device and storage medium
CN113453059B (en) * 2021-06-24 2022-12-09 深圳市腾讯计算机系统有限公司 Cloud game data processing method, device, equipment and medium
CN113476836B (en) * 2021-06-30 2024-03-22 广州方硅信息技术有限公司 Game picture display method, game picture display device, electronic equipment and readable storage medium
CN113274728B (en) * 2021-07-23 2021-11-16 北京蔚领时代科技有限公司 Dynamic resolution adjusting method, device, equipment and storage medium
CN113893524B (en) * 2021-08-04 2022-09-20 广州简悦信息科技有限公司 Cloud application processing system, method, device and equipment
CN113778589A (en) * 2021-08-20 2021-12-10 广州虎牙科技有限公司 Screen adaptation method, server, intelligent terminal, electronic device and storage medium
CN116887005A (en) * 2021-08-27 2023-10-13 荣耀终端有限公司 Screen projection method and electronic equipment
CN113452944B (en) * 2021-08-31 2021-11-02 江苏北弓智能科技有限公司 Picture display method of cloud mobile phone
CN114513512B (en) * 2022-02-08 2023-01-24 腾讯科技(深圳)有限公司 Interface rendering method and device
CN115278309A (en) * 2022-09-27 2022-11-01 海马云(天津)信息技术有限公司 Cloud application rendering video frame processing method and device
CN116440501B (en) * 2023-06-16 2023-08-29 瀚博半导体(上海)有限公司 Self-adaptive cloud game video picture rendering method and system
CN116886744B (en) * 2023-09-08 2023-12-29 深圳云天畅想信息科技有限公司 Dynamic adjustment method, device and equipment for streaming resolution and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104182270A (en) * 2014-08-25 2014-12-03 北京云巢动脉科技有限公司 Display method for enabling virtual machine interfaces to adapt to mobile terminal screens with different resolution ratios
CN109582425A (en) * 2018-12-04 2019-04-05 中山大学 A kind of GPU service redirection system and method merged based on cloud with terminal GPU
CN109876434A (en) * 2019-02-20 2019-06-14 深圳威尔视觉传媒有限公司 A kind of cloud game image encoding method and relevant apparatus
CN110392047A (en) * 2019-07-02 2019-10-29 华为技术有限公司 Data transmission method, device and equipment

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10433025B2 (en) * 2016-05-10 2019-10-01 Jaunt Inc. Virtual reality resource scheduling of process in a cloud-based virtual reality processing system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104182270A (en) * 2014-08-25 2014-12-03 北京云巢动脉科技有限公司 Display method for enabling virtual machine interfaces to adapt to mobile terminal screens with different resolution ratios
CN109582425A (en) * 2018-12-04 2019-04-05 中山大学 A kind of GPU service redirection system and method merged based on cloud with terminal GPU
CN109876434A (en) * 2019-02-20 2019-06-14 深圳威尔视觉传媒有限公司 A kind of cloud game image encoding method and relevant apparatus
CN110392047A (en) * 2019-07-02 2019-10-29 华为技术有限公司 Data transmission method, device and equipment

Also Published As

Publication number Publication date
CN111544886A (en) 2020-08-18

Similar Documents

Publication Publication Date Title
CN111544886B (en) Picture display method and related device
CN107454416B (en) Video stream sending method and device
CN111866433B (en) Video source switching method, video source playing method, video source switching device, video source playing device, video source equipment and storage medium
CN111491197B (en) Live content display method and device and storage medium
CN109168013B (en) Method, device and equipment for extracting frame and computer readable storage medium
CN104935955B (en) A kind of methods, devices and systems transmitting live video stream
CN108513671B (en) Display method and terminal for 2D application in VR equipment
CN106658064B (en) Virtual gift display method and device
CN112312144B (en) Live broadcast method, device, equipment and storage medium
CN107908765B (en) Game resource processing method, mobile terminal and server
CN111464825B (en) Live broadcast method based on geographic information and related device
CN113313804B (en) Image rendering method and device, electronic equipment and storage medium
CN113117326B (en) Frame rate control method and device
CN106454438B (en) data processing method, related equipment and system
CN110719319A (en) Resource sharing method, device, terminal equipment and storage medium
CN109474833B (en) Network live broadcast method, related device and system
CN112691363A (en) Cross-terminal switching method and related device for cloud games
CN110300047B (en) Animation playing method and device and storage medium
CN108121583B (en) Screen capturing method and related product
CN106446042B (en) Information display method and device
CN108259808B (en) Video frame compression method and mobile terminal
CN115665362A (en) Video conference processing method and device, electronic equipment and storage medium
CN111372127B (en) Data transmission method and related device
CN113630621B (en) Video processing method, related device and storage medium
CN115776593A (en) Video content processing method and related device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40028865

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant