CN112188270A - Cloud rendering display method and device - Google Patents

Cloud rendering display method and device Download PDF

Info

Publication number
CN112188270A
CN112188270A CN202011046197.4A CN202011046197A CN112188270A CN 112188270 A CN112188270 A CN 112188270A CN 202011046197 A CN202011046197 A CN 202011046197A CN 112188270 A CN112188270 A CN 112188270A
Authority
CN
China
Prior art keywords
display
proportion
video data
display video
screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011046197.4A
Other languages
Chinese (zh)
Inventor
刘湘泉
江梦梁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhai Dashi Intelligence Technology Co ltd
Original Assignee
Wuhai Dashi Intelligence Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhai Dashi Intelligence Technology Co ltd filed Critical Wuhai Dashi Intelligence Technology Co ltd
Priority to CN202011046197.4A priority Critical patent/CN112188270A/en
Publication of CN112188270A publication Critical patent/CN112188270A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/816Monomedia components thereof involving special video data, e.g 3D video

Abstract

The invention provides a cloud rendering display method and a cloud rendering display device, wherein the method comprises the following steps: receiving pre-display video data with fixed size sent by a cloud rendering server; acquiring the screen size of current terminal equipment, calculating the screen proportion, calculating the proportion required by the display of the pre-display video data according to the screen size of the current terminal equipment and the size of the pre-display video data, and planning an area with the same proportion as the required proportion of the display of the pre-display video data if the proportion required by the display of the pre-display video data is different from the displayable proportion of the current terminal equipment; and displaying the pre-display video in the area. By the scheme, the problem that the server side load is large in the existing cloud rendering display method is solved, the calculated amount of the cloud rendering server during screen compatibility is reduced, the server load is reduced, terminal screens with different sizes and proportions are compatible, and normal display of cloud rendering pictures is guaranteed.

Description

Cloud rendering display method and device
Technical Field
The invention relates to the field of cloud rendering, in particular to a cloud rendering display method and device.
Background
Cloud rendering is similar to common cloud computing, a 3D program is placed on a remote server for rendering, a user can access resources based on a high-speed internet, the remote server performs corresponding rendering tasks, and rendering pictures are transmitted to a user terminal for displaying.
However, with the increase of access devices of cloud rendering platforms, the types of the devices are different, if rendering pictures are directly sent to terminal devices in a default proportion for display, the pictures are deformed, and if a server needs to adjust the proportion of the rendering pictures according to the screen size of the terminal devices, the load of the server is greatly increased.
Disclosure of Invention
In view of this, embodiments of the present invention provide a cloud rendering display method and device, so as to solve the problem that the existing cloud rendering display method causes an excessive load on a server.
In a first aspect of the embodiments of the present invention, a cloud rendering display method is provided, including:
receiving pre-display video data with fixed size sent by a cloud rendering server;
acquiring the screen size of current terminal equipment, calculating the screen proportion, calculating the proportion required by the display of the pre-display video data according to the screen size of the current terminal equipment and the size of the pre-display video data, and planning an area with the same proportion as the required proportion of the display of the pre-display video data if the proportion required by the display of the pre-display video data is different from the displayable proportion of the current terminal equipment;
and displaying the pre-display video in the area.
In a second aspect of the embodiments of the present invention, there is provided a cloud rendering display apparatus, including:
the data receiving unit is used for receiving the pre-display video data with fixed size sent by the cloud rendering server;
the screen compatible unit is used for acquiring the screen size of the current terminal equipment, calculating the screen proportion, calculating the proportion required by the display of the pre-display video data according to the screen size of the current terminal equipment and the size of the pre-display video data, and if the proportion required by the display of the pre-display video data is different from the displayable proportion of the current terminal equipment, setting an area with the same proportion as the required proportion of the display of the pre-display video data;
and the data display unit is used for displaying the pre-display video data in the area.
In a third aspect of the embodiments of the present invention, there is provided an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the steps of the method according to the first aspect of the embodiments of the present invention.
In a fourth aspect of the embodiments of the present invention, a computer-readable storage medium is provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the method provided in the first aspect of the embodiments of the present invention.
In the embodiment of the invention, the fixed-size video data of the cloud rendering server is received, the screen size and the ratio are obtained, whether the current terminal screen meets the required ratio is calculated and judged, an area which is in accordance with the display of the original video picture is planned, the screen compatibility processing is realized at the terminal, the normal display of the cloud rendering picture is ensured, the load of the cloud rendering server is reduced, the calculated amount is reduced, and the terminal screens with different sizes and ratios can be compatible.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings described below are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic flowchart of a cloud rendering display method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an apparatus for cloud rendering display according to an embodiment of the present invention.
Detailed Description
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the embodiments described below are only a part of the embodiments of the present invention, and not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons skilled in the art without any inventive work shall fall within the protection scope of the present invention, and the principle and features of the present invention shall be described below with reference to the accompanying drawings.
The terms "comprises" and "comprising," when used in this specification and claims, and in the accompanying drawings and figures, are intended to cover non-exclusive inclusions, such that a process, method or system, or apparatus that comprises a list of steps or elements is not limited to the listed steps or elements.
It can be understood that, currently, terminal devices on the market are various in types and different in screen size and proportion, and a cloud rendering picture generally needs to be displayed after being subjected to compatible processing. According to the invention, the fixed-size video data rendered by the cloud is sent to the terminal, and the terminal can keep the original picture proportion for displaying through compatibility processing by detecting the size and the proportion of the screen, so that the calculation amount of the cloud service is reduced.
Referring to fig. 1, fig. 1 is a schematic flow chart of a cloud rendering display method according to an embodiment of the present invention, including:
s101, receiving pre-display video data with fixed size sent by a cloud rendering server;
the cloud rendering server is used for receiving rendering requests and resource files sent by terminal users, rendering according to access resources and instructions, and sending rendering pictures to the terminal users, so that the hardware requirements of the terminal devices can be reduced, for example, the rendering requirements of the terminal devices such as games and animations can be reduced, and the hardware calculation requirements of a CPU and a GPU can be reduced.
And the client corresponding to the terminal equipment can receive the encrypted data packet from the remote server through the IP bearer network and decrypt and display the rendered video data.
S102, obtaining the screen size of the current terminal equipment, calculating the screen proportion, calculating the proportion required by the display of the pre-display video data according to the screen size of the current terminal equipment and the size of the pre-display video data, and planning an area with the same proportion as the required proportion of the pre-display video data if the proportion required by the display of the pre-display video data is different from the displayable proportion of the current terminal equipment;
for the pre-display video data rendered by the cloud, the current screen size and proportion and the size of the video data can be calculated, and the proportion required by the display of the pre-display video data is calculated, so that the normal display of the picture is ensured. When the displayable proportion of the terminal equipment does not meet the display requirement, a specific area meeting the display proportion can be planned in the current screen area so as to realize the compatible display of the terminal screen.
Optionally, the type of the terminal device is detected, and different operation events are detected according to the type of the terminal device. If the mobile terminal is a PC device, events and positions such as mouse movement and clicking are captured; in the case of a touch screen device, events and positions such as finger clicks, swipes, and rotations are captured.
S103, displaying the pre-displayed video in the area.
Generally, when the terminal screen meets the display requirement of rendering video data, the terminal screen can be directly displayed in a default area at a received fixed proportion, and if the terminal screen does not meet the display requirement, the terminal screen can be displayed in a planning area.
And decrypting the received encrypted data packet and displaying the decrypted encrypted data packet on a terminal screen according to a display area provided by the screen compatible unit.
In the embodiment, based on the compatible processing of the terminal client to the fixed-size cloud rendering video, screens with different sizes and proportions can be compatible, rendered pictures can be displayed in the original proportion, deformation is avoided, and meanwhile, control events of various different types of equipment can be compatible.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
Fig. 2 is a schematic structural diagram of an apparatus for cloud rendering display according to an embodiment of the present invention, where the apparatus includes:
a data receiving unit 210, configured to receive pre-display video data of a fixed size sent by a cloud rendering server;
the screen compatible unit 220 is configured to perform compatible processing on different terminal screens, specifically, obtain a screen size of a current terminal device, calculate a screen ratio, calculate a ratio required for displaying the pre-displayed video data according to the screen size of the current terminal device and a size of the pre-displayed video data, and set an area having the same ratio as the required ratio for displaying the pre-displayed video data if the ratio required for displaying the pre-displayed video data is different from a displayable ratio of the current terminal device;
optionally, the method further includes:
and an operation compatible unit 230, configured to perform compatible processing on different client operation events.
The operation compatible unit is used for detecting the equipment type and capturing different operation events according to the terminal equipment type. Illustratively, events and positions of mouse movement, clicking, etc. are captured in case of a PC device, and events and positions of finger clicking, sliding, rotating, etc. are captured in case of a touch screen device.
And a data display unit 240 for displaying the pre-display video data in the region.
Displaying video data sent by a cloud rendering server on a terminal screen
It will be appreciated by those of ordinary skill in the art that in one embodiment, the electronic device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing steps S101 to S103 when executing the computer program for display of cloud rendered video data. In another embodiment, the computer program may be further stored in a computer readable storage medium, the storage medium including, for example: ROM/RAM, magnetic disk, optical disk, etc.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (6)

1. A cloud rendering display method is characterized by comprising the following steps:
receiving pre-display video data with fixed size sent by a cloud rendering server;
acquiring the screen size of current terminal equipment, calculating the screen proportion, calculating the proportion required by the display of the pre-display video data according to the screen size of the current terminal equipment and the size of the pre-display video data, and planning an area with the same proportion as the required proportion of the display of the pre-display video data if the proportion required by the display of the pre-display video data is different from the displayable proportion of the current terminal equipment;
and displaying the pre-display video in the area.
2. The method of claim 1, wherein said pre-displaying the pre-displayed video before the area is presented further comprises:
and detecting the type of the terminal equipment, detecting the operation event according to the equipment type, and performing compatible processing on the operation events of different clients.
3. An apparatus for cloud-rendering presentations, comprising:
the data receiving unit is used for receiving the pre-display video data with fixed size sent by the cloud rendering server;
the screen compatible unit is used for acquiring the screen size of the current terminal equipment, calculating the screen proportion, calculating the proportion required by the display of the pre-display video data according to the screen size of the current terminal equipment and the size of the pre-display video data, and if the proportion required by the display of the pre-display video data is different from the displayable proportion of the current terminal equipment, setting an area with the same proportion as the required proportion of the display of the pre-display video data;
and the data display unit is used for displaying the pre-display video data in the area.
4. The apparatus of claim 3, wherein the screen-compatible unit further comprises:
and the operation compatible unit is used for detecting the type of the terminal equipment, detecting the operation event according to the equipment type and carrying out compatible processing on the operation events of different clients.
5. An electronic device comprising a processor, a memory, and a computer program stored in the memory and running on the processor, wherein the steps of the cloud rendering presentation method according to any one of claims 1 to 2 are implemented when the computer program is executed by the processor.
6. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the cloud rendering presentation method according to any one of claims 1 to 2.
CN202011046197.4A 2020-09-29 2020-09-29 Cloud rendering display method and device Pending CN112188270A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011046197.4A CN112188270A (en) 2020-09-29 2020-09-29 Cloud rendering display method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011046197.4A CN112188270A (en) 2020-09-29 2020-09-29 Cloud rendering display method and device

Publications (1)

Publication Number Publication Date
CN112188270A true CN112188270A (en) 2021-01-05

Family

ID=73945618

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011046197.4A Pending CN112188270A (en) 2020-09-29 2020-09-29 Cloud rendering display method and device

Country Status (1)

Country Link
CN (1) CN112188270A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008023270A2 (en) * 2006-08-23 2008-02-28 Palm, Inc. Multiple screen size render-engine
WO2013008379A1 (en) * 2011-07-13 2013-01-17 パナソニック株式会社 Drawing device and method
CN103095828A (en) * 2013-01-14 2013-05-08 上海电力学院 Web three dimensional (3D) synchronous conference system based on rendering cloud and method of achieving synchronization
WO2017193576A1 (en) * 2016-05-13 2017-11-16 乐视控股(北京)有限公司 Video resolution adaptation method and apparatus, and virtual reality terminal
CN110264550A (en) * 2019-06-19 2019-09-20 深圳市瑞云科技有限公司 A kind of fireworks joint performance effect simulation display systems and method based on CG real-time rendering
CN110913202A (en) * 2019-11-26 2020-03-24 深圳英伦科技股份有限公司 Three-dimensional display cloud rendering method and system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008023270A2 (en) * 2006-08-23 2008-02-28 Palm, Inc. Multiple screen size render-engine
WO2013008379A1 (en) * 2011-07-13 2013-01-17 パナソニック株式会社 Drawing device and method
CN103095828A (en) * 2013-01-14 2013-05-08 上海电力学院 Web three dimensional (3D) synchronous conference system based on rendering cloud and method of achieving synchronization
WO2017193576A1 (en) * 2016-05-13 2017-11-16 乐视控股(北京)有限公司 Video resolution adaptation method and apparatus, and virtual reality terminal
CN110264550A (en) * 2019-06-19 2019-09-20 深圳市瑞云科技有限公司 A kind of fireworks joint performance effect simulation display systems and method based on CG real-time rendering
CN110913202A (en) * 2019-11-26 2020-03-24 深圳英伦科技股份有限公司 Three-dimensional display cloud rendering method and system

Similar Documents

Publication Publication Date Title
EP3046331B1 (en) Media control method and system based on cloud desktop
US8667054B2 (en) Systems and methods for networked, in-context, composed, high resolution image viewing
US9646401B2 (en) System and method for implementing a dynamic media link
US20110010629A1 (en) Selectively distributing updates of changing images to client devices
US8572168B2 (en) Systems and methods for networked, in-context, high-resolution image viewing
US20140320592A1 (en) Virtual Video Camera
EP2905945B1 (en) Inter-terminal image sharing method, terminal device and communication system
EP2594080A2 (en) Systems and methods for networked in-context, high-resolution image viewing
WO2022089330A1 (en) Method for taking screenshot, apparatus, electronic device, and readable storage medium
US8887059B2 (en) Method and apparatus of locally controlling display content of a remote system
US10044979B2 (en) Acquiring regions of remote shared content with high resolution
WO2016066147A2 (en) Method and device for processing image
CN102053867B (en) Method and device for dynamically switching pictures
CN111427528B (en) Display method and device and electronic equipment
CN106843794B (en) Split screen display method and system based on android
CN112114928A (en) Display page processing method and device
US20180018398A1 (en) Positioning content in computer-generated displays based on available display space
CN113778583A (en) Method, device, equipment and medium for publishing local application of cloud desktop
JP6083039B1 (en) Notification method and notification server for push notification to portable terminal
CN112188270A (en) Cloud rendering display method and device
WO2016066056A1 (en) Image remote projection method, server and client
CN111726666A (en) Video display control method and device
CN112445394A (en) Screenshot method and device
EP3316109B1 (en) Computer-implemented method for controlling a remote device with a local device
JP6149652B2 (en) Information processing apparatus, information processing method, and information processing program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210105

RJ01 Rejection of invention patent application after publication