CN115379257B - Rendering method, device, system, storage medium and program product - Google Patents
Rendering method, device, system, storage medium and program product Download PDFInfo
- Publication number
- CN115379257B CN115379257B CN202110552872.9A CN202110552872A CN115379257B CN 115379257 B CN115379257 B CN 115379257B CN 202110552872 A CN202110552872 A CN 202110552872A CN 115379257 B CN115379257 B CN 115379257B
- Authority
- CN
- China
- Prior art keywords
- picture
- web client
- format
- data
- rendering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000009877 rendering Methods 0.000 title claims abstract description 103
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000004590 computer program Methods 0.000 claims description 13
- 230000011664 signaling Effects 0.000 claims description 8
- 230000004044 response Effects 0.000 claims description 7
- 230000009466 transformation Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 7
- 230000009471 action Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The embodiment of the disclosure relates to a rendering method, a rendering device, a rendering system, a storage medium and a program product, wherein the rendering method is used for rendering a picture for displaying on a web client through server equipment; according to the information of the playing format supported by the browser of the web client, the picture is processed into data of a corresponding format; the method and the device have the advantages that the data are sent to the web client to enable the web client to draw pictures based on the data, the rendering capability realized based on C++ can be deployed on the server device with lower technical transformation cost, the computational power consumption of rendering on the web client is reduced, the performance of the web client is optimized, and the rendered pictures can be processed into data in corresponding formats according to the playing formats supported by the browser of the web client by the server device in the method and the device, the rendering capability can be compatible with different browsers, and the technical compatibility is improved.
Description
Technical Field
The embodiment of the disclosure relates to the technical field of rendering, in particular to a rendering method, a rendering device, a rendering system, a storage medium and a program product.
Background
In the related art, rendering capability (such as map rendering) is mostly implemented based on c++, but the inventors of the present disclosure found that in some scenarios, the rendering capability implemented based on c++ needs to be landed on the web side, and the technical stack of the web side is not matched with c++, so how to support the rendering capability of the web side with lower technical transformation cost is a technical problem that needs to be solved by those skilled in the art.
Disclosure of Invention
To solve or at least partially solve the above technical problems, the present disclosure provides a rendering method, apparatus, system, storage medium, and program product.
A first aspect of an embodiment of the present disclosure provides a rendering method, including:
rendering by the server device to obtain a picture for display on the web client;
Processing the picture into data with a corresponding format according to the pre-obtained information of the playing format supported by the browser of the web client;
and sending the data to the web client so that the web client draws the picture based on the data.
A second aspect of an embodiment of the present disclosure provides a rendering apparatus, including:
The rendering module is used for rendering and obtaining a picture for displaying on the web client;
the coding module is used for processing the picture into data in a corresponding format according to the information of the playing format supported by the browser of the web client;
And the sending module is used for sending the data to the web client so that the web client draws the picture based on the data.
A third aspect of the disclosed embodiments provides a rendering system, which includes a server device, a signaling service module, and a Web client;
the server device is used for rendering and obtaining a picture, and processing the picture into data in a corresponding format based on a play format supported by a browser on the web client;
the signaling service module is used for receiving the data sent by the server equipment and forwarding the data to the Web client;
And the Web client is used for drawing the picture according to the data.
A fourth aspect of the disclosed embodiments provides a computer readable storage medium having a computer program stored therein, which when executed by a processor causes the processor to perform the method of the first aspect described above.
A fifth aspect of the disclosed embodiments provides a computer program product comprising: a computer program stored in a computer readable storage medium, from which a processor reads and executes the computer program, which when executed by the processor performs the method according to the first aspect described above.
Compared with the prior art, the technical scheme provided by the embodiment of the disclosure has the following advantages:
According to the embodiment of the disclosure, after the picture for being displayed on the web client is rendered through the server side equipment, the picture is processed into the data in the corresponding format according to the information of the playing format supported by the browser of the web client, and the data is sent to the web client for drawing, so that the embodiment of the disclosure does not need to reform the rendering capability realized by C++ by using the technical stack supported by the web client, the rendering capability is deployed on the server side equipment and converted into the data in the format supported by the browser of the web client, the rendering capability of the browser of the web client is directly utilized, the rendering implementation of the web client is realized by using lower technical reform cost, the calculation power consumption of the rendering on the web client is reduced, the performance of the web client is optimized, and the rendered picture can be processed into the data in the corresponding format according to the playing format supported by the browser of the web client, so that the rendering capability can be compatible with different browsers, and the compatibility of the technology is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.
In order to more clearly illustrate the embodiments of the present disclosure or the solutions in the prior art, the drawings that are required for the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a schematic diagram of a rendered scene provided by an embodiment of the present disclosure;
FIG. 2 is a flow diagram of a rendering method provided by an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of processing a frame into data in a streaming format according to an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of another example of processing a frame into data in a streaming format according to an embodiment of the present disclosure;
fig. 5 is a flowchart of a rendering method of a navigation scene according to an embodiment of the present disclosure;
FIG. 6 is a schematic diagram of a rendering system provided by an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of a rendering device according to an embodiment of the present disclosure.
Detailed Description
In order that the above objects, features and advantages of the present disclosure may be more clearly understood, a further description of aspects of the present disclosure will be provided below. It should be noted that, without conflict, the embodiments of the present disclosure and features in the embodiments may be combined with each other.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced otherwise than as described herein; it will be apparent that the embodiments in the specification are only some, but not all, embodiments of the disclosure.
In the related art, rendering capability (such as map rendering) is mostly implemented based on c++, and in some scenarios, the rendering capability implemented based on c++ needs to be implemented in a server device, for example, a vehicle machine of a vehicle has page rendering capability, and a user can be provided with services through pages of a World Wide Web (Web for short) end, but a rendering operation occupies processing resources of the vehicle machine, however, the processing resources of the vehicle machine are limited, and the rendering capability of the vehicle machine needs to be opened to the server device.
In view of the above-mentioned needs, the embodiments of the present disclosure provide a new rendering scheme, and exemplary, fig. 1 is a schematic diagram of a rendering scene provided by the embodiments of the present disclosure, as shown in fig. 1, a server device renders, by a preset rendering method, a picture for displaying on a web client, then encodes the picture into data in a corresponding format according to information in a playing format supported by a browser of the web client, and sends the data in the corresponding format to the web client, and after the web client receives the data transmitted by the server device, the web client draws based on the data, and displays the drawn picture to a user. According to the scheme, the rendering capability realized by C++ is not required to be modified by a technical stack supported by the web client, the rendering capability is deployed in the server device to be completed, the rendering result is converted into data in a format supported by the browser of the web client, the capability of the browser of the web client is directly utilized, the rendering realization of the web client is realized by using lower technical modification cost, the computational power consumption of the rendering on the web client is reduced, the performance of the web client is optimized, and the service device in the embodiment of the invention can process the rendered picture into data in a corresponding format according to the playing format supported by the browser of the web client, so that the rendering capability can be compatible with different browsers, and the compatibility of the technology is improved.
In order to better understand the inventive concepts of the embodiments of the present disclosure, the technical solutions of the embodiments of the present disclosure are described below in conjunction with exemplary embodiments.
Fig. 2 is a flowchart of a rendering method according to an embodiment of the present disclosure, where the method may be performed by a server device. As shown in fig. 2, the method includes:
Step 101, the server device renders a screen for displaying on the web client.
The Web client is also called a Web application program, and is an application program which can be accessed through the Web and can be understood as a Web page version application program of a computer. The user can access the application program through the browser, and other software is not required to be installed. The web client may be composed of multiple service connectors (servlets), JAVA server Pages (JSP for short), hypertext markup language (Hyper Text Markup Language, HTML) files, and image files, which coordinate to provide a complete set of services to the user.
In this embodiment, the rendering capability of the web client is opened to the server device, and the picture displayed on the web client by the target can be rendered through the server device, where the rendering capability of the server device can be implemented based on, but is not limited to, the c++ programming language.
In the embodiment, the rendering capability of the web client is deployed on the server device, so that the rendering of the web client is realized with lower technical transformation cost, the computational power consumption of the rendering on the web client is reduced, and the performance of the web client is optimized.
And 102, processing the picture into data in a corresponding format according to the information of the playing format supported by the browser of the web client.
The information of the playing format supported by the browser of the web client may be understood as information whether the browser of the web client supports the streaming media playing format, that is, whether the browser has a media source expansion (Media Source Extensions, MSE) interface (Application Programming Interface, API) for streaming media playing.
In this embodiment, the path of the server device to obtain the information of the playing format supported by the browser of the web client is not limited, and the server device may actively obtain the information of the playing format supported by the browser from the web client, or may periodically report the information of the playing format supported by the browser to the server device through the web client.
In this embodiment, according to the information of the playing format supported by the browser of the web client, the processing the picture into the data of the corresponding format may include: and processing the picture into data in a corresponding image format or streaming media format according to the information of the playing format supported by the browser of the web client. Optionally, processing the picture into data in a corresponding image format or streaming media format according to the information of the playing format supported by the browser of the web client, which is obtained in advance, includes: responding to the browser to support streaming media playing, and processing the picture into data in a streaming media format; or processing the picture into data in an image format in response to the browser not supporting streaming media playing; the image format includes at least one of the following: PNG format, webP format, and jpeg format.
The streaming media format refers to a media format that is played in an Internet/Intranet (Internet/Intranet) by adopting a streaming mode. The streaming media format and the image format in this embodiment may be set according to actual needs, and are not limited to one or several specific streaming media formats or image formats, for example, the streaming media format may be at least one of fmp4 (FRAGMENTED MP 4) format, ASF (ADVANCED STREAM format) format and TS (Transport Stream) format. Wherein the fmp4 format is also referred to as fragment MP4, which may be a streaming media format based on MPEG-4part 12. The image format may be at least one of a portable network graphics (Portable Network Graphics, PNG) format, a webP format, and a jpeg (Joint Photographic Experts Group) format. The webP format is a picture file format that provides both lossy compression and lossless compression.
In the scheme, the server device can adaptively encode the rendered picture into the format supported by the browser according to the information of the play format supported by the browser of the web client, so that the rendering capability can be compatible with different browsers, and the technical compatibility is improved.
And step 103, transmitting the data to the web client so that the web client draws a picture based on the data.
The server device encodes the picture into data with corresponding format according to the information of the playing format supported by the browser of the web client, and then can transmit the encoded data to the web client in a preset transmission mode (including a wired mode and a wireless mode). After the Web client receives the data transmitted by the server device, drawing is performed based on the data, and a picture obtained by drawing is displayed to a user.
According to the embodiment of the disclosure, after the picture for being displayed on the web client is rendered through the server side equipment, the picture is processed into the data in the corresponding format according to the information of the playing format supported by the browser of the web client, and the data is sent to the web client for drawing, so that the embodiment of the disclosure does not need to reform the rendering capability realized by C++ by using the technical stack supported by the web client, the rendering capability is deployed on the server side equipment and converted into the data in the format supported by the browser of the web client, the rendering capability of the browser of the web client is directly utilized, the rendering implementation of the web client is realized by using lower technical reform cost, the calculation power consumption of the rendering on the web client is reduced, the performance of the web client is optimized, and the rendered picture can be processed into the data in the corresponding format according to the playing format supported by the browser of the web client, so that the rendering capability can be compatible with different browsers, and the compatibility of the technology is improved.
In some embodiments, a virtual frame may also be inserted into the rendered frame, so that the frame may be played in time.
Specifically, fig. 3 is a schematic diagram of processing a picture into data in a streaming media format according to an embodiment of the present disclosure, as shown in fig. 3, in a possible implementation, if a rendered picture includes a plurality of picture frames, the plurality of picture frames may be processed into image frames in a plurality of streaming media formats; and then inserting a preset number of virtual frames before and/or after at least part of the image frames in the streaming media format to obtain the data in the streaming media format corresponding to the picture. The virtual frame is understood as an image frame that does not include specific display content, and is used for filling up a buffer area of the browser, so that the browser can flush the buffer area in time and immediately display the image in the buffer area. The number of virtual frames inserted and the positions of the virtual frames inserted may be set according to needs, for example, in a navigation scene, a preset number of virtual frames may be inserted before and/or after an image frame at a turn, so that a navigation image at the turn may be displayed on a web client in time, that is, in some embodiments, in order to enable a rendered key frame (such as a frame at a turn, but not limited to a frame at a turn) to be displayed in time, a virtual frame may be inserted before and/or after the key frame. Of course, this is by way of illustration only and not by way of limitation.
Fig. 4 is a schematic diagram of another example of processing a picture into data in a streaming media format according to an embodiment of the present disclosure, as shown in fig. 4, in another possible implementation manner, if a rendered picture includes a plurality of picture frames, a preset number of virtual frames may also be inserted before and/or after at least some of the plurality of picture frames, and the rendered plurality of picture frames and the inserted virtual frames are taken as image frames to be processed; and then processing the image frame to be processed into the image frame in the streaming media format. In this manner, the number of virtual frames inserted and the positions of the virtual frames inserted may be set as required, and will not be described herein.
The virtual frame is inserted in the middle of the rendered picture frame, so that frame loss can be prevented, and the browser can wash the buffer area of the decoder of the browser in time, so that the picture corresponding to the current data is displayed in time, the problems of blurring of the first frame and delay of display in the related art are avoided, and the timeliness of picture display is improved.
Fig. 5 is a flowchart of a rendering method of a navigation scene according to an embodiment of the present disclosure, and as shown in fig. 5, the rendering method of the navigation scene is specifically described on the basis of the above embodiment, where the specific rendering method is as follows:
step 201, a server device of the navigation service renders a navigation screen for displaying on a web client of the navigation device.
The navigation device may be any electronic device with a navigation function, and is not particularly limited, for example, the navigation device may be a vehicle navigation device.
In this embodiment, the server device of the navigation service has rendering capability, and may render a navigation screen for displaying on the web client of the navigation device, where the navigation screen may be understood as a screen including navigation related data such as position data and navigation path.
In some embodiments, a server device of a navigation service renders a navigation screen for display on a web client of the navigation device, comprising: the method comprises the steps that a server-side device of navigation service receives position data sent by navigation equipment; and rendering to obtain a navigation picture of the current position according to the position data and the information of the obtained navigation path.
Step 202, according to the information of the playing format supported by the browser of the web client, the navigation picture is processed into data of a corresponding format.
The information of the playing format supported by the browser of the web client can be understood as information whether the browser of the web client supports streaming media playing, and the server device of the navigation service can actively acquire the information of the playing format supported by the browser of the web client from the web client, or periodically report the information of the playing format supported by the browser to the server device by the web client.
In this embodiment, according to the information of the playing format supported by the browser of the web client, the navigation screen is processed into the data of the corresponding format, which includes: and encoding the navigation picture into data in an image format or a streaming media format according to the information of the playing format supported by the browser of the web client. Responding to the browser to support streaming media playing, and processing the navigation picture into data in a streaming media format; or in response to the browser not supporting streaming media playback, processing the navigation screen into data in an image format. The streaming media format and the image format can be set as required.
In the scheme, the server side equipment of the navigation service can adaptively encode the rendered navigation picture into the format supported by the browser according to the information of the play format supported by the browser of the web client, so that the rendering capability can be compatible with different browsers, and the technical compatibility is improved.
And 203, transmitting the data to the web client so that the web client draws a navigation picture based on the data.
The server equipment of the navigation service encodes the picture into data with corresponding format according to the information of the playing format supported by the browser of the web client, and then the encoded data can be transmitted to the web client in a preset transmission mode (including a wired mode and a wireless mode). After the web client receives the data transmitted by the server-side equipment of the navigation service, drawing is carried out based on the data, and a picture obtained by drawing is displayed to a user.
According to the embodiment of the disclosure, after a navigation picture for being displayed on a web client of a navigation device is rendered through a server device of the navigation service, the navigation picture is processed into data in a corresponding format according to information in a play format supported by a browser of the web client, which is obtained in advance, and the data is sent to the web client, so that the web client draws the navigation picture based on the data. Therefore, the embodiment of the disclosure does not need to reform the rendering capability realized by C++ by using a technical stack supported by the web client, but deploys the rendering capability on the server device of the navigation service, converts the rendering result into data in a format supported by the browser of the web client of the navigation device, directly utilizes the capability of the browser of the web client, realizes the rendering realization of the web client by using lower technical reform cost, reduces the computational power consumption of the rendering on the web client, optimizes the performance of the web client, and processes the rendered picture into data in a corresponding format according to the playing format supported by the browser of the web client as the server device of the navigation service in the embodiment of the disclosure, so that the rendering capability can be compatible with different browsers and the technical compatibility is improved.
Fig. 6 is a schematic structural diagram of a rendering system provided by an embodiment of the present disclosure, and as shown in fig. 6, the rendering system 300 may include a server device 301, a signaling service module 302, and a web client 303; the server device 301 is configured to render the obtained picture, and process the picture into data in a corresponding format based on a play format supported by a browser on the web client 303; a signaling service module 302, configured to receive data sent by the server device 301 and forward the data to the Web client 303; and the Web client 303 is used for drawing a picture according to the data.
Rendering system 300 is a server device rendering (SERVER SIDE RENDERING, SSR) framework that supports the establishment of a connection between server device 301 and web client 303 for data transfer in real-time. As shown in fig. 6, the signaling service module 302 may include two units of connection management for establishing a connection between the server device 301 and the web client 303 and signaling distribution for performing data transmission in real time.
As shown in fig. 6, a rendering service module is preset in the server device 301, where the rendering service module may include an encapsulator and an encoder, and is configured to perform encoding processing and encapsulation on a picture after rendering the picture to obtain data in a corresponding format. The encoder may encode the picture into data in a streaming format or data in an image format based on the H264 format and jpeg format shown in the figure, which are only examples.
When the picture rendered by the server device 301 includes a plurality of picture frames, a preset number of virtual frames may be inserted between the plurality of picture frames to prevent frame loss, specifically, the plurality of picture frames may be encoded into an image frame in a streaming media format and then inserted into the virtual frames, or the plurality of picture frames may be inserted into the virtual frames and then encoded into data in the streaming media format, and both the above two methods may obtain the data in the streaming media format in which the virtual frames are inserted. And after the data in the streaming media format is sent to the web client, the browser can be enabled to wash out the buffer area of the decoder of the browser in time, so that the picture corresponding to the current data is displayed in real time, the problems of first frame blurring and display delay in the related art are avoided, and the instantaneity is improved.
As shown in fig. 6, the web client 303 includes a connection unit (such as webSocket) and a decapsulator, where the connection unit is configured to establish a connection with the server device 301 based on a Socket (Socket) implementation, and the decapsulator is configured to decapsulate data sent by the server device 301. The web client 303 may further include a plurality of different drawing modules, which may be called according to a data format to draw, and fig. 6 includes a first drawing module and a second drawing module, where the first drawing module may be used to draw an image through "Html5Canvas", and the second drawing module may be used to draw a streaming media through "Html5Mse", and a drawing picture obtained by drawing may be presented to a user.
In the embodiment of the disclosure, through the cooperation of each device and module in the rendering system, when the browser of the web client supports the streaming media playing format, the data of the frame code obtained by the rendering of the server device in the streaming media format is transmitted to the web client, and when the browser of the web client does not support the streaming media playing format, the data of the frame code obtained by the rendering of the server device in the image format is transmitted to the web client, so that the compatibility of the browser is improved; in real-time, the rendered picture can be timely displayed by inserting the virtual frame.
According to the method and the device for rendering the images, the rendered images can be adaptively encoded into the format supported by the browser according to the information of the play format supported by the browser of the web client, so that the rendering capability can be compatible with different browsers, and the technical compatibility is improved; and by inserting the virtual frames into a plurality of picture frames, the problems of frame loss, first frame blurring and display delay can be avoided, and the instantaneity is improved.
Fig. 7 is a schematic structural diagram of a rendering apparatus according to an embodiment of the present disclosure, where the apparatus may be specifically implemented as part of functional modules in a server device in a rendering system according to the foregoing embodiment. As shown in fig. 7, the rendering apparatus includes:
A rendering module 401, configured to render a screen for display on a web client;
the encoding module 402 is configured to process the frame into data in a corresponding format according to information in a play format supported by a browser of the web client, where the information is obtained in advance;
And the sending module 403 is configured to send the data to the web client, so that the web client draws the picture based on the data.
In one embodiment, the encoding module 402 is specifically configured to:
and processing the picture into data in a corresponding image format or streaming media format according to the pre-obtained information of the playing format supported by the browser of the web client.
In one embodiment, the encoding module 402 includes:
The first processing unit is used for responding to the browser to support streaming media playing and processing the picture into data in a streaming media format;
Or alternatively
The second processing unit is used for processing the picture into data in an image format in response to that the browser does not support streaming media playing;
The image format includes at least one of the following: PNG format, webP format, and jpeg format.
In one embodiment, the first processing unit is specifically configured to:
If the picture comprises a plurality of picture frames, processing the picture frames into a plurality of image frames in a streaming media format;
and inserting a preset number of virtual frames before and/or after at least part of the image frames in the plurality of image frames to obtain data in a streaming media format corresponding to the picture.
In one embodiment, the first processing unit is specifically configured to:
a preset number of virtual frames are inserted before and/or after a key frame in the plurality of image frames.
In one embodiment, the first processing unit is specifically configured to:
If the picture comprises a plurality of picture frames, inserting a preset number of virtual frames before and/or after at least part of the picture frames in the plurality of picture frames, and taking the plurality of picture frames and the virtual frames as image frames to be processed;
and processing the image frame to be processed into an image frame in a streaming media format.
The implementation manner and the beneficial effects of the device provided in this embodiment are similar to those of the method in any one of fig. 2 to 5, and are not repeated here.
The disclosed embodiments also provide a computer readable storage medium having a computer program stored therein, which when executed by a processor, implements the method of any of the embodiments of fig. 2-5.
The disclosed embodiments also provide a computer program product comprising: a computer program stored in a computer readable storage medium, from which a processor reads and executes the computer program, which when executed by the processor, implements the method of any of the embodiments of fig. 2-5.
It should be noted that in this document, relational terms such as "first" and "second" and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing is merely a specific embodiment of the disclosure to enable one skilled in the art to understand or practice the disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the disclosure. Thus, the present disclosure is not intended to be limited to the embodiments shown and described herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (9)
1. A rendering method, comprising:
Rendering by the server side equipment to obtain a picture for displaying on the web client side, wherein a programming language for rendering by the server side equipment comprises C++, and the picture comprises a navigation picture at a turning position;
Processing the picture into data with a corresponding format according to the pre-obtained information of the playing format supported by the browser of the web client;
Sending the data to the web client so that the web client draws the picture based on the data;
The processing the picture into the data with the corresponding format according to the information of the playing format supported by the browser of the web client comprises the following steps:
And responding to the browser supporting streaming media playing, and inserting a preset number of virtual frames into the picture frames of the navigation pictures at the turning position to obtain streaming media format data corresponding to the navigation pictures at the turning position.
2. The method of claim 1, wherein the processing the navigation screen at the turn into data of a corresponding format according to the pre-obtained information of a play format supported by the browser of the web client comprises:
Responding to the browser not supporting streaming media playing, and processing the navigation picture at the turning position into data in an image format;
The image format includes at least one of the following: PNG format, webP format, and jpeg format.
3. The method of claim 1, wherein the inserting a preset number of virtual frames into the frame of the navigation frame at the turning place in response to the browser supporting streaming media playing, to obtain the streaming media format data corresponding to the navigation frame at the turning place, comprises:
if the navigation picture at the turning position comprises a plurality of picture frames, processing the picture frames into a plurality of image frames in a streaming media format;
And inserting a preset number of virtual frames before and/or after at least part of the image frames in the plurality of image frames to obtain streaming media format data corresponding to the navigation pictures at the turning positions.
4. A method according to claim 3, wherein said inserting a preset number of virtual frames before and/or after at least part of said plurality of image frames comprises:
a preset number of virtual frames are inserted before and/or after a key frame in the plurality of image frames.
5. The method of claim 1, wherein the inserting a preset number of virtual frames into the frame of the navigation frame at the turning place in response to the browser supporting streaming media playing, to obtain the streaming media format data corresponding to the navigation frame at the turning place, comprises:
If the navigation picture at the turning position comprises a plurality of picture frames, inserting a preset number of virtual frames before and/or after at least part of the picture frames in the plurality of picture frames, and taking the plurality of picture frames and the virtual frames as image frames to be processed;
and processing the image frame to be processed into an image frame in a streaming media format.
6. A rendering apparatus, comprising:
The rendering module is used for rendering and obtaining a picture for displaying on the web client, wherein a programming language for realizing rendering by the server equipment comprises C++, and the picture comprises a navigation picture at a turning position;
the coding module is used for processing the picture into data in a corresponding format according to the information of the playing format supported by the browser of the web client;
The sending module is used for sending the data to the web client so that the web client draws the picture based on the data;
The coding module is specifically configured to insert a preset number of virtual frames into the frame of the navigation frame at the turning position in response to the browser supporting streaming media playing, so as to obtain streaming media format data corresponding to the navigation frame at the turning position.
7. A rendering system comprises a server device, a signaling service module and a web client;
The server device is used for rendering and obtaining a picture, and processing the picture into data with a corresponding format based on a pre-obtained play format supported by a browser on the web client, wherein a programming language for rendering by the server device comprises C++, and the picture comprises a navigation picture at a turning position;
the signaling service module is used for receiving the data sent by the server equipment and forwarding the data to the web client;
the web client is used for drawing the picture according to the data;
The server device is specifically configured to insert a preset number of virtual frames into the frame of the navigation frame at the turning position in response to the browser supporting streaming media playing, so as to obtain streaming media format data corresponding to the navigation frame at the turning position.
8. A computer readable storage medium having stored therein a computer program which, when executed by a processor, causes the processor to perform the method of any of claims 1-5.
9. A computer program product, the computer program product comprising: a computer program stored in a computer readable storage medium, from which a processor reads and executes the computer program, which when executed by the processor performs the method according to any of claims 1-5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110552872.9A CN115379257B (en) | 2021-05-20 | 2021-05-20 | Rendering method, device, system, storage medium and program product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110552872.9A CN115379257B (en) | 2021-05-20 | 2021-05-20 | Rendering method, device, system, storage medium and program product |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115379257A CN115379257A (en) | 2022-11-22 |
| CN115379257B true CN115379257B (en) | 2024-05-14 |
Family
ID=84058330
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110552872.9A Active CN115379257B (en) | 2021-05-20 | 2021-05-20 | Rendering method, device, system, storage medium and program product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115379257B (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2665252A1 (en) * | 2006-10-02 | 2008-04-10 | Aftercad Software Inc. | Method and system for delivering and interactively displaying three-dimensional graphics |
| AU2011202182B1 (en) * | 2011-05-11 | 2011-10-13 | Frequency Ip Holdings, Llc | Creation and presentation of selective digital content feeds |
| CN102662938A (en) * | 2010-09-14 | 2012-09-12 | 埃森哲环球服务有限公司 | Treatment controller |
| WO2013055802A1 (en) * | 2011-10-10 | 2013-04-18 | Genarts, Inc. | Network-based rendering and steering of visual effects |
| CA2809671A1 (en) * | 2012-03-23 | 2013-09-23 | Comcast Cable Communications, Llc | Application support for network devices |
| US9413807B1 (en) * | 2012-10-15 | 2016-08-09 | Tableau Software, Inc. | Browser rendering and computation |
| CN106846451A (en) * | 2017-01-22 | 2017-06-13 | 南通大学 | The sense of reality body of facing mobile apparatus is rendered and interactive system and its method of work |
| CN108629296A (en) * | 2018-04-17 | 2018-10-09 | 广州视源电子科技股份有限公司 | Image processing method and device |
| CN109889907A (en) * | 2019-04-08 | 2019-06-14 | 北京东方国信科技股份有限公司 | A kind of display methods and device of the video OSD based on HTML5 |
| CN110620959A (en) * | 2018-06-20 | 2019-12-27 | 杭州海康威视数字技术股份有限公司 | Data processing method, device, electronic equipment, system and storage medium |
| CN111641838A (en) * | 2020-05-13 | 2020-09-08 | 深圳市商汤科技有限公司 | Browser video playing method and device and computer storage medium |
| CN111708600A (en) * | 2020-08-20 | 2020-09-25 | 腾讯科技（深圳）有限公司 | Page display method, device, equipment and computer readable storage medium |
| CN111798553A (en) * | 2020-07-13 | 2020-10-20 | 重庆大学 | WebGL-based three-dimensional model rendering method, system and related device |
| CN112422508A (en) * | 2020-10-19 | 2021-02-26 | 武汉烽火众智数字技术有限责任公司 | Method and system for playing video in browser webpage |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080129864A1 (en) * | 2006-12-01 | 2008-06-05 | General Instrument Corporation | Distribution of Closed Captioning From a Server to a Client Over a Home Network |
| WO2012050832A1 (en) * | 2010-09-28 | 2012-04-19 | Google Inc. | Systems and methods utilizing efficient video compression techniques for providing static image data |
| US8941673B2 (en) * | 2011-11-08 | 2015-01-27 | Red Hat, Inc. | Rendering images in a remote web browser |
| US8799358B2 (en) * | 2011-11-28 | 2014-08-05 | Merge Healthcare Incorporated | Remote cine viewing of medical images on a zero-client application |
| US20130198342A1 (en) * | 2012-01-26 | 2013-08-01 | General Instrument Corporation | Media format negotiation mechanism delivering client device media capabilities to a server |
| US20150088977A1 (en) * | 2013-09-20 | 2015-03-26 | Versigraph Inc. | Web-based media content management |
-
2021
- 2021-05-20 CN CN202110552872.9A patent/CN115379257B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2665252A1 (en) * | 2006-10-02 | 2008-04-10 | Aftercad Software Inc. | Method and system for delivering and interactively displaying three-dimensional graphics |
| CN102662938A (en) * | 2010-09-14 | 2012-09-12 | 埃森哲环球服务有限公司 | Treatment controller |
| AU2011202182B1 (en) * | 2011-05-11 | 2011-10-13 | Frequency Ip Holdings, Llc | Creation and presentation of selective digital content feeds |
| WO2013055802A1 (en) * | 2011-10-10 | 2013-04-18 | Genarts, Inc. | Network-based rendering and steering of visual effects |
| CA2809671A1 (en) * | 2012-03-23 | 2013-09-23 | Comcast Cable Communications, Llc | Application support for network devices |
| US9413807B1 (en) * | 2012-10-15 | 2016-08-09 | Tableau Software, Inc. | Browser rendering and computation |
| CN106846451A (en) * | 2017-01-22 | 2017-06-13 | 南通大学 | The sense of reality body of facing mobile apparatus is rendered and interactive system and its method of work |
| CN108629296A (en) * | 2018-04-17 | 2018-10-09 | 广州视源电子科技股份有限公司 | Image processing method and device |
| CN110620959A (en) * | 2018-06-20 | 2019-12-27 | 杭州海康威视数字技术股份有限公司 | Data processing method, device, electronic equipment, system and storage medium |
| CN109889907A (en) * | 2019-04-08 | 2019-06-14 | 北京东方国信科技股份有限公司 | A kind of display methods and device of the video OSD based on HTML5 |
| CN111641838A (en) * | 2020-05-13 | 2020-09-08 | 深圳市商汤科技有限公司 | Browser video playing method and device and computer storage medium |
| CN111798553A (en) * | 2020-07-13 | 2020-10-20 | 重庆大学 | WebGL-based three-dimensional model rendering method, system and related device |
| CN111708600A (en) * | 2020-08-20 | 2020-09-25 | 腾讯科技（深圳）有限公司 | Page display method, device, equipment and computer readable storage medium |
| CN112422508A (en) * | 2020-10-19 | 2021-02-26 | 武汉烽火众智数字技术有限责任公司 | Method and system for playing video in browser webpage |
Non-Patent Citations (1)
| Title |
|---|
| 基于Html5的Web Map矢量渲染技术研究;丁立国;周斌;熊伟;;测绘工程(第08期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115379257A (en) | 2022-11-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108337528B (en) | Method and equipment for previewing video | |
| US8929459B2 (en) | Systems and methods utilizing efficient video compression techniques for browsing of static image data | |
| JP5555728B2 (en) | System and method for providing video content associated with a source image to a television in a communication network | |
| US10979785B2 (en) | Media playback apparatus and method for synchronously reproducing video and audio on a web browser | |
| CN112653700B (en) | Website video communication method based on WEBRTC | |
| US20100281042A1 (en) | Method and System for Transforming and Delivering Video File Content for Mobile Devices | |
| KR100632793B1 (en) | Method and apparatus for moving image conversion, method and apparatus for moving image transmission, and medium recording programs therefor | |
| CN102656857B (en) | Method and apparatus for acquiring and transmitting streaming media data in the process of initiation | |
| CN111104631B (en) | Webp picture format conversion method | |
| US10356431B2 (en) | Moving image reproduction method and moving image reproduction system | |
| CN103177015A (en) | Method and system for webpage image presentation | |
| CN113727184B (en) | Video playing method, device, system, storage medium and electronic equipment | |
| CN101127780A (en) | Method for downloading, saving and replaying online video and construction of online video network | |
| CN112995698A (en) | Video playing method, client, service platform and intelligent conference system | |
| JP2004220260A (en) | Web page browsing system and image distribution server | |
| CN102770827A (en) | Method for displaying multimedia content on a screen of a terminal | |
| CN115379257B (en) | Rendering method, device, system, storage medium and program product | |
| KR101621530B1 (en) | Method and System for Providing Flash Contents via Mobile Network and Method and Apparatus for Converting Flash Contents | |
| US20210021659A1 (en) | Delivery apparatus, delivery method, and program | |
| US7016543B2 (en) | Method for providing a terminal with coded still image signals, communications system, network element and module | |
| CN115022725A (en) | Video playing method and device | |
| CN101296166A (en) | Method for measuring multimedia data based on index | |
| US9219948B2 (en) | Method and system for compression and decompression for handling web content | |
| CN104991933A (en) | Picture display method and apparatus | |
| KR20160110844A (en) | Method for providing of cloud streaming service, and apparatus thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20240306 Address after: # 03-06, Lai Zan Da Building 1, 51 Belarusian Road, Singapore Applicant after: Alibaba Innovation Co. Country or region after: Singapore Address before: Room 01, 45th Floor, AXA Building, 8 Shanton Road, Singapore Applicant before: Alibaba Singapore Holdings Ltd. Country or region before: Singapore |
|
| TA01 | Transfer of patent application right | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |