CN110572715A

CN110572715A - Method for solving problem of webp blockage during Android TV playing

Info

Publication number: CN110572715A
Application number: CN201910906636.5A
Authority: CN
Inventors: 熊俊; 宗超东
Original assignee: Sichuan Changhong Electric Co Ltd
Current assignee: Sichuan Changhong Electric Co Ltd
Priority date: 2019-09-24
Filing date: 2019-09-24
Publication date: 2019-12-13
Anticipated expiration: 2039-09-24
Also published as: CN110572715B

Abstract

The invention discloses a method for solving the problem that Android TV plays webbp morton, which comprises the steps of calling a decoding module to decode a webbp dynamic graph, carrying out secondary processing on decoded data to obtain original frame data, and transmitting the frame data to a data display module for rendering. Based on the construction of the decoding module and the display module, on the basis of solving the problem that the existing webp dynamic image playing card is dune, the problems of strong invasiveness and large volume of the existing webp framework are solved, and a non-invasive solution is provided. The playing and rendering effect of the webp dynamic image is greatly improved, and the phenomenon that the playing of the webp dynamic image is blocked and dropped is avoided.

Description

Method for solving problem of webp blockage during Android TV playing

Technical Field

the invention relates to the technical field of Android dynamic picture processing and rendering, in particular to a method for solving the problem that Android TV plays webbp morton.

Background

At present, the development and popularity of the Android system are very high, but the hardware resources of the television system are relatively lagged compared with those of a mobile phone system. How to add complex animation and reduce the volume of Android application under the limited hardware condition becomes a problem to be solved urgently. Through analysis and comparison of the current mainstream motion picture and video format, the webp motion picture can effectively reduce the Android application volume and highly restore the animation effect.

meanwhile, the Android system does not have a perfect solution for webp playing at present, the Android native control does not support a webp moving picture, a mainstream Fresco picture playing frame is large in frame integration volume, fine-grained control cannot be performed on playing, decoding and rendering processes are performed through the soc, the burden of the soc is increased, the frame rate of playing cannot be guaranteed, the situations of too low frame rate, frame loss and the like occur, the rendering effect is poor, and mosaics easily occur on parts such as gradual color change and the like.

Through the generation and decoding analysis of Google on the webp, the decoding and rendering of the webp to a screen, and the synchronization of a decoding thread and a rendering thread occupy much time. Therefore, the method has the advantages that due to the fact that the soc resources are limited, the webp playing is redesigned and optimized, the task of rendering part is handed to the GPU, the calculation amount of the soc is reduced, meanwhile, the characteristic of strong calculation capacity of the GPU is utilized, and the playing effect and the fluency of the webp dynamic graph are optimized.

disclosure of Invention

The invention aims to provide a method for solving the problem that Android TV plays webp morton, so that the rendering workload of soc is reduced under the condition of limited hardware resources, and the smooth playing of webp is realized.

In order to achieve the technical effects, the invention provides the following technical scheme:

A method for solving the problem of webbp morton playing of an Android TV is characterized by comprising the following steps:

(1) Decoding the webp dynamic graph by using a webp animation decoding library;

(2) and rendering and displaying the data decoded by the webp animation decoding library by using the webp animation rendering library.

the further technical scheme is that the webp animation rendering library in the step (2) adopts a GPU rendering mode.

The further technical scheme is that the step (1) specifically comprises the following steps: and transmitting the image data to a decoding library for decoding, and processing the decoded frame data, wherein the processing specifically comprises removing redundant frame information and processing pixel data, so that the pixel data can be adaptive to OpenGL ES texture generation.

The further technical scheme is that the decoded frame data does not generate a Bitmap image, but directly uses the pixel data for rendering.

the technical scheme is that the step (2) specifically includes providing a rendering drawing surface through surface View, generating OpenGL ES textures on pixel information decoded by a webp animation decoding library, then transferring a GPU by the webp animation rendering library to perform rendering operation, and storing decoded pixel data in a native memory without converting the decoded pixel data into a traditional Bitmap.

First, the scheme for playing the webp map provided by Google is introduced. So completes the decoding work mainly through libframesequence. And after the Android main thread refreshes the current frame, the decoding thread is notified to decode the next frame. The problem with this solution is that the tv soc has limited performance, and when the task currently handled by the soc is heavy, the decoding and rendering of a frame cannot be completed within 40ms, and a stuck-down frame phenomenon occurs.

Based on the above analysis of the protocol, the time consumption is mainly found in two places, respectively:

(1) The native layer carries out webp frame decoding, and the decoding time usually consumes 5 ms-15 ms;

(2) The Android main thread renders, the process takes longer time, and especially under the condition that the soc is busy, the process usually takes 20-40 ms to render and exchange foreground and background buffers.

Aiming at the analysis of the decoding and rendering process, the invention adopts the following technical scheme to play the webp motion picture:

in a first aspect, the present invention provides a decoding scheme, called a webp animation decoding library, which mainly aims to perform redundancy removal on data decoded from a webp animation to obtain pure pixel information, so that the pure pixel information can be directly used for rendering of a display module. Compared with the method for generating the Bitmap after the libframe sequence decoding, the Bitmap is directly generated after the pixel data is decoded, the Bitmap generation is not performed on the pixel data after the decoding, the Bitmap is used as the heavy-weight metadata, so that the cost of soc and the memory is quite large, and the optimized scheme is to avoid the Bitmap operation. Frame data decoded by the decoding library is directly put into a native memory, so that Bitmap generation time and memory copy time are saved.

in a second aspect, the present invention provides a module for displaying original pixel data after decoding an anchor graph, referred to as a webp animation rendering library, where the anchor graph includes: the webp map. And the motion picture display module is responsible for moving the decoding module to decode, the decoding module returns the pixel data of the frame and the display TimeStamp of the next frame, and the next frame is rendered and displayed when the display TimeStamp of the next frame is reached. And the motion picture display module is also responsible for rendering and displaying the pixel data returned by the decoding module, wherein the pixel data returned after decoding is pure pixel data, the decoded frame data is filled into a buffer of a native surface to generate an OpenGL ES texture, and an OpenGL ES is directly adopted to operate a GPU rendering pipeline for rendering instead of the traditional ImageView rendering. Compared with ImageView, the method can effectively improve the rendering effect, relieve the work of soc, put more computing power in the decoding process and send the rendering task to the GPU for processing.

Compared with the prior art, the invention has the following beneficial effects: the method decodes the webb dynamic image by calling the decoding module, performs secondary processing on the decoded data to obtain original frame data, and transmits the frame data to the data display module for rendering. Based on the construction of the decoding module and the display module, on the basis of solving the problem that the existing webp dynamic image playing card is dune, the problems of strong invasiveness and large volume of the existing webp framework are solved, and a non-invasive solution is provided. The playing and rendering effect of the webp dynamic image is greatly improved, the phenomenon that the playing of the webp dynamic image is blocked and dropped is avoided, the overall quality of application is improved, the resource occupation of the soc is reduced, and the flow degree of the system is improved. Leading to a better visual effect experience.

Drawings

FIG. 1 is a flow chart before redesign of an optimized decoding rendering;

FIG. 2 is a diagram of a decoding rendering framework after optimization.

Detailed Description

The invention will be further explained and explained with reference to the drawings and the embodiments.

FIG. 1 is a flow chart of the process before redesign of the optimal decoding rendering, where the darkened ellipses are identified as time consuming process-intensive, requiring optimization of the part.

FIG. 2 is a diagram of a decoding rendering framework after optimization, mainly describing the workflow of the decoding module and the rendering module.

Example 1

As shown in fig. 2, this embodiment provides a method for solving the problem of webbp morton playing of an Android TV, which specifically includes:

(1) And (4) transmitting the webp dynamic graph path to a decoding module for decoding. The decoding module is packaged with a pixel processing and memory operation part, the LibFrames sequence is called by the decoding module for decoding, and frame information data can be obtained after decoding is completed. The decoding module processes the frame information data, removes redundant information, and performs data conversion to obtain pixel data which can be used for a subsequent display rendering module.

(2) Defining a surface View, a GLSL shader renderer and an EGL rendering thread, wherein the step mainly provides a rendering window for a rendering module. Meanwhile, a playing mode and a playing monitor can be set, and the rendering module can call back the corresponding monitoring function when the playing is finished.

(3) And transmitting the surface of the SurfaceView to a display rendering module, filling pixel data into a Buffer of the native surface by the display rendering module, generating corresponding texture through OpenGL ES, and transmitting the texture to a GPU rendering pipeline for rendering.

Although the present invention has been described herein with reference to the illustrated embodiments thereof, which are intended to be preferred embodiments of the present invention, it is to be understood that the invention is not limited thereto, and that numerous other modifications and embodiments can be devised by those skilled in the art that will fall within the spirit and scope of the principles of this disclosure.

Claims

1. A method for solving the problem of webbp morton playing of an Android TV is characterized by comprising the following steps:

(1) Decoding the webp dynamic graph by using a webp animation decoding library;

2. The method for solving the problem of webbp blockage in Android TV playing according to claim 1, wherein the step (1) is specifically as follows: and transmitting the image data to a decoding library for decoding, and processing the decoded frame data, wherein the processing specifically comprises removing redundant frame information and processing pixel data, so that the pixel data can be adaptive to OpenGL ES texture generation.

3. The method for resolving webbp stuck of Android TV playing of claim 2, wherein the decoded frame data does not generate a Bitmap image, but directly uses pixel data for rendering.

4. The method for solving the problem of webp morton playing of Android TVs as claimed in claim 1, wherein the webp animation rendering library in the step (2) adopts a GPU rendering mode.

5. The method for solving the problem of webbp stuck of Android TV playing according to claim 1, wherein the step (2) is specifically to provide a rendering drawing surface through SurfaceView, generate OpenGL ES textures for the pixel information decoded by the webp animation decoding library, then transfer a GPU to perform rendering operation by the webp animation rendering library, and store the decoded pixel data in a native memory without conversion into a traditional Bitmap.