WO2019170110A1

WO2019170110A1 - Image rendering method and related product

Info

Publication number: WO2019170110A1
Application number: PCT/CN2019/077196
Authority: WO
Inventors: 舒茧
Original assignee: Oppo广东移动通信有限公司
Priority date: 2018-03-09
Filing date: 2019-03-06
Publication date: 2019-09-12
Also published as: CN108509240A; CN108509240B

Abstract

Disclosed in the embodiments of the present application are an image rendering method and a related product. The method is used in a mobile terminal, the mobile terminal running a GL thread invoked by a graphics splicing program interface OpenGL ES and a working thread other than the GL thread, the method comprising: the working thread writes image data of a target image to a graphic buffer; the working thread encapsulates the image data written to the graphic buffer into a texture map texture format recognised by the GL thread; and the GL thread uses image data of said texture format to execute a rendering operation on a target image. The embodiments of the present application help solve the problem of image display jamming, improving the image rendering speed of the mobile terminal, and reducing the time consumption of image rendering.

Description

Picture drawing method and related products

Technical field

The present application relates to the field of mobile terminal technologies, and in particular, to a picture drawing method and related products.

Background technique

With the rapid development of related technologies of mobile terminals (for example, smart phones), more and more applications are installed in mobile terminals, such as camera applications, payment applications, etc., with the improvement of people's living standards, people The use of camera-like applications is becoming more frequent.

At present, in camera applications, people have higher and higher performance requirements for album display. However, when the amount of data displayed on a picture is large or there are many pictures displayed at the same time, how to improve the display speed of the picture and solve the picture display card The phenomenon has become an urgent problem to be solved.

Summary of the invention

The embodiment of the present application provides a picture drawing method and related products, which can solve the problem of the picture display, improve the speed of drawing the picture of the mobile terminal, and reduce the time taken for the picture drawing.

In a first aspect, the embodiment of the present application provides a picture drawing method, which is applied to a mobile terminal, where the mobile terminal runs a GL thread invoked by a graphics splicing program interface OpenGL ES and a working thread other than the GL thread, Methods include:

The worker thread writes image data of the target picture to the graphics buffer Graphic Buffer;

The worker thread encapsulates the image data written in the Graphic Buffer into a texture map Texture format recognized by the GL thread;

The GL thread uses image data of the Texture format to perform a drawing operation for the target picture.

In a second aspect, the embodiment of the present application provides a picture drawing apparatus, which is applied to a mobile terminal, where the mobile terminal runs a GL thread invoked by a graphics splicing program interface OpenGL ES and a working thread other than the GL thread, The picture drawing device includes a writing unit, a packaging unit, and an execution unit, wherein

The writing unit is configured to control the working thread to write image data of the target picture to the graphics buffer Graphic Buffer;

The encapsulating unit is configured to control the working thread to encapsulate the image data written in the Graphic Buffer into a texture map Texture format recognized by the GL thread;

The execution unit is configured to control the GL thread to use image data of the Texture format to perform a drawing operation for the target image.

In a third aspect, an embodiment of the present application provides a mobile terminal, including a processor, a memory, a communication interface, and one or more programs, where the one or more programs are stored in the foregoing memory, and are configured by the foregoing processing. Executing, the above program includes instructions for performing the steps in any of the methods of the first aspect of the embodiments of the present application.

In a fourth aspect, the embodiment of the present application provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program for electronic data exchange, wherein the computer program causes the computer to execute the embodiment of the present application. Some or all of the steps described in either method.

In a fifth aspect, an embodiment of the present application provides a computer program product, where the computer program product includes a non-transitory computer readable storage medium storing a computer program, the computer program being operative to cause a computer to perform the implementation as in the present application. Some or all of the steps described in any of the methods of the first aspect. The computer program product can be a software installation package.

DRAWINGS

The drawings referred to in the embodiments of the present application will be briefly described below.

1A is a schematic structural diagram of a smart phone according to an embodiment of the present application;

1B is a diagram showing an example of a code running space of a smart phone according to an embodiment of the present application;

1C is a structural diagram of a display system in an Android system according to an embodiment of the present application;

2 is a schematic flowchart of a picture drawing method according to an embodiment of the present application;

3 is a schematic flow chart of a picture drawing method disclosed in an embodiment of the present application;

4 is a schematic flow chart of a picture drawing method disclosed in an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a mobile terminal according to an embodiment of the present disclosure;

FIG. 6A is a block diagram showing the functional units of a picture drawing apparatus disclosed in an embodiment of the present application; FIG.

FIG. 6B is a block diagram showing the functional unit composition of another picture drawing apparatus disclosed in the embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present application. It is a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

The terms "first", "second" and the like in the specification and claims of the present application and the above drawings are used to distinguish different objects, and are not intended to describe a specific order. Furthermore, the terms "comprises" and "comprising" and "comprising" are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or device that comprises a series of steps or units is not limited to the listed steps or units, but optionally also includes steps or units not listed, or alternatively Other steps or units inherent to these processes, methods, products, or equipment.

References to "an embodiment" herein mean that a particular feature, structure, or characteristic described in connection with the embodiments can be included in at least one embodiment of the present application. The appearances of the phrases in various places in the specification are not necessarily referring to the same embodiments, and are not exclusive or alternative embodiments that are mutually exclusive. Those skilled in the art will understand and implicitly understand that the embodiments described herein can be combined with other embodiments.

The mobile terminal involved in the embodiments of the present application may include various handheld devices having wireless communication functions, in-vehicle devices, wearable devices, computing devices, or other processing devices connected to the wireless modem, and various forms of user devices (User Equipment, UE), mobile station (MS), terminal device, and the like. For convenience of description, the devices mentioned above are collectively referred to as mobile terminals. The embedded operating system involved in the embodiments of the present invention is a software system that uniformly manages hardware resources and provides a service interface to users.

For example, FIG. 1A is a schematic structural diagram of a smart phone 100 according to an embodiment of the present application. The smart phone 100 includes a housing 110, a touch display screen 120, and a main board 130. The battery 140 and the sub-board 150 are provided with a front camera 131, a processor 132, a memory 133, a power management chip 134, a radio frequency system 135, etc., and the sub-board is provided with a vibrator 151, an integrated sound chamber 152, and a VOOC flash. Charge interface 153.

The processor is a control center for a smartphone that connects various portions of the entire smartphone using various interfaces and lines, by running or executing software programs and/or modules stored in memory 133, and recalling stored in memory 133. Data, perform various functions of the smartphone and process data to monitor the smartphone as a whole. The processor may include one or more processing units, such as an integrated application processor AP and a baseband processor (also known as a baseband chip, baseband), etc., wherein the application processor mainly processes an operating system, a user interface, an application, and the like. The baseband processor primarily handles wireless communications. It can be understood that the above baseband processor may also not be integrated into the processor. The processor can be, for example, a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), and a field programmable gate. Field Programmable Gate Array (FPGA) or other programmable logic device, transistor logic device, hardware component, or any combination thereof. It is possible to implement or carry out the various illustrative logical blocks, modules and circuits described in connection with the present disclosure. The above processors may also be a combination of computing functions, such as one or more microprocessor combinations, a combination of a DSP and a microprocessor, and the like.

The memory 133 can be used to store software programs and modules that execute various functional applications and data processing of the smartphone by running software programs and modules stored in the memory 133. The memory 133 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function, and the like; the storage data area may store data created according to usage of the smartphone or the like. Further, the memory 133 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. The memory 133 can be, for example, a random access memory (RAM), a flash memory, a read only memory (ROM), an erasable programmable read only memory (EPROM), and an electrically erasable memory. Programmable EPROM (EEPROM), registers, hard disk, removable hard disk, compact disk read only (CD-ROM) or any other form of storage medium known in the art.

FIG. 1B is a diagram showing an example of a code running space of a smart phone provided by an embodiment of the present application. Currently, a mobile terminal such as a smart phone is generally provided with a program running space, where the program running space includes a user space and an operating system space, wherein the user space There are one or more applications running, the one or more applications are third-party applications installed for the mobile terminal, and the operating system space runs an operating system with the mobile terminal. The mobile terminal can specifically run the Android Android system, the mobile operating system iOS developed by Apple, etc., and is not limited herein.

Taking the above-mentioned mobile terminal running Android system as an example, the Android system includes a display system. The architecture of the display system is as shown in FIG. 1C. The display system includes an interface drawing service (SurfaceFlinger) and a graphic splicing program interface (OpenGL for Embedded Systems, OpenGL). ES), EGL interface, localization window NativeWindow and hardware abstraction layer Gralloc. Among them, the SurfaceFlinger holds a GraphicPlane member variable to describe the display, and an instance of the display hardware DisplayHardware object. OpenGL ES is an interface protocol, a general-purpose function library that needs to be "localized" on different platform systems - that is, it is associated with a window system on a specific platform to ensure that it works properly. Among them, NativeWindow is the window that localizes OpenGL ES on the Android platform, and the EGL interface is the intermediate adaptation translation layer for configuring the local window for OpengGL ES.

In the general design, taking the business displayed by the photo album of the mobile terminal as an example, in the embedded system, the display of the photo album includes the uploading and writing operation of the photo data, the drawing operation of the photo, the display operation of the photo, etc., wherein the photo data is The upload operation is performed by using the related function in OpenGL ES to call the GL thread. In the case where the amount of photo data displayed is large or the number of photos displayed at the same time is large, it is performed by OpenGL ES. When the photo data is uploaded and written, the GL thread will be blocked, causing serious jamming of the photo display, and the display speed is slow. When the photo is dynamically modified, the modified data needs to be re-uploaded to The display of OpenGL ES further causes the blocking of the GL thread. In fact, the uploading and writing operation of the photo data does not need to pass the function in OpenGL ES, but the drawing operation of the photo must use the related function in OpenGL ES, so In response to this situation, the following application is made for the business displayed in the album.

For the above situation, the embodiment of the present application provides a picture drawing method for a mobile terminal, where the mobile terminal runs a GL thread invoked by a graphics splicing program interface OpenGL ES and a working thread other than the GL thread. The worker thread writes the image data of the target picture to the graphics buffer Graphic Buffer; the worker thread encapsulates the image data written in the Graphic Buffer into a texture map Texture format recognized by the GL thread; the GL thread The image data of the Texture format is used to perform a drawing operation for the target picture. The problem of the card display displayed in the picture is solved, which is beneficial to improving the speed of drawing the picture of the mobile terminal and reducing the time taken for drawing the picture.

The embodiments of the present application are described below with reference to the accompanying drawings.

Referring to FIG. 2, FIG. 2 is a schematic flowchart diagram of a method for drawing a picture, which is applied to a mobile terminal, where the mobile terminal runs a GL thread invoked by a graphics splicing program interface OpenGL ES and the GL thread. The working thread outside, as shown in the figure, the drawing method of this picture includes:

S201. The worker thread writes image data of the target picture into a graphics buffer, a Graphic Buffer.

Among them, the graphics splicing interface OpenGL ES is the OpenGL version for embedded systems.

The triggering condition that the working thread writes the image data of the target image into the graphic buffer of the graphic buffer may be various, for example, the display operation of any program may be detected for any image, or the album may be detected. The operation of generating a new picture for the modification of a certain picture is not limited herein.

The working thread of the mobile terminal detects the display operation for the target picture and the image data of the target picture sent by the upper application, before the image data of the target picture is written into the graphic buffer. The format of the image data is a bitmap file Bitmap.

The working thread for executing the image data of the target picture to be written into the Graphic Buffer operation may be one, or multiple working threads may divide the image data into regions, and jointly perform the writing of the image data into the Graphic Buffer operation, and do not do this. limited.

The image buffer may be created by a GL thread, or may be created by a worker thread, and is not limited herein.

In a possible example, the front end of the mobile terminal runs an album application, and the running interface of the photo album application includes a multi-image display interface, and the number of photos to be displayed in the multi-image display interface is greater than a preset number threshold. .

The foreground is running an application that the photo album application displays for the current display screen, and an application that the current user is operating.

The multi-picture display interface may be an annual photo display interface in the album, and the number of the photos may be ten sheets, one hundred sheets, one thousand sheets, etc., which are not limited herein.

It can be seen that, in this example, when the photo album application is run in the foreground of the mobile terminal, and the running interface includes the multi-image display interface, the image drawing method is used to execute the image data writing operation by using the working thread, which is beneficial to improving the multi-picture and simultaneously displaying the scene. The display speed, solve the picture shows the Karton problem.

S202. The worker thread encapsulates the image data written in the Graphic Buffer into a texture map Texture format recognized by the GL thread.

In one possible example, the worker thread encapsulates the image data written in the Graphic Buffer into a Texture Map Texture format recognized by the GL thread, including:

The worker thread encapsulates the image data written in the Graphic Buffer into image data having an EGLImage format recognized by an EGL interface;

The worker thread encapsulates the image data having the EGLImage format into image data having the Texture format recognized by the GL thread.

Wherein, the format of the plurality of data modules that complete the data writing operation is the Graphic Buffer image data recognized by the localization window NativeWindow, and then the Texture data format recognized by the GL thread, so in the data encapsulation process, as shown in FIG. 1C, first The Graphic Buffer image data is encapsulated into image data of the EGLImage format recognized by the intermediate adaptation translation layer EGL interface, and then the image data of the EGLImage format is encapsulated into a Texture data format recognized by the GL thread.

It can be seen that, in this example, the mobile terminal masquerades the image data of the working thread to complete the data writing operation through the data encapsulation as the Texture data format that can be recognized by the GL thread, and tricks the GL thread to perform image drawing operation on the image data, which is beneficial to realize. The thread-sharing operation of the data write operation and the image drawing operation solves the blocking problem of the GL thread.

S203. The GL thread uses the image data of the Texture format to perform a drawing operation for the target picture.

The GL thread obtains the image data of the Texture format encapsulated by the worker thread, and performs a drawing operation on the image data by using a dedicated function in the OpenGL ES.

It can be seen that, in the embodiment of the present application, the working thread of the mobile terminal first writes the image data of the target image into the graphics buffer, and second, the worker thread encapsulates the image data written in the Graphic Buffer into the The texture map texture format recognized by the GL thread, and finally, the GL thread uses the image data of the Texture format to perform a drawing operation for the target picture. It can be seen that since the data write operation does not need to call OpenGL ES to implement, the mobile terminal separates the time-consuming data write operation from the GL thread called by OpenGL ES, and is completed by other worker threads, improving the GL thread. The blocking problem is beneficial to improve the drawing speed of the GL thread and reduce the drawing time of the image, and the OpenGL ES calls the GL thread to only recognize the specified Texture format when performing the drawing operation on the image data, so the data writing operation is completed. After that, the data format is changed to the Texture format by data encapsulation without changing the data, which solves the problem of realizing the picture drawing operation after the data writing operation is separated, and realizes the data writing operation and the picture drawing operation. The successful separation effectively solves the problem of stuck in the picture drawing operation.

In one possible example, before the GL thread uses the image data of the Texture format to perform a drawing operation for the target image, the method further includes:

The worker thread sends an address identifier of the image data of the Texture format to the GL thread, and the address identifier is used by the GL thread to use image data of the Texture format according to an address obtained by identifying the address identifier.

It can be seen that in this example, the worker thread sends the address identifier of the image data encapsulated in the Texture format to the GL thread, so that the GL thread can conveniently find the image data to be drawn instead of sending the image data to the fixed data of the GL thread. In the address, it helps to reduce data consumption and reduce power consumption.

In one possible example, the worker thread writes image data of the target picture to the graphics buffer, including:

The worker thread acquires the image data in a format of a bitmap file Bitmap;

The worker thread creates the Graphic Buffer that matches the amount of data of the image data;

The worker thread writes the image data in the format of a bitmap file Bitmap to the Graphic Buffer.

The larger the data volume of the image data is, the larger the graphics buffer area is created, and the relationship between the data volume and the size of the Graphic Buffer can be set by the development staff according to experience before leaving the factory.

It can be seen that in this example, the worker thread first creates the Graphic Buffer with the data amount matching in the write operation, instead of randomly creating the fixed size Graphic Buffer, which is beneficial to improve the utilization of the memory cache, and the Graphic Buffer is created by the worker thread. , further reducing the burden of the GL thread, effectively solving the blocking problem of the GL thread.

The worker thread acquires the image data in a format of a bitmap file Bitmap;

The worker thread writes the image data in the format of the bitmap file Bitmap to the Graphic Buffer created by the GL thread.

It can be seen that, in this example, the worker thread writes the image data to the Graphic Buffer created by the GL thread, instead of creating the Graphic Buffer by the worker thread, which reduces the time consumption of the GL thread to find the data after the data is written, which is beneficial to the improvement. The speed at which the GL thread draws the target image.

In one possible example, the worker thread writes the image data in the format of a bitmap file Bitmap to the Graphic Buffer, including:

The worker thread starts a read-write lock on the Graphic Buffer;

The worker thread writes the image data in the format of a bitmap file Bitmap to the Graphic Buffer;

The worker thread closes the read-write lock.

It can be seen that, in this example, when the calling terminal writes the image data into the buffer area, the mobile terminal starts the read-write lock for the cache area corresponding to the thread, and only starts the read-write lock for the buffer area of the data written by the thread, which is beneficial to the mobile terminal. Improve the data write success rate of the thread. When the read-write lock is started, the read-write lock is not started for the overall cache area created by the GL thread, and the data of the different mobile areas is modified for the later mobile terminal, without all data being required. The rewrite operation is beneficial to increase the speed of data modification after writing.

FIG. 3 is a schematic flowchart of a picture drawing method according to an embodiment of the present disclosure, which is applied to a mobile terminal, where the mobile terminal runs a graphic splicing program interface. The GL thread called by OpenGL ES and the worker thread other than the GL thread. As shown in the figure, the drawing method of this picture includes:

S301. The worker thread acquires image data in a format of a bitmap file Bitmap.

S302. The worker thread creates a graphics buffer, a Graphic Buffer, that matches the amount of data of the image data.

S303. The worker thread writes the image data in the format of a bitmap file Bitmap to the Graphic Buffer.

S304. The worker thread encapsulates the image data written in the Graphic Buffer into image data having an EGLImage format recognized by an EGL interface.

S305. The worker thread encapsulates the image data having the EGLImage format into image data having a Texture format recognized by the GL thread.

S306. The worker thread sends an address identifier of the image data in the Texture format to the GL thread.

S307. The GL thread uses the image data of the Texture format according to the address obtained by identifying the address identifier to perform a drawing operation for the target picture.

In addition, the worker thread first creates a Graphic Buffer that matches the data amount in the write operation, instead of creating a fixed-size Graphic Buffer at will, which is beneficial to improve the utilization of the memory cache, and the Graphic Buffer is created by the worker thread, which further reduces the The burden of the GL thread effectively solves the blocking problem of the GL thread.

In addition, the mobile terminal masquerades the image data of the working thread to complete the data writing operation through the data package as the Texture data format that can be recognized by the GL thread, and tricks the GL thread to perform image drawing operation on the image data, which is beneficial to the data writing operation. The thread-sharing operation with the image drawing operation solves the blocking problem of the GL thread, and sends the address identifier of the image data encapsulated in the Texture format to the GL thread, so that the GL thread can conveniently find the image data to be drawn instead of Image data is sent to the fixed data address of the GL thread, which helps to reduce data consumption and reduce power consumption.

FIG. 4 is a schematic flowchart of a picture drawing method according to an embodiment of the present disclosure, which is applied to a mobile terminal, where the mobile terminal runs a graphic splicing program interface. The GL thread called by OpenGL ES and the worker thread other than the GL thread. As shown in the figure, the drawing method of this picture includes:

S401. When the foreground of the mobile terminal runs an album application, the worker thread acquires image data in a format of a bitmap file Bitmap.

The running interface of the photo album application includes a multi-image display interface, and the number of photos to be displayed in the multi-image display interface is greater than a preset number threshold.

S402. The GL thread creates a graphics buffer, and sends an address identifier of the Graphic Buffer to the worker thread.

S403. The worker thread writes the image data in the format of a bitmap file Bitmap to the Graphic Buffer.

S404. The worker thread encapsulates the image data written in the Graphic Buffer into image data having an EGLImage format recognized by an EGL interface.

S405. The worker thread encapsulates the image data having the EGLImage format into image data having a Texture format recognized by the GL thread.

S406. The worker thread sends an address identifier of the image data in the Texture format to the GL thread.

S407. The GL thread uses the image data of the Texture format according to an address obtained by identifying the address identifier to perform a drawing operation for the target picture.

In addition, when the photo album application is run in the foreground of the mobile terminal, and the running interface includes the multi-image display interface, the image drawing method is used to execute the image data writing operation by using the working thread, which is beneficial to improving the display speed of the multi-picture simultaneous display scene. Solve the picture display card problem, and write the image data to the Graphic Buffer created by the GL thread, instead of creating the Graphic Buffer by the worker thread, which reduces the time consumption of the GL thread to find the data after the data is written, which is beneficial to improve The speed at which the GL thread draws the target image.

With reference to the embodiment shown in FIG. 2, FIG. 3, and FIG. 4, please refer to FIG. 5. FIG. 5 is a schematic structural diagram of a mobile terminal according to an embodiment of the present application, where the mobile terminal runs a graphics splicing program. a GL thread invoked by the interface OpenGL ES and a worker thread other than the GL thread, and the mobile terminal runs one or more applications and an operating system, as shown, the mobile terminal includes a processor, a memory, a communication interface and one or more programs, wherein the one or more programs are different from the one or more applications, and the one or more programs are stored in the memory and configured to be executed by the processor The above program includes instructions for performing the following steps;

Controlling the worker thread to write image data of the target picture to the graphics buffer Graphic Buffer;

Controlling the worker thread to encapsulate the image data written in the Graphic Buffer into a texture map Texture format recognized by the GL thread;

The GL thread is controlled to use the image data of the Texture format to perform a drawing operation for the target picture.

In one possible example, in controlling the worker thread to encapsulate the image data written in the Graphic Buffer into a texture map Texture format recognized by the GL thread, the instructions in the program are specifically used to perform the following Operation: controlling the worker thread to encapsulate the image data written in the Graphic Buffer into image data having an EGLImage format recognized by an EGL interface; and controlling the worker thread to encapsulate the image data having the EGLImage format Image data having the Texture format identified for the GL thread.

In this possible example, the above program further includes instructions for: controlling the GL thread to control the worker thread before using the image data of the Texture format to perform a drawing operation for the target picture An address identifier of the image data of the Texture format is sent to the GL thread, and the address identifier is used by the GL thread to use image data of the Texture format according to an address obtained by identifying the address identifier.

In one possible example, in controlling the worker thread to write image data of the target picture to the graphics buffer Graphic Buffer, the instructions in the program are specifically configured to: control the worker thread to acquire the format as a bit The image data of the map file Bitmap; and the Graphic Buffer for controlling the worker thread to match the data amount of the image data; and for controlling the worker thread to use the format as a bitmap file Bitmap The image data is written to the Graphic Buffer.

In one possible example, in controlling the worker thread to write image data of the target picture to the graphics buffer Graphic Buffer, the instructions in the program are specifically configured to: control the worker thread to acquire the format as a bit And the image data of the map file Bitmap; and the graphic buffer for controlling the working thread to write the image data of the bitmap file Bitmap to the GL thread.

In one possible example, in controlling the worker thread to write the image data of the format bitmap file Bitmap to the Graphic Buffer, the instructions in the program are specifically configured to perform the following operations: controlling the work. Threading a read/write lock to the Graphic Buffer; and controlling the worker thread to write the image data of the format bitmap file Bitmap to the Graphic Buffer; and for controlling the worker thread to close the read Write a lock.

The above description mainly introduces the solution of the embodiment of the present application from the perspective of the method side execution process. It can be understood that, in order to implement the above functions, the mobile terminal includes corresponding hardware structures and/or software modules for performing various functions. Those skilled in the art will readily appreciate that the present application can be implemented in a combination of hardware or hardware and computer software in combination with the elements and algorithm steps of the various examples described in the embodiments disclosed herein. Whether a function is implemented in hardware or computer software to drive hardware depends on the specific application and design constraints of the solution. A person skilled in the art can use different methods for each particular application to implement the described functionality, but such implementation should not be considered to be beyond the scope of the application.

The embodiment of the present application may divide the functional unit into the mobile terminal according to the foregoing method example. For example, each functional unit may be divided according to each function, or two or more functions may be integrated into one processing unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logical function division. In actual implementation, there may be another division manner.

In the case of employing an integrated unit, FIG. 6A shows a block diagram of a possible functional unit composition of the picture drawing device involved in the above embodiment. The picture drawing device 600 is applied to a mobile terminal running a GL thread called by a graphics splicing program interface OpenGL ES and a working thread other than the GL thread, the picture drawing device 600 including a writing unit 601, and a package Unit 602 and execution unit 603, wherein

The writing unit 601 is configured to control the working thread to write image data of the target picture to the graphics buffer Graphic Buffer;

The encapsulating unit 602 is configured to control the working thread to encapsulate the image data written in the Graphic Buffer into a texture map Texture format recognized by the GL thread;

The executing unit 603 is configured to control the GL thread to use the image data of the Texture format to perform a drawing operation for the target picture.

In one possible example, the encapsulating unit 602 is specifically configured to: control the control unit, by controlling the working thread to encapsulate the image data written in the Graphic Buffer into a texture map texture format recognized by the GL thread. The worker thread encapsulates the image data written in the Graphic Buffer into image data having an EGLImage format recognized by an EGL interface; and is configured to control the worker thread to encapsulate the image data having the EGLImage format into the GL Thread-recognized image data having the Texture format.

In this possible example, as shown in FIG. 6B, the picture drawing device 600 further includes a transmitting unit 604, where

The sending unit 604 is configured to: after the execution unit controls the GL thread to use the image data of the Texture format to perform a drawing operation for the target image, control the working thread to use the image data of the Texture format. The address identifier is sent to the GL thread, and the address identifier is used by the GL thread to use image data of the Texture format according to an address obtained by identifying the address identifier.

In one possible example, the writing unit 601 is specifically configured to: control the working thread to acquire a bitmap file as a bitmap file, by controlling the working thread to write the image data of the target image to the graphics buffer. The image data; and the Graphic Buffer for controlling the worker thread to match the data amount of the image data; and image data for controlling the worker thread to format the bitmap as a bitmap file Write to the Graphic Buffer.

In one possible example, the writing unit 601 is specifically configured to: control the working thread to acquire a bitmap file as a bitmap file, by controlling the working thread to write the image data of the target image to the graphics buffer. And the image data for controlling the worker thread to write the image data of the bitmap file Bitmap to the Graphic Buffer created by the GL thread.

In one possible example, the writing unit 601 is specifically configured to: control the working thread pair to control the working thread to write the image data of the bitmap file Bitmap to the Graphic Buffer. The Graphic Buffer starts a read/write lock; and is configured to control the worker thread to write the image data of the format bitmap file Bitmap to the Graphic Buffer; and to control the worker thread to close the read/write lock.

It should be noted that the picture drawing device described in the device embodiment of the present application is presented in the form of a functional unit. The term "unit" as used herein shall be understood to mean the broadest possible meaning, and the object for implementing the functions described for each "unit" may be, for example, an integrated circuit ASIC, a single circuit for executing one or more software or firmware. A processor (shared, dedicated or chipset) and memory of the program, combinatorial logic, and/or other suitable components that perform the functions described above.

Specifically, the above writing unit 601, encapsulating unit 602, and executing unit 603 may be processors of the mobile terminal, and the transmitting unit 604 may be an internal communication interface.

The embodiment of the present application further provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, the computer program causing the computer to perform some or all of the steps of any of the methods described in the foregoing method embodiments. The above computer includes a mobile terminal.

The embodiment of the present application further provides a computer program product, where the computer program product comprises a non-transitory computer readable storage medium storing a computer program, the computer program being operative to cause the computer to execute any one of the methods described in the foregoing method embodiments. Part or all of the steps of the method. The computer program product can be a software installation package, and the computer includes a mobile terminal.

It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present application is not limited by the described action sequence. Because certain steps may be performed in other sequences or concurrently in accordance with the present application. In the following, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

In the above embodiments, the descriptions of the various embodiments are different, and the details that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.

In the several embodiments provided herein, it should be understood that the disclosed apparatus may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the above units is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or integrated. Go to another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical or otherwise.

The units described above as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The above-described integrated unit can be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a standalone product. Based on such understanding, the technical solution of the present application, in essence or the contribution to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a memory. A number of instructions are included to cause a computer device (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the above-described methods of various embodiments of the present application. The foregoing memory includes: a U disk, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk, and the like, which can store program codes.

A person skilled in the art can understand that all or part of the steps of the foregoing embodiments can be completed by a program to instruct related hardware, and the program can be stored in a computer readable memory, and the memory can include: a flash drive Read-Only Memory (ROM), Random Access Memory (RAM), disk or optical disk.

The embodiments of the present application have been described in detail above. The principles and implementations of the present application are described in the specific examples. The description of the above embodiments is only used to help understand the method and core ideas of the present application. A person of ordinary skill in the art, in view of the idea of the present application, is subject to change in the specific embodiments and the scope of application. In the above, the content of the present specification should not be construed as limiting the present application.

Claims

A picture drawing method is applied to a mobile terminal, wherein the mobile terminal runs a GL thread called by a graphics splicing program interface OpenGL ES and a working thread other than the GL thread, and the method includes:

The worker thread writes image data of the target picture to the graphics buffer Graphic Buffer;

The worker thread encapsulates the image data written in the Graphic Buffer into a texture map Texture format recognized by the GL thread;

The GL thread uses image data of the Texture format to perform a drawing operation for the target picture.
The method according to claim 1, wherein the worker thread encapsulates the image data written in the Graphic Buffer into a Texture Map Texture format recognized by the GL thread, comprising:

The worker thread encapsulates the image data written in the Graphic Buffer into image data having an EGLImage format recognized by an EGL interface;

The worker thread encapsulates the image data having the EGLImage format into image data having the Texture format recognized by the GL thread.
The method according to claim 2, wherein before the GL thread uses the image data of the Texture format to perform a drawing operation for the target picture, the method further comprises:

The worker thread sends an address identifier of the image data of the Texture format to the GL thread, and the address identifier is used by the GL thread to use image data of the Texture format according to an address obtained by identifying the address identifier.
The method according to any one of claims 1-3, wherein the worker thread writes image data of the target picture to the graphics buffer, including:

The worker thread acquires the image data in a format of a bitmap file Bitmap;

The worker thread creates the Graphic Buffer that matches the amount of data of the image data;

The worker thread writes the image data in the format of a bitmap file Bitmap to the Graphic Buffer.
The method according to any one of claims 1-3, wherein the worker thread writes image data of the target picture to the graphics buffer, including:

The worker thread acquires the image data in a format of a bitmap file Bitmap;

The worker thread writes the image data in the format of the bitmap file Bitmap to the Graphic Buffer created by the GL thread.
The method according to claim 4 or 5, wherein the worker thread writes the image data in the format of the bitmap file Bitmap to the Graphic Buffer, including:

The worker thread starts a read-write lock on the Graphic Buffer;

The worker thread writes the image data in the format of a bitmap file Bitmap to the Graphic Buffer;

The worker thread closes the read-write lock.
The method according to any one of claims 1-6, wherein the foreground of the mobile terminal runs an album application, and the running interface of the album application comprises a multi-picture display interface, and the multi-picture display interface The number of photos to be displayed is greater than the preset number threshold.
The method according to any one of claims 1 to 7, wherein the worker thread writes the image data of the target picture to the graphics buffer before the graphic buffer, the method further includes:

Detecting a to-be-displayed operation for the target picture in the album application;

The worker thread receives the image data from the target picture of the album application, the format of the image data being the bitmap file Bitmap.
The method according to any one of claims 1-8, wherein the GL thread uses the image data of the Texture format to perform a drawing operation for the target picture, including:

The GL thread acquires image data of the Texture format that is encapsulated by the worker thread;

The GL thread performs a drawing operation on the image data of the Texture format through a first function in the OpenGL ES.
A picture drawing device, which is applied to a mobile terminal, wherein the mobile terminal runs a GL thread called by a graphics splicing program interface OpenGL ES and a working thread other than the GL thread, and the picture drawing device includes writing Into the unit, the encapsulation unit and the execution unit, wherein

The writing unit is configured to control the working thread to write image data of the target picture to the graphics buffer Graphic Buffer;

The encapsulating unit is configured to control the working thread to encapsulate the image data written in the Graphic Buffer into a texture map Texture format recognized by the GL thread;

The execution unit is configured to control the GL thread to use image data of the Texture format to perform a drawing operation for the target image.
The apparatus according to claim 10, wherein said encapsulating unit is specific in controlling said worker thread to encapsulate said image data written in said Graphic Buffer into a texture map Texture format recognized by said GL thread For controlling the worker thread to encapsulate the image data written in the Graphic Buffer into image data having an EGLImage format recognized by an EGL interface; and for controlling the worker thread to use the image data having the EGLImage format Encapsulating image data having the Texture format identified by the GL thread.
The device according to claim 11, wherein the picture drawing device further comprises a transmitting unit, wherein

The sending unit, configured to: after the execution unit controls the GL thread to use the image data of the Texture format to perform a drawing operation for the target image, control the working thread to image data of the Texture format. An address identifier is sent to the GL thread, the address identifier being used by the GL thread to use image data of the Texture format according to an address obtained by identifying the address identifier.
The device according to any one of claims 10 to 12, wherein in the controlling the working thread to write the image data of the target picture to the graphic buffer, the writing unit is specifically used for: The worker thread acquires the image data in the format of a bitmap file Bitmap; and the graphic buffer for controlling the worker thread to match the data amount of the image data; and for controlling the worker thread to The image data in the format of the bitmap file Bitmap is written to the Graphic Buffer.
The device according to any one of claims 10 to 12, wherein in the controlling the working thread to write the image data of the target picture to the graphic buffer, the writing unit is specifically used for: The worker thread obtains the image data in the format of a bitmap file Bitmap; and controls the worker thread to write the image data in the format of the bitmap file Bitmap to the Graphic Buffer created by the GL thread.
The device according to claim 13 or 14, wherein the writing unit is specifically configured to: when the working thread is controlled to write the image data of the format bitmap file Bitmap to the Graphic Buffer: Controlling the worker thread to initiate a read/write lock on the Graphic Buffer; and controlling the worker thread to write the image data of the format bitmap file Bitmap to the Graphic Buffer; and for controlling the worker thread Turn off the read-write lock.
The device according to any one of claims 10-15, wherein the foreground of the mobile terminal runs an album application, and the running interface of the album application comprises a multi-image display interface, and the multi-image display interface The number of photos to be displayed is greater than the preset number threshold.
The device according to any one of claims 10 to 16, wherein the writing unit is further configured to: detect that the image data of the target picture is written to the graphic buffer before the working thread a to-be-displayed operation of the target picture in the photo album application; controlling the worker thread to receive the image data of the target picture from the photo album application, the format of the image data being the bitmap file Bitmap.
The apparatus according to any one of claims 10-17, wherein the execution unit is specifically configured to use image data of the Texture format to perform a drawing operation for the target picture. Controlling, by the GL thread, image data of the Texture format encapsulated by the worker thread; and controlling the GL thread to perform rendering on the image data of the Texture format by using a first function in the OpenGL ES operating.
A mobile terminal, comprising a processor, a memory, the memory storing a program, the processor for calling the program to perform the method according to any one of claims 1-9.
A computer readable storage medium, wherein the computer readable storage medium stores a computer program for electronic data exchange, wherein the computer program causes the computer to perform the method of any one of claims 1-9 method.