WO2018214779A1

WO2018214779A1 - Rendering method and device

Info

Publication number: WO2018214779A1
Application number: PCT/CN2018/086784
Authority: WO
Inventors: 李利民; 郑剑杰
Original assignee: 阿里巴巴集团控股有限公司
Priority date: 2017-05-24
Filing date: 2018-05-15
Publication date: 2018-11-29
Also published as: CN108965975B; CN108965975A; TW201901610A

Abstract

A rendering method and device are disclosed in the present application. An electronic device provided in the present application comprises a first processor and a second processor. A first processor obtains images that are used for interface display; from among said images, the first processor converts the 2D texture data of images that have like properties into corresponding 3D texture data; and, sends the 3D texture data to a second processor. On the basis of an image to be rendered, the second processor obtains from the 3D texture data 2D texture data of the image to be rendered and, on the basis of the obtained 2D texture data, renders the image to be rendered. The present application allows for batch process-rendering of images, thereby increasing rendering efficiency.

Description

Drawing method and device

The present application claims the priority of the Japanese Patent Application Serial No. PCT Application No. No. No. No. No. No. No. No. No.

Technical field

The present application relates to the field of computer image processing technologies, and in particular, to a drawing method and apparatus.

Background technique

In order to ensure the rendering performance of the smart TV interface and the clarity of the interface, the interface drawing of the smart TV is usually performed by a graphics processing unit (GPU) dedicated to image processing in the smart television. The GPU is based on the Open Graphics Library (OpenGL) for interface rendering. OpenGL provides a variety of graphics processing functions. The graphics processing software can implement interface rendering by calling these functions.

The interface usually includes a plurality of display objects, and one display object occupies a certain display area. For example, an interface for displaying a movie list may include a publicity picture of a plurality of movies, and each picture is a display object. When drawing the interface, you need to draw separately for each image. The drawing process for a picture generally includes: the CPU in the smart TV acquires a picture for displaying in the movie list interface from the network side, and generates basic data for performing picture drawing based on the acquired picture and a preset interface layout. And transfer the basic data to the GPU in the smart TV; the GPU draws the movie list interface by calling the basic data by calling OpenGL according to the drawing logic provided by the graphics processing software. The above process is called a drawing process. The basic data used for image drawing may include vertex data of the display area where the image is located, texture coordinate data of the area where the image is located, and texture data of the image, and may further include illumination data, a scene matrix, and the like.

Every drawing process requires the CPU to transfer basic data to the GPU. Due to the limited data transmission bandwidth between the CPU and the GPU, the GPU cannot perform its proper processing performance and becomes a bottleneck for interface rendering. To this end, the prior art proposes a batch processing scheme: for a display object in which a plurality of basic data are the same (except vertex data and texture coordinate data), the CPU transmits the basic data of the plurality of display objects to the GPU at a time, so that the GPU will be more The secondary rendering process is combined to reduce the impact of the data transfer bandwidth between the CPU and the GPU on rendering efficiency.

However, the above batch scheme needs to meet certain conditions, that is, the basic data except the vertex data and the texture coordinate data are the same to merge the drawing processes of the plurality of display objects. In some application scenarios, the above conditions cannot be met in most cases (for example, in a smart TV application scenario, the texture of each picture in an interface is different), so the above batch scheme cannot be adopted.

It can be seen that how to improve the drawing efficiency is a technical problem that needs to be solved at present.

Summary of the invention

The embodiment of the present application provides a drawing method and device for improving drawing efficiency.

In a first aspect, an electronic device is provided, comprising:

The first processor obtains a picture for the interface display, converts the 2D texture data of the attribute-related picture in the picture for the interface display into corresponding 3D texture data, and sends the 3D texture data to the second process. The second processor obtains 2D texture data of the to-be-drawn picture from the 3D texture data according to the picture to be drawn, and draws the picture to be drawn according to the acquired 2D texture data.

In a second aspect, a processing apparatus is provided, comprising:

Obtaining a unit, acquiring a picture for displaying the interface; and a data processing unit, converting the 2D texture data of the attribute-related picture in the picture for displaying the interface into corresponding 3D texture data; and sending, sending the 3D texture data .

In a third aspect, a processing apparatus is provided, comprising:

a receiving unit that receives 3D texture data of an attribute-related image, where the 3D texture data is transformed by 2D texture data of the attribute-related picture; and a data processing unit that acquires the 3D texture data according to the picture to be drawn 2D texture data of the picture to be drawn; a drawing unit that draws the picture to be drawn according to the acquired 2D texture data.

In a fourth aspect, a method of drawing is provided, including:

Obtaining a picture for the interface display; converting the 2D texture data of the attribute-related picture in the picture for the interface display into corresponding 3D texture data; and transmitting the 3D texture data.

In a fifth aspect, a method of drawing is provided, including:

Receiving 3D texture data of the attribute-related picture, the 3D texture data being transformed by the 2D texture data of the attribute-related picture; acquiring 2D texture data of the to-be-drawn picture in the 3D texture data according to the picture to be drawn And drawing the picture to be drawn according to the acquired 2D texture data.

In a sixth aspect, an electronic device is provided, including:

The first processor obtains a picture for the interface display, and transforms the first dimension texture data of the attribute-related picture in the picture for the interface display into the corresponding second dimension texture data, and the second dimension texture The data is sent to the second processor, and the second processor obtains the first dimension texture data of the to-be-drawn picture from the second dimension texture data according to the picture to be drawn, and draws the first dimension texture data according to the acquired The picture to be drawn.

In a seventh aspect, a method of drawing is provided, comprising:

Obtaining a unit, acquiring a picture for displaying the interface; and a data processing unit, converting the first dimension texture data of the attribute-related picture in the picture for displaying the interface into the corresponding second dimension texture data; sending unit, sending station The second dimension texture data.

In an eighth aspect, a processing apparatus is provided, comprising:

a receiving unit, configured to receive second dimension texture data of the attribute-related image, where the second dimension texture data is transformed by the first dimension texture data of the attribute-related image; and the data processing unit acquires the image according to the image to be drawn a first dimension texture data of the to-be-drawn picture in the second dimension texture data; a rendering unit that draws the to-be-drawn picture according to the acquired first dimension texture data.

In a ninth aspect, a drawing method is provided, comprising:

Obtaining a picture for the interface display; converting the first dimension texture data of the attribute-related picture in the picture for the interface display to the corresponding second dimension texture data; and transmitting the second dimension texture data.

In a tenth aspect, a drawing method is provided, comprising:

Receiving second dimension texture data of the attribute-related picture, the second dimension texture data being transformed by the first dimension texture data of the attribute-related picture; acquiring the second dimension texture data according to the picture to be drawn Depicting the first dimension texture data of the picture; and drawing the picture to be drawn according to the acquired first dimension texture data.

In an eleventh aspect, there is provided one or more computer readable medium having stored thereon instructions that, when executed by one or more processors, cause an electronic device to perform the fourth or ninth aspect described above The method provided.

In a twelfth aspect, there is provided one or more computer readable medium having stored thereon instructions that, when executed by one or more processors, cause an electronic device to perform the fifth or tenth aspect described above The method provided.

In the foregoing embodiment of the present application, in one aspect, the first processor transforms the 2D texture data of the attribute-related picture for the interface display into the corresponding 3D texture data, such as adding a new dimension to the 3D texture data. In order to identify the picture, so that the attribute-related pictures have the same 3D texture data, which satisfies the requirements of the batch processing scheme, a batch processing scheme can be adopted, thereby improving the drawing efficiency.

DRAWINGS

The embodiments of the present application are illustrated by way of example and not limitation, and the

FIG. 1 exemplarily shows a schematic diagram of a system architecture to which an embodiment of the present application is applied;

FIG. 2 exemplarily shows another system architecture diagram applicable to the embodiment of the present application;

FIG. 3A exemplarily shows an interface diagram in the present application;

FIG. 3B exemplarily shows another interface diagram in the present application;

FIG. 3C exemplarily shows another interface diagram in the present application;

FIG. 3D exemplarily shows another interface diagram in the present application;

FIG. 3E exemplarily shows another interface diagram in the present application; FIG.

FIG. 3F exemplarily shows another interface diagram in the present application; FIG.

FIG. 3G exemplarily shows another interface diagram in the present application;

FIG. 4 is a schematic structural diagram of a television apparatus according to an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a television apparatus according to an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a processing apparatus provided by an embodiment of the present application;

FIG. 7 is a schematic diagram showing another structure of a processing apparatus provided by an embodiment of the present application;

FIG. 8 is a schematic diagram showing an interface drawing process provided by an embodiment of the present application;

FIG. 9 exemplarily shows a schematic diagram of the principle of 3D texture data in the embodiment of the present application.

detailed description

While the concept of the present application is susceptible to various modifications and alternatives, the specific embodiments thereof are illustrated by the examples in the drawings and will be described in detail herein. It should be understood, however, that the invention is not intended to be limited to the details of the invention.

References to "an embodiment", "an embodiment", "an illustrative embodiment" or the like in the specification are intended to mean that the described embodiments may include specific features, structures, or characteristics, but each embodiment may or may not necessarily include a particular Feature, structure or characteristic. Moreover, such phrases are not necessarily referring to the same embodiments. Further, it is to be understood that the specific features, structures, or characteristics may be combined with other embodiments, whether explicitly described or not, in conjunction with the embodiments. In addition, it should be understood that items included in the list in the form of "at least one of A, B, and C" may represent (A); (B); (C); (A and B); (A and C) ; (B and C); or (A, B and C). Similarly, items listed in the form of "at least one of A, B or C" may represent (A); (B); (C); (A and B); (A and C); (B and C) or (A, B and C).

In some cases, the disclosed embodiments can be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments can also be implemented as instructions carried or stored by one or more transitory or non-transitory machine readable (eg, computer readable) storage media, which can be read by one or more processors And execution. A machine-readable storage medium may be embodied in any storage device, mechanism or other physical structure for storing or transmitting information in a machine readable form (eg, a volatile or nonvolatile memory, media disk or other medium). ).

In the figures, some structural or method features may be shown in a particular arrangement and/or order. However, it should be understood that such specific arrangements and/or ordering may not be required. Rather, in some embodiments, these features may be arranged in a different and/or sequential manner than shown in the illustrative figures. In addition, the inclusion of structural or method features in a particular figure is not meant to imply that such a feature is required in all embodiments, and may not include or be combined with other features in some embodiments.

As described in the background art, a batch processing scheme can be used to improve drawing efficiency when performing object drawing. However, the batch processing needs to meet certain conditions, that is, the drawing process of multiple objects can be combined except that the data other than the vertex data and the texture coordinate data are the same, which requires the objects to be drawn to be different except for the position. Other data (such as texture data, scene matrix, etc.) must be the same. In some scenarios, especially in the field of smart TV, in the interface displayed by the smart TV (such as the resource list interface), other attributes of different areas are the same except for the pictures displayed in different areas. However, because the images displayed in different regions are different, the OpenGL texture data of different regions is different, and the above batch processing scheme cannot be adopted. That is to say, the drawing process of each region requires a data transmission from the CPU to the GPU. The picture in each display area in each frame of the interface needs to perform data transmission from the CPU to the GPU, resulting in low rendering efficiency.

To this end, the embodiment of the present application transforms texture data of one dimension (referred to as first dimension texture data for convenience) into texture data of another dimension (referred to as second dimension texture data for convenience), so that The second dimensional texture data obtained after the conversion satisfies the batch processing requirements, so that batch processing technology can be used to improve the drawing efficiency.

Without loss of generality, the second dimension texture data has a higher dimension than the first dimension texture data, and the newly added dimension can be used to identify the image. For example, the first dimensional texture data may be 2D texture data (2D texture data), and the second dimensional texture data may be 3D texture data. By transforming 2-dimensional texture data (2D texture data) into 3-dimensional texture data (3D texture data), the newly added dimension is used to identify the image, so that multiple attributes can be correlated (such as the same size) but the texture data is different. The texture data is unified into the 3D texture data corresponding to the set of pictures, so that it meets the batch processing requirements, so that the batch processing technology can be used for drawing, thereby improving the drawing efficiency. Of course, the first dimension texture data and the second dimension texture data are not limited to the above 2D texture data and 3D texture data, and may also be texture data of other dimensions, as long as the first dimension texture data is transformed into the second dimension texture data. , can meet the batch processing requirements, use batch processing technology to improve the drawing efficiency, are within the protection scope of this application.

The embodiments of the present application are described in detail below with reference to the accompanying drawings. The 2D texture data in the following embodiments may be replaced with the above-described first dimensional texture data, and the 3D texture data may be replaced with the above second texture data, unless otherwise stated.

FIG. 1 exemplarily shows a system architecture to which the embodiment of the present application is applied. As shown in the figure, the architecture may include: a television device 101 and a server 103. Television device 101 and server 103 can communicate information over network 104.

The television device 101 can be a smart TV with digital signal processing capabilities and supports 3D texture processing capabilities, such as OpenGL technology that supports OpenGL ES version 3.0 or higher. The user can control the television device 101 through the remote controller, and the user also directly controls the television device through the function keys provided by the television device 101. The server 103 stores a resource list (such as an electronic program guide), and the TV device 101 can be provided with a resource list to cause the television device 101 to draw an interface according to the resource list for the user to select a program to be viewed according to the interface.

Considering that some TV devices do not have digital signal encoding and decoding functions, they need to receive numbers through a Digital Video Converter (STB, commonly referred to as a set-top box or set-top box, which is a device that connects a TV to an external source). The content (for example, may include an electronic program guide, an Internet webpage, a subtitle, etc.), is decoded and transmitted to a television device for interface drawing and display, and may also send user interaction information to the network side to implement an interactive service. FIG. 2 exemplarily shows a system architecture including a digital video conversion box to which the embodiment of the present application is applied. In this architecture, the television device 101' is connected to the digital video conversion box 102, and the digital video conversion box 102 is connected to the server 103 via the network 104. The digital video converter box can also convert the received video digital signal into an analog signal and transmit it to the television device for playback.

It should be noted that the above FIG. 1 and FIG. 2 are described by taking a television device as an example, and the above television device can be replaced with any other electronic device having similar functions.

Taking the system architecture shown in FIG. 1 as an example, in an application scenario, a user requests a list of resources, such as a movie list, through a remote controller. After receiving the request, the television device 101 acquires a movie list from the server 103 via the network 104 (the movie list includes content such as a movie picture), and performs interface rendering according to the obtained movie list, and the drawn interface includes a movie picture. The television device 101 displays the drawn interface containing the movie picture on the screen of the television device 101 for the user to select the movie to be played.

At present, in the resource list interface displayed by the television device, the pictures corresponding to the resources are arranged in a regular manner, for example, the sizes are basically the same, the arrangement is relatively neat, and the classification is relatively clear. 3A to 3G exemplarily show several interface forms adopted by current smart televisions. Taking the interface shown in FIG. 3A as an example, the interface includes nine object display areas (object display area 1 to object display area 9), and the object display area 1 and the object display area 2 have the same display object size, and the object display area 4 Pictures (picture 1 to picture 7) are respectively displayed in the object display area 9, and the pictures are the same size. The correspondence between the pictures 1 to 7 and the object display area can be set in advance.

These kinds of interface forms basically cover the display style of the current smart TV interface. The embodiments of the present application are applicable to the drawing process of the above various forms of interfaces.

FIG. 4 exemplarily shows a schematic structural diagram of a television device related to an embodiment of the present application. As mentioned previously, the television device can also be replaced with other electronic devices having similar functions. The following is only a description of a television device.

The television device shown in FIG. 4 includes at least two processors, specifically a first processor 401 and a second processor 402 as shown in the figure. Further, the television device may further include a display device.

The first processor 401 is mainly used for logic control, and can send data for interface rendering to the second processor 402, and can control the second processor to perform interface rendering. The second processor can perform interface drawing. The drawn interface can be output to the display device for display.

Specifically, the first processor 401 is configured to acquire a picture for interface display sent by the server, convert 2D texture data of the picture related to the picture attribute for the interface display into corresponding 3D texture data, and send the 3D texture data. The second processor 402 is provided. The second processor 402 is configured to acquire 2D texture data of the to-be-drawn picture from the 3D texture data according to the picture to be drawn, and draw the picture to be drawn according to the acquired 2D texture data.

The image related to the attribute may be a group of pictures of the same size, and may also be a group of pictures with the same or related attributes. One dimension in the 3D texture data can be used to identify a picture.

The first processor may be a CPU, and the second processor may be a GPU. Taking the first processor as the CPU and the second processor as the GPU, the CPU runs the OpenGL main program to control the interface drawing process, and the GPU runs the shader program to implement the interface drawing process.

Based on the principle shown in FIG. 4, FIG. 5 exemplarily shows the structure of an electronic device such as a television device. At least 2 processors may be included in the electronic device. In this example, two processors (5021, 5022) are taken as an example, wherein the first processor 5021 may be a CPU, and the second processor 5022 may be a GPU. System control logic 501 is coupled to at least one processor (5021, 5022), non-volatile memory (NMV)/memory 504 is coupled to system control logic 501, and network module or network interface 506 is coupled to system control logic 501.

System control logic 501 in one embodiment may include any suitable interface controller to provide any suitable interface to at least one of first processor 5021 or second processor 5022, and/or to the system Any suitable interface of any suitable device or component that controls logic 501 to communicate.

System control logic 501 in one embodiment may include one or more memory controllers to provide an interface to system memory 503. System memory 503 is used to load and store data and/or instructions. For example, in response to an electronic device, in one embodiment, system memory 503 can include any suitable volatile memory.

NVM/memory 504 can include one or more tangible, non-transitory computer readable media for storing data and/or instructions. For example, NVM/memory 504 can include any suitable non-volatile storage device, such as one or more hard disk devices (HDDs), one or more compact disks (CDs), and/or one or more Digital versatile disk (DVD).

The NVM/memory 504 can include a storage resource that is physically part of the device that the system is installed on or can be accessed, but is not necessarily part of the device. For example, NVM/memory 504 can be accessed by the network via a network module or network interface 506.

System memory 503 and NVM/memory 504 can each include a copy of temporary or persistent instructions 510. The instructions 510 can include instructions that, when executed by at least one of the first processor 5021 or the second processor 5022, cause the electronic device to implement one or a combination of the methods described in the embodiments of the present application. In various embodiments, instructions 510 or hardware, firmware, and/or software components may additionally/alternatively be placed in system control logic 501, network module or network interface 506 and/or processor (5021, 5022).

The network module or network interface 506 can include a receiver to provide a wireless interface for the electronic device to communicate with one or more networks and/or any suitable device. Network module or network interface 506 can include any suitable hardware and/or firmware. The network module or network interface 506 can include multiple antennas to provide a multiple input multiple output wireless interface. In one embodiment, the network module or network interface 506 can include a network adapter, a wireless network adapter, a telephone modem, and/or a wireless modem.

In one embodiment, at least one of the processors (5021, 5022) may be packaged with logic for one or more controllers of the system control logic. In one embodiment, at least one of the processors may be packaged with logic for one or more controllers of system control logic to form a system level package. In one embodiment, at least one of the processors can be integrated on the same die as the logic of one or more controllers for system control logic. In one embodiment, at least one of the processors can be integrated on the same die as the logic of one or more controllers for system control logic to form a system chip.

The electronic device can further include an input/output device 505. Input/output device 505 can include a user interface intended to enable a user to interact with the electronic device, can include a peripheral component interface designed to enable peripheral components to interact with the system, and/or can include sensors for determining an environment Conditions and/or location information about the electronic device.

Based on the structure shown in FIG. 4 or FIG. 5, FIG. 6 exemplarily shows the structure of a processing apparatus. The processing device can be an application applied to the first processor. As shown, the processing device may include an obtaining unit 601, a data processing unit 602, and a transmitting unit 603.

The obtaining unit 601 is configured to acquire a picture for interface display, and the data processing unit 602 is configured to transform the 2D texture data of the attribute-related picture in the picture for the interface display into the corresponding 3D texture data. The sending unit 603 is configured to send the 3D texture data, and specifically, the 3D texture data may be sent to the second processor.

Based on the structure shown in Fig. 4 or Fig. 5, Fig. 7 exemplarily shows the structure of another processing apparatus. The processing device can be an application that is applied to the second processor. As shown, the processing device may include a receiving unit 701, a data processing unit 702, and a rendering unit 703.

The receiving unit 701 is configured to receive 3D texture data of an attribute-related picture, where the 3D texture data is transformed by 2D texture data of the attribute-related picture, wherein one dimension of the 3D texture data can be used to identify a picture. The data processing unit 702 is configured to acquire 2D texture data of the to-be-drawn picture in the 3D texture data according to the picture to be drawn. The drawing unit 703 is configured to draw the picture to be drawn according to the acquired 2D texture data.

FIG. 8 exemplarily shows an interface drawing process provided by an embodiment of the present application. As shown in the figure, after the television device is started, a picture for the interface display can be obtained from the server on the network side, and the interface is drawn, and the drawn interface is displayed. The interface displayed after the TV device is started is generally referred to as a desktop, and may include a plurality of object display areas, and an object display area may display a picture, and each object display area may be triggered to perform a corresponding function. For example, taking the interface shown in FIG. 3A as an example, when an object in the object display area (a picture in this example) is triggered (for example, the user selects a picture in the display area through a remote controller), playing the object corresponding to the object the film.

As shown in FIG. 8, the above interface drawing process may include:

S801: The first processor acquires a picture for displaying the interface.

In a scenario in which the television device is booted, in some embodiments based on the architecture shown in FIG. 1, the OpenGL main program running in the first processor establishes a connection with the server on the network side through the network module of the television device, and requests the server to transmit The image displayed on the interface. In some embodiments based on the architecture shown in FIG. 2, the digital video transform box establishes a connection with the network side server, and sends the picture sent by the network side server for the interface display to the first processor in the television device.

Usually, the interface displayed by the television device can include multiple pages (the user can page through the page turning function keys such as "previous page" and "next page" in the interface). The interface displayed by the TV device can also contain only one page but its length exceeds the height of the screen display area. It can be scrolled (for example, the user can move the key content through the “Up/Down” or “Left/Right” keys of the remote control. Scroll forward and backward to display. Since the interface can include a large number of pictures, the process of sending pictures by the network side server occupies more network resource overhead and affects the picture transmission efficiency. In addition, the process of drawing the interface by the television device also occupies a large amount of system overhead, which takes a long time and affects. User experience. Therefore, in the embodiment of the present application, the server may first send a part of the picture for the interface display to the television device, and then send the corresponding picture to the television device according to the request of the user when the user requests other interfaces or requests other parts of the interface. The server may first send a picture in the interface displayed by default after the television device is started or a N (N is an integer greater than or equal to 1) picture in the interface in the interface to the television device. The value of N can be preset, and can generally be set according to the processing capability of the television device (such as drawing capability).

After receiving the picture sent by the server for interface display, the first processor may store the picture and/or the index of the picture in the memory of the first processor. The index of the image is used to uniquely identify a picture.

The above S801 may be specifically performed by the first processor or by a processing device (such as an application) applied to the first processor. More specifically, it can be performed by the acquisition unit 601 in FIG.

S802: The first processor transforms the 2D texture data of the attribute-related picture in the picture for the interface display into the corresponding 3D texture data.

As mentioned before, the attribute related picture can be a set of pictures of the same size and size. Optionally, after the first processor obtains the image sent by the server for the interface display, the acquired image may be grouped according to the size of the image, and the size of the image in the same group is the same. The first processor converts the 2D texture data of the set of pictures into 3D texture data corresponding to the set of pictures for each picture group, and sends the 3D texture data corresponding to each set of pictures to the second processor.

Optionally, in order to prevent the processing efficiency from decreasing due to the excessive number of pictures in one picture group, the maximum number of pictures in one picture group may be preset, and the number of pictures in each picture group does not exceed the maximum picture number. If the number of pictures of the same size exceeds the maximum number of pictures, it is divided into multiple picture groups.

2D texture data is actually a two-dimensional array whose elements are some color values. The first processor may generate 2D texture data of the picture according to the color value of each pixel in the received picture. In S802, the converted 3D texture data includes first dimension data, second dimension data, and third dimension data. The third dimension is a newly added dimension based on the 2D texture data, and the third dimension data is used to identify the image. For example, the third dimension data can be an index of the picture. In the converted 3D texture data, the first dimension data and the second dimension data corresponding to one third dimension data are the first dimension data and the second dimension data in the 2D texture data of the image identified by the third dimension data. .

For example, FIG. 9 exemplarily shows a schematic diagram of the principle of converting 3D texture data from 2D texture data in the embodiment of the present application. As shown in the figure, the pictures 1 to 8 are the same size, and the 2D texture data of each picture includes the s dimension and the t dimension, and the s dimension and the t dimension are the color values of the picture in the horizontal direction and the vertical direction, respectively. The r dimension is added to the 3D texture data converted from the 2D texture data of the picture 1 to the picture 8. The data of the r dimension is used to identify the picture 1 to the picture 8, and specifically may be an index of the picture.

By converting the 2D texture data of the same set of pictures into the 3D texture data corresponding to the set of pictures, the set of pictures corresponds to the same 3D texture data, so that for the drawing of the set of pictures, batch processing technology can be adopted. achieve.

Further, the interface layout related information is pre-stored in the memory of the first processor, and the interface layout related information defines the attributes of the interface (such as size, length and width ratio) and the position of each object display area in the interface, and may also define an interface. Each object displays an object that needs to be displayed in the area. For example, taking the interface shown in FIG. 3A as an example, the interface layout related information of the interface defines the position of each object display area (object display area 1 to object display area 9) in the interface, and the display of each object. The index of the image displayed by the area. The first processor may obtain vertex data of each object display area in the interface according to the interface layout related information (the object display area in FIG. 3A is a rectangle, including 4 vertices).

Further, texture coordinate data of each object display area in the interface is stored in advance in the memory of the first processor. The texture coordinates are simply the texture data to the target primitive surface map.

The above S801 may be specifically performed by the first processor or by a processing device (such as an application) applied to the first processor. More specifically, it can be performed by data processing unit 602 in FIG.

S803: The first processor sends the 3D texture data to the second processor.

In this step, the first processor may combine the 3D texture data processed in S802 and other data used for interface drawing (such as vertex data, texture coordinate data, illumination data, scene matrix, etc. of each object display area). And transmitting the merged data to the second processor according to a data transfer protocol with the second processor. The data such as the illumination data and the scene matrix may be preset in the memory of the first processor.

The above S803 may be specifically performed by the first processor or by a processing device (such as an application) applied to the first processor. More specifically, it can be performed by the transmitting unit 603 in FIG.

S804: After receiving the data for interface rendering, such as 3D texture data, the second processor acquires 2D texture data of the image to be drawn in the 3D texture data according to the image to be drawn, and according to the acquired 2D texture. The data is drawn to the picture to be drawn.

Optionally, in a specific implementation, after transmitting, by the first processor, data for interface rendering, such as 3D texture data, to the second processor, the first processor may send a drawing instruction to the second processor. A picture to be drawn in the interface or interface to be displayed by the second processor may be indicated by a drawing instruction. The drawing instruction may include indication information of the picture to be drawn in the interface to be displayed. The second processor may determine a picture to be drawn in the area according to the indication information of the picture to be drawn in the drawing instruction. The indication information of the picture to be drawn may be an index of the picture to be drawn. The indication information of the image to be drawn may also be an index of the display area of the object to be drawn. In this case, the correspondence between the object display area and the index of the picture may be preset, so that the second processor may be based on the object to be drawn. The index of the display area determines the index of the corresponding picture, and the third dimension data in the 3D texture data is queried according to the index of the picture, and the first dimension data and the second dimension data of the picture to be drawn are obtained, that is, the 3D texture data is obtained. The 2D texture data of the picture needs to be drawn. Further, the second processor may be configured according to the 2D texture data of the image to be displayed, and combined with other data (such as vertex data of the object display area to be drawn, texture coordinate data, and illumination data, scene matrix, etc.) The image in the object display area is drawn.

Taking the interface shown in FIG. 3A as an example, since the sizes of the pictures 2 to 7 are the same, the 2D texture data corresponding to the pictures 2 to 7 can be converted into the 3D texture data corresponding to the set of pictures, and sent to the second. The processor is configured to enable the second processor to draw the picture 2 to the picture 7 in the corresponding object display area based on the 3D texture data in one drawing process, that is, to implement batch processing.

Optionally, if the second processor receives the plurality of 3D texture data corresponding to the plurality of picture groups from the first processor, the picture group in which the picture to be drawn is located may be determined when the picture to be drawn is drawn. The 2D texture data of the picture to be drawn is obtained in the 3D texture data corresponding to the picture group in which the picture is located, thereby realizing picture drawing.

The above S804 may be specifically performed by the second processor or by a processing device (such as an application) applied to the first processor. More specifically, it can be performed by the receiving unit 701, the data processing unit 702, and the drawing unit 703 in FIG. 7, respectively.

Through the above process, after the television device is started, a picture for interface drawing can be obtained from the server for interface drawing, and the drawn interface is displayed on the screen of the television device. Subsequently, if the user issues a request for page up or down or a request to scroll the interface, or requests another interface, the television device may update the currently displayed content in response to the user's request.

For example, in the case that the user issues a page-down request, the first processor may determine the image included in the target page after receiving the request for page-down, and determine whether the image is included in the target page. The 3D texture data of the picture is sent to the second processor; if it has been sent, sending a drawing instruction to the second processor for instructing the second processor to draw the pictures; otherwise, sending a picture acquisition request to the server to request to obtain the a picture, and converting the acquired 2D texture data of the same size picture into 3D texture data, and transmitting the same to the second processor, and sending a drawing instruction to the second processor to indicate the second The processor draws the target page.

For example, in the case of requesting a new interface, the current interface is a movie list interface. After receiving the request for switching to the TV drama list interface, the first processor may determine, for the requested interface, whether the image for the interface display is It has been obtained from the server. If the determination is no, sending a picture acquisition request to the server to request to acquire a picture in the requested interface; otherwise, sending a drawing instruction to the second processor, the drawing instruction is used to instruct the second processor to draw the requested interface .

In some cases, the server on the network side updates the picture used for interface drawing, such as updating the first movie picture in the movie list interface. In this case, the server sends the updated picture to the television device. The first processor in the television device receives the updated picture sent by the server, updates the 3D texture data corresponding to the picture group in which the picture is located according to the 2D texture data of the updated picture, and sends the updated 3D texture data to the second processor. . The first processor may further send a drawing instruction to the second processor, where the drawing instruction includes indication information of the picture to be updated in the interface, to instruct the second processor to update the corresponding picture. The second processor may obtain 2D texture data of the image from the updated 3D texture data according to the indication information of the updated picture in the drawing instruction, and draw the picture according to the 2D texture data.

Based on the same technical concept, the embodiment of the present application further provides one or more computer readable media having instructions stored thereon, when the instructions are executed by one or more processors, such that the electronic device performs the foregoing The drawing method in the embodiment. For example, the electronic device may be caused to execute the method performed by the first processor in the foregoing embodiment, or to perform the method performed by the second processor, or to execute the method performed by the first processor and the second processor.

As can be seen from the above description, in the above embodiment of the present application, on the one hand, the first processor transforms the 2D texture data of the attribute-related picture in the picture for the interface display into the corresponding 3D texture data, thereby satisfying the batch. The requirements of the processing scheme are adopted, so that the batch processing scheme can be adopted, and the 3D texture data corresponding to the multiple pictures is sent to the second processor for picture drawing at a time. On the other hand, the second processor may acquire 2D texture data of the to-be-drawn picture in the to-be-displayed interface in the 3D texture data according to the to-be-drawn picture in the interface to be displayed, and draw the 2D texture data according to the acquired 2D texture data. The picture in the display interface is described, and the batch drawing of the picture is realized, thereby improving the drawing efficiency.

Obviously, those skilled in the art should understand that the above modules or steps of the embodiments of the present invention can be implemented by a general computing device, which can be concentrated on a single computing device or distributed in multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device such that they may be stored in the storage device by the computing device and, in some cases, may be different from The steps shown or described are performed sequentially, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps thereof are fabricated into a single integrated circuit module. Thus, embodiments of the invention are not limited to any specific combination of hardware and software.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various changes and modifications may be made to the embodiments of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

An electronic device, comprising:

The first processor obtains a picture for the interface display, converts the 2D texture data of the attribute-related picture in the picture for the interface display into corresponding 3D texture data, and sends the 3D texture data to the second process. Device

The second processor obtains the 2D texture data of the to-be-drawn picture from the 3D texture data according to the picture to be drawn, and draws the picture to be drawn according to the acquired 2D texture data.
The electronic device of claim 1 wherein one dimension of said 3D texture data is used to identify a picture.
The electronic device according to claim 2, wherein the dimension for identifying the picture in the 3D texture data is a third dimension, the third dimension data is an index of the picture, and the third dimension data is a third The first dimension data and the second dimension data corresponding to the dimension data are first dimension data and second dimension data in the 2D texture data of the image identified by the third dimension data.
The electronic device according to claim 3, wherein the second processor queries the third dimension data in the 3D texture data according to the index of the picture to be drawn, and obtains an index with the picture to be drawn Corresponding first dimension data and second dimension data, obtaining 2D texture data of the to-be-drawn picture in the 3D texture data.
The electronic device according to claim 1, wherein the attribute-related picture is a set of pictures of the same size and size;

After acquiring the picture for the interface display, the first processor further groups the acquired pictures according to the picture size, and the pictures in the same group have the same size;

Converting, by the first processor, 2D texture data of the at least one set of pictures to 3D texture data corresponding to the at least one set of pictures, and mapping the 3D texture data corresponding to the at least one set of pictures to the at least one set of pictures Send to the second processor.
The electronic device according to claim 5, wherein the second processor determines a group of pictures in which the picture to be drawn is located; and obtains from the 3D texture data corresponding to the picture group in which the picture to be drawn is located The 2D texture data of the drawn picture is described.
The electronic device of claim 1 wherein:

The first processor sends a first drawing instruction to the second processor, where the first drawing instruction includes indication information of a picture to be drawn in the interface to be displayed;

The second processor determines the to-be-drawn picture according to the indication information of the picture to be drawn in the first drawing instruction.
The electronic device according to claim 7, wherein the indication information of the picture to be drawn comprises: an index of the picture to be drawn, or an index of the display area of the object to be drawn;

When the indication information of the to-be-drawn picture is an index of the display area of the object to be drawn, the second processor queries the correspondence between the object display area and the image according to the index of the object display area, and obtains the object to be drawn The image to be drawn corresponding to the index of the display area.
The electronic device according to claim 1, wherein the first processor further receives the updated picture, updates the corresponding 3D texture data according to the 2D texture data of the updated picture, and sends the updated 3D texture data to Second processor.
The electronic device according to claim 9, wherein the first processor further sends a second drawing instruction to the second processor, where the second drawing instruction includes indication information of the updated picture;

The second processor further acquires 2D texture data of the updated picture from the updated 3D texture data according to the indication information of the updated picture in the second drawing instruction, according to the acquired 2D texture. The data is drawn to the updated picture.
The electronic device according to claim 1, wherein the first processor sends a picture acquisition request to the server after the electronic device is started or after receiving the interface request;

Receiving a picture for the interface display sent by the server according to the picture acquisition request.
The electronic device according to claim 11, wherein the first processor determines, after receiving the interface request, whether the picture for the interface display has been obtained from the server for the requested interface;

If the determination is no, the image acquisition request is sent to the server, where the image acquisition request is used to request to acquire a picture in the requested interface; otherwise, the first drawing instruction is sent to the second processor, where the first drawing The instructions are for instructing the second processor to draw the requested interface.
The electronic device according to any one of claims 1 to 12, wherein the first processor is a central processor and the second processor is a graphics processor.
The electronic device according to any one of claims 1 to 12, wherein the electronic device is a television device.
A processing device, comprising:

Obtain a unit to obtain a picture for the interface display;

a data processing unit, converting the 2D texture data of the attribute-related picture in the picture for the interface display into corresponding 3D texture data;

a sending unit that transmits the 3D texture data.
The apparatus of claim 15 wherein one dimension of said 3D texture data is used to identify a picture.
The device according to claim 16, wherein the dimension for identifying the picture in the 3D texture data is a third dimension, the third dimension data is an index of the picture, and the third dimension is in the 3D texture data. The first dimension data and the second dimension data corresponding to the data are the first dimension data and the second dimension data in the 2D texture data of the image identified by the third dimension data.
The device according to claim 15, wherein the attribute-related picture is a set of pictures of the same size and size;

After obtaining the picture for the interface display, the data processing unit further groups the acquired pictures according to the picture size, and the pictures in the same group have the same size; and, for at least one set of pictures, the at least one set of pictures Transforming 2D texture data into 3D texture data corresponding to the at least one set of pictures;

The sending unit sends the 3D texture data corresponding to the at least one set of pictures.
The apparatus according to claim 15, wherein the transmitting unit further transmits a first drawing instruction, wherein the first drawing instruction includes indication information of a picture to be drawn.
The device according to claim 19, wherein the indication information of the picture to be drawn comprises: an index of the picture to be drawn, or an index of the display area of the object to be drawn.
The apparatus according to claim 15, wherein said obtaining unit further receives an updated picture;

The data processing unit further updates corresponding 3D texture data according to the 2D texture data of the updated picture;

The transmitting unit further transmits the updated 3D texture data.
The apparatus according to claim 21, wherein the transmitting unit further transmits a second drawing instruction, wherein the second drawing instruction includes indication information of the updated picture.
The device according to claim 15, wherein the obtaining unit sends a picture acquisition request to the server after the electronic device is started or after receiving the interface request; and receiving the server to send according to the picture acquisition request The image used for the interface display.
The device according to claim 23, wherein the obtaining unit determines, after receiving the interface request, whether the picture for the interface display has been obtained from the server for the requested interface; if the determination is no, Sending the picture acquisition request to the server, the picture acquisition request is for requesting to acquire a picture in the requested interface; otherwise, sending a first drawing instruction, the first drawing instruction is used to indicate that the requested interface is drawn.
A processing device, comprising:

a receiving unit, which receives 3D texture data of an attribute-related picture, where the 3D texture data is transformed by 2D texture data of the attribute-related picture;

a data processing unit, configured to acquire 2D texture data of the to-be-drawn picture in the 3D texture data according to a picture to be drawn;

The drawing unit draws the to-be-drawn picture according to the acquired 2D texture data.
The apparatus of claim 25 wherein one dimension of said 3D texture data is used to identify a picture.
The device according to claim 26, wherein the dimension for identifying the picture in the 3D texture data is a third dimension, the third dimension data is an index of the picture, and the third dimension is in the 3D texture data The first dimension data and the second dimension data corresponding to the data are the first dimension data and the second dimension data in the 2D texture data of the image identified by the third dimension data.
The device according to claim 27, wherein the data processing unit queries the third dimension data in the 3D texture data according to the index of the picture to be drawn, and obtains an index corresponding to the index of the picture to be drawn. The first dimension data and the second dimension data obtain 2D texture data of the to-be-drawn picture in the 3D texture data.
The device according to claim 25, wherein the attribute-related picture is a set of pictures related to attributes;

The data processing module determines the group of pictures in which the picture to be drawn is located, and acquires 2D texture data of the picture to be drawn from the 3D texture data corresponding to the picture group in which the picture to be drawn is located.
The device according to claim 25, wherein the receiving unit is further configured to receive a first drawing instruction, where the first drawing instruction includes indication information of the picture to be drawn;

The data processing module determines the to-be-drawn picture according to the indication information of the picture to be drawn in the first drawing instruction.
The device according to claim 30, wherein the indication information of the picture to be drawn comprises: an index of the picture to be drawn, or an index of the display area of the object to be drawn;

When the indication information of the to-be-drawn picture is an index of the display area of the object to be drawn, the data processing module queries the correspondence between the object display area and the image according to the index of the object display area, and obtains the display with the object to be drawn. The index of the area corresponds to the picture to be drawn.
The apparatus according to claim 25, wherein said receiving unit further receives updated 3D texture data, said updated 3D texture data being 2D texture data of an updated picture according to said attribute-related picture Transformed.
The apparatus according to claim 32, wherein the receiving unit further receives a second drawing instruction, wherein the second drawing instruction includes indication information of the updated picture;

The data processing unit further acquires 2D texture data of the updated picture from the updated 3D texture data according to the indication information of the updated picture in the second drawing instruction, according to the acquired 2D The texture data draws the updated picture.
The apparatus according to any one of claims 25 to 33, wherein the attribute-related picture is a set of pictures of the same size and size.
A drawing method, comprising:

Get the image for the interface display;

Converting the 2D texture data of the attribute-related picture in the picture for the interface display into corresponding 3D texture data;

Sending the 3D texture data.
The method of claim 35 wherein one of the 3D texture data is used to identify a picture.
The method according to claim 36, wherein the dimension for identifying the picture in the 3D texture data is a third dimension, the third dimension data is an index of the picture, and the third dimension is in the 3D texture data The first dimension data and the second dimension data corresponding to the data are the first dimension data and the second dimension data in the 2D texture data of the image identified by the third dimension data.
The method according to claim 35, wherein the attribute-related picture is a set of pictures of the same size and size;

Converting the 2D texture data of the attribute-related picture in the picture for the interface display to the corresponding 3D texture data, including:

After obtaining the image for the interface display, the acquired images are grouped according to the image size, and the images in the same group are the same size; and, for at least one set of images, the 2D texture data of the at least one set of images is transformed into 3D texture data corresponding to the at least one set of pictures;

The sending the 3D texture data includes:

Sending 3D texture data corresponding to the at least one set of pictures.
The method of claim 35, further comprising:

Sending a first drawing instruction, where the first drawing instruction includes indication information of a picture to be drawn.
The method according to claim 39, wherein the indication information of the picture to be drawn comprises: an index of the picture to be drawn, or an index of the display area of the object to be drawn.
The method of claim 35, further comprising:

Receive updated pictures;

Updating corresponding 3D texture data according to the 2D texture data of the updated picture;

Send updated 3D texture data.
The method of claim 41, further comprising:

Sending a second drawing instruction, where the second drawing instruction includes indication information of the updated picture.
A drawing method, comprising:

Receiving 3D texture data of an attribute-related picture, the 3D texture data being transformed by 2D texture data of the attribute-related picture;

Obtaining 2D texture data of the to-be-drawn picture in the 3D texture data according to a picture to be drawn;

Drawing the picture to be drawn according to the acquired 2D texture data.
The method of claim 43 wherein one of the 3D texture data is used to identify a picture.
The method according to claim 44, wherein the dimension for identifying the picture in the 3D texture data is a third dimension, the third dimension data is an index of the picture, and the third dimension is in the 3D texture data The first dimension data and the second dimension data corresponding to the data are the first dimension data and the second dimension data in the 2D texture data of the image identified by the third dimension data.
The method according to claim 45, wherein the acquiring the 2D texture data of the to-be-drawn picture in the 3D texture data according to the picture to be drawn comprises:

Querying the third dimension data in the 3D texture data according to the index of the to-be-drawn picture, obtaining first dimension data and second dimension data corresponding to the index of the to-be-drawn picture, and obtaining the 3D texture data The 2D texture data of the drawn picture is described.
The method according to claim 43, wherein the attribute-related picture is a set of pictures of the same size and size;

Obtaining 2D texture data of the to-be-drawn picture in the 3D texture data according to the picture to be drawn, including:

Determining the group of pictures in which the picture to be drawn is located, and acquiring 2D texture data of the picture to be drawn from the 3D texture data corresponding to the picture group in which the picture to be drawn is located.
The method according to claim 43, wherein before the acquiring the 2D texture data of the to-be-drawn picture in the 3D texture data according to the picture to be drawn, the method further comprises:

Receiving a first drawing instruction, where the first drawing instruction includes indication information of a picture to be drawn;

Determining the picture to be drawn according to the indication information of the picture to be drawn in the first drawing instruction.
The method according to claim 48, wherein the indication information of the picture to be drawn comprises: an index of the picture to be drawn, or an index of the display area of the object to be drawn;

When the indication information of the to-be-drawn picture is an index of the display area of the object to be drawn, the determining the picture to be drawn according to the indication information of the picture to be drawn in the first drawing instruction includes:

And according to the index of the object display area, the corresponding relationship between the object display area and the image is obtained, and a picture to be drawn corresponding to the index of the object display area to be drawn is obtained.
The method of claim 43 further comprising:

The updated 3D texture data is received, and the updated 3D texture data is transformed according to 2D texture data of the updated picture in the attribute-related picture.
The method of claim 50, further comprising:

Receiving a second drawing instruction, where the second drawing instruction includes indication information of the updated picture;

Obtaining 2D texture data of the updated picture from the updated 3D texture data according to the indication information of the updated picture in the second drawing instruction;

The updated picture is drawn according to the acquired 2D texture data.
The method according to any one of claims 43 to 51, wherein the attribute-related picture is a set of pictures of the same size and size.
An electronic device, comprising:

The first processor obtains a picture for the interface display, and transforms the first dimension texture data of the attribute-related picture in the picture for the interface display into the corresponding second dimension texture data, and the second dimension texture Data is sent to the second processor;

And acquiring, by the second processor, the first dimension texture data of the to-be-drawn picture from the second dimension texture data according to the to-be-drawn picture, and drawing the to-be-drawn picture according to the acquired first dimension texture data.
A drawing method, comprising:

Obtain a unit to obtain a picture for the interface display;

a data processing unit, configured to convert the first dimension texture data of the attribute related picture in the picture for the interface display to the corresponding second dimension texture data;

And sending, sending the second dimension texture data.
A processing device, comprising:

a receiving unit, configured to receive second dimension texture data of the attribute-related image, where the second dimension texture data is transformed by the first dimension texture data of the attribute-related picture;

a data processing unit, configured to acquire first dimension texture data of the to-be-drawn picture in the second dimension texture data according to a picture to be drawn;

The drawing unit draws the to-be-drawn picture according to the acquired first dimension texture data.
A drawing method, comprising:

Get the image for the interface display;

Transforming the first dimension texture data of the attribute-related picture in the picture for the interface display into the corresponding second dimension texture data;

Sending the second dimension texture data.
A drawing method, comprising:

Receiving second dimension texture data of the attribute-related picture, the second dimension texture data being transformed by the first dimension texture data of the attribute-related picture;

Obtaining first dimension texture data of the to-be-drawn picture in the second dimension texture data according to the picture to be drawn;

Drawing the picture to be drawn according to the acquired first dimension texture data.
One or more computer readable mediums having stored thereon instructions that, when executed by one or more processors, cause an electronic device to perform the method of any one of claims 35 to 42 .
One or more computer readable mediums having stored thereon instructions that, when executed by one or more processors, cause an electronic device to perform the method of any one of claims 43 to 52 .