TW201901620A - Rendering method and device - Google Patents

Abstract

A rendering method and device are disclosed in the present application. An electronic device provided in the present application comprises a first processor and a second processor. The first processor obtains N first images that are used for interface display, combines the N first images into a second image, and sends texture data of the second image to a second processor; on the basis of a third image to be rendered, the second processor obtains texture data of the third image from the texture data of the second image and, on the basis of the obtained texture data, renders the third image, the third image being at least one image from among the N first images. The present application allows for batch process-rendering of images, thereby increasing rendering efficiency.

Description

Drawing method and device

The present application relates to the field of computer image processing technology, and in particular, to a drawing method and apparatus.

In order to ensure the rendering performance and interface clarity of the smart TV interface, the interface drawing of the smart TV is usually performed by a graphics processing unit (GPU) dedicated to image processing in smart TV. The GPU is based on the Open Graphics Library (OpenGL) for interface rendering. OpenGL provides a variety of graphics processing functions. The graphics processing software can interface the interface by calling these functions. The interface usually includes a plurality of display objects, and one display object occupies a certain display area. For example, an interface for displaying a movie list may include a promotional image of a plurality of movies, and each image is a display object. When you are working on interface drawing, you need to draw separately for each picture. The drawing process for a picture generally includes: the CPU in the smart TV acquires the picture for displaying in the movie list interface from the network side, and generates basic data for drawing the picture based on the acquired picture and the preset interface layout. And transfer these basic data to the GPU in the smart TV; the GPU draws the movie list interface by calling OpenGL using the basic data according to the drawing logic provided by the graphics processing software. The above process is called a drawing process. The basic data used for image drawing may include vertex data of the display area where the image is located, texture coordinate data of the area where the image is located, and texture data of the image, and may further include illumination data, a scene matrix, and the like. Every drawing process requires the CPU to transfer the basic data to the GPU. Due to the limited bandwidth of data transmission between the CPU and the GPU, the GPU cannot perform its proper processing performance and becomes a bottleneck for interface rendering. To this end, the prior art proposes a batch processing scheme: for a display object with multiple basic data (except vertex data and texture coordinate data), the CPU transmits the basic data of the plurality of display objects to the GPU at a time, so that the GPU will be more The sub-rendering process merges, thereby reducing the impact of the data transmission bandwidth between the CPU and the GPU on the rendering efficiency. However, the above batch processing scheme needs to meet certain conditions, that is, the basic data except the vertex data and the texture coordinate data are the same to merge the drawing processes of the plurality of display objects. In some application scenarios, the above conditions cannot be met in most cases (for example, in a smart TV application scenario, the texture of each picture in an interface is different), so the above batch processing scheme cannot be adopted. It can be seen that how to improve the drawing efficiency is a technical problem that needs to be solved at present.

The embodiment of the present application provides a drawing method and device for improving drawing efficiency. The first aspect provides an electronic device, including: a first processor, acquiring N first pictures for interface display, combining the N first pictures into a second picture, and texture of the second picture The data is sent to the second processor, where N is an integer greater than or equal to 1; the second processor obtains the texture data of the third image from the texture data of the second image according to the third picture to be drawn, according to The obtained texture data is used to draw the third picture, and the third picture is at least one of the N first pictures. In a second aspect, a processing apparatus is provided, including: an acquiring unit, acquiring N first pictures for interface display, N is an integer greater than or equal to 1; and a data processing unit combining the N first pictures into a second a sending unit that transmits the texture data of the second picture. A third aspect provides a processing apparatus, including: a receiving unit, receiving a second picture, where the second picture is obtained according to a combination of N first pictures, where N is an integer greater than or equal to 1; and a data processing unit, according to the to-be-drawn a third picture, the texture data of the third picture is obtained from the texture data of the second picture; and the drawing unit is configured to draw the third picture according to the acquired texture data. A fourth aspect provides a rendering method, including: acquiring N first pictures for interface display, N being an integer greater than or equal to 1; combining the N first pictures into a second picture; and sending the second The texture data of the picture. A fifth aspect provides a drawing method, including: receiving a second picture, where the second picture is obtained according to N first picture combinations, and N is an integer greater than or equal to 1; according to the third picture to be drawn, Obtaining the texture data of the third picture in the texture data of the second picture; and drawing the third picture according to the acquired texture data. In a sixth aspect, there is provided one or more computer readable medium having stored thereon instructions that, when executed by one or more processors, cause an electronic device to perform the method provided by the fourth aspect above. In a seventh aspect, there is provided one or more computer readable mediums having stored thereon instructions that, when executed by one or more processors, cause an electronic device to perform the method provided by the fifth aspect above. In the above embodiment of the present application, the first processor combines the N first pictures for the interface display into the second picture, and sends the texture data of the second picture to the second processor, so that the plurality of first The texture data of the picture is integrated into the texture data of a picture, which satisfies the requirements of the batch processing scheme. Therefore, the batch processing scheme can be adopted, and the texture data of multiple pictures is sent to the second processor for image drawing at one time, thereby improving Drawing efficiency.

While the concept of the present application is susceptible to various modifications and alternatives, the specific embodiments thereof are illustrated by the examples in the drawings and will be described in detail herein. It should be understood, however, that the invention is not intended to be limited to the details of the invention. References to "an embodiment", "an embodiment", "an illustrative embodiment" or the like in the specification are intended to mean that the described embodiments may include specific features, structures, or characteristics, but each embodiment may or may not necessarily include a particular Feature, structure or characteristic. Moreover, such phrases are not necessarily referring to the same embodiments. Further, it is to be understood that the specific features, structures, or characteristics may be combined with other embodiments, whether explicitly described or not, in conjunction with the embodiments. In addition, it should be understood that items included in the list in the form of "at least one of A, B, and C" may represent (A); (B); (C); (A and B); (A and C) ; (B and C); or (A, B and C). Similarly, items listed in the form of "at least one of A, B or C" may represent (A); (B); (C); (A and B); (A and C); (B and C) or (A, B and C). In some cases, the disclosed embodiments can be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments can also be implemented as instructions carried or stored by one or more transitory or non-transitory machine readable (eg, computer readable) storage media, which can be read by one or more processors And execution. A machine-readable storage medium may be embodied as any storage device, mechanism, or other physical structure for storing or transmitting information in a machine readable form (eg, volatile or non-volatile memory, media disk, or other media). . In the figures, some structural or method features may be shown in a particular arrangement and/or order. However, it should be understood that such specific arrangements and/or ordering may not be required. Rather, in some embodiments, these features may be arranged in a different and/or sequential manner than illustrated in the illustrative figures. In addition, the inclusion of structural or method features in a particular figure is not meant to imply that such a feature is required in all embodiments, and may not include or be combined with other features in some embodiments. As described in the background art, a batch processing scheme is adopted when object drawing is performed to improve drawing efficiency. However, batch processing needs to meet certain conditions, that is, the drawing process of multiple objects can be combined except that the vertex data and the texture coordinate data are the same, which requires that the objects to be drawn be different in position. Other materials (such as texture data, scene matrices, etc.) must be the same. In some scenarios, especially in the field of smart TV, in the interface displayed by smart TV (such as the resource list interface), other attributes of different areas are the same except for the pictures displayed in different areas. However, because the images displayed in different regions are different, the OpenGL texture data of different regions is different, and the above batch processing scheme cannot be adopted. That is to say, the drawing process of each region requires a data from the CPU to the GPU. In the transmission, each picture in the display area in each frame of the interface needs to perform data transmission from the CPU to the GPU, resulting in low rendering efficiency. To this end, the embodiment of the present application combines multiple pictures into one picture, that is, combines texture data of multiple pictures into texture data of one picture, so that the texture data can be integrated into one picture for multiple pictures. The texture data is such that it meets the batch processing requirements, so that it can be drawn by batch processing technology, thereby improving the drawing efficiency. The texture data may be a 2D texture data, or may be a texture data of other dimensions, which is not limited in the embodiment of the present application. The embodiments of the present application are described in detail below with reference to the accompanying drawings. FIG. 1 exemplarily shows a system architecture to which the embodiment of the present application is applied. As shown in the figure, the architecture may include: a television device 101 and a server 103. The television device 101 and the server 103 can perform information interaction via the network 104. The television device 101 can be a smart television with digital signal processing functionality. The user can control the television device 101 through the remote controller, and the user also directly controls the television device through the function keys provided by the television device 101. A list of resources (such as an electronic program guide) is stored in the server 103, and the resource list can be provided to the television device 101 to cause the television device 101 to draw an interface according to the resource list for the user to select a program to be viewed according to the interface. Considering that some TV devices do not have digital signal encoding and decoding functions, they need to receive digital digits through a digital video conversion box (STB, commonly referred to as a set-top box or set-top box, which is a device that connects a TV to an external signal source). The content (for example, may include an electronic program guide, an internet webpage, a subtitle, etc.), is decoded and transmitted to a television device for interface drawing and display, and can also send interactive information of the user to the network side to realize an interactive service. FIG. 2 exemplarily shows a system architecture including a digital video conversion box to which the embodiment of the present application is applied. In this architecture, the television device 101' is coupled to the digital video conversion box 102, and the digital video conversion box 102 is coupled to the server 103 via the network 104. The digital video conversion box can also convert the received video digital signal into an analog signal and transmit it to the television device for playback. It should be noted that the above FIG. 1 and FIG. 2 are described by taking a television device as an example, and the above television device can be replaced with any other electronic device having similar functions. Taking the system architecture shown in FIG. 1 as an example, in an application scenario, a user requests a list of resources, such as a movie list, through a remote controller. After receiving the request, the television device 101 acquires a movie list from the server 103 via the network 104 (the movie list includes content such as a movie picture), and performs interface drawing according to the obtained movie list, and the drawn interface includes a movie picture. . The television device 101 displays the drawn interface containing the movie picture on the screen of the television device 101 for the user to select the movie to be played. At present, in the resource list interface displayed by the television device, the pictures corresponding to the resources are arranged in a regular manner, for example, the sizes are basically the same, the arrangement is relatively neat, and the classification is relatively clear. 3A to 3G exemplarily show several interface forms adopted by current smart televisions. Taking the interface shown in FIG. 3A as an example, the interface includes nine object display areas (object display area 1 to object display area 9), and the object display area 1 and the object display area 2 have the same display object size, and the object display area 4 Pictures (picture 1 to picture 7) are respectively displayed in the object display area 9, and the pictures are the same size. The correspondence between the pictures 1 to 7 and the object display area can be set in advance. These types of interfaces basically cover the display style of the current smart TV interface. The embodiments of the present application are applicable to the drawing process of the above various forms of interfaces. FIG. 4 exemplarily shows a schematic structural diagram of a television device related to an embodiment of the present application. As mentioned previously, the television device can also be replaced with other electronic devices having similar functions. The following is only a description of a television device. The television device shown in FIG. 4 includes at least two processors, specifically a first processor 401 and a second processor 402 as shown in the figure. Further, the television device may further include a display device or the like. The first processor 401 is mainly used for logic control, and can send data for interface drawing to the second processor 402, and can control the second processor to perform interface drawing. The second processor can perform interface drawing. The drawn interface can be output to the display device for display. Specifically, the first processor 401 is configured to acquire N (N is an integer greater than or equal to 1) first picture sent by the server for interface display, and combine the N first pictures into a second picture, The texture data of the two pictures is sent to the second processor 402. The second processor 1002 is configured to obtain, according to the third picture to be drawn, the texture data of the third picture from the texture data of the second picture, and draw the third picture according to the acquired texture data, where The third picture is at least one of the N first pictures. Among them, the “first picture”, the “second picture”, and the “third picture” are named only for the convenience of distinction. For example, the “first picture” may be a picture received by the television device from the server, and the picture obtained by combining the plurality of first pictures is referred to as a second picture. The number of first pictures is usually multiple and the sizes may not be the same. The first processor may be a CPU, and the second processor may be a GPU. Taking the first processor as the CPU and the second processor as the GPU, the CPU runs the OpenGL main program to control the interface drawing process, and the GPU runs the shader program to implement the interface drawing process. Based on the principle shown in FIG. 4, FIG. 5 exemplarily shows the structure of an electronic device such as a television device. At least 2 processors may be included in the electronic device. In this example, two processors (5021, 5022) are taken as an example, wherein the first processor 5021 may be a CPU, and the second processor 5022 may be a GPU. The system control logic 501 is coupled to at least one processor (5021, 5022), the non-volatile memory (NMV)/memory 504 is coupled to the system control logic 501, and the network module or network interface 506 is coupled. In system control logic 501. System control logic 501 in one embodiment may include any suitable interface controller to provide any suitable interface to at least one of first processor 5021 or second processor 5022, and/or to the system Any suitable interface of any suitable device or component that controls logic 501 to communicate. System control logic 501 in one embodiment may include one or more memory controllers to provide an interface to system memory 503. System memory 503 is used to load and store data and/or instructions. For example, in response to an electronic device, in one embodiment, system memory 503 can include any suitable volatile storage. NVM/memory 504 can include one or more tangible, non-transitory computer readable media for storing data and/or instructions. For example, NVM/memory 504 can include any suitable non-volatile memory, such as one or more hard disk devices (HDDs), one or more compact disks (CDs), and/or one or Multiple digital versatile disk (DVD). The NVM/memory 504 can include a storage resource that is physically part of the device that the system is installed or can be accessed, but is not necessarily part of the device. For example, NVM/memory 504 can be accessed by the network via a network module or network interface 506. System memory 503 and NVM/memory 504 can each include a copy of a temporary or persistent instruction 510. The instructions 510 can include instructions that, when executed by at least one of the first processor 5021 or the second processor 5022, cause the electronic device to implement one or a combination of the methods described in the embodiments of the present application. In various embodiments, the instructions 510 or hardware, firmware, and/or software components may additionally/alternatively be placed in system control logic 501, network module or network interface 506 and/or processor (5021) , 5022). The network module or network interface 506 can include a receiver to provide a wireless interface for the electronic device to communicate with one or more networks and/or any suitable device. The network module or network interface 506 can include any suitable hardware and/or firmware. The network module or network interface 506 can include multiple antennas to provide a multiple input multiple output wireless interface. In one embodiment, the network module or network interface 506 can include a network interface card, a wireless network interface card, a telephone modem, and/or a wireless modem. In one embodiment, at least one of the processors (5021, 5022) may be packaged with logic for one or more controllers of the system control logic. In one embodiment, at least one of the processors may be packaged with logic for one or more controllers of system control logic to form a system level package. In one embodiment, at least one of the processors can be integrated on the same die as the logic of one or more controllers for system control logic. In one embodiment, at least one of the processors can be integrated on the same die as the logic of one or more controllers for system control logic to form a system wafer. The electronic device can further include an input/output device 505. Input/output device 505 can include a user interface intended to enable a user to interact with the electronic device, can include a peripheral component interface that is designed to enable peripheral components to interact with the system, and/or can include a sensor, Determine environmental conditions and/or location information about electronic devices. Based on the structure shown in FIG. 4 or FIG. 5, FIG. 6 exemplarily shows the structure of a processing apparatus. The processing device can be an application applied to the first processor. As shown, the processing device may include an obtaining unit 601, a data processing unit 602, and a transmitting unit 603. The obtaining unit 601 is configured to acquire N first pictures for interface display, and the data processing unit 602 is configured to combine the N first pictures into a second picture. The sending unit 603 is configured to send the texture data of the second picture to the second processor. Based on the structure shown in Fig. 4 or Fig. 5, Fig. 7 exemplarily shows the structure of another processing apparatus. The processing device can be an application that is applied to the second processor. As shown, the processing device can include a receiving unit 701, a data processing unit 702, and a rendering unit 703. The receiving unit 701 is configured to receive a second picture, where the second picture is obtained according to the N first picture combinations. The data processing unit 702 is configured to obtain the texture data of the third picture from the texture data of the second picture according to the third picture to be drawn. The drawing unit 703 is configured to draw the third picture according to the acquired texture data. FIG. 8 exemplarily shows an interface drawing process provided by an embodiment of the present application. As shown in the figure, after the TV device is started, the image for the interface display can be obtained from the server on the network side, and the interface is drawn, and the drawn interface is displayed. The interface displayed after the TV device is started is generally referred to as a desktop, and may include a plurality of object display areas, and an object display area may display a picture, and each object display area may be triggered to perform a corresponding function. For example, taking the interface shown in FIG. 3A as an example, when an object in the object display area (a picture in this example) is triggered (for example, the user selects a picture in the display area by using a remote controller), playing the object corresponding to the object the film. As shown in FIG. 8, the interface drawing process may include: S801: The first processor acquires a picture for interface display, and the acquired picture may include N (N is an integer greater than or equal to 1) the first picture. In a scenario where the television device is activated, in some embodiments based on the architecture shown in FIG. 1, the OpenGL main program running in the first processor establishes a connection with the network side server through the network module of the television device, and requests The server sends a picture for the interface display. In some embodiments based on the architecture shown in FIG. 2, the digital video conversion box establishes a connection with the network side server, and sends the picture for interface display sent by the network side server to the first processor in the television device. Usually, the interface displayed by the television device can include multiple pages (the user can page through the page turning function keys such as "previous page" and "next page" in the interface). The interface displayed by the TV device can also contain only one page but its length exceeds the height of the screen display area. It can be scrolled (for example, the user can move the key to the interface content via the “Up/Down” or “Left/Right” buttons of the remote control. Scroll forward and backward to display. Since a large number of pictures can be included in the interface, the process of sending pictures by the network side server consumes more network resource overhead and affects the picture transmission efficiency. In addition, the process of drawing the interface of the TV device also takes a lot of system overhead and takes a long time. , affecting user experience. Therefore, in the embodiment of the present application, the server may first send a part of the picture for the interface display to the television device, and then send the corresponding picture to the television device according to the user's request when the user requests other interfaces or other parts of the request interface. . The server may first send the picture in the interface displayed by default after the television device is started or the N (N is an integer greater than or equal to 1) picture in the interface to the television device. The value of N can be preset, and can generally be set according to the processing capability of the television device (such as drawing capability). After receiving the picture sent by the server for the interface display, the first processor may store the picture and/or the index of the picture in the memory of the first processor. The index of the image is used to uniquely identify a picture. The above S801 may be specifically executed by the first processor or by a processing device (such as an application) applied to the first processor. More specifically, it can be performed by the acquisition unit 601 in FIG. S802: The first processor combines the N first pictures used for the interface display into the second picture. In this step, the picture combination may be used to perform picture combination, that is, the N first pictures are spliced into one second picture. When the first processor splicing the N first pictures into one second picture, the first processor may perform the principle that the size of the second picture obtained by the splicing is as small as possible. Based on the above principles, in some embodiments, the first processor may group the N pictures according to a picture size, and the pictures in the same group have the same size. The first processor sequentially stitches the same set of pictures in a horizontal direction, and a set of pictures are aligned on the picture height. FIG. 9 exemplarily shows a schematic diagram of splicing 17 pictures of different sizes into one picture. In the specific implementation, the size of the spliced picture can be calculated according to the width and height of the 17 pictures, that is, the sum of the widths of the larger pictures is first used as the width of the spliced picture, and then the other pictures are sequentially in the order of the lines. Arrange, and finally calculate the height of the stitched image based on the number of rows and the height of each line of the image. As shown in FIG. 9 , grouping according to the picture size can obtain three picture groups, the pictures 1~4 are a group, the pictures 5~8 are a group, and the pictures 9~17 are a group. Each group of pictures is arranged in the row direction (ie, the s-axis direction or the horizontal direction in the figure), and different groups of pictures occupy different lines. This splicing minimizes the size of the stitched image, thereby saving memory. Based on the foregoing principles, in other embodiments, the first processor may further calculate a splicing manner of the N first pictures according to a more complicated splicing algorithm, so that the size of the second picture is as small as possible. Further, as shown in FIG. 9, the interval of the set size may be reserved between the pictures, for example, a gap of 1 to 2 pixels may be reserved, which facilitates the interception of the picture boundary. Further, in order to facilitate the subsequent picture drawing operation, the texture width (the s-axis direction in the figure) and the height (the t-axis direction in the figure) of the assembled picture may be normalized. After the spliced picture shown in FIG. 9 is normalized, it can be as shown in FIG. The spliced picture has a length of 1 in the s-axis direction and a length of 1 in the t-axis direction. The width and height of the pictures 1 to 17 can be as shown by the digits in FIG. Further, after combining the second picture, the first processor may calculate location information of each first picture in the second picture in the second picture, and save the location information. The location information may be coordinates of the first picture in the second picture. Taking a rectangular picture as an example, it can be the coordinates of the four vertices of the picture. Taking 2D texture data as an example, 2D texture data is actually a two-dimensional array, and its elements are some color values. The first processor may generate 2D texture data of the first image according to the color value of each pixel in the received first image, and generate 2D texture data of the second image according to the spliced second image. The texture data of the plurality of first pictures is included in the texture data of the second picture by combining the plurality of first pictures into one second picture, so that the texture data of the plurality of first pictures is integrated into one The texture data of the two pictures can be implemented by batch processing technology when the plurality of first pictures are drawn. Further, the memory of the first processor is pre-stored with interface layout related information, and the interface layout related information defines the attributes of the interface (such as size, aspect ratio) and the position of each object display area in the interface, and may also define an interface. Each object in the display area displays the objects that need to be displayed in the area. For example, taking the interface shown in FIG. 3A as an example, the interface layout related information of the interface defines the position of each object display area (object display area 1 to object display area 9) in the interface in the interface, and display of each object. The index of the image displayed by the area. The first processor may obtain vertex data of each object display area in the interface according to the interface layout related information (the object display area in FIG. 3A is a rectangle, including 4 vertices). Further, the texture coordinate data of each object display area in the interface is stored in advance in the memory of the first processor. The texture coordinates are simply the texture data to the target primitive surface map. The above S801 may be specifically executed by the first processor or by a processing device (such as an application) applied to the first processor. More specifically, it can be performed by the material processing unit 602 in FIG. S803: The first processor sends the texture data of the second picture to the second processor. In this step, the first processor may use the texture data of the second image processed in S802, and other materials used for interface drawing (such as vertex data, texture coordinate data, illumination data, scene matrix, etc. of each object display area). Merging, and transmitting the merged data to the second processor according to a data transfer protocol with the second processor. The data such as the illumination data and the scene matrix may be preset in the memory of the first processor. Optionally, the data sent by the first processor to the second processor may further include location information of the texture data of the first image included in the texture data of the second image. The above S803 may be specifically performed by the first processor or by a processing device (such as an application) applied to the first processor. More specifically, it can be performed by the transmitting unit 603 in FIG. S804: After receiving the data for the interface drawing, such as the 2D texture data of the second picture, the second processor acquires the to-be-drawn from the texture data of the second image according to the first picture to be drawn. The texture data of the three pictures, and the third picture is drawn according to the obtained texture data. The third picture is at least one of the N first pictures. The second processor may acquire the texture data of the third picture from the texture data of the second picture according to the location information of the texture data of the third picture in the texture data of the second picture. Optionally, in a specific implementation, after transmitting, by the first processor, the texture data for the interface of the second picture to the second processor, the interface may send an interface drawing instruction to the second processor. The third picture to be drawn in the interface or interface to be displayed by the second processor is indicated by a drawing instruction. The drawing instruction may include indication information of the third picture to be drawn in the interface to be displayed. The second processor may determine a picture to be drawn in the area according to the indication information of the third picture to be drawn in the drawing instruction. The indication information of the third picture to be drawn may be an index of the picture to be drawn. In this case, the second processor may query the position of the picture index and the first picture in the second picture according to the index of the third picture. Corresponding relationship between the information, the picture position information corresponding to the index of the third picture to be drawn is obtained. The indication information of the third picture may also be an index of the display area of the object to be drawn corresponding to the third picture. In this case, the second processor may query the correspondence between the object display area and the first picture according to the index of the object display area. a relationship (the correspondence may be preset according to the interface layout), obtaining an index of the third picture corresponding to the index of the display area of the object to be drawn, and querying the first picture index and the first picture according to the index of the third picture Corresponding relationship between the location information in the two pictures (the correspondence may be determined by the first processor in S802), obtaining location information corresponding to the index of the third picture to be drawn, thereby obtaining information according to the location information The corresponding position in the texture data of the two pictures obtains the texture data of the third picture. The indication information of the third picture to be drawn may also be the location information of the picture in the second picture. In this case, the second processor may directly obtain the third picture from the texture data of the second picture according to the location information. Texture information. Further, the second processor may be configured according to the texture data of the third picture to be drawn, and combining other materials (such as vertex data of the object display area to be drawn, texture coordinate data, and illumination data, scene matrix, etc.) The object in the display area is drawn in the third picture. Taking the interface shown in FIG. 3A as an example, the pictures 1 to 9 can be spliced into one picture, and the 2D texture data of the spliced picture is sent to the second processor, so that the second processor can be in one drawing process. Based on the 2D texture data of the second picture, picture 1 to picture 9 are drawn in the corresponding object display area, that is, batch processing is implemented. The above S804 may be specifically executed by the second processor or by a processing device (such as an application) applied to the first processor. More specifically, it can be performed by the receiving unit 701, the material processing unit 702, and the drawing unit 703 in FIG. 7, respectively. Through the above process, after the television device is started, the interface for drawing the interface can be obtained from the server for interface drawing, and the drawn interface is displayed on the screen of the television device. Subsequently, if the user issues a request to page up or down or a request to scroll the interface, or request another interface, the television device can respond to the user's request and update the currently displayed content. For example, in the case that the user issues a page-down request, the first processor may determine the first picture included in the target page after receiving the request for page-down, and determine the first picture included in the target page. Whether the texture data of the picture obtained by combining the pictures has been sent to the second processor; if it has been sent, sending a drawing instruction to the second processor for instructing the second processor to draw the pictures, otherwise, sending the pictures to the server The image acquisition request is requested to acquire the pictures, and the acquired first picture is combined into a second picture, the texture data of the second picture is sent to the second processor, and the second processing is performed according to the foregoing embodiment. The device sends a drawing instruction to instruct the second processor to draw the target page. For example, in the case of requesting a new interface, the current interface is a movie list interface, and after receiving the request to switch to the TV drama list interface, the first processor may determine whether the image for the interface display is for the requested interface. It has been obtained from the server. If the determination is no, sending a picture acquisition request to the server to request to acquire the picture in the requested interface; otherwise, sending a drawing instruction to the second processor, the drawing instruction is used to instruct the second processor to draw the requested interface. In some cases, the server on the network side updates the image used for interface drawing, such as updating the first movie picture in the movie list interface. In this case, the server sends the updated first picture to the TV. device. For convenience of description, the "fourth picture" is used to indicate the updated picture of one or more of the N first pictures. The first processor in the television device receives the fourth picture sent by the server, acquires the second picture before the update, updates the second picture according to the fourth picture, and sends the updated texture information of the second picture to the second picture. processor. The first processor may further send a drawing instruction to the second processor, where the drawing instruction includes indication information of the fourth picture to instruct the second processor to update the corresponding picture. The second processor may obtain the texture data of the fourth image from the texture data of the updated second image according to the indication information of the fourth image in the drawing instruction, and draw the fourth image according to the texture data. . Based on the same technical concept, the embodiment of the present application further provides one or more computer readable media, where the readable medium stores instructions, when the instructions are executed by one or more processors, causing the electronic device to perform the foregoing The drawing method in the embodiment. For example, the electronic device may be caused to execute the method performed by the first processor in the foregoing embodiment, or to perform the method performed by the second processor, or to execute the method performed by the first processor and the second processor. As can be seen from the above description, in the foregoing embodiment of the present application, in one aspect, the first processor combines the N first pictures for interface display into a second picture, and sends the texture information of the second picture to The second processor, so that the texture data of the plurality of first pictures is integrated into the texture data of one picture, satisfies the requirements of the batch processing scheme, so the batch processing scheme can be adopted, and the texture data of the multiple pictures is sent at a time Perform picture drawing to the second processor. On the other hand, the second processor may obtain the texture data of the picture to be drawn in the texture data of the second picture according to the picture to be drawn, and draw the picture to be drawn according to the obtained texture data, and implement the picture. Batch processing is drawn to improve drawing efficiency.

101‧‧‧TV equipment

103‧‧‧Server

104‧‧‧Network

102‧‧‧Digital Video Converter Box

401‧‧‧First processor

402‧‧‧second processor

5021‧‧‧First processor

5022‧‧‧second processor

501‧‧‧System Control Logic

503‧‧‧ memory

504‧‧‧ memory

505‧‧‧Input/output devices

506‧‧‧Network module or network interface

510‧‧ directive

601‧‧‧Acquisition unit

602‧‧‧ Data Processing Unit

603‧‧‧Send unit

701‧‧‧ receiving unit

702‧‧‧ Data Processing Unit

703‧‧‧ drawing unit

S801~S804‧‧‧Process

The embodiments of the present application are illustrated by way of example, and not limitation FIG. 1 and FIG. 2 are respectively a schematic diagram showing a system architecture applicable to an embodiment of the present application; FIG. 3A to FIG. 3G respectively exemplarily show an interface diagram in the present application; FIG. 4 exemplarily shows FIG. 5 is a schematic structural diagram of a television apparatus according to an embodiment of the present application; FIG. 6 and FIG. 7 respectively exemplarily illustrate the processing provided by the embodiment of the present application. FIG. 8 exemplarily shows a schematic diagram of the interface splicing process provided by the embodiment of the present application; FIG. 9 exemplarily shows a schematic diagram of the splicing principle of the embodiment of the present application; FIG. 10 exemplarily shows A schematic diagram of normalizing the coordinates of the stitched picture in the embodiment of the present application.

Claims (49)

An electronic device, comprising: a first processor, acquiring N first pictures for interface display, combining the N first pictures into a second picture, and sending texture information of the second picture to The second processor, N is an integer greater than or equal to 1; the second processor obtains the texture data of the third image from the texture data of the second image according to the third picture to be drawn, according to the obtained The texture data is used to draw the third picture, and the third picture is at least one of the N first pictures. The electronic device of claim 1, wherein the first processor further determines location information of the texture data of the N first pictures in the texture data of the second picture, and the location Sending information to the second processor; the second processor further acquiring, according to location information in the texture data of the second image, the texture data of the second image from the texture data of the second image The texture data of the third picture. The electronic device of claim 1, wherein the first processor groups the N first pictures according to a picture size, and the pictures in the same group have the same size; and the same group of pictures Splicing in the horizontal direction, a group of pictures are aligned on the height of the picture. The electronic device according to claim 1, wherein in the second picture, a distance between the adjacent first pictures is set. The electronic device of claim 1, wherein the first processor further sends a first drawing instruction to the second processor, where the first drawing instruction includes indication information of the third picture; The second processor determines the third picture to be drawn according to the indication information of the third picture in the first drawing instruction. The electronic device of claim 5, wherein the indication information of the third picture comprises: an index of the third picture, or an index of the display area of the object to be drawn corresponding to the third picture, or the third picture is Location information in the second picture. The electronic device of claim 6, wherein, when the indication information is an index of the third picture, the second processor queries the picture index and the first picture according to the index of the third picture. Corresponding relationship between the location information in the second picture, the picture location information corresponding to the index of the third picture is obtained; or the indication information of the third picture is the display area of the object to be drawn corresponding to the third picture When indexing, the second processor queries the corresponding relationship between the object display area and the image according to the index of the display area of the object to be drawn, and obtains an index of the third picture corresponding to the index of the display area of the object to be drawn, according to An index of the third picture, a correspondence between the picture index and the location information of the first picture in the second picture, to obtain picture location information corresponding to the index of the third picture. The electronic device of claim 1, wherein the first processor further: receiving the updated fourth picture, updating the texture data of the second picture according to the texture data of the fourth picture, and updating The texture data of the second picture is sent to the second processor, where the fourth picture is an updated picture corresponding to at least one of the N first pictures. The electronic device of claim 8, wherein the first processor further sends a second drawing instruction to the second processor, where the second drawing instruction includes indication information of the fourth picture; The second processor further acquires the texture data of the fourth picture from the texture data of the updated second picture according to the indication information of the fourth picture in the second drawing instruction, according to the obtained The texture data draws the fourth picture. The electronic device of claim 1, wherein the first processor sends a picture acquisition request to the server after the electronic device is started or after receiving the interface request; and receiving the servo The N first pictures for interface display sent according to the obtaining request. The electronic device of claim 10, wherein the first processor determines, after receiving the interface request, whether the first picture for the interface display has been obtained from the server for the requested interface. If the determination is no, the image acquisition request is sent to the server, where the image acquisition request is used to request to acquire the first picture in the requested interface; otherwise, the third drawing instruction is sent to the second processor. The third drawing instruction is used to instruct the second processor to draw the requested interface. The electronic device of any one of claims 1 to 11, wherein the first processor is a central processor and the second processor is a graphics processor. The electronic device of any one of claims 1 to 11, wherein the electronic device is a television device. A processing device, comprising: an acquiring unit, acquiring N first pictures for interface display, N is an integer greater than or equal to 1; a data processing unit combining the N first pictures into a second picture; a unit that transmits the texture data of the second picture. The apparatus of claim 14, wherein the data processing unit further determines location information of texture data of the N first pictures in texture data of the second picture; Send the location information. The device of claim 14, wherein the data processing unit groups the N first pictures according to a picture size, the pictures in the same group have the same size; and, the same group of pictures are horizontal The directions are stitched one after the other, and a set of pictures are aligned at the height of the picture. The device of claim 14, wherein the second picture has a set distance between adjacent first pictures. The device of claim 14, wherein the sending unit further sends a first drawing instruction, where the first drawing instruction includes indication information of the third picture. The device of claim 18, wherein the indication information of the third picture comprises: an index of the third picture, or an index of the display area of the object to be drawn corresponding to the third picture, or the third picture is in the Location information in the second picture. The device of claim 14, wherein the obtaining unit further receives an updated fourth picture; wherein the fourth picture is an update corresponding to at least one of the N first pictures The data processing unit further updates the texture data of the second picture according to the texture data of the fourth picture; the sending unit further sends the texture data of the updated second picture. The device of claim 20, wherein the sending unit further sends a second drawing instruction, wherein the second drawing instruction includes indication information of the fourth picture. The device of claim 14, wherein the acquiring unit sends a picture acquisition request to the server after the electronic device is started or after receiving the interface request; and receiving the server according to the The N first pictures for interface display sent by the request are obtained. The device of claim 22, wherein the obtaining unit determines, after the interface request is received, whether the first picture for the interface display has been obtained from the server for the requested interface; If yes, the image acquisition request is sent to the server, where the image acquisition request is used to request to acquire the first picture in the requested interface; otherwise, the third drawing instruction is sent by the sending unit, the third A drawing instruction is used to instruct the second processor to draw the requested interface. A processing device, comprising: a receiving unit, receiving a second picture, the second picture is obtained according to a combination of N first pictures, N is an integer greater than or equal to 1; a data processing unit, according to a third to be drawn a picture, the texture data of the third picture is obtained from the texture data of the second picture; and the drawing unit is configured to draw the third picture according to the acquired texture data. The device of claim 24, wherein the receiving unit further receives location information of texture data of the N first pictures in texture data of the second picture; The position information of the texture data of the third picture in the texture data of the second picture, and the texture data of the third picture is obtained from the texture data of the second picture. The device of claim 24, wherein the receiving unit further receives a first drawing instruction, wherein the first drawing instruction includes indication information of the third picture; The indication information of the third picture in the first drawing instruction determines the third picture to be drawn. The device of claim 26, wherein the indication information of the third picture comprises: an index of the third picture, or an index of the display area of the object to be drawn corresponding to the third picture, or the third picture is in the Location information in the second picture. The device of claim 27, wherein, when the indication information is an index of the third picture, the data processing unit queries the picture index and the first picture in the second according to the index of the third picture. Corresponding relationship between the location information in the picture, the picture position information corresponding to the index of the third picture is obtained; or the indication information of the third picture is the index of the display area of the object to be drawn corresponding to the third picture The data processing unit queries the correspondence between the display area of the object and the image according to the index of the display area of the object to be drawn, and obtains an index of the third picture corresponding to the index of the display area of the object to be drawn, according to the The index of the three pictures, the correspondence between the image index and the location information of the first picture in the second picture, and the picture location information corresponding to the index of the third picture is obtained. The device of claim 24, wherein the receiving module further receives the updated texture data of the second image, and the updated texture data of the second image includes the texture data of the fourth image. The fourth picture is an updated picture of at least one of the N first pictures. The device of claim 29, wherein the receiving module further receives a second drawing instruction, wherein the second drawing instruction includes indication information of the fourth picture; And the indication information of the fourth picture in the second drawing instruction, acquiring the texture data of the fourth picture from the texture data of the updated second picture, and drawing the fourth according to the acquired texture data image. A drawing method, comprising: obtaining N first pictures for interface display, N being an integer greater than or equal to 1; combining the N first pictures into a second picture; transmitting a texture of the second picture data. The method of claim 31, further comprising: determining location information of the texture data of the N first pictures in the texture data of the second picture; and transmitting the location information. The method of claim 31, wherein the combining the N first pictures into a second picture comprises: grouping the N first pictures according to a picture size, in the same group The images are the same size; and the same set of images are stitched together in a horizontal direction, and a set of images are aligned at the height of the image. The method of claim 31, wherein in the second picture, the adjacent first pictures are spaced apart by a set distance. The method of claim 31, further comprising: transmitting a first drawing instruction, wherein the first drawing instruction includes indication information of the third picture. The method of claim 35, wherein the indication information of the third picture comprises: an index of the third picture, or an index of the display area of the object to be drawn corresponding to the third picture, or the third picture is in the Location information in the second picture. The method of claim 31, further comprising: receiving an updated fourth picture; wherein the fourth picture is an updated one corresponding to at least one of the N first pictures Updating the texture data of the second picture according to the texture data of the fourth picture; and sending the texture data of the updated second picture. The method of claim 37, further comprising: transmitting a second drawing instruction, wherein the second drawing instruction includes indication information of the fourth picture. The method of claim 31, wherein the obtaining the N first pictures for the interface display comprises: sending a picture to the server after the electronic device is started or after receiving the interface request Acquiring the request; and receiving, by the server, the N first pictures for interface display sent according to the obtaining request. The method of claim 39, wherein the sending the image acquisition request to the server after the electronic device is started or after receiving the interface request comprises: after receiving the interface request, The requested interface determines whether the first picture for the interface display has been obtained from the server; if the determination is no, the image acquisition request is sent to the server, and the image acquisition request is used to request to acquire the requested interface. The first picture in the picture; otherwise, the third drawing instruction is sent, the third drawing instruction is used to instruct the second processor to draw the requested interface. A drawing method, comprising: receiving a second picture, the second picture is obtained according to N first picture combinations, N is an integer greater than or equal to 1; according to the third picture to be drawn, from the second Obtaining the texture data of the third picture in the texture data of the image; and drawing the third picture according to the acquired texture data. The method of claim 41, further comprising: receiving location information of texture data of the N first pictures in texture data of the second picture; Obtaining the texture data of the third image in the texture data, comprising: obtaining, according to location information in the texture data of the second image, texture information of the third image, from the texture data of the second image The texture data of the third picture. The method of claim 41, further comprising: receiving a first drawing instruction, wherein the first drawing instruction includes indication information of the third picture; according to the first drawing instruction Determining the information of the third picture to determine the third picture to be drawn. The method of claim 43, wherein the indication information of the third picture comprises: an index of the third picture, or an index of the display area of the object to be drawn corresponding to the third picture, or the third picture is in the Location information in the second picture. The method of claim 44, wherein the determining, according to the indication information of the third picture in the first drawing instruction, the third picture to be drawn, comprising: the indication information When the index of the third picture is the index of the third picture, the corresponding relationship between the picture index and the location information of the first picture in the second picture is obtained, and the picture corresponding to the index of the third picture is obtained. Position information; or, when the indication information of the third picture is an index of the display area of the object to be drawn corresponding to the third picture, according to the index of the display area of the object to be drawn, the correspondence between the display area and the image of the object is obtained An index of the third picture corresponding to the index of the display area of the object to be drawn, according to the index of the third picture, querying a correspondence between the picture index and the location information of the first picture in the second picture, and obtaining The picture location information corresponding to the index of the third picture. The method of claim 41, further comprising: receiving texture data of the updated second picture, wherein the updated texture data of the second picture includes texture data of the fourth picture, The fourth picture is an updated picture of at least one of the N first pictures. The method of claim 46, further comprising: receiving a second drawing instruction, wherein the second drawing instruction includes indication information of the fourth picture; according to the second drawing instruction And the indication information of the fourth picture is obtained, the texture data of the fourth picture is obtained from the texture data of the updated second picture, and the fourth picture is drawn according to the acquired texture data. One or more computer readable mediums having stored thereon instructions that, when executed by one or more processors, cause the electronic device to perform as claimed in any one of claims 31 to 40 The method described. One or more computer readable mediums having stored thereon instructions that, when executed by one or more processors, cause the electronic device to perform any of claims 41-47 The method described.