WO2018214768A1 - 一种绘制方法及装置 - Google Patents

一种绘制方法及装置 Download PDF

Info

Publication number
WO2018214768A1
WO2018214768A1 PCT/CN2018/086647 CN2018086647W WO2018214768A1 WO 2018214768 A1 WO2018214768 A1 WO 2018214768A1 CN 2018086647 W CN2018086647 W CN 2018086647W WO 2018214768 A1 WO2018214768 A1 WO 2018214768A1
Authority
WO
WIPO (PCT)
Prior art keywords
picture
texture data
pictures
index
processor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2018/086647
Other languages
English (en)
French (fr)
Inventor
李利民
郑剑杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Publication of WO2018214768A1 publication Critical patent/WO2018214768A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for programme selection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for programme selection
    • H04N21/4825End-user interface for programme selection using a list of items to be played back in a given order, e.g. playlists

Definitions

  • the present application relates to the field of computer image processing technologies, and in particular, to a drawing method and apparatus.
  • the interface drawing of the smart TV is usually performed by a graphics processing unit (GPU) dedicated to image processing in the smart television.
  • the GPU is based on the Open Graphics Library (OpenGL) for interface rendering.
  • OpenGL provides a variety of graphics processing functions.
  • the graphics processing software can implement interface rendering by calling these functions.
  • the interface usually includes a plurality of display objects, and one display object occupies a certain display area.
  • an interface for displaying a movie list may include a publicity picture of a plurality of movies, and each picture is a display object.
  • the drawing process for a picture generally includes: the CPU in the smart TV acquires a picture for displaying in the movie list interface from the network side, and generates basic data for performing picture drawing based on the acquired picture and a preset interface layout. And transfer the basic data to the GPU in the smart TV; the GPU draws the movie list interface by calling the basic data by calling OpenGL according to the drawing logic provided by the graphics processing software.
  • the above process is called a drawing process.
  • the basic data used for image drawing may include vertex data of the display area where the image is located, texture coordinate data of the area where the image is located, and texture data of the image, and may further include illumination data, a scene matrix, and the like.
  • Every drawing process requires the CPU to transfer basic data to the GPU. Due to the limited data transmission bandwidth between the CPU and the GPU, the GPU cannot perform its proper processing performance and becomes a bottleneck for interface rendering.
  • the prior art proposes a batch processing scheme: for a display object in which a plurality of basic data are the same (except vertex data and texture coordinate data), the CPU transmits the basic data of the plurality of display objects to the GPU at a time, so that the GPU will be more
  • the secondary rendering process is combined to reduce the impact of the data transfer bandwidth between the CPU and the GPU on rendering efficiency.
  • the above batch scheme needs to meet certain conditions, that is, the basic data except the vertex data and the texture coordinate data are the same to merge the drawing processes of the plurality of display objects.
  • the above conditions cannot be met in most cases (for example, in a smart TV application scenario, the texture of each picture in an interface is different), so the above batch scheme cannot be adopted.
  • the embodiment of the present application provides a drawing method and device for improving drawing efficiency.
  • an electronic device comprising:
  • the first processor obtains N first pictures for interface display, combines the N first pictures into a second picture, and sends texture data of the second picture to a second processor, where N is greater than An integer equal to 1; a second processor, acquiring texture data of the third picture from the texture data of the second picture according to the third picture to be drawn, and drawing the third picture according to the acquired texture data
  • the third picture is at least one of the N first pictures.
  • a processing apparatus comprising:
  • N is an integer greater than or equal to 1; a data processing unit combining the N first pictures into a second picture; and sending, sending the second picture Texture data.
  • a processing apparatus comprising:
  • Receiving, by the receiving unit, the second picture, the second picture is obtained according to the combination of the N first pictures, where N is an integer greater than or equal to 1; the data processing unit, according to the third picture to be drawn, from the second picture
  • the texture data of the third picture is obtained in the texture data; the drawing unit is configured to draw the third picture according to the acquired texture data.
  • a method of drawing including:
  • N is an integer greater than or equal to 1; combining the N first pictures into a second picture; and transmitting texture data of the second picture.
  • a method of drawing including:
  • one or more computer readable medium having stored thereon instructions that, when executed by one or more processors, cause an electronic device to perform the method provided by the fourth aspect above.
  • a seventh aspect there is provided one or more computer readable medium having stored thereon instructions that, when executed by one or more processors, cause an electronic device to perform the method provided by the fifth aspect above.
  • the first processor combines the N first pictures for the interface display into a second picture, and sends the texture data of the second picture to the second processor, so that the multiple first
  • the texture data of the image is integrated into the texture data of a picture, which satisfies the requirements of the batch processing scheme. Therefore, the batch processing scheme can be adopted, and the texture data of multiple pictures is sent to the second processor for image drawing at one time, thereby improving the drawing. effectiveness.
  • FIG. 1 and FIG. 2 are respectively a schematic diagram showing a system architecture applicable to an embodiment of the present application
  • FIG. 4 is a schematic structural diagram of a television apparatus according to an embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of a television apparatus according to an embodiment of the present application.
  • FIG. 6 and FIG. 7 are respectively a schematic structural diagrams of a processing apparatus provided by an embodiment of the present application.
  • FIG. 8 is a schematic diagram showing an interface drawing process provided by an embodiment of the present application.
  • FIG. 9 exemplarily shows a schematic diagram of a picture splicing principle in the embodiment of the present application.
  • FIG. 10 exemplarily shows a schematic diagram of normalizing the coordinates of the stitched picture in the embodiment of the present application.
  • references to "an embodiment”, “an embodiment”, “an illustrative embodiment” or the like in the specification are intended to mean that the described embodiments may include specific features, structures, or characteristics, but each embodiment may or may not necessarily include a particular Feature, structure or characteristic. Moreover, such phrases are not necessarily referring to the same embodiments. Further, it is to be understood that the specific features, structures, or characteristics may be combined with other embodiments, whether explicitly described or not, in conjunction with the embodiments. In addition, it should be understood that items included in the list in the form of "at least one of A, B, and C” may represent (A); (B); (C); (A and B); (A and C) ; (B and C); or (A, B and C). Similarly, items listed in the form of "at least one of A, B or C” may represent (A); (B); (C); (A and B); (A and C); (B and C) or (A, B and C).
  • the disclosed embodiments can be implemented in hardware, firmware, software, or any combination thereof.
  • the disclosed embodiments can also be implemented as instructions carried or stored by one or more transitory or non-transitory machine readable (eg, computer readable) storage media, which can be read by one or more processors And execution.
  • a machine-readable storage medium may be embodied in any storage device, mechanism or other physical structure for storing or transmitting information in a machine readable form (eg, a volatile or nonvolatile memory, media disk or other medium). ).
  • a batch processing scheme can be used to improve drawing efficiency when performing object drawing.
  • the batch processing needs to meet certain conditions, that is, the drawing process of multiple objects can be combined except that the data other than the vertex data and the texture coordinate data are the same, which requires the objects to be drawn to be different except for the position.
  • Other data such as texture data, scene matrix, etc.
  • other attributes of different areas are the same except for the pictures displayed in different areas.
  • the drawing process of each region requires a data transmission from the CPU to the GPU.
  • the picture in each display area in each frame of the interface needs to perform data transmission from the CPU to the GPU, resulting in low rendering efficiency.
  • the embodiment of the present application combines multiple pictures into one picture, that is, combines texture data of multiple pictures into texture data of one picture, so that the texture data can be integrated into one picture for multiple pictures.
  • the texture data is made to meet the batch processing requirements, so that it can be drawn by batch technology, thereby improving the drawing efficiency.
  • the texture data may be 2D texture data, or may be texture data of other dimensions, which is not limited in the embodiment of the present application.
  • FIG. 1 exemplarily shows a system architecture to which the embodiment of the present application is applied.
  • the architecture may include: a television device 101 and a server 103.
  • Television device 101 and server 103 can communicate information over network 104.
  • the television device 101 can be a smart television with digital signal processing functionality.
  • the user can control the television device 101 through the remote controller, and the user also directly controls the television device through the function keys provided by the television device 101.
  • the server 103 stores a resource list (such as an electronic program guide), and the television device 101 can be provided with a resource list to cause the television device 101 to draw an interface according to the resource list for the user to select a program to be viewed according to the interface.
  • a resource list such as an electronic program guide
  • FIG. 2 exemplarily shows a system architecture including a digital video conversion box to which the embodiment of the present application is applied.
  • television device 101 is coupled to digital video transform box 102
  • digital video transform box 102 is coupled to server 103 via network 104.
  • the digital video converter box can also convert the received video digital signal into an analog signal and transmit it to the television device for playback.
  • FIG. 1 and FIG. 2 are described by taking a television device as an example, and the above television device can be replaced with any other electronic device having similar functions.
  • a user requests a list of resources, such as a movie list, through a remote controller.
  • the television device 101 acquires a movie list from the server 103 via the network 104 (the movie list includes content such as a movie picture), and performs interface rendering according to the obtained movie list, and the drawn interface includes a movie picture.
  • the television device 101 displays the drawn interface containing the movie picture on the screen of the television device 101 for the user to select the movie to be played.
  • the pictures corresponding to the resources are arranged in a regular manner, for example, the sizes are basically the same, the arrangement is relatively neat, and the classification is relatively clear.
  • 3A to 3G exemplarily show several interface forms adopted by current smart televisions. Taking the interface shown in FIG. 3A as an example, the interface includes nine object display areas (object display area 1 to object display area 9), and the object display area 1 and the object display area 2 have the same display object size, and the object display area 4 Pictures (picture 1 to picture 7) are respectively displayed in the object display area 9, and the pictures are the same size. The correspondence between the pictures 1 to 7 and the object display area can be set in advance.
  • These kinds of interface forms basically cover the display style of the current smart TV interface.
  • the embodiments of the present application are applicable to the drawing process of the above various forms of interfaces.
  • FIG. 4 exemplarily shows a schematic structural diagram of a television device related to an embodiment of the present application.
  • the television device can also be replaced with other electronic devices having similar functions. The following is only a description of a television device.
  • the television device shown in FIG. 4 includes at least two processors, specifically a first processor 401 and a second processor 402 as shown in the figure. Further, the television device may further include a display device or the like.
  • the first processor 401 is mainly used for logic control, and can send data for interface rendering to the second processor 402, and can control the second processor to perform interface rendering.
  • the second processor can perform interface drawing.
  • the drawn interface can be output to the display device for display.
  • the first processor 401 is configured to acquire N (N is an integer greater than or equal to 1) first picture sent by the server for interface display, and combine the N first pictures into a second picture, and the second The texture data of the picture is sent to the second processor 402.
  • the second processor 1002 is configured to obtain texture data of the third picture from the texture data of the second picture according to the third picture to be drawn, and draw the third picture according to the acquired texture data, where The third picture is at least one of the N first pictures.
  • the “first picture”, the “second picture”, and the “third picture” are named only for the convenience of distinction.
  • the “first picture” may be a picture received by the television device from the server, and the picture obtained by combining the plurality of first pictures is referred to as a second picture.
  • the number of first pictures is usually multiple and the sizes may not be the same.
  • the first processor may be a CPU
  • the second processor may be a GPU.
  • the CPU runs the OpenGL main program to control the interface drawing process
  • the GPU runs the shader program to implement the interface drawing process.
  • FIG. 5 exemplarily shows the structure of an electronic device such as a television device. At least 2 processors may be included in the electronic device. In this example, two processors (5021, 5022) are taken as an example, wherein the first processor 5021 may be a CPU, and the second processor 5022 may be a GPU.
  • System control logic 501 is coupled to at least one processor (5021, 5022), non-volatile memory (NMV)/memory 504 is coupled to system control logic 501, and network module or network interface 506 is coupled to system control logic 501.
  • NMV non-volatile memory
  • System control logic 501 in one embodiment may include any suitable interface controller to provide any suitable interface to at least one of first processor 5021 or second processor 5022, and/or to the system Any suitable interface of any suitable device or component that controls logic 501 to communicate.
  • System control logic 501 in one embodiment may include one or more memory controllers to provide an interface to system memory 503.
  • System memory 503 is used to load and store data and/or instructions.
  • system memory 503 can include any suitable volatile memory.
  • NVM/memory 504 can include one or more tangible, non-transitory computer readable media for storing data and/or instructions.
  • NVM/memory 504 can include any suitable non-volatile storage device, such as one or more hard disk devices (HDDs), one or more compact disks (CDs), and/or one or more Digital versatile disk (DVD).
  • HDDs hard disk devices
  • CDs compact disks
  • DVD Digital versatile disk
  • the NVM/memory 504 can include a storage resource that is physically part of the device that the system is installed on or can be accessed, but is not necessarily part of the device.
  • NVM/memory 504 can be accessed by the network via a network module or network interface 506.
  • System memory 503 and NVM/memory 504 can each include a copy of temporary or persistent instructions 510.
  • the instructions 510 can include instructions that, when executed by at least one of the first processor 5021 or the second processor 5022, cause the electronic device to implement one or a combination of the methods described in the embodiments of the present application.
  • instructions 510 or hardware, firmware, and/or software components may additionally/alternatively be placed in system control logic 501, network module or network interface 506 and/or processor (5021, 5022).
  • the network module or network interface 506 can include a receiver to provide a wireless interface for the electronic device to communicate with one or more networks and/or any suitable device.
  • Network module or network interface 506 can include any suitable hardware and/or firmware.
  • the network module or network interface 506 can include multiple antennas to provide a multiple input multiple output wireless interface.
  • the network module or network interface 506 can include a network adapter, a wireless network adapter, a telephone modem, and/or a wireless modem.
  • At least one of the processors may be packaged with logic for one or more controllers of the system control logic. In one embodiment, at least one of the processors may be packaged with logic for one or more controllers of system control logic to form a system level package. In one embodiment, at least one of the processors can be integrated on the same die as the logic of one or more controllers for system control logic. In one embodiment, at least one of the processors can be integrated on the same die as the logic of one or more controllers for system control logic to form a system chip.
  • the electronic device can further include an input/output device 505.
  • Input/output device 505 can include a user interface intended to enable a user to interact with the electronic device, can include a peripheral component interface designed to enable peripheral components to interact with the system, and/or can include sensors for determining an environment Conditions and/or location information about the electronic device.
  • FIG. 6 exemplarily shows the structure of a processing apparatus.
  • the processing device can be an application applied to the first processor.
  • the processing device may include an obtaining unit 601, a data processing unit 602, and a transmitting unit 603.
  • the obtaining unit 601 is configured to acquire N first pictures for interface display, and the data processing unit 602 is configured to combine the N first pictures into a second picture.
  • the sending unit 603 is configured to send the texture data of the second picture to the second processor.
  • Fig. 7 exemplarily shows the structure of another processing apparatus.
  • the processing device can be an application that is applied to the second processor.
  • the processing device may include a receiving unit 701, a data processing unit 702, and a rendering unit 703.
  • the receiving unit 701 is configured to receive a second picture, where the second picture is obtained according to the N first picture combinations.
  • the data processing unit 702 is configured to obtain texture data of the third picture from the texture data of the second picture according to the third picture to be drawn.
  • the drawing unit 703 is configured to draw the third picture according to the acquired texture data.
  • FIG. 8 exemplarily shows an interface drawing process provided by an embodiment of the present application.
  • a picture for the interface display can be obtained from the server on the network side, and the interface is drawn, and the drawn interface is displayed.
  • the interface displayed after the TV device is started is generally referred to as a desktop, and may include a plurality of object display areas, and an object display area may display a picture, and each object display area may be triggered to perform a corresponding function.
  • taking the interface shown in FIG. 3A as an example when an object in the object display area (a picture in this example) is triggered (for example, the user selects a picture in the display area through a remote controller), playing the object corresponding to the object the film.
  • the above interface drawing process may include:
  • the first processor acquires a picture for interface display, and the acquired picture may include N (N is an integer greater than or equal to 1) the first picture.
  • the OpenGL main program running in the first processor establishes a connection with the server on the network side through the network module of the television device, and requests the server to transmit The image displayed on the interface.
  • the digital video transform box establishes a connection with the network side server, and sends the picture sent by the network side server for the interface display to the first processor in the television device.
  • the interface displayed by the television device can include multiple pages (the user can page through the page turning function keys such as "previous page” and "next page” in the interface).
  • the interface displayed by the TV device can also contain only one page but its length exceeds the height of the screen display area. It can be scrolled (for example, the user can move the key content through the “Up/Down” or “Left/Right” keys of the remote control. Scroll forward and backward to display. Since the interface can include a large number of pictures, the process of sending pictures by the network side server occupies more network resource overhead and affects the picture transmission efficiency. In addition, the process of drawing the interface by the television device also occupies a large amount of system overhead, which takes a long time and affects. User experience.
  • the server may first send a part of the picture for the interface display to the television device, and then send the corresponding picture to the television device according to the request of the user when the user requests other interfaces or requests other parts of the interface.
  • the server may first send a picture in the interface displayed by default after the television device is started or a N (N is an integer greater than or equal to 1) picture in the interface in the interface to the television device.
  • N is an integer greater than or equal to 1
  • the value of N can be preset, and can generally be set according to the processing capability of the television device (such as drawing capability).
  • the first processor may store the picture and/or the index of the picture in the memory of the first processor.
  • the index of the image is used to uniquely identify a picture.
  • the above S801 may be specifically performed by the first processor or by a processing device (such as an application) applied to the first processor. More specifically, it can be performed by the acquisition unit 601 in FIG.
  • the first processor combines the N first pictures used for the interface display into the second picture.
  • the picture combination may be used to perform picture combination, that is, the N first pictures are spliced into one second picture.
  • the first processor may perform the principle that the size of the second picture obtained by the splicing is as small as possible.
  • the first processor may group the N pictures according to a picture size, and the pictures in the same group have the same size.
  • the first processor sequentially stitches the same set of pictures in a horizontal direction, and a set of pictures are aligned on the picture height.
  • FIG. 9 exemplarily shows a schematic diagram of splicing 17 pictures of different sizes into one picture.
  • the size of the spliced picture can be calculated according to the width and height of the 17 pictures, that is, the sum of the widths of the larger pictures is first used as the width of the spliced picture, and then the other pictures are sequentially in the order of the lines.
  • grouping according to the picture size can obtain three picture groups, the pictures 1 to 4 are a group, the pictures 5 to 8 are a group, and the pictures 9 to 17 are a group.
  • Each group of pictures is arranged in the row direction (ie, the s-axis direction or the horizontal direction in the figure), and different groups of pictures occupy different lines. This splicing minimizes the size of the stitched image, thereby saving memory.
  • the first processor may further calculate a splicing manner of the N first pictures according to a more complicated splicing algorithm, so that the size of the second picture is as small as possible.
  • the interval of the set size may be reserved between the pictures, for example, a gap of 1 to 2 pixels may be reserved, which facilitates the interception of the picture boundary.
  • the texture width (the s-axis direction in the figure) and the height (the t-axis direction in the figure) of the assembled picture can be normalized.
  • the spliced picture shown in FIG. 9 After the spliced picture shown in FIG. 9 is normalized, it can be as shown in FIG.
  • the spliced picture has a length of 1 in the s-axis direction and a length of 1 in the t-axis direction.
  • the widths and heights of the pictures 1-17 can be as shown by the numbers in FIG.
  • the first processor may calculate location information of each first picture in the second picture in the second picture, and save the location information.
  • the location information may be coordinates of the first picture in the second picture. Taking a rectangular picture as an example, it can be the coordinates of the four vertices of the picture.
  • 2D texture data is actually a two-dimensional array whose elements are some color values.
  • the first processor may generate 2D texture data of the first picture according to the received color value of each pixel in the first picture, and generate 2D texture data of the second picture according to the stitched second picture.
  • the texture data of the second picture is included in the texture data of the second picture by combining the plurality of first pictures into a second picture, so that the texture data of the plurality of first pictures is integrated into one
  • the texture data of the two pictures may be implemented by using a batch processing technique when the plurality of first pictures are drawn.
  • the interface layout related information is pre-stored in the memory of the first processor, and the interface layout related information defines the attributes of the interface (such as size, length and width ratio) and the position of each object display area in the interface, and may also define an interface.
  • Each object displays an object that needs to be displayed in the area.
  • the interface layout related information of the interface defines the position of each object display area (object display area 1 to object display area 9) in the interface, and the display of each object.
  • the first processor may obtain vertex data of each object display area in the interface according to the interface layout related information (the object display area in FIG. 3A is a rectangle, including 4 vertices).
  • texture coordinate data of each object display area in the interface is stored in advance in the memory of the first processor.
  • the texture coordinates are simply the texture data to the target primitive surface map.
  • the above S801 may be specifically performed by the first processor or by a processing device (such as an application) applied to the first processor. More specifically, it can be performed by data processing unit 602 in FIG.
  • S803 The first processor sends the texture data of the second picture to the second processor.
  • the first processor may use the texture data of the second picture processed in S802, and other data used for interface drawing (such as vertex data, texture coordinate data, illumination data, scene matrix, etc. of each object display area). Merging and transmitting the merged data to the second processor according to a data transfer protocol with the second processor.
  • the data such as the illumination data and the scene matrix may be preset in the memory of the first processor.
  • the data sent by the first processor to the second processor may further include location information of the texture data of the first picture included in the texture data of the second picture.
  • the above S803 may be specifically performed by the first processor or by a processing device (such as an application) applied to the first processor. More specifically, it can be performed by the transmitting unit 603 in FIG.
  • the second processor After the second processor receives the data for the interface drawing, such as the 2D texture data of the second image, the second processor acquires the to-be-drawn from the texture data of the second image according to the first image to be drawn.
  • the texture data of the three pictures, and the third picture is drawn according to the obtained texture data.
  • the third picture is at least one of the N first pictures.
  • the second processor may acquire the texture data of the third picture from the texture data of the second picture according to the location information of the texture data of the third picture in the texture data of the second picture.
  • the first processor may send an interface drawing instruction to the second processor.
  • the third picture to be drawn in the interface or interface to be displayed by the second processor may be indicated by a drawing instruction.
  • the drawing instruction may include indication information of the third picture to be drawn in the interface to be displayed.
  • the second processor may determine a picture to be drawn in the area according to the indication information of the third picture to be drawn in the drawing instruction.
  • the indication information of the third picture to be drawn may be an index of the picture to be drawn.
  • the second processor may query the position of the picture index and the first picture in the second picture according to the index of the third picture.
  • the picture position information corresponding to the index of the third picture to be drawn is obtained.
  • the indication information of the third picture may also be an index of the display area of the object to be drawn corresponding to the third picture.
  • the second processor may query the correspondence between the object display area and the first picture according to the index of the object display area.
  • a relationship (the correspondence may be preset according to the interface layout), obtaining an index of the third picture corresponding to the index of the display area of the object to be drawn, and querying the first picture index and the first picture according to the index of the third picture Corresponding relationship between the location information in the two pictures (the correspondence may be determined by the first processor in S802), obtaining location information corresponding to the index of the third picture to be drawn, thereby obtaining the first information according to the location information Corresponding positions in the texture data of the two pictures obtain texture data of the third picture.
  • the indication information of the third picture to be drawn may also be location information of the picture in the second picture. In this case, the second processor may directly obtain the third picture from the texture data of the second picture according to the location information. Texture data.
  • the second processor may be configured according to the texture data of the third picture to be drawn, and combining other data (such as vertex data of the object display area to be drawn, texture coordinate data, and illumination data, scene matrix, etc.) The object in the display area is drawn in the third picture.
  • the pictures 1 to 9 can be spliced into one picture, and the 2D texture data of the spliced picture is sent to the second processor, so that the second processor can be in one drawing process. Based on the 2D texture data of the second picture, picture 1 to picture 9 are drawn in the corresponding object display area, that is, batch processing is implemented.
  • the above S804 may be specifically performed by the second processor or by a processing device (such as an application) applied to the first processor. More specifically, it can be performed by the receiving unit 701, the data processing unit 702, and the drawing unit 703 in FIG. 7, respectively.
  • a picture for interface drawing can be obtained from the server for interface drawing, and the drawn interface is displayed on the screen of the television device. Subsequently, if the user issues a request for page up or down or a request to scroll the interface, or requests another interface, the television device may update the currently displayed content in response to the user's request.
  • the first processor may determine the first picture included in the target page after receiving the request for page-down, and determine the first picture included in the target page. Whether the texture data of the picture obtained by combining the pictures has been sent to the second processor; if it has been sent, sending a drawing instruction to the second processor for instructing the second processor to draw the pictures; otherwise, sending the picture to the server Obtaining a request to request to obtain the pictures, and combining the acquired first picture into a second picture, transmitting the texture data of the second picture to the second processor, and to the second processor, according to the foregoing embodiment A drawing instruction is sent to instruct the second processor to draw the target page.
  • the current interface is a movie list interface.
  • the first processor may determine, for the requested interface, whether the image for the interface display is It has been obtained from the server. If the determination is no, sending a picture acquisition request to the server to request to acquire a picture in the requested interface; otherwise, sending a drawing instruction to the second processor, the drawing instruction is used to instruct the second processor to draw the requested interface .
  • the server on the network side updates the picture for interface drawing, such as updating the first movie picture in the movie list interface.
  • the server sends the updated first picture to the television device.
  • the "fourth picture" is used to indicate the updated picture of one or more of the N first pictures.
  • the first processor in the television device receives the fourth picture sent by the server, acquires the second picture before the update, updates the second picture according to the fourth picture, and sends the updated texture data of the second picture to the second process.
  • the first processor may further send a drawing instruction to the second processor, where the drawing instruction includes indication information of the fourth picture to instruct the second processor to update the corresponding picture.
  • the second processor may obtain texture data of the fourth picture from the texture data of the updated second picture according to the indication information of the fourth picture in the drawing instruction, and draw the fourth picture according to the texture data. .
  • the embodiment of the present application further provides one or more computer readable media having instructions stored thereon, when the instructions are executed by one or more processors, such that the electronic device performs the foregoing The drawing method in the embodiment.
  • the electronic device may be caused to execute the method performed by the first processor in the foregoing embodiment, or to perform the method performed by the second processor, or to execute the method performed by the first processor and the second processor.
  • the first processor combines the N first pictures used for interface display into one second picture, and sends the texture data of the second picture to The second processor, so that the texture data of the plurality of first pictures is integrated into the texture data of one picture, satisfies the requirements of the batch processing scheme, so the batch processing scheme can be adopted, and the texture data of the multiple pictures is sent to the first
  • the second processor performs picture drawing.
  • the second processor may obtain the texture data of the picture to be drawn in the texture data of the second picture according to the picture to be drawn, and draw the picture to be drawn according to the obtained texture data, and implement the picture. Batch drawing, which improves drawing efficiency.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Image Generation (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本申请公开了一种绘制方法及装置。本申请提供的电子设备中包括第一处理器和第二处理器。第一处理器获取用于界面展示的N个第一图片,将所述N个第一图片组合为第二图片,将所述第二图片的纹理数据发送给第二处理器;第二处理器根据待绘制的第三图片,从所述第二图片的纹理数据中获取所述第三图片的纹理数据,根据获取到的纹理数据绘制所述第三图片,所述第三图片为所述N个第一图片中的至少一个图片。采用本申请可实现图片的批处理绘制,进而提高了绘制效率。

Description

一种绘制方法及装置
本申请要求2017年05月24日递交的申请号为201710375345.9、发明名称为“一种绘制方法及装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及计算机图像处理技术领域,尤其涉及一种绘制方法及装置。
背景技术
为了保证智能电视界面的绘制性能和界面的清晰度,智能电视的界面绘制通常由智能电视中专用于图像处理的图形处理器(Graphics Processing Unit,GPU)来进行。GPU基于开放式图形库(Open Graphics Library,OpenGL)进行界面绘制,OpenGL提供了多种图形处理函数,图形处理软件通过调用这些函数可实现界面绘制。
界面中通常包括多个显示对象,一个显示对象占用一定的显示区域。以用于展示电影列表的界面为例,其中可包括多个电影的宣传用图片,每个图片即为一个显示对象。在进行界面绘制时,需要针对每个图片分别进行绘制。针对一个图片的绘制过程一般包括:智能电视中的CPU从网络侧获取到用于在电影列表界面中展示的图片,基于获取到的图片以及预先设置的界面布局生成用于进行图片绘制的基本数据,并将这些基本数据传输给智能电视中的GPU;GPU依据图形处理软件提供的绘制逻辑,通过调用OpenGL使用这些基本数据绘制出电影列表界面。上述过程称为一次绘制过程。其中,用于进行图片绘制的基本数据可包括图片所在显示区域在所在界面中的顶点数据、图片所在区域的纹理坐标数据、图片的纹理数据,还可进一步包括光照数据、场景矩阵等。
每一次绘制过程都需要CPU将基本数据传输给GPU。由于CPU与GPU之间的数据传输带宽有限,使GPU无法发挥其应有的处理性能,成为界面绘制的瓶颈。为此,现有技术提出了批处理方案:针对多个基本数据相同(顶点数据和纹理坐标数据除外)的显示对象,CPU将该多个显示对象的基本数据一次传输给GPU,使得GPU将多次绘制过程进行合并,从而降低了CPU与GPU之间的数据传输带宽对绘制效率的影响。
但是,上述批处理方案需要满足特定条件,即除了顶点数据和纹理坐标数据之外的其他基本数据均相同才能对多个显示对象的绘制过程进行合并。在一些应用场景中,多数情况下无法满足上述条件(比如在智能电视应用场景中,一个界面中的每个图片的纹 理各不相同),因此无法采用上述批处理方案。
由此可见,如何提高绘制效率是目前亟需解决的技术问题。
发明内容
本申请实施例提供了一种绘制方法及装置,用以提高绘制效率。
第一方面,提供一种电子设备,包括:
第一处理器,获取用于界面展示的N个第一图片,将所述N个第一图片组合为第二图片,将所述第二图片的纹理数据发送给第二处理器,N为大于等于1的整数;第二处理器,根据待绘制的第三图片,从所述第二图片的纹理数据中获取所述第三图片的纹理数据,根据获取到的纹理数据绘制所述第三图片,所述第三图片为所述N个第一图片中的至少一个图片。
第二方面,提供一种处理装置,包括:
获取单元,获取用于界面展示的N个第一图片,N为大于等于1的整数;数据处理单元,将所述N个第一图片组合为第二图片;发送单元,发送所述第二图片的纹理数据。
第三方面,提供一种处理装置,包括:
接收单元,接收第二图片,所述第二图片是根据N个第一图片组合得到的,N为大于等于1的整数;数据处理单元,根据待绘制的第三图片,从所述第二图片的纹理数据中获取所述第三图片的纹理数据;绘制单元,根据获取到的纹理数据绘制所述第三图片。
第四方面,提供一种绘制方法,包括:
获取用于界面展示的N个第一图片,N为大于等于1的整数;将所述N个第一图片组合为第二图片;发送所述第二图片的纹理数据。
第五方面,提供一种绘制方法,包括:
接收第二图片,所述第二图片是根据N个第一图片组合得到的,N为大于等于1的整数;根据待绘制的第三图片,从所述第二图片的纹理数据中获取所述第三图片的纹理数据;根据获取到的纹理数据绘制所述第三图片。
第六方面,提供一个或多个计算机可读介质,所述可读介质上存储有指令,所述指令被一个或多个处理器执行时,使得电子设备执行上述第四方面提供的方法。
第七方面,提供一个或多个计算机可读介质,所述可读介质上存储有指令,所述指令被一个或多个处理器执行时,使得电子设备执行上述第五方面提供的方法。
本申请的上述实施例中,第一处理器将用于界面展示的N个第一图片组合为第二图 片,将该第二图片的纹理数据发送给第二处理器,从而使多个第一图片的纹理数据整合为一个图片的纹理数据,满足了批处理方案的要求,因此可采用批处理方案,一次将与多个图片的纹理数据发送给第二处理器进行图片绘制,进而提高了绘制效率。
附图说明
本申请的实施例通过示例而非限制的方式示出在所附附图中,类似的附图标记表示类似的元素。
图1、图2分别示例性地示出了本申请实施例所适用的系统架构示意图;
图3A至图3G分别示例性地示出了本申请中的界面示意图;
图4示例性地示出了本申请实施例提供的电视设备原理结构图;
图5示例性地示出了本申请实施例的电视设备的结构示意图;
图6、图7分别示例性地示出了本申请实施例提供的处理装置的结构示意图;
图8示例性地示出了本申请实施例提供的界面绘制流程示意图;
图9示例性地示出了本申请实施例中图片拼接原理示意图;
图10示例性地示出了本申请实施例中对拼接后的图片的坐标进行归一化的示意图。
具体实施方式
虽然本申请的概念易于进行各种修改和替代形式,但是其具体实施例已经通过附图中的示例示出并且将在本文中详细描述。然而,应当理解,没有意图将本申请的概念限制为所公开的特定形式,而是相反,意图是覆盖与本申请以及所附权利要求一致的所有修改、等同物和替代物。
说明书中对“一个实施例”、“实施例”、“说明性实施例”等的引用,指示所描述的实施例可包括特定特征、结构或特性,但是每个实施例可以或可以不必包括特定特征、结构或特性。此外,这样的短语不一定指的是相同的实施例。进一步地,认为在本领域技术人员的知识范围内,当结合实施例描述特定特征、结构或特性时,结合无论是否明确描述的其它实施例影响这样的特征,结构或特性。另外,应当理解,以“A,B和C中的至少一个”的形式包括在列表中的项目可以表示(A);(B);(C);(A和B);(A和C);(B和C);或(A,B和C)。类似地,以“A,B或C中的至少一个”的形式列出的项目可以表示(A);(B);(C);(A和B);(A和C);(B和C)或(A,B和C)。
在一些情况下,所公开的实施例可以在硬件、固件、软件或其任何组合中实现。所公开的实施例还可以被实现为由一个或多个暂时性或非暂时性机器可读(例如,计算机可读)存储介质携带或存储的指令,其可以由一个或多个处理器读取和执行。机器可读存储介质可以体现为用于以机器可读形式(例如,易失性或非易失性存储器、介质盘或其他介质)存储或传输信息的任何存储设备,机制或其他物理结构的设备)。
在附图中,一些结构或方法特征可以以特定布置和/或顺序示出。然而,应当理解,可能不需要这样的具体布置和/或排序。相反,在一些实施例中,这些特征可以以与说明性附图中所示不同的方式和/或顺序来布置。另外,在特定图中包括结构或方法特征并不意味着暗示这种特征在所有实施例中都是需要的,并且在一些实施例中可以不包括或可以与其他特征组合。
如背景技术所述,在进行对象绘制时采用批处理方案可提高绘制效率。但是采用批处理需要满足一定的条件,即除了顶点数据和纹理坐标数据之外的其他数据均相同的情况下才能将多个对象的绘制过程进行合并,这就要求待绘制的对象除了位置不同以外,其他的数据(比如纹理数据、场景矩阵等)均要相同。在一些场景下,尤其在智能电视领域中,智能电视所展示的界面(比如资源列表界面)中,除不同区域所展示的图片不同以外,不同区域的其他属性均相同。但正是由于不同区域展示的图片不同,因此不同区域的OpenGL纹理数据不同,进而无法采用上述批处理方案,也就是说每一个区域中的图片的绘制过程都需要一次从CPU到GPU的数据传输,界面中每一帧中的每一个显示区域内的图片都需要进行一次从CPU到GPU的数据传输,导致绘制效率较低。
为此,本申请实施例通过将多个图片组合为一个图片,即,将多个图片的纹理数据组合为一个图片的纹理数据,这样可针对多个图片,将其纹理数据整合为一个图片的纹理数据,使其满足批处理要求,从而可采用批处理技术进行绘制,进而提高了绘制效率。其中,所述纹理数据可以是2D纹理数据,也可以是其他维度的纹理数据,本申请实施例不作限制。
下面结合附图对本申请实施例进行详细描述。
图1示例性地示出了本申请实施例所适用的系统架构。如图所示,该架构中可包括:电视设备101、服务器103。电视设备101和服务器103可通过网络104进行信息交互。
电视设备101可以是具有数字信号处理功能的智能电视。用户可通过遥控器对电视设备101进行控制操作,用户也直接通过电视设备101提供的功能键对电视设备进行控制操作。服务器103中存储有资源列表(比如电子节目指南),可向电视设备101提供 资源列表,以使电视设备101根据资源列表绘制界面,以供用户根据该界面选择需要收看的节目。
考虑到有些电视设备不具备数字信号编解码功能,需要通过数字视频变换盒(Set Top Box,简称STB,通常称作机顶盒或机上盒,是一种连接电视机与外部信号源的设备)接收数字内容(比如可包括电子节目指南、因特网网页、字幕等等),进行解码后传输给电视设备进行界面绘制和显示,还可将用户的交互信息发送给网络侧,实现交互式业务。图2示例性地示出了本申请实施例所适用的包含数字视频变换盒的系统架构。该架构中,电视设备101与数字视频变换盒102连接,数字视频变换盒102通过网络104与服务器103连接。数字视频变换盒也可将接收到的视频数字信号转换为模拟信号并传输给电视设备进行播放。
需要说明的是,上述图1和图2是以电视设备为例描述的,上述电视设备可被替换为任何其他具有类似功能的电子设备。
以图1所示的系统架构为例,在一种应用场景中,用户通过遥控器请求获取资源列表,比如电影列表。电视设备101接收到该请求后,通过网络104从服务器103获取电影列表(该电影列表中包括电影图片等内容),并根据获得的电影列表进行界面绘制,所绘制的界面中包括电影图片。电视设备101将绘制得到的包含有电影图片的界面显示在电视设备101的屏幕上,供用户从中选择需要播放的电影。
目前,电视设备所显示的资源列表界面中,各资源对应的图片在排列方式上比较有规律,比如尺寸基本相同、排列上较为整齐、分类较为清晰。图3A至图3G分别示例性地示出了几种目前智能电视采用的界面形式。以图3A所示的界面为例,界面中包括9个对象显示区域(对象显示区域1至对象显示区域9),对象显示区域1和对象显示区域2中的显示对象尺寸相同,对象显示区域4至对象显示区域9中分别显示有图片(图片1至图片7),且图片的尺寸相同。图片1至图片7与对象显示区域之间的对应关系可预先设置。
这几种界面形式基本涵盖了当前智能电视界面的显示风格。本申请实施例可适用于上述各种形式界面的绘制过程。
图4示例性地示出了电视设备中与本申请实施例相关的结构示意图。如前所述,该电视设备也可被替换为其他具有类似功能的电子设备。以下仅以电视设备为例进行描述。
图4所示的电视设备中包括至少2个处理器,具体如图中所示的第一处理器401和第二处理器402。进一步地,该电视设备还可包括显示装置等组成部分。
第一处理器401主要用于进行逻辑控制,可向第二处理器402发送用于界面绘制的数据,并可控制第二处理器进行界面绘制。第二处理器可进行界面绘制。绘制的界面可输出到显示装置进行显示。
具体地,第一处理器401用于获取服务器发送的用于界面展示的N个(N为大于等于1的整数)第一图片,将该N个第一图片组合为第二图片,将第二图片的纹理数据发送给第二处理器402。第二处理器1002用于根据待绘制的第三图片,从所述第二图片的纹理数据中获取所述第三图片的纹理数据,根据获取到的纹理数据绘制所述第三图片,所述第三图片为所述N个第一图片中的至少一个图片。其中,“第一图片”、“第二图片”、“第三图片”仅出于便于区分的考虑进行命名。例如,“第一图片”可以是电视设备从服务器接收到的图片,由多个第一图片组合后得到的图片称为第二图片。第一图片的数量通常为多个,且尺寸有可能不相同。
其中,第一处理器可以是CPU,第二处理器可以是GPU。以第一处理器为CPU、第二处理器为GPU为例,CPU中运行OpenGL主程序以控制界面绘制过程,GPU中运行着色器程序以实现界面绘制过程。
基于图4所示的原理,图5示例性地示出了一种电子设备(比如电视设备)的结构。该电子设备中可包括至少2个处理器。此例子中以2个处理器(5021,5022)为例描述,其中第一处理器5021可以是CPU,第二处理器5022可以是GPU。系统控制逻辑501耦合于至少一个处理器(5021,5022),非易失性存储器(non-volatile memory,NMV)/存储器504耦合于系统控制逻辑501,网络模块或网络接口506耦合于系统控制逻辑501。
一个实施例中的系统控制逻辑501,可包括任何适当的接口控制器,以提供到第一处理器5021或第二处理器5022中的至少一个的任何合适的接口,和/或提供到与系统控制逻辑501通信的任何合适的设备或组件的任何合适的接口。
一个实施例中的系统控制逻辑501,可包括一个或多个内存控制器,以提供到系统内存503的接口。系统内存503用来加载以及存储数据和/或指令。例如,对应该电子设备,在一个实施例中,系统内存503可包括任何合适的易失性存储器。
NVM/存储器504可包括一个或多个有形的非暂时的计算机可读介质,用于存储数据和/或指令。例如,NVM/存储器504可包括任何合适的非易失性存储装置,如一个或多个硬盘(hard disk device,HDD),一个或多个光盘(compact disk,CD),和/或一个或多个数字通用盘(digital versatile disk,DVD)。
NVM/存储器504可包括存储资源,该存储资源物理上是该系统所安装的或者可以被 访问的设备的一部分,但不一定是设备的一部分。例如,NVM/存储器504可经由网络模块或网络接口506被网络访问。
系统内存503以及NVM/存储器504可分别包括临时的或持久的指令510的副本。指令510可包括当由第一处理器5021或第二处理器5022中的至少一个执行时导致该电子设备实现本申请实施例描述的方法之一或组合的指令。各实施例中,指令510或硬件、固件,和/或软件组件可另外地/可替换地被置于系统控制逻辑501,网络模块或网络接口506和/或处理器(5021,5022)。
网络模块或网络接口506可包括一个接收器来为该电子设备提供无线接口来与一个或多个网络和/或任何合适的设备进行通信。网络模块或网络接口506可包括任何合适的硬件和/或固件。网络模块或网络接口506可包括多个天线来提供多输入多输出无线接口。在一个实施例中,网络模块或网络接口506可包括一个网络适配器、一个无线网络适配器、一个电话调制解调器,和/或无线调制解调器。
在一个实施例中,处理器(5021,5022)中的至少一个可以与用于系统控制逻辑的一个或多个控制器的逻辑一起封装。在一个实施例中,处理器中的至少一个可以与用于系统控制逻辑的一个或多个控制器的逻辑一起封装以形成系统级封装。在一个实施例中,处理器中的至少一个可以与用于系统控制逻辑的一个或多个控制器的逻辑集成在相同的管芯上。在一个实施例中,处理器中的至少一个可以与用于系统控制逻辑的一个或多个控制器的逻辑集成在相同的管芯上以形成系统芯片。
该电子设备可进一步包括输入/输出装置505。输入/输出装置505可包括用户接口旨在使用户与该电子设备进行交互,可包括外围组件接口,其被设计为使得外围组件能够与系统交互,和/或,可包括传感器,旨在确定环境条件和/或有关电子设备的位置信息。
基于图4或图5所示的结构,图6示例性地示出了一种处理装置的结构。该处理装置可以是应用于第一处理器的应用程序。如图所示,该处理装置可包括:获取单元601、数据处理单元602、发送单元603。
获取单元601用于获取用于界面展示的N个第一图片,数据处理单元602用于将所述N个第一图片组合为第二图片。发送单元603用于将所述第二图片的纹理数据发送给第二处理器。
基于图4或图5所示的结构,图7示例性地示出了另一种处理装置的结构。该处理装置可以是应用与第二处理器的应用程序。如图所示,该处理装置可包括:接收单元701、数据处理单元702、绘制单元703。
接收单元701用于接收第二图片,所述第二图片是根据N个第一图片组合得到的。数据处理单元702用于根据待绘制的第三图片,从所述第二图片的纹理数据中获取所述第三图片的纹理数据。绘制单元703用于根据获取到的纹理数据绘制所述第三图片。
图8示例性地示出了本申请实施例提供的界面绘制流程。如图所示,当电视设备启动后,可从网络侧的服务器获取用于界面展示的图片,并进行界面绘制,将绘制的界面进行展示。电视设备启动后所展示的界面一般称为桌面,其中可包括多个对象显示区域,一个对象显示区域可显示一个图片,每个对象显示区域被触发后,可执行对应的功能。比如,以图3A所示的界面为例,当对象显示区域中的对象(本例子中为图片)被触发后(比如用户通过遥控器选择该显示区域中的图片),播放该对象所对应的电影。
如图8所示,上述界面绘制过程可包括:
S801:第一处理器获取用于界面展示的图片,所获取到的图片可包括N个(N为大于等于1的整数)第一图片。
在电视设备启动的场景下,在基于图1所示架构的一些实施例中,第一处理器中运行的OpenGL主程序通过电视设备的网络模块与网络侧的服务器建立连接,并请求服务器发送用于界面展示的图片。在基于图2所示架构的一些实施例中,数字视频变换盒与网络侧服务器建立连接,将网络侧服务器发送的用于界面展示的图片发送给电视设备中的第一处理器。
通常情况下,电视设备所展示的界面可包含多页(用户可通过界面中的“上一页”“下一页”等翻页功能键进行翻页)。电视设备所展示的界面也可仅包含一页但其长度超过屏幕显示区域的高度,可通过滚动方式(比如用户可通过遥控器的“上/下”或“左/右”移动键对界面内容进行前后滚动)进行显示。由于界面中可包含大量图片,网络侧服务器发送图片的过程会占用较多的网络资源开销,影响图片传输效率,另外,电视设备绘制界面的过程也会占用大量系统开销,耗时较长,影响用户感受。因此本申请实施例中,服务器可首先将用于界面展示的部分图片发送给电视设备,之后在用户请求其他界面或请求界面的其它部分时,再根据用户的请求将相应图片发送给电视设备。其中,服务器可首先将电视设备启动后默认显示的界面中的图片或该界面中显示顺序在前的N个(N为大于等于1的整数)图片发送给电视设备。其中,N的取值可预先设置,一般可根据电视设备的处理能力(比如绘制能力)进行设置。
第一处理器接收到服务器发送的用于界面展示的图片后,可将该图片和/或该图片的索引存储在第一处理器的内存中。其中,图片的索引用于唯一标识一个图片。
上述S801具体可由第一处理器执行,或者由应用于第一处理器的处理装置(如应用程序)执行。更具体地,可由图6中的获取单元601执行。
S802:第一处理器将用于界面展示的N个第一图片组合为第二图片。
该步骤中,可采用图片拼接方式进行图片组合,即,将N个第一图片拼接为一个第二图片。第一处理器将N个第一图片拼接为一个第二图片时,可基于拼接得到的第二图片的尺寸尽量小的原则来进行。
基于上述原则,在一些实施例中,第一处理器可根据图片尺寸对所述N个图片进行分组,同一组中的图片的尺寸相同。第一处理器将同一组图片沿水平方向依次拼接,一组图片在图片高度上对齐。图9示例性地示出了将尺寸不完全相同的17个图片拼接为一个图片的示意图。具体实施时,可根据17个图片的宽高计算出拼接后的图片的尺寸,即,首先将尺寸较大的图片的宽度之和作为拼接后的图片的宽度,然后其他图片按行的顺序依次排列,最终根据行数以及每行图片的高度算出拼接后的图片的高度。具体如图9所示,根据图片尺寸进行分组可得到3个图片组,图片1~4为一组,图片5~8为一组,图片9~17为一组。每组图片按行方向(即图中的s轴方向,或称水平方向)依次排列,不同组图片占用不同的行。这样拼接可尽量减小拼接后的图片的尺寸,进而节省内存。
基于上述原则,在另外一些实施例中,第一处理器还可以根据更为复杂的拼接算法,计算得到N个第一图片的拼接方式,从而使第二图片的尺寸尽量小。
进一步地,如图9所示,各图片之间可保留设定大小的间隔,比如可保留1个到2个像素的间隙,这样可便于图片边界的截取。
进一步地,为了方便后续的图片绘制操作,对拼装后的图片的纹理宽度(如图中的s轴方向)和高度(如图中的t轴方向)坐标可进行归一化处理。对图9所示的拼接后的图片进行归一化处理后,可如图10所示。其中,拼接后的图片在s轴方向上的长度为1,在t轴方向上的长度为1。图片1~17的宽度和高度可如图10中的数字所示。
进一步地,在组合得到第二图片后,第一处理器可计算得到第二图片中每个第一图片在该第二图片中的位置信息,并保存该位置信息。所述位置信息可以是第一图片在第二图片中的坐标。以矩形图片为例,可以是图片4个顶点的坐标。
以2D纹理数据为例,2D纹理数据实际上是二维数组,它的元素是一些颜色值。第一处理器可根据接收到的第一图片中各像素的颜色值生成该第一图片的2D纹理数据,根据拼接后的第二图片生成该第二图片的2D纹理数据。
通过将多个第一图片组合为一个第二图片,使得该第二图片的纹理数据中包括所述 多个第一图片的纹理数据,这样,将多个第一图片的纹理数据整合为一个第二图片的纹理数据,针对该多个第一图片的绘制时,则可以采用批处理技术实现。
进一步地,第一处理器的内存中预先存储有界面布局相关信息,界面布局相关信息定义了界面的属性(比如大小、长宽比例)以及界面中各对象显示区域的位置,还可以定义界面中各对象显示区域内需要显示的对象。比如,以图3A所示的界面为例,该界面的界面布局相关信息定义了该界面中各对象显示区域(对象显示区域1至对象显示区域9)在该界面中的位置,以及各对象显示区域所显示的图片的索引。第一处理器可根据该界面布局相关信息获得界面中各对象显示区域的顶点数据(图3A中的对象显示区域为矩形,包括4个顶点)。
进一步地,第一处理器的内存中预先存储有界面中各对象显示区域的纹理坐标数据。纹理坐标简单地说就是纹理数据到目标图元表面映射。
上述S801具体可由第一处理器执行,或者由应用于第一处理器的处理装置(如应用程序)执行。更具体地,可由图6中的数据处理单元602执行。
S803:第一处理器将第二图片的纹理数据发送给第二处理器。
该步骤中,第一处理器可将S802中处理得到的第二图片的纹理数据,以及其他用于界面绘制的数据(比如各对象显示区域的顶点数据、纹理坐标数据、光照数据、场景矩阵等)进行合并,并根据与第二处理器之间的数据传输协议,将合并后的数据传输给第二处理器。其中,光照数据、场景矩阵等数据可预先设置在第一处理器的内存中。
可选地,第一处理器发送给第二处理器的数据中还可包括第二图片的纹理数据中所包含的第一图片的纹理数据在其中的位置信息。
上述S803具体可由第一处理器执行,或者由应用于第一处理器的处理装置(如应用程序)执行。更具体地,可由图6中的发送单元603执行。
S804:第二处理器从第一处理器接收到第二图片的2D纹理数据等用于界面绘制的数据后,根据待绘制的第一图片,从第二图片的纹理数据中获取待绘制的第三图片的纹理数据,并根据获取到的纹理数据绘制所述第三图片。其中,所述第三图片为所述N个第一图片中的至少一个图片。第二处理器可根据第三图片的纹理数据在所述第二图片的纹理数据中的位置信息,从所述第二图片的纹理数据中获取所述第三图片的纹理数据。
可选地,具体实施时,第一处理器在将第二图片的纹理数据等用于界面绘制的数据传输给第二处理器后,可向第二处理器发送界面绘制指令。通过绘制指令可指示第二处理器待展示的界面或界面中待绘制的第三图片。绘制指令中可包括待展示界面中待绘制 的第三图片的指示信息。第二处理器可根据绘制指令中待绘制的第三图片的指示信息确定该区域中需要绘制的图片。其中,待绘制的第三图片的指示信息可以是待绘制图片的索引,此种情况下,第二处理器可根据第三图片的索引,查询图片索引与第一图片在第二图片中的位置信息之间的对应关系,得到与待绘制的第三图片的索引对应的图片位置信息。第三图片的指示信息也可以是第三图片所对应的待绘制对象显示区域的索引,此种情况下,第二处理器可根据对象显示区域的索引,查询对象显示区域与第一图片的对应关系(该对应关系可根据界面布局预先设置),得到与该待绘制对象显示区域的索引对应的第三图片的索引,根据该第三图片的索引,查询第一图片索引与第一图片在第二图片中的位置信息之间的对应关系(该对应关系可在S802中由第一处理器确定),得到与该待绘制的第三图片的索引对应的位置信息,从而根据该位置信息从第二图片的纹理数据中的相应位置获得该第三图片的纹理数据。待绘制的第三图片的指示信息还可以是该图片在第二图片中的位置信息,此种情况下,第二处理器可直接根据该位置信息从第二图片的纹理数据中获得第三图片的纹理数据。
进一步地,第二处理器可根据待绘制的第三图片的纹理数据,并结合其他数据(比如待绘制对象显示区域的顶点数据、纹理坐标数据,以及光照数据、场景矩阵等)对该待绘制的对象显示区域中的第三图片进行绘制。
以图3A所示的界面为例,可将图片1至图片9拼接为一个图片,并将拼接得到的图片的2D纹理数据发送给第二处理器,使得第二处理器可在一次绘制过程中基于该第二图片的2D纹理数据在相应对象显示区域绘制图片1至图片9,即实现批处理。
上述S804具体可由第二处理器执行,或者由应用于第一处理器的处理装置(如应用程序)执行。更具体地,可分别由图7中的接收单元701、数据处理单元702和绘制单元703执行。
通过上述流程,当电视设备启动后,可从服务器获取用于界面绘制的图片进行界面绘制,并将绘制得到的界面显示在电视设备的屏幕上。后续,如果用户发出了上下翻页的请求或前后滚动界面的请求,或者请求另外的界面,此时,电视设备可响应用户的上述请求,更新当前显示的内容。
例如,以用户发出向下翻页的请求为例,第一处理器接收到向下翻页的请求后,可确定目标页面中包含的第一图片,针对目标页面中包含的第一图片,判断是否已经将由这些图片组合得到的图片的纹理数据发送给第二处理器;如果已经发送,则向第二处理器发送绘制指令,用于指示第二处理器绘制这些图片,否则,向服务器发送图片获取请 求,以请求获取这些图片,并按照前述实施例的方式,将获取到的第一图片组合为第二图片,将第二图片的纹理数据发送给第二处理器,并向第二处理器发送绘制指令,以指示第二处理器绘制目标页面。
再例如,在以请求新的界面为例,当前界面为电影列表界面,第一处理器接收到请求切换到电视剧列表界面的请求后,可针对所请求的界面确定用于该界面展示的图片是否已经从服务器获取得到。若判定为否,则向服务器发送图片获取请求,以请求获取所请求的界面中的图片;否则,向第二处理器发送绘制指令,该绘制指令用于指示第二处理器绘制所请求的界面。
在有些情况下,网络侧的服务器对用于界面绘制的图片进行了更新,比如更新了电影列表界面中第一个电影图片,此种情况下,服务器将更新的第一图片发送给电视设备。为描述方便,以下用“第四图片”表示上述N个第一图片中的一个或多个图片所更新后的图片。电视设备中的第一处理器接收服务器发送的第四图片,获取包含更新前的第二图片,根据第四图片更新该第二图片,将更新后的第二图片的纹理数据发送给第二处理器。第一处理器可进一步向第二处理器发送绘制指令,该绘制指令中包括第四图片的指示信息,以指示第二处理器更新相应图片。第二处理器可根据该绘制指令中的第四图片的指示信息,从更新后的第二图片的纹理数据中获取该第四图片的纹理数据,并根据该纹理数据对该第四图片进行绘制。
基于相同的技术构思,本申请实施例还提供了一个或多个计算机可读介质,所述可读介质上存储有指令,所述指令被一个或多个处理器执行时,使得电子设备执行前述实施例中的绘制方法。比如,使得电子设备可执行前述实施例中第一处理器所执行的方法,或者执行第二处理器所执行的方法,或者执行第一处理器和第二处理器所执行的方法。
通过以上描述可以看出,本申请的上述实施例中,一方面,第一处理器将用于界面展示的N个第一图片组合为一个第二图片,将该第二图片的纹理数据发送给第二处理器,从而使多个第一图片的纹理数据整合为一个图片的纹理数据,满足了批处理方案的要求,因此可采用批处理方案,一次将与多个图片的纹理数据发送给第二处理器进行图片绘制。另一方面,第二处理器可根据待绘制的图片,获取第二图片的纹理数据中所述待绘制的图片的纹理数据,根据获取到的纹理数据绘制所述待绘制的图片,实现了图片的批处理绘制,进而提高了绘制效率。

Claims (49)

  1. 一种电子设备,其特征在于,包括:
    第一处理器,获取用于界面展示的N个第一图片,将所述N个第一图片组合为第二图片,将所述第二图片的纹理数据发送给第二处理器,N为大于等于1的整数;
    第二处理器,根据待绘制的第三图片,从所述第二图片的纹理数据中获取所述第三图片的纹理数据,根据获取到的纹理数据绘制所述第三图片,所述第三图片为所述N个第一图片中的至少一个图片。
  2. 如权利要求1所述的电子设备,其特征在于,
    第一处理器进一步确定所述N个第一图片的纹理数据在所述第二图片的纹理数据中的位置信息,并将所述位置信息发送给第二处理器;
    所述第二处理器进一步根据所述第三图片的纹理数据在所述第二图片的纹理数据中的位置信息,从所述第二图片的纹理数据中获取所述第三图片的纹理数据。
  3. 如权利要求1所述的电子设备,其特征在于,所述第一处理器根据图片尺寸对所述N个第一图片进行分组,同一组中的图片的尺寸相同;以及,将同一组图片沿水平方向依次拼接,一组图片在图片高度上对齐。
  4. 如权利要求1所述的电子设备,其特征在于,所述第二图片中,相邻的第一图片之间间隔有设定距离。
  5. 如权利要求1所述的电子设备,其特征在于,
    所述第一处理器进一步向第二处理器发送第一绘制指令,所述第一绘制指令中包括所述第三图片的指示信息;
    所述第二处理器根据所述第一绘制指令中的所述第三图片的指示信息,确定所述待绘制的第三图片。
  6. 如权利要求5所述的电子设备,其特征在于,所述第三图片的指示信息包括:第三图片的索引,或者第三图片对应的待绘制对象显示区域的索引,或者第三图片在第二图片中的位置信息。
  7. 如权利要求6所述的电子设备,其特征在于,
    所述指示信息为第三图片的索引时,所述第二处理器根据所述第三图片的索引,查询图片索引与第一图片在第二图片中的位置信息之间的对应关系,得到与所述第三图片的索引对应的图片位置信息;或者,
    所述第三图片的指示信息为第三图片对应的待绘制对象显示区域的索引时,所述第 二处理器根据所述待绘制对象显示区域的索引,查询对象显示区域与图片的对应关系,得到与所述待绘制对象显示区域的索引对应的第三图片的索引,根据所述第三图片的索引,查询图片索引与第一图片在第二图片中的位置信息之间的对应关系,得到与所述第三图片的索引对应的图片位置信息。
  8. 如权利要求1所述的电子设备,其特征在于,第一处理器进一步:
    接收更新的第四图片,根据所述第四图片的纹理数据更新所述第二图片的纹理数据,将更新后的第二图片的纹理数据发送给第二处理器;其中,所述第四图片为所述N个第一图片中的至少一个图片所对应的更新后的图片。
  9. 如权利要求8所述的电子设备,其特征在于,所述第一处理器进一步向第二处理器发送第二绘制指令,所述第二绘制指令中包括所述第四图片的指示信息;
    第二处理器进一步根据所述第二绘制指令中的所述第四图片的指示信息,从所述更新后的第二图片的纹理数据中获取所述第四图片的纹理数据,根据获取到的纹理数据绘制所述第四图片。
  10. 如权利要求1所述的电子设备,其特征在于,所述第一处理器在所述电子设备启动后或在接收到界面请求后,向服务器发送图片获取请求;以及,接收所述服务器根据所述获取请求发送的用于界面展示的所述N个第一图片。
  11. 如权利要求10所述的电子设备,其特征在于,所述第一处理器在接收到界面请求后,针对所请求的界面确定用于该界面展示的第一图片是否已经从服务器获取得到;
    若判定为否,则向服务器发送所述图片获取请求,所述图片获取请求用于请求获取所请求的界面中的第一图片;否则,向第二处理器发送第三绘制指令,所述第三绘制指令用于指示第二处理器绘制所请求的界面。
  12. 如权利要求1至11中任一项所述的电子设备,其特征在于,所述第一处理器为中央处理器,所述第二处理器为图形处理器。
  13. 如权利要求1至11中任一项所述的电子设备,其特征在于,所述电子设备为电视设备。
  14. 一种处理装置,其特征在于,包括:
    获取单元,获取用于界面展示的N个第一图片,N为大于等于1的整数;
    数据处理单元,将所述N个第一图片组合为第二图片;
    发送单元,发送所述第二图片的纹理数据。
  15. 如权利要求14所述的装置,其特征在于,所述数据处理单元进一步确定所述N 个第一图片的纹理数据在所述第二图片的纹理数据中的位置信息;
    所述发送单元进一步发送所述位置信息。
  16. 如权利要求14所述的装置,其特征在于,所述数据处理单元根据图片尺寸对所述N个第一图片进行分组,同一组中的图片的尺寸相同;以及,将同一组图片沿水平方向依次拼接,一组图片在图片高度上对齐。
  17. 如权利要求14所述的装置,其特征在于,所述第二图片中,相邻的第一图片之间间隔有设定距离。
  18. 如权利要求14所述的装置,其特征在于,所述发送单元进一步发送第一绘制指令,所述第一绘制指令中包括第三图片的指示信息。
  19. 如权利要求18所述的装置,其特征在于,所述第三图片的指示信息包括:第三图片的索引,或者第三图片对应的待绘制对象显示区域的索引,或者第三图片在第二图片中的位置信息。
  20. 如权利要求14所述的装置,其特征在于,所述获取单元进一步接收更新的第四图片;其中,所述第四图片为所述N个第一图片中的至少一个图片所对应的更新后的图片;
    所述数据处理单元进一步根据所述第四图片的纹理数据更新所述第二图片的纹理数据;
    所述发送单元进一步发送更新后的第二图片的纹理数据。
  21. 如权利要求20所述的装置,其特征在于,所述发送单元进一步发送第二绘制指令,所述第二绘制指令中包括所述第四图片的指示信息。
  22. 如权利要求14所述的装置,其特征在于,所述获取单元在电子设备启动后或在接收到界面请求后,向服务器发送图片获取请求;以及,接收所述服务器根据所述获取请求发送的用于界面展示的所述N个第一图片。
  23. 如权利要求22所述的装置,其特征在于,所述获取单元在接收到界面请求后,针对所请求的界面确定用于该界面展示的第一图片是否已经从服务器获取得到;
    若判定为否,则向服务器发送所述图片获取请求,所述图片获取请求用于请求获取所请求的界面中的第一图片;否则,通过所述发送单元发送第三绘制指令,所述第三绘制指令用于指示第二处理器绘制所请求的界面。
  24. 一种处理装置,其特征在于,包括:
    接收单元,接收第二图片,所述第二图片是根据N个第一图片组合得到的,N为大 于等于1的整数;
    数据处理单元,根据待绘制的第三图片,从所述第二图片的纹理数据中获取所述第三图片的纹理数据;
    绘制单元,根据获取到的纹理数据绘制所述第三图片。
  25. 如权利要求24所述的装置,其特征在于,所述接收单元进一步接收所述N个第一图片的纹理数据在所述第二图片的纹理数据中的位置信息;
    所述数据处理单元根据所述第三图片的纹理数据在所述第二图片的纹理数据中的位置信息,从所述第二图片的纹理数据中获取所述第三图片的纹理数据。
  26. 如权利要求24所述的装置,其特征在于,所述接收单元进一步接收第一绘制指令,所述第一绘制指令中包括所述第三图片的指示信息;
    所述数据处理单元根据所述第一绘制指令中的所述第三图片的指示信息,确定所述待绘制的第三图片。
  27. 如权利要求26所述的装置,其特征在于,所述第三图片的指示信息包括:第三图片的索引,或者第三图片对应的待绘制对象显示区域的索引,或者第三图片在第二图片中的位置信息。
  28. 如权利要求27所述的装置,其特征在于,
    所述指示信息为第三图片的索引时,所述数据处理单元根据所述第三图片的索引,查询图片索引与第一图片在第二图片中的位置信息之间的对应关系,得到与所述第三图片的索引对应的图片位置信息;或者,
    所述第三图片的指示信息为第三图片对应的待绘制对象显示区域的索引时,所述数据处理单元根据所述待绘制对象显示区域的索引,查询对象显示区域与图片的对应关系,得到与所述待绘制对象显示区域的索引对应的第三图片的索引,根据所述第三图片的索引,查询图片索引与第一图片在第二图片中的位置信息之间的对应关系,得到与所述第三图片的索引对应的图片位置信息。
  29. 如权利要求24所述的装置,其特征在于,所述接收模块进一步接收更新后的第二图片的纹理数据,所述更新后的第二图片的纹理数据中包括第四图片的纹理数据,所述第四图片为所述N个第一图片中的至少一个图片更新后的图片。
  30. 如权利要求29所述的装置,其特征在于,所述接收模块进一步接收第二绘制指令,所述第二绘制指令中包括所述第四图片的指示信息;
    所述数据处理单元根据所述第二绘制指令中的所述第四图片的指示信息,从所述更 新后的第二图片的纹理数据中获取所述第四图片的纹理数据,根据获取到的纹理数据绘制所述第四图片。
  31. 一种绘制方法,其特征在于,包括:
    获取用于界面展示的N个第一图片,N为大于等于1的整数;
    将所述N个第一图片组合为第二图片;
    发送所述第二图片的纹理数据。
  32. 如权利要求31所述的方法,其特征在于,还包括:
    确定所述N个第一图片的纹理数据在所述第二图片的纹理数据中的位置信息;
    发送所述位置信息。
  33. 如权利要求31所述的方法,其特征在于,所述将所述N个第一图片组合为第二图片,包括:
    根据图片尺寸对所述N个第一图片进行分组,同一组中的图片的尺寸相同;以及,将同一组图片沿水平方向依次拼接,一组图片在图片高度上对齐。
  34. 如权利要求31所述的方法,其特征在于,所述第二图片中,相邻的第一图片之间间隔有设定距离。
  35. 如权利要求31所述的方法,其特征在于,还包括:
    发送第一绘制指令,所述第一绘制指令中包括第三图片的指示信息。
  36. 如权利要求35所述的方法,其特征在于,所述第三图片的指示信息包括:第三图片的索引,或者第三图片对应的待绘制对象显示区域的索引,或者第三图片在第二图片中的位置信息。
  37. 如权利要求31所述的方法,其特征在于,还包括:
    接收更新的第四图片;其中,所述第四图片为所述N个第一图片中的至少一个图片所对应的更新后的图片;
    根据所述第四图片的纹理数据更新所述第二图片的纹理数据;
    发送更新后的第二图片的纹理数据。
  38. 如权利要求37所述的方法,其特征在于,还包括:
    发送第二绘制指令,所述第二绘制指令中包括所述第四图片的指示信息。
  39. 如权利要求31所述的方法,其特征在于,所述获取用于界面展示的N个第一图片,包括:
    在电子设备启动后或在接收到界面请求后,向服务器发送图片获取请求;以及,接 收所述服务器根据所述获取请求发送的用于界面展示的所述N个第一图片。
  40. 如权利要求39所述的方法,其特征在于,所述在电子设备启动后或在接收到界面请求后,向服务器发送图片获取请求,包括:
    在接收到界面请求后,针对所请求的界面确定用于该界面展示的第一图片是否已经从服务器获取得到;
    若判定为否,则向服务器发送所述图片获取请求,所述图片获取请求用于请求获取所请求的界面中的第一图片;否则,发送第三绘制指令,所述第三绘制指令用于指示第二处理器绘制所请求的界面。
  41. 一种绘制方法,其特征在于,包括:
    接收第二图片,所述第二图片是根据N个第一图片组合得到的,N为大于等于1的整数;
    根据待绘制的第三图片,从所述第二图片的纹理数据中获取所述第三图片的纹理数据;
    根据获取到的纹理数据绘制所述第三图片。
  42. 如权利要求41所述的方法,其特征在于,还包括:
    接收所述N个第一图片的纹理数据在所述第二图片的纹理数据中的位置信息;
    所述从所述第二图片的纹理数据中获取所述第三图片的纹理数据,包括:
    根据所述第三图片的纹理数据在所述第二图片的纹理数据中的位置信息,从所述第二图片的纹理数据中获取所述第三图片的纹理数据。
  43. 如权利要求41所述的方法,其特征在于,还包括:
    接收第一绘制指令,所述第一绘制指令中包括所述第三图片的指示信息;
    根据所述第一绘制指令中的所述第三图片的指示信息,确定所述待绘制的第三图片。
  44. 如权利要求43所述的方法,其特征在于,所述第三图片的指示信息包括:第三图片的索引,或者第三图片对应的待绘制对象显示区域的索引,或者第三图片在第二图片中的位置信息。
  45. 如权利要求44所述的方法,其特征在于,所述根据所述第一绘制指令中的所述第三图片的指示信息,确定所述待绘制的第三图片,包括:
    所述指示信息为第三图片的索引时,根据所述第三图片的索引,查询图片索引与第一图片在第二图片中的位置信息之间的对应关系,得到与所述第三图片的索引对应的图 片位置信息;或者,
    所述第三图片的指示信息为第三图片对应的待绘制对象显示区域的索引时,根据所述待绘制对象显示区域的索引,查询对象显示区域与图片的对应关系,得到与所述待绘制对象显示区域的索引对应的第三图片的索引,根据所述第三图片的索引,查询图片索引与第一图片在第二图片中的位置信息之间的对应关系,得到与所述第三图片的索引对应的图片位置信息。
  46. 如权利要求41所述的方法,其特征在于,还包括:
    接收更新后的第二图片的纹理数据,所述更新后的第二图片的纹理数据中包括第四图片的纹理数据,所述第四图片为所述N个第一图片中的至少一个图片更新后的图片。
  47. 如权利要求46所述的方法,其特征在于,还包括:
    接收第二绘制指令,所述第二绘制指令中包括所述第四图片的指示信息;
    根据所述第二绘制指令中的所述第四图片的指示信息,从所述更新后的第二图片的纹理数据中获取所述第四图片的纹理数据,根据获取到的纹理数据绘制所述第四图片。
  48. 一个或多个计算机可读介质,所述可读介质上存储有指令,所述指令被一个或多个处理器执行时,使得电子设备执行如权利要求31至40中任一项所述的方法。
  49. 一个或多个计算机可读介质,所述可读介质上存储有指令,所述指令被一个或多个处理器执行时,使得电子设备执行如权利要求41至47中任一项所述的方法。
PCT/CN2018/086647 2017-05-24 2018-05-14 一种绘制方法及装置 Ceased WO2018214768A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710375345.9A CN108933955A (zh) 2017-05-24 2017-05-24 一种绘制方法及装置
CN201710375345.9 2017-05-24

Publications (1)

Publication Number Publication Date
WO2018214768A1 true WO2018214768A1 (zh) 2018-11-29

Family

ID=64396165

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/086647 Ceased WO2018214768A1 (zh) 2017-05-24 2018-05-14 一种绘制方法及装置

Country Status (3)

Country Link
CN (1) CN108933955A (zh)
TW (1) TW201901620A (zh)
WO (1) WO2018214768A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109636724A (zh) * 2018-12-11 2019-04-16 北京微播视界科技有限公司 一种列表界面的显示方法、装置、设备及存储介质
CN112581557A (zh) * 2019-09-30 2021-03-30 Oppo广东移动通信有限公司 图层绘制方法及电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102855132A (zh) * 2011-06-30 2013-01-02 深圳市大族激光科技股份有限公司 一种图形对象的选取方法及系统
CN102999946A (zh) * 2012-09-17 2013-03-27 Tcl集团股份有限公司 一种3d图形数据处理方法、装置及设备
US20140035950A1 (en) * 2009-02-02 2014-02-06 Adobe Systems Incorporated System and Method for Image Composition Using Non-Destructive Editing Model and Fast Gradient Solver
CN103677828A (zh) * 2013-12-10 2014-03-26 华为技术有限公司 一种图层绘制方法、绘图引擎及终端设备
CN105719331A (zh) * 2016-01-15 2016-06-29 网易(杭州)网络有限公司 精灵绘制方法、装置及游戏系统
CN106548501A (zh) * 2015-09-21 2017-03-29 阿里巴巴集团控股有限公司 一种图像绘制方法及设备

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8773448B2 (en) * 2010-04-09 2014-07-08 Intel Corporation List texture
CN102332151B (zh) * 2011-09-13 2015-01-07 深圳Tcl新技术有限公司 大批量图片的处理方法及系统
US20130106887A1 (en) * 2011-10-31 2013-05-02 Christopher Tremblay Texture generation using a transformation matrix
CN104461480B (zh) * 2013-09-16 2018-04-27 联想(北京)有限公司 一种信息处理方法及电子设备
CN106296622B (zh) * 2015-05-27 2020-04-28 阿里巴巴集团控股有限公司 一种自动布局的拼图方法及装置
CN105426191B (zh) * 2015-11-23 2019-01-18 深圳创维-Rgb电子有限公司 用户界面显示处理方法及装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140035950A1 (en) * 2009-02-02 2014-02-06 Adobe Systems Incorporated System and Method for Image Composition Using Non-Destructive Editing Model and Fast Gradient Solver
CN102855132A (zh) * 2011-06-30 2013-01-02 深圳市大族激光科技股份有限公司 一种图形对象的选取方法及系统
CN102999946A (zh) * 2012-09-17 2013-03-27 Tcl集团股份有限公司 一种3d图形数据处理方法、装置及设备
CN103677828A (zh) * 2013-12-10 2014-03-26 华为技术有限公司 一种图层绘制方法、绘图引擎及终端设备
CN106548501A (zh) * 2015-09-21 2017-03-29 阿里巴巴集团控股有限公司 一种图像绘制方法及设备
CN105719331A (zh) * 2016-01-15 2016-06-29 网易(杭州)网络有限公司 精灵绘制方法、装置及游戏系统

Also Published As

Publication number Publication date
TW201901620A (zh) 2019-01-01
CN108933955A (zh) 2018-12-04

Similar Documents

Publication Publication Date Title
KR102366752B1 (ko) 지도 인터페이스들의 지연시간 단축
CN100547646C (zh) 图象显示系统
WO2022110903A1 (zh) 全景视频渲染方法及系统
US9025927B2 (en) Systems and methods of variable frame rate playback
CN107103890B (zh) 在固定方向显示器上显示应用的方法及设备
US9426476B2 (en) Video stream
US10528998B2 (en) Systems and methods for presenting information related to products or services being shown on a second display device on a first display device using augmented reality technology
CN105934943A (zh) 动态显示布局
CN113687745A (zh) 一种分屏窗口的界面显示方法、系统及终端
CN112153459A (zh) 用于投屏显示的方法和装置
CN113891167B (zh) 投屏方法和电子设备
AU2017317839B2 (en) Panoramic video compression method and device
CN112835730B (zh) 图像存储、内存分配、图像合成方法、装置、设备及介质
JP5323260B2 (ja) 制御端末装置及びリモート制御システム
CN108595134A (zh) 智能交互平板及矢量图处理方法、装置和设备
CN114339412B (zh) 视频质量增强方法、移动终端、存储介质及装置
CN111901660B (zh) 一种图像显示方法、终端、电子设备及存储介质
WO2018214768A1 (zh) 一种绘制方法及装置
JP7289390B2 (ja) ディスプレイウォールシステムに用いるイメージ処理デバイス、および、ディスプレイ制御方法
CN110365918A (zh) 一种信源切换方法及设备
WO2018214779A1 (zh) 一种绘制方法及装置
US9207754B2 (en) Enabling immersive, interactive desktop image presentation
US20130104025A1 (en) Enabling immersive search engine home pages
KR102409033B1 (ko) 클라우드 스트리밍 서비스 시스템, 알파 레벨을 이용한 이미지 클라우드 스트리밍 서비스 방법 및 이를 위한 장치
CN111885417A (zh) Vr视频播放方法、装置、设备以及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18804950

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18804950

Country of ref document: EP

Kind code of ref document: A1