JP6503061B2 - Image synthesizing method, image chip and image device - Google Patents

Description

[Cross-reference to related applications]
This application claims the priority of Chinese Patent Application No. 201410566548.2 filed with the Chinese Patent Office on October 22, 2014 under the name of "IMAGE SYNTHESIS METHOD, IMAGE CHIP, AND IMAGE DEVICE", the entire contents of which are incorporated herein by reference. It is incorporated by reference.

[Technical field]
The present invention relates to the field of image processing technology, and in particular to an image combining method, an image chip and an image device.

  In the terminal screen, the application program generally displays the content for the user in the form of a window, ie, an image that the user views by using the terminal screen. When all of the plurality of application programs need to display the content on the terminal screen, the image displayed on the terminal screen is generally synthesized by overlapping a plurality of windows displayed by the plurality of application programs. It is acquired after. If the user activates the application program, the application program presents a window on the terminal screen and displays the content in the window. In this case, when a warning box of another application program pops up on the terminal screen, the warning box generally covers a part of the content in the window of the application program, and the result is finally displayed on the terminal screen Is an image displayed after the window displayed by the application program and the window displaying the warning box are superimposed.

In order to realize composite display of content corresponding to a plurality of windows, an available method is to make each window correspond to one layer in the memory . Images are actually drawn in memory, the image in each layer indicates the content that needs to be displayed in a window. If the window covers part of the other windows, the values of the pixels finally displayed on the terminal screen are those of the two layers in memory, and the values of the pixels at the same screen position are required The content is realized by adding according to the ratio, and the content finally displayed in the plurality of windows is obtained by adding the pixel values of the part mutually covered by the plurality of layers layer by layer according to the corresponding ratio Be done.

  In the prior art, images of multiple layers are combined in an off-line mode. In the offline mode, the layers that need to be displayed are read in advance before being displayed, and the pixel values of each point on the terminal screen are obtained by calculation and written to memory. If the layer needs to be displayed, the specific content is read from the memory where the pixel values are written and the specific content is displayed on the terminal screen. Thus, calculation of pixel values can only be performed after all layers have been read completely. As a result, it is not possible to maintain synchronization between the time when the pixel value is calculated and the time when the pixel value is displayed. If there are many image frames that need to be displayed, it will take a relatively long period of time to wait for a complete read of the layer, and it will take a relatively long time to calculate the pixel values This reduces the image synthesis efficiency and can not meet the requirements of current application programs.

  Embodiments of the present invention provide an image combining method, an image chip and an image device for improving the processing efficiency of image combining.

  In order to solve the aforementioned technical problems, the embodiments of the present invention provide the following technical solutions.

According to a first aspect, an embodiment of the present invention provides an image chip for use in image synthesis, wherein, on a first coordinate axis, of each layer in a plurality of layers of an image frame, An acquisition unit configured to individually acquire two coordinates corresponding to two boundaries perpendicular to one coordinate axis, thereby acquiring a plurality of coordinates corresponding to a plurality of layers; A layer division unit configured to divide an image frame into at least two image segments perpendicular to the first coordinate axis by using, the two boundaries of any image segment being within a plurality of coordinates the two corresponding to the adjacent coordinates, any image segments, are within at least one layer includes a portion where the image segment is within the interval located, near the one of the layer The part in which the image segment is located is divided by the layer division unit according to the time division system and the scanning order along the direction of the first coordinate axis and the layer division unit which is a sublayer of any layer An image reading unit configured to read at least two image segments acquired by the image acquisition unit, and sequentially combining the image composition on the at least two image segments according to a time sequence in which the image reading unit reads the at least two image segments in a time division manner An image compositing unit configured to generate display data corresponding to an image frame, the image compositing of the image segment comprising image compositing including image compositing of all the sublayers included in the image segment Includes units and

  With reference to the first aspect, in a first possible realization mode of the first aspect, the image reading unit is configured to adjust the first time along the direction of the first coordinate axis and in accordance with the scanning order. Specifically configured to read each sublayer in the image segment, read each sublayer in the nth image segment at the nth time, and repeat this step until n equals N, where n is 2 or more It is a positive integer and N is the quantity of image segments included in at least two image segments.

  With reference to the first possible realization mode of the first aspect or the first aspect, in a second possible realization mode of the first aspect, the image reading unit comprises a control module and at least one reading channel And the control module individually assigns one reading channel to each sublayer in the mth image segment obtained by the division by the layer division unit at the mth time among the at least one reading channel. Configured, m is any integer less than or equal to N, N is the quantity of image segments included in the at least two image segments, and each read channel is assigned to the read channel by the control module at the mth time Configured to read one sublayer.

  With reference to the second possible realization manner of the first aspect, in the third possible realization manner of the first aspect, the control module determines that the number of all sublayers in the m-th image segment is at least one. Specifically configured to assign all sublayers in the mth image segment to at least one read channel at time m, if not more than the number of read channels in one read channel, one unique sublayer Are assigned to one read channel at the mth time.

  Referring to the second possible realization manner of the first aspect, in the fourth possible realization manner of the first aspect, the control module is configured to: at least one of the number of all sublayers in the m-th image segment Specifically configured to allocate all sublayers in the mth image segment to at least one read channel multiple times within the mth time if greater than the number of read channels in one read channel, one sublayer Are assigned to one read channel in one assignment process.

  With reference to the second or third possible realization manner of the first aspect, in the fifth possible realization manner of the first aspect, the control module further comprises: a read sublayer in the m th image segment If a sublayer other than the already read sublayer is already read in the layer to which the pb belongs, release the reading channel assigned to the already read sublayer in the mth image segment, or If there is another unread sublayer other than the already read sublayer in the layer to which the already read sublayer in the second image segment belongs, it is assigned to the already read sublayer in the m-th image segment Are configured to continue reading other unread sublayers by using the Ru.

  According to a second aspect, an embodiment of the present invention further provides an imaging device, and an imaging chip according to any one of the above-described first aspect or any of the possible realization modes of any of the first aspects. A display, the display being configured to display display data generated by the imaging chip.

According to a third aspect, an embodiment of the present invention further provides an image compositing method, wherein on a first coordinate axis, each layer in a plurality of layers of an image frame is of a first coordinate axis. By obtaining two coordinates corresponding to two boundaries which are vertical, thereby obtaining a plurality of coordinates corresponding to a plurality of layers, and using the plurality of coordinates, Dividing into at least two image segments perpendicular to one coordinate axis, the two boundaries of any image segment correspond to two adjacent coordinates in the plurality of coordinates, and any image segment is: A portion which is in at least one layer and which falls within the section in which the image segment is located, which is in any layer and which is in which the image segment is located is Reading at least two image segments in a time division manner and according to a scanning order along the direction of the first coordinate axis, and at least two according to the time order reading the at least two image segments Performing image combining sequentially on the image segments, thereby generating display data, wherein the image combining of the image segments includes image combining of all one or more sub-layers included in the image segment; including.

  Referring to the third aspect, in a first possible realization mode of the third aspect, reading at least two image segments in a time division manner and according to a scanning order along the direction of the first coordinate axis Reads each sublayer in the first image segment at a first time along the direction of the first coordinate axis and according to the scanning order, and reads each sublayer in the nth image segment at an nth time, Repeating this step until n is equal to N, where n is a positive integer greater than or equal to 2 and N is the quantity of image segments included in at least two image segments.

  Referring to the third aspect, in a second possible realization mode of the third aspect, reading at least two image segments in a time division manner and according to a scanning order along the direction of the first coordinate axis Is a step of individually assigning one reading channel to each sublayer in the m-th image segment at the m-th time among at least one reading channel, and m is any integer less than or equal to N, N is a quantity of image segments included in at least two image segments, and reading each sublayer in the mth image segment by using each reading channel assigned to each sublayer.

  With reference to the second possible realization manner of the third aspect, in the third possible realization manner of the third aspect, the m-th image segment at the m-th time in at least one reading channel The step of individually assigning one read channel to each of the sub-layers in at least one of the sub-layers of the at least one read channel if the number of all sub-layers in the m th image segment is less than or equal to the number of read channels in at least one read channel Assigning all sublayers in the mth image segment to at least one reading channel, one unique sublayer being assigned to one reading channel at the mth time, or within the mth image segment If the quantity of all sublayers of is greater than the quantity of read channels in at least one read channel, A step of assigning a plurality of times in at least one of a read channel all sublayers in the image segment, one sublayer comprises assigned to one of a read channel in one assignment process.

  Referring to the second possible realization manner of the third aspect, in the fourth possible realization manner of the third aspect, the m-th image is obtained by using each reading channel assigned to each sublayer. After the step of reading each sublayer in the segment, the method is such that, in the layer to which the already read sublayer in the mth image segment belongs, the other sublayers other than the already read sublayer are already read , Releasing the reading channel assigned to the sublayer already read in the m th image segment, or in the layer to which the already read sub layer in the m th image segment belongs, If there are other unread sublayers except for the sublayer that has already been read in the m-th image segment, By using a read channel assigned to Ya, further comprising the step of continuing reading the sublayer that is not other read.

From the above technical solutions it can be learned that embodiments of the invention have the following advantages. In an embodiment of the present invention, two coordinates of each layer in the plurality of layers of the image frame, corresponding to the two boundaries in the direction of the first coordinate axis, are first obtained and correspond to the plurality of layers A plurality of coordinates are obtained, and then the image frame is divided into at least two image segments in the direction of the first coordinate axis by using the plurality of coordinates, and the two boundaries of any image segment are: Corresponding to two adjacent coordinates in the plurality of coordinates, any image segment is in at least one layer, including a portion falling within the section in which the image segment is located, in any layer, The part that falls within the section in which the image segment is located is a sublayer of any layer, and then in a time-division manner and along the direction of the first coordinate axis According to the ordinance, at least two image segments are read, and finally, image combining is performed sequentially on the at least two image segments according to the time sequence to read the at least two image segments in a time-division manner, whereby display data The image composition of the image segment includes the image composition of all one or more sublayers included in the image segment. In an embodiment of the present invention, the image frame is divided into at least two image segments, so that the image frame is also read in time division manner and according to the image segment, if the image synthesis is last performed, the image segment Can also be synthesized segment by segment according to the time sequence in which at least two image segments are read, multiple portions of display data can be generated, and the generated display data can be displayed directly. Since each layer of the image frame in the embodiment of the present invention is divided into a plurality of sublayers according to the section in which the image segment is located, the image segment is to perform image composition after the image segment is completely divided. It can be read in a timely manner, whereby the image combining efficiency in the embodiment of the present invention can be improved as compared to the prior art.

BRIEF DESCRIPTION OF DRAWINGS To describe the technical solutions in the embodiments of the present invention more clearly, the following briefly introduces the accompanying drawings required for describing the embodiments. Apparently, the attached drawings in the following description show only some embodiments of the present invention, and those skilled in the art can still derive other drawings from these attached drawings.
5 is a flowchart of an image combining method according to an embodiment of the present invention. FIG. 5 is a schematic view of layer composition according to an embodiment of the present invention. FIG. 7 is a schematic view of another layer combination according to an embodiment of the present invention. FIG. 5 is a schematic view of layer processing by using an image combining method according to an embodiment of the present invention. FIG. 5 is a schematic diagram of multiple layers input to an image chip in accordance with an embodiment of the present invention. FIG. 5 is a schematic view of an image obtained using composition by using multiple layers according to an embodiment of the present invention and displayed on a terminal screen. FIG. 5 is a schematic view of a plurality of layers input to an image chip. FIG. 1 is a schematic block diagram of an image chip according to an embodiment of the present invention. It is a schematic block diagram of the image reading unit by the Example of this invention. 1 is a schematic block diagram of an imaging device according to an embodiment of the present invention. FIG. 6 is a schematic view of another image chip according to an embodiment of the present invention.

  Embodiments of the present invention provide an image combining method, an image chip and an image device for improving the processing efficiency of image combining.

To invent purposes, easier to clear and understandable more of the features and advantages of the present invention, the following technical solution to clarify the embodiment of the present invention with reference to the accompanying drawings in the embodiment of the present invention described Do. Apparently, the embodiments shown in the drawings are merely a part rather than all of the embodiments of the present invention. All other embodiments obtained by a person skilled in the art based on the embodiments of the present invention shall fall within the protection scope of the present invention.

  In the specification, claims and attached drawings of the present invention, terms such as "first", "second" and the like are intended to distinguish between similar objects, and not necessarily in a specific order or It does not necessarily indicate the sequence. The terms used in this way are interchangeable under appropriate circumstances, which is merely a distinction scheme used when objects having the same attributes are described in the embodiments of the present invention. Furthermore, the terms "comprise", "include" and other variations are intended to cover non-limiting inclusions, whereby a process, method, system, product or device comprising a series of units It is not necessarily limited to these units, but may include other units not specifically described in such processes, methods, systems, products or devices, or other units unique to these.

Example 1
As shown in FIG. 1, embodiments of the present invention provide an image compositing method that may be applied to scenarios such as image compositing processing. The image combining method may include the following steps.

  101. On the first coordinate axis, obtain two coordinates corresponding to two boundaries of each layer in the plurality of layers of the image frame to be displayed, which are perpendicular to the first coordinate axis, , Get multiple coordinates corresponding to multiple layers.

Those skilled in the art should recognize that when the image frame to be displayed is displayed on the terminal screen, all layers contained in the image frame need to be composited for display. The reason for this is that image frames are generally obtained by overlaying multiple layers. In this embodiment of the invention, the coordinate system including the first coordinate axis is used as a reference system, and each frame in the image frame to be displayed has two boundaries perpendicular to the first coordinate axis, The boundary corresponds to one coordinate on the first coordinate axis. The first coordinate axis may specifically indicate a direction axis in a different coordinate system. A planar coordinate system is used as an example, and the first coordinate axis may be a horizontal axis (also called X axis, x-axis) or a vertical axis (also called Y axis, y-axis). An example is used where the first coordinate axis is the vertical axis, and for the boundaries of each layer perpendicular to the direction of the vertical axis, there are corresponding top and bottom coordinates, and the portion of the layer between the two boundaries is the top It corresponds separately to the coordinates between the coordinates and the bottom coordinates. Note that the layers included in this example may be rectangular layers, the two boundaries perpendicular to the first coordinate axis being here two sides that are within the rectangular layer and perpendicular to the first coordinate axis Should. Reference may be made to the description herein for similar expressions in the following, and details are not described in the following for the sake of brevity. It should be appreciated that both the top and bottom coordinates of each layer are described in the case where the first coordinate axis is selected as the vertical axis. In this embodiment of the invention, the "top coordinates" of the layer may be referred to as "top coordinates" and the "bottom coordinates" of the layer may be referred to as "bottom coordinates";"top and bottom" and "top coordinates" Both top and bottom are relative, and are used to describe the coordinate values of the layer's two start and end boundaries in the direction of the vertical axis. In some application scenarios of the present invention, when the terminal screen is arranged in the horizontal direction, the “top coordinates” and “bottom coordinates” of the layer are “left coordinates” and “right coordinates”, “right coordinates” and “right coordinates” It may further be called "left coordinate" or the like. Alternatively, if the first coordinate axis is a horizontal axis, the two boundaries of the layer in the direction of the horizontal axis also correspond respectively to the "left coordinate" and the "right coordinate".

  The image displayed on the terminal screen can generally be obtained by overlaying and combining multiple windows displayed by multiple applications, ie, one frame of the image displayed on the terminal screen is It should be noted that it is obtained by overlaying and combining layers corresponding to windows. The terminal screen continuously displays each layer continuously according to the scanning order. For example, if the scanning method of the terminal screen is progressive scanning from top to bottom, the content of the portion corresponding to the top coordinates of the layer may be displayed first, and the content of the portion corresponding to the bottom of the layer is last Is displayed.

In this embodiment of the invention, in order to realize the image composition, the image chip must first be acquired in the image frame to be displayed and all layers that need to be displayed on the terminal screen. Next, in the direction of the first coordinate axis, the coordinates of each layer corresponding to the boundary are acquired. From the above description of the contents, it can be learned that each layer has two boundaries in the direction of the first coordinate axis. For example, the two boundaries of each layer correspond to one top coordinate and one bottom coordinate. After obtaining a plurality of coordinates corresponding to the two boundaries of all layers that the image chip needs to be displayed, optionally, the image chip sorts the plurality of coordinates corresponding to the two boundaries of all layers You may Specifically, the sorting needs to be performed based on the selected first coordinate axis and according to the coordinate values, and the sorting may be performed according to the coordinate values in descending order or according to the coordinate values in ascending order May be After the plurality of coordinates (for example, the top coordinates and the bottom coordinates) corresponding to the two boundaries of all the layers are sorted , a plurality of coordinate values whose values are in ascending or descending order may be obtained.

  In this embodiment of the invention, if the example is used in which the first coordinate axis is a vertical axis in a plane coordinate system, at two coordinates corresponding to the two boundaries of all layers in the image frame to be displayed. The sorting performed by the image chip may specifically include the following steps.

  A1. Acquire separately top and bottom coordinates corresponding to the two boundaries of each layer that needs to be displayed.

  A2. Sort all acquired top and bottom coordinates.

The image chip first obtains top and bottom coordinates of each layer in all layers that need to be displayed, ie first, top and bottom coordinates of each layer are obtained. In this way, all top coordinates and all bottom coordinates of all layers can be obtained, and then all top coordinates and all bottom coordinates are sorted so that the values are in ascending or descending order to obtain a certain plurality of coordinate. As shown in FIG. 2a, there are a total of three layers in the image frame to be displayed that need to be displayed, which are layer a, layer b and layer c respectively, and layer a is right Layer b is a box filled with left diagonal lines, and layer c is a box filled with horizontal lines. Layer a and layer shown in the plan graph b, since the area A overlapping between the layers, not perfect. Those skilled in the art will appreciate that the complete layer a should include the part of the overlapping area between layer a and layer b, and likewise the complete layer b may overlap between layer b and layer c . It should be recognized that part of the area should be included. Reference may be made to the description herein for a schematic view on the same plane of multiple layers in an image frame that is included in the next example of the present invention. Each layer has top and bottom coordinates. Two boundaries of layer a correspond to top coordinates D1 and bottom coordinates D2, respectively, two boundaries of layer b correspond to top coordinates D3 and bottom coordinates D4, respectively, and two boundaries of layer c correspond to top coordinates D5 and bottom Assuming that the coordinate values respectively correspond to the coordinate D6 and are different from each other, the six coordinates are sorted according to the coordinate values. In this way, a sequence of six coordinates may be obtained whose values are in ascending or descending order . Assuming that D1>D3>D2>D5>D4> D6, the acquired sequence of six coordinate values whose values change continuously is D1, D3, D2, D5, D4 and D6. If there are multiple layers with the same boundaries, ie, if the respective boundaries of at least two layers correspond to the same top or bottom coordinates, then only one of these coordinates is selected for sorting. For example, as shown in FIG. 2b, if the bottom coordinate of layer a is the same as the top coordinate of layer b, ie D3 = D2, then it is obtained after being sorted and the values are successively in descending order The five changing coordinates should be D1, D3 (D2), D5, D4 and D6.

  In addition to the sorting scheme described above, other implementations may also be used in some other embodiments of the invention. For example, the top coordinates of all of the layers in the image frame to be displayed may be obtained first, and then the top coordinates of all of the layers are sorted. Next, all bottom coordinates of the layer are obtained, all bottom coordinates of the layer are sorted, and the result of sorting performed according to the bottom coordinates is inserted into the result of sorting performed according to the top coordinates. In some other embodiments of the present invention, first, the top and bottom coordinates of any two layers in all layers that need to be displayed may be acquired, and then the acquired top Coordinates and bottom coordinates are sorted. Next, the top and bottom coordinates of other layers in the layer that need to be displayed are obtained and inserted into the original sort result, until the top and bottom coordinates of the last layer are obtained, The top and bottom coordinates of the layer are inserted into the original sorting result. For a plurality of previously described coordinates having the same coordinate value, only one of these coordinates is selected and added to the sort result.

  A detailed description of the corresponding application scenario is provided below to facilitate a better understanding and implementation of the aforementioned solution.

  Referring to FIG. 3, FIG. 3 is a schematic view of a layer processing process by using an image combining method according to an embodiment of the present invention. In FIG. 3, the image chip may include a read circuit of T read channels and a processor, and may include a layer combiner configured to perform image segmentation on each layer input to the image chip, The processor is not shown here. The layer compositor reads each layer that is in the image frame and needs to be displayed by using T read channels, and then performs the image compositing and uses the display channel, Output the combined image to the terminal screen for display, T is a non-zero natural number, T read channels are marked as read channel 1, read channel 2, ... and read channel T respectively May be By using the vertical axis (y-axis) in the planar coordinate system as the first coordinate axis, an explanation is provided here. Step 101 may further include the following steps.

1011. Perform sorting according to the top and bottom coordinates of all layers, and there are M total sorted coordinates with ascending or descending values and M is non-zero natural number, M sorting The coordinate values of the set coordinates are y1, y2,... And yM respectively, which totals (M-1) coordinate sections, ie, (y1, y2), (y1, y2), .. And (yM-1, yM-2) respectively.

  As shown in FIG. 4a, an example is used in which the image frame comprises five layers, the five layers being layer A, layer B, layer C, layer D and layer E respectively. In the figure, layer A is represented by an empty box, the top coordinate of layer A is y1, and the bottom coordinate of layer A is y7. Layer B is represented by a box filled with right hatching, the top coordinate of layer B is y2, and the bottom coordinate of layer B is y5. Layer C is represented by a box filled with grid lines, with the top coordinates of layer C being y3, and the bottom coordinates of layer C being y7. Layer D is represented by a gray box, with the top coordinates of layer D being y4, and the bottom coordinates of layer D being y6. Layer E is represented by a box filled with dashed lines, with the top coordinates of layer E being y6 and the bottom coordinates of layer E being y7. The top and bottom coordinates of all layers are sorted to obtain sort results y1, y2, ... and y7. It should be appreciated that in FIG. 4a, transparency processing is performed on each layer to indicate the integrity of each layer. For overlapping areas between any two layers or between layers, the fill line and / or fill color is mixed with the respective fill line and / or fill color of the layer. It should be noted that step 1011 is merely an optional implementation scheme among the specific implementations of the image synthesis method provided in this embodiment of the present invention. It is not particularly limited in the present invention whether the plurality of coordinates obtained in step 101 are further processed to facilitate the realization after step 102.

102. By using a plurality of coordinates, the image frame to be displayed is divided into at least two image segments perpendicular to the first coordinate axis, and the two boundaries of any image segment are within the plurality of coordinates. Two image coordinates correspond to two adjacent coordinates, and any image segment is in at least one layer, includes a portion that falls within the section in which the image segment is located, is in any layer, and the image segment is located The part that falls within the section is the sublayer of any layer.

In this embodiment of the invention, after the image chip has acquired a plurality of coordinates corresponding to a plurality of layers in the image frame to be displayed, a plurality of coordinate sections may be acquired according to the values of the plurality of coordinates. The frame is divided into a plurality of corresponding image segments according to a plurality of coordinate intervals. A coordinate interval is composed of two adjacent coordinates, and each image segment includes all sublayers within the image frame and within the range of the coordinate interval corresponding to the image segment. For example, if the coordinate values of P coordinates do not repeat for P coordinates in which the value when P is a nonzero natural number changes continuously, the P coordinates are (p-1) coordinates A section can be configured. Referring to FIG. 2b, an example is used in which the image frame to be displayed includes three layers, and the first coordinate axis is the vertical axis. Each layer has two boundaries in the direction of the first coordinate axis, and each boundary corresponds to one coordinate, for a total of six coordinates. Because the bottom boundary of layer a is the same as the top boundary of layer b, the five coordinates obtained after duplicate elimination was performed on the values of six coordinates are: D1> D3 (D2)>D5> D4 > (D1, D3), (D3, D5), (D5, D4) and (D4, D6) are pairs of adjacent coordinates. The image frame may be divided into four image segments according to four pairs of adjacent coordinates. For example, layer a which falls in (D1, D3) is added to the image segment, sublayer b1 which is in layer b and which falls in (D3, D2) is added to another image segment, which is in layer b, (D5 , D4) in sublayer b2 and layer c, sublayer c1 in (D5, D4) is added to the third image segment, in layer c, sublayer c2 in (D4, D6) Added to 4 image segments.

  In this embodiment of the invention, at least two image segments are obtained by segmentation based on the coordinates of each boundary of each layer in the image frame to be displayed in the direction of the first coordinate axis, It should be noted that it may be recognized that both of any image segments generally need to be represented by using a two dimensional coordinate system. The two-dimensional coordinate system may be constituted by a first coordinate axis and a second coordinate axis which are perpendicular to each other. The boundaries of any image segment obtained by segmentation in the direction of the second coordinate (ie perpendicular to the second coordinate axis) are the same as the boundaries of the image frame to be displayed in the direction of the second coordinate axis. FIG. 4a is used as an example, the first coordinate axis is the y-axis and the second coordinate axis is the x-axis. The coordinates of the two boundaries of any image segment in the direction of the x-axis are those of the image frame to be displayed, and are the coordinates on the x-axis of the two boundaries perpendicular to the x-axis, ie x0 and x1 equal. The following embodiments are all in accordance with this rule and will not be described in detail.

  It should be noted that in this embodiment of the invention, one layer may be completely divided into one sublayer or may be divided into multiple sublayers. The sublayers obtained by the division still belong to one layer. The division of the original layer in this embodiment of the invention spreads one layer into one or more image segments, and then successively all the sublayers contained in each image segment to perform image composition. To read. Furthermore, in the reading process, data reading resources may be configured for sublayers in the layer for each segment according to the image segment reading order. Refer to the descriptions of the following examples for how to configure data reading resources for image segments formed after layer segmentation.

  3 and 4a described above are still used as an illustrative example, and step 102 may specifically include the following steps.

  1021. Divide all layers that need to be displayed into sub-layers according to all sorted y coordinates, thereby dividing the image frame to be displayed into at least two image segments.

  Figure 4a is used as an example. For layer A, two adjacent coordinates y1 and y2, two adjacent coordinates y2 and y3, two adjacent coordinates y3 and y4, two adjacent coordinates y4 and y5, two adjacent coordinates y5 and y6, and According to two adjacent coordinates y6 and y7, layer A may be divided into six sublayers, which are respectively y1-y2, y2-y3, y3-y4, y4-y5, y5-y6 and y6. layer B is divided into three sublayers, which are y2-y3, y3-y4 and y4-y5 respectively, and layer C is divided into four sublayers, which are Layer D is divided into two sublayers, y3-y4, y4-y5, y5-y6 and y6-y7 respectively, these are y4-y5 and y5-y6 respectively, layer E is 1 It is divided into a number of sublayers, namely y6-y7.

  1022. Add sub-layers in multiple sub-layers, each sub-layer individually corresponding to the same two adjacent coordinates, to one image segment, thereby obtaining at least two image segments.

Correspondingly, as shown in FIG. 4a, the image segment located between the two adjacent coordinates y1 and y2 contains only the first sublayer of layer A, and is between the two adjacent coordinates y2 and y3. The image segment located includes the second sublayer of layer A and the first sublayer of layer B, and the image segment located between the two adjacent coordinates y3 and y4 is the third sublayer of layer A, layer The image segment comprising the second sublayer of B and the first sublayer of layer C, located between the two adjacent coordinates y4 and y5, is the fourth sublayer of layer A, the third sublayer of layer B, comprises a first sub-layer of the second sub-layer and layer D layer C, 2 pieces of image segments located between adjacent coordinates y5 and y6 is a fifth sublayer of layer a, the third sublayer of layer C Includes a second sublayer of microcrystalline layer D, the two image segments located between adjacent coordinate y6 and y7 are the sixth layer A sublayer of Layer C first of the fourth sub-layer and Layer E Includes sublayers. That is, sublayers that are of all layers and that fall in the same coordinate section constitute one image segment, and for the sublayers included in each image segment, reference is further made to FIG. 2b and the description of the corresponding embodiment. The details are not described here. The "first" and "second" used to describe the sublayers of a layer are for ease of explanation and should be distinguished according to the top-to-bottom sorting of sublayers on the vertical axis Should be recognized.

  103. Read at least two image segments in time-division fashion and according to the scanning order along the direction of the first coordinate axis.

  In this embodiment of the invention, the image segmentation is performed along the direction of the first coordinate axis, so that the image chip is at least in time-shared fashion and according to the scanning order along the direction of the first coordinate axis. Read two image segments. Reading in a time division manner is reading at least two image segments at different times. That is, in this embodiment of the present invention, when scanning an image frame, the image chip performs scanning according to a specific scanning order. Based on the difference with the selection of the first coordinate axis described above, the imaging chip may perform scanning from top to bottom, or may perform scanning from bottom to top, or scanning from left to right Or scanning from right to left. Those skilled in the art should recognize that existing displays generally perform scanning in a progressive scanning manner. In general, progressive scanning is performed from top to bottom, starting with the first row at the top left corner of the screen. Each row may be considered as one scanning line, and the display screen is divided into a plurality of scanning lines along the horizontal direction. When performing display, according to the scanning order, the terminal screen displays an image segment corresponding to the scanning line for which progressive scanning is first completed within a certain time, and progressive scanning is completed later within the next time An image segment corresponding to the scanning line may be displayed. The time division scheme may be learned that the image chip is used both for scanning image frames and for the terminal screen to display image frames. Thus, when reading at least two image segments in an image frame, the image chip may also read the at least two image segments in a time division manner and in accordance with the scanning order of the scanning lines of the terminal.

  In this embodiment of the invention, the imaging chip may acquire at least two image segments in a time division manner. All coordinate values on the first coordinate axes of multiple sublayers in the same image segment are between the same pair of adjacent coordinates, and sublayers of the same image segment are displayed simultaneously or sequentially on the terminal screen The image chip needs to place these simultaneously or successively displayed sublayers in one image segment for reading.

  In some embodiments of the present invention, step 103 reads each sub-layer in the first image segment at a first time along the direction of the first coordinate axis and according to the scanning order, at an n th time Reading each sublayer in the nth image segment and repeating this step until n equals N, where n is a positive integer greater than or equal to 2 and N is an image segment included in at least two image segments Specifically, the steps may be included.

That is, N image segments may be read at N time points. At a first time, each sublayer of the first image segment is read, and at a later time, each sublayer in the image segment corresponding to the other time is read. For example, at the nth time, each sublayer in the nth image segment is read. This step is repeated until n equals N, where the value of n is 2, 3, 4, 5 etc. until each sublayer in the Nth image segment is read at the Nth time, etc. image segments and image segments of "a N" in the first "are sorted according to scan order.

Note that the image frames to be displayed are processed in the prior art in units of a single layer, so in the prior art image synthesis can only be performed after all layers have been completely read. It should. In this embodiment of the present invention, the image frame to be displayed is not processed in single layer units but in sub layer units. The sublayer is obtained after the layer is divided according to two adjacent coordinates, and the sublayer between the same two adjacent coordinates belongs to the image segment. In this embodiment of the invention, the image synthesis may no longer be performed in the off-line mode in the prior art, but instead at least two in time-division fashion and according to the scanning order along the direction of the first coordinate axis. When step 103 of reading one image segment is being performed, step 104 may be performed each time one image segment is read, and does not have to be performed after all image segments have been acquired. . In this embodiment of the invention, the real time reading and image combining scheme is defined as the on-line mode. Before the frames of the image begin to be displayed, the sublayers that need to be displayed are configured on the display channel. When a frame of the image starts to be displayed, the display channel simultaneously reads the pixel values from the corresponding sublayer, and the read pixel values are combined and added according to the pixel position to obtain the pixel value of each position on the terminal screen Do. Next, the pixel values obtained after composition are displayed directly on the terminal screen, in which case there is a relatively tight time synchronization relationship between when the pixel values are calculated and when the pixel values are displayed. Do.

  The above FIG. 3 and FIG. 4a are still used as an example for detailed description, and step 103 may specifically include the following steps.

  1031. Every time all sublayers of an image segment are acquired by division, all sublayers in the image segment are individually assigned to the reading channel.

  FIG. 4a is used as an example, and the assignment may be performed in the following manner.

  (1) Since the first image segment located between adjacent coordinates y1-y2 includes only the first sublayer of layer A, only the first sublayer of layer A reads channel 1 at a first time It needs to be configured, and other read channels need not be occupied.

  (2) Since the second image segment located between adjacent coordinates y2-y3 includes the second sublayer of layer A and the first sublayer of layer B, layer 2 for read channel 1 at a second time It is only necessary to configure the second sublayer of A and configure the first sublayer of layer B for read channel 2, ie, only two read channels need to be occupied in the second time There is no need for other read channels to be occupied.

  (3) For the third image segment located between adjacent coordinates y3 to y4, the image segment includes the third sublayer of layer A, the second sublayer of layer B and the first sublayer of layer C Thus, at the third time, the third sublayer of layer A may be configured for read channel 1 and the second sublayer of layer B may be configured for read channel 2; One sub-channel may be configured for read channel 3, i.e. only three read channels need to be occupied within the third time, and the other read channels need not be occupied.

  (4) For the fourth image segment located between adjacent coordinates y4 to y5, the fourth image segment is the fourth sublayer of layer A, the third sublayer of layer B, the second of layer C At the fourth time, the fourth sublayer of layer A may be configured for read channel 1 and the third sublayer of layer B may be read channel 2 at a fourth time, as it includes the first sublayer of sublayer and layer D. , And the second subchannel of layer C may be configured for read channel 3 and the first subchannel of layer D may be configured for read channel 4, ie Only one read channel needs to be occupied in the fourth time, the other read channel need not be occupied.

(5) For the fifth image segment located between adjacent coordinates y5 to y6, the fifth image segment corresponds to the fifth sublayer of layer A, the third sublayer of layer C, and the second of layer D. At the fifth time, the fifth sublayer of layer A may be configured for read channel 1, since there are only three sublayers in the fifth image segment , including the sublayer, the fifth of layer C The third sublayer may be configured for read channel 3 and the second subchannel for layer D may be configured for read channel 4, ie, only three read channels are in a fifth time period It needs to be occupied and other read channels do not have to be occupied. Since there are a total of three sublayers in layer B and the image combiner has already completely read the sublayers in layer B by using read channel 2 at the fifth time, read channel 2 It should be noted that it may be released to read sublayers of a layer.

  (6) For the sixth image segment located between adjacent coordinates y6-y7, the sixth image segment corresponds to the sixth sublayer of layer A, the fourth sublayer of layer C, and the first of layer E. At the sixth time, the sixth sublayer of layer A may be configured for read channel 1 and the fifth sublayer of layer C may be configured for read channel 3 to include the sublayer. According to the above description, read channel 2 is already released at the sixth time, and it can be learned that it is idle. Thus, layer E may be further configured for read channel 2. In this case, only read channel 1, read channel 2 and read channel 3 are occupied, and the other channels need not be occupied.

  In the above example, it may be learned that the number of read channels occupied may be different for different image segments, and the specific number of read channels may be selected according to the needs. Furthermore, in the previous example, since read channel 2 is idle after being assigned to layer B, layer E may also be configured for read channel 2 so that the sublayers of different layers are in different times It is read by using one read channel, which reduces the number of read channels. However, as customary in the prior art, when one read channel is generally configured for one layer, ie there are 5 layers, according to the prior art in common, 5 read channels are used simultaneously It needs to be done. However, in this embodiment of the present invention, five layers of image composition can be implemented without having to occupy five read channels, which reduces the number of read channels.

104. Perform image composition sequentially on the at least two image segments according to the time order reading the at least two image segments in time division mode, thereby generating display data corresponding to the image frame, image composition of the image segments includes an image synthesis of all sublayer included in the image segment.

  In this embodiment of the invention, after one image segment in at least two image segments has been read by performing step 103, the image chip immediately begins to execute step 104 and is read. Image compositing is performed on sublayers within the image segment to generate display data. Specifically, the image composition of the image segment is an image composition of all one or more sublayers in the image segment.

  In some embodiments of the present invention, when performing image synthesis on at least two images read in a time-division manner by performing step 104, the image chip may be configured to generate sub-layers within the first read image segment. The image synthesis is performed in S., then the image segment is performed in the sublayer in the image segment read later.

  In this embodiment of the invention, if the image chip performs image combining on each image segment, the image chip may read the pixel values corresponding to each layer in the image segment. After reading all pixel values of the image segment, the image chip may perform compositing calculations on all read pixel values to generate display data corresponding to the image segment. , Is a pixel value that can be synthesized on the terminal screen for display.

  In this embodiment of the present invention, the compositing calculation performed by the image chip at multiple pixel values is specifically realized by adding multiple pixel values at the same screen position according to the required ratio Also well, the ratio is the required transparency of the two layers, and the transparency is optionally from completely transparent to completely opaque. Image composition is realized by adding pixel values of portions mutually covered by a plurality of layers layer by layer according to the corresponding ratio, and pixel values displayed in portions not covered by the upper layer are lower It is a pixel value of a layer. An example in which the image frame to be displayed is RGBA (English full name: Red Green Blue Alpha) is used, one layer covers the other layer, and the value of A (abbreviation of Alpha) in the RGBA layer represents transparency. , RGB values represent the three colors of the layer, ie, red, green and blue, and the finally displayed color values are: RGB value of the current layer × a + RGB value of the lower layer × (1-a ).

  Steps 103 and 104 are further shown below to better explain the technical solution in the present invention. In some embodiments of the present invention, at least one image segment may be read by using the read channel in the image chip if at least one read channel is configured in the image chip. The read channel is a hardware resource configured in the image chip for reading data, and the specific implementation form of the read channel includes a bus, a data transmission line, a set of electronic components with read capability, etc. Not limited to these. The image segments may be read by using a read channel, and the number of read channels configured in the image chip may be preset according to the needs of the image frame to be processed by the image chip. Illustratively, there may be more than one read channel, which is not specifically limited in the present invention. After the number of read channels in the image chip has been set, the step of reading at least two image segments in a time-division manner and according to the scanning order along the direction of the first coordinate axis step 103 comprises the following steps: May be included in

  C1. One read channel is individually assigned to each sublayer in the mth image segment at the mth time among the at least one read channel configured in the image chip, and m is any one of N or less It is an integer and N is the quantity of image segments included in at least two image segments.

  C2. Read each sublayer in the mth image segment by using each read channel assigned to each sublayer.

  C3. Repeat the previous steps C1 and C2 until all image segments in the image frame are completely read.

  In the above example, for N image segments, the image segments are read at N time points each and the m th image segment may be any image segment in N image segments, ie The scheme of reading the mth image segment by the image chip is also applicable to all image segments. In step C1, the image chip assigns one read channel to each sublayer in the mth image segment, ie, one read channel is assigned to one sublayer when the sublayer is being read and the read channel After is fully assigned to the sublayer, sublayer reading can be realized by using the reading channel for the sublayer to which a reading channel has already been assigned.

  Correspondingly, step 104 performs the following steps: image combining on all sublayers in the mth image segment read by using at least one reading channel, whereby the mth image The method may specifically include the step of generating display data corresponding to the segment.

  That is, for all the mth image segment, after all sublayers in the mth image segment have been completely read, the image compositing is performed on all the readings to generate display data corresponding to the mth image segment. And the display data may be displayed on the terminal screen. Since the generation of display data for each image segment conforms to the scanning order, the reading of the m-th image segment and the image synthesis may be considered to be performed substantially simultaneously, to generate display data It is not required to perform image compositing only after the (m + 1) -th image segment, the (m + 2) -th image segment, etc. have been completely read. Those skilled in the art will recognize that as long as the frequency of scanning of the image frame is controlled so that reading and image synthesis of each image segment in the image frame and scanning of the image frame are performed almost simultaneously or synchronized, the image is human. It is possible to ensure that the visuals are continuous and that the image is formed when the display data acquired after the image synthesis has been performed individually on all image segments is displayed on the terminal screen It should be recognized.

  Furthermore, for the above-mentioned step C1, there may be two specific implementation schemes, which will be described in detail below.

C11. At least one of all the sublayers in the mth image segment at the mth time if the number of all the sublayers in the mth image segment is equal to or less than the number of the reading channel in at least one reading channel Assigned to the read channel, one unique sublayer is assigned to one read channel at time m, or
C12. If the number of all sublayers in the mth image segment is greater than the number of read channels in the at least one read channel, at least one all sublayers in the mth image segment within the mth time period. The read channel is assigned multiple times, and one sublayer is assigned to one read channel in one assignment process.

  For the implementation scheme in step C11, if the number of sublayers in the mth image segment is less than or equal to the number of read channels in the image chip, this means that the read channel needs of all sublayers in the mth image segment It means that the image chip can be assigned, and the image chip can assign read channels simultaneously to all sublayers in the mth image segment, and only one sublayer needs to be assigned to each read channel. Assigning read channels simultaneously means to assign all read channels in the image chip to all sublayers in the mth image segment at once, and all sublayers in the mth image segment One read channel can be obtained respectively by using the assignment of, and for all the sublayers in the mth image segment, data read can be completed at one time by using the assigned read channel it can.

For the implementation scheme in step C12, if the number of sublayers in the mth image segment is larger than the number of read channels in the image chip, this means that the read channel in the image chip is all sublayers in the mth image segment. The image chip needs to assign the read channel to all sublayers in the mth image segment multiple times, and one sublayer needs to assign each read channel in one allocation process. Assigned to Assigning a read channel to sublayers in the mth image segment multiple times does not complete individually assigning one sublayer to all sublayers in the mth image segment at one time, but completes it at least twice Meaning that all sublayers in the mth image segment can acquire one reading channel using multiple assignments, and for all sublayers in the mth image segment, data reading is , Can be completed multiple times by using the assigned read channel. The read channel is a physical resource used when the data of each layer is read, and the specific implementation method of the read channel is configured in a bus, a data transmission line, or an image chip and has read capability. Hardware resources, and image segments can be read by using a read channel. For example, if only three reading channels are configured in the image chip and there are seven sublayers in the mth image segment, including sublayers such as m1, m2, m3, m4, m5, m6 and m7 The image chip needs to assign seven sublayers to the read channel at least three times for reading. In the first assignment, the three read channels may be configured for the three sublayers (m1, m2 and m3) in the mth image segment, and the data of the three sublayers use the three read channels It is read first by doing. After the data of the three sublayers is completely read, the three read channels are then configured for the other three sublayers (m4, m5 and m6) in the mth image segment and the other three sublayers. Data is read by using three read channels. Finally, any read channel in the three read channels is assigned to the remaining last sublayer (m7) in the mth image segment, and the last sublayer data is read by using the read channel This completes the reading of all sublayers in the mth image segment. In this implementation method, m1, m @ 2, m3, m4, a plurality of sub-layers such as m5 and m6 are read first, and a storage medium for general cache is needed, then, image synthesis is the last It should be noted that it is performed in the six sublayers read first with the sublayer m7 read in.

In this embodiment of the invention, to improve the image synthesis efficiency and reduce the waiting time, the corresponding number of reading channels generally corresponds to the maximum number of sublayers that can be included in any image segment. may be configured in a chip, thereby, sublayer reading process can be any sublayer in the image segment is implemented according Architecture on C11 to be read simultaneously with the assignment of one. In this way, time to interact with the storage medium is saved, which improves the image synthesis efficiency.

  In some other embodiments of the present invention, based on the above implementation of steps C2 and C3, the image combining method provided in this embodiment of the present invention may further include the following steps. In the layer to which the already read sublayer in the mth image segment belongs, if the other sublayers other than the already read sublayer are already read, assign to the already read sublayer in the mth image segment Release the read channel, or if there are unread sublayers other than the already read sublayer in the layer to which the already read sublayer in the mth image segment belongs, Continue reading the other unread sublayers by using the read channel assigned to the already read sublayer in the image segment of.

That is, in the previous example, already read sublayers and other unread sublayers in the layer are added to different image segments, but the above sublayers still belong to the same layer. Thus, the "already read sublayer" and the "other unread sublayer" belong to different image segments. Therefore, the "previously read sublayer" and the "other unread sublayer" are not simultaneously displayed on the terminal screen, and the "already read sublayer" and the "other unread sublayer" are the same. A read channel may be used. Thus, in some embodiments of the present invention, for multiple groups of image segments located between two different adjacent coordinates, one read channel is used if these several image segments belong to the same layer , And may be fixedly assigned to a plurality of image segments belonging to the same layer. If all the other sublayers belonging to the same layer have been completely read after the already read sublayer has been completely read by using the read channel assigned to the sublayer, then the read channel assigned to the layer is: There is no need to be reserved, and the read channel can be released so that the image chip assigns the read channel to sublayers in other layers for use. Releasing the read channel is to release the corresponding hardware read resource so that the read channel continues to be used to read other sublayers and the released read channel becomes idle. , Which may continue to be called, which provides for reuse of the read channel. Unlike the above implementation scheme, if there is an unread sublayer other than the already read sublayer in the layer to which the already read sublayer in the mth image segment belongs, this means that the layer reads It means that you need to keep using the channel. Thus, the read channel used when a previously read sublayer is read may be reserved, thereby continuing to read other unread sublayers in the layer. That is, when a plurality of sublayers belong to the same layer, one of a read channel may be fixedly allocated to these sub-layer belonging to the same layer. The read channel does not have to be released after the image segment is completely processed, and the read channel may continue to be reserved to other sublayers in the same layer. In this way, the utilization efficiency of the read channel can be improved and frequent configuration and release of the read channel can be avoided, thereby improving the configuration efficiency of the read channel.

  According to the above description of the implementation scheme, in this embodiment of the invention, only a one-to-one correspondence is realized between the sublayer and the read channel, and there is no fixed binding between the read channel and the sublayer, It should be noted that the same reading channel may be used for different image segments, whereby the reading channel can be reused. For the use of read channels, in this embodiment of the invention, the number of read channels is selected according to the number of sublayers in different image segments, and in this embodiment of the invention "use on demand" is realized. This can avoid the unnecessary occupancy of the read channel and alleviates the problem of high instantaneous occupancy of bus bandwidth, which is present when all read channels are in use. If the number of sublayers of the image segment is very small, then the occupied read channels also decrease accordingly, and it is not necessary for each read channel to correspond to one layer. In this embodiment of the invention, if each layer occupies the entire terminal screen, this generally does not occur, and the layers generally occupy only a part of the terminal. In this way, it may occur that the layers in the image segment are divided into only one sublayer. Thus, only one read channel needs to be configured for the layer, and after the image segment is completely read, the read channel assigned to the above layer is further released and may be used by other layers Well, this considerably reduces the occupancy of the read channel.

  Referring to FIG. 3 and FIG. 4a above, when starting the composited display, the layer compositor follows the scanning order and before calculation of each segment for calculation of composition within the image segment It should be noted that the data of each sublayer is read from top to bottom segment by segment and the display performs the display.

  The calculation of composition performed on multiple pixel values may be specifically realized by adding multiple pixel values at the same screen position according to the requested ratio, the ratio being a requirement of two layers Transparency, which is optionally from completely transparent to completely opaque. The display of composition of a plurality of layers is realized by adding pixel values of portions mutually covered by a plurality of layers layer by layer according to the corresponding ratio, and displayed in a portion not covered by an upper layer The pixel value is a pixel value of the lower layer. FIG. 4b is a schematic view of an image synthesized on a plurality of layers and displayed on a terminal screen according to an embodiment of the present invention. During image composition, the parts mutually covered by layer A, layer B, layer C, layer D and layer E may be covered according to the degree of transparency.

  From the above specific application scenario of this embodiment of the present invention, layers are read progressively from segment to segment in the display process, but not simultaneously at the start of the display process, this is an instantaneous occupancy of the bus bandwidth. It can be learned that you can reduce If the layer does not occupy all segments on the y axis, the corresponding read channel is released after the layer is completely displayed. In this case, the read channel may be configured for other layers not yet displayed, which reduces the read channel occupancy.

From the description of the present invention in the previous embodiment, two coordinates corresponding to the two boundaries in the direction of the first coordinate axis are obtained first for each layer in the plurality of layers of the image frame to be displayed , A plurality of coordinates corresponding to a plurality of layers are obtained, and then the image frame to be displayed is divided into at least two image segments in the direction of the first coordinate axis by using the plurality of coordinates, Two boundaries of some image segments correspond to two adjacent coordinates in a plurality of coordinates, and any image segment is in at least one layer, and a portion that falls within the section in which the image segment is located The part that is included in any layer and included in the section where the image segment is located is a sublayer of any layer, and then the direction of the first coordinate axis Along the time-division scheme and according to the scanning order, at least two image segments are read, and finally, the image synthesis is consecutive on the at least two image segments according to the time sequence to read the at least two image segments in a time-division scheme This may be performed to generate display data, and the image composition of the image segment may be learned to include image composition of all one or more sublayers included in the image segment. In this embodiment of the invention, the image frame to be displayed is divided into at least two image segments, so that the image frames are also read in time-division and according to the image segments, and the image synthesis is finally performed If so, image segments may also be synthesized segment by segment according to the time sequence to read at least two image segments, multiple portions of display data may be generated, and the generated display data may be displayed directly . Since each layer of the image frame to be displayed in this embodiment of the present invention is divided into a plurality of sublayers according to the section in which the image segment is located, the image segment is synthesized after the image segment is completely divided. It can be read in a timely manner to implement, whereby the image combining efficiency in this embodiment of the invention can be improved compared to the prior art.

It should be noted that, for ease of explanation, the above-described method embodiments are expressed as a combination of a series of operations. However, one of ordinary skill in the art should recognize that the present invention is not limited by the above-described operation sequence, as some steps may be performed in other sequences or simultaneously according to the present invention. Furthermore, the person skilled in the art should also recognize that the embodiments described in the specification all belong to the optional embodiments, and the related operations and modules are not necessary for the present invention.

  In order to facilitate a better realization of the above-mentioned solution in the first embodiment of the present invention, in the following, the related apparatus configured to realize the above-mentioned solution is further provided. It should be noted that relevant features of the following apparatus embodiments may be cross-referenced to the features of the aforementioned method embodiments.

Example 2
As shown in FIG. 5a, the image chip 500 used for image synthesis and provided in this embodiment of the invention comprises an acquisition unit 501, a layer division unit 502, an image reading unit 503, an image synthesis unit 504 and May be included.

  The acquisition unit 501 is individually associated with two coordinates corresponding to the two boundaries perpendicular to the first coordinate axis, of each layer in the plurality of layers of the image frame to be displayed on the first coordinate axis. It is configured to obtain and thereby obtain a plurality of coordinates corresponding to a plurality of layers.

  Those skilled in the art should recognize that the image chip generally includes a memory or cache configured to store each layer of the image frame to be displayed and is not shown in the drawings for the sake of brevity. .

The layer division unit 502 is configured to divide the image frame into at least two image segments perpendicular to the first coordinate axis by using a plurality of coordinates, and the two boundaries of any image segment are: Corresponding to two adjacent coordinates in the plurality of coordinates, any image segment is in at least one layer, including a portion falling within the section in which the image segment is located, in any layer, The part that falls within the section in which the image segment is located is a sublayer of any layer.

The image reading unit 503 is configured to read at least two image segments obtained by the division by the layer division unit 502 in a time division manner and according to a scanning order along the direction of the first coordinate axis.

The image compositing unit 504 performs image compositing sequentially on the at least two image segments according to the time sequence in which the image reading unit 503 reads the at least two image segments in a time division manner, thereby generating display data. configured, image synthesis of the image segment includes an image synthesis of all sublayer included in the image segment.

  In some embodiments of the present invention, the image reading unit 503 reads each sub-layer in the first image segment at a first time along the direction of the first coordinate axis and according to the scanning order, the n th It may be specifically configured to read each sublayer in the nth image segment at time and repeat this step until n equals N, where n is a positive integer greater than or equal to 2 and N is at least It is the number of image segments included in two image segments.

In some embodiments of the present invention, referring to FIG. 5 b, the image reading unit 503 includes a control module 5031 and at least one reading channel 5032, the control module 5031 including at least one reading channel 5032 . In the m-th time, one reading channel is individually assigned to each sublayer in the m-th image segment acquired by division by the layer division unit, and m is any integer less than or equal to N , N is the quantity of image segments included in at least two image segments, and each read channel 5032 is configured to read one sublayer assigned to the read channel by the control module 5031 at the mth time.

  In some embodiments of the present invention, the control module 5031 may determine if the number of all sublayers in the mth image segment is less than or equal to the number of read channels in the at least one read channel. Specifically configured to assign all sublayers in the m image segments to at least one read channel, one unique sublayer is assigned to one read channel at the mth time.

  In some embodiments of the present invention, the control module 5031 determines whether the number of all sublayers in the mth image segment is greater than the number of read channels in the at least one read channel within the mth time period. Specifically, all sublayers in m image segments are allocated to at least one read channel multiple times, and one sublayer is allocated to one read channel in one allocation process.

  In some embodiments of the present invention, the control module 5031 is configured such that, in the layer to which the already read sublayer in the mth image segment belongs, the other sublayers other than the already read sublayer are already read. , Release the reading channel assigned to the sublayer already read in the mth image segment, or remove the already read sublayer in the layer to which the already read sublayer in the mth image segment belongs If there are other unread sublayers, it is further configured to continue reading other unread sublayers by using the read channel assigned to the already read sublayer in the mth image segment Be done.

From the above description of this embodiment of the invention, two coordinates are obtained first of each layer in the plurality of layers of the image frame to be displayed, corresponding to the two boundaries in the direction of the first coordinate axis And a plurality of coordinates corresponding to the plurality of layers are obtained, and then the image frame to be displayed is divided into at least two image segments in the direction of the first coordinate axis by using the plurality of coordinates, The two boundaries of any image segment correspond to two adjacent coordinates in the plurality of coordinates, and any image segment is in at least one layer and the part that falls within the interval in which the image segment is located The part that is included in any layer and that falls within the section in which the image segment is located is a sublayer of either layer, and then in the direction of the first coordinate axis. Therefore, at least two image segments are read in a time division manner and in accordance with a scanning order, and finally, the image composition is continuous in at least two image segments according to a time order in which at least two image segments are read in a time division manner. This may be performed to generate display data, and the image composition of the image segment may be learned to include image composition of all one or more sublayers included in the image segment. In this embodiment of the invention, the image frame to be displayed is divided into at least two image segments, so that the image frames are also read in time-division and according to the image segments, and the image synthesis is finally performed If so, image segments may also be synthesized segment by segment according to the time sequence to read at least two image segments, multiple portions of display data may be generated, and the generated display data may be displayed directly . Since each layer of the image frame to be displayed in this embodiment of the present invention is divided into a plurality of sublayers according to the section in which the image segment is located, the image segment is synthesized after the image segment is completely divided. It can be read in a timely manner to implement, whereby the image combining efficiency in this embodiment of the invention can be improved compared to the prior art. The units or modules within the image chip 500 according to either FIG. 5a or 5b may be integrated in a semiconductor by using integrated circuit production technology.

[Example 3]
As shown in FIG. 6, this embodiment of the present invention further provides an imaging device 600 which may include an imaging chip 500 according to either FIG. 5a or 5b and a display 601.

  The display 601 is configured to display display data generated by the image chip.

  The display 601 is generally used as a terminal screen in a mobile terminal or other home terminal, and the display 601 serves as the terminal screen described in the above embodiment and displays display data generated by an image chip. Configured to

  The imaging device provided in this embodiment of the present invention may include, but is not limited to, multiple product types that need to perform image composition such as mobile terminals, tablet computers, desktop computers and home terminals. It can be understood.

  From the above description of this embodiment of the invention, the image frame to be displayed in the image chip is divided into at least two image segments, so that the image frames are also read in time-division fashion and according to the image segments, If image combining is performed last, image segments may also be combined segment by segment, multiple portions of display data may be generated, and the generated display data may be directly displayed. Since each layer of the image frame to be displayed in this embodiment of the present invention is divided into a plurality of sublayers according to the section in which the image segment is located, the image segment is synthesized after the image segment is completely divided. It can be learned that it can be read in a timely manner to perform, whereby the image combining efficiency in this embodiment of the invention can be improved compared to the prior art.

Example 4
As shown in FIG. 7, this embodiment of the present invention further provides another image chip 700, which includes a memory 701, a processor 702, a reading circuit 703, and an image synthesizer 704. .

  The memory 701 is configured to store an image frame to be read.

The processor 702 reads the image frame stored in the memory 701 and individually separates the two coordinates corresponding to the two boundaries perpendicular to the first coordinate axis of each layer in the plurality of layers of the image frame. Acquiring and thereby acquiring a plurality of coordinates corresponding to a plurality of layers and using the plurality of coordinates to divide the image frame to be displayed into at least two image segments perpendicular to the first coordinate axis Configured such that the two boundaries of any image segment correspond to two adjacent coordinates in the plurality of coordinates, any image segment is within at least one layer, and the image segment is located A portion that includes a portion that falls within a section, is within any layer, and falls within a section in which an image segment is located is a sublayer of any layer.

  The reading circuit 703 is configured to read at least two image segments obtained by the division by the processor 702 in a time division manner and according to a scanning order along the direction of the first coordinate axis.

The image synthesizer 704 is configured to sequentially perform image synthesis on the at least two image segments according to the time sequence in which the reading circuit 703 reads at least two image segments, thereby generating display data, image composition includes an image synthesis of all sublayer included in the image segment.

  In some embodiments of the present invention, the image combiner 704 performs the following steps: each sub-layer in the first image segment at a first time along the direction of the first coordinate axis and according to the scanning order Reading each sublayer in the nth image segment at the nth time, and repeating this step until n equals N, where n is a positive integer greater than or equal to 2 and N is at least 2 It is specifically configured to perform a step which is the quantity of image segments included in one image segment.

In some embodiments of the present invention, the read circuit 703 may specifically include a controller 7031 and at least one read channel 7032, the read channel being a data read channel configured by hardware resources, Specific implementations of the read channel include, but are not limited to, buses, data transmission lines, sets of electronic components with data read capabilities, and the like. The controller 7031 may be controlled by using at least one read channel 7032 channel commands, input / output, interrupts, channel release etc., and reference is made to the aforementioned techniques for a specific implementation of the controller. It may be The controller 7031 is a step of individually assigning one reading channel 7032 to each sublayer in the m-th image segment at the m-th time among the following steps: at least one reading channel, where m is N It is configured to perform the step of any integer number below, where N is the quantity of image segments included in the at least two image segments.

  Correspondingly, the image combiner 704 reads each sublayer in the mth image segment by using each read channel assigned to each sublayer.

  In the previous embodiment, further, the controller 7031 performs the following steps: if the quantity of all sublayers in the mth image segment is less than or equal to the quantity of read channels in at least one read channel Assigning all sublayers in the mth image segment to at least one read channel at a time, one unique sublayer being assigned to one read channel at the mth time, or the mth Assigning all sublayers in the mth image segment to at least one read channel multiple times if the quantity of all sublayers in the image segment is greater than the number of read channels in at least one read channel; Sublayers in one allocation process It is specifically configured to perform the steps assigned to one read channel.

  In this embodiment of the present invention, the controller 7031 performs the following steps: in the layer to which the already read sublayer in the mth image segment belongs, the other sublayers other than the already read sublayer have already been read If it is, the step of releasing the reading channel assigned to the sublayer already read in the m.sup.th image segment, or in the layer to which the already read sublayer in the m.sup.m image segment belongs is already read. Continue reading the other unread sublayers by using the read channel assigned to the already read sublayer in the m-th image segment, if there are other unread sublayers other than the specified sublayer It is further configured to perform the steps.

  The components in this embodiment may correspond to the units provided in the second embodiment, the processor 702 corresponds to the acquisition unit and the layer division unit, the reading circuit 703 corresponds to the image reading unit, and the layer The combiner 704 corresponds to an image combining unit. In view of this, reference may be made to the image chip provided in Example 2 for the relevant features of the image chip provided in this embodiment. Furthermore, for the sake of brevity, certain corresponding features in the embodiments will not be repeatedly described in detail, and the description in the first embodiment may be specifically referred to.

From the above description of this embodiment of the invention, two coordinates are obtained first of each layer in the plurality of layers of the image frame to be displayed, corresponding to the two boundaries in the direction of the first coordinate axis And a plurality of coordinates corresponding to the plurality of layers are obtained, and then the image frame to be displayed is divided into at least two image segments in the direction of the first coordinate axis by using the plurality of coordinates, The two boundaries of any image segment correspond to two adjacent coordinates in the plurality of coordinates, and any image segment is in at least one layer and the part that falls within the interval in which the image segment is located The part that is included in any layer and that falls within the section in which the image segment is located is a sublayer of either layer, and then in the direction of the first coordinate axis. Therefore, at least two image segments are read in a time division manner and in accordance with a scanning order, and finally, the image composition is continuous in at least two image segments according to a time order in which at least two image segments are read in a time division manner. This may be performed to generate display data, and the image composition of the image segment may be learned to include image composition of all one or more sublayers included in the image segment. In this embodiment of the invention, the image frame to be displayed is divided into at least two image segments, so that the image frames are also read in time-division and according to the image segments, and the image synthesis is finally performed If so, image segments may also be synthesized segment by segment according to the time sequence to read at least two image segments, multiple portions of display data may be generated, and the generated display data may be displayed directly . Since each layer of the image frame to be displayed in this embodiment of the present invention is divided into a plurality of sublayers according to the section in which the image segment is located, the image segment is synthesized after the image segment is completely divided. It can be read in a timely manner to implement, whereby the image combining efficiency in this embodiment of the invention can be improved compared to the prior art.

  Furthermore, it should be noted that the described embodiment of the device is merely an example. The units described as separate parts may or may not be physically separate, and the parts labeled as units may or may not be physical units, or 1 It may be located at one location or may be distributed over multiple network units. Some or all of the modules may be selected according to the actual needs to achieve the purpose of the solution of the embodiment. Furthermore, in the accompanying drawings of the embodiment of the device provided in the present invention, the connection between modules shows that the modules have a communication connection with each other, which is embodied as one or more communication buses or signal cables. May be realized. One skilled in the art can understand and implement the embodiments of the present invention without creative efforts.

  Based on the above description of the implementation scheme, those skilled in the art may realize the software in addition to the general purpose hardware required by the present invention, or a special purpose integrated circuit, a dedicated CPU, a dedicated memory, a dedicated component, etc. It can be clearly understood that it may be realized by hardware. In general, any function that can be performed by a computer program can be easily realized by using corresponding hardware. Furthermore, the specific hardware configuration used to achieve the same function may take various forms, for example in the form of analog circuits, digital circuits, dedicated circuits, etc. However, for the present invention, software program implementations are in most cases a better implementation scheme. Based on such an understanding, the technical solution of the present invention may be realized in the form of a software product, in essence or contributing to the prior art. The software product may be a computer's floppy disk, USB flash drive, removable hard disk, read-only memory (ROM), readable memory such as random access memory (RAM), magnetic disk or optical disk. It includes a plurality of instructions stored in a medium and instructing a computer device (which may be a personal computer, a server, a network device or the like) to perform the method described in the embodiment of the present invention.

  The foregoing description is merely intended to illustrate the technical solutions of the present invention, and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art can continue to use the techniques described in the above embodiments without departing from the spirit and scope of the technical solutions of the embodiments of the present invention. It should be understood that modifications may be made to the solution, or equivalent substitutions may be made to some of its technical features.

Claims (12)

An image chip used for image composition,
On a first coordinate axis, separately obtaining two coordinates corresponding to two boundaries of each layer in the plurality of layers of the image frame and perpendicular to the first coordinate axis, An acquisition unit configured to acquire a plurality of coordinates corresponding to a plurality of layers, wherein each layer is a rectangular layer ;
A layer division unit configured to divide the image frame into at least two image segments perpendicular to the first coordinate axis by using the plurality of coordinates, two of any image segments The boundary corresponds to two adjacent coordinates in the plurality of coordinates, and any one of the image segments is in at least one layer and includes a portion that falls within the section in which the image segment is located; A layer division unit which is a sublayer of any one of the layers;
An image reading unit configured to read the at least two image segments obtained by the division by the layer division unit in a time division manner and according to a scanning order along the direction of the first coordinate axis;
Image combining is sequentially performed on the at least two image segments according to the time sequence in which the image reading unit reads the at least two image segments in the time division manner, thereby generating display data corresponding to the image frame An image compositing unit configured to perform image compositing of image segments, the image compositing unit including image compositing of all sublayers included in the image segment. The image reading unit reads each sublayer in the first image segment at a first time along the direction of the first coordinate axis and in accordance with the scanning order, and at an n th time in an n th image segment reads each sublayer, n is configured to repeat this step until it equals the n, n is 2 or more integer, n is the a number of image segments included in the at least two image segments, The chip according to claim 1. The image reading unit comprises a control module and at least one reading channel
The control module is configured to individually assign one reading channel to each sublayer in the mth image segment acquired by the division by the layer division unit at the mth time among the at least one reading channel. And m is any integer not greater than N, and N is the number of image segments included in the at least two image segments,
The chip according to claim 1 or 2, wherein each read channel is configured to read one sublayer assigned to the read channel by the control module at the mth time.   The control module is configured to: if the quantity of all sublayers in the m-th image segment is less than or equal to the quantity of reading channels in the at least one reading channel, at the m-th time the m-th image segment The chip according to claim 3, wherein all the sublayers are configured to be assigned to the at least one read channel, and one unique sublayer is assigned to one read channel at the mth time.   The control module is configured to: if the quantity of all sublayers in the mth image segment is greater than the quantity of read channels in the at least one read channel, the control module may generate the mth image segment in the mth time period. The chip according to claim 3, wherein all the sublayers are configured to be assigned to the at least one read channel multiple times, and one sublayer is assigned to one read channel in one assignment process.   The control module is configured to, when a sublayer other than the already read sublayer is already read in the layer to which the already read sublayer in the mth image segment belongs, Release the reading channel assigned to the already read sublayer, or else read other than the already read sublayer in the layer to which the already read sublayer in the mth image segment belongs Further configured to continue reading the other unread sublayer by using the read channel assigned to the already read sublayer in the mth image segment, if there is an unread sublayer, The chip according to claim 3 or 4. An imaging device comprising the imaging chip according to any one of claims 1 to 6 and a display,
An imaging device, wherein the display is configured to display display data generated by the imaging chip. On a first coordinate axis, separately obtaining two coordinates corresponding to two boundaries of each layer in the plurality of layers of the image frame and perpendicular to the first coordinate axis, Obtaining a plurality of coordinates corresponding to a plurality of layers, each layer being a rectangular layer ;
Dividing the image frame into at least two image segments perpendicular to the first coordinate axis by using the plurality of coordinates, the two boundaries of any image segment being the coordinates of the plurality of coordinates And any of the image segments corresponding to two adjacent coordinates in the at least one layer, including a portion falling within a section in which the image segment is located, in any of the layers, part image segments is within the interval of positions, the steps a sublayer of said one of the layer,
Reading the at least two image segments in a time division manner and according to a scanning order along the direction of the first coordinate axis;
Performing sequentially image combining on the at least two image segments according to a time sequence to read the at least two image segments, thereby generating display data, wherein image combining of the image segments is performed on the image segments And b. Including image compositing of all included sublayers. Reading the at least two image segments in a time division manner and according to a scanning order along the direction of the first coordinate axis,
Read each sublayer in the first image segment at a first time along the direction of the first coordinate axis and according to the scanning order, read each sublayer in an nth image segment at the nth time , n is the step of repeating the steps until equal to n, n is 2 or more integer, n is the comprising a number of image segments included in the at least two image segments according to claim 8 The method described in. Reading the at least two image segments in a time division manner and according to a scanning order along the direction of the first coordinate axis,
Assigning individually one read channel to each sublayer in the mth image segment at the mth time among at least one read channel, where m is any integer less than or equal to N and N is The number of image segments included in the at least two image segments;
And D. reading each sublayer in the mth image segment by using each read channel assigned to each sublayer. The step of individually assigning one read channel to each sublayer in the mth image segment at the m-th time among the at least one read channel,
If the number of all sublayers in the mth image segment is less than or equal to the number of read channels in the at least one read channel, then in the mth time all sublayers in the mth image segment are Assigning to at least one read channel, one unique sub-layer being assigned to one read channel at the m th time, or the quantity of all sub-layers in the m th image segment is at least the at least one read sub-channel. Assigning all sublayers in the mth image segment to the at least one read channel multiple times if larger than the number of read channels in one read channel, wherein one sublayer is in one allocation process Assign to one read channel 11. The method of claim 10, comprising the steps of: After the step of reading each sublayer in the m th image segment by using each reading channel assigned to each sublayer, the method may
In the layer to which the already read sublayer in the mth image segment belongs, when the other sublayers other than the already read sublayer are already read, the already read in the mth image segment is Releasing the read channel assigned to the selected sublayer, or
If there is an unread sublayer other than the already read sublayer in the layer to which the already read sublayer in the mth image segment belongs, the already read in the mth image segment 11. The method of claim 10, further comprising: continuing to read the other unread sublayers by using a read channel assigned to the selected sublayer.

Images