JP2010152257A - Graphics display device and graphical user interface execution device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain a graphics display device in which it is not necessary to consider a platform in execution in graphics screen design, whose design is easy and which can perform display as intended in the graphics screen design. <P>SOLUTION: A rear face drawing part 103 generates drawing information of a rear face plane. A mask generation part 104 generates a mask according to the drawing information of the rear face drawing part 103. A front face drawing part 105 applies the mask generated by the mask generation part 104 to a front face plane. The rear face plane and the front face plane are combined by a plane combining part 106 to be displayed by an output part 107. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a graphics display device and a graphical user interface execution device that display a graphics screen by superimposing a plurality of drawing planes.

  In general, in a graphics display device, a background surface and a foreground surface superimposed on the surface side are separately generated, and an on-screen image is generated by sequentially overlapping the surface (see, for example, Patent Document 1). As a result, when the background surface or foreground surface is superimposed, it is only necessary to add the background surface or foreground surface like a component, and an on-screen image can be generated without redrawing.

JP 2006-301029 A

  At the stage of designing a graphics screen, a graphics display component can be created using a commercially available tool such as Photoshop (registered trademark) or Visio (registered trademark) or a dedicated tool for designing a graphics screen. Lay out on the screen. In such a design stage, there is a logical infinite layer, and an arbitrary graphics display component can be arranged in an arbitrary layer. However, in a graphics display device that displays such graphics display components on a real machine, there are only a finite number of planes due to platform restrictions, and the above-described layers are superimposed on these finite number of planes. Will be.

  In addition, depending on the circumstances of the platform, a specific graphics display component may be arranged only on a specific plane. For example, a graphics display component that displays a video stream may only be placed on a plane managed by a processor that can decode and render the video. In addition, special cursor components managed by hardware may be placed only on a plane managed by a processor that controls the cursor. In such a graphics display device, a certain graphics display component may be arranged only on a specific plane at the time of execution due to the platform. In this case, the graphics display component placed on the rear plane is shielded by the graphics display component placed on the front plane and cannot be seen. In some cases, it was not visible when displayed on. In order to avoid this, if the graphics screen designer considers the plane situation at the time of display on the actual machine and the part is hidden by the front part, It is necessary to perform transmission processing on the front plane so that the portion can be seen through the front surface. However, such work is impossible for a designer who does not know the convenience of the platform, and even a designer who knows it is forced to perform complicated work. In addition, when it is desired to display the same graphics screen on platforms with different plane conditions, there is a problem that a transparent process needs to be changed for each platform, and complicated work is required.

  The present invention has been made to solve the above-described problems. It is not necessary to consider a platform at the time of designing a graphics screen, and it is easy to design and displays the display as intended when designing the graphics screen. It is an object of the present invention to obtain a graphics display device and a graphical user interface execution device which can be performed.

  The graphics display device according to the present invention arranges graphics display components on a rear plane, generates a rear plane drawing unit that generates rear plane drawing information, and generates a mask and a list of masks according to the drawing information of the rear plane drawing unit. A mask generator and a graphics display component are arranged on the front plane to generate drawing information for the front plane, and the mask included in the list of masks is applied to the front plane to transmit the mask plane to the front plane. The image forming apparatus includes a front drawing unit that generates drawing information and makes the drawing area the same as the rear drawing unit, and a plane combining unit that generates screen information obtained by combining drawing information of the front plane and the rear plane.

  Since the graphics display device of the present invention generates a mask according to the drawing information of the rear drawing unit and applies this mask to the front plane, it is necessary to consider the runtime platform when designing the graphics screen. Therefore, it is easy to design and can display as intended when designing the graphics screen.

Embodiment 1 FIG.
FIG. 1 is a block diagram showing a graphics display device according to Embodiment 1 of the present invention.
In the figure, the graphics display device includes a rear plane storage unit 101, a front plane storage unit 102, a rear surface drawing unit 103, a mask generation unit 104, a front surface drawing unit 105, a plane composition unit 106, and an output unit 107. The rear drawing unit 103 and the front drawing unit 105 have the same drawing area.

  The rear plane storage unit 101 is a memory area that stores drawing information of the rear plane generated by the rear drawing unit 103. The front plane storage unit 102 is a memory area for storing front plane drawing information generated by the front drawing unit 105. The rear drawing unit 103 is a functional unit that has graphics display component information 103a to be drawn on the rear plane, and generates and outputs rear drawing information based on the graphics display component information 103a. The mask generation unit 104 is a functional unit that generates a list of masks based on the drawing information output from the rear surface drawing unit 103 and outputs the mask list to the front surface drawing unit 105. The front drawing unit 105 has graphics display component information 105a to be drawn on the front plane, generates front drawing information based on the graphics display component information 105a, and a list of masks from the mask generation unit 104. Based on the above, a mask is applied to the drawing information and output to the front plane storage unit 102. In the above description, the graphics display component information is arranged in the rear drawing unit and the front drawing unit. However, a separate display component database for storing the graphics display component information may be provided. In this case, the front and rear drawing units are configured to acquire necessary graphics display component information from the display component database.

  The plane combining unit 106 combines the contents of the front plane storage unit 102 and the contents of the rear plane storage unit 101 by superimposing the contents of the rear plane storage unit behind and the contents of the front plane storage unit in front. And a functional unit that outputs to the output unit 107. The output unit 107 includes a display device such as a CRT or a liquid crystal display, receives the output result of the plane synthesis unit 106, converts it into a video signal suitable for these display devices, and visualizes the video signal by the display device. ing.

  The video signal processing portions in the rear surface rendering unit 103 to the plane synthesis unit 106 and the output unit 107 are composed of software corresponding to each function and hardware such as a processor and a memory for executing the software. ing. The rear plane storage unit 101 and the front plane storage unit 102 are configured by a memory such as a VRAM. Alternatively, the rear plane storage unit 101 to the output unit 107 may be implemented with a mixture of hardware and software, such as a dedicated hardware configuration, and a portion that is difficult to implement with hardware is implemented with software. May be.

  The graphics display component information 103a and 105a in the rear drawing unit 103 and the front drawing unit 105 has properties such as coordinates, width, height, and Z index where the information is to be arranged. In addition, drawing data that is visible to the user when the component is arranged on the screen is held. Here, the drawing data includes bitmap data, file name of image file, vector data, 3D model data, rectangle drawing command and line drawing command, or a set of drawing commands such as map drawing commands provided by the platform. It is. The image file may be a general image file format (bmp, tiff, png, gif, jpg) or a format unique to the platform.

  These graphics display component information 103a and 105a may be arranged on the main memory. Further, it may be arranged on a cache memory of a processor in charge of drawing the graphics display component. When a shared memory exists in a multiprocessor system, it may be on the shared memory.

Pixels on the rear plane and the front plane in the rear plane storage unit 101 and the front plane storage unit 102 have a 24-bit color value composed of 8 bits for each of RGB, and an alpha value of 8 bits indicating the transparency of the drawing content on the rear surface. Can have.
The rear plane storage unit 101 and the front plane storage unit 102 may be provided anywhere in the main memory, shared memory, or VRAM. Further, if the platform has a double buffering mechanism, an off-screen buffer or an on-screen buffer may be used.

In each embodiment described below, an ARGB 32-bit color model in the RGB color space is used, but other color models may be used. Further, YCrCb, YPrPb, and other YUV, YIQ, and CMYK color spaces may be used.
Furthermore, the mask list generated by the mask generation unit 104 may be stored in the main memory, or may be stored in a shared memory area in a multiprocessor environment. Further, it may be stored on the VRAM.

Next, the operation of the graphics display device according to the first embodiment will be described.
FIG. 2 is a flowchart showing the overall operation of the graphics display device of the first embodiment.
When the graphics display device is activated, the process proceeds to the rear drawing process (step ST201). Next, mask generation processing is executed (step ST202). Further, a front drawing process is executed (step ST203). Next, a synthesis process is executed (step ST204), and an output process is further executed (step ST205). If YES in step ST206, the process returns to step ST201.

Next, details of processing in each step of FIG. 2 will be described.
FIG. 3 is a flowchart of the rear surface drawing process of step ST201 in FIG.
In the initialization process (step ST301), the value stored in the memory area of the rear plane is set to zero. Then, the mask generation unit 104 is notified of the start of mask generation. The graphics display component loop (step ST302) is the beginning of the loop. The component acquisition process (step ST303), the component drawing process (step ST304), and the output process to the mask generation unit 104 (step ST305) Repeat as many times as the number of parts is processed for each graphics display part.

  In the component acquisition process (step ST303), the graphics display component information 103a is extracted in ascending order of the Z index from the memory area storing the graphics display component information 103a. In the component drawing process (step ST304), drawing data to be displayed is transferred from the graphics display component information 103a to the rear plane. If the drawing data to be displayed is bitmap data, the drawing start address is calculated from the display coordinates of the graphics display component information 103a, and the content of the bitmap data is transferred from the address by the number of bytes of the bitmap data. If the drawing data is an image file, vector data, stream, etc., it is acquired from the file system as necessary, converted into a drawing image by an appropriate decoder, and transferred to the rear plane. If it is a set of drawing commands, it calls a function that executes the drawing commands in a predetermined order, the function calls an appropriate renderer, and the renderer outputs a drawing image by a predetermined method and transfers it to the rear plane. . In the output process to the mask generation unit (step ST305), the drawing data transferred in the component drawing process (step ST304) is monitored, and for each drawn part, a snapshot of one plane on which only that part is drawn is taken. It is created and output to the mask generation unit 104 together with the graphics display component information of the component.

  The graphics display component loop (step ST306) is the end of the loop. If the end condition is not satisfied, the process returns to step ST302. Otherwise, an end notification is output to the mask generation unit 104, and the rear drawing process ends.

FIG. 4 is a flowchart showing the mask generation process of step ST202 in FIG.
The mask generation unit 104 starts execution upon receiving a start notification from the rear surface drawing unit 103. In the drawing content acquisition process (step ST401), the drawing data and the graphics display component information 103a corresponding to the drawing data are acquired from the rear surface drawing unit 103. In the front display attribute determination process (step ST402), a true / false value is acquired as to whether or not the value of the front display attribute of the graphics display component information for the drawing content is the front. If YES, the process proceeds to step ST403. If NO, step ST403 is skipped and the process proceeds to step ST404. In the mask construction process (step ST403), the mask construction process is executed, which will be described later with reference to FIG. The masks generated in the mask construction process (step ST403) are managed as a list. If one or more elements are already included in the list, the newly constructed mask is linked to the end of the list. In the end notification determination (step ST404), it is determined whether an end notification is received from the front drawing unit 105. If YES, the generated mask list is output and the mask generation process is terminated. If NO, the process returns to step ST401.

  In the present embodiment, the rear drawing unit 103 performs drawing for each component, and the mask generation unit 104 generates a mask each time. For this reason, a start notification for activation is sent from the rear surface drawing unit 103 to the mask generation unit 104 every time the component drawing is completed. However, the present invention is not limited to such a configuration. For example, after the rear surface drawing unit 103 completes drawing of all components, information on all the components is output to the mask generation unit 104, and the mask is generated at that time. The unit 104 may generate a mask.

FIG. 5 is a flowchart of the mask construction process in step ST403 in FIG.
In the mask area securing process (step ST501), an area capable of storing a 1-bit value per pixel is secured with the same number of pixels as the rear plane. In the index initialization process (step ST502), the value of the variable index is set to zero.
The mask pixel number loop (step ST503) is the first end of the loop, and the processes from step ST504 to ST507 are repeated several times for the mask pixels. Hereinafter, the drawing data acquired in the drawing content acquisition process (step ST401) is regarded as an array having the name of image. Each element of the image array is the ARGB color value of the pixel pointed to by the index. Also, the contents of the mask are regarded as an array having the name of mask. Each element of the mask array is a 1-bit mask value of the pixel indicated by the index. Both arrays have the same number of elements.
In pixel value determination of drawing data (step ST504), it is checked whether the value of image [index] is zero. If it is 0, the process proceeds to step ST505. Otherwise, the process proceeds to step ST506.
In the mask non-transmission value setting process (step ST505), the value of mask [index] is set to 1. In the mask transmission value setting process (step ST506), the value of mask [index] is set to zero. In the index value increment process (step ST507), the value of the variable index is incremented by one.

  The mask pixel count loop (step ST508) is the end of the loop. If the end condition is not satisfied, the process returns to step ST503. Otherwise, output the contents of the mask array and exit.

In the mask, the values of the pixels on the mask are represented by binary values of 1 and 0. However, an alpha value mask that stores an alpha value indicating transparency may be used. If the alpha value is 8 bits, one element of the mask array is 8 bits. In this case, the content of the mask transmission value setting process in step ST506 is that the color value of the index-th pixel is image [index], and the alpha value of the pixel is indicated by image [index] .a. Values are as follows:
mask [image] = 255-image [index] .a
This may be another alpha value calculation formula.

FIG. 6 is a flowchart of the front drawing process in step ST203 of FIG.
In the initialization process (step ST601), first, the value stored in the memory area of the front plane is set to zero. Next, a mask list is acquired from the mask generation unit 104. Next, the graphics display component information 105a held by the front drawing unit 105 is acquired and a component list is generated.
The graphics display component loop (step ST602) is the first end of the loop, and the processing from step ST603 to step ST604 is repeated as many times as the number of component lists generated in the initialization processing of step ST601. In the component acquisition process (step ST603), graphics display components are extracted from the component list in ascending order of Z index. In the component drawing process (step ST604), drawing data to be displayed is transferred from the graphics display component information 105a to the front plane. If the drawing data is bitmap data, a drawing start address is calculated from the display coordinates of the graphics display component information 105a, and the content of the bitmap data is transferred from the address by the number of bytes of the bitmap data. If the drawing data is an image file, vector data, stream, etc., it is acquired from the file system as necessary, converted into a drawing image by an appropriate decoder, and transferred to the front plane. If it is a set of drawing instructions, the functions are called in a predetermined order, the function calls an appropriate renderer, and the renderer outputs a drawing image by a predetermined method and transfers it to the front plane.

  The graphics display component loop (step ST605) is the end of the loop. If the end condition is not satisfied, the process returns to step ST602. Otherwise, the process proceeds to step ST606. The mask list element loop (step ST606) is the first end of the loop, and is repeated for the number of elements in the mask list acquired in the initialization process of step ST601. In the mask application process (step ST607), the mask application process is called. The mask application process in step ST607 will be described later with reference to the flowchart of FIG. The mask list element loop (step ST608) is the end of the loop. If the end condition is not satisfied, the process returns to step ST606. Otherwise, the front drawing process is terminated.

Next, the mask application process will be described with reference to the flowchart of FIG.
In the index initialization process (step ST701), the value of the variable index is set to 0. The front plane pixel number loop (step ST702) is the first end of the loop, and steps ST703 and ST704 are repeated several times within the mask.
In the mask value multiplication process (step ST703), it is assumed that the current foreground drawing content of the front plane is regarded as a pixel array for the variable fore. Each element of the fore array is the ARGB color value of the pixel pointed to by the index. Further, the array named mask is regarded as the array of the mask contents. Each element of the mask array is a 1-bit mask value of the pixel indicated by the index. Then, the new fore [index] value is set as the current fore [index] * mask [index] value. That is, if mask [index] is 0, the new fore [index] value is 0. On the other hand, if the value of mask [index] is 1, the new value of fore [index] is the same as the current value. In the index value increment process (step ST704), the index value is incremented by one. The pixel count loop of the front plane (step ST705) is the end of the loop. If the end condition is not satisfied, the process returns to step ST702. Otherwise, the mask application process ends.

Next, a mask value multiplication process when the mask is an 8-bit alpha value mask will be described. In this case, if fore [index] .a is the alpha value at that index value, and fore [index] .r, fore [index] .g, and fore [index] .b are the RGB values at that index value, then Apply the formula
fore [index] .a = fore [index] .a * mask [index] / 255
fore [index] .r = fore [index] .r * mask [index] / 255
fore [index] .g = fore [index] .g * mask [index] / 255
fore [index] .b = fore [index] .b * mask [index] / 255
The blend formula and the alpha value calculation formula may be replaced with different formulas.

  If a special effect is desired in the mask application process, a special effect may be applied to the mask in the mask application process in steps ST701 to ST705. For example, in the initialization process (step ST701), enlargement / reduction, rotation, or applying a texture pattern to the mask or applying an effect that produces an artistic effect to the mask, Special effects can also be applied to the image on the front plane. In the case of an alpha value mask, a special translucent effect such as blurring can be produced by multiplying the contents of the mask by a value of 0 to 1 in step ST701.

FIG. 8 is a flowchart of the synthesis process in step ST204 of FIG.
In the synthesis process, all the planes connected to the plane synthesis unit 106 are synthesized. When there are a plurality of rear planes, the n-th to (n-1) th and n-2th planes are superimposed, and the front plane is superimposed on the first rear plane. Is done. For each overlap, the compositing process outputs the value if the pixel value of the preceding plane is 1 or more, and if the pixel value of the preceding plane is 0, the same index position of the following plane Output the pixel value of. By applying this to all pixels, you can see the graphics display part drawn in the back plane in the pixel part where the pixel value is 0 by the mask, otherwise the front plane An image in which the graphics display component drawn in FIG.

If the plane has an alpha channel and alpha synthesis is allowed, alpha synthesis is performed. The formula for alpha composition is that dest is the output result array, fore is the pixel value of the preceding plane, back is the pixel value of the following plane, and α = fore [index] .a
dest [index] .a = (fore [index] .a * α + back [index] .a * (255-α)) / 255
dest [index] .r = (fore [index] .r * α + back [index] .r * (255-α)) / 255
dest [index] .g = (fore [index] .g * α + back [index] .g * (255-α)) / 255
dest [index] .b = (fore [index] .b * α + back [index] .b * (255-α)) / 255
Is used. Other alpha synthesis formulas and approximate formulas may be used.

FIG. 9 is a flowchart of the output process of step ST205 in FIG.
In the video signal conversion process (step ST901), the output result of the synthesis process (step ST204) is subjected to color model conversion if necessary, and then converted into a video signal. In the video output process (step ST902), the display device visualizes the video signal.

Next, in the graphics display device according to Embodiment 1 of the present invention, an example of data held by each component and data to be output will be described.
FIG. 10 shows an example of the graphics display component information 103 a held by the rear surface drawing unit 103.
In the rear drawing unit 103, two graphics display components shown in examples 1001 and 1002 are registered as graphics display component information 103a. Each item shows the following values. That is, the component ID indicates an ID for identifying the component. The placement coordinates indicate the start coordinates for placing the component. The Z index indicates the Z index value of the part. The drawing type indicates whether the display content of the component is an image file, a drawing command, or an array of bitmap data. If the drawing content is an image file, the file name of the image file is stored, if it is a drawing command, a set of drawing functions is stored, and if it is bitmap data, an array of the data is stored. The front display attribute includes a front face, a rear face, and a default as attribute values of this attribute. The front side indicates that the part must be visible from the front even if it is placed on the back. That is, the mask generation unit 104 always becomes a mask generation target. If it is the rear surface, it is not a mask generation target.

  A drawing image of Example 1001 is shown in Example 1003, and a drawing image of Example 1002 is shown in Example 1004. In these drawing image examples 1003 and 1004, a white portion is not drawn (that is, transparent), and a shaded portion is drawn.

FIG. 11 shows an example of the graphics display component information 105 a held by the front drawing unit 105.
An example 1101 shows an example of one registered graphics display component. Example 1102 shows an example of a drawing image of Example 1101. The meaning of each item value in Example 1101 and Example 1102 are the same as those in FIG.

FIG. 12 shows an example 1201 of an image output by the rear surface drawing unit 103.
FIG. 13 shows an example 1301 of the mask output from the mask generation unit 104.
In FIG. 13, the black portion indicates a portion having a mask value of 1, and the white portion indicates a portion having a mask value of 0.

FIG. 14 shows an example of an image output by the front drawing unit 105.
In the figure, an example 1401 shows an example of an image immediately before the mask processing step, and an example 1402 shows an example of an image as a final result of the front surface drawing processing step. As shown in example 1402, a transmissive portion has been generated by a masking step.

FIG. 15 shows an example of an image output by the plane composition unit 106.
This shows that the image output from the rear surface drawing unit 103 is seen through the portion that has been transmitted through the mask processing step.

As described above, according to the graphics display device of the first embodiment,
A graphics display component is arranged on the rear plane, a rear drawing unit that generates drawing information of the rear plane, a mask generation unit that generates a mask and a list of masks according to the drawing information of the rear drawing unit, and a graphics display component Is generated on the front plane, and the front plane drawing information is generated, and the mask included in the list of masks is applied to the front plane to generate the front plane drawing information that is transmitted through the mask portion. Because it has a front drawing unit that makes the drawing area the same, a plane synthesis unit that generates screen information obtained by combining the drawing information of the front plane and the rear plane, and an output unit that displays the screen information generated by the plane synthesis unit When a graphics screen designer designs a graphics screen, the graphics screen designer does not know the convenience of the platform at runtime. Ikkusu screen can be carried out the design, also the graphics display when it is possible to obtain a display of the original intention of the graphics screen designer.

Embodiment 2. FIG.
The second embodiment is characterized in that the mask generation unit 104 performs mask processing using a mask ID. Since the configuration on the drawing is the same as that of the first embodiment, FIG. I will explain.
The mask generation unit 104 according to the second embodiment is configured to assign the value of the Z index of the graphics display component to be masked to the mask as a mask ID representing the positional relationship before and after the graphics display component. In addition, the front drawing unit 105 is configured to perform based on the mask ID when applying a mask. Other configurations are the same as those in the first embodiment.

Next, the operation of the second embodiment will be described focusing on the parts different from the first embodiment.
FIG. 16 is a flowchart of the mask generation process in the second embodiment.
This is obtained by removing the front display attribute determination process in step ST402 in FIG. 4 and adding a mask ID assigning process in step ST1601 instead. Since parts other than this step ST1601 are the same as those in FIG. 4, the same step numbers are assigned to corresponding processes, and the description thereof is omitted. In the mask ID assigning process in step ST1601, a Z index value is acquired from the graphics display component information that is the mask target for the generated mask, and is given as the mask ID.

FIG. 17 is a flowchart of front drawing processing in the front drawing unit 105 according to the second embodiment.
In FIG. 17, steps ST601, ST604, and ST607 are the same as the processing of FIG. 6, and thus description thereof is omitted here.
In the part / mask list generation process (step ST1701), a mask list whose default display attribute is the default is extracted and integrated with the part list to generate a list. This is List 1. In the list 1, the Z index value of the component and the mask ID value of the mask are compared and sorted in ascending order. That is, the part with the Z index value of 2 is in the order before the mask with the mask ID value of 3. Further, the mask with the mask ID of 4 is in the order before the component with the Z index value of 5.
Further, in the mask list, those having the front display attribute in front are extracted, and a list sorted in ascending order of mask ID is generated. This is List 2.

  The element number loop in list 1 (step ST1702) is the first end of the loop, and steps ST1703 to steps ST604 and ST607 are repeated several times in the list 1. In the part / mask acquisition process (step ST1703), the mask list 1 is sequentially extracted from the top. In the mask determination process (step ST1704), it is determined whether or not the component / mask acquisition process (step ST1703) acquired is a mask. If YES, the process proceeds to the mask application process (step ST607), and if NO, the process proceeds to the component drawing process (step ST604). The element number loop in step 1 (step ST1705) is the end of the loop. If the end condition is not satisfied, the process returns to step ST1702. Otherwise, the process proceeds to step ST1706.

  The element number loop in list 2 (step ST1706) is the beginning of the loop, and steps ST1707 to ST607 are repeated several times in the list 2. If the number of elements is 0, it will progress to step ST1708. In the part / mask acquisition process (step ST1707), the mask list 2 is sequentially extracted from the top. The element number loop in step 2 (step ST1708) is the end of the loop. If the end condition is not satisfied, the process returns to step ST1706. Otherwise, the front drawing process is terminated.

Next, data output by each component in the graphics display device according to the second embodiment of the present invention will be described.
FIG. 18 shows an example of the graphics display component information 103 a held by the rear surface drawing unit 103. In the drawing, an example 1801 is an example of one registered graphics display component, and an example 1802 shows a drawing image of the example 1801.
FIG. 19 shows an example of the graphics display component information 105 a held by the front drawing unit 105. In the figure, an example 1901 and an example 1902 are examples of two registered graphics display components, an example 1903 shows a drawing image of the example 1901, and an example 1904 shows a drawing image of the example 1902.

FIG. 20 shows an example 2001 of an image output by the rear surface drawing unit 103.
FIG. 21 shows an example 2101 of the mask output from the mask generation unit 104.
In FIG. 21, a black portion indicates a portion having a mask value of 1, and a white portion indicates a portion having a mask value of 0.
FIG. 22 shows an example of an image output by the front drawing unit 105. An example 2201 shows an example of an image as a final result of the front drawing process. As shown in the figure, it is shown that a transmissive portion is formed by the mask process. In addition, since the triangles (examples 1901, 1903) have a Z index of 3 and are front surfaces compared to the mask ID = 2, the triangle portions are not transmitted.
FIG. 23 shows an example of an image output by the plane composition unit 106.
As shown in the figure, it is shown that the image output from the rear surface drawing unit 103 is seen through the portion that is transmitted through the mask process.

  As described above, according to the graphics display device of the second embodiment, the mask generation unit assigns the mask ID representing the positional relationship before and after the graphics display component to be masked to the mask, and the front drawing unit Since the mask is applied based on the value of the mask ID, even if the graphics display parts overlap on each plane, the display as defined by the graphics screen designer when designing the graphics screen is displayed. can get. For this reason, it is easier to design and display as intended can be performed.

Embodiment 3 FIG.
Embodiment 3 includes a plurality of rear surface drawing units having the same drawing area as the front surface drawing unit (first rear surface drawing unit, second rear surface drawing unit... Nth rear surface drawing unit), and the nth rear surface drawing unit at the backmost position. This is an embodiment of a graphics display device that displays a plane and superimposes an n-1 rear surface drawing unit, an n-2 rear surface drawing unit,..., A first rear surface drawing unit, and a front surface drawing unit in this order. One mask generation unit is provided for each rear drawing unit. In addition, each mask generation unit outputs the generated mask list to all of the rear drawing units before the rear drawing unit to which the mask generation unit corresponds, and also outputs to the front drawing unit. It is what I did.

FIG. 24 is a block diagram showing a graphics display device according to Embodiment 3 of the present invention. Here, for the sake of explanation, only two rear drawing units, the first rear drawing unit and the second rear drawing unit, are included, but the same applies even if there are more rear drawing units.
The illustrated apparatus includes a first rear plane storage unit 101a, a second rear plane storage unit 101b, a front plane storage unit 102, a second rear drawing unit 103b, a first mask generation unit 104a, a plane synthesis unit 106, an output unit 107, A second mask generation unit 108, a first rear drawing unit 109, and a front drawing unit 110 are provided.

  The first rear plane storage unit 101a is a storage unit for storing the rear plane generated by the first rear plane drawing unit 109, and the second rear plane storage unit 101b is a storage unit for storing the rear plane generated by the second rear plane drawing unit 103b. The basic configuration is the same as that of the rear plane storage unit 101 of the first and second embodiments. The front plane storage unit 102, the plane synthesis unit 106, and the output unit 107 are the same as those in the first and second embodiments. Further, the second rear drawing unit 103b has the same configuration as the rear drawing unit 103 of the first embodiment. The basic function of the first mask generation unit 104a is the same as that of the mask generation unit 104 of the second embodiment, except that mask generation is performed on the output of the first rear surface drawing unit 109. .

The second mask generation unit 108 generates a mask by the same method as the mask generation unit 104 of the second embodiment based on the drawing information output from the second rear surface drawing unit 103b and the graphics display component information corresponding thereto, The output is output to the first rear drawing unit 109 and the front drawing unit 110. That is, in the third embodiment, the first mask generation unit 104a and the second mask generation unit 108 are configured to output the generated mask to the front drawing unit 110. When the first rear drawing unit 109 receives a list of masks from the mask generation unit corresponding to the rear drawing unit located behind, the first rear drawing unit 109 draws the drawing information based on the graphics display component information held by the first rear drawing unit 109. Is generated, and mask application processing is performed based on the received mask list, and then drawing information is output to the corresponding first rear plane. The front drawing unit 110 generates drawing information based on graphics display component information held by the front drawing unit 110 and applies a mask based on the masks generated by the first mask generation unit 104a and the second mask generation unit 108. It is configured to perform processing.
In the drawing, the second rear drawing unit 103b, the first rear drawing unit 109, and the front drawing unit 110 each hold graphics display component information, but the illustration thereof is omitted.

Next, the operation of the graphics display device according to the third embodiment will be described.
First, the operations of the second rear surface drawing unit 103b, the second rear surface plane storage unit 101b, and the second mask generation unit 108 are the operations of the rear surface drawing unit 103, the rear surface plane storage unit 101, and the mask generation unit 401 of the second embodiment. It is the same. That is, the second mask generation unit 108 assigns a mask ID similarly to the operation shown in the flowchart of FIG. Then, the first rear surface drawing unit 109 performs its own component drawing and outputs it to the first rear surface plane storage unit 101a, and performs mask processing based on the mask generation result from the second mask generation unit.

FIG. 25 is a flowchart showing the operation of the first rear surface drawing unit 109.
In FIG. 25, the process is the same as the front drawing process shown in the flowchart of FIG. 17 except for the process of step ST305. That is, the first rear surface drawing unit 109 performs drawing while acquiring the mask of the second mask generation unit 108 and outputs the drawing information as the rear plane, and in step ST305, the drawing content is sent to the first mask generation unit 104a. Output. The process of step ST305 here is the same as the process of step ST305 in the flowchart of FIG. 3 in the first embodiment. At the same time, an end notification is output to the first mask generation unit 104a.

  The first mask generation unit 104a performs a mask generation process similar to that of the mask generation unit 104 in the second embodiment and outputs the result to the front drawing unit 110. The front drawing unit 110 performs the same processing as the front drawing unit 105 of the second embodiment as shown in FIG. 17 based on the masks output from the first mask generation unit 104a and the second mask generation unit. To generate drawing information of the front plane. The plane combining unit 106 combines the planes stored in the first rear plane storage unit 101a, the second rear plane storage unit 101b, and the front plane storage unit 102.

  In the third embodiment, the rear surface drawing unit and the mask generation unit are provided in two stages, but three or more stages may be provided.

  As described above, according to the graphics display device of the third embodiment, there are a plurality of pairs of the rear surface drawing unit and the mask generation unit, and each rear surface drawing unit is a mask corresponding to the rear surface drawing unit located behind. When a list of masks is received from the generation unit, drawing information obtained by applying a mask to drawing information based on graphics display component information held by the rear drawing unit is generated and output to the corresponding rear plane to generate each mask. The unit outputs the generated mask list to the front drawing unit and the front drawing unit at the front, and the plane synthesis unit draws the rear plane drawing information of all the rear drawing units and the drawing information of the front plane of the front drawing unit. As a result, the planes can be multistaged while maintaining the effects obtained by the graphics display device of the second embodiment, and the number of planes can be increased innumerably. The effect of wear can be obtained.

Embodiment 4 FIG.
Embodiment 4 is provided with a plurality of sets of a rear surface drawing unit and a mask generation unit, and each rear surface drawing unit receives a list of masks from a mask generation unit corresponding to the rear surface drawing unit that is behind by one Applies the list of masks to its own drawing content and outputs it to the mask generation unit corresponding to the rear drawing unit that is just one before the rear drawing unit, and each mask generation unit outputs the corresponding rear drawing. When a mask list is received from the rear drawing unit that is only one behind the unit, it is integrated with the mask list generated by the own mask generation unit and output to the rear drawing unit or front drawing unit that is only one before It is what I did.

FIG. 26 is a configuration diagram of the graphics display device according to the fourth embodiment of the present invention.
The illustrated apparatus includes a first rear plane storage unit 101a, a second rear plane storage unit 101b, a front plane storage unit 102, a second rear surface drawing unit 103b, a second mask generation unit 104b, a front drawing unit 105, and a plane synthesis unit 106. , An output unit 107, a first rear surface drawing unit 111, and a first mask generation unit 112.

  The first rear drawing unit 111 applies the mask output from the second mask generation unit 104b to its own drawing content and stores the mask in the first rear plane storage unit 101a, and stores the mask list in the first mask generation unit 112. It is configured to output. The first mask generation unit 112 generates a mask based on the drawing content received from the first rear drawing unit 111, and integrates the generated mask and the mask list received from the first rear drawing unit 111 to perform front drawing. It is configured to output to the unit 105. The second rear surface drawing unit 103b is the same as the second rear surface drawing unit 103b in the third embodiment, and the second mask generation unit 104b has the same function as the mask generation unit 104 in the second embodiment. ing. Other configurations are the same as those in the second embodiment. In the drawing, the second rear drawing unit 103b, the first rear drawing unit 111, and the front drawing unit 105 each hold graphics display component information, but the illustration thereof is omitted.

Next, the operation of the graphics display device according to the fourth embodiment will be described.
First, the operations of the second rear drawing unit 103b, the second rear plane storage unit 101b, and the second mask generation unit 104b are the operations of the rear drawing unit 103, the rear plane storage unit 101, and the mask generation unit 401 of the second embodiment. It is the same. That is, the second mask generation unit 104b assigns a mask ID similarly to the operation shown in the flowchart of FIG. Then, the first rear surface drawing unit 111 performs its own component drawing and outputs it to the first rear surface plane storage unit 101a, and performs mask processing based on the mask list from the second mask generation unit 104b.

FIG. 27 is a flowchart of the first rear surface drawing unit 111.
In FIG. 27, the processes other than the process of step ST2701 are the same as the front drawing process shown in the flowchart of FIG. That is, in the first rear surface drawing unit 111, when the drawing process and the mask application process are completed, in step ST2701, all the contents of the graphics display parts in list 1 and the graphics display parts included in list 1 and list 2 are displayed. All of the drawing contents and the mask are output to the first mask generation unit 112 corresponding to the first rear surface drawing unit which is one before.

Next, the operation of the first mask generation unit 112 will be described.
FIG. 28 is a flowchart of the first mask generation processing by the first mask generation unit 112.
Here, the basic operation flow is the same as the flow shown in the flowchart of FIG. 16 in the second embodiment, but the processes of step ST2801 and step ST2802 are different. That is, in step ST2801, the value of the front display attribute is included as a mask attribute together with the mask ID. Further, in step ST2802, the mask generated in its own mask generation processing step is combined with the mask list acquired from the first rear surface drawing unit 111 which is the drawing unit behind by one, and only one is in front. The image is output to the front drawing unit 105 which is a drawing unit.

  In the fourth embodiment, the first rear drawing unit 111 outputs the mask output from the second mask generation unit 104b to the first mask generation unit 112 as it is, but the graphic stored in the front drawing unit 105 is stored. If the display display component information is known in advance, a mask that is not applied by the front surface drawing unit 105 may be deleted here. Thereby, the processing amount for the mask processing in the front surface drawing unit can be reduced.

  Also, if the drawing contents in the rear drawing unit and the front drawing unit that are in front can be known, it is output to the rear drawing unit and the front drawing unit in front in the middle drawing unit to determine whether it is meaningful. As a result, the number of masks can be reduced. For example, when the Z index value of all the graphics display components to be drawn in the rear drawing unit or the front drawing unit located in front is larger than the ID of the mask, the mask is delivered to the drawing unit located in front. However, it is not applied in the mask processing step. In such a case, it is possible to reduce the amount of processing and improve the overall performance by preventing the mask from being output to the rear drawing unit and the front drawing unit that are in front.

  In the fourth embodiment, the rear surface drawing unit and the mask generation unit have two stages, but three or more stages may be provided.

  As described above, according to the graphics display device of the fourth embodiment, there are a plurality of rear surface drawing units and mask generation units, and each mask generation unit is output from the rear surface drawing unit that is behind by one. When a list of masks is received, it is combined with the list of masks generated by its own mask generation unit and output to the previous rear drawing unit or front drawing unit, and each rear drawing unit has only one If a mask list is received from the mask generation unit corresponding to the rear rear drawing unit, the mask is applied to the drawing contents of the rear drawing unit, and the mask generation corresponding to the rear drawing unit that is immediately before is generated. Since the plane combining unit combines the drawing information of the rear plane of all the rear drawing units and the drawing information of the front plane of the front drawing unit, the graphics display device according to the second embodiment can get Can be plain while keeping the fruit in multiple stages, there is an advantage that it is possible to increase the number of planes countless.

Embodiment 5 FIG.
In the fifth embodiment, a graphical user interface execution device is configured using the graphics display device of any of the first to fourth embodiments.
FIG. 29 is a configuration diagram of the graphical user interface execution device according to the fifth embodiment.
The illustrated graphical user interface execution apparatus includes a rear plane storage unit 101, a front plane storage unit 102, a rear drawing unit 103, a mask generation unit 104, a front drawing unit 105, a plane synthesis unit 106, an output unit 107, and a user input unit 113. The event determination unit 114 is provided. Here, since the rear plane storage unit 101 to the output unit 107 have the configuration of the first embodiment, the same reference numerals are given to the corresponding portions, and descriptions thereof are omitted.

  The user input unit 113 is a user interface that converts an input from the user as an event and sends the event to the event determination unit 114. That is, when an input is received, it is converted into an appropriate event and output together with the coordinate value at which it occurred. Examples of the input include touch on the touch panel, mouse click, line-of-sight input, and gesture input. When there is an event input from the user input unit 113, the event determination unit 114 is configured to specify a graphics display component in which an event has occurred, using the contents of the mask held by the front drawing unit 105. In other words, the event determination unit 114 receives the coordinates where the input has occurred, and if the coordinates are coordinates where the graphics display component to be drawn by the front drawing unit 105 exists, the user inputs the graphics display component. Is determined to have been performed. If not, a mask is extracted from the end of the mask list held by the front drawing unit 105 (from the one with the larger Z index value), and a mask whose mask value is 0 in the coordinate portion is searched. If found, it is determined that the user has input to the graphics display component corresponding to the mask.

Next, the operation of the graphical user interface execution apparatus of the fifth embodiment will be described.
FIG. 30 is a flowchart of the event determination process in the event determination unit 114.
In the event coordinate acquisition process (step ST3001), the coordinate value at which the event occurred is acquired from the user input unit 113. In the front face determination process (step ST3002), it is determined whether there is a graphics display component to be drawn on the front surface at the coordinates. If YES, the process proceeds to step ST3008. Otherwise, the process proceeds to step ST3003.
In the mask list acquisition process (step ST3003), a mask list is acquired from the front drawing unit 105. The element loop of the mask list (step ST3004) is the beginning of the loop, and the loop is started by the number of mask elements. In the mask acquisition process (step ST3005), a mask is acquired from the end of the list. In the coordinate determination process (step ST3006), it is determined whether or not the coordinate value corresponds to a portion where the mask value is 0 in the mask. If applicable, the process proceeds to step ST3008. Otherwise, the process proceeds to step ST3007.

  In the component identification process (step ST3008), it is identified that an event has been issued to the graphics display component corresponding to the determined mask. If necessary, it is possible to instruct the graphics display component to perform a predetermined process such as updating display contents. The mask element loop (step ST3007) is the end of the loop, and ends if the end condition is satisfied. Otherwise, the process returns to step ST3004.

  The example shown in FIG. 29 is an example in which the user input unit 113 and the event determination unit 114 are added to the graphics display device of the first embodiment, but the graphic of any of the second to fourth embodiments. A display device may be used.

  As described above, according to the graphical user interface execution device of the fifth embodiment, when any one of the graphic display devices of the first to fourth embodiments is used and there is an input, an event is input. And an event determination unit that identifies a graphics display component in which an event has occurred according to the contents of the mask held by the front drawing unit. It is possible to determine which graphics display component the input has occurred from the mask that is centrally managed by the front drawing unit, so the processing amount for event processing can be reduced, and the input from the user The effect is to be able to respond quickly.

  Further, according to the graphical user interface execution device of the fifth embodiment, the event determination unit is a graphics display component that is transmitted by the mask when the coordinate value at which the event has occurred is a transmission part of the mask. Since the determination is made, it is possible to easily and accurately recognize the graphics display component in which the input has occurred.

It is a block diagram which shows the graphics display apparatus by Embodiment 1 of this invention. It is a flowchart which shows operation | movement of the graphics display apparatus by Embodiment 1 of this invention. It is a flowchart of the rear surface drawing process by Embodiment 1 of this invention. It is a flowchart of the mask production | generation process by Embodiment 1 of this invention. It is a flowchart of the mask construction process by Embodiment 1 of this invention. It is a flowchart of the front surface drawing process by Embodiment 1 of this invention. It is a flowchart of the mask application process by Embodiment 1 of this invention. It is a flowchart of the synthetic | combination process by Embodiment 1 of this invention. It is a flowchart of the output process by Embodiment 1 of this invention. It is explanatory drawing which shows the example of the information of a graphics display component and the drawing image which the back surface drawing process part by Embodiment 1 of this invention hold | maintains. It is explanatory drawing which shows the example of the information of graphics display components and the drawing image which the front surface drawing process part by Embodiment 1 of this invention hold | maintains. It is explanatory drawing which shows the example of the drawing result image of the rear surface drawing process part by Embodiment 1 of this invention. It is explanatory drawing which shows the example of the output result image of the mask production | generation part by Embodiment 1 of this invention. It is explanatory drawing which shows the example of the drawing image of the front surface drawing part by Embodiment 1 of this invention. It is explanatory drawing which shows the example of the output drawing image of the synthetic | combination part by Embodiment 1 of this invention. It is a flowchart of the mask production | generation process by Embodiment 2 of this invention. It is a flowchart of the front surface drawing process by Embodiment 2 of this invention. It is explanatory drawing which shows the example of the information of graphics display components and the drawing image which the back surface drawing process part by Embodiment 2 of this invention hold | maintains. It is explanatory drawing which shows the example of the information of graphics display components and the drawing image which the front surface drawing process part by Embodiment 2 of this invention hold | maintains. It is explanatory drawing which shows the example of the drawing result image of the rear surface drawing process part by Embodiment 2 of this invention. It is explanatory drawing which shows the example of the output result image of the mask production | generation part by Embodiment 2 of this invention. It is explanatory drawing which shows the example of the drawing image of the front surface drawing part by Embodiment 2 of this invention. It is explanatory drawing which shows the example of the output drawing image of the synthetic | combination part by Embodiment 2 of this invention. It is a block diagram which shows the graphics display apparatus by Embodiment 3 of this invention. It is a flowchart of the rear surface drawing process by Embodiment 3 of this invention. It is a block diagram which shows the graphics display apparatus by Embodiment 4 of this invention. It is a flowchart of the rear surface drawing process by Embodiment 4 of this invention. It is a flowchart of the mask production | generation process by Embodiment 4 of this invention. It is a block diagram which shows the graphical user interface execution apparatus by Embodiment 5 of this invention. It is a flowchart of the event determination process by Embodiment 5 of this invention.

Explanation of symbols

  101 rear plane storage unit, 101a first rear plane storage unit, 101b second rear plane storage unit, 102 front plane storage unit, 103 rear drawing unit, 103a graphics display component information, 103b second rear drawing unit, 104 mask generation 104a first mask generation unit 104b second mask generation unit 105, 110 front drawing unit 105a graphics display component information 106 plane synthesis unit 107 output unit 108 112 112 second mask generation unit 109 111 1st rear surface drawing part, 113 User input part (input part), 114 Event determination part.

Claims (6)

A rear surface drawing unit that arranges the graphics display component on the rear surface plane and generates drawing information of the rear surface plane;
A mask generation unit that generates a mask and a list of the masks according to the drawing information of the rear surface drawing unit;
The graphics display component is arranged on the front plane, and drawing information of the front plane is generated, and the drawing information of the front plane that is transmitted through the mask portion by applying the mask included in the mask list to the front plane. And a front drawing unit that makes the drawing area the same as the rear drawing unit,
A plane combining unit that generates screen information obtained by combining drawing information of the front plane and the rear plane;
A graphics display device comprising: an output unit that displays screen information generated by the plane synthesis unit. The mask generation unit assigns a mask ID representing the positional relationship before and after the graphics display component to be masked to the mask,
The graphics display device according to claim 1, wherein the front drawing unit applies a mask based on the value of the mask ID. A plurality of the sets having a front-rear relationship with a rear drawing unit and a mask generation unit as a set,
When each rear drawing unit receives a list of masks from the mask generation unit corresponding to the rear drawing unit behind the rear drawing unit, it generates drawing information of the rear plane to which the mask is applied,
Each mask generation unit outputs the generated mask to all rear drawing units and front drawing units preceding the mask generation unit,
3. The graphics display device according to claim 2, wherein the plane synthesis unit synthesizes the drawing information of the rear plane of all the rear drawing units and the drawing information of the front plane of the front drawing unit. A plurality of the sets having a front-rear relationship with a rear drawing unit and a mask generation unit as a set,
When each mask generation unit receives a list of masks output from the rear surface drawing unit that is one behind the corresponding rear surface drawing unit, it combines with the mask list generated by its own mask generation unit, Output to the rear drawing part or front drawing part that is only one in front,
When each rear drawing unit receives a list of masks from the mask generation unit corresponding to the rear drawing unit that is only one before the rear drawing unit, it applies the mask to the drawing contents of the rear drawing unit. , Output to the mask generation unit corresponding to the rear drawing unit that is only one before the rear drawing unit,
3. The graphics display device according to claim 2, wherein the plane synthesis unit synthesizes the drawing information of the rear plane of all the rear drawing units and the drawing information of the front plane of the front drawing unit. A graphical user interface execution device using the graphics display device according to any one of claims 1 to 4,
An input unit that converts the input into an event when there is an input;
An apparatus for executing a graphical user interface, comprising: an event determination unit that identifies a graphics display component in which the event has occurred according to a mask content held by a front drawing unit.   6. The graphical user interface according to claim 5, wherein when the coordinate value at which the event has occurred is a transparent portion of the mask, the event determining unit determines that the graphic display component is transmitted through the mask. Execution device.

Images