JP2010049302A - Device and method for displaying moving image using computer, program, and information recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display method using a computer capable of dealing with a universal and real time moving image. <P>SOLUTION: The display method includes: a process for reading vertex coordinate values of a polygon character (17) for front/rear discrimination for each frame; a process for calculating a Z value of the polygon character (17) for front/rear discrimination; a process for obtaining a three-dimensional polygon character (21); a process for comparing the Z value of the polygon character (17) for front/rear discrimination with the Z value of the three-dimensional polygon character (21) in pixel units; a process for performing hidden surface removal; and a process for obtaining a combined screen. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a moving image display apparatus using a computer, a display method, a program, and an information recording medium. The moving image display apparatus using the computer of the present invention acquires the virtual vertex coordinates of only the character that requires depth determination in the two-dimensional image, and uses this to delete the hidden surface from the polygon. A display device using this computer is used to realize a real-time graphic movie.

  Japanese Patent Application Laid-Open No. 8-149458 discloses a moving image processing apparatus that encodes a moving image at a high compression rate. This moving image processing apparatus adds depth information to a moving image. A technique for providing depth information to a moving image is known.

If this technique is used, when a character composed of a three-dimensional polygon is represented in a two-dimensional image, it is considered that hidden surface removal from a specific object included in the two-dimensional image can be performed. That is, it is conceivable that the Z value is obtained for all the pixels of the two-dimensional image by the method disclosed in the above publication, and this is compared with the Z value of the three-dimensional polygon. In this case, a Z value representing a two-dimensional image in a three-dimensional manner is stored in a ROM or the like, and is read when the Z values are compared. For this reason, in order to compare Z values, the amount of information read from a ROM or the like becomes enormous. Therefore, the problem that a moving image cannot be displayed in real time arises.
JP-A-8-149458

  An object of this invention is to provide the display method and display apparatus using the computer which can respond to a general purpose and a real-time moving image.

  In the present invention, basically, the two-dimensional character (15) requiring depth determination in the two-dimensional image (13) is represented by three-dimensional polygons from the vertex coordinate value of the front-rear determination polygon character (17). By calculating the Z value for each pixel of the determination polygon character (17) and removing the hidden surface from the three-dimensional polygon character, it is possible to reduce the amount of information read from the ROM, thereby supporting a general-purpose real-time video. This is based on the knowledge that a display device using a computer can be provided. Each means in the present invention can be realized by using software, and can also be implemented by a circuit having a function similar to that of software.

  A first aspect of the present invention relates to a moving image display method using a computer. The computer (11) used in this method includes a vertex coordinate value storage means (19), a polygon acquisition means (23), a front and rear determination polygon character Z value acquisition means (25), and a Z value comparison means ( 27), hidden surface erasing means (29), and image synthesizing means (31).

  In the present specification, the front / rear determination polygon character (17) is composed only of coordinate information. That is, it does not have color information and texture information that a normal polygon has, but has only coordinate information such as vertex coordinate information and motion information. That is, the front / rear determination polygon character (17) is a virtual polygon character used for front / rear determination with a three-dimensional polygon character. As a result, hidden surface removal from the three-dimensional polygon character can be easily performed. This front-rear determination polygon character (17) overlaps the two-dimensional character (15) requiring depth determination in the two-dimensional image (13), and when the two-dimensional character (15) moves, the front-rear determination polygon character ( 17) also operates.

  This method performs information processing including the following steps for each frame. That is, in this method, a step of reading the vertex coordinate values of the front and rear determination polygon character (S101), a step of obtaining the Z value of the front and rear determination polygon character (S102), and a step of obtaining a three-dimensional polygon character (S103). , Z value comparison step (S104), hidden surface removal step (S105), and composite screen acquisition step (S106).

  The step (S101) of reading out the vertex coordinate value of the front / rear determination polygon character (S101) includes a front / rear determination polygon character (17) when the two-dimensional character (15) is represented by a three-dimensional polygon from the vertex coordinate value storage means (19). This is a step of reading out the vertex coordinate values.

  The step of obtaining the Z value of the front / rear determination polygon character (S102) is a step of obtaining the Z value of the front / rear determination polygon character (17) using the vertex coordinate values.

  The step of obtaining a three-dimensional polygon character (S103) is a step of obtaining a three-dimensional polygon character (21) to be displayed together with the two-dimensional image (13) by the polygon acquisition means (23).

  The Z value comparison step (S104) is a step in which the Z value comparison means (27) compares the Z value of the front and rear determination polygon character (17) with the Z value of the three-dimensional polygon character (21) in units of pixels. is there.

  In the hidden surface erasing step (S105), the hidden surface erasing means (29) is arranged on the back of the three-dimensional polygon character (21) and the front / rear determination polygon character (17) based on the comparison result of the Z value comparing means (27). This is a process of performing hidden surface erasure on a positioned object.

  In the composite screen acquisition step (S106), the image compositing means (31) uses the two-dimensional image (13) subjected to the hidden surface erasure processing by the hidden surface erasing means (29) and the front-rear determination. This is a step of combining the polygon character (17) to obtain a combined screen.

  As described above, the method of the present invention is based on the vertex coordinate value of the front and rear determination polygon character (17) when the two-dimensional character (15) requiring depth determination in the two-dimensional image (13) is represented by a three-dimensional polygon. By obtaining the value and performing hidden surface removal with the three-dimensional polygon, the amount of information read out for hidden surface removal can be reduced, thereby making it possible to support general-purpose and real-time moving images.

  The second aspect of the present invention relates to a display device using a computer. This display device is used in the method of the first aspect described above. This display device includes a vertex coordinate value storage means (19), a polygon acquisition means (23), a front and rear determination polygon character Z value acquisition means (25), a Z value comparison means (27), and a hidden surface removal means ( 29) and image composition means (31).

  The vertex coordinate value storage means (19) stores the vertex coordinate values of the front and rear determination polygon character (17) when the two-dimensional character (15) requiring depth determination in the two-dimensional image (13) is represented by a three-dimensional polygon. It is a means for memorizing.

  The polygon acquisition means (23) is means for obtaining a three-dimensional polygon character (21) to be displayed together with the two-dimensional image (13).

  The front and rear determination polygon character Z value acquisition means (25) is a means for obtaining the Z value of the front and rear determination polygon character (17) from the vertex coordinate values stored in the vertex coordinate value storage means (19).

  The Z value comparison means (27) includes the Z value of the front and rear determination polygon character (17) obtained by the front and rear determination polygon character Z value acquisition means (25) and the Z value of the polygon acquired by the polygon acquisition means (23). Is a means for comparing with each other in pixel units.

  The hidden surface removal means (29) is a means for performing hidden surface removal of the three-dimensional polygon character (21) and the front and rear determination polygon character (17) based on the comparison result by the Z value comparison means (27).

  The image composition means (31) synthesizes the two-dimensional image (13) with the three-dimensional polygon character (21) and the front-rear determination polygon character (17) subjected to the hidden surface removal processing by the hidden surface removal means (29). , A means to obtain a composite screen.

  The display device of the present invention can reduce the amount of information read from the ROM by obtaining the Z value from the vertex coordinate value of the front-rear determination polygon character (17) and erasing the hidden surface from the three-dimensional polygon. Compatible with general-purpose and real-time video.

  A preferred mode of use of the present invention is a gaming machine equipped with the above display device.

  According to a third aspect of the present invention, the computer includes a vertex coordinate value storage means (19), a polygon acquisition means (23), a front and rear determination polygon character Z value acquisition means (25), a Z value comparison means (27), a hidden surface. The present invention relates to a program for functioning as erasing means (29) and image composition means (31). These means are as described above. The present invention also provides a computer-readable information recording medium storing this program.

  A preferred pattern of the present invention relates to a two-dimensional image (13) generated based on a character represented by a polygon. The vertex coordinate value of the front / rear determination polygon character (17) is preferably obtained by using a plurality of vertices when a character that requires depth determination in a two-dimensional image is represented by a polygon.

  In this way, when an object manufactured in advance with a three-dimensional polygon is used as a two-dimensional image, the polygon information is usually discarded. However, in the present invention, the vertex coordinate information of the character to be the front-rear determination polygon character (17) is stored without being discarded. Then, using the stored vertex coordinate information, the Z value of the front / rear determination polygon character is obtained and used for hidden surface removal with the three-dimensional polygon character. As a result, the coordinate information can be used effectively, and it is not necessary to read out the Z values for all the pixels of the two-dimensional image when performing the hidden surface removal process.

  A preferred pattern of the present invention includes a graphic chip in which the display device includes a Z buffer, and a ROM connected to the graphic chip by a bus. The ROM functions as vertex coordinate value storage means (19). The Z value comparison means (27) compares the Z value of the front / rear determination polygon character (17) with the Z value of the polygon. The Z buffer included in the graphic chip stores, for each pixel, the Z value of the front / rear determination polygon character (17) and the three-dimensional polygon character (21) that is in front (that is, the Z value is small). Remember.

  Hereinafter, the best mode for carrying out the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a display device using a computer of the present invention. As shown in FIG. 1, the display device (11) using the computer of the present invention comprises a vertex coordinate value storage means (19), a polygon acquisition means (23), and a front and rear determination polygon character Z value acquisition means (25). ), Z value comparison means (27), hidden surface removal means (29), and image composition means (31). Each element is connected so that information can be transmitted and received by a bus or the like.

  FIG. 2 is a flowchart for explaining an example of processing by the display device using the computer of the present invention. In FIG. 2, S indicates a step. FIG. 3 is a diagram for explaining a process of image processing according to a display device using a computer of the present invention. FIG. 3A shows an example of a two-dimensional image including a character. FIG. 3B shows an example of a figure obtained by extracting the Z value of the character. FIG. 3C is a conceptual diagram of a polygon. FIG. 3D shows an example of an image when a character and a polygon subjected to hidden surface removal processing are combined. FIG. 3E shows the synthesized image.

  The present invention relates to a moving image display method using a computer. The computer (11) used in this method includes a vertex coordinate value storage means (19), a polygon acquisition means (23), a front and rear determination polygon character Z value acquisition means (25), and a Z value comparison means ( 27), hidden surface erasing means (29), and image synthesizing means (31).

  This method performs information processing including the following steps for each frame. That is, in this method, a step of reading the vertex coordinate values of the front and rear determination polygon character (S101), a step of obtaining the Z value of the front and rear determination polygon character (S102), and a step of obtaining a three-dimensional polygon character (S103). , Z value comparison step (S104), hidden surface removal step (S105), and composite screen acquisition step (S106).

A step of reading the vertex coordinate value of the polygon character for forward / backward determination (S101)
The step (S101) of reading out the vertex coordinate value of the front / rear determination polygon character (S101) includes a front / rear determination polygon character (17) when the two-dimensional character (15) is represented by a three-dimensional polygon from the vertex coordinate value storage means (19). This is a step of reading out the vertex coordinate values. This step can be achieved, for example, by reading a plurality of vertex coordinate values stored in a storage device such as a ROM when predetermined information is input from the input device.

  The vertex coordinate value storage means (19) is a vertex coordinate value (15) of the front / rear determination polygon character (17) when the two-dimensional character (15) requiring depth determination in the two-dimensional image (13) is represented by a three-dimensional polygon. Z, Y, Z) is a means for storing. A computer storage device functions as vertex coordinate value storage means. A specific vertex coordinate value storage means is a ROM. The vertex coordinate value storage means (19) usually stores a plurality of vertex coordinate values.

  The two-dimensional character (15) is a character that exists in the two-dimensional image (13). This character requires depth determination in order to perform hidden surface removal with a three-dimensional polygon character. In the example shown in FIG. 3A, the sphere (15) included in the two-dimensional image (13) is the two-dimensional character (15). In other words, in a later process, the sphere (15) and the cars (21a, 21b) are hidden.

  FIG. 4 is a diagram illustrating an example when the two-dimensional image of FIG. 3A is created. FIG. 4A shows a background image (41) before drawing a character. FIG. 4B shows a sphere as a character. That is, a background image (41) and a polygon character (33) are drawn using a display device using a computer. In the figure, for simplicity, the polygon is drawn like a two-dimensional image. Usually, the background image (41) and the character (33) are synthesized and rasterized to obtain a two-dimensional image. Even in that case, the polygon information of the character (33) is stored in the character file. Therefore, the polygon character for forward / backward determination can be extracted by reading the vertex coordinates of the character from the character file.

  As described above, the front-rear determination polygon character (17) in this specification is a virtual character when the two-dimensional character (15) is represented by a three-dimensional polygon. The front-rear determination polygon character (17) only needs to be able to perform hidden surface removal with a three-dimensional polygon character. For this reason, the front-rear determination polygon character (17) only needs to have vertex coordinates required for expressing the polygon.

  A preferred pattern of the present invention relates to a two-dimensional image (13) generated based on a character represented by a polygon. The vertex coordinate value of the polygon character for determination before and after (17) is obtained by using a plurality of vertices when a character that requires depth determination in a two-dimensional image is represented by a polygon.

A step of obtaining the Z value of the front / rear determination polygon character (S102)
The step of obtaining the Z value of the front / rear determination polygon character (S102) is a step of obtaining the Z value of the front / rear determination polygon character (17) using the vertex coordinate values. The Z value is a coordinate value indicating depth and depth. In this step, a conversion method used in ordinary three-dimensional computer graphics may be used as appropriate. For example, the Z value may be obtained using a predetermined transformation matrix. In this case, the Z value of the front-rear determination polygon character can be obtained by having means for storing the conversion matrix, means for reading the conversion matrix, and means for converting the coordinate values using the conversion matrix.

  The front and rear determination polygon character Z value acquisition means (25) is a means for obtaining the Z value of the front and rear determination polygon character (17) from the vertex coordinate values stored in the vertex coordinate value storage means (19). This means includes, for example, means for grasping the primitive, means for obtaining the Z value on the edge of the primitive by interpolating the vertex coordinates, and means for obtaining the Z value inside the primitive by sweep interpolation. It is done. In this way, the Z value of the front / rear determination polygon character can be obtained for each pixel. The front-rear determination polygon character Z value acquisition means (25) may be realized by a CPU or may be implemented by a GPU (graphic chip).

  The obtained Z value of the front-rear determination polygon character is stored as appropriate. Thus, since the Z value of the polygon character for forward / backward determination is stored, this value can be read out and the hidden surface removal with the three-dimensional polygon character can be performed.

Step of obtaining a three-dimensional polygon character (S103)
The step of obtaining a three-dimensional polygon character (S103) is a step of obtaining a three-dimensional polygon character (21) to be displayed together with the two-dimensional image (13) by the polygon acquisition means (23). This process may be performed before S101 or between S101 and S102. Moreover, it may be performed in parallel with S101 and S102. In this process, polygon information created separately may be obtained. That is, the polygon stored in the drawing apparatus may be read, or the polygon input to the drawing apparatus may be obtained. In the example shown in FIG. 3C, cars (21a, 21b) passing through the front and rear of the sphere (15) are drawn. In FIG. 3C, for the sake of simplicity, the three-dimensional polygon character (21) is drawn two-dimensionally instead of a polygon image. The cars (21a, 21b) are displayed together with a two-dimensional image. If the polygon character (21a, 21b) is directly drawn on the two-dimensional image, the front-rear relationship between the character (15) and the polygon character (21a, 21b) included in the two-dimensional image becomes unnatural. Therefore, the Z values of the front and rear determination polygon character (17) based on the two-dimensional character (15) and the polygon character (21a, 21b) are compared, and hidden surface removal processing is performed.

  The polygon acquisition means (23) is means for obtaining a three-dimensional polygon character (21) to be displayed together with the two-dimensional image (13). Devices and methods for creating 3D computer graphics polygons are known. It is also known to store a three-dimensional polygon character (21) in a storage device and read the three-dimensional polygon character (21).

  When a three-dimensional polygon character is obtained, the vertex coordinates of a plurality of primitives representing this polygon and the Z value for each pixel can also be obtained.

Z value comparison process (S104)
The Z value comparison step (S104) is a step in which the Z value comparison means (27) compares the Z value of the front and rear determination polygon character (17) with the Z value of the three-dimensional polygon character (21) in units of pixels. is there. FIG. 5 is a conceptual diagram showing the Z value. In FIG. 5, the Z value is expressed by shading. That is, it can be seen that the car (21b) is located in front of the car (21a).

  Comparing Z values and performing hidden surface removal processing is known as described in, for example, Japanese Patent Laid-Open No. 6-44384. The Z value for each pixel of the virtual character portion is stored as appropriate. Also, the Z value of the three-dimensional polygon character is stored as appropriate. Then, two Z values in the corresponding pixels are read and compared in magnitude. As a result, the Z value of the character portion and the Z value of the polygon can be compared for each pixel. Specifically, the Z value of the sphere shown in FIG. 3B is compared with the Z value of the car shown in FIG. This Z-value comparison may be performed only on the sphere portion, for example. Further, the Z value comparison may be performed only on the vehicle portion. Furthermore, the Z value comparison may be performed only for the portion where the ball and the car are combined. That is, the Z value comparison may be performed only on the character portion or the polygon portion. Usually, since the background image is in a deep part, it is not necessary to determine the context with the polygon. In such a case, the processing amount can be reduced by comparing the Z values of only the character portion and the polygon, thereby realizing a real-time moving image.

  The Z value comparison means (27) includes the Z value of the front and rear determination polygon character (17) obtained by the front and rear determination polygon character Z value acquisition means (25) and the Z value of the polygon acquired by the polygon acquisition means (23). Is a means for comparing with each other in pixel units. As an example of the Z value comparison means (27), there is one having a comparison means for obtaining the divisor between the Z value of the polygon character for determination before and after (17) and the Z value of the polygon and comparing the divisor. Further, the difference between the Z value of the polygon character for determination before and after (17) and the Z value of the polygon may be obtained, and the magnitude comparison may be performed using the sign of the obtained difference.

Hidden surface removal process (S105)
In the hidden surface erasing step (S105), the hidden surface erasing means (29) is arranged on the back of the three-dimensional polygon character (21) and the front / rear determination polygon character (17) based on the comparison result of the Z value comparing means (27). This is a process of performing hidden surface erasure on a positioned object. Comparing Z values and performing hidden surface removal processing is known as described in, for example, Japanese Patent Laid-Open No. 6-44384. For each pixel, data of the polygon character for which the Z value is large and located deeply among the front-rear determination polygon character and the three-dimensional polygon character is deleted. For example, let us consider a case where a front-rear determination polygon character is positioned behind a three-dimensional polygon character at a certain pixel. In this case, the information on the front / rear determination polygon character in the pixel is deleted. For example, the Z buffer included in the graphic chip may obtain the Z value of the front-side determination polygon character (17) and the three-dimensional polygon character (21) for each pixel (that is, the one having a small Z value). Remember. In the case where another polygon exists before the front / rear determination polygon character (17) and the three-dimensional polygon character (21), the Z values of the front / rear determination polygon character (17) and the three-dimensional polygon character (21) are present. Rather, it is preferable that the Z value of the closest one (that is, the smallest Z value) is stored in the Z buffer.

  The hidden surface removal means (29) is a means for performing hidden surface removal of the three-dimensional polygon character (21) and the front and rear determination polygon character (17) based on the comparison result by the Z value comparison means (27).

  FIG. 6 is a diagram illustrating an example of an image after hidden surface removal. FIG. 6A is a diagram illustrating an example of polygons and characters after hidden surface removal. FIG. 6B is a diagram illustrating an example of a polygon after hidden surface removal. That is, as a result of the Z value comparison, in the pixel in the overlapping area of the polygon and the character, the car (21a) is located at the backmost position, the sphere (15) is located at the middle position, and the car (21b) is located at the forefront position. . The hidden surface removal process is performed based on the result of the Z value comparison. That is, in the overlap region between the car (21a) and the sphere (15), the information on the car (21a) is deleted as a result of the Z value comparison. On the other hand, in the overlapping region of the car (21b) and the sphere (15), the information of the sphere (15) is deleted as a result of the Z value comparison.

Synthetic screen acquisition process (S106)
In the composite screen acquisition step (S106), the image compositing means (31) uses the two-dimensional image (13) subjected to the hidden surface erasure processing by the hidden surface erasing means (29) and the front-rear determination. This is a step of combining the polygon character (17) to obtain a combined screen. For example, when the image of FIG. 6A and the image of FIG. 5 are combined, the combined image shown in FIG. 3E can be obtained. On the other hand, even if the image of FIG. 6B and the image of FIG. 3A are combined, the combined image shown in FIG. 3E can be obtained.

  The synthesized image may be appropriately rasterized and output as a two-dimensional image. The two-dimensional image output in this way is stored in a frame buffer or the like and displayed on a display device.

  The image composition means (31) synthesizes the two-dimensional image (13) with the three-dimensional polygon character (21) and the front-rear determination polygon character (17) subjected to the hidden surface removal processing by the hidden surface removal means (29). , A means to obtain a composite screen.

  The present invention relates to a display device using a computer. The computer includes an input / output device, a storage device, an arithmetic device, and a control device. Each element is connected by a bus or the like so that information can be exchanged. An example of such a computer is a computer having a graphic processor. The program of the present invention is stored in a storage device as a control program, for example. The display device of the present invention operates as follows, for example. Some instruction is input from the input device. Then, the control device reads the control program stored in the storage device. And while using input information, the information memorize | stored in the memory | storage device suitably is read, and a predetermined calculation is performed with an arithmetic unit. And the calculation result performed with the arithmetic unit is memorize | stored in a memory | storage device. Then, the control device outputs the calculation result stored in the storage device from the input / output device.

  The present invention also provides a gaming machine equipped with a display device using the above computer. Examples of gaming machines include pachinko machines, slot machines, pachislot machines, game machines, and mobile phones with games. These gaming machines have a monitor that displays computer graphics. Therefore, the gaming machine equipped with the display device using the computer of the present invention can display a real-time graphic moving image from the monitor.

  The program according to the present invention includes a computer, a vertex coordinate value storage means (19), a polygon acquisition means (23), a front and rear determination polygon character Z value acquisition means (25), a Z value comparison means (27), a hidden surface removal means ( 29), and a program for causing the image composition means (31) to function. These means are as described above. The present invention also provides a computer-readable information recording medium storing this program. Examples of the information recording medium include ROM, CD-ROM, DVD, and hard disk.

  In a preferred pattern of the present invention, the display device includes a graphic chip including a Z buffer, and a ROM connected to the graphic chip by a bus. For example, by storing compressed data of a two-dimensional image in a ROM connected to the graphic chip via a bus, the data can be read and decoded continuously by the graphic chip decoding function. In parallel with these, a three-dimensional polygon character can be drawn. In addition, the Z-buffer can be built in a graphic chip, etc., so extremely fast access can be realized. For example, the ROM functions as vertex coordinate value storage means (19). For example, the Z buffer included in the graphic chip is a Z buffer of the front-side determination polygon character (17) and the three-dimensional polygon character (21) for each pixel (that is, the one having a small Z value). Store the value. In the case where another polygon exists before the front / rear determination polygon character (17) and the three-dimensional polygon character (21), the Z values of the front / rear determination polygon character (17) and the three-dimensional polygon character (21) are present. Rather, it is preferable that the Z value of the closest one (that is, the smallest Z value) is stored in the Z buffer.

  FIG. 7 is a block diagram of the display device in the embodiment. As shown in FIG. 7, the display device includes a graphic chip and a first ROM connected to the CPU, and a second ROM, a frame buffer and a monitor connected to the graphic chip. The graphic chip includes a Z buffer. Since the graphic chip includes a Z buffer, high-speed access can be realized. Hereinafter, an example of the method of the present invention will be described.

  First, a 3D model (3D polygon character) is created using 3D drawing software such as MAYA (registered trademark), 3DSTUDIOMAX (registered trademark), or the like. Create a model and background, add motion, and complete a 3D file containing a series of videos. Then, the 3D file is rendered to obtain a two-dimensional continuous image for each frame. When converting a 3D file to a 2D file, a 3D polygon character such as a pattern to be synthesized is deleted (not displayed) and rendered to form a 2D image. Furthermore, it is preferable to compress the 2D image data in order to reduce the data capacity. A known compression format can be used as appropriate.

  Using the converter, the vertex coordinate data and motion data of the front / rear determination polygon are extracted from the previously completed 3D file according to the system format. Thereby, data for determining the Z value of the character in the movie is extracted. The acquired vertex data of the front-rear determination polygon is treated as 3D polygon character data without color information (transparent). 3D polygon character information such as symbols to be synthesized is also converted from the original file. This 3D polygon character information is acquired with color / image information to be drawn / displayed, and handled as 3D polygon character data to be displayed. By changing the image information, different designs (numbers, etc.) can be displayed, and a changeable 3D polygon can be synthesized in a fixed 2D movie. The higher the decoding performance of compressed data for reproducing a 2D movie and the 3D real-time rendering performance, the more 3D polygon characters can be displayed at a higher frame rate.

  Thereafter, the data is written into the ROM.

  In the first embodiment, when the data produced by the 3D polygon is rendered into a 2D image, since the original information includes polygon coordinate information and motion information for each character, it can be realized relatively easily. . However, 3D polygon characters can be combined with animations or live-action images taken with a camera. Coordinate information can be assigned to target characters in animations and live-action images by extracting them using image recognition, or by creating the same model that overlaps the target character manually and assigning the same movement. Also good.

  FIG. 8 is a diagram for explaining a process of image processing according to a display device using a computer of the present invention. FIG. 8A shows an example of a two-dimensional image including a character. FIG. 8B shows an example of a front / rear determination polygon character obtained by extracting the Z value of the character. FIG. 8C shows an example of a three-dimensional polygon character. FIG. 8D shows an example of an image when a polygon subjected to hidden surface removal processing is synthesized.

  First, a character that requires depth determination is extracted from the two-dimensional image. In the example shown in FIG. 8A, monsters included in the two-dimensional image are extracted. In this example, a three-dimensional computer graphic is created using a three-dimensional polygon and converted to two-dimensional data. Therefore, the vertex coordinate information of the 3D polygon before being converted into 2D data was acquired. Thereby, the character (monster) contained in the two-dimensional image was extracted. Specifically, when a two-dimensional image is generated by rendering a three-dimensional polygon, a plurality of vertex coordinate values of the polygon are stored separately from the rendered image.

  Next, the Z value of the virtual character part is obtained. In the example shown in FIG. 8B, the front / rear determination polygon character is distinguished from an area other than the character portion of the two-dimensional image. That is, in the example shown in FIG. 8B, the Z value of the character part is smaller than the Z value of the surrounding part. For this reason, the character portion is displayed lightly.

  Next, a polygon for three-dimensional computer graphics to be entangled with a two-dimensional image was created. In this embodiment, the polygon stored in the storage device of the drawing apparatus is read out. In the example shown in FIG. 8C, a plurality of number plates that rotate around a two-dimensional character (monster) are drawn as a three-dimensional polygon character. This 3D polygon character is displayed together with the 2D image. If a polygon is drawn as it is on a two-dimensional image, the front-rear relationship between the character and the polygon included in the two-dimensional image becomes unnatural. Therefore, the Z values of the three-dimensional polygon character and the front and rear determination polygon character were compared, and hidden surface removal processing was performed.

  The two-dimensional image and the image (polygon and character) that have been subjected to hidden surface removal processing were synthesized (step 107). FIG. 8D shows an example of a composite image.

  Next, a calculation for comparing all the Z values of the two-dimensional image, performing hidden surface removal, and obtaining the composite image and the data amount when performing image processing based on the present invention is performed. went. The result is shown in FIG. That is, FIG. 9 shows the amount of data per frame when the hidden surface removal processing is performed by giving a 4-byte Z value to all pixels of the 2D image, and when the image processing is performed according to the present invention. It is a graph which shows the data amount per frame.

  From FIG. 9, it can be seen that when all the pixels have Z values, the amount of data increases especially as the resolution increases. In contrast, according to the image composition method of the present invention, it can be seen that the amount of data does not change even when the resolution increases. Therefore, it can be seen that the present invention is particularly effective for image processing in the high resolution mode.

  The present invention can be suitably used in fields such as computer graphics.

FIG. 1 is a block diagram showing a display device using a computer of the present invention. FIG. 2 is a flowchart for explaining an example of processing by the display device using the computer of the present invention. FIG. 3 is a diagram for explaining a process of image processing according to a display device using a computer of the present invention. FIG. 3A shows an example of a two-dimensional image including a character. FIG. 3B shows an example of a figure obtained by extracting the Z value of the character. FIG. 3C is a conceptual diagram of a polygon. FIG. 3D shows an example of an image when a character and a polygon subjected to hidden surface removal processing are combined. FIG. 3E shows the synthesized image. FIG. 4 is a diagram illustrating an example when the two-dimensional image of FIG. 3A is created. FIG. 4A shows a background image (41) before drawing a character. FIG. 4B shows a sphere as a character. FIG. 5 is a conceptual diagram showing the Z value of a polygon. FIG. 6 is a diagram illustrating an example of an image after hidden surface removal. FIG. 6A is a diagram illustrating an example of polygons and characters after hidden surface removal. FIG. 6B is a diagram illustrating an example of a polygon after hidden surface removal. FIG. 7 is a block diagram of the display device in the embodiment. FIG. 8 is a diagram for explaining a process of image processing according to a display device using a computer of the present invention. FIG. 8A shows an example of a two-dimensional image including a character. FIG. 8B shows an example of a figure obtained by extracting the Z value of the character. FIG. 8C shows an example of a polygon. FIG. 8D shows an example of an image when the two-dimensional image after the character is removed and the polygon subjected to the hidden surface removal process are combined. FIG. 9 shows the amount of data per frame when performing hidden surface removal processing with a Z value of 4 bytes for all pixels of a 2D image, and one frame when performing image processing according to the present invention. It is a graph which shows the amount of data per hit.

Explanation of symbols

11 computer; 13 two-dimensional image; 15 two-dimensional character; 17 front and rear determination polygon character; 19 vertex coordinate value storage means; 21 three-dimensional polygon character; 23 polygon acquisition means; 25 front and rear determination polygon character Z value acquisition means; Z value comparison means; 29 hidden surface removal means; 31 image composition means

Claims (7)

A video display method using a computer (11),

The computer (11)
Vertex coordinate value storage means (19) for storing the vertex coordinate value of the front and rear determination polygon character (17) when the two-dimensional character (15) requiring depth determination in the two-dimensional image (13) is represented by a three-dimensional polygon. When,
Polygon acquisition means (23) for obtaining a three-dimensional polygon character (21) to be displayed together with the two-dimensional image (13);
A front / rear determination polygon character Z value acquisition means (25) for obtaining a Z value of the front / rear determination polygon character (17) from the vertex coordinate values stored by the vertex coordinate value storage means (19);
The Z value of the front / rear determination polygon character (17) obtained by the front / rear determination polygon character Z value acquisition means (25) and the Z value of the polygon acquired by the polygon acquisition means (23) are compared in pixel units. Z value comparison means (27) to perform,
A hidden surface removing means (29) for performing hidden surface removal of the three-dimensional polygon character (21) and the front-rear determination polygon character (17) based on the comparison result by the Z value comparing means (27);
The two-dimensional image (13) is combined with the three-dimensional polygon character (21) and the front-rear determination polygon character (17) that have been subjected to hidden surface removal processing by the hidden surface removal means (29), and a combined screen is displayed. Obtaining image composition means (31);
Comprising

The front / rear determination polygon character (17) is composed only of coordinate information,

For each frame,
Reading from the vertex coordinate value storage means (19) the vertex coordinate value of the front-rear determination polygon character (17) when the two-dimensional character (15) is represented by a three-dimensional polygon;
Obtaining the Z value of the front-rear determination polygon character (17) using the vertex coordinate values;
Obtaining a three-dimensional polygon character (21) to be displayed together with the two-dimensional image (13) by the polygon acquisition means (23);
The Z value comparing means (27) comparing the Z value of the front-rear determination polygon character (17) with the Z value of the three-dimensional polygon character (21) in units of pixels;
Based on the comparison result of the Z value comparison means (27), the hidden surface removal means (29) is located behind the three-dimensional polygon character (21) and the front / rear determination polygon character (17). A hidden surface removal process;
The image synthesizing means (31) and the two-dimensional image (13) subjected to the hidden surface erasure processing by the hidden surface erasing means (29) and the front-rear determination polygon character (17). ) To obtain a composite screen,
including,

A video display method using a computer. A display device using a computer (11),
Vertex coordinate value storage means (19) for storing the vertex coordinate value of the front and rear determination polygon character (17) when the two-dimensional character (15) requiring depth determination in the two-dimensional image (13) is represented by a three-dimensional polygon. When,
Polygon acquisition means (23) for obtaining a three-dimensional polygon character (21) to be displayed together with the two-dimensional image (13);
A front / rear determination polygon character Z value acquisition means (25) for obtaining a Z value of the front / rear determination polygon character (17) from the vertex coordinate values stored by the vertex coordinate value storage means (19);
The Z value of the front / rear determination polygon character (17) obtained by the front / rear determination polygon character Z value acquisition means (25) and the Z value of the polygon acquired by the polygon acquisition means (23) are compared in pixel units. Z value comparison means (27) to perform,
A hidden surface removing means (29) for performing hidden surface removal of the three-dimensional polygon character (21) and the front-rear determination polygon character (17) based on the comparison result by the Z value comparing means (27);
The two-dimensional image (13) is combined with the three-dimensional polygon character (21) and the front-rear determination polygon character (17) that have been subjected to hidden surface removal processing by the hidden surface removal means (29), and a combined screen is displayed. Obtaining image composition means (31);
Comprising

The front-rear determination polygon character (17) is composed only of coordinate information.

Display device. The two-dimensional image (13)
Generated based on the character represented by the polygon,
The display device according to claim 2, wherein the vertex coordinate value of the front / rear determination polygon character (17) is obtained by using a plurality of vertices when the character is represented by a polygon. A graphics chip including a Z buffer;
Including the graphic chip and a ROM connected by a bus;

The ROM functions as the vertex coordinate value storage means (19),

The Z value comparison means (27) compares the Z value of the polygon character for determination before and after (17) and the Z value of the polygon,

The Z buffer included in the graphic chip is:
For each pixel, the Z value of the front / rear determination polygon character (17) and the three-dimensional polygon character (21) of the front one is stored.

The display device according to claim 2.   A gaming machine equipped with the display device according to claim 2. Computer
Vertex coordinate value storage means (19) for storing the vertex coordinate value of the front and rear determination polygon character (17) when the two-dimensional character (15) requiring depth determination in the two-dimensional image (13) is represented by a three-dimensional polygon. When,
Polygon acquisition means (23) for obtaining a three-dimensional polygon character (21) to be displayed together with the two-dimensional image (13);
A front / rear determination polygon character Z value acquisition means (25) for obtaining a Z value of the front / rear determination polygon character (17) from the vertex coordinate values stored by the vertex coordinate value storage means (19);
The Z value of the front / rear determination polygon character (17) obtained by the front / rear determination polygon character Z value acquisition means (25) and the Z value of the polygon acquired by the polygon acquisition means (23) are compared in pixel units. Z value comparison means (27) to perform,
A hidden surface removing means (29) for performing hidden surface removal of the three-dimensional polygon character (21) and the front-rear determination polygon character (17) based on the comparison result by the Z value comparing means (27);
The two-dimensional image (13) is combined with the three-dimensional polygon character (21) and the front-rear determination polygon character (17) that have been subjected to hidden surface removal processing by the hidden surface removal means (29), and a combined screen is displayed. Obtaining image composition means (31);
To function,

The front-rear determination polygon character (17) is composed only of coordinate information.

program. A computer-readable information recording medium storing the program according to claim 6.

Images