JPH10283487A - Multiple texture mapping device and method therefor and storage medium storing program for multiple texture mapping - Google Patents

Abstract

PROBLEM TO BE SOLVED: To attain object display with high quality equivalent to the real thing by CG by texture mapping even when the object has a complicate shape. SOLUTION: A projected picture processing part 32 sets plural projection faces in the surrounding of an object constituted of three-dimensional picture data, and projects the visible face of the object in parallel to each projection face. A texture picture preparing part 34 generates a texture picture having the color data of an object surface from the projected picture of each projection face. A texture related information generating part 38 generates three- dimensional shape data obtained by adding related information indicating a corresponding relation with the texture picture of each projection face to three- dimensional shape data. A texture mapping processing part 48 generates two-dimensional picture data in which an object expressed with the three-dimensional shape data with the texture related information is viewed from an arbitrary direction, and reproduces the object by multiply mapping the texture picture of each projection face based on the texture related information.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multi-texture mapping apparatus and method for displaying objects having complicated shapes, colors and patterns, such as human and monkey fossil specimens, using computer graphics, and a multi-texture. More particularly, the present invention relates to a multi-texture mapping apparatus and method for accurately displaying an object by multi-mapping of texture images using a plurality of projection planes, and a program for multi-texture mapping. It relates to the stored storage medium.

[0002]

2. Description of the Related Art When displaying natural shaped objects such as fossil specimens of humans and monkeys in computer graphics, it is difficult to express them with a combination of basic shapes such as cubes and cylinders. You cannot enter the shape of the specimen. Therefore, the three-dimensional shape of the fossil specimen is input using a non-contact type three-dimensional shape measuring device. If the three-dimensional shape data of the fossil sample can be generated in this way, the display of the sample by computer graphics can be easily performed with respect to the shape.

On the other hand, in computer graphics, the color and pattern of the surface of a fossil specimen must be displayed simultaneously with the display of the three-dimensional shape of the fossil specimen. The expression of colors and patterns on the surface of objects in computer graphics
There are shading and texture mapping. In shading, the color of the object surface is specified and displayed.
There are a method of designating the color and a method of designating the color of the surface of the polygon constituting the object and the method of designating the color of the vertex of the polygon. However, when three-dimensional shape data such as fossil specimens measured by a three-dimensional shape measurement device are displayed by directly specifying colors by shading, the number of polygons is too large, and colors and patterns close to the real thing that changes smoothly are expressed. It is difficult to do.

In texture mapping, the color of the object surface is previously extracted as texture image data and stored in, for example, a texture image table, and the texture image data is projected and displayed on a corresponding portion of the object surface when displaying the object. . The texture mapping uses the colors and patterns of the fossil specimens as they are, so that a display close to the real thing is possible.

FIG. 24 is a schematic diagram of texture mapping, in which texture image data is prepared in advance in a two-dimensional rectangular texture image table 204 corresponding to a rectangular area 202 of an object 200. When the object 200 is displayed by computer graphics, the image data of the texture image table 204 is projected and mapped in correspondence with the object surface 202. This mapping correspondence is represented by (S, T) = f (X, Y, Z), where the object coordinates are (X, Y, Z) and the texture coordinates are (S, T). Here, the transformation function f () may be a projection of cylindrical polar coordinates using a texture image of a cylindrical projection surface or a projection of polar coordinates using a texture image of a spherical projection surface, in addition to the orthographic projection of an arbitrary plane as shown in FIG. And other coordinate conversion coefficients.

[0006] In order to display an object such as a fossil specimen by texture mapping, first, texture image data must be created in advance from a real object. FIG. 25 shows generation of a texture image of the donut-shaped object 214.
A texture image is generated by the cylindrical projection plane 210. FIG. 25 shows generation of a texture image using the two-dimensional rectangular projection surface 215.

For example, the generation of a texture image by the two-dimensional rectangular projection surface 215 in FIG. 26 takes the object 216 having a cubic shape in FIG. 27 as an example.
As represented by the triangular polygon 216, it is represented by a set of many triangular polygons. Therefore, texture image data is generated on the texture image table 204 for each polygon.

That is, the vertices P1, P2 and P3 of the polygon 216 constituting the surface of the object 216 are projected onto the texture image table 204 which is a two-dimensional rectangular plane, and the texture polygon 21 having projection vertices TP1, TP2 and TP3.
Find 8. Normally, the vertices P1, P2,
RGB color data is also added to the coordinate data of P3.

Therefore, the projection vertices TP1, TP2, TP3 of the texture polygon 218 correspond to the vertices P1, P2, P
By storing the three RGB color data, each texture pixel is generated. Texture pixels inside the texture polygon 218 are projected vertices TP1, TP2, T
It is generated by interpolating the RGB color data of P3. FIG.
27 is a texture image table 204 based on the two-dimensional rectangular projection surface 215 of FIG. 26 generated as shown in FIG. 27, and stores texture image data 220.

[0010]

However, when texture image data is generated by projecting an image on the surface of an object, there are the following problems. FIG. 29 shows a case where a plurality of different points on the object surface are projected in an overlapping manner.
Regarding the polycons 222 and 226 constituting the object surface,
If the vertices 224 and 226 are on the same projection line 232 with respect to the projection plane 216, the projection point 230 has two vertices 2
24, 228 are projected overlapping. Therefore, the vertex 22
When any one of the color data 4, 228 is associated with the color data of the projection point 230, the color data of the other vertex is missing.

When an object viewed from the vertex side where the color data is missing is displayed by computer graphics from the three-dimensional shape data, the missing part cannot be expressed and the color or pattern on the surface is lost, and the viewing direction is reduced. Therefore, there is a problem that an image of an object cannot be accurately reproduced. FIG.
Is a problem of surface distortion when a polygon of an object plane is projected onto a projection plane and coordinate conversion is performed. The projection lines 238-1 to 238-3 on the projection plane 216 passing through the vertices 236-1 to 236-3 of the polygon 234 constituting the object surface may be arranged in one direction depending on the direction of the polygon 234. In this case, the projection polygon 240 on the projection plane 216 approaches a straight line, and most of the texture pixels on the projection plane 216 are missing. Therefore, when an object is displayed by computer graphics, there is a problem that a color or a pattern of a missing portion cannot be expressed and a hole is formed, so that accurate reproduction cannot be performed.

Such a problem that color data is lost when generating texture image data is remarkable in the case of an object having a very complicated shape, color, and pattern such as a fossil sample. It has not been possible to display a high-quality image equivalent to the real thing while freely changing the viewing direction of the image using computer graphics. The present invention
In light of these problems, even objects with extremely complex shapes, colors, and patterns, such as fossil specimens, can display high-quality objects equivalent to the real objects by texture mapping using computer graphics. It is an object of the present invention to provide a multi-texture mapping apparatus and method realized by a computer and a storage medium storing a program for multi-texture mapping.

[0013]

FIG. 1 is a diagram illustrating the principle of the present invention. According to the present invention, as shown in FIG. 1A, an image input unit 22, a projection image processing unit 32, a texture image creation unit 3
4, a texture-related information generation unit 38 and a texture mapping processing unit 48.

The image input unit 22 inputs three-dimensional image data including three-dimensional shape data and color data of a surface that can be visually recognized from the outside of an actual object. The projection image processing unit 32
A plurality of projection planes are set around the object represented by the three-dimensional image data input from the image input unit 22, and two-dimensional projection image data obtained by parallel projection (orthogonal projection) of a plane where the object can be seen on each projection plane is displayed. Generate. The texture image creation unit 34 stores color data of the object surface for the two-dimensional projection image data of each projection plane, and generates texture image data for each projection plane.

The texture-related information generating section 38 adds relevant information indicating the correspondence between the three-dimensional shape data extracted from the image input section 22 and the texture image data for each projection plane created by the texture image creating section 34. Generated three-dimensional shape data with texture related information. The texture mapping processing unit 48 generates two-dimensional shape data with texture-related information when the object represented by the three-dimensional shape data with texture-related information is viewed from any direction,
Based on the texture-related information of the two-dimensional shape data, texture image data created for each projection plane is mapped to generate two-dimensional display data on the frame memory 18 and display it on the CRT 20.

As described above, in the multiple texture mapping apparatus according to the present invention, a plurality of projection planes are set around an object, and a two-dimensional projection image is obtained by parallel projection (orthogonal projection) of a plane in which the object can be seen on each projection plane. Since a texture image is generated from an object, even if the object has a complicated shape such as a fossil specimen, it can be seen from the outside by setting multiple projection planes, for example, inside a hole that can be seen from the outside The texture image can also be generated for the surface portion located at.

Therefore, there is no missing part in the texture image expressing the color and the pattern on the surface of the object, and the surface color and the pattern can be converted into a plurality of parts without any loss when the object represented by the three-dimensional shape data is viewed from any direction. From the texture images of the plurality of tables created by setting the projection plane, multiple textures can be mapped and accurately expressed, and a high-quality object display that is almost the same as the real object can be obtained by computer graphics.

As the image input unit 22, a three-dimensional shape measuring device for irradiating a laser beam to the surface of the object and optically measuring the distance to the surface of the object to measure the surface shape and color of the object is used. The image input unit 22 expresses the object surface as a set of minute polygons as three-dimensional shape data of the object surface, and the polygons include vertex coordinates and color data of each vertex. This polygon is a triangular polygon and includes three vertex coordinates and R, G, B color component information of each vertex.

As shown in FIG. 1B, the projection image processing section 32 projects all observable parts in a predetermined observation area set outside the object 70 represented by three-dimensional image data. A plurality of projection planes 60 are set. Further, the projection image processing unit 32 can also set a plurality of projection planes so that all the parts observable from the outside of the object can be projected. Specifically, the projection plane is set by a three-dimensional or more three-dimensional constituent surface, for example, a hexagonal prism, an octagonal prism, or the like. in this case,
The projection image processing unit 32 sets the projection plane around the object such that a normal from an arbitrary point on the projection plane passes through the center of the object.

The texture image creating section 34 is shown in FIG.
, The position of the projection plane (S,
T), a color image (R, G, B), and a distance (d) to the surface of the object. A texture image table 84 having storage areas for each pixel position of the mapping of the object surface to the projection plane 60 is provided. Then, each of the color data and the distance to the object surface is generated and stored.

The texture image creating section 34 projects vertex coordinates on a projection plane for each polygon of the object, generates and stores color data and a distance to the object surface for each vertex position,
Next, the color data of the texture pixels existing in the area surrounded by each vertex is generated and stored by the interpolation process based on the information of each vertex. The texture image creating unit 34 provides flag information indicating that the texture pixel data is valid, and stores the color data (R, G, B) at the pixel position (S, T) based on the mapping on the projection plane 60. Next, the flag information is turned on. As this flag information, an alpha value (α) provided in the RGB data structure is used.

The texture image creation unit 34 normalizes the positions of the texture pixels in the texture image table 84 and sets them as texture two-dimensional coordinates (S, T).
When the projection plane 60 is set, the normalized coordinates are converted into the size of the projection plane and three-dimensional coordinates (S, T, PZ). The texture-related information generation unit 38 extracts the three-dimensional shape data from the three-dimensional image data of the image input unit 22, adds the relevant information with the texture image data generated by the texture image generation unit to the three-dimensional shape data, and Generate three-dimensional shape data with related information.

That is, the texture-related information generating unit 38
Three-dimensional shape data is generated by adding the position coordinates (Si, Ti, PZi) of the corresponding texture pixel data to the vertex coordinates (Xi, Yi, Zi) of the polygon representing the three-dimensional shape of the object as related information. . The texture-related information generation unit 38 determines a projection plane on which a polygon representing the three-dimensional shape of the object is projected, and, when determining a plurality of projection planes, selects an optimal projection plane and generates texture image data and Is added to the polygon on the surface of the object.

In selecting an optimum projection plane, first, it is determined whether or not a polygon polygon is projected without being hidden by another polygon polygon, and a projection plane that is projected without being hidden is selected. That is, the distance to the object surface included in the texture image data is compared with the actually calculated distance to the object surface,
When the two coincide with each other within a predetermined error range, it is determined that the projection plane is not hidden by other polygons and is projected and selected.

When the texture-related information generation unit 38 determines a plurality of projection planes on which the polygon is to be projected, the texture-related information generation unit 38 further compares the normals of the polygon and the projection polygon to obtain a projection plane having the maximum intersection angle. Is selected as the optimal projection plane.
By selecting such an optimal projection plane, even if the texture image corresponding to the polygon on the object surface exists in the texture image data of a plurality of projection planes, it is closest to the polygon plane among them, A projection plane having a projection polygon that is not hidden by other polygons is selected as the optimal projection plane. That is, the projection plane having the largest amount of information on the texture pixels with respect to the polygon constituting the object plane is selected as the optimal projection plane.

Further, in the present invention, there is provided a three-dimensional shape data reduction processing unit 40 for reducing the data amount of the three-dimensional image data taken out from the image input unit 22 and supplying the reduced data amount to the texture related information generation unit 38. When displaying three-dimensional image data of an object digitized using a three-dimensional shape measuring apparatus using computer graphics, the three-dimensional shape data is generated as an aggregate of minute polygons covering several hundred thousand surfaces. . In computer graphics, most of the processing is spent on coordinate transformation of shapes.

Therefore, according to the present invention, the three-dimensional image data is separated into color data for generating a shape and a texture image, and the data amount of the shape is reduced to reduce the processing load of computer graphics. I do. That is, the three-dimensional image data reduction processing unit 40 reduces polygonal polygons representing the three-dimensional shape of the object into larger polygons to reduce the data amount of the three-dimensional shape data.

The texture mapping processing section 48 reads a texture pixel data group specified by texture coordinates (Si, Ti, PZi) added as related information to the two-dimensional image data, and performs texture mapping on the two-dimensional image data. To generate two-dimensional display data. The present invention also provides a multiple texture mapping method comprising the following steps.

An image inputting step of inputting three-dimensional image data including three-dimensional shape data and color data of a surface of an actual object that can be visually recognized from the outside; an object represented by the three-dimensional image data input from the image inputting step; A projection image processing process in which a plurality of projection planes are set around and two-dimensional projection image data is generated by projecting a plane in which an object is visible on each projection plane in parallel; color data of the object surface for the two-dimensional projection image data of each projection plane For creating a texture image data for each projection plane; the correspondence between the three-dimensional shape data extracted from the image input step and the texture image data for each projection plane created in the texture image creation step -Related information generating step of generating three-dimensional shape data with texture-related information to which related information indicating a texture is added; Generates two-dimensional shape data with texture-related information when the object represented by the original shape data is viewed from any direction, and texture image data created for each projection plane based on the texture-related information of the two-dimensional shape data In the texture mapping process for generating two-dimensional display data by mapping data; details of the multiple texture mapping method are basically the same as those of the device configuration.

Further, the present invention provides a storage medium storing a program for multiple texture mapping. The recording medium includes: an image input unit 22 for inputting three-dimensional image data including three-dimensional shape data and color data of a surface that can be visually recognized from the outside of an actual object; expressed by three-dimensional image data input from the image input unit 22 Projection image processing unit 3 that sets a plurality of projection planes around the object to be projected, and generates two-dimensional projection image data in which a plane where the object is visible is parallel projected on each projection plane
2: a texture image creation unit 34 that stores color data of the object surface for the two-dimensional projection image data of each projection plane and generates texture image data for each projection plane; image input unit 22
Texture-related information for generating texture-related information-added three-dimensional shape data obtained by adding related information indicating the correspondence between the three-dimensional shape data extracted from the above and the texture image data for each projection plane created by the texture image creation unit 34 Information generation unit 38; generates two-dimensional shape data with texture-related information when an object represented by the three-dimensional shape data with texture-related information is viewed from an arbitrary direction, and based on the texture-related information of the two-dimensional shape data. Texture mapping processing unit 4 that maps texture image data created for each projection plane to generate two-dimensional display data
8;

The storage medium storing a program for multiple texture mapping reduces the data amount of the three-dimensional shape data extracted from the image input unit 22 and supplies the data to the texture-related information generation unit 38. The processing unit 42 is provided. Other details of this storage medium are basically the same as the device configuration.

[0032]

FIG. 2 shows a hardware configuration of a computer to which multiple texture mapping according to the present invention is applied. In FIG. 2, a RAM 14 used as a work memory is connected to a bus 12 of an MPU 10 functioning as an arithmetic processing unit, and as a dedicated processing unit for realizing computer graphics (hereinafter, referred to as “CG”). Graphics accelerator 1
6 are provided.

A frame memory 18 for expanding display image data is connected to the graphics accelerator 16, and the image data expanded in the frame memory 18 is displayed on a CRT display device 20. The bus 12 is provided with a three-dimensional shape measuring device 22, an external storage device 24 such as a magnetic disk drive, a keyboard 26 for performing input / output operations, and a pointing device 28 for performing mouse clicks on a CRT. ing.

The three-dimensional shape measuring device 22 scans the periphery in a cylindrical shape while irradiating the surface of the object with a laser beam in a state where an actual object such as a fossil specimen is set in the device, and synchronizes with the scanning of the laser beam. The distance to the surface of the object is optically measured by detection scanning by the scanner head, and three-dimensional image data including three-dimensional shape data of the object and color data of the object surface are output as measurement data. Store in image data file.

The three-dimensional shape data of the object output from the three-dimensional shape measuring device 22 is a set of minute triangular polygons. Become. Color data of the vertices is added to the coordinates of the three vertices of the polygon, for example, as RGB data. FIG. 3 is a flowchart of the overall processing of the multiple texture mapping of the present invention by the MPU 10 of FIG. First, in step S1, an object to be displayed, for example, a fossil sample is set in the three-dimensional shape measuring device 22, and three-dimensional shape data and color data are measured to generate three-dimensional image data.

Subsequently, the process proceeds to step S2, where step S1
A plurality of projection planes are set for the object represented by the three-dimensional image data input in step (1), and texture image data is generated for each projection plane. Then, the process proceeds to step S3,
The three-dimensional shape data with texture-related information obtained by creating the relevant information with the texture image generated in step S2 for the three-dimensional shape data of the object generated in step 1 and adding the texture image-related information to the three-dimensional shape data Generate By the processing of steps S1 to S3, C
G completes the preparation work for reproducing the object.

Subsequently, in step S4, two-dimensional shape data obtained by viewing the object represented by the three-dimensional shape data with the texture-related information of step S3 from an arbitrary direction is generated and added to the two-dimensional shape data. Based on the relevant texture-related information, the texture image corresponding to the plurality of projection planes created in step S2 is read out and mapped in pixel units from the corresponding texture image data.
Display on T.

Here, as for the three-dimensional shape data to which the related information of the texture image is added in step S3, the three-dimensional shape data input by the three-dimensional shape measuring device in step S1 is not directly used, but is used in the embodiment of the present invention. In this case, the polygons constituting the initially input three-dimensional shape data are combined into a larger polygon to reduce the data amount, and texture-related information is added to the reduced three-dimensional shape data. .

FIG. 4 is a functional block diagram of the multiple texture mapping of the present invention realized by the MPU 10 of FIG. Three-dimensional shape measuring device 2 functioning as an image input unit to realize multiple texture mapping of the present invention
2, projection image processing unit 32, texture image generation unit 34,
Texture-related information creation unit 38, three-dimensional image data reduction processing unit 40, two-dimensional shape data generation unit 46, texture mapping processing unit 48, texture image table 50-
1 to 50-n, a frame memory 18 and a CRT 20 are provided.

The two-dimensional shape data generator 46, texture mapping processor 48, texture image tables 50-1 to 50-n, frame memory 18, and CRT
20 constitutes the CG processing unit 45. The three-dimensional shape measuring device 22 functioning as an image input unit measures a three-dimensional shape and a surface color of a display target object such as a fossil sample, and outputs a three-dimensional image data file 30 as shown in FIG. 5, for example. . This three-dimensional image data file 30 is a set of triangular polygons which are constituent surfaces of the object surface shape, and polygon data P1i, P2i, P3
i,...

Here, the polygon data P1i, P2i, P
Are the numbers of the vertices, and take the values of i = 1, 2, 3 since they are triangular polygons. As the polygon data, for example, the vertex coordinates 52 and the color data 54 are stored for the vertex numbers P11, P12, and P13 as shown by extracting the polygon data P1i on the right side. The vertex coordinates 52 are X, Y, and Z coordinate values in the three-dimensional coordinates defined by the measurement coordinates of the three-dimensional shape measurement device 22. The color data 54 includes three vertices P11 and P1 of the polygon.
2, the R component value, the G component value, and the B component value measured by the three-dimensional shape measuring device 22 for P13.

Referring again to FIG. 4, the projection image processing unit 3
Reference numeral 2 denotes a process for setting a projection plane for generating a texture image on the three-dimensional image data input as the three-dimensional image data file 30. FIG. 6 is an example of a projection plane set according to the present invention, which is a setting of a projection plane constituting the hexagonal prism projection body 56, and is a projection plane 60- arranged in a hexagon.
It has eight projection planes 1 to 60-6 and projection planes 60-7 and 60-8 constituting the bottom and top surfaces of the hexagonal prism. Such a hexagonal prism projection body 56 is set around an object represented by three-dimensional image data.

FIG. 7 shows another embodiment of the projection surface used in the present invention, which is characterized in that a tetrahedral projection body 58 is used.
The tetrahedral projection body 58 has four projection planes 60-11 to 60-14.
Having. As a projection body that completely surrounds the periphery of the object, the tetrahedral projection body 58 has the smallest number of projection planes. FIG. 8 shows another embodiment of the projection plane setting used in the present invention, wherein an octagonal prism projection body 64 is used. In the octagonal prism projection body 64, the upper surface and the lower surface are open, and a projection surface 60-21 which is an octagonal rectangular surface is provided.
~ 60-28 is set. The hexagonal prism projection body 56 of FIG.
Also, in the tetrahedral projection body 58 of FIG. 7, a plurality of projection planes are set so as to completely surround the object located inside. This is because the expression by texture mapping of the target object is expressed as a two-dimensional image viewed from all directions. On the other hand, in the octagonal prism projection body 64 of FIG.
The upper and lower surfaces are not set as projection surfaces, and eight surrounding surfaces are set as projection surfaces 60-21 to 60-28. Such setting of the projection plane only around the upper and lower sides is a case where the viewing direction for displaying the object located inside is limited to the periphery of the object. Of course, when it is desired to represent the object as an image viewed from all directions, the projection plane may be set to 10, and the projection plane may be set to 10 also for the surface that is open up and down in FIG.

FIG. 9 shows a specific example of setting a projection plane for a target object in the present invention. In this example, an object having a donut shape is taken as an example of the target object 70, and rectangular patterns with different pitches are displayed on the surface to give a three-dimensional effect. When an arbitrary projection plane 60 is set for the target object 70, the projection plane 60 is set such that, for example, a normal 77 from a center point 76 of the projection plane 60 passes through the object center 72 of the target object 70.

By setting the projection plane 60 as described above, an image of the surface of the target object 70 is orthogonally projected (parallel projected) onto the projection plane 60 to extract a texture image. For example, target object 7
Focusing on the polygon 74 facing the second projection plane 60, the polygon 74 is orthogonally projected as a projection polygon 76 on the projection plane 60. Here, a distance d from the polygon 74, which is a constituent surface of the target object 70, to the projection polygon 76 on the projection surface 60 is calculated as one piece of information of the texture image data based on the projection surface 60.

FIG. 10 shows a state in which the target object 70 is projected onto the projection plane 60 in FIG.
FIG. 7 is an explanatory diagram of projection image data 78 when projected on a. The projection image data 78 includes projection polygon data PP1i, PP2i, PP3 corresponding to the three-dimensional image data 30 in FIG.
i, PP4i,... As the projection polygon data, the first projection polygon data PP1i is extracted and shown on the right side, and the projected vertex numbers PP11, PP1 are shown.
2 and PP13, each of which has the X, Y, and Z values of the vertex coordinates on the projection plane 60, and color data 54 added to the polygon data P1i of FIG. The color data 82 having the same R, G, B component values is stored.

The projection image data 78 shown in FIG. 10 is an intermediate data form when generating the texture image data, and is finally reflected on the texture image data.
FIG. 11 is an explanatory diagram of a process of generating texture image data after a polygon serving as an object configuration surface of the target object 70 is projected on a projection surface. The generation processing of the texture image data is performed by the texture image generation unit 34 in FIG. In FIG. 11, a texture image table 84 is prepared in advance for the projection plane 60 set for the target object 70.

As shown in FIG. 12, the texture image table 84 includes a projection plane position 85, object color data 86, and a distance 8 to the object surface for each pixel data area in the vertical axis direction.
8 areas. As the projection plane position 85, as shown in FIG. 11, since the texture image table 84 has two-dimensional rectangular coordinates of S and T, the respective values of the coordinate values (S, T) are stored. The object color data 86 has an α value in addition to the R, G, and B component values. Since the .alpha. value is added to an ordinary R, G, B data structure in units of, for example, 8 bits, the .alpha. value region is used as flag information indicating whether or not a texture image is registered in the table in the present invention. .

That is, the α value of the projection plane position in which the object color data 86 and the distance 88 to the object surface are stored is set to 1, and other unregistered pixels are set to 0. As the distance 88 to the object surface, as shown in FIG. 9, a distance d calculated when the polygon 74 on the object surface is projected on the projection plane 60 is stored. FIG. 13 shows the entire structure of the texture image table 84 with respect to the projection plane 60, and has a three-dimensional table structure. The texture image table 84 has the normalized two-dimensional coordinates (S, T) before the correspondence with the projection plane 60 is set, and
When 0 is set as shown in the figure, the coordinates are initialized to coordinate values (S, T, PZ) corresponding to the coordinate positions (X, Y, Z) on the projection plane 60.

Referring again to FIG. 11, the projection polygon 76 of the polygon 74 on the surface of the target object 70 with respect to the projection plane 60 has the projection vertices PP1, PP2, and PP3 at the corresponding coordinate positions (S ,
T), the vertex texture pixels 90-1, 90-2,
90-3. For example, assuming that the vertex coordinates of the projection polygon 76 are the values of the vertex coordinates 80 in FIG. 10, when stored in the texture image table 84, the coordinates of the vertex texture pixels 90-1 to 90-3 are (Si,
Ti, PZi). Here, i is the vertex number of 1, 2, and 3.

Then, each vertex texture pixel 90-1 to 90-9
FIG. 12 of the texture image table 84 corresponding to 0-3
In the area of the object color data 86 in the projection polygon 7
6, the same color data as the vertices P1 to P3 of the polygon 74 constituting the surface of the object is stored as R, G, B component values, and the texture pixel becomes effective. , Α value are set from 0 to 1. Further, the distance between each polygon vertex and the projection vertex is calculated and stored as the distance d1 to the object surface.

As shown in FIG. 11, the texture image table 8
When the storage of the vertex texture pixels 90-1 to 90-3 based on the projection vertices of the projection polygon 76 in FIG. 4 is completed, the interpolation texture of the pixel region included in the projection polygon 76 surrounded by the broken line is interpolated as shown in FIG. A pixel 92 is generated. Specifically, the vertex texture pixels 90-1, 90-1
For pixels located between the straight lines connecting 90-2 and 90-3, linear interpolation is performed on each of the R, G, and B values of the vertex texture pixels at both ends of the straight line to obtain each pixel. Subsequently, with respect to interpolation pixels on a triangular straight line sequentially connecting vertex texture pixels 90-1 to 90-3, for example, color data of pixels located between the R, G, and B values of pixels on both sides located in the horizontal direction Is obtained by linear interpolation.

For d1 indicating the distance 88 to the surface of the object, since the mapping of the texture image to the surface of the object is performed using a polygon as a minimum unit, it is not necessary to determine d1 for the interpolation pixel. Of course, if necessary, the distance d1 to the object surface for the interpolation pixel
May be obtained and stored. FIG. 15 is an explanatory diagram in the case where the projection planes 60-21 to 60-28 by the octagonal prism projection body 64 shown in FIG. 8 are set for the target object 70. Projection surface 60
When the texture image table is created by setting -21 to 60-28, the target object 70 as shown in FIGS. 16A to 16H is viewed from eight directions around the target object 70, and the texture image obtained by projection is obtained. 94-1 to 94-8 can be created.

That is, the texture image 90 shown in FIG.
-1 is created by setting the projection plane 60-21 in FIG. 15, and FIGS. 16B to 16H are obtained by setting the projection planes 60-22 to 60-28 in the counterclockwise order in FIG. It was done. As is clear from the eight texture images 94-1 to 94-8 in FIGS. 16A to 16H, the object surface that can be seen when the target object 70 in FIG. Are generated in the eight texture images 94-1 to 84-8, and the pixel of the object constituent surface at a certain position on the object has the texture of the corresponding projected pixel having a plurality of textures. The relationship exists in the image.

The texture images 94-1 to 94-1 created by setting a plurality of projection planes as shown in FIGS.
94-8 is the texture image data file 36 shown in FIG.
Are stored for each texture image table. FIG.
FIG. 7 is an explanatory diagram of a process of generating texture-related information for three-dimensional shape data by the texture-related information generation unit 38 in FIG. In the embodiment shown in FIG. 4, the three-dimensional image data file 30 input from the three-dimensional shape measuring device 22 is used.
With respect to (3), the three-dimensional shape data reduction processing unit 40 extracts the three-dimensional shape data, and performs a process of reducing the data amount for the three-dimensional shape data.

That is, the three-dimensional shape data obtained from the three-dimensional shape measuring device 22 is a large number of polygon aggregates of, for example, hundreds of thousands of faces. Because the burden is too much,
Reduce data volume. In this shape data reduction processing, a large polygon is formed by grouping a set of polygons constituting the original three-dimensional shape data obtained from the three-dimensional image data file 30 into a predetermined number K. Reduce.

For example, when K is set to 5 and the polygons are grouped into a large polygon, the polygon which was initially several hundred thousand faces can be reduced to one-hundred thousand faces and one fifth. The number K of polygons to be combined for data reduction may be appropriately determined according to the coordinate conversion performance of the CG processing unit 45. However, if K is too large, the shape of the reconstructed image will not be smooth. The value of K may be set within a range that does not impair the smoothness of.

The three-dimensional shape data whose data amount has been reduced in this way is stored in the three-dimensional shape data file 42. In the texture-related information generation unit 38, the three-dimensional shape data file 42 whose data amount has been reduced
17, texture-related information is generated and added in units of polygons constituting the object surface represented by the three-dimensional shape data, as shown in FIG.

FIG. 17 shows a part of the reproduced object shape 100 reconstructed with the three-dimensional shape data whose data amount has been reduced. Focusing on the polygon 102 on the object surface,
For example, projection polygons 104-1, 104-2, and 10 corresponding to projection planes 60-1, 60-2, and 60-3, respectively.
4-3 exists. First, a projection plane 60- on which projection polygons 104-1 to 104-3 of the polygon 102 exist.
The determination of 1, 60-2 and 60-3 is performed as follows.

First, it is determined whether or not a projection polygon of the polygon 102 exists for each of a plurality of projection planes including the projection planes 60-1 to 60-3 set around the reproduction object shape 100. As a result, as shown in FIG.
Projection surface 60 having projection polygons 104-1 to 104-3
Three of -1 to 60-3 are selected. Next, the projection plane 60-
Projection polygons 104-1 to 104-3 of 1 to 60-3
, The projection of the polygon 102 is the reproduction object shape 100
Is projected without being hidden by the other polygons in. It is determined whether or not the polygon 102 is hidden by another polygon by determining the actual distances d1, d2 between the polygon 102 and the projection polygons 104-1 to 104-3.
d3 is obtained and compared with the d value stored in the area of the distance 88 to the object surface in the texture image table 84 shown in FIG. 13 corresponding to each of the projection polygons 104-1 to 104-3.

Actually, the polygon 102 and the projection polygon 1
This is the determination of the distance between three corresponding vertices in 04-1 to 104-3. For example, taking the polygon 102 and the projection polygon 104-1 as an example, if the polygon 102 is hidden by another polygon of the reproduction object shape 100, the projection polygon 104-1 on the projection plane 60-1 hides the polygon 102. The value of d representing the distance to the object surface stored in the corresponding texture image memory is different from the actual distance d1.

On the other hand, if there is no other polygon obstructing the polygon 102, the d value indicating the distance to the object surface stored in the texture image table 84 corresponding to the projection polygon 104-1 is the actual calculated distance d1. be equivalent to. Therefore, if the stored value of the distance d to the object surface of the texture image table 84 corresponding to the projection polygon 104-1 is equal to the actual calculated distance d1, the projection polygon 104 on which the polygon 102 is projected without being hidden by other polygons It can be determined that the projection plane is an appropriate projection plane having −1.

More specifically, the distance between the three vertices of the polygon 102 and the projection polygon 104-1 is compared, and the actual distance between the three vertices and the distance d stored in the texture image table 84 are slightly different. Therefore, when the difference in the distance is within a predetermined error range, the distance is regarded as the same distance, and it is determined that the polygon 102 is an appropriate projection plane on which the polygon 102 is projected without being hidden.

In FIG. 17, the projection planes 60-1 to 60-1
-3, the projection polygons 104-1 to 104-1 which are correctly projected without the polygon 102 being hidden by other polygons.
It is determined that the projection plane has 104-3. FIG.
If the projection planes 60-1 to 60-3 on which the polygon 102 is correctly projected can be selected as shown in 7, the projection polygon of one optimal projection plane is selected from among them. The selection of this optimum projection plane is based on the polygon 1 of the reproduction object shape 100.
02 normal vector 106 and projected polygons 104-1 to 104-1
This is performed using the normal vectors 108-1, 108-2, and 108-3 of the projection planes 60-1 to 60-3 in which 104-3 exists.

The normal vector 106 of the object-side polygon 102 and the normal vector 1 of the projection planes 60-1 to 60-3
In comparison of 08-1 to 108-3, the projection plane in which the intersection angle of the extension of the normal vector 108-1 to 108-3 on the object side becomes the largest is selected as the optimal projection plane. FIG. 18 shows FIG.
7 and the projection planes 60-2, 60-
3 projection polygons 104-2 and 104-3, the respective normal vectors 106, 108-2 and 108-3
The relationship has been taken out. The intersection angle of the extension of the normal vector 108-2 of the projection polygon 104-2 with respect to the normal vector 106 of the object-side polygon 102 is θ _I2 .
The intersection angle between the normal vector 106 of the object-side polygon 102 and the extension of the normal vector 108-3 of the projection polygon 104-3 is θ _I3 .

Of these two intersection angles θ _I2 and θ _I3 , the intersection angle θ _I3 on the side of the projection polygon 104-3 is larger. That is,
For the object side vector 102, the projection polygon 104-3
Are closer to being parallel to each other. The close parallel relationship means that the texture pixel data included in the orthogonally projected projection polygon 104-3 of the object-side polygon 102 has a smaller parallel relationship with the projection polygon 104-.
This means that the projection polygon 104-3, which is close to parallel, has a larger amount of texture image data, which is the color data of the object surface corresponding to the polygon 102, than the texture pixel data included in the polygon 2.

That is, the projection plane closest to the object side polygon 102 is selected as the optimum projection plane. FIG.
In the case of, the polygon 1 on the object side as shown in FIG.
Since the intersection angle between the normal vector 106 of No. 02 and the normal vector 108-3 of the projection plane 60-3 is maximized, the projection plane 60-3 is selected as the optimal projection plane. By selecting such an optimal projection plane 60-3, the reproduction object shape 100
For the vertex data of the polygon 102 of the
The coordinate data of the projection vertex of the projection polygon 104-3 is added as texture-related information.

FIG. 19 shows three-dimensional shape data 38 with texture-related information generated based on FIGS. 17 and 18. Polygon data P1i, P1 with texture-related information.
2i, P3i, P4i,... The polygon data with texture-related information is obtained by extracting the X, Y, and Z values of the vertex coordinates 52 corresponding to the polygon vertex numbers P1, P2, and P3 in the three-dimensional shape data, as shown on the right side of the leading P1i. Related information 11
As S, T, and PZ values, which are the coordinates of the vertexes of the projection polygon on the optimal projection plane selected as shown in FIG.

The three-dimensional shape data with texture related information created in this way is stored in the three-dimensional shape data file with texture related information 44 as shown in FIG.
If the three-dimensional shape data file 44 with the texture-related information can be created, the subsequent processing is an object display by the normal texture mapping by the CG processing unit 45. That is, for the reproduced object shape represented by the shape data of the three-dimensional shape data file with texture-related information 44 by the two-dimensional shape data generation unit 46, the two-dimensional shape data viewed from an arbitrary direction to be displayed on the CRT 20 is obtained. Generate. Of course, texture-related information is added to the two-dimensional shape data. The two-dimensional shape data with the texture-related information is provided to the texture mapping processing unit 48.

At this time, in the RAM 14 functioning as the work memory shown in FIG. 2, the texture image tables 50-1 to 50 corresponding to the number n of the already created projection planes stored in the texture image data file 36 are stored. −n is read and expanded. For this reason, the texture mapping processing unit 48 refers to the texture-related information for each polygon unit of the two-dimensional shape data, and uses the texture-related information to correspond to the corresponding texture image tables 50-1 to 50-50.
The texture pixel data group of the area corresponding to the projection polygon is read from any one of -n and the coordinate conversion from the two-dimensional coordinates (S, T) of the texture image table to the coordinates (X, Y) of the two-dimensional shape data Is performed, and the texture mapping is performed on the frame memory 18.

When such texture mapping is completed for all the polygons of the two-dimensional shape data, two-dimensional image data having substantially the same color and pattern as the original object after the texture mapping is obtained on the frame memory 18. , The reproduction object can be displayed on the CRT 20 with high quality. 20 and 21 are flowcharts of a series of multiple texture mapping processes from input of the three-dimensional image data shown in FIG. 4 to display of an object image by multiple mapping. First, in step S1, three-dimensional image data, which is an aggregate of polygon data Pi generated by the three-dimensional shape measuring device 22, is read from the three-dimensional image data file 30. In step S2, for example, as shown in FIG. On the other hand, projection surfaces 60-21 to 6 by an octagonal prism projection body
The setting of 0-28 is performed.

Subsequently, in step S3, a projection plane counter J indicating the number of projection planes and a polygon counter I indicating the number of polygons of the target object are each set to 1, and a step is performed based on the projection plane counter J and the polygon counter I. S4 ~
In S7, projection processing and generation of texture image data are performed.
That is, in step S4, the vertex information of the polygon currently being processed is projected onto the projection surface specified by the projection counter J, and data of the vertex Pi of the projection polygon is generated.

Subsequently, in step S3, data necessary for the texture vertex pixel from the projection vertex Pi, that is, the ST coordinate position,
Create color data and store it in the texture image table. Subsequently, in step S6, texture pixels, that is, color data of an area surrounded by the texture vertex coordinates Pi are generated by interpolation and stored in the texture image table. Further, in step S7, the distance d from the projection plane to the object plane is calculated for each vertex and stored in the texture image table.

Subsequently, it is checked in step S8 whether or not the polygon is the last polygon. If not, the polygon counter I is incremented by one in step S9.
The processing from step 4 is repeated. If it is the last polygon, the process proceeds to step S10, where it is checked whether it is the last projection surface. If it is not the last projection surface, the polygon counter I is determined in step S11.
Is initially set to I = 1, the projection plane counter J is incremented by one in step S12, and the processing from step S4 is repeated again for a new projection plane.

If it is determined in step S10 that the projection plane is the final projection plane, the process proceeds to step S13 and subsequent steps in FIG. In step S13, the reduced three-dimensional shape data is obtained from the three-dimensional shape data file 42 generated by the three-dimensional shape data reduction processing unit 40 of FIG. 4 performed in parallel with the creation of the texture image table. In step S14, the projection plane counter J and polygon counter I are read.
Are initially set to 1 respectively, and then steps S15 to S2
4 is performed.

In this texture-related information generation processing, first, in step S15, the projection plane designated by the projection plane counter J is read, and in step S16, the presence or absence of projection of the polygon constituent plane designated by the polygon counter I is checked.
If there is projection, it is checked in step S17 whether or not the polygon constituent surface is projected without being hidden by other polygon constituent surfaces.

Whether or not this polygon constituent surface is hidden by another polygon constituent surface is determined by determining the actual distance between the object polygon and the projection polygon by the storage distance d of the texture image data corresponding to the projection polygon of the constituent surface. In comparison, if they match within a predetermined error range, it is determined that the projection plane is an appropriate projection plane that is not hidden by other constituent surfaces and is projected. Then, in step S18, the intersection θ _IJ between the intersection of the normal vector of the polygon object surface and the polygon projection surface is calculated, and in step S1
9, the already calculated intersection angle θ on another projection plane
Compare with _IJ and check if the value calculated this time is the maximum.

If this time is larger than the previous intersection angle, the optimum projection plane is updated to the projection plane specified by the current projection plane counter J in step S20. Then step S
It is checked at 21 whether or not the projection plane is the final projection plane. If it is not the final projection plane, the projection plane counter J is incremented by one at step S22, and the processing from step S15 is repeated. Through the processing in steps S15 to S21, one of the optimal projection planes for the polygon currently being processed is selected as the optimal projection plane.

Subsequently, in step S23, related information indicating the correspondence between the polygon Pi and the projection polygon on the texture image table of the selected optimum projection plane, specifically, the projection of the texture image table corresponding to the polygon vertex coordinates. The ST coordinates of the polygon are added as related information. Subsequently, in step S24, it is checked whether or not the polygon is the final polygon. If the polygon is not the final polygon, the polygon counter I is incremented in step S25. Then, in step S26, the projection plane counter J is initialized to J = 1. The generation of the texture-related information from S16 is repeated.

If the generation of the texture-related information has been completed for all the polygons in step S24 and it is determined that the polygon is the final polygon, the process proceeds to step S27, where the three-dimensional shape data with the texture-related information set at that time is used. Two-dimensional image data is generated by viewing the represented reproduction object from an arbitrary direction. Then, texture mapping is performed on each polygon of the two-dimensional image data on the frame memory 18 by multiple mapping by referring to a plurality of texture image tables based on the texture-related information added to the image data. The completed two-dimensional data is output and displayed on the CRT 20.

The processing of adding the texture-related information to the three-dimensional shape data based on the texture image data by setting a plurality of projection planes in steps S1 to S24 in FIG. 21 is completed, and the three-dimensional shape data with texture-related information in FIG. If the file 44 can be created, thereafter, only display processing by ordinary computer graphics based on multiple mapping of a two-dimensional image of the reproduced object viewed from an arbitrary direction by the CG processing unit 45 will be performed.

From this, the system configuration for the multiple mapping processing of the present invention includes the processing from creation of the three-dimensional shape data file 44 with texture-related information by the three-dimensional shape measuring device 22 in FIG. Of the CG processing unit 45 can be physically separated.
The processing up to the creation of the first half of the three-dimensional shape data file 44 with texture-related information is handled by the maker such as a soft house, and the texture image data file 36 and the three-dimensional shape data with texture-related information that can be created by the maker By providing the file 44 to the user through a storage medium such as a CD-ROM magnetic tape or a floppy disk or a communication line such as the Internet, the user can provide an image display by the multiple mapping of the present invention only by providing the function of the CG processing unit 45 realizable.

Further, in the embodiment of the present invention, in order to reduce the load of coordinate calculation at the time of texture mapping in the CG processing unit 45, texture-related information generation is performed on three-dimensional shape data whose data amount is reduced. The unit 38 generates three-dimensional data with texture-related information.
In the case where a powerful graphics accelerator having a high processing capability can be provided as the G processing unit 45, texture-related information generation is performed on the three-dimensional shape data of the three-dimensional image data file 30 obtained directly from the three-dimensional shape measuring device 22. The unit 38 may add texture-related information.

FIG. 22 shows eight projection planes 60-1 to 60-1 serving as the hexagonal prism projection body 56 shown in FIG. 6 for a human fossil specimen.
It is an example of eight texture images created by the setting of 60-8. Of course, the actual texture image is a full-color display representing the color of the fossil specimen. This figure 2
The texture-related information is generated for the three-dimensional shape data of the fossil sample whose data amount has been reduced with respect to the eight texture images of No. 2 and the two-dimensional sample viewed from any direction with respect to the three-dimensional shape data with texture-related information When setting and performing multiple mapping, for example, computer graphics images of a fossil specimen viewed from four different directions shown in FIG. 23 can be displayed on a CRT, and colors are mapped to almost the same complex shape as an actual fossil specimen. The reproduced high quality image can be reproduced.

In actual sample display, for example, CRT
While performing multiple mapping in real time while rotating the fossil specimen horizontally on the screen, a reproduced image by high quality computer graphics can be obtained. Especially in the case of fossil specimens, there are complex shapes such as surface dropouts and holes at the bottom, but in the multiple mapping of the present invention, not only the surface that can be seen from the surroundings, but also Even the visible part can be accurately expressed by texture mapping, and even if it has a complicated shape, an almost same real object image can be reproduced by computer graphics without losing surface color data.

[0086] Although the above-described embodiment exemplifies a natural shaped object such as a fossil specimen of a person or a monkey having a complicated shape, the same applies to an industrial product having a complicated shape such as a camera or a video. Applicable, by measuring the model or finished product made during the product development with a 3D shape measuring device and importing it as 3D image data,
An image can be freely reproduced by computer graphics by the multiple mapping of the present invention.

The quality of the reproduced object image can be easily changed as needed by adjusting the number and position of the prepared projection planes and the size of the texture image table. . Furthermore, the present invention is not limited to the above embodiments, and appropriate modifications can be made without departing from the purpose and spirit of the present invention. The present invention is not limited by the numerical values shown in the above embodiments.

[0088]

As described above, according to the present invention, a plurality of projection planes are set around an object represented by three-dimensional image data, and a two-dimensional image obtained by projecting a plane on which the object can be seen is projected on each projection plane. Because a texture image is generated from the projected image, even if the object has a complicated shape, color, or pattern, such as a fossil specimen, the surface of the object image can be viewed from any direction without any information loss depending on the viewing direction. Can be accurately expressed by multiple texture mapping without missing color data, and a high-quality object image that is almost the same as a real object can be reproduced by computer graphics.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating the principle of the present invention.

FIG. 2 is a block diagram of a hardware configuration according to the present invention.

FIG. 3 is a flowchart of an overall process of the present invention.

FIG. 4 is a functional block diagram of the present invention.

FIG. 5 is an explanatory diagram of three-dimensional image data input by the three-dimensional shape measuring device.

FIG. 6 is an explanatory view of a projection plane using a hexagonal prism set according to the present invention.

FIG. 7 is an explanatory diagram of a projection plane using a tetrahedron set according to the present invention.

FIG. 8 is an explanatory view of a projection plane using an octagonal prism set according to the present invention.

FIG. 9 is an explanatory diagram of a correspondence relationship between an object and a projection plane according to the present invention.

FIG. 10 is an explanatory diagram of projection image data on a projection plane.

FIG. 11 is an explanatory diagram of an object polygon, a projection polygon, and a texture image table in the texture image creation processing of the present invention.

FIG. 12 is an explanatory diagram of a texture image table according to the present invention.

FIG. 13 is an explanatory diagram of a correspondence relationship between a projection plane and a texture image table according to the present invention.

FIG. 14 is an explanatory diagram of pixel interpolation processing in a texture image table.

FIG. 15 is an explanatory diagram of a specific example of setting a projection plane for an object;

FIG. 16 is an explanatory diagram of eight texture images obtained by setting the projection plane in FIG.

FIG. 17 is an explanatory diagram of a process of generating related information of a texture image according to the present invention.

18 is an explanatory diagram of a normal intersection angle between the object polygon of FIG. 17 and a plurality of projection polygons.

FIG. 19 is an explanatory diagram of three-dimensional shape data with texture-related information generated by the present invention.

FIG. 20 is a flowchart of a multiple texture mapping process according to the present invention.

FIG. 21 is a flowchart of a multiple texture mapping process of the present invention (continued).

FIG. 22 is an explanatory diagram of eight texture images created from a human fossil specimen.

FIG. 23 is an explanatory diagram of a fossil specimen reproduced by computer graphics using the texture image of FIG. 22;

FIG. 24 is a diagram illustrating the principle of texture mapping.

FIG. 25 is an explanatory diagram of conventional texture image generation using a cylindrical projection surface.

FIG. 26 is an explanatory diagram of conventional texture image generation using a two-dimensional rectangular plane.

FIG. 27 is an explanatory diagram of a process of generating a texture image by projecting polygons constituting an object plane onto a texture image table.

FIG. 28 is an explanatory diagram of a texture image created by setting the two-dimensional rectangular projection plane in FIG. 26;

FIG. 29 is an explanatory diagram of missing color data due to the overlapping of vertices that occurs when creating a conventional texture image.

FIG. 30 is an explanatory diagram of missing color data due to distortion of a polygon surface caused by creation of a conventional texture image.

[Explanation of symbols]

10: MPU 12: bus 14: RAM 16: graphics accelerator 18: frame memory 20: CRT 22: three-dimensional shape measuring device (image input unit) 24: external storage device 26: keyboard 28: pointing device 30: three-dimensional image Data file (3D image data file) 32: Projection image processing unit 34: Texture image creation unit 36: Texture image data file 38: Texture related information creation unit 40: Three-dimensional image data reduction processing unit (3D image data reduction processing unit) 42: 3D shape data file (3D shape data file) 44: 3D shape data file with texture related information 45: Computer graphics processing unit (CG processing unit) 46: 2D shape data generation unit 48: Texture mapping processing unit 50-1 to 50 n: texture image table 52, 86: vertex coordinates 54, 82, 86: color data 56: hexagonal prism projection 58: four-plane projection 60, 60-1 to 60-8, 60-11 to 60-14, 60 -21 to 60-28: projection plane 64: octagonal prism projection body 70: target object 72: object center 74, 102: polygon (object constituting plane) 76104-1 to 104-3: projection polygon 78: projection image data 84: Texture image table 85: Projection plane position 88: Distance to object surface 90-1 to 90-3: Vertex texture pixel 92: Interpolated texture pixel 100: Reproduced object shape 101-1 to 101-3: Projection lines 106, 108 -1 to 108-3: Normal vector 110: Texture related information

Claims (27)

[Claims] An image input unit for inputting three-dimensional image data including three-dimensional shape data and color data of a surface of a real object that can be visually recognized from the outside, and expressed by three-dimensional image data input from the image input unit A plurality of projection planes are set around the object to be projected, and a projection image processing unit that generates two-dimensional projection image data by parallel projecting a plane on which the object is visible on each projection plane, and two-dimensional projection image data of each projection plane A texture image creating unit that stores color data of the surface of the object and generates texture image data for each projection plane; and a three-dimensional shape data extracted from the image input unit. A texture-related information generation unit that generates three-dimensional shape data with texture-related information to which related information indicating a correspondence relationship with each texture image data is added; Generates two-dimensional shape data with texture-related information when the object represented by the three-dimensional image data with cha-related information is viewed from an arbitrary direction, and generates each of the projection planes based on the texture-related information of the two-dimensional shape data. A multi-texture mapping device, comprising: a texture mapping processing unit that maps texture image data created in the above to generate two-dimensional display data. 2. The multi-texture mapping apparatus according to claim 1, wherein the image input unit irradiates the surface of the object with a laser beam and optically measures a distance to the surface of the object to determine the surface shape and the shape of the object. A multiple texture mapping device, which is a three-dimensional shape measuring device for measuring color. 3. The multi-texture mapping apparatus according to claim 1, wherein said image input unit expresses the object surface as a set of minute polygons as three-dimensional shape data of the object surface. A multiple texture mapping device, wherein the polygon includes vertex coordinates and color data of each vertex. 4. The multiple texture mapping device according to claim 3, wherein said polygon polygon is a triangular polygon, and includes coordinates of three vertices and R, G, B color component information of each vertex. Texture mapping device. 5. The multiple texture mapping device according to claim 3, wherein the projection image processing unit is configured to perform a plurality of projections so that all observable parts can be projected in a predetermined observation area set outside the object. A multiple texture mapping apparatus, characterized by setting a surface. 6. A multiple texture mapping apparatus according to claim 5, wherein said projection image processing section sets a plurality of projection planes so that all of the portions observable from outside the object can be projected. Multiple texture mapping device. 7. The multiple texture mapping apparatus according to claim 5, wherein the projection image processing unit sets the projection plane so that a normal from an arbitrary point on the projection plane passes through the center of the object. A multiple texture mapping device, wherein the multiple texture mapping device is set around 8. The multiple texture mapping apparatus according to claim 1, wherein the texture image creating section has, for each texture pixel, a storage area for each of a position of a projection plane, color data, and a distance to an object surface. A texture image table, wherein color data and a distance to the object surface are generated and stored for each pixel position of the mapping of the object surface to the projection plane. 9. The multiple texture mapping device according to claim 8, wherein the texture image creating section projects vertex coordinates on a projection plane for each polygon of the object and outputs color data for each vertex position. Is generated and stored, and then the color data of the texture pixels existing in the area surrounded by each vertex is
A multi-texture mapping apparatus characterized by being generated and stored by interpolation processing based on information of each vertex. 10. The multiple texture mapping device according to claim 8, wherein the texture image creating section provides flag information indicating that the texture pixel data is valid, and sets the flag information at a pixel position based on the projection plane mapping. A multiple texture mapping device, wherein the flag information is turned on when color data is stored. 11. The multiple texture mapping device according to claim 10, wherein the texture image creating section uses an alpha value provided in an RGB data structure as flag information indicating that the texture pixel data is valid. A multi-texture mapping apparatus characterized in that it is used. 12. The multiple texture mapping apparatus according to claim 8, wherein the texture image creating section normalizes the positions of the texture pixels in the texture image table and sets the texture pixels as texture two-dimensional coordinates (S, T). A multi-texture mapping apparatus for converting the normalized coordinates into the size of the projection plane and the three-dimensional object coordinates (S, T, PZ) when the projection plane is set. 13. The multiple texture mapping device according to claim 1, wherein the texture-related information generating unit extracts three-dimensional shape data from three-dimensional image data from the image input unit, and converts the three-dimensional shape data into the three-dimensional shape data. A multi-texture mapping apparatus, characterized in that the three-dimensional image data with texture related information is generated by adding information related to the texture image data generated by the texture image generating unit. 14. A multiple texture mapping apparatus according to claim 13, wherein said texture related information generating section comprises:
The position coordinates (Si, Ti, PZi) of the corresponding texture pixel data are added to the vertex coordinates (Xi, Yi, Zi) of the polygon representing the three-dimensional shape of the object, and the three-dimensional image with texture-related information is added. A multiple texture mapping device for generating data. 15. The multiple texture mapping device according to claim 14, wherein the texture related information generation unit comprises:
When a projection plane on which a polygon representing the three-dimensional shape of the object is projected is determined, and a plurality of projection planes are determined,
A multiple texture mapping apparatus, wherein an optimum projection plane is selected and information relating to the texture image data is added to a polygon on the surface of the object. 16. The multiple texture mapping apparatus according to claim 15, wherein said texture related information generating section comprises:
When determining a plurality of projection planes on which the polygon polygon is projected, it is determined whether the polygon polygon is projected without being hidden by other polygon polygons, and the projection plane that is projected without being hidden is determined. A multiple texture mapping device, characterized in that it is selected. 17. The multiple texture mapping apparatus according to claim 16, wherein said texture related information generating section comprises:
Whether or not the polygon polygon is projected without being hidden by other polygons is compared with the distance to the object surface included in the texture image data and the actually calculated distance to the object surface, A multi-texture mapping apparatus characterized in that when both coincide with each other within a predetermined error range, the selected texture plane is selected as a projection plane projected without being hidden by another polygon. 18. A multiple texture mapping apparatus according to claim 17, wherein said texture related information generating section comprises:
When a plurality of projection planes onto which the polygon is projected are determined, the normals of the polygon and the projection polygon are compared, and the projection plane having the maximum intersection angle is selected as the optimal projection plane. Multiple texture mapping device. 19. The multi-texture mapping apparatus according to claim 1, further comprising: reducing a data amount of the three-dimensional original image data extracted from the image input unit and supplying the reduced data amount to the texture-related information generating unit. A multiple texture mapping device comprising a shape data reduction processing unit. 20. A multi-texture mapping apparatus according to claim 19, wherein said three-dimensional shape data reduction processing section converts a polygon representing a three-dimensional shape of said object into:
A multi-texture mapping apparatus, wherein the data amount of the three-dimensional shape data is reduced by combining the three-dimensional shape data into larger polygons. 21. A multi-texture mapping apparatus according to claim 14, wherein said texture mapping processing section specifies a texture specified by texture coordinates (Si, Ti, PZi) added as related information to the two-dimensional shape data. A multiple texture mapping apparatus, which reads out a pixel data group and texture-maps the two-dimensional shape data to generate two-dimensional display data. 22. An image inputting step of inputting three-dimensional image data including three-dimensional shape data and color data of a surface that can be visually recognized from the outside of a real object, and expressed by three-dimensional image data input from the image inputting step. A plurality of projection planes are set around the object to be projected, and a projection image processing step of generating two-dimensional projection image data by parallel projecting a plane on which the object is visible on each projection plane, and two-dimensional projection image data of each projection plane A texture image data creation step of storing color data of the object surface for each projection plane to generate texture image data, and a three-dimensional shape data extracted from the image input step to the texture image data creation step. A texture function for generating three-dimensional shape data with texture related information to which related information indicating a correspondence relationship with texture image data for each projection plane is added. An information generating step, and generating two-dimensional shape data with texture-related information when the object represented by the three-dimensional shape data with texture-related information is viewed from an arbitrary direction, based on the texture-related information of the two-dimensional shape data A texture mapping processing step of mapping the texture image data created for each of the projection planes to generate two-dimensional display data. 23. An image inputting step of inputting three-dimensional image data including three-dimensional shape data and color data of a surface of a real object that can be visually recognized from the outside, and expressed by three-dimensional image data input from the image inputting step. A plurality of projection planes are set around the object to be projected, and a projection image processing step of generating two-dimensional projection image data by parallel projecting a plane on which the object is visible on each projection plane, and two-dimensional projection image data of each projection plane A texture image creating step of storing color data of the object surface for each projection plane and generating texture image data for each projection plane; and three-dimensional shape data extracted from the image input step, each projection plane created in the texture image creation step. Generation of texture-related information to generate three-dimensional shape data with texture-related information to which related information indicating a correspondence relationship with each texture image data is added. Multiple texture mapping method characterized by comprising and. 24. The multi-texture mapping method according to claim 22, wherein the three-dimensional shape data extracted from the image input step is reduced in data amount and supplied to the texture-related information generating step. A multiple texture mapping method comprising a data reduction process. 25. An image input unit for inputting three-dimensional image data including three-dimensional shape data and color data of a surface that can be visually recognized from the outside of a real object, and represented by three-dimensional image data input from the image input unit. A plurality of projection planes are set around the object to be projected, and a projection image processing unit that generates two-dimensional projection image data by parallel projecting a plane on which the object is visible on each projection plane, and two-dimensional projection image data of each projection plane A texture image creating unit that stores color data of the surface of the object and generates texture image data for each projection plane; and a three-dimensional shape data extracted from the image input unit. A texture-related information generating unit that generates three-dimensional shape data with texture-related information to which related information indicating a correspondence relationship with each texture image data is added; Generates two-dimensional shape data with texture-related information when the object represented by the three-dimensional shape data with texture-related information is viewed from any direction, and for each of the projection surfaces based on the texture-related information of the two-dimensional shape data And a texture mapping processing unit for mapping the created texture image data to generate two-dimensional display data. A storage medium storing a program for multiple texture mapping. 26. An image input unit for inputting three-dimensional image data including three-dimensional shape data and color data of a surface that can be visually recognized from the outside of a real object, and expressed by three-dimensional image data input from the image input unit. A plurality of projection planes are set around the object to be projected, and a projection image processing unit that generates two-dimensional projection image data by parallel projecting a plane on which the object is visible on each projection plane, and two-dimensional projection image data of each projection plane A texture image creating unit that stores color data of the surface of the object and generates texture image data for each projection plane; and a three-dimensional shape data extracted from the image input unit. A texture-related information generating unit that generates three-dimensional shape data with texture-related information to which related information indicating a correspondence relationship with each texture image data is added. Storage medium storing a program for multiple texture mapping, wherein. 27. A storage medium storing a program for multiple texture mapping according to claim 25 or 26, wherein the data amount of the three-dimensional shape data extracted from the image input unit is reduced to obtain the texture-related information. A storage medium storing a program for multiple texture mapping, comprising a three-dimensional shape data reduction processing unit to be supplied to a generation unit.