JP3453410B2 - Image processing apparatus and method - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a computer graphics image processing apparatus and method, and more particularly to a computer graphics animation in which a plurality of objects in a three-dimensional space are independently texture-animated. The present invention relates to an image processing apparatus and method for realizing CG animation).

[0002]

2. Description of the Related Art Conventional computer graphics, particularly three-dimensional graphics for forming an image representing a three-dimensional object, are roughly divided into two parts in order to obtain a normal image. Becomes

First of all, modeling is an operation of creating in a computer data such as the shape, color and surface property of an object to be expressed in an image. For example, if you are making an image of a human face, create data such as what the surface shape is, what part of the face is what shape, and what the light reflectance is. Then, store it in the computer in a format that can be used for later rendering. Such a collection of data is called an object model.

Rendering refers to creating an image according to the appearance of the object after considering the appearance of the object when viewed from a certain position. So to render,
In addition to the model, it is necessary to consider the conditions for viewing position (viewpoint) and lighting. The rendering work is subdivided as follows.

Coordinate conversion, hidden surface removal, shading, and a device for producing realism First, coordinate conversion is performed on the screen when viewed from the viewpoint position with respect to various coordinate values representing the model. It means calculating the position where it looks and converting it to the coordinates on the screen. Next, by hidden surface removal, it is determined from the current viewpoint position in the model which part is visible and which part is not visible. Algorithms such as the Z-buffer method and the scanline method are typical methods of hidden surface removal. Then, after the hidden surface removal is completed and it is decided which part of the object can be seen, the next step is to consider the lighting to determine what color and how bright each part looks like, and display that color on the screen. That is, the shading process of painting the pixels is performed. And, what is usually executed at the end of rendering is a device for giving realism. This is because even if an image is created by changing the field of view, hidden surface removal, and shading, the obtained picture (image) is far from the real object and has no interest. The reason for this is that such a method is based on the assumption that the surface of an object is an ideal plane or a perfectly smooth curved surface that can be expressed by a mathematical expression, or that the surface color is constant for each surface. is there. Texture mapping is one of the typical methods performed in order to avoid such a situation and make the obtained image more realistic. Texture mapping is a method in which a two-dimensional pattern prepared in advance is pasted onto the surface of an object model in three-dimensional space (mathematically speaking, mapping). An object composed of a monotonous surface is converted into an object having a complicated surface. The purpose is to make it appear pseudo. This allows, for example, a simple rectangular parallelepiped model to look like metal or stone.

When creating a computer graphics animation (CG animation) in which a picture is given a motion by the above-described method, it is roughly classified into the following two methods.

The first method is to place in a three-dimensional space, lighting conditions, viewpoint conditions (viewpoint position / direction / angle of view),
After gradually changing the shape and color of the object model and rendering each time to obtain a series of images for animation (or each time one image is rendered), record them with a video recorder, etc. This is a method of recording one frame at a time using the device (frame recording), and playing back on the playback device after all recording is completed. With this method, the time it takes to render an image may be as long as is allowed (depending on the time it takes to render one image and the total time of the animation to be created), so that it may be complicated on the screen. It is also possible to arrange a large number of shaped objects or create a high-quality image by using a rendering method that requires a long calculation time, as represented by ray tracing (ray tracing method). For example, most of the CG images used in current television commercials and SF movies are created by this method.

As a second method, two processes of rendering while changing the illumination condition, the viewpoint condition, and the shape and color of the object model, and displaying the image obtained by the rendering process are performed. There is a method of executing CG animation by repeating at high speed. This is generally called real-time CG animation, and interactively controls the movement of the CG animation in real time by directly reflecting the instructions from the user on the rendering.
The greatest feature is that it can be processed. On the other hand, resides Yi to the computer running performance with respect to realization, or there is a limit to the number of objects that can be displayed on a screen,
Since there is a limitation that the rendering method is limited to a simple and high-speed rendering method, the image created compared to the former is of low quality. Flight simulators for practicing aircraft pilots and racing games for arcades are good examples.

[0009]

However, the texture mapping to the object in the rendering image in the computer graphics device described in the above-mentioned conventional example is mainly for imitating the material feeling and the feel of the object that actually exists. Since it is being performed, the visual change of the texture during the progress of the CG animation is only a subtle change of the color due to the change of the viewpoint condition and the ray condition, and the shape and color of the texture dynamically change. CG animation with texture animation that emphasizes art has not been realized.

In addition, when the number of input texture images is small, the limited images are mapped to a plurality of objects, so that the obtained CG animation image is monotonous and uninteresting. there were.

[0011]

SUMMARY OF THE INVENTION The present invention is intended to solve the above-mentioned problems, and in particular, a plurality of objects existing in a three-dimensional space are each provided with a texture animation state value, and animation is performed. It is an object of the present invention to provide an image processing apparatus and method for realizing a CG animation that is full of unprecedented art by changing the texture animation state value during the progress and executing an independent texture animation for each object. To do.

In order to solve this problem, the image processing apparatus of the present invention has the following configuration. That is, 3 of the object
A data input means for performing modeling by inputting a dimension shape data, an image input unit for inputting the texture image data, texture image de entered in said image input means
Used when performing a predetermined animation process on the data
State value input means for inputting a state value to be set as an initial value,
The state value input by the state value input means is set as the state value.
Status value update procedure that updates based on the specified change speed information
The texture image is processed based on the step and the state value.
Image processing means and a test generated by the image processing means.
The texture image is textured on the surface of the three-dimensional shape data.
Image with texture mapping
An image generation unit that generates an image and an image display unit that displays the generated image are provided.

The image processing method of the present invention includes the following steps.

[0014] and a data input step for modeling by inputting a three-dimensional shape data of the object, an image input step of inputting texture image data, input by said image input step
The specified animation for the texture image data
Input the state value to be used when performing the
State value input step and the state input in the state value input step
The value is based on the change speed information set by the state value.
Based on the status value updating process and the status value to be updated ,
An image processing step of processing the Kusucha image, the image processing Engineering
The texture image generated by
Texture by performing texture mapping on the data surface
An image generation step of generating a mapped image and an image display step of displaying the generated image are provided.

[0015]

[0016]

First, in order to clarify the features of this embodiment, a flow of processing from modeling of a three-dimensional solid adapted to the embodiment to image rendering and further to display of a generated image by the rendering will be described.

<1. Modeling> First, modeling of a three-dimensional object will be described.
This is to make your Keru input three-dimensional shape data of the object in the modeling coordinate system. However, the modeling coordinate system is a coordinate system for defining and manipulating the shape of an object. For example, when modeling the shape of a cube as shown in FIG. 2, consider a modeling coordinate system in which one vertex of the illustrated cube is the origin. Then, the coordinate data (x, y, z coordinates) of the eight vertices of the cube in this coordinate system are determined as follows, for example.

Table 1 <Coordinate data> (Numbers of vertices are assigned in order from the top) 8 ... Number of all vertices 0.0 0.0 0.0 1.0 1.0 0.0 0.0 0.0 1.0 1. 0 0.0 ... (x, y, z) coordinates of each vertex 0.0 1.0 0.0 0.0 0.0 0.0 -1.0 1.0 0.0 -1.0 1.0 1.0-1.0 0.0 1.0-1.0 As shown in Table 1 above, each vertex (vertices 1 to
The coordinate data of 8) is input.

Next, the surface loop data such as which point is connected to which point to form a surface is determined as shown in the following table.

Table 2 <Surface Loop Data> 6 ... Number of faces forming object 4 ... Number of vertices forming first face loop 1 2 3 4 ... 1st face vertex number sequence 4 ... Number of vertices forming second surface loop 5 6 7 8 4 ・ 4 3 7 8 ・ 4 ・ 1 5 8 4 ・ 4 ・ 1 2 6 5 4 ・ ・ ・ Forming sixth surface loop Number of vertices 2 6 7 3 ... Vertex number sequence of sixth surface A set of coordinate data and surface loop data obtained in this way becomes modeling data of the object in FIG.

<2. Rendering> -Projection conversion After modeling the three-dimensional shape of the object, projection conversion is performed next. When compared to photography, it corresponds to selection of a lens (focal length = magnification), shooting location (viewpoint), and orientation of camera (visual axis).

FIG. 3 is a diagram showing four coordinate systems for projection conversion. First, the shape data of the object defined in the modeling coordinate system is converted into data in the world coordinate system (the coordinate system used for the coordinates in the model when representing the shape of the object). Then, the viewing conversion (field of view conversion) is performed by pointing the selected camera in various directions so that the target object can be viewed. At this time, the data of the object represented by the world coordinate system is converted into the data of the viewpoint coordinate system. Also, a screen (view window) is specified in the world coordinate system for this conversion, and this screen becomes the final projection plane of the object.
And the coordinate system for defining this screen is UV
It is called the N coordinate system (screen coordinate system). However, drawing everything in front of the viewpoint may take unnecessary calculation time, so it is also necessary to determine the drawing area (this drawing area is called the view volume (view space). Is called clipping).

Next, the projection conversion will be described in more detail. FIG. 4 is a diagram showing the projection conversion. In the figure, first, a viewpoint as the center of projection is placed in a space, and a visual axis (a half line extending from the viewpoint toward the direction in which a person is looking) and a visual angle (angle of view) θ are considered. When a plane orthogonal to the visual axis and having a distance f from the viewpoint is considered as a projection surface (screen), the intersection of the projection surface and the view cone (the conical surface having the view axis as the axis) is circular. Are doing Then, as shown in the figure, consider a rectangular area having four vertices on this arc and having a horizontal length of h and a vertical length of v, and this area is used as a screen.

Now, consider a method of calculating h and v from θ and f. However, it is assumed that the ratio of h and v is the same as the horizontal and vertical ratios of the display image. In the figure, first, OE is the radius of the above-mentioned circular portion, so ∠OPE = θ / 2 (Equation-0), and as a result, len (OE) = f * tan (θ / 2) (Equation-1) Further, since the point O is the middle point of EG, using the above equation, len (EG) = 2 * len (OE) = 2 * f * tan (θ / 2) (Equation-2). Next, let the horizontal and vertical pixel numbers of the display image be a
And b are known, the two ratios are the same as the ratios of h and v, so that a: b = h: v (equation-3). Further, according to the Pythagorean theorem, h * h + v * v = len (EG) * len (EG) (Equation-4) Therefore, from (Equation-2), (Equation-3), (Equation-4), h = 2 * f * tan (θ / 2) / sqrt (1+ (a / b) * (a / b)) (Equation-5) v = 2 * f * tan (θ / 2) / sqrt (1+ (b / a) * (b / a)) (equation-6).

In the above equation, len (AB) is a function that returns the length of the line segment AB, and sqrt (x) is a function that returns the square root of x. The contents thereof need not be described. Let's do it.

The visual field is converted by moving the screen in various directions. Then, after the visual field conversion is determined, an operation for obtaining the intersection of the viewpoint and the projection surface is performed for each point of the three-dimensional shape of the object existing in the space to obtain the projection diagram on the screen as shown in FIG. 4 ( However, in this case, the projection shows a finite distance between the viewpoint and the projection surface). Therefore, when the projection conversion is performed, the data expressed in the above-mentioned viewpoint coordinate system is converted into the data in the UVN coordinate system.

After this projection conversion, the figure shown by the UVN coordinate system is converted into the final device coordinate system and displayed on the display device. However, the device coordinate system is
The coordinate system used to represent the positions of pixels and dots in the image is the same as the coordinate system in the display image.

How to actually implement the coordinate conversion described above will be described using mathematical expressions.

First, in the world coordinate system which is set so that the XZ plane is horizontal and the Y axis is vertical, the position and direction of the viewpoint and the target object are determined. The x-axis of the viewpoint coordinate system is parallel to the visual axis, and the y-axis is U of the UVN coordinate system.
Set to be parallel to the axis. Here, the coordinates of an arbitrary point P in the world coordinate space are represented by (X, Y, Z). The coordinates of the viewpoint are (Xe, Ye, Ze), the azimuth angle (horizontal angle) in the world coordinate system is α, the elevation angle (vertical angle) is β, and the coordinates of the point P in the viewpoint coordinate system are (x, y, Ze). z), the following relationship is established between them.

[0030]

[Equation 1] The projection plane on which the three-dimensional solid is projected is assumed to be perpendicular to the x axis of the viewpoint coordinate system, and the viewing distance is f as described above.
Then, the coordinates (x ′, y ′) of the point P ′ obtained by projecting the point P in the space on the UV plane which is the projection surface are as follows: x ′ = − f · (x / z) y ′ = −f · (y / z)

Image generation and display, and finally the screen area in the UV plane (see FIG. 5).
A) is converted into a column of pixels in the display image (device coordinate system), and the point on the display image corresponding to the point P ′ on the screen at that time is P ″ as shown in FIG. 5B. (X ″, y ″), the coordinate values x ″ and y ″ are given by x ″ = a · x ′ / h + a / 2 y ″ = by · y ′ / v + b / 2 To be However, h and v are the horizontal and vertical lengths of the screen, respectively, and a and b are the horizontal and vertical pixel numbers of the display image (device coordinate system), respectively.

Then, using this coordinate transformation, points on the screen (sample points) corresponding to the pixels in the final output image are considered, first the sample points contained in the object are searched, and the corresponding display is performed. By painting the pixels in the image onto the object at that point with the color values of the texture, the object transformed into the UVN coordinate system is transformed into the final column of pixels of the secondary image. When drawing a plurality of objects by such a method, an area (Z buffer) for storing depth information is provided for each pixel of the display device, and the depths of a plurality of objects are compared using this area to hide the objects. A method of erasing a surface (hidden surface erasing method) is generally used.

<3. CG Animation Processing> Hereinafter, the CG animation processing in the embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 shows a computer graphics device according to an embodiment of the present invention.

In the figure, 2 is the start of CG animation processing, selection of texture to be mapped to an object,
And a command input device for giving instructions such as selection of texture animation and change of texture animation state value during execution of CG animation processing,
For example, a keyboard is used.

Reference numeral 3 denotes a data input device for inputting modeling data of the object, initial values such as viewpoint conditions, and for example, a mouse is used.

Reference numeral 4 denotes an image input device for inputting a texture image, for example, a drum scanner is used.

Reference numeral 5 is a photographing device for photographing a texture image, and for example, a camera is used.

Reference numeral 6 denotes an arithmetic unit for updating various variables, modeling data of objects, viewpoint conditions, rendering processing of a display image by a texture image after image processing, and the like.

Reference numeral 7 is modeling data of the object, viewpoint conditions,
And a file device that stores various data such as animation variables (hard disk, magneto-optical disk device, etc.)
Is.

Reference numeral 8 denotes a display device for displaying the display image generated by the rendering process, for example, C
An RT monitor is used.

Reference numeral 9 denotes an image processing apparatus 1 for generating an image obtained by subjecting a two-dimensional image to a mosaic process described later.

Reference numeral 10 denotes an image processing device for generating an image in which a color conversion process, which will be described later, is similarly applied to a two-dimensional image.

Reference numeral 11 denotes a viewpoint input device for inputting the movement of the viewpoint position and the change of the azimuth angle and elevation angle of the viewpoint.
For example, a space ball is used. The space ball generally has a shape as shown in FIG. 6A, and is a device for detecting movement in an arbitrary direction and rotation about an arbitrary axis by subtly moving the spherical portion. . In the present embodiment, as shown in FIG. 6A, when the center of the ball moves in a certain direction, X, Y, and Z movement amount components Dx, Dy, and Dz of the movement vector are output. When the ball rotates about a certain axis as in 6B, the rotation amount components Dα and Dβ of the azimuth angle and the elevation angle are output.

Reference numeral 1 is a control device, which is a command input device 2, a data input device 3, an image input device 5, an arithmetic device 6,
The file device 7 and the display device 8 are controlled. In addition, the control device 1 has a memory (not shown), and loads and executes an OS (operating system) stored in advance in the file device 7 and a program according to the flowcharts of FIGS.

With respect to the computer graphics device constructed as described above, in this embodiment, the real time C
The case of G animation will be described according to the flow of data.

First, the user presses a key on the keyboard which is the command input device 2 to start the CG animation processing. Next, the system waits for the input of shape data, and the user inputs the shape data of multiple objects using the coordinate values in the system modeling coordinate system (the modeling coordinate system is assumed to match the world coordinate system). Model the shape of the object. Next, the viewpoint conditions (viewpoint coordinates,
Viewing angle (angle of view), elevation angle, azimuth angle, distance to screen)
Is initialized. Next, referring to FIG.
The input image for texture, for example, the input image of landscape photographed by is subjected to A / D (analog / digital) conversion by the image input device 4 and stored in the file device 7. Here, for convenience, the red, green, and
The blue data are represented by R, G, and B, respectively. In addition, one pixel is data that can be expressed by each component of 8 bits, that is, 256 gradations, and the maximum luminance is 255 and the minimum luminance is 0, but the present invention is not limited to this. In this embodiment, the number of vertical and horizontal pixels of the input image is determined by the image reading pitch designated by the control device 1 when the image is input. Next, the user selects a texture animation to be mapped for each of the plurality of modeled objects from the pre-registered animation processing group. Then, the initial state value of the texture animation designated for each object is input. When all the values have been initialized, the CG animation start wait state is entered, and the CG animation starts when the user issues a start command. Then, a command acceptance check from the user is performed next. At this time, if there is no command from the user, image rendering processing and display are performed by the above method based on the viewpoint condition and the texture animation state value as they are. However, even if the viewpoint condition does not change, the texture animation on the object changes while maintaining the initial state (according to the state value indicating the speed of the texture animation). On the contrary, if the user gives an instruction to change the viewpoint condition and the texture animation state value, the image is rendered and displayed according to the change. Similarly, in the command reception check, if an instruction to end the CG animation is issued, the CG animation processing ends.
In the image rendering process of this embodiment, the shading described in the conventional example is not particularly mentioned, but the present invention is not limited to this.

Two image processing methods (mosaic processing and color conversion processing) in this embodiment will be described.

First, the mosaic processing in this embodiment will be described. In the mosaic processing, as shown in FIG. 7, the image is divided into square areas each having a certain number of pixels (the number of unit pixels) as one side, and all the pixels included in each area are included in a certain area in the area. This refers to the process of replacing with the color value of a pixel (representative pixel: in the figure, the leftmost point colored in gray in the square area). However, division is performed with the upper left point of the image as the reference point, and if the length of one of the areas that touches the right edge and the lower edge of the image is less than the unit pixel, the rectangular area that can be formed in that case is similarly used as the representative pixel. It will be filled with color.

The color conversion process in this embodiment is
It is the process of setting the amount of change for each color of R, G, B and adding (or subtracting) the amount of change of the corresponding color to each value of R, G, B of all pixels in the image. is there. However, if the new value obtained by this addition (or subtraction) is smaller than 0, the new value is set to 0, and if it is larger than 255, the new value is set to 25.
It shall be 5. Here, the color of the i-th pixel of the image composed of N pixels is (Ri, Gi, Bi) (i =
1, ..., N), and the change amount of each color of RGB is SR, S
Given G and SB, this color conversion processing is given by the following equation.

Ri ← Ri + SR Gi ← Gi + SG (i = 1, ..., N) Bi ← Bi + SB The image processing apparatus described above is used in the following CG animation processing.

Next, the texture mapping method in this embodiment will be described.

FIG. 8 is a diagram showing perspective coordination (projection coordination), which is a typical method of texture mapping on an object in space. First, a point P that is the center of projection is placed in the space, and a quadrangular pyramid P-
Consider ABCD (provided that a quadrangle ABCD is a rectangle). Further, the intersection of two diagonal lines of the quadrangle ABCD is M. Then, a plane g perpendicular to PM is placed between the point P and the object, and a rectangular area where this plane cuts a quadrangular pyramid is defined as A'B'C'D '. Also, the square A '
The intersection of two diagonal lines of B'C'D 'is M'. Here, the area representing the texture image is EFGH, and
Let M ″ be the intersection of the two diagonal lines of H. Then, M '' is overlaid on M ', and the texture EFGH is a square A'B'C'.
D'is arranged so as to completely surround it, and projection from the point P is performed to map a part of the texture on the object (in the figure, "M" drawn on the texture is mapped to the surface of a spherical object. ing). For example, when a spherical object subjected to texture mapping as shown in FIG. 8 is viewed under a certain viewing condition, the image projected on the screen is as shown in FIG. 11A, and viewing is performed under a viewing condition different from that. The image projected in this case is as shown in FIG. 11B.

In the following description, for the sake of simplicity, only an object consisting of one plane is used, but the present invention is not limited to this.

The texture mapping method described above is used in the following CG animation processing.

Next, the CG animation processing in this embodiment will be described.

FIG. 9 is a flow chart showing the CG animation processing in this embodiment.

The processing method will be described in detail below according to the flow of data.

<Description of Step S1> 1-1 The user inputs the coordinate data of the quadrangle. At this time,
The control device 1 displays a message "Please input the rectangular coordinate data.->" On the display device 8, prompts the user to input from the command input device 2, and waits for the input.

Here, the user uses the keyboard to follow this message, for example, "4 1.0 0.0 0.0 2.0 0.0 0.0 2.0 1.0 0.0 1.0 1.0 1.
Type 0 0.0 ”and press the return key at the end to store these numerical data as square coordinate data in the file device 7 (space becomes a delimiter). However, the first of these numerical data Is the number of vertices of the quadrangle, and the second to fourth, the fifth to the seventh, the eighth to the tenth, and the eleventh to the thirteenth set of numerical values are the vertices of each quadrangle. The x, y, z coordinates are shown.

1-2 Next, the user inputs square surface loop data. That is, the control device 1 inputs the “quadrilateral surface loop data to the surface device 8.
The message ">" is displayed, and the keyboard which is the command input device 2 is placed in a command input waiting state. Here, the user types "1 4 1 2 3 4" in order to respond to this display from the keyboard, Finally, the return key is pressed, whereby these numerical data are stored in the file device 7 as square surface loop data, provided that among these numerical values,
The first numerical value indicates the number of faces forming the object, the second numerical value indicates the number of vertices forming the surface loop, and the third to sixth numerical values indicate the vertex number sequence of the quadrangular surface.

1-3 Next, the user inputs the coordinate data of the triangle. That is, the control device 1 displays the following message on the display device 8 and prompts the command input device 2 to make an input.

“Enter the coordinate data of the triangle. --->” In response to this, the user continues to type, for example, “3 -1.0 0.0 0.0 -1.0 1.0 0.0 -2.0 0.0 0.0” using the keyboard. , Finally press the return key. This allows
These numerical data are stored in the file device 7 as triangular coordinate data. However, the first number is the number of triangle vertices, the second to fourth, the fifth to seventh, and eight
The tenth to tenth set of three numbers is the triangle x,
The y and z coordinates are shown.

1-4 Next, the user inputs triangular surface loop data. That is, the control device 1 inputs “triangular surface loop data to the surface device 8 .---
The message ">" is displayed, and the keyboard, which is the command input device 2, is placed in a command input waiting state. Here, the user types "1 3 1 2 3" in order to respond to this display from the keyboard, and finally Then, press the return key to store these numerical data as triangular surface loop data in the file device 7. However, among these numerical values,
The first numerical value shows the number of faces forming the object, the second numerical value shows the number of vertices forming the surface loop, and the third to fifth numerical values show the vertex number sequence of the triangular surface.

<Description of Step S2> Next, the user inputs the initial value of the viewpoint condition data.

For this reason, the control device 1 displays a message "Enter viewpoint conditions. --->" on the display device 8 and prompts the user to input from the keyboard which is the command input device 2. When this message is displayed, the user types, for example, "0.0 0.0 -10.0 2.0 0.0 0.0 5.0", and finally presses the return key. Thus, these numerical data are stored in the file device 7 as the initial values of the viewpoint condition data. However, of these numerical values, 1
Numerical values from the 3rd to 3rd are viewpoint coordinates Pe (Xe, Ye,
Ze), and the fourth to seventh numerical values indicate the viewing angle θ, the azimuth angle α, the elevation angle β, and the viewing distance f, respectively. Then, using these values and the numbers of vertical and horizontal pixels a and b of the display image, the vertical and horizontal lengths h and v of the screen are calculated by the above-mentioned (Equation-5) and (Equation-6).

<Explanation of Step 3> Next, the user pastes the two photograph originals of the landscape and the person photographed by the photographing device 5 onto the drum of the image input device 4, for example, the drum scanner, and inputs the command. The device 2 sends a processing start command to the control device 1. When the control device 1 receives the processing start command, it sends a scan start command to the image input device 4. When the input device 4 receives the scan start command, it scans the image attached to the drum,
For example, 8-bit quantized data of the input image is output.
Then, the control device 1 stores the two image data output from the image input device 4 in the file device 7 as texture images.

At this time, the horizontal length a1 and the vertical length b1 of the photographic original of the arithmetic unit 6 and the horizontal length a of the photographic original of the person are calculated.
2. From the vertical length b2 and the reading pitch p at the time of image input, the horizontal and vertical pixel numbers X1 and Y1 of the landscape image and the horizontal and vertical pixel numbers X2 and Y2 of the person image are calculated by the following equations. It is calculated and stored in the file device 7.

X1 = a1 / p Y1 = b1 / p X2 = a2 / p Y2 = b2 / p <Explanation of Step 4> The control device 1 puts the command input device 2 in a command input waiting state, and the user enters the above-mentioned quadrangle. A texture image to be mapped for each of the objects and triangles is specified, for example, quadrilateral → landscape texture triangle → person texture.

<Explanation of Step S5> The control device 1 puts the command input device 2 in a command input waiting state, and the user performs a texture animation for a texture image to be mapped on each of the above-mentioned quadrangle and triangle objects, for example, a quadrangle object. -> Mosaic processing Triangular object-> Specify like color conversion processing.

<Description of Step S6> The control device 1 puts the data input device 3 into a data input waiting state, and the user inputs the texture animation state value to be executed on each object as follows.

First, the texture animation state value for the mosaic processing executed on the quadrangle is represented by, for example, the unit pixel number of mosaic N = 5, the speed of change of the unit pixel number of mosaic Sm = 2, and the change of the unit pixel number of mosaic. Direction of increase / decrease Dm = 1 The minimum value Nmin = 1 of the unit pixel number of the mosaic The maximum value Nmax = 100 of the unit pixel number of the mosaic is input and initialization is performed. However, the increase / decrease direction of the change in the number of unit pixels of the mosaic takes a value of 1 (increase) or -1 (decrease).

Further, the texture animation state value of the color conversion processing executed on the triangular object is, for example, the change speed SR of R = 10 R change increasing / decreasing direction DR = 1 G change speed SG = 20 G Initialization is performed by inputting in the increasing / decreasing direction of change DG = -1 B, changing speed SB = 30 B, in the increasing / decreasing direction of change DB = -1. However, the increasing / decreasing direction of the change of each color of R, G, B shall take a value of 1 (increase) or -1 (decrease). Then, these input values are stored in the file device 7.

<Description of Step S7> Next, the controller 1
Command, the command input device 2 is in a command input waiting state. If the user inputs YES, the process proceeds to the next step (CG animation starts), and if NO, the process returns to step S1 (starts from the beginning).

<Explanation of Step S8> The main part of the CG animation is processed by the command of the control device 1, and the CG animation process ends when an appropriate end command is given.

Next, the processing performed in step S8, which is the main part of the CG animation processing, will be described.

FIG. 10 is a flowchart showing the processing performed in the main part of the CG animation.

The processing method will be described in detail below according to the flow of data.

<Description of Step T1> The command input device 2 is in the command input check state according to the command of the control device 1, and if the user gives a command to end the CG animation, the CG animation process is ended. Go to the next step.

<Explanation of Step T2> According to a command from the control device 1, the space ball which is the viewpoint input device 11 has components Dx, Xx, Y, Z in the movement vector, respectively.
Dy and Dz, and the left and right and up and down rotation components Dα and Dβ in the rotation direction are measured and stored in the file device 7.

<Explanation of Step T3> In accordance with an instruction from the control unit 1, the arithmetic unit 4 receives Dx, Dy,
The position Xe, Ye, Ze of the viewpoint is updated by the following equation using Dz.

Xe ← Xe + Dx Ye ← Ye + Dy Ze ← Ze + Dz Similarly, the azimuth angle α and the elevation angle β are updated by the following equations using Dα and Dβ in the file device 7.

Α ← α + Dα β ← β + Dβ Then, these new Xe, Ye, Ze, α and β are stored in the file device 7.

<Explanation of Step T4> In accordance with an instruction from the control device 1, the arithmetic unit 4 causes Dx, Dy,
The animation state value is updated using Dz, Dα, and Dβ.

First, the arithmetic unit 4 updates the texture animation state value indicating the mosaic processing on the quadrangle using Dα and Dβ, for example, as follows.

Sm ← Sm + omit (Dα) Dm ← Dm * mark (Dβ) N ← N + Sm * Dm (where N <Nmin: N ← Nmin, and N> Nmax: N ← Nmax) Nmin ← Nmin (no change) Nmax ← Nmax (no change) where omit (x) is a function that rounds down the decimal point of x, and mark (x) is a function that returns 1 and -1 depending on whether the sign of x is positive or negative. Suppose

Next, the arithmetic unit 6 updates the animation state value indicating the color conversion process on the triangle by using Dx, Dy and Dz, for example, as follows.

SR ← SR + omit (Dx) DR ← DR * mark (Dy) SG ← SG + omit (Dy) DG ← DG * mark (Dz) SB ← SB + omit (Dz) DB ← DB * mark (Dx) Then, these updated values are stored in the file 7.

<Explanation of Step T5> In response to a command from the control device 1, the image processing device 9 uses the texture animation state variable of the quadrangle object to generate an image of the landscape in the file device 7 which is also designated as the quadrangle object. On the other hand, the same mosaic processing is applied to the rectangular object.

Similarly, in response to a command from the control device 1, the image processing device 10 uses the texture animation state variable of the triangular object to compare the triangular object with the image of the person in the file device 7 designated as the triangular object. The color conversion processing specified in is applied.

Then, the two processed texture images are stored in the file device 7.

<Explanation of Step T6> According to a command from the control unit 1, the arithmetic unit 6 performs image rendering processing.

First, the arithmetic unit 6 creates a background image having the same size as the generated image, and initializes all pixels with, for example, black color, (R, G, B) = (0,0,0). .

Then, the arithmetic unit 6 uses the viewpoint condition value in the file unit 7 by the rendering method described above,
Similarly, a quadrangle object in space is mapped to the texture after the mosaic processing in the file device 7, and an object is drawn at an appropriate position on the created background image.

Similarly, the arithmetic unit 6 maps the texture after the color conversion processing in the file unit 7 to the triangular object in the space by using the viewpoint condition value in the file unit 7 by the rendering method described above. The object with the mark is drawn at an appropriate position on the background image.

However, it is assumed that the texture mapping to these two plane objects is set so that the central axis of the projection in the above-mentioned perspective coordination is perpendicular to the plane object.

The generated image obtained as a result is stored in the file device 7.

<Explanation of Step T7> The display device 8 displays the generated image in the file device 7 (outputs the generated image to the display device) according to a command from the control device 1, and then executes the step S8.
Return to.

As described above, according to this embodiment,
By giving each of a plurality of objects existing in the three-dimensional space a texture animation state value, changing the texture animation state value while the animation is in progress, and executing an independent texture animation for each object, CG full of unprecedented art
A computer graphics device characterized by realizing animation can be provided. Accordingly, if a plurality of texture animation methods are prepared in advance, even if the number of input texture images is small, it is possible to use a small number of images for texture animation with a variety of variations.

The present invention may be applied to a system composed of a plurality of devices or a system composed of one device. Further, it goes without saying that the present invention can be applied to the case where it is realized by supplying a program to a system or an apparatus.

[0101]

As described above, according to the present invention, each of a plurality of objects existing in the three-dimensional space has a texture animation state value, and the texture animation state value is set while the CG animation is in progress. It is possible to provide a computer graphics device characterized by realizing a CG animation full of unprecedented art by changing and performing a texture animation independently for each object.

As a result, even if the number of input texture images is small, it is possible to use a small number of images for CG animation having a variety of variation texture animations.

[0103]

[Brief description of drawings]

FIG. 1 is a diagram showing a computer graphics device according to an embodiment of the present invention.

FIG. 2 is a diagram showing a three-dimensional object in a modeling coordinate system.

FIG. 3 is a diagram showing four coordinate systems for projection conversion.

FIG. 4 is a diagram showing projection conversion.

FIG. 5A is a diagram showing a screen (UVN coordinate system) in the example.

FIG. 5B is a display image (device coordinate system) in the example.
FIG.

FIG. 6A is a structural view of a space ball.

FIG. 6B is a structural diagram of a space ball.

FIG. 7 is a diagram illustrating mosaic processing.

FIG. 8 is a diagram showing a state of texture mapping.

FIG. 9 is a flowchart showing the entire CG animation processing.

FIG. 10 is a flowchart showing a process of a main part of a CG animation process.

FIG. 11A is a diagram showing a projected image of the object in FIG. 8 under a certain viewpoint condition.

FIG. 11B is a diagram showing a projected image of the object in FIG. 8 under another viewpoint condition.

[Explanation of symbols]

1 control device 2 Command input device 3 data input device 4 Image input device 5 Imaging device 6 arithmetic unit 7 file device 8 display devices 9, 10 Image processing device

Continuation of the front page (56) References Japanese Unexamined Patent Publication No. Hei 1-131976 (JP, A) Japanese Unexamined Patent Publication No. 61-90275 (JP, A) Japanese Unexamined Patent Publication No. 62-95666 (JP, A) Hirohito Doi 1 person, "small Real-Time Generation of Anthropomorphic Agent Video by Large Scale Parallel Processor ”, Journal of the Institute of Image Electronics Engineers of Japan, Image Electronics Society of Japan, June 25, 1993, Vol. 240-246 (58) Fields investigated (Int.Cl. ⁷ , DB name) G06T 15/70 G06T 15/00 CSDB (Japan Patent Office)

Claims (8)

(57) [Claims] And 1. A data input means for performing modeling by inputting a three-dimensional shape data of the object, an image input unit for inputting the texture image data, with respect to the texture image data input by said image input means
State value used when performing a predetermined animation process
Is input as the initial value, and the state value input by the state value input means is set as the state value.
Status value update procedure that updates based on the specified change speed information
An image that processes the texture image based on the step and the state value
The processing means and the texture image generated by the image processing means are
Texture mapping is performed on the surface of 3D shape data.
Image to generate an image with texture mapping
An image processing apparatus comprising: a forming unit and an image display unit for displaying the generated image. 2. A three-dimensional object by the image display means
Change means to change the viewpoint while displaying the body
The image processing device according to claim 1, further comprising:
Place 3. An image processing apparatus according to claim paragraph 1, wherein the animation state values in the texture animation is variable Oite in the computer graphics animation execution. 4. Three-dimensional shape data for each of a plurality of objects
Inputting texture image data and inputting state values independently
Force, status value update, image processing, and image generation.
There, the image processing apparatus of claim 1 wherein, wherein the this <br/> for displaying an image of the plurality of objects on the display means. 5. A data input step of performing modeling by inputting a three-dimensional shape data of the object, an image input step of inputting texture image data, with respect to the texture image data input by said image input step
State value used when performing a predetermined animation process
Is input as the initial value, and the state value input in the state value input step is set as the state value.
Status value updater that updates based on the specified change speed information
And an image that processes the texture image based on the state value
The processing step and the texture image generated by the image processing step are
Texture mapping is performed on the surface of 3D shape data.
Image to generate an image with texture mapping
An image processing method comprising: a forming step; and an image displaying step of displaying the generated image. 6. A three-dimensional object according to the image display step.
Change process to change the viewpoint while displaying the body
The image processing method according to claim 5, further comprising:
Law. 7. The image processing method according to claim 5, wherein said animation state value of the texture in the animation, characterized in that a variable Oite in the computer graphics animation execution. 8. Three-dimensional shape data of a plurality of objects, respectively
Inputting texture image data and inputting state values independently
Force, status value update, image processing, and image generation.
There, the image processing method according to claim 5 wherein, wherein the this <br/> for displaying an image of the plurality of objects in said display step.