JP3501479B2 - Image processing device - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus, and more particularly to realizing a computer graphics animation (CG animation) in which a plurality of objects in a three-dimensional space are independently texture-animated. The present invention relates to a characteristic image processing device.

[0002]

2. Description of the Related Art Conventional computer graphics, particularly three-dimensional graphics for forming an image representing a three-dimensional object, are roughly divided into two parts in order to obtain a normal image. Becomes

First of all, modeling is an operation of creating in a computer data such as the shape, color and surface property of an object desired to be expressed in an image. For example, if you are making an image of a human face, create data such as what the shape of the surface is, what part of the face has what color, and what the light reflectance is. Then, store it in the computer in a format that can be used for later rendering. Such a collection of data is called an object model.

Rendering refers to creating an image according to the appearance of the object after considering the appearance of the object when viewed from a certain position. So to render,
In addition to the model, it is necessary to consider the conditions for viewing position (viewpoint) and lighting. The rendering work is subdivided as follows.

· Coordinate conversion ・ Hidden surface removal ·shading ・ Ingenuity for realism

First, in coordinate conversion, with respect to various coordinate values representing a model, which position on the screen is viewed from the viewpoint position is calculated and converted into coordinates on the screen. Means that.

Next, by hidden surface removal, in the model,
Judging from the current position of the viewpoint, which part is visible and which part is not visible is determined. Algorithms such as the Z-buffer method and the scanline method are typical methods of hidden surface removal. Then, after the hidden surface removal is completed and it is decided which part of the object can be seen, the next step is to consider the lighting to determine what color and how bright each part looks like, and display that color on the screen. That is, the shading process of painting the pixels is performed.

[0008] Then, what is usually executed at the end of the rendering is a device for giving realism. this is,
This is because even if an image is created by performing visual field conversion, hidden surface removal, and shading, the obtained picture will not be as interesting as a real object. The reason for this is that such a method is based on the assumption that the surface of an object is an ideal plane or a perfectly smooth curved surface that can be expressed by a mathematical expression, or that the surface color is constant for each surface. is there. Texture mapping is one of the typical methods performed in order to avoid such a situation and make the obtained image more realistic. Texture mapping is a method in which a 2D pattern prepared in advance is pasted (mathematically speaking) onto the surface of an object model in 3D space, and an object composed of a monotonous surface is converted into an object with a complex surface. The purpose is to imitate it. This allows, for example, a simple rectangular parallelepiped model to look like metal or stone.

In the case of creating a computer graphics animation (CG animation) in which a motion is added to a picture obtained by the above-mentioned method, there are roughly the following two methods.

The first method is to place in a three-dimensional space and set lighting conditions, viewpoint conditions (viewpoint position / direction / angle of view),
After changing the shape and color of the object model little by little and rendering each time to obtain a group of images for a series of animation (or each time one image is rendered), use them in a video recorder, etc. This is a method of recording one frame by one frame (frame recording) using a recording device, and reproducing by the reproducing device after all recording is completed.

In this method, the time required to render an image may be set as long as possible (depending on the time required to render one image and the total time of the animation to be created). It is also possible to arrange a large number of objects having a complicated shape, or to create a high-quality image by using a rendering method that requires a long calculation time as represented by ray tracing (ray tracing method). For example, most CG images used in current TV commercials, SF movies, etc. are created by this method.

The second method is to render while changing the illumination condition, the viewpoint condition, and the shape and color of the object model, and display the image obtained by the rendering process. There is a method of executing CG animation by repeating one process at high speed. This is generally called real-time CG animation, and its greatest feature is that it is possible to perform interactive processing to control the movement of CG animation in real time by directly reflecting the instruction from the user in rendering. .

On the other hand, the implementation is considerably dependent on the performance of the computer to be executed, and the number of objects that can be displayed on the screen is limited, and the rendering method is limited to a simple and high-speed rendering method. , The image created compared to the former is of low quality. Flight simulators for practicing aircraft pilots and racing games for arcades are good examples.

[0014]

However, in the computer graphics device described in the above-mentioned prior art, the texture mapping to the object in the rendered image mainly imitates the texture and feel of the object that actually exists. This is done for the purpose of visualizing the texture, and the visual change of the texture during the progress of the CG animation is only a subtle change of the color due to the change of the viewpoint condition and the light ray condition. However, CG animation with texture animation that emphasizes art has not been realized.

Further, when the number of texture images to be input is small, the limited images are mapped to a plurality of objects, so that the obtained CG animation image has a drawback that it is monotonous and has no interest. It was

Further, it goes without saying that there is no computer graphics device that realizes a CG animation in which the texture to be mapped to each object and the texture animation performed for the texture are switched while the CG animation is in progress.

[0017]

The image processing apparatus of the present invention is intended to solve the above-mentioned problems, and a texture animation state value unique to each object existing in a three-dimensional space. And changing the texture animation state value in the process of generating a plurality of images forming a CG animation, the following is executed.

The texture assigned to each object and the texture animation being executed for that texture are switched to another texture and another texture animation, respectively.

Even when the same animation is executed for textures on a plurality of different objects, the movement is changed by changing the texture animation variable in each texture animation state value.

Accordingly, an object of the present invention is to provide an image processing apparatus characterized in that it realizes a CG animation which is full of unprecedented artistic properties in which textures mapped to individual objects dynamically change.

Therefore, if a plurality of texture animations are prepared in advance, even if the number of input texture images is small, a CG animation which realizes a texture animation having a variety of variations using the few images is provided. It will be possible.

[0022]

First, in order to clarify the characteristics of the embodiment of the present invention, a flow of processing from modeling of a three-dimensional solid to rendering of an image and display of an image generated by the rendering will be described.

<1. Modeling> First, modeling of a three-dimensional object will be described.
This is to make your Keru input three-dimensional shape data of the object in the modeling coordinate system. However, the modeling coordinate system is a coordinate system for defining and manipulating the shape of an object. For example, when performing shape modeling of a cube as shown in FIG. 2, first consider a modeling coordinate system with one vertex of the cube as the origin as shown in the figure. Then, the coordinate data of the eight vertices of the cube in this coordinate system is determined as follows, for example.

<Coordinate data> (vertex numbers are assigned in order from the top) 8 ... All the number of vertices (0.0 0.0 0.0 0.0) ... (x, y, z of each vertex) ) Coordinates (1.0 0.0 0.0) (1.0 1.0 0.0) (0.0 1.0 0.0) (0.0 0.0-1.0) (1. 0 0.0-1.0) (1.0 1.0-1.0) (0.0 1.0-1.0) Then, a surface loop such as which points are connected to form a surface. Determine the data as follows.

<Surface Loop Data> 6 ... Number of faces constituting object 4 ... Number of vertices constituting first face loop 1 2 3 4 ... Vertex number sequence 4 of first face 4 ..Number of vertices forming second surface loop 5 6 7 8 ... Vertex number sequence 4 of second surface 4 ... Number of vertices forming third surface loop 4 3 7 8 ... 3rd Number of vertices forming the fourth face loop of the face No. 4 ... The number of vertices forming the fourth face loop 1 5 8 4 ... The number of vertices of the fourth face 4 ... 2 6 5 ... 5th face vertex number sequence 4 ... 6th face loop number of vertices 2 6 7 3 ... 6th face vertex number sequence Obtained in this way A set of coordinate data and surface loop data becomes modeling data of the object shown in FIG.

<2. Rendering> ○ Projection conversion After modeling the three-dimensional shape of the object, projection conversion is performed next. This is equivalent to the selection of a lens, the shooting location (viewpoint), and the camera orientation (visual axis) when compared to photography.

FIG. 3 is a diagram showing four coordinate systems for projection conversion. First, the shape data of the object defined in the modeling coordinate system is converted into data in the world coordinate system (the coordinate system used for the coordinates in the model when representing the shape of the object). Then, the viewing conversion (field of view conversion) is performed by pointing the selected camera in various directions so that the target object can be viewed. At this time, the data of the object represented by the world coordinate system is converted into the data of the viewpoint coordinate system.

For this conversion, a screen (view window) is designated in the world coordinate system, and this screen becomes the final projection plane of the object. The coordinate system for defining this screen is called the UVN coordinate system (screen coordinate system). However, drawing everything in front of the viewpoint may take unnecessary calculation time, so it is also necessary to determine the drawing area (this drawing area is called the view volume (view space). Is called clipping).

Next, the projection conversion will be described in more detail. FIG. 4 is a diagram showing the projection conversion. In the figure, first, a viewpoint that is the center of projection is placed in space, and the visual axis (half line extending from the viewpoint toward the direction in which a person is looking) and the visual angle (angle of view) θ are considered. When a plane orthogonal to the visual axis and having a distance f from the viewpoint is considered as a projection surface (screen), the intersection of the projection surface and the view cone (the conical surface having the view axis as the axis) is circular. Are doing Then, as shown in the figure, consider a rectangular area having four vertices on this arc and having a horizontal length of h and a vertical length of v, and this area is used as a screen.

Now, consider a method of calculating h and v from θ and f. However, it is assumed that the ratio of h and v is the same as the horizontal and vertical ratios of the display image. In the figure, first, OE
Is the radius of the above-mentioned circular portion, so that ∠OPE = θ / 2 (Equation 0), and as a result, len (OE) = f × tan (θ / 2) (Equation 1) Since it is a point, using Equation 1, len (EG) = 2 × len (OE) = 2 × f × tan (θ / 2) (Equation 2).

Next, assuming that the numbers of horizontal and vertical pixels of the display image are known for a and b, respectively, the ratio of these two is the same as the ratio of h and v, so a: b = h: v (Equation 3) Further, according to the Pythagorean theorem, h × h + v × v = len (EG) × len (EG) (Equation 4) Therefore, from Equations 2, 3, and 4, h = 2 × f × tan (θ / 2) / Sqrt (1+ (a / b) × (a / b)) (Equation 5) v = 2 × f × tan (θ / 2) / sqrt (1+ (b / a) × (b / a)) (Equation 6) becomes.

However, len (AB) is a function that returns the length of the line segment AB, and sqrt (C) is a function that returns the square root of C.

The field of view is converted by moving the screen in various directions. Then, after the field of view conversion is determined, an operation for obtaining the intersection of the viewpoint and the projection surface is performed for each point of the three-dimensional shape of the object existing in the space to obtain a projection view on the screen as shown in FIG. (However,
In this case, it shows perspective projection in which the distance between the viewpoint and the projection surface is finite). Therefore, when the projection conversion is performed, the data expressed in the above-mentioned viewpoint coordinate system is converted into the data in the UVN coordinate system.

After this projection conversion, the figure shown by the UVN coordinate system is converted into the final device coordinate system and displayed on the display device. However, the device coordinate system is
The coordinate system used to represent the positions of pixels and dots in the image is the same as the coordinate system in the display image.

How to actually implement the coordinate conversion described above will be described using mathematical expressions.

First, in the world coordinate system set so that the XZ plane is horizontal and the Y axis is vertical, the position and direction of the viewpoint and the target object are determined. The x-axis of the viewpoint coordinate system is parallel to the visual axis, and the y-axis is U of the UVN coordinate system.
Set to be parallel to the axis. Here, the coordinates of an arbitrary point P in the world coordinate space are shown as (X, Y, Z). The coordinates of the viewpoint are (Xe, Ye, Ze), the azimuth angle (horizontal angle) in the world coordinate system is α, the elevation angle (vertical angle) is β, and the coordinates of the point P in the viewpoint coordinate system are (x, y, Ze).
z), the following relationship is established between them.

[0037]

[Outer 1] However,

[0038]

[Outside 2] Is.

The projection plane for projecting the three-dimensional solid is
If it is assumed that it is perpendicular to the x-axis of the viewpoint coordinate system and that the viewing distance is f as described above, the coordinates of the point P ′ obtained by projecting the point P in space onto the UV plane that is the projection plane. (X ',
y ') is shown by x' =-f * (x / z) y '=-f * (y / z).

Generation and display of image, and finally U-
The screen area in the V plane is converted into a column of pixels in the display image (device coordinate system), and a point on the display image corresponding to the point P ′ in the screen at that time is shown in FIG. Let P ″ (x ″, y ″) be the coordinate values x ″, y ″ given by x ″ = a · x ′ / h + a / 2 y ″ = b · y ′ / v + b / 2, respectively. , H and v respectively indicate the horizontal and vertical lengths of the screen, and a and b respectively indicate the horizontal and vertical pixel numbers of the display image (device coordinate system).

Then, using this coordinate transformation, points on the screen (sample points) corresponding to the pixels in the final output image are considered, first the sample points contained in the object are searched, and the corresponding display is performed. By filling the pixels in the image with the color value of the texture on the object at that point, the object converted into the UVN coordinate system is converted into the final row of pixels in the two-dimensional image.

When drawing a plurality of objects by such a method, an area (Z buffer) for storing depth information is provided for each pixel of the display device, and the depths of a plurality of objects are compared using this area. Generally, a method of erasing hidden surfaces (hidden surface elimination method) is used.

<3. CG Animation Processing> Hereinafter, the CG animation processing in one embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram of a computer graphic device according to an embodiment of the present invention.

In the figure, 2 is the start of CG animation processing, selection of texture to be mapped to an object,
And a command input device 2 for giving instructions such as selection of texture animation and change of texture animation state value during execution of CG animation processing, and for example, a mouse is used. However, this mouse has three buttons (left button, middle button, right button).

Reference numeral 3 denotes a data input device 3 for inputting modeling data of an object, initial values such as viewpoint conditions,
For example, a keyboard is used.

Reference numeral 4 is an image input device 4 for inputting a texture image, and for example, a drum scanner is used.

Reference numeral 5 denotes a photographing device 5 for photographing a texture image, and for example, a camera is used.

Reference numeral 6 denotes an arithmetic unit for updating various variables, modeling data of an object, viewpoint conditions, rendering processing of a display image by a texture image after image processing, and the like.

Reference numeral 7 is a file device for storing various data such as object modeling data, viewpoint conditions, and animation variables, and is, for example, a hard disk, floppy disk, magneto-optical disk or the like.

Reference numeral 8 denotes an image display device for displaying the display image generated by the rendering process, for example, C
An RT monitor is used.

Reference numeral 8a denotes a data display device for displaying instructions to the user at the time of data input, numerical data input by the user, and the like, for example, a liquid crystal display is used.

Reference numeral 9 is an image processing apparatus A for generating an image obtained by subjecting a two-dimensional image to a mosaic process described later.

Reference numeral 10 denotes an image processing apparatus B which produces an image in which a color conversion process, which will be described later, is performed on the two-dimensional image.

Reference numeral 11 denotes a viewpoint input device 11 for inputting movement of the viewpoint position and changes in the azimuth angle and elevation angle of the viewpoint, for example, a space ball is used. The space ball generally has a shape as shown in FIG. 6, and by moving the spherical part subtly, movement in any direction,
And a device for detecting rotation about an arbitrary axis.

In this embodiment, when the center of the ball moves in a certain direction, as shown in FIG. 6A, the X, Y and Z movement amount components Dx, Dy and Dz of the movement vector are calculated. Further, when the ball is rotated about a certain axis as shown in FIG. 6B, the rotation amount components Dα and Dβ of the azimuth angle and the elevation angle are output.

[0057] 1 is a control equipment, command input device 2, the data input device 3, the image input unit 5, arithmetic unit 6,
File device 7, image display device 8, data display device 8
a, the image processing apparatus A9, and the image processing apparatus B10 are controlled.

In the present embodiment, the real-time CG is applied to the computer graphic device constructed as described above.
The case of animation will be described according to the flow of data.

First, when the user presses a key on the keyboard which is the command input device 2, the CG animation process is started. Next, the system waits for the input of shape data, and the user inputs the shape data of multiple objects using the coordinate values in the system modeling coordinate system (the modeling coordinate system is assumed to match the world coordinate system). Model the shape of the object.

Next, the viewpoint conditions (viewpoint coordinates, viewing angle (angle of view), elevation angle, azimuth angle, distance to the screen) are initialized.

Next, the input image for texture photographed by the photographing device 5, for example, the input image of landscape is A / D (analog / digital) converted by the image input device 4 and stored in the file device 7. Here, for convenience, red, green, and blue data forming each pixel of the input image are represented by R, G, and B, respectively. Each pixel consists of 8 bits for each component,
That is, the data can be expressed in 256 gradations, and the maximum brightness is 255 and the minimum brightness is 0, but the invention is not limited to this. In this embodiment, the number of vertical and horizontal pixels of the input image is determined by the image reading pitch designated by the control device 1 when the image is input.

Next, the user selects a texture image to be mapped for each of the plurality of modeled objects from the input image group, and selects a texture animation to be executed for each texture from those registered in advance. To do. Then, the texture animation variable designated for each object is initialized.

In this way, when all the texture animation state values have been initialized, the CG animation start wait state is entered, and the CG animation starts when the user gives a start instruction. And
Next, a command reception check from the user is performed. At this time, if there is no command from the user, image rendering processing and display are performed by the above method based on the viewpoint condition and the texture animation state value as they are.
However, even if the viewpoint condition does not change, the texture animation on the object changes with the initial state (according to the state value indicating the speed of the texture animation). On the contrary, if the user gives an instruction to change the viewpoint condition and the texture animation state value, the texture is selected and the image processing of the texture is performed according to the change, and the texture in the object in the space is processed. The three-dimensional CG image in which is mapped will be rendered.

Similarly, when checking the command reception,
When the CG animation end command is input, the CG animation processing ends. In the image rendering process of this embodiment, the shading described in the conventional example is not particularly mentioned, but the present invention is not limited to this.

Here, two image processing methods (mosaic processing and color conversion processing) in this embodiment will be described.

First, the mosaic processing in this embodiment will be described. In the mosaic processing, as shown in FIG. 7, the image is divided into square areas each having a certain number of pixels (the number of unit pixels) as one side, and all the pixels included in each area are included in a certain area in the area. Pixel (representative pixel: In the case of the figure,
This is the process of replacing with the color value of the upper leftmost gray colored point in each square area). However, the division is performed using the upper left point of the image as a reference point, and if the side length is less than the unit pixel in the area that touches the right edge and the lower edge of the image, the rectangular area that can be formed in that case is similarly defined as It will be filled with color.

The color conversion processing in this embodiment is
It is a process of setting the change amount for each color of R, G, B and adding (or subtracting) the change amount of the corresponding color to each value of R, G, B of all pixels in the image. is there. However, if the new value obtained by this addition (or subtraction) is smaller than 0, the new value is set to 0, and if it is larger than 255, the new value is set to 25.
It shall be 5.

Here, i of the image composed of N pixels
Let the color of the th pixel be (Ri, Gi, Bi) (i = 1, ...,
N), RGB color change amount SR, SG, SB
Then, this color conversion process is given by the following equation.

Ri ← Ri + SR Gi ← Gi + SG Bi ← Bi + SB Here, i = 1, ..., N.

The image processing method described above is based on the following C
Used in G animation processing.

Next, the texture mapping method in this embodiment will be described.

FIG. 8 is a diagram showing perspective coordination (projection coordination), which is a typical method of texture mapping on an object in space.

First, a point P, which is the center of projection, is placed in the space, and a quadrangular pyramid P-ABCD that completely includes a three-dimensional object is considered with this point as the center (however, the quadrangle ABC
Suppose D is a rectangle). In addition, 2 of square ABCD
Let N be the intersection of the diagonals of the book. Then, a plane g perpendicular to PN is placed between the point P and the object, and a rectangular area in which this plane cuts a quadrangular pyramid is A′B′C′D ′.

Further, the intersection of two diagonal lines of the quadrangle A'B'C'D 'is N'. Here, the area representing the texture image is EFGH, and the intersection of the two diagonal lines of EFGH is N ″. In a state of being arranged so as to surround it, projection from the point P is performed, and a part of the texture is mapped onto the object (in the figure, "M" drawn on the texture is mapped onto the surface of the spherical object).

For example, when a spherical object subjected to texture mapping as shown in FIG. 8 is viewed under a certain viewpoint condition, the image projected on the screen is as shown in FIG. 9 (a). An image projected on the screen when viewed under different viewpoint conditions is as shown in FIG. In addition, in the present embodiment, for the sake of simplicity, only an object formed of one plane is dealt with, but the present invention is not limited to this.

The texture mapping method described above is used in the following CG animation processing.

Next, the CG animation processing in this embodiment will be described.

FIG. 10 is a flowchart showing the CG animation processing in this embodiment.

The processing method will be described in detail below according to the flow of data.

(Step S1) <Input of Square Coordinate Data> The user inputs square coordinate data.

That is, the control device 1 displays on the data display device 8 "Please input the coordinate data of the rectangle --->" and sets the keyboard which is the command input device 2 to the command input waiting state. To do. Here, the user continues to this display with the keyboard, for example, “4 1.0 0.0 0.0 0.0 2.0 0.0 0.0.
0 2.0 1.00.0 1.0 1.0 1.0
Type "0.0" and press the return (line feed) key at the end to store these numerical data as rectangular coordinate data in the file device 7. However, among these numerical data,
The first number is the number of vertices of the quadrangle, the second to the fourth, the fifth to the seventh, and the eighth to the first.
It is assumed that the 0th, 11th to 13th sets of numerical values for each three indicate the x, y, z coordinates of each vertex of the quadrangle.

<Input of Square Surface Loop Data> Next, the user inputs square surface loop data.

That is, the control device 1 has the data display device 8
Is displayed, "Please input the square loop data --->" is displayed, and the keyboard which is the command input device 2 is put in the command input waiting state. Here, the user continues to display this on the keyboard, for example, by typing "1 4 1 2 3 4" and pressing the return (line feed) key at the end, these numerical data are converted into rectangular surface loop data as file device 7 Stored in. However, of these numerical data, the first numerical value is the number of faces that make up the object, the second numerical value is the number of vertices that make up the surface loop, and the third to sixth numerical values are It is assumed that the vertex number sequence of the quadrangular surface is shown.

<Input of Triangle Coordinate Data> Next, the user inputs triangle coordinate data.

That is, the control device 1 displays on the data display device 8 "Please input the coordinate data of the triangle --->", and sets the keyboard which is the command input device 2 to the command input waiting state. To do. Here, the user uses the keyboard to continue the display, for example, "3-1.0 0.0 0.0 -1.0 1.0
Type "0.0-2.0 0.0 0.0" and press the return (line feed) key at the end to store these numerical data in the file device 7 as triangular coordinate data. First of the data
The third number is the number of vertices of the triangle, and the second to fourth, fifth to seventh, eighth to tenth sets of numbers are the triangle vertices. x,
The y and z coordinates are shown.

<Input of Triangular Surface Loop> Next, the user inputs triangular surface loop data.

That is, the control device 1 displays on the data display device 8 ', "Please input triangle surface loop data --->", and causes the keyboard, which is the command input device 2, to wait for command input. And Here, the user uses the keyboard to continue the display and, for example, types "1 3 1 2 3" and presses the return (line feed) key at the end, and these numerical data are stored in the file device 7 as triangular surface loop data. Is stored. However, in this numerical data,
The first number indicates the number of faces that make up the object, the second number indicates the number of vertices that make up the face loop, and the third to fifth numbers indicate the vertex number sequence of the triangular faces. I shall.

(Step S2) Next, the user inputs the initial value of the viewpoint condition data.

That is, the control device 1 has the data display device 8
A message "Please input the viewpoint condition --->" is displayed on a and the keyboard which is the command input device 2 is set in the command input waiting state. Here, the user uses the keyboard to continue to this display, for example, "0.0 0.0 -10.0 2.0 0.0 0.0.
If you type 0 5.0 "and press the return (line feed) key at the end, these numerical data are stored in the file unit 7 as the initial values of the viewpoint condition data. The third numerical value from is the viewpoint coordinate Pe (X
e, Ye, Ze), and the fourth to seventh numerical values indicate the viewing angle θ, the azimuth angle α, the elevation angle β, and the viewing distance f, respectively.

(Step S3) Next, the user pastes the two photograph originals of the landscape and the person photographed by the photographing device 5 on the drum of the image input device 4, for example, the drum scanner, and the command input device 2 Sends a processing start command to the control device 1. When the control device 1 receives the processing start command, it sends a scan start command to the image input device 4.
Then, when the input device 4 receives the scan start command, it scans the image attached to the drum and outputs the input image, for example, 8-bit quantized data. Then, the control device 1 stores the two image data output from the image input device 4 in the file device 7 as texture images.

At this time, the arithmetic unit 6 determines that the horizontal length a1 of the photographic original, the vertical length b1, and the horizontal length a of the photographic original of a person.
2, the vertical length b2, and the horizontal and vertical pixel counts X1 and Y1 of the landscape image and the horizontal and vertical pixel counts X2 and Y2 of the person image, based on the reading pitch p at the time of image input. And stored in the file device 7.

X1 = a1 / p Y1 = b1 / p X2 = a2 / p Y2 = b2 / p

(Step S4) Next, the user inputs the texture animation state value for the quadrilateral object.

That is, the control device 1 displays the following on the data display device 8a and puts the data input device 3 into a data input waiting state. Then, the user types the numerical value corresponding to the item following the arrow of each item on the display with the keyboard, and the mapping image number 1
(Landscape image) and animation number 1 (mosaic processing) are input.

<Input of square texture animation state value> Mapping image number NT ---> 1 Animation number NA ---> 1 Next, the control device sets the animation number 1, that is, as described above. In response to the designation of the mosaic processing, the following display is displayed on the data display device 8a to prompt the user to input the initial value of each variable of the mosaic processing animation. The user uses the keyboard to perform numerical data for each item in the same manner as described above.

Input the initial value of each variable of mosaic processing.-Number of unit pixels N ---> 5-Speed of change of unit pixel number Sm ---> 2-Increase / decrease direction of change of unit pixel number Dm ---> 1-Minimum value of the number of unit pixels Nmin ---> 1-Maximum value of the number of unit pixels Nmax ---> 100 However, the change direction of the number of unit pixels of the mosaic is 1
The value shall be either (increase) or -1 (decrease).

(Step S5) Next, the user inputs the texture animation state value for the triangular object.

That is, the control device 1 displays the following on the data display device 8a and puts the data input device 3 into a data input waiting state. Then, the user types the numerical value corresponding to the item following the arrow of each item on the display using the keyboard, and the mapping image number 2
(Person image) and animation number 2 (color conversion process) are input.

<Input of triangle texture animation state value> Mapping image number NT ---> 2 Animation number NA ---> 2 Next, the control unit displays the animation number 2 above, that is, color conversion. In response to the designation of processing, the data display device 8a
The following display is displayed to prompt the user to input the initial value of each variable of the color conversion processing animation. The user uses the keyboard to perform numerical data for each item in the same manner as above.

○ Enter the initial value of each variable of color conversion process ・ R change speed SR ---> 10 ・ R change increase / decrease direction DR ---> 1 ・ G change speed SG --- -> 20 ・ Increase / decrease direction of change of G DG --->-1 ・ Speed of change of B SB ---> 30 ・ Increase / decrease direction of change of B DB --->-1 However, R, G, B respectively The increase / decrease direction of the color change is 1
The value shall be either (increase) or -1 (decrease). Then, these input values are stored in the file device 7.

(Step S6) Next, in response to a command from the control device 1, the command input device 2 enters a command input waiting state, and if the user inputs YES, the process proceeds to the next step (CG animation starts) and NO is input. Then, the process returns to step S1 (input is redone from the beginning).

(Step S7) The CG animation main part is processed by the command of the control device 1, and the CG animation process is ended when an appropriate end command is given.

Next, the processing performed in step S7, which is the main part of the CG animation processing, will be described with reference to FIG.

FIG. 11 is a flowchart showing the processing performed in the main part of the CG animation.

The processing method will be described in detail below according to the data flow.

(Step T1) The command of the control device 1 causes the mouse, which is the command input device 2, to enter the command input check state, and when the user gives a command to end the CG animation by pressing the middle button of the mouse, CG
End the animation processing, and if not, proceed to the next step.

(Step T1 ') According to the instruction of the control device 1, the mouse which is the command input device 2 is in the command input check state, and if the user has pressed the left button of the mouse, within the respective animation state values of the rectangle and the triangle. The texture number NT of is updated as follows.

NT ← NT + 1 However, if NT exceeds the total number of texture images by this calculation, NT ← 1 is set.

(Step T1 ") By the command of the control device 1, the mouse which is the command input device 2 is in the command input check state, and if the user has pressed the right button of the mouse, within the rectangular and triangular animation state values. The animation number NA of is updated as follows.

NA ← NA + 1 However, if NT exceeds the total number of types of texture animation by this calculation, NA ← 1.

(Step T2) In response to a command from the control device 1, the space ball, which is the viewpoint input device 11, has components Dx and D in the X, Y, and Z directions of the movement vector, respectively.
The y, Dz, and the left and right rotation components Dα, Dβ in the rotation direction are measured and stored in the file device 7.

(Step T3) In accordance with a command from the control unit 1, the arithmetic unit 6 has Dx, Dy, Dz in the file unit 7.
The position Xe, Ye, Ze of the viewpoint is updated by the following equations: Xe ← Xe + Dx Ye ← Ye + Dy Ze ← Ze + Dz Similarly, using Dα and Dβ in the file device 7, the azimuth α and the elevation β Update with.

Α ← α + Dα β ← β + Dβ Then, these new Xe, Ye, Ze, α and β are stored in the file device 7.

(Step T4) In response to a command from the control unit 1, the arithmetic unit 6 receives Dx, Dy, D in the file unit 7.
The animation state value is updated using z, Dα, and Dβ.

First, the arithmetic unit 6 updates the animation state value of the texture image for which the mosaic processing animation is being performed at this point using Dα and Dβ, for example, as follows.

Sm ← Sm + omit (Dα) Dm ← Dm * mark (Dβ) N ← N + Sm * Dm (where N <Nmin: N ← Nmin, or
If N> Nmax: N ← Nmax) Nmin ← Nmin (no change) Nmax ← Nmax (no change) where omit (A) is a function that rounds down the decimal point of A, and mark (B) is the sign of B Is a function that returns 1 and −1 depending on whether it is positive or negative.

Next, the arithmetic unit 6 updates the animation state value indicating the color conversion processing on the triangle using Dx, Dy, and Dz, for example, as follows.

SR ← SR + omit (Dx) DR ← DR × mark (Dy) SG ← SG + omit (Dy) DG ← DG × mark (Dz) SB ← SB + omit (Dz) DB ← DB × mark (Dx) And these updates The value is stored in the file device 7.

(Step T5) In response to a command from the control device 1, the image processing device A9 uses the texture animation state variable of the object for the image of the landscape in the file device 7 which is also designated as a rectangular object. The specified mosaic processing is applied to the rectangular object.

Similarly, in response to a command from the control device 1, the image processing device B10 uses the texture animation state variable of the triangular object to compare the triangular object with the image of the person in the file device 7 designated as the triangular object. The color conversion processing specified in is applied.

Then, the two processed texture images are stored in the file device 7.

(Step T6) In accordance with a command from the control unit 1, the arithmetic unit 6 performs image rendering processing.

First, the arithmetic unit 6 creates a background image having the same size as the generated image, and initializes all pixels with, for example, black color data, (R, G, B) = (0, 0, 0). To do.

Then, the arithmetic unit 6 uses the viewpoint condition value in the file unit 7 by the rendering method described above,
Similarly, a quadrangle object in space is mapped to the texture after the mosaic processing in the file device 7, and an object is drawn at an appropriate position on the created background image.

Similarly, the arithmetic unit 6 maps the texture after the color conversion processing in the file unit 7 to the triangular object in the space by using the viewpoint condition value in the file unit 7 by the rendering method described above. The object with the mark is drawn at an appropriate position on the background image.

However, it is assumed that the texture mapping to these two plane objects is set so that the central axis of the projection in the above-mentioned perspective coordination is perpendicular to the plane object.

The generated image obtained as a result is stored in the file device 7.

(Step T7) In response to a command from the control device 1, the image display device 8 displays the generated image in the file device 7 (outputs the generated image to the image display device), and then returns to step S8.

As described above, according to the present invention,
A texture animation state value unique to each object existing in the three-dimensional space is changed, and the texture animation state value is changed in the process of generating a plurality of images forming a CG animation. And the texture animation executed for that texture to another texture, another texture animation, or each texture animation when the same animation is executed for textures on different objects A computer-aided computer graphics animation that realizes unprecedented artistic CG animation in which the texture mapped to each object dynamically changes by changing the texture animation variable in the state value. It is possible to provide a chromatography data graphics devices.

Therefore, if a plurality of texture animations are prepared in advance, even if the number of input texture images is small, a CG animation that realizes a texture animation having a variety of variations using the few images can be obtained. It will be possible.

The present invention may be applied to a system composed of a plurality of devices or a system composed of one device.

It goes without saying that the present invention can also be applied to the case where it is realized by supplying a program to a system or an apparatus.

[0133]

As described above, according to the present invention,
And to each surface of each object existing in three-dimensional space one
By assigning texture image data and a unique texture animation state value, and changing the texture animation state value in the process of generating a plurality of images forming a CG animation, the same animation is executed for textures on different objects. If the texture animation variable in each texture animation state value is changed and the movement is changed, the texture mapped to each object dynamically changes.
Animation can be realized.

Therefore, if a plurality of texture animations are prepared in advance, even if the number of input texture images is small, a CG animation that realizes a texture animation having a variety of variations using the few images is provided. It will be possible.

[Brief description of drawings]

FIG. 1 is a block diagram of an image processing apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram showing a three-dimensional object in a modeling coordinate system.

FIG. 3 is a diagram showing four coordinate systems for projection conversion.

FIG. 4 is a conceptual diagram showing projection conversion.

FIG. 5 is a conceptual diagram showing the correspondence between screens and display images.

FIG. 6 is a diagram showing a space ball.

FIG. 7 is a conceptual diagram for explaining mosaic processing.

FIG. 8 is a conceptual diagram showing a state of texture mapping.

FIG. 9 is a diagram showing the appearance of an object subjected to texture mapping.

FIG. 10 is a flowchart showing the entire CG animation processing.

FIG. 11 is a flowchart showing the processing of the main part of CG animation processing.

[Explanation of symbols]

1 control device 2 Command input device 3 data input device 4 Image input device 5 Imaging device 6 arithmetic unit 7 file device 8 Image display device 8a Data display device 9 Image processing device A 10 Image processing device B

Front page continued (58) Fields investigated (Int.Cl. ⁷ , DB name) G06T 17/40 G06T 15/00 G06T 15/70 CSDB (Japan Patent Office)

Claims (4)

(57) [Claims] 1. A data input unit for modeling by inputting three-dimensional shape data of an object, an image input unit for inputting texture image data, and the image input for each surface constituting the three-dimensional shape data. with corresponding one of the texture image data input by means
And the technology associated with each surface by the associating means.
The state value input means for inputting the initial value of the state value used when performing a predetermined animation process on the stature image data, and the state value input by the state value input means for each surface are included in the initial value. State value updating means for updating each based on the change speed information, image processing means for processing each of the one texture image data based on the state value for each surface, and a texture image generated by the image processing means data <br/>, image producing means for producing an image subjected to texture mapping performed corresponding texture mapping on each side, characterized in that it comprises an image display means for displaying the generated image Image processing device. 2. The image processing apparatus according to claim 1, further comprising changing means for changing a viewpoint while displaying the three-dimensional object by the image displaying means. 3. The image processing apparatus according to claim 1, wherein the animation state value in the texture animation is variable during execution of the computer graphics animation. 4. A data input step of modeling by inputting three-dimensional shape data of an object, an image input step of inputting texture image data, and the image input for each surface constituting the three-dimensional shape data. Correspond to one texture image data input in the process
And the technology associated with each of the faces by the associating step.
The state value input step of inputting the initial value of the state value used when performing a predetermined animation process on the stature image data , and the state value input in the state value input step for each surface is set to the initial value. A state value updating step of updating each based on the included change speed information, an image processing step of processing each of the one texture image data based on the state value of each surface, and an image processing step generated by the image processing step. A texture image data , an image generating step of performing texture mapping on each corresponding surface to generate an image subjected to the texture mapping, and an image displaying step of displaying the generated image. Image processing method.