JP2002208024A - Method and device for generating agent character animation dataset, and recording medium recorded with generation program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow a user to freely and easily generate an agent character animation dataset according to his or her own tasters or the like. SOLUTION: The user generates characters by selecting component data from preliminarily prepared components according to his or her own taste or the like (a step S1 and a step S2). Then, the listed-up animations of respective operation are generated by rendering by using the generated characters (step S3-S6), and the animations generated by rendering concerning all the operations are gathered as a final agent character animation dataset (a step S7). The generated agent character animation dataset is used by a display system. and the agent characters customized by the user are displayed on the screen.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to generation of an agent character moving image data set, and more particularly to a method and apparatus for generating a customized agent character moving image data set and a recording medium recording a generating program. The present invention relates to a method and apparatus for generating an agent character moving image data set capable of freely customizing characters, and a recording medium on which a generating program is recorded.

[0002]

2. Description of the Related Art In recent years, a user interface for displaying an agent character in various situations and causing the agent character to perform various actions and utterances has been rapidly spreading.

[0003] As such an agent character display system, Microsoft's MS-Agent is used.
Are well known, and there are some agent character display systems using the same method. These agent character display systems use an agent character moving image data set in which moving image data generated in advance is collected, extract necessary moving image data from the agent character moving image data set as needed, and display the data on a display device. Is generally performed.

[0004] The following method is usually used to generate the agent character moving image data set used here.

First, the actions of the agent character are listed in advance. Next, a moving image of the motion is generated for each of the listed motions. Here, the generation of the moving image includes photographing a real person, photographing a doll, CAD,
There are various methods such as generating using CG, creating using various general-purpose CG tools, etc., all of which require a great deal of labor and time, and also require the creator's skill. It was work to be done.

[0006] Finally, the generated moving images are put together by an agent character moving image data set generation program to generate an agent character movement data set.

[0007]

As described above, in the conventional agent character moving image data set generation method, the operation of generating an operation for each of the listed operations is extremely time-consuming. It was also a work that required the skill of the operator. In other words, generating many types of agent character moving image data sets requires a great deal of time and is a difficult task.

[0008] Further, as an apparatus for reducing the trouble of generating a moving image, techniques disclosed in “Animation creating apparatus” of Japanese Patent Application Laid-Open No. H10-134202 and techniques cited and introduced in the same publication are available. Although various types are known, all of them are means for generating a single moving image, and when many types of moving images are generated, there remains a problem that it takes a lot of trouble. for that reason,
Conventional agent characters are fixed or, if they can be selected, can be selected from a small number of types.
Further, it has been extremely difficult for a user to freely generate and use an agent character according to his / her preferences.

SUMMARY OF THE INVENTION The present invention has been made in order to solve such a problem. It is an object of the present invention to provide an agent character moving image data which allows a user to freely and easily generate an agent character moving image data set according to his / her preferences. It is an object of the present invention to provide a set generation method and a generation apparatus and a recording medium on which a generation program is recorded.

[0010]

According to an aspect of the present invention, there is provided an agent character moving image data set generating method for generating a moving image data set for displaying an agent character on a screen. The first step of performing the customization of the agent and the customized agent character
A second procedure for generating a set of moving image data by selecting various types of operation data prepared in advance by a user.

Further, as the first procedure, it is possible to adopt a procedure of customizing the agent character by selecting various kinds of component data prepared in advance by the user. Further, as the first procedure, it is possible to adopt a procedure in which a user inputs an arbitrary image and customizes the agent character by using the input image data as a part of the agent character. is there. Furthermore, as the first procedure, when the user selects various component data prepared in advance, and when the user inputs an arbitrary image, the selected component data and the input image data are input. By using as a part of the agent character, a procedure for customizing the agent character can be adopted.

According to the present invention having the above features,
The procedure for generating the agent character moving image data set is as follows.

First, a user selects component data from prepared components according to his / her preference. Here, the part data includes, for example, eyes, eyebrows, nose, mouth, face contour, body, hands,
It is data of feet, clothes, etc.

In addition to the method of simply selecting parts,
For example, by inputting an image such as a face photograph and pasting the input image as a texture on, for example, a face contour part, it is possible to generate a character as if the person in the input image had become a character.

Using the character thus generated, a moving image for each of the listed actions is generated by rendering. Specifically, operation data is prepared for each operation. Here, the operation data is the position of each part,
This is a set of parameters necessary for generating a moving image, such as movement of an angle and changes in facial expressions.

Finally, the moving images generated by rendering for all the operations are summarized as a final agent character moving image data set. The display unit uses the agent character moving image data set generated in this way, and displays the agent character customized by the user on the screen.

That is, the user selects component data,
Or just enter an image, or both,
According to the user's preferences, etc., a freely customized agent character can be easily created and used.

Further, as such component data of the agent character, it is possible to use component data composed two-dimensionally or component data composed three-dimensionally.

Also, the agent character moving image data set generating device of the present invention is a device for generating a moving image data set for displaying an agent character on a screen, the first means for executing customization of the agent character, A second means for generating a set of moving image data by selecting a variety of motion data prepared in advance by the user for the customized agent character.

Further, the apparatus further comprises storage means for storing various component data prepared in advance, wherein the first means comprises:
The agent character is customized by selecting an arbitrary part data from the part data stored in the storage means.

The image processing apparatus may further include image input means for inputting an image, wherein the first means uses the image data input by the image input means as a part of the agent character to customize the agent character. It is characterized by executing.

The apparatus further comprises both the storage means and the image input means, wherein the first means allows a user to select arbitrary part data from the part data stored in the storage means, and When the user inputs an arbitrary image by means, the agent character customization is performed by using the selected component data and the input image as a part of the agent character.

The recording medium on which the agent character moving image data set generating program of the present invention is recorded
A computer-readable recording medium recording a program for generating a moving image data set for displaying an agent character on a screen, comprising: a first step of customizing an agent character; A second step of generating a set of moving image data by selecting various kinds of operation data prepared in advance.

As the first step, a step of customizing the agent character by selecting various kinds of component data prepared in advance by the user can be adopted. Further, as the first step, a step of inputting an arbitrary image by a user and executing customization of the agent character by using the input image data as a part of the agent character can be adopted. is there. Furthermore, as the first step, the user selects various component data prepared in advance, and the user inputs an arbitrary image,
A step of customizing the agent character by using the selected component data and the input image data as a part of the agent character can be adopted.

[0025]

Embodiments of the present invention will be described below with reference to the drawings.

[First Embodiment] FIG. 1 is a functional block diagram showing a first embodiment of a method and apparatus for generating an agent character moving image data set according to the present invention.

The generating device according to the first embodiment includes a CPU 1 and an R
OM2, RAM3, storage unit 4, operation input unit 5, display unit 6
It consists of.

The CPU 1 is a central processing unit. R
OM2 stores a control program for controlling the operation of the entire apparatus, and also stores an agent character moving image data set generation program. R
The AM 3 stores various data generated by executing the agent character moving image data set generation program, and serves as a work area when the CPU 1 executes a processing operation by the various programs stored in the ROM 2. It is a working block. The storage unit 4 is a block for storing various component data and operation data sets used by the agent character, and specifically, a memory and a hard disk drive (H
DD) and the like. The operation input unit 5 is a block in which a user performs an operation input, and is specifically an input device such as a keyboard and a mouse. The display unit 6
It is a block for performing various displays, and is specifically a display device such as a CRT or LCD.

As described above, the storage unit 4 stores various component data and motion data sets used by the agent character. Here, in the first embodiment,
As the agent character, a human or a character (robot or the like) having a similar shape is used. In addition, a character having a characteristic different from that of a human or a similar shape, such as a four-legged animal, is used. It is also possible to use. Parts data includes eyes, eyebrows,
Nose, mouth, face contour, body below the neck, hand, foot,
And clothing. However, in addition to such classification, various classification methods other than the classification method in the first embodiment, such as preparing the body and limbs as separate parts and preparing hairstyle parts, are considered. It is easy to apply. In the first embodiment, the component data is created as two-dimensional vector image data.

An operation data set is a set of data for operating an agent character and generating a moving image. That is, the motion data set is a set of motion data relating to each of the listed motions, and the motion data corresponding to each motion includes the position, angle, and deformation parameters of each component at each time. The component classification in the operation data is different from the component classification selected by the user. For example, in the user's selection, the arms, legs, and torso are treated as a body as a whole, but in the motion data, the arms, legs, and torso are treated as separate parts.

Next, a processing procedure for generating an agent character moving image data set by using the generating apparatus having the above configuration will be described with reference to a flowchart shown in FIG. 2, a conceptual diagram of agent character generation using a combination of parts shown in FIG. A description will be given with reference to a conceptual diagram of operation generation based on the operation data set shown in FIG.

The user uses the operation input unit 5 to select a component from various component data stored in the storage unit 4 (steps S1 and S2). The result of the selection is displayed on the display unit 6. FIG. 3 shows an example of a character generated as a result of the selection. In FIG. 3, reference numerals 301 to 310 represent various prepared components. Reference numeral 311 represents an example of an agent character created by making a selection from the above components. In this example, the part 309 is selected for the face outline, the part 301 is selected for the eyes, the part 307 is selected for the nose, the part 303 is selected for the mouth, and the part 305 is selected for the body.

A series of customizing operations of the agent character by selecting such parts are performed by the operation input unit 5.
When the user presses a customization end button (not shown) (the judgment is Yes in step S2), the process ends.

After the customization is completed, the selected component and the motion data set are combined, and a moving image of the agent character is generated by rendering. That is, operation data relating to a predetermined operation is extracted from the operation data set, and then each parameter at a predetermined time is extracted from the extracted operation data (step S3).
Then, according to the extracted parameters, the position of each part,
The angle is determined, a deformation process is performed, and a rendering image is generated (step S4).

FIG. 4 is a conceptual diagram of an example in which parts are arranged and deformed according to these parameters. Reference numeral 401 in the figure
Is an action set, and reference numeral 402 is an example of an agent character when each component is arranged at a standard position. Each agent character indicated by reference numerals 403 to 405 below it represents an example of a result of arranging and deforming each component according to parameters extracted from the respective motion data sets. It should be noted that the details of the rendering here can be easily realized by a person skilled in the art, and thus detailed description is omitted here.

As described above, one image constituting a moving image is generated. Such processing is performed for all necessary times to generate a moving image. That is, step S
Steps S3 and S4 are repeated until YES is determined in step 5. Further, the processing of steps S3 to S5 is performed for all the operations (that is, until the determination in step S6 is Yes), and a series of images is generated.

Finally, the moving images corresponding to all the generated actions are put together to generate an agent character moving image data set (step S7). Here, “to put together” means to attach index information for determining which moving image is necessary for display, prepare the data into a format usable by the display unit 6, and create an agent character moving image data set. This means outputting to the display unit 6. In the first embodiment, the data is output as a single file. However, the agent character moving image data set may be a single file, a plurality of files classified for each group, or a completely different file for each moving image or index, and various formats are conceivable. Also, as the display unit 6 for displaying the agent character, actually various types are used, and it is easy to apply these various types to the present invention.

The display unit 6 uses the agent character moving image data set generated in this way, and the agent character is displayed on the screen. That is, the agent character customized by the user is displayed on the screen and used.

[Second Embodiment] FIG. 5 is a functional block diagram showing a second embodiment of the method and apparatus for generating an agent character moving image data set according to the present invention.

The generating device according to the second embodiment includes a CPU 1 and an R
It comprises an OM 2, a RAM 3, a storage unit 4, an operation input unit 5, a display unit 6, and an image input unit 7.

That is, the generator of the second embodiment is different from the generator of the first embodiment only in that only the image input unit 7 is added.
Since the configuration is completely the same, the same reference numerals are given to the same blocks, and the detailed description is omitted.

The image input unit 7 is a block for inputting an image, and is specifically a device such as a CCD camera, a digital still camera, a video capture, and a scanner.

Next, a processing procedure for generating an agent character moving image data set by using the generating apparatus having the above configuration will be described with reference to a flowchart shown in FIG. 6, a conceptual diagram of agent character generation by inputting an image shown in FIG.
A description will be given with reference to a conceptual diagram of an image modification example based on the operation data set shown in FIG.

The user inputs an image and customizes the agent character using the image (steps S11 and S12). More specifically, an image to be input (such as a photograph of a face) is set in the image input unit 7 and the image is input. By pasting, the agent character is customized. The result of the customization is displayed on the display unit 6. FIG. 7 shows an example of customization. In FIG.
Only the face portion of the input image 701 is extracted, the inclination is corrected by rotation, and the agent character 702 is extracted.
Paste on the face of. As a result, a customized original agent character 703 is created.

A series of customizing operations of the agent character by inputting such an image are performed by the operation input unit 5.
When the user presses an unillustrated customization end button (determined as Yes in step S12), the process ends.

After the customization is completed, the customized parts of the agent character and the motion data set are combined, and a moving image of the agent character is generated by rendering. That is, operation data relating to a predetermined operation is extracted from the operation data set, and then each parameter at a predetermined time is extracted from the extracted operation data (step S13). Then, according to the extracted parameters, determine the position and angle of each part,
By performing a deformation process, a rendering image is generated (step S14). Here, in the second embodiment, in addition to the position, angle, and deformation parameter of each component,
A parameter for controlling the deformation of the image is entered. Then, a moving image of an expression obtained by deforming the face image using the parameters is also synthesized (steps S13 and S14).

FIG. 8 shows an example in which facial expressions are synthesized by image deformation. In FIG. 8, image deformation is performed on the eyes and the mouth, and a smile expression is synthesized. Reference numeral 8 in the figure
The image of the face denoted by reference numeral 01 is an image before the transformation processing is performed, reference numeral 8
The image of the face indicated by 02 is an image after the image processing of the eyes and the mouth is subjected to the deformation.

As described above, one image constituting a moving image is generated. Such processing is performed for all necessary times to generate a moving image. That is, step S
Steps S13 and S14 are repeated until the determination at 15 is Yes. Further, step S
The processing from step 13 to step S15 is performed for all the operations (that is, until the determination in step S16 is Yes), and a series of images is generated.

Finally, the moving images corresponding to all the generated actions are put together to generate an agent character moving image data set (step S17).

The display unit 6 uses the agent character moving image data set generated in this way, and the agent character is displayed on the screen. That is, the agent character customized by the user is displayed on the screen and used.

In the second embodiment, the agent character is customized by pasting the image 701 input from the image input unit 7 onto the standard agent character 702 (see FIG. 7) prepared in advance. However, it is also possible to generate the agent character 702 by selecting and combining the component data from each component data as in the first embodiment, and to paste the input image onto the generated agent character.

In the first and second embodiments, the component data stored in advance in the storage unit 4 is described as two-dimensional component data. However, three-dimensional component data can be used. is there. Also in this case, the processing procedure for generating the agent character moving image data set is as follows.
Since the processing procedure is the same as that described in the first and second embodiments, the description will be omitted here.

Further, both two-dimensional data and three-dimensional data may be prepared as part data. Specifically, the eye and mouth parts are created in two dimensions,
Create other parts such as face shape, nose, body, etc. in three dimensions.
Then, the parts created in two dimensions are arranged and deformed to generate a rendered image.
It is used by being pasted as a texture image of a part created in two dimensions. Various types and classifications of the components and classifications created in two dimensions and the types and classifications of components created in three dimensions can be considered in addition to the types and classifications in the first and second embodiments. It is easy to apply them to the present invention.

As described above, in the agent character moving image data set generating apparatus described in the first and second embodiments, the processing of generating the moving image data set of the agent character is realized by the program stored in the apparatus. This program is stored in a computer-readable recording medium. In the present invention, the recording medium is stored in the ROM. However, the recording medium may be a program medium provided with a program reading device (not shown) inside the device and readable by inserting the recording medium therein. In any case, the stored program may be configured to be directly accessed and executed, or in any case, the program may be read, and the read program may be downloaded to the main storage memory or the like. A method in which the program is executed may be used. It is assumed that this download program is stored in the apparatus in advance.

Here, the program medium is a recording medium configured to be separable from the main body, such as a tape system such as a magnetic tape or a cassette tape, a magnetic disk such as a floppy disk or a hard disk, a CD-ROM / MO /
Disk system of optical disk such as MD / DVD, card system such as IC card / optical card, mask ROM, EP
It may be a medium that fixedly carries a program, including a semiconductor memory such as a ROM, an EEPROM, and a flash ROM.

[0056]

According to the present invention, the first procedure for customizing an agent character and the setting of moving image data by selecting various motion data prepared in advance by the user for the customized agent character , The user can freely and easily customize and use the agent character.

Further, according to the present invention, the first procedure can be a procedure for executing customization of the agent character by selecting various component data prepared in advance by the user. This allows the user to freely customize and use the agent character by simple means of selecting parts.

Further, according to the present invention, the first procedure is a procedure in which the user inputs an arbitrary image and customizes the agent character by using the input image data as a part of the agent character. It can be. Thus, the user can create and use an original agent character by a simple means of inputting an image.

Further, according to the present invention, the first procedure is performed by selecting various component data prepared in advance by the user, and by inputting an arbitrary image by the user.
By using the selected component data and the input image data as a part of the agent character, a procedure for customizing the agent character can be performed. Thus, the user can create and use an agent character having higher originality by two means of selecting a part and inputting an image.

According to the present invention, the user can easily create and use an original agent character by using small-capacity two-dimensional component data as the agent character component data.

According to the present invention, by using three-dimensional part data as the part data of the agent character, the user can create an original agent character having more expressive and realistic features. Can be used.

Further, according to the present invention, two-dimensional parts having a small capacity are used while using three-dimensional data having a high expressive power and real characteristics as compared with two-dimensional. It is possible to create and use an original agent character having higher expressiveness and real features from a smaller volume of component data.

[Brief description of the drawings]

FIG. 1 is a functional block diagram showing a first embodiment of a method and a device for generating an agent character moving image data set according to the present invention.

FIG. 2 is a flowchart illustrating a processing procedure for generating an agent character moving image data set according to the first embodiment.

FIG. 3 is a conceptual diagram of generating an agent character by combining parts.

FIG. 4 is a conceptual diagram of generation of a motion by a motion data set.

FIG. 5 is a functional block diagram showing a second embodiment of a method and a device for generating an agent character moving image data set according to the present invention.

FIG. 6 is a flowchart illustrating a processing procedure for generating an agent character moving image data set according to the second embodiment.

FIG. 7 is a conceptual diagram of generating an agent character by inputting an image.

FIG. 8 is a conceptual diagram of an image modification example using a motion data set.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 CPU 2 ROM 3 RAM 4 Storage part 5 Operation input part 6 Display part 7 Image input part

Claims (18)

[Claims] 1. A method for generating a moving image data set for displaying an agent character on a screen, comprising:
And a second step of generating a set of moving image data by allowing the user to select various kinds of operation data prepared in advance for the customized agent character. Dataset generation method. 2. The method according to claim 1, wherein the first step is a step of customizing an agent character by selecting various parts data prepared in advance by a user. . 3. The first procedure is a procedure in which a user inputs an arbitrary image and customizes the agent character by using the input image data as a part of the agent character. 3. The method for generating an agent character moving image data set according to item 1. 4. In the first procedure, when a user selects various component data prepared in advance, and when the user inputs an arbitrary image, the selected component data and the input image are selected. 2. The method according to claim 1, wherein the customizing of the agent character is performed by using the data as a part of the agent character. 5. The component data of the agent character is two-dimensionally configured component data.
5. The method for generating an agent character moving image data set according to claim 4. 6. The component data of the agent character is component data configured three-dimensionally.
5. The method for generating an agent character moving image data set according to claim 4. 7. The part data of the agent character is two-dimensionally structured part data and three-dimensionally structured part data.
The agent character moving image data set generation method according to any one of the above. 8. An apparatus for generating a moving image data set for displaying an agent character on a screen, wherein the first apparatus executes customization of the agent character.
Means for generating a set of moving image data by a user selecting various kinds of operation data prepared in advance for a customized agent character, the agent character moving picture characterized by the above-mentioned. Data set generator. 9. A storage device for storing various kinds of component data prepared in advance, wherein the first means allows a user to select arbitrary component data from the component data stored in the storage device. 9. The agent character moving image data set generation device according to claim 8, wherein the agent character customization is performed by: 10. An image input means for inputting an image, wherein the first means uses the image data input by the image input means as a part of the agent character to customize the agent character. 9. The agent character moving image data set generating apparatus according to claim 8, wherein the apparatus executes. 11. An electronic apparatus further comprising: storage means for storing various types of component data prepared in advance; and image input means for inputting an image. When the user selects arbitrary part data, and when the user inputs an arbitrary image from the image input means, the selected part data and the input image are used as a part of the agent character. 9. The agent character moving image data set generation device according to claim 8, wherein the agent character customization is performed. 12. The agent character moving image data set generating apparatus according to claim 8, wherein the part data of the agent character is two-dimensionally structured part data. 13. The agent character moving image data set generation apparatus according to claim 8, wherein the part data of the agent character is three-dimensionally structured part data. 14. The agent character moving image according to claim 8, wherein the part data of the agent character is two-dimensional part data and three-dimensional part data. Data set generator. 15. A computer-readable recording medium on which a program for generating a moving image data set for displaying an agent character on a screen is recorded, wherein a first program for customizing the agent character is provided.
And a second step of generating a set of moving image data by selecting various kinds of operation data prepared in advance by the user for the customized agent character;
A recording medium on which an agent character moving image data set generation program is recorded. 16. The program according to claim 15, wherein the first step is a step of customizing the agent character by selecting various parts data prepared in advance by a user. Recording medium on which is recorded. 17. The method according to claim 15, wherein the first step is a step of inputting an arbitrary image by a user and customizing the agent character by using the input image data as a part of the agent character. A recording medium recording the agent character moving image data set generation program according to 1. 18. In the first step, when the user selects various component data prepared in advance, and when the user inputs an arbitrary image, the selected component data and the input image are selected. The recording medium according to claim 15, wherein the step of customizing the agent character is performed by using the data as a part of the agent character.