JP5639440B2 - CG character production device and CG character production program - Google Patents

Description

  The present invention relates to a CG character production apparatus and a CG character production program, and more particularly to a CG character production apparatus and a CG character production program for a user to easily produce a CG character with a facial expression.

  Conventionally, there is a technology for automatically producing video content such as a program based on CG (Computer Graphics) based on a simple script description (see, for example, Patent Document 1). In such a technique, for example, by only inputting a script into an effect adding unit called APE (Automatic Program Engine), a predetermined action or dialogue is given to a specific CG character or the like stored in advance corresponding to the description of the script. It is possible to generate detailed information (for example, a TV program making language (TVML) script) for generating the video content that makes the image appear to be blurred.

  Conventionally, the above-described TVML script is input to a playback unit such as a video content generation engine (hereinafter referred to as a TVML player (Player)) to generate video content suitable for the script, and the generated content is displayed on a screen or the like. It is output and presented to the user. With such a mechanism, anyone can easily produce video content without any experience or technology of video content production or technology or knowledge about CG.

  Therefore, it is a script that can be used for the entire production of video content such as TV programs. In addition to the CG character's inflection and movement, lighting, cameras, sets, props, superimposes, movies, BGM, etc. Can describe all necessary functions.

  In general, a CG character appearing in video content can be automatically punctured by just inputting a line without specifying in detail the movement of the CG character, such as mouth opening / closing information. The character's mouth can be opened and closed in response to real-time voice input. Further, in the prior art, blinking and shaking are generated at an appropriate timing without detailed description.

  Note that the production of a CG character that appears in video content in the past is composed of, for example, shape data, texture data, bone data, and the like, and the shape changes accordingly when the bone is moved (see, for example, Patent Document 2). Further, these shape data have information of a surface surrounded by a plurality of vertices and texture information mapped thereon, and the deformation of the shape is realized by moving the vertices. Therefore, in an animation in which a CG character moves, it is necessary to generate movements of limbs and facial expressions, eyes and mouth, and change the shape accordingly. Therefore, in particular, in order to change the blink of the eyes and the mouth, it is necessary to finely create a face shape using a lot of vertex data and control the vertex data around the eyelids and the mouth (for example, see Non-Patent Document 1) .

  Here, FIG. 1 is a diagram for explaining a CG character production method in the prior art. 1A shows the face of the CG character with the mouth closed, FIG. 1B shows the face of the CG character with the mouth open, and FIG. FIG. 1D shows an enlarged view around the eyes of the CG character with the eyes open. FIG. 1D shows an enlarged view around the eyes of the CG character with the eyes closed.

  As shown in FIGS. 1A to 1D, the CG character is composed of a set of polygons corresponding to each shape, and is represented as a set of triangles. These triangular polygons are defined by three vertices, and a large number of smaller polygons are required to enable fine deformation. For example, as shown in FIGS. 1 (a) and 1 (b) At the time of opening and closing, and at the time of opening and closing the eye as shown in FIGS. 1C and 1D, it is necessary to move many vertices around the eye, and this is the same when opening and closing the mouth.

JP 2008-257450 A JP-A-9-330424

Naoki Honjo, “Maya Beginners”, Chapter 10 Character Creation, BNN Corporation, July 20, 2007

  As described above, in conventional CG character production, it is necessary to move many vertices and adjust fine polygons in order to achieve natural eye blinks and mouth changes. Time preparation work is required. For this reason, it is very difficult for a general user who does not have the above-described technique to produce a CG character, and the production of a CG character requires the above-described specialized knowledge. It was entrusted to.

  That is, general users and non-professional users cannot produce CG characters, and it is difficult to customize CG characters created by experts for themselves.

  The present invention has been made in view of the above-described problems, and an object thereof is to provide a CG character production apparatus and a CG character production program for a user to easily produce a CG character with a facial expression.

  In order to solve the above problems, the present invention employs means for solving the problems having the following characteristics.

According to the first aspect of the present invention, in the CG character production device for producing a CG character using the texture image data, the image acquisition means for acquiring the respective images in the open / closed state of the eyes and mouth of the CG character model, An image obtained by the image acquisition means is used as the texture image data, and is applied to the surface data by the surface data pasting means to be pasted on the surface data having the shape set as the head of the CG character model, and the surface data pasting means. The pasted texture image data is divided into an upper half including the eyes of the CG character model and a lower half including the mouth of the CG character model, and the upper half corresponding to the dialogue or motion of the CG character model. And the lower half at each timing, and the CG character model Eye and have a texture changing means for changing the opening and closing state of the mouth, the texture changing means, generating a CG character definition file that defines the change condition for switching the texture image data to be pasted on the surface data Features.

  According to the first aspect of the present invention, the user can easily produce a CG character with a facial expression.

The invention described in claim 2 includes screen generation means for generating a guide screen for fixing the position of the face at the time of photographing so that the images acquired by the image acquisition means have the same face size. It is characterized by that.

According to a third aspect of the present invention, there is provided program production means for producing a program using at least one CG character obtained by the texture changing means.

The invention described in claim 4 is a CG character production program for causing a computer to function as the CG character production apparatus according to any one of claims 1 to 3 .

According to the fourth aspect of the present invention, the user can easily produce a CG character with a facial expression. In addition, the CG character production process can be easily realized by installing the execution program in the computer.

  According to the present invention, a user can easily create a CG character with a facial expression.

It is a figure for demonstrating the production method of the CG character in a prior art. It is a figure which shows an example of a function structure of the CG character production apparatus in this embodiment. It is a figure which shows an example of the texture sticking in this embodiment. It is a figure for demonstrating the other Example of the texture change in this embodiment. It is a figure for demonstrating the definition content of the CG character in this embodiment. It is a figure which shows an example of the control content of the mouth part of the CG character in this embodiment. It is a figure which shows an example of the menu screen in this embodiment. It is a figure which shows an example of the screen displayed when taking a face photograph. It is a figure which shows an example of the production | presentation setting screen in this embodiment. It is a figure which shows an example of the image | video selection screen in this embodiment. It is a figure which shows an example of a dialog setting screen. It is a figure which shows an example of the audio | voice input screen in this embodiment. It is a figure which shows an example of the program reproduction screen in this embodiment. It is a flowchart which shows an example of the CG character production process procedure in this embodiment. It is a flowchart which shows an example of the program production process sequence in this embodiment.

<About the present invention>
In the production of a CG character that appears (appears) in video content such as a program, for example, the present invention prepares a plurality of images showing opening and closing of the mouth and opening and closing of the eyes, particularly for the production of a face. By switching according to the above conditions, a simple face shape composed of a small number of polygons is created.

  With this configuration, since detailed shape deformation is not performed, a head model having a simple shape such as a cube or a sphere can be produced, so even a general user can easily use a simple CG tool. A CG character can be produced. Although an image may be created, a CG character that is real and customized by the user can be produced by using a photograph taken by an imaging means such as a camera. That is, since only the contents described above are prepared by the general user, a customized character can be easily produced.

  Hereinafter, a preferred embodiment of a CG character production apparatus and a CG character production program according to the present invention having the above-described features will be described in detail with reference to the drawings.

<CG character production device: schematic configuration example>
FIG. 2 is a diagram illustrating an example of a functional configuration of the CG character production apparatus according to the present embodiment. The CG character production apparatus 10 shown in FIG. 2 includes an input unit 11, an output unit 12, a storage unit 13, an image acquisition unit 14, a surface data pasting unit 15, a texture changing unit 16, and a program production unit 17. And a reproduction means 18, a screen generation means 19, a transmission / reception means 20, and a control means 21.

  For example, if the CG character production apparatus 10 is a general-purpose computer such as a PC, the input means 11 is a keyboard, a game pad, various controllers such as a mouse, a dedicated operation panel, a voice input device such as a microphone, or the like. Therefore, input of execution instructions (image acquisition instruction, surface data pasting instruction, texture change instruction, program production instruction, reproduction instruction, screen generation instruction, transmission / reception instruction) of each component in the present embodiment by input from a user or the like In addition, an operation input (operation content) for an object such as a CG character or a camera is received.

  The output means 12 includes the instruction content input by the input means 11, a CG character produced based on each instruction content, a screen for making various settings for producing a CG character and a program, Various kinds of information such as execution results and error information are displayed and output. The output unit 12 has a screen display function such as a display, a sound output function such as a speaker, and the like.

  The accumulating unit 13 is obtained by the various programs for executing the CG character production in the present embodiment, the image acquired by the image acquiring unit 14, the pasting result obtained by the surface data pasting unit 15, and the texture changing unit 16. Various parameters in the texture change to be made, the changed result, the reproduction result in the reproducing means 18, the setting condition generated by the screen generating means 19, the set result, and the data such as various information transmitted / received by the transmitting / receiving means 20 accumulate.

  The storage unit 13 can also acquire the various data described above from the external device connected to the communication network or the like by the transmission / reception unit 20. Various data stored in the storage means 13 can be read out as needed, and can be written and deleted.

  The image acquisition unit 14 acquires an image that becomes the face of the CG character. Specifically, for example, a face image of a person obtained by the imaging means 22 such as a camera provided outside the CG character production apparatus 10 is acquired. The acquired image may be an image of the user himself / herself, for example, another person such as a celebrity.

  The image acquired by the image acquisition unit 14 acquires a plurality of texture images including, for example, an image with eyes closed and an image with mouth open. Specifically, for example, in the face image, two images of an image with eyes and mouth closed and an image with eyes and mouth open are acquired. If the two images to be acquired can be taken with two images, one with open eyes and one with closed eyes, one with open mouths and one with closed mouths, the combination of opening and closing the mouth and eyes is either will do.

  In the present embodiment, the face sizes of the two images described above are preferably the same so that there is no difference when switching images, but one face image is enlarged or reduced as necessary. May be adjusted to the same face size.

  Thereby, a required image can be acquired easily. The image acquisition unit 14 may acquire a face image of a person such as a user, may be an animal such as a dog or a cat, and may be an animation image. The image may be drawn, but using a photograph can produce a more realistic and customized character.

  Here, for example, an existing digital camera can be used as the imaging unit 22. Further, the image acquisition unit 14 can store the image acquired by the imaging unit 22 or the like in the storage unit 13 or the like.

  The surface data pasting unit 15 pastes the image obtained from the image obtaining unit 14 on the surface data of a preset CG character. Specifically, the surface data pasting means 15 creates a simple face shape composed of a small number of polygons. The surface data pasting means 15 manages information on which part of the image is mapped (pasted) to which polygon. The specific contents of the surface data pasting means 15 will be described later.

  The texture changing unit 16 displays the CG character, and switches the image to which the face of the CG character is pasted using the image obtained from the image acquiring unit 14 according to the timing of opening / closing the mouth and opening / closing the eyes. Further, the texture changing means 16 controls the change of the texture image for opening and closing the eyes according to a predetermined interval such as blinking of the eyes of the CG character. Further, the texture changing unit 16 controls the change of the texture image for opening and closing the mouth according to the turning of the CG character.

  That is, in the present embodiment, facial expressions and actions are expressed only by switching images, and the shape of the head is not deformed. Therefore, the shape of the head model can be produced in a simple shape such as a cube or a sphere. Further, the texture changing means 16 can be changed by, for example, a general user using a simple CG tool or the like. Therefore, in this embodiment, the general user only needs to prepare the above-described switching image, and can easily create a customized character.

  Further, the texture changing unit 16 generates a CG character definition file for reflecting the above-described image change information on the CG character. Details of the CG character definition file will be described later.

  The program production means 17 has a function of producing a program using at least one CG character obtained by the surface data pasting means 15 and the texture changing means 16. Specifically, the program production means 17 sets the production content, the video used for the program, the speech of the CG character, the voice, etc., and the CG character produced in the present embodiment is made to appear based on the set content. Create a program.

  For program production, for example, TVML (TV program Making Language) can be used. TVML is a technology for automatically producing video content such as a program based on CG (Computer Graphics) based on a simple script description, and the script is input to an effect adding unit called APE (Automatic Program Engine). As a result, it is possible to generate detailed information (for example, a TVML script) for generating video content in correspondence with the description of the script. In addition, TVML is, because it is a script-based description language to produce a TV program, program production means 17, for example, that the word "Hello" is to be input to the APE as input text, APE the string analysis process carried out, etc., as the output text, "character: talk (name = CharacterA, text =" Hello ")" that it is possible to output the TVML script.

  The reproduction means 18 can actually reproduce the produced CG character using a TVML script and output video or audio by the output means 12 so that the user can confirm the expression and action of the CG character. it can.

  Note that the playback means 18 may be a TVML player, for example. The TVML player is software that interprets a TVML script, generates content such as a program using real-time CG, voice synthesis, and the like, and reproduces and outputs the content.

  The screen generation means 19 generates various screens necessary for CG character production in the present embodiment. For example, the execution screen of CG character production in this embodiment, the screen related to image acquisition processing, the screen related to surface data pasting, the screen related to texture change, the screen reproduced by the reproduction means 18, the execution progress in the CG character production device 10 Various screens such as execution results are generated so as to be output in a predetermined layout. Note that the screen generated by the screen generating means 19 is output by the output means 12 as video and / or usage guidance for the screen as audio.

  The transmission / reception means 20 transmits various control data, programs, CG character data (for example, hat, hairstyle, glasses, clothes, shoes, bag information, etc.), script data, material data, program production engine via a communication network. This is a communication interface for transmitting various data such as scripts to other devices and receiving the above-mentioned various data from other devices. The transmission / reception unit 20 can transmit and receive face image data separately from the image acquisition unit 14.

  The control means 21 controls the entire functional configuration of the CG character production apparatus 10. Specifically, the control unit 21 acquires an image based on input information from the user or the like input by the input unit 11 or pastes it on the plane data of the CG character set in advance using the acquired image data. Various controls are performed such as performing an attaching process, changing the texture by the texture changing unit 16, playing it back, generating various screens in the present embodiment, outputting the generated screens, and transmitting / receiving various data.

  As described above, according to the present embodiment, with respect to the realization of the CG character's facial expression change, for example, a plurality of textures including an eye closed state and an open state image, a mouth open state and a closed state image By preparing images and switching textures in real time, blinking and mouth shape change of a CG character can be realized easily and easily.

<About surface data pasting and texture change>
Next, specific examples of the surface data pasting process in the surface data pasting unit 15 and the texture changing process in the texture changing unit 16 in the present embodiment will be described with reference to the drawings. FIG. 3 is a diagram illustrating an example of texture pasting in the present embodiment.

  In the present embodiment, as shown in FIG. 3, a CG character model 30 having a plurality of character models excluding the head accumulated in the accumulation means 13 and the like and arbitrarily selected from the plurality of character models is set. Further, the head shape of the set CG character model is set (for example, a cube, a sphere, etc.), and the face image acquired by the image acquisition unit 14 is pasted as a texture on the set head model. The shape of the head is, for example, simple shape data such as a cube, a rectangular parallelepiped, or a sphere. Thereby, it can form with a simple polygon, without performing a complicated polygon structure.

  In this embodiment, when a face image is pasted as face data, the face data corresponding to the front face of the head of the CG character model 30 is divided into an upper area including eyes and a lower area including mouth. Divide. This is to separate the opening / closing image of the eyes and the opening / closing image of the mouth. By combining the divided data, the facial expression of the CG character model 30, particularly the eyes and mouth where the most characteristic features appear, is switched between the upper face half face and the lower face half face of the CG character model 30. Moreover, the timing of switching may be, for example, the timing of blinking eyes, and can be switched as appropriate according to how to open the mouth for each character of the speech, the timing to speak.

  Specifically, as shown in FIG. 3, a photographic image 31 with eyes and mouth open and a photographic image 32 with eyes and mouth closed are divided into an upper half and a lower half, respectively. That is, the upper half of the photographic image 31 is the image 31-a, and the lower half is the image 31-b. Similarly, the upper half of the photographic image is the image 32-a, and the lower half is the image 32-b. In the surface data pasting means 15, information on which surface of the cube of the head the photographic image 31 and the photographic image 32 are mapped is set in advance, whereby the image 31-a and the image 31-a The image 32-a, the image 31-b, and the image 32-b can be switched at each timing.

  Further, in FIG. 3, a CG model 33 of a hat worn by the CG character model 30 is set. As described above, in the present embodiment, for the clothes, hat, glasses, shoes, and the like worn by the CG character model 30, data relating to a plurality of appearances are stored in the storage unit 13 in advance, and are selected by the user or the like. Various CG character settings can be performed by mapping these images to corresponding portions of the CG character model 30.

  Here, the images 34-1 to 34-5 shown in FIG. 3 display the CG character 30 after being switched and mapped in accordance with each expression, and the CG model of the hat is also one of the CG character models 30. Has become a department.

  Specifically, in the CG character model 30 of the image 34-1, an image with open eyes is mapped to the upper front part of the head model, and an image with a closed mouth is mapped to the lower front part of the head model. Has been.

  Further, when the CG character model 30 speaks something, the mouth opens and closes in accordance with a preset voice file or voice input from an external microphone. In this case, the texture changing unit 16 performs mapping of the mouth portion by switching between the photographic image 31-b and the photographic image 32-b of the mouth corresponding to each character or each word of the input voice, and the image 34- As shown in FIG. 2, it is possible to easily display an image that is actually speaking. In the present embodiment, the photographic image 31-a and the photographic image 32-a are used for blinking at a preset periodicity or a predetermined rhythm even when the user is standing still or at rest. And blinking is performed as shown in an image 34-3.

  It should be noted that the eyelashes appear to move only by switching between two images consisting of an image with the eyes closed and an image with the eyes open. This is a so-called “apparent movement”, and utilizes the phenomenon that there is an illusion that there is a movement even though there is no movement. That is, in the present embodiment, by using an illusion that is an illusion about vision, a blink video can be easily presented to the user without a sense of incongruity.

  In the example of FIG. 3, since the image is pasted on the front of the cube head, as shown in the images 34-4 and 34-5, the CG character model 30 is directed obliquely from another viewpoint. Because there are few opportunities to shoot diagonally or behind, the color of the legislature is displayed as it is. As a result, the work load can be reduced, and a comical character unique to CG that is more familiar can be produced. In the present invention, the present invention is not limited to this. For example, a photographic image may be pasted so that the shape of the head is not a legitimate body but a sphere, and the entire surface is covered. You may color according to the color of hair, or according to the color designated beforehand.

  Further, as shown in an image 34-5 in FIG. 3, the CG character model 30 can display an operation such as moving a limb as an animation image. In this case, the mapping image is switched during the character display. Thus, blinking and opening / closing of the mouth can be realized.

<Another embodiment of texture change>
Here, another example of texture change in the present embodiment will be described with reference to the drawings. FIG. 4 is a diagram for explaining another example of texture change according to the present embodiment. In the example of FIG. 4, the facial expression is changed by enlarging or compressing an image of only a predetermined portion of one photographic image 41.

  Specifically, as shown in FIG. 4, by extending the top and bottom of the image from the center to the end of the photographic image 41, it can be changed to an angry face as shown in the modified image 42-a. Further, as it goes from the center of the photographic image 41 to the end portion, the upper and lower sides of the image are compressed, so that the face can be changed to a smile as shown in the modified image 42-b.

  Therefore, these deformed images are accumulated in the accumulating means 13, and the deformed image 43- whose display is changed in accordance with a dialogue or a set action (for example, “angry”, “fun”, etc.) by the CG character. It can be changed to a, 43-b and displayed. Note that the deformed image in the present embodiment is not limited to the above-described content, and for example, the left and right sides of the image may be stretched or compressed. Further, in the present embodiment, the facial expression can be changed by partially extracting the eyes and mouth from the luminance and color difference of the pixels by image analysis processing and changing the shape and orientation thereof. However, in that case, an image analysis process is separately required and the process becomes complicated. Therefore, when an image is deformed in the present embodiment, the above-described enlargement or compression is performed on the entire image. It is preferable. Thereby, a plurality of images can be generated from one image and a facial image of a CG character with a facial expression can be set.

  Furthermore, in this embodiment, it is possible to prepare photographic images with different facial expressions in advance, but by transforming one photographic image, it is possible to generate different facial expressions while suppressing the number of times of photographing. That is, in the present embodiment, the expression change can be realized by changing the texture image data.

  In the examples shown in FIGS. 3 and 4 described above, the shape of the head is a very simple cube. However, for example, the shape of the head is complicated by an elliptical sphere or a curved surface with unevenness, and the number of polygons is increased to increase the texture. By specifying the mapping area in detail, a more natural character can be produced. In the present embodiment, not only the above-described photographic image but also a handwritten image can be used.

<Definition of CG character>
Here, the contents of the definition of the CG character in the above-described surface data pasting will be described with reference to the drawings. FIG. 5 is a diagram for explaining the definition contents of the CG character in the present embodiment. In the example shown in FIG. 5, “Chara.bm” (FIG. 5A) for setting the change parameter of the CG character and the like, and “Chara.bmo” (FIG. 5B) for setting the expression of the CG character. ) And “eyeO.x” (FIG. 5C) for setting the texture mapping information of the eye area.

  In (1) of “Chara.bm” shown in FIG. 5A, the timing of blinking (blinking interval, time during which the blinking is closed, etc.) is set. Also, in “Chara.bmo” shown in FIG. 5B, the name of the file of the CG character's mouth movement or eye blink is set as the expression of the CG character. Specifically, as shown in (2) of FIG. 5B, when the CG character does not speak anything or utters some words (for example, vowels (“A”, “I “,“ U ”,“ E ”,“ O ”), etc.) is assigned.

  In the example of (2) in FIG. 5B, “moutC.x” indicates an image with the mouth closed, and “moutO.x” indicates an image with the mouth open. .

  In addition, as shown in (3) of FIG. 5B, the respective CG data when the eyes are opened and closed are set. Here, in the example of (3) in FIG. 5B, “eyeC.x” indicates an image with the eyes closed, and “eyeO.x” indicates an image with the eyes open. Show. Further, as shown in (4) of FIG. 5B, a control method is set for how to control blinking.

  Further, in (5) of “eyeO.x” shown in FIG. 5C, the shape data of the eye area is set for the texture image “image.JPG”, and “eyeO.X” shown in FIG. .X ”(6) sets texture mapping information for the eye area. As a result, the texture image pasting process for the eye area is performed on the surface data.

  FIG. 6 is a diagram illustrating an example of the control content of the mouth portion of the CG character in the present embodiment. The example shown in FIG. 6 has two types of definition files, “Chara.bmo” for controlling the mouth portion and “mouseO.x” for setting texture mapping information for the mouth region.

  In “Chara.bmo” shown in FIG. 6A, data for a plurality of facial expressions are set as shown in (1) and (2). Further, a control method for opening and closing the mouth is set as shown in (3), and a control method for changing the facial expression is set as shown in (4).

  Also, in “mouseO.x” shown in FIG. 6B, the shape data of the mouth area shown in (5) and the mouth area texture mapping information shown in (6) are set. An appropriate operation can be realized by reproducing the operation using, for example, TVML.

  These definition files are generated by the surface data pasting means 15, the texture changing means 16, and the like, and read by the reproducing means 18, so that a predetermined CG character can be set.

<Description example using TVML>
Here, as an application example of this embodiment, a description example at the time of changing texture image data using TVML will be specifically described.

  For example, when a character A (“Character A”), which is a CG character, appears in a program or the like, a definition file that defines actions and the like corresponding to the character A is acquired from the storage means 13 and the definition file is referred to. The normal operation of the character A (for example, blinking of eyes or opening / closing of the mouth in accordance with a line) is performed.

So, in the description of TVML, for example
character: expression (name = CharacterA, type = angry, time = 1.0);
character: talk (name = CharacterA, text = "angry", emotion = excite)
character: expression (name = CharacterA, type = happy, time = 1.0);
character: talk (name = CharacterA, text = "happy", emotion = excite)
Is included, the texture changing unit recognizes a parameter such as “type = angry” or “type = happy”, and switches to the above-described modified image according to the type (type). . As a result, face images with various facial expressions can be displayed using the open / closed images of the eyes and mouth and the deformed images.

<Screen generation example>
Next, an example of screen generation in the above-described screen generation means 19 will be described with reference to the drawings. The screen example below shows a screen example when creating a video of a TV program such as news or variety by creating a “my character” using your face photo. This includes the CG character production described above.

<Example of menu screen>
FIG. 7 is a diagram illustrating an example of a menu screen in the present embodiment. The menu screen 50 shown in FIG. 7 is an example of a program production procedure. For a user, “Create a character”, “Select a production”, “Select a video”, “Let's think about a line”, “Speak a voice” Titles such as “Let's see” and “Let's see the work” are displayed. That is, the program production procedure shown in FIG. 7 specifically includes a step of producing a CG character, a step of selecting an effect, a step of selecting a video, a step of selecting a speech, a step of making a voice, Viewing step.

  Further, the contents of the drawing for producing the CG character shown in FIG. 7 are displayed. The CG character production procedure includes a step of taking a photograph of the user's face to produce a “self character”, and a step of selecting the appearance of the CG character's clothes, hairstyle, etc. A step of selecting an illustration and a step of selecting a CG character can also be included.

  In the step of selecting a face illustration, a face is selected from illustrations contained in a personal computer (personal computer) or the like as the CG character production apparatus 10. In the step of directly selecting a CG character, a CG character model in a personal computer or the like is selected. In addition, the CG character 51 in the selected state can be displayed on the menu screen 50.

<Face photo shooting screen>
Next, the face photo shooting screen will be described with reference to the drawings. FIG. 8 is a diagram illustrating an example of a screen displayed when a face photograph is taken. As shown in FIG. 8, a face photo shooting screen 60 having a guidance function is provided so that the user can take two photos of the same size (opening / closing the eyes, opening / closing the mouth) for the face photo shooting. Is displayed in front of the menu screen 50.

  Here, the face photo shooting screen 60 is placed in a preset contour area 61 of the face, and a shutter button shown in FIG. 8 is pressed to take a picture. At this time, in the example of FIG. 8, the area 62 for entering the eyes and the area 63 for entering the mouth are slightly displayed on the screen, and the user performs shooting while aligning the positions of the eyes and the mouth in the areas. That is, the above-described contour image is output to the output unit 12 such as a display, and the user can perform shooting while adjusting the position of the face image shot by the imaging unit 22 while checking the screen.

  In the example of FIG. 8, a face image with the eyes closed with the screen voice guidance closed, and an image with the eyes closed with the eyes closed are photographed. In the voice guidance, for example, a predetermined face image can be taken at the same timing with a voice such as “3, 2, 1, Kash!”.

  In addition, the shutter button can continuously capture the two types of images described above. Furthermore, the shutter button can be pressed any number of times, and a face image can be taken again.

  Further, since the captured images are displayed in the preview screen display areas 64-1 and 64-2, it is possible to take two types of photographs immediately after shooting and quickly perform processing such as re-taking. In addition, in the image of FIG. 8, an image can be seen in which the image of the web camera is taken through only a blue portion.

  Thus, the user can accurately and easily capture two different images having the same face size. Furthermore, in the present embodiment, in the initial setting part for creating a CG character, for example, a plurality of different clothes and hairstyles are displayed to determine the appearance and hairstyle of the CG character, and a screen for setting from among them is generated. Alternatively, it is also possible to generate a screen that allows a face to be selected from a plurality of illustrations stored in advance in the storage unit 13 or to be selected from already produced CG characters.

  When a plurality of CG characters are to appear in a program, the above-described processing is performed with another face. Thereby, a program using at least one CG character can be produced.

<Direction setting screen>
Next, the effect setting screen in the present embodiment will be described with reference to the drawings. FIG. 9 is a diagram showing an example of the effect setting screen in the present embodiment. The effect setting screen 70 shown in FIG. 9 displays the general contents of the program such as studio set, lighting, camera work, and the like. The effect setting screen 70 is displayed in front of the menu screen 50.

  That is, as shown in FIG. 9, on the effect setting screen 70, a plurality of effect contents are displayed on predetermined capture screens 71-1 to 71-6 and the like. Note that what is displayed on the capture screens 71-1 to 71-6 may be a still image or a moving image.

  Specifically, for example, there are reporter-like ones with animated backgrounds and “news-like” ones with a monitor on the back, but others that produce variety such as indoors and outdoors. Can be displayed.

  Note that, on the effect setting screen 70, as shown in the capture image 71-4, the currently selected item can be highlighted, and thus the selected capture image can be easily grasped.

<Video selection screen>
Next, the video selection screen in the present embodiment will be described with reference to the drawings. FIG. 10 is a diagram illustrating an example of a video selection screen in the present embodiment.

  When a video is selected in the present embodiment, a video selection screen 80 as shown in FIG. 10A is displayed. The video selection screen 80 is displayed in front of the menu screen 50. The video selection screen 80 includes a keyword input area 81 for inputting a keyword for searching for a video and a video display area 82 for displaying a video obtained by the search.

  When a keyword for searching for a video on the video selection screen 80 is input and a search button (“search” button) is selected, a video corresponding to the keyword is extracted with reference to a predetermined content database stored in advance. The extracted video is displayed on the search result screen 83. The search result screen 83 is displayed in front of the menu screen 50.

  Here, on the search result screen 83, the videos 84-1 to 84-5 obtained as a result of the search and the description content (for example, title, video playback time, description of the content, etc.) for each video are displayed. Note that the number of displayed images is not limited to this in the present invention.

  Moreover, as shown in FIG.10 (b), the highlighted item can be highlighted in the image | videos 84-1 to 84-5 displayed. Furthermore, in this embodiment, when an item is selected, when the playback button on the video search result screen 83 is selected, the selected video is displayed in the video playback area 85.

  Accordingly, the user can easily search for the video and confirm the searched video, and can quickly obtain the desired video.

<Serif setting screen>
Next, the dialogue setting screen in the present embodiment will be described with reference to the drawings. FIG. 11 is a diagram illustrating an example of a dialogue setting screen. A dialogue setting screen 90 shown in FIG. 11 includes a video reproduction area 91 for reproducing a video, a pull-down menu 92 for selecting an action for the video, a timing designation button 93 for designating timing for reproducing the video, and a speech input. An area 94; a facial expression display area 95 for displaying the expression of the CG character with respect to the text input in the speech input area 94; a camera angle setting area 96 for setting a camera angle; and a speech interval designation button 97. ing. The dialogue setting screen 90 is displayed in front of the menu screen 50.

  The video playback area 91 is a screen for previewing all lines from the top with the playback button of the line setting screen 90. That is, the dialogue setting screen 90 displays a plurality of dialogues in the order in which they are spoken, and the video playback area 91 displays the contents of the program that speaks all these dialogues. In the present embodiment, not only all the lines described above but also at least one line designated by the user can be displayed.

  The pull-down menu 92 is used to select an action for a CG character appearing on the video. The action contents such as “bowing”, “raising both hands”, and “waving hands” are set in advance. select.

  Furthermore, the timing designation button 93 is a button that can designate the timing for reproducing the video. In other words, the timing designation button 93 can be set so that the video is played after the speech starts or starts to be spoken. In the input area 94, template text is input in advance, and original expressions and words are set in the sentence. In the facial expression display area 95, a character animation of a predetermined facial expression such as “angry” or “laughing” is displayed in accordance with the set line. The camera angle setting area 96 is used to set an angle (for example, zoom, pan, etc.) of the camera that captures the CG character. The facial expression display area 95 and the camera angle setting area 96 are set with preset values. Further, when each of these areas is selected, a separate window is displayed, and a large screen can be displayed.

  Here, the serif setting screen 90 is displayed in the order in which a plurality of serifs and narrations are given to the CG character. That is, the user uses the input unit 11 or the like to set the speech that the CG character speaks, the narration in the program, or the like using the speech setting screen 90.

  Further, in the present embodiment, the interval can be adjusted by the serif interval designation button 97 in order to designate the interval (interval) at which each line or narration is output. In the present embodiment, when the speech interval designation button 97 is clicked, the number of buttons increases, and a preset number of seconds is set out of about 0.5 to 3 seconds per button. Thereby, the user can easily set between the lines, and can easily obtain the interval between the lines from the screen.

<Voice input screen>
Next, the voice input screen in the present embodiment will be described with reference to the drawings. FIG. 12 is a diagram illustrating an example of a voice input screen according to the present embodiment. The voice input screen 100 shown in FIG. 12 has a video display area 101 and a script display area 102 for voice input. The voice input screen 100 is displayed in front of the menu screen 50.

  The voice input screen 100 of FIG. 12 includes a recording button 103 for recording voice, a voice playback button 104 for playing back voice, and a delete button 105 for deleting voice and script (original). Each button can be used to record, play back, or delete a voice that is struck by the CG character. When the recording button 103 is selected and the recording state is set, the recording button 103 changes to a stop button, and recording is stopped by selecting the stop button.

<Program playback screen>
Next, the program playback screen in the present embodiment will be described with reference to the drawings. FIG. 13 is a diagram showing an example of a program playback screen in the present embodiment. The program playback screen 110 in FIG. 13 has a full screen playback button and a save button. The program playback screen 110 is displayed in front of the menu screen 50.

  The program playback screen 110 displays the playback of the program on the full screen with the contents set so far by selecting the full screen playback button. In the present embodiment, when the playback is stopped halfway, a stop button may be provided, or may be stopped by selecting a predetermined key (for example, escape key) or the like. In addition, by selecting the save button, for example, a name can be saved in the save dialog, or it can be set to be saved in a pre-mounted server for rendering on an external device such as a server. Good. Note that the settings are preferably defined in, for example, an ini file.

  In the present embodiment, the above-described various screen examples are generated by the screen generation unit 19 and output to the output unit 12, so that the user can easily use the CG character or the CG character in the present embodiment while viewing the screen. Can produce programs.

<Execution program>
Here, the above-described CG character production device 10 includes, for example, a CPU (Central Processing Unit), a volatile storage medium such as a RAM (Random Access Memory), a nonvolatile storage medium such as a ROM (Read Only Memory), a mouse, It can be constituted by a computer including an input device such as a keyboard and a pointing device, a display device for displaying images and data, and an interface device for communicating with the outside.

  Accordingly, the above-described functions of the CG character production apparatus 10 can be realized by causing the CPU to execute a program describing these functions. These programs can also be stored and distributed in a recording medium such as a magnetic disk (floppy disk, hard disk, etc.), optical disk (CD-ROM, DVD, etc.), semiconductor memory, or the like.

  That is, the program production process is realized by generating an execution program (CG character production program) for causing the computer to execute the process in each configuration described above and installing the program in, for example, a general-purpose personal computer or server. be able to. In addition, about the process by the execution program in this invention, each process mentioned above is realizable, for example.

  Next, a processing procedure by the execution program in the present invention will be described with reference to a flowchart for a CG character production processing procedure and a program production process including CG character production. In the following description of the process, a program is used as an example of content, but the type of content in the present invention is not limited to this.

<CG character production processing procedure>
FIG. 14 is a flowchart illustrating an example of a CG character production process procedure according to the present embodiment. In FIG. 14, for example, as described above, a screen for photographing is displayed on the output means 12 such as a display (S01), and two images obtained by opening and closing the eyes and mouth photographed by the imaging means 22 are acquired (S01). S02).

  Next, the surface data pasting process is performed on the head data of the head of the CG character set in advance for the image acquired in the process of S02 (S03), and further, the contents of the CG character and the contents of the action When the facial expression is changed by, for example, the texture is changed according to the above contents (S04). Further, a CG character definition file is generated based on the changed information (S05). Further, the defined CG character is displayed (S06). Here, when the CG character does not move as desired, the process returns to the processing of S02 to S04 and the setting is changed. If the CG character is satisfactory, the CG character is registered by the CG character definition file (S07).

  Here, it is determined whether or not another CG character is to be produced (S08). When another CG character is produced (YES in S08), the process returns to S01 and the subsequent processing is performed by changing the setting. CG characters are produced under other conditions. If no other CG character is produced in the process of S08 (NO in S08), the CG character production process is terminated by an end instruction from the user or the like.

<Program production process>
Next, the program production processing procedure in the present embodiment will be described using a flowchart. FIG. 15 is a flowchart showing an example of a program production processing procedure in the present embodiment. In FIG. 15, for example, as described above, a screen for photographing is displayed on the output means 12 such as a display (S11), and two images obtained by opening and closing the eyes and mouth photographed by the imaging means 22 are acquired (S11). S12).

  Next, in order to make the characteristics of the CG character more specific with respect to the image acquired by the process of S12, the appearance, such as clothes and hairstyle, stored in the storage means 13 or the like is selected in advance (S13), S12 A CG character appearing in the program is created on the basis of the image acquired by the process and the clothes and hairstyle selected by the process of S13 (S14).

  Next, the production of the program is selected (S15), the speech of the CG character is set (S16), and the voice adapted to the CG character's accent or the voice adapted to the narration is input (S17). . A program is produced according to these settings (S18), and the produced program is reproduced (S19). In addition, when correcting or changing a program, the corresponding process is performed after returning to the process to be changed selected from S11 to S17.

  Here, it is determined whether or not another program is to be produced (S20), and if another program is produced (YES in S20), the process returns to S11 to change the settings and perform the subsequent processing, and so on. The program can be produced under the conditions. If no other program is produced in the process of S20 (NO in S20), the program production process is terminated by an end instruction from the user or the like.

  As described above, according to the present invention, a user can easily create a CG character with a facial expression. Specifically, according to the present invention, it is possible to produce a program such as an animation using a character model easily customized by a general user. Further, in the present invention, since a photographic image taken by an imaging means such as a camera can be used as it is, for example, by taking a picture of yourself and making it a texture image, it is possible to produce a character of his own character. Further, according to the present invention, it is possible to open and close the mouth in accordance with blinking or squealing at an appropriate timing using a definition file or the like, and it is possible to produce a more natural animation.

  Although the preferred embodiment of the present invention has been described in detail above, the present invention is not limited to the specific embodiment, and various modifications, within the scope of the gist of the present invention described in the claims, It can be changed.

DESCRIPTION OF SYMBOLS 10 CG character production apparatus 11 Input means 12 Output means 13 Storage means 14 Image acquisition means 15 Surface data pasting means 16 Texture change means 17 Program production means 18 Playback means 19 Screen generation means 20 Transmission / reception means 21 Control means 22 Imaging means 30 CG Character model 31, 32, 41 Photo image 33 CG model 34 Image 42, 43 Deformed image 50 Menu screen 51 CG character 60 Face photography screen 61 Contour area 62, 63 area 64 Preview screen display area 70 Effect setting screen 71 Capture screen 80 Video selection screen 81 Keyword input area 82 Video display area 83 Search result screen 84 Video 85 Playback area 90 Dialog setting screen 91 Video playback area 92 Pull-down menu 93 Timing specification button 94 Dialog input area Area 95 Expression display area 96 Camera angle setting area 97 Dialog interval designation button 100 Audio input screen 101 Video display area 102 Script display area 110 Program playback screen

Claims (4)

In a CG character production apparatus that produces a CG character using texture image data,
Image acquisition means for acquiring respective images in the open / closed state of the eyes and mouth of the CG character model;
An image obtained by the image acquisition means as the texture image data, surface data pasting means for pasting the surface data of the shape set as the head of the CG character model;
The texture image data pasted on the surface data by the surface data pasting means is divided into an upper half including the eyes of the CG character model and a lower half including the mouth of the CG character model, and in correspondence with the speech or operation, by switching the lower half and the upper half each time, it has a texture changing means for changing the opening and closing states of the eyes and mouth of the CG character model,
The CG character production apparatus , wherein the texture changing means generates a CG character definition file defining a change condition for switching the texture image data to be pasted on the plane data . Wherein as image acquired by the image acquiring means is the same face size, according to claim 1, characterized in that it comprises a screen generation means for generating a guidance screen for fixing the position of the face at the time of shooting CG character production device. CG character producing apparatus according to claim 1 or 2, characterized in that it has a program production means for producing at least one program with CG characters having a face obtained by the texture changing means. A CG character production program for causing a computer to function as the CG character production apparatus according to any one of claims 1 to 3 .