JP2004013486A - Device and method for program production - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device and a method for program production with high working efficiency capable of setting a free pose and animation for a character on a screen being edited under collaboration of a motion authoring tool and a program information creating part. <P>SOLUTION: The system comprises the program information creating part to create program information for producing a video program including a CG where a character appears, a program creating part to create a program according to the program information, and a display device to display the created program on a screen. The motion authoring part to set a free pose and animation for a character and an automatic scripting part to incorporate pose and animation data created by the setting of the free pose and animation for the character on the screen of the program being edited into a script which shows program information are integrated into the program information creating part. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
FIELD OF THE INVENTION
The present invention relates to a program production apparatus used for television broadcast program production, video program production, program simulator, presentation, demonstration, and the like, and particularly, describes program information using a computer, and reproduces and executes the described contents. It relates to a program production method.
[0002]
[Prior art]
In recent years, in addition to presentations and demonstrations, computer-produced video programs have appeared in some of the broadcasts. With the development of technology that combines CG (computer graphics) animation technology with voice synthesis technology, moving image generation technology, and the like, it has become possible to produce expressive videos. In the production of a video program using such a computer, a GUI (Graphical User Interface) for interacting with a person via a picture (icon) is used.
[0003]
By the way, recently, a TVML (TVprogram Making Language) language has been developed as a dedicated language for producing CG animation (Japanese Broadcasting Corporation website: http://www.strl.nhk.or.jp/TVML/indexj.html). reference). The TVML language is a text-based language in which elements necessary for creating a television program can be described as a script, and is based on the GUI operation described above.
[0004]
Video production using the TVML language is performed as follows. Using various kinds of characters (persons), studio sets, props, lighting, titles, etc. prepared as video material, that is, CG objects, as well as pre-recorded voices (line, voice, etc.) and moving images, etc. Select a CG object according to the scenario of the program you want to use, and perform one line of each of the actions of the CG object (for example, speaking, bowing, walking, etc. for a character) (each prepared as an event). It is described every time. The operation on the screen in the production process by the description is performed by the GUI operation to complete the CG animation image.
[0005]
In the program production device, a computer forms a structure for program production according to a program production program in the TVML language. FIG. 36 shows an example of such a structure.
[0006]
The computer 103 displays a GUI screen on a monitor 112 which is a peripheral device by a program editing program 122 included in a program production program 121 stored in the storage device 102. Information is input to this GUI screen by an input device 113 such as a keyboard or a mouse according to the scenario of the program, and program information for program production is generated in the program information generation unit 105. Since the GUI is used, the operation for generating the program information is performed interactively. As described above, the program information 101 is written in the TVML language. The generated program information is stored in the program information file 124 of the storage device 102 one by one.
[0007]
By the processing by the program production program 121, the computer 103 forms roughly two units, a program generation unit 104 and a program information generation unit 105. The program generation unit 104 generates a program by interpreting the program information 101 generated by the program information generation unit 105 and stored in the program information file 122 of the storage device 102.
[0008]
In the program information generation unit 105, the sequencer unit 106 sequentially reproduces the television program by controlling the CG animation generation 107, the audio synthesis unit 108, and the moving image generation unit 109 based on the program information 101. That is, the CG animation generation unit 107 reads out appearing sets, characters, props, and the like from modeling data of CG characters and data of studio sets stored in advance in the image / audio file 123 of the storage device 102, and generates CG animation. I do. The voice synthesizing unit 108 outputs a synthesized voice signal of a voice of an appearing character or a narrator or a voice signal generated by reading voice data stored in advance in the image / voice 123 as voice by the speaker 111. The moving image generation unit 109 generates a moving image from moving image data edited in advance and stored in the image / audio file 123. The image data generated by the CG animation generation unit 107 or the moving image generation unit 109 is converted into a video signal by the video interface 110. The video signal output from the video interface 110 is output as an image by the monitor 112.
[0009]
Next, the program information generation unit 105 will be specifically described. The program information generation unit 105 operates on the computer 103 to create the program information 101. FIG. 2 shows an example of a screen by the program information generation unit 105. 201 is a main screen of the program information generation unit 105. Reference numeral 202 denotes a menu bar, which displays a menu for activating a preparation window 205 for inputting information in the information display window 203. Reference numeral 203 denotes a program information display window, which is a window for displaying the program information as a script (command) in text. Reference numeral 204 denotes a preview window, which is a window for displaying program information displayed as text in the information display window as a program via the program generation unit 204. Reference numeral 205 denotes a preparation window for inputting program information to the program information display window 203. The number of the preparation windows 205 is the same as the number of pieces of information necessary for producing a program, such as character movement, talking, and camera work.
[0010]
As a specific operation example of the program information generation unit 105, a method of editing a scene in which a appearing character walks will be described with reference to FIGS. First, when "command" is clicked from the menu bar 202, an event type menu 301 is displayed. Further, when "character" is clicked, a command selection menu 302 is displayed. Here, when "walk" is clicked, a preparation dialog 205 for inputting a TVML command instructing the "walk" operation is displayed.
[0011]
FIG. 4 is an enlarged view of the preparation dialog 205 for inputting the command “walk”. Reference numeral 401 denotes a “walking” preparation dialog, which is a type of the preparation dialog 205. Reference numeral 402 denotes a name combo box (a box having a list box and a text box), and selects a walking character. Reference numerals 403 to 405 denote text boxes for inputting the end position of the walk, which indicate components of the x coordinate, the y coordinate, and the z coordinate, respectively (unit is [m]). Reference numeral 406 denotes an orientation text box for designating the orientation of the character at the end of walking. A pitch slider 407 sets the walking speed of the character. Reference numeral 408 denotes a stride length slider for setting the stride length of the character. A step slider 409 sets up and down movements when the character walks. A stop mode selection combo box 410 sets how to stop after walking. A waiting combo box 411 selects yes or no. If yes is selected, the next command is not executed until the character has finished walking. When no is selected, the next command is executed immediately. A preview button 412 displays program information on the preview screen 205. An OK button 413 reflects the content set in the “walk” preparation window 401 in the program information 101 and displays the edited content in the program information display window 203 as a command defined in the TVML language. At the same time, the walking preparation window 401 is ended. A cancel button 414 is used to terminate the walking window 401 without reflecting the edited contents. An update button 415 performs the same processing as the OK button 413. However, the walking preparation window 401 is not ended.
[0012]
In the walking preparation window 401, the end position of walking is input from the input device 113, and the preview button 412 is clicked. A state in which the character selected in the name combo box 402 is walking to the end position of walking is displayed on the preview screen 204.
[0013]
FIG. 5 shows an example of a screen of the program information generation unit 105 after the character has finished walking. The position of the character displayed on the preview screen 204 in FIG. 5 is the end position of walking. When an OK button 413 is clicked, a command (script) defined in the TVML language is displayed in the program information window 203.
[0014]
In Ver1.1, which has been upgraded from Ver1.0 of the TVML language specification, it is possible to set a pose and animation as a free motion of the character. Here, the pose means that when the final pose of the character is specified, the program generation unit automatically changes the pose from the current pose to the set pose while gradually changing the pose. It goes. On the other hand, animation is a technique in which the pose of a character can be specified by continuously defining the pose of the character until the user transitions to the final pose.
[0015]
For example, a command for setting a pause is defined as follows in the TVML language specification Ver1.1.
character: definepose (name, pose, joint, rotx, roty, rotz, movex, movey, movez)
name: Character name
pose: Specify the pose name
joint: joint designation
rotx, roty, rotz: joint angle specification
movex, movey, movez: joint position designation
In the above command, angles and positions are designated for all joints of the character to define one pose. Here, the number of joints of the character is basically 17 (may be 17 or more depending on the character creator).
[0016]
[Problems to be solved by the invention]
In the prior art, as described above, 17 commands are required for one pose, and the operation of designating the pose becomes very complicated. Also, it is intuitive and difficult to input the angles and positions of the joints by numerical values. Furthermore, the range of the pose is limited to walking, bowing, talking, etc., and free movement cannot be selected.
[0017]
Therefore, one of the present inventors has developed a motion authoring tool prior to the present invention (motion: motion, authoring: editing, tool: means). The motion authoring tool is a unit formed by the computer 103 along with the program information generation unit 105 based on the motion authoring program, and thereby, the pose or animation executed by the CG character generated by the CG animation generation unit, that is, The movement can be freely created. In other words, this tool allows the user to freely set an unprecedented movement, such as raising the hand, turning the hand, or extending the hand toward a certain object.
[0018]
By the way, in the motion authoring tool, poses and animations are set independently of the screen being created. The pose and animation data for which the setting has been completed are manually incorporated into the script of the program information 101 and inserted into the screen being created. Hereinafter, the motion authoring tool will be described with reference to FIGS.
[0019]
FIG. 6 shows the main screen of the motion authoring tool. Reference numeral 601 denotes a main screen of the motion authoring tool. Reference numeral 602 denotes a menu bar, which displays a menu for performing operations such as reading a character and saving pose / animation data. A character display unit 603 displays a character for setting a pose or animation. By clicking a joint of the character with a mouse, it is possible to select a joint for setting an angle and a position. Furthermore, the user can set an arbitrary character display state by a combination of the Rot button 605, the Trans button 606, the Scale button 607, and the drag operation of the mouse. A home button 604 can return the character display to the display state at the time of starting the motion authoring tool (the display state shown in FIG. 6).
[0020]
When the Rot button 605 is clicked, the button is kept pressed. By dragging the character display portion 603 in this state, the camera for displaying the character can be rotated and moved. By dragging the character display portion 603 in a state where the Trans button 606 is pressed, the camera that displays the character can be translated. When the character display unit 603 is clicked in a state where the Scale button 607 is pressed, the character can be enlarged or reduced.
[0021]
A joint selection combo box 608 is used to select a joint for setting an angle and a position. Reference numeral 609 denotes a rotx text box for specifying a rotation angle around the x-axis. Here, the coordinate axis of the joint has an origin and a coordinate axis unique to the joint. The unit is [degree]. Reference numeral 610 denotes a rotx dial. By dragging the rotx dial with a mouse, it is possible to continuously change the joint angle around the x axis. A rotation text box 611 is used to input a rotation angle around the y-axis. Reference numeral 612 denotes a roty dial, which can continuously change the rotation angle around the y-axis. Reference numeral 613 denotes a rotz text box in which a rotation angle around the z axis is input. Reference numeral 614 denotes a roty dial, which can continuously change the rotation angle about the z-axis. A frame number display text box 615 displays the total number of frames of the animation and the displayed frame number. A frame control slider 616 controls the number of frames of the animation. A TOP button 617 moves to the first frame of the animation. A rewind button 618 fast-forwards the animation in the reverse direction. Reference numeral 619 denotes a reverse frame advance button for returning the animation by one frame. A play button 620 plays an animation. During animation playback, it becomes a pause button. A frame advance button 621 advances the animation by one frame. A fast forward button 622 fast forwards the animation. An END button 623 moves to the last frame of the animation.
[0022]
An example of editing a pose using FIGS. 6 to 8 will be described. First, a joint for setting an angle and a position is selected by clicking a joint of the character in the character display unit 603 or selecting a joint name in a joint selection combo box 608. Next, the angle of the joint is set by directly inputting the joint angle into the rotx text box 609, the roty text box 611, and the rotz text box 613 by numerical values, or by dragging the rotx dial 610, the roty dial 612, and the rotz dial 614. I do. This operation is repeated for all the joints whose angles are to be set.
[0023]
FIG. 7 shows an example of the pose set by the above operation. The set pose is saved as a file by selecting the Save Pose menu 803 of the pose file operation menu 801 in FIG. Here, FIG. 8 is the same as the main screen 601 of the motion authoring tool shown in FIG. 6, and is a diagram when the “Figure” item in the menu bar 602 is clicked. Load Pose 802 reads a pose file created in advance. With AddMorphTarget 804, it is possible to set the state of the joint as the final result of the morphing for the selected joint. This function is mainly used for setting facial expressions. Rename group 805 is for changing the joint name.
[0024]
Next, an example of an animation setting method will be described with reference to FIG. 6 and FIGS. FIG. 9 is the same as FIG. 6, but when an animation setting menu Animation 901 is clicked from the menu bar 602. The Load Animation 902 is a menu item for reading an animation data file in a format that can be read by the program generation unit 104. The Save Animation 903 saves the edited animation data in a file as animation data in a format that can be used by the program generation unit 104. The Import BVH 904 reads animation data in the BVH format. Here, the BVH format is a format of animation data created by motion capture, and is the most commonly used data format. The Import LWS Animation 905 can read animation data (LWS format file) created by LightWave3D (developed by NewTek, USA, total sales: DStorm Inc.). Save BVH 906 saves the edited animation data in a file in BVH format. The Animation Edit 907 is a menu item for performing detailed editing of animation data.
[0025]
Hereinafter, an example of an operation for setting an animation will be described. First, click importBVH904 to read a BVH animation file. Next, the reproduction button 620 is clicked to reproduce the animation. FIG. 10 shows an example of a screen on which an animation is reproduced by the motion authoring tool. When the read animation is used by the program generation unit 104, the animation is converted into a data format that can be used by the program generation unit 104 by selecting Save Animation 903, and is saved in a file. When the animation file is read by clicking Import LWS Animation 905, the animation file created by LightWave3D can be converted into a format that can be used by the program generation unit 104.
[0026]
The motion authoring tool has been described above. The above-mentioned motion authoring tool is executed as software separate from the program information generation unit 105, and does not have a function of cooperating with the program information generation unit 105, and is used independently and independently. Therefore, when the completed pose or movement is inserted in the editing screen, for example, it may happen that the direction of the hand intended to point to the prop is slightly deviated, and the work efficiency of resetting is reduced. Things could happen.
[0027]
An object of the present invention is to set a free pose and animation for a character in a screen being edited by incorporating a method of editing a character pose and animation data in a motion authoring tool as a function of a program information generating unit. It is an object of the present invention to provide a program production apparatus and a program production method with high work efficiency which can perform the program.
[0028]
[Means for Solving the Problems]
In order to achieve the above object, a program production apparatus according to the present invention comprises: a program information generation section for generating program information for producing a video program including a CG in which a character appears; and a program generation section for generating a program according to the program information. And a display device for displaying the generated program on a screen, a motion authoring unit for setting a free pose and animation for the character, and pose data generated by setting a free pose and animation. An automatic scripting unit for incorporating animation data into a script indicating the program information is integrated with the program information generating unit, so that a free pose and animation can be set for the character on the screen during program editing. It is characterized by being performed. The pose data and animation data generated by the motion authoring unit are automatically incorporated into the script created in the program information generation, so that the motion authoring unit, i.e., the motion authoring tool and the program information generation unit are integrated, and the user is realized. Can set poses and animations on the GUI screen during program editing, and can effectively solve the problem. Specifically, a pause button and an animation button are newly provided in a menu bar of a GUI screen during program information generation, and by operating each item on these buttons, a pause or an animation data is edited. A newly provided GUI is displayed, and a pose and animation are set by operating the dialog.
[0029]
The effect of the present invention can be further enhanced by providing a user viewpoint procedure for viewing a character image in which a pose or animation is set from a free angle. In that case, a user viewpoint button is provided on the menu bar.
[0030]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, a program production apparatus and a program production method according to the present invention will be described in more detail with reference to embodiments of the invention shown in some drawings.
[0031]
FIG. 1 shows an example of the configuration of the program production device of the present embodiment. In the television program production device, the computer 103 forms a structure for program production according to a program production program 121 in the TVML language stored in the storage device 102. In the present embodiment, the program production program 121 includes, in addition to the program editing program 122, a motion authoring program 127 for setting poses and animations, and pose data and animation data created by the programs. (Configured by the program editing program 122).
[0032]
The computer 103 displays a GUI screen on the monitor 112 by the program editing program 122. Information is input to this GUI screen by an input device 113 such as a keyboard or a mouse according to the scenario of the program, and program information for program production is generated in the program information generation unit 105. Since the GUI is used, the operation for generating the program information is performed interactively. The generated program information is stored in the program information file 124 of the storage device 102 one by one.
[0033]
By the processing by the program production program 121, the computer 103 forms roughly two units, a program generation unit 104 and a program information generation unit 105. The program generation unit 104 generates a program by interpreting the program information 101 generated by the program information generation unit 105 and stored in the program information file 122 of the storage device 102.
[0034]
The program information generation unit 105 includes three units: a program editing unit 125, an automatic scripting unit 115, and a motion authoring unit 114. The program editing unit 125 outputs the edited program information as the program information 101 via the automatic scripting unit 115. When editing the pose or movement of the character, the program editing unit 125 outputs the program data in which the character is paused or moved via the motion authoring unit 114 as the program information 101 via the automatic scripting unit 115. .
[0035]
With such a configuration of the program information generation unit 105, the program information 101 generated by the program information generation unit 105 includes characters to which the motion authoring unit 114 has given a free pose or movement.
[0036]
In the program generation unit 104, the sequencer unit 106 controls the CG animation generation 107, the voice synthesis unit 108, and the moving image generation unit 109 based on the program information 101 to sequentially reproduce television programs. That is, the CG animation generation unit 107 reads out appearing sets, characters, props, and the like from modeling data of CG characters and data of studio sets stored in advance in the image / audio file 123 of the storage device 102, and generates CG animation. I do. The voice synthesizing unit 108 outputs a synthesized voice signal of a voice of an appearing character or a narrator or a voice signal generated by reading voice data stored in advance in the image / voice 123 as voice by the speaker 111. The moving image generation unit 109 edits an image in advance. A moving image is generated from the moving image data stored in the audio file 123. The image data generated by the CG animation generation unit 107 or the moving image generation unit 109 is converted into a video signal by the video interface 110. The video signal output from the video interface 110 is output as an image by the monitor 112.
[0037]
In the above program production apparatus, the step of setting pose data and animation data by GUI operation under the program information generating unit 105 including the motion authoring unit 114, the automatic scripting unit 115, and the program editing unit 125 will be described next. explain.
[0038]
First, a method of setting a pause in the program information generation unit 105 will be described. FIG. 11 is the same as the screen of the program information generating unit 105 shown in FIG. 2, except that a pause item 1101, an animation item 1102, and a user viewpoint item 1103 are added to the menu bar. That is, in FIG. 11, reference numeral 201 denotes a main screen of the program information generation unit 105. Reference numeral 202 denotes a menu bar, which displays a menu for activating a preparation window 205 for inputting information in the information display window 203. Reference numeral 203 denotes a program information display window, which is a window for displaying the program information as a script (command) in text. Reference numeral 204 denotes a preview window, which is a window for displaying program information displayed as text in the information display window as a program via the program generation unit 204. Reference numeral 205 denotes a preparation window for inputting program information to the program information display window 203. The number of the preparation windows 205 is the same as the number of pieces of information necessary for producing a program, such as character movement, talking, and camera work.
[0039]
Clicking a pause item 1101 on menu bar 202 with a mouse displays a pause setting menu 1201 shown in FIG. The pause setting menu 1201 includes an edit item 1202, an execution item 1203, and a delete item 1204.
[0040]
If edit item 1202 is clicked on with a mouse, a pose edit preparation dialogue 1301 shown in FIG. 13 is displayed on main screen 201 of program information generation unit 105. Reference numeral 1302 denotes a name combo box which defines a character to which a pose to be set is set. Reference numeral 1303 denotes a pose name text field for giving a unique name to the pose data. Reference numeral 1304 denotes a file name text field which designates pause data recorded in the recording device 102 in advance. Reference numeral 1305 denotes a reference button which displays a file selection window 1041 shown in FIG. 14 for selecting pose data recorded in the recording device 102.
[0041]
Here, FIG. 14 shows an example of a dialog for selecting a pose file. Reference numeral 1401 denotes a pause file selection dialog. A pose file display section 1402 displayed in the file selection dialog 1401 displays an image in which the contents of the pose data can be intuitively understood. The character string below the image indicates the file name of the pause file. In the file display unit 1402, by double-clicking an arbitrary image with a mouse, the pause information is read into the program information generation unit 105.
[0042]
In FIG. 13, reference numeral 1306 denotes a character display unit which displays an image file of the character selected in the name combo box 1302. This allows the user to intuitively know the character for which the pose is set. A pause display unit 1037 displays an image indicating the contents of the pause file selected by the file name text box 1304 or the reference button 1305. Thereby, the user can intuitively know the contents of the read pose data. Reference numeral 1308 denotes a joint structure display unit, which shows the joint structure of the character generated by the CG animation generation unit. In the joint structure display unit 1308, when a joint is clicked with a mouse, the display color or shape (for example, a concave shape) of the joint is changed to highlight the joint to indicate that the joint is selected.
[0043]
FIG. 15 shows an example of highlighting when a joint is clicked in the joint structure display unit 1308. At the same time, the name "hip" of the joint is displayed in the joint name combo box 1309. Here, the selection state is a state in which numerical values of the angle and the position of the joint can be input. Furthermore, the joints for which numerical values of angles and positions are set are highlighted. The highlight indicating the selected state of the joint name and the highlight indicating the setting of the numerical value clarify the difference between the states by using different colors and display methods. Reference numeral 1309 denotes a joint name combo box, which displays the name of a joint for setting an angle and a position. Also, by selecting a joint name in the joint name combo box 1309, a joint of the character whose angle and position are to be set can be selected.
[0044]
In FIG. 13, reference numeral 1310 denotes an angle x text box for designating a joint angle around the x axis with respect to the joint selected in the joint structure display unit 1308 or the joint name combo box 1309. The joint angle can be specified by inputting a numerical value directly into the angle x text box or by clicking a spin button at the right end of the angle x text box. Further, when the angle x text button is selected (when the mouse is clicked on the text box), the numerical value is changed in accordance with the amount of mouse dragging by dragging on the pose edit preparation window. Can be. Reference numeral 1311 denotes an angle y text box, which specifies a joint angle around the y axis. Reference numeral 1312 denotes an angle z text box, which specifies a joint angle around the z axis.
[0045]
Reference numeral 1313 denotes a detail button. When the detail button 1313 is clicked, a GUI for setting a position is displayed. FIG. 16 shows an example of a GUI for setting the position. Reference numeral 1601 denotes a position x text box, which specifies position coordinates in the x-axis direction for the joint selected in the joint structure display unit 1308 or the joint name combo box 1309. Reference numeral 1602 denotes a position y text box, which specifies the position coordinates of the selected joint in the y-axis direction. Reference numeral 1603 denotes a position z text box, which specifies the position coordinates of the selected joint in the z-axis direction.
[0046]
In FIG. 13, reference numeral 1314 denotes a release button, which releases the setting of the joint angle and the position coordinates for the selected joint. Reference numeral 1315 denotes a release button for releasing settings of angles and positions for all joints. A preview button 1316 displays the set pose on the preview screen 204. A file save button 1317 saves the created or edited pose as a file in the storage device 102. An OK button 1318 outputs the edited pose data to the program information display unit 203 as a TVML command (script). A cancel button 1319 terminates the pose editing preparation dialog 1301 without outputting the edited pose data as a TVML command.
[0047]
The procedure for editing the pose will be described with reference to FIGS. FIG. 17 is a flowchart showing a procedure for editing a pose. When an edit item 1202 is selected from the pose setting menu 1201 in step 1701, a pose edit preparation dialogue 1301 is activated. In step 1702, a character name for setting a pose is selected in a name combo box 1302. In step 1703, whether to read the pose file stored in the storage device 102 is selected.
[0048]
If a pause file is to be read, the process proceeds to step 1704, and a reference button 1305 is clicked. Since a pose file selection dialog 1401 is activated, a pose file to be read is selected in step 1705, and the flow advances to step 1706.
[0049]
If the pause file is not read, the process proceeds to step 1706. In step 1706, a joint for inputting the numerical value of the angle is selected. The joint is selected by clicking the joint in the joint structure display unit 1308 or selecting the joint in the joint name combo box 1309. In step 1707, the angle of the joint is input. The input result is reproduced on the preview screen 204 in real time in step 1708. Thus, it is possible to edit while checking the pose on the preview screen 204.
[0050]
Here, when the user's viewpoint menu 1103 shown in FIG. 11 is clicked, pose editing while changing the angle of the camera displaying the preview screen can be performed by the user viewpoint setting menu 1801 displayed in FIG. The user viewpoint setting item 1801 includes a front item 1802, an upper item 1803, a right item 1804, a left item 1805, and an upper right item 1806.
[0051]
When the front item 1802 is clicked, the display state of the preview screen 204 changes to a screen showing the character from the front (FIG. 19). When the upper item 1803 is clicked, the display state of the preview screen 204 changes to a screen showing the character from directly above (FIG. 20). When the right item 1804 is clicked, the display state of the preview screen 204 changes to a screen showing the character from the right side (FIG. 21). When the left item 1805 is clicked, the display state of the preview screen 204 changes to a screen showing the character from the left (FIG. 22). When the upper right diagonal item 1806 is clicked, the display state of the preview screen 204 changes to a screen showing the character from the upper right diagonal (FIG. 23).
[0052]
In FIG. 17, in step 1709, the user determines whether or not the setting has been completed for all the joints for which the value of the joint angle needs to be set by the above operation. If the desired pose has not been obtained, the process returns to step 1706 to continue the operation for setting the joint angle. If the desired pose is obtained, the process proceeds to step 1710. In step 1710, by clicking the preview button 1316, the pose set by the above operation is reproduced on the preview screen 204 from the state before setting the pose.
[0053]
In step 1711, the user determines whether or not the preview result is desired. If a desired preview result is obtained, the process proceeds to step 1712. If the desired preview result is not obtained, the setting operation of the joint angle from step 1706 is repeated. In step 1712, the user determines whether to store the pose set by the above operation as a file in the storage device 102. If the pose file is to be saved, the process proceeds to step 1713, and the save file to file button 1317 is clicked to save the pose file. If the pause file is not stored, the process proceeds to step 1714.
[0054]
In step 1714, an OK button 1318 or a cancel button 1319 is clicked. If the OK button 1318 is clicked, a TVML command for defining a pause is output to the program information display window 203, and the process proceeds to step 1715. An example of the output TVML command is
character: definepose (name = mari, pose = shokai, joint = Head, rotx = 30.0, roty = 0.0, rotz = 10.0, movex = 0.0, movey = 0.0, movez = 0. 0)
It is. If the cancel button 1319 is clicked, the process proceeds to step 1716 without outputting the TVML command. In step 1716, the pose edit preparation dialog is ended.
[0055]
Next, an example of executing the pause set above will be described with reference to FIGS. When an execution item 1203 in FIG. 12 is clicked, a pause execution preparation dialog 2401 in FIG. 24 is displayed. A dialog 2401 is a preparation dialog for executing the pose data edited in the above procedure. Reference numeral 2402 denotes a name combo box for designating a character for performing a pose. Reference numeral 2403 denotes a character display unit that displays an image of the character specified by the name combo box. A pose name combo box 2404 specifies a pose to be executed by the character. Reference numeral 2405 denotes a pose display unit, which displays an image of the pose specified by the pose name combo box 2404. Reference numeral 2406 denotes an edit button, and when clicked, a pose edit preparation dialog 1301 is activated. As a result, the pose can be edited. Reference numeral 2407 denotes a time text box for inputting a time from a pose before executing the pose designated by the pose name combo box 2404 to a transition to the designated pose. Reference numeral 2408 denotes a preview button for executing the pose specified in the pose name combo box 2404 on the preview screen 204. Reference numeral 2409 denotes an OK button, which outputs the content specified in the pause execution preparation dialogue 2401 to the program information display unit 203 as a TVML command. A cancel button 2410 terminates the pause execution preparation dialog 2401 without outputting the contents specified in the pause execution preparation dialog 2401.
[0056]
The execution procedure of the pause will be described with reference to FIG. FIG. 25 is a flowchart showing the procedure for executing the pause. In step 2501, a pause execution preparation dialog 2401 is started by clicking the execution item 1203 or double-clicking the "pose" command displayed in the program information display window 203. In step 2502, a character to execute a pose is selected from the name combo box 2402. In step 2503, a pose to be executed is selected from the pose names edited in the above pose editing procedure.
[0057]
In step 2504, it is determined whether the edit button 2406 has been clicked. When the edit button 2406 is clicked, the flow advances to step 2505 to start a pose editing preparation dialog 1301, where the pose is edited by the above-described pose editing procedure, and the flow advances to step 2506. If not, the process proceeds to step 2506. In step 2506, the time until the transition from the pose before execution to the pose after execution is entered in a time text box 2407. In step 2507, a pause is executed on the preview screen 204.
[0058]
In step 2508, the user determines whether or not the result of the preview is desired. If a desired preview result is obtained, the process proceeds to step 2509. If the desired preview result is not obtained, the process returns to step 2502, and the character to execute the pose and the pose to be executed are set again. In step 2509, the user clicks an OK button 2409 or a cancel button 2410. If the OK button 2409 is clicked, a TVML command for executing a pause is output to the program information display window 203, and the flow advances to step 2511. An example of the TVML script output here is
character: pose (name = mari, pose = shokai, time = 0.0)
It is. If the cancel button 2410 has been clicked, the flow advances to step 2511. In step 2511, the pause execution preparation dialog 2401 ends.
[0059]
Next, a method of deleting the defined pose will be described with reference to FIGS. When the delete item 1204 in FIG. 12 is clicked, a pause delete preparation dialog 2601 in FIG. 26 is displayed. The dialog 2601 is for deleting the pause data defined by the pause edit preparation dialog 1301 from the program generation unit. Reference numeral 2602 denotes a name combo box for selecting a character whose pose is to be deleted. A pose name combo box 2603 is used to select a pose to be deleted from the defined poses. An OK button 2604 outputs a TVML command for deleting a pause to the program information display unit 203. Reference numeral 2605 denotes a cancel button, which terminates the pause deletion preparation dialog 2601 without outputting a TVML command for deleting a pause.
[0060]
The procedure for deleting the pause will be described with reference to FIG. FIG. 27 is a flowchart showing a procedure for deleting a pause. In step 2701, the user clicks on the delete item 1203 or double-clicks on the “deletepose” command displayed in the program information display window 203 to start the pause delete preparation dialog 2601. In step 2702, the name of the character whose pose is to be deleted is selected in the name combo box 2602. In step 2703, a pose name to be deleted is selected in a pose name combo box 2603. In step 2704, an OK button 2604 or a cancel button 2605 is clicked. If the OK button 2604 is clicked, a TVML command for deleting the pause is output to the program information display window 203, and the flow advances to step 2706. An example of the TVML command output here is
character: deletepose (name = mari, pose = shokai)
It is. If the cancel button 2605 has been clicked, the flow advances to step 2706. In step 2706, the pause erase preparation dialogue 2601 ends.
[0061]
Next, an animation editing method will be described with reference to FIGS. FIG. 28 is the same as the screen example shown in FIG. 11, but is a screen example when an animation item 1102 is clicked on the menu bar 202. When an animation item 1102 is clicked, an animation setting menu 2801 shown in FIG. 28 is displayed. Reference numeral 2802 denotes a read item, which is a menu item for starting a preparation dialog for reading an animation file. Reference numeral 2803 denotes an execution item, which is a menu item for activating a preparation dialog for executing an animation. Reference numeral 2804 denotes a close item for closing the read animation file.
[0062]
FIG. 29 shows an example of a screen displayed when the read item 2802 is clicked. The displayed dialog is an animation reading preparation dialog 2901, which is a dialog for executing reading of an animation file. Reference numeral 2902 denotes a name combo box for selecting a character for executing an animation. Reference numeral 2903 denotes an animation name text box for inputting an animation name unique in a program. Reference numeral 2904 denotes a file name text box for designating an animation file stored in the storage device 102. Reference numeral 2905 denotes a reference button. When clicked, a file selection dialog shown in FIG. 30 is activated.
[0063]
30 is a screen similar to the file selection dialog 1401 in FIG. 14 except that the file display unit 3002 displays an animation file. The file display unit 3002 displays a moving image indicating the contents of the animation as an icon. By double-clicking this, an animation file can be selected.
[0064]
In FIG. 29, reference numeral 2906 denotes a character display unit on which an image of the character selected in the name combo box 2902 is displayed. Reference numeral 2907 denotes an animation display unit which displays a moving image of the animation selected by the animation file selection dialog 3001 activated from the file name text box 2904 or the reference button 2905. A preview button 2908 executes the read animation on the preview screen 204. Reference numeral 2909 denotes an OK button, which outputs a TVML script defining an animation file to the program information display window 203, and terminates the animation loading preparation dialogue 2901. A cancel button 2910 terminates the animation reading preparation dialogue 2901 without outputting a TVML command for defining the animation.
[0065]
The animation reading procedure will be described with reference to FIG. FIG. 31 is a flowchart showing a procedure for reading an animation. In step 3101, the animation reading preparation dialogue 2901 is activated by clicking the read item 2802 or double-clicking the “openkeyframe” command displayed on the program information display unit 203. In step 3102, a character for which an animation is to be set is selected from the name combo box 2902. In step 3103, an animation file to be read is specified. As for the method of specifying an animation file, an animation file to be read is selected in an animation file selection dialog 3001 activated by clicking a reference button 2905. In step 3104, the animation name is entered in the animation name text box 2903. In step 3105, an animation is executed on the preview screen 204 by clicking the preview button 2908.
[0066]
In step 3106, the user determines whether or not the result of the preview is desired. If a desired preview result is obtained, the process proceeds to step 3107. If the desired preview result is not obtained, the process returns to step 3102, and the character name for setting the animation and the animation file to be read are set again. In step 3107, the user clicks an OK button 2909 or a cancel button 2910. If the OK button 2909 is clicked, a TVML command for reading an animation is output, and the flow advances to step 3109. An example of the TVML command output here is
character: openkeyframe (name = mari, keyframename = anime, filename = "anime.dcanime")
It is. If the cancel button 2910 is clicked, the flow advances to step 3109. A step 3109 ends the animation reading preparation dialogue 2901.
[0067]
Next, an example of an animation execution method will be described with reference to FIGS. When an execution item 2803 in FIG. 28 is clicked, an animation execution preparation dialog 3201 in FIG. 32 is displayed. The dialog 3201 is a dialog for outputting a TVML command for executing an animation. Reference numeral 3202 denotes a name combo box for selecting a character name for executing an animation. Reference numeral 3203 denotes a character display unit which displays an image of the character selected in the name combo box 3202. An animation name combo box 3204 is used to select an animation to be executed from the animation name specified in the animation file reading dialog 2901. Reference numeral 3205 denotes an animation display unit which displays an image showing the contents of the animation.
[0068]
Reference numeral 3206 denotes a file selection button. When clicked, an animation file reading dialog 2901 is activated. Thereby, reading of the animation file is possible. A speed text box 3207 is used to input a speed at which the animation is executed. Reference numeral 3208 denotes a repeat text box for inputting the number of times the animation is executed. A preview button 3210 executes an animation specified by the animation name combo box 3204 on the preview screen 204. An OK button 3210 outputs a TVML command for executing an animation to the program information display unit 203. A cancel button 3211 ends the animation execution preparation dialogue 2901 without outputting a TVML command for executing the animation.
[0069]
The animation procedure will be described with reference to FIG. FIG. 33 is a flowchart showing a procedure for executing an animation. In step 3301, the animation execution preparation dialog 3201 is started by clicking the execution item 2803 or double-clicking the “keyframe” command displayed in the program information display window 203. A step 3302 selects a character to execute the animation in the name combo box 3202. A step 3303 selects an animation name to be executed from the animation name combo box 3204.
[0070]
In step 3304, if the file selection button 3206 is clicked, the process proceeds to step 3305. If not, the process proceeds to step 3306. In step 3305, an animation reading preparation dialogue 2901 is activated to perform the above-described animation reading operation.
[0071]
In step 3306, the speed at which the animation is executed is input to the speed text box 3207. In step 3307, the number of times of repeating the animation is input to the repeat text box 3208. In step 3308, a preview button 3209 is clicked to execute animation on the preview screen 204.
[0072]
In step 3309, the user determines whether or not the result of the preview is desired. If a desired preview result is obtained, the process proceeds to step 3310. If the desired preview result is not obtained, the process returns to step 3302, and the character for executing the animation, the name of the animation to be executed, and the like are set again. In step 3310, an OK button 3210 or a cancel button 3211 is clicked. If the OK button 3210 is clicked, a TVML command for executing a pause is displayed on the program information display window 203, and the process proceeds to the end step 3312. An example of the TVML command output here is
character: keyframe (name = mari, keyframename = anime, speed = 1.0, repeat = 1)
It is. If the cancel button 3211 has been clicked, the flow advances to step 3212. In step 3312, the pause execution preparation dialog is ended.
[0073]
Finally, an example of closing the read animation file will be described with reference to FIG. 28 and FIGS. When the close item 2804 in FIG. 28 is clicked, an animation close dialog 3401 in FIG. 34 is displayed. The dialog 3401 is a dialog for closing the animation file read by the animation reading dialog 2901. Reference numeral 3402 denotes an animation name combo box for selecting an animation name to be closed. An OK button 3403 outputs a TVML command for closing the animation to the program information display unit 203. A step 3404 ends the animation close dialog 3401 without outputting a TVML command for closing the animation.
[0074]
The procedure for closing the animation file will be described with reference to FIG. In step 3501, the animation close preparation dialogue 3401 is activated by clicking the close item 2804 of the menu bar 202 in FIG. 28 or double-clicking the “closekeyframe” command displayed in the program information display window 203. In step 3502, an animation to be closed is selected in the animation name combo box 3402. In step 3503, the user clicks an OK button 3403 or a cancel button 3404. If the OK button 3404 is clicked, a TVML command for closing the animation is output to the program information display window 203, and the process proceeds to step 3505. An example of the TVML command output here is
character: closekeyframe (keyframename = anime)
It is. If the cancel button 3405 is clicked, the flow advances to step 3505. In step 3505, the animation close preparation dialogue 3401 ends.
[0075]
As described above, according to the present embodiment, the cooperation between the motion authoring tool and the program information generation unit is realized, and it becomes possible to set a free pose and animation for the character in the screen being edited, thereby achieving an efficient program. It has become possible to provide a production method and apparatus.
[0076]
【The invention's effect】
According to the present invention, it becomes possible to freely specify a pose or animation for a character in program editing executed by a computer under a program production program. This enables the production of highly expressive programs. Furthermore, since the pose and animation can be set interactively and intuitively using the GUI displayed on the production screen, it is not necessary to directly input numerical values such as joint angles, thereby improving the efficiency of program production. be able to. In addition, by displaying the pose and animation being edited on the preview screen, it is possible to specify the pose and animation of the character while mutually confirming the background and the positional relationship with other characters, thereby improving the efficiency of program production. be able to.
[0077]
As described above, it is possible to realize a program production apparatus and a program production method capable of producing a program with rich expressiveness, which can reduce the complexity of work and improve work efficiency.
[Brief description of the drawings]
FIG. 1 is a configuration diagram for explaining an embodiment of a program generation device according to the present invention;
FIG. 2 is a diagram for explaining an example of a conventional program production method.
FIG. 3 is an exemplary view showing an example of a screen operation when a program is produced by the program production method shown in FIG. 2;
FIG. 4 is an exemplary view showing an example of producing a screen on which a character walks by the screen operation shown in FIG. 3;
FIG. 5 is a diagram showing an example of a screen after a character has finished walking.
FIG. 6 is a view for explaining an example of a program production method using a motion authoring tool.
FIG. 7 is an exemplary view showing an example of a character pose set by the program production method shown in FIG. 6;
FIG. 8 is a diagram showing an example of an operation when setting a pose using a motion authoring tool.
FIG. 9 is a diagram showing an example of an operation when setting an animation using a motion authoring tool.
FIG. 10 is a diagram showing an example of a playback screen of an animation created by the operation shown in FIG. 9;
FIG. 11 is a diagram for explaining an embodiment of the program production method of the present invention.
FIG. 12 is a view for explaining an example of pause setting by the program production method of the present invention.
FIG. 13 is a view for explaining an example of pause editing preparation in pause setting by the program production method of the present invention.
FIG. 14 is an exemplary view for explaining an example of pause file selection in pause setting according to the program production method of the present invention.
FIG. 15 is a view showing a state where a joint is selected in the pose editing preparation shown in FIG. 13;
FIG. 16 is a view showing a state in which position designation is displayed in the pose editing preparation shown in FIG. 13;
FIG. 17 is a flowchart for explaining an example of a procedure for editing a pose by the program production method of the present invention.
FIG. 18 is a view for explaining an example of user viewpoint setting by the program production method of the present invention.
19 is a diagram showing an example of a viewpoint from the front in the user viewpoint setting shown in FIG. 18;
20 is a diagram showing an example of a viewpoint from above in the user viewpoint setting shown in FIG. 18;
FIG. 21 is a diagram showing an example of a viewpoint from the right in the user viewpoint setting shown in FIG. 18;
FIG. 22 is a view showing an example of a viewpoint from the left in the user viewpoint setting shown in FIG. 18;
FIG. 23 is a diagram showing an example of a viewpoint obliquely from the upper right in the user viewpoint setting shown in FIG. 18;
FIG. 24 is a view for explaining an example of a pause execution preparation dialog according to the program production method of the present invention.
FIG. 25 is a flowchart illustrating an example of a procedure for executing a pause according to the program production method of the present invention.
FIG. 26 is a view for explaining an example of pause erase preparation by the program production method of the present invention.
FIG. 27 is a flowchart illustrating an example of a procedure for deleting a pause according to the program production method of the present invention.
FIG. 28 is a view for explaining an example of animation setting by the program production method of the present invention.
FIG. 29 is a view for explaining an example of animation reading preparation by the program production method of the present invention.
FIG. 30 is a view for explaining an example of animation file selection by the program production method of the present invention.
FIG. 31 is a flowchart for explaining an example of a procedure for reading an animation by the program production method of the present invention.
FIG. 32 is a view for explaining an example of animation preparation by the program production method of the present invention.
FIG. 33 is a flowchart illustrating an example of a procedure for executing an animation according to the program production method of the present invention.
FIG. 34 is a view for explaining an example of an animation close preparation dialogue according to the program production method of the present invention.
FIG. 35 is a flowchart illustrating an example of a procedure for closing an animation according to the program production method of the present invention.
FIG. 36 is a configuration diagram for explaining an example of a conventional program production device.
[Explanation of symbols]
101: Program information, 102: Storage device, 103: Computer, 104: Program generation unit, 105: Program information generation unit, 106: Sequencer unit, 107: CG animation generation unit, 108: Voice synthesis unit, 109: Moving image generation Unit 110 video interface 111 speaker 112 monitor 113 input device 114 motion authoring unit 115 automatic scripting unit 121 program production program 122 program editing program 123 image / audio File 124: Program information file 125: Program editing unit 126: Automatic scripting program 127: Motion authoring program 201: Main screen of the program information generation unit 202: Menu bar 203: Program information display window 204 ... Preview screen, 1 01 ... the pause menu, 1102 ... animation menu, 1103 ... user point of view menu.

Claims (12)

A program information generating unit for generating program information for producing a video program including a CG in which a character appears, a program generating unit for generating a program according to the program information, and a display device for displaying the generated program on a screen. A motion authoring unit for setting a free pose and animation for the character; and automatic scripting for incorporating pose data and animation data generated by setting a free pose and animation into a script indicating the program information. A program and a program, wherein a free pose and an animation are set for the character on the screen during program editing by being integrated with the program information generating unit. 2. The program production device according to claim 1, wherein the program information generation unit generates the program information based on a dialog on a displayed screen. The program production apparatus according to claim 1, wherein the motion authoring unit sets a free pose and animation based on a displayed dialog on the screen of the program information generation unit. 2. The program production apparatus according to claim 1, further comprising a storage device for storing pose data and animation data generated by setting free poses and animations. 2. The program production apparatus according to claim 1, further comprising means for generating a screen in which a character in which a free pose and animation are set is viewed from an arbitrary viewpoint. A program information generating step of generating program information for producing a video program including a CG in which a character appears, a program generating step of generating a program according to the program information, a display step of displaying the generated program on a screen, A motion authoring process for setting a free pose and animation for the character; and an automatic script process for incorporating pose data and animation data generated by setting the free pose and animation into a script indicating the program information. A program production method, wherein a free pose and animation are set for the character on the screen during program editing. The program production method according to claim 6, wherein the program information generating step generates the program information based on a dialog on a displayed screen. 7. The program production method according to claim 6, wherein in the motion authoring step, a free pose and animation are set based on a displayed dialog on the screen of the program information generation step. The method according to claim 6, further comprising the step of storing pose data and animation data generated by setting free poses and animations in a storage device. 7. The program production method according to claim 6, further comprising a step of generating a screen in which a character in which a free pose and animation are set is viewed from an arbitrary viewpoint. A procedure for generating program information for producing a video program including a CG in which a character appears on the computer, a procedure for generating a program in accordance with the program information, a procedure for displaying the generated program on a screen, Procedures for setting free poses and animations, and generated by setting free poses and animations so that free poses and animations are set for the characters on the screen during program editing Automatically incorporating pose data and animation data into a script indicating the program information. A procedure for generating program information for producing a video program including a CG in which a character appears on the computer, a procedure for generating a program in accordance with the program information, a procedure for displaying the generated program on a screen, Procedures for setting free poses and animations, and generated by setting free poses and animations so that free poses and animations are set for the characters on the screen during program editing And a computer-readable recording medium for recording a program production program for executing a procedure for automatically incorporating pause data and animation data into a script indicating the program information.

Images