JP4289179B2 - Interactive animation generation method and apparatus, interactive animation generation program, and storage medium storing interactive animation program - Google Patents

Description

  The present invention relates to an interactive animation generation method and apparatus, an interactive animation generation program, and a storage medium storing the interactive animation program, and more particularly, generates an interactive animation in response to a user's interactive input. The present invention relates to an interactive animation generation method and apparatus, an interactive animation generation program, and a storage medium storing the interactive animation program.

Conventionally, there is a method of capturing the motion of an application as shown in FIG. In the figure, an application 10 has an interactive property and captures the moving image recording device 12 including the user input from the input device 11 (for example, free software “Eyes of Cajamarca” http: // (See www.paw.hi-ho.ne.jp/milbesos/) .

  However, since the conventional method of capturing the movement of the application as a moving image includes the user input performed at the time of capturing, the generated moving image is fixed. As shown in FIG. There is a problem that the interactive nature that we had is lost.

  On the other hand, when a complicated calculation is required for generating an animation, as shown in FIG. 14, the calculation must be performed every time the animation is played back. There is a problem that can not be.

  The present invention has been made in view of the above points, and an interactive animation generation method and apparatus and an interactive animation generation program for generating an animation that retains interactivity without complicated calculations at the time of animation reproduction. And a storage medium storing an interactive animation program.

  FIG. 1 is a diagram for explaining the principle of the present invention.

The present invention provides an interactive animation generation method,
State comparator no change in state of the screen on which the application is running (step 1), the application detects a state of waiting for input from the user (step 2), the screen state at that time Whether it has been in the past is determined by referring to the screen state recording means (step 3). If not, the screen state S1 is stored in the screen state recording means, and the frame number of the screen in the screen state S1 is recorded as a moving image. Recorded in the means (step 4),
Input generator, the screen state at the present time, generates an input that is not input so far, as an input to the application (Step 5),
The application operates on the input from the input generator,
State comparator, the when the application monitor screen during operation (step 6), when the application detects that a input wait state (step 7), the application is ready waiting for input The screen state S2 transitioned from the screen state S1 is recorded in the screen state recording unit, and the frame number of the screen in the screen state S2 is recorded in the moving image recording unit (step 8).
The process of acquiring information on the state transition from the screen state S1 to the screen state S2 from the screen state recording unit and the moving image recording unit and recording it in the state transition recording unit is repeated (step 9).

  FIG. 2 is a principle configuration diagram of the present invention.

The present invention is an interactive animation generation apparatus,
Moving image recording means 4 for storing moving images and frame numbers of moving images;
An application 7 that operates in response to an input;
Screen state recording means 2 for storing the screen state by the application 7,
State transition recording means 3 for recording a screen state transition;
The state of the screen display in which the application 7 is operating does not change , the state in which the application 7 is waiting for input from the user is detected, and the screen state recording means indicates whether the screen state at that time has been in the past. Referring to determine, the said screen state S1 if no and records on said screen status recording device 2, the state comparator 1 for recording the frame number of the screen in the screen state S1 to the moving image recording unit 5,
An input generator 5 that generates an input that has not been input so far in the screen state at the present time, and uses the input as an input to the application;
The state comparator 1 is
When the application 7 monitors the operating screen and detects that the application is in an input waiting state, the screen state recording of the screen state S2 that has transitioned from the screen state S1 when the application is in an input waiting state is performed. In addition to recording in the means 2, the frame number of the screen in the screen state S2 is recorded in the moving picture recording means 4, and information on the state transition from the screen state S1 to the screen state S2 is recorded in the screen state recording means 2 and the moving picture recording means. 4 and a means for recording in the state transition recording means 3.

The present invention is an interactive animation generation program,
On the computer,
The screen display state in which the application is operating does not change , the state in which the application is waiting for input from the user is detected, and whether the screen state at that time has been in the past is referred to the screen state recording means. If not, the step of recording the screen state S1 in the screen state recording unit and recording the frame number of the screen in the screen state S1 in the moving image recording unit;
In the current screen state, generating an input that has not been input so far and inputting it to the application;
When a screen on which the application is operating is monitored and it is detected that the application is in an input waiting state, the screen state recording means displays a screen state S2 that has transitioned from the screen state S1 when the application is in an input waiting state. And recording the frame number of the screen in the screen state S2 in the moving image recording means;
Acquiring information on the state transition from the screen state S1 to the screen state S2 from the screen state recording unit and the moving image recording unit, and recording the information in the state transition recording unit;
Repeating the above steps.

The present invention is a storage medium storing an interactive animation generation program,
On the computer,
The screen display state in which the application is operating does not change , the state in which the application is waiting for input from the user is detected, and whether the screen state at that time has been in the past is referred to the screen state recording means. If not, the step of recording the screen state S1 in the screen state recording unit and recording the frame number of the screen in the screen state S1 in the moving image recording unit;
In the current screen state, generating an input that has not been input so far and inputting it to the application;
When a screen on which an application is operating is monitored and it is detected that the application is in an input waiting state, a screen state S2 that has transitioned from the screen state S1 when the application is in an input waiting state is recorded. And recording the frame number of the screen in the screen state S2 on the moving image recording means,
Acquiring information on the state transition from the screen state S1 to the screen state S2 from the screen state recording unit and the moving image recording unit, and recording the information in the state transition recording unit;
A storage medium storing interactive animation creation program Ru to execute the steps of: repeating the above steps.

  As described above, in the present invention, in response to the user's interactive input, the calculation is performed in advance by limiting the user's input to the software that performs the complicated calculation and generates the animation, It is possible to create an animation that retains the interactive nature without performing complicated calculations when the animation is played back.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 3 shows a configuration of an interactive animation generation apparatus according to an embodiment of the present invention.

  The apparatus shown in FIG. 1 includes a state comparator 1, a screen state recording unit 2, a state transition recording unit 3, a moving image recording unit 4, an input generator 5, an input unit 6, and an application 7.

  The state comparator 1 observes the state of the screen of the application 7 and detects that there is no change in the screen, that is, the application 7 is waiting for user input, and the same screen state as the state of the screen at that time The screen state recording unit 2 is searched for whether or not there has been in the past, and if not, the screen state is recorded in the screen state recording unit 2.

  The input generator 5 generates an input (for example, click mark) that has not been tried in the screen state at that time, and sends it to the application 7 as an input.

  The application 7 operates according to the input generated by the input generator 5 until it next waits for input from the input unit 6, and records the screen operation during that time in the moving image recording device 4.

  The moving image recording device 4 stores the frame number in the moving image screen state.

  The state transition recording unit 3 records a state transition in which the screen state has changed. For example, when there is a state of all screens of the application 7 and an input “input” from a certain state “Start” and a transition to another state “Send”, a movie recording “movie”, that is, a set of four (Start , Input, Send, movie).

  Since this set can be played back with a fragment of a moving image and simple user input, it can be played back with a smaller amount of calculation than creating a moving image.

  Next, the operation in the above configuration will be described.

  FIG. 4 is a flowchart of the operation in one embodiment of the present invention.

Application 7 starts (step 101) and records the screen and the frame number f _i during operation of the application 7 to the moving image recording section 4 (step 102).

The state comparator 1 monitors the screen during operation of the application 7, and determines whether the application 7 is waiting for input (step 103). If it is not waiting for input but is in operation, the process proceeds to step 102 and the operation of the application 7 is continuously monitored.

If it is waiting for input determines whether the screen state S _i at the present time exists in the screen state recording unit 2 (step 104). If there is a same screen in the screen condition recording unit 2 proceeds to step 107, if no records screen state S _i at that time in the screen state recording unit 2 (step 106). Moreover, to record the frame number _{f i} of the current video movie recording unit 4 (step 107).

The input generator 5 generates a new input and inputs it to the application 7 (step 108). Thereby, the moving image and the frame number f _{i + 1} by the operation of the application 7 are recorded in the moving image recording unit 4 (step 109).

Here, when the application 7 is in an input waiting state (step 110), it is determined whether or not the current screen state S _{i + 1} exists in the screen state recording unit 2 (step 111). (Step 112), the screen state S _{i + 1} at that time is recorded in the screen state recording unit 2 (Step 113). The current moving image frame number f _{i + 1} is recorded in the moving image recording unit 4 (step 114).

Next, the screen states S _i and S _{i + 1} before and after the state transition are acquired from the screen state recording unit 2, and the frame numbers of the respective screens corresponding to the screen state recorded in the moving image recording unit 4 F _i and f _{i + 1} are acquired, recorded in the state transition recording unit 3 (step 115), and the process proceeds to step 108.

  Hereinafter, an example in which auxiliary information is added to limit the range that can be input in a certain screen state will be specifically described.

  FIG. 5 shows an example of an operation screen of an application according to the embodiment of the present invention. The application 7 shown in the figure performs the animation of the soccer ball for several steps by clicking the red card with the mouse and stops in the mouse input state. For example, FIG. 6 shows a state in which the animation is activated by clicking the red card at the top in FIG. 5 and stopped.

  In the case of the application 7, the combination is such that three soccer players are facing left or right. If the soccer player is facing left and is “0”, and right is “1”, there are a total of eight screen states in binary. Clicking on the top red card adds “1” to that state. Clicking on the second card adds “2” to that state. Clicking on the third card can be interpreted as adding “4” to the state. In FIG. 6, when the third card is clicked, the state shown in FIG. 7 is obtained after the animation.

  Each of the above states and the state transitions are shown in FIG. 8, FIG. 9, and FIG. When the top card is clicked (+1), the second card is clicked (+2), and the third card is clicked (+4). Each state transition corresponds to an animation fragment.

Which part of the application 7 should be clicked differs depending on each application 7, so a method of explicitly giving it is necessary. Therefore, as shown in FIG. 11, a mark is placed at a place where the application 7 can click. Here, since three marks are placed, they are m1, m2, and m3 from the top. If the screen states are S0, S1,..., S7, the state transition is
(S0, S1, m1) (S1, S2, m1) (S2, S3, m1) ...
(S0, S2, m2) (S1, S3, m2) (S2, S4, m2) ...
(S0, S4, m3) (S1, S5, m3) (S2, S6, m3) ...
It is expressed as This means that if m1 is clicked in S0, transition is made to S1.

  The operation of the system will be described with reference to FIGS.

  The moving image recording unit 4 records all the frame numbers of the operation of the application 7 (step 101). The initial state is S0. The state comparator 1 searches the screen state recording unit 2 to check whether the same state as S0 already exists (step 104). Since this state is not recorded (step 105), the screen state of S0 is recorded in the screen state recording unit 2 (step 106).

  Next, the frame number (f01) of the current moving image is recorded in the moving image recording unit 4 (step 107), and the input generator 5 generates a click at the position of the click mark m1 existing in S0, and Send (step 108).

The application 7 operates several steps and waits for the next input (step 110). The state comparator 1 also retrieves the state from the screen state recording unit 2 and sets it to the screen state S1 (step 113) because it is a new state (steps 111 and 112). Further, the frame number of the moving picture recording apparatus at that time is set to f1 (step 114). here,
[S0, m1, S1, f01, f11]
Is recorded in the state transition recording unit 3 (step 115). The meaning of this information is “clicking m1 in state S0 to enter state S1. The moving image of the state transition is from frame f01 to frame f11”.

  The state comparator 1 searches the state transition recording unit 3 to find the mark that has not been clicked from the current state, and clicks the position (step 108).

  By repeating the above operations, it is possible to obtain the application state and state transition, the position of the click required for it, and the start and end frames of the moving image that occurs during the state transition.

  The information obtained as described above can be easily converted into a format that can be reproduced by a player with a small amount of calculation that can be executed by a mobile phone such as a Flash player.

  It is possible to construct the operation shown in FIG. 4 as a program, install it on a computer that operates as an interactive animation generation apparatus, execute it by a control means such as a CPU, or distribute it via a network. .

  In this case, in the configuration shown in FIG. 3, it is the state comparator and the input generator 5 that substantially operate as a program, and the application 7 is called from the program and executed. The screen state storage unit 2, the state transition recording unit 3, and the moving image recording unit 4 are assumed to use storage means such as a hard disk.

  It is also possible to store the constructed program in a portable storage medium such as a hard disk, a flexible disk, or a CD-ROM connected to a computer that operates as an interactive animation generation apparatus, and install it in the computer. .

  The present invention is not limited to the above-described embodiments and examples, and various modifications and applications are possible within the scope of the claims.

  The present invention is applicable to a system that uses state transitions by assigning an animation image to each state of a finite automan when generating an animation.

It is a figure for demonstrating the principle of this invention. It is a principle block diagram of this invention. It is a block diagram of the interactive animation production | generation apparatus in one embodiment of this invention. It is a flowchart of the operation | movement in one embodiment of this invention. It is an example of the operation | movement screen of a certain application in one embodiment of this invention. It is a figure which shows the state which the animation in one embodiment of this invention operate | moved and stopped. It is a figure which shows the state after clicking the 3rd card | curd in one embodiment of this invention. It is a figure which shows a state transition when the card | curd of "+1" is clicked in one embodiment of this invention. It is a figure which shows a state transition when the card | curd of "+2" is clicked in one embodiment of this invention. It is a figure which shows a state transition when the card | curd of "+4" is clicked in one embodiment of this invention. The example which put the mark in the clickable place in one embodiment of this invention is shown. It is a figure for demonstrating the prior art. It is FIG. (1) for demonstrating the conventional problem. It is FIG. (2) for demonstrating the conventional problem.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 State comparator 2 Screen state recording means, Screen state recording part 3 State transition recording means, State transition recording part 4 Movie recording means, Movie recording part 5 Input generator 6 Input means, input part 7 Application

Claims (4)

In the interactive animation generation method,
State comparator no change in state of the screen on which the application is running, detects a state in which the application is waiting for input from the user, whether the screen state at that time was in the past, the screen state record If not determined with reference to the means, the screen state S1 is stored in the screen state recording means, and the frame number of the screen in the screen state S1 is recorded in the moving image recording means.
The input generator generates an input that has not been input so far in the current screen state, and serves as an input to the application.
The application operates based on the input from the input generator;
The state comparator monitors a screen on which the application is operating. When the state comparator detects that the application is in an input waiting state, the state comparator transitions from the screen state S1 when the application is in an input waiting state . The screen state S2 is recorded in the screen state recording unit, and the screen frame number in the screen state S2 is recorded in the moving image recording unit.
An interactive animation generation characterized by repeating the process of acquiring information of state transition from the screen state S1 to the screen state S2 from the screen state recording unit and the moving image recording unit and recording the information in the state transition recording unit Method. An interactive animation generation device,
Movie recording means for storing movies and movie frame numbers;
An application that works in response to input,
Screen state recording means for storing the screen state by the application;
State transition recording means for recording screen state transition;
The state of the screen display on which the application is operating does not change , the state in which the application is waiting for input from the user is detected, and whether the screen state at that time has been in the past is determined by the screen state recording means. Referring to determine records the said screen state S1 to be in the said screen status recording device, and a state comparator for recording the frame number of the screen in the screen state S1 to the moving image recording unit,
An input generator that generates an input that has not been input so far in the screen state at the present time, and that is used as an input to the application;
The state comparator is
When a screen on which the application is operating is monitored and it is detected that the application is in an input waiting state, the screen state S2 that has transitioned from the screen state S1 when the application is in an input waiting state is displayed on the screen. Recording in the state recording means, recording the frame number of the screen in the screen state S2 in the moving picture recording means, and information on the state transition from the screen state S1 to the screen state S2 in the screen state recording means and the moving picture It is obtained from the recording means, interactive animation generating apparatus characterized by comprising means for recording the state transition recording means. An interactive animation generation program,
On the computer,
The screen display state in which the application is operating does not change , the state in which the application is waiting for input from the user is detected, and whether the screen state at that time has been in the past is referred to the screen state recording means. If not, the step of recording the screen state S1 in the screen state recording unit and recording the frame number of the screen in the screen state S1 in the moving image recording unit;
In the current screen state, generating an input that has not been input so far, and inputting to the application;
When a screen on which the application is operating is monitored and it is detected that the application is in an input waiting state, the screen state S2 that has transitioned from the screen state S1 when the application is in an input waiting state is displayed on the screen. Recording in the state recording means, and recording the frame number of the screen in the screen state S2 in the moving image recording means;
Acquiring information of state transition from the screen state S1 to the screen state S2 from the screen state recording unit and the moving image recording unit, and recording the information in the state transition recording unit;
An interactive animation generation program characterized by causing the above steps to be repeated. A storage medium storing an interactive animation generation program,
On the computer,
The screen display state in which the application is operating does not change , the state in which the application is waiting for input from the user is detected, and whether the screen state at that time has been in the past is referred to the screen state recording means. If not, the step of recording the screen state S1 in the screen state recording unit and recording the frame number of the screen in the screen state S1 in the moving image recording unit;
In the current screen state, generating an input that has not been input so far, and inputting to the application;
When a screen on which the application is operating is monitored and it is detected that the application is in an input waiting state, the screen state S2 that has transitioned from the screen state S1 when the application is in an input waiting state is displayed on the screen. Recording in the state recording means, and recording the frame number of the screen in the screen state S2 in the moving image recording means;
Acquiring information of state transition from the screen state S1 to the screen state S2 from the screen state recording unit and the moving image recording unit, and recording the information in the state transition recording unit;
A storage medium storing an interactive animation generating program, characterized in that a program for executing the above steps is stored.