JPH09167252A - Animation image generation processing method by action input - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make it possible to attain input time series parameter for the composite animation image generation processing with no contact and also to make the animation image generation processing with a special effect, etc., possible to match with the human actions. SOLUTION: An action input means X inputs the human action image via camera, etc., extracts the feature value at every unit processing time and turns the time series change of the feature value into a parameter. A transfer processing means Y turns the parameter into the data to send it to an animation image generation processing means Z. Then, the data is converted into a control parameter to be applied to the animation image generation processing and inputted to the means Z. The means Z generated a computer animation or produce and edit the video images by means of the control parameter.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to dynamic image generation, for example, for creating animation by computer graphics on a computer and for producing and editing video by adding special effects to moving images. When performing processing, moving image generation using a certain feature amount change in motion information of a human or the like input using a non-contact type input means such as a camera as a parameter of temporal or spatial change of the moving image. It relates to a processing method.

[0002]

2. Description of the Related Art Normally, when a computer is used to interactively perform a moving image generation process such as computer animation creation or video production / editing, a mouse, trackball,
In many cases, it is directly and manually performed using a contact type input device such as a tablet or a dial, which is connected to a computer that implements the moving image generation processing means.

[0003]

However, when a direct contact type device is used when interactively performing moving image generation processing such as video production / editing as described above,
It was inconvenient when both hands were occupied or the user had a hand disorder.

Further, since the input by the contact type device is basically an input by a position change, it is difficult to perform a moving image generation process at a delicate timing according to a human motion.

If there is a distance between the computer that holds and processes the work that is the target of the moving image generation processing and the person who gives the instruction for the moving image generation processing, interactive moving image generation processing should be performed. It was difficult to implement.

Further, it has been difficult to perform moving image generation processing using a value obtained by combining a plurality of input values as a parameter.

The present invention is intended to solve the above problems, and enables non-contact input of time-series parameters of complex moving image generation processing, and special effects tailored to human motions. It is an object of the present invention to provide a moving image generation processing method that enables the moving image generation processing.

[0008]

In order to achieve the above object, the first invention according to the present invention is to input motion information such as a human motion using a non-contact type input means such as a camera,
An operation input step of extracting a change in a feature amount from the input motion information and parameterizing the parameter, converting the parameter into data and transferring the data for each unit time of a moving image generating process, and generating the transferred data by generating the moving image. A transfer processing step of converting into a single or a plurality of control parameters applied to the processing, and a moving image generation processing step of performing a moving image generation processing such as computer animation or video production / editing using the control parameters. And a moving image generation processing method based on motion input.

According to a second aspect of the present invention, in the transfer processing stage of the first aspect of the present invention, the dataized parameters are transferred to a moving image generation processing side using a remote computer via a network line. Then, the transferred image is converted by the moving image generation processing side into a single or a plurality of control parameters and input to a moving image generation processing step executed by a computer or the like. The generation processing method is used as a means.

Further, a third invention according to the present invention is provided with a plurality of motion input means for extracting the change of the feature quantity and parameterizing it at the motion input stage in the above-mentioned first invention, wherein a plurality of motion information parameters are set. In the transfer processing stage, transfer data in which each parameter is converted into data is transferred in each of the operation input means, and the transferred transfer data is converted into a single or a plurality of control parameters applied to the moving image generation processing. A moving image generation processing method by motion input characterized by conversion is used as means.

Further, in a fourth invention according to the present invention, at the transfer processing stage in the third invention, the transfer data of each parameter converted into data for each operation input means is used as a moving image using a remote computer or the like. The data is transferred to the generation processing side via a network line, and each of the transferred transfer data is converted to one or more control parameters on the moving image generation processing side and input to the moving image generation processing stage by a computer or the like. A moving image generation processing method by motion input is used as means.

According to the present invention, the operation of a human being or the like is parameterized and input by the non-contact type input means.
Non-contact time-series parameters for composite moving image generation processing can be input, and by using these time-series parameters, videos such as special effects that are not dependent on the number of input parameters and are suitable for human motions can be created. Enables image generation processing. Further, in the transfer processing stage, the parameter of the motion information is transferred to the moving image generation processing side via a network line or the like, thereby realizing the moving image generation processing independent of the input location of the parameter.

[0013]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

[Embodiment 1] FIG. 1 shows the configuration and processing flow of a first embodiment of the present invention.

The present embodiment shows a basic configuration, in which a motion image of a person is input by a non-contact type input means such as a camera, and a feature amount for every unit time is extracted, The operation input means X for parameterizing the time series change of the feature quantity is made into one module, and by inputting the time series change of a certain parameter, the computer animation generation process and the video image production / edit process can be performed in the computer. The moving image generation processing means Z to be realized is made into one module, and the data transfer processing means Y for sending the time series change of the parameter from the operation input means X to the moving image generation processing means Z is made into one module, and these three are By combining the modules, that is, the motion input means X, the moving image generation processing means Y, and the data transfer processing means Z, the location and the number of input parameters Realizing moving image generation processing method according-independent operating input.

The motion input means X inputs a motion image of a human at a unit processing time ti by a non-contact motion input device such as a camera, appropriately processes the image, and then extracts a feature quantity of the motion and digitizes it. , By taking the difference from the previous time,
It is parameterized as a time series change of the feature amount for each unit processing time ti, and the obtained parameter P _m (ti) is output.

The moving image generation processing means Z inputs a time-series change of a certain parameter as a control parameter for each unit processing time in the computer animation generation processing and the video image production / editing processing in the computer, and the unit thereof. A moving image is generated and displayed for each processing time. The control parameter may be singular or plural.

The data transfer processing means Y is an operation input means X.
In a computer that realizes the above, the parameters generated by the operation input means X are converted into data and transferred to the moving image generation processing means Z for each processing unit time. Further, a computer that implements the moving image generation processing means Z receives the above data,
In the case of a plurality of data, appropriate weighting or the like is performed and converted into a control parameter Q _n = f (P ₁ , P ₂ , ..., P _M ) applied to the moving image generation processing as one or a plurality of output values. , Is passed to the moving image generation processing means Z for each processing unit time so that the moving image generation processing can be performed. When the computer that implements the motion input means X and the computer that implements the moving image generation processing means Z are different, the former is the part that converts the parameters into data and transmits the latter, and the latter is the part that receives the data and converts the parameters. To be done.

The motion input means X and the moving image generation processing means Z may be realized on the same computer, or may be realized on different computers connected by a network line.

[Embodiment 2] FIG. 2 shows a second embodiment of the present invention.
6 is a diagram for explaining the configuration and the flow of processing of the embodiment example of FIG.

In the present embodiment, the processing in the operation input means consisting of three stages shown in the first embodiment, the processing in the data transfer means, and the processing in the moving image generation processing means are performed by the first computer 1. And the second computer 2.
The computer 1 and the computer 2 may be the same.

In FIG. 2, t represents time and Δt represents unit processing time. The processing start time is set to t ₀ by the initial time setting.
And The parameter P (t) is the amount of change in the motion feature quantity at time t, that is, the difference amount obtained by subtracting the motion feature quantity at t−Δt from the motion feature quantity at time t.

The processing in the operation input means is performed by the computer 1. First, for example, an image is input from a camera connected to the computer 1 to input a motion. The image frame captured at time t is subjected to image processing such as binarization of pixels or digitization of luminance information by removing the background, and the feature amount is extracted. Any image processing method and extracted feature amount may be used as long as the action at each time is extracted. The parameter P (t) at time t is obtained by taking the difference between this feature amount and the feature amount at time t-Δt.

The processing in the data transfer processing means, for example, when the operation input means and the moving image generation processing means are mounted on different computers via a network line,
In the computer 1 in which the operation input means is installed, the parameter P (t) is transferred to the computer 2 in which the moving image generation processing means is installed, and the parameter P (t) received in the computer 2 is transferred in the moving image generation processing means. The control parameter Q (t) is input to. The conversion formula may have any format. Although Q (t) = f (P (t)) is shown in the figure, it may be a simple linear expression such as Q (t) = aP (t) or a complicated non-linear expression. In the network transfer, since the parameters output from the operation input means are converted into data and transferred, the transfer time is short and interactive moving image generation processing can be performed.

Further, for example, when the motion input means and the moving image generation processing means are mounted on the same computer, the output value from the motion input means side is directly used for each unit processing time. Substitute as an input value to.

The processing in the moving image generation processing means is performed by the computer 2. Here, the parameter Q (t) from the data transfer processing means is substituted, and necessary moving image generation processing and moving image display are performed.

For example, when a scene is changed from one moving image A to another moving image B by inputting the movement of the hand into the camera, the moving distance of the hand at time t is set to P.
(T), the brightness of the moving image A is Q (t), and the brightness of the moving image B is 1-Q (t), and Q (t) = P (t) / P _max (P
_It can be realized by superimposing the moving image A and the moving image B such that _max is a known value).

[Embodiment 3] FIG. 3 shows a third embodiment of the present invention.
6 is a diagram for explaining the configuration and the flow of processing of the embodiment example of FIG.

Like the first embodiment, this embodiment has three stages of processing in the operation input means, processing in the data transfer means, and processing in the moving image generation processing means. It is assumed that there are M computers (computers 11, 12, ..., 1M) that implement (1), and that there are N control parameters for the moving image generation processing in the moving image generation processing means (N = 1 is also acceptable). .

In FIG. 3, a computer 1 m (m = 1, 2, ...,
The parameter at time t output from M) is P _m (t), and the n-th moving image generation parameter at time t is Q _n (t) (n = 1, 2, ..., N). The processing start time is set to t ₀ by the initial time setting. P (t) is the amount of change in the motion feature quantity at time t, that is, the difference amount obtained by subtracting the motion feature quantity at t-Δt from the motion feature quantity at time t.

The operation input means in each computer 1m inputs the operation by a non-contact type input means such as a camera, as in the computer 1 in the second embodiment.

During the processing in the data transfer processing means, the procedure of data transmission in each computer 1m is the same as that of the second embodiment. In the subsequent processing of the data transfer processing means in the computer 2 in which the moving image generation processing means is mounted, each received parameter P _m (t) (m = 1,
2, ..., M) are converted into control parameters necessary for the moving image generation processing as described below, and are passed to the moving image generation processing means in the computer 2.

That is, here, Q _n (t) = f (P
Conversion such as ₁ (t), P ₂ (t), ..., P _M (t)) is performed. For example, in the case of linear conversion, set the coefficient to c _nm

[0034]

[Equation 1]

## EQU1 ##

The moving image generation processing means in the computer 2 uses the parameter Q input by the data transfer processing means.
Necessary moving image generation processing is performed using (t _i ).

For example, assuming that two cameras are connected to the computer, the light source position Q ₁ in the computer graphics image changes when a person crosses in front of the first camera, and the second camera When the object moves in the computer graphics image by the distance Q _{2 in} front of the person moving the hand, the moving distance of the person image by the first camera at a certain time t is P ₁ , the moving distance of the hand of the camera as _{P 2, Q 1 (t i} ) = c 1 P 1 (t i), Q 2 (t i) = c 2 P 2 (t i) (2) ( where c ₁ and c ₂ can be expressed as a coefficient).

In each of the above embodiments, an example in which a human motion is input as motion information has been shown, but a motion other than a human motion may be input to perform the moving image generation processing. In addition, the non-contact type input means is not limited to the camera, for example,
Other means such as a spatial position detecting means using a laser, radio waves, sound waves, ultrasonic waves or the like can be used.

[0039]

As described above, according to the present invention,
(1) Since the operation input is performed using the non-contact type input means, it is possible to realize a highly convenient moving image generation process that does not depend on the number of input parameters.

(2) It is possible to perform moving image generation processing at a delicate timing according to the motion of a person or the like.

According to the second and fourth aspects of the present invention, in particular, (3) it does not depend on the physical distance between the person or the like who is the subject of the motion and the computer that implements the moving image generation processing. A moving image generation process can be realized.

Furthermore, according to the third and fourth aspects of the present invention, in particular, (4) a complex moving image generation process can be performed using a value obtained by combining a plurality of motion input values as a parameter.

There is an effect.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a configuration and a flow of processing according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating a configuration and a flow of processing according to a second embodiment of the present invention.

FIG. 3 is a diagram illustrating a configuration and a flow of processing according to a third embodiment of the present invention.

[Explanation of symbols]

X ... Motion input means Y ... Data transfer processing means Z ... Moving image generation processing means 1, 11, 12, ..., 1M ... Computer that mounts motion input means 2 ... Computer that mounts moving image generation processing means

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Internal reference number FI Technical indication H04N 7/18 G06F 15/62 380 15/70 400

Claims (4)

[Claims] 1. A motion input step of inputting motion information using a non-contact type input means, extracting a change of a feature amount from the input motion information and parameterizing the motion information, and converting the parameter into data to generate a moving image. A transfer processing step of transferring at every unit time of the generation processing and converting the transferred data into a single or a plurality of control parameters applied to the moving image generation processing; and generating a moving image using the control parameters. A moving image generation processing method according to motion input, comprising: a moving image generation processing step for performing processing. 2. In the transfer processing stage, the dataized parameter is transferred to a remote moving image generation processing side via a network line, and the transferred data is transferred to the moving image generation processing side by a single or plural number. The moving image generation processing method by motion input according to claim 1, wherein the moving image generation processing method converts the control parameter and inputs the control parameter to the moving image generation processing step. 3. The motion inputting step comprises a plurality of motion inputting means for extracting the change of the feature quantity and parameterizing the change, and obtains a plurality of motion information parameters. In the transfer processing step, each parameter for each motion inputting means 2. The moving image according to the motion input according to claim 1, wherein the moving image is converted into data and transferred, and the transferred data of each parameter is converted into a single or a plurality of control parameters applied to the moving image generation process. Generation processing method. 4. In the transfer processing stage, each parameter converted into data for each operation input means is transferred to a remote moving image generation processing side via a network line, and each transferred to the moving image generation processing side. 4. The moving image generation processing method by motion input according to claim 3, wherein the data is converted into a single or a plurality of control parameters and input to the moving image generation processing step.