KR101668747B1 - Apparatus and Method for authoring 3D animation contents - Google Patents

Abstract

The present invention relates to an apparatus and a method for authoring three-dimensional animation contents.
The present invention recognizes the state of both hands of a user by using an infrared ray sensor and controls the corresponding three-dimensional object, and authoring the three-dimensional animation contents using the three-dimensional object, A 3D animation content authoring apparatus and a method therefor, which can manipulate objects or author 3D animations, and which can be used easily and quickly intuitively by general users.

Description

[0001] Apparatus and method for authoring 3D animation contents [0002]

The present invention relates to an apparatus and a method for authoring three-dimensional animation contents.

Various techniques have been proposed to control the motion and state of an object in a three-dimensional virtual space, in particular, in order to author a 3D animation or allow a user to experience a virtual three-dimensional space. For this purpose, a sketch based method of inputting an operation of an object through a fan input has been proposed. However, the above method has difficulty in mapping two-dimensional input information into three-dimensional spatial information. In addition, a video-based animation authoring method has been proposed in which a motion of a physical object is captured and then converted to a three-dimensional animation form. However, a large amount of operations are required in the preprocessing step of preprocessing a physical object to generate a three- In addition, there is a problem that an error occurs in the process of tracking an object in an image.

(0001) Korean Patent Publication No. 10-2011-0055951 (May 26, 2011)

The object of the present invention is to recognize the state of both hands of a user by using an infrared ray sensor and to control the three-dimensional object accordingly and to write the three-dimensional animation contents using the infrared ray sensor, Dimensional animation object or a three-dimensional animation can be manipulated through the movement of the animation object, and a general user can intuitively easily and quickly use the animation object.

According to an aspect of the present invention, there is provided a three-dimensional animation content authoring apparatus for detecting a user's hand on a three-dimensional space and displaying information on the position or direction of the user's hand on the three- An operation detecting unit for obtaining hand information; A gesture recognition unit for recognizing a gesture having a predetermined meaning defined according to an operation of the user's hand using the obtained hand information; And a three-dimensional content authoring unit for editing or recording the three-dimensional animation object on the three-dimensional content space using the obtained hand information and the recognized gesture according to a predetermined predetermined type of authoring state to author three- .

Here, the motion sensing unit may include a sensor unit for sensing the user's hand in a three-dimensional space; And a hand information acquiring unit for acquiring the hand information at predetermined intervals of time.

Here, the sensor unit senses the user's hand in a three-dimensional space using at least two cameras.

Here, the sensor unit includes at least two infrared cameras and an infrared light emitting device. The infrared light emitted from the infrared light emitting device captures light reflected by the user's hand with the infrared camera, And the hand information obtaining unit obtains the hand information about the hand of the user using the obtained image.

Here, the hand information includes two-handed identification information for identifying the left or right hand of the user, finger identification information for identifying each finger of the user, position information of each hand or each finger of the user, and direction information of the palm , The hand information obtaining unit tracks the hand of the user detected by the sensor unit according to time and acquires the hand information at a predetermined interval of time using the user's hand that has been tracked have.

Wherein the gesture recognition unit comprises: a hand information storage unit for storing the hand information acquired by the motion sensing unit for a predetermined period of time; A first hand gesture means for recognizing the gesture according to an operation of the first hand by using the hand information stored in the hand information storage unit according to time with respect to a first hand of the user's hand, A determination unit; And recognizing the gesture according to an operation of the second hand by using the hand information stored in the hand information storage unit with respect to a second hand of the user's hands other than the first hand, And a second hand gesture semantic determination unit.

Here, the first hand gesture meaning determiner may compare the hand information of the first hand with predetermined hand motion patterns to select the hand motion pattern corresponding to the hand motion, The gesture corresponding to the hand information for the first hand can be recognized by selecting the defined gesture.

Here, the second hand gesture semantic determination unit may compare the hand information of the second hand with predetermined hand motion patterns to select the hand motion pattern corresponding to the hand motion, And the gesture corresponding to the hand information for the second hand is recognized by selecting the defined gesture.

Here, the three-dimensional content authoring unit may include a authoring state setting unit for setting the authoring state according to the gesture of the first hand recognized by the first hand gesture semantic determination unit; And, in the set authoring state, editing or recording the 3D animation object on the 3D content space according to the gesture of the second hand recognized by the second hand gesture semantic determination unit to generate the 3D content And a content generation unit.

Here, the authoring state may include a first authoring state including an editing state and a recording state, and a second authoring state including a timeline setting state and an operation state.

Here, the authoring state setting unit sets the second authoring state to one of the operation state or the time line setting state when the first authoring state is the editing state, and the first authoring state is the recording state The second operation state is set to the operation state.

Here, the gesture may include a first rotation gesture indicating an operation in which the first hand rotates while holding the fist, and a second rotation gesture indicating an operation in which the first hand rotates in a state where the palm is rotated, The authoring state setting unit sets the first authoring state to one of the editing state and the recording state if the gesture of the first hand is the first rotational gesture and sets the gesture of the first hand to the second state, And setting the second authoring state if the gesture is a rotation gesture.

Here, when the gesture is the first rotation gesture, the authoring state setting unit determines whether the first hand rotates by a predetermined angle or more in a predetermined predetermined direction using the hand information about the first hand And changing the first authoring state according to a predetermined order, and when the gesture is the second rotation gesture, using the hand information about the first hand, the first hand moves in advance in a predetermined fixed direction Determining whether or not the rotation is over a predetermined constant angle, and changing the second authoring state according to a predetermined order.

Here, the gesture may include an additional gesture and a deletion gesture according to a predetermined predetermined operation of the second hand, and the content generation unit may generate the gesture when the first authoring state is the editing state, Adding the 3D animation object to the 3D content space using the hand information for the second hand if the gesture is the delete gesture and if the gesture of the second hand is the delete gesture, The 3D animation object is deleted from the 3D content space using the hand information for the 3D animation object.

Here, the gesture may include a time line setting gesture according to an operation in which the second hand moves left and right on the horizontal plane, and the content generation unit may generate a time line setting gesture And setting the time on the time line of the 3D content using the hand information for the second hand if the gesture is the time line setting gesture.

Here, the gesture may include a recording time setting gesture according to a predetermined predetermined operation of the second hand, and the content generating unit may generate the recording time setting gesture when the gesture of the second hand is the recording time setting gesture. And setting a time point at which the 3D animation object is recorded using the hand information for the second hand.

Here, the gesture may include any one of a selection gesture, a position movement gesture, a size conversion gesture, and a third rotation gesture according to a predetermined movement of the second hand, Dimensional content space using the hand information on the second hand, if the gesture of the second hand is the selection gesture, selecting the three-dimensional animation object on the three-dimensional content space, Moving the selected three-dimensional animation object using the hand information for the second hand if the gesture is the position-shifting gesture; and if the gesture of the second hand is the resize gesture, Dimensional animation object using the hand information of the first hand, and the gesture of the second hand Dimensional animation object using the hand information for the second hand if the 3D animation object is a three-rotation gesture.

Here, the selection gesture, the position movement gesture, the size conversion gesture, and the third rotation gesture are respectively the first finger, the second finger, the second hand, and the second hand, which are predetermined two fingers of the second hand, Wherein the content generating unit is configured to predefine a position of the first finger and the second finger in the hand information when the gesture of the second hand is the selection gesture, Information on the position of the first finger in the three-dimensional content space, and if the gesture of the second hand is the position-moving gesture, information on the position of the first finger in the hand information is used Moving the selected three-dimensional animation object, and if the gesture of the second hand is the resize gesture, moving the first Dimensional animation object by using information about the position of the finger and the second finger, and if the gesture of the second hand is the third rotation gesture, converting the size of the selected three- Dimensional animation object by rotating the selected three-dimensional animation object using information about a direction of the three-dimensional animation object.

Here, the second authoring state may include a motion effect setting state, and when the first authoring state is the recording state, the second authoring state may be the motion effect setting state, and the gesture may include the second hand And a motion effect setting gesture that sets at least one predetermined motion effect according to a predetermined constant motion of the second hand when the first motion state is in the motion effect setting state, And setting a motion effect of the 3D animation object in the 3D content space using the hand information of the second hand if the gesture is the motion effect setting gesture.

The apparatus may further include a preprocessor for removing the outlier from the hand information.

According to one aspect of the present invention, there is provided a method for authoring a three-dimensional animation content, the method comprising the steps of sensing a user's hand in a three-dimensional space and displaying information on the position or direction of the user's hand on the three- An operation detecting step of obtaining hand information; A gesture recognition step of recognizing a gesture having a predetermined meaning defined in advance according to an operation of the user's hand using the obtained hand information; And a three-dimensional content authoring step for authoring the three-dimensional content by editing or recording the three-dimensional animation object on the three-dimensional content space using the obtained hand information and the recognized gesture according to a predetermined predetermined type of authoring state And a control unit.

Here, the gesture recognition step may include: a hand information storage step of storing the hand information obtained in the operation sensing step for a predetermined period of time; A first hand gesture means for recognizing the gesture according to an operation of the first hand, using the hand information stored according to time in the hand information storing step, with respect to a first hand, which is one of the hands of the user, Determining; And recognizing the gesture according to an operation of the second hand using the hand information stored in the hand information storing step with respect to a second hand of the user's hands other than the first hand, And a second hand gesture semantic determination step.

Here, the three-dimensional content authoring step may include: a authoring state setting step of setting the authoring state according to the gesture of the first hand recognized in the first hand gesture semantic determination step; And, in the set authoring state, editing or recording the 3D animation object on the 3D content space according to the gesture of the second hand recognized in the second hand gesture semantic determination step to generate the 3D content And a content generation step.

According to the 3D animation content authoring apparatus of the present invention, it is possible to manipulate a three-dimensional object or author a three-dimensional animation through movement of both hands of a user with high accuracy and to easily and quickly use the general user intuitively .

In addition, it is possible to build a 3D interface environment with a simple installation without complicated devices, and it provides an interface that a beginner can easily and quickly author 3D animation with only a gesture.

1 is a block diagram of a 3D animation content authoring apparatus according to an embodiment of the present invention.
2 is a block diagram of a 3D animation content authoring apparatus according to another embodiment of the present invention.
3 is a detailed block diagram of the motion sensing unit of the present invention.
4 is a reference diagram for explaining hand information of the present invention.
5 is a reference diagram for explaining the gesture recognition unit of the present invention.
6 is a reference diagram for explaining the first hand and the second hand of the user of the present invention.
7 is a detailed block diagram of a gesture recognition unit and a 3D content authoring unit of the present invention.
8 is a reference diagram for explaining the state of the present invention.
FIG. 9 is a reference view for explaining the operation of the first and second rotation gestures of the gesture of the present invention and the operation of the authoring state setting unit.
FIG. 10 is a reference diagram for explaining a time line setting state in the authoring ecology of the present invention.
11 is a reference diagram for explaining a recording-time setting operation of the content generation unit of the present invention.
12 is a reference view for explaining a position shifting gesture among the gestures of the present invention.
13 is a reference diagram for explaining the third rotation gesture of the gesture of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to designate the same or similar components throughout the drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In addition, the preferred embodiments of the present invention will be described below, but it is needless to say that the technical idea of the present invention is not limited thereto and can be variously modified by those skilled in the art.

1 is a block diagram of a 3D animation content authoring apparatus according to an embodiment of the present invention.

The 3D animation contents authoring apparatus according to the present invention may include a motion sensing unit 100, a gesture recognition unit 200, and a 3D content authoring unit 300.

2 is a block diagram of a 3D animation content authoring apparatus according to another embodiment of the present invention.

The 3D animation contents authoring apparatus according to the present invention may include a motion sensing unit 100, a preprocessor 150, a gesture recognition unit 200, and a 3D content authoring unit 300.

In addition, the 3D animation content authoring apparatus according to the present invention may further include a screen display unit 400.

The motion sensing unit 100 senses the user's hand in a three-dimensional space and acquires hand information, which is information on the position or direction of the user's hand in the three-dimensional space.

Herein, the hand information may include coordinate information in which a specific portion of the user's hand is located on the three-dimensional space, or may include information on a direction in which a specific portion of the user's hand faces on the three-dimensional space.

For example, the hand information may be coordinate information in which the index fingertip portion of the right hand of the user is located in the three-dimensional space and information on the normal direction of the palm in the direction of the palm of the user's hand.

The motion sensing unit 100 acquires the hand information as described above with respect to the user's hand sensed in the three-dimensional space.

The gesture recognition unit 200 recognizes a gesture having a predetermined meaning defined according to the operation of the user's hand by using the obtained hand information.

Here, the gesture may have a certain predetermined kind. That is, the gesture recognition unit 200 can determine whether or not the hand information corresponds to a predetermined hand motion of a predetermined pattern by using the hand information according to various operations of the user's hand, The gesture may be recognized as a gesture having a predefined meaning with respect to the hand motion of the user of the predetermined pattern having a predetermined pattern.

For example, assuming that the index finger portion of the user's right hand moves on the three-dimensional space, the motion sensing unit 100 determines that the hand information is obtained by moving the index finger portion of the user's right hand in the three- The gesture recognition unit 200 acquires the position information of the right index fingertip, and the gesture recognition unit 200 detects the movement of the index finger portion of the right hand of the user in the three-dimensional space using the hand information obtained as described above, It is possible to judge whether or not it corresponds to the hand motion of the user. At this time, if there is a hand operation in which the right index fingertip portion moves by the user's hand operation of a predetermined pattern and the meaning of 'the position movement gesture of the object' is defined in advance for the above hand operation, the gesture recognition unit 200 determines whether or not the obtained hand information corresponds to a hand operation in which a right index fingertip portion of a user's hand operation in a predetermined pattern corresponds to a moving hand operation, and if so, Quot; position movement gesture "

The three-dimensional content authoring unit 300 edits or records the three-dimensional animation object on the three-dimensional content space using the obtained hand information and the recognized gesture according to a predetermined fixed type of authoring state, Author.

Here, the authoring state refers to a state in which the 3D animation contents authoring apparatus according to the present invention author three-dimensional contents, for example, an editing state or a recording state.

The 3D content authoring unit 300 may author 3D content using the hand information acquired by the motion sensing unit 100 and the gesture recognized by the gesture recognition unit 200 according to the authoring state.

In addition, the 3D content authoring unit 300 maps the 3D space in which the user's hand is located onto the 3D content space, and generates hand information corresponding to the user's hand on the 3D content space Can be displayed. Then, by using a specific symbol as described above, an image related to the three-dimensional content space including the displayed hand information and the three-dimensional animation object can be generated.

For example, the three-dimensional content authoring unit 300 may detect the upper right hand using the specific symbol on the three-dimensional content space according to the coordinates of the index finger of the user's right hand on the three- The fingertip can indicate the position.

Hereinafter, the operation of the 3D animation content authoring apparatus and method according to the present invention will be described based on an image related to the 3D content space in which the 3D space where the user's hand is located is mapped to the 3D content space .

The preprocessor 150 may perform an operation of removing the outlier from the hand information.

The hand information may be obtained as information different from a hand operation of an actual user according to an error of the motion sensing unit 100. [ Therefore, it is preferable to remove the outlier, which is hand information erroneously obtained in accordance with the error, through the preprocessing unit 150 before being input to the gesture recognition unit 200.

Here, the preprocessing unit 150 may use various existing methods for removing data corresponding to an outlier from a predetermined number of data. For example, the preprocessor 150 may remove the outlier from the hand information acquired by the motion sensing unit 100 using median filtering.

The screen display unit 400 may receive an image related to the three-dimensional content space generated by the three-dimensional content authoring unit 300 and display the input image on the screen. That is, the screen display unit 400 can display a three-dimensional animation object and a three-dimensional content space, which are edited or recorded by the three-dimensional content authoring unit 300, on the three-dimensional content space. Also, the screen display unit 400 may receive the 3D content authored by the 3D content authoring unit 300 and display the 3D content on the screen. The user can view, edit, and record the content of the three-dimensional content authored by the user in real time while checking the image related to the three-dimensional content space in real time through the screen display unit 400.

Hereinafter, detailed operation of the motion sensing unit 100, the gesture recognition unit 200, and the 3D content authoring unit 300 will be described in detail.

3 is a detailed block diagram of the motion sensing unit 100 of the present invention.

The motion sensing unit 100 may include a sensor unit 110 and a hand information acquisition unit 120. [

The sensor unit 110 senses the user's hand on the three-dimensional space.

The hand information obtaining unit 120 obtains the hand information at predetermined intervals of time.

Here, it is preferable that the sensor unit 110 senses the user's hand in a three-dimensional space using at least two cameras.

In addition, the sensor unit 110 includes at least two infrared cameras and an infrared light emitting device. The infrared light emitted by the infrared light emitting device captures light reflected by the user's hand with the infrared camera, It is possible to acquire an image according to the light photographed by the camera.

Here, the hand information obtaining unit 120 may obtain the parallax map for the images obtained using the two cameras as described above, and may obtain the hand information for the hand of the user using the parallax map.

Here, the hand information on the user's hand may include information on the shape of the hand or the position or direction on the three-dimensional space.

In addition, the hand information obtaining unit 120 preferably obtains the hand information for the user's hand over time. That is, it is preferable to obtain the hand information for the user's hand at predetermined time intervals predetermined in accordance with the flow of time.

Here, the hand information obtaining unit 120 tracks the hand of the user detected by the sensor unit 110 according to time, and obtains the hand information at predetermined intervals of time using the user's hand .

Here, the predetermined interval for acquiring the hand information can be set as needed. For example, 1/10 second or 1/20 second.

Here, the hand information may include two-handed identification information for identifying the left or right hand of the user, finger identification information for identifying each finger of the user, position information of each hand or each finger of the user, and direction information of the palm have.

4 is a reference diagram for explaining hand information of the present invention.

4, the hand information includes the finger identification information for identifying the thumb F1, the finger F2, the stop F3, the finger F4, and the little finger F5 of the user's hand H, And position information of each finger.

Here, the positional information of each finger can be measured or obtained based on a specific region of each finger. For example, the positional information of each finger can be measured or obtained based on the end portion of each finger. The hand information may include positional information of the user's hand H, wherein the positional information of the user's hand H is measured or obtained based on the center point P1 of the palm as shown in FIG. . The hand information may include direction information P2 of the palm of the user's hand H. [ Here, the direction information P2 of the palm may be a normal direction perpendicular to the palm surface.

Hereinafter, the operation of the gesture recognition unit 200 will be described in more detail.

5 is a reference diagram for explaining the gesture recognition unit 200 of the present invention.

The gesture recognition unit 200 includes a hand information storage unit 210, a first hand gesture semantic determination unit 220, and a second hand gesture semantic determination unit 230.

The hand information storage unit 210 stores the hand information acquired by the motion sensing unit 100 for a predetermined period of time.

For example, the hand information storage unit 210 may store the hand information acquired by the motion sensing unit 100 for 3 seconds. Here, the predetermined time may be set to various values as needed.

The first hand gesture semantic determination unit 220 determines the first hand using the hand information stored in the hand information storage unit 210 according to time with respect to the first hand as one of the hands of the user, And recognizes the gesture according to the operation.

The second hand gesture meaning determiner 230 may determine the second hand using the hand information stored in the hand information storing unit 210 with respect to the second hand as the remaining hand among the hands of the user, And recognizes the gesture according to the motion of the second hand.

6 is a reference diagram for explaining the first hand and the second hand of the user of the present invention.

Referring to FIG. 6, the first hand H1 and the second hand H2 can be determined with respect to the user's hand. In the 3D animation content authoring apparatus according to the present invention, it is preferable that the left hand of the user is set as the first hand H1 and the right hand is set as the second hand H2 as shown in FIG. This is because the left-handed first-hand phenomenon, in which a person first takes action with his / her left hand before performing a specific task (Y. Guiard, 'Asymmetric division of labor in human skilled bimanual action: Journal of motor behavior, vol. 19, no. 4, pp. 486-517, 1987.) in order to facilitate three-dimensional content authoring. However, if the user is left-handed, the right hand may be set as the first hand and the left hand as the second hand.

Here, the first hand gesture sense determiner 220 may compare the hand information of the first hand with predetermined hand motion patterns to select the hand motion pattern corresponding to the hand motion, And the gesture corresponding to the hand information for the first hand is recognized.

As described above, the gesture may have a predetermined constant type. That is, the first hand gesture semantic determination unit 220 may determine whether the hand information corresponds to a predetermined kind of hand motion patterns using the hand information. Here, if the hand information corresponds to a predetermined specific hand movement pattern, the predetermined hand movement pattern may be recognized as a gesture having a predetermined meaning defined in advance. That is, a gesture having a predetermined meaning defined in advance for each hand movement pattern is defined, and when the hand information corresponds to a specific hand movement pattern, the gesture having a predefined meaning is recognized for the hand movement pattern.

For example, assuming that the index finger portion of the user's right hand moves on the three-dimensional space, the motion sensing unit 100 determines that the hand information is obtained by moving the index finger portion of the user's right hand in the three- The hand information storage unit 210 stores the position information of the right index fingertip for a predetermined period of time, and the first hand gesture meaning determiner 220 determines the position of the right index fingertip, Using the hand information stored in the hand information storage unit 210, i.e., the position information of the right index fingertip portion, whether the position information of the right index finger portion corresponds to a predetermined specific hand movement pattern Can be determined. In this case, if there is a hand motion pattern in which the right index fingertip portion moves in a predetermined hand motion pattern and the meaning of the 'position movement gesture of the object' is predefined for the above hand motion pattern, The controller 220 determines whether the obtained hand information corresponds to a hand motion pattern in which the right index fingertip moves as described above, and if it corresponds to the hand movement pattern, Can be recognized.

Here, the comparison of the hand information with the hand motion pattern may be performed by calculating the distance between each hand motion pattern and the hand information, and comparing the hand motion pattern with the calculated distance to the hand motion pattern corresponding to the hand information Or the like.

The second hand gesture sense determiner 230 may compare the hand information of the second hand with predetermined hand motion patterns to select the hand motion pattern corresponding to the hand motion, It is preferable to select the predefined gesture to recognize the gesture corresponding to the hand information for the second hand.

Here, the second hand gesture semantic determination unit 230 performs an operation on the second hand in the same manner as the first hand gesture semantic determination unit 220 performed on the first hand, Can be recognized.

Hereinafter, the operation of the 3D content authoring unit 300 will be described in more detail.

7 is a detailed block diagram of the gesture recognition unit 200 and the 3D content authoring unit 300 of the present invention.

The 3D content authoring unit 300 includes a authoring state setting unit 310 and a content generating unit 320 as shown in FIG.

The authoring state setting unit 310 sets the authoring state according to the gesture of the first hand recognized by the first hand gesture sense determiner 220.

The content creator 320 may edit or edit the 3D animation object in the 3D content space according to the gesture of the second hand recognized by the second hand gesture semantic determiner 230 in the set authoring state And generates the three-dimensional content by recording.

That is, the authoring state setting unit 310 sets the authoring state for authoring the three-dimensional content using the gesture according to the first hand and the hand information, and the content generation unit 320 generates a gesture Dimensional content to be included in the three-dimensional content by using the information, and performs recording according to the edited three-dimensional animation object to generate the three-dimensional content.

8 is a reference diagram for explaining the state of the present invention.

As shown in FIG. 8, the authoring state may include a first authoring state including an editing state and a recording state, and a second authoring state including a timeline setting state and an operation state.

Here, the first authoring state may further include an IDLE state, and the second authoring state may further include a motion effect setting state.

First, the first authoring state will be described.

Here, the editing state refers to a state in which the content generating unit 320 edits a three-dimensional animation object or three-dimensional content on a three-dimensional content space using a gesture and hand information according to a second hand. For example, in an editing state, the content generating unit 320 may add or delete a 3D animation object to a 3D content space, and may set a path along which the object moves according to time by manipulating the object.

Here, the recording state means that the 3D animation objects edited as described above are operated according to the timeline of the 3D content.

In this case, the recording is performed according to a separately set recording point, that is, a virtual camera point. That is, the content generation unit 320 can set the recording time point along with the path of the 3D animation object on the 3D content space. Here, the recording time may be set based on a specific three-dimensional animation object, or may be set based on three-dimensional content space coordinates. The recording state can record the motion of the 3D animation object according to the set recording time as described above to generate the 3D content.

Here, the IDLE state refers to a state in which editing or recording is not performed due to a gesture or hand information according to a user's hand.

Next, the second authoring state will be described.

The timeline setting state refers to a state in which a timeline for managing time information of three-dimensional content is set using a gesture and hand information according to a second hand. The three-dimensional content is composed of three-dimensional frames in which a specific three-dimensional animation object at a specific time is arranged at a specific position in the three-dimensional content space. The time line for managing time information for such frames is a timeline.

The manipulation state refers to a state in which a 3D animation object is manipulated in a 3D content space using a gesture and hand information according to a second hand. Here, the operation refers to an operation such as selecting an object, moving a position of a selected object, or converting or rotating a size.

The motion effect setting state refers to a state in which a predefined motion effect is set for the 3D animation object using the gesture and hand information according to the second hand. For example, when a predefined second hand gesture is input, a motion effect in which the object rotates a predetermined number of times can be set.

Next, an operation of setting and changing the first and second authoring states by the authoring state setting unit 310 will be described.

As shown in FIG. 8, the authoring state setting unit 310 may set the second authoring state to either the operation state or the time line setting state when the first authoring state is the editing state.

The authoring state setting unit 310 may set the second authoring state to the operation state when the first authoring state is the recording state. Or a motion effect setting state.

The gesture may include a first rotation gesture indicating an operation of rotating the first hand while holding the fist and a second rotation gesture indicating an operation of rotating the first hand in a state where the palm is rotated.

At this time, if the gesture of the first hand is the first rotation gesture, the authoring state setting unit 310 may set the first authoring state to either the editing state or the recording state.

That is, if the gesture of the first hand recognized by the first hand gesture semantic determination unit 220 is the first rotation gesture, the authoring state setting unit 310 sets the first authoring state to the editing state or the recording State.

The authoring state setting unit 310 may set the second authoring state if the gesture of the first hand is the second rotational gesture.

FIG. 9 is a reference view for explaining the operation of the first and second rotation gestures of the gesture of the present invention and the operation of the authoring state setting unit.

Referring to FIG. 9A, a first rotation gesture indicating an operation R1 in which the first hand H1 rotates while holding a fist is taken, and the first hand gesture semantic determination unit 220 recognizes The authoring state setting unit 310 may set the first authoring state to either the edit state E12 or the record state E13.

9 (b), the first hand H1 takes a second rotation gesture indicating an operation R2 in which the palm is rotated, and the first hand gesture meaning determiner 220 determines The authoring state setting unit 310 may set the second authoring state to any one of a timeline setting state E21, a manipulation state E22, and a motion effect setting state E23 .

Here, if the gesture is the first rotation gesture, the authoring state setting unit 310 determines whether the first hand rotates by a predetermined angle or more in a predetermined predetermined direction using the hand information about the first hand And change the first authoring state according to a predetermined order.

If the gesture is the second rotation gesture, the authoring state setting unit 310 may determine whether the first hand rotates by a predetermined angle or more in a predetermined predetermined direction using the hand information about the first hand And change the second authoring state according to a predetermined order.

Here, predetermined predetermined directions and angles can be set to arbitrary values as needed.

The content generation unit 320 may add or delete a three-dimensional animation object to a three-dimensional content space by a gesture defined according to a predetermined hand motion.

Here, the gesture may include an additional gesture according to a predetermined constant movement of the second hand, and a deletion gesture.

In this case, if the first authoring state is the editing state, if the gesture of the second hand is the additional gesture, the content generating unit 320 may generate the three-dimensional The 3D animation object may be added to the content space. Here, the content generation unit 320 may select the 3D animation object using the hand information, and add the selected 3D animation object to the 3D space using the additional gesture and the hand information.

For example, the additional gesture may be defined in advance with respect to a hand movement pattern indicating an operation of tapping the index finger tip of the second hand of the user, and the content generation unit 320 may generate the additional gesture If the gesture recognized by the second hand gesture semantic recognition unit 230 is the additive gesture, the hand gesture information stored in the hand information storage unit 210 is used to determine the second hand You can add a 3D animation object to the end point.

In a similar manner, when the first authoring state is the editing state, if the gesture of the second hand is the deletion gesture, the content generation unit 320 generates the content information of the third hand by using the hand information of the second hand, The 3D animation object can be deleted from the 3D content space.

The content generation unit 320 may set a timeline of the three-dimensional content by a defined gesture in accordance with a predetermined hand motion.

At this time, the gesture may include a time line setting gesture according to an operation of moving the second hand from side to side on the horizontal plane.

In this case, if the second authoring state is the time line setting state and the gesture of the second hand is the time line setting gesture, the content generating unit 320 may use the hand information on the second hand And sets the time on the time line of the three-dimensional content.

For example, in the above case, the content generation unit 320 may generate the time line of the second finger based on the degree of movement of the index fingertip portion of the second hand along the x-axis on the horizontal plane set on the three- You can set the time on the screen.

FIG. 10 is a reference diagram for explaining a time line setting state in the authoring ecology of the present invention.

The content generation unit 320 may generate and add or delete a three-dimensional animation object on the three-dimensional content space at a time on each timeline by controlling the timeline according to the timeline setting gesture as shown in FIG. 10, You can also record 3-D content over the set time.

The content generation unit 320 may set a recording time for generating three-dimensional content by a gesture defined according to a predetermined hand motion.

As described above, the three-dimensional content is recorded according to a separately set recording point, that is, a virtual camera point. That is, the content generation unit 320 can set the recording time point along with the path of the 3D animation object on the 3D content space. Here, the recording time may be set based on a specific three-dimensional animation object, or may be set based on three-dimensional content space coordinates. The recording state can record the motion of the 3D animation object according to the set recording time as described above to generate the 3D content.

The gesture may include a recording time setting gesture according to a predetermined predetermined operation of the second hand.

In this case, if the gesture of the second hand is the recording time setting gesture, the content generation unit 320 may record the time of recording the 3D animation object of the 3D content space on the hand information of the second hand It is preferable to set it.

Here, if the first authoring state is the editing state or the recording state, the content generation unit 320 may set the recording time according to the recording time setting gesture.

11 is a reference diagram for explaining a recording-time setting operation of the content generation unit of the present invention.

If the first authoring state is in the editing state, the content generation unit 320 recognizes the recording time setting gesture with respect to the hand information of the second hand, and sets the recording time point to a predetermined angle around the three- You can rotate and change. For example, referring to FIG. 11 (a), the recording time point C may be rotated by 90 degrees about the three-dimensional animation object O and changed. At this time, the recording time setting gesture can be defined in advance as a swipe operation pattern in which the second hand of the user moves left and right at a constant speed or more. In this case, when the second hand-gesture semantic determination unit 230 recognizes the above-mentioned recording-time setting gesture with respect to the second hand, the content generation unit 320 generates a recording start point Can be rotated and changed.

If the second authoring state is the recording state, the content generation unit 320 generates the recording time point setting gesture based on the three-dimensional animation object or the three-dimensional content It can be set based on space. For example, the recording time setting gesture can be predefined in a hand motion pattern in which the end of the index finger of the second hand and the end of the thumb are arranged with a three-dimensional animation object according to predetermined rules. In this case, if the second hand-gesture semantic determination unit 230 recognizes the above-mentioned recording-time setting gesture with respect to the second hand, the content generation unit 320 generates a predetermined time- It is possible to set the recording time at a distance and a predetermined angle. Here, the predetermined distance and angle can be set by the user as required.

The content generation unit 320 may manipulate the 3D animation object by a defined gesture according to a predetermined hand motion.

At this time, the gesture may include any one of a selection gesture, a position movement gesture, a size conversion gesture, and a third rotation gesture according to a predetermined movement of the second hand.

Wherein the selection gesture, the position shifting gesture, the size conversion gesture, and the third rotation gesture respectively correspond to the first finger, the second finger, and the second hand, which are predetermined two fingers of the second hand among the movements of the second hand, Can be predefined according to a predetermined motion of any one of the palms.

In this case, when the second authoring state is the operation state, the content generation unit 320 may operate to manipulate the three-dimensional animation object according to each gesture as follows.

The content creator 320 may select the 3D animation object on the 3D content space using the hand information for the second hand if the gesture of the second hand is the selection gesture.

Here, if the gesture of the second hand is the selection gesture, the content generation unit 320 generates information on the position of the first finger and the second finger in the three-dimensional content space The 3D animation object can be selected.

For example, the selection gesture may be defined with respect to a hand movement pattern in which the index finger portion and the thumb end portion of the second hand come within a predetermined distance. In this case, the content generation unit 320 may use the hand information of the second hand to select a three-dimensional animation object located between the index fingertip and the thumb end of the second hand.

The content creator 320 may move the selected 3D animation object using the hand information of the second hand if the gesture of the second hand is the position movement gesture.

Here, if the gesture of the second hand is the movement gesture, the content generation unit 320 may move the selected 3D animation object using the information on the position of the first finger in the hand information have.

For example, the movement gesture may be defined with respect to a hand motion pattern that moves after the index finger portion of the second hand is positioned on the selected 3D animation object for a predetermined period of time or longer. In this case, the content generation unit 320 may move the 3D animation object according to the position of the index fingertip of the second hand using the hand information of the second hand. When the thumb of the second hand is bent into the palm of the hand, the movement of the hand is stopped to determine the meaning of the movement gesture, and when the hand information of the second hand corresponds to the movement, Can be stopped.

12 is a reference view for explaining a position shifting gesture among the gestures of the present invention.

For example, when the predefined gesture is recognized as shown in FIG. 12 (a), the content generation unit 320 moves the object along the end portion of the index finger F2 of the second hand, It is possible to stop the movement of the object when the detected gesture is recognized.

The content creator 320 may convert the size of the selected 3D animation object using the hand information for the second hand if the gesture of the second hand is the resize gesture.

Here, if the gesture of the second hand is the resize gesture, the content generation unit 320 may use the information about the positions of the first and second fingers of the hand information, You can convert the size of the animation object.

For example, the size conversion gesture may be defined with respect to a hand operation pattern in which the index fingertip portion and the thumb end portion of the second hand are moved away from or closer to a certain distance. In this case, the content generation unit 320 may convert the size of the 3D animation object located between the index fingertip and the thumb end of the second hand using the hand information of the second hand.

The content creator 320 may rotate the selected 3D animation object using the hand information for the second hand if the gesture of the second hand is the third rotation gesture.

Here, if the gesture of the second hand is the third rotation gesture, the content generation unit 320 may rotate the selected 3D animation object using the information on the direction of the palm of the hand information have.

For example, the third rotation gesture may be defined with respect to a hand movement pattern in which the direction of the palm of the second hand is constantly rotated. In this case, the content generation unit 320 may rotate the 3D animation object in a predetermined direction according to the direction of the palm of the second hand using the hand information of the second hand.

13 is a reference diagram for explaining the third rotation gesture of the gesture of the present invention.

13A, 13B, and 13C are reference views for explaining the x-axis rotation, the z-axis rotation, and the y-axis rotation in the three-dimensional content space of the three-dimensional animation object, respectively.

13A, when the hand direction P2 of the hand information of the second hand H2 of the user corresponds to a hand movement pattern in which the x axis is rotated on the yz plane on the yz plane, the content generation unit 320 The three-dimensional content can be rotated with respect to the x-axis. Wherein one of the three axis rotations can rotate the object along the hand end direction of the user's second hand rather than the palm direction. Figure 13 (c) shows an example.

The content generation unit 320 may set a motion effect of the 3D animation object by a gesture defined according to a predetermined constant hand motion.

In this case, the gesture may include a motion effect setting gesture for setting at least one predetermined motion effect according to a predetermined constant motion of the second hand.

In this case, when the first authoring state is the motion effect setting state, the content generating unit 320 may use the hand information of the second hand if the gesture of the second hand is the motion effect setting gesture The motion effect of the 3D animation object can be set in the 3D content space.

FIG. 14 is a flowchart of a method for authoring 3D animation contents according to another embodiment of the present invention.

The 3D animation contents authoring method according to the present invention may include an operation sensing step (S100), a gesture recognition step (S200), and a 3D content authoring step (S300). Here, the 3D animation contents authoring method according to the present invention can operate in the same manner as the 3D animation contents authoring apparatus according to the present invention described with reference to FIGS. 1 to 13 above. Hereinafter, overlapping portions will be omitted and briefly described.

The motion detection step S100 detects the user's hand on the three-dimensional space and obtains hand information, which is information on the position or direction of the user's hand on the three-dimensional space.

The gesture recognition step (S200) recognizes a gesture having a predetermined meaning defined according to the operation of the user's hand using the obtained hand information.

In the three-dimensional content authoring step S300, the three-dimensional animation object is edited or recorded on the three-dimensional content space using the obtained hand information and the recognized gesture according to a predetermined fixed type of authoring state, Author.

Here, the gesture recognition step S200 may include a hand information storage step S210, a first hand gesture semantic determination step S220, and a second hand gesture semantic determination step S230.

The hand information storage step S210 stores the hand information obtained in the operation sensing step S100 for a predetermined period of time.

In the first hand gesture semantic determination step S220, for the first hand, which is one of the hands of the user, using the hand information stored according to time in the hand information storage step, And recognizes the gesture according to the gesture.

In the second hand gesture semantic determination step S230, the hand information stored in the hand information storage step for the second hand as the remaining hand, which is not the first hand among the hand of the user, And recognizes the gesture according to the motion of the hand.

Here, the three-dimensional content authoring step S300 may include a authoring state setting step S310 and a content generating step S320.

The authoring state setting step S310 sets the authoring state according to the gesture of the first hand recognized in the first hand gesture semantic determination step.

In the content creation step S320, in the set authoring state, the 3D animation object is edited or recorded on the 3D content space according to the gesture of the second hand recognized in the second hand gesture semantic determination step, Thereby generating three-dimensional content.

It is to be understood that the present invention is not limited to these embodiments, and all elements constituting the embodiment of the present invention described above are described as being combined or operated in one operation. That is, within the scope of the present invention, all of the components may be selectively coupled to one or more of them.

In addition, although all of the components may be implemented as one independent hardware, some or all of the components may be selectively combined to perform a part or all of the functions in one or a plurality of hardware. As shown in FIG. In addition, such a computer program may be stored in a computer readable medium such as a USB memory, a CD disk, a flash memory, etc., and read and executed by a computer to implement an embodiment of the present invention. As the recording medium of the computer program, a magnetic recording medium, an optical recording medium, a carrier wave medium, and the like can be included.

Furthermore, all terms including technical or scientific terms have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined in the Detailed Description. Commonly used terms, such as predefined terms, should be interpreted to be consistent with the contextual meanings of the related art, and are not to be construed as ideal or overly formal, unless expressly defined to the contrary.

It will be apparent to those skilled in the art that various modifications, substitutions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims. will be. Therefore, the embodiments disclosed in the present invention and the accompanying drawings are intended to illustrate and not to limit the technical spirit of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments and the accompanying drawings . The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

100:
110:
120: hand information obtaining unit
150:
200: Gesture recognition unit
210: hand information storage unit
220: first hand gesture semantic determination unit
230: second hand gesture semantic determination unit
300: 3D content authoring unit
310: authoring state setting section
320:

Claims (22)

A three-dimensional animation content authoring apparatus comprising:
An operation sensing unit sensing the user's hand in a three-dimensional space and acquiring hand information, which is information on the position or direction of the user's hand on the three-dimensional space;
A gesture recognition unit for recognizing a gesture having a predetermined meaning defined according to an operation of the user's hand using the obtained hand information; And
A three-dimensional content authoring unit for editing or recording the three-dimensional animation object on the three-dimensional content space using the obtained hand information and the recognized gesture according to a predetermined predetermined type of authoring state to author the three-dimensional content and,
Wherein the motion sensing unit senses the user's hand in a three-dimensional space using an image photographed using at least two cameras, and analyzes the image to acquire the hand information about the user's hand A three-dimensional animation content authoring device The apparatus of claim 1,
A sensor unit for sensing the user's hand on a three-dimensional space; And
And a hand information acquiring unit for acquiring the hand information at predetermined intervals of time, delete 3. The method of claim 2,
Wherein the sensor unit includes at least two infrared cameras and an infrared light emitting device, the infrared light emitted by the infrared light emitting device captures light reflected by the user's hand with the infrared camera, Acquiring the image according to light,
Wherein the hand information obtaining unit obtains the hand information on the hand of the user using the obtained image, 3. The method of claim 2,
Wherein the hand information includes two-handed identification information for identifying the left or right hand of the user, finger identification information for identifying each finger of the user, position information of each or each finger of the user, and direction information of the palm,
Wherein the hand information obtaining unit tracks the hand of the user detected by the sensor unit according to the time and acquires the hand information at a predetermined interval of time using the user's hand Dimensional animation content authoring device The apparatus of claim 1, wherein the gesture recognition unit comprises:
A hand information storage unit for storing the hand information acquired by the motion sensing unit for a predetermined period of time;
A first hand gesture means for recognizing the gesture according to an operation of the first hand by using the hand information stored in the hand information storage unit according to time with respect to a first hand of the user's hand, A determination unit; And
And a second recognition unit for recognizing the gesture according to the motion of the second hand using the hand information stored in the hand information storage unit with respect to the second hand of the user's hands other than the first hand, 2 < / RTI > animation content authoring device The method according to claim 6,
The first hand gesture semantic determination unit compares the hand information of the first hand with predetermined hand motion patterns to select the hand motion pattern corresponding to the hand motion, Selecting the gesture to recognize the gesture corresponding to the hand information for the first hand,
Wherein the second hand gesture semantic determination unit compares the hand information of the second hand with predetermined hand motion patterns to select the hand motion pattern corresponding to the hand motion, Characterized in that the gesture recognition means recognizes the gesture corresponding to the hand information for the second hand by selecting the gesture, The method according to claim 6,
The three-dimensional content authoring unit,
A writing state setting unit for setting the writing state according to the gesture of the first hand recognized by the first hand gesture semantic determining unit; And
Wherein the 3D animation content is edited or recorded on the 3D content space according to the gesture of the second hand recognized by the second hand gesture semantic determination unit to generate the 3D content Dimensional animation content authoring device, characterized in that the three-dimensional animation content authoring device 9. The method of claim 8,
Wherein the authoring state includes a first authoring state including an editing state and a recording state, and a second authoring state including a time line setting state and an operation state. 10. The apparatus according to claim 9,
Setting the second authoring state to the operation state or the time line setting state when the first authoring state is the editing state,
Wherein the control unit sets the second authoring state to the operating state when the first authoring state is the recording state, 10. The method of claim 9,
Wherein the gesture includes a first rotation gesture indicating an operation of rotating the first hand while holding the fist and a second rotation gesture indicating an operation of rotating the first hand in a state where the palm is rotated,
The authoring state setting unit,
Setting the first authoring state to either the editing state or the recording state if the gesture of the first hand is the first rotation gesture,
And setting the second authoring state if the gesture of the first hand is the second rotation gesture, 12. The apparatus of claim 11, wherein the authoring state setting unit
Determining whether the first hand rotates by a predetermined angle or more in a predetermined fixed direction using the hand information about the first hand when the gesture is the first rotation gesture, Changing the first authoring state,
Determining whether the first hand rotates by a predetermined angle or more in a predetermined predetermined direction using the hand information about the first hand when the gesture is the second rotation gesture, And the second authoring state is changed by changing the second authoring state. 10. The method of claim 9,
Wherein the gesture includes an additional gesture according to a predetermined constant movement of the second hand,
Wherein, when the first authoring state is the editing state,
Adding the 3D animation object to the 3D content space using the hand information about the second hand if the gesture of the second hand is the additive gesture,
Dimensional content space in the 3D content space using the hand information on the second hand if the gesture of the second hand is the delete gesture, 10. The method of claim 9,
Wherein the gesture includes a timeline setting gesture according to an operation of moving the second hand laterally on the horizontal plane,
Wherein the content generating unit generates the three-dimensional content using the hand information for the second hand if the second authoring state is the time line setting state and the gesture of the second hand is the time line setting gesture, Is set to a time on the time line of the three-dimensional animation content authoring device 10. The method of claim 9,
Wherein the gesture includes a recording time setting gesture according to a predetermined constant motion of the second hand,
Wherein the content generation unit sets a time at which the 3D animation object of the 3D content space is recorded using the hand information for the second hand if the gesture of the second hand is the recording time setting gesture Dimensional animation content authoring device 10. The method of claim 9,
Wherein the gesture includes any one of a selection gesture, a movement gesture, a size conversion gesture, and a third rotation gesture according to a predetermined movement of the second hand,
Wherein, when the second authoring state is the operation state,
If the gesture of the second hand is the selection gesture, selecting the 3D animation object on the 3D content space using the hand information of the second hand,
Moving the selected 3D animation object using the hand information for the second hand if the gesture of the second hand is the position movement gesture,
If the gesture of the second hand is the resize gesture, transforming the size of the selected 3D animation object using the hand information for the second hand,
Dimensional animation object is rotated using the hand information of the second hand if the gesture of the second hand is the third rotation gesture. 17. The method of claim 16,
Wherein the selection gesture, the position movement gesture, the size conversion gesture, and the third rotation gesture are respectively the first finger, the second finger, the palm of the second hand, Or a predetermined motion according to any one of the first and second predetermined motion,
The content generation unit generates,
If the gesture of the second hand is the selection gesture, selecting the three-dimensional animation object on the three-dimensional content space using information on the positions of the first finger and the second finger in the hand information,
Moving the selected three-dimensional animation object using information on the position of the first finger in the hand information if the gesture of the second hand is the position-moving gesture,
Wherein if the gesture of the second hand is the resize gesture, the size of the selected three-dimensional animation object is converted using information about the positions of the first finger and the second finger in the hand information,
Wherein the 3D animation object is rotated using the information on the direction of the palm of the hand information when the gesture of the second hand is the third rotation gesture. Device 10. The method of claim 9,
Wherein the second authoring state includes a motion effect setting state, the second authoring state may be the motion effect setting state when the first authoring state is the recording state,
Wherein the gesture includes a motion effect setting gesture for setting at least one predetermined motion effect according to a predetermined constant motion of the second hand,
Wherein the contents generating unit generates the contents using the hand information of the second hand when the first authoring state is the motion effect setting state and the gesture of the second hand is the motion effect setting gesture, Dimensional animation object, and sets a motion effect of the 3D animation object in a space. 10. The method of claim 9,
Further comprising a preprocessing unit for removing the outlier from the hand information, In a method for authoring 3D animation contents,
Sensing a user's hand in a three-dimensional space, and obtaining hand information, which is information on the position or direction of the user's hand on the three-dimensional space;
A gesture recognition step of recognizing a gesture having a predetermined meaning defined in advance according to an operation of the user's hand using the obtained hand information; And
A three-dimensional content authoring step of editing or recording the three-dimensional animation object on the three-dimensional content space using the obtained hand information and the recognized gesture according to a predetermined predetermined type of authoring state to author three-dimensional content Including,
Wherein the motion detection step detects the user's hand in a three-dimensional space using an image photographed using at least two cameras and analyzes the image to obtain the hand information for the user's hand To create 3D animation contents 21. The method of claim 20, wherein the gesture recognition step comprises:
A hand information storing step of storing the hand information obtained in the motion detecting step for a predetermined period of time;
A first hand gesture means for recognizing the gesture according to an operation of the first hand, using the hand information stored according to time in the hand information storing step, with respect to a first hand, which is one of the hands of the user, Determining; And
A second hand for recognizing the gesture according to an operation of the second hand by using the hand information stored in accordance with time in the hand information storing step for a second hand of the user's hands other than the first hand, 2 < / RTI > hand gesture semantic determination step < RTI ID = 0.0 > 22. The method of claim 21, wherein the three-
A setting step of setting the authoring state according to the gesture of the first hand recognized in the first hand gesture semantic determination step; And
Wherein the 3D animation content is edited or recorded on the 3D content space in accordance with the gesture of the second hand recognized in the second hand gesture semantic determination step to generate the 3D content And generating a three-dimensional animation content

Images