KR20100138615A - Searching method of motion-data and the search and creation system of motion-library - Google Patents

Abstract

PURPOSE: A method for searching motion data and a system for searching and generating a motion library are provided to supply an operation similar to an operation posture in which a motion library is set. CONSTITUTION: A motion library loading unit(103) comprises motion data which is a comparison target with an operation for search that a user edits. The motion library loading unit loads the motion data on a screen display unit of a user terminal. An operation searching unit(104) searches a similar operation in a motion library using rotation information of a joint obtained from an operation for search that the user edits. A motion comparison unit(105) compares the operation for search with an operation of the motion library.

Description

Search method of motion-data and The search and creation system of motion-library}

The present invention relates to a method of searching for motion data and a motion library generation and search system, and provides a method for a user to search and utilize motion data more easily and easily. In addition, the present invention relates to a system and a method for adding a database to an operation of motion data found by a user.

Recently, with the development of computer graphics technology and virtual reality technology, a case of applying a motion of a real person or a character to various contents has been spreading.

In general, the motion capture technique is one of motion generation techniques that capture the movement of a character in the real world with a special camera and apply it to a virtual character on a computer. Unlike other motion generation techniques, the motion capture technique can reproduce the motion of a character in the real world. There is a big advantage. Recently, high quality motion data can be obtained by improving motion capture equipment.

As such, motion data is captured by actual human motions and used in computer graphics, and motion data is generally stored in a DB based on the classification and name of motion according to the classification of the corresponding field. .

For this reason, to search for motions stored in the conventional motion DB, search is performed based on the motion classification and name. However, since motion is not stored as a unit motion but is generated by dividing the motion as needed, its length and difficulty are different, and a motion includes a variety of various body motions. When searching for motion by criteria, it was difficult to find a desired search result.

In addition, recent studies have suggested how to use the computer to learn dance effectively and easily.Along with the rapid development of computer hardware and software that can process huge graphic information, dance learning and dance games using the same The development of the system is active. The reality is that motion data is also utilized in such dance learning and dance game systems.

However, ballet or dance terms such as mime, adage, entrechat, pas d'action, ballet blanc, etc. Since there is a problem in that it is difficult to search for a corresponding operation, there is a demand for a method of searching for a similar operation even if a user does not know a term of a desired operation posture.

As described above, the motion data retrieval method according to the related art requires a large amount of time and endurance as well as a large amount of motion data, and also has a problem that the satisfaction with the search results is remarkably low.

Therefore, when a user searches for an action that he / she needs, he or she sets up a search method that can easily and conveniently find the action in a small amount of time without having to spend a lot of time and a posture of the action that is not a term of the action. There is a need for a method of searching for and finding motions, and a method of newly adding these motions to a motion library by using a database is also required.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems of the prior art, and provides a method for a user to set a predetermined motion posture in searching for an action required by a user, and provides a motion posture in which a motion library is set. The purpose of the present invention is to provide a method for retrieving motion data more simply and conveniently by presenting similar operations.

In addition, another object of the present invention is to provide a system and method for increasing the utilization of the operation by searching for the motion required by the user, adding the searched motion to the database to the motion library.

In order to achieve the above object, the present invention provides a first step of loading a character into a screen display unit of a user terminal, a second step of the user setting the character as a search operation, and a display unit of the user. A third step of loading a motion library, a fourth step of comparing the motion of the search operation with the motion library, and a forward operation of the motion library if the motion of the search motion and the motion library are inconsistent And a sixth step of displaying on a clip data arrangement screen when searching for an operation that is identical to or similar to the search operation.

The present invention may further include automatically presenting a similar operation to the user by an algorithm included in the user terminal based on the search operation set by the user after the third step.

The user terminal may include an algorithm for performing a motion data retrieval method. The algorithm may be included in an operation comparison unit to be described later.

When the user sets a search operation, the rotation value of each joint of the character may be a data value to be compared, and the motion data in the motion library can be automatically searched by an algorithm included in the motion comparison unit. At this time, the position of each joint of the motion data and each joint of the search operation may be grasped to collect motion data that does not deviate from the limit of similarity which will be described later.

If the user selects a similar operation among the presented motion data, it may be newly added to the motion library by making a database by the clip generation unit, and it may be possible to easily search and use the motion data later.

In the present invention, after searching for the last operation of the motion library after the fifth step, it is determined whether the additional motion library exists, and if the additional motion library exists, the additional motion library is loaded and the search operation and the additional motion library are performed. And comparing the operations and searching forward.

The present invention may further include generating a clip in the motion library and storing the matched or similar operation when searching for the matched or similar operation to the search operation after the sixth step.

The present invention provides a screen display unit of a user terminal, a character loading unit for loading a character on the screen display unit, an operation editing unit for editing and displaying a search operation desired by the user using the character, and a search operation edited by the user. And a motion library loading unit for including the motion data to be compared and loading them on the screen display unit of the user terminal, and searching for similar motions in the motion library using rotation information of joints obtained from the search operation edited by the user. It provides a motion library search generation system including a motion search unit and a motion comparison unit for comparing the motion for the search edited by the user and the motion of the motion library to check the similarity.

The present invention includes a screen display of the user terminal.

The user terminal may perform the functions of the above-described computing device, and may include a microprocessor including memory means such as a computer, a personal digital assistant (PDA), a mobile phone, an electronic notebook, etc. that can display motion data on a screen. If it is equipped with a computing device with a computing power may be included in this. The user terminal may include a computer program used for the motion data search method and the motion library search and generation method.

The screen display unit may perform a function of presenting an operation of motion data to a user through a monitor of a computer. The user may search for a similar operation in comparison with the operations for searching on the screen display and the operations loaded from the motion library.

The present invention includes a character loading unit for loading a character on the screen display unit.

The character may include a shape of a human body and includes a basic human shape constituting motion data.

The character loading unit may store various kinds of basic characters including a human body shape, an animal shape, a virtual character shape, and the like, and when the character loading unit is loaded on the screen display unit and displayed to the user, the user searches using the character. Operation can be edited and set.

The present invention includes a motion editing unit that can edit and display a search motion that a user wants to find using a character.

When the character is loaded into the screen display unit by the character loading unit, the user may set a desired posture on the motion editing unit by using a character formed in the shape of a human body.

Characters formed in the shape of the human body can be presented in the same structure as the human body, the user can control each joint of the character to set the desired posture, at this time, the rotation value of the joint obtained by manipulating the joint to search for motion It can be the data to be used.

The present invention includes a motion library loading unit including motion data to be compared with a search operation edited by a user and loading the same into the screen display unit of the user terminal.

The motion data refers to data obtained by capturing the motion of a real person or a virtual character in a form used in computer graphics. For example, a motion capture device is used to capture a human body's motion as it is and use it on a computer. Can be made from data.

Library refers to a collection of classes or subroutines used when making software, and the motion library may refer to a collection of classes or subroutines that collect motion data.

Therefore, if the user has set up a search operation, the screen display unit may be divided to display a search operation on one side, and motion data loaded from the motion library may be sequentially displayed on the other side. It is possible to find a match or similar action.

The present invention includes a motion search unit for searching for a similar motion in a motion library using rotation information of a joint obtained from a search motion edited by a user.

The motion search unit may provide a motion search option to allow a user to designate a joint that is a search criterion. Not only can you search by comparing all the joints of the character, you can also search by specifying a certain part of the character, such as the arm or leg.

That is, the user may set a desired motion and then search for a similar motion by designating a desired part such as an upper body, a lower body, an arm or a leg of the search motion.

In this case, the target of the search is a motion library composed of motion data, and the motion data is a series of postures. Motion data can typically be composed of 30 cuts per second, and can be stored in the form of motion capture data.

The present invention includes an operation comparison unit for comparing the operation for the search edited by the user with the operation of the motion library to check the similarity.

When the user performs a motion search through a motion search option or the like, a method of searching for a motion similar to a search motion set by comparing the position of a character joint may be performed by an algorithm including a motion cost grant. .

For example, after confirming the position of the hand in the search operation, it is checked whether the position of the hand is within the error range in the motion data. This process may be performed for all joints, and compared to the search operation, if all the joints of the motion data do not exceed the limit of similarity, it may be determined that they are similar operations.

The calculation of the similarity can be calculated by the following method.

 Similarity = SUM (weighting × (position of target joint i-position of reference joint i) ²)

The target joint refers to a joint of motion data, and the reference joint refers to a joint of a search operation. The weight may vary depending on the limit of similarity desired by the user.

Since the motion search should be independent of the direction in which the character is standing, the position of each joint is compared with the direction of the search motion and the motion data motion matched. Since the left side and the right side may be reversed, the operation may be suggested.

The present invention is characterized by further comprising a clip generation unit for constructing and storing in the database an operation determined to be identical or similar to the search operation edited by the user.

Motion data determined to be identical to or similar to the search operation may be added to the motion library to be placed as a clip, and similar motion may be added to the motion data including front, back, and side poses for use in a library. Can be added.

In addition, even when an operation similar to the search operation desired by the user is not searched, the front, rear, side postures, etc. of the search operation set by the user may be newly generated as motion data and added to the motion library.

The present invention may further include a controller for controlling data flow between the character loading unit, the motion editing unit, the motion library loading unit, the motion search unit, the motion comparison unit, and the motion data generation unit.

The controller may control a data flow between the respective components to perform a unique function in each component.

The present invention includes a computer readable recording medium for recording a computer program for executing the above-described motion motion retrieval method.

According to the present invention, there is an effect of providing a method and system that allows a user to search motion data more easily and quickly to find a desired motion.

In addition, according to the present invention, an operation similar to the search operation set by the user can be newly added as a motion data to a motion library, thereby providing convenience and ease in later search.

In addition, according to the present invention, it is possible to easily produce a three-dimensional character animation by the search method as described above, furthermore, the field of education, such as games, three-dimensional motion editing program, dance, dance can be applied to the three-dimensional character animation It can be used for virtual reality.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms or words used in the specification and claims should not be construed as having a conventional or dictionary meaning, and the inventors should properly explain the concept of terms in order to best explain their own invention. Based on the principle that can be defined, it should be interpreted as meaning and concept corresponding to the technical idea of the present invention. Therefore, the embodiments described in the specification and the drawings shown in the drawings are only one of the most preferred embodiments of the present invention and do not represent all of the technical idea of the present invention, various modifications that can be replaced at the time of the present application It should be understood that there may be equivalents and variations.

1 is a block diagram showing a computing device including a user terminal according to an embodiment of the present invention.

The character loading unit 101 may serve to load a character selected by the user into the screen display unit 107 from the character DB 111 storing the shape of the human body, the shape of the animal, and the like as a database.

When a predetermined character is loaded into the screen display unit 107 by the character loading unit 101, the user may set the character as an operation for searching on the operation editing unit 102. The search operation can be set by rotating each joint of the shoulder, elbow, wrist, waist, pelvis, knee, ankle, and the like. At this time, the rotation value according to the rotation angle of each joint may be data for comparing the similarity with the motion data.

When the search operation is set on the operation editor 102, the motion library loading unit 103 loads the motion data 113 included in the motion library to the screen display unit 107. At this time, since the motion data 113 provided by the search operation and the motion library are displayed to the user by dividing the screen of the user terminal, the user can easily compare and search the motions.

The motion search unit 104 may provide a motion search option to allow a user to designate a joint of a human body shape that is a reference of the search. Not only can you search by comparing all the joints of the character, you can also search by specifying a certain part of the character, such as the arm or leg.

In this case, the search target is a motion library including the motion data 113, and the motion data 113 is a data set consisting of a series of postures in a series of poses.

When the user performs a motion search through a motion search option or the like, the motion comparison unit 105 compares the position of the character joints with the search motion set by an algorithm included in the motion comparison unit 105. A method for finding similar actions can be performed.

After confirming the position of a specific joint of the search operation, the motion data 113 checks whether the same joint position is within the error range. This process is performed for all joints and the motion data 113 is compared with the search operation. If all of the joints do not exceed the limit of similarity, it can be determined that the similar motion.

The clip generation unit 106 generates a clip and adds a new operation as motion data.

Motion data 113, which is determined to be identical to or similar to the motion for searching, can be added to the motion library so that it can be placed as a clip. Similar motion can be used in the library, including forward, backward, and side poses. The motion data 113 may be added.

In addition, even when an operation similar to the search operation desired by the user is not searched, the front, rear, side postures, etc. of the search operation set by the user may be newly generated as the motion data 113 and added to the motion library.

The screen display unit 107 may load a character and load a motion library to compare and search the search operation set by the user and the motion data 113 of the motion library.

In addition, the clip generated by the clip generation unit 106 may be displayed, and newly added motion data included in the clip may be displayed to the user.

The controller 108 controls the flow of data such as the character DB 111, the clip DB 112, the motion data 113, and the like between the components, thereby controlling each component to perform its own function. It can play a role.

2 is a flowchart of a method of searching for motion data according to an embodiment of the present invention.

First, when the character loading unit 101 steps to load the character selected by the user from the character DB 111 to the screen display unit 107 (S210), the user sets the character as a search operation on the operation editing unit 102. (S220)

Then, if the step of loading the motion data 113 included in the motion library to the screen display unit in the motion library loading unit 103 (S230), the user on the motion search unit 104 using the motion search option, etc. (113) can be searched.

Thereafter, the operation comparison unit 105 compares the position of the search operation with the joint position or the rotation value of the joint of the motion data 113 to determine whether or not there is a similarity (S240).

In this case, when the motion data 113 to be compared is found to be identical to or similar to the search operation, the clip generator 106 may generate a new clip and add and store similar motion as motion data in the motion library. (S250)

On the contrary, if the compared motion data 113 turns out to be a similar operation, it is determined whether or not the motion data 113 is similar to other motion data in the motion library.

The calculation of the similarity can be calculated by the following method.

 Similarity = SUM (weighting × (position of target joint i-position of reference joint i) ²)

Through this process, it is determined whether it is the last motion data of the motion library (S270). If it is not the last motion data, the process of comparing the search data with the motion data is performed again.

On the contrary, if the last motion data has been compared and searched, it is determined whether additional motion libraries exist (S280).

If the additional motion library exists, loading the additional motion library, comparing the motion for the search with the motion of the additional motion library, and performing a forward search.

On the contrary, if the additional motion library does not exist, the step of displaying similar motions that have already been searched is displayed on the library clip data cleanup screen (S290). It can be applied to educational fields such as games, 3D motion editing programs, dance, dance, and virtual reality.

3 is an exemplary view illustrating an example in which a user sets a search operation on an operation edit unit according to an embodiment of the present invention.

When the character is loaded into the screen display unit 107 by the character loading unit 101, the user may set a desired posture using a character formed in the shape of a human body on the operation editing unit 102.

Characters formed in the shape of the human body can be presented in the same structure as the human body, the user can control each joint of the character to set the desired posture, at this time, the rotation value of the joint obtained by manipulating the joint to search for motion It can be the data to be used.

4 is an exemplary view showing a list of motion search options in a motion search unit according to an embodiment of the present invention.

The motion search unit 104 may provide a motion search option so that a user can designate a joint that is a search criterion, and compare and search all the joints of the character. You can also search by specifying only certain parts.

That is, when clicking the motion search option in Figure 4, you can specify the position of the head, chest, belly, hips, left arm, right arm, left hand, right hand, left leg, right leg, left foot, right foot, motion comparison In step 105, it is determined whether the position of the designated part of the character and the same part of the motion data is within the error range, and the similarity is measured using the rotation value of each joint.

The motion search unit may perform other functions in addition to the motion search option such as the rotation direction of the human joint.

5 is an exemplary diagram of motion data obtained by rotating an operation similar to a search operation on an operation comparison unit according to an embodiment of the present invention according to an angle.

When the user performs a motion search through a motion search option or the like, the motion comparison unit 105 compares the position of the character joints with the search motion set by an algorithm included in the motion comparison unit 105. A method for finding similar actions can be performed.

After confirming the position of a specific joint of the search operation, the motion data 113 checks whether the same joint position is within the error range. This process is performed for all joints and the motion data 113 is compared with the search operation. If all of the joints do not exceed the limit of similarity, it can be determined that the similar motion.

An operation determined as an operation similar to a search operation may generate motion data by rotating a character around the basic type 510 and add motion data to the motion library by a clip generated by the clip generator 106. Can be stored.

6 is an exemplary screen diagram illustrating a process of adding, as motion data, an operation similar to a search operation according to an embodiment of the present invention.

Motion data determined to be identical to or similar to the search operation may be added to the motion library to be placed as a clip, and similar motion may be added to the motion data including front, back, and side poses for use in a library. Can be added.

In addition, even when an operation similar to the search operation desired by the user is not searched, the front, rear, side postures, etc. of the search operation set by the user may be newly generated as motion data and added to the motion library.

6 shows a clip information display window 610, a basic type 620 of a similar operation to a search operation, and a representative motion display window 630, which show clip information by classifying motion data by its name and content, Representative motions are placed on the right to make searching easier.

That is, in the process of adding motion data by the basic type 620 of the operation similar to the search operation to the motion library, a new clip is generated and displayed on the clip information display window 610, and the basic type of the operation similar to the search operation. 620 is displayed as one of the representative motions of the representative motion display window 630. Therefore, when the user later clicks on the newly created clip or similar motion belonging to the representative motions, motion data derived from the basic type 620 of the motion similar to the search motion is displayed on the screen display. Can provide ease of search.

7 is an exemplary view showing an interface of a screen display unit and an editing program according to an embodiment of the present invention.

The interface includes a screen display unit 710 for displaying a character on a screen, an operation display unit 730 for a clip, a serial number display window 720, a character selection button 740, a stage selection button 750, a prop selection button 760 ), An illumination selection button 770, and a zoom control window 780 for enlarging or reducing a character or the like.

The user can load the motion data of the clip through the clip information in the motion library on the interface, and can also edit, classify, and save the motion data separately.

At this time, a male, female, animal, or virtual character can be selected by the character selection button 740, one of several kinds of stages can be selected by the stage selection button 750, and a prop selection button ( A necessary prop may be selected and displayed on the screen by 760, and the brightness of the screen may be adjusted by the light selection button 770.

In addition, the size of the character or the like may be adjusted by the zoom control window 780.

The present invention has been described above in connection with specific embodiments of the present invention, but this is only an example and the present invention is not limited thereto. Those skilled in the art can change or modify the described embodiments without departing from the scope of the present invention, and within the equivalent scope of the technical spirit of the present invention and the claims to be described below. Various modifications and variations are possible.

1 is a block diagram showing a computing device including a user terminal according to an embodiment of the present invention.

2 is a flow chart of a method for retrieving motion data according to an embodiment of the present invention.

3 is an exemplary view showing an example in which a user sets a search operation on an operation edit unit according to an embodiment of the present invention.

Figure 4 is an exemplary view showing a list of motion search options in the motion search unit according to an embodiment of the present invention.

5 is an exemplary view of motion data obtained by rotating an operation similar to a search operation on an operation comparison unit according to an embodiment of the present invention according to an angle.

6 is an exemplary screen illustrating a process of adding an operation similar to a search operation to motion data according to an embodiment of the present invention.

7 is an exemplary view showing an interface of a screen display unit and an editing program according to an embodiment of the present invention.

{Description of major symbols in the drawing}

100: computing device including the user terminal

101: character loading unit

102: operation editing unit

103: motion library loading unit

104: motion search unit

105: operation comparison

106: clip generation unit

107: display unit

108: control unit

111: character DB

112: Clip DB

113: motion data

510, 620: basic type of operation similar to the search operation

610: Clip information display window

630: representative motion display window

710: character display window

720: Serial number display window

730: operation display of the clip

740: character selection button

750: stage selection button

760: Prop selection button

770: light selection button

780: Zoom control button

Claims (8)

A first step of loading a character into a screen display unit of a user terminal; A second step of setting, by the user, the character as a search operation; A third step of loading a motion library on the screen display of the user; A fourth step of comparing the operation for the search with the operation of the motion library; A fifth step of advancing to the next operation of the motion library when the search operation and the motion library are inconsistent; And A sixth step of displaying on the clip data arrangement screen when searching for an operation that matches or is similar to the searching operation; Motion search method of motion data comprising a. The method of claim 1, wherein after the third step And presenting a similar operation to the user automatically by an algorithm included in the user terminal based on a search operation set by the user. The method of claim 1, wherein after the fifth step If the search is made up to the last motion of the motion library, it is determined whether an additional motion library exists, and if there is an additional motion library, loading the additional motion library, comparing the motion for searching with the motion of the additional motion library, and searching forward Motion search method of the motion data, characterized in that it further comprises. The method of claim 1, wherein after the sixth step And generating a clip in the motion library and storing the matched or similar motion when searching for a motion that matches or is similar to the search motion. A screen display unit of the user terminal; A character loading unit loading a character on the screen display unit; A motion editing unit for editing and displaying a search motion that a user wants to find using the character; A motion library loading unit including motion data to be compared with the search operation edited by the user and loading the same into the screen display unit of the user terminal; A motion search unit for searching for a similar motion in the motion library by using rotation information of a joint obtained from the search motion edited by the user; And A motion comparison unit comparing the search operation edited by the user with the motion library to check similarity; Motion library search generation system comprising a. The method of claim 5, And a clip generation unit for constructing and storing, as a database, an operation determined to be identical or similar to the search operation edited by the user. The method according to claim 5 or 6, And a control unit for controlling a data flow between the character loading unit, the motion editing unit, the motion library loading unit, the motion search unit, the motion comparison unit, and the motion data generation unit. A computer-readable recording medium for recording a computer program for executing the method according to any one of claims 1 to 4.

Images