JPH11120197A - Motion data retrieving device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To retrieve motion data of a graphic character which fits music. SOLUTION: This motion data retrieving device has a music storing means 3 which accumulates musical data and a music title, makes the music title enter and outputs musical data that corresponds to it, a music analyzing means 2 which makes the musical data and a music position enter, finds a 1st beat information in reproducing the music position and outputs it, a motion data storing means 4 which accumulates movement data of a character that operates, tuning to music at an optical section of the music and a 2nd beat information of an optional section of the music and a motion data retrieving means 1 which inputs the music title that designs motions and the tune position, compares the 1st beat information at the time of acquiring it with the 2nd beat information accumulated in the means 4 and retrieves motion data of the character by an algorithm that is preliminarily defined and retrieves movement data that is tuned to the beat of the music.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus for retrieving character motion data corresponding to a song.

[0002]

2. Description of the Related Art Heretofore, attempts have been made to make graphic characters jump with music by taking advantage of the characteristics of graphics, such as the ability to freely create virtual spaces that cannot be represented by natural images. In this case, the motion data of the graphic character has been produced for each song by using a motion capture or by a skilled designer. Although this conventional production process always yields motion data that matches the song, the production of motion data required a great deal of expense. Thus, for example,
It has been very difficult to incorporate graphic characters into services that require content that can be enjoyed at low cost, such as karaoke content.

Therefore, motion data in a certain time unit is
Attempts have been made to reduce the total cost of motion data production by producing motion data for one song, combining multiple motion data to create motion data for one song, and reusing motion data once produced. Along with this, a mechanism for managing once created motion data so that it can be easily reused has become necessary when producing graphic content titles.

[0004]

However, when actively trying to reuse motion data, the number of combinations of motion data increases as the types of motion data increase, and graphic characters can be choreographed according to various songs. On the other hand, there is a problem that it is difficult to grasp all available motion data, and it is difficult to quickly select appropriate motion data.

SUMMARY OF THE INVENTION The present invention solves the above-mentioned conventional problems, and provides an apparatus which can easily search for motion data that matches a song when producing graphic content titles by reusing motion data. is there.

[0006]

In order to solve the above-mentioned problems, a motion data search device according to a first aspect of the present invention accumulates music data and music titles, and when a music title is input, converts the music data corresponding to the music title. A music storage unit to be output, music data and a music position obtained from the music storage unit are input, the music data is analyzed, time signature information for reproducing the input music position is obtained, and first time signature information is obtained. Music data analyzing means for outputting the data as character data, and motion data storage means for accumulating motion data of a character operating in accordance with the music in an arbitrary section of the music and second time signature information as time signature information of the music in the arbitrary section of the music; When a song name and a song position to which the movement of the character is to be input are input, the first time information is obtained from the music analysis means, and the second time information and the first time information stored in the movement data storage means are obtained. Beat information And a motion data retrieval means for retrieving motion data of the character by an algorithm predetermined by comparing the.

A motion data retrieval apparatus according to a second aspect of the present invention stores music data and music titles, and when music titles are input, outputs music data corresponding to the music titles, and the music storage means. The music data and the music position obtained from the input are input, the music data is analyzed, the time signature information at the time of reproducing the input music position is obtained, and the music analysis means for outputting as the first time signature information; Motion data of a character operating in accordance with a song in a section, second time signature information which is time signature information of a song in an arbitrary section of the song, and words indicating the motion of the motion data of the character operating in accordance with the song, Motion data storage means for storing information of a logical expression description of a motion keyword expressed in the form of a logical expression using at least one of a symbol and a sign; When the song name and the song position to be input are input, the first beat information is obtained from the song analyzing means, and the second beat information stored in the motion data storage means is compared with the first beat information. Then, the motion data of the character is searched by a predetermined algorithm, and when a motion keyword or a logical expression description of the motion keyword is input, the search is performed using the first time information and the second time information. Compares the information of the logical expression description of the motion keyword corresponding to the motion data with the input motion keyword or the logical expression description of the motion keyword, and matches, or the motion data corresponding to the logical expression description of the motion keyword including the same. And a motion data search means for searching the motion data storage means.

A motion data search device according to a third aspect of the present invention stores music data and music titles, and when music titles are input, outputs music data corresponding to the music titles; The music data and the music position obtained from the input are input, the music data is analyzed, the time signature information at the time of reproducing the input music position is obtained, and the music analysis means for outputting as the first time signature information; Motion data of a character operating in accordance with a song in a section, second beat information which is time signature information of a song in an arbitrary section of the song, and motion data of a character operating in accordance with the song in an arbitrary section of the song are produced. Accumulates comment information that expresses the image that the choreographer or motion data creator puts on the choreographed by using at least one of words, symbols, or codes. A motion data storage unit that, when the title and song position Ru choreography movement of the character is input,
The first beat information is obtained from the music analysis means, and the second beat information stored in the motion data storage means is compared with the first beat information, and the movement of the character is determined by a predetermined algorithm. Search data,
The comment information corresponding to the motion data retrieved using the first time signature information and the second time signature information is obtained from the motion data storage means, and the obtained comment information is displayed. When information is selected, there is provided a motion data search means for searching the motion data storage means for motion data corresponding to the selected comment information.

[0009]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to FIGS.

(Embodiment 1) FIG. 1 is a block diagram of a motion data search apparatus according to the first invention of the present application.

In FIG. 1, reference numeral 1 denotes motion data search means;
Reference numeral 2 denotes music analysis means, 3 denotes music storage means, and 4 denotes motion data storage means.

When the name of the piece to be choreographed and the position in the song are input, the motion data search means 1 passes the input song name and the position in the song to the song analysis means 2 and the music data in the song data corresponding to the song name. The time signature information at the time of reproducing the designated music position is acquired from the music analysis means 2, and the acquired time signature information is compared with the time information of the motion data stored in the motion data storage means 4 to compare the numerator and denominator of the time information. The motion data having the same ratio is retrieved from the motion data storage unit 4.

The music analysis means 2 includes a motion data search means 1
When the song name and the position in the song are designated by, the song data corresponding to the designated song name is obtained from the song storage means 3,
This is analyzed, and time signature information at the time of reproducing the designated position is output.

The music storage means 3 stores the music data and the music title as 1
They are stored in correspondence with one to one. When a song name is input, the corresponding song data is output.

The motion data storage means 4 records the motion data of the motion choreographed in the section divided by the appropriate break in the music and the time signature information of the section in the music at the time of the choreography. I have. Here, the section divided by a break in an appropriate song is a time section that can be easily handled as a unit of motion of motion data, such as a section of one phrase in the song, a section of interlude, and the like. This is a time section delimited by the motion data creator according to the music for which the motion is produced.

Hereinafter, the operation of the motion data search device will be described. For the sake of explanation, a case will be described as an example where motion data to be choreographed to the tenth bar of song title A is searched.

The music storage means 3 stores the music title and music data in one
It is stored in correspondence with one to one. Motion data storage means 4
Stores the motion data in association with the beat information of the choreography section of the music piece to which the motion of the motion data is choreographed.

First, the motion data search means 1 gives the music analysis means 2 the music title A and the ten bars in the music.

The music analysis means 2 acquires the music data of the music title A from the music storage means 3. The music data is analyzed to obtain time signature information for playing the music data of the tenth bar, and the time information is passed to the motion data search means 1.

Here, for the following explanation, temporarily assume that the music title A
It is assumed that, as a result of analyzing the music data of No. 4, a quarter beat is obtained.

Next, the motion data search means 1 matches the time signature information obtained from the music analysis means 2 with the quarter time signature.
The motion data whose time signature information is a quarter time is obtained from the motion data storage means 4.

In this embodiment, the music analysis means 2
Motion data in which the time information obtained from the time information matches the time information recorded in the motion data storage means 4 was searched.
If the ratio between the numerator of the time signature and the denominator, such as the time signature of two-half, is the same, it is possible to match the movement of four-four time, so the motion data of two-half time is used as a motion data candidate. You can also search. The same applies to the numerator and denominator of other beats.

The motion data search device of the present invention searches for motion data corresponding to a song as a part of a title production device. FIG. 4 shows an embodiment of a title production device using the motion data search device of the present invention.

FIG. 4 shows an embodiment in which a title production device is configured using the motion data search device of the first invention. In the figure, 401 is the motion data search means described in 1 of FIG. 1, 402 is the music analysis means described in 2 of FIG. 1, 403 is the music storage means described in 3 of FIG.
Reference numeral 404 denotes the motion data storage means described in 4 of FIG.
5 is a graphic title producing means, 406 is a scenario storing means, and 407 is a graphic character storing means.

The graphic title producing means 405 includes:
The motion data is searched by using the motion data search device of the first invention, and graphic reproduction is performed by using the searched motion data and graphic character data. Simultaneously, the graphic reproduction and the reproduction of the musical sound data are synchronized. Let the user confirm that the image of the motion of the graphic character matches the image of the sound.The contents of the content, such as the correspondence between the motion data, the graphic character data, and the musical sound data, and the order in which each data is played back, are checked. Describe in scenario data.

Graphic character storage means 407
Stores shape data of graphic characters such as polygon data.

The scenario storage means 406 describes scenario data describing the correspondence between musical sound data, motion data and graphic characters.

Hereinafter, the operation of the title producing apparatus will be described. Assume that the movement of the graphic character is choreographed to the tenth bar of the song title.

The graphic title producing means 405 comprises:
The song name A to which the motion is to be assigned and ten bars indicating the song position are input, and the motion data search means 401 obtains the name of the motion data to be assigned to. Here, 10 of song A
The name of the motion data corresponding to the beat information that matches the ratio of the numerator and denominator of the beat information when the measure is reproduced is acquired.

Next, graphic title producing means 40
5 obtains motion data corresponding to the name of motion data that is a choreography candidate from the motion data storage unit 404,
The graphic character data is obtained from the graphic character storage means 407, the music data of the music title A is obtained from the music storage means 403, and the graphic and musical sound data are reproduced synchronously from the tenth measure, and the image of the music and the movement are in agreement. Ask the user to confirm.

When it is confirmed that the image of the music and the movement match, the graphic title producing means 405
Describes the contents of the content such as the correspondence between the motion data, the graphic character data, and the musical sound data at this time, and the order of reproduction of each data in the scenario data.

If there are a plurality of candidate motion data, the graphic data and the tone data are synchronized and reproduced using the respective motion data, and the user selects the motion data that the user thinks appropriate. The corresponding relationship between musical sound data, motion data, and graphic characters at the time is recorded in scenario data.

The scenario storage means 406 stores the scenario data recorded by the graphic title producing means 405.

As described above, when producing a graphic content title in which a graphic character operates in accordance with a song, the efficiency of graphic content title production can be improved by using the motion data search device of the first aspect of the present invention. Can be.

(Embodiment 2) FIG. 1 is a configuration diagram of a motion data search device according to the second invention of the present application.

In FIG. 1, reference numeral 1 denotes motion data search means;
Reference numeral 2 denotes music analysis means, 3 denotes music storage means, and 4 denotes motion data storage means.

The music analysis means 2 and the music storage means 3 operate in the same manner as in the first embodiment.

When the name of the song to be choreographed and the position in the song are input, the motion data search unit 1 passes the input song name and the position in the song to the song analysis unit 2, and the music data in the song data corresponding to the song title is input. The time signature information at the time of reproducing the position of the designated music is acquired from the music analysis means 2, and the acquired time information is compared with the time information of the motion data stored in the motion data storage means 4. Is retrieved from the motion data storage means 4, and the information of the logical expression description of the keyword of the motion corresponding to the retrieved motion data is compared with the keyword expressing the motion of the inputted motion data to be retrieved. , To narrow down the motion data that matches this keyword.

The motion data storage means 4 stores the motion data of the motion choreographed to the section delimited by the break in the appropriate music, the time signature information of the section in the music when choreographed, and the logical expression of the keyword of the motion. The information representing the movement by the description is stored in association with the information.

The operation of the motion data search device will be described below. The motion data to be choreographed to the tenth bar of the song title A is searched. The music storage means 3 stores music names and music data in one-to-one correspondence. The motion data storage means 4 expresses the motion by the motion data of the motion shown in FIGS. 2 and 3, the time information of the music position of the music when the motion of the motion data is choreographed, and the logical expression description of the keyword of the motion. The stored information is stored in association with the information.

FIG. 2 shows a movement in which a turn (201, 202) is performed and a horizontal skip (203, 204, 205) is performed in the left direction. Is expressed. The information of the logical expression description by the keyword of the motion is stored in the motion data storage unit 4. It is assumed that this movement was made to music in quarter time.

FIG. 3 shows the movement of a character walking in a square locus by sequentially moving the space in four directions.
The figure of the two characters is forward (301), turning left and moving forward (302), turning left and moving forward (30).
3) A movement (304) of turning left and moving forward. The logical expression description using the keyword of this movement is expressed as “walk * square”. The information of this logical expression description is
It is stored in the motion data storage means 4. This movement is 4
It is assumed that the music was produced in accordance with the music of four beats.

First, the motion data search means 1 gives the music analysis means 2 the music title A and the ten bars in the music.

The music analysis means 2 acquires the music data of the music title A from the music storage means 3. The music data is analyzed to obtain time signature information for playing the music data of the tenth bar, and the time information is passed to the motion data search means 1. For the following description, it is assumed here that, as a result of analyzing the music data of the music title A, a quarter time signature is obtained.

Next, the motion data search means 1 matches the time signature information of four-fourths obtained from the music analysis means 2.
The motion data of the motion shown in FIGS.

Next, a search based on the keyword of the motion is performed from the two motion data of FIG. 2 and FIG. For example, consider a case where motion data including a turn is acquired. The motion data search means 1
When the "turn" which is the keyword of the movement is received as an input, the information of the logical expression description of the movement corresponding to the two movement data of FIG. 2 and FIG. And searches for the motion data in FIG. 2 using “turn” as a logical expression description of the motion.

In this embodiment, the music analysis means 2
Motion data in which the time information obtained from the time information matches the time information recorded in the motion data storage means 4 was searched.
If the ratio between the numerator of the time signature and the denominator, such as the time signature of two-half, is the same, it is possible to match the movement of four-four time, so the motion data of two-half time is used as a motion data candidate. You can also search. The same applies to the numerator and denominator of other beats.

(Embodiment 3) FIG. 1 is a configuration diagram of a motion data search device according to the third invention of the present application.

In FIG. 1, reference numeral 1 denotes motion data search means;
Reference numeral 2 denotes music analysis means, 3 denotes music storage means, and 4 denotes motion data storage means.

The music analysis means 2 and the music storage means 3 operate in the same manner as in the first embodiment.

When the name of the piece to be choreographed and the position in the music are input, the motion data search means 1 passes the input name of the music and the position in the music to the music analysis means 2, and the music data in the music data corresponding to the name of the music. The time signature information at the time of reproducing the designated music position is obtained from the music analysis means 2, and the obtained time information is compared with the time information of the motion data stored in the motion data storage means 4 to match the obtained time information. The motion data is retrieved from the motion data storage means 4, and comment information corresponding to the retrieved motion data is read from the motion data storage means 4.

The motion data storage means 4 produces motion data of the motion choreographed to the section demarcated by an appropriate break in the music, time signature information of the section in the music when choreographed, and motion of the motion data. It stores comment information that expresses, by using words, symbols, and codes, an image that is put into the choreographer or the motion data creator at the time of the choreography. For example, the motion data of the motions shown in FIGS. 2 and 3, the time signature information of each motion, the quarter time signature, and the comment information of each motion, the motion data of FIG. It is assumed that "it moves with a free feeling." And "it moves exactly in the image of a soldier."

The operation of the motion data search device will be described below. Now, motion data to be choreographed to the tenth bar of the song title A is searched.

First, the motion data search means 1 gives the music analysis means 2 the music title A and the ten bars in the music.

The music analysis means 2 acquires the music data of the music title A from the music storage means 3. The music data is analyzed to obtain beat information when the tenth bar in the music data is played, and is passed to the motion data search means 1. For the following description, it is assumed here that, as a result of analyzing the music data of the music title A, a quarter time signature is obtained.

Next, the motion data search means 1 matches the time signature information obtained by the music analysis means 2 with the quarter time signature.
The motion data of the motions shown in FIGS. 2 and 3 which are motion data of a quarter time are retrieved from the motion data storage means 4.

Next, the motion data search means 1 is the comment information of the two motion data shown in FIGS. 2 and 3, "Move lightly and freely" and "Move perfectly with the image of a soldier." Are read from the motion data storage means 4,
Display these comment information. The user who is searching for the motion data reads the comment information, imagines each motion, selects the comment information “Move lightly and freely,” and the motion data search means 1 uses the motion shown in FIG. Search for motion data.

In the present embodiment, the music analysis means 2
Motion data in which the time information obtained from the time information matches the time information recorded in the motion data storage means 4 was searched.
If the ratio between the numerator of the time signature and the denominator, such as the time signature of two-half, is the same, it is possible to match the movement of four-four time, so the motion data of two-half time is used as a motion data candidate. You can also search. The same applies to the numerator and denominator of other beats.

[0059]

As described above, according to the present invention, the music data to which the movement of the character is to be analyzed is analyzed, and the time signature information corresponding to the position of the music to which the movement of the character is to be obtained is obtained. By comparing this with the time signature information of the choreography section in the song used when producing the motion data of the character, it is possible to search for motion data matching the beat of the song by a predetermined algorithm.

Further, the information expressed by the logical expression description of the motion keyword of the motion data retrieved by a predetermined algorithm by comparing the time signature information and the motion keyword input to the motion data retrieval means or the logical expression description of the motion keyword By comparing with the above, it is possible to search for the motion data of the character that moves in time with the beat of the song and that matches the image of the user of the title production device.

Also, by displaying the comment information of the motion data retrieved by a predetermined algorithm by comparing the time signature information to the user of the title producing apparatus, the image of the choreographer or the motion data creator can be accurately displayed in the title. It is possible to inform the user of the production device to support the selection of the motion data in time with the song and without impairing the image of the choreographer or the motion data creator.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a motion data search device according to an embodiment of the present invention.

FIG. 2 is a diagram showing a motion of turning the motion data search device according to the embodiment of the present invention and performing a horizontal skip to the left.

FIG. 3 is a diagram illustrating a walking motion drawing a rectangle of the motion data search device according to the embodiment of the present invention;

FIG. 4 is a configuration diagram of a title production device in one embodiment using the motion data search device of the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 Motion data search means 2 Music search means 3 Music storage means 4 Motion data storage means 101 User input 201 Turn start movement 202 Turn end pose 203 Movement to skip leftward 204 Movement to skip leftward 205 Movement to skip leftward 301 Move forward and walk 302 Movement to move left and move forward 303 Movement to walk backward 304 Movement to change left and move forward from 303 303 401 Motion data search means 402 which is the same component as FIG. 1 Music search means 403 which is the same component as 2 in FIG. 1 Music storage means 404 which is the same component as 3 in FIG. 1 404 Same configuration as 4 in FIG. Motion data storage means 405 as elements Graphic title creation means 406 Scenario storage means 407 Graph Click character storage means

Claims (3)

[Claims] 1. A music storage means for accumulating music data and music titles and outputting music data corresponding to the input music titles, and music data and music positions acquired from the music storage means as inputs. Music analysis means for analyzing music data, obtaining time signature information for reproducing the input music position, and outputting it as first time information, and motion data of a character operating in accordance with the music in an arbitrary section of the music Motion data storage means for storing time signature information, which is time signature information of a song in an arbitrary section of the song, and a song name and a song position to which the movement of the character is to be inputted. 1
Motion data retrieval means for obtaining the time signature information of the character, comparing the second time signature information stored in the motion data storage means with the first time signature information, and searching for character motion data by a predetermined algorithm. A motion data search device comprising: 2. A music storage means for accumulating music data and music titles and outputting music data corresponding to the input of the music title, and music data and music position acquired from the music storage means as inputs. Music analysis means for analyzing music data, obtaining time signature information for reproducing the input music position, and outputting it as first time information, and motion data of a character operating in accordance with the music in an arbitrary section of the music And at least one of words, symbols, or symbols indicating motion of the motion data of the character that moves in accordance with the song, and second time information that is time signature information of the song in an arbitrary section of the song. Motion data storage means for storing information of a logical expression description of a motion keyword expressed in the form of a logical expression using
When a song name and a song position to which the movement of the character is to be input are input, the first time information is obtained from the music analysis means, and the second time information and the first time information stored in the movement data storage means are obtained. The character data is compared with the time signature information to search for the motion data of the character by a predetermined algorithm. When the motion keyword or the logical expression description of the motion keyword is input, the first time information and the second time information are used. Comparing the information of the logical expression description of the motion keyword corresponding to the retrieved motion data with the input motion keyword or the logical expression description of the motion keyword, and matching or including the logical expression description of the motion keyword And a motion data search means for searching the motion data storage means for motion data corresponding to. 3. A music storage means for accumulating music data and music titles and outputting music data corresponding to the input music titles, and music data and music positions acquired from the music storage means as inputs. Music analysis means for analyzing music data, obtaining time signature information for reproducing the input music position, and outputting it as first time information, and motion data of a character operating in accordance with the music in an arbitrary section of the music And second time signature information, which is time signature information of a song in an arbitrary section of the song, and a motion choreographed by a choreographer or a motion data creator when motion data of a character operating in accordance with the song is created in an arbitrary section of the song. Motion data storage means for storing comment information that expresses an image put in with respect to at least one of words, symbols, or codes; When a song name and a song position to be attached are input, the first beat information is obtained from the song analyzing means, and the second beat information and the first beat information stored in the motion data storage means are obtained. The motion data of the character is searched for by a predetermined algorithm for comparison, and comment information corresponding to the motion data searched using the first time signature information and the second time signature information is read from the motion data storage means. Acquiring, displaying the acquired comment information, and, when at least one comment information is selected by input, a motion data search means for searching the motion data storage means for motion data corresponding to the selected comment information. A motion data search device provided.