JP2005258695A - Apparatus and method for searching music content, music content search program, and storage medium storing the music content search program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To realize searching for a music content capable of achieving high resolution. <P>SOLUTION: When a portion of music data is input, the portion of the music data is divided into a plurality of partial music data. From the partial music data, a plurality of sub-queries are generated, and by collecting the sub-queries, a single query is generated. A music database is searched by the query, and the search result is analyzed. A search result with a lack of features being given in advance is excluded. Using a query generated by use of the remainder of the search result, the music database is searched again, and the result is shaped and processed, which is then output as a final search result. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a music content search device and method, a music content search program, and a storage medium storing a music content search program, and more particularly, a music content search device for searching for music content using a characteristic portion in input data. And a music content search program and a storage medium storing the music content search program.

In conventional music search, music is divided into pieces of music in advance and assigned with importance, and a part or all of the music is used as a search key to search for similar music based on importance. There are methods (see, for example, Patent Documents 1 to 4 and Non-Patent Documents 1 and 2).
Japanese Patent Laid-Open No. 2001-109471 “Music Retrieval Device, Music Retrieval Method, and Storage Medium Recording Music Retrieval Program” Nishihara, Kosugi, Sugaya, Yamamuro JP 2002-175073 A "Performance Collection Device, Performance Collection Method and Performance Collection Program Recording Medium" Kataoka, Kosugi, Kojima JP 2000-347659 A “Music Search Device, Music Search Method, and Recording Medium Recording a Music Search Program” Nishihara, Kosugi, Sakata, Yamamuro, Umeda, Kajitani JP 2002-123287 A “Music Feature Generation Method and Device, Music Information Retrieval Device, and Music Feature Generation Program Recording Medium” Naoko Kosugi "Humming search system for large-scale music database" IPSJ Journal 2002 February "Sound Compass: Music Search System by Humming" IPSJ Journal, January 2004

  However, in music content search, it is important to see how effectively input data can be used. Partial analysis of music has also revealed that there are similar melodies that are used in multiple songs. Such a portion has a poor feature from the viewpoint of search and causes a reduction in search resolution.

  The present invention has been made in view of the above points, and an object thereof is to provide a music content search apparatus and method capable of realizing high resolution, a music content search program, and a storage medium storing the music content search program. And

  FIG. 1 is a principle configuration diagram of the present invention.

The present invention is a music content search device for searching for music content stored in a music database 30,
When a part of the music data is input, the part of the music data is divided into a plurality of partial music data, a plurality of subqueries are created from the partial music data, and the plurality of subqueries are combined into one. Subquery creation means 10 for creating two queries;
Search means 20 for searching the music database 30 with a query;
An effective subquery detection unit 40 that analyzes the search result searched by the search unit 20, eliminates a search result having poor features given in advance, and generates a query using the remaining search result;
A final result shaping / processing unit 50 which shapes the result of re-searching the music database 30 by the search unit 20 using the query generated by the valid subquery detection unit 40 and outputs the result as a final search result. .

  Further, the subquery creation means 10 of the present invention includes means for generating partial music data of a certain length while shifting at a certain interval when dividing a part of music data into a plurality of partial music data. .

  FIG. 2 is a diagram for explaining the principle of the present invention.

The present invention is a music content search method for searching music content stored in a music database,
When a part of the music data is input in the subquery creation means (step 1), a part of the music data is divided into a plurality of partial music data (step 2), and a plurality of subqueries are created from the partial music data. , A plurality of subqueries are combined into one query to create one query (step 3); a subquery creation step;
A search step for searching the music database by query (step 4);
An effective subquery detection step of analyzing the search result searched in the search step, eliminating a search result having poor features given in advance, and generating a query using the remaining search result (step 5);
The music database is re-searched by the search means using the query generated in the valid subquery detection step (step 6), the result is shaped and processed, and the final result shaping / processing step for outputting as the final search result (step) 7).

  In addition, the subquery creation step of the present invention includes a step of generating partial music data having a predetermined length while shifting at a predetermined interval when part of the music data is divided into a plurality of partial music data.

The present invention is a music content search program for searching for music content stored in a music database,
On the computer,
When a part of the music data is input, the part of the music data is divided into a plurality of partial music data, a plurality of subqueries are created from the partial music data, and the plurality of subqueries are combined into one. A subquery creation step that creates one query,
A search step for searching a music database with a query;
An effective subquery detection step of analyzing the search result searched in the search step, eliminating a search result having poor characteristics given in advance, and generating a query using the remaining search result;
Using the query generated in the effective subquery detection step, the result of re-searching the music database is shaped and processed, and the final result shaping / processing step of outputting as a final search result is executed.

The present invention provides a subquery creation step,
When part of the music data is divided into a plurality of pieces of partial music data, a step of generating partial music data of a certain length is executed while shifting at regular intervals.

The present invention is a storage medium storing a music content search program for searching for music content stored in a music database,
On the computer,
When a part of the music data is input, the part of the music data is divided into a plurality of partial music data, a plurality of subqueries are created from the partial music data, and the plurality of subqueries are combined into one. A subquery creation step that creates one query,
A search step for searching a music database with a query;
An effective subquery detection step of analyzing the search result searched in the search step, eliminating a search result having poor characteristics given in advance, and generating a query using the remaining search result;
A music content search program for executing a final result shaping / processing step for shaping a result of re-searching a music database using a query generated in an effective subquery detection step and outputting the result as a final search result A stored storage medium.

  Further, in the storage medium storing the music content search program of the present invention, when the part of the music data is divided into a plurality of partial music data in the subquery creation step, A step of generating typical music data.

  As described above, according to the present invention, a portion with poor features is detected from input data and the portion is not used for search. Specifically, a plurality of subqueries based on the portion from inquiry music data are used. , Search the music database with a query that consists of those subqueries, analyze the search results of those subqueries, detect subqueries that are considered valid for the search, and use the query that consists only of them again The music database is searched and the result is shaped and processed as the final result.

  Specifically, for example, it is characterized in that a search is performed centering on a more characteristic part in the input Hamming data, and one tune is composed of a very characteristic melody. When a part (such as “rust”) and a part composed of a melody that is often used in relatively many songs (such as the end of a song) are mixed, a number of songs are included in the humming search. If there is a melody that is used in, a search using that part will output a search result saying that many songs are correct, limiting which song is actually hummed. Can not do. In the present invention, the search is performed by eliminating a portion having such a poor feature, thereby limiting the hummed music more accurately.

  According to the present invention, it is possible to automatically determine a pitch and a sound value from an acoustic signal and tempo information of an input person's singing voice (singing with a tatter or lyric). Further, by performing preprocessing before frequency analysis and determining the necessity / unnecessity of time-consuming frequency analysis, the processing speed can be increased.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 3 shows a configuration of a music content search apparatus according to an embodiment of the present invention.

  The music content search apparatus shown in FIG. 1 includes a subquery creation unit 10, a search unit 20, a music database (DB) 30, an effective subquery detection unit 40, and a final result shaping unit 50.

  When a part of music data is input as input information, the subquery creation unit 10 divides a part of the music data into a plurality of subdata, creates a subquery from each of the divided subdata, and collects the subqueries. One query is created and passed to the search unit 20.

  The search unit 20 searches the music DB 30 with the subquery created by the subquery creation unit 10 and sends the search result to the valid subquery detection unit 40. In addition, the music DB 30 is searched again using the query acquired from the valid subquery detection unit 40, and the search result is sent to the final result shaping unit 50.

  The valid subquery detection unit 40 analyzes the search result acquired from the search unit 20, detects a valid subquery, creates a query using only the valid subquery, and returns the query to the search unit 20.

  The final result shaping unit 50 shapes and processes the search result re-searched by the query in the search unit 20 and outputs it as the final result.

  Next, the operation in the above configuration will be described.

  FIG. 4 is a flowchart of a series of operations according to the embodiment of the present invention.

  Step 101) When music data is input, the sub-query creating unit 10 divides the music data into parts to generate partial music data. At this time, as shown in FIG. 5, a plurality of pieces of partial music data having a length (window length) being cut are extracted while being shifted at a constant interval (slide width). In this case, a sliding window method (C. faloutsos, M. Ranganathan, and Y. Manolopoulos. Fast Subsequence Matching in Time-Series Database. In Proceedings of the ACM SIGMOD, International Conference on management of Data, pp.419 -429, 1994).

Step 102) The subquery creation unit 10 creates a subquery from the partial music data. At this time, feature data (for example, feature vector) is extracted and used as a subquery. For example, as the feature data, when music data is divided at regular time intervals, the pitch of the sound that is reproduced for the longest time is extracted. For example, as a method for extracting feature vectors, `` N. Kosugi, Y. Nishihara, T. Sakata, M. Yamamuro, and K. Kushima, A Practical Query-By-Humming System for a Large Music Database.In Proc, of ^{the 8 th ACM International Conference on Multimedia} , pp. 333-342, it is possible to use a 2000 ".

  Step 103) The subquery generator 10 combines the subqueries into one query (for example, an SQL statement).

  Step 104) The search unit 20 searches the music DB 30 using the query created in step 103. The search is a similar search (for example, Naoko Kosugi, Yasushi Sakurai, Masashi Yamamuro, Kazuhiko Kushima, Sound Compass: "Music Search System by Hamming" Information Processing Society of Japan Journal, Vol. 45, No. 1, Jan, 2004). Similarity search is, for example, when a numeric string is entered, the distance between the numeric string and each numeric string in the database is calculated, and the top few items with the closest distance are used as search results. is there. As a search result, the song title and its similarity are acquired and transferred to the valid subquery detection unit 40.

  Step 105) The valid subquery detection unit 40 determines whether or not there is a search result including the acquired song name and its similarity that matches a preset condition. If there is, the process proceeds to step 106, and if not, the process proceeds to step 107.

  Step 106) If there is a subquery that satisfies the condition, the valid subquery detection unit 40 excludes the subquery and collects the remaining one subquery (for example, an SQL statement). For example, if four subqueries are created from one hamming and the fourth subquery meets the condition, a query is created using only the subqueries 1 to 3, passed to the search unit 20, and the process proceeds to step 104.

  Step 107) If there is no subquery that matches the condition in Step 105, the final result shaping unit 50 shapes and processes the search result. For example, as shown in FIG. 6, in the case of a WWW browser, it is processed into an HTML format. As a result of shaping and processing, for example, a list of song names arranged in order of similarity and the similarity of each station are output as the final search result.

  Next, the operation of the valid subquery detection unit 40 in step 105 will be described in detail.

For example, when music data h is input to a music DB 30 that holds a song a _k (1 ≦ k), and a music content search is performed to output a song list of the top n songs with high similarity as a final search result. To do.

Let m be the number of partial music data created from the input music data h, and p be the number of partial music data for the song _ak . The distance between the i-th partial music data of the song _{ak and} the j-th partial music data of the input music data

としたとき、曲ａ_ｋと入力音楽データｈとの距離Ｄ（ａ_ｋ，ｈ）を、

If the distance D (a _k , h) between the music a _k and the input music data h is

とする。このとき、Ｄ（ａ_ｋ，ｈ）の値が小さい上位ｎ件が最終結果となるが、ｎ個のＤ（ａ_ｋ，ｈ）を算出したｈ_ｊのそれぞれの比率を、そのｈ_ｊの最終結果決定率

And At this time, the top n cases where the value of D (a _k , h) is small is the final result, and the ratio of each of h _j from which n D (a _k , h) is calculated is the final value of h _j Result decision rate

と定義し以下の式で算出する。

And calculate with the following formula.

ここで、

here,

がある閾値を越えて大きかった場合（例えばｘ％を越えた場合）、ｈ_ｊは入力音楽データの中で特徴が乏しい部分であると判断する。

If a certain threshold value is larger than a certain threshold value (for example, if x% is exceeded), h _j is determined to be a portion with poor features in the input music data.

Therefore, for example, as a condition,
“Final result decision rate exceeds x%”
It can be. For example, x may be “80”.

  The above operation is shown in FIG.

  As described above, once the music database 30 is searched with a query, the search result is analyzed, and if a portion with poor features is included in it, a query that excludes that portion is generated and searched again. By using the result as the final search result, high resolution can be realized.

  4 and 7 in the above embodiment is constructed as a program, installed in a computer used as a music content search device, executed by a control means such as a CPU, or distributed through a network. It can also be installed on a computer.

  Further, the constructed program can be stored in a hard disk connected to a computer used as a music content search device or a portable storage medium such as a CD-ROM and installed in the computer.

  The present invention is not limited to the above-described embodiment, and various modifications and applications can be made within the scope of the claims.

  The present invention can be applied to search for music content and the like and music.

It is a principle block diagram of this invention. It is a figure for demonstrating the principle of this invention. It is a block diagram of the music content search apparatus in one embodiment of this invention. It is a flowchart of a series of operation | movement in one embodiment of this invention. It is a figure which divides | segments the input music data based on a part in one embodiment of this invention. It is an example of shaping and processing of a final search result in an embodiment of the present invention. It is a flowchart of the search result analysis process in one embodiment of the present invention.

Explanation of symbols

10 subquery creation means, subquery creation section 20 search means, search section 30 music DB (database)
40 Effective subquery detection means, effective subquery detection section 50 Final result shaping / processing means, final result shaping / processing section

Claims (8)

A music content search device for searching for music content stored in a music database,
When a part of the music data is input, the part of the music data is divided into a plurality of partial music data, a plurality of subqueries are created from the partial music data, and the plurality of subqueries are combined into one. Sub-query creation means to create one query,
Search means for searching the music database with the query;
An effective sub-query detection unit that analyzes the search result searched by the search unit, eliminates a search result having poor characteristics given in advance, and generates a query using the remaining search result;
Final result shaping / processing means for shaping the result of re-searching the music database by the search means using the query generated by the effective sub-query detection means and outputting the result as a final search result. The music content search apparatus characterized by the above-mentioned. The subquery creation means includes:
2. The music content search apparatus according to claim 1, further comprising means for generating partial music data having a predetermined length while shifting at a predetermined interval when dividing a part of the music data into a plurality of partial music data. A music content search method for searching for music content stored in a music database,
When a part of the music data is input by the sub-query creating means, the music data is partially divided into a plurality of partial music data, a plurality of sub-queries are created from the partial music data, and the plurality of sub-queries are combined into one. A sub-query creation step that creates a single query
A search step of searching the music database with the query;
An effective subquery detection step of analyzing the search result searched in the search step, eliminating a search result having a poor feature provided in advance, and generating a query using the remaining search result;
The final result shaping / processing step of shaping the result of re-searching the music database by the search means using the query generated in the effective subquery detection step and outputting the result as a final search result is performed. The music content search method characterized by this. In the subquery creation step,
4. The music content search method according to claim 3, further comprising the step of generating partial music data having a predetermined length while shifting at a predetermined interval when dividing a part of the music data into a plurality of partial music data. A music content search program for searching for music content stored in a music database,
On the computer,
When a part of the music data is input, the part of the music data is divided into a plurality of partial music data, a plurality of subqueries are created from the partial music data, and the plurality of subqueries are combined into one. A subquery creation step that creates one query,
A search step of searching the music database with the query;
An effective subquery detection step of analyzing the search result searched in the search step, eliminating a search result having a poor feature provided in advance, and generating a query using the remaining search result;
Using the query generated in the effective subquery detection step, shaping the result of re-searching the music database, and executing a final result shaping / processing step of outputting as a final search result. A music content search program. In the subquery creation step,
6. The music content search program according to claim 5, wherein when dividing a part of the music data into a plurality of partial music data, a step of generating partial music data having a predetermined length while being shifted at a predetermined interval is executed. . A storage medium storing a music content search program for searching for music content stored in a music database,
On the computer,
When a part of the music data is input, the part of the music data is divided into a plurality of partial music data, a plurality of subqueries are created from the partial music data, and the plurality of subqueries are combined into one. A subquery creation step that creates one query,
A search step of searching the music database with the query;
An effective subquery detection step of analyzing the search result searched in the search step, eliminating a search result having a poor feature provided in advance, and generating a query using the remaining search result;
A program for executing a final result shaping / processing step of shaping a result of re-searching the music database using the query generated in the effective subquery detection step and outputting the result as a final search result A storage medium storing a music content search program characterized by being stored. In the subquery creation step,
8. The music content search program according to claim 7, wherein when dividing a part of the music data into a plurality of partial music data, a step of generating partial music data having a predetermined length is executed while being shifted at predetermined intervals. A storage medium that stores

Images