KR100780542B1 - System and method for recognition of music linked mobile communication network to broadcasting network - Google Patents

Abstract

A mobile/broadcasting-linked music recognition system and a method thereof are provided to induce users to actively participate in broadcasting programs by converting results for users' singing into scores, displaying them through TV receivers, and incorporating each user's score information into various song ranking programs. A mobile/broadcasting-linked music recognition system(10) is connected with a mobile terminal(30) through a mobile communication network(20). Also the music recognition system(10) is connected with a broadcasting station server(40). The music recognition system(10) receives a voice signal containing melody from the mobile terminal(30), extracts and analyzes a feature, and compares it with the original song. Then the music recognition system(10) calculates a score according to the similarity, and transmits the calculated score information to the broadcasting station server(40) so that it can be displayed through a TV receiver(50).

Description

System and Method for Recognition of Music Linked Mobile Communication Network to Broadcasting Network}

1 is an exemplary diagram of a communication network to which the present invention is applied;

2 is a detailed configuration diagram of the music recognition system shown in FIG. 1;

3 is a flowchart illustrating a music recognition method according to an embodiment of the present invention;

4 is a flowchart illustrating a music recognition method according to another embodiment of the present invention.

<Description of the symbols for the main parts of the drawings>

10: music recognition system 20: mobile communication network

30: mobile communication terminal 40: broadcasting station server

50: TV receiver 110: control unit

120: database 130: ARS server

140: music feature extraction unit 150: comparison and score conversion unit

160: message generating unit 170: interface

The present invention relates to a music recognition system and method, and more specifically, to a mobile communication network for transmitting a score conversion result through a broadcasting network after analyzing and converting a score of a song that is input by a user connected through a communication terminal. The present invention relates to a broadcasting network linked music recognition system and method.

At present, TV stations produce and transmit music, especially popular song ranking programs. Popularity ranking program is a program that ranks each popular song, for example, by counting and converting the record sales, broadcasts, MP3 file sales, etc., for a specified period of time, and the viewers rank the songs of interest. You can see and listen to the music while listening to the music can be provided services.

However, such a ranking program has a problem that it is difficult to induce the participation of viewers or fans who like the singer due to the limitation of TV broadcasting that provides one-way service. Of course, it is possible to allow viewers to participate in ranking through a voting method through an automatic answering phone, but it is difficult to induce active participation of viewers because it is only a simple voting, and also has a disadvantage of being inferior.

The modern society is developing into a society in which the distribution of various digital contents related to multimedia and entertainment is gradually increasing. Especially, as young people want more diverse and new contents, the popular popularity ranking program is not simply viewed or voted. It is expected that the desire for contents that can be felt as actively participating in them will intensify.

The present invention has been made in order to solve the above-described needs, a music recognition system that can calculate the score by comparing the original song when the user of the mobile communication terminal user desired song, and transmits the calculation result to the TV receiver and display The technical challenge is to provide a method.

Another technical problem of the present invention is to reflect the music recognition result of the mobile communication terminal user in the ranking of the flexible ranking program, so that user participation can be induced.

Music recognition system of the present invention for achieving the above-described technical problem receives a voice signal containing a melody transmitted from the communication terminal to extract and analyze features, compare this with the original song and score according to the similarity, And transmit the determined score information to the broadcasting station server for display.

According to another aspect of the present invention, there is provided a music recognition method, comprising: a first step of transmitting a announcement including a service usage method and a selectable music list as the communication terminal is connected; A second step of reproducing accompaniment data of music selected from the music list and storing voice signals transmitted from the communication terminal for each communication terminal as a key for completing selection is input from the communication terminal; A third step of extracting and analyzing a feature from each voice signal stored for each communication terminal; A fourth step of analyzing the similarity between the result of the third step and the original music; A fifth step of setting a score according to the result of the fourth step; And a sixth step of generating a message-setting score for each communication terminal as a message and controlling the score setting result to be transmitted to the broadcasting station server for display.

In addition, the music recognition method according to another embodiment of the present invention comprises a first step of receiving and storing the basic score information for each music item from the broadcasting station server; A second step of transmitting a announcement including a service usage method and a selectable music list as the communication terminal connects; A third step of reproducing accompaniment data of music selected from the music list and storing a voice signal transmitted from the communication terminal for each communication terminal as a key for completing selection is input from the communication terminal; A fourth step of extracting and analyzing a feature from each voice signal stored for each communication terminal; A fifth step of analyzing the similarity between the result of the third step and the original music; A sixth step of setting a score according to the result of the fourth step; A seventh step of updating the total score information for each music item by adding a score determined for each communication terminal to a basic score of the corresponding music item; And an eighth step of generating the updated score information and the score information for each communication terminal as a message and transmitting the message to the broadcasting station server.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

1 is an exemplary diagram of a communication network to which the present invention is applied.

Music recognition system 10 according to the present invention is connected to the mobile communication terminal 30 through the mobile communication network 20 receives a voice signal containing a melody transmitted from the mobile communication terminal 30 to extract and analyze features The score is then compared with the original song based on the similarity.

In addition, the music recognition system 10 is connected to the broadcasting station server 40, and transmits the user-specific score information according to the voice recognition result including the melody transmitted from the user of the mobile communication terminal 30 to the broadcasting station server 40 The broadcasting station server 40 synthesizes the score information for each user with an image signal and transmits the caption information so that the score information for each user is displayed on the TV receiver 50 together with the image.

It is preferable to perform the score setting by the music recognition and the score information display process through the broadcasting station server 40 during a specific TV program (eg, popular ranking program) transmission time. To this end, the program is sent out and the access information to the music recognition system 10 is notified with subtitles, or the age of the mobile communication service subscriber is referred to the music recognition system 10 by referring to the mobile communication service subscriber. Involvement can be induced by sending a callback URL address that can be accessed to the mobile communication terminal.

In addition, the basic score information for determining the song rank from the broadcasting station server 40 to the music recognition system 10 before transmitting the program (scores set regardless of the viewer's participation in broadcasting, for example, a record for a specified period of time). If the score is set according to the sales amount, the amount of broadcasts, etc.), the music recognition system 10 by the music recognition system for the voice signal including the melody transmitted from the mobile communication terminal 10 for each music The sum can be reflected in the ranking of the music.

Here, the music recognition system 10 may extract a musical feature using a method as described, for example, in Korean Laid-Open Publication No. 2004-0072486, but is not limited thereto. Of course, any possible method of producing sheet music can be applied.

In addition, although FIG. 1 only describes a user connecting to the music recognition system 10 through the mobile communication network 20, it is also possible to connect through a public telephone network.

FIG. 2 is a detailed configuration diagram of the music recognition system shown in FIG. 1.

The music recognition system 10 according to the present invention is connected to the music recognition system 10 by a user through a communication terminal such as a control unit 110, a database 120, and a mobile communication terminal 30 for controlling the overall operation. Providing announcements for using the service, if the user selects the desired music, the accompaniment for the music is provided, and the voice signal transmitted from the user's communication terminal after the accompaniment is transmitted to the music title and user identification number (for example, ARS server 130 for storing in the user music database 123 for each access telephone number), framing the user voice signal stored in the ARS server 130, effective sound section classification, pitch extraction, smoothing, melody / beat determination The user's voice signal and music database extracted and analyzed by the music feature extraction unit 140 and the music feature extraction unit 140 that extract and analyze the musical features through the process. Comparing and score conversion unit 150 for comparing the original music of the music stored in the 122, the score is set according to the similarity and the score set by the music title and user identification number in the scorecard database 124 ), A message conversion unit 160 for generating a score conversion result for each user as a message and transmitting the same to a broadcasting station server 40 and connected to a mobile communication network, a public telephone network, an internet network, a broadcasting network, and performs a protocol conversion for data transmission and reception. Interface 170.

In addition, the message generating unit 160 according to the present invention may further include a message for transmitting the access information to the music recognition system 10 to the communication terminal, and for notifying the communication terminal of the user of the score conversion result by the music recognition. And a function of generating at least one of a message for notifying the fact that the highest score has been obtained to the communication terminal of the user who has obtained the highest score with reference to the score table DB 124 accumulated and stored for a specified time.

A detailed operation of the music recognition system 10 having such a configuration will be described below with reference to FIGS. 3 and 4.

3 is a flowchart illustrating a music recognition method according to an embodiment of the present invention. The present embodiment illustrates a music recognition method for transmitting a scoring result of a music recognition apparatus through a broadcasting network regardless of the broadcast time of a TV broadcast program.

Referring to the drawings, as the user connects to the music recognition system S101 through the communication terminal, the ARS server 130 sends a message (service use method, selectable music list, etc.) to use the service to the communication terminal. It is provided (S103). Subsequently, when a key for completing selection is input from the communication terminal (S105), the ARS server 130 retrieves the accompaniment data of the music selected by the user from the music DB 122, plays back the retrieved accompaniment data, and sends it to the communication terminal. Accordingly, a voice recognition process of storing the voice signal transmitted from the communication terminal in the user music DB 123 is performed (S107). Here, when storing the voice signal, the access communication terminal number, the selected music title, and the like are stored together.

Thereafter, the music feature extractor 140 extracts and analyzes a musical feature through a framing, effective sound section classification, pitch extraction, smoothing, and melody / beat determination process for the user's voice signal stored in the user music DB 123. (S109). In addition, the comparison and score converting unit 150 analyzes the original song of the corresponding music in the music DB 122 and compares the result with the feature extraction and analysis result (S111), and sets a score according to the result of the similarity analysis ( S113).

Subsequently, as the message generating unit 160 generates a score conversion result for each user as a message (S115), the controller 110 transmits the determined score information to the broadcasting station server 40 together with the user identification number and the music title. (S117), the broadcasting station server 40 synthesizes a subtitle including the user identification number / music title / score to the video signal currently being transmitted (S119) and transmits it to the air (S121).

By doing so, the score information of the song sung by the user is displayed on the TV set, and the user can feel his interest by checking his song ability through TV subtitles, and can try more participation.

In addition, after the message generating unit 160 of the music recognition system 10 transmits the score information for each user to the broadcasting station server 40, the message generating unit 160 accesses the music recognition system 10 and performs singing to each user. The score information may be generated and transmitted as a message, or after accumulating and storing the score information for each user for a predetermined time period, the message may be generated and transmitted to the communication terminal of the user who has obtained the highest score. .

In addition, in order to perform the step S101, the message generating unit 160 may create a message including the callback URL to the music recognition system 10 and transmit it to the communication terminal.

4 is a flowchart illustrating a music recognition method according to another embodiment of the present invention. This embodiment shows a music recognition method for reflecting the score information obtained by the user for each song when determining the rank for each song in the popular song ranking program transmitted by the broadcasting station.

To this end, the broadcast station server 40 transmits the basic score information for each song to the music recognition system 201 (S201), and the music recognition system 10 stores it in the scorecard DB 124.

In this state, when the user connects to the music recognition system 10 by using the communication terminal (S203), the ARS server 130 transmits a guide (service use method, selectable music list, etc.) for service use. (S205). In this case, the announcement may include a list of selectable music titles, and the selectable music may be set to a music list provided by the broadcasting station server 40 to the music recognition system 10 by providing a basic score.

Subsequently, when a key for completing selection is input from the communication terminal (S207), the ARS server 130 extracts and plays back accompaniment data from the music DB 122, and the voice signal input from the communication terminal is reproduced from the user music DB 123. In step S209, a music recognition process is performed.

When the user's singing is completed, the music feature extraction unit 140 of the music recognition system 10 performs framing, effective sound section division, pitch extraction, smoothing, and the like on the user's voice signal stored in the user music DB 123. Musical features are extracted and analyzed through the melody / beat determination process (S211).

In addition, the comparison and score converting unit 150 analyzes the original music of the corresponding music in the music DB 122 and compares the result with the feature extraction and analysis result (S213), and sets a score according to the result of the similarity analysis ( S215). Subsequently, the comparison and score converting unit 150 updates the total score by adding the score obtained by the user singing a song to the basic score previously stored for each song (S217).

Thereafter, as the message generating unit 160 generates the updated score information for each song and the score information for each user as a message (S219), the controller 110 stores the updated score information and the score information for the user as a user identification number, It transmits to the broadcasting station server 40 together with the music title (S221). The broadcast station server 40 which receives this stores the updated score information for each song (S223), and synthesizes a subtitle including the user identification number / music title / score to the video signal being transmitted (S225). It is sent to the air (S227).

In the present embodiment, the step (S217) of updating the total score from the connection (S203) step of the communication terminal is preferably performed for a specified time, preferably during the time that the TV program is sent, the user-specific score information message And the step after generating the updated score information message (S219) is preferably performed every designated period during the time that the TV program is transmitted.

In the present embodiment, the message generating unit 160, after transmitting the user-specific score information and updated score information to the broadcasting station server 40, to each user who connected to the music recognition system 10 and performed a song Each score information may be generated and transmitted as a message, or the score information for each user may be accumulated and stored for a specified time, and then a message may be generated and transmitted to the communication terminal of the user who has obtained the highest score. have.

In addition, in order to perform the step S203, the message generating unit 160 may create a message including the callback URL to the music recognition system 10 and transmit it to the communication terminal.

As such, those skilled in the art will appreciate that the present invention can be implemented in other specific forms without changing the technical spirit or essential features thereof. Therefore, the above-described embodiments are to be understood as illustrative in all respects and not as restrictive. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

According to the present invention, the user's singing results are converted into scores and displayed on the TV set, and the user's active broadcast participation can be induced by reflecting the user's score information in the ranking of the flexible ranking program. In addition, it is possible to increase the rate of use of the communication terminal can be expected to generate revenue from the network operators.

Claims (16)

A music recognition system connected with a communication terminal through a communication network and connected with a broadcasting station server, The music recognition system receives a voice signal including a melody transmitted from the communication terminal, extracts and analyzes a feature, compares it with an original song, sets a score according to the similarity, and sets the score information based on the determined score information. Music recognition system, characterized in that for controlling to transmit to display. The method of claim 1, The music recognition system receives and stores basic score information for each music item from the broadcasting station server, and adds a score set from a voice signal including a melody transmitted from the communication terminal to the basic score for each music item. Music recognition system. The method according to claim 1 or 2, The music recognition system provides a guide for using the service as the communication terminal accesses, and when a key for completing selection is input from the communication terminal, the music recognition system plays back and plays the accompaniment for the corresponding music, and the user's communication after the accompaniment transmission. An ARS server for storing a voice signal transmitted from the terminal in a database for each music title and user identification number; A music feature extraction unit for extracting and analyzing musical features from a user voice signal stored in the ARS server; Comparison and score conversion for storing the user's score information set by the music title and the user identification number in the database after comparing the original songs of the music corresponding to the user extracted and analyzed by the music feature extraction unit, scored according to the similarity part; And A message generator for generating the score setting result of the comparison and score converting unit as a message and transmitting the message to the broadcasting station server; Music recognition system comprising a. The method of claim 3, wherein And the message generating unit generates a message including music recognition system access information for transmitting to the communication terminal. The method of claim 3, wherein And the message generator generates a message including the score information for each user. The method of claim 3, wherein The message generating unit generates a message for notifying the fact that the highest score has been obtained to the communication terminal of the user who has obtained the highest score among accumulated stored score information for a predetermined time with reference to the database. A music recognition method in a music recognition system connected to a communication terminal via a communication network and connected to a broadcasting station server, A first step of transmitting a announcement including a service usage method and a selectable music list as the communication terminal connects; A second step of reproducing accompaniment data of music selected from the music list and storing voice signals transmitted from the communication terminal for each communication terminal as a key for completing selection is input from the communication terminal; A third step of extracting and analyzing a feature from each voice signal stored for each communication terminal; A fourth step of analyzing the similarity between the result of the third step and the original music; A fifth step of setting a score according to the result of the fourth step; And Generating a score setting result for each communication terminal as a message and transmitting the message to the broadcasting station server for display; Music recognition method comprising a. The method of claim 7, wherein The second step is a step of storing the number information and the selected music title of the communication terminal along with the voice signal transmitted from the communication terminal. The method according to claim 7 or 8, And after the sixth step, further comprising a seventh step of generating score information for each communication terminal as a message and transmitting the message to the communication terminal. The method according to claim 7 or 8, And after the sixth step, an eighth step of transmitting a message indicating that the highest score has been obtained to the communication terminal having obtained the highest score by referring to the score information for each communication terminal accumulated and stored for a specified time. How to recognize music. The method according to claim 7 or 8, Before performing the first step, generating a message including access information to the music recognition system and transmitting the message to a plurality of communication terminals. A music recognition method in a music recognition system connected to a communication terminal via a communication network and connected to a broadcasting station server, A first step of receiving and storing basic score information for each music item from the broadcasting station server; A second step of transmitting a announcement including a service usage method and a selectable music list as the communication terminal connects; A third step of reproducing accompaniment data of music selected from the music list and storing a voice signal transmitted from the communication terminal for each communication terminal as a key for completing selection is input from the communication terminal; A fourth step of extracting and analyzing a feature from each voice signal stored for each communication terminal; A fifth step of analyzing the similarity between the result of the third step and the original music; A sixth step of setting a score according to the result of the fourth step; A seventh step of updating the total score information for each music item by adding a score determined for each communication terminal to a basic score of the corresponding music item; And An eighth step of generating the updated score information and the score information for each communication terminal as a message and transmitting the message to the broadcasting station server; Music recognition method comprising a. The method of claim 12, And the third step is a step of storing the number information of the communication terminal and the selected music title together with the voice signal transmitted from the communication terminal. The method according to claim 12 or 13, And after the eighth step, further comprising a ninth step of generating score information for each communication terminal as a message and transmitting the message to the communication terminal. The method according to claim 12 or 13, And further comprising a tenth step of transmitting a message indicating that the highest score has been obtained to the communication terminal having obtained the highest score by referring to the score information for each communication terminal accumulated and stored for a specified time after the eighth step. How to recognize music. The method according to claim 12 or 13, And before generating the second step, generating a message including the access information to the music recognition system and transmitting the message to a plurality of communication terminals.

Images