JP6501344B2 - Karaoke scoring system considering listener's evaluation - Google Patents

Description

  The present invention relates to a karaoke scoring system, and more particularly, to a karaoke scoring system capable of appropriately reflecting a listener's evaluation in addition to singing scoring using singing scoring reference data as a scoring standard. is there.

  The song scoring in the karaoke performance apparatus is performed by extracting pitch data, volume data, and rhythm from the singing voice input from the microphone, and comparing the extracted singing voice data with singing scoring reference data including the main melody of the musical performance, etc. Then, based on the score which is the comparison result, it is judged whether the singing ability of the singer and the other singers is superior or inferior.

  However, according to such a conventional song scoring method, a singer who can perform singing close to the singing score reference data as a scoring standard can naturally obtain a high score. However, for example, listeners other than the singer may actually feel less well than the calculated score, but may feel better than the calculated score. That is, there are cases where the scoring result using the singing scoring reference data as the scoring standard and the skill of the singing that the listener actually feels are different.

  Various proposals have been made for such problems. For example, Patent Document 1 discloses a technique that allows a listener to evaluate singing by a singer by inputting a singing evaluation point to the karaoke remote control device. Further, in Patent Document 2, when reserving a music, the music ID of the singing music and the terminal ID of the reserved portable terminal are associated with each other and registered in the reservation queue, thereby being linked to the musical performance. There is disclosed a technique for transmitting marking input permission information to a portable terminal other than a portable terminal, that is, a portable terminal owned by an attendant, not owned by a singer.

  In addition, although it is not a technical field related to a karaoke performance apparatus, Patent Document 3 uses a camera or a microphone installed in a concert hall to clap a listener, clapping hands, claps, etc., the speed of operation at that time, voice There is disclosed a technique of detecting the degree of excitement, concentration, degree of excitement, etc. of a listener by analyzing the size of the speaker, and controlling the illumination etc. of the electronic musical instrument being played and the concert hall.

JP-A-8-115091 JP, 2009-288684, A JP-A-4-174696

  However, the techniques disclosed in Patent Document 1 and Patent Document 2 are for the listener to input the evaluation value when the singer finishes singing the music, so the listener actually sings the singer It is not possible for the listener to properly reflect the section that has been listened to and the section that has not been developed or was not interesting as a listener's singing evaluation.

  In addition, it is also conceivable to perform singing scoring in response to the excitement of listeners other than the singer using the technology disclosed in Patent Document 3. However, in a karaoke system in which various pieces of music are sung, since the section to which the music rises depends on the music, as in the technology described in Patent Document 3, the degree of excitement of the listener from the video and audio simply input from the camera or microphone Etc. are detected and reflected as a song evaluation, it is judged that the listener is excited even if the listener happens to be loud or the singer provokes a provocative pose, which is different from the reality There is a disadvantage that high singing score is calculated.

  The present invention has been proposed in view of the above-mentioned circumstances, and provides a karaoke scoring system capable of appropriately reflecting the listener's evaluation in addition to singing scoring using song scoring reference data as a scoring standard. The purpose is to

  The karaoke scoring system (hereinafter abbreviated as a karaoke scoring system) in consideration of the listener evaluation according to the present invention has the following features in order to achieve the above-mentioned purpose. That is, the karaoke scoring system according to the present invention is a karaoke scoring system capable of performing song scoring by appropriately reflecting the listener's evaluation, which is characterized by a singer microphone, motion detection means, listener evaluation Reference data, song scoring reference data, and song scoring means are provided.

The singer microphone is a device for outputting a singing voice signal based on the input of the singing voice. The motion detection means is a means for detecting a listener's motion. The listener evaluation reference data is data defining an evaluation of a listener's reaction for each performance section for each karaoke piece . The singing scoring reference data is data including at least main melody data for each karaoke song.

The song scoring means calculates a singing score value by comparing a singing voice signal output from the singer microphone with the singing score reference data of the karaoke song upon performance of an arbitrary karaoke song, and also detects the detected listening The evaluation value of the listener is calculated by comparing the action of the person with the listener evaluation reference data of the karaoke music, and the singing score is scored based on the passing score determined for the karaoke music and the evaluation value of the listener. It is a means to calculate the correction ratio with respect to a value, correct the singing score value by the said correction ratio, and calculate a synthetic singing score value.

  Further, in addition to the above-described configuration, the listener evaluation reference data can perform weighting for operation for each performance section.

  Further, in addition to the configuration described above, the motion detection means can be configured by at least one of a camera, a microphone for a listener, and a biological sensor.

  In the karaoke scoring system according to the present invention, the listener does not perform song evaluation using the karaoke remote control device or the portable terminal after the singer finishes singing, as in the prior art, but the listener's reaction for each section of karaoke music Analyze and assess listeners' excitement. For this reason, it is possible to reflect in the song evaluation the fact that the listener listened to the singer's song and the fact that the listener did not swell up.

  In addition, as with conventional singing scoring, not only evaluation by comparison of singing reference data and singing voice signal, but also reaction of listeners can be included to perform singing evaluation and calculate general singing score value, so listening It is possible to conduct an appropriate evaluation that reflects the evaluation of the

BRIEF DESCRIPTION OF THE DRAWINGS The block diagram which shows schematic structure of the karaoke scoring system which concerns on embodiment of this invention. Explanatory drawing which shows an example of the performance area data of a karaoke music. Explanatory drawing which shows an example of listener evaluation reference data. Explanatory drawing which shows the other example of listener evaluation reference data. Explanatory drawing which shows the evaluation criteria of evaluation item. Explanatory drawing which shows the relationship between the detection result of an operation | movement detection means, and evaluation value. Explanatory drawing which shows a song scoring method.

  Hereinafter, with reference to the drawings, an embodiment of a karaoke scoring system according to the present invention will be described. 1 to 7 illustrate a karaoke scoring system according to an embodiment of the present invention. FIG. 1 is a block diagram showing a schematic configuration of the karaoke scoring system, and FIG. 2 is an illustration showing one example of performance section data of karaoke music. 3 and 4 are explanatory views showing listener evaluation reference data, FIG. 5 is an explanatory view showing evaluation criteria of evaluation items, and FIG. 6 is an explanatory view showing a relationship between detection results of motion detecting means and evaluation values. FIG. 7 is an explanatory view showing a singing scoring method.

<Outline of karaoke scoring system>
The karaoke scoring system 100 according to the embodiment of the present invention is a system capable of appropriately reflecting the listener's evaluation in addition to the singing scoring using the singing scoring reference data, as shown in FIG. This system is applied to the karaoke performance apparatus 10. The karaoke scoring system 100 includes a listener microphone 14 functioning as motion detecting means, a living body sensor 15, a camera 16, and a singing scoring means 27. In the singing scoring means 27, singing score reference data and a listener Based on the evaluation reference data, an overall singing score value is calculated.

  In this embodiment, various data such as song scoring reference data and listener evaluation reference data are stored in the karaoke performance apparatus 10, but these data are stored in a server (not shown), and the router and data communication circuit The functions of the present invention may be exhibited by transmitting and receiving data between the karaoke performance apparatus 10 and the server via In addition, when the server is provided, personal information of the user, singing history and the like can be comprehensively managed.

  In the following description, a program is stored in a RAM or the like and executed by hardware such as a CPU, whereby not only software that exerts that function but also logic circuits capable of exerting an equivalent function It is an included concept.

<Karaoke performance device>
As shown in FIG. 1, the karaoke performance apparatus 10 to which the karaoke scoring system 100 according to the embodiment of the present invention is applied includes a karaoke body 11, a karaoke remote control device 12, a singer microphone 13, a listener microphone 14, and a living body sensor A camera 16, a display device 17, a mixing amplifier 18 and a speaker 19 are provided. The listener microphone 14, the living body sensor 15, and the camera 16 are devices functioning as motion detection means, and all of these devices may be provided, but any one or more devices constitute the motion detection means. You may

<Karaoke remote control device>
The karaoke remote control device 12 has a user interface function, and transmits and receives data to and from the karaoke body 11 through the router 40 and the data communication line 50. Data is transmitted and received between the karaoke remote control device 12 and the router 40 by wireless communication such as infrared communication. The karaoke remote control device 12 includes a program functioning as a music search means 12a, a music index database 12b, a data storage unit 12c for storing various data, and an input / output display unit 12d for inputting / outputting data. There is.

  Necessary controls for karaoke performance such as login operation, music selection operation, performance control operation, etc. are executed by operating switches attached to the karaoke remote control device 12 and various icons displayed on the input / output display unit 12d. Be done. The operations performed using the karaoke remote control device 12 are not limited to these, and various operations in the karaoke performance device 10 can be performed.

<Music search means / Music index database>
The music search means 12a is a program for searching for music by referring to the music index database 12b based on the user's instruction. The music index database 12b is a database describing attribute information of the karaoke music provided for the performance by the karaoke performance apparatus 10. For example, the music number, the song name, the artist name, the lyrics of the singing part, the popular season, the music Various attribute information such as genre / duet song is included in this. The music search means 12a searches for music by referring to the music index database 12b based on an instruction input by the user.

<Speaker Microphone / Speaker>
The singer microphone 13 is a device for outputting a singing voice signal based on the input of the singing voice. The singing voice input from the singer microphone 13 is output as a singing voice signal, mixed and amplified by the mixing amplifier 18 with the karaoke performance signal sent from the music reproduction control means 30, and output to the speaker 19 . The voice input signal from the singer microphone 13 is converted into a digital signal by the A / D converter 31 and is used to generate a score in the song scoring means 27 or the like.

<Microphone for listeners>
The listener microphone 14 is a device for outputting a listener voice signal based on the input of cheers and cheers of the listener. The cheers and cheers input from the listener microphone 14 are output as a listener voice signal and transmitted to the listener operation data reception means 28 of the karaoke body 11 by wireless communication or wire communication. The listener microphone 14 is installed, for example, on the ceiling or upper wall surface of the karaoke room, and it is desirable that the microphone 14 be fixed toward a passenger seat or the like on which the listener is sitting if it is a directional microphone.

<Biometric sensor>
The living body sensor 15 uses a wristwatch-type sensor worn on the listener's body, a thermography capable of acquiring information from the listener without contact, and the like. It is an apparatus for acquiring various data related to a listener's motion, such as gravity acceleration (body movement), in real time. The data acquired by the biometric sensor 15 is transmitted to the listener operation data receiving means 28 of the karaoke body 11 by wireless communication or wired communication.

<Camera>
The camera 16 is a device for capturing a motion of a listener, and can be configured by, for example, a video camera. The video signal output from the camera 16 is transmitted to the listener operation data receiving means 28 of the karaoke body 11 by wireless communication or wire communication. In addition, since the camera 16 is a device for capturing a video for analysis such as detection of the motion of the listener, the imaging direction is fixed and the focal length is adjusted so that the entire listener area can be captured and captured. It is preferable that it is a fixed focus type which does not perform.

<Display device>
The display device 17 is a device for displaying a background image, a lyrics telop, a song scoring result and the like related to the karaoke music, and is constituted by, for example, a liquid crystal display or the like.

<Karaoke body>
The karaoke body 11 includes a central control means 21, a ROM 22, a RAM 23, an HDD 24, a transmission / reception control means 25, a reserved music management means 26, a song scoring means 27, a listener operation data receiving means 28, a video reproduction control means 29, a music reproduction control means 30, an A / D converter 31 is provided.

<Central control means>
The central control means 21 is an electronic device for comprehensively controlling the karaoke body 11, and is constituted of, for example, a CPU and its peripheral devices, and the CPU etc. operate according to a program stored in the ROM 22 etc. The control function can be demonstrated.

<ROM / RAM>
The ROM 22 is an electronic device for storing program data and numerical data for controlling the respective devices constituting the karaoke body 11, and is constituted by, for example, a semiconductor memory or the like. The RAM 23 is an electronic device that functions as a temporary storage area for temporarily storing programs and various data, and is formed of, for example, a semiconductor memory or the like. In the present embodiment, the reserved music management table 23a is stored in the RAM 23.

<HDD>
The HDD 24 is an electronic device that functions as a large-capacity storage device, and stores a music database 24a, a background video database 24b, a listener evaluation reference database 24c, and a singing scoring reference database 24d. In place of the HDD 24 or together with the HDD 24, a mass storage means such as a DVD or an SSD capable of rewriting data may be used.

<Music database / Background video database>
The music database 24a is a database in which music data configured by synchronizing performance control data (data of MIDI standard) and lyric depiction data is configured in association with a music ID. The performance control data is digital data for controlling the performance of each music, and the lyric rendering data includes display timing data and color change data of lyric characters synchronized with the performance. The background video database 24 b is a database in which a predetermined number of background videos corresponding to the karaoke music to be played are stored as background video files corresponding to the music IDs of the karaoke music.

  Each piece of music data that constitutes the music database 24a includes performance zone data representing a performance zone. As shown in FIG. 2, the performance section data represents a tune that changes as the performance progresses, and includes A melody, B melody, rust, interlude, last, and the like. In the example shown in FIG. 2, only the performance section having a relationship with the listener evaluation reference data is described, but there is a prelude etc. as another performance section.

<Hearer evaluation reference database>
The listener evaluation reference database 24c is a database configured by listener evaluation reference data of each karaoke piece. The listener evaluation reference data constituting the listener evaluation reference database 24c is data defining an evaluation of a listener's reaction for each performance section of each karaoke piece. That is, the listener evaluation reference data is data serving as a reference for evaluation by the listener, and a listener who is detected by the operation detection unit (the listener microphone 14, the living body sensor 15, the camera 16) by the function of the song scoring unit 27 The evaluation value of the listener is calculated by comparing the operation of and the listener evaluation reference data of the karaoke piece.

  The listener evaluation reference data, as shown in FIG. 3, is data defining an evaluation item (a listener's reaction) for a performance section for each karaoke song. Evaluation items are, for example, cheering, concentration, excitement, applause, etc., and the size, sound quality, movement, etc. of the listener's voice inputted by the listener microphone 14 or the camera 16, the living body sensor 15, etc. The listener's heart rate, body temperature, blood pressure, etc. are detected by using, and each item is judged according to the evaluation criteria of FIG. In addition, about determination of each evaluation item, you may determine by five-step evaluation etc., and you may use the different determination method for every item.

  As shown in FIG. 5, the cheering is evaluated when the input value of the listener microphone 14 exceeds a specified value. The degree of concentration is to be evaluated when the listener's movement matches or there is no useless operation. The degree of excitement is evaluated when the movement of the listener and the input value of the listener microphone 14 exceed the specified value, or when the average temperature of the listener detected by the biological sensor 15 rises. The applause detects the listener's applause sound, and when the input value of the listener microphone 14 exceeds a specified value, it is an evaluation target. In addition, when evaluating each evaluation item, users other than the singer who is currently logged in may be the number of listeners, and each evaluation item may be evaluated in consideration of the number of listeners.

  The evaluation items in each performance section shown in FIG. 3 are an example of karaoke music gradually rising from A melody. For the first A melody, the cheering and the degree of concentration are evaluated, and the next B melody is evaluated. On the other hand, the degree of concentration is evaluated before the rust, the degree of concentration and excitement are evaluated in the rust, and the applause, cheering and excitement are evaluated in the interlude. The evaluation items may be similarly set according to the tune of the karaoke music for the other performance sections.

  Furthermore, the evaluation items may be weighted according to the type of the playing section. For example, the listener evaluation reference data shown in FIG. 4 is set to give an evaluation score only to the degree of concentration and the degree of excitement in the performance section of the chorus and to be larger than the evaluation items of the other performance sections and make listening carefully. In the performance section, a score may be given only to the degree of concentration, and when the cheering or the degree of excitement is detected, the score may not be evaluated as noise or may be set to be deducted. Further, although only the performance section of the chorus is shown in FIG. 6, weighting may be set so that the evaluation score for the degree of concentration and the degree of excitement is larger than that of the other evaluation items.

  The listener evaluation reference data may not be created for each karaoke piece, but the performance zone and the evaluation item may be associated with each other to create listener evaluation reference data common to the pieces of music.

<Song scoring reference database>
The singing scoring reference database 24d is a database configured by singing scoring reference data of each karaoke piece. The song scoring reference data that constitutes the song scoring reference database 24 d is data including at least main melody data of karaoke songs. The singing scoring reference data is data serving as basic data for singing scoring, and the singing voice signal output from the singer microphone 13 is converted into digital form by the A / D converter 31 by the function of the singing scoring means 27. The singing voice signal and the singing scoring reference data are compared to calculate a singing scoring value.

<Transmission control means>
The transmission / reception control means 25 comprises an electronic device and a program for controlling transmission and reception of data and signals with the karaoke remote controller 12 and a server (not shown). The function of the transmission / reception control means 25 performs synchronization, error control, etc. of data and signals transmitted / received to / from the karaoke remote controller 12 or a server (not shown). Further, as a function of the transmission / reception control means 25, transmission / reception control of data in login operation can be performed.

  The log-in operation is, for example, an operation for transmitting data (for example, identification information of the karaoke performance apparatus 10 or the portable information terminal) for system login using a portable information terminal owned by the user to the server. The server that has received the data for logging in to the system transmits the user ID or the like of the user to the corresponding karaoke performance device 10. Note that the login operation is not limited to such an aspect, and may be any aspect as long as it is an operation for specifying a user who has logged in to the system and acquiring a user ID, for example, karaoke The remote control device 12 may be used to perform a login operation.

<Reserved music management means / Reserved music management table>
The reserved music management means 26 associates the user ID of the user with the music ID of the reserved music and manages the reserved music management table 23a when any user reserves a karaoke music. The program consists of That is, the reserved music management means 26 creates a reserved music management table 23a, and stores and manages this reserved music management table 23a in the RAM 23. The reserved music management table 23a is a data table created by arranging music IDs selected by the user using the function of the music search means 12a in the order of performance.

<Listener operation data receiving means>
The listener operation data receiving unit 28 includes an interface for receiving an operation signal from the listener microphone 14 functioning as an operation detecting unit, the living body sensor 15, and the camera 16. In the example shown in FIG. 1, while the listener operation data receiving means 28 receives the operation signals from the listener microphone 14, the living body sensor 15, and the camera 16, the data is received by the separate data receiving means You may configure it. Although transmission and reception of the operation signal may be performed by wireless communication or wired communication, it is preferable that communication with the biological sensor 15 be wireless communication in particular.

<Song scoring means>
The song scoring means 27 basically comprises a program for evaluating the skill of singing from the singing voice input at the time of karaoke performance and generating a scoring value (scoring data), and in the present invention, singing scoring is instructed When playing a karaoke piece, karaoke voice data such as pitch data and volume data is extracted from the singing voice signal input from the singing microphone 13 at every minute interval of, for example, 15 msec. The song score value is calculated by comparing the singing score reference data consisting of the main melody of the music with the extracted singing voice data, and the detected listener's action and the listener evaluation reference data of the karaoke song Compare and calculate the listener's evaluation value and calculate the overall singing score based on the singing score and the evaluation value You have me.

  That is, the singing scoring means 27 evaluates the skill of singing by comparing the singing scoring reference data and the singing voice for each predetermined singing section, and further, the listener evaluation reference data and the listener's action for the predetermined playing section The evaluation of the listener is taken into consideration by comparing each time, and comprehensive song scoring result data is output. The scoring result by the singing scoring means 27 is displayed on the display screen of the display device 17 or the input / output display unit 12d of the karaoke remote control device 12 as a comprehensive singing scoring result.

  For example, with the listener's evaluation, as shown in FIG. 7, the sum of the evaluation values of the actual listeners in each performance section (in this embodiment, 736 points and a full score of 800 points make the passing score 720 points) , From the singing score value, calculate a comprehensive singing score value. In this embodiment, 92.0 points are calculated as an overall song scoring value by multiplying the song scoring value of 90 points by 736/720 = 1.022 which is the listener's evaluation. That is, when the listener's reaction is taken into consideration, the overall singing score becomes high (because the reaction is good) as compared with the simple singing score. On the contrary, if the total of the listener's evaluation value is below the passing score of 720 points, the overall singing score becomes low.

  The evaluation based on the listener's action, the song scoring result based on the comparison with the song reference data, the overall song scoring result is displayed, for example, for each performance section, and the average value in all the performance sections is displayed after the performance is finished Do. In addition, the evaluation based on the listener's action and the display of the singing score result based on the comparison with the singing reference data may be omitted, and only the overall singing score result may be displayed, or the display for each performance section is omitted. Then, each evaluation may be displayed after the end of the performance.

  The song scoring in the song scoring means 27 may be performed only when the user performs a song scoring instruction input using the input / output display unit 12d of the karaoke remote control device 12, or the song scoring reference data or the listener Only the karaoke music for which evaluation reference data is prepared may be performed. Although the instruction input for performing song scoring is performed, for example, at the time of music reservation, if it is until the start of the music of the performance, the instruction input for performing song scoring after the music selection reservation may be performed.

<Music playback control means>
The music reproduction control means 30 drives a sound source (synthesizer) based on the performance control data extracted from the music data corresponding to the music ID, generates a musical tone signal constituting the karaoke performance signal, and converts it into analog and mixes it. 18 is an electronic device for outputting. The mixing amplifier 18 mixes the singing voice signal of the singer input from the microphone 13 for the singer with the karaoke performance signal sent from the music reproduction control means 30 and amplifies it by the amplifier function to obtain the speaker 19. It is a device for more output.

<Video playback control means>
The video reproduction control means 29 performs, during the performance of the karaoke music, the background video data extracted from the background video database 24b and the lyric characters created on the basis of the lyric depiction data included in the music data, the music of the karaoke music. It is an electronic device for outputting to the display device 17 in synchronization with data.

DESCRIPTION OF SYMBOLS 100 karaoke scoring system 10 karaoke performance apparatus 11 karaoke main body 12 karaoke remote control apparatus 12a music search means 12b music index database 12c data storage part 12d input / output display part 13 microphone for singers 14 microphone for listeners (motion detection means)
15 biometric sensor (motion detection means)
16 Camera (motion detection means)
17 Display Device 18 Mixing Amplifier 19 Speaker 21 Central Control Means 22 ROM
23 RAM
23a Reserved music management table 24 HDD
24a music database 24b background image database 24c listener evaluation reference database 24d song scoring reference database 25 transmission / reception control unit 26 reserved song management unit 27 song scoring unit 28 listener operation data receiving unit 29 image playback control unit 30 music playback control unit 31 A / D converter 40 router 50 data communication line

Claims (3)

It is a karaoke scoring system capable of performing singing scoring appropriately reflecting listeners' evaluations,
A singer microphone that outputs a singing voice signal based on a singing voice input;
Motion detection means for detecting a listener's motion;
Listener evaluation reference data that defines the listener's reaction evaluation for each performance section for each karaoke song;
Sing scoring reference data including at least main melody data for each karaoke song;
When performing an arbitrary karaoke song, the singing voice signal output from the singer microphone is compared with the singing scoring reference data of the karaoke song to calculate a singing scoring value, and the detected listener's The evaluation value of the listener is calculated by comparing the operation and the listener evaluation reference data of the karaoke piece, and the song scoring is performed based on the passing score determined for the karaoke piece and the evaluation value of the listener. A singing scoring means for calculating a correction ratio to a value, and correcting the singing score value according to the correction ratio to calculate a general singing score value;
The karaoke scoring system which considered listener's evaluation characterized by having.   The karaoke scoring system according to claim 1, wherein the listener evaluation reference data performs operation weighting for each performance section.   The karaoke scoring system according to claim 1 or 2, wherein the motion detection means is at least one of a camera, a microphone for a listener, and a biological sensor.

Images