JP2016102961A - Karaoke rating system considering listener evaluation - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appropriately reflect evaluation of listeners in addition to a singing rating which uses singing rating reference data as a rating reference.SOLUTION: A karaoke rating system comprises: listener evaluation reference data which defines evaluation on listener response for each musical performance section of a karaoke music; and singing rating reference data which includes at least main melody data of each karaoke music. Singing rating means 27 compares, when any karaoke music is performed, a singing audio signal outputted from a singer microphone 13 with the singing rating reference data for the karaoke music to calculate singing rating value, compares an action of listeners detected by action detection means (for example, a listener microphone 14, a biological sensor 15, and a camera 16) with the listener evaluation reference data for the karaoke music to calculate a listener evaluation value, and calculates an overall singing rating value based on the singing rating value and the evaluation value.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a karaoke scoring system, and more particularly, to a karaoke scoring system capable of appropriately reflecting the evaluation of a listener in addition to singing scoring using singing scoring reference data as a scoring standard. is there.

  The singing score in the karaoke performance device means that the pitch data, volume data, and rhythm are extracted from the singing voice input from the microphone, and the extracted singing voice data is compared with the singing grading reference data composed of the main melody of the performance music. Then, the superiority or inferiority of the singing ability between the singer and the other singer is determined based on the score which is the comparison result.

  However, naturally, in such a conventional singing scoring method, a singer who can perform singing close to the singing scoring reference data serving as a scoring standard can obtain a high score. However, for example, listeners other than the singer may actually feel that they are not so good at the calculated score, but may feel that they are better than the calculated score. That is, the scoring result using the singing scoring reference data as the scoring standard may be different from the skill of the singing actually felt by the listener.

  Various proposals have been made for such problems. For example, Patent Literature 1 discloses a technique that allows a listener to evaluate a singer's singing by inputting a singing evaluation point to a karaoke remote control device. Further, in Patent Document 2, when reserving a music, the music ID of the song is associated with the performance ID by registering the reserved mobile terminal ID and registering it in the reservation queue. There is disclosed a technique for transmitting scoring input permission information to a portable terminal other than the portable terminal, that is, not owned by a singer but owned by the same person.

  Further, although not in the technical field related to karaoke performance devices, Patent Document 3 discloses that a camera and a microphone installed in a concert hall use a listener's applause, hand clapping, habit, etc. A technique is disclosed in which the degree of excitement, concentration, excitement, etc. of a listener is detected by analyzing the size of an electronic musical instrument, and the lighting of a playing electronic musical instrument or a concert hall is controlled.

JP-A-8-115091 JP 2009-288684 A JP-A-4-174696

  However, since the technique disclosed in Patent Document 1 and Patent Document 2 is for the listener to input the evaluation value when the singer finishes singing the song, the listener actually sings the singer. It is not possible to appropriately reflect a section that has been listened to, or a section that is not so much excited or interested in, for example, as a song evaluation by the listener.

  It is also conceivable to use a technique disclosed in Patent Document 3 to perform singing scoring according to the excitement of listeners other than the singer. However, in a karaoke system in which various musical pieces are sung, the excitement varies depending on the musical piece. Therefore, as in the technique described in Patent Document 3, the degree of excitement of the listener is simply determined from video and audio input from a camera or microphone. , Etc., and reflected as a singing evaluation, it is judged that the listener is excited even if the listener happens to be only noisy or the singer just takes a provocative pose. There is a drawback that a high singing score is calculated.

  The present invention has been proposed in view of the above-described circumstances, and provides a karaoke scoring system capable of appropriately reflecting the evaluation of the listener in addition to singing scoring using singing scoring reference data as a scoring standard. The purpose is to do.

  The karaoke scoring system considering the listener evaluation according to the present invention (hereinafter abbreviated as karaoke scoring system) has the following features in order to achieve the above-described object. That is, the karaoke scoring system according to the present invention is a karaoke scoring system that can appropriately reflect the listener's evaluation and can perform singing scoring, and includes a microphone for the singer, motion detection means, and listener evaluation. Reference data, singing scoring reference data, and singing scoring means are provided.

  The microphone for singers is a device for outputting a singing voice signal based on an input of singing voice. The motion detection means is means for detecting a listener's motion. The listener evaluation reference data is data defining an evaluation of the listener's reaction for each performance section of each karaoke piece. The singing score reference data is data including at least main melody data for each karaoke piece.

  The singing scoring means calculates a singing scoring value by comparing the singing voice signal output from the singer's microphone with the singing scoring reference data of the karaoke music piece when playing any karaoke music piece, Is a means for calculating the listener's evaluation value by comparing the listener's action and the listener evaluation reference data of the karaoke music piece, and calculating the total singing score value based on the singing score value and the evaluation value .

  In addition to the above-described configuration, the listener evaluation reference data can be weighted for each performance section.

  In addition to the above-described configuration, the motion detection means can be configured by at least one of a camera, a listener microphone, and a biological sensor.

  In the karaoke scoring system of the present invention, the listener does not perform singing evaluation using the karaoke remote control device or the portable terminal after the singing of the singer is finished as in the prior art, but the reaction of the listener for each section of the karaoke music And evaluate the audience's excitement. For this reason, it becomes possible to reflect in the singing evaluation the fact that the listener listened to the song of the singer and the fact that the listener did not swell.

  In addition, as in the conventional singing scoring, not only the evaluation by comparing the singing reference data and the singing voice signal, but also the singing evaluation with the reaction of the listener, the total singing scoring value can be calculated. It is possible to perform an appropriate evaluation that reflects the evaluation of the worker.

The block diagram which shows schematic structure of the karaoke scoring system which concerns on embodiment of this invention. Explanatory drawing which shows an example of the performance area data of karaoke music. Explanatory drawing which shows an example of listener evaluation reference data. Explanatory drawing which shows the other example of listener evaluation reference data. Explanatory drawing which shows the evaluation criteria of an evaluation item. Explanatory drawing which shows the relationship between the detection result of an operation | movement detection means, and an evaluation value. Explanatory drawing which shows the singing scoring method.

  Hereinafter, an embodiment of a karaoke scoring system of the present invention will be described with reference to the drawings. 1 to 7 illustrate a karaoke scoring system according to an embodiment of the present invention. FIG. 1 is a block diagram illustrating a schematic configuration of the karaoke scoring system. FIG. 2 illustrates an example of performance section data of karaoke music. FIG. 3, FIG. 3 and FIG. 4 are explanatory diagrams showing listener evaluation reference data, FIG. 5 is an explanatory diagram showing evaluation criteria for evaluation items, and FIG. 6 is an explanatory diagram showing the relationship between detection results of motion detection means and evaluation values, FIG. 7 is an explanatory diagram showing a singing scoring method.

<Outline of karaoke scoring system>
The karaoke scoring system 100 according to the embodiment of the present invention is a system capable of appropriately reflecting the evaluation of the listener in addition to the singing scoring using the singing scoring reference data, as shown in FIG. This is a system applied to the karaoke performance apparatus 10. The karaoke scoring system 100 includes a listener microphone 14 that functions as an operation detecting unit, a biosensor 15, a camera 16, and a singing scoring unit 27. The singing scoring unit 27 includes singing scoring reference data and a listener. Based on the evaluation reference data, an overall singing score value is calculated.

  In the present embodiment, various data such as singing scoring reference data and listener evaluation reference data are stored in the karaoke performance device 10, but these data are stored in a server (not shown), and the router and the data communication line. The function of the present invention may be exhibited by performing data transmission / reception between the karaoke performance device 10 and the server. Moreover, when a server is provided, the user's personal information, singing history, and the like can be comprehensively managed.

  In the following description, a program is stored in a RAM or the like and executed by hardware such as a CPU, so that not only software that exhibits its function but also a logic circuit that can exhibit an equivalent function. It is a concept that includes.

<Karaoke performance device>
A karaoke performance device 10 to which a karaoke scoring system 100 according to an embodiment of the present invention is applied includes a karaoke main body 11, a karaoke remote control device 12, a singer microphone 13, a listener microphone 14, and a biosensor as shown in FIG. 15, a camera 16, a display device 17, a mixing amplifier 18, and a speaker 19. The listener microphone 14, the biological sensor 15, and the camera 16 are devices that function as motion detection means, and may include all of these devices, but any one or more of the devices constitute the motion detection means. May be.

<Karaoke remote control device>
The karaoke remote control device 12 has a user interface function, and transmits / receives data to / from the karaoke main body 11 via the router 40 and the data communication line 50. Note that data transmission / reception is performed between the karaoke remote control device 12 and the router 40 by wireless communication such as infrared communication. The karaoke remote control device 12 includes a program functioning as a music search means 12a, a music index database 12b, a data storage unit 12c for storing various data, and an input / output display unit 12d for inputting / outputting data. Yes.

  Controls necessary for karaoke performance such as login operation, music selection operation, performance control operation, etc. are executed by operating switches attached to the karaoke remote control device 12 and various icons displayed on the input / output display section 12d. Is done. The operations performed using the karaoke remote control device 12 are not limited to these, and various operations in the karaoke performance device 10 can be performed.

<Music search means / music index database>
The music search means 12a includes a program for searching for music by referring to the music index database 12b based on a user instruction. The music index database 12b is a database in which attribute information of karaoke music used for performance by the karaoke performance device 10 is described. Various attribute information such as whether or not it is a genre duet song is included in this. The music search means 12a searches for music by referring to the music index database 12b based on an instruction input by the user.

<Singer's microphone / speaker>
The microphone 13 for singers is a device for outputting a singing voice signal based on the input of singing voice. The singing voice inputted from the singer's microphone 13 is outputted as a singing voice signal, mixed with the karaoke performance signal sent from the music reproduction control means 30 by the mixing amplifier 18, amplified and outputted to the speaker 19. . The voice input signal from the singer's microphone 13 is digitally converted by the A / D converter 31 and used for generating a scoring value in the singing scoring means 27.

<Microphone for listener>
The listener microphone 14 is a device for outputting a listener voice signal based on input of cheering or cheering of the listener. The cheering or cheering input from the listener microphone 14 is output as a listener voice signal, and transmitted to the listener operation data receiving means 28 of the karaoke main body 11 by wireless communication or wired communication. The listener microphone 14 is preferably installed, for example, on the ceiling or upper wall surface of a karaoke room, and is preferably fixed toward the audience seat where the listener is seated if it is a directional microphone.

<Biological sensor>
The biometric sensor 15 is a wristwatch-type sensor that is worn on the listener's body, a thermography that can acquire information from the listener in a non-contact manner, and the listener's heart rate, respiratory rate, body temperature, It is a device for acquiring various data related to the movement of the listener such as gravitational acceleration (body movement) in real time. Data acquired by the biometric sensor 15 is transmitted to the listener operation data receiving means 28 of the karaoke main body 11 by wireless communication or wired communication.

<Camera>
The camera 16 is a device for photographing the operation of the listener, and can be constituted by, for example, a video camera. The video signal output from the camera 16 is transmitted to the listener operation data receiving means 28 of the karaoke main body 11 by wireless communication or wired communication. Note that the camera 16 is a device for capturing a video for analysis such as detection of the listener's motion, so that the shooting direction is fixed and the focal length is adjusted so that the entire listener area can be viewed from above. It is preferable to be a fixed focus type that does not perform the above.

<Display device>
The display device 17 is a device for displaying a background video, lyrics telop, singing grading results, and the like related to karaoke music, and is composed of a liquid crystal display, for example.

<Karaoke body>
The karaoke main body 11 includes a central control means 21, ROM 22, RAM 23, HDD 24, transmission / reception control means 25, reserved music management means 26, singing scoring means 27, listener operation data receiving means 28, video reproduction control means 29, music reproduction control means. 30 and an A / D converter 31.

<Central control means>
The central control means 21 is an electronic device for comprehensively controlling the karaoke main body 11, and is composed of, for example, a CPU and its peripheral devices. When the CPU or the like operates according to a program stored in the ROM 22 or the like, The control function can be demonstrated.

<ROM / RAM>
The ROM 22 is an electronic device for storing program data and numerical data for controlling each device constituting the karaoke main body 11, and is constituted by a semiconductor memory, for example. The RAM 23 is an electronic device that functions as a temporary storage area for temporarily storing programs and various types of data, and includes, for example, a semiconductor memory. In the present embodiment, a reserved music management table 23 a is stored in the RAM 23.

<HDD>
The HDD 24 is an electronic device that functions as a mass storage device, and stores a music database 24a, a background video database 24b, a listener evaluation reference database 24c, and a singing score reference database 24d. Note that a mass storage means such as a DVD or SSD that can rewrite data may be used instead of the HDD 24 or together with the HDD 24.

<Music database / background video database>
The music database 24a is a database configured by associating music control data (MIDI standard data) and lyrics rendering data in synchronization with music IDs. The performance control data is digital data for controlling the performance of each musical piece, and the lyric rendering data includes display timing data and color change data of lyric characters synchronized with the performance. The background video database 24b is a database that stores a predetermined number of background videos corresponding to karaoke songs to be played as background video files corresponding to the song IDs of the karaoke songs.

  Each piece of music data constituting the music database 24a includes performance section data representing a performance section. As shown in FIG. 2, the performance section data represents a tune that changes as the performance progresses, and includes A melody, B melody, chorus, interlude, last, and the like. In the example shown in FIG. 2, only the performance section related to the listener evaluation reference data is described, but other performance sections include a prelude and the like.

<List of listener evaluation reference>
The listener evaluation reference database 24c is a database constituted by listener evaluation reference data for each karaoke piece. The listener evaluation reference data constituting the listener evaluation reference database 24c is data defining an evaluation for the listener's reaction for each performance section of each karaoke piece. That is, the listener evaluation reference data is data serving as an evaluation criterion by the listener, and the listener detected by the motion detection means (listener microphone 14, biological sensor 15, camera 16) by the function of the singing scoring means 27. Is compared with the listener evaluation reference data of the karaoke music piece, and the evaluation value of the listener is calculated.

  The listener evaluation reference data is data defining an evaluation item (listener's reaction) for the performance section for each karaoke piece as shown in FIG. The evaluation items are, for example, cheering, concentration, excitement, applause, etc. The loudness, sound quality, operation, etc. of the listener's voice input by the listener microphone 14 or the camera 16, and the biosensor 15 The heart rate, body temperature, blood pressure, etc. of the listener are detected and determined for each item according to the evaluation criteria of FIG. In addition, regarding determination of each evaluation item, you may determine by 5-step evaluation etc., and you may use the determination method different for every item.

  As shown in FIG. 5, cheering is evaluated when the input value of the listener microphone 14 exceeds a specified value. The degree of concentration is evaluated when the listener's movements match or there is no useless movement. The degree of excitement is evaluated when the listener's movement and the input value of the listener microphone 14 exceed a specified value, or when the average body temperature of the listener detected by the biosensor 15 rises. The applause is an evaluation target when the applause sound of the listener is detected and the input value of the listener microphone 14 exceeds a specified value. When evaluating each evaluation item, the number of listeners may be users other than the currently logged-in singer, and each evaluation item may be evaluated in consideration of the number of listeners.

  The evaluation items in each performance section shown in FIG. 3 are examples of karaoke music that gradually rises from the A melody. For the first A melody, the cheering and concentration are evaluated, and the next B melody is evaluated. In contrast, the degree of concentration is evaluated in front of the rust, the degree of concentration and the degree of excitement are evaluated in the case of rust, and the applause, cheering and degree of excitement are evaluated in the interlude. Similarly, for other performance sections, evaluation items may be set in accordance with the tone of the karaoke music.

  Furthermore, the evaluation items may be weighted according to the type of performance section. For example, the listener evaluation reference data shown in FIG. 4 is set so that evaluation points are given only to the degree of concentration and excitement in the chorus performance section, and are set to be larger than the evaluation items of the other performance sections, and are listened to carefully. In the performance section, an evaluation score is given only to the degree of concentration, and when cheering or excitement is detected, it may be set not to evaluate as noise or to reduce points. Although only the chorus performance section is shown in FIG. 6, weighting may be set so that the evaluation points for the degree of concentration and the degree of excitement are larger than other evaluation items.

  Note that the listener evaluation reference data common to the music may be created by associating the performance section with the evaluation item, instead of creating the listener evaluation reference data for each karaoke music piece.

<Singing Scoring Reference Database>
The singing score reference database 24d is a database composed of singing score reference data of each karaoke piece. The singing grading reference data constituting the singing grading reference database 24d is data including at least main melody data of karaoke music. This singing scoring reference data is data that is basic data for singing scoring. By the function of the singing scoring means 27, the singing voice signal output from the microphone 13 for the singer is digitally converted by the A / D converter 31. The singing score value is calculated by comparing the singing voice signal and the singing score reference data.

<Transmission / reception control means>
The transmission / reception control means 25 includes an electronic device and a program for controlling transmission / reception of data and signals with the karaoke remote control device 12 and a server (not shown). The function of the transmission / reception control means 25 performs synchronization and error control of data and signals transmitted / received to / from the karaoke remote control device 12 and a server (not shown). Further, as a function of the transmission / reception control means 25, data transmission / reception control in the login operation can be performed.

  The login operation is, for example, an operation of transmitting data for system login (for example, identification information of the karaoke performance device 10 or the portable information terminal) to the server using a portable information terminal possessed by the user. The server that has received data for system login transmits the user ID of the user to the corresponding karaoke performance apparatus 10. Note that the login operation is not limited to such an aspect, and may be any aspect as long as it is an operation for specifying the user who has logged in the system and acquiring the user ID. A login operation may be performed using the remote control device 12.

<Reserved music management means / reserved music management table>
The reserved music management means 26 associates the user ID of the user with the music ID of the reserved music and manages them in the reserved music management table 23a when an arbitrary user reserves the karaoke music. It consists of the program. That is, the reserved music management means 26 creates a reserved music management table 23 a and stores this reserved music management table 23 a in the RAM 23 for management. The reserved music management table 23a is a data table created by arranging music IDs selected by the user using the function of the music search means 12a in the order of performance.

<Listener operation data receiving means>
The listener motion data receiving means 28 includes an interface for receiving motion signals from the listener microphone 14, the biosensor 15, and the camera 16 that function as motion detection means. In the example shown in FIG. 1, the operation signal is received from the listener microphone 14, the biosensor 15, and the camera 16 by the listener operation data receiving unit 28, but the data is received by separate data receiving units. You may comprise. The transmission / reception of the operation signal may be performed by wireless communication or may be performed by wired communication. In particular, the communication with the biosensor 15 is preferably wireless communication.

<Singing method for singing>
The singing scoring means 27 basically comprises a program for evaluating the skill of the singing from the singing voice input at the time of karaoke performance and generating a scoring value (scoring data). In the present invention, the singing scoring is instructed. When playing a karaoke song, for example, singing voice data such as pitch data, volume data, etc. is extracted from the singing voice signal input from the singing microphone 13 for every minute section such as 15 msec, and the karaoke currently being played. By comparing the singing score reference data composed of the main melody of the music and the extracted singing voice data, the singing score value is calculated, and the detected listener's action and the listener evaluation reference data of the karaoke music are In order to calculate the evaluation value of the listener in comparison, and to calculate the total singing score value based on the singing score value and the evaluation value You have me.

  That is, the singing scoring means 27 evaluates the skill of the singing by comparing the singing scoring reference data and the singing voice for each predetermined singing section, and further, the listener evaluation reference data and the listener's action are determined in the predetermined performance section. Comprehensive song scoring result data is output by taking into account the listener's evaluation by comparing each. The scoring result by the singing scoring means 27 is displayed as a comprehensive singing scoring result on the display screen of the display device 17, the input / output display unit 12d of the karaoke remote control device 12, or the like.

  For example, as shown in FIG. 7, the evaluation of the listener is the sum of the actual evaluation values of the listener in each performance section (in this embodiment, 736 points, 800 points out of score and the passing score is 720 points). The overall singing score value is calculated from the singing score value. In this embodiment, 92.0 points are calculated as a total singing score value by multiplying the singing score value of 90 points by the listener's evaluation of 736/720 = 1.022. That is, when the listener's reaction is taken into account, the overall singing score is higher than that of a simple singing score (because the response is good). Conversely, if the total evaluation value of the listener falls below the passing score of 720 points, the overall singing score value becomes low.

  The evaluation based on the listener's movement, the singing score result based on the comparison with the singing reference data, and the total singing score result are displayed for each performance section, for example, and the average value in all performance sections after the performance is finished To do. Also, the evaluation based on the listener's action, the display of the singing score result based on the comparison with the singing reference data may be omitted, and only the comprehensive singing score result may be displayed, or the display for each performance section may be omitted. Then, each evaluation may be displayed after the performance is completed.

  The singing scoring in the singing scoring means 27 may be performed only when the user inputs a singing scoring instruction using the input / output display unit 12d of the karaoke remote control device 12, or the singing scoring reference data or the listener. You may perform only about the karaoke music for which evaluation reference data is prepared. For example, the instruction input for performing the singing is performed at the time of reserving the music, but the instruction input for performing the singing scoring may be performed after the music selection reservation until the performance of the music is started.

<Music playback control means>
The music reproduction control means 30 drives the sound source (synthesizer) based on the performance control data extracted from the music data corresponding to the music ID, generates a musical sound signal that constitutes a karaoke performance signal, and converts it into an analog signal for mixing. 18 is an electronic device for outputting to E. The mixing amplifier 18 mixes the singer's singing voice signal input from the singer's microphone 13 and the karaoke performance signal sent from the music reproduction control means 30, and amplifies it by an amplifier function to a speaker 19. It is a device for outputting more.

<Video playback control means>
The video playback control means 29 uses the background video data extracted from the background video database 24b and the lyric characters created based on the lyric rendering data included in the music data during the performance of the karaoke music to the music of the karaoke music. This is an electronic device for outputting to the display device 17 in synchronization with data.

DESCRIPTION OF SYMBOLS 100 Karaoke scoring system 10 Karaoke performance apparatus 11 Karaoke main body 12 Karaoke remote control apparatus 12a Music search means 12b Music index database 12c Data storage part 12d Input / output display part 13 Singer microphone 14 Listener microphone (motion detection means)
15 Biological sensor (motion detection means)
16 Camera (motion detection means)
17 Display device 18 Mixing amplifier 19 Speaker 21 Central control means 22 ROM
23 RAM
23a Reserved music management table 24 HDD
24a music database 24b background video database 24c listener evaluation reference database 24d singing scoring reference database 25 transmission / reception control means 26 reserved music management means 27 singing scoring means 28 listener operation data receiving means 29 video playback control means 30 music playback control means 31 A / D converter 40 Router 50 Data communication line

Claims (3)

A karaoke scoring system that can appropriately reflect the evaluation of the listener and perform singing scoring,
A microphone for a singer that outputs a singing voice signal based on the input of the singing voice;
Motion detection means for detecting the listener's motion;
For each performance section of each karaoke piece, listener evaluation reference data defining the evaluation for the listener's reaction,
For each karaoke song, singing grading reference data including at least main melody data,
When performing an arbitrary karaoke song, the singing voice signal output from the singer's microphone and the singing score reference data of the karaoke song are compared to calculate a singing score value, and the detected listener's Singing scoring means for calculating an evaluation value of the listener by comparing the operation and the listener evaluation reference data of the karaoke music piece, and calculating a total singing scoring value based on the singing scoring value and the evaluation value; ,
A karaoke scoring system that takes into account the listener's evaluation.   The karaoke scoring system in consideration of listener evaluation according to claim 1, wherein the listener evaluation reference data weights movements for each performance section.   The karaoke scoring system in consideration of listener evaluation according to claim 1, wherein the motion detection means is at least one of a camera, a listener microphone, and a biosensor.

Images