JP5627063B2 - Inappropriate song scoring reference data notification system - Google Patents

Description

  The present invention relates to an inappropriate singing grading reference data notification system, and in particular, estimated whether or not reference data used for singing grading has been created accurately and estimated to be inappropriate reference data. The present invention relates to a technique for notifying that fact.

  Some of the popular karaoke performance terminals have a singing scoring function. Compare the singing voice input from the microphone with the reference data set in advance for each piece of music, and the accuracy of the pitch. Skillful singing can be scored for voice timing, volume adjustment, etc.

  For example, Patent Document 1 discloses a technique related to a karaoke performance terminal with a scoring function. The technique described in Patent Document 1 calculates the basic score by scoring the frequency of the singing voice, and calculates additional points by scoring other singing elements such as the vibrato, intonation, voice quality, timing, and screaming of the singing. Is.

  Patent Document 2 discloses a technique related to a karaoke performance terminal capable of displaying a plurality of different evaluation scores. In the technique described in Patent Document 2, when a user's singing voice is input, the singing scoring function works, and the pitch, volume, and rhythm of the singing are scored. Based on a plurality of different scoring criteria (scoring criteria with different weights for singing pitch, volume, and rhythm), the scoring values in the singing scoring function are weighted and averaged to derive a plurality of scoring results ( A plurality of scoring results with different viewpoints such as frequency) emphasis and rhythm emphasis are obtained.

JP 2005-107337 A JP-A-10-161673

  By the way, in order to perform singing on a karaoke performance terminal, the reference data that is the basis of scoring needs to be accurate. That is, when the reference data is not accurately created, no matter how well the user sings, the singing score value is low, which may cause discomfort and distrust to the user.

  Conventionally, contractors who create and distribute karaoke songs check the accuracy of reference data and confirm that it is appropriate reference data before delivering and distributing it. However, human error can occur in any technology, and even if strict checks are performed, it is difficult to say that check errors can be completely eliminated.

  The present invention has been proposed in view of the above-described circumstances, and objectively estimates whether or not reference data used for singing scoring is accurately created, and when it is estimated that the reference data is inappropriate It is an object of the present invention to provide an improper singing scoring reference data notification system that does not give discomfort or distrust to the user by informing the user of correction of the reference data.

  The improper singing grading reference data notification system of the present invention has the following characteristic points in order to achieve the above-described object. In other words, the improper singing grading reference data notification system of the present invention estimates whether or not the reference data used for singing grading has been created accurately, and if it is estimated that it is improper reference data A system for informing, comprising singing scoring means, singing scoring value statistics means, underscoring section specifying means, and inappropriate data notifying means.

  The singing scoring means compares the reference data created for each piece of music in advance with the singing voice input from the microphone for each predetermined singing section, quantifies the difference between the two according to a predetermined algorithm, and calculates the singing It is a means for calculating the singing score value indicating the accuracy of. The singing scoring value statistical means is a means for calculating the statistic value of the singing scoring value for each predetermined singing section for an arbitrary piece of music for which singing scoring has been performed. The underscoring section specifying means is a means for specifying a singing section whose statistical value is lower than a predetermined reference value. The inappropriate data notifying means is a means for notifying that the reference data of the music is inappropriate for the specified song section.

  In a system having such a configuration, in order to perform singing scoring, reference data is created for each piece of music and stored together with the music data in a predetermined storage means. Then, when the user is instructed to give a singing score, or when a song that has been set to perform singing in advance is played, the singing scoring means inputs the singing reference data for the song and the microphone. Compared with the singing voice, the singing score value regarding the skill of the singing is calculated with respect to the accuracy of the pitch, the utterance timing, and the volume adjustment.

  Moreover, the statistic value of a singing score value is computed for every predetermined | prescribed song area by the function of a singing score value statistics means about the arbitrary music to which the singing score was performed. And the singing section whose statistical value is lower than a predetermined reference value is specified by the function of the underscoring section specifying means.

  When a singing section whose statistic value is lower than a predetermined reference value is specified, the function of the inappropriate data notification means notifies that the reference data in the specified singing section is inappropriate. For example, for the music with improper reference data attached, the notification outputs, for example, the music ID and data for specifying the singing section where the improper reference data exists as a file, or on the screen of the display device. It may be displayed or printed by a printer.

  Further, in addition to the above-described configuration, a user-specific singing score storage means for storing a singing grading value for each user, and a high grading that identifies users whose statistic values of singing grading values by user are equal to or higher than a reference value And a value user specifying means. When it is set as such a structure, a singing score value statistics means calculates the statistic value of a singing score value only about the specified user.

  In the system having such a configuration, when singing is performed, the singing score value is stored for each user by the function of the singing score storing unit for each user. In addition, the function of the high scoring value user specifying means specifies the user whose statistical value of the singing scoring value for each user is equal to or higher than the reference value. And a singing score value statistics means calculates the statistic value of a singing score value only about the user specified that the singing score value is more than a reference value. That is, a statistical value is calculated on the basis of a singing score value of a user who is objectively evaluated to be good at singing, and it is estimated whether or not inappropriate reference data exists.

  According to the improper singing grading reference data reporting system of the present invention, the singing skill is sung despite the fact that the singing section whose statistic value is lower than the reference value is actually singing well. Since it may be underestimated, it is estimated whether the reference data of the singing section is incorrect and the reference data is accurately created by notifying that effect. It can be estimated objectively.

  Thereby, it is possible to re-confirm the reference data notified as inappropriate and to obtain appropriate reference data, so that the user is not given discomfort or distrust to the singing score.

  Also, not all users who performed singing scores are able to sing well, so remember the singing score values of each user, and be good at singing whose singing score value is more than the reference value By calculating the statistic value of the singing score value only for the user, it is possible to identify inappropriate reference data more accurately and reliably.

The block diagram which shows the principal part of the improper song scoring reference data alerting | reporting system of this invention. Explanatory drawing which shows the function of the improper song scoring reference data alerting | reporting system of this invention. The block diagram which shows the karaoke performance terminal to which the improper song scoring reference data alerting | reporting system of this invention is applied. Explanatory drawing which shows the structure of the singing score value table classified by music. Explanatory drawing which shows the structure of an improper data alerting | reporting file. Explanatory drawing which shows the structure of the singing score value table classified by user.

  Hereinafter, an embodiment of an inappropriate singing grading reference data notification system (hereinafter abbreviated as a notification system) of the present invention will be described with reference to the drawings. 1 to 6 show a notification system according to an embodiment of the present invention. FIG. 1 is a block diagram of a main part of the notification system, FIG. 2 is a functional explanatory diagram of the notification system, and FIG. 3 is an application of the notification system. 4 is a block diagram of a karaoke performance terminal, FIG. 4 is an explanatory diagram of a song-specific singing score table, FIG. 5 is an explanatory diagram of an inappropriate data notification file, and FIG. 6 is an explanatory diagram of a user-specific singing score table.

<Outline of notification system>
The notification system according to the embodiment of the present invention estimates whether or not the reference data used for singing scoring is accurately created, and notifies the fact when it is estimated that the reference data is inappropriate. As shown in FIG. 1, the singing scoring value management server 50 and a plurality of karaoke performance terminals 10 comprise a singing scoring means 39, a singing scoring value statistics means 51, and an underscoring section specifying means 52. And improper data notification means 53. Moreover, you may provide the singing score value memory | storage means 54 classified by user and the high score value user identification means 57 as a component of an alerting | reporting system. In the present embodiment, the singing scoring means 39 is a constituent element of each karaoke performance terminal 10, and the singing scoring value statistics means 51, the underscoring section specifying means 52, the inappropriate data notifying means 53, the singing scoring for each user. The value storage means 54 and the high score value user specifying means 57 are components of the singing score value management server 50.

  In this notification system, as shown in FIG. 2, when a song is instructed by a user or a song that is set in advance to perform singing is played, The singing scoring value is calculated by comparing the singing scoring reference data and the singing voice input from the microphone 24. Further, when such singing is performed, the function of the singing scoring value statistical means 51 calculates the statistic value of the singing scoring value for each song (for each predetermined singing section) at a predetermined timing, and underscores. By the function of the section specifying means 52, a singing section whose statistical value is lower than a predetermined reference value is specified for each piece of music. Then, the function of the inappropriate data notification means 53 notifies that the reference data in the singing section whose statistical value is lower than a predetermined reference value is inappropriate. Notification that the reference data is inappropriate is performed, for example, by creating an inappropriate data notification file 56.

  In such processing, the singing score value is stored for each user by the function of the user-specific singing score storage means 54, and the singing score value by user is stored by the function of the high-scoring-value user specifying means 57. Identify users whose statistics are above the reference value. And it is preferable that the singing score value statistics means 51 calculates the statistic value of a singing score value only using the data of the user whose singing score value is more than a reference value.

<Details of notification system>
In the notification system according to the embodiment of the present invention, as shown in FIG. 1, the singing score management server 50 and a plurality of karaoke performance terminals 10 are connected to each other via a communication network 60. The communication network 60 can use a public telephone line, a dedicated telephone line, an optical communication line, a LAN, etc., but it is difficult for a third party to infiltrate the network, to listen to and alter data, and to not monopolize the bandwidth. It is preferable to use a VPN constituted by the Internet because it is an inexpensive communication network.

<Singing score management server>
As shown in FIG. 1, the singing scoring value management server 50 includes a singing scoring value statistic means 51, an underscoring section specifying means 52, an inappropriate data notifying means 53, and further a singing scoring value storage means for each user. 54, high scoring value user specifying means 57 can be provided. Although not shown, the singing scoring value management server 50 transmits / receives data to / from a plurality of karaoke performance terminals 10 in addition to the functional means described above, and stores the received data in a predetermined storage device. It has a basic server function. In addition, the singing score management server 50 is not constructed as an independent server, but the host server that distributes karaoke music is provided with a function for managing singing grading values, or the singing scoring value management server 50 by virtualization technology. May be constructed.

<Singing score statistics means>
The singing scoring value statistical means 51 is composed of a program for calculating a statistic value of a singing scoring value for each predetermined singing section for an arbitrary piece of music for which singing scoring has been performed in an arbitrary karaoke performance terminal 10. The statistical value of the singing score value may be any statistical value such as a simple average value, a weighted average value, a standard deviation value, etc. of the singing score values by a plurality of users. For example, when using a simple average value of singing scores by a plurality of users, an average value of singing scores for each singing section is obtained for each piece of singing scores, and a singing score table for each song 55 is created and stored in a storage device such as an HDD. Note that the statistical value may be calculated at any timing. For example, the statistical value is calculated every month, every week, or every time a predetermined number of singings are performed.

  For example, as shown in FIG. 4, the song-specific singing score table 55 is a data table configured by associating a song ID and a singing score average value for each singing section for each song. Note that the data included in the song-specific singing score table 55 is not limited to that shown in FIG. 4, and may include other data such as the average value of the singing score values of all sections.

  The singing scoring value statistics means 51 is based on the singing scoring value stored by the user-specific singing scoring value storage means 54 and based on the statistical value of the singing scoring value by user by the high scoring value user specifying means 57. It is possible to make it function so as to calculate the statistic value of the singing scoring value only for the user specified to be greater than or equal to the value. In this case, the statistical value based only on the singing score value of the user who is objectively evaluated to be good at singing is calculated. The underscoring section specifying means 52 uses this statistical value to estimate whether there is illegal reference data.

<Unscoring section identification means>
The underscoring section specifying means 52 includes a program for specifying a singing section whose statistical value calculated by the singing scoring value statistics means 51 is lower than a predetermined reference value. In addition, although any value may be sufficient as a reference value, it is preferable to make a clearly low value into a reference value as a general user's singing score value. For example, when it is assumed that a general user can give a singing score of about 60 points, 40 points clearly lower than this can be set as the reference value. Moreover, when calculating the statistical value based only on the singing score value of the user who is objectively evaluated to be good at singing, 50 points higher than the former can be set as the reference value.

<Inappropriate data notification means>
The inappropriate data notifying means 53 notifies that the reference data of the music is inappropriate for the singing section specified as the statistical value calculated by the singing scoring value statistical means 51 being lower than the predetermined reference value. For the program. That is, in the inappropriate data notification means 53, when it is specified that the reference data is inappropriate, the music ID and the inappropriate singing section are specified for the music accompanied with the inappropriate reference data. The inappropriate data notification file 56 associated with the data is output, the contents of the inappropriate data notification file 56 are displayed, or printed by a printer. As shown in FIG. 5, the improper data notification file 56 is a file in which a song ID of a song that is determined to have improper reference data attached to a song section that includes the improper reference file. It is.

<User-specific singing score storage means>
The user-specific singing score storage means 54 includes a program for storing a singing score value for each user. That is, the user-specific singing score storage means 54 obtains the singing grading value 58 each time singing is performed at the karaoke performance terminal 10, and creates the singing singing score table 58 for each user. Store in the storage means. As shown in FIG. 6, for example, the user-specific singing score table 58 is data in which the user ID is associated with the maximum value, the minimum value, and the average value of the singing score values. Instead, any one of the maximum value, the minimum value, and the average value, or the standard deviation value may be used as the configuration data.

<High scoring value user identification means>
The high scoring value user specifying means 57 includes a program for specifying a user whose statistic value of the user-specific singing scoring value stored by the function of the user-specific singing scoring value storage means 54 is equal to or higher than a reference value. That is, the high scoring value user specifying means 57 specifies a user who is objectively evaluated to be good at singing, and calculates the statistical value by the singing scoring value statistics means 51 based on the singing scoring value. Make it.

<Karaoke performance terminal>
The karaoke performance terminal 10 to which the notification system according to the embodiment of the present invention is applied includes a karaoke main body 21, a karaoke remote control device 22, a speaker 23, a microphone 24, a display device 25, and a mixing amplifier 26, as shown in FIG. Yes.

<Karaoke remote control device>
The karaoke remote control device 22 has a user interface function, and transmits / receives data to / from the local transmission / reception means 36 of the karaoke main body 21 by a wired method or a wireless method. The karaoke remote control device 22 includes a storage unit (not shown) including a program functioning as a music search unit 22a, a music index database 22b, a card reader 22c, an electronic circuit and program for transmitting and receiving data, a flash memory, and the like. I have. Various operations such as a music selection operation can be performed by operating switches attached to the karaoke remote control device 22 and various icons displayed on an input / output display unit (not shown).

<Music search means / music index database>
The music search means 22a includes a program for searching for karaoke music by referring to the music index database 22b based on a user instruction. The music index database 22b is a database in which attribute information about karaoke music used for performance at the karaoke performance terminal 10 is described. For example, the music number, music title, singer name, lyrics of the singing part, fashion season, music genre This includes various attribute information such as whether or not it is a category / duet song.

<Card reader>
The card reader 22c is a device for acquiring the user ID of the user when an arbitrary user uses the karaoke performance terminal 10, and in this embodiment, the user uses the karaoke performance terminal 10. In doing so, the user ID is read from the ID medium 27 possessed by the user. The user ID read by the card reader 22 c is stored as a user management table 34 b in the RAM 34 of the karaoke main body 21 and managed by the user management means 37. The ID medium 27 includes, for example, a non-contact type ID card, a mobile phone, a portable information terminal, etc., and can store user IDs and transmit / receive data to / from the card reader 22c. Yes. The data stored in the user management table 34b is used when tabulating singing score values for each user.

<Microphone>
The microphone 24 is a device for inputting singing voice. The singing voice signal input from the microphone 24 is mixed and amplified by the mixing amplifier 26 with the performance voice signal sent from the music reproduction control means 40 and output to the speaker 23. The voice input signal from the microphone 24 is digitally converted by the A / D converter 41 and used for scoring in the singing scoring means 39.

<Display device>
The display device 25 is a device for displaying a background video, lyrics telop, and the like related to karaoke music, and is configured by, for example, a liquid crystal display.

<Karaoke body>
The karaoke main body 21 includes network transmission / reception means 31, central control means 32, ROM 33, RAM 34, HDD 35, local transmission / reception means 36, user management means 37, reservation management means 38, singing scoring means 39, music reproduction control means 40, A / A D converter 41 and a video reproduction control means 42 are provided.

<Central control means>
The central control means 32 is a means for comprehensively controlling the karaoke main body 21 and is constituted by, for example, a CPU and its peripheral devices, and is controlled by the CPU or the like operating according to a program stored in the ROM 33 or the like. The function can be demonstrated.

<ROM / RAM>
The ROM 33 is a device for storing program data and numerical data for controlling each device constituting the karaoke main body 21, and is constituted by a semiconductor memory, for example. The RAM 34 functions as a temporary storage area for temporarily storing programs and various data, and is composed of, for example, a semiconductor memory. Note that the virtual RAM 34 may be configured using a hard disk storage device or the like instead of configuring the RAM 34 with a physical semiconductor memory. In the present embodiment, the RAM 34 stores a reservation queue 34a, a user management table 34b, and a user-specific song scoring value 34c.

  The reservation queue 34a is a data table configured by associating the song ID and the user ID of the song selector with respect to the karaoke song reserved for song selection in the order of performance, and may be associated with other identification data. The user management table 34b is a data table for managing a user who has logged into the karaoke performance terminal 10 based on the user ID. Moreover, the singing score value 34c classified by user is data regarding the singing score value of each user, and is transmitted to the singing score management server 50 and used.

<HDD>
The HDD 35 functions as a large-capacity storage device, and stores a music database 35a and a video database 35b. Note that a mass storage device such as a DVD capable of rewriting data may be used instead of the HDD 35 or together with the HDD 35.

<Music database>
The music database 35a is a database configured by associating performance control data (MIDI (registered trademark) data), lyrics rendering data, and singing scoring reference data in association with music IDs. It is. The performance control data is digital data for controlling the performance of each musical piece, and the lyric rendering data includes display timing data and color change data of lyric characters synchronized with the performance. The reference data is data created for each musical note corresponding to the original music, such as pitch, volume, rhythm, vibrato, inflection, voice quality, timing, and squeak, for each musical piece. Singing can be performed by comparing with the singing voice input from 24.

<Video database>
The video database 35b is a database that stores a predetermined number of background video data corresponding to karaoke music to be played as video files corresponding to the music ID of the karaoke music.

<Network transmission / reception means / local transmission / reception means>
The network transmission / reception means 31 includes an electronic circuit and a program for transmitting / receiving data between the singing score management server 50 and the karaoke main body 21. The local transmission / reception means 36 includes an electronic circuit and a program for transmitting / receiving data between the karaoke main body 21 and the karaoke remote control device 22. In the present embodiment, data is transmitted and received between the karaoke main body 21 and the karaoke remote control device 22 by infrared communication.

<User management means>
The user management unit 37 includes a program for specifying and managing a user based on the acquired user ID. That is, in the user management means 37, when the card reader 22c reads the user ID from the ID medium 27, the user is specified based on the user ID and managed by the user management table 34b. The acquired user ID is used when performing music selection reservation and singing grading statistics.

<Reservation management means>
The reservation management means 38 adds the user ID of the music selector to the music ID of the karaoke music selected by the user using the function of the music search means 22a, arranges them in the order of performance, and generates the reservation queue 34a. It consists of a program for storing and managing the queue 34a in the RAM 34.

<Singing method for singing>
The singing scoring means 39 compares the reference data created for each piece of music in advance with the singing voice input from the microphone 24 for each predetermined singing section, and calculates the difference between the two according to a predetermined algorithm. It consists of a program for calculating a singing score value indicating the accuracy of singing.

  That is, the singing scoring means 39 extracts singing evaluation data such as the pitch, voice volume, and tempo from the user's voice signal input from the microphone 24 and digitally converted by the A / D converter 41, and this singing evaluation data. Is compared with reference data consisting of the main melody of the karaoke music played, and singing is performed. As the scoring function in the singing scoring means 39, the pitch, scoring, running and ticking, inflection, long tone skill, vibrato skill, fall, fist, accuracy of bass part and treble part, etc. may be scored. . The scoring result value in the singing scoring means 39 is transmitted to the singing scoring value management server 50, and the statistical value is calculated at a predetermined timing by the function of the singing scoring value statistics means 51. Further, the singing score value for each user received by the singing score management server 50 is stored as a singing score value table 58 for each user by the function of the singing score value storage means 54 for each user.

<Music playback control means>
The music reproduction control means 40 is an electronic circuit for digitally reproducing the sound source data based on the performance control data extracted from the music database 35a based on the music ID and converting it to analog and outputting it to the mixing amplifier 26. As described above, the mixing amplifier 26 mixes the user's singing voice signal input from the microphone 24 and the performance voice signal sent from the music reproduction control means 40, and amplifies the signal by the amplifier function to produce the speaker 23. It is a device for outputting more.

<Video playback control means>
The video reproduction control means 42 synchronizes the video data extracted from the video database 35b and the lyric rendering data included in the performance data with the performance data of the karaoke music in the display device 25 during the performance of the karaoke music. It consists of a program for output.

<Notification process>
Next, processing for performing notification that improper reference data exists using the notification system of the present embodiment will be described. In the notification system of the present embodiment, as shown in FIG. 2, when a song is instructed by a user or a song that is set in advance to perform singing is played, the function of the singing scoring means 39 is used. Then, the reference data of the music is compared with the singing voice input from the microphone 24, and the singing score value regarding the skill of the singing is calculated with respect to the accuracy of the pitch, the utterance timing, and the volume adjustment. And by the function of the singing score value statistical means 51, a statistic value is calculated for each song at a predetermined timing for a plurality of users.

  At this time, based on the singing score value for each user stored in the singing score value table 58 for each user, the statistical value (for example, the singing score average value) is calculated by the function of the high scoring value user specifying means 57. It is preferable to calculate a statistical value in the singing score value statistics means 51 using only the singing score value of the specified user by specifying a user who is equal to or higher than the reference value.

  When the singing score value calculation and statistics are performed, the function of the under-scoring section specifying means 52 specifies the singing section whose statistical value is lower than a predetermined reference value, and is specified by the function of the inappropriate data notifying means 53. The singing section is notified that the reference data of the music is inappropriate.

<Other embodiments>
The devices and means constituting the system of the present invention and its peripheral devices are not limited to those described above, and only the necessary devices and means are configured according to the purpose of use, or other devices and means are appropriately added. Can be. Further, each unit may be configured as a unit in which a plurality of functions are integrated, instead of being configured separately. Further, instead of using the plurality of karaoke performance terminals 10 and the singing score management server 50 connected to the network, the karaoke performance terminal 10 and the singing score management server 50 connected to each other within a predetermined area may be used. However, a system with only one karaoke performance terminal 10 may be used.

DESCRIPTION OF SYMBOLS 10 Karaoke performance terminal 21 Karaoke main body 22 Karaoke remote control apparatus 22a Music search means 22b Music index database 22c Card reader 23 Speaker 24 Microphone 25 Display apparatus 26 Mixing amplifier 27 ID medium 31 Network transmission / reception means 32 Central control means 33 ROM
34 RAM
34a Reservation queue 34b User management table 34c Singing score by user 35 HDD
35a Music database 35b Video database 36 Local transmission / reception means 37 User management means 38 Reservation management means 39 Singing scoring means 40 Music playback control means 41 A / D converter 42 Video playback control means 50 Singing score value management server 51 Singing scoring value statistics means 52 Underscoring section specifying means 53 Inappropriate data informing means 54 User-specific song scoring value storage means 55 Music-specific song scoring value table 56 Inappropriate data informing file 57 High scoring value user specifying means 58 User-specific song scoring value table 60 Communication network

Claims (2)

It is a system for estimating whether or not reference data used for singing scoring has been created accurately and informing that it is improper reference data, singing scoring means, and singing scoring A value statistic means, an underscoring section specifying means, and inappropriate data notification means,
The singing scoring means compares the reference data created for each piece of music in advance with the singing voice input from the microphone for each predetermined singing section, and calculates the difference between the two according to a predetermined algorithm. Calculate the singing score that indicates the accuracy of the singing,
The singing scoring value statistic means calculates a statistic value of the singing scoring value for each predetermined singing section, for any song for which singing scoring has been performed,
The underscoring section specifying means specifies a singing section in which the statistical value is lower than a predetermined reference value,
The inadequate data notifying means notifies that the reference data of the music is inappropriate for the specified song section.
An improper singing scoring reference data notification system characterized by that. Further comprising a user-specific singing score storage means and a high score value user identification means,
The user-specific singing score storage means stores the singing score value for each user as a user-specific singing score value,
The high scoring value user specifying means specifies a user whose statistical value of the singing scoring value for each user is a reference value or more,
The singing scoring value statistical means calculates a statistic value of the singing scoring value only for the specified user.
The inappropriate singing grading reference data notification system according to claim 1.

Images