JP6144593B2 - Singing scoring system - Google Patents

Description

  The present invention relates to a singing scoring system, and in particular, sets a scoring section that is subject to singing scoring so that it is shorter than the singing time of each word that is the lyrics of karaoke music, and in each scoring section The present invention relates to a singing scoring system that compares a singing voice signal input from a microphone with scoring reference data to calculate a singing scoring value.

  The currently popular karaoke system has a singing scoring function that compares a singing voice signal input from a microphone and scoring reference data to calculate a singing scoring value. The technique regarding such a singing scoring function is described in Patent Document 1, for example.

  In the karaoke apparatus described in Patent Document 1, a karaoke performance is performed by a sequencer reading out data for karaoke performance and inputting it into a musical sound generator. The karaoke singer sings along with the karaoke performance, and the singing voice signal is input to the amplifier via the microphone and also to the A / D converter, and is converted into digital data.

  Then, the data extraction unit extracts pitch data and volume data from the digitized singing voice signal, and inputs the extracted pitch data and volume data (singing voice) to the comparison unit. The sequencer reads a guide melody, which is comparison data, in parallel with the karaoke performance data and inputs it to the comparison unit. The comparison unit compares the extracted pitch data, volume data, and guide melody, and evaluates the skill of the singer's singing.

Japanese Patent Laid-Open No. 10-69216

  As described above, the singing score value can be calculated by comparing the singing voice signal input from the microphone and digitally converted by the A / D converter with the singing score reference data such as a guide melody. However, in particular, a grading section that is subject to singing is set so that it is shorter than the singing time of each word that is the lyrics of the karaoke music, and in each scoring section, the singing voice signal input from the microphone and In a singing scoring system that calculates singing scoring values by comparing with scoring reference data, pitch data (pitch data) may not be extracted depending on the type of words in the lyrics.

  And, in the scoring section where pitch data (pitch data) cannot be extracted, the singing scoring value becomes low because the data compared with the scoring reference data cannot be extracted even though the singer sings well. There was a problem that accurate singing could not be performed.

  In other words, in the pitch detection method used in the current karaoke system, the pitch cannot be detected in principle for consonant parts (s, t, k, etc.) in words included in the lyrics. Further, the time length of sound generation differs depending on the type of consonant. Specifically, when “su” and “ki” having the same length are compared, the consonant part “s” in “su” has a longer pronunciation time than the consonant part “k” in “ki”. Therefore, if pitch detection is performed for each scoring interval, the time required for the consonant part “s” to occupy the pronunciation of the sub-line becomes longer, and the accuracy of pitch detection is lower than that of the pronunciation of the c-line. On the other hand, in the pronunciation of the K line, since the time occupied by the consonant part “k” in the section is short, the accuracy of pitch detection hardly decreases.

  Referring to the drawings, the length of the consonant part when pronounced "su" and "ki", the analysis result of the frequency characteristics by FFT of the consonant "s" in "su" (hereinafter abbreviated as FFT, the same applies to the drawings) ) And the vowel “u”, the FFT of the consonant “k” and the FFT of the vowel “i” in “ki”. In normal singing, the length of “s” in the pronunciation of the consonant part, that is, “s” and “k” in the pronunciation of “ki” may be considered to be substantially constant. On the other hand, regarding the length of “u” in the pronunciation of the vowel part, that is, “i” in the pronunciation of “su”, the entire pronunciation such as “su” and “ki” is sung short or long. It will change. 5 is an explanatory diagram showing the length of the consonant in the pronunciation of “su”, FIG. 6 is an explanatory diagram showing the FFT of the consonant “s”, and FIG. 7 is an explanatory diagram showing the FFT of the vowel “u”. 8 is an explanatory diagram showing the length of the consonant in the pronunciation of “ki”, FIG. 9 is an explanatory diagram showing the FFT of the consonant “k”, and FIG. 10 is an explanatory diagram showing the FFT of the vowel “i”.

  As shown in FIG. 5, when “su” is pronounced, the pronunciation of the consonant “s” continues for about 110 msec. Also, as shown in FIG. 6, when the consonant “s” is pronounced, no clear fundamental tone or harmonic sequence is recognized, and it is difficult to detect the pitch. On the other hand, as shown in FIG. 7, when the vowel “u” is pronounced, it includes a fundamental tone having a relatively high level at a frequency of about 310 Hz and a harmonic sequence having a frequency that is substantially an integral multiple of the fundamental tone. Can be detected. As described above, in the pronunciation of the sub-line (for example, the pronunciation of “su”), since the time occupied by the consonant part “s” is long in the scoring interval, accurate pitch detection cannot be performed. Therefore, it is necessary to devise a scoring method in order to improve the scoring accuracy in the scoring section including the voice of the bank.

  On the other hand, as shown in FIG. 8, when “ki (ki)” is pronounced, the pronunciation portion of the consonant “k” is about 25 msec, which is less than a quarter of the pronunciation portion of the consonant “s”. . As shown in FIG. 9, when the consonant “k” is pronounced, no clear fundamental tone or harmonic sequence is recognized, and it is difficult to detect the pitch. On the other hand, as shown in FIG. 10, when the vowel “i” is pronounced, it includes a fundamental tone having a relatively high level at a frequency of about 300 Hz and a harmonic sequence having a frequency that is substantially an integral multiple of the fundamental tone. Can be detected. In this way, in the pronunciation of a ka line (for example, the pronunciation of “ki”), the time occupied by the consonant part “k” in the scoring section of a predetermined time length is extremely short, and therefore pitch detection is performed on the consonant part “k”. Even if it is not possible, it is possible to detect the pitch necessary for singing in the vowel part “i”. Therefore, the accuracy of the scoring method does not extremely decrease in the scoring section including the voice of the mosquito line.

  As is clear from FIG. 5 to FIG. 10, the vowel part has a clear peak of integer overtones, and pitch detection is possible with the fundamental tone in both the case of the S-line and the line-of-line. In the consonant part, there is no peak even if it is attempted to detect the pitch in the frequency range of the fundamental tone. Furthermore, since the pronunciation time of the consonant part “k” is shorter in the ca line than in the sa line, the pitch detection can be performed while ignoring the consonant part “k”.

  By the way, as described above, when the time during which the pitch cannot be detected is relatively long as in the case where the consonant part “s” is pronounced, the evaluation value of the pitch is lowered at the singing score. On the other hand, even in a scoring section including a consonant part “s” where the pitch cannot be detected, the singing is performed well for the listener by performing a characteristic singing method such as changing the pronunciation mode of the consonant. There are singing techniques that sound like this.

  However, even if such a characteristic singing method is performed, if the pitch cannot be detected, the singing score value becomes low, and there is a discrepancy between the actual singing score value and the listener's sense. This will cause the listener to feel uncomfortable with the singing score.

  Therefore, when performing a characteristic singing method, by correcting so that the singing score value becomes high, the actual singing score value and the listener's sense are the same, and not just giving the listener a sense of incongruity The singing enjoyment can be fully enjoyed even for singers having characteristic singing techniques.

  The present invention has been proposed in view of the circumstances described above, and even if there is a scoring section in which pitch data (pitch data) cannot be extracted according to the type of consonant included in the words of the lyrics, the listener feels uncomfortable. When performing a characteristic singing technique that does not give a singing, it is an object to provide a singing scoring system in which both singers and listeners can enjoy karaoke by correcting the singing scoring values.

  The singing scoring system of the present invention has been proposed in view of the above-described circumstances, and has the following characteristic points. That is, the singing scoring system of the present invention sets a scoring section that is the subject of singing scoring so that the singing time is shorter than the singing time of each word that is the lyrics of karaoke music, and the singing scoring value in each scoring section A singing scoring system for calculating, singing scoring means, consonant scoring section specifying means, pitch detecting means, pitch detection determining means, characteristic singing mode storage means, singing mode specifying means, and singing mode comparing means It is characterized by comprising.

  The consonant scoring section specifying means is means for specifying the scoring section where the consonant is generated based on the lyrics telop information. The singing scoring means is a means for calculating the singing scoring value by comparing the singing voice signal input from the microphone with the scoring reference data. The pitch detection means is means for detecting the pitch from the input singing voice signal in the specified consonant scoring section. The pitch detection determination means is a means for determining whether or not the time when the pitch detection means cannot detect the pitch is a predetermined time or more.

  The characteristic singing mode storage unit is a unit for storing a plurality of characteristic singing modes for singing by changing the pronunciation mode of the consonant. The singing mode specifying means is a means for specifying the singing mode based on the singing voice signal input from the microphone in the consonant scoring section. The singing mode comparison unit is a unit for comparing the specified singing mode with the characteristic singing mode stored in the characteristic singing mode storage unit.

  Then, the singing scoring means determines that the time when the pitch cannot be detected by the pitch detection judging means is not less than a predetermined time despite the input of the singing voice signal from the microphone, and the specified singing mode is When it matches with any one of the characteristic singing modes, the corrected singing score value is calculated without deducting points for the fact that the pitch could not be detected.

  Further, in the configuration described above, the singing scoring means determines that the time when the pitch cannot be detected by the pitch detection determining means is not less than a predetermined time despite the input of the singing voice signal from the microphone, and When the singing mode specified by the singing mode specifying means matches any one of the characteristic singing modes, the singing voice signal input from the microphone is compared with the scoring reference data, and the rhythm evaluation is performed to detect the pitch. It is possible to calculate the corrected singing score value by performing correction based on the singing score value based on the rhythm evaluation without adopting the singing score value based on.

  Further, in the configuration described above, the singing scoring means determines that the time when the pitch cannot be detected by the pitch detection determining means is not less than a predetermined time despite the input of the singing voice signal from the microphone, and When the singing mode specified by the singing mode specifying unit matches any one of the characteristic singing modes, it is possible to calculate a corrected singing score value by adding bonus points.

  In the singing scoring system having such a configuration, when a user sings along with the performance of the karaoke music, the singing voice signal input from the microphone is digitally converted by the A / D converter, and becomes a singing scoring target. Generate scoring target data. Then, the singing scoring means calculates the singing scoring value by comparing the scoring target data with the scoring reference data for each predetermined singing scoring section.

  Also, based on the lyrics telop information output as the karaoke music progresses, the scoring section where the consonant is generated is sequentially specified, and the singing scoring value is corrected depending on whether or not the pitch has been detected in the consonant scoring section. That is, in the consonant scoring section specified as the scoring section where the consonant is generated by the pitch detection means, the pitch is detected from the singing voice signal, and the time during which the pitch cannot be detected by the pitch detection determination means is a predetermined time or more. It is determined whether or not. Here, in the consonant scoring section, the pitch cannot be detected for a predetermined time (for example, 200 msec) or more unless the listener sings by an irregular singing method that makes the listener feel uncomfortable.

  By the way, there is a singing technique that sounds like a singing skill to the listener by performing a characteristic singing method such as changing the consonant pronunciation mode, so a characteristic singing mode equivalent to this singing technique Is stored in the consonant scoring section, the singing mode is specified based on the singing voice signal input from the microphone, and the singing mode specified by the singing mode comparing unit and the characteristic singing By comparing with an aspect, it can be specified whether it is singing by the characteristic singing method. For this reason, the characteristic singing mode storage means stores a plurality of characteristic singing modes for singing by changing the pronunciation mode of consonants. Specifically, a data table (characteristic singing mode data table) in which general pronunciation and characteristic pronunciation in a characteristic singing mode are linked is created and stored in a storage unit such as an HDD.

  The singing scoring means has a time when the pitch cannot be detected for a predetermined time or more despite the fact that the singing voice signal is input from the microphone, and the consonant pronunciation mode is By performing a characteristic singing method such as changing, a penalty for not being able to detect the pitch when it is determined that the song is sung using a singing technique that sounds good to the listener The corrected singing score value is calculated without performing.

  According to the singing scoring system of the present invention, in the consonant scoring section specified as the scoring section where the consonant is generated, the time when the pitch cannot be detected from the singing voice signal input from the microphone is a predetermined time or more. However, when singing by a predetermined characteristic singing method, the corrected singing score value is calculated without deducting points for the time when the pitch cannot be detected is longer than the predetermined time. .

  Therefore, even if it is a consonant scoring section where the pitch cannot be detected for a predetermined time or more, a characteristic singing that can be recognized that the singer is singing well by using his own singing technique When singing by the method, both the singer and the listener can correct the singing score value without degrading the singing score value, or by adding points, so that both the singer and the listener can feel comfortable. It becomes possible to enjoy karaoke.

  Also, if you set a scoring section that is subject to singing so that it is shorter than the singing time of each word that is the lyrics of karaoke music, pitch data may not be extracted. In the singing scoring system of the invention, even when such a singing scoring section exists, if the singer performs a singing using a characteristic singing method (singing technique), Evaluate singing techniques and score singing that does not deviate from the listener's sense.

The block diagram which shows the structure of the karaoke system to which the singing scoring system which concerns on embodiment of this invention is applied. Explanatory drawing which shows the structure of the characteristic song aspect data table in the song scoring system which concerns on embodiment of this invention. Explanatory drawing which shows Example 1 of the singing scoring method in the singing scoring system which concerns on embodiment of this invention. Explanatory drawing which shows Example 2 of the singing scoring method in the singing scoring system which concerns on embodiment of this invention. Explanatory drawing which shows the length of the consonant in pronunciation of "su". Explanatory drawing which shows FFT of consonant "s". Explanatory drawing which shows FFT of vowel "u". Explanatory drawing which shows the length of the consonant in pronunciation of "ki". Explanatory drawing which shows FFT of consonant "k". Explanatory drawing which shows FFT of vowel "i".

  An embodiment of a singing scoring system of the present invention will be described with reference to the drawings. 1 to 4 show a singing scoring system according to an embodiment of the present invention, FIG. 1 is a block diagram showing a configuration of a karaoke system to which the singing scoring system is applied, and FIG. 2 is a configuration of a characteristic singing mode data table. FIG. 3 and FIG. 4 are explanatory views showing examples of the singing scoring method.

<Outline of singing scoring system>
The singing scoring system according to the embodiment of the present invention sets a scoring section that is a target of singing scoring so that the singing time is shorter than the singing time of each word that is the lyrics of the karaoke music, and singing scoring in each scoring section The present invention relates to a system for calculating a value. As shown in FIG. 1, this singing scoring system 10 is incorporated in a karaoke system (system including the karaoke performance device 20) to realize its function, and is configured as a part of the singing scoring function.

  In the singing scoring system 10 of the present embodiment, as shown in FIG. 1, singing scoring means 37, consonant scoring section specifying means 38, pitch detecting means 39, and pitch are provided as functional means for realizing the singing scoring function. The detection determination means 40, the characteristic singing aspect memory | storage means (characteristic singing aspect data table 35c), the singing aspect specific | specification means 41, and the singing aspect comparison means 42 are provided.

  In the following description, a program is a logic that can be stored in a RAM or the like and executed by hardware such as a CPU, so that not only software that exhibits the function but also an equivalent function can be achieved. It is a concept that includes a circuit.

<Karaoke performance device>
As shown in FIG. 1, a karaoke performance device 20 to which a singing scoring system 10 according to an embodiment of the present invention includes a karaoke main body 21, a speaker 22, a microphone 23, a display device 24, a mixing amplifier 25, and a karaoke remote control device 26. I have. The karaoke performance device 20 is connected to the management server 70 via the router 50 and the data communication line 60.

<Karaoke remote control device>
The karaoke remote control device 26 has a user interface function, and performs data communication with the karaoke main body 21 via the router 50. The karaoke remote control device 26 includes a program functioning as a music search means 26a, a music index database 26b, a data storage unit 26c for storing various data, an input / output display unit 26d for inputting / outputting data, and the like. ing. A music selection operation or the like is performed by operating switches attached to the karaoke remote control device 26 or various icons displayed on the input / output display unit 26d.

  The karaoke main body 21 is provided with local transmission / reception means (not shown), and data transmission / reception is performed between the local transmission / reception means and the karaoke remote control device 26 by a wired method or a wireless method (for example, infrared communication). Also good. Furthermore, by installing a music selection program in a mobile information terminal (for example, a smartphone) possessed by the user, the mobile information terminal has a function as a music selection device, and the mobile information terminal is connected via the management server 70. The music selection information may be transmitted to the karaoke performance device 20 paired with.

<Music search means / music index database>
The music search means 26a is composed of a program for searching for music by referring to the music index database 26b based on a user instruction. The song index database 26b is a database describing attribute information of karaoke songs used for performance by the karaoke performance device 20, for example, song number, song name, artist name, lyrics of the singing part, trend time, music. This includes various attribute information such as genre classification and whether or not it is a duet song.

<Microphone>
The microphone 23 is a device for inputting singing voice. The singing voice signal input from the microphone 23 is mixed and amplified by the mixing amplifier 25 with the performance voice signal sent from the music reproduction control means 43 and output to the speaker 22. The audio input signal from the microphone 23 is digitally converted by the A / D converter 44 and used for singing scoring in the singing scoring means 37.

<Display device>
The display device 24 is a device for displaying a background video, lyrics telop, and the like related to karaoke music, and is configured by, for example, a liquid crystal display.

<Karaoke body>
As shown in FIG. 1, the karaoke main body 21 includes a network transmission / reception means 31, a central control means 32, a ROM 33, a RAM 34, an HDD 35, a reservation management means 36, a singing scoring means 37, a consonant scoring section specifying means 38, a pitch detecting means 39, Pitch detection determination means 40, characteristic singing mode storage means (characteristic singing mode data table 35c), singing mode specifying means 41, singing mode comparison means 42, music playback control means 43, A / D converter 44, video playback control means 45.

<Network transmission / reception means>
The network transmission / reception means 31 includes an electronic circuit and a program for transmitting / receiving data to / from the management server 70, the karaoke remote control device 26, and other karaoke performance devices 20 via the router 50 and the data communication line 60. The data communication line 60 may be any line as long as it can transmit and receive data. For example, an optical line, a dedicated telephone line, a general telephone line, the Internet, or the like can be used. In the present embodiment, the data communication line 60 is configured by combining a communication line such as an optical line, a dedicated telephone line, and a general telephone line, and the Internet.

<Central control means>
The central control means 32 is a means for comprehensively controlling the karaoke main body 21 and is constituted by, for example, a CPU and its peripheral devices, and is controlled by the CPU or the like operating according to a program stored in the ROM 33 or the like. The function can be demonstrated.

<ROM / RAM>
The ROM 33 is a device for storing program data and numerical data for controlling each device constituting the karaoke main body 21, and is constituted by a semiconductor memory, for example. The RAM 34 functions as a temporary storage area for temporarily storing programs and various data, and is composed of, for example, a semiconductor memory.

  In the present embodiment, a reservation queue 34 a is stored in the RAM 34. Note that the reservation queue 34a is a data table in which music IDs are arranged in order of performance for karaoke music reserved for music selection, and when other identification data such as a user ID of a music selection reservation person is associated. There is also. Moreover, you may make it memorize | store a singing score value in RAM34.

<HDD>
The HDD 35 functions as a large-capacity storage device, and stores a music database 35a, a video database 35b, and a characteristic singing mode data table 35c. Note that a mass storage device such as a DVD capable of rewriting data may be used instead of the HDD 35 or together with the HDD 35.

<Music database / video database>
The music database 35a is a database in which music data configured by synchronizing performance control data (MIDI standard data) and lyrics telop information and scoring reference data used for singing is associated with a music ID. It is. The performance control data is digital data for controlling the performance of each musical piece, and the lyrics telop information includes display timing data and color change data of lyrics characters synchronized with the performance. The scoring reference data is data for calculating the singing scoring value by comparing with the singing voice signal input from the microphone 23 in the singing scoring in the singing scoring means 37. The consonant scoring section specifying means 38 specifies the singing section including the consonant and the type of the consonant based on the lyrics telop information.

  The video database 35b is a database that stores a predetermined number of background videos corresponding to karaoke songs to be played as video files corresponding to the song IDs of the karaoke songs. The characteristic singing mode data table 35c will be described later.

<Reservation management means>
The reservation management means 36 includes a program for creating and managing a reservation queue 34a including the song ID of the selected karaoke song when an arbitrary user makes a song selection reservation. That is, the reservation management means 36 creates a reservation queue 34a by arranging the music IDs selected by the user using the function of the music search means 26a in the order of performance, and stores and manages this reservation queue 34a in the RAM 34. . In addition, when the user ID of the music selector is included in the reservation queue 34a, it is necessary to acquire the user ID.

  The user ID is acquired based on the user ID and password input using the input / output display unit 26d of the karaoke remote control device 26 by reading the user ID stored in the user ID card with a card reader. That's fine. Furthermore, when it has the function to make a reservation using the portable information terminal which a user carries, you may acquire user ID linked | related with apparatus ID of the said portable information terminal. Moreover, when using the karaoke performance apparatus 20, you may provide a user ID temporarily with respect to a user.

<Music playback control means>
The music reproduction control means 43 is an electronic circuit for digitally reproducing the sound source data based on the performance control data extracted from the performance data based on the music ID and converting it to analog and outputting it to the mixing amplifier 25. As described above, the mixing amplifier 25 mixes the singer's singing voice signal input from the microphone 23 and the performance voice signal sent out from the music reproduction control means 43, and amplifies it by the amplifier function to be amplified by the speaker 22. It is a device for outputting more.

<Video playback control means>
The video reproduction control means 45 uses the background video data extracted from the video database 35b and the lyric characters created based on the lyrics telop information included in the performance data during the performance of the karaoke music as performance data of the karaoke music. Are output to the display device 24 in synchronization with

<Singing method>
The singing scoring means 37 is composed of a program for comparing the singing voice signal input from the microphone 23 and the scoring reference data to calculate a singing scoring value. Then, although the singing voice signal is input from the microphone 23, any time in which the pitch cannot be detected is a predetermined time (for example, 200 msec) or more, and the specified singing mode is one of the characteristic singing modes. If it matches one, a corrected singing score value is calculated without deducting points for failure to detect the pitch.

  Even if the singing voice signal is input from the microphone 23, the condition that the time when the pitch cannot be detected is a predetermined time (for example, 200 msec) or more is the case where the singer is singing, This is because the pitch cannot be detected because it is a consonant scoring section, and furthermore, it is confirmed that the singing forcibly detecting the pitch is not performed by an irregular singing method different from the original singing method.

  An irregular singing method is a singing that increases the singing score away from the listener's sense by shortening the pronunciation time of consonants extremely or by producing only vowels without producing consonants. It is a method. When such an irregular singing method is permitted and the singing score value becomes high, the singing score value and the listener's sense are different, and the listener feels uncomfortable. In this case, the device which prevents that a singing scoring value raises by an irregular singing method is needed. In order to deal with an irregular singing method, for example, when the pitch can be detected despite the consonant scoring section, deduction may be performed.

  Further, the singing scoring means 37 determines that the time when the pitch cannot be detected by the pitch detection determining means 40 is not less than a predetermined time (for example, 200 msec) even though the singing voice signal is input from the microphone 23. When the singing mode specified by the singing mode specifying unit 41 matches any one of the characteristic singing modes, the singing voice signal input from the microphone 23 is compared with the scoring reference data to evaluate the rhythm. The corrected singing score value may be calculated by performing correction based on the singing score value based on the rhythm evaluation without adopting the singing score value based on the pitch detection.

  Further, the singing scoring unit 37 determines that the time when the pitch cannot be detected by the pitch detection determining unit 40 is not less than a predetermined time (for example, 200 msec) even though the singing voice signal is input from the microphone 23. In addition, when the singing mode specified by the singing mode specifying unit 41 matches any one of the characteristic singing modes, a bonus score may be added to calculate a corrected singing score value.

<Consonant scoring section identification means>
The consonant scoring section specifying means 38 includes a program for specifying a scoring section where a consonant is generated based on the lyrics telop information. That is, the lyric telop information includes lyric character information to be displayed on the display device 24, and based on this lyric character information, it is possible to specify a scoring section where a consonant is generated.

<Pitch detection means>
The pitch detection means 39 consists of a program for performing pitch detection from the input singing voice signal in the specified consonant scoring section.

<Pitch detection determination means>
The pitch detection determination means 40 is composed of a program for determining whether or not the time when the pitch detection means 39 cannot detect the pitch is a predetermined time or more. That is, in the consonant scoring section, although it depends on the type of consonant, it is common that the pitch cannot be detected when singing with the original singing method. However, even if the pitch cannot be detected in the consonant scoring section, this is evaluated when singing in a characteristic singing manner in which the singing method of the consonant is changed by the singer's singing technique. By doing so, you can enhance the fun of karaoke. Therefore, in the present embodiment, when the pitch cannot be detected because the singing is performed in a characteristic singing mode in which the consonant sounding mode is changed, and an irregular singing method different from the original singing method, In order to distinguish the case of singing to detect the pitch, it is determined whether or not the time when the pitch cannot be detected is a predetermined time or more.

<Characteristic singing mode storage means>
The characteristic singing mode storage means is a means for storing a plurality of characteristic singing modes for singing by changing the pronunciation mode of the consonant. For example, the characteristic singing mode data table 35c is created and the HDD 35 or the like is created. Is stored in the storage means.

  The characteristic singing mode of singing by changing the pronunciation mode of consonants is a singing technique that is different from general pronunciation but sounds to the listener as if singing well. Specifically, the singing mode that emphasizes the beginning of singing by pronouncing “n” before pronouncing “ma” so that “wait” is pronounced “nmantete”, “dry” is “quayta” A singing mode that pronounces “K” with a separate sound and vowels of the Ka line, and pronounces “Ta” with a separate sound and vowels of the Ta line, so that “sleeping” is pronounced as “Nemutica” Singing mode, “swaying” is pronounced as “Yurareze”, “te” is pronounced with separate sounds and vowels in the Ta line, and “proud” is pronounced as “Hokora Shige” Singing mode that pronounces “u” before pronunciation or “la” with lingual tongue, singing mode that produces sibilant sound before “si” in “machine”, etc. . It should be noted that the characteristic singing mode is not limited to the above-described ones, and by performing a characteristic singing method such as changing the pronunciation mode of consonants, it differs from general pronunciation, but the listener sings well. As long as it is a singing mode that sounds like it is, any mode may be used.

  As shown in FIG. 2, the characteristic singing mode data table 35c is a data table in which general pronunciation and characteristic pronunciation in the characteristic singing mode are linked. Corresponding characteristic singing modes are described.

  The singing method (characteristic singing mode) of singing by changing the consonant pronunciation mode does not create a sense of incongruity for the listener, such as giving impact to the listener or weakening the attack to emphasize the melody. There is no need to evaluate the singer's singing technique. Therefore, according to the present invention, for such a characteristic singing mode, even if the time during which the pitch cannot be detected is longer than a predetermined time, no deduction is performed, or further bonus points are given.

<Singing mode identification means>
The singing mode specifying means 41 includes a program for specifying the singing mode based on the singing voice signal input from the microphone 23 in the consonant scoring section. The singing mode is the pronunciation mode of the lyric characters, and when singing the lyric characters with a general pronunciation, as described above, it is different from the general pronunciation, but the listener sings well. When singing with a sound that sounds like it is singing, and by singing in an irregular manner, the singing score increases, but the listener may feel uncomfortable. The singing mode specifying means 41 specifies the singing mode based on the singing voice signal input from the microphone 23 in order to distinguish a general singing mode, a characteristic singing mode, and an irregular singing mode.

  In order to specify the singing mode, for example, in the consonant scoring section, it is possible to confirm the time when the pitch has not been detected and the change in the singing volume, or to apply the voice recognition technique. That is, based on the singing voice signal input from the microphone 23, the singing mode is specified by determining the change in the singing volume and the time during which the pitch has not been detected, or by performing voice recognition.

<Singing mode comparison means>
The singing mode comparison means 42 includes a program for comparing the specified singing mode with the characteristic singing mode stored in the characteristic singing mode storage unit (characteristic singing mode data table 35c). As described above, the singing mode includes a general singing mode, a characteristic singing mode, and an irregular singing mode, and the singing mode comparing means 42 is a singing mode specified by the singing mode specifying means 41, and The characteristic singing aspect set in advance is compared, and the comparison result is reflected in the singing score in the singing scoring means 37.

  The singing mode comparing unit 42 compares the characteristic pronunciation corresponding to the general pronunciation of the consonant specified by the consonant scoring section specifying unit 38 and the pronunciation by the singing mode specified by the singing mode specifying unit 41. That is, referring to the characteristic singing mode data table 35 c shown in FIG. 2, the pronunciation by the singing mode specified by the singing mode specifying means 41 in the consonant scoring section corresponds to the consonant specified by the consonant scoring section specifying means 38. Compare whether or not it is a characteristic pronunciation. And when both correspond, in the singing scoring means 37, the preferential scoring process with respect to a characteristic singing aspect is performed.

<Scoring method (Example 1)>
With reference to FIG. 3, Example 1 of the scoring method will be described. In the scoring method according to the first embodiment, the pitch detection determination unit 40 determines that the time when the pitch cannot be detected is equal to or longer than a predetermined time (for example, 200 msec) despite the input of the singing voice signal from the microphone 23. In addition, when the specified singing mode matches any one of the characteristic singing modes, the scoring method does not perform any deduction for the fact that the pitch cannot be detected. Furthermore, since it is a characteristic singing mode that makes it seem that the singer is singing well by using the singing technique, the bonus point is added. In addition, you may increase / decrease the bonus point to add according to the kind of characteristic singing aspect.

  That is, as shown in FIG. 3, in the consonant scoring section (1), a singing voice signal is input from the microphone 23, and the time when the pitch cannot be detected is determined by the pitch detection determination means 40 to be 200 msec or more. And, when singing in a characteristic singing mode, no deduction is made for the fact that the pitch could not be detected. For example, when the score score for pitch detection is 30 points, if the pitch cannot be detected, 30 points will be deducted, but in the consonant scoring section (1) of Example 1, 30 points will not be deducted. 90 points obtained by adding 30 points as correction values and 5 points as bonus points to the actual singing score values are the corrected singing score values.

  Moreover, even if it is a case where the pitch is not detected even if the pitch is not detected, the time when the pitch cannot be detected is less than a predetermined value (for example, 200 msec), or a characteristic singing mode In the consonant scoring section (3) that is not performed, the actual singing scoring value is set as the corrected singing scoring value.

<Scoring method (Example 2)>
With reference to FIG. 4, Example 2 of the scoring method is demonstrated. Example 2 of the scoring method performs rhythm evaluation by comparing the singing voice signal input from the microphone 23 and the scoring reference data in the consonant scoring section, and does not adopt the singing scoring value based on pitch detection. This is a scoring method for calculating a corrected singing scoring value by performing correction based on the singing scoring value based on evaluation. Furthermore, since it is a characteristic singing mode that makes it seem that the singer is singing well by using the singing technique, the bonus point is added. In addition, you may increase / decrease the bonus point to add according to the kind of characteristic singing aspect.

  That is, as shown in FIG. 4, in the consonant scoring section, when a singing voice signal is input from the microphone 23, the time when the pitch cannot be detected is 200 msec or more, and when the singing mode is characteristic, In order to perform singing scoring based on rhythm evaluation without using the singing scoring value based on pitch detection, and to compensate for the singing scoring value based on pitch detection, a correction value based on the singing scoring value based on rhythm evaluation is added. Then, the corrected singing score value is calculated.

  Here, for example, the total score of the singing score value is 100 points, the singing score value based on the pitch detection is 30 points, the singing score value based on the rhythm evaluation is 40 points, and other criteria Suppose that the perfect score of the singing score based on is 30.

  In the example shown in FIG. 4, in the consonant singing section (1), the time when the pitch cannot be detected is 200 msec or more, and further singing in a characteristic singing mode. And in the consonant singing section (1), since the pitch cannot be detected, the singing score value based on the pitch detection is 0 point, but the singing score value based on the rhythm evaluation is 35 points, and the singing score based on other criteria The value is 25 points. Therefore, in order to correct the singing score value based on the pitch detection, a correction value calculated based on the rhythm evaluation is added.

  That is, for the rhythm evaluation, 35 points out of 40 points are obtained, and the score ratio is 35/40. Therefore, the correction value for the singing scoring value based on the pitch detection is calculated by multiplying 30 points which are the full score of the singing scoring value based on the pitch detection by 35/40 which is the scoring ratio based on the rhythm evaluation, and Since this is a characteristic singing mode that makes it seem that the singer is singing well for the listener by using the singing technique, points are added as bonus points. In this case, the singing scoring value based on the rhythm evaluation is 35 points, the singing scoring value based on other criteria is 25 points, the correction value is 26 points, and the bonus score is 5 points. The value is 91 points.

  In addition, the consonant scoring section (2) in which the pitch is detected, or even when the pitch cannot be detected, the time during which the pitch cannot be detected is less than a predetermined value (for example, 200 msec), or in a characteristic singing mode In no consonant singing section (3), the actual singing score is set as the corrected singing score.

<Other embodiments>
The devices and means constituting the system of the present invention and its peripheral devices are not limited to those described above, and only the necessary devices and means are configured according to the purpose of use, or other devices and means are appropriately added. Can be. Further, each unit may be configured as a unit in which a plurality of functions are integrated, instead of being configured separately.

DESCRIPTION OF SYMBOLS 10 Song scoring system 20 Karaoke performance apparatus 21 Karaoke main body 22 Speaker 23 Microphone 24 Display apparatus 25 Mixing amplifier 26 Karaoke remote control apparatus 26a Music search means 26b Music index database 26c Data storage part 26d Input / output display part 31 Network transmission / reception means 32 Central control means 33 ROM
34 RAM
34a Reservation queue 35 HDD
35a Music database 35b Video database 35c Characteristic singing mode data table 36 Reservation management means 37 Singing scoring means 38 Consonant scoring section specifying means 39 Pitch detecting means 40 Pitch detection determining means 41 Singing mode specifying means 42 Singing mode comparing means 43 Music reproduction control Means 44 A / D converter 45 Video reproduction control means 50 Router 60 Data communication line 70 Management server

Claims (3)

In the singing scoring system, which sets the scoring section that is the subject of singing scoring so that it is shorter than the singing time of each word that is the lyrics of the karaoke song, and calculates the singing scoring value in each scoring section,
Singing scoring means for calculating a singing scoring value by comparing the singing voice signal input from the microphone with the scoring reference data;
A consonant scoring section specifying means for specifying a scoring section where a consonant is generated based on the lyrics telop information;
In the specified consonant scoring section, pitch detection means for performing pitch detection from the input singing voice signal;
Pitch detection determination means for determining whether or not the time when the pitch detection means cannot detect the pitch is a predetermined time or more;
Characteristic singing mode storage means for storing a plurality of characteristic singing modes for singing by changing the pronunciation of consonants;
In the consonant scoring section, singing mode specifying means for specifying a singing mode based on a singing voice signal input from a microphone;
Singing mode comparing means for comparing the specified singing mode with the characteristic singing mode stored in the characteristic singing mode storage unit,
The singing scoring means determines that the time when the pitch cannot be detected by the pitch detection judging means is not less than a predetermined time despite the input of a singing voice signal from a microphone, and specifies the singing mode When the singing mode specified by the means matches with any one of the characteristic singing modes, the corrected singing score value is calculated without deducting the point that the pitch could not be detected,
A singing scoring system characterized by that. The singing scoring means determines that the time when the pitch cannot be detected by the pitch detection judging means is not less than a predetermined time despite the input of a singing voice signal from a microphone, and specifies the singing mode When the singing mode specified by the means matches any one of the characteristic singing modes, the singing voice signal input from the microphone is compared with the scoring reference data to perform rhythm evaluation, and based on pitch detection Without adopting the singing score value, a correction singing score value is calculated by performing a correction based on the singing score value based on the rhythm evaluation,
The singing scoring system according to claim 1. The singing scoring means determines that the time when the pitch cannot be detected by the pitch detection judging means is not less than a predetermined time despite the input of a singing voice signal from a microphone, and specifies the singing mode When the singing mode specified by the means matches any one of the characteristic singing modes, a bonus score is added to calculate a corrected singing score value.
The singing scoring system according to claim 1 or 2.

Images