JP6920135B2 - Karaoke equipment - Google Patents

Description

The present invention relates to a karaoke device.

Duet singing is one of the ways to enjoy karaoke. For example, when multiple people use the karaoke box, the participants can get excited by singing a duet. In addition, there are many male users (or female users) who come to the night store to enjoy duet singing with the female staff (or male staff) of the store.

In order to further expand the enjoyment of such duet singing, techniques for scoring duet singing by singer and diagnosing the compatibility of two singers are known.

For example, Patent Document 1 discloses a karaoke system in which when a user who has reserved a duet song selects a partner and sings the duet, the user and the partner's singing are appropriately scored.

In addition, Patent Document 2 states that if the singing styles of the two duet singers deviate from the model singing style of the music, the two people are compatible with each other. The karaoke device to be judged is disclosed.

Further, Patent Document 3 discloses a technique for controlling the display mode of the singing image of the other party based on the compatibility evaluation value between the singers performing the communication duet.

Japanese Unexamined Patent Publication No. 2008-250186 Japanese Unexamined Patent Publication No. 2006-259237 Japanese Unexamined Patent Publication No. 2015-040995

By the way, the original pleasure of duet singing is not only the singer who selects the target karaoke song (hereinafter, "first singer"), but also the partner who sings the duet together with the first singer (hereinafter, "first singer"). The "second singer") is also able to enjoy karaoke singing. Therefore, when evaluating the karaoke singing of each of the first singer and the second singer, it is preferable to consider whether or not the karaoke singing can be enjoyed by each other.

An object of the present invention is to provide a karaoke device capable of performing a singing evaluation that reflects the emotions of a duet partner.

The main invention for achieving the above object is a karaoke device used by a first singer who selects a karaoke song and a second singer who sings a duet of the selected karaoke song with the first singer. A scoring process for calculating a scoring value by scoring the singing voice data extracted from the singing voice obtained by singing the karaoke song based on at least one of pitch, volume and singing technique. A unit, a singing emotion data generation unit that generates singing emotion data obtained by emotionally analyzing the singing voice, a scoring value of the first singer scored by the scoring processing unit, and a singing emotion data generation unit. It is a karaoke apparatus having a karaoke singing evaluation unit for evaluating the singing of the first singer based on the singing emotion data of the second singer.
Other features of the present invention will be clarified by the description of the description and drawings described later.

According to the present invention, it is possible to perform a singing evaluation that reflects the emotions of the duet partner.

It is a figure which shows the hardware configuration example of the karaoke apparatus which concerns on embodiment. It is a figure which shows the software configuration example of the apparatus main body which concerns on embodiment. It is a figure which showed the singing emotion data which concerns on embodiment. It is a figure which showed the emotion score which concerns on embodiment. It is a flowchart which shows the process of the karaoke apparatus which concerns on embodiment. It is a figure which showed the emotional score which concerns on the modification. It is a figure which shows the software configuration example of the apparatus main body which concerns on the modification.

<Embodiment>
The karaoke device 1 according to the present embodiment will be described with reference to FIGS. 1 to 5. In the present embodiment, the first singer is a singer who selects a karaoke song, and the second singer is a singer who sings the selected karaoke song in a duet together with the first singer.

== Karaoke device ==
The karaoke device 1 is a device for playing a karaoke piece selected by a singer and for the singer to sing karaoke along with the performance. As shown in FIG. 1, the karaoke device 1 includes a karaoke body 10, a speaker 20, a display device 30, a microphone 40a, a microphone 40b, and a remote control device 50.

The speaker 20 is configured to emit sound based on the sound emitted signal from the karaoke main body 10. The display device 30 is configured to display an image or an image on the screen based on the signal from the karaoke main body 10. The microphone 40a and the microphone 40b are configured to convert the singing voice of the singer (input voice from the microphone 40a or the microphone 40b) into an analog singing voice signal and input it to the karaoke main body 10. When performing duet singing, the first singer and the second singer each perform karaoke singing with separate microphones.

(Karaoke hardware)
As shown in FIG. 1, the karaoke main body 10 includes a control unit 11, a communication unit 12, a storage unit 13, an acoustic processing unit 14, a display processing unit 15, and an operation unit 16. Each configuration is connected to bus B via an interface (not shown).

The karaoke body 10 performs various controls related to karaoke singing, such as performance control of the selected karaoke music, display control of lyrics and background images, and processing of a singing voice signal input through the microphone 40a or the microphone 40b.

The control unit 11 includes a CPU 11a and a memory 11b. The CPU 11a realizes various control functions by executing an operation program stored in the memory 11b. The memory 11b is a storage device that stores a program to be executed in the CPU 11a and temporarily stores various information when the program is executed.

The communication unit 12 provides an interface for connecting the karaoke body 10 to the communication line via a router (not shown).

The storage unit 13 is a large-capacity storage device that stores various types of data, such as a hard disk drive. The storage unit 13 stores a plurality of music data for performance by the karaoke device 1.

Identification information (music ID) for identifying each karaoke music is added to the music data. The music data includes accompaniment data, reference data, background image data, lyrics data, and attribute information. The accompaniment data is MIDI format data that is the source of the karaoke performance sound. Reference data is data used as a reference when scoring karaoke singing by a singer. The reference data includes pitch (pitch) data, sound length data, timing data, and the like. The background image data is data corresponding to the background image displayed on the display device 30 or the like at the time of karaoke performance. The lyrics data is data related to lyrics (lyric telop) to be displayed on the display device 30 or the like. The attribute information is information about the karaoke music such as a song name, a singer name, a lyricist / composer name, and a genre.

Based on the control of the control unit 11, the sound processing unit 14 controls the performance of the karaoke music and processes the singing audio signal input through the microphone 40a or the microphone 40b. The sound processing unit 14 includes, for example, a MIDI sound source, a mixer, and an amplifier (none of which are shown). The control unit 11 sequentially reads out the accompaniment data of the reserved karaoke music based on the tempo clock signal and inputs it to the MIDI sound source. The MIDI sound source generates a musical tone signal based on the accompaniment data. The mixer mixes the musical tone signal with the singing audio signal output from the microphone 40a or the microphone 40b at an appropriate ratio and outputs the mixture to the amplifier. The amplifier amplifies the mixing signal from the mixer and outputs it to the speaker 20 as a sound emission signal. As a result, the karaoke performance sound based on the sound emission signal and the singing sound from the microphone 40a or the microphone 40b are emitted from the speaker 20. When performing a duet singing, the singing sounds from the microphones 40a and 40b are simultaneously emitted.

The display processing unit 15 performs processing related to various displays in the display device 30 based on the control of the control unit 11. For example, the display processing unit 15 controls the display device 30 to display an image in which lyrics and various icons are superimposed on a background image at the time of performance.

The operation unit 16 includes a panel switch, a remote control reception circuit, and the like, and sends operation signals such as a music selection signal and a performance stop signal to the control unit 11 in response to the operation of the panel switch of the karaoke device 1 or the remote control device 50 by the singer. Output. The control unit 11 detects the operation signal from the operation unit 16 and executes the corresponding process.

The remote control device 50 is a device for performing various operations on the karaoke main body 10. The singer can use the remote control device 50 to select (reserve) a karaoke song that he / she wishes to sing.

(Karaoke main unit software)
FIG. 2 is a diagram showing a software configuration example of the karaoke main body 10. The karaoke body 10 includes a scoring processing unit 100, a singing emotion data generation unit 200, a karaoke singing evaluation unit 300, and a performance control unit 400. The scoring processing unit 100, the singing emotion data generation unit 200, the karaoke singing evaluation unit 300, and the performance control unit 400 are realized by the CPU 11a executing a program stored in the memory 11b.

[Scoring section]
The scoring processing unit 100 calculates the scoring value by scoring the singing voice data extracted from the singing voice obtained by singing the karaoke music based on at least one of pitch, volume and singing technique.

Known techniques can be used for scoring singing. For example, the scoring processing unit 100 extracts singing voice data such as pitch (pitch) data and volume data from the singing voice signal input from the microphone 40a and compares it with the reference data of the music to determine the scoring value. calculate.

Further, when the first singer and the second singer perform duet singing, the scoring processing unit 100 performs scoring processing for the karaoke singing of the first singer and scoring processing for the karaoke singing of the second singer. And can be performed individually, and each scoring value can be calculated.

[Singing emotion data generation unit]
The singing emotion data generation unit 200 generates singing emotion data obtained by emotionally analyzing the singing voice obtained by singing a karaoke song.

The singing emotion data is data showing the emotional expression included in the singing of the karaoke music. In this embodiment, the singing emotion data is shown numerically. Singing emotion data is obtained by emotionally analyzing the singing voice. For emotion analysis, known techniques (for example, Japanese Patent Application Laid-Open No. 10-187178 and "Voice Heart Analysis Service" (Hitachi Systems, Ltd.)) can be used. As a specific example, the singing emotion data generation unit 200 extracts an emotional feature amount that correlates with how to put emotions from the singing voice. In addition, the singing emotion data generation unit 200 analyzes the emotions contained in the singing based on the extracted emotional features. Sentiment analysis is performed, for example, for each predetermined singing section. Then, the singing emotion data generation unit 200 generates singing emotion data for each singing section by quantifying the information obtained by the emotion analysis and classifying it into a predetermined emotion type. Emotion types correspond to general emotional expressions such as emotions.

Alternatively, it is also possible to generate singing emotion data using a known artificial intelligence technique. For example, the PC development support kit "ST Emotion SDK" (AGI Co., Ltd.) has a function to detect emotional states such as joy, anger, and sadness from conversational voice and the intensity of excitement in 10 stages by the voice emotion recognition engine ST. Exists. The singing emotion data generation unit 200 has a function similar to that of such a kit, and it is possible to detect the emotion of the singer by machine learning the emotion analysis of the singing voice. In this case, the singing emotion data generation unit 200 can generate singing emotion data for each singing section by quantifying the detected information and classifying it into a predetermined emotion type.

Further, when the first singer and the second singer perform duet singing, the singing emotion data generation unit 200 analyzes the emotions of the first singer for the singing voice and the second singer's singing voice. It is possible to perform emotion analysis individually and create singing emotion data for each.

FIG. 3 shows an example of singing emotion data obtained by emotionally analyzing the singing voice of the second singer in the duet singing of the karaoke music X. In this example, singing emotion data is generated in which the emotion analysis results are classified into three emotion types (joy, anger, and sadness) for each singing section. Further, in this example, the total score of the three emotion types is adjusted to be 100 points or less. In the singing emotion data, the emotion type having the highest score may be set to 100 points for a certain singing section, and the other emotion types may be set to 0 points. Further, at least one emotion type may be associated with one singing section. For example, it is possible to associate only one of the most dominant emotion types with a singing section, or conversely, associate four or more emotion types.

The singing emotion data changes according to the emotion of the singer. For example, as in the singing sections A and B in FIG. 3, when the degree of tension is strong at the beginning of singing, the scores of all emotions are low. In addition, when the first singer makes a mistake in the lyrics or when the audience throws a heckler, the score of the feeling of "anger" becomes high (see the score of the singing section C in FIG. 3). In addition, when the pitch is off and the audience is ridiculed, the score of the feeling of "sadness" becomes high (see the score of the singing section F in FIG. 3). On the other hand, when singing karaoke happily, the score of the emotion of "joy" becomes high (see the scores of the singing sections D, E, G, and H in FIG. 3).

[Karaoke Singing Evaluation Department]
The karaoke singing evaluation unit 300 evaluates the singing of each singer who performs a duet singing based on the scoring value scored by the scoring processing unit 100 and the singing emotion data generated by the singing emotion data generation unit 200. ..

The singing is evaluated by comprehensively evaluating whether the singing is performed according to the reference data of the karaoke music and whether the duet partner enjoys the duet singing.

The karaoke singing evaluation unit 300 according to the present embodiment includes the scoring value of the first singer scored by the scoring processing unit 100 and the singing emotion data of the second singer generated by the singing emotion data generation unit 200. The karaoke singing of the first singer is evaluated based on.

Specifically, the karaoke singing evaluation unit 300 calculates an emotion score, which is the ratio of the joyful emotion type score to the scores of all the emotion types constituting the singing emotion data, and the emotion score and the scoring processing unit 100 calculate the emotion score. Evaluation is performed based on the calculated score value. When the emotional score shows a high score, it can be said that the singer often showed the feeling of "joy". That is, it can be determined that the singer enjoyed the duet singing.

For example, when the singing emotion data as shown in FIG. 3 is obtained, the karaoke singing evaluation unit 300 determines the ratio of the score of the “joy” emotion type to the score of all the emotion types in each singing section (that is, the emotion score). ) Is calculated. FIG. 4 is a diagram showing an emotional score in the example of FIG. Further, the karaoke singing evaluation unit 300 evaluates the karaoke singing by obtaining the average value of the emotional scores of each singing section shown in FIG. 4 and adding it to the scoring value calculated by the scoring processing unit 100.

In the example of FIG. 4, the average value of the emotional scores of the second singer is 61.24 points. Further, it is assumed that the scoring result for the karaoke singing of the first singer who sang the karaoke song X duet was 85.75 points.

In this case, the karaoke singing evaluation unit 300 uses these scores to evaluate the singing of the first singer. For example, when the weighting of "scoring result of the first singer: emotional score of the second singer = 9: 1" is set, the karaoke singing evaluation unit 300 determines (85.75 points x 0.9). ) + (61.24 points x 0.1) = 77.79 points is calculated as the score of the singing evaluation of the first singer.

Alternatively, when the emotional score of the second singer is added as a 10% bonus point to the scoring result of the first singer, the karaoke singing evaluation unit 300 gives 85.75 points + (61.24 points x 0. 1) = 91.87 points is calculated as the score of the singing evaluation of the first singer. When the addition method is adopted in this way, the upper limit is preferably the maximum value (for example, 100 points) provided in the scoring function of the karaoke device 1.

The karaoke singing evaluation unit 300 can present the evaluation result to the singer. For example, the karaoke singing evaluation unit 300 can display the calculated score on the display device 30. Alternatively, the karaoke singing evaluation unit 300 may display the scoring value of the first singer by the scoring processing unit 100 and the emotional score of the second singer separately as the singing evaluation of the first singer. good.

[Performance control unit]
The performance control unit 400 controls the performance of the karaoke music. Specifically, when the performance processing unit 400 receives the input of the music ID of the music via the remote controller 50 or the like, the performance processing unit 400 reads the music data corresponding to the music ID from the storage unit 13 and starts playing the karaoke music.

== About the operation of the karaoke device 1 ==
Next, a specific example of the operation of the karaoke device 1 in the present embodiment will be described with reference to FIG. FIG. 5 is a flowchart showing an operation example of the karaoke device 1. Here, an example will be described in which the karaoke song X selected by the first singer is duet sung together with the second singer and the singing of the first singer is evaluated.

The karaoke device 1 performs a karaoke performance based on the accompaniment data of the karaoke music X selected by the first singer (Karaoke performance, step 10). The first singer and the second singer perform a duet singing along with the performance.

After the duet singing of the karaoke song X is completed, the scoring processing unit 100 compares the singing voice data extracted from the singing voice of the first singer obtained by singing the karaoke song X with the reference data. , Calculate the scoring value (calculate the scoring value of the first singer. Step 11).

On the other hand, the singing emotion data generation unit 200 emotionally analyzes the singing voice of the second singer obtained by singing the karaoke song X, and generates singing emotion data for each singing section (second singer). Singing sentiment data of. Step 12).

The karaoke singing evaluation unit 300 sings the first singer based on the score value of the first singer calculated in step 11 and the singing emotion data of the second singer generated in step 12. (Singing evaluation of the first singer. Step 13).

In the above example, an example in which various processes are executed after the duet singing of the karaoke song X is completed has been described, but the singing emotion data is generated sequentially every time the karaoke singing in one singing section is completed. But it may be. For example, the process of step 12 is performed after the duet singing of the singing section A is completed, the process of step 12 is performed after the singing of the singing section B is completed, the process of step 12 is performed after the singing of the singing section C is completed, and so on. The process of step 12 may be repeated until the end of the karaoke song X. Similarly, when calculating the emotion score from the singing emotion data of the second singer, the karaoke singing evaluation unit 300 may sequentially calculate the emotion score for each singing section.

As described above, the karaoke device 1 according to the present embodiment scores the singing voice data extracted from the singing voice obtained by singing the karaoke music X based on at least one of pitch, volume and singing technique. The scoring processing unit 100 that calculates the scoring value, the singing emotion data generation unit 200 that generates the singing emotion data obtained by emotionally analyzing the singing voice, and the scoring value of the first singer scored by the scoring processing unit 100. It has a karaoke singing evaluation unit 300 that evaluates the singing of the first singer based on the singing emotion data of the second singer generated by the singing emotion data generation unit 200.

Specifically, the singing emotion data is composed of a plurality of emotion types including at least the joy emotion type, and the karaoke singing evaluation unit 300 has a joy emotion type score with respect to the scores of all the emotion types constituting the singing emotion data. The emotional score, which is the ratio of the above, can be calculated, and the evaluation can be performed based on the emotional score and the scoring value calculated by the scoring processing unit 100.

In this way, when evaluating the singing of the first singer, not only the scoring value based on the singing of the first singer but also the singing emotion data of the second singer who performed the duet singing together is taken into consideration. By doing so, the viewpoint of whether or not the duet partner (second singer) enjoyed the duet singing can be included in the evaluation. That is, according to the karaoke device 1 according to the present embodiment, it is possible to perform singing evaluation that reflects the emotions of the duet partner.

<Modification example>
In the above embodiment, the example in which the singing evaluation of the first singer is performed has been described, but the singing evaluation of the second singer may be performed. In this case, the karaoke singing evaluation unit 300 is based on the scoring value of the second singer scored by the scoring processing unit 100 and the singing emotion data of the first singer generated by the singing emotion data generation unit 200. And evaluate the singing of the second singer.

For example, in the example of the above embodiment, the scoring result for the karaoke singing of the second singer who sang the duet of the song X is 83.55 points, and the singing emotion data generation unit 200 generated the first singer. It is assumed that the emotional score based on the singing emotional data is 90.87 points.

In this case, the karaoke singing evaluation unit 300 uses these scores to evaluate the singing of the second singer. For example, when the weighting of "scoring result of the second singer: emotional score of the first singer = 9: 1" is set, the karaoke singing evaluation unit 300 determines (83.55 points x 0.9). ) + (90.87 points x 0.1) = 84.28 points is calculated as the score of the singing evaluation of the second singer.

In this example, the score value is higher for the first singer (first singer: 85.75 points, second singer: 83.55 points). On the other hand, it is considered that the first singer enjoyed the duet singing (emotion score: 90.87 points), but the second singer did not enjoy the duet singing so much (emotion score: 61.24). point). In such a case, the final singing evaluation is lower for the first singer.

In addition, duet singing may be performed in a situation unfavorable for the second singer, such as when the boss (first singer) forces a subordinate (second singer) to perform a duet. In such a case, the second singer wants to finish the duet singing, but it is difficult for the second singer to stop the performance by using the remote control device 50 by himself / herself.

Therefore, the performance control unit 400 may stop the performance of the karaoke music when the emotional score of the second singer falls below a predetermined value in a predetermined number of singing sections. The predetermined number and the predetermined value are values that serve as a reference for determining the stop of playing the karaoke music. Any value can be preset for the predetermined number and the predetermined value.

For example, suppose that the predetermined number is set to "4" and the predetermined value is set to "20 points". On the other hand, as a result of calculating the emotion score based on the singing emotion data of the second singer for each singing section, it is assumed that the value as shown in FIG. 6 is shown. In this case, the emotional score of the second singer is less than 20 points in the four singing sections. In this case, the performance control unit 400 automatically stops the performance of the karaoke music. The performance control unit 400 can also stop the performance when a predetermined number of emotional scores below the predetermined value are continuously continued (for example, when 20 points or less are continuously continued four times as shown in FIG. 6). Alternatively, the performance may be stopped when the emotional score below the predetermined value reaches a predetermined number (for example, when 20 points or less occur four times). With such a configuration, the duet singing can be forcibly terminated. Therefore, the first singer can be penalized as part of the singing evaluation. Moreover, since the second singer does not have to continue the duet singing that is not enthusiastic, he / she can enjoy the place of karaoke singing.

Further, for example, when the duet singing is performed in a situation unfavorable for the second singer, the selection of the karaoke music may not be appropriate. In such a case, the second singer may be able to comfortably perform a duet singing as long as it is a song that he / she is good at or has singing experience.

Here, FIG. 7 is a diagram showing a software configuration example of the karaoke main body 10 according to this modification. The karaoke main body 10 includes a scoring processing unit 100, a singing emotion data generation unit 200, a karaoke singing evaluation unit 300, a performance control unit 400, and a recommended music presentation unit 500. The scoring processing unit 100, the singing emotion data generation unit 200, the karaoke singing evaluation unit 300, the performance control unit 400, and the recommended music presentation unit 500 are realized by the CPU 11a executing a program stored in the memory 11b.

After stopping the performance of the karaoke music, the recommendation music presentation unit 500 searches for and presents the recommended music for performing a duet singing from the singing history of the second singer.

The singing history is information about karaoke singing performed by the singer in the past. The singing history includes, for example, the name of the sung song, the date and time of singing, the scoring result of the singing, and the like. Further, in the present modification, the singing history includes identification information for identifying whether or not duet singing has been performed for each karaoke song sung. The singing history is stored in the storage unit 13 (or a server device (not shown)) in association with the identifier (singer ID) of each singer.

Specifically, after the performance control unit 400 stops playing the karaoke music, the recommendation music presentation unit 500 reads the singing history of the second singer from the storage unit 13, and the second singer has sung in the past. A song for which duet singing has been performed is specified from the karaoke songs, and the display device 30 or the like is displayed as "a karaoke song recommended for duet singing". Further, when there are a plurality of karaoke songs sung by the second singer in the past duet, the recommendation song presenting unit 500 may present all the corresponding karaoke songs, and the most emotional score or singing evaluation among them. A karaoke song with a high score (that is, a karaoke song that is considered to have enjoyed the most duet singing) may be presented as a recommended song. With such a configuration, it is possible to present a karaoke song that the second singer desires to sing duet. Therefore, since the first singer can recognize the music that the second singer who sang the duet can enjoy, the singing evaluation can be improved at the next opportunity to perform the duet singing with the second singer. In addition, the second singer can easily enjoy the karaoke singing place because the duet singing becomes easy with the karaoke music that he / she can easily sing.

<Others>
The above embodiment is presented as an example and does not limit the scope of the invention. The above configurations can be implemented in appropriate combinations, and various omissions, replacements, and changes can be made without departing from the gist of the invention. The above-described embodiments and modifications thereof are included in the scope and gist of the invention, as well as in the scope of the invention described in the claims and the equivalent scope thereof.

1 Karaoke device 100 Scoring processing unit 200 Singing emotion data generation unit 300 Karaoke singing evaluation unit 400 Performance control unit

Claims (5)

A karaoke device used by a first singer who selects a karaoke song and a second singer who sings a duet of the selected karaoke song with the first singer.
A scoring processing unit that calculates a scoring value by scoring singing voice data extracted from the singing voice obtained by singing the karaoke music based on at least one of pitch, volume, and singing technique.
A singing emotion data generation unit that generates singing emotion data obtained by emotionally analyzing the singing voice,
The first singer based on the scoring value of the first singer scored by the scoring processing unit and the singing emotion data of the second singer generated by the singing emotion data generation unit. Karaoke singing evaluation department that evaluates the singing of
Karaoke device with. The karaoke singing evaluation unit is based on the scoring value of the second singer scored by the scoring processing unit and the singing emotion data of the first singer generated by the singing emotion data generation unit. The karaoke device according to claim 1, wherein the singing of the second singer is evaluated. The singing emotion data is composed of a plurality of emotion types including at least the emotion type of joy.
Based on the singing emotion data, the karaoke singing evaluation unit calculates an emotion score which is a ratio of the joy emotion type scores to the scores of all the emotion types constituting the singing emotion data, and calculates the emotion score and the emotion score and the above. The karaoke device according to claim 1 or 2, wherein the evaluation is performed based on the scoring value calculated by the scoring processing unit. It has a performance control unit that controls the performance of karaoke music.
The singing emotion data generation unit generates singing emotion data for each singing section of the karaoke song.
The karaoke device according to claim 3, wherein the performance control unit stops playing the karaoke music when the emotional score of the second singer falls below a predetermined value in a predetermined number of singing sections. .. The fourth aspect of claim 4, wherein the recommended music presenting unit is provided to search for and present a recommended music for performing a duet singing from the singing history of the second singer after stopping the performance of the karaoke music. Karaoke device.

Images