JP6944390B2 - Karaoke equipment - Google Patents

Description

The present invention relates to a karaoke device.

With the karaoke device, you can enjoy karaoke singing of various songs. The songs include Western songs that sing karaoke in foreign languages such as English and Chinese. Therefore, the lyrics telop of Western songs is displayed in a foreign language. Also, in the case of Western songs, the ruby of the native language (for example, a pseudonym) is displayed together with the lyrics telop of the foreign language, so even users who are not accustomed to pronunciation in foreign languages can enjoy karaoke singing of Western songs. It is possible. On the other hand, some users whose mother tongue is the foreign language find it difficult to sing karaoke because ruby is displayed.

Therefore, the karaoke device can display / hide ruby via a remote controller or the like. Further, Patent Document 1 discloses a technique for displaying or erasing ruby of a lyric telop depending on the degree of matching of the pronunciation of the user.

Japanese Unexamined Patent Publication No. 9-24467

By the way, when pronouncing a certain foreign language, users who have the same native language tend to have common words that are easy to pronounce and words that are difficult to pronounce. On the other hand, since the lyrics telop contains multiple words, it is highly possible that these words are mixed.

In such a case, it is complicated to turn on / off the ruby display for each word via the remote control device while singing karaoke. Further, the technique disclosed in Patent Document 1 switches the display of ruby in the next singing section according to the determination result of the degree of pronunciation matching in one singing section. Therefore, if the words included in a certain singing section are easily pronounced, the ruby in the next singing section is not displayed. However, if the next singing section contains a word that is difficult to pronounce, the user cannot refer to the ruby, which makes it difficult to sing karaoke.

An object of the present invention is to provide a karaoke device capable of switching a ruby display mode for each word according to the native language of a user when singing a song in a foreign language.

The main invention for achieving the above object is to evaluate the user's singing voice signal based on the reference information for evaluating the pronunciation when karaoke singing a song in a foreign language, and the words included in the lyrics of the song. Based on the evaluation acquisition unit that acquires pronunciation evaluation data showing the evaluation result of each pronunciation and the pronunciation evaluation data of a plurality of users who have the same native language, the statistical evaluation result of pronunciation for each word is shown. A statistical calculation unit that calculates pronunciation evaluation statistical data, and when the user sings a song in a foreign language in karaoke, the lyrics telop in the foreign language is displayed based on the lyrics telop data, and each word included in the lyrics telop is displayed. It is a karaoke device having a display control unit for displaying ruby in the native language based on the ruby data in a display mode corresponding to the pronunciation evaluation statistical data corresponding to the native language of the user.
Other features of the present invention will be clarified by the description of the description and drawings described later.

According to the present invention, when singing a song in a foreign language in karaoke, the display mode of ruby can be switched for each word according to the native language of the user.

It is a figure which shows the structure of the karaoke apparatus which concerns on embodiment. It is a figure which shows the example of the pronunciation evaluation data which concerns on embodiment. It is a figure which shows the example of the pronunciation evaluation statistical data which concerns on embodiment. It is a figure which shows the relationship between the evaluation result which concerns on embodiment, and the display mode of ruby. It is a figure which shows the display example of the lyrics telop and ruby which concerns on embodiment. It is a flowchart which shows the process of the karaoke apparatus which concerns on embodiment. It is a flowchart which shows the process of the karaoke apparatus which concerns on embodiment.

<Embodiment>
The karaoke device 1 according to the present embodiment will be described with reference to FIGS. 1 to 6B.

== Karaoke device ==
The karaoke device 1 is a device for performing karaoke performance of music selected by the user and singing karaoke by the user. As shown in FIG. 1, the karaoke device 1 includes a karaoke body 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50.

The speaker 20 is configured to emit sound based on the sound emitted signal from the karaoke main body 10. The display device 30 is configured to display an image or an image on the screen based on the signal from the karaoke main body 10. The microphone 40 is configured to convert the user's singing voice (input voice to the microphone 40) into an analog singing voice signal and input it to the karaoke main body 10.

(Karaoke hardware)
As shown in FIG. 1, the karaoke main body 10 includes a control unit 11, a communication unit 12, a storage unit 13, an acoustic processing unit 14, a display processing unit 15, and an operation unit 16. Each configuration is connected to bus B via an interface (not shown).

The karaoke body 10 performs various controls related to karaoke singing, such as karaoke performance control of selected songs, display control of lyrics and background images, and processing of singing voice signals input through a microphone 40.

The control unit 11 includes a CPU and a memory (neither of which is shown). The CPU realizes various control functions by executing an operation program stored in the memory. The memory is a storage device that stores a program to be executed by the CPU and temporarily stores various information when the program is executed.

The communication unit 12 provides an interface for connecting the karaoke body 10 to the communication line via a router (not shown).

The storage unit 13 is a large-capacity storage device that stores various types of data, such as a hard disk drive. The storage unit 13 stores a plurality of music data for performing karaoke performance by the karaoke device 1.

The music data is provided with identification information (music ID) for identifying each music. The music data includes accompaniment data, reference data, background image data, lyrics data, and attribute information. The accompaniment data is MIDI format data that is the source of the karaoke performance sound. The reference data is data used as a reference when scoring a karaoke song by a user. The reference data includes pitch (pitch) data, sound length data, timing data, and the like. The background image data is data corresponding to the background image displayed on the display device 30 or the like at the time of karaoke performance. The lyrics data is data related to lyrics (lyric telop) to be displayed on the display device 30 or the like. The attribute information is information about the music such as a song title, a singer name, a lyricist / composer name, and a genre. Further, the attribute information according to the present embodiment includes linguistic information indicating the language of the lyrics. For example, in the case of music data of Japanese lyrics, the language information "Japanese" is included as attribute information.

Here, some songs have lyrics in foreign languages. A foreign language is a language other than your mother tongue. For example, for a user whose native language is Japanese, a song that requires karaoke singing in English or Chinese (a song whose lyrics are in English or Chinese) corresponds to a song in a foreign language. In addition, for users whose native language is English, songs that require karaoke singing in Japanese (songs whose lyrics are in Japanese) correspond to songs in a foreign language.

The music data of the music in a foreign language in the present embodiment includes pronunciation reference data and ruby data in addition to accompaniment data and the like. The lyrics data of a song in a foreign language is data for displaying a lyrics telop in a foreign language. For example, the lyrics data of an English song is composed of a plurality of English words.

The pronunciation reference data is data for evaluating the pronunciation when a song in a foreign language is sung in karaoke. The pronunciation reference data is an example of "reference information".

Specifically, the pronunciation reference data is data showing the accurate pronunciation of each word included in the lyrics of the song, and is pronounced by, for example, a person whose native language is a foreign language (hereinafter, may be referred to as "native"). This is the converted data of the voice.

The above-mentioned reference data is used as a standard for comprehensive singing evaluation including pitch and rhythm in karaoke singing. On the other hand, the pronunciation reference data is used as a standard for evaluating how close the pronunciation of a certain word uttered in karaoke singing is to the native pronunciation.

Ruby data is character data for adding ruby in the native language to a lyric telop. For example, ruby data is used to add Japanese (native) ruby to English (foreign language) lyrics telops.

Based on the control of the control unit 11, the sound processing unit 14 controls the performance of the music and processes the singing voice signal input through the microphone 40. The sound processing unit 14 includes, for example, a MIDI sound source, a mixer, and an amplifier (none of which are shown). The control unit 11 sequentially reads out the accompaniment data of the reserved music based on the tempo clock signal and inputs it to the MIDI sound source. The MIDI sound source generates a musical tone signal based on the accompaniment data. The mixer mixes the musical tone signal and the singing voice signal output from the microphone 40 at an appropriate ratio and outputs the mixture to the amplifier. The amplifier amplifies the mixing signal from the mixer and outputs it to the speaker 20 as a sound emission signal. As a result, the karaoke performance sound based on the sound emission signal and the singing sound from the microphone 40 are emitted from the speaker 20.

The display processing unit 15 performs processing related to various displays in the display device 30 based on the control of the control unit 11. For example, the display processing unit 15 controls the display device 30 to display an image in which lyrics and various icons are superimposed on a background image during a karaoke performance.

The operation unit 16 includes a panel switch, a remote control reception circuit, and the like, and sends operation signals such as a music selection signal and a performance stop signal to the control unit 11 according to the operation of the panel switch of the karaoke device 1 or the remote control device 50 by the user. Output. The control unit 11 detects the operation signal from the operation unit 16 and executes the corresponding process.

The remote control device 50 is a device for performing various operations on the karaoke main body 10. The user can use the remote control device 50 to select (reserve) a karaoke song that he / she wants to sing.

(Karaoke main unit software)
As shown in FIG. 1, the karaoke main body 10 includes an evaluation acquisition unit 100, a statistical calculation unit 200, and a display control unit 300. The evaluation acquisition unit 100, the statistical calculation unit 200, and the display control unit 300 are realized by the CPU executing a program stored in the memory.

[Evaluation acquisition department]
The evaluation acquisition unit 100 evaluates the user's singing voice signal based on the reference information for evaluating the pronunciation when singing a karaoke song in a foreign language, and evaluates the pronunciation of each word included in the lyrics of the song. Acquire pronunciation evaluation data showing the result.

The evaluation result is obtained by evaluating how much the user can pronounce a word that is close to the native pronunciation. The evaluation result can be set, for example, as a pronunciation level of 5 levels from 1 to 5 (the larger the number, the closer to the native pronunciation).

As a specific example, it is assumed that a user A whose mother tongue is Japanese sings a karaoke song of an English (foreign language) song X. In this case, the evaluation acquisition unit 100 reads the pronunciation reference data of the music X from the storage unit 13 and evaluates the pronunciation for each word by comparing with the singing voice signal obtained by the karaoke singing of the user A. For example, when the characteristic pattern of a word obtained by analyzing the singing voice signal is close to the pronunciation reference data of the word, the evaluation acquisition unit 100 evaluates that the pronunciation of the word is similar to the native pronunciation. do. In this case, the evaluation acquisition unit 100 sets an evaluation result that the pronunciation level of the word is high (in the above example, the numerical value is “5”). The evaluation acquisition unit 100 acquires pronunciation evaluation data for the user A by setting the pronunciation level for all the words included in the music X. The evaluation acquisition unit 100 stores the acquired pronunciation evaluation data in the storage unit 13. Similarly, when another user sings a karaoke song in a foreign language, the evaluation acquisition unit 100 stores the pronunciation evaluation data acquired for each user in the storage unit 13. FIG. 2 is an example of pronunciation evaluation data of each of users A to C (users whose mother tongue is Japanese) stored in the storage unit 13. Here, pronunciation levels of "1" to "5" are set as evaluation results for each word.

In order to acquire the pronunciation evaluation data of a certain user, the evaluation acquisition unit 100 needs to specify the mother tongue of the certain user. At this time, the evaluation acquisition unit 100 can specify the mother tongue by referring to the user information registered in advance for each user. In addition, the display control unit 300 causes the remote controller device 50 to display a screen for selecting a native language when reserving a musical piece. A user selects his / her native language on the screen. The evaluation acquisition unit 100 identifies a user's native language based on the input. Alternatively, the evaluation acquisition unit 100 may specify the native language of the user based on the language used displayed on the screen of the remote controller device 50.

After identifying the native language of the user, the evaluation acquisition unit 100 determines whether or not it is necessary to acquire the pronunciation evaluation data based on whether or not the language of the reserved music matches the identified native language.

In addition, pronunciation evaluation data is acquired for each foreign language. For example, when the user A sings an English song and a Chinese song in karaoke, the storage unit 13 stores the pronunciation evaluation data for English and the pronunciation evaluation data for Chinese separately. Further, the acquired pronunciation evaluation data may be stored in a server (not shown) together with the singing history.

[Statistical calculation unit]
The statistical calculation unit 200 calculates pronunciation evaluation statistical data showing a statistical evaluation result of pronunciation for each word based on pronunciation evaluation data of a plurality of users who have the same native language.

Specifically, the statistical calculation unit 200 reads out the pronunciation evaluation data of users who have the same native language from the storage unit 13. Then, the statistical calculation unit 200 obtains the statistics of the evaluation result for each word included in the pronunciation evaluation data. Statistics can be obtained as general statistical values such as mean value, deviation value, variance value, standard deviation, and the like.

For example, it is assumed that users A to E each sing a karaoke song of an English song X. It is assumed that the native languages of users A to C are Japanese, and the native languages of users D and E are Chinese. It is assumed that the storage unit 13 stores the pronunciation evaluation data of each user acquired based on the karaoke singing of the music X.

In this case, the statistical calculation unit 200 reads the pronunciation evaluation data for English of the users A to C from the storage unit 13 and evaluates each word. For example, the evaluation results of the English word "love" shown in FIG. 2 are "4" for user A, "3" for user B, and "5" for user C. The statistical calculation unit 200 calculates "4", which is the average value of each evaluation result, as a statistical evaluation result for the English word "love".

The statistical calculation unit 200 calculates pronunciation evaluation statistical data (data of users having the same native language) of users A to C by performing the same processing on all the words included in the music X. The statistical calculation unit 200 stores the calculated pronunciation evaluation statistical data in the storage unit 13. FIG. 3 is a diagram showing pronunciation evaluation statistical data based on pronunciation evaluation data of users A to C.

Information that identifies the mother tongue is associated with the pronunciation evaluation statistical data. In addition, each word included in the pronunciation evaluation statistical data is associated with a population (the number used in the statistics). In the pronunciation evaluation statistical data shown in FIG. 3, "Japanese" is associated as the mother tongue, and each word ("love", "midnight", "of", "promises", "week") is associated with it. Are associated with the population parameter "3".

The population parameter of words included in songs that are often sung in karaoke, such as Western songs that hit at a certain time, may increase sharply. As the population parameter increases, the change in pronunciation evaluation statistical data becomes scarce. Therefore, it is preferable that the statistical calculation unit 200 calculates the pronunciation evaluation statistical data based on a predetermined number of pronunciation evaluation data. Furthermore, as the population parameter increases, it is conceivable that the pronunciation skills of all users will improve. Therefore, it is preferable that the statistical calculation unit 200 calculates the pronunciation evaluation statistical data based on the pronunciation evaluation data (for example, the pronunciation evaluation data of the last 100 times) whose acquisition time is relatively new.

Further, in the above example, the pronunciation evaluation statistical data is calculated using the pronunciation evaluation data indicating the pronunciation evaluation result for each word included in the lyrics of the music X, but the present invention is not limited to this. For example, assume that user A sings karaoke of English song X, user B sings karaoke of English song Y, and user C sings karaoke of English song Z. Further, it is assumed that the lyrics of each song contain the English word "love". In this case, the statistical calculation unit 200 can also calculate the statistical evaluation result based on the pronunciation level of the English word "love" included in each song. Furthermore, if the songs are different, there is a high possibility that some words are included in only one of the songs. In such a case, the statistical calculation unit 200 may obtain the pronunciation evaluation statistical data as the evaluation result of the user who has the same native language as the pronunciation level of the word. On the other hand, when there is a word included in only one of the songs, the statistical calculation unit 200 may obtain the pronunciation evaluation statistical data excluding the evaluation result of the word.

Here, the statistical calculation unit 200 stores the pronunciation evaluation statistical data already stored in the storage unit 13 each time a user having the same native language sings a karaoke song in a foreign language (every time the pronunciation evaluation data is acquired). It is preferable to recalculate. It is also possible to add the pronunciation evaluation result for a new word to the pronunciation evaluation statistical data each time.

Specifically, when the word included in the pronunciation evaluation statistical data is sung again in karaoke, the statistical calculation unit 200 recalculates the statistical evaluation result including the pronunciation evaluation result for the word. When the pronunciation evaluation statistical data is changed in and a new word not included in the pronunciation evaluation statistical data is sung in karaoke, the pronunciation evaluation result for the new word is added to the pronunciation evaluation statistical data.

For example, it is assumed that the pronunciation evaluation statistical data shown in FIG. 3 is stored in the storage unit 13. After that, when the user F whose mother tongue is Japanese sings the karaoke of the English song X, the evaluation acquisition unit 100 evaluates the singing voice signal of the user F and acquires the pronunciation evaluation data.

The statistical calculation unit 200 reads out the pronunciation evaluation statistical data shown in FIG. 3 from the storage unit 13 and recalculates the statistical evaluation result including the pronunciation evaluation data of the user F. For example, it is assumed that the evaluation result of the user F is "3" for the English word "love". In this case, the statistical calculation unit 200 has the average value "4" (parameter 3) of the evaluation results of the English words "love" of the users A to C stored in the storage unit 13 and the evaluation of the user F. Based on the result "3", the statistical evaluation result is obtained again. In this example, the statistical calculation unit 200 newly adds (statistical evaluation result "4" x parameter "3") + evaluation result "3" of user F / parameter "4" = "3.75". Calculated as a statistical evaluation result. In addition, the parameter "4" is newly associated with the English word "love".

The statistical calculation unit 200 changes the pronunciation evaluation statistical data by recalculating the statistical evaluation results and updating the population parameter for all the words included in the music X.

On the other hand, it is assumed that the user F sings the English song Y in karaoke. Here, when the English word "data" that is not included in the music X is included in the music Y, the evaluation acquisition unit 100 receives the singing voice signal obtained by the karaoke singing of the user F and the music Y. The pronunciation of the new word "death" is evaluated based on the pronunciation reference data of, and the evaluation result is acquired as the value of the pronunciation level. In this case, the statistical calculation unit 200 adds the acquired evaluation result to the pronunciation evaluation statistical data of the user whose mother tongue is Japanese.

[Display control unit]
The display control unit 300 controls the display processing unit 15 and performs various display controls on the karaoke device 1.

In the present embodiment, when the user sings a song in a foreign language in karaoke, the display control unit 300 displays the lyrics telop in the foreign language based on the lyrics telop data, and for each word included in the lyrics telop, The lyrics of the native language based on the ruby data are displayed in a display mode according to the pronunciation evaluation statistical data corresponding to the native language of the user.

For example, suppose user A whose mother tongue is Japanese sings English song Z in karaoke. Further, it is assumed that the data shown in FIG. 3 is stored in the storage unit 13 as pronunciation evaluation statistical data of a user whose mother tongue is Japanese.

The display control unit 300 reads the lyrics telop data of the music Z from the storage unit 13, and causes the display device 30 to display the English lyrics telop in accordance with the karaoke performance of the music Z. Further, the display control unit 300 reads the ruby data of the music Z from the storage unit 13 and displays the ruby together with the display of the lyrics telop.

At this time, the display control unit 300 confirms whether or not the word included in the lyrics telop is included in the pronunciation evaluation statistical data shown in FIG. When the word included in the lyrics telop is included in the pronunciation evaluation statistical data, the display control unit 300 displays ruby in a display mode according to the evaluation result of the word.

The relationship between the evaluation result and the display mode of ruby is preset. FIG. 4 is table data that defines the relationship between the pronunciation level value as the evaluation result and the display mode of ruby. In FIG. 4, the higher the pronunciation level value (the more natively approximated pronunciation is), the smaller the ruby display size (when the pronunciation level is the maximum value, the ruby is not displayed) is set. Has been done. Such table data is stored in, for example, the storage unit 13. Instead of using the table data, the display size of ruby may be functionally determined based on a predetermined conversion formula.

Here, it is assumed that the word "promises" is included in the lyrics telop of the song Z. In this case, the display control unit 300 identifies the pronunciation level value "1.7" of the word "promises" from the pronunciation evaluation statistical data shown in FIG. 3, and refers to the table data shown in FIG. 4 to obtain the pronunciation level value. The display mode corresponding to "1.7" is determined. Then, the display control unit 300 displays the ruby "promises" of the word "primises" in a size 1.5 times the normal size (see FIG. 5). In the example of FIG. 5, the word "Do" is not displayed because the pronunciation level value is "5", and the words "believe" and "false" are normal sizes because the pronunciation level value is "3". It is displayed at (1.0 times), and the word "not" is displayed at a size (0.8 times) slightly smaller than the normal size because the pronunciation level value is "4".

On the other hand, when displaying a new word not included in the pronunciation evaluation statistical data as a lyrics telop, the display control unit 200 displays ruby based on the ruby data in a predetermined display mode.

The predetermined display mode is set in advance in the ruby data. For example, when changing the display size of ruby, a normal size (1.0 times) is set as a predetermined display mode.

The change in the display mode is not limited to the change in the display size of ruby. For example, the display color and brightness of ruby may be changed, or the display time and timing of ruby may be changed (words with a low pronunciation level value are displayed earlier, etc.). Alternatively, the ruby font may be changed or the ruby may be underlined. The relationship between the evaluation result (pronunciation level) and the ruby display mode (display color, brightness, display time, display timing, font, presence / absence of underline, etc.) is preset as table data as described above, and is stored in the storage unit 13. It may be stored, or the display mode may be determined functionally based on a predetermined conversion formula. Moreover, you may change the display mode by combining these.

== About the operation of the karaoke device 1 ==
Next, a specific example of the operation of the karaoke device 1 in the present embodiment will be described with reference to FIGS. 6A and 6B.

[Acquisition of pronunciation evaluation statistical data]
FIG. 6A is a flowchart showing an operation example of the karaoke device 1 when acquiring pronunciation evaluation statistical data.

When a user whose native language is Japanese sings a karaoke song of English song X, the karaoke device 1 uses pronunciation evaluation statistical data when a user whose native language is Japanese sings an English song. , Read from the storage unit 13 (pronunciation evaluation statistical data read. Step 10), and acquire a singing voice signal based on the voice obtained through the microphone 40 (acquisition of singing voice signal. Step 11).

The evaluation acquisition unit 100 reads the pronunciation reference data of the song X from the storage unit 13 and compares it with the singing voice signal obtained in step 11 to evaluate the pronunciation for each word included in the lyrics of the song X. Acquire pronunciation evaluation data (acquisition of pronunciation evaluation data. Step 12).

When the word included in the pronunciation evaluation statistical data read in step 10 is sung again in karaoke (in the case of Y in step 13), the statistical calculation unit 200 includes statistics including the pronunciation evaluation result for the word. The pronunciation evaluation statistical data is changed by recalculating the typical evaluation result (change of pronunciation evaluation statistical data. Step 14). The statistical calculation unit 200 stores the pronunciation evaluation statistical data calculated in step 14 in the storage unit 13 (memory of pronunciation evaluation statistical data. Step 15). On the other hand, when a new word not included in the pronunciation evaluation statistical data is sung in karaoke (in the case of N in step 13), the statistical calculation unit 200 converts the pronunciation evaluation result for the new word into the pronunciation evaluation statistical data. Add and memorize (add and memorize the evaluation result to the pronunciation evaluation statistical data. Step 16). The statistical calculation unit 200 repeats the processes of steps 11 to 16 until the statistical evaluation results are calculated for all the words included in the music X (until the case of Y in step 17).

[Display of ruby]
FIG. 6B is a flowchart showing an operation example of the karaoke device 1 when displaying ruby. In this example, it is assumed that the pronunciation evaluation statistical data for English of a user whose mother tongue is Japanese has already been acquired by the process shown in FIG. 6A and stored in the storage unit 13.

Here, when a user whose native language is Japanese sings a karaoke song of the English song Y, the display control unit 300 reads the lyrics telop data of the song Y from the storage unit 13 and displays it according to the karaoke performance. Display the lyrics telop on 30 (display of the lyrics telop. Step 20). The native language of the user is specified, for example, based on the user information registered in advance for the user when the user logs in to the karaoke device 1.

At this time, the display control unit 300 confirms whether or not the word included in the displayed lyrics telop is included in the pronunciation evaluation statistical data stored in the storage unit 13. When the word included in the displayed lyrics telop is included in the pronunciation evaluation statistical data (in the case of Y in step 21), the display control unit 300 responds to the pronunciation evaluation statistical data according to the display of the lyrics telop. The ruby is displayed in the display mode (the ruby is displayed in the display mode according to the pronunciation evaluation statistical data. Step 22).

On the other hand, when the word included in the displayed lyrics telop is not included in the pronunciation evaluation statistical data (in the case of N in step 21), the display control unit 300 sets a predetermined value according to the display of the lyrics telop. The ruby is displayed in the display mode of (step 23).

The display control unit 300 repeats the processes of steps 20 to 23 until all the lyrics telop and ruby of the music Y are displayed (in the case of Y in step 24).

As is clear from the above, the karaoke device 1 according to the present embodiment evaluates the singing voice signal of the user based on the pronunciation reference data for evaluating the pronunciation when karaoke singing a song in a foreign language. Statistics of pronunciation for each word based on the evaluation acquisition unit 100 that acquires pronunciation evaluation data indicating the evaluation result of pronunciation for each word included in the lyrics of the song, and the pronunciation evaluation data of a plurality of users who share the same native language. A statistical calculation unit 200 that calculates pronunciation evaluation statistical data showing a typical evaluation result, and when a user sings a song in a foreign language in karaoke, the lyrics telop in the foreign language is displayed based on the lyrics telop data, and the lyrics It is a karaoke device having a display control unit 300 for displaying the ruby of the native language based on the ruby data in a display mode corresponding to the pronunciation evaluation statistical data corresponding to the native language of the user for each word included in the telop.

According to such a karaoke device 1, when singing a karaoke song in a foreign language, it is possible to switch the display mode of ruby for each word according to the mother tongue of the user. Specifically, the karaoke device 1 has ruby characters for each word included in the lyrics telop according to the statistical evaluation result (for example, the average value of the pronunciation level) based on the pronunciation evaluation data of users who have the same native language. The display mode can be switched. Therefore, for example, by not displaying ruby for words that are easy to pronounce, there is no situation in which the display of ruby interferes with karaoke singing. In addition, for words that are difficult to pronounce, by displaying the ruby in a large size, it becomes easier to see the ruby, and karaoke singing is currently being performed to show that the words that are common to users who have the same native language are difficult to pronounce. Since the user can easily recognize it, he / she can sing karaoke with caution. Further, since the ruby display mode is changed according to the pronunciation evaluation statistical data calculated in advance, it is possible to avoid the situation where the ruby is not displayed even though the word is difficult to pronounce.

Further, when the word included in the pronunciation evaluation statistical data is sung again in karaoke, the statistical calculation unit 200 pronounces the word by recalculating the statistical evaluation result including the evaluation result of the pronunciation of the word. When the evaluation statistical data is changed and a new word not included in the pronunciation evaluation statistical data is sung in karaoke, the pronunciation evaluation result for the new word is added to the pronunciation evaluation statistical data. In this way, by updating the statistical evaluation results of the words that have already been evaluated, it is possible to change the display mode of ruby to reflect the proficiency level of the foreign language of the user who has the same mother tongue. Further, by adding the pronunciation evaluation result for a new word as a part of the pronunciation evaluation statistical data, it is possible to increase the number of ruby characters whose display modes can be switched.

Further, when displaying a new word not included in the pronunciation evaluation statistical data as a lyrics telop, the display control unit 300 displays ruby based on the ruby data in a predetermined display mode. According to such a configuration, even when karaoke singing a song having a new word not included in the pronunciation evaluation data, the ruby can be displayed in an appropriate display mode that is easy for the user to refer to. ..

<Others>
In the above embodiment, an example of acquiring singing evaluation data by comparing a singing voice signal and pronunciation reference data has been described, but the present invention is not limited to this. Singing evaluation data can be obtained by using a database containing pattern data that classifies the pronunciation characteristics of the native language and the foreign language. In this case, the music data does not need to include the pronunciation reference data. Such a database is an example of "basic information".

Specifically, the karaoke device 1 (storage unit 13) stores a database composed of English pronunciation feature pattern data pronounced by Japanese and native pronunciation feature pattern data. Here, when the user A sings a karaoke song of the music X in a foreign language, the evaluation acquisition unit 100 analyzes the singing audio signal and extracts a feature pattern for each word. The evaluation acquisition unit 100 compares the extracted feature patterns with the database, and sets the pronunciation level value according to the degree of approximation with the Japanese pronunciation and the degree of approximation with the native pronunciation. The evaluation acquisition unit 100 acquires the pronunciation evaluation data of the user A by setting the pronunciation level values for all the words included in the music X (details regarding the comparison process between the extracted feature pattern and the database). See Japanese Patent Application Laid-Open No. 2001-282096).

In addition, even users who use the same mother tongue have strengths and weaknesses in pronunciation of the same word due to various differences such as age, gender, and foreign language skills. Therefore, the statistical calculation unit 200 may calculate the pronunciation evaluation statistical data in consideration of the difference between them.

Specifically, the statistical calculation unit 200 calculates pronunciation evaluation statistical data for each of a plurality of users who have the same native language and who have the same identification information including at least age and / or gender.

The identification information is information for distinguishing users who have the same native language, and includes at least age and / or gender. Other identification information includes study abroad history, overseas residence history, test results and qualifications related to foreign languages (for example, TOEIC (registered trademark) score, Practical English proficiency test series), user's address or singing place, or foreign language. The singing history of the song of the word can be used. These identification information may be included in the user information of each user, for example, or may be stored in the storage unit 13 in association with the pronunciation evaluation data of each user.

In addition, the display control unit 300 displays ruby in the native language based on the ruby data in a display mode corresponding to the pronunciation evaluation statistical data corresponding to the user's native language and identification information.

For example, suppose a man in his twenties whose mother tongue is Japanese sings karaoke of English song X. In this case, the statistical calculation unit 200 reads out the pronunciation evaluation data of a plurality of users whose mother tongue is Japanese from the storage unit 13. Then, the statistical calculation unit 200 extracts only the pronunciation evaluation data of men in their twenties based on the identification information associated with the read pronunciation evaluation data. The statistical calculation unit 200 calculates the pronunciation evaluation statistical data based on the extracted pronunciation evaluation data. The display control unit 300 displays Japanese ruby based on the ruby data in a display mode according to the calculated pronunciation evaluation statistical data.

The age and gender of the user who sings karaoke may be specified based on the user information registered in advance, or predetermined identification information may be input in advance before singing karaoke. Alternatively, the age and gender of the user who sings karaoke may be specified by using a known face recognition technique.

In this way, by calculating the pronunciation evaluation statistical data for each user who has the same identification information from among a plurality of users who have the same native language, the ruby is displayed in a display mode more suitable for the user who sings karaoke. Is possible.

The above embodiment is presented as an example and does not limit the scope of the invention. The above configurations can be implemented in appropriate combinations, and various omissions, replacements, and changes can be made without departing from the gist of the invention. The above-described embodiments and modifications thereof are included in the scope and gist of the invention, as well as in the scope of the invention described in the claims and the equivalent scope thereof.

1 Karaoke device 100 Evaluation acquisition unit 200 Statistics calculation unit 300 Display control unit

Claims (5)

Pronunciation evaluation data that evaluates the user's singing voice signal based on the reference information for evaluating the pronunciation when singing a foreign language song in karaoke, and shows the evaluation result of the pronunciation of each word included in the lyrics of the song. With the evaluation acquisition department to acquire
A statistical calculation unit that calculates pronunciation evaluation statistical data showing statistical evaluation results of pronunciation for each word based on the pronunciation evaluation data of a plurality of users who share the same native language.
When the user sings a song in a foreign language in karaoke, the lyrics telop in the foreign language is displayed based on the lyrics telop data, and each word included in the lyrics telop corresponds to the user's native language. A display control unit that displays the lyrics of the native language based on the lyrics data in a display mode according to the pronunciation evaluation statistical data,
Karaoke device with. When the word included in the pronunciation evaluation statistical data is sung again in karaoke, the statistical calculation unit recalculates the statistical evaluation result including the pronunciation evaluation result for the word, thereby calculating the pronunciation. When the evaluation statistical data is changed and a new word not included in the pronunciation evaluation statistical data is sung in karaoke, the pronunciation evaluation result for the new word is added to the pronunciation evaluation statistical data. The karaoke device according to claim 1. Claim 1 or 2 is characterized in that, when displaying a new word not included in the pronunciation evaluation statistical data as a lyrics telop, the display control unit displays ruby based on the ruby data in a predetermined display mode. The karaoke device described. The karaoke device according to any one of claims 1 to 3, wherein the display control unit displays ruby in the native language based on the ruby data in a size corresponding to the pronunciation evaluation statistical data. The statistical calculation unit calculates the pronunciation evaluation statistical data for each of a plurality of users who have the same native language and who have the same identification information including at least age and / or gender.
The display control unit according to claims 1 to 4, wherein the display control unit displays ruby in the mother tongue based on the ruby data in a display mode corresponding to the pronunciation evaluation statistical data corresponding to the user's mother tongue and identification information. The karaoke device described in any one.

Images