JP2019117284A - Karaoke device - Google Patents

Abstract

To provide a karaoke device capable of switching a display mode of ruby for each word in accordance with a user when music of a foreign language is karaoke-sung.SOLUTION: A karaoke device comprises: an evaluation acquisition section for evaluating a singing voice signal of a user on the basis of reference information for evaluating pronunciation when music of a foreign language is karaoke-sung and acquiring pronunciation evaluation data indicative of an evaluation result of pronunciation for each word, which is included in lyrics of the music; and a display control section for displaying lyrics telop of the foreign language on the basis of lyrics telop data when the user karaoke-sings the music of the foreign language, and displaying ruby of a native language on the basis of ruby data at a display mode corresponding to the pronunciation evaluation data of the user for each word included in the lyrics telop.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a karaoke apparatus.

  The karaoke apparatus can enjoy karaoke singing of various songs. Among the songs are Western songs that perform karaoke singing in foreign languages such as English and Chinese. For this reason, the lyrics telops of Western music are displayed in a foreign language. Also, in the case of Western music, Rubi in the native language (for example, pseudonym) is displayed together with the lyrics telop of the foreign language, so even users who are not used to pronunciation in foreign languages can enjoy karaoke singing of Western music It has become possible. On the other hand, some users who are good at pronunciation in foreign languages and some users who use the foreign language as their native language may find it difficult to perform karaoke singing by displaying ruby.

  Therefore, the karaoke apparatus can display / hide ruby via a remote control device or the like. Further, Patent Document 1 discloses a technique for displaying or deleting a ruby of a lyric telop according to the matching degree of the user's pronunciation.

Japanese Patent Application Laid-Open No. 9-244667

  By the way, even in the same foreign language, there are words easy to pronounce and difficult words for each user. On the other hand, since the lyric telop contains a plurality of words, there is a high possibility that these words are mixed.

  In such a case, it is troublesome to turn on / off the display of ruby for each word through the remote control device while performing karaoke singing. Moreover, the technique disclosed by patent document 1 switches the display of the ruby in the following song area according to the determination result of the pronunciation | voice matching degree in a certain song area. Therefore, when it is easy to pronounce a word included in a certain song section, ruby in the next song section is not displayed. However, if the next song section contains a word that is difficult to pronounce, the user can not refer to ruby, which makes it difficult to perform karaoke singing.

  An object of the present invention is to provide a karaoke apparatus capable of switching the display mode of ruby for each word according to the user when karaoke songs of foreign languages are sung.

The main invention for achieving the above object is to evaluate the user's singing voice signal based on the reference information for evaluating the pronunciation when singing a karaoke song of a foreign language, and the words included in the lyrics of the music An evaluation acquisition unit for acquiring pronunciation evaluation data indicating evaluation results of each pronunciation, and displaying the lyrics telop of the foreign language based on the lyrics telop data when the user sings karaoke songs of the foreign language and And a display control unit configured to display ruby in a native language based on ruby data in a display mode corresponding to the pronunciation evaluation data of the user for each word included in the lyrics telop.
Other features of the present invention will become apparent from the description of the specification and the drawings described below.

  According to the present invention, it is possible to switch the display mode of the ruby for each word according to the user when performing karaoke singing of music in a foreign language.

It is a figure showing composition of a karaoke device concerning an embodiment. It is a figure which shows the example of the pronunciation evaluation data which concern on embodiment. It is a figure which shows the example of the pronunciation evaluation data which concern on embodiment. It is a figure which shows the relationship between the evaluation result which concerns on embodiment, and the display aspect of ruby. It is a figure which shows the example of a display of the lyrics telop and ruby which concern on embodiment. It is a flow chart which shows processing of a karaoke device concerning an embodiment. It is a flow chart which shows processing of a karaoke device concerning an embodiment.

First Embodiment
A karaoke apparatus 1 according to the present embodiment will be described with reference to FIGS. 1 to 6B.

== Karaoke device ==
The karaoke apparatus 1 is an apparatus for performing a karaoke performance of a music selected by the user and a user singing a karaoke song. As shown in FIG. 1, the karaoke apparatus 1 includes a karaoke body 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50.

  The speaker 20 is configured to emit sound based on the sound emission signal from the karaoke body 10. The display device 30 is configured to display an image or an image on a screen based on a signal from the karaoke body 10. The microphone 40 is configured to convert a user's singing voice (input voice to the microphone 40) into an analog singing voice signal and input it to the karaoke body 10.

(Hardware of karaoke itself)
As shown in FIG. 1, the karaoke body 10 includes a control unit 11, a communication unit 12, a storage unit 13, an acoustic processing unit 14, a display processing unit 15, and an operation unit 16. Each configuration is connected to the bus B via an interface (not shown).

  The karaoke body 10 performs various controls related to karaoke singing, such as karaoke performance control of selected music, display control of lyrics and background images, and processing of a singing voice signal input through the microphone 40.

  The control unit 11 includes a CPU and a memory (all not shown). The CPU implements various control functions by executing the operation program stored in the memory. The memory is a storage device that stores a program to be executed by the CPU or temporarily stores various information when the program is executed.

  The communication unit 12 provides an interface for connecting the karaoke body 10 to a communication line via a router (not shown).

  The storage unit 13 is a large-capacity storage device for storing various data, and is, for example, a hard disk drive. The storage unit 13 stores a plurality of music data for performing a karaoke performance by the karaoke apparatus 1.

  The music data is provided with identification information (music ID) for specifying each music. The music data includes accompaniment data, reference data, background image data, lyric data, and attribute information. The accompaniment data is MIDI format data that is the source of the karaoke performance sound. Reference data is data used as a standard when scoring a karaoke song by a user. The reference data includes pitch (pitch) data, tone length data, timing data, and the like. The background image data is data corresponding to the background image displayed on the display device 30 or the like in accordance with the karaoke performance. The lyric data is data relating to lyric (lyric telop) to be displayed on the display device 30 or the like. The attribute information is information on the music, such as a song name, a singer name, a lyrics / composer name, and a genre.

  Here, in the music, there is a music whose lyrics are in a foreign language. Foreign languages are languages other than the native language. For example, for a user whose native language is Japanese, music requiring karaoke singing in English or Chinese (music with lyrics in English or Chinese) corresponds to music in a foreign language.

  The music data of the music of the foreign language in this embodiment includes pronunciation reference data and ruby data in addition to the accompaniment data and the like. In addition, the lyric data of the music of a foreign language is data for displaying the lyric telop by a foreign language. For example, the lyric data of an English song is composed of a plurality of English words.

  The pronunciation reference data is data for evaluating pronunciation when karaoke songs of foreign languages are sung. The pronunciation reference data is an example of “reference information”.

  Specifically, the pronunciation reference data is data indicating the correct pronunciation of each word included in the lyrics of the music. For example, a person whose native language is a foreign language (hereinafter sometimes referred to as "native") pronounces Data obtained by converting the generated voice.

  The reference data described above is used as a basis for comprehensive song evaluation including pitches and rhythms in karaoke singing. On the other hand, the pronunciation reference data is used as a reference for evaluating how closely the pronunciation of a word uttered in a karaoke song is similar to the native pronunciation.

  The ruby data is character data for adding ruby in the native language to the lyric telop. For example, ruby data is used to attach Japanese (native language) ruby to English (foreign language) lyrics telops.

  The sound processing unit 14 controls the performance of the music and processes the singing voice signal input through the microphone 40 based on the control of the control unit 11. The sound processing unit 14 includes, for example, a MIDI sound source, a mixer, and an amplifier (all not shown). The control unit 11 sequentially reads accompaniment data of the reserved music based on the tempo clock signal, and inputs it to the MIDI sound source. The MIDI sound source generates a tone signal based on the accompaniment data. The mixer mixes the musical tone signal and the singing voice signal output from the microphone 40 at an appropriate ratio, and outputs the mixed signal to the amplifier. The amplifier amplifies the mixing signal from the mixer and outputs it to the speaker 20 as a sound emission signal. As a result, from the speaker 20, the karaoke performance sound based on the sound emission signal and the singing voice from the microphone 40 are emitted.

  The display processing unit 15 performs processing regarding various displays on the display device 30 based on the control of the control unit 11. For example, the display processing unit 15 controls the display device 30 to display an image in which lyrics and various icons are superimposed on a background image during karaoke performance.

  The operation unit 16 is composed of a panel switch and a remote control reception circuit, etc., and sends an operation signal such as a music selection signal or a performance stop signal to the control unit 11 according to the user's operation of the panel switch of the karaoke apparatus 1 Output. Control unit 11 detects an operation signal from operation unit 16 and executes a corresponding process.

  The remote control device 50 is a device for performing various operations on the karaoke body 10. The user can use the remote control device 50 to perform song selection (reservation) or the like of karaoke music for which singing is desired.

(Karaoke's software)
As shown in FIG. 1, the karaoke body 10 includes an evaluation acquisition unit 100 and a display control unit 200. The evaluation acquisition unit 100 and the display control unit 200 are realized by the CPU executing a program stored in the memory.

[Evaluation acquisition unit]
The evaluation acquisition unit 100 evaluates the user's singing voice signal based on the standard information for evaluating the pronunciation when singing a karaoke song of a foreign language song, and evaluates the pronunciation of each word included in the lyrics of the song Acquire pronunciation evaluation data indicating the result.

  The evaluation result is obtained by evaluating how much native pronunciation was obtained when the user pronounced a certain word. The evaluation result can be set, for example, as a pronunciation level of five levels 1 to 5 (the larger the number, the closer to the native pronunciation).

  As a specific example, it is assumed that user A performs karaoke singing of English music X. In this case, the evaluation acquisition unit 100 reads the pronunciation reference data of the music X from the storage unit 13 and evaluates the pronunciation for each word in comparison with the singing voice signal obtained by the user A's karaoke singing. For example, when the feature pattern of a certain word obtained by analyzing a singing voice signal is close to the pronunciation reference data of the certain word, the evaluation acquiring unit 100 evaluates that the pronunciation of the word is a pronunciation similar to native. Do. In this case, the evaluation acquisition unit 100 sets an evaluation result that the pronunciation level of the word is high (in the example, the numerical value “5”). The evaluation acquisition unit 100 acquires the pronunciation evaluation data for the user A by setting the pronunciation levels for all the words included in the music X. The evaluation acquisition unit 100 stores the acquired pronunciation evaluation data in the storage unit 13 for each user. FIG. 2 is an example of the pronunciation evaluation data of the user A stored in the storage unit 13. Here, the pronunciation levels "1" to "5" are set as the evaluation result for each word.

  In addition, the evaluation acquisition unit 100 updates and adds the already stored evaluation result each time the user A sings a karaoke song in a foreign language.

  Specifically, when the word included in the pronunciation evaluation data is sung again, the evaluation acquisition unit 100 updates the evaluation result of the pronunciation for the word, and the evaluation acquisition unit 100 newly generates a new one not included in the pronunciation evaluation data. When a word is singed karaoke, the evaluation result of pronunciation for the new word is added.

  For example, when the pronunciation evaluation data shown in FIG. 2 is stored in the storage unit 13, it is assumed that the user A performs karaoke singing of English music Y. Here, when the same word "love" as the music X is included in the music Y, the evaluation acquisition unit 100 evaluates the pronunciation of the word "love" of the user A again, and the already stored pronunciation If it differs from the level value, it is updated to the value of the evaluated pronunciation level again. In addition, when the word “death” not included in the music X is included in the music Y, the evaluation acquisition unit 100 generates the singing voice signal obtained by the user A's karaoke singing and the pronunciation of the music Y Based on the reference data, the pronunciation of the new word "death" is evaluated, and the evaluation result is added to the pronunciation evaluation data of FIG. 2 as the value of the pronunciation level (see FIG. 3).

  The pronunciation evaluation data is acquired for each foreign language. For example, when the user A sings an English song and a Chinese song in karaoke, the storage unit 13 separately stores pronunciation evaluation data for English and pronunciation evaluation data for Chinese. In addition, the acquired pronunciation evaluation data may be stored in a server (not shown) along with the singing history.

[Display control unit]
The display control unit 200 controls the display processing unit 15 to perform various display control in the karaoke apparatus 1.

  In the present embodiment, the display control unit 200 displays the lyrics telop of the foreign language based on the lyrics telop data when the user sings karaoke songs of the foreign language, and for each word included in the lyrics telop, The ruby of the native language based on the ruby data is displayed in a display mode according to the user's pronunciation evaluation data.

  For example, it is assumed that user A sings karaoke song Z in a foreign language. Further, it is assumed that data shown in FIG. 3 is stored in the storage unit 13 as the pronunciation evaluation data of the user A.

  The display control unit 200 reads the lyrics telop data of the music Z from the storage unit 13 and causes the display device 30 to display the lyrics telop in a foreign language in accordance with the karaoke performance of the music Z. Further, the display control unit 200 reads ruby data of the music Z from the storage unit 13 and displays the ruby together with the display of the lyrics telop.

  At this time, the display control unit 200 confirms whether or not the word included in the lyrics telop is included in the pronunciation evaluation data shown in FIG. When a word included in the lyrics telop is included in the pronunciation evaluation data, the display control unit 200 displays ruby in a display mode according to the evaluation result of the word.

  The relationship between the evaluation result and the display mode of ruby is set in advance. FIG. 4 is table data defining the relationship between the value of the tone generation level as the evaluation result and the display mode of ruby. In FIG. 4, the display size of the ruby decreases as the value of the tone generation level increases (as the tone approximates natively), so that the display size of the ruby decreases (when the tone generation level is the maximum value, the ruby is not displayed). It is done. Such table data is stored, for example, in the storage unit 13.

  Here, it is assumed that the word "promises" is included in the lyric telop of the music Z. In this case, the display control unit 200 specifies the value “1” of the pronunciation level of the word “promises” from the pronunciation evaluation data shown in FIG. 3 and refers to the table data shown in FIG. The display mode corresponding to is determined. Then, the display control unit 200 causes the ruby “promises” of the word “primises” to be displayed at a size 1.5 times the normal size (see FIG. 5). In the example of FIG. 5, the word "Do" is not displayed because the value of the pronunciation level is "5", and the words "believe" and "false" have the normal value of the pronunciation level "3". The word "not" is displayed at a size slightly smaller than the normal size (0.8 times) because the value of the pronunciation level is "4".

  On the other hand, when displaying a new word not included in the pronunciation evaluation data as a lyrics telop, the display control unit 200 displays ruby based on ruby data in a predetermined display mode.

  The predetermined display mode is set in advance in ruby data. For example, when changing the display size of ruby, a normal size (1.0 times) is set as a predetermined display mode.

  The change of the display mode is not limited to the change of the display size of the ruby. For example, the display color and the luminance of the ruby may be changed, or the display time and the display timing of the ruby may be changed (for example, a word having a low sound level may be displayed earlier). Alternatively, the font of the ruby may be changed or the ruby may be underlined. Moreover, you may change a display mode by combining these.

== About the operation of the karaoke apparatus 1 ==
Next, a specific example of the operation of the karaoke apparatus 1 in the present embodiment will be described with reference to FIGS. 6A and 6B.

[Acquisition of pronunciation evaluation data]
FIG. 6A is a flow chart showing an operation example of the karaoke apparatus 1 when acquiring the pronunciation evaluation data.

  When the user A performs karaoke singing of the music X in English, the karaoke apparatus 1 acquires a singing voice signal based on the voice obtained through the microphone 40 (acquisition of a singing voice signal. Step 10).

  The evaluation acquisition unit 100 reads the pronunciation reference data of the music X from the storage unit 13 and compares it with the singing voice signal obtained in step 10 to evaluate the pronunciation for each word included in the lyrics of the music X ( Evaluate pronunciation for each word (step 11). Here, when the pronunciation evaluation data of the user A is already stored in the storage unit 13 (in the case of Y in step 12), the evaluation acquisition unit 100 includes the word whose pronunciation has been evaluated in the pronunciation evaluation data. Check if it is.

  If the word for which the pronunciation has been evaluated is not included in the pronunciation evaluation data (in the case of N in step 13), the evaluation acquiring unit 100 stores the evaluation result of the word (storage of the evaluation result. Step 14).

  On the other hand, when the word for which the pronunciation evaluation has been performed is included in the pronunciation evaluation data (in the case of Y in step 13), the evaluation acquisition unit 100 updates the evaluation result according to the evaluation of the pronunciation for the word. (Update of evaluation result. Step 15).

  In addition, when the pronunciation evaluation data of the user A is not stored in the storage unit 13 (in the case of N at step 12), the evaluation acquisition unit 100 stores the evaluation result of the word (storage of the pronunciation level. Step 14). .

  The evaluation acquisition unit 100 repeatedly performs the process of steps 11 to 15 until the evaluation result of the pronunciation is obtained for all the words included in the music X (in the case of Y in step 16).

[Display of ruby]
FIG. 6B is a flowchart showing an operation example of the karaoke apparatus 1 when displaying ruby. In this example, it is assumed that the pronunciation evaluation data of the user A has already been acquired by the process shown in FIG. 6A.

  When the user A performs karaoke singing of the music Y in English, the display control unit 200 reads the lyrics telop data of the music Y from the storage unit 13 and causes the display device 30 to display the lyrics telop in accordance with the karaoke performance (lyrics Display of telop, step 20).

  At this time, the display control unit 200 checks whether the word included in the displayed lyrics telop is included in the pronunciation evaluation data of the user A. If the word included in the displayed lyrics telop is included in the pronunciation evaluation data of the user A (in the case of Y at step 21), the display control unit 200 uses the pronunciation evaluation data in accordance with the display of the lyrics telop. A ruby is displayed in a display mode according to the display mode (a ruby is displayed in a display mode according to the pronunciation evaluation data. Step 22).

  On the other hand, when the word included in the displayed lyrics telop is not included in the pronunciation evaluation data of the user A (in the case of N at step 21), the display control unit 200 sets in advance according to the display of the lyrics telop. The ruby is displayed in the predetermined display mode (the ruby is displayed in the predetermined display mode. Step 23).

  The display control unit 200 repeatedly performs the processing of steps 20 to 23 until all the lyrics telops and the ruby of the music Y are displayed (in the case of Y at step 24).

  As apparent from the above, the karaoke apparatus 1 according to the present embodiment evaluates the user's singing voice signal based on the pronunciation reference data for evaluating the pronunciation when karaoke songs of foreign languages are sung, Evaluation acquisition unit 100 for acquiring pronunciation evaluation data indicating evaluation results of pronunciation for each word included in the lyrics of the music, and when the user sings karaoke songs of the foreign language, the lyrics of the foreign language based on the lyrics telop data And a display control unit 200 for displaying a telop and displaying, for each word included in the lyric telop, ruby in a native language based on ruby data in a display mode corresponding to the pronunciation evaluation data of the user.

  According to such a karaoke apparatus 1, when singing karaoke songs in foreign languages, it is possible to switch the display mode of ruby for each word according to the user. Specifically, the karaoke apparatus 1 can switch the display mode of ruby for each word included in the lyric telop according to the evaluation result of the user (value of the pronunciation level). For example, by not displaying the ruby for a word that is easy to pronounce, there is no situation where the display of the ruby prevents the karaoke singing. Also, be careful to perform karaoke singing because the user can easily recognize that the word is difficult to pronounce, and the user can easily recognize that the word is difficult to pronounce, by displaying a large size of the word for words that are difficult to pronounce. Can. Furthermore, since the display mode of the ruby is changed according to the pronunciation evaluation data acquired in advance, it is possible to avoid the situation where the ruby is not displayed despite the word that is difficult to pronounce.

  In addition, when the word included in the pronunciation evaluation data is sung again for a karaoke song, the evaluation acquisition unit 100 updates the evaluation result of the pronunciation for the word, and the new word not included in the pronunciation evaluation data is updated. When a karaoke song is sung, the evaluation result of pronunciation for the new word is added. Thus, by updating the evaluation result of the pronunciation of the already evaluated word, it is possible to change the display mode of the ruby reflecting the degree of progress of the foreign language of the user. Moreover, the ruby which can switch a display mode can be increased by adding the evaluation result of the pronunciation | sound_production with respect to a new word.

  Further, when displaying a new word not included in the pronunciation evaluation data as a lyrics telop, the display control unit 200 displays ruby based on ruby data in a predetermined display mode. According to such a configuration, even in the case of singing karaoke songs having a new word not included in the pronunciation evaluation data, the ruby can be displayed in an appropriate display mode that the user can easily refer to. .

<Others>
In the above-mentioned embodiment, although the example which acquires singing evaluation data by comparing a singing voice signal and pronunciation reference data was described, it is not restricted to this. The song evaluation data can be acquired by using a database including pattern data in which the pronunciation characteristics of the native language and the foreign language are classified. In this case, the music data does not have to include the pronunciation reference data. Such a database is an example of “basic information”.

  Specifically, the karaoke apparatus 1 (storage unit 13) stores a database including feature pattern data of English pronunciation pronounced by Japanese and native feature pattern data. Here, when the user A sings a karaoke song of the music X in a foreign language, the evaluation acquisition unit 100 analyzes a singing voice signal and extracts a feature pattern for each word. The evaluation acquisition unit 100 compares the extracted feature pattern with a database, and sets the value of the pronunciation level according to the degree of approximation with Japanese pronunciation and the degree of approximation with native pronunciation. The evaluation acquisition unit 100 acquires the pronunciation evaluation data of the user A by setting the value of the pronunciation level for all the words included in the music X (Details of the comparison process between the extracted feature pattern and the database are described. In Japanese Patent Application Laid-Open No. 2001-820096).

  The above embodiments are presented as examples and do not limit the scope of the invention. The above configurations can be implemented in combination as appropriate, and various omissions, replacements, and changes can be made without departing from the scope of the invention. The above embodiments and the modifications thereof are included in the invention described in the claims and the equivalents thereof as well as included in the scope and the gist of the invention.

1 karaoke apparatus 100 evaluation acquisition unit 200 display control unit

Claims (4)

Pronunciation evaluation data indicating evaluation results of pronunciation for each word included in the lyrics of the song, evaluating the singing voice signal of the user based on the reference information for evaluating the pronunciation when singing the karaoke song of the music of the foreign language And an evaluation acquisition unit for acquiring
When the user sings a karaoke song in a foreign language, the foreign language lyric is displayed based on the lyric telop data, and the pronunciation evaluation data of the user is displayed for each word included in the lyric telop. A display control unit that displays a native language ruby based on the ruby data in a different display mode;
Karaoke device having.   The evaluation acquisition unit updates the evaluation result of the pronunciation for the word when the word included in the pronunciation evaluation data is sung again, and a new word not included in the pronunciation evaluation data is updated. 2. The karaoke apparatus according to claim 1, wherein when the karaoke song is sung, evaluation results of pronunciation for the new word are added.   3. The display control unit according to claim 1, wherein when displaying a new word not included in the pronunciation evaluation data as a lyrics telop, the display control unit displays ruby based on the ruby data in a predetermined display mode. Karaoke equipment.   The karaoke apparatus according to any one of claims 1 to 3, wherein the display control unit displays ruby in a native language based on the ruby data in a size corresponding to the pronunciation evaluation data.

Images