JP5704201B2 - Karaoke device and karaoke music processing program - Google Patents

Description

  The present invention relates to a karaoke apparatus and a karaoke piece processing program for displaying lyrics text.

  There has already been proposed a technique for sequentially replacing text composed of a predetermined language with English words having similar sounds (see, for example, Patent Document 1). In this prior art, the above replacement is performed based on the similarity of phonetic symbols so that, for example, the pronunciation of a Japanese conversation language is transmitted to a person who can read an English conversation language substantially accurately.

JP 2010-108201 A

  By the way, in a karaoke apparatus, the lyric text of the said karaoke music is displayed with the reproduction | regeneration of a karaoke music, so that the user can enjoy singing while watching the lyrics. Here, when the user uses the language of the lyric text as a native language (for example, when the lyric text is in Japanese and the user is Japanese), the lyrics displayed in the above manner, for example, are in Japanese. It is possible to easily sing along the original karaoke music (the music sung by the singer). On the other hand, when the user does not use the language of the lyrics text as a native language (for example, when the user speaks English as a native language or is a foreigner used daily), the lyrics displayed as described above. It is difficult to sing along the original music because the text cannot be read sufficiently, or even if it can be read, it cannot be pronounced by the flow of the sentence in the fluent language.

  In such a case, it is conceivable to apply the above-mentioned conventional technique and simply replace the text of the lyrics with an enumeration of English words having similar sounds by the similarity of phonetic symbols. However, the karaoke music piece constitutes one segment or group for each predetermined passage or phrase such as so-called A melody, B melody, and chorus. Therefore, for example, when there are lyrics that straddle the two above-mentioned passages / phrases, it is difficult to perform singing in a manner close to the original music reflecting the flow and breaks of the music with the simple replacement as described above. It was.

  An object of the present invention is to provide a karaoke apparatus capable of reliably singing in a pronunciation manner close to the original song of a karaoke song even when the user is a foreigner whose native language is English (or used everyday) To provide a karaoke music processing program.

In order to achieve the above object, a karaoke apparatus according to a first aspect of the present invention is a music playback means capable of playing back karaoke music data in which predetermined phrase phrase data and first lyric data are associated, and the karaoke music by the user. Music accepting means for accepting selection of data, and second lyrics that are extracted from the first lyrics data corresponding to the karaoke song data accepted by the music accepting means and extracted from the lyrics corresponding to English words and English words lyrics generating means for generating data, with respect to the lyrics text of the remaining portion not extracted by the English single word lyric generating means of the first lyrics data, and pronunciation symbols applying means for applying a pronunciation symbol for each word For each phrase phrase corresponding to the phrase phrase data, it is given to the lyrics text by the phonetic symbol assigning means. The phonetic symbol is compared with the phonetic symbol of the English word candidate for replacing the lyric text, and the similarity degree deriving means for deriving the degree of similarity, and according to the derivation result by the similarity degree deriving means, A plurality of English word candidates are selected and arranged so that the degree of similarity is maximized, and replacement lyric generating means for generating third lyric data for replacement is generated by the English word lyric generating means Lyric synthesizer for synthesizing the second lyric data and the third lyric data generated by the replacement lyric generator, and generating new lyric data corresponding to the karaoke song data received by the music receiver And the new lyrics corresponding to the karaoke music data according to the reproduction of the karaoke music data received by the music receiving means And having display means for displaying the over data, the.

  In the karaoke apparatus, the lyrics text of the karaoke music is displayed along with the reproduction of the karaoke music, so that the user can enjoy singing while watching the lyrics. In the invention of the present application, the lyrics of the karaoke music are replaced with a list of English words similar as sounds and displayed, thereby making it easier for foreign users. That is, when the user selects karaoke music data, the selection is received by the music receiving means, and a phonetic symbol is given to each word by the phonetic symbol giving means to the lyric text of the lyrics data of the music.

  Then, in order to replace the lyric text with the phonetic symbol for each word as described above with an English word that resembles the sound, the similarity derivation means uses the phonetic symbol of the lyric text and the replacement English word candidate The phonetic symbol is compared to derive the similarity. Then, the replacement lyrics generation means selects and arranges the plurality of English word candidates while generating the highest similarity, and generates replacement lyrics data (third lyrics data).

  At this time, there are cases where words (so-called foreign words) originally in English are included in the lyrics of the karaoke music as described above (for example, composed of Japanese). In such a case, it is easier for the user to pronounce the word by returning the word to the original English alphabet notation without performing the above processing. Therefore, in the present invention, the lyric part corresponding to the English word is extracted from the lyric data (first lyric data) of the karaoke song data received as described above by the English word lyric generating means and converted into the alphabet. Second lyrics data is generated. Then, the phonetic symbol assigning means assigns phonetic symbols only to the remaining lyric texts not extracted in the above, and the derivation of the similarity in the similarity derivation means based on the lyric symbols is performed. Generation of third lyrics data is performed.

  Then, the second lyric data is synthesized with the generated third lyric data by the lyric synthesizing means, whereby new lyric data is generated and displayed by the display means.

  As a result of the above, in the present invention, the foreign word part is included as it is as the original English word converted into alphabets, and the lyric data is displayed in the form of an enumeration of English words with similar sounds for the other parts. Thus, even if the user is a foreigner whose native language is English (or used daily), the user can sing in a pronunciation manner close to the original karaoke song. In particular, in the present invention, lyrics phrase data corresponding to karaoke music data is associated with phrase phrase data representing a predetermined phrase or phrase such as so-called A melody, B melody, and chorus. Then, derivation of similarity by the similarity deriving means and arrangement of a plurality of English word candidates by the replacement lyrics generating means are performed for each of the passages and phrases. Thus, for example, even if there is a lyric that straddles two passages / phrases, the replacement of the lyric with the English word is performed in a manner divided for each passage / phrase (that is, the lyrics are divided into two). ) Done. As a result, singing in a manner closer to the original song that reflects the flow and breaks of the song is more reliably realized than when the lyrics text is simply replaced with an enumeration of English words with similar sounds. Can do.

  In a second aspect based on the first aspect, note length data corresponding to the karaoke piece data is associated with the first lyric data, and the similarity derivation means is configured to generate the phonetic symbol of the lyric text. Derivation of the similarity while using a predetermined weighting that becomes larger as the note represented by the note length data becomes larger and becomes shorter as the note represented by the note length data becomes shorter when comparing the pronunciation symbol of the English word candidate It is characterized by performing.

  When lyrics are sung and sung, words placed on long sounds are clearly audible because of the long pronunciation time, whereas words placed on short sounds are heard indefinitely because the pronunciation time is short . In the present invention, weighting in consideration of the above is performed when the similarity is derived by comparing the phonetic symbol of the lyric text with the phonetic symbol of the English word candidate.

  In other words, in the present invention, lyric data (first lyric data) of karaoke music data is associated with note length data such as full notes, quarter notes, eighth notes, and the like. In the derivation of the similarity, the phonetic symbol with a long note is placed with a higher weight (corresponding to the property that it is clearly audible to the ear) and the similarity is derived, For phonetic symbols with short notes, the similarity is derived by reducing the weight (corresponding to the property of being audible only indefinitely). Thereby, for example, the singing in a mode closer to the original song sung in Japanese by the Japanese can be reliably realized.

In order to achieve the above object, a karaoke music piece processing program according to a third aspect of the present invention is a music piece reproduction means capable of reproducing karaoke piece data associated with predetermined phrase phrase data and first lyric data, a display means, A music reception procedure for accepting selection of the karaoke music data by the user, and the first lyrics data corresponding to the karaoke music data received in the music reception procedure. the English word lyric generation step of generating a second lyric data alphabetized by extracting lyric portion corresponding to the English word, the rest of the not extracted with English single language lyrics generation procedure of the first lyrics data A syllable text assignment procedure for assigning a phonetic symbol for each word and a phrase phrase corresponding to the phrase phrase data. A degree-of-similarity derivation procedure for comparing the phonetic symbol given to the lyric text with the phonetic symbol of the English word candidate for replacing the lyric text and deriving similarity In accordance with the derivation result in the similarity degree derivation procedure, the plurality of English word candidates are selected and arranged so that the similarity degree is maximized for each of the phrase phrases, and replacement third lyric data is obtained. The generated replacement lyrics generation procedure, the second lyrics data generated in the English word lyrics generation procedure and the third lyrics data generated in the replacement lyrics generation procedure are combined and received in the music reception procedure In accordance with the lyrics composition procedure for generating new lyrics data corresponding to the karaoke song data, and the reproduction of the karaoke song data received in the song reception procedure, And display control procedure of the new lyrics data corresponding to Raoke music data to be displayed on the display unit, thereby to execute.

  According to the present invention, even when the user is a foreigner whose native language is English (or used daily), the user can reliably sing in a pronunciation manner close to the original karaoke song.

It is a functional block diagram showing the whole structure of the karaoke music reproduction system provided with the karaoke apparatus by one Embodiment of this invention. It is explanatory drawing showing the data structure of karaoke music data. It is explanatory drawing showing the method of the English word substitution process by a comparative example. It is explanatory drawing showing the method of the English word substitution process by embodiment. It is a flowchart showing the process sequence performed by a control part. It is a flowchart showing the detailed procedure of step S100. It is a figure showing an example of a weighting table. It is explanatory drawing explaining the aspect in which an English word substitution process is performed using weighting.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

<System overview>
FIG. 1 is a functional block diagram showing the overall configuration of a karaoke music piece reproduction system provided with a karaoke apparatus according to an embodiment of the present invention. The karaoke playback system 1 includes a karaoke device main body 100, a remote controller 200, and an authentication server 300. The karaoke apparatus main body 100 and the remote controller 200 are installed in a karaoke room KR such as a karaoke store that provides a karaoke music reproduction service.

  The karaoke apparatus main body 100 and the remote controller 200 are connected to each other so as to be able to transmit and receive information to and from each other via a network NW1 such as a wireless or wired local area network (LAN). The karaoke apparatus main body 100, the remote controller 200, and the authentication server 300 are connected to each other via the network NW1 and the network NW2 so that information can be transmitted and received between them. The karaoke apparatus main body 100 and the remote controller 200 constitute a karaoke apparatus described in each claim.

<Karaoke device body>
The karaoke device main body 100 is a device that provides a karaoke song reproduction service using Musical Instrument Digital Interface (MIDI; registered trademark) data, background video data, and lyrics data (details will be described later) that constitute karaoke song data. It is. The karaoke apparatus main body 100 includes a control unit 101, a mass storage device 103 including an English word phonetic symbol database 103A and a Japanese word phonetic symbol database 103B (details will be described later) connected to the control unit 101, respectively. , An operation unit 104, a microphone 105, a sound source 106, a sound control unit 107, a display unit 109, and a communication control unit 110.

  The control unit 101 includes a CPU (not shown) and a memory such as a RAM and a ROM. The control unit 101 uses various programs stored in advance in the ROM or the large-capacity storage device 103 (karaoke music processing for executing the processing shown in FIGS. 5 and 6 described later) while using the temporary storage function of the RAM. Program). As a result, the entire karaoke apparatus body 100 is controlled.

  The mass storage device 103 is composed of, for example, a hard disk drive (HDD). The large-capacity storage device 103 includes MIDI data, background video data, karaoke music data (see FIG. 2 to be described later) composed of, for example, Japanese lyrics data (corresponding to first lyrics data), and other various types. Information is stored. Further, the English word phonetic symbol database 103A (a large number of English words and corresponding phonetic symbols are stored in association with each other) and the Japanese word phonetic symbol database 103B ( A large number of Japanese words and corresponding phonetic symbols are stored in association with each other), which is used when English word replacement processing described later is performed on the lyrics data.

  The operation unit 104 includes, for example, a plurality of keys and switches. A user can perform various operations such as a reservation operation for a user's desired karaoke piece by using the operation unit 104 or an operation unit 204 of the remote controller 200 described later.

  The microphone 105 converts the voice of the karaoke song by the user into a voice signal and outputs the voice signal.

  The sound source 106 reproduces the MIDI data read from the mass storage device 103 by the control unit 101 and outputs it to the audio control unit 107.

  The sound control unit 107 synthesizes and amplifies the performance sound generated by reproducing the MIDI data output from the sound source 106 and the sound signal input from the microphone 105 and outputs the result to the speaker 108.

  The speaker 108 is connected to the audio control unit 107 and emits MIDI data and audio signals output from the audio control unit 107 as audio output, that is, as sound.

  The sound source 106 and the sound control unit 107 function as music reproducing means described in each claim. Hereinafter, the sound source 106 and the sound control unit 107 are appropriately omitted and referred to as “sound source 106 or the like”.

  The display unit 109 is composed of a liquid crystal display, for example, and displays various videos. In particular, the display unit 109 is read from the mass storage device 103 in synchronization with the reproduction of the MIDI data by the sound source 106 or the like, in other words, as the MIDI data is reproduced by the sound source 106 or the like. Background video data, telop (lyric text) corresponding to lyrics data, and the like can be displayed.

  The communication control unit 110 controls information communication between the remote controller 200 and the authentication server 300 via the networks NW1 and NW2.

<Remote control>
The remote controller 200 is an operation terminal for a user to perform various operations such as a reservation operation for karaoke music. The remote controller 200 includes a control unit 201, a storage device 203, an operation unit 204, a display unit 209, and a communication control unit 210.

  The control unit 201 includes a CPU (not shown) and a memory such as a RAM and a ROM. The control unit 201 executes various programs stored in advance in the ROM or the storage device 203 while using the temporary storage function of the RAM. As a result, the entire remote controller 200 is controlled.

  The storage device 203 is composed of, for example, a nonvolatile memory and stores various types of information.

  The operation unit 204 is composed of, for example, a plurality of keys and switches. Using the operation unit 204 or the operation unit 104 of the karaoke apparatus main body 100, the user can perform various operations such as a reservation operation for karaoke music.

  The display unit 209 is composed of, for example, a liquid crystal display and performs various displays.

  The communication control unit 210 controls information communication performed between the karaoke apparatus main body 100 and the authentication server 300 via the networks NW1 and NW2. In this example, the connection between the communication control unit 210 and the network NW1 is a wireless connection.

<Authentication server>
The authentication server 300 includes a control unit 301, a mass storage device 303, and a communication control unit 310.

  The control unit 301 includes a CPU (not shown) and a memory such as a RAM and a ROM. The control unit 301 executes various programs stored in advance in the ROM or the large-capacity storage device 303 while using the temporary storage function of the RAM. As a result, the entire authentication server 300 is controlled.

<Features of the embodiment>
Here, as described above, the feature of the present embodiment is that an English word replacement process of lyrics data is performed.

<Need for English word replacement>
In the karaoke apparatus as described above, the lyrics text of the karaoke music is displayed on the display unit 109 along with the reproduction of the karaoke music from the speaker 108, so that the user can enjoy singing while watching the lyrics. Here, when the user uses the language of the lyric text (in this example, Japanese) as a native language (for example, Japanese), the user sees, for example, Japanese lyrics displayed as described above. Singing along the original karaoke song (the song sung by the singer) can be performed easily.

  On the other hand, when the user is a foreigner whose native language is English (or used daily), the lyrics text displayed on the display unit 109 cannot be read sufficiently as described above. Or, even if it can be read, it is difficult to sing along the original music because it cannot be pronounced in a fluent text flow.

  Therefore, in this embodiment, the lyrics of the karaoke music are replaced with a list of English words that are similar as sounds, and displayed for convenience to the foreign user. The details will be described in detail below.

<Data structure>
FIG. 2 is an explanatory diagram showing the data structure of karaoke song data in the present embodiment.

  As shown in FIG. 2, the karaoke song data 20 includes song identification information (song ID) 21 such as a song name, score data 22, lyrics data 23, and MIDI data 24 as performance data.

  The song identification information 21 is placed as a header of the karaoke song data 20. As described above, the MIDI data 24 is reproduced by the sound source 106 and the like, and is emitted from the speaker 108 as sound. The lyrics data 23 is displayed on the display unit 109 as lyrics telop as described above.

  The musical score data 22 (corresponding to the phrase phrase data) includes at least the note length data of the notes representing the melody line, and a predetermined phrase (for example, a set of so-called A melody, B melody, chorus, etc.) or phrase ( In the example described later, it has a function representing one measure). The musical score data 22 is typically expressed in a staff notation as shown in FIGS. 4A and 4D described later, for example.

  In this example, the lyric data 23 and the score data 22 are incorporated in the same file as the karaoke music data 20, but the present invention is not limited to this. That is, the lyrics data 23 and the score data 22 may be configured as a separate file from the karaoke song data 20 including the MIDI data 24 and the like, and may be associated with the same song name.

<English word replacement of lyrics data>
In this embodiment, with respect to lyrics data 23 in Japanese text (corresponding to lyrics text) included in the karaoke song data 20, in the present embodiment, the Japanese word phonetic symbol database 103B is referred to, and for example, a phonetic symbol is provided for each word. Is granted. Further, those Japanese texts to which phonetic symbols are assigned are replaced with English words having similar sounds by referring to the English word phonetic symbol database 103A.

  At this time, in the present embodiment, by replacing the English word with the score data, it is possible to reliably realize the singing in a mode closer to the original music reflecting the music flow and breaks. Replacements can be made. Hereinafter, the replacement method will be described in detail using a comparative example.

<Comparative example>
An English word replacement method according to a comparative example of the present embodiment will be described with reference to FIGS. As shown in the example of the score data 22 in FIG. 3A, in this example, the melody line for four measures, which is the lyrics of “If you don't have to say that word”, is described as a note, Progression is in the order of code Em (first measure) → code Bm7 (second measure) → code Cadd9 (third measure) → code Bm7 (fourth measure).

  In this comparative example, as shown in FIG. 3B, when the above-mentioned English word replacement is performed on the lyric text for the four measures “I have to say that word” (as described later, phrases, musical phrases, etc.) It is treated as text only (without taking into account the musical elements) and separated by clauses. That is, as shown in FIG. 3C, it is divided into five parts: “that”, “word”, “even”, “say” and “if not”.

  Each phrase segmented in this way is replaced with an English word with similar pronunciation. In this example, the Japanese text “Ano” is replaced with the English word “I know”, the Japanese text “Word” is replaced with the English word “Cut Bar”, and the Japanese text “Even” is converted into the English word. The Japanese text “say” is replaced with the English word “Ear Word”, and the Japanese text “Miss” is replaced with the English word “Naked Level”.

  However, in such a method for replacing English words in this comparative example, as shown in FIG. 3 (e), for example, since the sound of the original song “A” is a relatively long sound, it is replaced with “I”. If you do, the difference in pronunciation between the two will stand out and you will not be able to sing like the original song. Also, for example, the “word” of the original song is pronounced across two bars, but if you replace it with “Cut Bar”, you will not be able to get through the melody line score that spans two bars, so sing like the original song. I can't. Also, “Nake” of the original song “No” is pronounced over two bars, but if this is replaced with “Naked”, the melody line straddling over two bars will not be able to survive well, as described above. I can't sing like the original song.

<Embodiment>
In contrast to the method of the comparative example, in the method of replacing English words in the present embodiment, processing is performed in consideration of musical elements such as phrases and passages. That is, for the lyric text for four measures shown in FIG. 4 (a) and FIG. 4 (b) similar to 104 (a) and FIG. As shown in Fig. 3 (c), the musical elements such as "that word", "even the leaf", "don't say", "if you" (In the example, it is the same as the number of bars).

  Each of the four words is replaced with an English word having a similar pronunciation, more specifically, an English word having a similar phonetic symbol (corresponding to an English word candidate) as described later. At this time, in the present embodiment, the above note length is further considered, and English words that are more similar with accuracy are selected as the note length is longer. English words that have good rhythm balance with words are selected.

  For example, in this example, in the Japanese text “that word”, since the note related to “a” is a dotted quarter note and is relatively long, “a” is “Ane” which is a single character and has a higher similarity. The notes related to “ko” and “to” are octal notes and are relatively short, so “Go” and “To” have good rhythm balance between them (even if they have a relatively low degree of similarity). Is replaced by That is, the Japanese text “That word” is replaced with the English word “Ann know Go To”.

  In addition, in the Japanese text “Hane”, the note related to “sa” is an eighth note and is relatively short. Therefore, even when the similarity is relatively low, It is a part of “Bus” with good rhythm balance. That is, the Japanese text “Even leaf” is replaced with the English word “Bus Away”.

  In addition, in the Japanese text “say”, the note related to “wa” is a dotted quarter note and is relatively long, so “wa” is replaced with “warn”, which is a single character with a higher similarity. Since the note related to “NA” is a quarter note and has a medium length, emphasis is placed on the rhythm balance with the next word (“Kate” described later) even if the similarity is medium. “Now”. That is, the Japanese text “say na” is replaced with the English word “Ear Warn Now”.

  Furthermore, in the Japanese text “Kara”, the note related to “ke” is a quarter note and has a medium length, so even if the degree of similarity is medium, the previous word (“Now” described above) is used. ")" And "Kate". That is, the Japanese text “if” is replaced with the English word “Kate Lever”.

  According to the above method, in this embodiment, it is possible to reliably realize singing in a mode closer to the original music while reflecting the flow and break of the music as compared with the comparative example.

  Although explanation is omitted in the above-described illustration, the lyric data 23 based on the Japanese text included in the karaoke song data 20 may include words originally in English (so-called foreign words). In such a case, it is easier for the foreign user to pronounce the word if the word is not processed as described above and is returned to the original English alphabet. Therefore, in the present embodiment, before performing the above-described English word replacement process, first, the lyrics portion corresponding to the English word is extracted from the lyrics data 23, and the lyrics data (second lyrics data) is alphabetized. (Refer to step S15 in FIG. 5 described later). Then, the above-described English word replacement process is performed on the remaining Japanese lyrics data that has not been extracted (see step S25 and step S100 in FIG. 5 described later).

<Control flow>
Next, a control procedure executed by the control unit 101 of the karaoke apparatus main body 100 in order to execute the above method will be described with reference to FIG. In this flow, for example, when a user inputs a song selection number of a song intended for singing via the operation unit 204 of the remote controller 200 or the operation unit 104 of the karaoke apparatus main body 100, the song selection is accepted by the control unit 101. Is started. In addition, the function of the control part 101 which receives this music selection functions as a music reception means as described in each claim.

  5, first, in step S5, the control unit 101 transmits a request signal for requesting transmission of karaoke music data corresponding to the music selection by the user to the authentication server 300 via the network NW2. As a result, the authentication server 300 searches the large-capacity storage device 303 for karaoke song data 20 (including the lyric data 23 and the score data 22) corresponding to the music selection number indicated in the request signal, and reads the control data. 20 to send. Then, the control unit 101 reads the lyric data 23 (consisting of Japanese text) from the karaoke song data 20 transmitted from the authentication server 300. Thereafter, the process proceeds to step S10.

  In step S10, the control unit 101 sequentially checks the lyrics data 23 read in step S10, and determines whether or not the above-described lyrics of words originally in English (so-called foreign words) are included. If no foreign language is included, the determination in step S10 is not satisfied (S10: NO), and the process proceeds to step S20 described later. If a foreign word is included, the determination in step S10 is satisfied (S10: YES), and the process proceeds to step S15.

  In step S15, new lyrics data in which the lyric portion of the foreign word identified in step S10 (for example, written in Japanese by Katakana) is alphabetized is generated and stored in an appropriate location (for example, the RAM). To do.

  In step S20, the control unit 101 determines whether or not the processing in steps S10 and S15 has been completed for all of the lyrics data 23 read in step S5. If the processing has not been completed for all of the lyrics data 23, the determination in step S20 is not satisfied (S20: NO), and the process returns to step S10 and the same processing is repeated. When the processing is completed for all of the lyrics data 23, the determination in step S20 is satisfied (S20: YES), and the process proceeds to step S25. Note that steps S10, S15, and S20 correspond to the English word lyrics generation procedure described in each claim, and the control unit 101 that executes these steps serves as the English word lyrics generation means described in each claim. Function.

  In step S25, the control unit 101 converts the remaining Japanese lyrics part of the lyrics data 23 that has not been alphabetized in step S15 into phonetic symbols while referring to the Japanese word phonetic symbol database 103B. . Since the phonetic symbols need only be converted by a known appropriate method (for example, Jones type phonetic symbols), detailed description thereof will be omitted.

  In step S30, the control unit 101 determines whether or not the processing in step S25 has been completed for all the remaining Japanese lyrics. If the process has not been completed for all the remaining Japanese lyrics parts, the determination in step S30 is not satisfied (S30: NO), and the process returns to step S25 and the same process is repeated. When the process is completed for all the remaining Japanese lyrics, the determination in step S30 is satisfied (S30: YES), and the process proceeds to step S100. The steps S25 and S30 correspond to the English phonetic symbol assigning procedure described in each claim, and the control unit 101 that executes these steps functions as the phonetic symbol assigning unit described in each claim.

  In step S100, the control unit 101 executes English word replacement processing. As described above with reference to FIG. 4, this English word replacement process is performed for each predetermined passage or phrase (in the above example, for each measure) based on the score data 22.

<English word replacement>
Details of the English word replacement process in step S100 are shown in FIG. In FIG. 6, the control unit 101 first refers to the English word phonetic symbol database 103A in step S105, and selects one phrase out of the phonetic symbols over the entire lyrics data 23 obtained by conversion as described above. Extract all English words that have fewer phonetic symbols than included phonetic symbols.

  Thereafter, in step S110, the control unit 101 determines whether or not similarity calculation in step S120, which will be described later, has been completed for all English words extracted in step S105. Until the similarity calculation is completed for all English words, the determination in step S110 is not satisfied (S110: NO), and the process proceeds to step S115. In step S115, the control unit 101 determines whether or not the calculation of similarity in step S120 described later has been completed for all phonetic symbols in the one phrase. Until the similarity calculation is completed for all phonetic symbols, the determination in step S115 is not satisfied (S: NO), and the process proceeds to step S120. In step S120, an appropriate number of phonetic symbols out of all phonetic symbols included in the one phrase and the English phonetic phonetic symbols extracted in step S105 are sequentially compared by a known method to calculate similarity. To do.

  When calculating the similarity, the pronunciation symbols are different but the pronunciations are similar (for example, “dzw”, “zw”, “th”, etc., corresponding to the Japanese text “Zu”) are mutually equivalent. The similarity is calculated as being compatible. Further, as described above, a phonetic symbol with a long corresponding note is replaced with a high similarity, and a phonetic symbol with a long corresponding note is replaced with a low similarity. For this reason, in step S120, the control unit 101 weights the similarity when the corresponding note length is longer based on the note length data included in the score data 22, and the corresponding note length is reversed. The shorter the weight, the lighter the weight. FIG. 7 shows an example of such a weighting table.

  In the example shown in FIG. 7, different weight values are associated with five types of notes having different note lengths. That is, a weight value of 16 is associated with all notes, a weight value of 8 is associated with half notes, a weight value of 4 is associated with quarter notes, A weight value of 2 is associated with the 16th note, and a weight value of 1 is associated with the sixteenth note. An example of calculating the similarity when such weight values are used is shown in FIG.

  In FIG. 8, in this example, a melody line in one phrase includes all notes, half notes, sixteenth notes (first), quarter notes, eighth notes, sixteenth notes (second), and A case where a total of seven notes of sixteenth notes (third) are included in this order is taken as an example. The phonetic symbols of the text of the Japanese lyrics placed on each note are, in the above order, “OO” for the whole note (simply an explanatory notation; the same applies hereinafter), and the half note. Is “XX”, “★★” for the sixteenth note (first), “ΔΔ” for the quarter note, “□□” for the eighth note, and the sixteenth note (second) ) Is “**”, and the above 16th note (third) is “**”.

For such a Japanese lyrics part, in this example, “English word 1” and “English word 2” are the calculation targets of similarity as replacement English words. The phonetic symbol of “English word 1” is “XX” for the whole note, “XX” for the half note, and “Δ △” for the sixteenth note (first) in the above order. ”,“ △△ ”for the quarter note,“ □□ ”for the eighth note,“ ** ”for the sixteenth note (second), and“ 「” for the sixteenth note (third) ** ” That is, in English word 1, the phonetic symbols are the same for a total of five notes: a half note, a quarter note, an eighth note, a sixteenth note (second), and a sixteenth note (third). . Assuming that the similarity (before weighting) is 1 when matching, and the similarity (before weighting) when mismatching is 0, the similarity of this English word 1 with the above weighting is
16 (whole note weight value) × 0 + 8 (half note weight value) × 1 + 1 (16th note weight value) × 0 + 4 (quarter note weight value) × 1 + 2 (8th note weight value) × 1 + 1 (16th note weight) Value) × 1 + 1 (16th note weight value) × 1
= 0 + 8 + 0 + 4 + 2 + 1 + 1
= 16
It becomes.

On the other hand, the phonetic symbols of “English word 2” are “◯◯” for the whole note, “ΔΔ” for the half note, and “Δ △” for the half note, and “ □□ ”,“ △△ ”for the quarter note,“ □□ ”for the eighth note,“ ** ”for the sixteenth note (second), and the sixteenth note (third) Is “★★”. That is, in the English word 2, the phonetic symbols are the same for a total of three notes of all notes, quarter notes, and eighth notes. Therefore, as above, the similarity of this English word 1 with weighting is
16 (whole note weight value) × 1 + 8 (half note weight value) × 0 + 1 (16th note weight value) × 0 + 4 (quarter note weight value) × 1 + 2 (8th note weight value) × 1 + 1 (16th note weight) Value) x 0 + 1 (16th note weight value) x 0
= 16 + 0 + 0 + 4 + 2 + 0 + 0
= 22
It becomes. Therefore, in this example, the English word 2 with a small number of phonetic symbols that are apparently matched (three) has a higher degree of similarity than the English word 1 with a large number of phonetic symbols that seem to match (five). Become. Note that step S120 corresponds to the similarity deriving procedure described in each claim, and the control unit 101 that executes this step functions as a similarity deriving unit described in each claim.

  Returning to FIG. 6, when step S120 is completed as described above, the process returns to step S115 described above, and the same procedure is repeated. As a result, among all the English words extracted in step S105, the comparison of the appropriate number of phonetic symbols included in the one phrase with respect to one English word and the calculation of the similarity are sequentially performed in step S120. When the calculation of the similarity for all the phonetic symbols is completed, the process returns to step S110, and the same procedure is repeated for the next English word among the extracted whole words. By repeating such steps including step S110, step S115, and step S120, the similarities of all the English words extracted in step S105 are calculated for all the appropriate number of phonetic symbols. When the calculation of the similarity of all English words is completed, the determination in step S110 is satisfied, and the process proceeds to step S125.

  In step S125, the control unit 101, as described above, based on the calculation results for all English words, an appropriate number of phonetic symbols included in the one phrase (in other words, Japanese lyrics corresponding to the phonetic symbols). Part) is replaced with an English word giving the maximum similarity. Thereafter, the process proceeds to step S130.

  In step S130, the control unit 101 determines whether or not the processing in steps S105 to S125 has been completed for all phonetic symbols included in the one phrase. The determination is not satisfied until the above processing is completed for all phonetic symbols in one phrase (S130: NO), the process returns to step S105 and the same procedure is repeated. When the above processing is completed for all phonetic symbols in one phrase, the determination is satisfied (S130: YES), and the process proceeds to step S35 in FIG.

  Returning to FIG. 5, in step S35, the control unit 101 performs the English word replacement process in step S100 described above for all phrases (all measures in the above example) that constitute the remaining Japanese lyrics portion that has not been alphabetized. It is determined whether or not the processing is finished. The determination is not satisfied until the above-mentioned English word replacement process is completed for all phrases (S35: NO), and the process of step S100 is continued while sequentially moving the phrase to the subsequent. When the above English word replacement process is completed for all phrases, the determination is satisfied (S35: YES), and the routine goes to Step S40. Note that steps S125 and S130 in FIG. 6 and step S35 in FIG. 5 correspond to the replacement lyrics generation procedure described in each claim, and the control unit 101 that executes these steps includes each claim. Functions as a replacement lyrics generation means.

  Thereafter, in step S40, the control unit 101 generates the replacement word lyrics (corresponding to the third lyric data) generated by the English word replacement process in steps S100 and S35 as described above, and is generated in step S15. The lyric data (corresponding to the second lyric data) obtained by converting the lyric portion corresponding to the English word into an alphabet is synthesized, and the new lyric data corresponding to the original Japanese lyric data 23 (corresponding to the first lyric data) Lyric data is generated. Thereafter, the process proceeds to step S45. This step S40 corresponds to the replacement lyrics composition procedure described in each claim, and the control unit 101 that executes this step functions as the lyrics composition means described in each claim.

  In step S45, the control unit 101 outputs a control signal to the display unit 109 (corresponding to the display unit), and causes the display unit 109 to display the new lyrics data synthesized in step S40. Thereafter, this flow is terminated. This step S45 corresponds to the display control procedure described in each claim.

  As described above, in the karaoke apparatus of the present embodiment, the foreign word part is included as an original English word that is alphabetized as it is, and the other parts are included in the form of lyrics data in the form of a series of English words with similar sounds. Display is performed. Thus, even if the user is a foreigner whose native language is English (or used daily), the user can sing in a pronunciation manner close to the original karaoke song. In particular, in this embodiment, the musical score data 22 including passage phrase data representing a predetermined passage or phrase is associated with the lyrics data 23 corresponding to the karaoke song data. Then, derivation of the similarity and arrangement of English words at the time of replacement are performed for each passage / phrase (for each measure in the above example). Thus, for example, even if there is a lyrics that spans a plurality of the above-mentioned passages / phrases (2 bars in the above example), the replacement of the lyrics with the above English words is performed in a manner divided for each passage / phrase ( That is, the lyrics are divided into two parts (see FIGS. 4C and 4D). As a result, the original song reflects the flow and breaks of the song compared to the case where the lyric text is simply replaced with an enumeration of similar English words (see the comparative example shown in FIG. 3 above). It is possible to reliably realize singing in a mode close to.

  In the present embodiment, in particular, when the phonetic symbol of the Japanese lyrics portion and the phonetic symbol of the English word are compared in step S100 in FIG. 5, the longer the note represented by the note length data, the larger the note represented by the note length data. The degree of similarity is derived using a weighting (see FIG. 7) that becomes smaller as is shorter. This has the following significance.

  That is, when the lyrics are sung and sung, the words put on the long sound are clearly audible because of the long pronunciation time, whereas the words put on the short sound are only indefinite because the pronunciation time is short. Inaudible. In the present embodiment, taking this into account, note length data such as full notes, quarter notes, and eighth notes is associated with the lyrics data 23 of the karaoke music data (see FIG. 8). Then, when calculating the similarity, for the phonetic symbols having a long note, the similarity is derived by increasing the weight (corresponding to the characteristic that it is clearly audible to the ear), while the above-mentioned placement is calculated. For phonetic symbols with short notes, the degree of similarity is derived by reducing the weight (corresponding to the property of being heard only indefinitely) (see FIG. 8). Thereby, for example, the singing in a mode closer to the original song sung in Japanese by the Japanese can be reliably realized.

  Note that the flowcharts shown in FIGS. 5 and 6 do not limit the present invention to the procedure shown in the above-described flow, and add / delete procedures or change the order within the scope of the invention and the technical idea. May be.

  In addition to those already described above, the methods according to the above-described embodiments and modifications may be used in appropriate combination.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

DESCRIPTION OF SYMBOLS 1 Karaoke music reproduction | regeneration system 20 Karaoke music data 23 Lyrics data 101 Control part 100 Karaoke apparatus main body 106 Sound source (music reproduction means)
107 Voice control unit (music playback means)
109 Display section (display means)

Claims (3)

Music playback means capable of playing back karaoke music data, which is associated with predetermined phrase phrase data and first lyrics data;
Music receiving means for receiving selection of the karaoke music data by the user;
English word lyric generation means for extracting lyrics parts corresponding to English words from the first lyric data corresponding to the karaoke music data received by the music receiving means and generating second lyric data alphabetized; ,
To lyrics text of the remaining portion not extracted by the English single word lyric generating means of the first lyrics data, and pronunciation symbols applying means for applying a pronunciation symbol for each word,
For each phrase phrase corresponding to the phrase phrase data, the phonetic symbol given to the lyric text by the phonetic symbol giving means is compared with the phonetic symbol of the English word candidate for replacing the lyric text. Similarity derivation means to derive;
According to the derivation result by the similarity deriving means, for each of the phrase phrases, a plurality of English word candidates are selected and arranged so as to maximize the similarity, and third lyric data for replacement is generated. Replacement lyrics generation means,
The second lyrics data generated by the English word lyrics generating means and the third lyrics data generated by the replacement lyrics generating means are combined to correspond to the karaoke song data received by the music receiving means. Lyrics synthesis means for generating new lyrics data;
Display means for displaying the new lyrics data corresponding to the karaoke song data in response to the reproduction of the karaoke song data received by the music receiving means;
A karaoke apparatus comprising: The karaoke apparatus according to claim 1,
The first lyrics data is associated with note length data corresponding to the karaoke song data,
The similarity derivation means includes:
When comparing the phonetic symbol of the lyric text and the phonetic symbol of the English word candidate, a predetermined weight is used that becomes larger as the note represented by the note length data becomes longer and becomes smaller as the note represented by the note length data becomes shorter. However, the karaoke apparatus is characterized in that the similarity is derived. With respect to the arithmetic means provided in the karaoke apparatus having the music playback means capable of playing back the karaoke music data, the predetermined music phrase phrase data and the first lyric data being associated, and the display means,
A music reception procedure for receiving selection of the karaoke music data by the user;
An English word lyric generating procedure for generating a second lyric data by extracting a lyric part corresponding to an English word from the first lyric data corresponding to the karaoke music data received in the music receiving procedure; ,
To lyrics text of the remainder of the not extracted with English single language lyrics generation procedure of the first lyric data, the phonetic symbol imparting procedure giving phonetic symbols for each word,
For each phrase phrase corresponding to the phrase phrase data, the phonetic symbol given to the lyrics text in the phonetic symbol assigning procedure is compared with the pronunciation symbol of the English word candidate for replacing the lyrics text, and the similarity is determined. A similarity derivation procedure to derive,
According to the derivation result in the similarity derivation procedure, for each of the phrase phrases, a plurality of English word candidates are selected and arranged so as to maximize the similarity, and third lyric data for replacement is generated. The replacement lyrics generation procedure to
The second lyrics data generated in the English word lyrics generation procedure and the third lyrics data generated in the replacement lyrics generation procedure are combined to correspond to the karaoke song data received in the music reception procedure Lyric composition procedure to generate new lyrics data,
A display control procedure for displaying the new lyric data corresponding to the karaoke song data on the display means in accordance with the reproduction of the karaoke song data received in the music receiving procedure;
Karaoke music processing program to execute.

Images