JP6429610B2 - Karaoke equipment - Google Patents

Description

  The present invention relates to a karaoke apparatus having an utterance support function in karaoke singing.

  In recent years, when a user sings along with the performance of a karaoke device installed in a karaoke room, it is recommended to sing with a wide open mouth for good speech and beauty and health. Yes. In karaoke singing, opening the mouth extremely wide may increase the burden on the temporomandibular joint and cause harm, so do not be conscious of opening the mouth greatly, but relax the joint of the lower jaw and smoothly It is thought that it is necessary to be conscious of moving. On the other hand, when singing with a well-known member, unlike the case of singing under the leadership, there is no particular concern about the movement of the chin, and the microphone signal amplification function is much lower. There is a strong tendency to sing without moving the jawbone, and it is desirable to provide karaoke content that makes it conscious that the joint of the lower jaw can be moved smoothly by relaxing the joint of the lower jaw.

  Conventionally, as a technique for detecting the movement of the jaw, for example, as in Patent Document 1, the pressure change in the ear canal caused by the movement of the muscle caused by mastication is sensed and measured by a pressure sensor inserted in the ear canal, and the pressure is measured. A technique for displaying the number of changes as the number of mastications is known. Further, as in Patent Document 2, the base part is brought into close contact with the human body, the detection means is continuously located on the base part, the movement derived from mastication is detected, the detection signal is received, and the number of chewing times A technique for recording and displaying as is also known.

  On the other hand, in karaoke, a technique for reflecting the appropriateness of the mouth shape of the singer in the scoring result is known. For example, as in Patent Document 3, shape data representing the ideal aspect ratio of the mouth is obtained for each vowel. Is stored as ideal shape data, and the syllables to be pronounced by the singer identified based on the lyric data in the music data being played are shape data corresponding to the vowels constituting the syllable. Extracting from the data, calculating the shape adaptability of the aspect ratio of the singer's mouth measured from the captured image of the camera with respect to the aspect ratio of the extracted shape data, and generating image score data based on the shape adaptability Technology is known.

Japanese Patent Application Laid-Open No. 07-213510 Japanese Patent Application Laid-Open No. 07-171136 JP 2005-242230 A

  By the way, singing karaoke music according to the lyrics moves the chin like chewing, so the singer can wear a device that can detect the number of mastications described in Patent Document 1 and Patent Document 2, so It is possible to detect the movement of the jaw at the time, but it is not possible to relate the number of chewing times to the music, and it is possible to specify whether or not the jaw movement is smooth along the lyrics when singing There is a problem that it can not be singing support to encourage.

  In addition, the technique described in Patent Document 3 is merely a technique for scoring a song, and it is determined whether or not a smooth jaw movement can be performed along the lyrics when singing only by specifying the mouth shape at the time of singing. There is a problem that it cannot be used as a singing support that promotes good utterance.

  Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a karaoke apparatus that supports singing that promotes utterance that allows the user to be aware that the joint of the lower jaw is relaxed and moved smoothly during singing.

In order to solve the above-mentioned problem, in the invention of claim 1, a karaoke apparatus capable of communicating with a detection device for detecting movement of a singer's jaw by singing and capable of receiving a detection signal transmitted from the detection device. The counting processing means for counting the detection signal received from the detection device during the performance of the music, and the movement of the singer's jaw according to the syllables of the lyrics characters included in the lyrics data of the music to be sung Reference information processing means for calculating a reference frequency to be estimated based on a predetermined number of syllable tables in which the number of syllables and jaw opening / closing times is preset, the number of times counted by the counting processing means, and the reference information processing means A comparison evaluation unit that compares the calculated number of references and gives a higher evaluation as the difference in the comparison result is smaller is adopted.

  According to a second aspect of the present invention, “the lyrics data is divided into a plurality of singing sections in units of lyric character strings, and the predetermined number of syllable tables corresponds to the number of times of opening and closing the chin when speaking one syllable. A single syllable table, a double syllable table that associates the number of times the jaw is opened and closed when the second syllable is uttered from the state where the first syllable is uttered with two syllables. Yes, the reference information processing means, for each singing section, the syllable specifying means for sequentially specifying the syllable from the first character of the lyrics data, and when the syllable specified by the syllable specifying means is the head of the singing section The number of times of opening and closing the jaw corresponding to the syllable is specified from the single syllable table, and in the case of a syllable other than the head of the singing section, the number of times of opening and closing the jaw corresponding to the pair according to the order of the syllable immediately before the syllable and the syllable Comprising a reference number identifying means for identifying the communicating syllable table, and "a configuration.

  According to the first aspect of the present invention, the detection signals received from the detection device during the performance of the music are counted, and the movement of the singer's jaw is estimated according to the syllables of the lyrics characters included in the lyrics data of the music to be sung. The number of times of reference is calculated based on a predetermined number of syllable tables in which the number of syllables and jaw opening / closing is set in advance, and the number of times the detection signal is counted is compared with the calculated number of references. By making the configuration so that the smaller the difference is, the higher the evaluation is, the number of times the jaw is moved when actually singing is compared with the number of times the jaw of the music should be moved. It is possible to check whether or not smooth jaw movements are sometimes possible, and support singing that encourages good utterance by making the lower jaw joint relax and smoothly move when singing One in which it is bet.

  According to the invention of claim 2, the lyric data is divided into a plurality of singing sections in units of lyric character strings, and a single syllable table that associates the number of times of opening and closing the jaw when speaking one syllable, For syllables, it is equipped with a double syllable table that associates the number of times the syllables are opened and closed when the second syllable is uttered with a pair in the order of the two syllables. If the syllable is identified sequentially from the first character of the data, and the identified syllable is the beginning of a singing section, the number of jaws corresponding to the syllable is identified from the single syllable table, and the syllable other than the beginning of the singing section The number of references that will be opened and closed during song singing from the lyric data by specifying from the double syllable table the number of times of opening and closing the chin corresponding to the syllable immediately before the syllable and the order of the syllable. Guess By identifying, it is not necessary to create a pre-data to the karaoke song reaches several million songs, those that can be realized with a simple configuration.

It is a block block diagram of the karaoke apparatus which concerns on this invention. It is explanatory drawing of the single syllable table of FIG. 1, and a double syllable table. It is explanatory drawing of the lyric data of reference frequency specific object. It is a block block diagram of the detection apparatus of FIG. It is explanatory drawing of the frequency specific process based on the lyric data in the reference frequency specific means of FIG. It is explanatory drawing of the frequency | count identification process of the separate syllable of FIG.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
1 is a block diagram of the karaoke apparatus according to the present invention, FIG. 2 is an explanatory diagram of the single syllable table and the double syllable table of FIG. 1, and FIG. FIG. 4 is a block diagram of the detection apparatus of FIG.

  In FIG. 1, a karaoke apparatus 11 is connected to a karaoke main body 12 serving as a main apparatus by wired or wireless connection, and a display unit 13, a mixing amplifier 14, a microphone 15, a speaker 16, and a remote input / output device 17 are connected. The karaoke main body 12 is configured to be communicable with a predetermined number of detection devices 18 (18A to 18N) (the detection device 18 will be described with reference to FIG. 4).

  The display unit 13 displays a normal music selection display, a background image during karaoke performance, and the like. For example, a liquid crystal display (LCD), a plasma display (PDP), and other various displays can be employed. The mixing amplifier 14 mixes the audio signal from the microphone 15 with the music performance signal sent from the karaoke main body 12, amplifies it, and outputs it from the speaker 16.

  The remote input / output device 17 transmits / receives data to / from the karaoke main body 12 using a wired system or a wireless system (IR system, Bluetooth (registered trademark) mechanism piconet connection system, etc.) by a terminal transmission / reception unit (not shown). Therefore, at least a login / logout processing means 17A, a music selection music registration means 17B as music search means, a detection device selection means 17C, and a remote control display unit 17D are provided as appropriate.

  The login / logout processing means 17A obtains a user name and user ID from the user in response to a login operation by the user, stores the user name and user ID in the RAM 23 as user information 42, and performs a process of permitting login. This is a program that performs use termination processing in response to a logout operation. The remote input / output device 17 can search and reserve a song that the user wants to sing using a GUI function described later, but the user preferably logs in to the karaoke device 11 first.

  The music selection music registration means 17B is a program for searching the music desired by the user based on a table including data such as music ID, music title, artist name, etc. and transmitting the music ID of the music selected to the karaoke main body 12. It is. The transmitted music ID is registered in the RAM 23 reservation queue 41 in the karaoke main body 12. The detection device selection means 17C is a program that associates the detection device 18 with the logged-in user.

  Specifically, a list of the detection devices 18A to 18N that have already been paired with the karaoke device 11 is displayed on the remote control display unit 17D, and the detection device 18 to be used is selected from the list. The user is associated with the detection device 18 and the information is stored in the RAM 23 as one of the user information 42. And if a user performs reservation operation after selecting himself as a singer at the time of a music reservation, the karaoke apparatus 11 will detect the detection signal from the detection apparatus 18 matched with the said user at the time of the performance of the said music. Will only receive.

  The remote control display unit 17D has a liquid crystal display (LCD) and a touch sensor stacked to be used for input / output, and can input data such as music selection by the touch sensor corresponding to displayed icons and the like. It has a GUI user interface function.

  The karaoke main body 12 includes a bus 20, a central control unit 21, a ROM 22, a RAM 23, a video display control unit 24, a music performance control unit 25, a sound source (synthesizer) 25A, a scoring unit 26, an A / D conversion unit 26A, and a transmission / reception unit 27. , A storage unit 28, a detection signal receiving unit 31, a counting processing unit 32, a syllable specifying unit 33, a reference number specifying unit 34, and a comparative evaluation unit 35. The syllable specifying means 33 and the reference number specifying means 34 constitute reference information processing means.

  In the RAM 23, a storage area for a reservation queue 41, user information 42, target lyrics data 43, lyrics-corresponding total value 44, and detection count value 45 is formed. The storage unit 28 also stores a music database (music DB) 51, a video database (video DB) 52, a reference database (reference DB) 53, a single syllable table 54, and a double syllable table 55. In addition, about each said structure, even if it is an element part which is not directly related to the summary of this invention, in order to show that most can be applied also in the conventional karaoke system, the whole component is demonstrated.

  The central control unit 21 is a physical CPU that performs overall processing control of the system, and performs algorithm processing based on a program stored in the ROM 22. The RAM 23 is provided with a storage area for the reservation queue 41, user information 42, target lyrics data 43, lyrics-corresponding aggregate value 44, and detection count value 45, and for developing and executing the various programs. It serves as a work area, and is a concept that includes, for example, a case where it is configured by a semiconductor memory and is virtually built on a hard disk.

  The target lyrics data 43 stored in the RAM 23 is the lyrics data read from the music DB 51 based on the music ID when the music is played (see FIG. 3). This lyric data is a set of character codes of lyric characters to which display layout data for display on a screen at a predetermined position of the display unit 13 is added, and includes timing data for color-changing each lyric character. The lyrics data is divided into pages and lines. The page is the maximum display unit for one screen of the display unit 13, and the line is a character string for one horizontal line when displayed on the display unit 13. The number-of-times specifying process described later is performed with a page or line as one singing section. The reading process is reserved and registered in the reservation queue 41 and is performed by the central control unit 21 at the start of performance. However, a program specialized for this process may be provided separately.

  The video display control means 24 is a program or an electronic circuit that outputs the background video extracted from the video DB 52 and the lyrics data of the music extracted from the music DB 51 to the display unit 13 during performance. In addition, it is good also as displaying the evaluation in the comparative evaluation means 35. FIG. The music performance control unit 25 includes, for example, a sequence program, and drives a sound source (synthesizer) 25A according to the note data extracted from the music DB 51 with the music ID. The output of the sound source 25A is sent to the mixing amplifier 14 as a performance signal. Is output.

  The scoring means 26 is for scoring by detecting the pitch of the singing voice by the user and comparing it with the pitches of the reference data of the main melody for each music, which will be described later. It is a program that performs scoring processing based on reference data for singing a voice signal digitally converted by 26A. Specifically, for example, a technique described in Japanese Patent No. 4229915 can be used.

  The transmission / reception unit 27 is used to exchange data with the remote input / output device 17 using a wired system or a wireless system (such as an IR system or a Bluetooth (registered trademark) mechanism piconet connection system). Electronic circuit and program.

  The music DB 51 stored in the storage unit 28 stores note data, lyrics data, and the like for each music. Regarding performance, specifically, there is a music table in which a music ID, a music title, and an artist ID (artist name) are associated, and for each music, note data of a karaoke music in a predetermined data format managed by the music ID (for example, , MIDI (registered trademark) format note data) or the like, and the music ID is stored as a file name. The video DB 52 stored in the storage unit 28 is a database in which music IDs are stored as file names for background video data corresponding to each music.

  Reference DB53 memorize | stored in the said memory | storage part 28 is reference data of the main melody for every music, Comprising: The karaoke music memorize | stored in the said music DB51 and the song by the singer matched with the song area of the said karaoke music are evaluated. This is a database that stores reference data used as an evaluation standard for analysis in association with each other.

  The single syllable table 54 stored in the storage unit 28 indicates the number of times the target syllable in the lyric data is moved in the direction of opening or closing the jaw when the target syllable is uttered. As shown in FIG. 2 (A), the number of jaw opening / closing times is preset for one syllable of “vowel” or “consonant + vowel” as the target syllable. Note that the syllable at the beginning of the singing section sets the number of times the chin moves when the syllable at the beginning of the singing section is uttered from a state where the chin is closed.

The double syllable table 55 stored in the storage unit 28 stores the second syllable between the syllable immediately before the target syllable and the target syllable when the target syllable in the lyrics data is a syllable other than the head of the singing section. 2 is a table that specifies the number of times the syllable is moved in the direction to open or close the chin, and as shown in FIG. 2B, the vowel that is the syllable immediately before the target syllable, “Consonant + vowel”, the target syllables “vowel” and “consonant + vowel”, and special vowel syllables (for example, “vowel a” and “consonant + vowel a”, “vowel e” and “consonant + vowel e”) , And “vowel o” and “consonant + vowel o” are two syllables of “ha (ha)”, “he (he)”, “ho (ho)”, “n (n)”). The number of times of opening and closing the jaws is set in advance for the group in the order of. For the syllables other than the beginning of the singing section, the number of times the jaw moves when the second syllable is uttered from the state where the first syllable is uttered is set for two consecutive syllables.

  The detection signal receiving unit 31 is a program or an electronic circuit that receives a detection signal transmitted from the detection device 18. The count processing means 32 is a program or an electronic circuit that counts the detection signals received from the detection device 18 during the performance of the music, sums them up, and stores them as a detection count value 45 in the RAM 23.

  The reference information processing means composed of the syllable specifying means 33 and the reference number specifying means 34 determines the reference number of times to estimate the movement of the singer's jaw according to the syllable of the lyrics data of the song to be sung. The number of times of opening and closing is calculated based on the preset single syllable table 54 and the double syllable table 55, and the syllable specifying means 33 sings based on the target lyrics data 43 shown in FIG. It is a program for specifying syllables sequentially from the first character of the lyrics data for each section (described in FIG. 5), and the reference number specifying means 34 is the syllable specified by the syllable specifying means 33 at the head of the singing section. In this case, the number of times of opening and closing the jaw corresponding to the syllable is specified from the single syllable table 54, and in the case of a syllable other than the head of the singing section, the syllable This is a program for specifying the number of jaw opening / closing corresponding to a pair in the order of the previous syllable and the syllable from the double syllable table 55 and storing it in the RAM 23 as a lyrics corresponding total value 44 (FIGS. 5 and 6). To explain).

  The comparison evaluation unit 35 includes a detection count value 45 stored in the RAM 23 as the number of detections of reception from the detection device 18 counted by the counting processing unit 32, and reference information processing units (syllable identification unit 33 and reference number identification). The lyrics correspondence total value 44 stored in the RAM 23, which is the reference count calculated by the means 34), is compared, and the smaller the difference in the comparison result, the higher the evaluation is given, and the remote display 17D of the remote input / output device 17 or This program is displayed on the display unit 13 (may be used together with the remote control display unit 17D). The evaluation contents (content examples will be described later) are determined and held in advance according to the comparison value.

  Here, the detection device 18 shown in FIG. 1 is a wearable terminal, which is always provided in a karaoke room or the like, and is selectively held by the user. The receiver 31) is paired by short-range wireless communication. As shown in FIG. 4, the detection apparatus 18 includes a detection processing unit 62 and a detection transmission unit 63 in the apparatus main body 61, and a detection sensor 64 extended and connected to the outside. The detection processing means 62 is provided with a program that holds the device ID and manages the entire device. When the user logs in, the detection processing unit 62 selects and specifies the detection device 18 (device ID) and uses it in the RAM 23. Stored as part of the person information 42.

  The detection transmission means 63 is a program or an electronic circuit that transmits a detection signal detected by the detection sensor 64 to the detection signal reception unit 31 of the paired karaoke apparatus 11. The detection sensor 64 includes a detection element such as a pressure sensor that detects movement of the jaw by singing, and uses a sensor that can be inserted into the ear canal of the user or a sensor that can be worn around the ear canal. It is something that can be done.

  FIG. 5 shows an explanatory diagram of the number specifying process based on the lyrics data in the reference number specifying means of FIG. 1, and FIG. 6 shows an explanatory diagram of the individual syllable number specifying process of FIG. Here, it is assumed that the target lyrics data 43 is stored in the RAM 23 shown in FIG.

  When the performance of the karaoke music is started, the syllable specifying means 33 performs the lyrics as shown in FIG. 5 for the target lyrics data 43 shown in FIG. 3 read from the RAM 23 based on the music ID of the music. In order from the first character of the data, the singing section for two lines of the target lyric data is set as one phrase section, and the character with the hiragana character code is specified for each phrase section (kanji is not specified).

  As shown in FIG. 5, the reference number specifying unit 34 refers to the syllable specified by the syllable specifying unit 33, and refers to the single syllable table 54 for the first syllable of the phrase section, and the corresponding number of times of opening and closing the jaw Referring to the double syllable table 55 for the syllables other than the head of the phrase section, specify the number of times of opening and closing the jaw corresponding to the pair in the order of the syllable immediately before the target syllable and the target syllable. It is something to do.

  In a specific example, in the example of FIG. 6A, the syllable of “a” [(consonant +) a] of the character number 2 in FIG. With reference to the table 54, the number of times “1” corresponding to the target syllable [(consonant +) a] is specified. In the example of FIG. 6B, the syllable of “ta” [(consonant +) a] of the character number 3 in FIG. 5 along the performance is in the middle of the phrase section, so the immediately preceding syllable is “A”. ”[(Consonant +) a]”, and the number of times “2” corresponding to the target syllable [(consonant +) a] → [(consonant +) a] is obtained by referring to the double syllable table 55. Identify.

  In the example of FIG. 6C, since the syllable of “ku” [(consonant +) u] of the character number 7 in FIG. 5 along the performance is in the middle of the phrase section, the immediately preceding syllable is “O” [ (Consonant +) o] is specified, and the number of times “1” corresponding to the target syllable [(consonant +) o] → [(consonant +) u] is specified with reference to the double syllable table 55. . Further, in the example of FIG. 6D, the syllable of “M” ((consonant +) o) of the character number 8 of FIG. 5 along the performance is in the middle of the phrase section, so the immediately preceding syllable is “ku”. ”[(Consonant +) u]”, and the number of times “1” corresponding to the target syllable [(consonant +) u] → [(consonant +) o] is determined by referring to the double syllable table 55. Identify.

  Then, the reference count specifying means 34 counts the reference count specified for each syllable specified by the lyrics data and stores it in the RAM 23 as the lyrics corresponding count value 44. On the other hand, during the singing of the user for karaoke performance, the counting processing means 32 receives and counts the detection signals corresponding to the opening and closing of the chin when singing from the detection device 18 used by the user, and sings. After completion, it is stored as a detection count value 45 in the RAM 23.

  Therefore, the comparison evaluation unit 35 compares the lyrics correspondence total value 44 stored in the RAM 23 with the detection count value 45, and gives a higher evaluation as the difference between the comparison results is smaller. The number of times the typical jaw moves 100 times, the number of times your jaw moves 88 times, let's sing with a little more attention to jaw movement! ” It is displayed on one or both of the display unit 13.

  In this way, since the number of times that the jaw was moved when actually singing was compared with the number of times the chin of the music should be moved, the singer can move the jaw smoothly during singing based on the comparison result. Thus, it is possible to support singing that encourages good utterance by making the lower jaw joint relax and smoothly move during singing.

  In addition, it is not necessary to create data for tens of thousands of karaoke songs in advance, since the number of times of opening and closing the jaws (reference times) that will open and close during song singing is estimated and specified from the lyrics data. It can be realized with a simple configuration.

  The karaoke apparatus of the present invention can be used in industries such as manufacture, use, and sales of a karaoke terminal having a basic karaoke function and a karaoke server.

DESCRIPTION OF SYMBOLS 11 Karaoke apparatus 12 Karaoke main body 17 Remote input / output apparatus 18 Detection apparatus 28 Memory | storage part 31 Detection signal receiving part 32 Count processing means 33 Syllable identification means 34 Reference frequency specification means 35 Comparison evaluation means 43 Target lyrics data 44 Lyric corresponding total value 45 Detection Count value 53 Reference database 54 Single syllable table 55 Double syllable table 63 Detection transmission means 64 Detection sensor

Claims (2)

A karaoke device that can communicate with a detection device that detects movement of a singer's jaw by singing, and that can receive a detection signal transmitted from the detection device ,
Counting processing means for counting detection signals received from the detection device during the performance of the music;
Based on a predetermined number of syllable tables in which the syllable and the number of times of opening and closing the chin are set in advance, the number of references for estimating the movement of the singer's jaw according to the syllable of the lyric character included in the lyrics data of the song to be sung Reference information processing means for calculating;
A comparison evaluation means that compares the number of times counted by the counting processing means with the reference number of times calculated by the reference information processing means, and gives a higher evaluation as the difference between the comparison results is smaller;
A karaoke apparatus comprising: The karaoke apparatus according to claim 1,
The lyric data is divided into a plurality of singing sections in units of lyric strings,
The predetermined number of syllable tables is a single syllable table that correlates the number of times of opening and closing the jaw when uttering one syllable, and when uttering the second syllable from the state where the first syllable is uttered for two syllables. It is a double syllable table in which the number of times of opening and closing the chin is associated with a pair in the order of the two syllables,
The reference information processing means includes
For each singing section, syllable identifying means for sequentially identifying syllables from the first character of the lyrics data;
If the syllable specified by the syllable specifying means is at the beginning of a singing section, the number of jaws corresponding to the syllable is specified from the single syllable table, and if it is a syllable other than the beginning of the singing section, immediately before the syllable Reference number specifying means for specifying from the double syllable table the number of times of opening and closing the chin corresponding to the set of syllables and the order of the syllable,
A karaoke apparatus comprising:

Images