JP7219541B2 - karaoke device - Google Patents

Description

The present invention relates to a karaoke machine.

A singer who sings karaoke can instruct various operations to the karaoke device via a switch provided on the device main body or an attached remote control device. Various operations are related to karaoke performance such as, for example, stopping karaoke performance, changing performance volume or performance pitch, or adjusting microphone volume. It is also possible to instruct various operations to the karaoke machine via a mobile terminal (smartphone, etc.) in which dedicated application software is installed.

Furthermore, a technique is disclosed in which a desired operation can be instructed by voice input using a microphone used by the singer. For example, Patent Literature 1 discloses a technique of inputting various command signals to a karaoke machine by uttering a voice command into a microphone.

JP-A-11-184479

Here, when instructing various operations using voice input, the singer must memorize the keywords corresponding to the various operations. However, it is difficult to recall appropriate keywords and input them by voice between karaoke performances while singing karaoke.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a karaoke apparatus that makes it possible to easily give an instruction to perform operations related to karaoke performance using voice input.

The main invention for achieving the above object is to record the operation history in chronological order of the karaoke performance-related operations instructed by the singer accompanying the karaoke performance of a certain song, the identification information of the song, and the karaoke performance. A history processing unit that stores in the storage unit in association with the identification information of the singer, and when the singer sings the certain song again in karaoke, the song is recorded in the operation history along with the karaoke performance again. A display control unit that displays confirmation information corresponding to the operation performed, and a determination unit that determines whether to execute the operation corresponding to the displayed confirmation information based on the analysis result of the voice uttered by the singer. and a performance control unit that controls a karaoke performance to perform the operation when it is determined that the operation is necessary.
Other features of the present invention will be clarified by the description of the specification and drawings described later.

ADVANTAGE OF THE INVENTION According to this invention, when instruct|indicating the operation regarding a karaoke performance using voice input, the said instruction|indication can be performed easily.

It is a figure which shows the hardware structural example of the karaoke apparatus which concerns on embodiment. It is a figure which shows the software structural example of the karaoke main body which concerns on embodiment. It is a figure which shows the operation log|history which concerns on embodiment. It is a figure which shows the confirmation information which concerns on embodiment. It is a flow chart which shows processing of a karaoke device concerning an embodiment.

<Embodiment>
A karaoke apparatus 1 according to the present embodiment will be described with reference to FIGS. 1 to 5. FIG.

==Karaoke Device==
The karaoke device 1 is a device for performing karaoke performances of songs selected by singers and for singing karaoke songs by singers. As shown in FIG. 1, the karaoke device 1 includes a karaoke main body 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50. As shown in FIG.

The speaker 20 is configured to emit sound based on the sound emission signal from the karaoke main body 10 . The display device 30 is configured to display video and images on the screen based on the signal from the karaoke main body 10 . The microphone 40 is configured to convert a singer's voice (input voice to the microphone 40 ) into an analog voice signal and input it to the karaoke main body 10 .

(Karaoke hardware)
As shown in FIG. 1 , the karaoke main body 10 includes a control section 11 , a communication section 12 , a storage section 13 , a sound processing section 14 , a display processing section 15 and an operation section 16 . Each configuration is connected to bus B via an interface (not shown).

The karaoke main body 10 performs various controls related to karaoke singing, such as karaoke performance control of selected songs, display control of lyrics, background images, etc., and processing of audio signals input through the microphone 40 .

The control unit 11 includes a CPU 11a and a memory 11b. The CPU 11a realizes various control functions by executing operation programs stored in the memory 11b. The memory 11b is a storage device that stores programs to be executed by the CPU 11a and temporarily stores various types of information during execution of the programs.

The communication unit 12 provides an interface for connecting the karaoke main body 10 to a communication line via a router (not shown).

The storage unit 13 is a large-capacity storage device that stores various data, such as a hard disk drive. The storage unit 13 stores a plurality of song data for karaoke performance by the karaoke apparatus 1 . The music data is provided with identification information (music ID) for specifying individual karaoke music. The song data includes accompaniment data, reference data, background image data, lyrics data, and attribute information (song title, singer name, etc.).

Under the control of the control unit 11 , the sound processing unit 14 controls karaoke performance of music and processes audio signals input through the microphone 40 . The sound processing unit 14 includes, for example, a MIDI sound source, an A/D converter, a mixer including a DSP (Digital Signal Processor), a D/A converter, and an amplifier (all not shown). The control unit 11 sequentially reads out the accompaniment data of the reserved music piece based on the tempo clock signal, and inputs it to the MIDI tone generator. The MIDI tone generator generates tone signals based on the accompaniment data. The A/D converter converts the audio signal input from the microphone 40 into digital audio data and inputs the data to the mixer (DSP). A mixer mixes the musical tone signal and the digital audio data at an appropriate ratio. The D/A converter converts the mixed signal into an analog audio signal, and the amplifier amplifies the analog audio signal from the D/A converter and outputs it to the speaker 20 as a sound emission signal. As a result, the karaoke performance sound based on the sound output signal and the sound from the microphone 40 (for example, the singing voice accompanying the karaoke performance) are emitted from the speaker 20 .

The display processing unit 15 performs processing related to various displays on the display device 30 under the control of the control unit 11 . For example, the display processing unit 15 controls the display device 30 to display an image in which lyrics and various icons are superimposed on a background image during a karaoke performance.

The operation unit 16 includes panel switches, a remote control receiving circuit, and the like. Operation signals such as a music selection signal and a performance stop signal are output to the control unit 11 in accordance with the operation of the panel switch of the karaoke device 1 or the remote control device 50 by the singer. The control unit 11 detects an operation signal from the operation unit 16 and executes corresponding processing.

The remote control device 50 is a device for performing various operations on the karaoke main body 10 . Using the remote control device 50, the singer can instruct various operations such as selection (reservation) of karaoke music that he wishes to sing, and stop playing.

(Karaoke main software)
FIG. 2 is a diagram showing an example of the software configuration of the karaoke main body 10. As shown in FIG. The karaoke main body 10 includes a history processing section 100 , a display control section 200 , a judgment section 300 and a performance control section 400 . The history processing unit 100, the display control unit 200, the determination unit 300, and the performance control unit 400 are implemented by the CPU 11a executing programs stored in the memory 11b.

[History processing unit]
The history processing unit 100 records the operation history in chronological order of the operations related to the karaoke performance instructed by the singer along with the karaoke performance of a certain song, the identification information of the song, and the singer's identification information. , and stored in the storage unit 13.

The operation related to the karaoke performance is an operation performed with respect to the karaoke performance, or an operation performed accompanying the karaoke performance. Such operations include, for example, starting a karaoke performance, stopping a karaoke performance, cutting an aftertaste, changing a key, changing an accompaniment volume, changing a microphone volume, and adjusting an echo. The operation history is a record of the operations instructed by the singer along with the karaoke performance of a certain song in the order of instructions (the order in which the karaoke apparatus 1 performed the operations) together with the times of instructions. A plurality of operation histories are created for each piece of music and for each singer.

For example, singer X sings karaoke along with karaoke performance of song A, and gives instructions for some operations. An operation instruction is given via the operation unit 16 or the remote control device 50 .

The history processing unit 100 creates an operation history by recording the operations instructed by the singer X in chronological order. After the karaoke performance (karaoke singing) of the song A ends, the history processing unit 100 associates the created operation history with the identification information (song ID) of the song A and the identification information (singer ID) of the singer X. is stored in the storage unit 13.

FIG. 3 is a diagram showing the operation history stored in the storage unit 13. As shown in FIG. In FIG. 3, the specific contents of the operation corresponding to the time indicated by singer X (operation time: elapsed time from the start of karaoke performance) are stored in association with the singer ID and the song ID. Specifically, the operation history shown in FIG. Immediately before the chorus, 1 minute 40 seconds), instructed to operate ``Echo level up by 2 steps'', and at the beginning of the interlude (3 minutes 05 seconds), instructed to operate ``Microphone volume 1/4 down''. At the end (3 minutes 55 seconds), I instructed the operation to "turn up the microphone volume by 1/4", and when the last lyric telop disappeared (4 minutes 15 seconds), I instructed the operation to "cut the ending". showing.

[Display control unit]
The display control unit 200 displays confirmation information corresponding to the operation recorded in the operation history when the singer sings a certain song again in karaoke, accompanying the karaoke performance of the certain song again.

An operation recorded in the operation history is an instruction given by a certain singer to a certain piece of music that has been karaoke-performed in the past. The confirmation information is information that serves as a reference when the singer decides whether or not to perform the operation instructed in the past karaoke performance in the current karaoke song. The confirmation information is, for example, a character string indicating specific contents of an operation or a character string prompting an operation instruction. Confirmation information for each operation is preset and stored in the storage unit 13, for example. The confirmation information is displayed on the display screen of the display device 30, for example.

The confirmation information is preferably displayed at a predetermined timing. Specifically, the display control unit 200 displays the confirmation information based on the timing at which the operation recorded in the operation history is instructed.

FIG. 4 shows specific confirmation information according to the operation history of FIG. Display time is associated with the confirmation information. The display time indicates the timing for displaying the confirmation information. The display time is set according to the operation time. In FIG. 4, the display time is set to a time slightly earlier than the operation time in FIG. In this way, by displaying the confirmation information at a slightly earlier timing than the timing at which the operation was instructed in the past, the singer can perform the operation instructed in the past karaoke singing from the time the operation was performed. can be grasped in advance.

Here, it is assumed that singer X sings karaoke song A again in a state in which the operation history shown in FIG. 3 is stored. In this case, the display control unit 200 displays the confirmation information (see FIG. 4) corresponding to the operation recorded in the operation history at the timing based on the operation time in the operation history shown in FIG. ) is read from the storage unit 13 and displayed on a display device or the like. For example, the display control unit 200 causes the display screen of the display device 30 to display a character string (confirmation information) "Do you want to lower the key by two?" 20 seconds after the karaoke performance starts.

[Determination part]
The judgment unit 300 judges whether or not to execute the operation corresponding to the displayed confirmation information based on the analysis result of the voice uttered by the singer.

A well-known technique can be used for speech analysis. For example, assume that a voice is input from the microphone 40 after certain confirmation information is displayed. The determination unit 300 controls the DSP of the sound processing unit 14 and analyzes the digital voice data converted by the A/D converter using a well-known voice recognition algorithm. Then, the determination unit 300 associates the characters based on the syllables recognized from the digital voice data with the input timing when the characters are voice-inputted, and temporarily stores them in a RAM (not shown) or the like. The determination unit 300 analyzes the voice by specifying the voice-inputted characters in chronological order by executing the same processing each time voice input is made from the microphone 40 .

After that, the determination unit 300 determines whether or not to execute the operation corresponding to the displayed confirmation information based on the analysis result of the voice.

Determining whether to perform the operation corresponding to the confirmation information can be made in various ways.

As an example, the determination unit 300 determines that it is necessary to perform an operation corresponding to the confirmation information when the singer's voice matches a predetermined word.

The predetermined word is a preset keyword. The predetermined word may be a short word (eg, "yes", "yes", etc.) as it indicates the singer's intent to perform the operation corresponding to the displayed confirmation information. Also, as the predetermined word, one keyword may be set regardless of the type of confirmation information (regardless of the content of the operation).

For example, it is assumed that during the second karaoke performance of song A, the confirmation information "Would you like to lower the key by two?" is displayed. On the other hand, it is assumed that the singer X has performed voice input of "yes". In this case, the determination unit 300 determines whether the input voice "yes" matches a predetermined word.

Specifically, the determination unit 300 sequentially compares each specified character with a predetermined word. For example, assume that the character "wa" is identified. In this case, the determination unit 300 compares "ha" with the first character of the predetermined word. When the specified character matches the first character of the predetermined word, the determination unit 300 compares the character specified next to the certain character with the second character of the predetermined word. As a result of the sequential comparison, if all the characters identified in time series match the predetermined word, the determination unit 300 determines that the singer's voice matches the predetermined word. As a result, the determination unit 300 determines that it is necessary to perform the operation corresponding to the confirmation information (lower the key by two semitones). The judgment section 300 outputs to the performance control section 400 a judgment result indicating that the operation is required to be executed.

On the other hand, when the singer's voice does not match the predetermined word, the determination unit 300 determines that it is not necessary to perform the operation corresponding to the confirmation information. For example, if the karaoke song continues despite the confirmation information being displayed (if the predetermined word is not uttered), the singer performs the operation corresponding to the confirmation information in this karaoke song is likely to think that is not necessary. Alternatively, the singer may utter words such as "no" or "no" (words other than predetermined words) when the singer determines that the operation corresponding to the confirmation information is not necessary. Therefore, when the singer's voice does not match the predetermined word, the determination unit 300 can determine that it is not necessary to perform the operation corresponding to the confirmation information. The judgment section 300 outputs to the performance control section 400 the judgment result that the operation is unnecessary.

As another example, the determination unit 300 can determine that the operation corresponding to the confirmation information does not need to be performed if there is no voice input within a predetermined time after the confirmation information is displayed.

If there is no voice input within a predetermined time after the confirmation information is displayed, the singer is likely to think that the operation corresponding to the confirmation information is not necessary in the current karaoke singing. Therefore, the determination unit 300 determines that execution of the operation corresponding to the confirmation information is unnecessary. In this case, the judgment section 300 outputs to the performance control section 400 a judgment result that the operation is unnecessary. The predetermined time can be set to any time (for example, 2 seconds) according to the tempo and length of the music.

On the other hand, there may be a case where the voice input of a predetermined word cannot be performed within a predetermined time for some reason. Therefore, if there is no voice input within a predetermined time after the confirmation information is displayed, the determination unit 300 can also determine that the operation corresponding to the confirmation information needs to be executed. Since the confirmation information is based on the operation history in the past karaoke singing (hereinafter referred to as "past operation history"), even if the corresponding operation is executed, the singer is unlikely to be confused.

In addition to the microphone 40, voice input can also be performed via the sound collecting means built in the remote control device 50 or the microphone of the portable terminal owned by the singer. When using a portable terminal, dedicated application software is installed in advance, and voice input is performed while the software is running.

[Performance control section]
The performance control unit 400 performs various controls related to karaoke performance. In this embodiment, when it is determined that an operation needs to be performed, the performance control section 400 controls the karaoke performance so that the operation is performed.

For example, it is assumed that determination section 300 outputs to performance control section 400 a determination result indicating that it is necessary to perform an operation of "lowering the key by two semitones." In this case, the performance control section 400 controls the sound processing section 14 to lower the key of the currently performed karaoke performance by two semitones based on the determination result. It should be noted that when the determination result that the operation is unnecessary is output from the determination unit 300, the performance control unit 400 does not perform any special processing (the performance control unit 400 makes a sound to continue the current karaoke performance as it is). control the processing unit 14).

==About the operation of the karaoke device 1==
Next, a specific example of the operation of the karaoke machine 1 in this embodiment will be described with reference to FIG. FIG. 5 is a flow chart showing an operation example of the karaoke device 1. As shown in FIG.

Suppose that a singer X instructs an operation related to the karaoke performance with the karaoke performance of the song A. In this case, the history processing unit 100 stores the operation history in which the operations related to the karaoke performance are recorded in chronological order in the storage unit 13 in association with the identification information of the song A and the identification information of the singer X (storage of the operation history .step 10).

After that, it is assumed that the singer X sings the song A again in karaoke. In this case, the display control unit 200 causes the confirmation information corresponding to the operation included in the operation history stored in step 10 to be displayed along with the second karaoke performance of the song A (the confirmation information is displayed along with the second karaoke performance). is displayed, step 11).

After that, the determination unit 300 determines whether or not to execute the operation corresponding to the displayed confirmation information based on the analysis result of the voice uttered by the singer X (determines whether or not to execute the operation; step 12). .

If it is determined that it is necessary to perform the operation (Y in step 13), the performance control unit 400 performs the operation corresponding to the confirmation information displayed in step 11 for the current karaoke performance. Execute (execute the operation corresponding to the confirmation information, step 14). The karaoke device 1 repeats the processing of steps 11 to 14 until the karaoke performance of the song A ends (until Y in step 15).

As is clear from the above, the karaoke device 1 according to the present embodiment stores an operation history in which operations related to the karaoke performance, which are instructed by the singer along with the karaoke performance of a certain song, are recorded in chronological order. and the history processing unit 100 that is stored in the storage unit 13 in association with the identification information of the singer and the identification information of the singer. Based on the display control unit 200 that displays confirmation information corresponding to the operation recorded in the operation history and the analysis result of the voice uttered by the singer, it is determined whether to execute the operation corresponding to the displayed confirmation information. and a performance control unit 400 that, when it is determined that an operation needs to be performed, performs control so that the operation is performed in karaoke performance.

According to such a karaoke device 1, when a singer sings a certain song again in karaoke, it corresponds to the operation recorded in the past operation history of the singer as the song is played again in karaoke. Confirmation information is displayed. Therefore, even during karaoke singing, the singer can easily grasp the details of the operation to be instructed. Also, based on the analysis result of the voice uttered by the singer, it is determined whether or not to execute the operation corresponding to the displayed confirmation information. Therefore, the singer does not need to give operation instructions via the remote controller 50 or the like, which is convenient. That is, according to the karaoke device 1 of the present embodiment, it is possible to easily give an instruction when instructing an operation related to karaoke performance using voice input.

Further, the display control unit 200 displays the confirmation information based on the timing at which the operation recorded in the operation history is instructed. By displaying the confirmation information at such timing, the singer can give an operation instruction at an appropriate time during karaoke singing.

Moreover, the determination unit 300 determines that it is necessary to perform an operation corresponding to the confirmation information when the singer's voice matches a predetermined word. Since there are a wide variety of operations that can be performed in karaoke performance, it is not realistic for each singer to remember all the keywords. On the other hand, by judging whether or not it is necessary to perform an operation based on whether or not the singer's voice matches a predetermined word, the singer does not need to memorize multiple keywords for each operation. Therefore, the singer can more easily give operation instructions.

Further, if there is no voice input within a predetermined time after the confirmation information is displayed, the determination unit 300 determines that the operation corresponding to the confirmation information does not need to be executed. By making such a determination, even if it is an operation recorded in the past operation history, the operation that the singer thought was unnecessary in the current karaoke singing is not executed. . In other words, the singer can instruct only the desired operation from among the operations recorded in the past operation history.

<Others>
In addition, the history processing unit 100 can update the operation history based on the new operation when a new operation is instructed by the singer along with the second karaoke performance of a certain song.

For example, assume that the operation history shown in FIG. 2 is stored in the storage unit 13 . After that, it is assumed that the singer X instructs a new operation when performing karaoke singing of the song A again.

In this case, the history processing unit 100 creates an operation history by recording new operations instructed by the singer X in chronological order. After the karaoke performance (karaoke singing) of the song A ends, the history processing unit 100 updates the operation history (past operation history) stored in the storage unit 13 to the created operation history (new operation history). do. It should be noted that the new operation does not have to be different from the past operation (the same operation may be included). Alternatively, the history processing unit 100 does not update the entire past operation history, but adds only the operations not included in the operation history to the already stored past operation history. can also be updated.

In addition, after the karaoke performance of the song A is completed, the history processing unit 100 stores the created operation history together with the identification information (song ID) of the song A and the identification information (singer ID) of the singer X, along with the karaoke The instruction content regarding the performance tempo at the start of the performance may be associated and stored in the storage unit 13 . As a result, even if a different performance tempo is instructed in the next karaoke performance of the song A, the confirmation information can be displayed at an appropriate timing based on the operation time recorded in the operation history. Indications regarding performance tempo are usually made using plus/minus values relative to the original tempo of the piece of music. Further, when recording the operations in chronological order, the history processing unit 100 may record the performance position information of the music data (MIDI data) instead of the time. In this case, since the MIDI information is always synchronized with the performance tempo, there is no need to store the instruction content regarding the performance tempo at the start of the karaoke performance.

In addition, the history processing unit 100 may further store the determination result of execution necessity for each operation, and delete from the operation history the operation for which the determination of execution necessity continues a predetermined number of times (for example, five times). As a result, it is possible to omit the display of the confirmation information of the operation that is presumed to be unnecessary.

Further, in the above embodiment, the confirmation information is a character string indicating the specific content of the operation, but an icon (illustration or figure) may be used as the confirmation information, or both the character string and the icon may be used. good too.

The above embodiments are presented as examples and are not intended to limit the scope of the invention. The above configurations can be implemented in combination as appropriate, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. The above-described embodiments and modifications thereof are included in the invention described in the claims and their equivalents, as well as being included in the scope and gist of the invention.

1 karaoke device 13 storage unit 100 history processing unit 200 display control unit 300 determination unit 400 performance control unit

Claims (5)

An operation history that chronologically records the operations related to the karaoke performance, which are instructed by the singer along with the karaoke performance of a certain song, in the storage unit in association with the identification information of the song and the singer's identification information. a history processing unit for storing;
When the singer sings the certain song again in karaoke, a display control unit that displays confirmation information corresponding to the operation recorded in the operation history in chronological order along with the karaoke performance of the certain song again,
A determination unit that determines whether to perform an operation corresponding to the displayed confirmation information based on the analysis result of the voice uttered by the singer after the confirmation information is displayed ;
A performance control unit that controls to perform the operation for karaoke performance when it is determined that the operation is required to be performed;
A karaoke device having The history processing unit updates the operation history based on the new operation when a new operation is instructed by the singer when the karaoke performance of the certain song is performed again. Item 1. The karaoke apparatus according to item 1. 3. The karaoke machine according to claim 1, wherein the display control unit displays the confirmation information based on the timing at which the operation recorded in the operation history is instructed. 4. Any one of claims 1 to 3, wherein the determination unit determines that it is necessary to perform an operation corresponding to the one piece of confirmation information when the voice of the singer matches a predetermined word. A karaoke device according to one. The judging unit judges that execution of the operation corresponding to the one piece of confirmation information is unnecessary if the voice is not input within a predetermined time after the one piece of confirmation information is displayed. The karaoke machine according to any one of claims 1 to 4.

Images