JP2021021848A - Input device for karaoke - Google Patents

Abstract

To provide an input device for karaoke, with which a user can easily input voice even if the user is a stammerer.SOLUTION: An input device for karaoke comprises: a voice processing unit for sound-recognizing a voice signal of a user, which is outputted from sound collection means, and outputting the signal as text data; an execution unit for executing a command corresponding to inputted voice; a determination unit for determining whether a stammer is included in the voice signal; and a guide unit for outputting guide sound for guiding voice input by the user when the stammer is determined to be included.SELECTED DRAWING: Figure 2

Description

The present invention relates to a karaoke input device.

A technique is known in which a remote controller attached to a karaoke device is used to input words or short sentences corresponding to operation or search commands by voice, change the tempo or key of a karaoke performance, or search for music.

For example, Patent Document 1 discloses a music search system capable of automatically extracting each search term from a series of voice data including a plurality of search terms and performing a highly accurate music search.

JP-A-2002-189483

Here, when the user stutters, the karaoke singing is not so affected, but the voice input of the word or short sentence corresponding to the command may be difficult.

An object of the present invention is to provide a karaoke input device capable of easily performing voice input even when the user stutters.

One invention for achieving the above object is a karaoke input device for executing a predetermined command by voice input, and voice recognition processing of a user's voice signal output from a sound collecting means is performed. A voice processing unit that outputs as text data, an execution unit that executes a command corresponding to the input voice based on the text data, a determination unit that determines whether or not the voice signal contains stuttering, and a stuttering sound. Is a karaoke input device having a guide unit for outputting a guide sound for guiding voice input by the user when it is determined that the data is included.
Other features of the present invention will be clarified by the description of the specification and drawings described later.

According to the present invention, voice input can be easily performed even when the user is stuttering.

It is a figure which shows the karaoke apparatus which concerns on 1st Embodiment. It is a figure which shows the remote control device which concerns on 1st Embodiment. It is a flowchart which shows the process by the remote control device which concerns on 1st Embodiment. It is a figure which shows the remote control device which concerns on 2nd Embodiment. It is a table of the tempo and volume of the guide sound according to the degree of stuttering, which is stored by the storage means according to the second embodiment.

<First Embodiment>
The karaoke input device according to the present embodiment will be described with reference to FIGS. 1 to 3.

== Karaoke device ==
The karaoke device K is a device for performing karaoke of music and for the user to sing karaoke. As shown in FIG. 1, the karaoke device K includes a karaoke body 10, a speaker 20, a display device 30, a microphone 40, and a remote control device 50.

The karaoke main body 10 performs various controls related to karaoke performance and karaoke singing, such as performance control of selected songs, display control of lyrics and background images, and processing of audio signals input through a microphone 40. The speaker 20 is configured to emit sound based on the sound emitted signal from the karaoke main body 10. The display device 30 is configured to display an image or an image on the screen based on the signal from the karaoke body 10. The microphone 40 is configured to convert the user's singing voice into an analog voice signal and input it to the karaoke main body 10. The remote control device 50 is a device for performing various operations on the karaoke main body 10. The remote control device 50 in this embodiment corresponds to a "karaoke input device".

== Remote control device ==
As shown in FIG. 2, the remote control device 50 according to the present embodiment includes a storage means 50a, a communication means 50b, a display means 50c, an input means 50d, a sound collecting means 50e, a sound emitting means 50f, and a control means 50g. Each configuration is connected to bus B via an interface (not shown).

[Memory means]
The storage means 50a is a large-capacity storage device that stores various types of data.

The storage means 50a in the present embodiment stores a plurality of commands in association with different text data.

The command is a command corresponding to a process that can be executed when singing karaoke. The commands are, for example, "Increase the tempo of the karaoke performance", "Decrease the key of the karaoke performance", "Pause the karaoke performance", "Increase the volume of the microphone", "Decrease the volume from the speaker", " It is an instruction to execute processing such as "turn off the display of lyrics" and "search for music".

Text data is data for identifying a command. One different text data is associated with each of the plurality of commands. For example, the text data of "Tempo Agete" is associated with the command "Increase the tempo of karaoke performance by 5%". Text data that is not stored in the table is treated as if there is no corresponding command.

[Communication means / Display means / Input means / Sound collecting means / Sound emitting means]
The communication means 50b provides an interface for communicating with the karaoke body 10. The display means 50c is configured to display various types of information. The input means 50d is configured for the user to input various instructions. The input means 50d is a button or the like provided on the remote controller device 50. Alternatively, when the display means 50c is configured in the touch panel format, the display means 50c also functions as the input means 50d. The sound collecting means 50e is a microphone for collecting sound emitted by the user and outputting it as a voice signal. The sound emitting means 50f is a speaker that emits various sounds.

[Control means]
The control means 50g performs various controls on the remote controller 50. The control means 50 g includes a CPU and a memory (neither of which is shown). The CPU realizes various functions by executing a program stored in the memory.

Here, it is assumed that a user who uses the karaoke device K wants to instruct the execution of various commands by using voice input. In this case, the user selects the "voice input" icon displayed on the display means 50c, for example, via the input means 50d. Based on the selection, the CPU of the control means 50g executes the program stored in the memory and shifts to the voice input mode. In this case, the control means 50g functions as a voice processing unit 100, an execution unit 200, a determination unit 300, and a guide unit 400.

(Voice processing unit)
The voice processing unit 100 performs voice recognition processing on the user's voice signal output from the sound collecting means 50e and outputs it as text data. A known method can be used for the voice recognition process.

For example, suppose that the user U utters "tempo agete" to the sound collecting means 50e. The sound collecting means 50e collects sound and outputs it as a voice signal to the voice processing unit 100. The voice processing unit 100 processes the voice signal and outputs the "tempo agete" indicated by the voice signal as text data.

(Execution department)
The execution unit 200 executes a command corresponding to the input voice based on the text data.

For example, it is assumed that the text data "tempo agete" is output from the voice processing unit 100. The execution unit 200 confirms whether or not the data corresponding to the output text data is stored in the storage means 50a. When the data is stored in the storage means 50a, the execution unit 200 reads the command corresponding to the text data and executes a process of raising the tempo of the karaoke performance.

On the other hand, when the data corresponding to the text data output from the voice processing unit 100 is not stored in the storage means 50a, there is no command corresponding to the text data. In this case, the execution unit 200 does not execute the command.

(Judgment unit)
The determination unit 300 determines whether or not the voice signal includes stuttering. As a method for determining whether or not the voice signal contains stuttering, a known method (see, for example, Japanese Patent Application Laid-Open No. 2019-056791) can be used.

Specifically, when the voice signal is output from the sound collecting means 50e, the determination unit 300 determines whether or not the voice signal includes stuttering.

When it is determined that stuttering is included, the determination unit 300 outputs a signal to that effect to the guide unit 400. On the other hand, when it is determined that the stuttering is not included, the determination unit 300 outputs a signal to that effect to the voice processing unit 100. The voice processing unit 100 starts voice recognition processing of a voice signal based on the signal. The voice signal may include stuttering as long as the voice recognition process by the voice processing unit 100 is not affected. That is, the determination unit 300 determines the presence or absence of stuttering based on whether or not the voice recognition process is affected.

Alternatively, when a voice signal is output from the sound collecting means 50e, the voice processing unit 100 may first perform voice recognition processing of the voice signal. When the voice recognition process is completed, the voice processing unit 100 outputs text data to the execution unit 200. On the other hand, when the voice recognition process cannot be performed, the voice processing unit 100 outputs a signal to that effect to the determination unit 300. Only when the voice recognition process cannot be performed in this way, the determination unit 300 may determine whether or not the voice signal includes stuttering. It should be noted that the reason why the voice recognition process cannot be performed may be various reasons other than stuttering, such as the voice itself being small and the noise being too much. That is, even if the voice recognition process cannot be performed, the voice signal does not always include stuttering.

(Guide section)
The guide unit 400 outputs a guide sound when it is determined that the stuttering sound is included. Stuttering is reduced by speaking in time with the guide sound. For example, as a training for stuttering in daily life, a method of using a metronome sound as a guide sound is used.

The guide sound is a sound for guiding the voice input of the stuttering user. The guide sound is, for example, an electronic metronome sound having a predetermined tempo and volume, or a rhythmic BGM or rhythm pattern. As the guide sound, one sound may be set in advance for each karaoke device, or a sound arbitrarily selected by the user from a plurality of guide sounds may be used.

When a signal indicating that stuttering is included is input from the determination unit 300, the guide unit 400 outputs the guide sound via the sound emitting means 50f. The user of stuttering can calmly input voice according to the guide sound.

The guide sound can be stopped at various timings. For example, the guide unit 400 can stop the output of the guide sound when the user selects the "voice input end" icon displayed on the display means 50c via the input means 50d.

Alternatively, the guide unit 400 determines that the voice signal does not include stuttering, the voice processing unit 100 completes the voice recognition process, or the sound collecting means 50e inputs the voice for a predetermined time. If it is not accepted, the output of the guide sound may be stopped.

== Processing in the remote control device ==
The processing in the remote control device 50 according to the present embodiment will be described with reference to FIG. FIG. 3 is a flowchart showing processing in the remote controller device 50. In this example, it is assumed that the voice input mode is being executed.

The user performs voice input via the sound collecting means 50e. The sound collecting means 50e collects sound and outputs it as a voice signal to the determination unit 300 (output of voice signal, step 10).

The determination unit 300 determines whether or not the voice signal output in step 10 includes stuttering.

When it is determined that stuttering is included (in the case of Y in step 11), the guide unit 400 outputs a guide sound for guiding the voice input by the user (output of the guide sound; step 12). The user inputs the voice again according to the guide sound.

On the other hand, when it is determined that stuttering is not included (in the case of N in step 11), the voice processing unit 100 performs voice recognition processing on the voice signal output in step 10 and outputs it as text data (text data). Output. Step 13).

The execution unit 200 executes a command corresponding to the input voice based on the text data output in step 13 (command execution. Step 14).

As is clear from the above, the remote controller device 50 according to the present embodiment is a device for executing a predetermined command by voice input. The remote control device 50 issues a voice processing unit 100 that performs voice recognition processing on the user's voice signal output from the sound collecting means 50e and outputs it as text data, and a command corresponding to the input voice based on the text data. An execution unit 200 to execute, a determination unit 300 for determining whether or not the voice signal contains a stutter, and a guide for outputting a guide sound for guiding the voice input by the user when it is determined that the voice signal contains the stutter. It has a part 400 and.

According to such a remote controller 50, a guide sound is output when the voice signal includes stuttering. A user of stuttering can input voice without being affected by stuttering by inputting voice according to the guide sound. That is, according to the remote control device according to the present embodiment, voice input can be easily performed even when the user is stuttering.

<Second Embodiment>
Next, the karaoke input device according to the second embodiment will be described with reference to FIGS. 4 and 5. In this embodiment, an example of outputting a guide sound according to the degree of stuttering will be described. The description of the same configuration as that of the first embodiment will be omitted.

[Control means]
As in the first embodiment, it is assumed that the user who uses the karaoke device K wants to instruct the execution of various commands by using voice input. In this case, the user selects the "voice input" icon displayed on the display means 50c via the input means 50d. Based on the selection, the CPU of the control means 50g executes the program stored in the memory and shifts to the voice input mode. In this case, the control means 50g functions as a voice processing unit 100, an execution unit 200, a determination unit 300, a guide unit 400, and a setting unit 500 (see FIG. 4).

(Setting part)
When it is determined that stuttering is included, the setting unit 500 sets the tempo and / or volume of the guide sound based on the degree of the stuttering.

The degree of stuttering can be expressed, for example, as the number of times within a predetermined time. The tempo and volume of the guide sound based on the degree of stuttering are preset. For example, the storage means 50a stores the tempo and volume of the guide sound according to the degree of stuttering, as shown in the table of FIG.

When the determination unit 300 determines that stuttering is included, the determination unit 300 measures the degree of stuttering. The determination unit 300 outputs information indicating the measured degree of stuttering to the setting unit 500.

The setting unit 500 sets the guide sound suitable for the degree of stuttering based on the signal output by the determination unit 300 to the effect that the stuttering is included and the information indicating the degree of stuttering. The guide sound is set for at least one of the tempo and the volume.

The guide unit 400 outputs a guide sound at the tempo and / or volume set by the setting unit 500.

As a specific example, it is assumed that "the stuttering is 3 times or more in 5 seconds" is output from the determination unit 300 as information indicating the degree of stuttering of the user U1.

In this case, the setting unit 500 refers to the table of FIG. 5 and sets the tempo of the guide sound to be slow (for example, BPM = 80) and the volume to be large (“4” out of 10 steps). The guide unit 400 outputs a guide sound at a set tempo and volume.

On the other hand, it is assumed that the determination unit 300 outputs "stuttering twice in 5 seconds" as information indicating the degree of stuttering of the user U2. In this case, it is considered that the degree of stuttering of user U2 is lighter than the degree of stuttering of user U1.

Therefore, the setting unit 500 sets the tempo of the guide sound to be slightly slower (for example, BPM = 100) and the volume to be slightly louder (“3” out of 10 steps). The guide unit 400 outputs a guide sound at a set tempo and volume.

In this example, an example of setting the tempo and volume of the guide sound has been described, but the setting unit 500 may set either the tempo or the volume.

As described above, the remote controller device 50 according to the present embodiment has a setting unit 500 that sets the tempo and / or volume of the guide sound based on the degree of the stuttering when it is determined that the stuttering is included. Further, the guide unit 400 outputs a guide sound at a set tempo and / or volume. According to such a remote control device, it is possible to output an appropriate guide sound (that is, a guide sound that facilitates the user to input voice) according to the degree of stuttering of the user.

<Modification example 1>
When the guide sound is output at a certain tempo and volume as in the second embodiment, the user tries to input the voice again in accordance with the guide sound. On the other hand, the set tempo and volume may not be appropriate for the user. In such a case, it is preferable to set the tempo and volume of the guide sound suitable for the user.

Therefore, when a new voice signal is output from the sound collecting means 50e while the guide unit 400 is outputting the guide sound, the determination unit 300 determines whether or not the new voice signal includes stuttering. ..

The setting unit 500 resets the tempo and / or the volume according to the determination result of the determination unit 300. Specifically, when the determination unit 300 determines that the voice signal includes stuttering, the setting unit 500 resets the guide sound by changing the tempo and volume.

The guide unit 400 outputs a new guide sound at the reset tempo and / or volume. The remote controller 50 can repeatedly reset the guide sound until it is determined that the stuttering is not included.

In this way, when the voice signal input by voice according to the guide sound includes stuttering, the guide sound suitable for the degree of stuttering of the user can be output by resetting the tempo and volume of the guide sound. ..

<Modification 2>
When voice input is performed in accordance with the guide sound as in the above embodiment, there is a possibility that the sound collected by the sound collecting means 50e includes not only the voice input but also the guide sound. The presence of such a guide sound may cause the voice processing unit 100 to make a mistake in the voice recognition process.

Therefore, when a new voice signal is output from the sound collecting means 50e while the guide unit 400 is outputting the guide sound, the voice processing unit 100 collects the new voice signal when performing voice recognition processing. Preprocessing is performed to remove the guide sound output from the sound means 50e.

Specifically, the voice processing unit 100 acquires a voice signal corresponding to the guide sound from the guide unit 400. The voice processing unit 100 extracts only the voice signal corresponding to the voice input by subtracting the voice signal corresponding to the guide sound from the voice signal corresponding to the sound collected by the sound collecting means 50e, and the extracted voice. Performs voice recognition processing based on the signal.

It is not necessary to completely remove the audio signal corresponding to the guide sound. That is, the voice signal corresponding to the guide sound may be weakened to the extent that the voice recognition process can be performed based on the voice signal corresponding to the voice input.

By performing such preprocessing, it is possible to reliably extract only the voice signal corresponding to the voice input from the sound collected by the sound collecting means 50e.

When the volume of the guide sound is set by the setting unit 500, the preprocessing for removing the guide sound may be performed based on the set volume of the guide sound. For example, in the table of FIG. 5, when the volume of the guide sound is set to be high (“4” out of 10 steps), preprocessing is performed and the volume of the guide sound is slightly loud (“3” out of 10 steps). ) If the following is set, preprocessing may not be performed. As a result, the voice processing unit 100 can perform voice recognition processing more reliably.

<Others>
The above embodiment has been described by taking the remote controller device 50 as an example of the input device for karaoke. On the other hand, the karaoke device K itself may function as a karaoke input device. In this case, the karaoke body 10 includes at least a storage means 50a, a communication means 50b, and a control means 50g (voice processing unit 100, execution unit 200, determination unit 300, guide unit 400). Further, the display device 30 functions as the display means 50c, the remote control device 50 functions as the input means 50d, the microphone 40 functions as the sound collecting means 50e, and the speaker 20 functions as the sound emitting means 50f.

The above-described embodiment is presented as an example and does not limit the scope of the invention. The above configurations can be implemented in appropriate combinations, and various omissions, replacements, and changes can be made without departing from the gist of the invention. The above-described embodiment and its modifications are included in the scope and gist of the invention, as well as in the scope of the invention described in the claims and the equivalent scope thereof.

50 Remote control device 100 Voice processing unit 200 Execution unit 300 Judgment unit 400 Guide unit 500 Setting unit

Claims (4)

A karaoke input device for executing a predetermined command by voice input.
A voice processing unit that performs voice recognition processing on the user's voice signal output from the sound collecting means and outputs it as text data.
An execution unit that executes a command corresponding to the input voice based on the text data,
A determination unit that determines whether or not the voice signal contains stuttering,
When it is determined that stuttering is included, a guide unit that outputs a guide sound for guiding voice input by the user, and a guide unit.
Input device for karaoke. When it is determined that stuttering is included, it has a setting unit that sets the tempo and / or volume of the guide sound based on the degree of stuttering.
The karaoke input device according to claim 1, wherein the guide unit outputs a guide sound at a set tempo and / or volume. When a new voice signal is output from the sound collecting means while the guide unit is outputting the guide sound, the determination unit determines whether or not the new voice signal includes stuttering.
The setting unit resets the tempo and / or the volume according to the determination result of the determination unit.
The karaoke input device according to claim 2, wherein the guide unit outputs a new guide sound at a reset tempo and / or volume. When a new voice signal is output from the sound collecting means while the guide unit is outputting the guide sound, the voice processing unit receives the sound when the new voice signal is voice-recognized. The karaoke input device according to any one of claims 1 to 3, wherein a pretreatment for removing the guide sound output from the means is performed.

Images