JP2016066034A - Karaoke device, and control method of karaoke device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a karaoke device capable of extracting user voice even when sounds are emitted from the karaoke device, and a control method of the karaoke device.SOLUTION: A karaoke device includes: music information expressing reproduction sound of the music; an acoustic control means for generating pronunciation information, which expresses the sound emitted from the speaker, including singing information expressing a singing voice of a singer; acquisition means for acquiring user voice information expressing the voice of the user and voice operation information including information expressing the sound emitted from the speaker according to the voicing information; extraction means for extracting the user voicing information included in the voice operation information by comparing the voice operation information and the voicing information; and first control means for generating instruction information expressing various kinds of instructions according to the user voice information extracted by the extraction means.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a karaoke apparatus capable of giving various instructions by a user's voice even when a sound such as an accompaniment sound is output from a speaker.

  2. Description of the Related Art Conventionally, a karaoke apparatus equipped with a music search function using voice recognition means is known. However, during the use of the karaoke service, karaoke music or the like is played in the karaoke box, and the karaoke box is not silent. That is, even if the user performs a music search using the voice recognition means in the karaoke box, voice recognition is hindered by ambient sounds such as karaoke music played by the karaoke device. In order to cope with the case where the voice recognition is hindered, for example, a music performance device described in Patent Document 1 has been proposed. This music performance device is provided with means for determining whether or not a music is being played when a voice is input, and if the means determines that the music is being played, it indicates that recognition by the voice recognition means is not possible. Output a message.

JP 11-265190 A

  However, when using a music search by voice in a karaoke box, the sound that hinders the extraction of the user's voice is mainly a music accompaniment sound and a music playback device such as a singer's singing sound at the time of singing Is a sound output by. In addition, the music reproducing device reproduces an advertising moving image or the like at a time other than singing, and outputs an advertising sound from the speaker. Therefore, there is a possibility that the voice cannot be recognized correctly even when not singing.

  Therefore, an object of the present invention is to provide a karaoke apparatus that can extract a user's voice even when sound is generated from the karaoke apparatus, and a method for controlling the karaoke apparatus.

  In order to achieve this object, the karaoke apparatus according to claim 1 is sound generation information including music information representing a reproduction sound of music and singing information representing a singer's singing sound, which is generated by a speaker. Sound control means for generating pronunciation information representing voice, acquisition means for obtaining voice operation information including user voice information representing user's voice, and information representing sound generated from a speaker according to the pronunciation information, voice operation information And the first control means for generating instruction information representing various instructions in accordance with the user voice information extracted by the extraction means, and extracting the user voice information included in the voice operation information. And.

  The karaoke apparatus according to claim 2 includes synchronization sound information adding means for adding, to the pronunciation information, synchronization sound information representing a sound of a predetermined frequency in order to synchronize the voice operation information and the pronunciation information, According to a predetermined frequency represented by the synchronization sound information, the voice operation information and the pronunciation information are synchronized to extract user voice information.

  The acquisition device of the karaoke apparatus according to claim 3 acquires a sound of a predetermined frequency represented by the synchronization sound information generated from the speaker according to the pronunciation information, and the synchronization sound information addition device acquires the user voice information by the acquisition device. When finished, the addition of the synchronization sound information ends, and the extraction means starts adding specific information representing a sound having a frequency matching the synchronization sound information included in the voice operation information and the synchronization sound information included in the pronunciation information User voice information is extracted by synchronizing the position and the addition end position.

  The karaoke apparatus according to claim 4 is a karaoke apparatus including a music playback device for playing back music and a movable terminal device, and the terminal device executes acquisition means, extraction means, and various processes. A first communication means for communicating with the music playback device; the music playback device; a second control means for executing an acoustic control means, a synchronization sound information adding means, and various processes; Second communication means for communicating with the terminal device, wherein the first control means generates instruction information representing various instructions according to the user voice information extracted by the extraction means.

  The first control means of the karaoke apparatus according to claim 5 is a process of causing the acquisition means to start acquiring voice operation information, a process of sending a generation instruction indicating starting generation of pronunciation information to the second control means, When the voice operation information acquired by the acquisition unit includes synchronous sound information, a process for displaying a notification indicating permission to include the user voice information in the voice operation information on the display unit, and including the user voice information in the voice operation information If the process ends, the process for sending the generation end instruction indicating the end of the generation of the pronunciation information to the second control means, the voice operation information, and the pronunciation information are compared with the extraction means and included in the voice operation information. A process for causing the extraction means to extract the user voice information to be extracted and a process for generating instruction information representing various instructions according to the extracted user voice information are executed. The second control means causes the sound control means to start generating the pronunciation information in accordance with the generation instruction from the first control means, adds the synchronization sound information to the pronunciation information by the synchronization sound information addition means, and generates the sound to the speaker. And a process of causing the sound control means to finish generating the pronunciation information and sending the pronunciation information to the first control means in accordance with a generation end instruction from the first control means.

  The karaoke apparatus according to claim 1, acoustic control means for generating the pronunciation information representing a sound generated by a speaker, user voice information representing a user's voice, and information representing a sound generated from the speaker according to the pronunciation information; An acquisition means for acquiring voice operation information including: an extraction means for comparing the voice operation information with the pronunciation information to extract user voice information included in the voice operation information; and the user voice information extracted by the extraction means And first control means for generating instruction information representing various instructions. The obtaining means obtains voice operation information including user voice information representing the user's voice and information representing the sound generated by the speaker according to the pronunciation information. Therefore, the extraction means includes the voice operation information and the pronunciation information. In comparison, user voice information can be extracted. Thereby, instruction information representing various instructions can be generated in accordance with the extracted user voice information.

  The karaoke apparatus according to claim 2 further includes synchronization sound information adding means for adding synchronization sound information representing a sound of a predetermined frequency to synchronize the sound operation information and the sound generation information with the sound generation information, In accordance with a predetermined frequency represented by the sound information, the voice operation information and the pronunciation information are synchronized, and the user voice information is extracted. By adding the synchronization sound information to the pronunciation information by the synchronization sound information addition means, the extraction means can compare the pronunciation information and the voice operation information more accurately. Thereby, user voice information can be extracted more reliably. Instruction information representing various instructions can be generated in accordance with the extracted user voice information.

  In the karaoke apparatus according to claim 3, the acquisition unit acquires a sound having a predetermined frequency represented by the synchronization sound information generated from the speaker in accordance with the pronunciation information, and the acquisition unit acquires the user voice information. When the process is finished, the addition of the synchronization sound information ends, and the extraction means starts adding specific information representing a sound having a frequency matching the synchronization sound information included in the voice operation information and the synchronization sound information included in the pronunciation information. The user voice information is extracted by synchronizing the position and the addition end position. By synchronizing the addition start position and the addition end position of the sound of the frequency matching the voice operation information and the synchronization sound information included in the pronunciation information, the extraction means can more accurately synchronize the pronunciation information and the voice operation information. Can be compared. Thereby, user voice information can be extracted more reliably. Further, since the addition start position and the addition end position of the synchronization sound information are synchronized and compared from the start position to the end position, the extraction process can be reduced.

  The karaoke device according to claim 4 includes a music playback device for playing back music and a movable terminal device. The terminal device includes acquisition means, extraction means, first control means for executing various processes, and first communication means for communicating with the music playback device. The music reproducing device includes an acoustic control unit, a synchronization sound information adding unit, a second control unit that performs various processes, and a second communication unit for communicating with the terminal device. The first control means generates instruction information representing various instructions according to the user voice information extracted by the extracting means. Since the karaoke device includes the music playback device and the movable terminal device, the instruction information can be generated by voice even at a place away from the music playback device using the movable terminal device.

1 is a block diagram of a music playback device 10 and a remote control terminal 20a of a karaoke device 1 according to a first embodiment of the present invention. It is a flowchart showing the process performed by the control part 100 of the music reproduction apparatus 10, and the control part 200 of the terminal device 20a. It is the schematic showing the extraction process of the user audio | voice information performed by the control part. It is a flowchart showing the process of the control part 100 in the 2nd Embodiment of this invention. It is the schematic showing the extraction process of the user audio | voice information performed by the control part 100 in the modification of this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[First Embodiment]
FIG. 1 is a block diagram of a music playback device 10 and a remote control terminal 20a of the karaoke device 1 according to the first embodiment. The karaoke apparatus 1 includes a music playback device 10, a remote control device 20a, and a terminal device 20b.

[Configuration of Music Reproducing Device 10]
The music reproducing device 10 is provided so as to be able to communicate with the remote control device 20a and the terminal device 20b. The music playback device 10 includes a control unit 100, a memory 101, a storage unit 110, an operation processing unit 120, an operation unit 121, a video playback unit 130, a video control unit 131, an acoustic control unit 140, and a communication unit 150.

  The control unit 100 controls processing of the music playback device 10. The memory 101 includes a ROM and a RAM. The ROM stores a program executed by the control unit 100. The RAM is a temporary storage area, and temporarily stores information related to the control of the control unit 100.

  The storage unit 110 includes a storage area and stores various types of information. The storage unit 110 stores music information representing the sound of music played by the music playback device 10, image information to be displayed, video information to be played back, and the like.

  The operation processing unit 120 receives operation information representing the operation of the operation unit 121 by the user, converts the operation information into a control request for switching the operation of the control unit 100, and sends the operation information to the control unit 100. The operation unit 121 includes a switch or a touch panel, and the switch or touch panel is pressed by the user. The operation unit 121 sends operation information indicating the position and frequency of the switch pressed by the user or operation information indicating the position and frequency of the touch panel to the operation processing unit 120. The operation information sent from the operation unit 121 is converted into a control request by the operation processing unit 120 and sent to the control unit 100.

  The video playback unit 130 plays back video information in accordance with a playback instruction sent from the control unit 100. The video information is included in the reproduction instruction together with the display start time information. The video information is reproduced by the video reproduction unit 130 in accordance with the display start time information. The reproduced video information is sent to the video control unit 131. The video control unit 131 receives the tablature and lyrics telop sent from the control unit 100 and the video information sent from the video playback unit 130. The video reproduction unit 130 combines these information and converts the information into a format that can be displayed on the monitor 132, and displays the converted information on the screen of the monitor 132.

  The sound control unit 140 reproduces the music information according to the reproduction instruction sent from the control unit 100. The acoustic control unit 140 synthesizes the singing sound information sent from the singing microphone 141 and the music information, and generates pronunciation information that causes the speaker 142 to generate a sound. The acoustic control unit 140 generates synchronized sound information representing a sound having a predetermined frequency in accordance with the synchronized sound information generation instruction from the control unit 100. The acoustic control unit 140 synthesizes the generated synchronized sound information with the pronunciation information. The sound control unit 140 causes the speaker 142 to sound according to the synthesized sound information. The synthesized pronunciation information is sent to the control unit 100. The sound of a predetermined frequency represented by the synchronization sound information is a sound of a frequency other than the range of 20 to 20000 Hz that can be generally heard by humans, can be produced by the speaker 142, and is used for an operation described later. The sound has a frequency that can be collected by the microphone 241.

  The communication unit 150 includes a wireless communication function that enables communication with a remote control device 20a and a terminal device 20b described later. The communication unit 150 receives a control request for the control unit 100 from the remote control device 20a and the terminal device 20b, and sends the control request to the control unit 100. The communication unit 150 receives a control request for the remote control device 20a and the terminal device 20b from the control unit 100, and sends the control request to the remote control device 20a and the terminal device 20b. Furthermore, the communication unit 150 has a function of transmitting and receiving various types of information such as image information and pronunciation information stored in the storage unit 110.

[Configuration of Remote Control Device 20a]
Next, the configuration of the remote control device 20a will be described with reference to FIG.

  The remote control device 20a is provided so as to be able to communicate with the music reproducing device 10. The remote control device 20a includes a control unit 200, a memory 201, a storage unit 210, an operation processing unit 220, an operation unit 221, a video reproduction unit 230, a video control unit 231, a display unit 232, an acoustic control unit 240, an operation microphone 241, and A communication unit 250 is provided.

  The control unit 200 controls processing of the remote control device 20a. The memory 201 includes a ROM and a RAM. The ROM stores a program executed by the control unit 200. The RAM is a temporary storage area, and temporarily stores information related to control by the control unit 200.

  The storage unit 210 includes a storage area and stores various types of information. The storage unit 210 stores a music list, image information displayed by the remote control device 20a, reproduced video information, and the like.

  The operation processing unit 220 receives operation information indicating the operation of the operation unit 221 by the user, converts the operation information into a control request for switching the operation of the control unit 200, and sends the operation information to the control unit 200. The operation unit 221 includes a switch or a touch panel, and the switch or touch panel is pressed by the user. The operation unit 221 sends operation information indicating the position and number of times of the switch pressed by the user or operation information indicating the position and number of times of the touch panel to the operation processing unit 220. The operation information sent from the operation unit 121 is converted into a control request by the operation processing unit 220 and sent to the control unit 200.

  The video playback unit 230 plays back video information in accordance with a playback instruction sent from the control unit 200. The video information is included in the reproduction instruction together with information indicating the display start time. The video information is reproduced by the video reproduction unit 230 in accordance with information indicating the display start time. The reproduced video information is sent to the video control unit 231. The video control unit 231 receives image information sent from the control unit 200 and video information sent from the video playback unit 230. The video reproduction unit 230 combines these pieces of information and converts them into a format that can be displayed on the display unit 232, and causes the display unit 232 to display the converted information.

  The acoustic control unit 240 sends voice operation information sent from the operation microphone 241 to the control unit 200. The operation microphone 241 includes an A / D converter for input sound, converts the input sound into sound operation information, and sends the sound operation information to the sound control unit 240. In addition, the sound control unit 240 determines whether or not specific information representing a sound having a frequency matching the synchronization sound information is included in the voice operation information with a strength higher than a predetermined strength. When the information is included in the voice operation information with a strength higher than a predetermined strength, a detection signal is sent to the control unit 200.

  The communication unit 250 includes a wireless communication function that enables communication with the music playback device 10. The communication unit 250 receives a control request for the control unit 200 from the music playback device 10 and sends the control request to the control unit 100. The communication unit 250 receives a control request for the music playback device 10 from the control unit 200 and sends the control request to the music playback device 10. Furthermore, the communication unit 250 has a function of receiving various types of information such as image information and pronunciation information stored in the storage unit 110 of the music playback device 10.

  Next, processing of the music playback device 10 and the remote control device 20a will be described. FIG. 2 is a flowchart of voice search processing by the music playback device 10 and the remote control device 2. The process of the music reproducing device 10 is a process performed by the control unit 100, and the process of the remote control terminal 20a is a process performed by the control unit 200. The voice search process is started when a control request indicating that voice search is started is sent from the operation processing unit 220 or the communication unit 250 to the control unit 200. In addition, even during music reproduction or BGM reproduction between songs, a control request indicating that voice search is started is sent to the control unit 200, whereby voice search processing is executed.

[Processing of Music Playback Device 10]
The process which the control part 100 of the music reproduction apparatus 10 performs is demonstrated. The processing of the music playback device 10 is started when a control request is sent from the communication unit 150 to the control unit 100. The control request is a control request that is sent from the remote control device 20a in step S202, which will be described later, and represents the start of storing pronunciation information. In accordance with the control request sent from the communication unit 150, the sound control unit 140 is instructed to send the pronunciation information to the control unit 100. When instructed to send pronunciation information, the process of step S102 is started.

  In step S102, storage of pronunciation information is started. Specifically, the pronunciation information sent from the acoustic control unit 140 is stored in the storage unit 110. When storage of pronunciation information is started, the process proceeds to step S103. The process of storing the pronunciation information in the storage unit 110 is continued until the process of step S106 described later is executed.

  In step S103, generation of synchronization sound information is instructed. A synchronous sound information generation instruction for generating synchronous sound information is sent to the acoustic control unit 140. The acoustic control unit 140 generates synchronized sound information representing a sound having a predetermined frequency in accordance with the synchronized sound information generation instruction. The generated synchronized sound information is combined with the pronunciation information by the acoustic control unit 140. In accordance with the synthesized pronunciation information, the speaker 142 generates a sound represented by the pronunciation information. The synthesized pronunciation information is stored in the storage unit 110 by the process of storing the pronunciation information started in step S102 in the storage unit 110. When the synchronization sound information generation instruction is sent to the acoustic control unit 140, the process proceeds to step S104.

  In step S104, it is determined whether or not a control request for terminating the storage of the pronunciation information is sent from the remote control device 20a. In step S206, which will be described later, a control request indicating the end of the storage of the pronunciation information is sent from the communication unit 250 of the remote control device 20a to the communication unit 150. The communication unit 150 sends the sent control request to the control unit 100. When a control request is sent, the process of step S104 becomes YES, and the process proceeds to step S105. If the control request is not sent, the process of step S104 is NO, and the process of step S104 is continued.

  In step S105, the end of generation of the synchronization sound information is instructed. In accordance with the control request sent from the communication unit 150 in step S104, a synchronization sound information generation end instruction for terminating the generation of synchronization sound information is sent to the acoustic control unit 140. The acoustic control unit 140 ends the generation of the synchronization sound information in accordance with the transmitted synchronization sound information generation end instruction. When the synchronization sound information generation end instruction is sent to the acoustic control unit 140, the process proceeds to step S106.

  In step S106, the storage of the pronunciation information is terminated. In accordance with the control request sent from the communication unit 150 in step S104, the acoustic control unit 140 is instructed to stop sending the pronunciation information to the control unit 100. Further, the process of storing the pronunciation information started in step S102 in the storage unit 110 is stopped. When the pronunciation information is stored, the process proceeds to step S107.

  In step S107, the pronunciation information stored in the storage unit 110 is sent to the remote control device 20a. Specifically, the pronunciation information stored in the storage unit 110 is read and sent to the communication unit 150. When all the pronunciation information is sent to the communication unit 150, completion information indicating that the transmission of the pronunciation information has been completed is sent to the communication unit 150. The communication unit 150 sends the pronunciation information to the communication unit 250, and sends the completion information to the communication unit 250 after completing the transmission of the pronunciation information. When the completion information is sent to the communication unit 150, the process of the music reproducing device 10 in the flowchart of FIG.

[Processing of remote control terminal 20a]
Processing performed by the control unit 200 of the remote control terminal 20a will be described. The processing of the remote control device 20a is started when a control request indicating the start of voice search is sent from the operation processing unit 220 to the control unit 200.

  In step S201, storage of voice operation information is started. Specifically, the acoustic control unit 240 is instructed by the control unit 200 to send voice operation information to the control unit 200. Voice operation information sent from the acoustic control unit 240 is stored in the storage unit 210. When storage of the voice operation information is started, the process proceeds to step S202. The process of storing the voice operation information in the storage unit 210 is continued until the process of step S208 described later is executed.

  In step S <b> 202, a control request indicating the start of storing pronunciation information is sent to the communication unit 250. The communication unit 250 sends the control request sent from the control unit 200 to the communication unit 150. If a control request is sent, the process proceeds to step S203.

  In step S203, it is determined whether synchronous sound information has been received. Specifically, a detection signal indicating that specific information representing a sound having a frequency matching the synchronization sound information is included in the voice operation information with a strength higher than a predetermined strength is received from the acoustic control unit 240. It is determined whether or not it has been sent to the control unit 200. In the process of step S103, the sound represented by the sound generation information obtained by synthesizing the synchronization sound information is generated by the speaker 142. The voice operation information is sound information including the sound represented by the pronunciation information generated from the speaker 142. The acoustic control unit 240 performs frequency analysis such as Fourier transform on the voice operation information, and performs voice operation with specific information representing a sound having a frequency matching the frequency of the synchronization sound information with a strength higher than a predetermined strength. Determine whether it is included in the information. When the specific information is included in the voice operation information with a strength greater than or equal to a predetermined strength, the acoustic control unit 240 generates a detection signal indicating that specific information related to the synchronization sound information has been detected. Send to. If the detection signal is sent, the process of step S203 is YES, and the process proceeds to step S204. If the detection signal is not sent, the process of step S203 is NO, and the process of step S203 is continued.

  In step S204, it is instructed to display an image representing permission of voice input by the user. Specifically, a display instruction for displaying an image representing permission to input a user's voice instruction to the operation microphone 241 is sent to the video control unit 231. An image representing permission of voice input is read from the storage unit 210. The read image indicating permission is sent to the video control unit 231. The video control unit 231 sends an image indicating permission to the display unit 232. When the image indicating permission is sent to the video control unit 231, the process proceeds to step S205.

  In step S205, it is determined whether or not the user's voice input has been completed. Specifically, it is determined whether or not a control request indicating that the user's voice input has been completed is sent from the operation processing unit 220. When the user finishes inputting voice, the user operates the operation unit 221. In accordance with the operation of the operation unit 221 by the user, operation information indicating that the voice input has been completed is sent from the operation unit 221 to the operation processing unit 220. The operation processing unit 220 converts operation information indicating that voice input has been completed into a control request and sends the control request to the control unit 200. If a control request indicating that the voice input has been completed is sent, the process of step S205 is YES, and the process proceeds to step S206. When the control request indicating that the voice input is finished is not sent, the process of step S205 is NO and the process of step S205 is continued.

  In step S <b> 206, a control request for ending the storage of pronunciation information is sent to the music reproducing device 10. A control request indicating termination of storage of pronunciation information is sent to the communication unit 250. The communication unit 250 sends the control request sent from the control unit 200 to the communication unit 150. When a control request indicating termination of storage of pronunciation information is sent from the control unit 200 to the communication unit 250, the process proceeds to step S207.

  In step S207, it is determined whether or not the pronunciation information sent from the music reproducing device 10 has been received. Specifically, in step S107, sound generation information and completion information are sent from the communication unit 150 to the communication unit 250. The pronunciation information received by the communication unit 250 is sent to the control unit 200 and stored in the storage unit 210. Further, when the transmission of the pronunciation information is completed, completion information indicating that the transmission of the pronunciation information is completed is sent from the communication unit 150 to the communication unit 250. The completion information is sent from the communication unit 250 to the control unit 200. When the completion information is sent from the communication unit 250 to the control unit 200, the process of step S207 is YES, and the process proceeds to step S208. When the completion information is not sent from the communication unit 250 to the control unit 200, the process of step S207 is NO and the process of step S207 is continued.

  In step S208, the storage of the voice operation information is terminated. Specifically, the process of storing the voice operation information started in step S201 in the storage unit 210 is stopped. In addition, a storage end instruction for terminating the sending of the voice operation information to the control unit 200 is sent to the acoustic control unit 240. The acoustic control unit 240 stops sending voice operation information to the control unit 200 in accordance with the storage end instruction. When the storage of the voice operation information is ended and a storage end instruction is sent to the acoustic control unit 140, the process proceeds to step S209.

  In step S209, the voice operation information and the pronunciation information are compared, and user voice information that is the user's voice is extracted. FIG. 3 is a schematic diagram illustrating user voice information extraction processing executed by the control unit 200. The voice operation information represents a sound having a frequency corresponding to the synchronization sound information and includes a sound having a strength higher than a predetermined strength. The pronunciation information includes a sound corresponding to the synchronized sound information. In the section including the sound corresponding to the synchronized sound information, the sound corresponding to the music information included in the voice operation information and the pronunciation information, and the sound corresponding to the singing information are the voice operation information and the pronunciation. Included in common information. Therefore, the voice operation information and the pronunciation information are synchronized by matching the start and end of the two sections including the sounds corresponding to the two synchronized sound information respectively included in the voice operation information and the pronunciation information. Can do.

  The strength of the sound of the frequency corresponding to the synchronized sound information respectively included in the synchronized voice operation information and the pronunciation information is compared for each synchronized time. As a result of the comparison, the ratio of the sound intensity at the frequency for each time corresponding to the two synchronized sound information respectively included in the voice operation information and the pronunciation information is calculated. The sound intensity of each frequency included in the pronunciation information is amplified according to the calculated ratio. Thereby, the sound of the frequency corresponding to the synchronous sound information included in the voice operation information is set to the same intensity as the sound of the frequency corresponding to the synchronous sound information included in the pronunciation information. By subtracting the frequency corresponding to the pronunciation information from the voice operation information, the sound having the frequency corresponding to the synchronized sound information is removed. In addition, music information and singing information included in the pronunciation information are also amplified according to the calculated ratio. It is removed by subtracting the frequency corresponding to the pronunciation information from the voice operation information. Thereby, as shown in FIG. 3, the frequency corresponding to the pronunciation information is removed from the voice operation information, and the user voice information is extracted. When user voice information is extracted, the process proceeds to step S210.

  In step S210, user voice information is converted into characters, and a control request is generated according to the characters. The music title is extracted according to the control request. Consonants and vowels included in the user voice information are specified according to a spectrum in which the sound corresponding to the user voice information extracted in step S209 changes with time. When the consonant and the vowel are specified, the sound corresponding to the user voice information is replaced with the corresponding character. When a character string included in the user voice information is specified, a control request for searching for a song with the specified character string is generated. In accordance with the control request, a song name that matches the character string specified from the song list stored in the storage unit 210 is extracted and read. If there is no song name that matches the character string in the song list, information indicating that there is no matching song is read from the storage unit 210.

  In step S211, the result retrieved in step S210 is displayed. In the process of extracting a song name that matches the character string in step S211, if a song name that matches the character string is extracted from the song list, the song name is associated with a song name such as a singer name and a genre. And image information corresponding to the information is read from the storage unit 210. Each piece of image information read from the storage unit 210 is sent to the video control unit 231. The image information sent to the video control unit 231 is converted into a displayable format and sent to the display unit 232, and each image such as a music title is displayed on the display unit 232. If there is no song name that matches the character string in the song list, image information indicating that there is no matching song is read from the storage unit 210. The read image information is sent to the video control unit 231. The image information sent to the video control unit 231 is converted into a displayable format and sent to the display unit 232, and an image indicating that there is no matching music is displayed on the display unit 232. When the search result is displayed, the voice search process is terminated.

[Second Embodiment]
Next, a second embodiment of the present invention will be described. In the first embodiment, the music reproducing device 10 and the remote control device 20a are provided, and the operation microphone 241 is provided in the remote control device 20a. Further, when performing the voice search process, the process is executed by the music reproducing device 10 and the remote control device 20a. However, in the second embodiment, the music reproducing apparatus 10 includes the operation microphone 241, and the operation microphone 241 is connected to the acoustic control unit 140. The sound control unit 140 sends voice operation information sent from the operation microphone 241 to the control unit 100. Furthermore, the voice search process is executed in the control unit 100 of the music playback device 10. Therefore, the process performed by the control unit 200 of the remote control device 20a is performed by the control unit 100. In the second embodiment, the storage unit 210 is the storage unit 110, the operation processing unit 220 is the operation processing unit 120, the operation unit 221 is the operation unit 121, the video playback unit 230 is the video playback unit 130, and the video control unit 231 is The video control unit 131, the display unit 232 are included in the monitor 132, and the acoustic control unit 240 is included in the acoustic control unit 140. For this reason, the music playback device 10 in the second embodiment performs the operations of the music playback device 10 and the remote control device 20a in the first embodiment. The processing of the control unit 100 will be described later with reference to FIG. Unless otherwise specified, the configuration of the apparatus and the meaning of information are the same as those in the first embodiment, and thus description thereof is omitted.

[Processing of Music Playback Device 10]
FIG. 4 is a flowchart showing the voice search processing of the music playback device 10 according to the second embodiment. Processing of the control unit 100 of the music playback device 10 will be described. The processing of the music playback device 10 is started when a control request is sent from the communication unit 150 or the operation processing unit 120 to the control unit 100. The control request is a control request indicating the start of storing pronunciation information. In accordance with the control request, the acoustic control unit 140 is instructed to send the pronunciation information and the voice operation information to the control unit 100. When it is instructed to send pronunciation information and voice operation information, the process of step S301 is started.

  In step S301, storage of voice operation information and pronunciation information is started. Specifically, the pronunciation information and voice operation information sent from the acoustic control unit 140 are stored in the storage unit 110. When storage of pronunciation information is started, the process proceeds to step S302. The process of storing the pronunciation information and the voice operation information in the storage unit 110 is continued until the process of step S306 described later is executed.

  In step S302, generation of synchronization sound information is instructed. Specifically, a synchronization sound information generation instruction for generating synchronization sound information is sent to the acoustic control unit 140. The acoustic control unit 140 generates synchronized sound information representing a sound having a predetermined frequency in accordance with the synchronized sound information generation instruction. The generated synchronized sound information is combined with the pronunciation information by the acoustic control unit 140. In accordance with the synthesized pronunciation information, the speaker 142 generates a sound represented by the pronunciation information. The synthesized pronunciation information is stored in the storage unit 110 by the process of storing the pronunciation information started in step S301 in the storage unit 110. When the synchronization sound information generation instruction is sent to the acoustic control unit 140, the process proceeds to step S303.

  In step S303, it is instructed to display an image representing permission of voice input by the user. Specifically, a display instruction for displaying an image representing permission to input an instruction by the user's voice to the operation microphone 241 is sent to the video control unit 131. Image information indicating permission of voice input is read from the storage unit 110. Image information indicating the read permission is sent to the video control unit 131. The video control unit 131 converts the image information indicating permission into a displayable format and sends it to the monitor 132. When the display image information indicating permission is sent to the video control unit 131, the process proceeds to step S304.

  In step S304, it is determined whether or not the user's voice input has been completed. Specifically, it is determined whether or not a control request indicating that the user's voice input has been completed is sent from the operation processing unit 120. When the voice input is finished and the user operates the operation unit 121, when the voice input is finished, operation information indicating that the voice input is finished is operated from the operation unit 121 according to the operation of the operation unit 121 by the user. It is sent to the processing unit 120. The operation processing unit 120 converts operation information indicating that voice input has been completed into a control request and sends the control request to the control unit 100. If a control request indicating that the voice input has been completed is sent, the process of step S304 is YES, and the process proceeds to step S305. When the control request indicating that the input of the voice is finished is not sent, the process of step S304 is NO and the process of step S304 is continued.

  In step S305, the generation of synchronization sound information is instructed to end. Specifically, a synchronization sound information generation end instruction for ending generation of synchronization sound information is sent to the acoustic control unit 140. The acoustic control unit 140 ends the generation of the synchronization sound information in accordance with the transmitted synchronization sound information generation end instruction. When the synchronization sound information generation end instruction is sent to the acoustic control unit 140, the process proceeds to step S306.

  In step S306, the generation of the voice operation information is terminated. Specifically, the process of storing the voice operation information started in step S301 in the storage unit 110 is stopped. In addition, a storage end instruction for ending sending the voice operation information to the control unit 100 is sent to the acoustic control unit 140. The acoustic control unit 140 stops sending voice operation information to the control unit 100 in accordance with the storage end instruction. When the storage of the voice operation information is ended and a storage end instruction is sent to the acoustic control unit 140, the process proceeds to step S307.

  In step S307, the voice operation information and the pronunciation information are compared, and user voice information that is the user's voice is extracted. FIG. 3 is a schematic diagram illustrating user voice information extraction processing executed by the control unit 100. The voice operation information represents a sound having a frequency corresponding to the synchronization sound information and includes a sound having a strength higher than a predetermined strength. The pronunciation information includes a sound corresponding to the synchronized sound information. In the section including the sound corresponding to the synchronized sound information, the sound corresponding to the music information included in the voice operation information and the pronunciation information, and the sound corresponding to the singing information are the voice operation information and the pronunciation. Included in common information. Therefore, the voice operation information and the pronunciation information are synchronized by matching the start and end of the two sections including the sounds corresponding to the two synchronized sound information respectively included in the voice operation information and the pronunciation information. Can do.

  The strength of the sound of the frequency corresponding to the synchronized sound information respectively included in the synchronized voice operation information and the pronunciation information is compared for each synchronized time. As a result of the comparison, the ratio of the sound intensity at the frequency for each time corresponding to the two synchronized sound information respectively included in the voice operation information and the pronunciation information is calculated. The sound intensity of each frequency included in the pronunciation information is amplified according to the calculated ratio. Thereby, the sound of the frequency corresponding to the synchronous sound information included in the voice operation information is set to the same intensity as the sound of the frequency corresponding to the synchronous sound information included in the pronunciation information. By subtracting the frequency corresponding to the pronunciation information from the voice operation information, the sound having the frequency corresponding to the synchronized sound information is removed. In addition, music information and singing information included in the pronunciation information are also amplified according to the calculated ratio. It is removed by subtracting the frequency corresponding to the pronunciation information from the voice operation information. Thereby, as shown in FIG. 3, the frequency corresponding to the pronunciation information is removed from the voice operation information, and the user voice information is extracted. When user voice information is extracted, the process proceeds to step S308.

  In step S308, the user voice information is converted into characters, and a control request is generated according to the characters. The music title is extracted according to the control request. Consonants and vowels included in the user voice information are specified according to a spectrum in which the sound corresponding to the user voice information extracted in step S308 changes with time. When the consonant and the vowel are specified, the sound corresponding to the user voice information is replaced with the corresponding character. When a character string included in the user voice information is specified, a control request for searching for a song with the specified character string is generated. In accordance with the control request, the music name that matches the character string specified from the music list stored in the storage unit 110 is extracted and read. If there is no song name that matches the character string in the song list, information indicating that there is no matching song is read from the storage unit 110.

  In step S309, the result retrieved in step S308 is displayed. In the process of extracting a song name that matches the character string in step S308, if a song name that matches the character string is extracted from the song list, the song name is associated with a song name such as a singer name and a genre. And the image corresponding to the information are read from the storage unit 110. Each image read from the storage unit 110 is sent to the video control unit 131. The image sent to the video control unit 131 is sent to the monitor 132 and displayed on the monitor 132. If there is no song name that matches the character string in the song list, an image indicating that there is no matching song is read from the storage unit 110. The read image is sent to the video control unit 131. The image sent to the video control unit 131 is sent to the monitor 132 and displayed on the monitor 132. When the search result is displayed, the voice search process is terminated.

[Modification]
[Modification 1]
In both embodiments, generation of a control request for searching for a song by voice has been described. However, a control request that represents key control for changing the key of the song and a control request that represents tempo control for changing the playback tempo of the song are voiced. You may perform the process produced | generated by. Thereby, not only the music can be searched by voice, but various processes performed by the music playback device 10 can be switched by a control request generated by the voice.

[Modification 2]
The remote control device 20a of the first embodiment may be configured by a terminal device 20b including a terminal device such as a user's mobile phone in which a remote control application is executed. The terminal device 20b is associated with the music playback device 10 by the remote control application, and performs the same operation as the remote control device 20a. In this case, a call microphone generally provided in a terminal device such as a mobile phone corresponds to the operation microphone 241, and a configuration capable of communicating via infrared or an Internet line corresponds to the communication unit 250. What is necessary is just to communicate with the music reproduction apparatus 10.

[Modification 3]
In the first embodiment, in step S209, the start and end of two sections including sounds corresponding to two pieces of synchronized sound information included in the sound operation information and the pronunciation information are combined, respectively. Operation information and pronunciation information were synchronized. However, in Modification 3, the process of step S209 may be synchronized by matching only the start positions of the two sections included in the voice operation information and the pronunciation information. For this reason, the process of generating the synchronization sound information in step S103 executed in the third modification may be terminated after a predetermined time. The certain period is a period during which the synchronization sound information can be detected in step S209. Further, since the process of generating the synchronization sound information in step S103 is terminated after a certain time, the process of step S105 is not executed. As an example, FIG. 5 shows an overview of the process of step S209 when the process of generating the synchronization sound information of step S103 is terminated after a predetermined time in the first embodiment. The voice operation information and the pronunciation information can be synchronized by matching the beginnings of the two sections in which the sounds corresponding to the two synchronized sound information included in the voice operation information and the pronunciation information are included. The process after the synchronization is the same as that in step S209. The process of extracting user voice information according to the third modification is performed up to the end of the stored voice operation information or the information stored for a short period of time in the pronunciation information. Thereby, user voice information is extracted. Similarly, in the second embodiment, in the process of step S307, only the start positions of the two sections included in the voice operation information and the pronunciation information may be synchronized. Alternatively, the process of generating the synchronization sound information in step S303 may be terminated after a certain time. Then, the process of step S305 is not executed.

[Modification 4]
In both embodiments, the music is searched from the music list stored in the storage unit, but may be searched from the music list stored in a server device (not shown). In this modification, the music reproducing device 10, the remote control device 20a, or the terminal device 20b is connected to a server device (not shown in FIG. 1). The storage unit of the server device stores a music list in the storage area. The control request generated in step S210 or step S306 is sent to the server device, and the server device extracts the song name from the song list according to the control request. The server device sends the extracted music name to the music playback device 10, the remote control device 20a, or the terminal device 20b, and the sent device displays the searched music name.

[Effect of this embodiment]
According to the music reproducing device 10 described in the present embodiment, the sound produced by the music reproducing device 10 becomes noise when performing a voice search. Therefore, the music reproducing device 10 stores pronunciation information representing the sound to be generated, and the remote control terminal 20a uses the voice operation information including the user voice information representing the user's voice based on the stored pronunciation information as the user voice information. Can be extracted. Thereby, the pronunciation information is deleted from the voice operation information, and the user's voice information can be recognized more correctly. Moreover, according to this embodiment, it is not necessary to provide the microphone for detecting noise.

[Correspondence Relationship between Configuration described in Claims and This Embodiment]
The correspondence between the configuration described in the present embodiment and the configuration described in the claims is as follows. The music playback device 10 is an example of a music playback device. The acoustic control unit 140 is an example of an acoustic control unit, an acquisition unit, and a synchronization sound information addition unit. The control unit 100 is an example of an extraction unit, a first control unit, and a second control unit. The control unit 200 is an example of an extraction unit and a first control unit. The acoustic control unit 240 is an example of an acquisition unit. The remote control device 20a and the terminal device 20b are examples of terminal devices. The music playback device 10 is an example of a music playback device. The process of step S209 or step S307 is an example of the operation of the extraction means and the extraction step. The process from step S102 to step S106 and the process from step S301 to step S306 are an example of an acoustic control step. The process of step S210 or step S308 is an example of a generation step.

  DESCRIPTION OF SYMBOLS 1 ... Karaoke apparatus, 10 ... Music reproduction | regeneration apparatus, 20a ... Remote control apparatus, 20b ... Terminal device, 100 ... Control part, 110 ... Memory | storage part, 120 ... Operation control part, 131 ... Image | video control part, 140 ... Sound control part, 150 ... Communication unit, 200 ... Control unit, 210 ... Storage unit, 220 ... Operation control unit, 231 ... Video control unit, 240 ... Sound control unit, 250 ... Communication unit.

Claims (6)

Sound control means for generating the pronunciation information representing the sound to be generated by a speaker, which is pronunciation information including music information representing the reproduced sound of the music and singing information representing the singing sound of the singer,
Acquisition means for acquiring voice operation information including user voice information representing a user's voice and information representing a sound generated from a speaker according to the pronunciation information;
Extracting means for comparing the voice operation information with the pronunciation information and extracting the user voice information included in the voice operation information;
First control means for generating instruction information representing various instructions according to the user voice information extracted by the extraction means;
A karaoke apparatus comprising: Synchronous sound information adding means for adding synchronous sound information representing a sound of a predetermined frequency to the sounding information in order to synchronize the voice operation information and the sounding information,
2. The karaoke apparatus according to claim 1, wherein the extraction unit synchronizes the voice operation information and the pronunciation information according to a predetermined frequency represented by the synchronization sound information, and extracts the user voice information. The acquisition means acquires a sound having a predetermined frequency represented by the synchronous sound information generated from a speaker according to the pronunciation information,
The synchronization sound information adding means ends the addition of the synchronization sound information when the acquisition means finishes acquiring the user voice information,
The extraction means includes a start position and an end position of specific information representing a sound having a frequency matching the synchronization sound information included in the voice operation information, an addition start position of the synchronization sound information included in the pronunciation information, and The karaoke apparatus according to claim 2, wherein the user voice information is extracted by synchronizing with an addition end position. A karaoke device comprising a music playback device for playing back music and a movable terminal device,
The terminal device
The acquisition means, the extraction means, the first control means for executing various processes, and the first communication means for communicating with the music reproducing device;
With
The music player is
A second control means for executing the acoustic control means, the synchronization sound information adding means, various processes, and a second communication means for communicating with the terminal device;
With
4. The karaoke apparatus according to claim 2, wherein the first control unit generates instruction information representing various instructions according to the user voice information extracted by the extracting unit. 5. The first control means causes the obtaining means to start obtaining the voice operation information;
A process of sending a generation instruction representing the generation of the pronunciation information to the second control means;
When the voice operation information acquired by the acquisition unit includes the synchronous sound information, a process of displaying a notification indicating permission to include the user voice information in the voice operation information on a display unit;
A process of sending a generation end instruction to end the generation of the pronunciation information to the second control means when ending the inclusion of the user voice information in the voice operation information;
Processing that causes the extraction means to compare the voice operation information and the pronunciation information to cause the extraction means to extract the user voice information included in the voice operation information;
In accordance with the extracted user voice information, processing to generate instruction information representing various instructions,
The second control means includes
In accordance with the generation instruction from the first control unit, a process for causing the acoustic control unit to start generating the pronunciation information;
A process of adding the synchronization sound information to the sound generation information by the synchronization sound information adding means and causing a speaker to sound;
In accordance with the generation end instruction from the first control unit, the sound control unit is caused to end the generation of the pronunciation information and the sounding information is sent to the first control unit.
The karaoke apparatus according to claim 4. A sound control step for generating the pronunciation information representing the sound to be generated by a speaker, which is pronunciation information including music information representing the reproduced sound of the music and singing information representing the singing sound of the singer,
An acquisition step of acquiring voice operation information including user voice information representing a user's voice and information representing a sound generated from a speaker;
An extraction step for comparing the voice operation information with the pronunciation information and extracting the user voice information included in the voice operation information;
A generation step for generating instruction information representing various instructions according to the user voice information extracted in the extraction step;
A method for controlling a karaoke apparatus, comprising: