JP6508567B2 - Karaoke apparatus, program for karaoke apparatus, and karaoke system - Google Patents

Description

  The present invention relates to a karaoke apparatus capable of searching for music by voice.

  In a conventional karaoke apparatus, a singer can search for a song that he / she wants to sing based on a song name, a singer name, etc., and can select and sing a song that he / she wants to sing from the list of search results. Further, among the conventional karaoke apparatuses, there is a karaoke apparatus capable of notifying a singer of recommended songs according to information extracted from the singing data of the singer. As an example, Patent Document 1 discloses a karaoke apparatus capable of presenting karaoke candidates that match the voice quality and the degree of skill and skill when singing based on singing data of a singer.

JP 2008-003483 A

  However, in general, voice quality, habit, and the like are determined depending on the user's singing condition and the way of singing that changes according to the music selection. Since the physical condition of the user changes from moment to moment, the physical condition of the user in creating the song data may differ from the current condition of the user at the time of actually selecting the music after creating the song data. Therefore, the voice quality extracted from the singing data may be different from the voice quality of the current user.

  Furthermore, the genre of the song sung at the time of song data creation may be different from the genre of the song selected for singing after the song data creation. When the genre of the music is different, there is a possibility that the manner of the user singing at the time of creating the singing data may be different from the manner of the user singing the selected music. If you sing differently, the voice quality and the way you sing may be different. Therefore, the user who sings may feel that it is difficult to sing the selected music, and other users who listen to the song may feel uncomfortable with the selected music and the voice of the user who sings.

  Therefore, the present invention has been made in view of the above-described circumstances, and an object of the present invention is to provide a karaoke apparatus capable of presenting to a user a piece of music matching the current situation of the user at the time of music selection.

  In order to achieve this object, the karaoke apparatus according to claim 1 comprises: storage means for storing instruction information representing a specific instruction including an instruction for causing the user to pronounce music-related information; An instruction presenting means for presenting the specific instruction to the user according to the instruction information, an acquiring means for acquiring voice information representing a voice uttered by the user in response to the specific instruction presented by the instruction presenting means; Extraction means for extracting, from the voice information acquired by the acquisition means, response content including the music related information in response to the specific instruction by the user, and information indicating characteristics of the current user's voice, and the extraction means Search means for searching a plurality of pieces of music information according to the music related information in the contents of the response extracted by the means, and previous contents of the contents of the response extracted by the extraction means The priority order of the music information to be presented to the user among the plurality of music information searched by the search means is determined based on the response contents other than the music related information and the information indicating the feature of the voice of the current user. And determining means.

  The instruction information of the karaoke apparatus according to claim 2 includes at least one of music sound generation instruction information, thought sound generation instruction information, and usage form sound generation instruction information, and the music sound generation instruction information includes the music related information. The instruction for causing the user to pronounce is indicated, and the thought pronunciation instruction information is an instruction for causing the user to pronounce thinking information representing the user's thoughts and emotions of the music associated with the music related information, and the usage form pronunciation instruction information Represents an instruction to cause the user to pronounce usage mode information representing a mode of use of the karaoke apparatus by the user, and the acquisition means represents first voice information, second voice information, and third voice representing a voice uttered by the user Acquiring at least one of the information, the first voice information is information representing a voice including the music related information, and the second voice information is the thought Information representing voice including information, the third voice information is information representing voice including the usage mode information, and the extraction means includes the first voice information, the second voice information, and the second voice information From the at least one of the three voice information, the music related information, the at least one of the thinking information and the usage form information, and the information indicating the feature of the voice are extracted, and the determination means is characterized by the voice The priority order of the music information to be presented to the user among the plurality of pieces of music information searched by the search means is determined according to at least one of the information indicating the information, the thought information, and the usage form information. I assume.

  The thought sounding instruction information of the karaoke apparatus according to claim 3 includes information representing a plurality of first response examples to which the user responds, and the usage mode sound generation instruction information representing information representing a plurality of second response examples to which the user responds The acquisition unit acquires the second voice information and the third voice information representing the user's voice when the user pronounces the first response example and the second response example, respectively; Means for performing a first comparison process of comparing the second voice information with a first reference determined in advance in relation to voice characteristics for the first response example; and for the second response example Performing at least one comparison process of the second comparison process of comparing the second voice information with the second standard predetermined in relation to the feature of Includes size, speed, and voice At least one voice element of a plurality of frequencies is extracted as the feature of the voice, and the determination means combines the voice element extracted by the extraction means with the voice element associated with music information. It is characterized in that priorities of the plurality of pieces of music information to be presented to the user are determined according to the degree of coincidence.

  5. The acquisition means according to claim 4, until the extraction means of the karaoke apparatus according to claim 4 extracts at least one of the music related information and information indicating a feature of at least one voice of the user from the voice information. And voice information representing a voice uttered by the user is obtained in response to an instruction from the user.

  When there is no music information associated with a voice element corresponding to the voice element extracted by the extraction means of the karaoke apparatus according to claim 5, use mode information representing the usage mode of the karaoke apparatus by the user and the music information The priority order of presenting the plurality of pieces of music information to the user is determined according to the matching degree with the usage mode information associated with the

  The music information of the karaoke apparatus according to claim 6, wherein the music information is stored in association with use mode information representing a use mode of the karaoke apparatus by a user, and the acquisition means responds to the specific instruction. Other than the user's voice, the sound in the karaoke box is acquired, the extraction means extracts the sound in the karaoke box, and the determination means is the sound in the karaoke box extracted by the extraction means As various sounds are included, it is characterized in that the priority of the music information associated with the usage mode information representing the mode in which the plurality of users use the karaoke apparatus is determined as the higher rank and presented to the user.

The karaoke apparatus program according to claim 7 is stored in the storage unit in a computer of the karaoke apparatus including storage means for storing instruction information representing a specific instruction including an instruction for causing the user to pronounce music-related information. An instruction presenting step of causing the user to present the specific instruction to the user according to the instruction information; an acquiring step of acquiring voice information representing a voice uttered by the user in response to the specific instruction presented by the instruction presenting step; An extraction step of extracting response content including the music related information in response to the specific instruction from the voice information acquired in the acquisition step, and information indicating a feature of the current user's voice; the extraction step Searching for a plurality of pieces of music information according to the music related information in the response contents extracted by , Response content other than the music-related information of said response content extracted by the extraction step, and on the basis of information indicating characteristics of the voice of the current user, the plurality of musical piece information retrieved by the retrieving step And determining a priority of music information to be presented to the user.

The karaoke system according to claim 8 is a karaoke system in which a karaoke apparatus, a server apparatus, and a portable terminal are provided so as to be mutually communicable via a network, and an instruction for causing a user to pronounce music related information Storage means for storing instruction information representing a specific instruction to be included, instruction presentation means for presenting the specific instruction to the user according to the instruction information stored in the storage means, and the specific device presented by the instruction presentation means Response means including the music related information in which the user responds to the specific instruction from the acquisition means for acquiring voice information representing the voice uttered by the user in response to the instruction, and the voice information acquired by the acquisition means And extraction means for extracting information indicating the characteristics of the current user's voice, and the music related information in the response contents extracted by the extraction means Based search means for searching a plurality of musical piece information, the response content other than the music-related information of said response content extracted by the extraction means, and the information indicating the characteristics of the voice of the current user in accordance with the And a determination unit configured to determine a priority of music information to be presented to the user among a plurality of pieces of music information searched by the search unit.

  According to the invention described in claim 1, claim 7, and claim 8, a plurality of pieces of music information are searched according to the music related information in the extracted response contents, and the extracted response contents and voice characteristics are obtained. The priority of the music information to be presented to the user among the plurality of pieces of searched music information is determined based on the indicated information. Thus, it is possible to present the user with music that matches the user's current situation at the time of music selection.

  The karaoke apparatus according to claim 2 is the music information to be presented to the user among the plurality of pieces of music information searched by the search means according to the information indicating the feature of the voice, and at least one of the thought information and the usage form information. Determine the priority. As a result, it is possible to present the user with music that more closely matches the user's current situation at the time of music selection.

  The karaoke apparatus according to claim 3 determines the priority of the plurality of pieces of music information to be presented to the user according to the degree of coincidence between the elements of the voice extracted by the extraction means and the elements of the voice associated with the music information. Do. As a result, it is possible to accurately present the user with music that matches the user's current situation at the time of music selection.

  The karaoke apparatus according to claim 4, wherein the acquisition means responds to the specific instruction until the extraction means respectively extracts at least one music related information and information indicating the feature of at least one voice of the user from the voice information. Then, voice information representing a voice uttered by the user is acquired. In this way, it is possible to present to the user at least one song that matches the user's current situation at the time of music selection.

  According to the fifth aspect of the present invention, when there is no music information associated with a voice element corresponding to an extracted voice element, the karaoke apparatus according to the fifth aspect is associated with usage mode information representing the usage mode of the karaoke apparatus by the user and the music information. Determine the priority of presenting multiple pieces of music information to the user according to at least one of the degree of coincidence with usage information or the degree of coincidence between thought information representing the user's emotions and thought information associated with the music information Do. Thereby, even if there is no music that matches the element of the user's current voice at the time of music selection, it is possible to present the user with a music that matches at least one of the usage form or the thought.

  The karaoke apparatus according to claim 6 extracts sounds in the karaoke box, and as the sounds in the extracted karaoke box include various sounds, utilization form information representing a form in which a plurality of users utilize the karaoke apparatus is supported The priority of the attached music information is determined to be a higher rank and presented to the user. As a result, when there are a plurality of people in the karaoke box at the time of music selection, it is possible to present to the user a song often sung in the karaoke box in which the plurality of people are present.

It is a block diagram of the karaoke system 1 which concerns on 1st Embodiment of this invention. It is a flow chart showing search processing which control part 100 of karaoke device 10 with which karaoke system 1 concerning a 1st embodiment is provided performs. It is a figure showing an example of a screen display when the karaoke apparatus 10 displays instruction information. It is a flow chart showing search processing which control part 100 of karaoke device 10 with which karaoke system 1 concerning a 2nd embodiment concerning the present invention is provided performs. It is a figure showing the modification of the screen display when the karaoke apparatus 10 displays instruction information.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
First Embodiment
[Configuration of karaoke system 1]
FIG. 1 is a block diagram of a karaoke system 1 according to a first embodiment of the present invention. The karaoke system 1 includes a karaoke device 10, a terminal device 20, and a server device 30.

  The karaoke apparatus 10 includes a control unit 100, a storage unit 110, an operation processing unit 120, an operation unit 121, a video reproduction unit 130, a video control unit 131, an acoustic control unit 140, and a communication unit 150.

  The control unit 100 includes a ROM and a RAM, and controls various processes of the karaoke apparatus 10. The ROM stores a program that the control unit 100 executes. The RAM is a temporary storage area, and temporarily stores information related to control of the control unit 100.

  The storage unit 110 includes a storage area and stores various types of information. The storage unit 110 stores music information indicating the accompaniment sound of music played by the karaoke apparatus 10, image information indicating an image to be displayed, video information indicating a moving image to be played back, instruction information, and the like. The music information is stored in association with music identification information including an identification number for identifying a music and a music name. The music identification information is stored in association with music related information related to music, such as music keyword, genre, user's impression of music, characteristics of music, and information indicating characteristics of singer's voice. The instruction information will be described later.

  The operation processing unit 120 receives operation information indicating an operation of the operation unit 121 by the user, converts the operation of the control unit 100 into a control request to switch, and sends the control request to the control unit 100. The operation unit 121 includes a switch or a touch panel, and the switch or the touch panel is pressed by the user. The operation unit 121 transmits, to the operation processing unit 120, operation information indicating the position and the number of times of the switch pressed by the user, or operation information indicating the position and the number of times of the touch panel touched by the user. The operation information sent from the operation unit 121 is converted into a control request by the operation processing unit 120, and sent to the control unit 100.

  The video reproduction unit 130 decodes the video information in accordance with the reproduction instruction sent from the control unit 100. The decoded video information is sent to the video control unit 131 or the memory 101 as information of reproducible moving pictures. Specifically, the reproduction instruction includes the video information, the information of the display start time, and the destination of the information of the decoded moving image. The video information is decoded by the video reproduction unit 130 in synchronization with the information of the display start time. The moving image represented by the decoded video information is sent to the video control unit 131 or the memory 101. The video control unit 131 receives an image represented by image information such as tablature and lyric telop sent by the control unit 100 and information of a decoded moving image sent from the video reproduction unit 130 and the memory 101. The image control unit 131 combines the tablature, the lyrics telop, and the like with the moving image, and converts it into a moving image in a format that can be displayed on the monitor 132. The video control unit 131 causes the converted moving image to be displayed on the screen of the monitor 132.

  The sound control unit 140 reproduces the accompaniment sound of the music in accordance with the reproduction instruction sent from the control unit 100. The sound control unit 140 combines the singing sound information and the music information sent from the singing microphone 141 to generate sounding information for causing the speaker 143 to sound. The sound control unit 140 sends sound generation information to the speaker 143 for sound generation. Further, the sound control unit 140 performs frequency analysis of voice information included in the answer information sent from the answer microphone 142, and sends the analysis result to the control unit 100. The frequency analysis will be described later.

  The communication unit 150 has a wireless communication function that enables communication with the terminal device 20 and the server device 30. The communication unit 150 receives a control request for the control unit 100 from the terminal device 20, and sends the control request to the control unit 100. The communication unit 150 receives a control request for the terminal device 20 from the control unit 100 and sends the control request to the terminal device 20. The communication unit 150 has a function of transmitting and receiving various information such as image information and music information. In addition, the communication unit 150 can receive various information such as music information, image information, and video information from the storage unit included in the server device 30.

  The terminal device 20 is provided to be communicable with the karaoke apparatus 10 and the server device 30. As an example, the terminal device 20 is a terminal such as a remote control device dedicated to karaoke, or a mobile phone of a user in which an application for controlling the karaoke device 10 is installed. The terminal device 20 transmits a control request corresponding to the operation information received from the user to the communication unit 150.

  The server device 30 is provided to be communicable with the karaoke device 10 and the terminal device 20. The server device 30 includes a storage unit, and the storage unit stores music information, image information, video information, and instruction information. The server device 30 extracts and sends various information or information included in the various information in accordance with a request sent from the karaoke device 10 or the terminal device 20. Extracting the information contained in the various information means, as an example, extracting only the music identification information from the music identification information contained in the music information and the information representing the accompaniment sound.

  The instruction information includes a plurality of music sounding instruction information, thinking sounding instruction information, and usage mode sounding instruction information. The song pronunciation instruction information is instruction information representing an instruction for causing a user to input a title, a keyword, and the like of a song by voice in order to specify a song that the user desires to sing. The thought-pronunciation instruction information is instruction information representing an instruction for causing the user to input the user's impression of the music that the user wants to sing, the user's current physical condition and the like by voice. The usage mode sound generation instruction information is instruction information representing an instruction for a voice input of the relationship between the users present in the karaoke box, the number of persons, the time of using the karaoke box, and the like. In the present embodiment, the instruction information is associated with the image information in which the instruction displayed on the monitor 132 is described. The instruction information includes at least one of thinking sounding instruction information and usage form sounding instruction information, and search processing described later is executed even if either one is not provided.

[Search process of karaoke system 1]
The search process of the karaoke system 1 will be described with reference to FIG. FIG. 2 is a flowchart showing a search process in the first embodiment of the present invention, and each process of the flowchart is a process performed by the control unit 100 of the karaoke apparatus 10. The search process described in the flowchart is started by sending a control request from the operation processing unit 120 or the communication unit 150 to the control unit 100 to cause the control unit 100 to execute an operation of searching for music information.

  In step S100, a voice recording process is started. Specifically, the voice input to the response microphone 142 is acquired, and the response information representing the acquired voice is generated and stored in the storage unit 110. Further, the output of the voice input from the answer microphone 142 is muted so that the sound input to the answer microphone 142 is not pronounced from the speaker 143. When the voice recording process is started, the process proceeds to step S101.

  In step S101, an image represented by the instruction information is displayed on the monitor 132. The music sounding instruction information, the thought sounding instruction information, and the usage sounding instruction information included in the instruction information are randomly extracted. The image information associated with the extracted instruction information is read from the storage unit 110 and sent to the video control unit 131. An image represented by the image information sent to the video control unit 131 is displayed on the monitor 132. Specifically, in the case where one of the extracted instruction information is thinking sounding instruction information and the user is to input what mood it is, an example of an image displayed on the monitor 132 is shown in FIG. Indicated. In addition, when one of the extracted instruction information is usage mode sound generation instruction information and the user is to input who is coming to the karaoke box, an example of the image displayed on the monitor 132 is shown in FIG. Shown in). The user utters the answer contents toward the answer microphone 142 in accordance with the answer example described below the question sentence. When the image associated with each piece of instruction information is displayed on the monitor 132, the process of step S101 is moved to step S102.

  In step S102, a search word is generated from the answer information. Specifically, generation is started in step S100, and the voice represented by the answer information stored in the storage unit 110 is frequency analyzed. The waveform derived from the analysis result by the frequency analysis is replaced with characters. The relationship between the waveform and the character is specified from the information representing the correspondence between the character and the waveform stored in the storage unit 110. The waveform is replaced with characters, and the generated search word is stored in the memory 101. When the search word is generated, the process proceeds to step S103. Alternatively, when the search word is not generated in step S102 and a predetermined time elapses, the process proceeds to step S103.

  In step S103, it is determined whether or not a search word is generated in step S102. Specifically, when the search word is stored in the memory 101 and it is determined that the search word has been generated, the process of step S103 is determined as YES, and the process is transferred to step S104. If it is determined that the memory is not stored in the memory 101 and the search word can not be generated, the process of step S103 is determined as NO, and the process is moved to step S111.

  In step S104, a music is searched by the search word produced | generated from the answer information produced | generated according to music sounding instruction | indication information among the search words produced | generated by step S102. Specifically, the search word stored in the memory 101 is read. The music related information is read out from the storage unit 110 according to the read search word. The music identification information associated with the read music related information is stored in the memory 101, and the process proceeds to step S105.

  In step S105, the voice recording process started in step S100 is ended. Further, in step S105, the mute of the response microphone 142 is released. When the voice recording process is completed, the process proceeds to step S106.

  In step S106, information indicating the feature of the user's voice is extracted from the recorded voice. Specifically, components of the voice size, speed, and multiple frequencies included in the voice are extracted. As an example, in order to extract information indicating the characteristics of these voices, the instruction information is associated with the information of the answer example shown in FIG. The information of each answer example is stored in association with the reference voice size and speed. Information representing a specific sound volume level is associated as the basis of the loudness of the voice, and information representing an utterance period according to the number of characters is associated as the basis of the speed. That is, a specific volume level that serves as a reference for determining the loudness of the voice is stored, and it is determined whether the loudness of the voice is larger or smaller than the specific loudness level. As for the speed, it is determined whether the pronunciation time is longer or shorter than the criterion of the length of the pronunciation time according to the number of characters of the search word and the contents of the answer example. If the pronunciation time is short, it is judged to be fast, and if the pronunciation time is long, it is judged to be slow. The process of extracting the component of the frequency divides the frequency of the sound included in the recorded voice into each sound by the conventionally known frequency analysis. The size and speed of the voice extracted by the determination result and the analysis result, and the components of the plurality of frequencies included in the voice are stored in the memory as information indicating the feature of the user's voice. When the process of analyzing the series of voice features is completed, the process proceeds to step S107 regardless of whether information indicating the voice features of the user has been extracted.

  In step S107, of the search words generated in step S102, a search word is further searched from the music searched in step S104 by the search word generated from the answer information generated according to the instruction information other than the music sounding instruction information. Be done. Specifically, a search word generated from the answer information generated in accordance with the thinking sound production instruction information and the usage form sound production instruction information is read from the memory 101. Also, the music related information associated with the music identification information retrieved in step S104 and stored in the memory 101 is read out from the storage unit 110. The read search word and the read music related information are compared to determine their respective matching degrees. As one example, the matching degree is a ratio calculated based on how many items of the search related information included in the plurality of search words are included. In step S 107, the music information associated with the music related information whose calculated ratio exceeds 90% is searched and stored in the memory 101. In this process, the match may be determined not only when the search word and the music related information completely match but also when it is determined to be a partial match and a related phrase. When the process of step S107 is finished, the process proceeds to step S108.

  In step S108, it is determined whether one or more pieces of music have been acquired by the processing of steps S104 and S107. Specifically, it is determined whether one or more pieces of music identification information of the music searched in step S107 are stored in the memory 101. If the music identification information is stored in the memory 101, the process of step S108 is determined as YES, and the process proceeds to step S109. If the music identification information is not stored in the memory 101, the process proceeds to step S113, since step S108 is NO.

  In step S109, the matching degree of the information indicating the feature of the singer's voice in the music related information and the information indicating the feature of the user's voice is calculated. Similar to step S107, in the calculation of the degree of coincidence, the information indicating the feature of the user's voice extracted in step S106 is compared with the information indicating the feature of the singer's voice included in the music related information. Specifically, information indicating the feature of the user's voice extracted in step S106 is read from the memory 101. Also, the music related information associated with the music identification information retrieved in step S 107 and stored in the memory 101 is read out from the storage unit 110. The information indicating the feature of the singer's voice included in the read music related information and the information indicating the feature of the read user's voice are compared, and the degree of coincidence is determined. As an example, the matching degree is a ratio calculated by how many items corresponding to the information indicating the feature of the singer's voice included in the music related information are included in the information indicating the features of the voices of a plurality of users is there. In step S109, this ratio is calculated for each music, and the ratio and the music identification information are associated with each other and stored in the memory 101. In this process, the match is determined not only when the information indicating the voice feature of the user and the information indicating the voice feature of the singer completely match, but also when it is determined that they are similar. May be When the process of step S109 is finished, the process proceeds to step S110.

  In step S110, the music pieces are arranged and displayed in the order of the degree of coincidence calculated in step S109. Specifically, the ratio representing the degree of coincidence calculated in step S109 and the music identification information are read out. The music identification information is sorted in descending order of the associated ratio. Image information for displaying the contents of the rearranged music identification information is sent to the video control unit 131. The music identification information sent from the video control unit 131 to the monitor 132 and displayed is selected by the user, and performance reservation of the music is performed. When the music identification information is sent to the video control unit 131, the search process is ended.

  Next, the process when it is determined NO in step S103 will be described. If NO in step S103, the process proceeds to step S111. In step S111, it is determined whether an end command has been issued. Specifically, it is determined whether a process termination instruction has been generated by a cancel operation by the user, or whether a process termination instruction has been generated by a timeout. If it is determined that the end command has been issued, the process of step S111 is determined as YES, and the process proceeds to step S112. If it is determined that the end instruction has not been generated, the process of step S111 is determined as NO, and the process is transferred to step S101.

  In step S112, the voice recording process started in step S100 is ended. The process of step S112 is the same as the process of step S105, and thus the description thereof is omitted. When the process of step S112 is finished, the search process is ended.

  A process when it is determined NO in step S108 will be described. If it is determined that step S108 is NO, the process proceeds to step S113. In step S113, it is displayed on the monitor 132 that no music is acquired by the process of step S107. Specifically, an image representing that the search could not be stored, which is stored in the storage unit 110, is extracted and sent to the image control unit 131. The video sent to the video control unit 131 is converted into a format that can be displayed on the monitor 132 and sent to the monitor 132. The video sent to the monitor 132 is displayed on the monitor 132. When the process of step S113 is finished, the search process is ended.

Second Embodiment
A second embodiment in which a search process different from the search process of the first embodiment is executed will be described with reference to FIG. FIG. 4 is a flowchart showing a search process in the second embodiment, which is a process performed by the control unit 100 of the karaoke apparatus 10. In FIG. 4, common steps are assigned to steps performing the same process as the process in the search process of the first embodiment shown in FIG. 2. The description of the process is omitted for the steps given the common numbers.

  Each process of the flowchart illustrated in FIG. 4 is started by sending a control request from the operation processing unit 120 or the communication unit 150 to the control unit 100 to cause the control unit 100 to execute an operation of searching for music information.

  When the processing from step S100 to step S102 is finished, the processing is moved to step S106. That is, information indicating the feature of the voice is extracted from the answer information in which the search word is generated and stored. The process of step S106 is the same as that of the first embodiment, and thus the description thereof is omitted. When the process of extracting the information indicating the feature of the voice is finished, the process proceeds to step S203.

  In step S203, it is determined whether a search word has been generated and information indicating voice characteristics has been extracted. When the search word is generated in step S102 and the information indicating the feature of the voice is extracted in step S106, YES is determined in step S203, and the process is moved to step S104. If the search word is not generated in step S102 or if the information indicating the feature of the voice is not extracted in step S106, NO is determined in step S203, and the process is moved to step S111. The subsequent processing is the same as the processing of the first embodiment, so the description will be omitted.

  In the second embodiment, steps S102 and S106 are repeatedly performed until a search word is generated and information indicating voice characteristics is extracted. This makes it possible to reliably extract information indicating voice characteristics and reflect it in the search. Furthermore, in addition to extracting information indicative of voice characteristics, multiple search words can also be generated. Since a plurality of pieces of answer information respectively corresponding to the music sounding instruction information, the thinking sounding instruction information, and the usage mode sounding instruction information can be acquired, a large number of information indicating the characteristics of the user's voice and the search word are generated. It is possible to present songs that match the situation.

Third Embodiment
The first embodiment and the second embodiment will be described about the third embodiment in which the method of processing for acquiring information indicating the feature of the voice is different. Specifically, in the third embodiment, the case where the information of the response example is not associated with the instruction information will be described. FIG. 5 is an image displayed on the monitor 132 in the third embodiment.

  In step S101 in the third embodiment, an image representing the content of the instruction information is displayed on the monitor 132. The music sounding instruction information, the thought sounding instruction information, and the usage sounding instruction information included in the instruction information are randomly extracted. The image information associated with the extracted instruction information is read from the storage unit 110 and sent to the video control unit 131. An image represented by the image information sent to the video control unit 131 is displayed on the monitor 132. Specifically, in the case where one of the extracted instruction information is thinking sounding instruction information and the user is to input what mood it is, an example of an image displayed on the monitor 132 is shown in FIG. Indicated. In addition, when one of the extracted instruction information is usage mode sound generation instruction information and the user is to input who is coming to the karaoke box, an example of an image displayed on the monitor 132 is shown in FIG. Shown in). The user pronounces the answer contents toward the answering microphone 142 in accordance with the question text.

  In step S106, the characteristics of the user's voice are analyzed from the recorded voice. Specifically, components of the voice size, speed, and multiple frequencies included in the voice are extracted. First, with regard to the loudness of the voice, the loudness of the voice is analyzed from the power spectrum of the waveform separated into frequency components by frequency analysis. As an example, if the voice pressure exceeds 80 dB, which is the sound pressure level in general human conversation, it is determined that the voice is large, and if less than 80 dB, the voice is determined to be small. The speed is analyzed by the number of characters of the search word generated in step S102 and the length of the pronunciation time corresponding to the number of characters. As an example, it is defined as a standard that the length of one character's pronunciation time is 0.1 second. If the search word is 5 characters of "Jo-ntsu", it is judged to be fast if the length of pronunciation time is within 0.5 seconds, and it is judged to be slow if it is longer than 0.5 seconds .

[Effect of the embodiment]
In the conventional karaoke apparatus, there is a method of acquiring voice quality based on song data sung in the past, call data on a call, and the like, and using this voice quality at the time of music search. However, in this method, information indicating characteristics of voices acquired in the past and a correspondence relationship with the user are essential. That is, the identification information of the user and the song data or the call data must be stored in association with each other. However, according to the present embodiment, it is not necessary to associate and store the user and the information indicating the feature of the voice. Furthermore, since the information indicating the feature of the voice is extracted based on the information indicating the current situation of the user, the information indicating the current situation of the user rather than the information indicating the feature of the voice extracted from the information acquired in the past Reliable information can be extracted. As a result, the singer can sing a piece of music that matches the information indicating the feature of the current voice, and the listener can listen to the singing of a piece of music that is less uncomfortable with the voice of the singer.

[Modification 1]
In step S101 in each embodiment, an image represented by image information associated with the instruction information is displayed on the monitor 132. However, the content of the instruction information may be presented to the user by the speaker 143 pronouncing the audio represented by the audio information associated with the instruction information. Specifically, the instruction information is stored in the storage unit 110 in association with the voice information. The audio information associated with the instruction information is read from the storage unit 110 and sent to the sound control unit 140. The sound control unit 140 generates an audio signal according to the audio information and sends the audio signal to the speaker 143. The speaker 143 produces an audio according to the audio signal. The user utters the answer contents toward the answer microphone 142 in accordance with the uttered question.

[Modification 2]
In each embodiment, the search process of the flowchart shown in FIG. 2 is performed by the control unit 100 of the karaoke apparatus 10, but may be performed by the control unit of the terminal device 20. Alternatively, although the response microphone 142 is connected to the karaoke apparatus 10, it may be connected to the terminal device 20 or may be equipped in the terminal device 20. Furthermore, the feature information representing the feature of the voice extracted from the answer information in the karaoke apparatus 10 or the terminal device 20 may be sent to the server device 30, and the music information stored in the server device 30 may be searched according to the feature information. That is, the search process of the flowchart may be performed by a combination of the karaoke apparatus 10, the terminal device 20, and the server device 30.

[Modification 3]
In each embodiment, in the search processing procedure, the music is selected by the search word, the music is narrowed down by thinking and use form, and the display order of the music is determined by the feature of the voice. However, the order of the information to be referred to may be switched to determine the display order of the music. Moreover, as a result of performing a search in a specific order, when one music can not be acquired, the user may be presented with the result immediately before the process for the music search. That is, as one example, when it is determined that the music can not be acquired in step S108, the music searched in step S104 may be presented to the user. Further, the processing of step S109 and step S110 may be performed on the result of the search in step S104. Thus, the previous result may be presented, or the order of the search may be changed to search again. As a result, the possibility of being able to present a music piece having a high degree of matching between the information indicating the feature of the user's voice and the information indicating the feature of the singer's voice is increased.

[Modification 4]
In each embodiment, in step S110, the music pieces are arranged in the order of the degree of coincidence calculated in step S109 and displayed on the monitor 132. In step S110, the matching degree calculated in step S109 may be associated with the music identification information and displayed on the monitor 132. In this way, not only can it be possible to sequentially know the degree of coincidence between the information indicating the characteristics of the user's voice and the information indicating the characteristics of the singer's voice, but also quantitatively know how much they match. Can. The degree of coincidence which can not be understood only by the order can be known, and the user can know not only the order but also the reliability of the order.

[Modification 5]
In each embodiment, it is not necessary to specify the user by the conventional login process or the like because it is not necessary to associate the identification information of the user with the information indicating the feature of the voice. However, the login process may be executed to associate the identification information of the user with the information indicating the feature of the voice and store them. Thus, in the process of extracting information indicating the feature of the user's voice, the information indicating the feature of the voice stored in the past can be compared with the information indicating the feature of the current voice. Therefore, when the information indicating the feature of the voice that can be extracted this time completely matches the information indicating the feature of the voice extracted in the past, the voice of the voice for which the information indicating the feature of the past voice could not be extracted this time By using the information indicating the feature, it is possible to extract the music that matches the information indicating the feature of the voice.

[Modification 6]
In each embodiment, the instruction information includes the music sounding instruction information, the thought sounding instruction information, and the usage sounding instruction information, but may further include the login instruction information. The login instruction information is displayed or pronounced, and the user speaks his / her identification information and password to the answer microphone 142 by voice. The identification information and password accepted by voice may be replaced with characters in step S102, and a conventionally known login process may be executed.

[Modification 7]
In each embodiment, the response microphone is a response-dedicated microphone, but may be shared with a singing microphone. As an example, it may be determined that the microphone is a response microphone by switching on the microphone after the music retrieval process by voice is started.

  Each embodiment and each modification are not limited to an independent thing, respectively, and may be combined suitably and carried out.

[Correspondence between claim and embodiment]
The storage unit 110, the storage unit of the terminal device, and the storage unit of the server device are examples of storage means. The monitor 132 and the speaker 14 are an example of an instruction presentation unit. The response microphone 142 is an example of an acquisition unit. The voice processing unit 140 is an example of an extraction unit. The control unit 100 is an example of a search unit and a determination unit. The combination of the control unit 100 and the memory 101 is an example of a computer.

  The instruction information is an example of the instruction information, the music sound generation instruction information is an example of the music sound generation instruction information, the thought sound generation instruction information is an example of the thought sound generation instruction information, and the usage form sound generation instruction information is an example of the usage form sound generation instruction information. . The answer information is an example of voice information, first voice information, second voice information, and third voice information.

  The process of step S106 is an example of the first comparison process and the second comparison process. The process of step S101 is an example of the instruction presenting step. The voice recording process started in step S100 and ended in step S105 is an example of the acquisition step. The processes of step S102 and step S106 are an example of the extraction step. The process of step S104 is an example of a search step. Steps S107, S109 and S110 are an example of the determination step.

DESCRIPTION OF SYMBOLS 1 karaoke system 10 karaoke apparatus 20 terminal device 30 server apparatus 100 control part 101 memory 110 storage part 120 operation control part 130 video reproduction part 131 video processing part 140 acoustic control part 141 microphone 146 reply microphone

Claims (8)

Storage means for storing instruction information representing a specific instruction including an instruction for causing the user to pronounce music related information;
An instruction presenting unit that presents the specific instruction to the user according to the instruction information stored in the storage unit;
Acquisition means for acquiring voice information representing a voice uttered by the user in response to the specific instruction presented by the instruction presentation means;
Extraction means for extracting response content including the music related information in response to the specific instruction from the user and information indicating characteristics of the current user's voice from the voice information acquired by the acquisition means;
Search means for searching a plurality of pieces of music information according to the music related information in the response contents extracted by the extraction means;
Among the plurality of pieces of music information searched by the search means based on the response contents other than the music related information among the response contents extracted by the extraction means and the information indicating the feature of the voice of the current user. Means for determining the priority of music information to be presented to the user at
A karaoke apparatus comprising: The instruction information includes at least one of music sound generation instruction information, thought sound generation instruction information, and usage form sound generation instruction information.
The music sound generation instruction information represents an instruction to cause the user to sound the music related information.
The thought pronouncing instruction information represents an instruction to cause the user to pronounce thinking information representing the user's thoughts and emotions of the music associated with the music related information,
The use form sound generation instruction information represents an instruction to cause the user to pronounce the use form information representing the use form of the karaoke apparatus by the user,
The acquisition means acquires first voice information and at least one of second voice information and third voice information representing a voice uttered by a user.
The first voice information is information representing a voice including the music related information,
The second voice information is information representing a voice including the thought information,
The third voice information is information representing a voice including the usage mode information,
The extraction means is
The music related information, at least one of the thought information and the usage form information, and information indicating the feature of the voice from the first voice information and at least one of the second voice information and the third voice information And the
The determining means is
According to the information indicating the feature of the voice, and at least one of the thought information and the usage form information, the priority order of the music information to be presented to the user among the plurality of music information searched by the search means is determined The karaoke apparatus according to claim 1, characterized in that: The thought pronunciation instruction information includes information representing a plurality of first response examples to which the user responds, and the usage form pronunciation instruction information includes information representing a plurality of second response examples to which the user responds.
The acquisition means acquires the second voice information and the third voice information representing the user's voice when the user pronounces the first response example and the second response example, respectively.
The extraction means is
A first comparison process for comparing the second voice information with a first reference determined in advance in relation to voice characteristics in the first response example;
Performing at least one comparison process of a second comparison process of comparing the third voice information with a second reference determined in advance with respect to voice characteristics, for the second response example;
According to the executed comparison process, at least one voice element of voice size, speed, and a plurality of frequencies included in the voice is extracted as the information indicating the feature of the voice;
The determining means is
A priority order of the plurality of pieces of music information to be presented to the user is determined according to the degree of coincidence between the voice element extracted by the extraction means and the voice element associated with the music information. The karaoke apparatus according to claim 2. Until at least one of the music related information and information indicating the feature of at least one voice of the user are respectively extracted from the voice information by the extraction means,
The karaoke apparatus according to any one of claims 1 to 3, wherein the acquisition means acquires voice information representing a voice uttered by the user in response to the specific instruction.   When there is no music information associated with the voice element matched with the voice element extracted by the extraction means, usage mode information representing a usage mode of the karaoke apparatus by the user and usage mode information correlated with the music information The present invention is characterized in that the priority order of presenting the plurality of pieces of music information to the user is determined in accordance with at least one of the degree of coincidence between the thought information and the thought information associated with the music information. 3 or the karaoke apparatus of Claim 4. The music information is stored in association with use form information representing a use form of the karaoke apparatus by a user.
The acquisition means acquires the sound in the karaoke box in addition to the voice pronounced by the user in response to the specific instruction.
The extraction means extracts the sound in the karaoke box,
The determination unit is configured to prioritize music information associated with usage form information representing a form in which a plurality of users use the karaoke apparatus as the sounds in the karaoke box extracted by the extraction unit include various sounds. The karaoke apparatus according to any one of claims 1 to 5, wherein the karaoke apparatus is determined to be a higher rank order and presented to the user. A computer of a karaoke apparatus comprising storage means for storing instruction information representing a specific instruction including an instruction for causing the user to pronounce music related information;
An instruction presenting step of causing the user to present the specific instruction according to the instruction information stored in the storage means;
An acquiring step of acquiring voice information representing a voice uttered by the user in response to the specific instruction presented by the instruction presenting step;
An extraction step of extracting, from the voice information acquired in the acquisition step, response contents including the music related information in response to the specific instruction by the user, and information indicating characteristics of the current user's voice;
A search step of searching a plurality of pieces of music information according to the music related information in the response content extracted in the extraction step;
Among the response contents extracted in the extraction step , the response contents other than the music related information and the information indicating the feature of the voice of the current user among the plurality of music information searched out in the search step Determining the priority of the music information to be presented to the user at
A program for a karaoke apparatus characterized in that A karaoke system in which a karaoke apparatus, a server apparatus, and a portable terminal are provided so as to be able to communicate with each other via a network.
Storage means for storing instruction information representing a specific instruction including an instruction for causing the user to pronounce music related information;
An instruction presenting unit that presents the specific instruction to the user according to the instruction information stored in the storage unit;
Acquisition means for acquiring voice information representing a voice uttered by the user in response to the specific instruction presented by the instruction presentation means;
Extraction means for extracting response content including the music related information in response to the specific instruction from the user and information indicating characteristics of the current user's voice from the voice information acquired by the acquisition means;
Search means for searching a plurality of pieces of music information according to the music related information in the response contents extracted by the extraction means;
Among the plurality of pieces of music information searched by the search means based on the response contents other than the music related information among the response contents extracted by the extraction means and the information indicating the feature of the voice of the current user. Means for determining the priority of music information to be presented to the user at
Karaoke system characterized by having.