JP7355165B2 - Music playback system, control method and program for music playback system - Google Patents

Description

The present disclosure relates to technology for playing music.

2. Description of the Related Art Techniques for playing music according to input from users have been proposed in the past. For example, Patent Document 1 discloses a karaoke device that operates according to voice input by a user into a microphone. The user speaks into the microphone a voice representing the content of the action (for example, "enso wo on wo okikku" or "on kai wo ageru").

Japanese Patent Application Publication No. 11-296182

In the technique disclosed in Patent Document 1, the voice used by the user to instruct the karaoke apparatus to perform an operation is limited to the voice that directly represents the operation. In consideration of the above circumstances, the present disclosure aims to diversify voice input methods.

In order to solve the above problems, a music playback system according to a preferred aspect of the present disclosure includes a determination unit that determines whether input audio is singing audio or instruction audio other than singing audio; If it is determined that the input voice is a singing voice, instructs a playback control unit that controls playback of the song to perform a first operation regarding playback of a song corresponding to the input voice, and determines that the input voice is an instruction voice. and an operation control section that instructs the playback control section to perform a second operation represented by the input voice when the input voice is determined.

A method for controlling a music playback system according to a preferred aspect of the present disclosure determines whether input audio is singing audio or instruction audio other than singing audio, and when the input audio is determined to be singing audio. Instructs a playback control unit that controls playback of music to perform a first operation related to playing music corresponding to the input audio, and when the input audio is determined to be instruction audio, the input audio The second operation represented by is instructed to the reproduction control section.

A music playback control method according to another aspect of the present disclosure provides a playback control unit with an instruction to present a music name corresponding to a first input voice instructing playback of a music piece, and a music piece with the presented music name. When receiving a second input voice indicating that the music corresponding to the first input voice is a desired song, the playback controller is instructed to play back the song corresponding to the first input voice.

A music playback control method according to another aspect of the present disclosure is such that the input audio is a singing voice of a song being played by a playback control unit that controls playback of a song, or is other than the song being played by the playback control unit. If the input audio is determined to be the singing audio of the song being played by the playback control unit, the singing evaluation unit is instructed to perform an operation of evaluating the input audio. If the input audio is determined to be singing audio of a song other than the song being played by the playback control unit, the playback control unit causes the playback control unit to perform an operation to play a song corresponding to the input audio. give instructions to

FIG. 1 is a block diagram illustrating the configuration of a music playback system according to a first embodiment. It is a schematic diagram of an operation table. 3 is a flowchart illustrating a process executed by a terminal device. 12 is a flowchart illustrating a process for determining whether or not it is a singing voice. FIG. 2 is a block diagram illustrating the configuration of a music playback system according to a second embodiment. 3 is a flowchart illustrating a process executed by a terminal device. FIG. 3 is a block diagram illustrating the configuration of a music playback system according to a third embodiment. FIG. 2 is a block diagram illustrating the configuration of a terminal device. FIG. 2 is a block diagram illustrating the configuration of a terminal device. FIG. 2 is a block diagram illustrating the configuration of a processing device. It is a flow chart of processing of a control device concerning a modification.

<First embodiment>
FIG. 1 is a block diagram illustrating the configuration of a music playback system 10 according to the first embodiment. The music reproduction system 10 according to the first embodiment is a computer system that reproduces music according to user U's operations. A song including accompaniment sounds (ie, a karaoke song) is played by the music playback system 10, and the user U sings along with the song. For example, the music playback system 10 is installed inside a car driven by user U. Therefore, it is difficult for the user U to instruct the music reproduction system 10 to perform various operations through manual input using a plurality of operators. Therefore, the music playback system 10 receives operation instructions through voice input from the user U. That is, it becomes possible to operate the music reproduction system 10 without interfering with driving the car. For example, information terminals such as mobile phones and smartphones are used as the music playback system 10.

As illustrated in FIG. 1, the music playback system 10 includes a sound collection device 11, a control device 12, a storage device 13, and a playback device 14. The sound collection device 11 is an audio device (microphone) that collects surrounding sounds. The sound collection device 11 of the first embodiment receives the voice produced by the user U (that is, the input voice V). The music reproduction system 10 operates based on the input voice V received by the sound collection device 11. Specifically, a singing voice and an instruction voice other than the singing voice are exemplified as the input voice V. The singing voice is the voice of the user U singing an arbitrary song. Singing audio is audio accompanied by a melody made up of multiple notes. On the other hand, the instruction voice is a voice without a melody. Specifically, the instruction voice is a voice that instructs the music reproduction system 10 to perform various operations. For example, an instruction voice may be used to instruct operations such as playing or stopping a song, changing the key, or changing the volume. The sound collection device 11 receives an input voice V from a user U, and generates an acoustic signal X representing a waveform of the input voice V. That is, an acoustic signal X representing a singing voice or an instruction voice is generated. Note that, in reality, the sound collection device 11 also collects sounds different from the singing sounds and the instruction sounds (hereinafter referred to as "speech sounds"). The uttered sound is, for example, the sound of a conversation.

The control device 12 (an example of a computer) is configured with a processing circuit such as a CPU (Central Processing Unit), and controls each element of the music reproduction system 10 in an integrated manner. The control device 12 implements a plurality of functions (discrimination section 121, operation control section 123, and reproduction control section 125) by executing programs stored in the storage device 13. Note that some functions of the control device 12 may be realized by a dedicated electronic circuit. Further, the functions of the control device 12 may be installed in a plurality of devices.

The storage device 13 stores programs executed by the control device 12 and various data used by the control device 12. For example, a known recording medium such as a semiconductor recording medium and a magnetic recording medium, or a combination of multiple types of recording media may be arbitrarily employed as the storage device 13. As illustrated in FIG. 1, a plurality of pieces of music data M each representing a plurality of different pieces of music and an operation table are stored in the storage device 13. For example, a file in a format compliant with the MIDI (Musical Instrument Digital Interface) standard (SMF: Standard MIDI File) is suitable as the music data M. Note that an audio file representing the waveform of the performance sound of a song may be used as the song data M. The music data M of the first embodiment includes a music name, performance data, and reference data. The performance data is time-series data that specifies a note sequence (performance content) for each of a plurality of performance parts. The reference data is time-series data that specifies the note string (guide melody) of the singing part. The performance data and the reference data are data of different channels within the same music data M. Note that a plurality of pieces of music data M may be stored in a web server that can communicate with the music playback system 10.

The playback device 14 is a playback device that plays various songs under the control of the control device 12 (playback control section 125). Specifically, the reproduction device 14 includes a sound emitting device (speaker) that emits the music represented by the music data M stored in the storage device 13. Note that the playback device 14 may include a display device.

FIG. 2 is a schematic diagram of the operation table. The operation table is a data table in which a plurality of different operations of the music reproduction system 10 are registered. As illustrated in FIG. 2, each action is associated with a character string representing the action (hereinafter referred to as "registered character string"). Specifically, a registered character string that corresponds to (for example, is similar to or matches) a character string representing an instruction voice that is expected to be pronounced by user U is registered. For example, a registered character string "stop" that corresponds to an instruction voice that instructs to stop playing a song (for example, an instruction voice that pronounces the character string "stop") is exemplified.

The determining unit 121 in FIG. 1 determines from the acoustic signal X generated by the sound collection device 11 whether the input voice V by the user U is a singing voice or an instruction voice. The operation control unit 123 instructs the playback control unit 125 to perform various operations related to music playback (for example, playing, stopping, or changing keys). The operation control unit 123 of the first embodiment instructs the playback control unit 125 to perform an operation according to the determination result by the determination unit 121.

The playback control unit 125 controls playback of music. Specifically, the playback control unit 125 controls the playback device 14 that plays music by executing instructions from the operation control unit 123. The playback control section 125 of the first embodiment includes a data processing section and a sound source section. The data processing section instructs the sounding or muting of each note of the music based on the performance data included in the music data M. The sound source section generates an acoustic signal representing the performance sound of a music piece in response to an instruction from the data processing section and supplies it to the playback device 14 . The playback device 14 plays back the audio signal supplied from the playback control section 125.

FIG. 3 is a flowchart illustrating the processing executed by the control device 12. In the following description, it is assumed that the music reproduction system 10 is instructed to operate by voice input, assuming that no music is being played (hereinafter referred to as a "standby state"). In the first embodiment, the user U instructs the music playback system 10 to play a desired song. The user U can instruct playback of a song by producing a singing voice of the desired song or an instruction voice instructing playback of the song. A voice that utters a character string including a song name or identification information (for example, a number) for identifying a song is suitable as the instruction voice. For example, when instructing to play the song "ABC", the input voice V may be a singing voice singing the song "ABC" or an instruction voice pronouncing, for example, the character string "Play [ABC]". . That is, in the first embodiment, each of the singing voice and the instruction voice can be said to be a voice specifying the song "ABC" desired by the user U.

For example, when the sound collection device 11 receives the input voice V, the process shown in FIG. 3 is executed. When the process of FIG. 3 is started, the determining unit 121 determines whether the input voice V is a singing voice or a voice other than a singing voice (that is, an instruction voice or a spoken voice) (Sa1).

FIG. 4 is a flowchart illustrating the process of step Sa1. The determination unit 121 calculates, for each of the plurality of reference data stored in the storage device 13, an index (hereinafter referred to as "similarity index") representing the degree of similarity between the reference data and the acoustic signal X (Sa11). For example, an index representing the degree of similarity between the pitch specified by the reference data for each note and each pitch detected from the acoustic signal X is used as the similarity index. For example, a value obtained by summing the pitch differences for each note between the reference data and the acoustic signal X for a note string is used as the similarity index. A known pitch detection technique is employed to detect the pitch of the acoustic signal X. The determining unit 121 determines whether the maximum value of the plurality of similarity indices calculated for each of the plurality of reference data exceeds a predetermined threshold (Sa12). If the maximum value exceeds the predetermined threshold (Sa12: YES), the determining unit 121 determines that the input voice V is the singing voice of the song represented by the reference data corresponding to the maximum value (Sa13). That is, in step Sa13, the reference data of the song sung by the user U is specified. Known techniques such as dynamic time warping (DTW) and query by singing/humming are arbitrarily employed to calculate the similarity index. Note that according to the configuration in which the similarity index is calculated by the dynamic time warping method, it is also possible to estimate the difference in tempo and key between the acoustic signal X and the reference data.

On the other hand, when the maximum value is less than the predetermined threshold (Sa12: NO), the determining unit 121 determines that the input voice V is a voice other than singing voice (Sa14). As understood from the above explanation, in step Sa1, it is determined whether or not the input voice V is a singing voice, and if it is determined that the input voice V is a singing voice, the input voice V is The corresponding song (that is, the song that user U is singing) is specified.

When the input voice V is determined to be a singing voice (Sa1: YES), the operation control unit 123 instructs the reproduction control unit 125 to perform the first operation (Sa2). The first operation is an operation related to reproducing the music corresponding to the input voice V (singing voice). In the first embodiment, the reproduction control unit 125 is instructed to perform an operation of reproducing the music corresponding to the input audio V as the first operation. Specifically, the determination unit 121 instructs the reproduction control unit 125 to perform a first operation of reproducing the music represented by the reference data identified in step Sa13 (that is, the music represented by the input voice V). The first operation of the first embodiment is an operation of reproducing the music corresponding to the input voice V from the position corresponding to the input voice V. For example, the first operation of playing the song immediately after the part of the song sung by the user U is instructed. That is, the user U can sing the song in succession to the singing voice for instructing the playback of the song.

The playback control unit 125 executes the first operation (Sa3). Specifically, the playback control unit 125 causes the playback device 14 to play back the music corresponding to the input audio V. Specifically, the reproduction control unit 125 causes the reproduction device 14 to reproduce the music corresponding to the input voice V from the position corresponding to the input voice V. Specifically, the playback control unit 125 supplies the playback device 14 with audio signals corresponding to the performance data of the music piece corresponding to the input sound V in chronological order starting from the portion corresponding to the input sound V. As understood from the above description, when the user U pronounces a singing voice, the music corresponding to the input voice V is identified and the music is played. As mentioned above, according to the configuration in which the music corresponding to the input audio V is specified using the dynamic time warping method, it is possible to estimate the difference in tempo and key between the audio signal X and the reference data, so that the input audio It becomes possible to play music at a tempo and key according to V.

On the other hand, when the determination unit 121 determines that the input voice V is a voice other than a singing voice (Sa1: NO), the determination unit 121 determines whether the input voice V is an instruction voice or a voice other than an instruction voice (that is, a spoken voice). (Sa4). Specifically, if a registered character string similar to the character string representing the input voice V (hereinafter referred to as "input character string") is registered in the action table, the determination unit 121 determines that the input voice V is the instruction voice. If the character string similar to the input character string is not registered in the action table, it is determined that the input voice V is a voice other than the instruction voice. For comparing the input character string and the registered character string, a known technique such as editing distance, for example, is arbitrarily employed. The input character string is specified by voice recognition of the acoustic signal X, for example. For example, when the input character string "play [ABC]" is specified, the registered character string "play [song name]" in the operation table of FIG. 2 is specified. Further, reference data corresponding to [music name] of the input character string is specified. For example, by performing natural language processing such as morphological analysis on the input character string, a proper noun (e.g. [ABC]) is extracted, and by comparing the proper noun with the song name of the song data M, the song to be played is extracted. is specified. Specifically, if there is a song name similar to the proper noun extracted from the input character string among the song names of the plurality of song data M, the performance data corresponding to the song name is specified. Note that if there is no performance data corresponding to the input character string [song name], the user U may be informed, for example, that there is no performance data corresponding to [song name]. For example, a sound or image representing the character string "[song title] does not exist." is played. As understood from the above description, in step Sa4, if the input voice V is determined to be an instruction voice, the performance data of the music piece represented by the input voice V is also specified. Note that the operation table may be stored in a server device that can communicate with the music playback system 10. In the above configuration, the music reproduction system 10 transmits the input voice V or the input character string to the server device, and the server device determines whether the input voice V is an instruction voice.

When it is determined that the input voice V is an instruction voice (Sa4: YES), the operation control unit 123 instructs the reproduction control unit 125 to perform the second operation represented by the input voice V (Sa5). Among the plurality of actions in the action table, the action corresponding to the registered character string similar to the input character string is instructed as the second action. That is, the second operation of reproducing the music "ABC" specified by the input voice V (instruction voice) is instructed. The second operation of the first embodiment is an operation of reproducing the music specified by the instruction voice from the beginning. That is, the first action is an action based on an instruction by a singing voice, whereas the second action is an action based on an instruction voice. In the first embodiment, the first operation and the second operation are different operations. The playback control unit 125 executes the second operation (Sa6). The playback control unit 125 of the first embodiment causes the playback device 14 to play the music specified by the instruction voice. Specifically, the playback control unit 125 supplies the playback device 14 with an audio signal corresponding to the performance data corresponding to the music specified by the instruction voice from the beginning. Specifically, the music represented by the performance data specified in step Sa4 is played back. Note that the playback control unit 125 may supply the playback device 14 with an audio signal according to the performance data and reference data. As understood from the above explanation, when the user U pronounces the instruction voice, the music specified by the instruction voice is specified, and the music is played.

On the other hand, if it is determined that the input voice V is a voice other than the instruction voice (that is, a spoken voice such as a conversational sound) (Sa4: NO), the operation control unit 123 does not instruct the playback control unit 125 to do anything. (Sa7). As understood from the above explanation, it is determined in step Sa1 and step Sa4 whether the input voice V is a singing voice or an instruction voice. Furthermore, the order of the processing in steps Sa1-Sa3 and the processing in steps Sa4-Sa6 may be reversed, or both processing may be performed in parallel.

As can be understood from the above description, in the first embodiment, when it is determined that the input voice V is a singing voice, the reproduction control unit 125 performs the first operation regarding reproduction of the music corresponding to the input voice V. be instructed. On the other hand, when it is determined that the input voice V is an instruction voice, the reproduction control unit 125 is instructed to perform the second action represented by the input voice V. That is, a variety of voice inputs including singing voice and instruction voice are possible. In addition, in the first embodiment, since the first action and the second action are different actions, by appropriately changing the type of input voice V (singing voice/instruction voice), the desired operation can be controlled to play. 125. Specifically, when a singing voice is input, a first operation is instructed to play a song corresponding to the singing voice (input voice V) from a position corresponding to the singing voice, and the playback of the song is instructed. When an instruction voice is input, a second operation of reproducing the music corresponding to the instruction voice (input voice V) from the beginning is instructed.

<Second embodiment>
A second embodiment of the present disclosure will be described. In each of the following examples, for elements whose functions are similar to those in the first embodiment, the reference numerals used in the description of the first embodiment will be used, and detailed descriptions of each will be omitted as appropriate.

In the first embodiment, it is assumed that the song is in a standby state where no music is being played. However, in the second embodiment, it is assumed that the song is already being played (hereinafter referred to as the "playing state"). Let us assume a situation where an operation is instructed to the playback system 10.

FIG. 5 is a configuration diagram of a music playback system 10 according to the second embodiment. As illustrated in FIG. 5, the music reproduction system 10 of the second embodiment has a configuration in which a singing evaluation section 127 is added to the music reproduction system 10 of the first embodiment. The sound collection device 11 receives the input voice V from the user U, similarly to the first embodiment. Similar to the first embodiment, the determining unit 121 determines whether the input voice V by the user U is a singing voice or an instruction voice.

Further, the determining unit 121 of the second embodiment determines whether the input voice V is a singing voice of a song being played by the playback control unit 125 or a singing voice of a song other than the song being played by the playback control unit 125. Discern. The singing evaluation unit 127 evaluates user U's singing voice. Specifically, the singing evaluation unit 127 compares the singing voice of the user U with the reference data of the song corresponding to the singing voice (input voice V), thereby obtaining an evaluation value ( e.g. score). Any known technique may be used to generate the evaluation value. The evaluation value generated by the singing evaluation unit 127 is reproduced (sounded or displayed) by the reproduction device 14, for example.

FIG. 6 is a flowchart illustrating processing executed by the control device 12 according to the second embodiment. For example, when the sound collection device 11 receives the input voice V, the process shown in FIG. 6 is executed. The flowchart of FIG. 6 executes the processing of steps Sa8 to Sa10 in addition to the processing of steps Sa1 to Sa7 illustrated in FIG.

When the process of FIG. 6 is started, the determining unit 121 determines whether the input voice V is a singing voice or a voice other than a singing voice (Sa1). Similar to the first embodiment, it is determined whether the input voice V is a singing voice by comparing the maximum value of the similarity index calculated for the plurality of reference data and the threshold value.

When the determination unit 121 determines that the input voice V is a singing voice (Sa1: YES), the determination unit 121 determines whether the input voice V is a singing voice of a song being played by the playback control unit 125. (Sa8). Specifically, when the music of the reference data identified in step Sa13 of FIG. 4 (that is, the reference data whose similarity index is the maximum value and whose maximum value exceeds the threshold) is being played, It is determined that the input voice V is the singing voice of the song being played. On the other hand, if the song of the reference data specified in step Sa13 of FIG. 4 is not being played, it is determined that the input voice V is the singing voice of a song other than the song that is being played.

If the input voice V is determined to be the singing voice of the song being played (Sa8: YES), the operation control unit 123 instructs the singing evaluation unit 127 to perform a third operation of evaluating the input voice V. (Sa9). The singing evaluation unit 127 executes a third operation (Sa10). Specifically, an evaluation value of the singing voice is generated. On the other hand, when the operation control unit 123 determines that the input voice V is a singing voice other than the song being played back (Sa8: NO), the operation control unit 123 instructs the playback control unit 125 to perform the first operation (Sa2). The first operation is an operation of reproducing the music corresponding to the input audio V, as in the first embodiment. However, in the second embodiment, the first operation is an operation in which the music corresponding to the input audio V is played back after the music being played (ie, scheduled playback). Note that the first operation of stopping the music being played and playing the music corresponding to the input audio V (that is, instantaneous playback) may be instructed. The playback control unit 125 executes the first operation (Sa3). The playback control unit 125 of the second embodiment causes the playback device 14 to play the music corresponding to the input audio V after the music being played.

On the other hand, similarly to the first embodiment, when it is determined that the input voice V is a voice other than a singing voice (Sa1: NO), the determination unit 121 determines whether the input voice V is an instruction voice or a voice other than an instruction voice. Determine whether it is a voice (Sa4). Similarly to the first embodiment, when it is determined that the input voice V is an instruction voice (Sa4: YES), the operation control unit 123 transmits the second operation represented by the input voice V to the playback control unit 125. Give instructions (Sa5). As illustrated in FIG. 2, various operations such as stopping the music being played, changing the key, or increasing the volume are exemplified as the second operation. Note that when the user U pronounces an instruction voice instructing reproduction of a desired music piece, a second operation is instructed to reproduce (reserved playback or immediate playback) the music piece specified by the instruction voice.

The reproduction control unit 125 executes the second operation similarly to the first embodiment (Sa6). For example, when the second action of stopping the reproduction of the music is instructed, the reproduction of the music is stopped. On the other hand, if it is determined that the input voice V is a voice other than the instruction voice (Sa4: NO), the operation control unit 123 does not instruct the reproduction control unit 125 (Sa7).

The second embodiment also achieves the same effects as the first embodiment. In the second embodiment, when the input voice V is the singing voice of the song being played, the singing evaluation unit 127 is instructed to perform the third operation of evaluating the input voice, and the input voice V is the singing voice of the song being played. If the input voice V is a singing voice, the reproduction control unit 125 is instructed to perform a first operation of reproducing the music corresponding to the input voice V. Therefore, the instructions for the first action and the third action can be changed depending on whether the input sound V is the singing sound of the song being played. Note that in the second embodiment as well, the processing exemplified in the first embodiment is executed in the standby state.

As explained in the first embodiment and the second embodiment, the first operation related to reproducing the music corresponding to the input audio V (singing audio) is, for example, reproducing the music corresponding to the input audio V (immediate playback/scheduled playback) This is an action to do. In addition, the second action represented by the input voice V (instruction voice) is, for example, an operation to play the music specified by the input voice V (immediate playback/scheduled playback), or to control the music being played (for example, by pressing the key , change the volume or playback speed). However, the contents of the first operation and the second operation are not limited to the above examples. Moreover, when a singing voice singing a common song in the standby state and the playback state is received, a configuration is suitable that instructs different first actions in the standby state and the playback state. In the standby state, a first operation of reproducing the music corresponding to the input voice V is instructed, and in the reproduction state, a third operation of evaluating the input voice V is instructed. However, a common action (for example, a first action of playing music) may be instructed in common in the standby state and the playback state.

<Third embodiment>
In the first embodiment, the functions of the music reproduction system 10 are realized by a single terminal device, but in the third embodiment, the functions of the music reproduction system 10 are realized by a plurality of devices. FIG. 7 is a block diagram illustrating the configuration of a music playback system 10 according to the third embodiment. As illustrated in FIG. 7, the music reproduction system 10 of the third embodiment includes a terminal device 20, a terminal device 30, and a processing device 40.

The processing device 40 is a playback device that plays music desired by the user U. For example, a car navigation device or a car audio device installed in a car is suitable as the processing device 40. The user U can instruct the processing device 40 to operate by voice input to the terminal device 20 and the terminal device 30. The terminal device 20 and the terminal device 30 are information terminals that commonly receive an input voice V from the user U and transmit an instruction according to the input voice V to the processing device 40. The terminal device 20 and the terminal device 30 are installed inside the vehicle in which the processing device 40 is mounted. The terminal device 20 receives the singing voice and transmits a first action instruction P1 to the processing device 40. For example, information terminals such as mobile phones and smartphones are suitable as the terminal device 20. On the other hand, the terminal device 30 receives the instruction voice and transmits a second operation instruction P2 to the processing device 40. For example, a voice interaction device such as a smart speaker is suitable as the terminal device 30. Each of the terminal device 20 and the terminal device 30 can communicate with the processing device 40 by wire or wirelessly.

FIG. 8 is a block diagram illustrating the configuration of the terminal device 20. As shown in FIG. As illustrated in FIG. 8, the terminal device 20 includes a sound collection device 21, a communication device 22, a control device 23, and a storage device 24. The sound collection device 21 is an audio device (microphone) that collects surrounding sounds. Specifically, the sound collection device 21 receives the input voice V from the user U and generates the acoustic signal X representing the input voice V.

The control device 23 (an example of a computer) is composed of a processing circuit such as a CPU, and controls each element of the music reproduction system 10 in an integrated manner. The control device 23 implements a plurality of functions (first processing section 231 and first operation control section 233) by executing programs stored in the storage device 24. Note that some functions of the control device 23 may be realized by a dedicated electronic circuit. Further, the functions of the control device 23 may be installed in a plurality of devices.

The storage device 24 stores programs executed by the control device 23 and various data used by the control device 23. For example, known recording media such as semiconductor recording media and magnetic recording media, or a combination of multiple types of recording media may be arbitrarily employed as the storage device 24. As illustrated in FIG. 8, the storage device 24 of the third embodiment stores a plurality of reference data respectively corresponding to a plurality of different songs.

The first processing unit 231 determines from the acoustic signal X generated by the sound collection device 21 whether the input voice V by the user U is a singing voice or a voice other than a singing voice (that is, an instruction voice or a spoken voice). do. In a process similar to step Sa1 (Sa11-Sa14 in FIG. 4) illustrated in FIG. 3, it is determined whether the input voice V is a singing voice. Specifically, a similarity index calculated between each of the plurality of reference data stored in the storage device 24 and the acoustic signal X is used to determine whether the input voice V is a singing voice. .

The first operation control unit 233 causes the communication device 22 to transmit a first operation instruction P1 to the processing device 40 when it is determined that the input voice V is a singing voice. The first action instruction P1 is, for example, an action to play back the music corresponding to the input audio V, as in the first embodiment. The communication device 22 transmits the first operation instruction P1 to the processing device 40 under the control of the first operation control section 233. Note that when it is determined that the input voice V is not a singing voice (that is, it is determined that it is a voice other than a singing voice), the instruction P1 for the first operation is not transmitted. The processing device 40 receives the instruction P1 transmitted from the terminal device 20.

FIG. 9 is a block diagram illustrating the configuration of the terminal device 30. As illustrated in FIG. 9, the terminal device 30 includes a sound collection device 31, a communication device 32, a control device 33, and a storage device 34. The sound collection device 31 is an audio device (microphone) that collects surrounding sounds. Specifically, like the sound collection device 21 of the terminal device 20, the sound collection device 31 receives the input voice V from the user U and generates the acoustic signal X representing the input voice V.

The control device 33 (an example of a computer) is composed of a processing circuit such as a CPU, and controls each element of the music reproduction system 10 in an integrated manner. The control device 33 realizes a plurality of functions (second processing section 331 and second operation control section 333) by executing programs stored in the storage device 34. Note that some functions of the control device 33 may be realized by a dedicated electronic circuit. Further, the functions of the control device 33 may be installed in a plurality of devices.

The storage device 34 stores programs executed by the control device 33 and various data used by the control device 33. For example, known recording media such as semiconductor recording media and magnetic recording media, or a combination of multiple types of recording media may be arbitrarily employed as the storage device 34. As illustrated in FIG. 9, the storage device 34 of the third embodiment stores an operation table similar to that of the first embodiment and a plurality of song names corresponding to the plurality of song data M, respectively.

The second processing unit 331 determines from the acoustic signal X generated by the sound collection device 31 whether the input voice V by the user U is an instruction voice or a voice other than the instruction voice (that is, a singing voice or a spoken voice). do. Similar to the first embodiment, an action table is used to determine whether the input voice V is an instruction voice. Further, when the instruction voice instructs to play a song, the song name specified by the instruction voice is specified from among the plurality of song names stored in the storage device 34. As in the first embodiment, natural language processing such as morphological analysis of input character strings is used to identify the song name. Note that the processing in the second processing unit 331 and the processing in the first processing unit 231 are executed in parallel.

The second operation control unit 333 causes the communication device 32 to transmit a second operation instruction P2 to the processing device 40 when it is determined that the input voice V is an instruction voice. The second operation is, for example, an operation of reproducing the music specified by the instruction voice, similar to the first embodiment. Specifically, a second operation instruction P2 for reproducing the performance data corresponding to the song name specified by the second processing unit 331 is transmitted. The communication device 32 transmits the second operation instruction P2 to the processing device 40 under the control of the second operation control section 333. Note that when it is determined that the input voice V is not an instruction voice (that is, it is determined that it is a voice other than the instruction voice), the instruction P2 for the second operation is not transmitted. The processing device 40 receives the second operation instruction P2 transmitted from the terminal device 30.

FIG. 10 is a block diagram illustrating the configuration of the processing device 40. As shown in FIG. As illustrated in FIG. 10, the processing device 40 includes a playback device 41, a communication device 42, a control device 43, and a storage device 44. The control device 43 (an example of a computer) is composed of a processing circuit such as a CPU, and controls each element of the music reproduction system 10 in an integrated manner. The control device 43 realizes the playback control section 431 by executing a program stored in the storage device 44. Note that some functions of the control device 43 may be realized by a dedicated electronic circuit. Further, the functions of the control device 43 may be installed in a plurality of devices.

The storage device 44 stores programs executed by the control device 43 and various data used by the control device 43. For example, known recording media such as semiconductor recording media and magnetic recording media, or a combination of multiple types of recording media may be arbitrarily employed as the storage device 44. As illustrated in FIG. 10, the storage device 44 of the third embodiment stores a plurality of pieces of music data M, similarly to the first embodiment.

The playback device 41 is a playback device that plays music under instructions from the control device 43. The communication device 42 receives the first operation instruction P1 from the terminal device 20. Further, the second operation instruction P2 is received from the terminal device 30.

The playback control unit 431 controls the playback device 41 by executing the instruction P1 or the instruction P2 received by the communication device 42. That is, the playback control section 431 executes the first operation instructed by the first operation control section 233 of the terminal device 20 or the second operation instructed from the second operation control section 333 of the terminal device 30. The playback control section 431 of the third embodiment includes a data processing section and a sound source section similar to those of the first embodiment, and generates data from performance data in accordance with instructions from the first operation control section 233 or the second operation control section 333. The resulting acoustic signal is supplied to the playback device 41. The playback device 41 plays music according to the audio signal supplied from the playback control unit 431.

As understood from the above explanation, the first processing unit 231 of the terminal device 20 and the second processing unit 331 of the terminal device 30 determine whether the input voice V is a singing voice or an instruction voice other than a singing voice. Functions as a discriminator for discrimination. That is, the function of the discriminator may be realized by a plurality of devices. Furthermore, when it is determined that the input voice V is a singing voice, the first operation control unit 233 of the terminal device 20 and the second operation control unit 333 of the terminal device 30 control the performance of the music corresponding to the input voice V. Instructs the playback control unit 431 to perform a first action related to playback, and instructs the playback control unit 431 to perform a second action represented by the input sound V when it is determined that the input voice V is an instruction sound. Functions as an operation control unit. That is, the function of the operation control section may be realized by a plurality of devices.

As understood from the above description, it is optional whether the functions of the music playback system 10 are realized by a single device or by a plurality of devices. Note that the configuration realized by a plurality of devices is not limited to the configuration illustrated in the third embodiment. For example, the first processing unit 231 and first operation control unit 233 of the terminal device 20 may be installed in a server device that can communicate with the terminal device 20. Specifically, the terminal device 20 transmits the acoustic signal X generated by the sound collection device 21 to the server device. The server device specifies the first action from the acoustic signal X received from the terminal device 20, and transmits an instruction P1 for the first action to the terminal device 20. Then, the terminal device 20 transmits the first operation instruction P1 transmitted from the server device to the processing device 40. Further, either one of the second processing section 331 and the second operation control section 333 of the terminal device 30 may be installed in the server device. Note that the configuration of the third embodiment may be applied to the second embodiment.

<Modified example>
Specific modification modes added to each of the embodiments exemplified above are illustrated below. A plurality of aspects arbitrarily selected from the examples below may be combined as appropriate to the extent that they do not contradict each other.

(1) In each of the above-described embodiments, the sound collection device of the music playback system 10 receives the input voice V, but a sound collection device separate from the music playback system 10 may be used to receive the input sound V. For example, a sound pickup device installed in the vehicle or a detachable sound pickup device is used to receive the input voice V. As understood from the above description, the music playback system 10 and the sound collection device may be integrated or separated as desired.

(2) In each of the above embodiments, the song data M includes performance data and reference data, but the song data M may include data different from the song name, performance data, and reference data. For example, the music data M may include lyrics data representing lyrics. For example, lyrics data is used to present lyrics. For example, the lyrics may be presented by display, or by emitting sound representing the lyrics.

(3) In each of the above embodiments, the specific processing method for determining whether the input voice V is a singing voice or an instruction voice is arbitrary. For example, when lyrics data is included in the music data M, the character string represented by the input voice V is specified by voice recognition, and the input voice V is It may be determined whether or not the voice is a singing voice. In addition, it is determined whether or not the input voice V is an instruction voice using known technology such as voice recognition for the input voice V or a trained model (artificial intelligence) such as a neural network obtained by machine learning. You may. In the above configuration, the content of the instruction expressed by the instruction voice is also specified. As understood from the above explanation, the action table is not essential for determining whether the input voice V is an instruction voice.

(4) In each of the above-mentioned embodiments, before the music is played according to the instruction of the first action or the second action to play the music, a process of presenting the music to the user U (hereinafter referred to as "music presentation process") is performed. The music playback system 100 may also perform the process. In the song presentation process, for example, a song name is presented to the user U. FIG. 11 is a flowchart of music presentation processing. When the sound collection device 11 receives an input voice V (hereinafter referred to as "first input voice") instructing reproduction of a music piece, the process of FIG. 11 is started. The first input voice may be a singing voice or an instruction voice. For example, when instructing to play the song "ABC", a singing voice singing the song "ABC" or an instruction voice pronouncing the character string "[ABC]" is exemplified as the first input voice. Ru.

The control device 12 identifies the song name corresponding to the first input audio (Sb1). In other words, the name of the song for which the reproduction instruction was given by the first input voice is specified. The operation control unit 123 gives an instruction to the playback control unit 125 to present the song name corresponding to the first input audio (Sb2). The playback device 14 presents the song name according to instructions from the playback control unit 125. For example, the playback device 14 emits a sound representing the song name (for example, a sound representing "[song name]?"). Note that a character string representing the song name may be displayed by the playback device 14.

If the song with the song name played by the playback device 14 is the desired song, the user U can use the input voice V (hereinafter referred to as "second input voice") that indicates that the song with the song name is the desired song. ”) is pronounced. The second input voice is, for example, a voice saying "yes". Note that, if the song with the song title played by the playback device 14 is not the desired song, the user U may hear a voice indicating that the song with the song name is not the desired song (for example, a voice saying "no"). ) to pronounce.

The control device 12 determines whether the sound collection device 11 has received the second input audio (Sb3). If it is determined that the second input audio has been accepted (Sb3: YES), the operation control unit 123 instructs the reproduction control unit 125 to perform an operation of reproducing the music corresponding to the first input audio (Sb4). That is, the song having the song name played by the playback device 14 is played back.

On the other hand, if it is determined that input audio V other than the second input audio has been received (Sb3: NO), the music corresponding to the first input audio is not played. Note that when the music reproduction system 10 receives input V audio indicating that the music is an undesired music, it may re-specify the music to be played. As can be understood from the above explanation, the music presentation process has the advantage that the user U can confirm whether or not the music specified by the first input audio is the desired music before playing the music. .

(5) In each of the above embodiments, the music playback system 10 is used in a car, but the music playback system 10 can be used at any location.

(6) In each of the above-described embodiments, the music playback system 10 played back karaoke music, but the music played by the music playback system 10 is not limited to the above examples. For example, a song including a singer's singing voice may be played.

(7) The music reproduction system 10 of each of the above-mentioned forms is also used by a plurality of users U. When used by a plurality of users U, the sound collection device receives input speech V including a plurality of sounds produced by each of the plurality of users U. The music reproduction system 10 separates the voices of each user U from the input voice V, and determines whether each voice after the separation is a singing voice or an instruction voice. That is, even when a plurality of users U make sounds at the same time, it is possible to instruct the music playback system 10 to perform operations corresponding to the voices uttered by each user U.

(8) In the first embodiment, the first action and the second action are different from each other, but the first action and the second action may be the same action. However, according to a configuration in which the first action and the second action are different actions, the user U can reproduce the desired action by appropriately changing the type of input voice V (singing voice/instruction voice). It is possible to instruct the control unit 125.

(9) In each of the above-described embodiments, the operation of reproducing the music corresponding to the input audio V is illustrated as the first operation, but the content of the first operation is not limited to the above examples. For example, the first operation may be an operation of changing the reproduction mode according to the input voice V (singing voice). For example, the first operation of changing the tempo of the song being played or the song that starts playing depending on the tempo of the input audio V, or the song that is being played or the song that starts playing depending on the key of the input audio V. The first action of changing the key is preferred.

(10) In the first embodiment, the operation of reproducing the song immediately after the part sung by the user U of the song was exemplified as the first operation of reproducing the song from the position corresponding to the input voice V, but the input voice The first operation of reproducing from the position corresponding to V is not limited to the above example. For example, among a plurality of sections (hereinafter referred to as "unit sections") into which the song corresponding to the input voice V is divided, the operation of reproducing the song from the beginning of the unit section that includes the part represented by the input voice V is performed in the first step. A configuration in which it is an operation is also adopted. In the above configuration, the music data M includes section data for defining unit sections. The section data defines the start point and end point of each unit section. The unit section is, for example, a phrase that is a group of musical expressions, or a structural section such as a melody, a melody, and a chorus. Note that the unit section is not limited to the above example. Among the plurality of unit sections, the unit section including the portion represented by the input voice V is specified by a known music analysis technique. In the above configuration, the music is played from the beginning of the unit section including the part represented by the input audio V among the plurality of unit intervals, so the user can play the music from the part corresponding to the input audio V among the multiple unit intervals. can sing.

Also, among the plurality of unit sections into which the music corresponding to the input audio V is divided, the operation of playing the music from the beginning of the unit section immediately before or after the unit section including the part represented by the input audio V is performed as the first operation. It may also be an action. Note that the first operation of reproducing the music from the beginning is also suitable. As understood from the above description, in the first operation, the position at which the music corresponding to the input voice V (singing voice) is played is set to be variable.

(11) In the second embodiment, assuming a configuration that determines whether the input voice V is a singing voice or an instruction voice, when the input voice V is a singing voice, the input voice V is being played back. It was determined whether the audio was the singing voice of a song or not. However, in the second embodiment, it is determined whether or not the input voice V is the singing voice of the song being played, without assuming a configuration for determining whether the input voice V is a singing voice or an instruction voice. You may. That is, it is determined whether the input voice V is the singing voice of the song being played by the playback control unit 125 or the singing voice of a song other than the song being played by the playback control unit 125, and the input voice V is determined. If it is determined that the input voice V is the singing voice of the song being played by the playback control unit 125, the third operation is instructed to the singing evaluation unit 127, and the input voice V is determined to be the singing voice of the song being played by the playback control unit 125. The configuration that instructs the playback control unit 125 to perform the first operation when it is determined that the input voice is a singing voice of a song other than the above is the configuration that determines whether the input voice V is a singing voice or an instruction voice. It is established independently of.

(12) In the third embodiment, the terminal device 20 and the terminal device 30 independently executed the process, but the terminal device 20 and the terminal device 30 may execute the process in conjunction with each other. For example, when the terminal device 30 determines that the input voice V by the user U is a voice other than the instruction voice, the terminal device 30 transmits an instruction to the terminal device 20 to determine whether the input voice V is a singing voice. You may. Upon receiving the instruction from the terminal device 30, the terminal device 20 determines whether the input voice V is a singing voice.

(13) In each of the above embodiments, a configuration is also suitable in which the music reproduction system 10 is started, for example, when a singing voice or an instruction voice is received.

(14) The functions of the music playback system 10 according to each of the above embodiments are realized by cooperation between a processing circuit such as a CPU and a program, as illustrated in each embodiment. The programs according to each of the above embodiments may be provided in a form stored in a computer-readable recording medium and installed in a computer. The recording medium is, for example, a non-transitory recording medium, and an optical recording medium (optical disk) such as a CD-ROM is a good example, but any known recording medium such as a semiconductor recording medium or a magnetic recording medium is used. Also included are recording media in the form of. Note that the non-transitory recording medium includes any recording medium except for transitory, propagating signals, and does not exclude volatile recording media. Further, the program may be provided to the computer in the form of distribution via a communication network.

<Additional notes>
From the embodiments exemplified above, the following configurations can be understood, for example.

A method for controlling a music playback system according to a preferred aspect (first aspect) of the present disclosure is to determine whether an input voice is a singing voice or an instruction voice other than a singing voice, and to determine whether the input voice is a singing voice. If it is determined that the input voice is an instruction voice, the input voice is determined to be an instruction voice, and the input voice is determined to be an instruction voice. Then, the playback controller is instructed to perform a second action represented by the input audio. In the above aspect, when the input voice is determined to be a singing voice, the playback control unit is instructed to perform the first operation related to the reproduction of the music corresponding to the input voice, and the input voice is determined to be an instruction voice. If so, the second action represented by the input audio is instructed to the playback control unit. That is, a variety of voice inputs including singing voice and instruction voice are possible. For example, the first operation and the second operation are different operations. In the above aspect, by appropriately changing the type of input audio (singing audio/instruction audio), it is possible to instruct the playback control unit to perform a desired operation.

In a preferred example of the first aspect (second aspect), the first operation is an operation of reproducing a song corresponding to the input voice from a position corresponding to the singing voice, and the second operation is an operation of reproducing the music corresponding to the input voice from a position corresponding to the singing voice. This is an operation that plays the music corresponding to the song from the beginning. In the above aspect, the operation of reproducing the music corresponding to the input audio from the position corresponding to the input audio is the first operation, and the operation of reproducing the music corresponding to the input audio from the beginning is the second operation. Therefore, by appropriately changing the type of input audio (singing audio/instruction audio), the user can reproduce the music according to a desired reproduction method.

In a preferred example of the second aspect (third aspect), the first operation is performed from the beginning of the section including the part represented by the input voice out of a plurality of sections into which the music corresponding to the input voice is divided. This is the action of reproducing. In the above aspect, when the input audio is a singing audio, the music is played from the beginning of the section that includes the part represented by the input audio, out of multiple sections into which the music corresponding to the input audio is divided. Ru. Therefore, the user can sing the song from the portion of the song that corresponds to the singing voice.

In a preferred example of any one of the first to third aspects (fourth aspect), the input audio is a singing voice of a song being played by the playback control unit, or the song being played by the playback control unit. If the input voice is determined to be the singing voice of a song being played by the playback control unit, perform a third operation of evaluating the input voice. When the input audio is determined to be the singing audio of a song other than the song being played by the playback control section, the evaluation section performs an operation to play back a song corresponding to the input audio. As a first operation, an instruction is given to the reproduction control section. In the above aspect, when the input audio is the singing audio of the song that is being played, the singing evaluation section is instructed to perform the third operation of evaluating the input audio, and the input audio is the singing audio of the song that is not the song that is being played. If the input audio is audio, the reproduction control unit is instructed to perform a first operation of reproducing the music corresponding to the input audio. Therefore, the instructions for the first action and the third action can be changed depending on whether the input sound is the singing sound of the song being played.

A method for controlling a music playback system according to another aspect (fifth aspect) of the present disclosure includes: providing a playback control unit with an instruction to present a song name corresponding to a first input voice instructing playback of a song; When receiving a second input voice indicating that the song with the given song name is the desired song, the playback controller is instructed to play back the song corresponding to the first input voice. In the above aspect, an instruction to present a song name corresponding to the first input voice instructing playback of a song is given to the playback control unit, and a first input voice indicating that the song with the presented song name is a desired song is given to the playback control unit. When the second input sound is received, the playback control unit is instructed to play the music corresponding to the first input sound. That is, before a song is played, it is possible to confirm whether the song is the desired song by presenting the song name.

A method for controlling a music playback system according to another aspect (sixth aspect) of the present disclosure is to determine whether the input audio is a singing voice of a song being played by a playback control unit that controls playback of a song, or determines whether the input voice is a singing voice of a song other than the song being played by the playback controller, and if the input voice is determined to be the singing voice of a song that is being played by the playback control unit, evaluates the input voice. Instruct the singing evaluation unit to perform the operation, and if the input audio is determined to be the singing audio of a song other than the song being played by the playback control unit, play the song corresponding to the input audio. The operation is instructed to the reproduction control section. In the above aspect, when the input audio is the singing audio of the song that is being played, the singing evaluation section is instructed to perform an operation to evaluate the input audio, and if the input audio is the singing audio of a song other than the song that is being played, the singing evaluation section is instructed to evaluate the input audio. In some cases, the playback control unit is instructed to play back the music corresponding to the input audio. Therefore, it is possible to instruct the music playback system to perform different operations depending on whether the input sound is the singing sound of the music being played.

A music playback system according to a preferred aspect (seventh aspect) of the present disclosure includes a determination unit that determines whether the input voice is a singing voice or an instruction voice other than the singing voice, and the input voice is a singing voice. If it is determined that the input voice is an instruction voice, the input voice is determined to be an instruction voice, and the input voice is determined to be an instruction voice. and an operation control section that instructs the reproduction control section to perform a second operation represented by the input voice. In the above aspect, when the input voice is determined to be a singing voice, the playback control unit is instructed to perform the first operation related to the reproduction of the music corresponding to the input voice, and the input voice is determined to be an instruction voice. If so, the second action represented by the input audio is instructed to the playback control unit. That is, a variety of voice inputs including singing voice and instruction voice are possible.

In a preferred example of the seventh aspect (eighth aspect), the first operation is an operation of reproducing a song corresponding to the input audio from a position corresponding to the input audio, and the second operation is an operation of reproducing the music corresponding to the input audio from a position corresponding to the input audio. This is an operation that plays the music corresponding to the song from the beginning. In the above aspect, the operation of reproducing the music corresponding to the input audio from the position corresponding to the input audio is the first operation, and the operation of reproducing the music corresponding to the input audio from the beginning is the second operation. Therefore, by appropriately changing the type of input audio (singing audio/instruction audio), the user can reproduce the music according to a desired reproduction method.

In a preferred example of the eighth aspect (ninth aspect), the first operation is performed from the beginning of the section including the part represented by the input voice, of a plurality of sections into which the song corresponding to the input voice is divided. This is the action of reproducing. In the above aspect, when the input audio is a singing audio, the music is played from the beginning of the section that includes the part represented by the input audio, out of multiple sections into which the music corresponding to the input audio is divided. Ru. Therefore, the user can sing the song in succession to the singing voice.

In a preferred example of any one of the seventh to ninth aspects (tenth aspect), the determination unit determines whether the input audio is a singing voice of a song being played by the playback control unit. The operation control section determines whether the input sound is the singing voice of a song other than the song being played back by the playback control section, and if the input voice is determined to be the singing voice of the song being played back by the playback control section, A third operation for evaluating the input voice is instructed to the singing evaluation section, and if the input voice is determined to be the singing voice of a song other than the song being played by the playback control section, the input voice is evaluated. An instruction is given to the reproduction control unit as the first operation to reproduce the music corresponding to the audio. In the above aspect, when the input audio is the singing audio of the song that is being played, the singing evaluation section is instructed to perform the third operation of evaluating the input audio, and the input audio is the singing audio of the song that is not the song that is being played. If the input audio is audio, the reproduction control unit is instructed to perform a first operation of reproducing the music corresponding to the input audio. Therefore, the instructions for the first action and the third action can be changed depending on whether the input sound is the singing sound of the song being played.

A program according to a preferred aspect (eleventh aspect) of the present disclosure includes a determination unit that causes one or more processors to determine whether an input voice is a singing voice or an instruction voice other than a singing voice; If the voice is determined to be a singing voice, instruct a playback control unit that controls playback of the song to perform a first operation related to playback of a song corresponding to the input voice, and determine that the input voice is an instruction voice. If it is determined that there is an input voice, it functions as an operation control section that instructs the reproduction control section to perform a second operation represented by the input voice. In the above aspect, when the input voice is determined to be a singing voice, the playback control unit is instructed to perform the first operation related to the reproduction of the music corresponding to the input voice, and the input voice is determined to be an instruction voice. If so, the second action represented by the input audio is instructed to the playback control unit. That is, a variety of voice inputs including singing voice and instruction voice are possible.

DESCRIPTION OF SYMBOLS 10... Music playback system, 11... Sound collection device, 12... Control device, 121... Discrimination part, 123... Operation control part, 125... Playback control part, 127... Singing evaluation part, 13... Storage device, 14... Playback device, 20...Terminal device, 21...Sound collection device, 22...Communication device, 23...Control device, 24...Storage device, 27...Operation control section, 231...First processing section, 233...First control section, 30...Terminal device , 31...Sound collection device, 32...Communication device, 33...Control device, 331...Second processing section, 333...Second operation control section, 34...Storage device, 40...Processing device, 41...Playback device, 42...Communication device, 43...control device, 431...playback control section, 44...storage device.

Claims (8)

Determine whether the input voice is a singing voice or an instruction voice other than a singing voice,
When the input voice is determined to be a singing voice, a first operation of reproducing a song corresponding to the input voice from a position corresponding to the input voice is performed on a playback control unit that controls playback of the song. a computer-implemented control method for a music playback system, comprising: instructing the playback control unit to perform a second action represented by the input sound when the input sound is determined to be the instruction sound; The method for controlling a music playback system according to claim 1, wherein the second operation is an operation corresponding to a registered character string similar to an input character string representing the input voice, among a plurality of operations corresponding to different registered character strings. . 3. The method of controlling a music reproduction system according to claim 1, wherein the second operation is an operation of reproducing the music specified by the input voice. 3. The method of controlling a music reproduction system according to claim 1, wherein the second operation is an operation of stopping reproduction of the music specified by the input voice. 3. The method of controlling a music reproduction system according to claim 1, wherein the second operation is an operation of changing the key of the music specified by the input voice. 3. The method of controlling a music reproduction system according to claim 1, wherein the second operation is an operation of changing the volume of the music specified by the input voice. a determination unit that determines whether the input voice is a singing voice or an instruction voice other than the singing voice;
When the input voice is determined to be a singing voice, a first operation of reproducing a song corresponding to the input voice from a position corresponding to the input voice is performed on a playback control unit that controls playback of the song. and an action control unit that instructs the playback control unit to perform a second action represented by the input sound when the input sound is determined to be the instruction sound. one or more processors,
a determination unit that determines whether the input voice is a singing voice or an instruction voice other than a singing voice, and
When the input voice is determined to be a singing voice, a first operation of reproducing a song corresponding to the input voice from a position corresponding to the input voice is performed on a playback control unit that controls playback of the song. and when the input voice is determined to be an instruction voice, the program functions as an operation control unit that instructs the playback control unit to perform a second operation represented by the input voice.

Images