JP2017181660A - Evaluation system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce a delay in timing when an evaluation result of a singing voice based upon a performance timing of an accompaniment sound is output by suppressing a deviation in output timing between the accompaniment sound and singing voice output from a speaker while evaluating the singing voice by a terminal.SOLUTION: An evaluation system comprises: an output control device which outputs a mixed sound of an accompaniment sound and a singing voice from a speaker; at least one evaluation device which acquires the mixing sound output from the speaker and evaluates the singing voice included in the mixed sound; a notification control device which gives notice of an evaluation result of the evaluated singing voice from a notification device. Evaluation devices each acquires the mixed sound output from the speaker (S150), and extracts the singing voice from the acquired mixed sound (S160). Further, the evaluation device evaluates the extracted singing voice (S170), and outputs an evaluation result thereof to the notification control device (S180).SELECTED DRAWING: Figure 2

Description

  The present invention relates to an evaluation system and a program for evaluating a singing voice.

  As described in Patent Document 1, a karaoke device including a speaker that plays and outputs music and a display unit that displays lyrics, and a mobile terminal that is provided separately from the karaoke device The system is known.

  In this karaoke system, each mobile terminal scores a voice input via the microphone of the mobile terminal. And a karaoke apparatus acquires and displays the scoring result in a portable terminal from each portable terminal by communication.

JP, 2015-118243, A

  By the way, in the karaoke system, it is preferable to output the singing sound from the speaker together with the accompaniment sound so that both the singing sound and the accompaniment sound can be heard by the user of the karaoke system such as a singer or an audience. Also, in the karaoke system, it is required to minimize the delay of the timing for displaying the result of scoring the singing voice of the singer to the performance timing of the accompaniment sound so that the singing skill can be improved during singing. ing.

  As in the karaoke system described in Patent Document 1, by allowing the mobile terminal to score the singing voice, the processing load of the karaoke apparatus can be reduced compared to the case where the karaoke apparatus scores the singing voice. For this reason, it becomes possible to use an apparatus with low processing capability for the karaoke apparatus of a karaoke system.

  However, in patent document 1, since a portable terminal scores a singing voice, it acquires a singer's singing voice from the microphone of a portable terminal. Therefore, when outputting accompaniment sound from a speaker connected to the karaoke device and outputting singing sound from the speaker of the karaoke device, it is necessary to sequentially transmit the sound data of the singing sound from the portable terminal to the karaoke device. The communication time transmitted from the mobile terminal to the karaoke apparatus is required. In particular, since audio data has a large amount of data, it takes time until the reception is completed after the transmission of the data is started. Therefore, there exists a subject that the difference of an output timing arises between the accompaniment sound and singing sound which are output from the speaker of a karaoke apparatus.

  On the other hand, in order to reduce the communication time during which the singing voice is transmitted from the portable terminal to the karaoke apparatus, it is conceivable that the singing voice is acquired by the karaoke apparatus. However, when the singing voice is scored by the mobile terminal and the scoring result is displayed by the display unit of the karaoke device, the communication time for transmitting the singing voice from the karaoke device to the mobile terminal, and the karaoke device gives the scoring result from the mobile terminal. Since the communication time to receive is required, the output timing of the scoring result is delayed in the transmission and reception communication times with respect to the output timing of the accompaniment sound and the singing voice.

  That is, in the conventional technology, while evaluating the singing voice at the terminal, the timing of outputting the evaluation result of the singing voice is suppressed while suppressing the deviation of the output timing between the accompaniment sound output from the speaker and the singing voice. There is a problem that it is difficult to reduce the delay from the performance timing of the accompaniment sound.

  Therefore, the present invention suppresses the output timing shift between the accompaniment sound output from the speaker and the singing voice while evaluating the singing voice at the terminal, and outputs the evaluation result of the singing voice; The object is to reduce the delay with respect to the performance timing of the accompaniment sound at the corresponding timing.

One aspect of the present invention made to achieve the above object relates to an evaluation system including an output control device, at least one evaluation device, and a notification control device.
Among these, the output control device outputs a mixed sound of the accompaniment sound of the reproduced music and the singing sound input via the microphone during the reproduction of the music from the speaker.

The evaluation device is formed separately from the output control device, acquires the mixed sound output from the speaker by the output control device, and evaluates the singing voice included in the mixed sound.
The notification control device is formed separately from the evaluation device and causes the notification device to notify the evaluation result of the singing voice evaluated by at least one evaluation device.

Furthermore, the evaluation device includes an acquisition unit, an extraction unit, an evaluation unit, and an output unit.
The acquisition unit acquires the mixed sound output from the speaker. The extraction unit extracts singing voice from the mixed sound acquired by the acquisition unit. The evaluation unit evaluates the singing voice extracted by the extraction unit. The output unit outputs the evaluation result evaluated by the evaluation unit to the notification control device.

According to such an evaluation system, the singing voice can be evaluated by an evaluation device formed separately from the output control device.
Moreover, since the singing voice is output from the speaker together with the accompaniment sound by the output control device, in the evaluation system, it is possible to reduce the possibility of a gap between the accompaniment sound output from the speaker and the singing voice. .

  Furthermore, in the evaluation system, since data to be output from the evaluation device to the notification control device is used as an evaluation result, in addition to being able to reduce the data amount of the output data, communication for transmitting a singing voice to the evaluation device Since time is not required, it is possible to reduce the timing of outputting the evaluation result of the singing voice from being delayed from the performance timing of the accompaniment sound.

  That is, according to the evaluation system, while the singing voice is evaluated by the evaluation device (that is, the terminal), the output timing shift between the accompaniment sound output from the speaker and the singing voice is suppressed, and the performance timing of the accompaniment sound is suppressed. The delay of the timing which outputs the evaluation result of the singing voice with respect to can be reduced.

The notification control device may include a first notification unit that notifies the evaluation result acquired from the evaluation device from the notification device.
According to such an evaluation system, the evaluation result acquired from the evaluation apparatus can be notified.

  Furthermore, the at least one evaluation device may be two or more evaluation devices. In this case, a 1st alerting | reporting part may alert | report the evaluation result based on the evaluation result acquired from two or more evaluation apparatuses from a alerting | reporting apparatus.

According to such an evaluation system, an evaluation result based on an evaluation result evaluated by two or more evaluation devices can be notified.
And an evaluation part may evaluate a singing voice for every at least 1 section previously prescribed | regulated as an evaluation area in a music. In this case, the output unit may output the evaluation result to the notification control device every time the singing voice is evaluated for each section by the evaluation unit. Furthermore, the said 1st alerting | reporting part of an alerting | reporting control apparatus may alert | report the said evaluation result from an alerting | reporting apparatus, whenever an evaluation result is acquired from an evaluation apparatus.

According to such an evaluation system, the evaluation result for each section can be notified.
A 1st alerting | reporting part may alert | report the evaluation result acquired first from two or more evaluation apparatuses with respect to one area from an alerting | reporting apparatus.

  According to such an evaluation system, it is possible to report the evaluation result acquired first for one section. Thereby, according to the evaluation system, the notification of the evaluation result can be realized earlier with respect to the performance timing of the accompaniment sound.

And a 1st alerting | reporting part may alert | report the representative value of the evaluation result with respect to the same area acquired from two or more evaluation apparatuses from an alerting | reporting apparatus.
According to such an evaluation system, the representative value of the evaluation result for the same section can be notified. Thereby, according to the evaluation system, the notified evaluation result can be made highly reliable.

  Furthermore, a 1st alerting | reporting part alert | reports the evaluation result acquired in the earliest out of two or more evaluation apparatuses with respect to one area from an alerting | reporting apparatus, and is the earliest among two or more evaluation apparatuses. When an evaluation result for the section is acquired from an evaluation apparatus other than the evaluation apparatus that has output the evaluation result, a representative value of the evaluation result for the section may be notified from the notification apparatus.

  In such an evaluation system, the evaluation result acquired at the earliest for one section is notified. In the evaluation system, when an evaluation result for the section is acquired from an evaluation device other than the evaluation device that outputs the earliest evaluation result, the evaluation result notified to the representative value of the evaluation result is changed.

Thereby, according to the evaluation system, it is possible to change the evaluation result to a highly reliable one while realizing the notification of the evaluation result earlier with respect to the performance timing of the accompaniment sound.
The notification control device derives a comprehensive evaluation for song singing based on an evaluation result acquired from at least one evaluation device, and a second notification that notifies the comprehensive evaluation derived by the derivation unit from the notification device. May be further provided.

According to such an evaluation apparatus, it is possible to notify the comprehensive evaluation of the song singing.
The output unit may output the evaluation result in the evaluation unit in association with the identification information of the evaluation device. In this case, the deriving unit may derive the sum of the evaluation results associated with the same identification information as a comprehensive evaluation.

According to such an evaluation system, the sum of the evaluation results from the same evaluation device can be notified as a comprehensive evaluation.
Furthermore, the deriving unit may derive a representative value of the evaluation result from at least one evaluation device as a comprehensive evaluation.

According to such an evaluation system, the representative value of the evaluation result can be notified as a comprehensive evaluation.
Another aspect of the present invention may be a program executed by a computer included in the evaluation apparatus.

This program may be a program that causes a computer to execute an acquisition procedure, an extraction procedure, an evaluation procedure, and an output procedure.
In the acquisition procedure, the mixed sound output from the speaker is acquired. In the extraction procedure, the singing voice is extracted from the acquired mixed sound. In the evaluation procedure, the extracted singing voice is evaluated. In the output procedure, the evaluated evaluation result is output to a notification control device formed separately from the evaluation device.

  As described above, if the present invention is implemented as a program, it is used by loading the computer from a recording medium as necessary and starting it, or by acquiring it and starting it through a communication line as necessary. be able to.

And it can be made to function as an evaluation apparatus mentioned above by making a computer perform each procedure.
The recording medium referred to here includes, for example, a computer-readable electronic medium such as a DVD-ROM, a CD-ROM, and a hard disk.

It is a block diagram which shows schematic structure of an evaluation system. It is a flowchart which shows the process sequence of the terminal process which information processing apparatus performs. It is a flowchart which shows the process sequence of the commander process which a karaoke apparatus performs. It is a flowchart which shows the process sequence of a 1st alerting | reporting process. It is a flowchart which shows the process sequence of a 2nd alerting | reporting process.

Embodiments of the present invention will be described below with reference to the drawings.
<1.1 Evaluation system>
The evaluation system 1 illustrated in FIG. 1 includes an information processing server 10, at least one karaoke device 30, and at least one information processing device 70 that is regulated separately from the karaoke device 30. In the present embodiment, description will be made assuming that the number of information processing apparatuses 70 is “two” or more.

  In this evaluation system 1, the karaoke apparatus 30 reproduces the music specified by the user. And the information processing apparatus 70 acquires the mixed sound output from the speaker 60 in the state with which the accompaniment sound of the music reproduced | regenerated by the karaoke apparatus 30 and the user's song voice were mixed, and evaluates a user's song To do. Furthermore, the karaoke apparatus 30 acquires and notifies the evaluation result in the information processing apparatus 70.

The singing voice is a voice of the user singing a song.
The music mentioned here is a music in which lyrics are assigned to at least a part of a plurality of notes arranged along the time axis. In the following, the music designated by the user is referred to as designated music.
<1.2 Information processing server>
The information processing server 10 includes a communication unit 12, a storage unit 14, and a control unit 16.

  In the communication unit 12, the information processing server 10 communicates with the outside through a communication network. That is, the information processing server 10 is connected to the karaoke apparatus 30 and the information processing apparatus 70 via a communication network. The communication network referred to here may be a wired communication network or a wireless communication network.

  The storage unit 14 is a known storage device configured to be able to read and write stored contents. The storage unit 14 stores accompaniment sound data for each music piece. The control unit 16 is a control device configured around a microcomputer.

  The accompaniment sound data is data representing the sound change of the accompaniment sound in the music by a waveform. Each piece of accompaniment sound data is associated with identification information for identifying a song (ie, a song ID) and section information representing an evaluation section.

The accompaniment sound is a sound obtained by playing a melody constituting a musical piece, for example, a sound obtained by playing a musical instrument such as a keyboard instrument or an electronic musical instrument.
The evaluation section is at least one section defined in advance as a section to be evaluated in the music.
<1.3 Karaoke equipment>
The karaoke apparatus 30 includes a communication unit 32, an input reception unit 34, a music playback unit 36, a storage unit 38, an audio control unit 40, a video control unit 46, and a control unit 50.

  In the communication unit 32, the karaoke device 30 communicates with an external device via a communication network. The input receiving unit 34 is an input device that receives input of information and commands in accordance with external operations. Here, the input device is, for example, a key, a switch, a reception unit of a remote controller, or the like.

The music playback unit 36 plays back the specified music.
The voice control unit 40 is a device that controls voice input / output. The voice control unit 40 includes an output unit 42 and a microphone input unit 44. A microphone 62 is connected to the microphone input unit 44. As a result, the microphone input unit 44 acquires the sound input via the microphone 62. A speaker 60 is connected to the output unit 42. The output unit 42 outputs the signal from the music playback unit 36 and the signal from the microphone input unit 44 to the speaker 60. The speaker 60 converts the signal from the output unit 42 into sound and outputs the sound.

The video control unit 46 outputs video or an image based on the data sent from the control unit 50. The video control unit 46 is connected to a display unit 64 that displays video or images.
The speaker 60 and the display unit 64 are an example of the notification device of the present invention. The notification device is a device that notifies information.

The control unit 50 is a control device that is configured mainly with a computer having at least a ROM 52, a RAM 54, and a CPU 56.
The ROM 52 stores data and programs that need to retain stored contents even when the power is turned off. The RAM 54 temporarily stores data. The CPU 56 executes processing according to a program stored in the ROM 52 or RAM 54.

The ROM 52 of the present embodiment stores a processing program for the control unit 50 to execute the commander process. The commander process is a process of playing back a specified music piece and obtaining and notifying the user's singing evaluation for the specified music piece from the information processing device 70.
<1.4 Information processing device>
The information processing device 70 is a device possessed by each user.

  The information processing apparatus 70 includes a communication unit 72, an input unit 74, a storage unit 76, a microphone 78, a display unit 80, a speaker 82, and a control unit 90. As an example of the information processing apparatus 70, a multi-function mobile phone (so-called smart phone) can be considered.

  The communication unit 72 inputs and outputs data via a public communication line network. The input unit 74 receives input of information and data. The input unit 74 includes various input devices such as a keyboard, a pointing device, a touch pad, a touch panel, and a switch.

  The storage unit 76 is a rewritable nonvolatile storage device, and includes, for example, a hard disk drive or a flash memory. The microphone 78 acquires the input voice.

The display unit 80 is a device that displays information based on a signal from the control unit 90. The speaker 82 is a device that converts a signal from the control unit 90 into sound and outputs the sound.
The control unit 90 is a control device configured mainly with a microcomputer including a ROM 92, a RAM 94, and a CPU 96.

  The ROM 92 stores data and programs that need to retain the stored contents even when the power is turned off. The RAM 94 temporarily stores data. The CPU 96 executes processing in accordance with a program stored in the ROM 92 or RAM 94.

The storage unit 76 or the ROM 92 of the control unit 90 stores a processing program for the control unit 90 to execute terminal processing. The terminal processing is to acquire a mixed sound output from the speaker 60 of the karaoke apparatus 30 in a state where the accompaniment sound of the designated music reproduced by the karaoke apparatus 30 and the user's singing voice are mixed, and the mixed sound It is the process which evaluates the user's singing voice | voice contained in and outputs it to the information processing server 10.
<1.5 Terminal processing>
Next, terminal processing executed by each of the information processing apparatuses 70 will be described.

  The terminal process may be activated in conjunction with the commander process in the karaoke apparatus 30. Interlocking means that when one process is activated, another process is activated in accordance with the activation. The interlock may be, for example, starting a terminal process when receiving an activation command from the karaoke device 30, or outputting a startup command to the karaoke device 30 when the terminal process is activated by the information processing device 70. The commander process may be started at 30.

  When the terminal process is activated, the control unit 90 first acquires an evaluation execution notification from the karaoke apparatus 30 via the information processing server 10 as shown in FIG. 2 (S110). The evaluation execution notification is a notification for inquiring of a user whether or not to perform singing evaluation on a specified music piece. The evaluation execution notification is output to the communication network via the information processing server 10 when the commander process is started in the karaoke apparatus 30.

  Subsequently, in the terminal process, the control unit 90 obtains accompaniment sound data of the designated music reproduced by the karaoke apparatus 30 from the information processing server 10 (S120). Furthermore, the control unit 90 outputs an evaluation participation notification to the information processing server 10 (S130). When receiving the evaluation participation notification from the information processing device 70, the information processing server 10 outputs the received evaluation participation notification to the karaoke device 30. The evaluation participation notification is a response to the evaluation execution notification and represents that the singing evaluation for the designated music is performed.

  Further, in the terminal process, the control unit 90 determines whether or not the evaluation for one designated song has been completed (S140). As a result of this determination, if the evaluation for one designated song has been completed (S140: YES), that is, if the evaluation for the last evaluation section along the time axis has been completed, the control unit 90 Terminate terminal processing.

  On the other hand, as a result of the determination in S140, if the evaluation for one designated song has not been completed (S140: NO), the control unit 90 acquires the sound for one evaluation section input via the microphone 78. (S150). The sound acquired in S150 is the sound output from the speaker 60 connected to the karaoke apparatus 30, and the accompaniment sound of the designated music that has been reproduced and the singing that is input via the microphone 62 during the reproduction of the designated music. It is a mixed sound with sound. The sound acquired in S150 is a sound indicating the mixed sound output in one evaluation section associated with the accompaniment sound data. A mixed sound is a sound in which two or more different sounds are mixed.

  Further, in the terminal process, the control unit 90 extracts the singing voice from the voice acquired in S150 (S160). Specifically, in S160, the sound waveform of the accompaniment sound in the corresponding evaluation section represented by the accompaniment sound data acquired in S120 is removed from the sound acquired in S160, and the remaining signal is extracted as a singing sound.

  Further, in the terminal process, the control unit 90 evaluates the singing voice extracted in S160 for one evaluation section (S170). In S <b> 170, the control unit 90 evaluates so that the higher the degree of coincidence between the transition of the pitch in the singing melody predetermined for each piece of music and the transition of the pitch of the singing voice, the higher the evaluation (for example, Scoring) may be performed. This evaluation is performed for each evaluation section.

  Further, in the terminal processing, the control unit 90, the evaluation result in S170, the evaluation section ID for identifying the evaluation section targeted for the evaluation, and the identification information for identifying the information processing device 70 (hereinafter referred to as terminal ID) Are associated with each other and output to the information processing server 10 (S180). Then, the information processing server 10 that has received the evaluation result stores the evaluation result for each evaluation section in the storage unit 14 in association with the evaluation ID and the terminal ID, and outputs it to the karaoke apparatus 30.

Thereafter, the control unit 90 shifts the terminal process to S140.
As described above, by executing the terminal process, the control unit 90 of the information processing device 70 functions as an example of the evaluation device of the present invention. The evaluation device is formed separately from the karaoke device 30, acquires the mixed sound output from the speaker 60 by the karaoke device 30, and evaluates the singing voice included in the mixed sound.
<1.6 Commander processing>
Next, the commander process executed by the CPU 56 of the control unit 50 of the karaoke apparatus 30 will be described.

The commander process is activated every time the designated music is played.
When this commander process is activated, the control unit 50 first acquires accompaniment sound data of the designated music as shown in FIG. 3 (S210). Subsequently, the control unit 50 outputs an evaluation execution notification to the information processing server 10 (S220). Then, when the information processing server 10 receives the evaluation execution notification from the karaoke device 30, the information processing server 10 outputs the received evaluation execution notification to each of the information processing devices 70 via the communication network.

  Further, the control unit 50 determines whether or not an evaluation participation notification from the information processing apparatus 70 has been received (S230). If the evaluation participation notification is not received as a result of the determination in S230 (S230: NO), the control unit 50 waits until the evaluation participation notification is received.

  When the evaluation participation notification is received (S230: YES), the control unit 50 reproduces the accompaniment sound of the designated music based on the accompaniment sound data acquired in S210 (S240). Specifically, the control unit 50 sequentially outputs the accompaniment sound data to the music reproduction unit 36 along the time axis. Then, the music reproducing unit 36 outputs the sound source signal of the designated music to the speaker 60 via the output unit 42. In addition, the music reproducing unit 36 outputs the sound input via the microphone 62 to the speaker 60 via the output unit 42. As a result, a mixed sound obtained by mixing the accompaniment sound of the designated music and the sound input via the microphone 62 is emitted from the speaker 60.

  Note that the reproduction of the designated music in S240 is not limited to reproduction based on the accompaniment sound data, and may be reproduction based on other data representing the music structure of the designated music. The other accompaniment sound data includes, for example, data representing a musical score of one piece of music according to the MIDI (Musical Instrument Digital Interface) standard.

Furthermore, in the reproduction of the designated music in S240, it is preferable to display the lyrics of the designated music on the display unit 64 in accordance with the reproduction of the designated music.
Subsequently, the control unit 50 executes a first notification process (S250). A 1st alerting | reporting process is a process which performs alerting | reporting based on the acquired evaluation result, if the evaluation result output from the information processing apparatus 70 is acquired. Details of the first notification process will be described later.

  In the commander process, the control unit 50 subsequently determines whether or not the reproduction of the designated music has been completed (S260). As a result of the determination in S260, if the reproduction of the designated music has not been completed (S260: NO), the control unit 50 returns the commander process to S250.

  On the other hand, when the reproduction of the designated music is completed (S260: YES), the control unit 50 executes the second notification process (S270). The second notification process is a process for deriving and notifying a comprehensive evaluation based on a plurality of evaluation results acquired from the information processing apparatus 70. Details of the second notification process will be described later. In addition, comprehensive evaluation means the comprehensive evaluation which evaluated the result of having sung the whole designated music.

Thereafter, the control unit 50 ends the commander process.
As described above, by executing the commander process, the control unit 50 of the karaoke device 30 functions as the output control device and the notification control device of the present invention.

The output control device is a control device that outputs a mixed sound of the accompaniment sound of the reproduced music and the singing sound input via the microphone during the reproduction of the music from a speaker. In addition, the notification control device is a control device that is formed separately from each of the information processing devices 70 and notifies the evaluation result of the singing voice evaluated by the information processing device 70 from the notification device.
<1.7 First Notification Process>
In the first notification process activated in S250 of the commander process, as shown in FIG. 4, the control unit 50 first determines whether or not the evaluation result output from the information processing apparatus 70 has been acquired (S310). . If the evaluation result is not acquired as a result of the determination in S310 (S310: NO), the control unit 50 waits until the evaluation result is acquired. When the evaluation result is acquired, the control unit 50 stores the acquired evaluation result in the RAM 54.

  Then, when the evaluation result is acquired (S310: YES), the control unit 50 determines whether or not the acquired evaluation result is the first evaluation result acquired from each of the information processing devices 70 for the evaluation section. Is determined (S320). Whether the evaluation result is the earliest or not is determined based on whether or not the evaluation result is already stored in the RAM M 54 for the same evaluation section.

  As a result of the determination in S320, if the acquired evaluation result is not the first acquired evaluation result (S320: NO), the control unit 50 shifts the first notification process to S340 described later in detail.

  On the other hand, as a result of the determination in S320, if the acquired evaluation result is the first acquired evaluation result (S320: YES), the control unit 50 outputs the first acquired evaluation result to the video control unit 46. (S330). The video control unit 46 displays the evaluation result acquired at the earliest on the display unit 64. In S330, the control unit 50 may output the evaluation result acquired at the earliest voice from the speaker 60 via the output unit 42.

  Subsequently, in the first notification process, the control unit 50 stores the evaluation result in the storage unit 38 in association with the terminal ID and the evaluation section ID associated with the evaluation result (S360). Further, the control unit 50 determines whether or not the number of received evaluation results for one evaluation section has reached a predetermined number (S370). The predetermined number here is a prescribed number, and in the present embodiment, is the number of information processing apparatuses 70 that have transmitted evaluation participation notifications.

  As a result of the determination in S370, if the number of evaluation results received for one evaluation section has reached a predetermined number (S370: YES), the control unit 50 ends the first notification process, and the commander process S250. Return processing to. The predetermined number may be one or more.

  On the other hand, if the number of received evaluation results has not reached the predetermined number as a result of the determination in S370 (S370: NO), the control unit 50 returns the first notification process to S310. In S310, the control unit 50 determines whether an evaluation result output from a different information processing apparatus 70 has been received. And if an evaluation result is received, the control part 50 will transfer the 1st alerting | reporting process to S340, assuming that the received evaluation result is not the evaluation result acquired first (S320: NO).

  In S340, the control unit 50 calculates an evaluation representative value. The evaluation representative value is a representative value of a plurality of evaluation results evaluated for one evaluation section. This evaluation representative value may be an average value, a mode value, or a median value.

  In the first notification process, subsequently, the control unit 50 displays the evaluation representative value calculated in S340 on the display unit 64 (S350). In S350, the control unit 50 may output the evaluation representative value from the speaker 60 via the output unit 42.

Thereafter, the control unit 50 shifts the first notification process to S360.
That is, in the first notification process, the evaluation result acquired first is notified among the evaluation results output from two or more information processing devices 70 for one evaluation section. Furthermore, in the first notification process, when the evaluation result for the evaluation section is acquired from the information processing device 70 other than the information processing device 70 that outputs the evaluation result first among the two or more information processing devices 70, An evaluation representative value for the evaluation section is notified.
<1.8 Second notification process>
In the second notification process activated in S <b> 270 of the commander process, as illustrated in FIG. 5, the control unit 50 first calculates a comprehensive evaluation based on all the evaluation results acquired from each of the information processing apparatuses 70. (S410).

  The comprehensive evaluation may be the sum of all the evaluation results, or may be a representative value of all the evaluation results. Furthermore, the comprehensive evaluation may be a sum of evaluation results that satisfy a specified condition, or may be a representative value of evaluation results that satisfy a specified condition. The specified condition referred to here may be that the same terminal ID is associated. That is, the sum or the representative value of the evaluation results from the specific information processing apparatus 70 may be calculated as a comprehensive evaluation. The representative values referred to here include an average value, a mode value, a median value, and the like.

  Subsequently, in the second notification process, the control unit 50 displays the comprehensive evaluation calculated in S410 on the display unit 64 (S420). In S420, the control unit 50 may output the comprehensive evaluation from the speaker 60 via the output unit 42.

Thereafter, the controller 50 ends the second notification process and ends the commander process.
[2. Effects of the embodiment]
(2a) According to the evaluation system 1, the singing voice can be evaluated by the information processing apparatus 70 formed separately from the karaoke apparatus 30.

  Moreover, since the singing voice is output from the speaker 60 together with the accompaniment sound by the karaoke device 30, in the evaluation system 1, there is a possibility that a deviation occurs between the accompaniment sound output from the speaker 60 and the singing voice. Can be reduced.

  (2b) Furthermore, since the evaluation system 1 uses the data output from the information processing device 70 to the karaoke device 30 as the evaluation result, the data amount of the output data can be reduced, and in addition to the evaluation device Since communication time for transmitting the singing voice is unnecessary, it is possible to reduce the timing at which the evaluation result of the singing voice is deviated from the performance timing of the accompaniment sound.

  (2c) That is, according to the evaluation system 1, while evaluating the singing voice with the terminal, the timing between outputting the evaluation result of the singing voice by suppressing the deviation between the accompaniment sound output from the speaker 60 and the singing voice. Can be prevented from deviating from the performance timing of the accompaniment sound.

  (2d) As a result, even when a microcomputer with low processing performance is used as the control unit 50 of the karaoke apparatus 30, it is possible to reduce the occurrence of inconveniences such as delay in the output of the evaluation result and the output of the accompaniment sound, thereby reducing the cost. Can be suppressed.

  (2e) By the way, in the 1st information processing, the evaluation result acquired earliest to one evaluation section is reported. In the first notification process, when the evaluation result for the evaluation section is acquired from the information processing device 70 other than the information processing device 70 that has output the earliest evaluation result, the evaluation is notified to the representative value of the evaluation result. Change the result.

Thereby, according to the evaluation system 1, it is possible to change the evaluation result to a highly reliable one while realizing the notification of the evaluation result earlier with respect to the performance timing of the accompaniment sound.
(2f) Moreover, comprehensive evaluation is alert | reported in the 2nd alerting | reporting process. That is, according to the evaluation system 1, it is possible to notify the comprehensive evaluation of the song singing.
[3. Other Embodiments]
As mentioned above, although embodiment of this invention was described, this invention is not limited to the said embodiment, In the range which does not deviate from the summary of this invention, it is possible to implement in various aspects.

  (3a) The first notification process may be configured to notify the acquired evaluation result every time the evaluation result is acquired from the information processing device 70. That is, the first notification process may be configured by S310, S330, S360, and S370, omitting S320, S340, and S350 in the process illustrated in FIG.

  (3b) Moreover, you may comprise a 1st alerting | reporting process to alert | report only the evaluation result acquired in the earliest among the evaluation results from the information processing apparatus 70. FIG. That is, the first notification process may be configured by S310, S320, S330, S360, and S370, omitting S340 and S350 in the process illustrated in FIG.

  (3c) Furthermore, the first notification process may be configured to notify only the representative value of the evaluation result from the information processing device 70. That is, the first notification process may be configured by S310, S340, 350, S360, and S370, omitting S320 and S330 in the process illustrated in FIG.

  (3d) Although a multi-function mobile phone has been assumed as the information processing apparatus 70 in the above embodiment, the information processing apparatus 70 is not limited to this. The information processing apparatus 70 may be configured as a personal computer, for example, or may be configured as a dedicated song evaluation apparatus.

  (3e) Furthermore, in the said embodiment, although communication between each of the karaoke apparatus 30 and the information processing apparatus 70 was performed via the information processing server 10, each of the karaoke apparatus 30 and the information processing apparatus 70 is carried out. May be directly executed without going through the information processing server 10.

  (3f) In the above embodiment, both the reproduction of the designated music and the notification of the evaluation for the designated music are executed by one karaoke device 30. However, the reproduction of the designated music and the evaluation result for the designated music are The notification may be executed by a separate device.

  In this case, the output control device may be configured as one device including the music playback unit 36 and the voice control unit 40, and the designated music playback may be executed by the output control device. The notification control device is configured as one device including the communication unit 32, the storage unit 38, the video control unit 46, and the control unit 50, and the notification result of the evaluation for the designated music is notified by the notification control device. May be executed.

(3g) In addition, the aspect which abbreviate | omitted a part of structure of the said embodiment is also embodiment of this invention. Further, an aspect configured by appropriately combining the above embodiment and the modification is also an embodiment of the present invention. Moreover, all the aspects which can be considered in the limit which does not deviate from the essence of the invention specified by the wording described in the claims are the embodiments of the present invention.
[4. Example of correspondence]
The function obtained by executing S150 in the terminal process corresponds to an example of an acquisition unit. The function obtained by executing S160 corresponds to an example of an extraction unit. The function obtained by executing S170 corresponds to an example of an evaluation unit. The function obtained by executing S180 corresponds to an example of an output unit.

  Furthermore, the function obtained by executing S250 of the commander process corresponds to an example of a first notification unit. The function obtained by executing S410 of the second notification process corresponds to an example of a derivation unit. The function obtained by executing S420 corresponds to an example of a second notification unit.

  DESCRIPTION OF SYMBOLS 1 ... Evaluation system 10 ... Information processing server 12, 32, 72 ... Communication part 14 ... Memory | storage part 16 ... Control part 30 ... Karaoke apparatus 34 ... Input reception part 36 ... Music reproduction | regeneration part 38 ... Memory | storage part 40 ... Voice control part 42 ... Output unit 44 ... Microphone input unit 46 ... Video control unit 50, 90 ... Control unit 52, 92 ... ROM 54, 94 ... RAM 56, 96 ... CPU 60, 82 ... Speaker 62, 78 ... Microphone 64, 80 ... Display unit 70 ... Information processing device 74 ... Input unit 76 ... Storage unit

Claims (11)

An output control device that outputs a mixed sound of the accompaniment sound of the reproduced music and the singing sound input via a microphone during the reproduction of the music from a speaker;
At least one evaluation device that is formed separately from the output control device, obtains the mixed sound output from the speaker by the output control device, and evaluates the singing voice included in the mixed sound;
A notification control device that is formed separately from the evaluation device, and that notifies the evaluation result of the singing voice evaluated by the at least one evaluation device from the notification device;
The evaluation device is
An acquisition unit for acquiring the mixed sound output from the speaker;
An extraction unit for extracting the singing voice from the mixed sound acquired by the acquisition unit;
An evaluation unit for evaluating the singing voice extracted by the extraction unit;
An evaluation system comprising: an output unit that outputs an evaluation result evaluated by the evaluation unit to the notification control device. The notification control device includes:
The evaluation system according to claim 1, further comprising a first notification unit that notifies the evaluation result acquired from the evaluation device from the notification device. The at least one evaluation device is two or more evaluation devices,
The first notification unit includes:
The evaluation system according to claim 2, wherein an evaluation result based on an evaluation result acquired from the two or more evaluation devices is notified from the notification device. The evaluation unit evaluates the singing voice for each at least one section defined in advance as an evaluation section in the music,
The output unit outputs the evaluation result to the notification control device each time a singing voice is evaluated for each section by the evaluation unit,
The first notification unit of the notification control device includes:
The evaluation system according to claim 2 or 3, wherein each time an evaluation result is acquired from the evaluation device, the evaluation result is notified from the notification device. The first notification unit includes:
The evaluation system according to claim 4, wherein an evaluation result acquired first from the two or more evaluation devices is notified from the notification device for one section. The first notification unit includes:
The evaluation system according to claim 4 or 5, wherein a representative value of an evaluation result for the same section acquired from the two or more evaluation devices is notified from the notification device. The first notification unit includes:
For one section, let the notification device notify the evaluation result acquired first among the two or more evaluation devices,
When an evaluation result for the section is acquired from an evaluation apparatus other than the evaluation apparatus that outputs the evaluation result at the earliest of the two or more evaluation apparatuses, a representative value of the evaluation result for the section is notified from the notification apparatus. The evaluation system according to claim 4. The notification control device includes:
A derivation unit for deriving a comprehensive evaluation of the song based on the evaluation result obtained from the at least one evaluation device;
The evaluation system according to any one of claims 1 to 7, further comprising: a second notification unit that notifies the comprehensive evaluation derived by the derivation unit from the notification device. The output unit is
The evaluation result in the evaluation unit is output in association with the identification information of the evaluation device,
The derivation unit includes:
Deriving the sum of the evaluation results associated with the same identification information as the comprehensive evaluation,
The evaluation system according to claim 8. The derivation unit includes:
The evaluation system according to claim 8 or 9, wherein a representative value of the evaluation result from the at least one evaluation device is derived as the comprehensive evaluation. A program executed by a computer included in the evaluation device,
An acquisition procedure for acquiring a mixed sound output from a speaker, which is a mixed sound of an accompaniment sound of a reproduced music and a singing voice that is a sound input via a microphone during the reproduction of the music;
An extraction procedure for extracting the singing voice from the mixed sound acquired in the acquisition procedure;
An evaluation procedure for evaluating the singing voice extracted in the extraction procedure;
An output procedure for outputting the evaluation result evaluated in the evaluation procedure to a notification control device formed separately from the evaluation device,
A program to be executed by the computer.

Images