JP2010276878A - Musical performance operation evaluation device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology for measuring brain functions and activating the brain functions by using a musical instrument. <P>SOLUTION: A task presentation device 1 is installed in a music stand of a keyboard instrument. A control part 11 of the task presentation device 1 reads out accompaniment sound data from an accompaniment sound data storage area 121 and reproduces the accompaniment sound. Also, the control part 11 reproduces phrase sound by reading out phrase sound data from a phrase sound data storage area 122, and presents the phrase sound to a player by irradiating a key corresponding to the phrase sound data out of the keys constituting a keyboard of the keyboard instrument with a laser beam. The player is taught to do a predetermined performance operation corresponding to the presented accompaniment sound. The control part 11 evaluates the performance operation based on comparison between the detected player's performance operation and predetermined reference performance data in a predetermined period during reproducing the accompaniment sound. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a performance operation evaluation apparatus and a program.

  2. Description of the Related Art In recent years, an apparatus has been provided in which an LED is provided on a keyboard and the keyboard is illuminated to instruct key depression (see, for example, Patent Documents 1 and 2). In addition, a device for playing a game or training a moving visual acuity using a musical instrument having an LED provided on a keyboard has been proposed (see, for example, Patent Document 3). In recent years, an apparatus for presenting a graphic problem and measuring a brain function has been proposed (see, for example, Patent Documents 4 and 5). Moreover, when a plurality of people perform an ensemble, a technique has been proposed in which a teacher controls the main melody with a master machine and a student accompanies with a child machine (see Patent Document 6). Further, a technique for detecting and displaying a tempo shift with a facilitator (teacher) has been proposed (see Patent Document 7).

Japanese Patent Application Laid-Open No. 06-066763 JP-A-10-222160 JP 2004-194955 A JP 2006-158421 A JP 2006-158944 A JP 2001-195060 A JP 2007-093820 A

By the way, it is preferable that brain function can be measured and brain function can be activated using a musical instrument.
The present invention has been made in view of the above-described background, and an object thereof is to provide a technique capable of measuring brain function and activating brain function using a musical instrument.

  In order to solve the above problems, the present invention provides accompaniment sound data storage means for storing accompaniment sound data including timing data representing tempo, and a tempo for notifying the tempo based on the timing data in the accompaniment sound data storage means. A notifying means, a performance operation detecting means for detecting a performance operation of the performer, and a performance operation detected by the performance operation detecting means during a predetermined period during the notification of the tempo by the tempo notifying means; There is provided a performance operation evaluation apparatus comprising evaluation means for evaluating a performance operation based on a comparison with the reference performance data.

  In a preferred aspect of the present invention, the timing data is accompaniment sound data representing an accompaniment sound, and the accompaniment sound data storage means stores a set of a plurality of accompaniment sound data having different note arrangements, and a recording tempo notification means Replays accompaniment sounds sequentially based on a plurality of accompaniment sound data belonging to the same set, and then replays accompaniment sounds again based on predetermined accompaniment sound data of the plurality of accompaniment sound data, The tempo notification means may perform the evaluation with the period during which the accompaniment sound data is reproduced based on the predetermined accompaniment sound data as the predetermined period.

  In another preferred aspect of the present invention, the timing data is accompaniment sound data representing an accompaniment sound, and the accompaniment sound data storage means stores a plurality of accompaniment sound data having different note arrangements, and the tempo notification The means sequentially reproduces the accompaniment sound based on the plurality of accompaniment sound data stored in the accompaniment sound data storage means, and the evaluation means indicates that the tempo notification means is a predetermined accompaniment sound among the plurality of accompaniment sound data. The evaluation may be performed by setting the period during which accompaniment sound data is reproduced based on the data as the predetermined period.

  In another preferable aspect of the present invention, the timing data is accompaniment sound data representing an accompaniment sound, and the tempo notification means reproduces an accompaniment sound based on the accompaniment sound data in the accompaniment sound data storage means. A phrase sound data storage means for storing a plurality of phrase sound data indicating a predetermined note arrangement, and a phrase reproduction means for selecting the phrase sound data in the phrase sound data storage means, wherein each selected phrase sound data And a phrase sound reproducing means for selecting and reproducing the next phrase sound after a standby time that is a predetermined multiple of the reproduction time of the phrase sound after reproducing one phrase sound, The evaluation means is the standby time from when the phrase sound reproducing means reproduces the one phrase sound to when the next phrase sound is reproduced. Partial period of the may be a period in which the predetermined.

  In another preferable aspect of the present invention, the timing data is accompaniment sound data representing an accompaniment sound, and the tempo notification means reproduces an accompaniment sound based on the accompaniment sound data in the accompaniment sound data storage means. And performance timing notifying means for notifying the performer of the performance timing, and the evaluation means performs the evaluation with the period during which the performance timing is notified by the performance timing notification means as the predetermined period. You may go.

  Further, in another preferred aspect of the present invention, the timing data is accompaniment sound data representing an accompaniment sound, and the accompaniment sound data storage means stores a set of a plurality of accompaniment sound data having different note arrangements, The tempo notification means sequentially reproduces accompaniment sounds based on a plurality of accompaniment sound data belonging to the same set, and stores a plurality of phrase sound data indicating a predetermined note arrangement corresponding to each of the plurality of accompaniment sound data. Phrase sound data storage means may be provided, and the evaluation means may perform the evaluation using phrase sound data corresponding to the accompaniment sound data reproduced by the tempo notification means as the reference performance data.

  According to the present invention, it is possible to measure brain function and activate brain function using a keyboard instrument.

It is a figure which shows an example of a structure of a keyboard musical instrument task presentation system. It is a block diagram which shows an example of the hardware constitutions of a subject presentation apparatus. It is a figure which shows an example of the content of the presentation process of the phrase sound of a subject presentation apparatus. It is a figure which shows an example of the memory content of a correspondence storage area. It is a block diagram which shows an example of a functional structure of a subject presentation apparatus. It is a figure which shows an example of the content of the subject presentation process. It is a figure which shows an example of the content of the subject presentation process. It is a figure which shows an example of the content of the subject presentation process. It is a figure which shows an example of the content of the subject presentation process. It is a figure which shows an example of a structure of an electronic musical instrument. It is a block diagram which shows an example of the hardware constitutions of an electronic musical instrument. It is a block diagram which shows an example of a functional structure of an electronic musical instrument.

<A: First Embodiment>
<A-1: Configuration>
FIG. 1 is a diagram showing an example of the configuration of a keyboard instrument problem presentation system according to an embodiment of the present invention. In the figure, a keyboard instrument 2 is an instrument provided with a keyboard, for example, an acoustic piano. The keyboard instrument 2 is provided with a music stand 21 for installing a musical score. A task presentation device 1 is installed on the music stand 21. The task presentation device 1 is a device for presenting a task to a player using the keyboard instrument 2.

  FIG. 2 is a diagram illustrating an example of a hardware configuration of the task presentation device 1. In the figure, the control unit 11 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory), and reads and executes a computer program stored in the ROM or the storage unit 12. The units of the task presentation device 1 are controlled via the bus. The storage unit 12 is a storage unit for storing a computer program executed by the control unit 11 and data used at the time of execution, and is, for example, a hard disk device. The display unit 13 includes a liquid crystal panel and the like, and displays various images under the control of the control unit 11. The operation unit 14 includes various operators that can be operated by the performer of the assignment presentation device 1 and outputs a signal corresponding to the operation.

  The microphone 15 is a sound collection unit that collects a nearby sound and outputs an analog signal representing the collected sound. The sound processing unit 16 A / D converts the analog signal output from the microphone 15 to generate digital data. In addition, under the control of the control unit 11, the audio processing unit 16 D / A converts digital audio data to generate an analog signal, and outputs the generated audio signal to the speaker 17. The speaker 17 is a sound emitting unit that emits sound with an intensity corresponding to the analog signal supplied from the sound processing unit 16.

  In this embodiment, the case where the microphone 15 and the speaker 17 are included in the task presentation device 1 will be described. However, the audio processing unit 16 is provided with an input terminal and an output terminal, and the input terminal is connected via an audio cable. An external microphone may be connected, and similarly, an external speaker may be connected to the output terminal via an audio cable. In this embodiment, the case where the audio signal input from the microphone 15 to the audio processing unit 16 and the audio signal output from the audio processing unit 16 to the speaker 17 are analog audio signals will be described. You may make it input / output. In such a case, the audio processing unit 16 does not need to perform A / D conversion or D / A conversion. The same applies to the display unit 13 and the operation unit 14, and may be a format built in the task presentation device 1 or may be a format attached externally.

The light source 19 is an irradiation unit that emits laser light. The light source control unit 18 controls the light source 19 to irradiate the keyboard of the keyboard instrument 2 with laser light. Here, laser light emitted from the light source 19 will be described with reference to the drawings. FIG. 3 is a diagram for explaining the laser light emitted from the light source 19. As illustrated, the task presentation device 1 according to the present embodiment is installed on a music stand 21 of a keyboard instrument 2. A light source 19 is provided on the surface of the task presentation device 1 facing the keyboard 22 of the keyboard instrument 2. The light source 19 can change the irradiation direction in a plurality of directions under the control of the light source control unit 18. Specifically, in the example shown in FIG. 3, the light source 19 can switch the irradiation direction in five directions of γ ₁ , γ ₂ , γ ₃ , γ ₄ , and γ ₅ . In other words, in the example shown in FIG. 3, the light source 19 irradiates one of a plurality of keys 221, 222, 223, 224, and 225 constituting the keyboard 22 of the keyboard instrument 2 with laser light. Further, the light source control unit 18 can simultaneously indicate a plurality of keys by continuously switching the irradiation direction of the laser light in those directions every minute unit time. The light source controller 18 presents one or more keys to the performer by controlling the light source 19 and irradiating the laser beam.

  The light source controller 18 receives the reflected light of the laser light emitted from the light source 19 and outputs a signal indicating the amount of the received reflected light. The light source control unit 18 receives direct reflected light or irregularly reflected light from the plurality of keys 221, 222, 223, 224, 225 of the keyboard 22. At this time, the amount of reflected light reaching the light source control unit 18 differs depending on whether or not the performer's finger is placed on the keyboard 22. Therefore, the light source control unit 18 can determine whether or not the player's finger is placed at each position of the plurality of keys according to the amount of reflected light. Further, the volume of the performance sound of the keyboard instrument 2 is detected using the microphone 15 in the task presentation device 1.

  Returning to the description of FIG. As illustrated, the storage unit 12 includes an accompaniment sound data storage area 121, a phrase sound data storage area 122, and a correspondence storage area 123. The accompaniment sound data storage area 121 stores a plurality of types of accompaniment sound data representing accompaniment sounds. Part of this accompaniment sound data has a set of first and second accompaniment sound data having different note arrangements.

  The phrase sound data storage area 122 stores a plurality of phrase sound data indicating a predetermined note arrangement. Here, the phrase sound is musical, such as a melody, chord, or accompaniment. In this embodiment, the length of the phrase sound is preferably 1 to 2 bars. The phrase sound may be a pattern played with the right hand, a pattern played with the left hand, or a pattern played with both hands simultaneously. The phrase sound data stored in the phrase sound data storage area 122 includes first and second phrase sound data corresponding to the first and second accompaniment sound data described above and indicating a predetermined note arrangement. ing.

  The correspondence storage area 123 stores the correspondence between accompaniment sounds and phrase sounds. FIG. 4 is a diagram illustrating an example of the content of data stored in the correspondence storage area 123. In the example shown in FIG. 4, items “accompaniment sound” and “phrase sound” are stored in association with each other in this storage area. Among these items, the “accompaniment sound” item stores an accompaniment sound ID (accompaniment sound identification information) for identifying the accompaniment sound data stored in the accompaniment sound data storage area 121. In the “phrase sound” item, a phrase ID (phrase identification information) for identifying phrase sound data stored in the phrase sound data storage area 122 is stored. In the example shown in FIG. 4, “identification information (ID) of accompaniment sound A” and “identification information (ID) of phrase sound X” are stored in association with each other, and “identification information of accompaniment sound B” “Identification information (ID) of phrase sound Y” is stored in association with each other.

  The phrase sound is a sound that the player is required to perform, and is generally a melody (melody) having a length of 1 to 2 bars. Note that the requested performance sound may not necessarily completely match the phrase sound. In the performance evaluation, the phrase sound becomes reference performance data serving as a reference for performance evaluation, and is compared with the sound actually played by the performer. On the other hand, the accompaniment sound is a sound that is reproduced from the task presentation device 1 as a trigger (cue, hint) of a phrase sound that is required to be played, and an accompaniment.

  Next, an example of a functional configuration of the task presentation device 1 will be described with reference to the drawings. FIG. 5 is a diagram illustrating an example of a functional configuration of the task presentation device 1. In the figure, a task presentation control unit 111, a phrase sound presentation unit 112, an accompaniment sound reproduction unit 113, an operation detection unit 114, and a performance evaluation unit 115 are read out by the control unit 11 from a computer program stored in the ROM or the storage unit 12. It is realized by executing. The arrows in the figure schematically show the relationship between data flow and control.

  In FIG. 5, the task presentation control unit 111 performs task presentation processing according to the operation content of the performer. The phrase sound presentation unit 112 reproduces a musical sound representing a phrase sound under the control of the task presentation control unit 111 and irradiates the keyboard instrument 2 with a laser beam, thereby allowing the player to perform sound and light. Present a phrase sound. That is, the phrase sound presenting unit 112 functions as a phrase sound reproducing unit that reproduces a phrase sound based on the phrase sound data stored in the phrase sound data storage area 122, and performs a performance corresponding to the reproduction of the phrase sound. It functions as a key pressing instruction means for instructing key pressing of the keyboard operated by the user.

  The accompaniment sound reproduction unit 113 reproduces an accompaniment sound based on the accompaniment sound data in the accompaniment sound data storage area 121. More specifically, the accompaniment sound reproduction unit 113 reads accompaniment sound data from the accompaniment sound data storage area 121 and supplies the accompaniment sound data to the audio processing unit 16 in accordance with an instruction from the task presentation control unit 111, and the accompaniment sound from the speaker 17. Let it sound.

  The operation detector 114 detects a performance operation performed by the performer. In this embodiment, the player's performance operation is detected according to the signal output from the light source control unit 18. More specifically, in the operation detection unit 114, when the amount of reflected light received by the light source control unit 18 is equal to or less than a predetermined threshold, the key irradiated with the laser light is pressed. On the other hand, in other cases, it is determined that the key irradiated with the laser light is not depressed. The operation detection unit 114 supplies data indicating the detected performance operation to the performance evaluation unit 115.

  The performance evaluation unit 115 is predetermined as a performance operation detected by the operation detection unit 114 during a predetermined period (hereinafter referred to as “evaluation target period”) during the reproduction of the accompaniment sound by the accompaniment sound reproduction unit 113. The performance operation by the performer is evaluated based on the comparison with the reference performance data (phrase sound data). In this embodiment, the performance evaluation unit 115 compares the performance result of the performer with the phrase sound presented to the performer by the phrase sound presenting unit 112, and evaluates the performance of the performer according to the degree of matching between the two. To do. The performance evaluation unit 115 displays the evaluation result on the display unit 13 and notifies the assignment presentation control unit 111 of the evaluation result.

<A-2: Operation>
Next, the operation of this embodiment will be described. The performer uses the operation unit 14 of the assignment presentation device 1 to perform an operation for performing assignment presentation processing. The operation unit 14 outputs an operation signal corresponding to the operated content. The control unit 11 starts the task presentation process in response to the signal output from the operation unit 14. The assignment presenting apparatus 1 has, as assignments, <1: branching assignment>, <2: Go / NoGo assignment>, <3: combination of branching assignment and Go / NoGo assignment (1)>, <4: branching assignment. , Go / NoGo assignment combination (2)>, <5: Conflict assignment>. The control unit 11 of the assignment presentation device 1 performs a process of selecting one of these five kinds of assignments according to the content operated by the performer and presenting the selected assignment to the performer. .

<A-2-1: Branching issue>
First, a branching assignment presentation process will be described with reference to the drawings. In this branching task, an accompaniment sound and a phrase sound are presented simultaneously as a pair, then only one accompaniment sound is presented, and the performer performs while remembering the corresponding phrase sound according to the accompaniment sound. It is. In this task, the control unit 11 sequentially reproduces the accompaniment sound based on the first and second accompaniment sound data belonging to the same group among the accompaniment sound data stored in the accompaniment sound data storage area 121. Then, the accompaniment sound is reproduced again based on the first accompaniment sound data. Moreover, the control part 11 produces | generates evaluation data by making into the evaluation object period the period which is producing | generating the accompaniment sound signal again based on 1st accompaniment sound data. Further, the control unit 11 reproduces the phrase sound based on the first and second phrase sound data in the phrase sound data storage area 122 in synchronization with the timing of reproducing the first and second accompaniment sound data. When reproducing the accompaniment sound again based on the first accompaniment sound data, the reproduction of the phrase sound is stopped.

  FIG. 6 is a diagram illustrating an example of accompaniment sounds reproduced by the task presentation device 1 and phrase sounds presented by the task presentation device 1. In the figure, the horizontal axis indicates time. In FIG. 6, (a) schematically shows the accompaniment sound to be reproduced, (b) schematically shows the phrase sound to be presented, and (c) shows a request from the performer. The performance sound to be played is schematically shown. When the branching task is selected, the control unit 11 first emits the accompaniment sound A and presents the phrase sound X (see times t0 to t1 in FIG. 6). More specifically, the control unit 11 reads out data representing the accompaniment sound A (hereinafter, “accompaniment sound data DA”) from the accompaniment sound data storage area 121 and emits it as a sound from the speaker 17, and also stores phrase sound data. Data representing the phrase sound X (hereinafter, “phrase sound data DX”) is read from the region 122 and emitted from the speaker 17 as sound, and the light source control unit 18 is controlled to present the phrase sound X on the keyboard 22.

  Next, the control unit 11 emits the accompaniment sound B and presents the phrase sound Y (see times t1 to t2 in FIG. 6). More specifically, the control unit 11 reads out data representing the accompaniment sound B (hereinafter referred to as “accompaniment sound data DB”) from the accompaniment sound data storage area 121 and emits it as a sound from the speaker 17, and also stores phrase sound data. Data representing the phrase sound Y (hereinafter, “phrase sound data DY”) is read from the region 122 and emitted from the speaker 17 as sound, and the light source control unit 18 is controlled to present the phrase sound Y on the keyboard 22.

  Next, the control unit 11 emits the accompaniment sound A (see times t2 to t3 in FIG. 6). That is, the control unit 11 reads the accompaniment sound data DA from the accompaniment sound data storage area 121 and supplies the accompaniment sound data DA to the sound processing unit 16, and causes the speaker 17 to emit the accompaniment sound A. During this period, the control unit 11 does not perform the phrase sound presentation process. The performer is requested to play the phrase sound X using the keyboard instrument 2 in accordance with the accompaniment sound A emitted from the task presentation device 1 (time t2 to t3 in FIG. 6).

  The control unit 11 detects the performance operation of the keyboard instrument 2 by the performer according to the reflected light of the laser light irradiated on the keyboard instrument 2. The control unit 11 compares the detection result with the phrase sound X stored in the phrase sound data storage area 122, and evaluates the performance of the performer according to the degree of matching between the two. As a specific example of the evaluation performed by the control unit 11, for example, the brain age of the subject may be calculated numerically according to a predetermined algorithm according to the degree of matching between the phrase sound and the detection result. Further, as another example, for example, the control unit 11 may perform a personality analysis (such as decoy, quick and dust) according to a predetermined algorithm. Further, for example, the control unit 11 may compare the result of the personality analysis with a musician according to a predetermined algorithm.

  As a specific aspect of the evaluation process according to the matching degree between the phrase sound and the detection result, for example, the evaluation process may be performed according to the matching degree of the pitch or timing (rhythm). Moreover, you may make it evaluate the finger usage of a keyboard musical instrument as a pitch. When an electronic musical instrument is used as the keyboard instrument, the electronic musical instrument may measure the strength (velocity) of key depression, and the evaluation may be performed according to the measurement result. In this way, as the degree of matching, any physical quantity that can be measured may be used. Thereby, the brain age (level) and musical ability are evaluated and calculated by a predetermined algorithm.

  Further, the control unit 11 may perform musical evaluation. Specifically, for example, the memory of phrase sounds, the ability to listen to phrases, the ability to listen to chords, the sense of rhythm, and the like may be output numerically according to a predetermined algorithm. In addition, depending on the evaluation results of a plurality of tasks, those that are good / not good may be displayed.

  When the degree of matching between the detection result and the phrase sound X satisfies a predetermined condition, the control unit 11 determines that the phrase sound X is correct and uses the next phrase sounds Z and W again to perform a task. The presentation process is executed (see times t3 to t5 in FIG. 6). That is, the control unit 11 determines that the phrase sound X is correct when the degree of whether or not the player has played the phrase sound X is equal to or higher than a predetermined level. On the other hand, if the answer is incorrect, the control unit 11 executes the task presentation process again using the phrase sounds A and B.

<A-2-2: Go / NoGo assignment>
Next, the Go / NoGo assignment presented by the assignment presentation apparatus 1 will be described. In the task presentation process, the accompaniment sounds A and B are used, and the task presentation process is performed using the phrase sound X. Here, as the accompaniment sounds A and B, those which are connected with musical progress are used. The phrase sound X is musically matched to the accompaniment sound A. Also, the accompaniment sounds A and B are not similar to each other.

  The control unit 11 instructs the performer not to play the phrase sound X when the accompaniment sound A is reproduced and to play the phrase sound X when the accompaniment sound B is reproduced. As an aspect of this control, for example, while the control unit 11 reproduces the accompaniment sound A and the phrase sound X, “when the accompaniment sound A flows, the phrase sound X is played, and when the accompaniment sound B flows, the phrase A message such as “Please do not play the sound X” may be output. Note that the control unit 11 may present the phrase sound X to the performer in advance on a musical score or the like without reproducing the phrase sound X.

  Next, the control unit 11 reproduces the accompaniment sound A and the accompaniment sound B in random order. That is, the control unit 11 reads the accompaniment sound data DA and the accompaniment sound data DB from the accompaniment sound data storage area 121 in a random order, and supplies the read data to the sound processing unit 16, whereby the accompaniment sound A and the accompaniment sound are stored. Sound B is randomly emitted from the speaker 17.

  When the accompaniment sound A is reproduced while listening to the accompaniment sound emitted from the task presentation device 1, the performer plays the phrase sound X. On the other hand, the performer does not play the phrase sound X when the accompaniment sound B is emitted.

  The control unit 11 detects the performance state of the keyboard instrument 2 by the performer according to the reflected light of the laser light irradiated on the keyboard instrument 2. The control unit 11 compares the detection result with the phrase sound X stored in the phrase sound data storage area 122, and evaluates the performance of the performer according to the degree of matching between the two. This evaluation process is the same as the content of the evaluation process shown in the branching task process described above, and a detailed description thereof is omitted here. When the comparison result between the detection result and the phrase sound X satisfies a predetermined condition, the control unit 11 determines that the phrase sound X is correct and uses the next phrase sounds C and D again. The assignment presentation process is executed.

  In the Go / NoGo task, the reverse task (that is, the phrase sound X is not played when the accompaniment sound A is played, while the phrase sound X is played when the accompaniment sound B is played). May also be performed. In addition, a reverse rotation problem is being performed while the above-described problem (playing phrase sound X when accompaniment sound A is played, but not playing phrase sound X when accompaniment sound B is played) is performed. You may make it switch to. Moreover, you may make it present the above-mentioned subject and the subject of reverse rotation mixed.

<A-2-3: Combination of branching task and Go / NoGo task (1)>
Next, the combination task (1) of the branching task and the Go / NoGo task will be described with reference to FIG. In this task, the control unit 11 selects the phrase sound data stored in the phrase sound data storage area 122, reproduces the phrase sound based on each selected phrase sound data, and after reproducing one phrase sound. After a standby time of a predetermined time (twice in this embodiment) of the reproduction time of the phrase sound, the next phrase sound is selected and reproduced. Further, the control unit 11 sets a part of the waiting time from the reproduction of one phrase sound to the reproduction of the next phrase sound (the second half period in this embodiment) as the evaluation target period.

  FIG. 7 is a diagram illustrating an example of an accompaniment sound reproduced by the task presentation device 1 and a phrase sound presented by the task presentation device 1 in this task. In the figure, (a) schematically shows the accompaniment sound to be reproduced, (b) schematically shows the phrase sound to be presented, and (c) shows a request from the performer. The performance sound is shown schematically. First, the control unit 11 reproduces the accompaniment sound and presents the phrase sound with sound and light in accordance with the reproduction of the accompaniment sound (see times t0 to t1 in FIG. 7).

  Next, the control unit 11 provides a waiting time having the same length as the time length of the phrase sound while the accompaniment sound is reproduced (see times t1 to t2 in FIG. 7). At this time, as an instruction not to play the phrase sound, the control unit 11 controls the light source control unit 18 to light all the keys.

  When the waiting time is over, the performer performs in accordance with the accompaniment sound while remembering the phrase sound presented at time t0 to t1 (see times t2 to t3 in FIG. 7).

  The control unit 11 repeatedly executes the processes at times t0 to t3 with different phrase sounds to be presented (FIG. 7 and after t3). At this time (between times t0 and t3), the same accompaniment sounds to be reproduced are all used (that is, the same accompaniment sounds are repeatedly reproduced in the periods t0 to t1, t1 to t2, and t2 to t3). Also, different phrase sounds may be presented for each of a plurality of tests.

  The control unit 11 detects the performance state of the keyboard instrument 2 by the performer according to the reflected light of the laser light irradiated on the keyboard instrument 2. The control unit 11 compares the detection result with the presented phrase sound, and evaluates the performance of the performer according to the comparison result. This evaluation process is the same as the evaluation process in the other problems described above, and detailed description thereof is omitted here. When the degree of matching between the detection result and the phrase sound satisfies a predetermined condition, the control unit 11 determines that the phrase sound is correct.

<A-2-4: Combination of branching issue and Go / NoGo issue (2)>
Next, the combination task (2) of the branching task and the Go / NoGo task will be described with reference to FIG. In FIG. 8, (a) schematically shows the accompaniment sound to be reproduced, (b) schematically shows the phrase sound to be presented, and (c) shows the request from the performer. The performance sound to be played is schematically shown.

  Prior to presenting this assignment, the performer has to learn one phrase sound in advance. For example, the phrase sound may be presented together with a message such as “Please remember the phrase sound to be presented” before starting to play the accompaniment sound. Instead of reproducing the phrase sound X that the controller 11 learns from the performer, the phrase sound may be presented to the performer in advance on a musical score or the like.

  First, the control unit 11 reproduces an accompaniment sound. In addition, the control unit 11 emits the entire keyboard where the player does not want to play the phrase sound, but does not emit the keyboard where the player does not want the phrase sound to be played. That is, the control unit 11 functions as timing notification means for notifying the performer of the evaluation target period (a predetermined period).

  The performer plays the phrase that was remembered when the keyboard was not lit. Specifically, for example, in the example shown in FIG. 8, the performer does not play the phrase sound at time t0 to t1 and time t2 to t3, and the phrase at time t1 to t2 and time t3 to t4. Play a sound.

  The control unit 11 detects the performance state of the keyboard instrument 2 by the performer according to the reflected light of the laser light irradiated on the keyboard instrument 2. The control unit 11 compares the detection result with the presented phrase sound, and evaluates the performance of the performer according to the comparison result. When the comparison result between the detection result and the phrase sound satisfies a predetermined condition, the control unit 11 determines that the phrase sound is correct.

<A-2-5: Conflict issues>
Next, the conflict problem presented by the problem presentation device 1 will be described with reference to FIG. 9A shows accompaniment sounds to be reproduced, FIG. 9B shows phrase sounds to be presented, and FIG. 9C schematically shows performance sounds required by the performer. In this task presentation process, accompaniment sounds A and B and phrase sounds X and Y are used. The accompaniment sounds A and B are preferably connected continuously. Moreover, it is preferable that the phrase sounds X and Y are composed of sounds that are adapted to the chords of the accompaniment sounds and have a melody progression that harmonizes with the chord progression of the accompaniment sounds, as in the case described above.

  First, prior to performing the task presentation process, the control unit 11 teaches the player to play the phrase sound X when the accompaniment sound A flows and to play the phrase sound Y when the accompaniment sound B flows. . As a mode of this instruction, for example, the control unit 11 outputs a message such as “Please play this phrase sound when this accompaniment sound flows” while reproducing the accompaniment sound A and the phrase sound X. It may be. Instead of reproducing the phrase sound X and the phrase sound Y, the control unit 11 may present the phrase sound X and the phrase sound Y to the performer in advance on a musical score or the like.

  The control unit 11 reproduces the accompaniment sound A and the accompaniment sound B in random order. That is, the control unit 11 reads the accompaniment sound data DA and the accompaniment sound data DB from the accompaniment sound data storage area 121 in a random order, and supplies the read data to the sound processing unit 16, whereby the accompaniment sound A and the accompaniment sound A Sound B is emitted from the speaker 17 at random. In the example shown in FIG. 9, the control unit 11 reproduces the accompaniment sound A, the accompaniment sound B, the accompaniment sound B, and the accompaniment sound A in the order (see times t0 to t4 in FIG. 9).

  The performer plays the phrase sound X when the accompaniment sound A is reproduced while listening to the accompaniment sound emitted from the task presentation device 1, while the phrase sound when the accompaniment sound B is emitted. Play Y.

  The control unit 11 detects the performance state of the keyboard instrument 2 by the performer according to the reflected light of the laser light irradiated on the keyboard instrument 2. The control unit 11 compares the detection result with the phrase sound X stored in the phrase sound data storage area 122, and evaluates the performance of the performer according to the comparison result. As an evaluation, whether the subject was responding to the accompaniment sounds A and B, whether or not there was a response, whether the response was correct, whether the rhythms / sounds of the phrase sounds X and Y were correct, whether they matched the accompaniment sound, etc. evaluate. When the comparison result between the detection result and the phrase sound X satisfies a predetermined condition, the control unit 11 determines that the phrase sound X is correct and uses the next phrase sounds C and D again. The assignment presentation process is executed.

  In addition, in this conflict task, the reversal task (that is, the phrase sound Y is played when the accompaniment sound A is played, while the phrase sound X is played when the accompaniment sound B is played). You may make it perform.

  As described above, according to the present embodiment, activation of brain functions, personality analysis, music training, and the like can be performed using a keyboard instrument. Specifically, for example, when the task presentation device 1 is used alone, the brain function can be activated, and personality analysis and music training can be performed. Moreover, when using the subject presentation apparatus 1 by multiple persons, it can enjoy, competing via the same place or the net | network.

  Further, according to the present embodiment, even when using an electronic musical instrument or a live musical instrument in which the keyboard does not shine, the key to be pressed by irradiating the keyboard with a laser beam is notified, so where to press. Can be presented to the user in real time.

<B: Second Embodiment>
Next explained is the second embodiment of the invention. FIG. 10 is a view showing an example of the appearance of the electronic musical instrument 3 according to the second embodiment of the present invention. In the figure, an electronic musical instrument 3 is a musical instrument having a keyboard, for example, an electronic piano. The keys 321, 322,... Constituting the keyboard 32 of the electronic musical instrument 3 are provided with light sources 391, 392,. In the following description, for convenience of description, when it is not necessary to distinguish the light sources 391, 392,..., These will be referred to as “light sources 39”.

  FIG. 11 is a diagram illustrating an example of a hardware configuration of the electronic musical instrument 3. In FIG. 11, the control unit 31 includes a CPU, a ROM, and a RAM, and controls each unit of the electronic musical instrument 3 via the bus by reading and executing a computer program stored in the ROM or the storage unit 32. The storage unit 32 is a storage unit for storing a computer program executed by the control unit 31 and data used at the time of execution, and is, for example, a hard disk device. The operation unit 14 outputs a signal corresponding to an operation by the player of the electronic musical instrument 3.

  The microphone 35 is a sound collecting unit that collects sound and outputs an analog signal representing the collected sound. The audio processing unit 36 A / D converts the analog signal output from the microphone 35 to generate digital data. In addition, under the control of the control unit 31, the audio processing unit 36 D / A converts digital audio data to generate an analog signal, and outputs the generated audio signal to the speaker 37. The speaker 37 is a sound emitting unit that emits sound with an intensity corresponding to the analog signal supplied from the sound processing unit 36.

  The light source 39 is, for example, an LED, and is provided for each key constituting the keyboard of the electronic musical instrument 3. The light source control unit 38 turns on the light source 39. The control unit 31 of the electronic musical instrument 3 controls the light source control unit 38 to turn on the light source provided for each key. The key press detection unit 40 detects a key press operation by the performer and outputs a signal indicating the detection result.

  As illustrated, the storage unit 32 includes an accompaniment sound data storage area 321, a phrase sound data storage area 322, and a correspondence storage area 323. The storage contents of the accompaniment sound data storage area 321, the phrase sound data storage area 322, and the correspondence relation storage area 323 are the accompaniment sound data storage area 121 and the phrase sound data storage area of the task presentation device 1 in the first embodiment described above. 122 and the correspondence storage area 123 are the same as the stored contents, and detailed description thereof is omitted here.

  Next, an example of a functional configuration of the electronic musical instrument 3 will be described with reference to the drawings. FIG. 12 is a diagram illustrating an example of a functional configuration of the electronic musical instrument 3. In the figure, an assignment presentation control unit 311, a phrase sound presentation unit 312, an accompaniment sound reproduction unit 313, and a performance evaluation unit 315 are realized by the control unit 31 reading and executing a computer program stored in the ROM or the storage unit 32. Is done. The arrows in the figure schematically show the flow of data. In FIG. 12, the processing performed by each of the task presentation control unit 311, the accompaniment sound reproduction unit 313, and the performance evaluation unit 315 includes the task presentation control unit 111, the accompaniment sound reproduction unit 113, and the performance shown in the first embodiment described above. This is the same as the processing performed by each of the evaluation units 115, and detailed description thereof is omitted here.

  The phrase sound presentation unit 312 reproduces a musical tone representing the phrase sound under the control of the task presentation control unit 311 and controls the light source control unit 38 to turn on the light source. Present a phrase sound.

  Next, the operation of this embodiment will be described. The performer of the electronic musical instrument 3 uses the operation unit 34 of the electronic musical instrument 3 to perform an operation for performing the task presentation process. The operation unit 34 outputs an operation signal corresponding to the operated content. The control unit 31 starts the task presentation process according to the signal output from the operation unit 34. The electronic musical instrument 3 has <1: branching task>, <2: Go / NoGo task>, <3: combination of branching task, Go / NoGo task (1)>, <4: branching task, Go / NoGo assignment combination (2)>, <5: Conflict assignment> 5 types of assignments are presented. The electronic musical instrument 3 selects one of these five types of tasks according to the content operated by the performer, and performs a process of presenting the selected task to the performer. The contents of these five types of problems are the same as those shown in the first embodiment described above, and a detailed description thereof is omitted here.

  The difference between the operation performed by the problem presentation device 1 in the first embodiment described above and the operation of the electronic musical instrument 3 in this embodiment is that the contents of the phrase sound presentation processing and the key press detection processing are different. This process is the same as that of the above-described embodiment. As for the phrase sound presentation process, the control unit 31 of the electronic musical instrument 3 presents the phrase sound to the performer with light by turning on the light source 39 provided for each key constituting the keyboard 32 as described above. To do. Regarding the key pressing detection process, the control unit 31 of the electronic musical instrument 3 detects the presence or intensity (velocity) of the key pressing by the player according to the signal output from the key pressing detection unit 40.

  In this embodiment, similarly to the first embodiment described above, activation of the brain function, personality analysis, music training, and the like can be performed using a keyboard instrument. Specifically, for example, when the electronic musical instrument 3 is used alone, the brain function can be activated, and personality analysis and music training can be performed. Further, when the electronic musical instrument 3 is used by a plurality of people, it can be enjoyed while competing through the same place or the net.

<C: Modification>
As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above, It can implement with another various form. An example is shown below. In addition, you may combine each following aspect suitably.
(1) In the first embodiment described above, the task presentation device 1 may automatically detect the keyboard layout. In this case, the control unit 11 detects irregularities on the keyboard according to the reflected light of the laser light emitted from the task presentation device 1, and specifies the key arrangement based on the detection result. The control unit 11 controls the irradiation direction of the laser light based on the specified key arrangement.
The key arrangement detection mode is not limited to this. For example, the task presentation device 1 includes a photographing unit that captures an image, and the control unit 11 recognizes an image captured by the photographing unit. The key arrangement may be detected by the following. In this case, the photographing unit may be built in the problem presentation device 1 or may be configured to have an imaging unit externally attached to the problem presentation device 1.

(2) In the first or second embodiment described above, the control unit 11 may display a finger number. In this case, for example, when irradiating the keyboard with laser light, the control unit 11 may control the laser light to irradiate and display an image representing a finger number on the keyboard. When an electronic musical instrument having a light source such as an LED is used as a key, a light source for displaying a finger number may be provided on each key, and the finger number may be displayed by controlling each light source. By doing so, the performer can also grasp the fingering of the performance.

(3) In the first embodiment described above, the task presentation device 1 may be a dedicated device, and may be, for example, a mobile phone terminal, a portable game machine, or the like. In the first embodiment described above, an acoustic piano is used as the keyboard instrument 2, but the keyboard instrument 2 is not limited to this, and an electronic piano, for example, may be used.

(4) In the first embodiment described above, the laser light is irradiated to the plurality of keys by using a single light source to change the irradiation direction of the laser light to the plurality of keys. However, the present invention is not limited to this, and the problem presentation device 1 may have a light source for each key.

(5) In the first and second embodiments described above, a plurality of different accompaniment sounds are reproduced in the branching task, the Go / NoGo task, and the combination task (1) of the branching task and the Go / NoGo task. Thus, the player is notified of the timing to perform and the timing to not perform. Further, in the combination task (2) of the branching task and the Go / NoGo task, the player is notified of the timing at which the performance is to be performed and the timing at which the performance is not performed, depending on the laser light irradiation mode on the keyboard. The manner of notifying the timing of performance is not limited to this. For example, the timing of performance may be notified by displaying an image on a display and changing the image in time series. Further, for example, the task presentation device 1 may include a mechanism that vibrates the device itself, and the performance timing may be notified by changing the vibration mode in time series. In short, the control unit 11 of the task presentation device 1 may notify the timing of performance by changing at least one of sound, light, video, and vibration in time series.

(6) In the first embodiment described above, it is determined whether or not the performer's finger is placed at each position of the plurality of keys according to the amount of reflected light received by the light source control unit 18. The method for determining whether or not the key is depressed is not limited to this, and the key depression may be detected by another method. For example, when an electronic piano provided with a key pressing sensor for detecting key pressing is used, presence / absence of key pressing may be detected according to an output signal of the key pressing sensor.

  Alternatively, the performance sound may be collected by a microphone (sound collection means), and the performance operation may be detected by the control unit 11 analyzing the collected performance sound. In this case, for example, the control unit 11 may detect the pitch from the audio signal output from the microphone, and determine which key is pressed based on the detected pitch.

(7) In the first embodiment described above, the task presentation device 1 reproduces the accompaniment sound. However, instead of presenting the accompaniment sound, the task presentation device 1 turns on the light source, for example. You may make it alert | report a tempo. Further, for example, the problem presentation device 1 may be provided with a mechanism for vibrating the device itself, and the tempo may be notified by vibrating the device at predetermined timings by the mechanism. In short, the task presentation device 1 stores timing data representing the tempo in a predetermined storage area in advance, and the control unit 11 of the task presentation device 1 performs sound, light, vibration based on the stored timing data. The tempo may be notified to the performer by a video or the like.

  As described above, the data used as timing data representing the tempo may be accompaniment sound data representing accompaniment sounds, or may be data representing simple rhythms played by percussion instruments. Any data may be used as long as it is used to notify the player of the tempo by vibration, video, or the like. The corresponding phrase sound (to be answered by the performer) is the same, and a phrase sound representing a rhythm may be used.

(8) In the first embodiment described above, in the Go / NoGo task, the accompaniment sounds A and B that are not similar to each other are used. An accompaniment sound or a dissimilar accompaniment sound may be used. That is, the similarity between the accompaniment sounds A and B may be varied according to the level. In this case, the more difficult the accompaniment sounds, the higher the difficulty of the task.

(9) In the first embodiment described above, in the combination task of the branching task and the Go / NoGo task, a standby time that is twice the playback time of the phrase sound is given after the playback of one phrase sound. The time length of the standby time is not limited to this. For example, the time length of the standby time may be varied according to the level. Specifically, for example, when the difficulty level is low, the standby time is not set, while when the difficulty level is medium, the standby time is shortened, and when the difficulty level is high, the standby time is increased. It may be.

(10) In the above embodiment, an acoustic piano or an electronic piano is used as a musical instrument played by the performer. However, the musical instrument played by the performer is not limited to these, and other keyboard instruments such as an electric tone and an organ, for example. It may be. The musical instrument played by the performer is not limited to a keyboard musical instrument, and may be another musical instrument. In short, the task presentation device 1 only needs to have a mechanism for detecting the performance operation of the performer in accordance with an output signal from a sensor provided on an operator of the musical instrument or the like.

(11) In the first embodiment described above, the keyboard is operated by the player by irradiating the keyboard with laser light. However, the keyboard is operated by the player. The aspect is not limited to this, and may be another aspect. For example, the control unit 11 may display an image indicating that the key pressing of the keyboard is instructed on the display unit 13 of the assignment presentation device 1. In short, the control unit 11 is accompanied by the reproduction of the phrase sound. Any key can be used as long as it indicates the key depression of the keyboard operated by the performer.

DESCRIPTION OF SYMBOLS 1 ... Problem presentation apparatus, 2 ... Keyboard instrument, 21 ... Music stand, 11 ... Control part, 12 ... Memory | storage part, 13 ... Display part, 14 ... Operation part, 15 ... Microphone, 16 ... Sound processing part, 17 ... Speaker.
3

Claims (7)

Accompaniment sound data storage means for storing accompaniment sound data including timing data representing the tempo;
Tempo notifying means for notifying the tempo based on timing data in the accompaniment sound data storing means;
A performance operation detecting means for detecting a performance operation of the performer;
Evaluation means for evaluating a performance operation based on a comparison between a performance operation detected by the performance operation detection means and predetermined reference performance data during a predetermined period during tempo notification by the tempo notification means; A performance operation evaluation apparatus comprising: The timing data is accompaniment sound data representing an accompaniment sound,
The accompaniment sound data storage means stores a set of a plurality of accompaniment sound data having different note arrangements,
The tempo notification means sequentially reproduces accompaniment sounds based on a plurality of accompaniment sound data belonging to the same set, and then reproduces accompaniment sounds again based on predetermined accompaniment sound data of the plurality of accompaniment sound data,
2. The evaluation unit according to claim 1, wherein the evaluation unit performs the evaluation with the period during which the tempo notification unit reproduces the accompaniment sound data based on the predetermined accompaniment sound data as the predetermined period. Performance operation evaluation device. The timing data is accompaniment sound data representing an accompaniment sound,
The accompaniment sound data storage means stores a plurality of accompaniment sound data having different note arrangements,
The tempo notification means sequentially reproduces accompaniment sounds based on a plurality of accompaniment sound data stored in the accompaniment sound data storage means,
The evaluation means performs the evaluation by setting the period during which the tempo notification means is reproducing accompaniment sound data based on predetermined accompaniment sound data of the plurality of accompaniment sound data as the predetermined period. The performance operation evaluation device according to claim 1, wherein The timing data is accompaniment sound data representing an accompaniment sound,
The tempo notification means reproduces an accompaniment sound based on the accompaniment sound data in the accompaniment sound data storage means,
Phrase sound data storage means for storing a plurality of phrase sound data representing a predetermined note arrangement;
Phrase reproduction means for selecting phrase sound data in the phrase sound data storage means, reproducing the phrase sound based on each selected phrase sound data, and the reproduction time of the phrase sound after reproduction of one phrase sound A phrase sound reproducing means for selecting and reproducing the next phrase sound after a predetermined waiting time of
The evaluation means sets a predetermined period of the waiting time from when the phrase sound reproducing means reproduces the one phrase sound to when the next phrase sound is reproduced as the predetermined period. The performance operation evaluation device according to claim 1. The timing data is accompaniment sound data representing an accompaniment sound,
The tempo notification means reproduces an accompaniment sound based on the accompaniment sound data in the accompaniment sound data storage means,
A performance timing notifying means for notifying the performer of the performance timing;
The performance evaluation device according to claim 1, wherein the evaluation unit performs the evaluation by setting a period during which the performance timing is notified by the performance timing notification unit as the predetermined period. The timing data is accompaniment sound data representing an accompaniment sound,
The accompaniment sound data storage means stores a set of a plurality of accompaniment sound data having different note arrangements,
The tempo notification means sequentially reproduces accompaniment sounds based on a plurality of accompaniment sound data belonging to the same set,
Phrase sound data storage means for storing a plurality of phrase sound data corresponding to each of the plurality of accompaniment sound data and indicating a predetermined note arrangement;
The performance operation evaluation apparatus according to claim 1, wherein the evaluation unit performs the evaluation using phrase sound data corresponding to accompaniment sound data reproduced by the tempo notification unit as the reference performance data. In a computer comprising accompaniment sound data storage means for storing accompaniment sound data including timing data representing tempo,
Informing the tempo based on the timing data in the accompaniment sound data storage means;
Detecting a player's performance operation;
A program for executing a step of evaluating a performance operation based on a comparison between the detected performance operation and predetermined reference performance data during a predetermined period during the tempo notification.

Images