JP5402253B2 - Operation evaluation apparatus and program - Google Patents

Description

  The present invention relates to an operation evaluation apparatus and a program.

  In recent years, an apparatus has been proposed in which an LED is provided on a keyboard and the keyboard is illuminated to instruct key depression (see, for example, Patent Documents 1 and 2). In addition, a device for playing a game or training a moving visual acuity using a musical instrument having an LED provided on a keyboard has been proposed (see, for example, Patent Document 3). In recent years, an apparatus for presenting a graphic problem and measuring a brain function has been proposed (see, for example, Patent Documents 4 and 5).

Japanese Patent Application Laid-Open No. 06-066763 JP-A-10-222160 JP 2006-158955 A JP 2006-158421 A JP 2006-158944 A

By the way, in the conventional method for measuring brain function, a person remembers and presents a pattern, presents a subject to a subject, and the person judges the result, so the measurement result can be calculated numerically. could not. Also, the guide on the keyboard often prompts to play the keyboard at the same time as it is presented, and it was difficult for an unfamiliar person to keep up with the guide, so the user could not practice happily, In addition, the measurement result could not be calculated numerically.
The present invention has been made in view of the above-described background, and an object of the present invention is to provide a technique that can easily perform brain function measurement and brain function activation as compared with the related art.

In order to solve the above problems, the present invention provides a timing data storage means for storing a plurality of timing data for informing a user's operation timing by a rhythm pattern composed of a plurality of sounds, and the timing data storage means after the sequential operation timing of the user based on the stored plurality of timing data it has been notified by the rhythm pattern, the operation timing of the user based on a predetermined timing data among again the plurality of timing data in the rhythm pattern An operation timing notifying means for notifying, an operator that can be moved by being gripped or attached to the user, a motion of the operator that is provided on the operator, and detecting the movement of the operator, and based on the detection result, the user a movement detecting means for detecting the operation to store a correspondence relationship between the operating mode of the user and the timing data A correspondence relation storage unit, the operation mode of the user corresponding to the reference timing data by the operation timing notification means, said specified by referring to the correspondence relationship storage means, the operation timing by the operation timing notification means Evaluation means for evaluating the user's operation based on a comparison between the specified user's operation mode and each of the plurality of operations detected by the operation detection unit in a predetermined period after the notification. Provided is an operation evaluation apparatus characterized by comprising.

The present invention also provides timing data storage means for storing a plurality of timing data for informing a user's operation timing with a rhythm pattern composed of a plurality of sounds, and a plurality of timing data storage means stored in the timing data storage means . Operation timing notifying means for selecting timing data in a random order, and notifying the user's operation timing in a rhythm pattern in a rhythm pattern; an operator that can be held or moved by the user; and the operator And detecting a movement of the operation element, and detecting a movement of the user based on the detection result, and storing a correspondence relationship between the timing data and the movement mode of the user. The operation mode of the user corresponding to the timing data referred to by the correspondence relationship storage unit and the operation timing notification unit is Identified by referring to the response relationship storage means, in a period in which the operation timing is predetermined from being broadcast by the operation timing notification means, a plurality of the specified user of the operation mode and the operation detecting unit detects There is provided an operation evaluation apparatus comprising evaluation means for evaluating the user's operation based on a comparison with each of the operations.

  According to the present invention, measurement of brain function and activation of brain function can be performed more easily than in the past.

It is a figure which shows an example of a structure of a subject presentation system. It is a figure which shows an example of the external appearance of an operating device. It is a block diagram which shows an example of the hardware constitutions of an operating device. It is a block diagram which shows an example of the hardware constitutions of a subject presentation apparatus. It is a figure which shows an example of the content of the data memorize | stored in the correspondence storage area. It is a block diagram which shows an example of a functional structure of a subject presentation apparatus. It is a sequence diagram which shows the flow of a task presentation process. It is a sequence diagram which shows the flow of a task presentation process. It is a sequence diagram which shows the flow of a task presentation process. It is a sequence diagram which shows the flow of a task presentation process. It is a figure which shows an example of the content of a scale name corresponding | compatible table.

<A: Configuration>
FIG. 1 is a diagram showing an example of the configuration of a problem presentation system according to an embodiment of the present invention. In the figure, a task presentation device 1 is a device that presents a task for measurement of brain function or activation of brain function to a user or evaluates a user's reaction. The operation device 2 is a device that is mounted on a user and is movable, and is a device that detects a user's operation.

  FIG. 2 is a diagram illustrating an example of the appearance of the controller device 2. As shown in the figure, the housing 2a of the controller device 2 has a substantially rectangular parallelepiped shape, and is used by being worn (or grasped) by a user. The internal configuration of the controller device 2 will be described with reference to FIG. In the controller device 2, the control unit 20, the acceleration sensor 21, and the transmission unit 22 are connected by a bus, and their configurations are housed in a housing 2 a shown in FIG. 2.

  The acceleration sensor 21 is a triaxial acceleration sensor. That is, the acceleration sensor 21 includes three sensors (hereinafter referred to as Sx, Sy, and Sz) for detecting axial acceleration, and the axes of the sensors are represented by x, y shown in FIG. The z-axis direction is provided. In this embodiment, as shown in FIG. 2, the longitudinal direction of the operating device 2 is defined as the x axis, the vertical direction in the figure is defined as the z axis, and the direction perpendicular to the x axis and the z axis is defined as the y axis. Each sensor Sx, Sy, Sz detects the positive and negative accelerations (represented as ax, ay, az, respectively) about the x, y, z axes shown in FIG. Generate and output numerical data representing acceleration. Hereinafter, the numerical data indicating the acceleration will be referred to as “acceleration data”. In the following, when specifically indicating the contents of the data, the values of acceleration in the directions of the x, y, and z axes are used to indicate (ax , Ay, az).

  The control unit 20 includes a central processing unit (CPU), a read only memory (ROM), and a random access memory (RAM). The CPU executes a control program stored in the ROM using the RAM as a working area. The transmission unit 22 outputs the acceleration data generated by the acceleration sensor 21 to the task presentation device 1 as a radio signal such as a radio wave every predetermined time (5 milliseconds in the present embodiment).

  Next, the configuration of the problem presentation device 1 will be described with reference to the drawings. FIG. 4 is a diagram illustrating an example of a hardware configuration of the task presentation device 1. In the figure, the control unit 11 includes a CPU, a ROM, and a RAM, and controls each unit of the task presentation device 1 through a bus by reading and executing a computer program stored in the ROM or the storage unit 12. The storage unit 12 is a storage unit for storing a computer program executed by the control unit 11 and data used at the time of execution, and is, for example, a hard disk device. The display unit 13 includes a liquid crystal panel and the like, and displays various images under the control of the control unit 11. The operation unit 14 includes various operators that can be operated by the user of the task presentation device 1 and outputs a signal corresponding to the operation.

  The microphone 15 is a sound collection unit that collects a nearby sound and outputs an analog signal representing the collected sound. The sound processing unit 16 A / D converts the analog signal output from the microphone 15 to generate digital data. In addition, under the control of the control unit 11, the audio processing unit 16 D / A converts digital audio data to generate an analog signal, and outputs the generated audio signal to the speaker 17. The speaker 17 is a sound emitting unit that emits sound with an intensity corresponding to the analog signal supplied from the sound processing unit 16. The receiving unit 18 receives a radio signal transmitted from the controller device 2 and outputs data represented by the received radio signal to the control unit 11.

  In this embodiment, the case where the microphone 15 and the speaker 17 are included in the task presentation device 1 will be described. However, the audio processing unit 16 is provided with an input terminal and an output terminal, and the input terminal is connected via an audio cable. An external microphone may be connected, and similarly, an external speaker may be connected to the output terminal via an audio cable. In this embodiment, the case where the audio signal input from the microphone 15 to the audio processing unit 16 and the audio signal output from the audio processing unit 16 to the speaker 17 are analog audio signals will be described. You may make it input / output. In such a case, the audio processing unit 16 does not need to perform A / D conversion or D / A conversion. The same applies to the display unit 13 and the operation unit 14, and may be configured to be built in the problem presentation device 1 or may be configured to be externally attached.

  The storage unit 12 includes a presentation sound data storage area 121 and a correspondence relation storage area 122 as illustrated. The presentation sound data storage area 121 stores a plurality of sound data (hereinafter referred to as “presentation sound data”) representing a sound presenting the user's operation timing (hereinafter referred to as “presentation sound”). This presentation sound data may be data representing a single sound, or data representing a phrase composed of a plurality of sounds. The presentation sound data may be rhythm pattern data representing a sound rhythm pattern. This presentation sound data is used as timing data for notifying the operation timing of the user. Moreover, a part of this presentation sound data has a set of first and second presentation sound data representing different sounds.

  The correspondence relationship storage area 122 stores the correspondence relationship between the presentation sound data and the operation mode of the user. FIG. 5 is a diagram illustrating an example of the content of data stored in the correspondence storage area 122. In the example shown in FIG. 5, the items “presentation sound” and “motion” are stored in association with each other in this storage area. Among these items, in the “presentation sound” item, a presentation sound ID (accompaniment sound identification information) for identifying presentation sound data stored in the presentation sound data storage area 121 is stored. In the “operation” item, data representing the content (operation mode) of the user's operation (hereinafter referred to as “reference data”) is stored. The correspondence relationship between the specific presentation sound data and the operation mode of the user is exemplified as follows. For example, in <B-1: Go / NoGo assignment> to be described later, in the “formation experiment assignment”, the operation corresponding to the presentation sound 1 is an action that swings the controller device 2, and in the “differentiation experiment assignment”, the presentation sound The operation corresponding to 2 is an operation that swings the controller device 2 and an operation that does not correspond to the presentation sound 3 (no operation). In the “reverse differentiation experiment task”, what is the operation that corresponds to the presentation sound 2? If there is no (no operation) and the operation corresponding to the presentation sound 3 is an operation of swinging the controller device 2. In <B-2: Branching task>, the operation corresponding to the presentation sound of the rhythm pattern P1 is an operation of engraving the rhythm similarly to the rhythm pattern P1, and the operation corresponding to the presentation sound of the rhythm pattern P2 is a rhythm. This is an operation for engraving the rhythm in the same manner as the pattern P2. Furthermore, in <B-3: Conflict task>, the action corresponding to the presentation sound of the rhythm pattern A is an action of hitting the rhythm pattern X, and the action corresponding to the presentation sound of the rhythm pattern B is an action of hitting the rhythm pattern Y. is there. As described above, the content of the presentation sound data, the content of the user's operation mode, and the corresponding relationship are arbitrarily set according to the task to be executed.

  Next, an example of a functional configuration of the task presentation device 1 will be described with reference to the drawings. FIG. 6 is a diagram illustrating an example of a functional configuration of the task presentation device 1. In the figure, a task presentation control unit 111, a presentation sound reproduction unit 112, a motion detection unit 113, and a motion evaluation unit 114 are realized by the control unit 11 reading and executing a computer program stored in the ROM or the storage unit 12. The The arrows in the figure schematically show the flow of data. In FIG. 6, the task presentation control unit 111 performs task presentation processing according to the operation content of the user. The presentation sound reproduction unit 112 reproduces the presentation sound based on the presentation sound data stored in the presentation sound data storage area 121 under the control of the task presentation control unit 111. The presentation sound reproduction unit 112 functions as an operation timing unit that notifies the user of the operation timing based on the presentation sound data stored in the presentation sound data storage area 121.

  The motion detection unit 113 detects the user's motion based on the signal output from the controller device 2. In this embodiment, the motion detection unit 113 detects whether or not the user has swung the operating device 2 based on the acceleration data output from the acceleration sensor 21 of the operating device 2, and the user operates the operating device. When 2 is shaken, the length of time of the shake is detected. More specifically, in this embodiment, the motion detection unit 113 swings the controller device 2 when the acceleration data values αx, αy, and αz are all less than a predetermined threshold. On the other hand, in other cases (that is, when at least one of the values of the acceleration data αx, αy, αz is equal to or greater than a predetermined threshold value), the user shakes the controller device 2. In addition, the motion detection unit 113 measures a time length in which at least one of the acceleration data αx, αy, and αz is equal to or greater than a predetermined threshold value. Data indicating the detection result is output to the operation evaluation unit 114.

  Further, the motion detection unit 113 controls the voice processing unit 16 when the user's motion is detected (that is, when it is determined that the user is shaking the controller device 2), and is determined in advance. Sound (hereinafter referred to as “sensor sound”) is emitted from the speaker 17. In other words, in this embodiment, a sensor sound is output from the speaker 17 every time the controller device 2 is swung by the user.

  The motion evaluation unit 114 detects the motion detected by the motion detection unit 113 and predetermined reference data during a predetermined period after the presentation sound is reproduced by the presentation sound reproduction unit 112 (hereinafter referred to as “evaluation target period”). The user's action is evaluated based on the comparison with (reference data stored in the correspondence storage area 122), and evaluation data indicating the evaluation result is generated. In this embodiment, the action evaluating unit 114 specifies an action corresponding to the presentation sound presented by the presentation sound reproducing unit 112 with reference to the correspondence storage area 122, and compares the identified action with the detected action. Then, the user's action is evaluated according to the degree of matching between the two. The operation evaluation unit 114 displays the evaluation result on the display unit 13.

<B: Operation>
Next, the operation of this embodiment will be described. The user uses the operation unit 14 of the assignment presentation device 1 to perform an operation for performing assignment presentation processing. The operation unit 14 outputs an operation signal corresponding to the operated content. The control unit 11 starts the task presentation process in response to the signal output from the operation unit 14. The task presentation device 1 presents three types of tasks: <1: Go / NoGo task>, <2: Branching task>, and <3: Conflict task>. The control unit 11 of the assignment presentation device 1 selects one of these three kinds of assignments according to the content operated by the performer, and performs a process of presenting the selected assignment to the performer. .

<B-1: Go / NoGo assignment>
First, the Go / NoGo assignment presented by the assignment presentation apparatus 1 will be described. In this task, three tasks of “formation experiment task”, “differentiation experiment task”, and “reverse differentiation experiment task” are performed in order.
First, the “formation experiment subject” will be described with reference to FIG. FIG. 7 is a sequence diagram showing the flow of the operation of the formation experiment task. In this operation, first, the task presentation device 1 presents the presentation sound 1 (s1). That is, the control unit 11 of the task presentation device 1 reads predetermined presentation sound data from the presentation sound data storage area 121 and controls the voice processing unit 16 to output the sound from the speaker 17. When the user confirms that the presentation sound 1 has been presented before the experiment, the user is instructed to swing the operation device 2 to generate a sound. For this reason, when the user confirms that the presentation sound 1 is presented, the user shakes the operation device 2 to generate a sound (s2). When the controller device 2 is swung by the user, the acceleration sensor 21 sequentially generates acceleration data representing the acceleration in each axial direction. The acceleration data is transmitted to the task presentation device 1 as a wireless signal via the transmission unit 22. In this embodiment, the acceleration data is written and transmitted at the current value every 5 milliseconds. The receiving unit 18 of the assignment presentation device 1 receives acceleration data from the controller device 2 and outputs the acceleration data to the control unit 11. The control unit 11 receives the acceleration data and detects the user's action based on the received acceleration data. The control unit 11 stores data indicating the detection result in the RAM. Further, when it is determined that the user has swung the controller device 2, the control unit 11 controls the voice processing unit 16 to reproduce a predetermined sensor sound. That is, every time the controller device 2 is moved by the user, a sensor sound is emitted according to the movement.

  The task presentation device 1 repeats the presentation process of the presentation sound 1 five times (s3, s5, s7, s9). The user performs an operation of swinging the operation device 2 every time the presentation sound 1 is presented by the task presentation device 1. A user's operation | movement is detected by the acceleration sensor 21, and is sequentially transmitted to the task presentation apparatus 1 (s4, s6, s8, s10).

  Next, the “differentiation experiment task” will be described with reference to FIG. FIG. 8 is a sequence diagram showing a flow of operations of the differentiation experiment task. In this task, the task presentation device 1 presents two types of presentation sounds, presentation sound 2 and presentation sound 3 (s11, s13). That is, the control unit 11 of the task presentation device 1 reads out two types of different presentation sound data from the presentation sound data storage area 121, and controls the sound processing unit 16 to output as sound from the speaker 17. When the presentation sound 2 sounds, the user shakes the operating device 2 (s12, s15, s18, s22, s25). On the other hand, when the presentation sound 3 sounds, the user is instructed before starting the experiment so as not to perform anything.

  The task presentation device 1 repeats the presentation sound presentation process 10 times (s11, s13, s14, s16, s17, s19, s20, s21, s23, s24). That is, the control unit 11 of the task presentation device 1 reads two types of different presentation sound data (presentation sound data of the presentation sound 2 and presentation sound data of the presentation sound 3) from the presentation sound data storage area 121, and randomly reads them. The sound is output from the speaker 17 in order. The user determines whether to perform the operation while listening to the presentation sound to be emitted. The control unit 11 of the assignment presentation device 1 detects the user's movement based on the acceleration data output from the controller device 2 and stores data indicating the detection result in the RAM.

  Next, the “reverse differentiation experiment subject” will be described with reference to FIG. FIG. 9 is a sequence diagram showing a flow of operations of the reverse differentiation experiment task. In this task, the task presentation device 1 presents two types of presentation sounds presented in the “differentiation experiment task” (s31, s32). That is, the control unit 11 of the task presentation device 1 reads out two types of different presentation sound data from the presentation sound data storage area 121, and controls the sound processing unit 16 to output as sound from the speaker 17. On the other hand, the user performs an operation reverse to that in the differentiation experiment. That is, when the presentation sound 2 sounds, the user does nothing, but when the presentation sound 3 sounds, the user is instructed to start the experiment by swinging the operation device 2 to generate sound. (S33, s36, s39, s41, s44).

  The task presentation device 1 repeats the presentation sound presentation process 10 times (s31, s32, s34, s35, s37, s38, s40, s42, s43, s45). That is, the control unit 11 of the task presentation device 1 reads two types of different presentation sound data (presentation sound data of the presentation sound 2 and presentation sound data of the presentation sound 3) from the presentation sound data storage area 121, and randomly reads them. The sound is output from the speaker 17 in order. The user determines whether to perform the operation while listening to the presentation sound to be emitted. The control unit 11 of the assignment presentation device 1 detects the user's movement based on the acceleration data output from the controller device 2 and stores data indicating the detection result in the RAM.

  When the task presentation processing is finished, the control unit 11 of the task presentation device 1 refers to the data stored in the RAM, compares the detected motion with the motion stored in the correspondence storage area 122, and both User behavior is evaluated according to the degree of matching. As a specific example of the evaluation performed by the control unit 11, for example, the brain age of the user may be calculated numerically according to a predetermined algorithm according to the degree of matching between the two. Further, as another example, for example, the control unit 11 may perform a personality analysis (such as decoy, quick and dust) according to a predetermined algorithm. In this embodiment, the control part 11 determines the presence or absence of a user's reaction with respect to each of the presentation sounds emitted from the task presentation device 1. Moreover, the control part 11 measures the time after a presentation sound is output until a user reacts, and also evaluates with reference to this time length.

  Specific contents of the evaluation performed by the control unit 11 include, for example, evaluating the ratio of correct / incorrect response of the user's action, and correct / incorrect response contents (reaction time length, which side of each task) It is also possible to evaluate whether or not the reaction is correct / incorrect in the time period of (1) or (2), and to evaluate the relationship between the test time and time (am and afternoon, seasonal effects, etc.). Further, for example, a history of correct / false reactions (the correct answer is gradually increasing / decreasing, a tendency of improvement / deterioration) may be taken, and the evaluation may be performed according to this history. That is, the control unit 11 compares the detected action with the action stored in the correspondence storage area 122, and based on the comparison result, the correctness / incorrectness of the user's action, the contents of correct / incorrect, the correct / incorrect ratio, and the comparison You may make it identify at least any one of the log | history of a result, and perform evaluation according to a specific result. In addition, for example, the evaluation mode may be varied according to the relationship (difficulty level or the like) with the presentation sound.

  Further, the control unit 11 determines that the type of the user's motion determination is “inactive type”, “excited type”, “suppressed type”, “depressed type” based on the determination result of the differentiation experiment task and the determination result of the reverse differentiation experiment task. It is determined whether the type is “type” or “active type”. Specifically, the control unit 11 has an error in the Go task (when the operation device 2 must be swung) in the differentiation experiment, and the NoGo task (the operation to swing the operation device 2) in the differentiation experiment. If there are three or more mistakes (when you must not do), it is determined as “inactive type”. Further, the control unit 11 determines “excited” when there is no mistake in the Go problem in the differentiation experiment and there are three or more errors in the NoGo problem in the differentiation experiment. In addition, the control unit 11 determines “inhibition type” when there is an error in the Go problem in the differentiation experiment and the error in the NoGo problem is twice or less in the differentiation experiment. In addition, the control unit 11 has no mistakes in the Go problem in the differentiation experiment, the error in the NoGo problem is twice or less in the differentiation experiment, the Go problem in the reverse differentiation experiment, and the NoGo problem in the reverse differentiation experiment. If the mistake is less than 2 times, it is determined to be a “moist type”. In addition, the control unit 11 determines “active type” when there is no mistake in the Go problem in both the differentiation experiment and the reverse differentiation experiment, and the error in the NoGo problem is two or less in the differentiation experiment and the reverse differentiation experiment. To do.

  That is, in the differentiation experiment task, the control unit 11 reproduces the presentation sound (presentation sound 2, presentation sound 3) based on the plurality of presentation sound data, and any one of the plurality of presentation sound data. The presentation sound data (presentation sound data indicating the presentation sound 2) is used as timing data for notifying the user's operation timing. That is, in the differentiation experiment task, the control unit 11 evaluates the user's operation during a predetermined period after reproducing the presentation sound 2. In addition, in the reverse differentiation experiment task, the control unit 11 reproduces the same presentation sound (presentation sound 2, presentation sound 3) as the differentiation experiment task described above, and the presentation sound data used as timing data in the differentiation experiment task. Presentation sound data (presentation sound data 3) other than (presentation sound data indicating the presentation sound 2) is used as timing data for notifying the operation timing of the user. That is, in the reverse differentiation experiment task, the control unit 11 evaluates the user's operation in a predetermined period after reproducing the presentation sound 3. Next, the control unit 11 compares the evaluation result in the differentiation experiment task and the evaluation result in the reverse differentiation experiment task, and determines the type of user motion determination (“inactive type”, “excited type”) according to the difference between the two. , “Inhibition type”, “moist type”, “active type”).

  The control unit 11 notifies the evaluation result to the user, for example, by displaying the evaluation result (determination result) on the display unit 13. The user can grasp the measurement result of his / her brain function by referring to the screen displayed on the display unit 13.

<B-2: Branching issue>
Next, a branching assignment presentation process will be described with reference to FIG. This blanching task is aimed at evaluating and improving short-term memory. In this task, first, the task presentation device 1 creates a rhythm pattern P2 as a presentation sound and reproduces the pattern (s91). That is, the control unit 11 reads predetermined presentation sound data (rhythm pattern data) from the presentation sound data storage area 121 and controls the sound processing unit 16 to emit sound as sound from the speaker 17.

  The user is taught to memorize the rhythm pattern P2 presented by the task presentation device 1, swing the operation device 2, and react to engrave the rhythm in the same manner as the presented rhythm pattern P2. The controller device 2 outputs acceleration data to the task presentation device 1 in accordance with a user operation (s92). In this branching task, in order to encourage the user to memorize intensively, instead of a simple presentation sound such as a short sound, a rhythm pattern composed of a plurality of sounds is adopted, and short-term memory It used for evaluation and improvement.

  Next, the task presentation device 1 creates a rhythm pattern P1 as the presentation sound, and reproduces the pattern a plurality of times (s101,..., S107). That is, the control unit 11 reads predetermined presentation sound data (rhythm pattern data) from the presentation sound data storage area 121 and controls the sound processing unit 16 to emit sound as sound from the speaker 17.

  The user is taught to memorize the rhythm pattern P1 presented by the task presentation device 1 and to make a reaction of engraving the rhythm in the same manner as the rhythm pattern P1 presented by swinging the operation device 2. The operation device 2 outputs acceleration data to the task presentation device 1 in accordance with a user operation (s102, s103, s104, s105, s106,..., S108, s109, s110, s111, s112). Each time the rhythm pattern P1 is presented once by the task presentation device 1, the user succeeds by repeating the same rhythm pattern P1 as the presented rhythm pattern P1 five times. Repeat this combination three times.

  In the example shown in FIG. 10, the user repeats the operation for one rhythm pattern P5 five times, and the task presentation device 1 repeats the presentation of the rhythm pattern P1 three times. Although illustrated, the frequency | count of a user's operation | movement and the frequency | count of presentation of the rhythm pattern of the subject presentation apparatus 1 are not limited to this, It can change suitably according to the design of the subject presentation apparatus 1, etc. In short, the task presentation device 1 may repeat the presentation of the rhythm pattern a plurality of times, and the user may repeat the operation for the presented rhythm pattern a predetermined number of times.

  When the presentation of the third rhythm pattern P1 is completed, the task presentation device 1 instructs the user to reproduce another rhythm pattern P2 previously performed (s113). The user swings the operating device 2 according to the rhythm pattern P2 presented by the task presentation device 1, and engraves the rhythm in the same manner as the other rhythm pattern P2. The controller device 2 outputs acceleration data to the task presentation device 1 according to the user's operation (s114). As described above, the rhythm pattern P1 is presented a plurality of times (three times), and this presentation period is provided between the two presentation periods of the rhythm pattern P2, so that the short-term memory retention capability of the rhythm pattern P2 is achieved. Determined.

  The control unit 11 refers to the data stored in the RAM, compares the detected operation with the operation stored in the correspondence relationship storage area 122, and evaluates the user's operation according to the degree of matching between the detected operation and the operation. . The evaluation process performed by the control unit 11 is the same as the process shown in the Go / NoGo problem described above, and a detailed description thereof is omitted here.

<B-3: Conflict issues>
Next, the conflict problem presented by the problem presentation device 1 will be described. In this task presentation process, rhythm patterns A and B and rhythm patterns X and Y that match the rhythm patterns A and B are used. Rhythm patterns A and B are preferably connected musically. The rhythm patterns X and Y are preferably musically matched to the rhythm patterns A and B, respectively.

  The user is instructed by the task presentation device 1 to strike the rhythm pattern X when the rhythm pattern A flows, and to strike the rhythm pattern Y when the rhythm pattern B flows. As an aspect of this teaching, for example, while the control unit 11 actually emits the rhythm pattern A and the rhythm pattern X, “When this rhythm pattern (A) flows, this rhythm pattern (X) A message such as “Please respond by hitting” may be output in synchronization with the sound actually emitted. Note that the rhythm pattern X and the rhythm pattern Y may be presented to the user in advance on a musical score or the like.

  The control unit 11 reproduces the rhythm pattern A and the rhythm pattern B in a random order. This rhythm pattern may be a performance sound of a percussion instrument or a performance sound of another musical instrument. Moreover, when using the performance sound which has a pitch, you may use a phrase, a chord, an accompaniment, etc. In this case, it is preferable that it is the length of 1-2 measures.

  That is, the control unit 11 reads two types of different rhythm pattern data from the presentation sound data storage area 121 and outputs them as sounds from the speaker 17 in a random order. The user performs an operation corresponding to each rhythm pattern while listening to the rhythm pattern to be emitted. The controller device 2 outputs acceleration data according to the user's operation, and the control unit 11 detects the user's action based on the acceleration data output from the controller device 2 and stores data indicating the detection result in the RAM. Remember.

  When the assignment is finished, the control unit 11 refers to the data stored in the RAM and compares the detected action with the action stored in the correspondence storage area 122 in association with the presented pattern data. The user's action is evaluated according to the degree of matching between the two. In this problem, the control unit 11 evaluates whether the user is responding to the rhythm pattern. In addition, the control unit 11 evaluates and analyzes whether the rhythms / sounds and patterns of the phrases X and Y match. The control unit 11 may store the situation data and the determination result, and when the difficulty level is further selected, the length, time, and pattern difficulty level may be presented at random.

  As described above, according to the present embodiment, it is possible to perform Go / NoGo assignment, branching assignment, and conflict challenge musically by sound / music presentation, etc., and prevent dementia and prefrontal cortex. You can know judgment-oriented patterns, such as activation, prevention training of so-called “Kyrel” children. That is, according to the present embodiment, it is possible to perform brain function activation, personality analysis, and the like, using the operation device 2 that senses a response action to a user's sound. Further, according to the present embodiment, since the task is presented using sound / music, the task can be performed while the user is enjoying without imposing a mental burden on the user.

  Moreover, according to this embodiment, a reflex brain age etc. can be taken out numerically from a test subject's reaction time, and it can lead to the next motivation. In addition, by evaluating the user's actions based on the correct answer rate and the reaction time, it is possible to analyze the types of user's action judgments (such as decoy and quick dust).

<C: Modification>
As mentioned above, although embodiment of this invention was described, this invention is not limited to embodiment mentioned above, It can implement with another various form. An example is shown below. In addition, you may combine each following aspect suitably.
(1) In the above-described embodiment, the task presentation device 1 reproduces the presentation sound, thereby informing the performer of the timing for performing the operation or the timing for not performing the operation. The manner of notifying the operation timing is not limited to this, and for example, the operation timing may be notified by displaying an image on a display device and changing the image in time series. In addition, for example, the task presentation device 1 may include a mechanism that vibrates the device itself, and the operation timing may be notified by changing the vibration mode in time series. In short, the control unit 11 of the task presentation device 1 may notify the operation timing by changing at least one of sound, light, video, and vibration in time series.

(2) In the above-described embodiment, the case where one user performs motion measurement using one operating device 2 is described. However, the present invention is not limited to this, and one user operates two operating devices 2. The movement measurement may be performed by grasping with both hands. In this case, the control unit 11 detects the user's action based on the data output from the plurality of controller devices 2, and evaluates the user's action according to the detection result.

(3) In the above-described embodiment, different sounds may be emitted according to the axial direction and the direction in which the controller device 2 is moved. In this case, it is set as the structure which memorize | stores the scale name corresponding | compatible table as shown in FIG. 11 in the memory | storage part 12 of the assignment | presentation presentation apparatus 1, and the control part 11 of the assignment | presentation presentation apparatus 1 refers to this table, A sound corresponding to the axis and the direction in which the operating device 2 is moved is emitted. In the example shown in FIG. 11, in the scale name correspondence table, as shown in the figure, the axial direction and direction in which the controller device 2 is moved and the scale name are stored in association with each other. As shown in the figure, in the scale name correspondence table, the scale of the scale corresponding to the combination of the axial direction (axis x, y, z) in which the operating device 2 is moved and the direction (positive or negative) of the axial direction is shown. One name is associated.

  When the operation device 2 is moved by the user, the acceleration sensor 21 sequentially generates acceleration data representing the acceleration in each axis direction and transmits the acceleration data to the task presentation device 1. The task presentation device 1 receives acceleration data from the operation device 2. The control unit 11 refers to the scale name correspondence table and specifies the scale corresponding to the received acceleration data. The control unit 11 emits the sound of the specified scale.

  In the above-described aspect, the axial direction and the direction in which the operating device 2 is moved are associated with the scale, but the axial direction and the direction in which the operating device 2 is moved are not limited to the scale. For example, it may be a timbre (tone for each musical instrument or its variation) or an effect (reverberation sound, localization (pan), etc.). The characteristics (including the scale, timbre, and effect) may be stored in association with each other.

(4) In the above-described embodiment, a device having a substantially rectangular parallelepiped shape is used as the operation device 2, but the shape of the operation device 2 is not limited to this, and for example, a shape of an orchestra command rod may be used. For example, it may be spherical. In short, the controller device 2 may be any device that can be gripped or mounted by a user and can be moved, and that has built-in sensors for detecting positive and negative motions about a plurality of axes.
In the above-described embodiment, the task presentation device 1 may be a dedicated device, and may be, for example, a mobile phone terminal, a portable game machine, or the like.

(5) In the above-described embodiment, the control unit 11 of the task presentation device 1 outputs a predetermined sensor sound from the speaker 17 every time a user action is detected by the acceleration sensor 21 of the controller device 2. I did it. Instead of this, the controller device 2 may have a built-in speaker, and the sensor sound may be output from the speaker of the controller device 2. In this case, the control unit 20 of the controller device 2 detects the presence / absence of the user's motion based on the acceleration data output from the acceleration sensor 21, and the user's motion is detected (that is, the user operates When it is determined that the device 2 is being shaken), a predetermined sensor sound may be emitted from the built-in speaker. In addition, the controller device 2 is not limited to a built-in speaker, and an external speaker may be connected to the controller device 2.

(6) In the above-described embodiment, the user's motion is detected using the triaxial acceleration sensor. However, the mode of detecting the user's motion is not limited to this, for example, a geomagnetic sensor or a gyro sensor. The operation device 2 may be built in, and the user's movement may be detected by a geomagnetic sensor or a gyro sensor. A plurality of types of sensors may be used in combination. In short, what is necessary is just to provide in the operating device 2 and to detect the motion about a some axis | shaft.

DESCRIPTION OF SYMBOLS 1 ... Problem presentation apparatus, 2 ... Operation apparatus, 11, 20 ... Control part, 12 ... Memory | storage part, 13 ... Display part, 14 ... Operation part, 15 ... Microphone, 16 ... Sound processing part, 17 ... Speaker, 18 ... Reception Part, 21 ... acceleration sensor, 22 ... transmission part.

Claims (4)

Timing data storage means for storing a plurality of timing data for informing a user's operation timing in a rhythm pattern composed of a plurality of sounds ;
After sequentially informing the user's operation timing with a rhythm pattern based on the plurality of timing data stored in the timing data storage means, the user's operation is again based on the predetermined timing data of the plurality of timing data. Operation timing notifying means for notifying the timing with a rhythm pattern ;
An operator that is movable by being gripped or mounted by the user;
Motion detecting means provided on the operating element, detecting movement of the operating element, and detecting the operation of the user based on the detection result;
Correspondence relationship storage means for storing the correspondence relationship between the timing data and the operation mode of the user;
The user's operation mode corresponding to the timing data referred to by the operation timing notification unit is specified with reference to the correspondence relationship storage unit, and the operation timing notification unit notifies the operation timing in advance. And an evaluation unit that evaluates the user's operation based on a comparison between the identified user operation mode and each of a plurality of operations detected by the operation detection unit in a specified period. An operation evaluation device. Timing data storage means for storing a plurality of timing data for informing a user's operation timing in a rhythm pattern composed of a plurality of sounds ;
Selecting a plurality of timing data stored in the timing data storage means in a random order, and an operation timing notification means for notifying a user's operation timing in a rhythm pattern in the selected order ;
An operator that is movable by being gripped or mounted by the user;
Motion detecting means provided on the operating element, detecting movement of the operating element, and detecting the operation of the user based on the detection result;
Correspondence relationship storage means for storing the correspondence relationship between the timing data and the operation mode of the user;
The user's operation mode corresponding to the timing data referred to by the operation timing notification unit is specified with reference to the correspondence relationship storage unit, and the operation timing notification unit notifies the operation timing in advance. And an evaluation unit that evaluates the user's operation based on a comparison between the identified user operation mode and each of a plurality of operations detected by the operation detection unit in a specified period. An operation evaluation device. Timing data storage means for storing a plurality of timing data for informing a user's operation timing with a rhythm pattern composed of a plurality of sounds, and storing a correspondence relationship between the timing data and the user's operation mode A computer having correspondence storage means ;
After sequentially informing the user's operation timing with a rhythm pattern based on the plurality of timing data stored in the timing data storage means, the user's operation is again based on the predetermined timing data of the plurality of timing data. An informing step for informing the timing with a rhythm pattern ;
A detection step of detecting movement of an operator that is gripped or attached to the user and is movable, and detecting an operation of the user based on a detection result;
The operation mode of the user corresponding to the timing data referred to in the notification step is specified with reference to the inside of the correspondence storage unit, and the specified mode is specified in a predetermined period after the operation timing is notified . A program for executing an evaluation step for evaluating the user's operation based on a comparison between the user's operation mode and each of the plurality of operations detected in the detection step . Timing data storage means for storing a plurality of timing data for informing a user's operation timing with a rhythm pattern composed of a plurality of sounds, and storing a correspondence relationship between the timing data and the user's operation mode A computer having correspondence storage means ;
A notification step of selecting a plurality of timing data stored in the timing data storage means in a random order, and informing a user's operation timing in a rhythm pattern in the selected order ;
A detection step of detecting movement of an operator that is gripped or attached to the user and is movable, and detecting an operation of the user based on a detection result;
The operation mode of the user corresponding to the timing data referred to in the notification step is specified with reference to the inside of the correspondence storage unit, and the specified mode is specified in a predetermined period after the operation timing is notified . A program for executing a step of evaluating the user's operation based on a comparison between the user's operation mode and each of the plurality of operations detected in the detection step .

Images