WO2017141578A1

WO2017141578A1 - Associating device, associating system, associating method, and associating program

Info

Publication number: WO2017141578A1
Application number: PCT/JP2017/000581
Authority: WO
Inventors: 小也香内藤; 嘉一森; 一希笠井
Original assignee: オムロン株式会社
Priority date: 2016-02-15
Filing date: 2017-01-11
Publication date: 2017-08-24
Also published as: JP2017143895A

Abstract

Provided are an associating device, associating system, associating method, and associating program with which an operation of a human subject and a biosignal that accompanies said operation can easily be associated. As one process within parallel processing, this associating device 1 acquires state information which is represented as position information and posture information based on a result obtained by measuring a part to be measured in the human subject (S101-S103), and performs calculation to determine an operation of the human subject on the basis of the acquired position information and posture information (S104-S105). The associating device 1 acquires a biosignal of the human subject as another process within the parallel processing (S106-S107). After the parallel processing, the associating device 1 associates the operation that is the calculation result with the acquired biosignal (S108) and records the associated operation and biosignal (S109).

Description

Association apparatus, association system, association method, and association program

The present invention relates to an associating device for associating a biological signal acquired from a subject with an action, an associating system provided with such an associating device, an associating method using such an associating device, and such an associating device. Related to association program.

Various techniques have been disclosed for motion sensing that detects a human surface myoelectric potential and analyzes human movement based on the detected surface myoelectric potential (see, for example, Patent Document 1).

In such conventional motion sensing using surface myoelectric potential, it is necessary to initialize the information relating to surface myoelectric potential and human movement. In order to initialize the association between the surface myoelectric potential and the action, it is necessary to adjust the electrode position based on the position of the muscle, and associate the predetermined action with the surface myoelectric potential.

JP 2011-25053 A

However, specialized knowledge is required for the method of initialization by adjusting the electrode position. In addition, in the method of associating the predetermined operation with the surface myoelectric potential, the operation may not be performed as prescribed, and may be repeated many times. Thus, there is a problem that initialization is not easy.

The present invention has been made in view of such circumstances, and when acquiring a biological signal such as a surface myoelectric potential of the subject, obtains the motion of the subject from the position information and / or posture information of the subject, The acquired biological signal is associated with the motion or motion site. Accordingly, the main object is to provide an association apparatus that can facilitate the initialization work.

Also, another object of the present invention is to provide an association system provided with the association device according to the present invention.

Further, the present invention has another object to provide an association method using the association apparatus according to the present invention.

Further, the present invention has another object to provide an association program for realizing the association apparatus according to the present invention.

In order to solve the above problem, the associating device according to the present application includes a biological signal acquisition unit that acquires a biological signal from a target person, and an operation of the target person from at least one of position information and posture information of the target person. A movement acquisition unit that acquires the movement signal, a biological signal acquired by the biological signal acquisition unit, and an association unit that associates the movement or operation part acquired by the movement acquisition unit.

In the associating device, the biological signal acquired by the biological signal acquisition unit is at least one of an electroencephalogram, a cerebral blood flow, and a myoelectric potential.

In the associating device, the motion acquisition unit includes a motion calculation unit that calculates the motion of the subject from at least one of the position information and posture information of the subject.

The association apparatus may further include a state information acquisition unit that acquires at least one of the position information and posture information of the subject, and at least one of the position information and posture information acquired by the state information acquisition unit. Is calculated based on at least one of speed, acceleration, angular velocity, angular acceleration, pressure, and magnetism measured for the measurement target region of the subject.

In the associating device, operation derivation for deriving the motion or motion part of the subject from the biological signal acquired by the biological signal acquisition unit based on the biological signal associated with the correlation unit and the motion or motion part. It comprises a part.

Furthermore, the associating system described in the present application includes the associating device, a signal detection device that detects a detection target region of the subject, and a measurement device that measures the measurement target region of the subject, and the associating device includes The biological signal acquisition unit is configured to acquire a biological signal based on the detection result of the signal detection device, and the operation acquisition unit included in the association device is configured to acquire an operation based on the measurement result of the measurement device. It is characterized by being.

Further, the association system includes a recording unit that records a biological signal and an operation associated with the association unit.

Furthermore, in the associating method described in the present application, the biological signal acquisition unit acquires the biological signal from the target person, and the motion acquisition unit acquires the target person from at least one of the position information and posture information of the target person. And a step of associating the biological signal acquired by the biological signal acquisition unit with the operation or operation part acquired by the motion acquisition unit.

Further, the association program described in the present application includes a step of acquiring a biological signal from the target person in a computer, a step of acquiring the action of the target person from at least one of the position information and posture information of the target person, The step of associating the acquired biological signal with the acquired motion or motion part is executed.

The association device, association system, association method, and association program described in the present application can easily associate a biological signal with an action or an action part.

The present invention associates the motion or motion part acquired from the subject with the biological signal of the subject. As a result, it is possible to facilitate the initialization work and the like, and thus excellent effects can be obtained.

It is a block diagram which shows an example of the hardware constitutions of various apparatuses, such as an association apparatus with which the association system of this application description is provided. It is explanatory drawing which shows notionally an example of the recording content of the correlation recording part with which the correlation apparatus of this application description is provided. It is a functional block diagram which shows an example of a function structure of the correlation apparatus of this application description, and other various apparatuses. It is a flowchart which shows an example of the correlation process of the correlation apparatus as described in this application. It is a flowchart which shows an example of the operation | movement derivation | leading-out process of the correlation apparatus as described in this application.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. The following embodiment is an example embodying the present invention, and is not intended to limit the technical scope of the present invention.

<Device configuration>
First, the configuration of various devices included in the association system described in the present application will be described mainly using the association device 1. FIG. 1 is a block diagram illustrating an example of a hardware configuration of various apparatuses such as an association apparatus 1 included in an association system described in the present application. The association system described in the present application is applied to initialization in which a subject's motion and a biological signal such as surface myoelectric potential are associated with each other in a technique such as motion sensing for detecting the motion of the subject.

The associating system includes an associating device 1 using a computer required for initialization and computation such as motion sensing based on initialization, and a measuring device 2 and a signal detecting device 3 worn by the subject.

The associating device 1 acquires various information respectively output from the measuring device 2 and the signal detecting device 3, and performs processing related to techniques such as initialization and motion sensing based on the acquired various information. The associating device 1 includes a control unit 10 and a recording unit 11, and further includes a measurement information acquisition unit 12 and a biological signal acquisition unit 13 as interfaces for communicating with other devices.

The control unit 10 is configured by using a processor such as a CPU (Central Processing Unit) and a memory such as a register, and controls the entire apparatus by executing various instructions.

The recording unit 11 includes a nonvolatile memory such as a ROM (Read Only Memory) and an EPROM (Erasable Programmable Read Only Memory), a volatile memory such as a RAM (Random Access Memory), and a recording medium such as a hard disk drive and a semiconductor memory. It records data such as various programs and information. In the recording area of the recording unit 11, an association program PG that causes the computer to function as the association device 1 according to the present invention is recorded.

Furthermore, a part of the recording area of the recording unit 11 is used as a database such as an association recording unit 11a that records the biological signal of the subject and the action of the subject in association with each other. Instead of using a part of the recording area of the recording unit 11 included in the associating device 1 as the associating recording unit 11a, a recording device such as a server computer that records various information is connected to the associating device 1 and the associating device 1 is connected. A part of the recording area of the connected recording device may be used as a database such as the association recording unit 11a. That is, the association recording unit 11a can be designed in various forms as long as it can be accessed and recorded and read by the control unit 10 included in the association apparatus 1.

FIG. 2 is an explanatory diagram conceptually showing an example of recorded contents of the association recording unit 11a provided in the association apparatus 1 described in the present application. In FIG. 2, in the association recording unit 11a, target person specifying information (target person ID) for specifying a target person, an operation, and a biological signal are recorded in association with each other. In FIG. 2, the movement part of the subject and the movement part of the subject such as “left elbow joint: flexion”, “left elbow joint: extension”, “left forearm part: pronation (motion to twist the forearm inward)” The example recorded as information which shows operation | movement is shown. The biological signal illustrated in FIG. 2 is a surface myoelectric potential of a plurality of channels detected from the subject, and the biological signal is displayed for each item such as “myoelectric ch1”, “myoelectric ch2”, “myoelectric ch3” indicating each channel. Information indicating a signal is recorded. The information indicating the biological signal is recorded as information such as “◯” and “−” indicating whether or not the myoelectric potential is changed when the motion part recorded as the motion moves. That is, when an operation is performed, “◯” is detected when a change in myoelectric potential equal to or greater than a preset threshold is detected, and “−” is displayed when a change in myoelectric potential is less than the threshold. In the example shown in FIG. 2, when the subject performs an operation of bending the left elbow joint, the surface myoelectric potential indicated as myoelectric ch1 changes more than a threshold, and the surface indicated as myoelectric ch2 It shows that the myoelectric potential does not change more than the threshold value. In FIG. 2, the association recording unit 11a records the movement part and the movement of the movement part in association with the biological signal as information indicating the movement, but only the movement part is recorded as the information indicating the movement. It is possible to develop in various forms such as recording in association with each other.

Returning to the block diagram of FIG. 1, the measurement information acquisition unit 12 is an interface that acquires various types of information such as measurement information output from the measurement apparatus 2 as a result of the measurement. The biological signal acquisition unit 13 is an interface that acquires various types of information such as a biological signal output from the signal detection device 3. Note that these interfaces do not necessarily have to exist as individual devices, and can be shared as appropriate.

Then, the computer reads various programs recorded in the recording unit 11, for example, the association program PG, obtains the biological signal included in the read association program PG, obtains the motion of the subject, the biological signal and the motion or the motion part By executing various steps such as associating with the control of the control unit 10, recording is performed as the associating device 1.

The measuring device 2 includes various configurations such as an inertial sensor such as an acceleration sensor and a gyro sensor, a measurement unit using other sensors, and an output unit that outputs a measurement result of the measurement unit. The measuring device 2 is configured so that the subject can wear it. When the subject wears the measuring device 2, the measuring device 2 is provided in various measurement target parts of the subject's body, for example, the measurement target parts such as the head, upper arm, forearm, chest, abdomen, thigh, and lower leg. Various inertial sensors such as an acceleration sensor and a gyro sensor are located. As a sensor to be attached to the measuring device 2, in addition to an inertial sensor such as an acceleration sensor or a gyro sensor, a sensor such as a magnetic sensor or a pressure sensor can be used. Then, the measuring device 2 measures physical quantities such as velocity, angular velocity, acceleration, angular acceleration, pressure, and magnetism in the measuring unit, and measures information such as so-called raw data indicating the measurement result from the output unit to the associating device 1. Output. The associating device 1 acquires measurement information indicating physical quantities such as velocity, angular velocity, acceleration, angular acceleration, pressure, magnetism, and the like in the measurement information acquisition unit 12 and calculates the state of the measurement target region calculated based on the acquired measurement information State information such as position information and posture information indicating For example, the position information can be calculated by integrating the acceleration measured by the acceleration sensor twice. It should be noted that calculation of state information such as position information and posture information based on measurement information indicating physical quantities such as velocity, angular velocity, acceleration, angular acceleration, pressure, and magnetism may be performed by the measurement device 2 and an association device. 1 may be implemented. In FIG. 1, for convenience of explanation, only one measuring device 2 is shown, but it may be configured such that the subject wears different measuring devices 2 at each measurement target site.

The signal detection device 3 includes various measuring units using a multi-channel biological signal sensor that detects biological signals such as surface myoelectric potential, brain waves, and cerebral blood flow of the subject, and an output unit that outputs measurement results of the measuring unit. It has a configuration. The signal detection device 3 is configured to be worn by the subject. When the subject wears the signal detection device 3, various detection target parts of the subject's body, for example, biological signals of the detection target parts such as the head, upper arm, forearm, chest, abdomen, thigh, and lower leg, It can be detected by the biological signal sensor. The signal detection device 3 including various biological signal sensors detects a biological signal of the subject and outputs information related to the biological signal as a detection result. In FIG. 1, for convenience of explanation, only one signal detection device 3 is shown, but it may be configured such that a subject attaches or attaches a different signal detection device 3 to each detection target portion. . In the following description, an example using a biological signal sensor that detects the potential of the subject as the surface myoelectric potential will be described. However, as described above, it may be configured to detect a potential such as an electroencephalogram, and further, a biological signal other than the potential, for example, a biological signal detected based on an optical sensor such as cerebral blood flow may be detected. You may comprise.

FIG. 3 is a functional block diagram showing an example of the functional configuration of the associating device 1 described in the present application and other various devices. The associating device 1 executes various programs such as the associating program PG, and based on the control of the control unit 10, the state information acquiring unit 10a, the operation calculating unit 10b, the operation acquiring unit 10c, the associating unit 10d, and the operation deriving unit 10e. A function for performing various operations such as is realized. Note that various arithmetic units that realize these various functions can be implemented as dedicated circuits using semiconductor chips such as LSI (Large Scale Integration) and VLSI (Very Large Scale Integration).

The state information acquisition unit 10a is configured to acquire position information and posture of a measurement target part based on measurement information indicating physical quantities such as velocity, angular velocity, acceleration, angular acceleration, pressure, and magnetism acquired by the measurement information acquisition unit 12 from the measurement device 2. Status information such as information is obtained by calculation. In addition, when state information, such as position information and posture information, is output from the measurement device 2 and the measurement information acquisition unit 12 acquires the state information, the state information acquisition unit 10a of the control unit 10 It is acquired as it is as information used for calculation.

The motion calculation unit 10b performs a calculation for obtaining the motion of the target person, that is, the motion part and the motion indicating the motion part based on various state information such as the position information and posture information acquired by the state information acquisition unit 10a. Execute the process to be performed. For example, if it is determined that the angle of the left elbow joint changes based on various state information such as position information and posture information, and the position near the left wrist is circularly moving around the left elbow joint, The motion can be determined as being an elbow joint flexion (or extension). In addition, when the model information which shows the human body model which modeled the subject's shape is needed in the case of operation calculation, the operation calculation part 10b is not shown in figure which was previously ensured in the correlation apparatus 1 or the external recording part. The model information is read from the model recording unit and used for calculation.

The operation acquisition unit 10c acquires information indicating the operation acquired by the operation calculation unit 10b. It should be noted that the measurement apparatus 2 performs the measurement from the measurement target region of the subject to the calculation of the operation with an external device, and the operation acquisition unit 10c stores information indicating the operation as a result of the calculation with the external device. You may make it acquire from an apparatus.

The associating unit 10d performs a process of associating the operation calculated by the operation calculating unit 10b and the biological signal acquired by the biological signal acquiring unit 13, and recording the related operation and the biological signal in the association recording unit 11a.

The motion deriving unit 10e records the association of the acquired biological signal based on the relationship between the motion and the biological signal recorded in the association recording unit 11a and the biological signal acquired by the biological signal acquisition unit 13. By extracting from the unit 11a, processing for deriving the motion of the subject is executed.

<Processing configuration>
Various processes of the association apparatus 1 described in the present application configured as described above will be described. FIG. 4 is a flowchart showing an example of the association process of the association apparatus 1 described in the present application. The associating process is a process in which the associating device 1 associates the biological signal and the action.

The control unit 10 included in the associating device 1 executes the associating process by executing various programs such as the associating program PG. The control unit 10 of the associating device 1 executes a process for calculating the motion of the subject and a process for acquiring a biological signal as parallel processes.

That is, as one process, the control unit 10 starts acquiring measurement information as a result of measuring the operation of the subject by the measurement information acquisition unit 12 from the measurement device 2 worn by the subject (S101). The control unit 10 acquires measurement information by the measurement information acquisition unit 12 (S102), and calculates state information such as position information and posture information of the measurement target part by the state information acquisition unit 10a based on the acquired measurement information. (S103). At the start of measurement information acquisition in step S101, a subject wearing various inertial sensors as the measuring device 2 performs a predetermined reference operation, and the measuring device 2 performs measurement on the subject performing the reference operation. Measurement of physical quantities such as part velocity, angular velocity, acceleration, angular acceleration, pressure, magnetism, etc. The measuring device 2 outputs measurement information indicating the measurement result to the associating device 1. The acquisition of the measurement information in step S102 is a physical quantity such as velocity, angular velocity, acceleration, angular acceleration, pressure, magnetism, and the like obtained by measuring the measurement target site as a result of measurement by the measurement device 2 including various sensors such as an inertial sensor. It is acquisition of measurement information such as raw data. The acquisition of the state information in step S103 is a process of calculating the position information and the posture information of the measurement target part as the state information based on the measurement information obtained by measuring the measurement target part acquired by the measurement information acquisition unit 12. . Note that the state information acquisition unit 10a acquires the state information output from the measurement device 2 to the association device 1 by the measurement device 2 via the measurement information acquisition unit 12 by calculating the state information from the measurement information. You may do it.

The control unit 10 that has acquired the position information and the posture information as the state information performs a calculation for obtaining the motion of the subject based on the acquired position information and the posture information by the motion calculation unit 10b (S104). The operation is acquired by the operation acquisition unit 10c (S105). In step S104, based on the position information and posture information, the subject's actions such as “left elbow joint: flexion”, “left elbow joint: extension”, “left elbow joint: pronation”, that is, the motion part and its motion The calculation which calculates | requires the motion of an operation | movement part is performed.

Further, as the other process, the control unit 10 starts acquiring a biological signal (S106), and acquires the biological signal from the signal detection device 3 by the biological signal acquisition unit 13 (S107).

Steps S101 to S105, which are executed as one of the parallel processing, cause the measurement device 2 to start measuring the measurement target part, and after starting measurement of the measurement target part, acquire measurement information that is a measurement result of the measurement target part. This is processing for acquiring position information and posture information as state information based on the acquired measurement information. Steps S106 to S107 executed as the other of the parallel processing are processes for causing the signal detection device 3 to start detecting a biological signal and acquiring the biological signal after starting detection of the biological signal. When the measurement device 2 and the signal detection device 3 have already started measurement and detection, steps S101 and S106 are processing for starting acquisition of measurement information that is a measurement result and a biological signal that is a detection result. Become. In addition, when starting acquisition of position information and posture information based on measurement information and a biological signal, a notification is given to the subject wearing the measurement device 2 and the signal detection device 3 to perform a predetermined operation. The notification for performing a predetermined operation indicates, for example, output processing such as display of an image for performing an operation such as bending, stretching, and rotation of an arm portion such as an arm or a forearm, lighting of an indicator lamp, and output of sound.

After the parallel processing, the control unit 10 associates the operation as the operation result and the acquired biological signal with the associating unit 10d (S108), and associates the associated operation and the biological signal with the subject identification information, and the association recording unit 11a. (S109). Step S109 is an initialization process that associates an operation with a biological signal as a pre-process for performing motion sensing. In step S109, the movement part and the movement of the movement are associated with the biological signal as the movement. Note that only the operation site may be associated with the biological signal.

And the control part 10 determines whether acquisition of the status information based on a measurement and acquisition of a biological signal is complete | finished (S110). For example, when a predetermined operation for ending the acquisition of the state information and the biological signal based on the measurement is performed and the associating device 1 receives the predetermined operation, the control unit 10 acquires the state information and the biological signal based on the measurement. Determine to end.

In step S110, when it is determined that the acquisition of the state information and the biological signal based on the measurement is finished (S110: YES), the control unit 10 ends the acquisition of the state information and the biological signal based on the measurement, and ends the association process. . In Step S110, when it is determined that the acquisition of the state information and the biological signal based on the measurement is continued (S110: NO), the control unit 10 executes again the parallel processing of the process of acquiring the measurement information and the process of acquiring the biological signal. To do. In this case, since the acquisition of measurement information and the acquisition of biological signals have already been started, the processing after step S102 and the processing after S107 are subject to repeated processing.

In this way, the association process is executed. In the association process, the target person performs a predetermined operation based on the notified content, but does not necessarily perform the operation as requested. However, since the operation is calculated in the associating device 1, it can be inferred whether the operation as requested is being performed, so if necessary, such as exclusion from correspondence, instructions for re-operation, etc. Processing can be performed. Since the associating device 1 confirms the operation, it is possible to easily perform highly reliable initialization.

FIG. 5 is a flowchart showing an example of operation derivation processing of the associating device 1 described in the present application. The action deriving process is a process in which the associating device 1 derives an action based on the biological signal after initialization by the associating process. The control unit 10 included in the associating device 1 executes the operation derivation process by executing various programs such as the associating program PG.

Control part 10 starts acquisition of a living body signal (S201), and acquires a living body signal from signal detector 3 in living body signal acquisition part 13 (S202). Step S <b> 201 is processing for causing the signal detection device 3 to start detection of a biological signal, and starting acquisition of the biological signal after starting detection of the biological signal. In addition, when the signal detection apparatus 3 has already started detection, step S201 is processing for starting acquisition of a biological signal that is a detection result. In addition, when starting the acquisition of the biological signal, a notification is given to the subject wearing the signal detection device 3 to instruct the start of the operation.

The control unit 10 accesses the association recording unit 11a by the operation deriving unit 10e, and based on the biological signal and the action recorded in association with the association recording unit 11a and the biological signal acquired by the biological signal acquisition unit 13. Then, a motion derivation process for deriving the motion of the subject is executed (S203). In step S203, it is determined whether or not a biometric signal pattern that matches or approximates the acquired biosignal is recorded in the association recording unit 11a. If the biosignal pattern is recorded, the operation associated with the pattern is recorded in the association recording unit. This is a process for deriving an operation by extracting from 11a.

And the control part 10 determines whether the acquisition of a biomedical signal is complete | finished (S204). For example, when a predetermined operation for ending the acquisition of the biological signal is performed and the associating device 1 receives the predetermined operation, the control unit 10 determines to end the acquisition of the biological signal.

If it is determined in step S204 that the acquisition of the biological signal is to be ended (S204: YES), the control unit 10 ends the acquisition of the biological signal and ends the operation derivation process. If it is determined in step S204 that acquisition of a biological signal is to be continued (S204: NO), the control unit 10 returns to step S202 and repeats the subsequent processing.

In this way, the operation derivation process is executed. The operation derivation process is executed by another device that can access the association recording unit 11a in which the information is recorded by the association process, or by another device that receives the information recorded in the association recording unit 11a. Also good.

As described above, since the associating device 1 and the like described in this application calculate the operation in the associating device 1, it is possible to infer whether or not the operation as requested is performed. It is possible to easily perform the above-described effects.

The present invention is not limited to the embodiment described above, and can be implemented in various other forms. For this reason, the above-described embodiment is merely an example in all respects and should not be interpreted in a limited manner. The scope of the present invention is shown by the scope of claims, and is not restricted by the text of the specification. Further, all modifications and changes belonging to the equivalent scope of the claims are within the scope of the present invention.

For example, in the above-described embodiment, the mode for obtaining the motion of the subject based on the position information and the posture information has been described. However, the present invention is not limited to this, and one of the position information and the posture information, and other information. It is possible to develop in various forms such as obtaining an action based on the above. In addition, various known techniques can be applied to the association method for obtaining an operation based on position information and / or posture information.

DESCRIPTION OF SYMBOLS 1 Association apparatus 10 Control part 10a State information acquisition part 10b Operation | movement calculating part 10c Operation | movement acquisition part 10d Association part 10e Operation | movement derivation part 11 Recording part 11a Association recording part 12 Measurement information acquisition part 13 Biosignal acquisition part 2 Measurement apparatus 3 Signal detection apparatus PG association program

Claims

A biological signal acquisition unit that acquires a biological signal from the subject;
An action acquisition unit for acquiring the action of the subject from at least one of the position information and posture information of the subject;
An association apparatus comprising: an association unit that associates the biological signal acquired by the biological signal acquisition unit with the operation or operation part acquired by the operation acquisition unit.
The associating device according to claim 1,
The biometric signal acquired by the biosignal acquisition unit is at least one of brain waves, cerebral blood flow, and myoelectric potential.
The associating device according to claim 1 or 2,
The motion acquisition unit includes a motion calculation unit that calculates the motion of the subject from at least one of the position information and posture information of the subject.
The associating device according to claim 3,
A state information acquisition unit that acquires at least one of the position information and posture information of the subject,
At least one of the position information and the posture information acquired by the state information acquisition unit is based on at least one of speed, acceleration, angular velocity, angular acceleration, pressure, and magnetism measured for the measurement target portion of the subject. An association device characterized by being calculated.
The associating device according to any one of claims 1 to 4, wherein
And a motion deriving unit for deriving the motion or motion part of the subject from the biological signal acquired by the biological signal acquisition unit based on the biological signal associated with the association unit and the motion or motion part. Association device to perform.
An association apparatus according to any one of claims 1 to 5,
A signal detection device for detecting a detection target portion of the subject;
A measuring device for measuring the measurement target site of the subject,
The biological signal acquisition unit provided in the association device is configured to acquire a biological signal based on a detection result of the signal detection device,
The operation acquisition unit included in the association apparatus acquires an operation based on a measurement result of the measurement apparatus.
The association system according to claim 6,
An association system comprising: a recording unit that records a biological signal and an operation associated with the association unit.
A biological signal acquisition unit acquiring a biological signal from the subject;
A motion acquisition unit acquiring the motion of the subject from at least one of the position information and posture information of the subject;
An associating unit comprising: associating the biological signal acquired by the biological signal acquiring unit with the motion or motion part acquired by the motion acquiring unit.
On the computer,
Obtaining a biological signal from the subject;
Obtaining the motion of the subject from at least one of the location information and posture information of the subject;
A step of associating the acquired biological signal with the acquired action or action part.