JP7141680B2 - Information processing device, information processing system and program - Google Patents

Description

The present invention relates to an information processing device, an information processing system, and a program.

There are technologies for sensing biological information such as brain waves. Further, for example, Patent Literature 1 discloses a technique for removing noise contained in an electroencephalogram signal and shaping the waveform of the electroencephalogram signal.

JP-A-08-215164

Since biometric information obtained from users varies from person to person, it is necessary to calibrate the biometric information for each individual user when using the biometric information. However, when linking biometric information to a user's specific state, it is difficult for an individual user to calibrate.
SUMMARY OF THE INVENTION An object of the present invention is to allow a user to perform calibration when linking biometric information to a specific state of the user.

The invention according to claim 1 comprises acquisition means for acquiring biometric information of a user, linking means for linking the acquired biometric information to a specific state of the user, and connecting the user to the specific state. the biometric obtained by guiding the user to a plurality of the specific states in an order set so as not to cause congestion in each state The information processing apparatus is characterized in that, according to the information, for each of the plurality of specific states, the linking means calibrates a reference for linking to the specific state.
The invention according to claim 2 is characterized in that the order set so as not to cause congestion is an order in which the time from generation to disappearance of the biometric information is short. is an information processing device.
(3) The information processing apparatus according to (1), wherein the guidance means continues to guide the user to the specific state until calibration of the reference is completed. be.
In the invention according to claim 4, the guidance means starts guidance to the second specific state after a certain period of time has passed since calibration of the reference for linking to the first specific state is completed. The information processing apparatus according to claim 1, characterized by:
The invention according to claim 5 is characterized in that, among the plurality of specific states, the specific state first guided by the guiding means is a reference state among the plurality of specific states. The information processing apparatus according to claim 1.
The invention according to claim 6 is the information processing apparatus according to claim 5, wherein the reference state is the normal state of the user.
According to the seventh aspect of the invention, the linking means uses a difference between a reference for linking to the reference state and a reference for linking to another specific state other than the reference state, 6. The information processing apparatus according to claim 5, wherein the acquired biometric information is associated with the other specific state.
The invention according to claim 8 is characterized in that, when there is a specific state requiring calibration of the reference among the plurality of specific states, only the specific state is recalibrated. An information processing apparatus according to claim 1 .
According to a ninth aspect of the invention, the guiding means guides the user to the specific state when the motion of the user satisfies a predetermined motion condition. 3. The information processing apparatus according to .
According to the tenth aspect of the invention, the predetermined operation condition is a condition that restricts the user's operation, and if the user's operation does not satisfy the predetermined operation condition, 10. The information processing apparatus according to claim 9, wherein the user is notified to reduce the movement.
The invention according to claim 11 is characterized in that the guidance means guides the user to the specific state after it is confirmed that the acquisition means normally acquires the biometric information. Item 1. The information processing apparatus according to Item 1.
According to a twelfth aspect of the invention, when it is not confirmed that the acquisition means normally acquires the biometric information, the user is notified that acquisition of the biometric information has not been confirmed. The information processing apparatus according to claim 11, wherein
The invention according to claim 13 is the information processing apparatus according to claim 1, wherein the biological information is potential information for measuring an electroencephalogram.
The invention according to claim 14 is the information processing apparatus according to claim 1, wherein the specific state is a specific emotion that the user has.
According to a fifteenth aspect of the present invention, there is provided an acquisition means for acquiring biometric information of a user, a linking means for linking the acquired biometric information to a specific state of the user, and connecting the user to the specific state. Guiding means for guiding the user to a state, and the biological information acquired by the guiding means guiding the user to the plurality of the specific states in an order set so as not to cause congestion in each state, and calibrating means for calibrating, for each of the plurality of specific states, a reference for tying to the specific state by the tying means.
According to a sixteenth aspect of the invention, a computer has a function of acquiring biometric information of a user, a function of linking the acquired biometric information to a specific state of the user, and a function of connecting the user to the specific condition. and the biometric information obtained by guiding the user to a plurality of the specific states in an order set so as not to cause congestion in each state, the plurality of specific states. and a function of calibrating the reference for linking to the specific state for each state of the state.

ADVANTAGE OF THE INVENTION According to invention of Claim 1 and Claim 2 , it enables a user individual to perform proofreading at the time of link|linking biometric information to a user's specific state.
According to the third aspect of the invention, it is possible to more reliably calibrate the reference for linking to a specific state .
According to the invention of claim 4, when the guidance to the second specific state is started before a certain period of time has passed since the calibration of the reference for linking to the first specific state is completed In comparison, it becomes easier to accurately acquire biometric information when guided to the second specific state.
According to the fifth aspect of the invention, it becomes easy to confirm whether or not the electroencephalogram is normally measured when guided to another specific state.
According to the sixth aspect of the invention, it becomes easy to confirm whether or not the electroencephalogram is normally measured when guided to another specific state.
According to the seventh aspect of the invention, it is possible to improve the accuracy of linking the biometric information to another specific state.
According to the eighth aspect of the invention, it is possible to omit the process of guiding the user to a specific state in which the calibration of the reference is not required.
According to the ninth aspect of the invention, it is possible to increase the possibility of normally acquiring biometric information during guidance.
According to the tenth aspect of the invention, when there is a possibility that biometric information cannot be acquired normally due to the user's motion, it is possible to notify the user to reduce the motion.
According to the eleventh aspect of the invention, biometric information is acquired normally during guidance, compared to the case where the user is guided to a specific state before it is confirmed that the biometric information is acquired normally. You can increase your chances.
According to the twelfth aspect of the invention, it is possible to notify the user that the acquisition of the biometric information has not been confirmed.
According to the thirteenth aspect of the invention, it is possible for an individual user to calibrate potential information for measuring electroencephalograms when linking it to a specific state of the user.
According to the fourteenth aspect of the present invention, it is possible for each user to perform proofreading when linking biometric information to a specific emotion that the user has.
According to the fifteenth aspect of the invention, it is possible for each user to calibrate when linking biometric information to a specific state of the user.
According to the sixteenth aspect of the invention, it is possible for each user to calibrate when linking biometric information to a specific state of the user.

1 is a diagram showing an example of the overall configuration of an electroencephalogram measurement system according to this embodiment; FIG. It is a figure which shows the structural example of an electroencephalogram measuring device. It is a figure which shows the hardware structural example of a user terminal. 3 is a block diagram showing a functional configuration example of a user terminal; FIG. (a) to (f) are diagrams for explaining an example of an electroencephalogram that causes an error in the signal check function. 4 is a flowchart showing an example of a processing procedure for calibrating a reference electroencephalogram by a user terminal; 7 is a flow chart showing an example of a processing procedure for tying by a state tying unit; (a) to (d) are diagrams for explaining an example of calibration of reference electroencephalograms. (a) to (c) are diagrams showing an example of transition of screens displayed on the user terminal when calibrating the reference electroencephalogram. (d) and (e) are diagrams showing an example of transition of screens displayed on the user terminal when calibrating the reference electroencephalogram.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

<Overall system configuration>
First, the overall configuration of an electroencephalogram measurement system 1 according to this embodiment will be described. FIG. 1 is a diagram showing an example of the overall configuration of an electroencephalogram measurement system 1 according to this embodiment.
As illustrated, this electroencephalogram measurement system 1 has an electroencephalogram measurement device 2 that measures (senses) a user's electroencephalogram, and a user terminal 3 that receives an operation from the user. In this embodiment, an electroencephalogram measurement system 1 is used as an example of an information processing system. Moreover, the user terminal 3 is used as an example of the information processing device.

Wireless communication is performed between the electroencephalogram measurement device 2 and the user terminal 3 . More specifically, pairing is established between the electroencephalogram measurement device 2 and the user terminal 3 via Bluetooth (registered trademark), and communication is performed. However, the method of communication between the electroencephalogram measuring device 2 and the user terminal 3 is not limited to the method using Bluetooth, and other wireless technologies may be used. Alternatively, the electroencephalogram measurement device 2 and the user terminal 3 may be connected by wire for communication.

The electroencephalogram measurement device 2 has, for example, an earphone-type (or headphone-type) shape, and is worn on the head of a user whose electroencephalogram is to be measured. In the illustrated example, the electroencephalogram measurement device 2 includes a headband 2a that supports the electroencephalogram measurement device 2 on the top of the user's head, and ear pads 2b that cover the ears. The headband 2a and the ear pads 2b bring the electroencephalogram measurement device 2 into contact with the user so that the user can move.
Then, the electroencephalogram measurement device 2 wirelessly transmits the measured electroencephalogram information to the user terminal 3 . The electroencephalogram is measured as potential information (that is, potential information for measuring the electroencephalogram) detected by electrodes 21 (see FIG. 2), which will be described later.

The user terminal 3 is a terminal device that receives an operation from a user, and is exemplified by a portable information terminal such as a tablet computer or a smart phone. The user terminal 3 receives the brain wave information of the user from the electroencephalogram measuring device 2 . Then, the user terminal 3 performs processing for linking the received electroencephalogram information to a specific state of the user.

More specifically, in the user terminal 3, a reference (electroencephalogram reference; hereinafter referred to as a reference electroencephalogram) is set for linking the electroencephalogram information received from the electroencephalogram measuring device 2 to a specific state of the user. ing. A specific state is, for example, a specific feeling that the user has. Specifically, for example, the user's normal state (hereinafter referred to as normal state), the user's relaxed state (hereinafter referred to as relaxed state), the user's concentrated state (hereinafter referred to as (referred to as a concentrated state). A reference electroencephalogram is set for each of such a plurality of specific states.

Then, the user terminal 3 compares the received electroencephalogram information with a reference electroencephalogram set for each specific state, and determines what state the user is in (that is, when the user is in the normal state). , relaxation state, concentration state, etc.). After judging the state of the user, the user terminal 3 presents the judgment result to the user by displaying it on the display of the user terminal 3 or the like. Also, the user terminal 3 transmits music data to the electroencephalogram measurement device 2 based on the determination result.

Further, the user terminal 3 performs processing for calibrating the reference electroencephalogram. In addition, since biometric information such as electroencephalograms varies among individuals, when biometric information is used, it is necessary to calibrate the biometric information for each individual user. Moreover, even if the brain waves are the same user, the brain waves may change depending on the position where the electroencephalogram measuring device 2 is worn, the environment in which the user is placed, and the like.

Therefore, the user terminal 3 is operated by the user to calibrate the reference electroencephalogram. More specifically, the user proceeds with the work according to the screen of the user terminal 3, and the reference electroencephalogram is calibrated based on the electroencephalogram information of the user.

The user's normal state described above is, for example, the user's normal state of mind. The user's normal state of mind is a state of mind that does not waver. Specifically, for example, it is a state in which the user is at rest (a state of being calm without moving the body) and the eyes are open. Alternatively, for example, the user may be in a state of rest and eyes closed.

Moreover, in the present embodiment, the specific state of the user is not limited to the above-described normal state, relaxed state, and concentrated state. Calmness, relaxation, and concentration are examples of specific emotions that users have. Other specific emotions that the user may have include, for example, joy, sadness, anger, worry, surprise, and the like.
Furthermore, the specific state of the user may be a state that is not associated with the user's emotions. For example, the user's fatigue state, hunger state, drowsiness state, and the like may be regarded as specific states of the user.

Also, in the present embodiment, an example using electroencephalograms as an example of biometric information will be mainly described, but biometric information to which the present embodiment can be applied is not limited to electroencephalograms. Biological information is information emitted by the living body of humans and other animals. The present embodiment can be applied to biometric information that can be associated with a specific state of a living body. Examples of biological information other than electroencephalograms to which this embodiment can be applied include veins (blood flow), heart rate, facial expressions, pulse waves, voiceprints, sweat, action potentials (muscle currents, biocurrents), electrocardiograms, Blood pressure and the like can be exemplified.

<Configuration of electroencephalogram measuring device>
Next, the configuration of the electroencephalogram measurement device 2 will be described. FIG. 2 is a diagram showing a configuration example of the electroencephalogram measurement device 2. As shown in FIG. As illustrated, the electroencephalogram measurement device 2 includes electrodes 21 , an electroencephalogram measurement section 22 , an electroencephalogram processing section 23 , a signal check function execution section 24 , an electroencephalogram transmission section 25 and a sound transmission section 26 .

The electrodes 21 detect electroencephalogram potential information. For example, a plurality of electrodes 21 are provided and arranged at positions where electroencephalograms can be easily measured when the user wears the electroencephalogram measuring device 2 .

The electroencephalogram measurement unit 22, for example, amplifies the potential difference between two electrodes 21 out of the electrodes 21 and measures it as an electroencephalogram. The electroencephalograms measured by the electroencephalogram measurement unit 22 are output to the electroencephalogram processing unit 23 . In this embodiment, the method of measuring electroencephalograms is not limited, and conventional methods may be used.

The electroencephalogram processing unit 23 performs predetermined processing on the electroencephalograms output from the electroencephalogram measurement unit 22 . Predetermined processing includes, for example, various types of processing such as processing for removing noise contained in the electroencephalogram signal and shaping the waveform, and processing for further amplifying the electroencephalogram signal. The electroencephalograms processed by the electroencephalogram processing section 23 are output to the electroencephalogram transmission section 25 . Alternatively, the electroencephalograms measured by the electroencephalogram measurement unit 22 may be directly output to the electroencephalogram transmission unit 25 without being processed by the electroencephalogram processing unit 23 .

The signal check function executing unit 24 executes the signal check function, for example, when the electroencephalogram measuring device 2 is activated or before the reference electroencephalogram is calibrated. This signal check function is performed to determine whether or not electroencephalograms can be measured, in other words, to check whether the electroencephalogram measurement unit 22 can normally measure electroencephalograms. In addition, the signal check function does not adjust for individual differences of the user like calibration of the reference electroencephalogram, but inspects errors caused by the device (electroencephalogram measurement device 2) due to poor contact, device failure, etc.・It is for adjustment.

The electroencephalogram transmission unit 25 transmits the electroencephalogram information output from the electroencephalogram processing unit 23 to the user terminal 3 .

The sound transmission unit 26 transmits sound to the outside. For example, the sound transmission unit 26 transmits music to the user based on music data received from the user terminal 3 .

<Hardware configuration of user terminal>
Next, the hardware configuration of the user terminal 3 will be explained. FIG. 3 is a diagram showing a hardware configuration example of the user terminal 3. As shown in FIG.

The user terminal 3 includes a CPU (Central Processing Unit) 31 that provides various functions through the execution of firmware and application programs, and a ROM (Read Only Memory) that is a storage area for storing firmware and BIOS (Basic Input Output System). ) 32 and a RAM (Random Access Memory) 33 as a program execution area.
The user terminal 3 also includes a non-volatile storage device 34 for storing downloaded application programs and the like, a communication interface (communication IF) 35 used for communication with the outside, an input device 36 such as a touch panel, It has a display device 37 including a display used for displaying information, and an imaging camera 38 . A semiconductor memory, for example, is used for the storage device 34 .
Here, the CPU 31 and various devices are connected through a bus 39 .

<Functional configuration of user terminal>
Next, the functional configuration of the user terminal 3 will be described. FIG. 4 is a block diagram showing a functional configuration example of the user terminal 3. As shown in FIG. As illustrated, the user terminal 3 includes an operation reception unit 301 , a display control unit 302 , an electroencephalogram information acquisition unit 303 , a state linking unit 304 , a reference electroencephalogram calibration unit 305 and a reference electroencephalogram storage unit 306 .

An operation reception unit 301 receives an operation from a user. Here, the operation accepting unit 301 accepts an operation for calibrating the reference electroencephalogram, for example.

An electroencephalogram information acquisition unit 303 , which is an example of acquisition means, acquires information on the electroencephalogram of the user measured by the electroencephalogram measurement device 2 .

The state tying unit 304, which is an example of a tying unit, performs processing for tying the electroencephalogram information acquired by the electroencephalogram information acquisition unit 303 to a specific state of the user. Here, the state linking unit 304 compares the electroencephalogram information acquired by the electroencephalogram information acquisition unit 303 with the reference electroencephalogram set for each specific state, and determines what state the user is in. . Then, the state linking unit 304 transmits music data to the electroencephalogram measurement device 2 based on the result of linking by the state linking unit 304 (that is, the determination result of what kind of state the user is in). do.

More specifically, for example, when the state linking unit 304 determines that the user is in a relaxed state, in order to continue the user's relaxed state (or to further relax the user), Data of music considered to have a relaxing effect is transmitted to the electroencephalogram measuring device 2 by wireless communication.

A display control unit 302 as an example of guidance means generates a control signal for controlling the display on the display device 37 and controls the display on the display device 37 .
Here, the display control unit 302 displays, for example, the result of linking by the state linking unit 304 (determination result of what state the user is in).

The display control unit 302 also displays an operation screen for calibrating the reference electroencephalogram, for example. Although the details will be described later, the operation screen for calibrating the reference electroencephalogram includes a screen for guiding the user to a specific state (hereinafter referred to as a guidance screen). Then, the display control unit 302 displays this guide screen on the display device 37 to guide the user to a specific state (for example, normal state, relaxed state, concentrated state).

A reference electroencephalogram calibration unit 305, which is an example of calibration means, performs a process of calibrating the reference electroencephalogram. Here, the reference electroencephalogram calibration unit 305 calibrates the reference electroencephalogram when a predetermined condition is satisfied. A case where a predetermined condition is satisfied is, for example, a case where it is estimated that calibration is necessary. Specifically, for example, when the electroencephalogram measurement device 2 is activated, or when an application program for electroencephalogram measurement is activated. Further, for example, there is a case where a failure occurs in the tying process by the state tying unit 304, or a case where a certain period of time (for example, one month) has passed since the last calibration. Further, for example, calibration may be performed when instructed by the user.

Further, in calibrating the reference electroencephalogram, the guidance screen is displayed as described above. Then, the reference electroencephalogram calibration unit 305 calibrates the reference electroencephalogram based on the electroencephalogram information acquired by guiding the user to a specific state.
A signal check function is executed before the calibration by the reference electroencephalogram calibration unit 305 . After the signal check function determines that no error has occurred, in other words, after confirming that the electroencephalogram information acquisition unit 303 normally acquires electroencephalogram information, the reference electroencephalogram is calibrated.

The reference electroencephalogram storage unit 306 stores reference electroencephalograms set for each specific state of the user. The reference electroencephalograms stored here are the reference electroencephalograms calibrated by the reference electroencephalogram calibration unit 305 . Also, for example, preset values are stored. A preset value is an initial value predetermined as a common value for all users.

Each functional unit that constitutes the user terminal 3 shown in FIG. 4 is realized by the cooperation of software and hardware resources. Specifically, for example, when the user terminal 3 is realized with the hardware configuration shown in FIG. By being executed by the CPU 31, an operation reception unit 301, a display control unit 302, an electroencephalogram information acquisition unit 303, a state linking unit 304, a reference electroencephalogram calibration unit 305, and the like are realized. Also, the reference electroencephalogram storage unit 306 is realized by the storage device 34, for example.

<Description of brain waves>
Next, electroencephalograms measured by the electroencephalogram measurement device 2 will be described.
Focusing on the frequency of brain waves, brain waves are generally classified into five types of components: γ waves, β waves, α waves, θ waves, and δ waves.

Gamma waves are waveforms having a frequency of 30 Hz or higher, and are said to appear in a state of strong anxiety or excitement.
A β wave is a waveform having a frequency of 30 to 13 Hz, and is said to appear when the person is tense or stressed.
Alpha waves are waveforms having a frequency of 13 to 8 Hz, and are said to appear in a calm (relaxed) state or in a state where the eyes are closed.
The θ wave is a waveform having a frequency of 8 to 4 Hz, and is said to appear during deep relaxation or sleep.
A delta wave is a waveform having a frequency of less than 4 hertz, and is said to appear during deep sleep or coma.
In reality, these five types of components are superimposed to form one electroencephalogram. In some cases, γ waves are collectively treated as β waves.

Also, here, the brain waves are classified into five (or four) types of components based on their frequency, but this classification is just an example. In the present embodiment, the electroencephalogram components are not limited to being classified as described above, and the electroencephalogram components may of course be classified according to other criteria.

<Description of signal check function>
Next, the signal check function will be explained. FIGS. 5(a) to 5(f) are diagrams for explaining an example of an electroencephalogram that causes an error in the signal check function. The signal check function execution unit 24 detects an error in an item related to the electroencephalogram signal, such as the flatness of the electroencephalogram signal, the magnitude of the amplitude of the electroencephalogram signal, the frequency ratio of the electroencephalogram signal, etc., as items of the signal check function. determine whether or not

First, the case of inspecting the flatness item of electroencephalogram signals will be described. In this case, for example, an amplitude threshold (threshold 1) and a wave number threshold (threshold 2) are provided as thresholds for determining whether or not an error has occurred. Then, for example, if the number of amplitudes exceeding threshold 1 is less than threshold 2 in electroencephalograms within a certain period of time, an error occurs because the electroencephalogram is too flat. For example, in the electroencephalogram shown in FIG. 5A, the number of amplitudes exceeding threshold 1 is greater than threshold 2, so it is determined to be a normal electroencephalogram. On the other hand, in the electroencephalogram shown in FIG. 5B, since the number of amplitudes exceeding threshold 1 is smaller than threshold 2, it is determined to be an error.

Next, the case of inspecting the item of the magnitude of the amplitude of the electroencephalogram signal will be described. In this case, as a threshold for determining whether an error has occurred, for example, a threshold (threshold 3) indicating the upper limit value of the amplitude is provided. Then, for example, if the amplitude exceeds threshold 3 in an electroencephalogram within a certain period of time, an error occurs because the amplitude is too large. For example, in the electroencephalogram shown in FIG. 5(c), the amplitude does not exceed threshold 3 and is judged to be a normal electroencephalogram. On the other hand, in the electroencephalogram shown in FIG. 5(d), since the amplitude exceeds the threshold value 3, it is judged as an error.

Next, the case of inspecting the item of the frequency ratio of electroencephalogram signals will be described. In this case, for example, a sharpness threshold (threshold 4) is provided as a threshold for determining whether an error has occurred. Then, for example, the frequency component (hertz) and amplitude component (decibel) are extracted from the electroencephalogram within a certain period of time, and if the sharpness exceeds threshold 4, an error occurs. For example, in the electroencephalogram shown in FIG. 5(e), the degree of sharpness does not exceed the threshold value 4, and it is determined as a normal electroencephalogram. On the other hand, in the electroencephalogram shown in FIG. 5(f), since the sharpness exceeds the threshold value 4, it is judged as an error.

The signal check function may be performed on an electroencephalogram in which five types of components are superimposed, or may be performed on some of the five types of components.

In this way, the signal check function executing unit 24 compares the electroencephalogram information measured from the user with the threshold values of various items, and determines whether or not an error has occurred. If an error occurs, it is determined that the electroencephalogram measurement unit 22 cannot normally measure electroencephalograms. Then, the signal check function execution unit 24 notifies the user terminal 3 that an error has occurred, in other words, that normal electroencephalogram measurement by the electroencephalogram measurement unit 22 has not been confirmed. As a result, the display control unit 302 of the user terminal 3 displays on the display device 37 the content of the notified message (or the fact that the brain wave information acquisition unit 303 has not confirmed acquisition of brain waves) to the user. Notice.

Note that the thresholds for various items are predetermined as initial values, or are set as values that can be set/changed by the user.
Also, the items of the signal check function are not limited to the items related to the parameters of the electroencephalogram signal, such as the items described above. For example, the signal check function executing section 24 may check the magnitude of the resistance of the electrode 21 . In this case, for example, the signal check function execution unit 24 determines an error when the magnitude of the resistance is greater than a predetermined upper limit, or determines that an error occurs when the magnitude of the resistance is less than a predetermined lower limit. is judged to be an error.

<Procedure for processing to calibrate the reference electroencephalogram>
Next, a procedure for processing to calibrate the reference electroencephalogram will be described. FIG. 6 is a flow chart showing an example of a processing procedure for the user terminal 3 to calibrate the reference electroencephalogram. In this example, it is assumed that the calibration is performed by guiding the user in the order of the first state, the second state, and the third state. The first state, the second state, and the third state are, for example, a normal state, a relaxed state, and a concentrated state, respectively.

First, after the signal check function determines that no error has occurred, the process of calibrating the reference electroencephalogram is started. Then, the display control unit 302 displays a guidance screen that guides the user to the first state (step 101). Here, the electroencephalogram information acquisition unit 303 acquires information on the electroencephalogram of the user measured by the electroencephalogram measurement device 2 (step 102). In addition, the reference electroencephalogram calibration unit 305 calibrates the reference electroencephalogram for the first state based on the acquired electroencephalogram information (step 103).

Next, after a certain period of time (for example, 5 seconds) has passed since the guidance screen that guides the user to the first state is displayed, the display control unit 302 displays the guidance screen that guides the user to the second state. (Step 104). Here, as in step 102, the electroencephalogram information acquisition unit 303 acquires information on the electroencephalogram of the user measured by the electroencephalogram measuring device 2 (step 105). In addition, the reference electroencephalogram calibration unit 305 calibrates the reference electroencephalogram for the second state based on the acquired electroencephalogram information (step 106).

Next, after a certain period of time (for example, 5 seconds) has passed since the guidance screen that guides the user to the second state is displayed, the display control unit 302 displays the guidance screen that guides the user to the third state. (Step 107). Here, similarly to steps 102 and 105, the electroencephalogram information acquisition unit 303 acquires information on the user's electroencephalogram measured by the electroencephalogram measuring device 2 (step 108). Further, the reference electroencephalogram calibration unit 305 calibrates the reference electroencephalogram for the third state based on the acquired electroencephalogram information (step 109). Then, this processing flow ends.

<Procedure for linking process>
Next, a procedure of linking processing by the state linking unit 304 will be described. FIG. 7 is a flow chart showing an example of a processing procedure for tying by the state tying unit 304. As shown in FIG.

First, the electroencephalogram information acquisition unit 303 acquires information on the electroencephalogram of the user measured by the electroencephalogram measurement device 2 (step 201). Next, the state linking unit 304 compares the obtained information of the electroencephalogram with the reference electroencephalogram (reference electroencephalogram set for each specific state) stored in the reference electroencephalogram storage unit 306 (step 202). . Next, the state linking unit 304 performs a process of linking the acquired brain wave information to a specific state (step 203). For example, when the state linking unit 304 determines that the acquired brain wave information is the brain wave in the relaxed state as a result of the comparison in step 202, the state linking unit 304 performs processing for linking to the relaxed state.

Next, the state linking unit 304 transmits music data to the electroencephalogram measurement device 2 based on the linking result of the state linking unit 304 (step 204). For example, when the state linking unit 304 performs the process of linking to the relaxed state, the state linking unit 304 transmits to the electroencephalogram measurement device 2 data of music considered to have a relaxing effect. As a result, in the electroencephalogram measurement device 2, music is transmitted from the sound transmitting section 26 to the user. Then, this processing flow ends.

<Description of reference electroencephalogram calibration>
Next, calibration of the reference electroencephalogram will be described. FIGS. 8A to 8D are diagrams for explaining an example of calibration of reference electroencephalograms. FIGS. 8A to 8D show brain waves of different users. Specifically, the electroencephalograms shown in FIGS. 8A to 8D are electroencephalograms measured by users A to D, respectively. shows an electroencephalogram. The vertical axis represents the electroencephalogram amplitude (μV), and the horizontal axis represents time.

Here, the reference electroencephalogram calibration unit 305 calculates the average value of the electroencephalogram amplitudes within a certain period of time for each user's electroencephalogram for each state. For example, the reference electroencephalogram calibration unit 305 calculates the average value of the electroencephalogram amplitudes within a certain period of time for each of the normal state, the relaxed state, and the concentrated state of the brain waves of user A shown in FIG. 8(a). do. As a result, the average amplitude is calculated to be 10 μV in the normal state, 30 μV in the relaxed state, and 50 μV in the concentrated state, for example.
When the other users are calculated in the same manner, for user B, the normal state is 5 μV, the relaxed state is 15 μV, and the concentrated state is 25 μV. For user C, for example, the normal state is 10 μV, the relaxed state is 50 μV, and the concentrated state is 60 μV. User D is calculated to be, for example, 5 μV in the normal state, 25 μV in the relaxed state, and 45 μV in the concentrated state.

In addition, the electroencephalogram of user B tends to have a smaller amplitude than the electroencephalogram of user A as a whole. Also, the electroencephalogram of user C shows similar amplitude to the electroencephalogram of user A in the normal state, but the amplitude tends to be larger in the relaxed state and the concentrated state. Furthermore, the electroencephalograms of user D tend to have smaller amplitudes as a whole than the electroencephalograms of user A, but the difference in amplitude between states (for example, the difference between the normal state and the relaxed state) degree.
In this way, since there are individual differences in the electroencephalograms acquired from users, calibration is performed for each individual user.

Then, for example, when calibrating the reference electroencephalogram based on the average amplitude value, the average value in each state is used as the reference electroencephalogram for that state. For example, in the case of user A, the average value (10 μV) of the amplitude in the normal state is used as the reference electroencephalogram in the normal state. Similarly, the average amplitude (30 μV) in the relaxed state is used as the reference electroencephalogram in the relaxed state. Also, the average amplitude (50 μV) in the state of concentration is used as the reference electroencephalogram in the state of concentration. Based on these calibrated reference electroencephalograms, the state linking unit 304 performs linking.

For example, the state tying unit 304 ties to the closest reference electroencephalogram among the reference electroencephalograms of each state. For example, if the amplitude of the electroencephalogram of user A obtained by the electroencephalogram information obtaining unit 303 is 25 μV, the reference electroencephalogram closest to 25 μV among the reference electroencephalograms in each state is 30 μV (reference electroencephalogram in relaxed state). Therefore, the state linking unit 304 links the obtained brain wave information to the relaxed state.

Further, for example, the state linking unit 304 may perform linking based on a certain range from the reference electroencephalogram of each state.
For example, in the case of user A, the reference electroencephalogram in the normal state is 10 μV, the reference electroencephalogram in the relaxed state is 30 μV, and the reference electroencephalogram in the concentration state is 50 μV. In this case, the difference between the normal state and the relaxed state is 20 μV, and the difference between the normal state and the concentrated state is 20 μV. Therefore, a range of 10 μV above and below the reference electroencephalogram is determined. Specifically, it is 0 to 20 μV in the normal state, 20 to 40 μV in the relaxed state, and 40 to 60 μV in the concentrated state. Here, for example, when the amplitude of the electroencephalogram of user A acquired by the electroencephalogram information acquisition unit 303 is 45 μV, the state linking unit 304 associates the acquired electroencephalogram information with the concentration state.
For example, in the case of user C, the reference electroencephalogram in the normal state is 10 μV, the reference electroencephalogram in the relaxation state is 50 μV, and the reference electroencephalogram in the concentration state is 60 μV. In this case, the difference between the normal state and the relaxed state is 40 μV, and the difference between the normal state and the concentrated state is 50 μV. Therefore, unlike user A, for example, the normal state range is set to 0 to 45 μV, the relaxed state range is set to 45 μV to 55 μV, and the concentrated state range is set to 55 to 65 μV.

In this way, a certain range for linking to each state is determined for each individual user based on the normal state. In addition, with the normal state as a reference, the difference between the reference electroencephalogram in the normal state and the reference electroencephalogram in the other state defines a certain range for linking to the other state. However, it is an example to set the reference of a plurality of states to the normal state, and the reference state is not limited to the normal state.

In calibrating the reference electroencephalogram, the reference electroencephalogram calibration unit 305 may calibrate the electroencephalogram using a part of the five types of components of the electroencephalogram described above, or generate an electroencephalogram in which the five types of components are superimposed. may be used for calibration. For example, when calibration is performed using one of the five types of components (for example, alpha waves), the state linking unit 304 also uses the brain wave information of that one component (that is, alpha waves) do the tying. Further, for example, when calibration is performed using electroencephalograms in which five types of components are superimposed, the state linking unit 304 also performs linking using information on electroencephalograms in which five types of components are superimposed.

To explain further, it is assumed that which component of the electroencephalogram appears strongly varies depending on the specific state. Therefore, which of the five types of components is used for calibration and linking may be changed according to a specific state. For example, the relaxation state of the user may be calibrated and linked using only α waves, and the concentration state may be calibrated and linked using β waves.

Note that when only some of the five types of components are used for linking or proofreading, the user terminal 3 performs processing for extracting some of the components from the electroencephalogram in which the five types of components are superimposed. Alternatively, the electroencephalogram measurement device 2 may perform this extraction processing.

Also, in the above example, the calibration using the average value of the amplitude of each state as the reference electroencephalogram has been described, but the calibration of the reference electroencephalogram is not limited to this. For example, the maximum amplitude of each state may be used as the reference electroencephalogram. Alternatively, for example, the value of variance of amplitude may be used as a reference electroencephalogram, and linkage may be performed according to how much the amplitude varies.
Furthermore, calibration may be performed using other parameters of brain waves instead of the amplitude of brain waves. Other parameters include, for example, brain wave wavelength, frequency, cycle, and the like. Alternatively, for example, the appearance rate of brain wave components such as alpha waves may be used for calibration.

<Screen transition when calibrating the reference EEG>
Next, transition of screens displayed on the user terminal 3 when calibrating the reference electroencephalogram will be described. 9-1 and 9-2 are diagrams showing an example of screen transitions displayed on the user terminal 3 when calibrating the reference electroencephalogram. In this example, the user is sequentially guided to a plurality of specific states such as the normal state, the relaxed state, and the concentrated state, and the user's electroencephalograms are measured in each state.

First, when the electroencephalogram measurement device 2 is activated or an application program for electroencephalogram measurement is activated, an initial screen 41 for calibration is displayed as shown in FIG. 9-1(a). Further, the initial screen 41 may be displayed when instructed by the user or when a failure occurs in the linking process, as described above. Before the initial screen 41 is displayed, or after the initial screen 41 is displayed and before guidance to a specific state is started, the signal check function is executed, and the electroencephalogram information acquisition unit 303 It is checked whether or not electroencephalogram information can be acquired.

Here, if the Bluetooth connection between the electroencephalogram measuring device 2 and the user terminal 3 is not confirmed, the user terminal 3 displays a screen prompting the user to confirm the Bluetooth connection. good too.

On the initial screen 41, as shown in FIG. 9-1(a), the application program for electroencephalogram measurement is explained. It also indicates to start calibration. Furthermore, in the area 42, the number of screens used when calibrating the reference electroencephalogram is displayed, and the number of the screen being displayed is displayed. The example shown in FIG. 9-1(a) indicates that it is the first sheet out of five.

Next, when the user performs an operation such as flicking or tapping on the initial screen 41, the screen is switched to the next screen. The next screen is the normal state guidance screen 43 shown in FIG. 9-1(b). The normal state guidance screen 43 is a guidance screen that guides the user to the normal state. More specifically, the area 44 displays a message that reads, "Take your eyes off the screen and take a deep breath with your eyes open." That is, when the user looks away from the normal state guidance screen 43 (the display of the display device 37) and takes a deep breath with the eyes open, the brain waves of the user at that time are measured as normal state brain waves.

Also, the guidance to the user is performed for 5 seconds, for example. That is, the message "Take your eyes off the screen and take a deep breath with your eyes open" is displayed for five seconds. Then, the electroencephalogram information acquisition unit 303 of the user terminal 3 acquires information on the electroencephalogram of the user measured by the electroencephalogram measurement device 2 during these five seconds. The obtained information of the electroencephalogram is used for calibration of the reference electroencephalogram calibration unit 305 as the electroencephalogram in the normal state. At this point, a voice message may be played that reads, "Take your eyes off the screen and take a deep breath with your eyes open."

Note that the area 45 displays the remaining guidance time (for example, the number of seconds). In the example shown in FIG. 9-1(b), it is shown that the remaining time of guidance in the normal state is 5 seconds.
In addition, in area 46, the number of the screen being displayed is displayed in the same manner as in area 42 of FIG. 9-1(a). In the illustrated example, it is shown to be the second sheet out of five.

More specifically, the reference electroencephalogram calibration unit 305 performs calibration using electroencephalograms in a normal state among a plurality of specific states as a reference. Therefore, the display control unit 302 displays the guidance screen in the normal state, which serves as the reference, as the first guidance screen among the plurality of guidance screens. In addition, by first guiding the patient to the reference state, for example, when the patient is induced to another state, the difference from the reference state becomes clear, and the electroencephalogram can be measured normally when the patient is induced to the other state. You can also check whether the

Then, after guidance is performed for 5 seconds on the normal state guidance screen 43, the screen is switched to the next screen. The next screen is the relaxation state guidance screen 47 shown in FIG. 9-1(c). The relaxed state guidance screen 47 is a guidance screen that guides the user to a relaxed state. More specifically, area 48 displays the message "Close your eyes and take a deep breath." That is, when the user closes his/her eyes and takes a deep breath, the brain waves of the user at that time are measured as brain waves in a relaxed state. At this point, the voice message "Please close your eyes and take a deep breath" may be played.

Also, the guidance to the user is performed for 5 seconds, for example, as in the normal state. That is, the message "Please close your eyes and take a deep breath" is displayed for 5 seconds. Then, the electroencephalogram information acquisition unit 303 of the user terminal 3 acquires information on the electroencephalogram of the user measured by the electroencephalogram measurement device 2 during these five seconds. The obtained brain wave information is used for calibration of the reference brain wave calibration unit 305 as a relaxed state brain wave.

The area 49 displays the remaining guidance time (for example, the number of seconds) in the same manner as the area 45 in FIG. 9-1(b).
Further, in the area 50, the number of the screen being displayed is displayed in the same manner as in the area 42 of FIG. 9A. In the illustrated example, it is shown to be the third sheet out of five.

Then, after guidance is performed for 5 seconds on the relaxation state guidance screen 47, the screen is switched to the next screen. The next screen is the concentration state guidance screen 51 shown in FIG. 9-2(d). The concentration state guidance screen 51 is a guidance screen that guides the user to a concentration state. More specifically, area 52 displays the message "Look at the number in the circle." That is, when the user gazes at the numbers shown in the area 53, the brain waves of the user at that time are measured as brain waves in the state of concentration. At this point, a voice message "Look at the number in the circle" may be played.

The area 53 displays the remaining guidance time (for example, the number of seconds) in the same manner as the area 45 in FIG. 9-1(b).
Further, in the area 54, the number of the screen being displayed is displayed in the same manner as in the area 42 of FIG. 9-1(a). In the illustrated example, it is shown to be the 4th sheet out of 5 sheets.

After five seconds of guidance on the concentration state guidance screen 51, the screen is switched to the next screen. The next screen is the end notification screen 55 shown in FIG. 9-2(e). The end notification screen 55 is a screen indicating that the guidance of the user has ended. As illustrated, the end notification screen 55 displays a message indicating that the guidance (that is, measurement of the user's electroencephalogram) has ended. In addition, an explanation will be given of what the application program for electroencephalogram measurement can do in the future, such as visualizing the user's condition and playing music that matches the user's condition. Furthermore, a message indicating the procedure for displaying the initial screen 41 again is displayed so that the user can instruct the calibration again.
In addition, in the area 56, the number of the screen being displayed is displayed in the same manner as in the area 42 of FIG. 9-1(a). In the illustrated example, the fifth screen out of five, that is, the last screen is shown.

In this way, the user is guided to a plurality of specific states in order, and the user's electroencephalogram is measured in each state. Then, calibration is performed by the reference electroencephalogram calibration unit 305 based on the electroencephalogram information in each state of the user.

In the example described above, guidance is performed for 5 seconds in each of the normal state, the relaxed state, and the concentrated state, but the configuration is not limited to this. The induction time may be set longer or shorter than 5 seconds. In addition, it is not necessary to set the guidance time to be the same in all states, and the time may be set according to the guidance in each state.
Also, if an error occurs during the 5 seconds of guidance, calibration may be performed by performing guidance again for 5 seconds.

Furthermore, for example, even if five seconds have elapsed during guidance, if the calibration of the reference electroencephalogram calibration unit 305 has not been completed, the display control unit 302 waits until the calibration of the reference electroencephalogram calibration unit 305 is completed. You may continue to guide to the state (you may continue to display the screen for guiding to the state). Further, for example, the display control unit 302 may end the guidance of the state during the guidance if the calibration of the reference electroencephalogram calibration unit 305 is completed before five seconds elapse (the guidance to the state is completed). You may transition from the screen for doing to the next screen).

Further, in the above-described example, after the induction of one state (calibration of the reference electroencephalogram in the first state) is performed for 5 seconds, the induction of the next state (calibration of the reference electroencephalogram in the next state) is performed. However, it is not limited to such a configuration. A certain period of time (for example, 10 seconds) may be provided between the induction of one state and the induction of the next state. In addition, the display control unit 302 performs induction of the next state (calibration of the reference electroencephalogram in the next state) after a certain period of time has passed after completion of the induction of one state (calibration of the reference electroencephalogram in the first state). calibration) may be started.

To explain further, when guiding the user to the next state after guiding the user to one state, it takes time for the user himself to change from one state to the next state, resulting in state congestion. can be considered. In such a case, the electroencephalogram generated in the first state may be mixed with the electroencephalogram measured in the next state, which may affect the calibration of the reference electroencephalogram in the next state. . Therefore, by providing a certain time between the induction of one state and the induction of the next state, when measuring the brain waves in the next state, the influence of the one state is cut off, and the brain waves of the next state are measured. can be measured accurately.

Also, the order of inducing a plurality of specific states may be set so as not to cause congestion in each state. For example, when comparing the relaxed state and the concentrated state, if the brain waves generated in the relaxed state are brain waves that take a long time to disappear once generated, the relaxed state is performed after the concentration state is induced. is induced.

Further, in the above example, the calibration is performed in all states of the normal state, the relaxed state, and the concentrated state. Only the state may be recalibrated. In this case, for example, in the first calibration procedure, the display control unit 302 displays only the guidance screen in the state where calibration of the reference electroencephalogram is required, and omits the display of the guidance screens in other states. good too.
The state in which reference electroencephalograms need to be calibrated includes, for example, a state in which a certain period of time (for example, one month) has passed since previous calibration, or a state in which linkage is performed among a plurality of specific states. An example is a state in which the number of times the state is broken is less than in other states.

As described above, in the present embodiment, the display control unit 302 of the user terminal 3 displays a guidance screen that guides the user to a specific state, thereby guiding the user to the specific state. Then, the reference electroencephalogram calibration unit 305 of the user terminal 3 calibrates the reference electroencephalogram for linking to the specific state based on the electroencephalogram information acquired by guiding the user to the specific state. In this way, the user can calibrate the reference electroencephalogram by himself/herself by proceeding with the work according to the screen of the user terminal 3 .

Further, in this embodiment, a server device (not shown) that implements all or part of the functions of the user terminal 3 may be provided. In this case, communication is performed between the electroencephalogram measurement device 2 and the server device via the network. Then, for example, when the user accesses the server device using the user terminal 3 , the information of the guidance screen is transmitted from the server device to the user terminal 3 and the guidance screen is displayed on the user terminal 3 . Further, for example, the information of the electroencephalogram measured by the electroencephalogram measurement device 2 is transmitted to the server device, and the server device performs linking and calibration processing. Furthermore, for example, the functions of the operation reception unit 301, the display control unit 302, and the electroencephalogram information acquisition unit 303 are realized in the user terminal 3, and the state linking unit 304, the reference electroencephalogram calibration unit 305, the reference electroencephalogram storage unit 306, etc. The server device may perform the processing of proofreading and linking. In such a case, the server device can be regarded as an example of information processing information, or the server device and the user terminal 3 can be regarded as an example of an information processing system.

In addition, when the user terminal 3 realizes each functional unit shown in FIG. 4, information on the electroencephalogram and the reference electroencephalogram measured by the user is suppressed from leaking out of the user terminal 3. . On the other hand, by realizing the function of the user terminal 3 in the server device, the information of the electroencephalogram and the reference electroencephalogram measured by the user is aggregated in the server device, and the aggregated information is shared by a plurality of users. become able to. Further, by realizing the functions of the user terminal 3 in the server device, the load on the user terminal 3 is reduced.

Furthermore, the electroencephalogram measurement device 2 may perform all or part of the functions of the user terminal 3 . By having the electroencephalogram measuring device 2 execute all or part of the functions of the user terminal 3, for example, the load on the user terminal 3 can be reduced, and the user's operation effort can be reduced. Specifically, for example, an electroencephalogram measurement application program or the like is executed by a control unit (not shown) or the like of the electroencephalogram measurement device 2, thereby realizing the function of the user terminal 3 in the electroencephalogram measurement device 2. . Then, instead of the user performing various operations on the screen of the user terminal 3 , for example, the voice uttered by the user is input to the electroencephalogram measurement device 2 and an instruction is given to the electroencephalogram measurement device 2 . In this case, the electroencephalogram measurement device 2 can be regarded as an example of an information processing device.
Also, for example, the user terminal 3 may execute part of the functions of the electroencephalogram measurement device 2, such as the signal check function.

Further, in the above example, the display control unit 302 displays the guidance screen to guide the user to a specific state, but the method of guidance is not limited to such a method. For example, instead of displaying the guidance screen, a voice such as "Please close your eyes and take a deep breath" may be played from the user terminal 3 to guide the user to a specific state. Alternatively, for example, a scent that is said to have a relaxing effect, such as a scent that guides the user to a specific state, may be emitted from the user terminal 3 to guide the user to a specific state. good. In addition, any method that appeals to the five senses of the user and guides the user to a specific state can be used as a guidance method.

Further, in the above example, music is played based on the result of the association by the state association unit 304, but the user terminal 3 further acquires the user's brain waves while playing the music, It may be determined whether the playing of the music actually made the person relax. Such determination makes it possible to evaluate the relaxing effect of music. Then, when playing music with a relaxing effect from the next time onward, the user terminal 3 performs control so that the music evaluated as having a high relaxing effect is played and the music evaluated as having a low relaxing effect is not played. You may Such a feedback function is implemented, for example, through execution of an application program for electroencephalogram measurement. Also, as an example of such a program, a deep learning program or a machine learning program may be used.

By evaluating the relaxation effect for each user, the music evaluated as having a high relaxation effect and the music evaluated as having a low relaxation effect differ for each user. On the other hand, regarding whether or not there is a relaxing effect, it is also assumed that there is a certain tendency as an effect common to a plurality of users. Therefore, it is possible to share the determination result of whether or not there is a relaxing effect among a plurality of users, and play music using the determination result of other users.

Further, the process using the result of linking is not limited to the process of playing music. Processing using the result of linking is, for example, processing that appeals to the user's five senses, and in addition to playing music, for example, a screen may be displayed or a scent may be emitted.
Furthermore, VR (Virtual Reality) technology and electroencephalogram information may be linked to produce a more realistic presentation. For example, when the user is playing a game using the user terminal 3, by linking the information of the electroencephalogram measured by the user with the user's specific state, the user's specific state ( Music may be played or screens may be switched according to the user's specific feelings.

Further, in the above example, the process of calibrating the reference electroencephalogram is started after the signal check function determines that no error has occurred, but the configuration is not limited to this. For example, calibration may be started without executing the signal check function, or calibration may be started even when an error occurs in the signal check function. Also, for example, the signal check function may be executed after calibration is completed. Furthermore, the signal check function alone may be executed independently of calibration.

In addition, brain waves may be affected by action potentials (biological currents) generated by movements of the user's face. Therefore, as a function similar to the signal check function, a function for checking the user's status may be provided. More specifically, for example, a gyro sensor is provided in the electroencephalogram measurement device 2, and it is confirmed by the gyro sensor whether the user is moving. Then, when it is confirmed that the user is not moving, the calibration and linking of the reference electroencephalogram are started. In other words, proofreading and linking are started when the user's motion satisfies a predetermined motion condition.

Here, the predetermined operation condition is a condition that restricts the user's movement, for example, the condition that the user is seated and does not move his/her face or mouth. For example, if the face is swaying from side to side, the mouth is moving, or the user is walking or running, it is determined that the predetermined operating conditions are not satisfied, and an error is generated. Occur. In this case, for example, the electroencephalogram measurement device 2 notifies the user terminal 3 of an error, and the user terminal 3 displays an error message. This error message includes, for example, a message instructing the user to reduce the action.

Furthermore, as a function similar to the signal check function, a function of checking the degree of contact between the user and the electroencephalogram measurement device 2 may be provided. More specifically, for example, the electroencephalogram measurement device 2 is provided with a sensor that detects the degree of contact with the user. The degree of contact is, for example, the strength of contact between the user and the electroencephalogram measurement device 2 or the area of contact between the user and the electroencephalogram measurement device 2 . For example, when the degree of contact is smaller than a predetermined degree, it is determined that the contact is weak, and the electroencephalogram measurement device 2 notifies the user terminal 3 of an error. Then, on the user terminal 3, for example, a message is displayed to notify the user to touch the electroencephalogram measurement device 2. FIG.

Also, in the above example, the case where there are three specific states, the normal state, the relaxed state, and the concentrated state, has been described, but the specific states are not limited to three. The number of specific states may be two or less, or four or more.

Furthermore, in the above-described example, the electroencephalogram measurement device 2 was used as an example of an information processing device that acquires biometric information. A device is used.
For example, when heart rate is used as biological information, a heart rate measuring device for measuring the heart rate of the user is used. Then, the user terminal 3 associates the heart rate information measured by the heart rate measuring device with the specific state of the user, or calibrates the criteria therefor. More specifically, for example, a guidance screen is displayed on the user terminal 3 to guide the user to the normal state, the relaxed state, and the concentrated state, and the heart rate in each state is measured. Then, for example, a certain range of heart rate is determined in each state and used as a reference for linking. Also, for example, a question screen is displayed on the user terminal 3, and the linking criteria are calibrated based on the answers to the questions. On this question screen, questions are asked about items that affect the heart rate (items that are presumed to have an impact), such as age and gender.

The device for measuring biological information is not limited to a device that is used in contact with the user, and may be a device that is used without contact with the user. For example, when measuring a voiceprint as biometric information, a voiceprint measuring device that measures the voiceprint without contacting the user may be used. Further, for example, when measuring a pulse wave as biological information, an imaging device that does not contact the user may be used, and the pulse wave may be measured from a moving image of the user captured by the imaging device.

Furthermore, in this embodiment, a plurality of pieces of biological information may be used instead of using only one piece of biological information. In other words, a plurality of pieces of biometric information may be used for linking, or a plurality of pieces of biometric information may be calibrated.

In the above example, determining the reference electroencephalogram was explained as "calibrating the reference for linking to a specific state". Determining a certain range for tying to can be regarded as "calibration of criteria for tying to a specific state."

Moreover, the program that implements the embodiment of the present invention can be provided not only by communication means but also by being stored in a recording medium such as a CD-ROM.

Furthermore, although various embodiments and modifications have been described above, it is of course possible to combine these embodiments and modifications.
In addition, the present disclosure is not limited to the above embodiments, and can be embodied in various forms without departing from the gist of the present disclosure.

1... electroencephalogram measurement system, 2... electroencephalogram measurement device, 3... user terminal, 22... electroencephalogram measurement unit, 24... signal check function execution unit, 26... sound transmission unit, 301... operation reception unit, 302... display control unit, 303... electroencephalogram information acquisition unit, 304... state linking unit, 305... reference electroencephalogram calibration unit, 306... reference electroencephalogram storage unit

Claims (16)

Acquisition means for acquiring biometric information of a user;
A linking means for linking the acquired biometric information to a specific state of the user;
and guidance means for guiding the user to the specific state,
The state of the plurality of specific states based on the biometric information acquired by the guidance means guiding the user to the plurality of the specific states in an order set so as not to cause congestion in each state each time, calibrating the criteria for linking to the specific state by the linking means ;
An information processing device characterized by: 2. The information processing apparatus according to claim 1, wherein the order set so as not to cause congestion is an order in which the time from generation to disappearance of the biometric information is short. 2. The information processing apparatus according to claim 1, wherein said guidance means continues to guide said user to said specific state until calibration of said reference is completed. 1. The guidance means starts the guidance to the second specific state after a certain period of time has passed since calibration of the reference for linking to the first specific state is completed. The information processing device according to . 2. The information processing according to claim 1 , wherein, among the plurality of specific states, the specific state first guided by the guiding means is a reference state among the plurality of specific states. Device. 6. The information processing apparatus according to claim 5, wherein the reference state is the normal state of the user. The linking means links the acquired biometric information to the other specific state by a difference between a reference for linking to the reference state and a reference for linking to another specific state that is not the reference state. 6. The information processing apparatus according to claim 5, wherein the information processing apparatus is linked to a specific state of. 2. The information processing apparatus according to claim 1 , wherein if there is a specific state requiring calibration of the reference among the plurality of specific states, only the specific state is recalibrated. . 2. The information processing apparatus according to claim 1, wherein said guide means guides said user to said specific state when said user's motion satisfies a predetermined motion condition. The predetermined operation condition is a condition that restricts the user's operation, and if the user's operation does not satisfy the predetermined operation condition, the user's operation is reduced. 10. The information processing apparatus according to claim 9, wherein the information processing apparatus notifies to do so. 2. The information processing apparatus according to claim 1, wherein said guidance means guides said user to said specific state after it is confirmed that said acquisition means normally acquires said biometric information. 12. The information according to claim 11, wherein when it is not confirmed that said acquisition means normally acquires said biometric information, said user is notified that acquisition of said biometric information is not confirmed. processing equipment. 2. The information processing apparatus according to claim 1, wherein the biological information is potential information for measuring electroencephalograms. 2. The information processing apparatus according to claim 1, wherein said specific state is a specific emotion that said user has. Acquisition means for acquiring biometric information of a user;
A linking means for linking the acquired biometric information to a specific state of the user;
guiding means for guiding the user to the specific state;
The state of the plurality of specific states based on the biometric information acquired by the guidance means guiding the user to the plurality of the specific states in an order set so as not to cause congestion in each state calibration means for calibrating the reference for linking to the specific state by the linking means for each ,
An information processing system having to the computer,
A function to acquire the user's biometric information;
a function of associating the acquired biometric information with a specific state of the user;
a function of guiding the user to the specific state;
Based on the biometric information acquired by guiding the user to a plurality of the specific states in an order set so as not to cause congestion in each state, for each of the plurality of specific states, the the ability to calibrate the criteria for tying to a particular state ;
program to realize

Images