WO2023157237A1

WO2023157237A1 - Information processing system, information processing system control method, and measurement device

Info

Publication number: WO2023157237A1
Application number: PCT/JP2022/006673
Authority: WO
Inventors: 和貴吉永; 辰太郎迫田
Original assignee: 株式会社EarBrain
Priority date: 2022-02-18
Filing date: 2022-02-18
Publication date: 2023-08-24
Also published as: JPWO2023157237A1

Abstract

Provided is an information processing system including at least a user terminal that wirelessly communicates with a measurement device for measuring brainwave data of a user, and an information processing device that analyzes the brainwave data. The measurement device is provided with a brainwave acquisition unit that is worn on an ear of the user and that acquires brainwave data, and a first transmission unit that wirelessly transmits the brainwave data to the user terminal. The information processing device is provided with a reception unit that receives, from the user terminal, the brainwave data of the user acquired by the measurement device, a user state acquisition unit that acquires state data indicating a state of the user when the brainwave data was measured, a generation unit that, in accordance with the brainwave data and the state data, generates an action goal to propose to the user, and a second transmission unit that transmits the action goal to a prescribed output unit.

Description

Information processing system, information processing system control method, and measuring device

The present invention relates to an information processing system, an information processing system control method, and a measuring device, and more particularly to an information processing system for providing an electroencephalogram analysis service.

Conventionally, electroencephalogram measurements are performed in a hospital examination room, etc., with a helmet-type measuring device equipped with multiple electrodes attached to the head. For this reason, the measurement is troublesome and the measurement place is limited. In addition, when the measuring device is worn on the head, the user's hair acts as a resistance, preventing the accuracy of measurement from increasing. In order to reduce this resistance, it is necessary to apply conductive gel to the electrodes. On the other hand, in recent years, there is a headset type electroencephalogram measuring device (for example, Patent Document 1).

JP 2017-108759 A

　There is a demand to acquire the brain waves of users in their daily lives and to understand the user's condition. In response to this demand, the headset-type electroencephalogram measurement device described in Patent Document 1 is difficult to use in daily life.

The present invention provides a measurement device that can be easily worn by the user to measure the user's brain waves while leading a daily life, and provides an action index that matches the user's condition based on the brain wave data acquired from the measurement device. The purpose is to provide an information processing system, etc., capable of

An information processing system according to an embodiment of the present invention is an information processing system that includes at least a user terminal that wirelessly communicates with a measuring device that measures electroencephalogram data of a user, and an information processing device that analyzes the electroencephalogram data, The measurement device includes an electroencephalogram acquisition unit that is worn on the user's ear and acquires electroencephalogram data, and a first transmission unit that wirelessly transmits the electroencephalogram data to the user terminal. An electroencephalogram data acquisition unit that acquires electroencephalogram data, a user state acquisition unit that acquires state data representing the user's state when the electroencephalogram data was measured, and an action goal that is proposed to the user according to the electroencephalogram data and the state data. and a second transmission unit that transmits the action target to a predetermined output unit.

In an information processing system according to an embodiment of the present invention, the information processing device further includes a learning unit that learns a plurality of combinations of electroencephalogram data and state data when the electroencephalogram data was measured, and the generation unit learns Behavioral goals may be generated based on the results of learning by the department.

In the information processing system according to one embodiment of the present invention, the generation unit may generate at least one of a message, voice, image, and video that encourages rest or concentration as an action target.

The information processing system according to one embodiment of the present invention may further include a display section for displaying electroencephalogram data measured by the measuring device.

An information processing system according to an embodiment of the present invention further includes a storage unit that stores model electroencephalogram data obtained when a plurality of model users who satisfy a predetermined skill-related condition have each taken a predetermined action, and a generation unit. may generate an action goal to be proposed to the user based on the comparison between the model electroencephalogram data and the user's electroencephalogram data.

A control method for an information processing system according to an embodiment of the present invention is an information processing system that includes at least a user terminal that wirelessly communicates with a measuring device that measures electroencephalogram data of a user, and an information processing device that analyzes the electroencephalogram data. A control method comprising: acquiring electroencephalogram data with a measuring device attached to the outer ear of a user; and wirelessly transmitting the electroencephalogram data to a user terminal; acquiring user's electroencephalogram data; acquiring state data representing the state of the user when the electroencephalogram data was measured; and generating an action goal to be proposed to the user according to the electroencephalogram data and the state data. and a step of transmitting the action target to a predetermined output unit.

A measuring device according to an embodiment of the present invention may include, as an electroencephalogram acquisition section, at least three or more electrode sections that are electrically insulated from each other on an ear pad that is inserted into the user's outer ear.

A measuring device according to an embodiment of the present invention may further include a main body provided with conductive parts that engage with the ear pads and conduct with the respective electrode parts, and the ear pads may be detachable from the main body.

According to an embodiment of the present invention, a measuring device that can be easily worn by a user and is capable of measuring a user's electroencephalogram while leading a daily life; It is possible to provide an information processing system or the like that can provide a suitable behavior index.

1 is a schematic diagram of an information processing system configuration according to an embodiment of the present invention; FIG. (a) to (d) are schematic diagrams of a measuring device according to an embodiment of the present invention. It is an example of a functional block diagram of a server (information processing device), a user terminal (user's terminal device), and an administrator terminal (administrator's terminal device) according to an embodiment of the present invention. It is a schematic diagram for explaining the operation of the information processing system according to one embodiment of the present invention. 4 is a flow chart showing an operation example of a server according to one embodiment of the present invention;

Hereinafter, one embodiment of the invention (also referred to as the present invention) according to the present disclosure will be described with reference to the drawings. The drawings are only examples, and the present invention is not limited to those shown in the drawings. For example, the illustrated number of servers, user terminal devices, etc., flow chart, appearance of the measuring device, etc. are examples, and the present invention is not limited to these.

<System configuration>
FIG. 1 is a diagram showing a configuration example of an information processing system according to one embodiment of the present invention. The information processing system 600 can realize an electroencephalogram analysis service that provides each user with an action target according to the state of the user based on the electroencephalogram of the user 20 (20A, 20B) measured by the measuring device 300 (300A, 300B). system. In the example of FIG. 1, the number of users is two, but the number of users 20 and the number of measuring devices 300 worn by the users are not limited to this. Hereinafter, when there is no particular need to distinguish between them, the alphabetical characters in the reference numerals of the user 20, the measuring device 300, etc. will be omitted.

According to the electroencephalogram analysis service according to one embodiment of the present invention, the user's state is estimated from the user's electroencephalogram, and an action goal that is in line with the user's state is provided. Here, the "behavior goal" may be an index of behavior or motion. For example, according to an electroencephalogram analysis service, the user's sleep level (depth of sleep) is estimated from the user's electroencephalogram, and content (music, video, voice, etc.) that maintains sleep is provided, or content that promotes awakening is provided. provide. In addition, it estimates the user's fatigue level and provides content for resting or improving concentration. Note that the content provided to the user at this time is customized for each user (details will be described later).

The information processing system 600 includes a server (information processing device) 100, communication terminals (user terminals) 200 and (200A, 200B) of the user 20, a measuring device 300 for measuring brain waves of the user, and a storage device 400.

The server 100 is connected to the user terminal 200 via the network 500 and can execute various processes related to the electroencephalogram analysis service realized by the information processing system 600 . Network 500 may include wireless networks and wired networks. Specifically, for example, the network 500 is a wireless LAN (WLAN), a wide area network (WAN), LTE (long term evolution), a mobile communication system after the fourth generation communication (4G). etc. and combinations thereof. Note that the network 500 is not limited to these examples.

Although only one server 100 is shown in FIG. 1, each function described as being provided by the server 100 may be realized by a plurality of servers. Also, the server 100 may be, for example, a so-called cloud server. In other words, the server 100 is not limited to a physical server, and may include a software virtual server.

Although the details will be described later, the measurement device 300 is worn on the ear (outer ear) of the user 20 and measures the electroencephalogram of the user 20 . Data related to brain waves (brain wave data) measured by the measuring device 300 is transmitted to the user terminal 200 by short-range wireless communication (such as Bluetooth (registered trademark)).

The user terminal 200 is a communication terminal of a user who uses the electroencephalogram analysis service. The user terminal 200 is connected to the server 100 via the network 500 and transmits the electroencephalogram data transmitted from the measuring device 300 to the server 100 . The electroencephalogram data may be transmitted to the server 100 via, for example, an application installed in the user terminal 200 for using an electroencephalogram analysis service. Alternatively, it is not essential to install an application on the user terminal 200, and the user 20 accesses a web page for using the electroencephalogram analysis service provided by the server 100 from the user terminal 200 via a web browser or the like. , the electroencephalogram data may be transmitted to the server 100 .

Although FIG. 1 shows a smartphone as the user terminal 200, the user terminal 200 may be any terminal as long as it can implement the functions described in each embodiment described below. For example, the user terminal 200 may be a mobile phone, a computer (eg, tablet, desktop computer, notebook computer), or a wearable terminal (glasses type device, watch type device, etc.).

The storage device 400 stores (stores) various types of information (data) used by the information processing system 600 . Although only one storage device 400 is shown separately from the server 100 in FIG. 1, it may be integrated with the server 100. FIG. That is, the storage device 400 may be a volatile memory or a non-volatile memory of the server 100. FIG. Further, the storage device 400 may be composed of a plurality of storage devices.

<Measuring device>
2(a)-(d) are schematic diagrams of a measuring device according to an embodiment of the present invention. 2(a) and 2(b) are side views of the measuring device 300, FIG. 2(c) is an ear pad (also referred to as an “ear piece”), and FIG. 2(d) is the measuring device 300 with the ear pad removed. is an example of the body portion 30 of. As shown in FIG. 2, the measuring device 300 according to one embodiment of the present invention is an earphone type measuring device. Note that the measuring apparatus of the present invention is not limited to the one shown in FIG. 2, and the implementation method may be different as long as each function described below can be implemented.

The measuring device 300 is worn on the ear of the user 20 by fitting the ear pad 31 into the user's external auditory canal and the main body 30 into the auricle. The ear pad 31 is provided with a plurality of electrically insulated electrodes 32, which are brought into contact with the user's ear canal to measure electrical signals (brain waves) appearing on the user's 20 skin. In addition, in the example of FIG. 2, the case where four electrodes 32 are provided is shown. The material of the ear pad 31 may be flexible in order to remove artifacts caused by body movements of the user 20 and to ensure contact pressure to the user's 20 external auditory canal. As an example, the ear pads 31 are made of non-conductive elastomers, including non-conductive rubber and non-conductive silicone. The electrodes 32 are made of a conductive elastomer containing conductive rubber, conductive silicon, coated with silver silver chloride (Ag/AgCl), one of the plurality of electrodes 32 being a reference electrode, see one The electroencephalogram may be measured from the potential difference between the reference electrode and the other electrodes, with the remaining two electrodes being the detection electrodes. That is, according to the measuring device according to one embodiment of the present invention, brain waves can be measured only in the external auditory canal. Also, the measuring device according to an embodiment of the present invention may be worn only on one ear, or may be worn on both ears to measure electroencephalograms. Note that the ear pads 31 may be customized for each user, or may be prepared in a plurality of sizes such as large, medium, and small.

The main unit 30 incorporates an electronic circuit (chip) that implements a communication unit 320, an electroencephalogram processing unit 340, a power supply unit 350, etc., which will be described later, processes electroencephalograms measured by the electrodes 32, and wirelessly transmits the electroencephalograms to the user terminal 200. . Moreover, the measuring device 300 may include a speaker 360 and function as a general earphone. The main body part 30 is not particularly limited as long as it is made of a material that does not affect the measurement. It may be made of synthetic resin (plastic).

FIG. 2(c) is a detailed view of the ear pad 31, and FIG. 2(d) shows the body part 30 with the ear pad 31 removed. As described above, in the measurement device 300 according to an embodiment of the present invention, the ear pad 31 may be detachable and replaceable. An earphone mounting portion 34 of the body portion 30 is provided with a conductive portion 33 that conducts with the electrode 32 , and the electrode 32 and the conductive portion 33 are brought into contact with each other to transmit brain waves to a chip in the body portion 30 . The ear pad 31 may wear out due to repeated wearing on the ear, but by making it detachable and replaceable, it is possible to secure the adhesion of the ear pad 31 to the external auditory canal and maintain the accuracy of electroencephalogram measurement.

Next, the hardware configuration and functional configuration of the measuring device 300, the user terminal 200 and the server 100 will be described using FIG.

<Measuring device>
The measurement device 300 includes a control unit 310 , a communication unit (first transmission unit) 320 , an electrode unit (electroencephalogram acquisition unit) 330 , an electroencephalogram processing unit 340 , a power supply unit 350 , a speaker 360 and a storage unit 370 . Control unit 310 is typically a processor and is realized by an MPU (Micro Processing Unit). The communication unit 320 is implemented by, for example, a Bluetooth antenna, and transmits and receives data to and from the user terminal 200 . The electrode portion 330 is the electrode 32 described above. The electroencephalogram processing unit 340 processes electroencephalograms measured by the electrode unit 330 . Processing the brain waves may include signal amplification, noise removal, and analog to digital signal conversion. The power supply unit 350 supplies power to the measuring device 300 . The storage unit 370 stores various programs and various data necessary for the operation of the measuring device 300 . The storage unit 370 may include, for example, flash memory or the like. Storage unit 370 may also include a memory (RAM (Random Access Memory), ROM (Read Only Memory), etc.) that provides a work area for control unit 310 .

<User terminal>
Next, the hardware configuration and functional configuration of the user terminal 200 according to one embodiment of the present invention will be described.

(1) Hardware Configuration of User Terminal User terminal 200 includes control unit 210 , communication unit 220 , display unit 230 , input/output unit 240 , and storage unit 270 .

The control unit 210 is typically a processor, and includes a central processing unit (CPU), MPU (Micro Processing Unit), GPU (Graphics Processing Unit), etc., integrated circuit (IC (Integrated Circuit) chip, LSI ( It is realized by a logic circuit (hardware) formed in Large Scale Integration) or a dedicated circuit. The control unit 210 reads a program stored in the storage unit 270 and executes the code or instructions included in the read program, thereby executing the functions and methods described in each embodiment.

The storage unit 270 stores various programs and various data required for the user terminal 200 to operate. For example, the storage unit 270 stores an application program for using the electroencephalogram analysis service on the user terminal 200 . Storage unit 270 includes, for example, a flash memory or the like. Storage unit 270 also includes a memory (RAM, ROM, etc.) that provides a work area for control unit 210 . Storage unit 270 further includes user information 271 . User information is identification information for uniquely identifying a user who uses the electroencephalogram analysis service, and may be an arbitrary identifier (ID), user name, or the like.

The communication unit 220 is implemented as hardware such as a network adapter, communication software, or a combination thereof. The communication unit 220 transmits and receives various data to and from the server 100 via the network 500 . The communication may be performed by wire or wirelessly, and any communication protocol may be used as long as mutual communication can be performed. The communication unit 220 also transmits and receives various data (eg, electroencephalogram data) to and from the measuring device 300 by short-range wireless communication. The communication unit 220 also transmits various data to the server 100 according to instructions from the control unit 210 . For example, the communication unit 220 may receive various data transmitted from the server 100 and transmit the data to the control unit 210 . In addition, when the communication unit 220 is composed of a physically structured circuit, it may be expressed as a communication circuit.

The display unit 230 is a monitor that displays data according to the display data written in the frame buffer, and is, for example, a touch panel, a touch display, or the like.

The input/output unit 240 includes an input device for inputting various operations to the user terminal 200 and an output device for outputting processing results processed by the user terminal 200 . Input devices include, for example, touch panels, touch displays, cameras, and microphones. The output device outputs the processing result processed by the control unit 210, and includes, for example, a display, a touch panel, a speaker, and the like.

(2) Functional Configuration of User Terminal The user terminal 200 includes a communication control section 211 , a display control section 212 , and an input/output control section 213 as functions realized by the control section 210 . Note that each functional unit shown in FIG. 2 is not essential, and non-essential functional units may be omitted in each embodiment described below. Also, the function or processing of each functional unit may be realized by machine learning or AI (Artificial Intelligence) within a feasible range. It should be noted that the server 100 may execute part of the various processes described below assuming that the user terminal 200 executes them.

The communication control unit 211 controls communication with the server 100 via the network 500 by the communication unit 220, and executes transmission and reception of various information. Also, the communication control unit 211 controls short-range wireless communication with the measuring device 300 by the communication unit 220 .

The display control unit 212 controls the display of data on the display unit 230. For example, the display control unit 212 causes the display unit 230 to display information about the measured electroencephalogram data.

The input/output control unit 213 controls transmission of various types of information with external devices via the input/output unit 240 . For example, the input/output control unit 213 transmits various types of information to each functional unit according to the input operation of the user 20 received by the input device, It transmits information from each functional unit. The input/output control unit 213 also includes a user state input unit 214 . The user state input unit 214 receives input from the user 20 indicating what state the user is in. For example, when the user's electroencephalogram is received from the measuring device 300, the user state input unit 214 receives input of information regarding the action that the user was performing as the user state. The information about the action performed by the user includes, for example, information about the action object (music name, movie name, TV program, book title, etc.), exercise information (running, yoga, walking, etc.), and place information. (Park, city, forest, sea, etc.) and the like. Further, as the user state, input of information indicating the user's psychological state may be received from the user. The information indicating the user's mental state may be information obtained by subjectively judging by the user what kind of mental state the user is in, such as user's emotions, surprise, stress, concentration, or the like. Information indicating the psychological state of the user is displayed on the display unit 230, for example, as options such as "fun", "sad", "interesting", "angry", "feeling stress", and "concentrating". may be displayed and input by the user to select.

<server>
Next, the hardware configuration and functional configuration of the server 100 according to one embodiment of the present invention will be described.

(1) Server Hardware Configuration The server 100 includes a control unit 110 , a communication unit (second transmission unit) 120 and a storage unit 170 .

The control unit 110 is typically a processor and includes a central processing unit (CPU), MPU, GPU, microprocessor, processor core, multiprocessor, ASIC, FPGA, etc., and is formed in an integrated circuit chip, LSI, or the like. It may be realized by a logic circuit (hardware) or a dedicated circuit.

The storage unit 170 stores various programs and various data required for the server 100 to operate. The storage unit 170 includes, for example, an HDD, SSD, flash memory, and the like. Storage unit 170 also includes a memory that provides a work area for control unit 110 .

The communication unit 120 is implemented as hardware such as a network adapter, communication software, or a combination thereof. The communication unit 120 transmits and receives various data to and from the user terminal 200 via the network 500 . The communication unit 120 transmits various data to the user terminal 200 according to instructions from the control unit 110 . Also, the communication unit 120 receives various data transmitted from the user terminal 200 and transmits the data to the control unit 110 .

(2) Functional configuration of the server The server 100 includes a communication control unit 111, an electroencephalogram data acquisition unit 112, a user state acquisition unit 113, an analysis unit 114, a learning unit 115, and a generation unit 116 as functions realized by the control unit 110. Prepare. Note that each functional unit shown in FIG. 2 is not essential, and non-essential functional units may be omitted in each embodiment described below. Also, the function or processing of each functional unit may be realized by machine learning or AI within the realizable range.

The communication control unit 111 controls communication with the user terminal 200 via the communication unit 120.

The electroencephalogram data acquisition unit 112 acquires electroencephalogram data transmitted from the user terminal 200 . The electroencephalogram data may be associated with user information for identifying which user the data belongs to.

The user status acquisition unit 113 acquires the user status described above. Note that the user state is associated with the electroencephalogram acquired by the electroencephalogram data acquisition unit 112 . “Associating a user state with an electroencephalogram” may refer to associating a certain user state with electroencephalogram data measured while in that user state.

The analysis unit 114 analyzes the electroencephalogram data. Analytical processing refers to the Fourier transform of electroencephalogram data, which is time-series data, into frequency data, the removal of artifacts (noise different from electroencephalograms) included in the electroencephalogram data, and the like.

The generation unit 116 generates action goals to be proposed to the user according to the electroencephalogram data and the state data. That is, the generation unit 116 generates the action target of the user from the electroencephalogram frequency data analyzed by the analysis unit 114 . In general, brain waves are δ (delta) waves (0.5-3 Hz), θ (theta) waves (4-7 Hz), α (alpha) waves (8-13 Hz), β (beta) waves (14-30 Hz), depending on the frequency. , γ (gamma) waves (30 Hz or higher). The amount of expression of these brain waves indicates what state the user is in (deep sleep, meditation, creativity and insight, joyful immersion, calmness). , relaxed state, frustrated state, worry, tension, anger, excitement, etc.). For example, the generation unit 116 detects, as a result of the analysis by the analysis unit 114, the timing of changing from β waves and γ waves emitted when one is concentrating to α waves emitted when one is drowsy, Action goals may be generated. The action goal generated by the generation unit 116 is transmitted from the communication unit 120 to the user terminal 200 and displayed on the display unit 230 of the user terminal 200, or transmitted from the user terminal 200 to the measurement device 300 to function as an earphone. It may be output by sound from the measuring device 300 . For example, the action goal is to output an alert from the user terminal 200 or output an announcement from the measuring device 300 such as "It's about time to lose concentration. Let's take a break for 5 minutes." good.

The learning unit 115 learns a plurality of combinations of electroencephalogram data and state data when the electroencephalogram data was measured. For example, the learning unit 115 may store, in the storage device 400 for each user, state data of the user when brain wave frequency data (α waves, β waves, etc.) was measured. FIG. 3 shows an example of a table TB10 in which electroencephalogram data and state data are associated with each user. In the example of FIG. 3, alpha waves are measured when user A listens to music A or music B or watches movie C. FIG. In addition, β waves are measured when user A listens to music E, reads book D, walks, and the like. According to one embodiment of the present invention, the user can lead a daily life while wearing the earphone-type measuring device 300, so that it is possible to acquire electroencephalograms that transition in the daily life. At this time, since state data related to the user's state is also acquired, what kind of brain waves (α waves, β waves, etc.) are obtained when the user is in what state (behavior, movement, target object, etc.) ) is measured can be accumulated for each user.

Also, learning by the learning unit 115 may be performed as follows. For example, regarding the judgment of the presence or absence of concentration, the user as a subject performs a simple task that requires concentration for a predetermined time (for example, 30 seconds) and does nothing for a predetermined time (for example, 30 seconds). Acquire electroencephalogram data during repetition with the relaxed state. A simple task that requires concentration may be a known game application, calculation, or the like. At this time, the electroencephalogram data during work that requires concentration is labeled as "1", the electroencephalogram data during relaxation is labeled as "0", the state of the electroencephalogram is labeled as an explanatory variable, and the labels 0 and 1 as the presence or absence of concentration are labeled as objective variables. , supervised machine learning can be performed. By conducting the above verification with several people to several dozen people for about 10 minutes, when counting the peak to peak of the brain wave as one wave, it is possible to collect a sufficient amount of brain wave data for hundreds of thousands of machine learning. can. Furthermore, with the consent of the user, acquisition of learning data and machine learning may continue during predetermined actions (executing an application, listening to music, exercising, etc.) performed in daily life.

The generation unit 116 may generate action goals based on the learning result of the learning unit 115 . For example, when gamma waves indicating that user A is tense or highly stressed are measured, the generation unit 116 creates a relaxed state based on the table TB10 for user A (generates alpha waves). may be output from the measuring device 300 . Note that the action goal does not necessarily have to be the same as the user's past action. For example, through learning by the learning unit 115, genres of music and videos, and categories of motions that the user is likely to produce α waves are estimated, such as “user A emits α waves when listening to modern classical music”, “user B emits α waves at 70 A setting such as β wave is emitted when listening to age rock may be made.

The action goal may be at least one of a message, voice, image, and moving image that encourages rest or concentration. Also, the output destination of the action target may be the display unit 230 of the user terminal 200, the measuring device 300, or a smart speaker (not shown). Also, when the user terminal 200 is a wearable terminal, the output destination may be the display or speaker of smart glasses or a smart watch.

Detailed information about the electroencephalogram data analyzed by the analysis unit 114 may be displayed on a predetermined display unit together with time axis data, frequency data, state data, and the like. For example, as the detailed information, time-axis data of the user's electroencephalogram and the state of the user when certain frequency data (α waves, β waves, etc.) appear may be listed. Detailed information may be provided by an API (Application Program Interface), for example. That is, the information processing system 600 according to an embodiment of the present invention can provide a platform for electroencephalogram data.

<Other embodiments>
According to the information processing system according to another embodiment of the present invention, the storage device 400 stores model electroencephalogram data obtained when a plurality of users who satisfy a predetermined skill-related condition have each taken a predetermined action. A "predetermined condition regarding skill" refers to a predetermined condition regarding some ability such as user's academic ability, physical ability, or artistic ability. Acquisition of a score equal to or higher than a predetermined threshold", "cook", "musician", "painter", "novelist", "swimmer", and the like. According to one embodiment of the present invention, electroencephalograms obtained when a plurality of users who satisfy a predetermined condition regarding these skills take a predetermined action may be accumulated as model electroencephalogram data. The predetermined actions are actions related to skills, such as playing a musical instrument in the example of a "musician", cooking in the example of a "cook", and scoring above a predetermined threshold in an academic test If it is a user who "acquired", it may be studying, taking a test, or the like.

The generation unit 116 generates an action goal to be proposed to the user based on the comparison between the model electroencephalogram data and the user's electroencephalogram data. The generation unit 116 may score the user's brain wave based on the difference between the user's brain wave data and the model brain wave data, and generate content (BGM music, message, etc.) as an action target based on the score. . Regarding scoring, for example, the duration of β waves and γ waves of model electroencephalogram data that appears in a concentrated state is measured, and the data with the longest duration in each action (cooking, academic ability test, playing a musical instrument) is set to 100. Then, the individual user's β-wave or γ-wave duration may be calculated as a percentage and scored.

<Server control flow chart>
A method of controlling the server 100 will be described with reference to the flowchart of FIG. First, the server 100 receives, from the user terminal 200, electroencephalogram data acquired by the measuring device 300 worn on the user's ear and transmitted to the user terminal 200 (step S11). The server 100 further acquires state data representing the state of the user when the electroencephalogram data was measured (step S12). Also, an action goal to be proposed to the user is generated according to the electroencephalogram data and the state data (step S13). Next, the server 100 transmits the action target to a predetermined output unit (step S14).

Although the present invention has been described based on the drawings and examples, it should be noted that those skilled in the art can easily make various modifications and modifications based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present invention. For example, the functions included in each component, each step, etc. can be rearranged so as not to be logically inconsistent, and multiple components, steps, etc. can be combined into one or divided. is. Further, the configurations shown in the above embodiments may be combined as appropriate. Note that the user terminal 200 may execute the processing described above as being executed by the server 100 .

Also, the measuring device 300 is not limited to the illustrated one. In the above description, a measuring device is described in which an ear pad having a plurality of electrodes including a reference electrode and a reference electrode is inserted into the ear (external auditory canal). However, the measuring device may be one in which the reference electrode and the reference electrode are attached to the auricle or the mastoid process. The electrodes may be formed by coating the surface of the ear pad with silver-silver chloride (Ag/AgCl), or by mixing silver-silver chloride (Ag/AgCl) with the material of the ear pad and molding. In addition, the method of realizing the electrodes is not limited to the surface electrodes described above, and any electrodes that can acquire biological information, such as needle electrodes, may be used.

For example, services that can be provided by the electroencephalogram analysis service according to one embodiment of the present invention are described below.
・When it is determined from the user's brain waves that the user has become sleepy, a message such as "You should go to bed soon and wake up early tomorrow" will be sent from the user terminal. The quality of the user's sleep is measured from the received brain waves and notified from the user terminal. ・At factories and construction sites, if a decline in the concentration of workers is detected from the brain waves, the worker will be warned by voice etc. If there is no improvement in the worker's EEG, notify the manager or stop the work (e.g., machine) (applicable to long-distance drivers)

The program of each embodiment of the present disclosure may be provided in a state stored in a storage medium readable by the information processing device. The storage medium can store the program in a "non-temporary tangible medium". Programs include, for example, software programs and control programs. When each functional unit of the server 100 is realized by software, the server 100 executes a program loaded on the memory by the processor, thereby causing the communication control unit 111, the electroencephalogram data acquisition unit 112, the user state acquisition unit 113, the analysis It functions as a unit 114 , a learning unit 115 and a generation unit 116 .

The storage medium may, where appropriate, be one or more semiconductor-based or other integrated circuits (ICs) (e.g., field programmable gate arrays (FPGAs), application specific ICs (ASICs), etc.); Disk drive (HDD), hybrid hard drive (HHD), optical disk, optical disk drive (ODD), magneto-optical disk, magneto-optical drive, floppy diskette, floppy disk drive (FDD), magnetic tape, solid state drive (SSD), RAM drive, secure digital card or drive, any other suitable storage medium, or any suitable combination of two or more thereof. Storage media may, where appropriate, be volatile, nonvolatile, or a combination of volatile and nonvolatile.

Also, the program of the present disclosure may be provided to the server 100 via any transmission medium (communication network, broadcast waves, etc.) capable of transmitting the program.

Each embodiment of the present disclosure can also be implemented in the form of a data signal embedded in a carrier wave in which a program is embodied by electronic transmission. Note that the program of the present disclosure may be implemented using, for example, script languages such as JavaScript (registered trademark) and Python, C language, Go language, Swift, Koltin, Java (registered trademark), and the like.

100 server (information processing device)
110 control unit 111 communication control unit 112 electroencephalogram data acquisition unit 113 state data acquisition unit 114 analysis unit 115 learning unit 116 generation unit 120 communication unit 170 storage device 200 user terminal (terminal device)
210 control unit 211 communication control unit 212 display control unit 213 input/output control unit 214 electroencephalogram data input unit 220 communication unit 230 display unit 240 input/output unit 270 storage unit 300 measurement device 310 control unit 320 communication unit 330 electrode unit 340 electroencephalogram processing unit 350 power supply unit 360 speaker 370 storage unit 400 storage device 500 network 600 information processing system

Claims

An information processing system including at least a user terminal that wirelessly communicates with a measuring device that measures electroencephalogram data of a user, and an information processing device that analyzes the electroencephalogram data,
The measuring device is
an electroencephalogram acquisition unit that is worn on the ear of the user and acquires the electroencephalogram data;
a first transmission unit that wirelessly transmits the electroencephalogram data to the user terminal;
with
The information processing device is
an electroencephalogram data acquisition unit that acquires the user's electroencephalogram data acquired by the measurement device;
a user state acquisition unit that acquires state data representing the state of the user when the electroencephalogram data was measured;
a generation unit that generates an action goal to be proposed to the user according to the electroencephalogram data and the state data;
a second transmission unit that transmits the action goal to a predetermined output unit;
An information processing system comprising:
The information processing device is
further comprising a learning unit that learns a plurality of combinations of the electroencephalogram data and the state data when the electroencephalogram data was measured;
The generation unit generates the action goal based on the learning result of the learning unit.
The information processing system according to claim 1.
The generating unit generates at least one of a message, voice, image, and moving image encouraging rest or concentration as the action goal.
The information processing system according to claim 1 or 2.
The information processing system is
Further comprising a display unit for displaying the electroencephalogram data measured by the measuring device,
The information processing system according to any one of claims 1 to 3.
The information processing system is
further comprising a storage unit that stores model electroencephalogram data obtained when a plurality of model users who satisfy a predetermined skill-related condition have each taken a predetermined action;
The generation unit generates the action goal to be proposed to the user based on a comparison between the model electroencephalogram data and the electroencephalogram data of the user.
The information processing system according to any one of claims 1 to 4.
A control method for an information processing system including at least a user terminal that wirelessly communicates with a measuring device that measures electroencephalogram data of a user, and an information processing device that analyzes the electroencephalogram data,
to the measuring device,
wearing the user's outer ear to acquire the electroencephalogram data;
wirelessly transmitting the electroencephalogram data to the user terminal;
and
In the information processing device,
a step of acquiring electroencephalogram data of the user acquired by the measuring device;
obtaining state data representing the state of the user when the electroencephalogram data was measured;
generating an action goal to be proposed to the user according to the electroencephalogram data and the state data;
transmitting the action goal to a predetermined output;
An information processing system control method for executing
As the electroencephalogram acquisition unit, an ear pad inserted into the user's outer ear is provided with at least three or more electrode units that are electrically insulated from each other,
A measuring device in an information processing system according to any one of claims 1 to 5.
The measuring device is
further comprising a body portion provided with a conductive portion that engages with the ear pad and conducts with each of the electrode portions;
The ear pad is detachable from the main body,
The measuring device according to claim 7.