JP7018640B2 - Information processing equipment, information processing methods and information processing programs - Google Patents

Description

The present invention relates to an information processing apparatus, an information processing method and an information processing program.

In general, it is considered that when the respiratory cycle and depth are stabilized in deep breathing, the activity of the sympathetic nerve of the autonomic nerve is suppressed and a certain relaxing effect is obtained. Suppressing sympathetic nerve activity by deep breathing is also used for the treatment of post-traumatic stress disorder (PTSD). Therefore, a technique for inducing the timing of deep breathing has also been proposed.

Japanese Unexamined Patent Publication No. 2013-63124

However, in the prior art, no proposal has been made to induce respiration so that the activity of the sympathetic nerve can be suppressed. For this reason, in deep breathing training aimed at relaxing such as meditation, whether breathing can be stabilized depends largely on the experience and skill of the instructor, and breathing is aimed at suppressing the activity of the sympathetic nerve. It has been difficult to provide a method of stabilizing.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an information processing device capable of guiding a user to perform breathing capable of suppressing sympathetic nerve activity. Is.

One aspect of the present invention is exemplified by the following information processing apparatus. This information processing device is attached to the user's head and receives the detection value detected by the head-mounted device that detects the blood flow in the head, and the time change of the blood flow from the detected value. A calculation unit that calculates the time change of the carbon dioxide concentration in the blood of the head and the cycle and depth of the user's breathing based on the extraction unit that extracts the indicated component and the component that indicates the time change of the extracted blood flow. Based on the calculated time change of the blood carbon dioxide concentration in the head and the breathing cycle and depth of the user, the user's blood carbon dioxide concentration in the head becomes substantially constant. It includes a specific unit that specifies the breathing cycle and depth, and an output unit that outputs information that guides the user's breathing so that the user's breathing cycle and depth are the specified breathing cycle and depth. ..

Further, in the above information processing apparatus, the extraction unit extracts a component indicating the time change of the pulse wave of the head from the detected value, and the calculation unit is based on the component indicating the time change of the pulse wave of the head. , The time change of the user's heart rate is calculated, and the specific part is in the time zone when the carbon dioxide concentration in the blood of the head becomes substantially constant based on the calculated time change of the user's heart rate. A time zone in which the user's heart rate is substantially constant may be specified, and the cycle and depth of the user's breathing in the specified time zone may be specified.

Further, the information processing apparatus according to another aspect of the present invention has a specific unit that specifies the cycle and depth of the user's respiration in a time zone in which the time change of the user's heart rate is substantially constant, and the user's respiration. It may be provided with an output unit that outputs information for inducing the user's breathing so that the cycle and depth of the breathing becomes the specified breathing cycle and depth.

The second aspect of the present invention is attached to the user's head, receives the detection value detected by the head-mounted device that detects the blood flow in the head, and obtains the time change of the blood flow from the detected value. The indicated components are extracted, and based on the extracted components indicating the time change of blood flow, the time change of the blood carbon dioxide concentration in the head and the cycle and depth of the user's breathing are calculated and calculated. The cycle and depth of the user's breathing during the time period when the blood carbon dioxide concentration in the head is substantially constant based on the time variation of the blood carbon dioxide concentration of the head and the cycle and depth of the user's breathing. Can be exemplified as an information processing method for specifying and outputting information for inducing the user's breathing so that the user's breathing cycle and depth become the specified breathing cycle and depth.

Further, in the above information processing method, a component indicating the time change of the pulse wave of the head is further extracted from the detected value, and the heart rate of the user is based on the component showing the time change of the pulse wave of the head. The user's heart rate becomes substantially constant during the time period when the carbon dioxide concentration in the blood of the head becomes substantially constant based on the calculated time change of the user's heart rate. A time zone may be specified and the cycle and depth of the user's breathing in the specified time zone may be specified.

Further, the information processing method according to another aspect of the present invention specifies the cycle and depth of the user's breathing in a time zone in which the time change of the user's heart rate is substantially constant, and the user's breathing cycle and the user's breathing cycle. Information that guides the user's breathing may be output so that the depth is the specified breathing cycle and depth.

Further, the third aspect of the present invention is a step of receiving a detection value detected by a head-mounted device mounted on the user's head and detecting blood flow in the head, and a detection value. Based on the step of extracting the component showing the time change of blood flow and the component showing the time change of the extracted blood flow, the time change of the carbon dioxide concentration in the blood of the head and the cycle and depth of the user's breathing. The time during which the blood carbon dioxide concentration in the head becomes substantially constant based on the step of calculating the speed, the time change of the calculated blood carbon dioxide concentration in the head, and the cycle and depth of the user's breathing. A step to specify the user's breathing cycle and depth in the band, and a step to output information to guide the user's breathing so that the user's breathing cycle and depth are the specified breathing cycle and depth. It can be exemplified as an information processing program that executes and.

Further, in the above information processing program, the computer further uses the step of extracting the component indicating the time change of the pulse wave of the head from the detected value and the component indicating the time change of the pulse wave of the head. The user's heart rate during the time period when the carbon dioxide concentration in the blood of the head becomes substantially constant based on the step of calculating the time change of the person's heart rate and the calculated time change of the user's heart rate. A time zone in which the number is substantially constant may be specified, and a step of specifying the cycle and depth of the user's breathing in the specified time zone may be executed.

Further, the information processing program according to another aspect of the present invention provides a computer with a step of specifying the cycle and depth of the user's breathing in a time zone in which the time change of the user's heart rate is substantially constant, and the user. A step of outputting information that induces the user's breathing may be performed so that the breathing cycle and depth of the user becomes the specified breathing cycle and depth.

According to the present invention, it is possible to provide an information processing device capable of guiding a user to perform breathing that can suppress the activity of the sympathetic nerve.

FIG. 1 is a diagram illustrating a schematic configuration of a measurement system according to an embodiment of the present invention. FIG. 2 is a perspective view illustrating the appearance of the head-mounted device as viewed from the lower rear. FIG. 3 is a plan view of the head mounting device as viewed from above. FIG. 4 is a front view of the head mounting device as viewed from the front. FIG. 5 is a diagram showing an example of a flowchart of processing executed in the user terminal according to the embodiment. FIG. 6 is a diagram showing an example of a brain activity waveform, a signal of a blood flow change component, and a signal of a pulse wave component. FIG. 7 is a diagram showing an example of processing of a subroutine executed in the user terminal according to the embodiment. FIG. 8 is a diagram showing an example of processing of a subroutine executed in the user terminal according to the embodiment. FIG. 9 is a diagram illustrating the correlation between the depth of respiration and the CO ₂ concentration in respiration. FIG. 10 is a diagram showing an example of a screen displayed on the user terminal according to the embodiment. FIG. 11 is a diagram showing an example of a flowchart of processing executed in the user terminal according to the embodiment.

Hereinafter, the measurement system according to the embodiment will be described with reference to the drawings. FIG. 1 is a diagram illustrating a schematic configuration of a measurement system according to an embodiment of the present invention. This measurement system detects measurement data (also referred to as a detected value) indicating a change in blood flow from the user's head, and acquires brain activity information indicating the activity state of the user's brain. As shown in FIG. 1, this measurement system has a head-mounted device 1 and a user terminal 2. The head-mounted device 1 has a control unit 11, a wireless communication unit 13, and a pair of sensors 115 and 125 as aspects of information processing. The control unit 11 controls the measurement and communication of the head-mounted device 1. The control unit 11 has, for example, a processor such as a CPU (Central Processing Unit) or a DSP (Digital Signal Processor) and a memory, and executes processing by a computer program, firmware, or the like executably deployed on the memory. .. However, the control unit 11 may be an FPGA (Field Programmable Gate Array) or a dedicated hardware circuit that activates the wireless communication unit 13 and the sensors 115 and 125 and executes the cooperation processing with each component. Further, the control unit 11 is a CPU.
A DSP, a dedicated hardware circuit, or the like may be mixed.

The wireless communication unit 13 is connected to the control unit 11 and the sensors 115 and 125 by a predetermined interface. However, the wireless communication unit 13 may be configured to acquire data from the sensors 115 and 125 via the control unit 11. The wireless communication unit 13 communicates with the user terminal 2 via the network N1. The network N1 is a network according to standards such as Bluetooth (registered trademark), wireless LAN (Local Area Network), and ZigBee (registered trademark). However, in this measurement system, the standard of the wireless interface of the wireless communication unit 13 is not limited. Further, the network N1 may be a wired network.

Further, in this measurement system, a communication unit that communicates by wire may be provided in place of the wireless communication unit 13 or together with the wireless communication unit 13. That is, the head-mounted device 1 and the user terminal 2 may be connected by a wired communication interface. The wired communication interface in this case is not limited, and various interfaces such as USB (Universal Serial Bus) and PCI Express can be used depending on the application of the measurement system.

Both the sensors 115 and 125 irradiate the head with near-infrared light, receive the near-infrared light partially absorbed and scattered near the cerebral cortex, and convert it into an electric signal. In the cerebral cortex, for example, the blood flow volume changes according to the activity state of the brain, and due to the change, the absorption characteristic or the scattering characteristic of near-infrared light in the vicinity of the cerebral cortex changes. The sensors 115 and 125 convert near-infrared light whose amount of light changes due to a change in near-infrared light absorption rate or a change in transmittance according to the state of blood flow near the cerebral cortex into an electric signal and output it. do.

In this measurement system, the sensors 115 and 125 irradiate near-infrared light and convert the received near-infrared light into an electric signal at predetermined time intervals such as 0.1 seconds. As a result, data on changes in blood flow in the brain of the user wearing the head-mounted device 1 can be obtained at the time interval. Further, the sensors 115 and 125 output data on a change in blood flow in the right forehead and the other output data on a change in blood flow in the left forehead.

Further, the sensors 115 and 125 include, for example, a near-infrared light source that irradiates near-infrared light and a light receiving unit that receives near-infrared light. Near-infrared light sources include, for example, LEDs (Light Emitting Diodes).
), Infrared light lamp, etc. Further, the light receiving unit includes a photoelectric element such as a photodiode and a phototransistor, an amplifier, and an AD (Analog Digital) converter. The near-infrared light source and the light receiving unit may not be provided as a pair. For example, a plurality of light receiving units may be provided for one near infrared light source.

The user terminal 2 is, for example, a smartphone, a mobile phone, a mobile information terminal, a PHS (Personal Handyphone System), a portable personal computer, or the like. However, depending on the function of the application, the user terminal 2 may be a stationary desktop personal computer, a television receiver, a game machine, a terminal dedicated to health management, a massager, an in-vehicle device, or the like.

The user terminal 2 acquires change data of the absorption rate or the transmittance of near-infrared light in the vicinity of the user's cerebral cortex from the head-worn device 1, and various data related to the activity state of the user's brain. Provide services including information processing.

The user terminal 2 has a CPU 21, a memory 22, a wireless communication unit 23, a display unit 24, an operation unit 25, and a voice output unit 26. The CPU 21 executes the process as the user terminal 2 by the computer program executably expanded in the memory 22. The processing as the user terminal 2 is, for example, a service including various information processing related to the activity state of the user's brain.

The memory 22 stores a computer program executed by the CPU 21 or data processed by the CPU 21. The memory 22 may include a volatile memory and a non-volatile memory. The wireless communication unit 23 is the same as the wireless communication unit 13 of the head-mounted device 1. Further, the user terminal 2 may have a communication unit that communicates by wire with the wireless communication unit 23 or instead of the wireless communication unit 23.

The display unit 24 is, for example, a liquid crystal display, an EL (Electro-Luminescence) panel, or the like, and displays output information from the CPU 21. The operation unit 25 is, for example, a push button, a touch panel, or the like, and accepts a user's operation. The voice output unit 26 is, for example, a speaker that outputs sound or voice.

FIG. 2 is a perspective view illustrating the appearance of the head-mounted device 1 as viewed from the lower rear. FIG. 3 is a plan view of the head mounting device 1 as viewed from above. Further, FIG. 4 is a front view of the head mounting device 1 as viewed from the front. However, in FIGS. 3 and 4, the fixing member 101 illustrated in FIG. 2 is omitted. Here, the lower rear means a position behind the user when the user wears the head mounting device 1 and looking up at the user's head from below. Further, the front means, for example, the front of the user (wearer) when the user wears the head wearing device 1. Further, the upper part means, for example, the upper part of the user. Hereinafter, the portion of the head mounting device 1 located on the right side of the user wearing the head mounting device 1 is referred to as a right side portion or a right side. Further, the portion of the head mounting device 1 located on the left side of the user wearing the head mounting device 1 is referred to as a left side portion or a left side. Further, the surface of the head mounting device 1 that comes into contact with the user is referred to as the back surface. The opposite side of the back side is called the front side. The surface is a surface that can be seen from the surroundings of the user when the user wears the head mounting device 1.

As illustrated in FIG. 2, the head mounting device 1 has a structure in which the head mounting device 1 is wound around the user's head in a headband shape and mounted, and is fixed to the user's head by tightening the fixing member 101. Therefore, the head mounting device 1 has a belt-shaped base material 100 that curves in a space slightly larger than the human head, and fixing members 101 that are fixed to both ends of the base material 100. The fixing member 101 has wire rods 110 and 120 extending from both ends of the base material 100 and fasteners for pulling in and fixing the wire rods 110 and 120 in pairs. The base material 100 forms an outer surface away from the surface of the user's head. That is, the head mounting device 1 has a structure in which the base material 100, which is a member that maintains the shape, is arranged on the outer surface away from the head. The base material 100 is made of, for example, a resin. However, the material of the base material 100 is not limited.

In this embodiment, the structure, shape, and material of the fixing member 101 are not limited. For example, in FIG. 2, the fixing member 101 has the wire rods 110 and 120, but a strip-shaped member may be used instead of the wire rod. Further, the fastener may have any structure.

As shown in FIG. 2, a battery box 102 is provided at the right end of the base material 100 of the head mounting device 1. The battery box 102 is a flat, substantially hexahedron, and the area of the front surface and the area of the back surface are both larger than the area of the four side surfaces. A groove (not shown) is provided on the back surface of the battery box 102. An intermediate portion of the wire rod 120 extending from the right end portion of the base material 100 is fitted in this groove. Therefore, the battery box 102 is fixed at the right end portion of the base material 100, and the wire rod 120 is fitted into the groove to be fixed to the head mounting device 1.

Two rounded housings 111 and 121 are provided near both ends of the front surface of the base material 100 of the head mounting device 1. The housings 111 and 121 contain a signal processing circuit, a control board having a communication circuit, and the like. As shown in FIG. 4, when the head mounting device 1 is viewed from the front, the two housings 111 and 121 appear to be located on both sides of the head mounting device 1.

As shown in FIG. 4, three markers 113, 103, and 123 are symmetrically arranged around the marker 103 in a straight line at a position along the lower edge of the base material 100 near the front surface of the base material 100. It is provided. The markers 113, 103, 123 may have any structure as long as the positions of the markers 113, 103, 123 can be identified on the image when the image is taken by the user terminal 2.

In the vicinity of the front surface of the base material 100, band-shaped openings 114 and 124 are formed above the markers 113 and 123, and knobs 112 and 122 are inserted into the openings 114 and 124, respectively. The knobs 112 and 122 are connected to left and right sliders (not shown) provided along the back surface of the base material 100, respectively. On the other hand, as illustrated in FIG. 2, the sensors 115 and 125 are fixed to the slider on the back surface of the base material 100. Therefore, by moving the knob 112 or the knob 122 relative to the base material 100 along the band-shaped opening 114 or the opening 124, the sensor 115 or 125 can be moved on the back surface side, respectively. Is. Further, a screw is formed coaxially with the knobs 112 and 122, and the position of the sensor can be fixed by a screw type.

In FIG. 4, the knob has a short cylindrical shape, but the shape of the knob is not limited to this. Further, in FIG. 4, a scale is engraved along the longitudinal direction of the band-shaped opening 114 and the opening 124. The scale has a different shape from the scale at the center position and the scale other than the center position so that the center position can be known. In FIG. 4, the scale at the center position is in the shape of a triangle with the vertices facing the openings 114 and 124, while the scale other than the center position is formed in a circular shape or a dot shape. The method of forming the scale is the same as the method of forming the markers 113, 103, and 123, but the method is not particularly limited.

As illustrated in FIG. 2, the sensors 115 and 125 have a shape in which three window portions are provided on a flat plate. An LED is provided as a near-infrared light source in each window of the sensors 115 and 125. Further, a photodiode or a phototransistor is provided as a light receiving portion in the remaining two windows of each of the sensors 115 and 125. The number of light receiving units of the sensors 115 and 125 is not limited to two, respectively. For example, one light receiving unit may be provided for each of the sensors 115 and 125, or three or more light receiving units may be provided.

Further, light-shielding portions 104 and 105 are provided on the upper and lower edges of the base material 100. Therefore, the sensors 115 and 125 are installed on the back surface of the base material 100 in a space sandwiched between the light-shielding portions 104 and 105 at the upper and lower edges. The light-shielding portions 104 and 105 also act as cushioning materials at the portions of the back surface of the head mounting device 1 that come into contact with the forehead. The material of the light-shielding portions 104 and 105 is not limited, but a light and soft member is desirable in order to come into contact with the user's head. The light-shielding portions 104 and 105 are, for example, a resin such as urethane, rubber, or the like.

Further, on the back surface of the base material 100, wiring for connecting the substrates in the battery box 102, the sensors 115, 125, and the housings 111, 121 is laid. However, except for the portion provided with the sensors 115 and 125 on the back surface of the base material 100, the cover 106 is covered. The cover 106 acts as a shielding plate on the back surface side of the head mounting device 1 that comes into contact with the head side so that the substrate, wiring, and the like do not come into direct contact with the user's skin. Therefore, the wiring is laid in the space between the base material 100 and the cover 106.

(First Embodiment)
The first embodiment using the above-mentioned measurement system will be described below. FIGS. 5, 7 and 8 show an example of a flowchart of the process executed by the CPU 21 of the user terminal 2 in the first embodiment. In the present embodiment, the user attaches the head wearing device 1 to the head before starting the measurement of the brain activity state associated with breathing, and the sensors 115 and 125 are relative to the user's head. It is assumed that the positioning has been completed.

In OP101, the CPU 21 of the user terminal 2 gives an instruction to execute the measurement of the brain activity state of the user wearing the head-mounted device 1 to the head-mounted device 1 via the wireless communication unit 23 and the network N1. Send. Upon receiving the instruction from the user terminal 2, the head-mounted device 1 notifies the user of a signal to start breathing through the display unit 24 and the voice output unit 26, and starts measuring the brain activity state. The brain activity state is repeatedly measured at a predetermined sampling frequency. The head-mounted device 1 measures the brain activity state of the user by the sensors 115 and 125, and repeats the detection value indicating the brain activity state to the user terminal 2 at the above sampling frequency via the wireless communication unit 13. Send. Then, the CPU 21 is attached to the user's head as a receiving unit, and repeatedly receives the detected value detected by the head-mounted device 1 that detects the blood flow in the head at the above sampling frequency.

Further, when the CPU 21 receives the detection value (brain activity waveform) indicating the brain activity state from the head-mounted device 1 via the wireless communication unit 23, the CPU 21 stores it in a storage means such as a memory 22. Here, the detected value may be the measured value itself, information processed so that the measured value can be easily transmitted to the user terminal 2, or the measured value is repeatedly measured at the above sampling frequency for a certain period of time. It may be information that summarizes the values. The detected value may be a value based on the value measured by the head-mounted device 1 for the change in blood flow in the head. A unique identifier is assigned to the user in advance. The detected value indicating the brain activity state is stored as time-series data together with the time information and the user's identifier.

In OP101, the CPU 21 outputs the start signal and the end signal of respiration through the display unit 24 and the audio output unit 26 by images and sounds. The user terminal 2 may accept the input of the operation of the start signal and the end signal of the breath through the operation unit 25. Further, the CPU 21 stores the detection value (brain activity waveform) indicating the brain activity state in the memory 22 together with the user identifier and the time information.

In OP102, the CPU 21 extracts a signal of a blood flow change component and a signal of a pulse wave component from the detected value (brain activity waveform) received from the head-mounted device 1. FIG. 6 is a diagram showing an example of a brain activity waveform, a signal of a blood flow change component, and a signal of a pulse wave component. In FIG. 6, the lateral direction is the direction of the time axis. FIG. 6A is a diagram showing an example of a brain activity waveform which is a detected value. In OP102, the CPU 21 executes, as an extraction unit, a process of extracting a component indicating a time change of blood flow from the detected value and a process of extracting a component indicating a time change of the pulse wave of the head from the detected value. The CPU 21 extracts the signal of the blood flow volume change component from the brain activity waveform by applying the received brain activity waveform to the first bandpass filter. A bandpass filter is a filter that extracts a signal in a predetermined frequency band. The frequency band of the signal passing through the first bandpass filter is, for example, 0.05 Hz to 0.14 Hz. A wave of about 0.1 Hz that passes through the first bandpass filter is called a Mayer wave. The blood flow change component is the amount of blood flowing through the blood vessels of the brain in a unit time. FIG. 6B is a diagram showing signals of blood flow change components extracted from the brain activity waveform. The frequency band of the signal passing through the first bandpass filter is 0.05 Hz or more and 0.14 Hz or less.

Further, the CPU 21 extracts the signal of the pulse wave component by applying the received brain activity waveform to the second bandpass filter. The frequency band of the signal passing through the second bandpass filter is a frequency band higher than the frequency band of the signal passing through the first bandpass filter. The frequency band of the signal passing through the second bandpass filter is, for example, 0.8 Hz to 2.0 Hz. The pulse wave component is a wave component generated by a pulse. FIG. 6C is a diagram showing signals of pulse wave components extracted from the brain activity waveform. The frequency band of the signal passing through the second bandpass filter is 0.8 Hz or more and 2.0 Hz or less. The user terminal 2 stores the extracted signal of the blood flow rate change component and the signal of the pulse wave component in the memory 22. Next, the CPU 21 advances the process to OP103.

In OP103, the CPU 21 performs a process (analysis process) of analyzing the data described below by using the signal of the blood flow rate change component and the signal of the pulse wave component stored in the memory 22. In the present embodiment, the CPU 21 executes the analysis process of OP103 and calculates the heart rate of the user, the cycle of deep breathing, the depth of deep breathing, and the change in the concentration of carbon dioxide (CO ₂ ) in the blood. In OP103, the CPU 21, as a calculation unit, calculates the time change of the carbon dioxide concentration in the blood of the head and the respiratory cycle and depth of the user based on the component indicating the time change of the extracted blood flow. Further, as a calculation unit, the CPU 21 calculates the time change of the user's heart rate based on the component indicating the time change of the pulse wave of the head. FIG. 7 is a flowchart showing the details of the analysis process (OP103 in FIG. 5). The analysis process is, for example, a subroutine of a program executed by the CPU 21. The processing of the subroutine of OP103 will be described below with reference to FIG. 7.

In OP201, the CPU 21 calculates the heart rate based on the cycle of the signal of the pulse wave component stored in the memory 22. For example, the CPU 21 calculates the heart rate (referred to as Herat Rate (HR) or beats per minute (bpm)) based on the ratio between the time width between the extreme values of the pulse wave component and the unit time, for example, 1 second. .. The CPU 21 stores the calculated heart rate and the data indicating the time zone for which the heart rate is calculated in the memory 22 in association with the user's identifier. Next, the CPU 21 advances the process to OP202.

In OP202, the CPU 21 calculates the respiratory cycle based on the cycle of the signal of the blood flow change component stored in the memory 22. For example, the CPU 21 uses the time indicated by the cycle of the signal of the blood flow change component as the respiratory cycle. In the present embodiment, the cycle of respiration is calculated based on the cycle of the signal of the blood flow change component because the blood vessels of the brain repeat expansion and contraction with respiration, and the respiration affects the measured value of blood flow. Is. The CPU 21 stores in the memory 22 data indicating the calculated respiration cycle and the time zone for which the respiration cycle is calculated.

Further, in OP 203, the CPU 21 calculates the depth of respiration based on the amplitude of the signal of the blood flow change component stored in the memory 22. Here, the depth of breathing means the amount of oxygen inhaled in one breath. For example, the unit of the amplitude of the signal of the blood flow change component is mM · mm, and since there is a correlation between the amplitude of the signal of the blood flow change component and the depth of respiration, the CPU 21 uses the amplitude of the signal of the blood flow change component. Is regarded as the depth of breathing. The CPU 21 may use the result obtained by performing a predetermined weighting on the amplitude of the signal of the blood flow change component as the depth of respiration. The CPU 21 stores in the memory 22 data indicating the calculated breathing depth and the time zone for which the calculated breathing depth is to be calculated.

Next, in OP204, the CPU 21 calculates the tendency of the CO ₂ concentration change in the blood of the user's head based on the signal of the blood flow change component. Here, the tendency of the CO ₂ concentration change in blood is the slope of the linear function by modeling the change of the signal of the blood flow volume change component in a cycle (long cycle) such as 1 minute with a linear function. The CO ₂ concentration in the blood tends to increase, decrease, or become substantially constant, which can be determined from the above. In OP204, the CPU 21 models the change in the signal of the blood flow change component obtained by applying the signal of the blood flow change component to a low-pass filter with a linear function. Further, the CPU 21 calculates from the slope of the linear function obtained by modeling whether the CO ₂ concentration in the blood tends to increase, decrease, or become substantially constant. It is possible to appropriately determine in which range the slope of the linear function the CO ₂ concentration tends to increase, decrease, or become substantially constant. Then, the CPU 21 stores in the memory 22 data indicating the time zone for which the calculated tendency of the CO ₂ concentration change in the blood of the user and the tendency of the CO ₂ concentration change are to be calculated. Next, the CPU 21 advances the process to OP205.

In OP201 to OP204, the time zone in which the signal of the blood flow change component and the signal of the pulse wave component are measured is the same. Therefore, the processing of OP201 to OP204 provides data showing the tendency of heart rate, respiratory cycle and depth, and CO ₂ concentration change in a certain time zone. In general, it is considered that humans have a substantially constant heart rate and blood CO ₂ concentration when sympathetic nerve activity is suppressed, that is, when they are relaxed. Therefore, in OP205, the CPU 21 suppresses the activity of the sympathetic nerve based on the data indicating the heart rate, the respiratory cycle, the respiratory depth, and the tendency of the CO ₂ concentration change stored in the memory 22 in OP201 to OP204. It is analyzed whether or not the user's breathing is stable from the viewpoint of whether or not the patient's breathing is stable.

FIG. 8 shows an example of the processing of the subroutine of OP205. In OP205, as a specific part, the CPU 21 has a substantially constant carbon dioxide concentration in the blood of the head based on the time change of the calculated carbon dioxide concentration in the blood of the head and the respiratory cycle and depth of the user. Performs a process to specify the user's breathing cycle and depth in the time zone. Further, as a specific unit, the CPU 21 has a substantially constant heart rate of the user during the time period in which the carbon dioxide concentration in the blood of the head is substantially constant based on the calculated time change of the heart rate of the user. The time zone is specified, and the cycle and depth of the user's breathing in the specified time zone are specified.

In OP301, the CPU 21 calculates the fluctuation range of the heart rate from the maximum value and the minimum value of the heart rate in a predetermined time width from the data indicating the heart rate. Here, the predetermined time width is a time width that allows the fluctuation range of the heart rate to be calculated based on the maximum value and the minimum value of the heart rate. Then, the CPU 21 determines that the heart rate is substantially constant when the fluctuation range of the heart rate is within a predetermined range. Then, the CPU 21 stores in the memory 22 a time zone in which the heart rate is substantially constant.

Further, in the OP 302, the CPU 21 specifies a time zone in which the CO ₂ concentration is substantially constant from the calculated tendency of the CO ₂ concentration change and the data indicating the time zone to be calculated. Then, the CPU 21 stores the specified time zone in the memory 22.

Further, in the OP 303, the CPU 21 specifies a time zone in which the heart rate is substantially constant and the CO ₂ concentration is substantially constant, based on the above time zone stored in the memory 22. Then, the CPU 21 specifies the breathing cycle and depth in the specified time zone from the data indicating the breathing cycle and depth stored in the memory 22. If there is data indicating a plurality of cycles or depths in the specified time zone, one of the cycles or depths may be specified as the respiratory cycle and depth in the specified time zone, or those may be specified. The average cycle or depth may be the cycle and depth of respiration during a specified time period. The CPU 21 stores the specified breathing cycle and depth in the memory 22. Then, the CPU 21 ends this subroutine, further terminates the subroutine shown in FIG. 7 from OP205, and proceeds to the process in OP104 of FIG.

In the present embodiment, the processing of OP205 specifies a time zone in which the heart rate is substantially constant and the CO ₂ concentration is substantially constant, that is, a time zone in which the activity of the sympathetic nerve can be considered to be suppressed. Can be done. Then, by inducing the user's breathing cycle and depth to be the user's breathing cycle and depth in the specified time zone, it is used so that the activity of the sympathetic nerve can be suppressed. Can guide people.

In OP104, the CPU 21 acquires measurement data of the brain activity state associated with breathing of the user wearing the head wearing device 1, and uses the acquired measurement data based on the respiratory cycle and depth specified in OP303. Induces one's breathing. Specifically, when the breathing cycle calculated from the acquired measurement data is longer than the breathing cycle specified in OP 303, the CPU 21 displays a message requesting that the breathing cycle be shortened on the display unit 24. .. Further, when the breathing cycle calculated from the acquired measurement data is shorter than the breathing cycle specified in OP 303, a message requesting that the breathing cycle be lengthened is displayed on the display unit 24. In addition, if the difference between the breathing cycle calculated from the acquired measurement data and the breathing cycle specified in OP303 is within a predetermined time, the breathing cycle is considered to be appropriate and the breathing cycle is maintained. The requested message is displayed on the display unit 24.

As a result, the user can adjust the breathing cycle according to the message displayed on the display unit 24. It should be noted that it is possible to appropriately determine when the difference between the breathing cycle calculated from the measurement data and the breathing cycle specified in OP 303 is determined to be long, short or appropriate.

Further, in OP 104, the CPU 21 outputs information as an output unit for inducing the user's breathing so that the breathing cycle and depth of the user become the specified breathing cycle and depth. Specifically, when the breathing depth calculated from the acquired measurement data is deeper than the breathing depth specified in OP 303, the CPU 12 displays a message requesting that the breathing be shallow on the display unit 24. Further, when the breathing depth calculated from the acquired measurement data is shallower than the breathing depth specified in OP 303, a message requesting deep breathing is displayed on the display unit 24. If the difference between the breathing depth calculated from the acquired measurement data and the breathing depth specified in OP303 is within a predetermined amount, the breathing depth is considered to be appropriate and the breathing depth is maintained. A message requesting is displayed on the display unit 24.

As a result, the user can adjust the depth of breathing according to the message displayed on the display unit 24. It should be noted that it is possible to appropriately determine when the difference between the breathing depth calculated from the measurement data and the breathing depth specified in OP 303 is determined to be deep, shallow or appropriate. Further, the message displayed on the display unit 24 is not limited to characters, and an image prompting the user to adjust the respiration may be displayed. As for how to display the above message on the display unit 24, various display forms can be applied by using a well-known technique. Further, the message may be output from the voice output unit 26 as a voice message. The message requesting the user to adjust the breathing cycle and the message requesting the adjustment of the breathing depth may be displayed on the display unit 24 at the same time, or may be individually displayed on the display unit 24. You may do so.

Further, in the OP 104, the CPU 21 repeatedly executes determination of the breathing cycle and depth based on the measurement data and display of a message at predetermined time intervals. Here, as an example of a predetermined time interval, 1 second to several seconds can be mentioned, but it can be appropriately set. The CPU 21 executes the above-mentioned induction of the breathing cycle and depth, stores the determination result of each breathing cycle and depth in the memory 22, and advances the process to OP105. In the present embodiment, in breathing training and the like, the CO ₂ concentration in the blood calculated from the time change of the blood flow in the head of the user and the time change of the pulse wave is used as an index. It is an objective index that does not depend on the experience of the instructor in charge of breathing training by inducing the cycle and depth of the user's breathing so that the user can breathe with suppressed sympathetic activity. You can do breathing training based on.

Next, in the OP 105, the CPU 21 evaluates the respiration based on the determination result of the depth of the respiration cycle stored in the memory 22. FIG. 9 schematically shows the relationship between the CO ₂ concentration and the depth of respiration. As shown in FIG. 9, the horizontal axis of the graph is the depth of respiration, and the vertical axis is the CO ₂ concentration. At this time, breathing to such an extent that the breathing is deep and the CO ₂ concentration is neither too low nor too high can be regarded as a good deep breathing in which the activity of the sympathetic nerve is suppressed. However, when humans cannot stabilize the breathing cycle and depth even when taking good deep breaths, the CO ₂ concentration in the blood changes, as shown by the breathing locus T1 in the figure. It is difficult to obtain a relaxing effect because good deep breathing cannot be continued. Further, as shown by the respiratory locus T2 in the figure, even if the human can maintain the depth of breathing, if the exhalation of breathing is low, the CO ₂ concentration decreases and it is not possible to perform good deep breathing. In addition, humans may become hyperventilated, as shown by locus T3, if breathing is shallow and exhalation is low.

In the present embodiment, the CPU 21 evaluates to what extent the user was able to perform the good deep breathing shown in FIG. 9 from the determination result of the depth of the breathing cycle stored in the memory 22. Further, the CPU 21 determines whether or not breathing can be regarded as hyperventilation. In this embodiment, the CO _{2 concentration when the breathing cycle and depth are specified in OP303 is regarded as the CO 2 concentration} when performing good deep breathing. In addition, it is appropriate to determine the range of the difference between the CO ₂ concentration and the breathing depth specified in OP303 and the CO ₂ concentration and the breathing depth calculated from the measurement data to be considered as good deep breathing. Can be decided.

The CPU 21 performs and evaluates three axes of the user's breathing "depth", "periodicity", and "heart rate" from the measurement data stored in the memory 22 and the determination result of the breathing cycle depth. The result is displayed on the display unit 24. Further, the CPU 21 stores the evaluation result displayed on the display unit 24 as a history in the memory 22 in association with the user's identifier. The history of the evaluation result stored in the memory 22 can be displayed again on the display unit 24 as the evaluation result of the past breathing by the user operating the user terminal 2.

Here, the evaluation of "depth" is an evaluation indicating how close the depth of breathing is to the depth of breathing regarded as good deep breathing. Further, the evaluation of "periodicity" is an evaluation showing how much the respiration could be repeated in the same cycle, that is, the reproducibility of respiration based on the respiration cycle. The evaluation of "periodicity" can be performed based on the correlation between the respiratory cycle and one cycle before. Further, the evaluation of the "heart rate" is an evaluation indicating how much the fluctuation of the heart rate can be suppressed and the breathing can be performed.

FIG. 10 shows an example of the above evaluation result displayed on the display 24a as an example of the display unit 24 of the user terminal 2 in OP105. As shown in FIG. 10, on the display 24a, the result of the three-axis evaluation of the "depth", "periodicity", and "heart rate" of the user's respiration is displayed as an evaluation score in a triangular graph 24b. .. Further, the display 24a displays a score 24c as a result of scoring the "depth", "periodicity", and "heart rate" of the result of the three-axis evaluation.

The evaluation of "depth", "periodicity", and "heart rate" specified the measurement data of the user's breathing measured in OP105 and the breathing cycle and depth, the breathing cycle and depth specified in OP303. It is based on comparison with heart rate data in the time zone. Then, how to convert the score may be determined by using a well-known technique so that the score easily confirmed by the user is displayed on the display 24a. Further, the evaluation results of "depth", "periodicity", and "heart rate" can be displayed on the display 24a using various display forms, not limited to the triangular graph.

The CPU 21 ends the processing of this flowchart after displaying and saving the evaluation result of the user's respiration.

(Second embodiment)
Next, a second embodiment using the above measurement system will be described. In this embodiment, a process of estimating a user's hyperventilation from a change in blood flow is exemplified. Other configurations and operations of this embodiment are the same as those of the first embodiment described above. Therefore, among the components of the second embodiment, the same components as those of the first embodiment are designated by the same reference numerals, and detailed description thereof will be omitted. FIG. 11 shows an example of a flowchart of the process executed by the CPU 21 of the user terminal 2 in the present embodiment.

Since the processing of OP401 and OP402 is the same as the processing of OP101 and OP102, detailed description thereof will be omitted. Next, in OP403, the CPU 21 calculates the heart rate based on the cycle of the signal of the pulse wave component stored in the memory 22, as in OP201. Further, the CPU 21 calculates whether the heart rate has an upward tendency, a downward tendency, or a substantially constant tendency from the time change of the heart rate. For example, the CPU 21 models the fluctuation of the heart rate with a linear function based on the measurement data from the time retroactive to the present time by a predetermined time, and determines the tendency of the heart rate according to the inclination of the linear function. Can be calculated. It should be noted that it is possible to appropriately determine in which range the slope of the linear function the heart rate tends to rise, fall, and become substantially constant. When the CPU 21 calculates the tendency of the heart rate change and stores the data indicating the calculation result in the memory 22, the process proceeds to OP404.

In OP404, the CPU 21 calculates the tendency of the blood flow change in the head of the user based on the signal of the blood flow change component. For example, the CPU 21 uses a linear function to model the change in the signal of the blood flow volume change component based on the measurement data from the time retroactive to the present time by a predetermined time, thereby performing the blood flow volume from the inclination of the linear function. The tendency of change can be calculated. It should be noted that the range in which the slope of the linear function is within the range in which the tendency of the blood flow change tends to increase, decrease, or become substantially constant can be appropriately determined. Then, the CPU 21 calculates the tendency of the blood flow change, stores the data indicating the calculation result in the memory 22, and proceeds to the processing to OP405.

In OP405, the CPU 21 determines whether or not the heart rate has increased and the blood flow has decreased based on the tendency of the heart rate change calculated in OP403 and the tendency of the blood flow change calculated in OP404. When the CPU 21 determines that the heart rate is increasing and the blood flow is decreasing (OP405: Yes), the processing proceeds to OP406. On the other hand, when the CPU 21 determines that the heart rate has not increased or the blood flow has not decreased (OP405: No), the processing of this flowchart ends.

In OP406, the CPU 21 considers the user's breathing to be hyperventilation and notifies the user that the breathing is hyperventilation. For example, the CPU 21 displays a message notifying that the breathing is hyperventilation on the display unit 24. Instead of or displaying the message by the display unit 24, the CPU 21 may output a voice notifying that the breathing is hyperventilation by the voice output unit 26. When the CPU 21 executes a process of notifying the user that the breathing is hyperventilation, the process of this flowchart ends.

As described above, in the present embodiment, the user's respiration is based on the tendency of the blood flow change and the heart rate change calculated from the time change of the blood flow of the user's head and the time change of the pulse wave. Can determine whether or not is hyperventilated and notify hyperventilation.

The above is the description of the embodiment of the present invention, but the configuration of the above measurement system is not limited to the above embodiment, and various within the range that does not lose the identity with the technical idea of the present invention. It can be changed. For example, in the first embodiment described above, the CPU 21 specifies the respiratory cycle and depth in a time zone in which the carbon dioxide concentration in the blood of the head is substantially constant and the heart rate of the user is substantially constant. do. However, the CPU 21 specifies the breathing cycle and depth in the time zone when the carbon dioxide concentration in the blood of the head is substantially constant, and induces the user's breathing using the specified breathing cycle and depth. You may. Alternatively, the CPU 21 may specify the breathing cycle and depth in a time zone in which the user's heart rate is substantially constant, and induce the user's breathing using the specified breathing cycle and depth. Further, in the above embodiment, the change in the signal of the blood flow change component is modeled by a linear function, and the time change of the blood flow is calculated from the slope of the linear function. The method is not limited to this. For example, when the time change of the blood flow is within a predetermined change range, the blood flow is considered to be substantially constant, and the tendency of the time change of the blood flow is determined according to the change range of the time change of the blood flow. You may.

Further, in the first embodiment described above, when the user terminal 2 induces the user to breathe, the user may be made to perform a predetermined action. Predetermined behaviors include, for example, zazen, meditation, yoga, sleep, watching videos, playing games, listening to music, exercising, eating and drinking, exams, playing applications, and the like. The predetermined action may be a specific action in a specific application. Applications include, for example, brain training applications. For example, when the user terminal 2 is allowed to watch a moving image, the display unit 24 is made to display the moving image, and the audio output unit 26 is made to output the sound accompanying the moving image so that the user can watch the moving image. Further, when the user terminal 2 is to play a game, the display unit 24 and the sound output unit 26 are made to output an image or sound for a game, and the operation unit 25 is made to operate the game by the user. , Let the game play.

Further, in the first embodiment described above, a graph showing the time change of the blood flow rate change component and the time change of the pulse wave component may be displayed on the display unit 24 of the user terminal 2. As a result, the user of the user terminal 2 can recognize the change in pulse wave amplitude (that is, the state of sympathetic nerve activity) when the blood flow changes. Then, the user of the user terminal 2 can perform training such as meditation while checking the graph and the message displayed on the display unit 24.

1 Head-mounted device 2 User terminal 21 CPU
22 Memory 24 Display unit 26 Audio output unit

Claims (3)

A receiver that is attached to the user's head and receives the detection value detected by the head-mounted device that detects the blood flow in the head.
An extraction unit that extracts a component indicating a time change of the blood flow rate and a component showing a time change of the pulse wave of the head from the detected value.
The respiratory cycle and depth of the user are calculated based on the extracted component indicating the time change of the blood flow, and the user's breathing cycle and the depth are calculated based on the component indicating the time change of the pulse wave of the head. A calculation unit that calculates the change in heart rate over time,
Based on the calculated time change of the user's heart rate and the cycle and depth of the user's respiration, the user's respiration in a time zone in which the fluctuation range of the user's heart rate is within a predetermined range. With a specific part that specifies the period and depth of
An information processing apparatus including an output unit that outputs information for inducing the user's breathing so that the user's breathing cycle and depth become the specified breathing cycle and depth. The computer
It is attached to the user's head and receives the detection value detected by the head-mounted device that detects the blood flow in the head.
From the detected value, a component showing a time change of the blood flow and a component showing a time change of the pulse wave of the head were extracted.
The respiratory cycle and depth of the user are calculated based on the extracted component indicating the time change of the blood flow, and the user's breathing cycle and the depth are calculated based on the component indicating the time change of the pulse wave of the head. Calculate the time change of heart rate,
Based on the calculated time change of the user's heart rate and the cycle and depth of the user's respiration, the user's respiration in a time zone in which the fluctuation range of the user's heart rate is within a predetermined range. Identify the period and depth of
An information processing method comprising outputting information for inducing the user's respiration so that the respiration cycle and depth of the user becomes the specified respiration cycle and depth. On the computer
A step of being mounted on the user's head and receiving a detection value detected by a head-mounted device that detects blood flow in the head, and a step of receiving the detection value.
A step of extracting a component showing a time change of the blood flow and a component showing a time change of the pulse wave of the head from the detected value, and a step of extracting the component showing the time change of the pulse wave of the head.
The respiratory cycle and depth of the user are calculated based on the extracted component indicating the time change of the blood flow, and the user's breathing cycle and the depth are calculated based on the component indicating the time change of the pulse wave of the head. Steps to calculate the change in heart rate over time,
Based on the calculated time change of the user's heart rate and the cycle and depth of the user's respiration, the user's respiration in a time zone in which the fluctuation range of the user's heart rate is within a predetermined range. And the steps to identify the period and depth of
An information processing program for executing a step of outputting information for inducing the user's breathing so that the user's breathing cycle and depth become the specified breathing cycle and depth.

Images