JP2018161246A - Information processing device, information processing method, and information processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device capable of notifying of hyperventilation based on a change in a blood flow rate in the brain.SOLUTION: An information processing device includes: a reception part mounted on the head of a user for receiving a detection value detected by a head-mounted device for detecting a blood flow rate in the head; an extraction part for extracting a component indicating a temporal change in the blood flow rate and a component indicating a temporal change in a pulse wave in the head from the detection value; a calculation part for calculating a temporal change in a heart rate of the user based on the extracted component indicating a temporal change in the pulse wave in the head; a determination part for determining whether or not the user's respiration is in a hyperventilation state based on the extracted temporal change in the blood flow rate and the calculated temporal change in the heart rate of the user; and a notification part for notifying that the user's respiration is in a hyperventilation state when the user's respiration is determined to be in a hyperventilation state.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus, an information processing method, and an information processing program.

  In general, it is considered that humans may fall into hyperventilation when breathing is low when repeating shallow breathing. Therefore, a technique for diagnosing hyperpnea based on the characteristics of a signal indicating respiration has also been proposed.

JP2015-43174A

  It is thought that there is a correlation between the temporal change in blood flow in the brain and the temporal change in respiration. However, in the prior art, no proposal has been made to estimate temporal changes in respiration based on changes in cerebral blood flow, for example, to estimate and notify hyperventilation.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an information processing apparatus capable of reporting hyperventilation based on a change in blood flow in the brain.

  One aspect of the present invention is exemplified by the following information processing apparatus. This information processing device is mounted on the user's head and receives a detection value detected by the head-mounted device that detects the blood flow of the head, and the time change of the blood flow from the detection value. And calculating the time change of the heart rate of the user based on the extracted component indicating the time change of the pulse wave of the head and the extracted component indicating the time change of the pulse wave of the head And a determination unit that determines whether the user's breathing is hyperventilation based on the time change of the extracted blood flow rate and the time change of the calculated user's heart rate, and the user's breathing is And a notifying unit for notifying that the user's breathing is overbreathing when it is determined that the breathing is overbreathing.

  Further, in the above information processing device, the determination unit determines that the user's heart rate changes when the temporal change in the calculated blood flow rate indicates a decrease in the blood flow rate and the temporal change in the user's heart rate indicates an increase in the heart rate. You may determine that respiration is hyperventilation.

  According to a second aspect of the present invention, the detection value detected by the head-mounted device that is mounted on the user's head and detects the blood flow rate of the head is received, and the time change of the blood flow rate is detected from the detection value. And the component indicating the temporal change of the pulse wave of the head are extracted, the temporal change of the heart rate of the user is calculated based on the extracted component indicating the temporal change of the pulse wave of the head, and the extracted blood When it is determined whether or not the user's breathing is hyperventilation based on the time change of the flow rate and the calculated temporal change of the user's heart rate, and when it is determined that the user's breathing is hyperventilation It can be illustrated as an information processing method for performing notification that the user's breathing is hyperventilation.

  Further, in the information processing method described above, the computer performs the breathing of the user when the time change in the calculated blood flow rate indicates a decrease in the blood flow rate and the time change in the user heart rate indicates an increase in the heart rate. May be determined to be hyperventilation.

  Further, according to a third aspect of the present invention, there is provided a step of receiving a detection value detected by a head-mounted device that is mounted on a user's head and detects a blood flow of the head, and a detection value. The step of extracting the component indicating the temporal change of the blood flow and the component indicating the temporal change of the pulse wave of the head, and the heart rate of the user based on the extracted component indicating the temporal change of the pulse wave of the head A step of calculating a temporal change, a step of determining whether the user's breathing is hyperventilation based on the temporal change of the extracted blood flow rate and the calculated temporal change of the user's heart rate; When it is determined that the person's breathing is overbreathing, the information processing program can be exemplified to execute a step of notifying that the user's breathing is overbreathing.

  In the information processing program described above, the computer may perform respiration of the user when the temporal change in the calculated blood flow rate indicates a decrease in the blood flow rate and the temporal change in the user's heart rate indicates an increase in the heart rate. May be determined to be hyperventilation.

  ADVANTAGE OF THE INVENTION According to this invention, the information processing apparatus which can alert | report hyperpnea based on the change of the blood flow rate of a brain can be provided.

FIG. 1 is a diagram illustrating a schematic configuration of a measurement system according to an embodiment of the present invention. FIG. 2 is a perspective view illustrating the external appearance of the head-mounted device as viewed from below. FIG. 3 is a plan view of the head-mounted device as viewed from above. FIG. 4 is a front view of the head-mounted device viewed from the front. FIG. 5 is a diagram illustrating an example of a flowchart of processing executed in the user terminal according to the embodiment. FIG. 6 is a diagram illustrating an example of a brain activity waveform, a blood flow change component signal, and a pulse wave component signal. FIG. 7 is a diagram illustrating an example of a subroutine process executed in the user terminal according to the embodiment. FIG. 8 is a diagram illustrating an example of a subroutine process executed in the user terminal according to the embodiment. FIG. 9 is a diagram illustrating the correlation between the respiration depth and the CO ₂ concentration in respiration. FIG. 10 is a diagram illustrating an example of a screen displayed on the user terminal according to an embodiment. FIG. 11 is a diagram illustrating an example of a flowchart of processing executed in the user terminal according to an embodiment.

Hereinafter, a measurement system according to an embodiment will be described with reference to the drawings. FIG. 1 is a diagram illustrating a schematic configuration of a measurement system according to an embodiment of the present invention. This measurement system detects measurement data (also referred to as a detection value) indicating a change in blood flow from the user's head, and acquires brain activity information indicating the activity state of the user's brain. As shown in FIG. 1, the measurement system includes a head-mounted device 1 and a user terminal 2. The head mounted device 1 includes a control unit 11, a wireless communication unit 13, and a pair of sensors 115 and 125 as information processing aspects. The control unit 11 controls measurement and communication of the head-mounted device 1. The control unit 11 includes a processor such as a CPU (Central Processing Unit) or DSP (Digital Signal Processor) and a memory, for example, and executes processing by a computer program, firmware, or the like that is executably expanded on the memory. . However, the control unit 11 may be a dedicated hardware circuit, an FPGA (Field Programmable Gate Array), or the like that activates the wireless communication unit 13 and the sensors 115 and 125 and executes cooperation processing with each component. The control unit 11 includes a CPU,
A DSP, a dedicated hardware circuit, or the like may be mixed.

The wireless communication unit 13 is connected to the control unit 11 and the sensors 115 and 125 through a predetermined interface. However, the wireless communication unit 13 may be configured to acquire data from the sensors 115 and 125 via the control unit 11. The wireless communication unit 13 communicates with the user terminal 2 via the network N1. The network N1 is a network that complies with standards such as Bluetooth (registered trademark), wireless LAN (Local Area Network), and ZigBee (registered trademark). However, in this measurement system, the standard of the wireless interface of the wireless communication unit 13 is not limited. The network N1 may be a wired network.

  In the present measurement system, a communication unit that performs wired communication instead of the wireless communication unit 13 or together with the wireless communication unit 13 may be provided. That is, the head-mounted device 1 and the user terminal 2 may be connected by a wired communication interface. In this case, the interface for wired communication is not limited, and various interfaces such as USB (Universal Serial Bus) and PCI Express can be used according to the use of the measurement system.

  The sensors 115 and 125 both irradiate the head with near-infrared light, receive near-infrared light partially absorbed and scattered near the cerebral cortex, and convert it into an electrical signal. In the cerebral cortex, for example, the blood flow changes according to the activity state of the brain, and due to the change, the absorption characteristic or scattering characteristic of near-infrared light near the cerebral cortex changes. The sensors 115 and 125 convert the near-infrared light whose light amount changes according to the change in the near-infrared light absorption rate or the change in the transmittance according to the state of blood flow in the vicinity of the cerebral cortex into an electrical signal and output it. To do.

  In this measurement system, the sensors 115 and 125 perform irradiation with near infrared light and conversion of the received near infrared light into electrical signals at predetermined time intervals such as 0.1 seconds. Thereby, the data regarding the change of the blood flow rate in the brain of the user wearing the head-mounted device 1 is obtained at the time interval. Further, one of the sensors 115 and 125 outputs data related to a change in blood flow in the right forehead, and the other outputs data related to a change in blood flow in the left forehead.

Sensors 115 and 125 include, for example, a near-infrared light source that emits near-infrared light and a light-receiving unit that receives near-infrared light. Near-infrared light sources are, for example, LEDs (Light Emitting Diodes)
), An infrared lamp or the like. The light receiving unit includes a photoelectric element such as a photodiode or a phototransistor, an amplifier, and an AD (Analog Digital) converter. Note that the near-infrared light source and the light receiving unit may not be provided in pairs. For example, a plurality of light receiving units may be provided for one near infrared light source.

  The user terminal 2 is, for example, a smartphone, a mobile phone, a portable information terminal, a PHS (Personal Handyphone System), a portable personal computer, or the like. However, depending on the function of the application, the user terminal 2 may be a stationary desktop personal computer, a television receiver, a game machine, a health management dedicated terminal, a massage device, an in-vehicle device, or the like.

  The user terminal 2 acquires the change data of the near-infrared light absorption rate or transmittance in the vicinity of the user's cerebral cortex from the head-mounted device 1, and various kinds of data related to the activity state of the user's brain. Provide services including information processing.

The user terminal 2 includes a CPU 21, a memory 22, a wireless communication unit 23, a display unit 24, an operation unit 25, and an audio output unit 26. The CPU 21 executes processing as the user terminal 2 by a computer program that is executed in the memory 22 so as to be executable. The processing as the user terminal 2 is, for example, a service including various information processing related to the activity state of the user's brain.

  The memory 22 stores a computer program executed by the CPU 21 or data processed by the CPU 21. The memory 22 may include volatile memory and non-volatile memory. The wireless communication unit 23 is the same as the wireless communication unit 13 of the head-mounted device 1. Further, the user terminal 2 may include a communication unit that performs wired communication instead of the wireless communication unit 23 or together with the wireless communication unit 23.

  The display unit 24 is, for example, a liquid crystal display, an EL (Electro-Luminescence) panel, and the like, and displays output information from the CPU 21. The operation unit 25 is, for example, a push button, a touch panel, or the like, and accepts a user operation. The sound output unit 26 is, for example, a speaker that outputs sound or sound.

  FIG. 2 is a perspective view illustrating the appearance of the head-mounted device 1 as viewed from below and behind. FIG. 3 is a plan view of the head-mounted device 1 as viewed from above. FIG. 4 is a front view of the head-mounted device 1 as viewed from the front. However, in FIGS. 3 and 4, the fixing member 101 illustrated in FIG. 2 is omitted. Here, the lower rear refers to a position behind the user when the user wears the head mounting device 1 and a position where the user's head is looked up from below. Further, the front means, for example, the front of the user (wearer) when the user wears the head mounting device 1. Furthermore, “above” means, for example, above the user. Hereinafter, the portion of the head mounting device 1 that is located on the right side of the user wearing the head mounting device 1 is referred to as the right side portion or the right side. Moreover, the part of the head mounting device 1 located on the left side toward the user wearing the head mounting device 1 is referred to as the left side portion or the left side. Moreover, the surface of the head mounting apparatus 1 which contacts a user is called a back surface. The opposite side of the back side is called the front side. The surface is a surface that can be seen from the periphery of the user when the user wears the head-mounted device 1.

  As illustrated in FIG. 2, the head-mounted device 1 has a structure in which the head-mounted device 1 is wound around the head of the user in a headband shape, and is fixed to the user's head by fastening the fixing member 101. Therefore, the head mounting device 1 includes a belt-like base material 100 that is curved in a space slightly larger than a human head, and a fixing member 101 that is fixed to both ends of the base material 100. The fixing member 101 has wire rods 110 and 120 extending from both ends of the base material 100 and a fastener that pulls and fixes the wire rods 110 and 120 in pairs. The base material 100 forms an outer surface away from the user's head surface. That is, the head mounting device 1 has a structure in which the base material 100 that is a member that maintains the shape is disposed on the outer surface away from the head. The base material 100 is made of, for example, a resin. However, the material of the base material 100 is not limited.

  In the present embodiment, the structure, shape, and material of the fixing member 101 are not limited. For example, in FIG. 2, the fixing member 101 includes the wire rods 110 and 120, but a belt-like member may be used instead of the wire rod. The fastener may have any structure.

  As shown in FIG. 2, a battery box 102 is provided at the right end of the base material 100 of the head-mounted device 1. The battery box 102 is a flat and substantially hexahedron, and both the area of the front surface and the area of the back surface are larger than the areas of the four side surfaces. A groove (not shown) is provided on the back surface of the battery box 102. An intermediate portion of the wire 120 extending from the right end portion of the substrate 100 is fitted in this groove. Therefore, the battery box 102 is fixed to the head mounting device 1 by being fixed at the right end portion of the substrate 100 and by fitting the wire 120 into the groove.

Two rounded housings 11 are provided near both ends on the front side of the base material 100 of the head mounting device 1.
1 and 121 are provided. The housings 111 and 121 accommodate a signal processing circuit, a control board having a communication circuit, and the like. As shown in FIG. 4, when the head mounting device 1 is viewed from the front, the two housings 111 and 121 appear to be located on both sides of the head mounting device 1.

  As shown in FIG. 4, in the vicinity of the front side of the base material 100, three markers 113, 103, and 123 are arranged symmetrically with respect to the marker 103 and linearly at a position along the lower edge of the base material 100. Is provided. The markers 113, 103, and 123 may have any structure as long as the positions of the markers 113, 103, and 123 can be identified on the image when captured by the user terminal 2.

  In the vicinity of the front side front surface of the substrate 100, strip-shaped openings 114 and 124 are formed in the upper portions of the markers 113 and 123, and knobs 112 and 122 are inserted into the openings 114 and 124, respectively. The knobs 112 and 122 are respectively connected to left and right sliders (not shown) provided along the back surface of the substrate 100. On the other hand, as illustrated in FIG. 2, the sensors 115 and 125 are fixed to the slider on the back surface of the substrate 100. Therefore, by moving the knob 112 or the knob 122 relative to the base material 100 along the strip-shaped opening 114 or the opening 124, the sensor 115 or 125 can be moved on the back surface side. It is. Furthermore, a screw is formed coaxially with the knobs 112 and 122, and the position of the sensor can be fixed by a screw type.

  In FIG. 4, the knob has a short cylindrical shape, but the shape of the knob is not limited to this. Further, in FIG. 4, scales are engraved along the longitudinal direction of the strip-shaped opening 114 and the opening 124. The scale has a shape in which the scale at the center position and the scales other than the center position are different so that the center position can be understood. In FIG. 4, the scale at the center position has a triangular shape with apexes facing the openings 114 and 124, while the scale other than the center position is formed in a circular shape or a dot shape. The method of forming the scale is the same as the method of forming the markers 113, 103, and 123, but there is no particular limitation.

  As illustrated in FIG. 2, the sensors 115 and 125 have a shape in which three windows are provided on a flat plate. An LED is provided as a near-infrared light source in one window portion of each of the sensors 115 and 125. In addition, a photodiode or a phototransistor is provided as a light receiving unit in the remaining two windows of each of the sensors 115 and 125. Note that the number of light receiving portions of the sensors 115 and 125 is not limited to two. For example, one light receiving unit may be provided for each of the sensors 115 and 125, or three or more light receiving units may be provided.

  Further, light shielding portions 104 and 105 are provided on the upper and lower edges of the substrate 100. Therefore, the sensors 115 and 125 are installed in the space between the light shielding portions 104 and 105 at the upper and lower edges on the back surface of the base material 100. And the light-shielding parts 104 and 105 act also as a buffer material in the part which touches a forehead on the back surface of the head-mounted device 1. Although the material of the light-shielding parts 104 and 105 is not limited, a light and soft member is desirable to contact the user's head. The light shielding portions 104 and 105 are, for example, a resin such as urethane or rubber.

  Further, on the back surface of the base material 100, wiring for connecting the battery box 102, the sensors 115 and 125, and the substrates in the housings 111 and 121 is laid. However, the portion other than the portion where the sensors 115 and 125 are provided on the back surface of the base material 100 is covered with the cover 106. The cover 106 acts as a shielding plate that prevents the substrate, wiring, and the like from directly touching the user's skin on the back side of the head mounting device 1 that contacts the head side. Therefore, the wiring is laid in the space between the base material 100 and the cover 106.

(First embodiment)
Below, 1st Embodiment using said measuring system is described. 5, 7, and 8 show an example of a flowchart of processing executed by the CPU 21 of the user terminal 2 in the first embodiment. In this embodiment, the user wears the head-mounted device 1 on the head before starting the measurement of the brain activity state associated with breathing, and the relative relationship between the sensors 115 and 125 and the user's head. Assume that positioning has been completed.

  In OP101, the CPU 21 of the user terminal 2 sends an instruction to perform measurement of the brain activity state of the user wearing the head-mounted device 1 to the head-mounted device 1 via the network N1 via the wireless communication unit 23. Send. When receiving the instruction from the user terminal 2, the head-mounted device 1 notifies the user of the start of breathing through the display unit 24 and the audio output unit 26 and starts measuring the brain activity state. The brain activity state is repeatedly measured at a predetermined sampling frequency. The head-mounted device 1 measures the brain activity state of the user with the sensors 115 and 125, and repeats the detected value indicating the brain activity state to the user terminal 2 at the above sampling frequency via the wireless communication unit 13. Send. Then, the CPU 21 as a receiving unit repeatedly receives the detection value detected by the head-mounted device 1 that is mounted on the user's head and detects the blood flow of the head at the above sampling frequency.

  In addition, when the CPU 21 receives a detection value (brain activity waveform) indicating the brain activity state from the head-mounted device 1 via the wireless communication unit 23, the CPU 21 stores it in a storage unit such as the memory 22. Here, the detected value may be the measured value itself, information obtained by processing the measured value so as to be easily transmitted to the user terminal 2, or repeatedly measured at the above sampling frequency for a certain period. Information that summarizes the values may be used. The detection value may be a value based on a value obtained by measuring the change in blood flow in the head by the head-mounted device 1. Each user is assigned a unique identifier in advance. The detection value indicating the brain activity state is stored as time series data together with time information and a user identifier.

  In OP101, the CPU 21 outputs a breathing start signal and an end signal by an image or sound through the display unit 24 or the sound output unit 26. The user terminal 2 may accept input of operations of a start signal and an end signal of breathing through the operation unit 25. Furthermore, the CPU 21 stores a detected value (brain activity waveform) indicating the brain activity state in the memory 22 together with the user identifier and time information.

  In OP102, the CPU 21 extracts a blood flow change component signal and a pulse wave component signal from the detection value (brain activity waveform) received from the head-mounted device 1. FIG. 6 is a diagram illustrating an example of a brain activity waveform, a blood flow change component signal, and a pulse wave component signal. In FIG. 6, the horizontal direction is the direction of the time axis. FIG. 6A is a diagram illustrating an example of a brain activity waveform that is a detection value. In OP102, as an extraction unit, the CPU 21 executes a process of extracting a component indicating a temporal change in blood flow from the detected value and a process of extracting a component indicating a temporal change in the pulse wave of the head from the detected value. The CPU 21 extracts the blood flow change component signal from the brain activity waveform by applying the received brain activity waveform to the first bandpass filter. The bandpass filter is a filter that extracts a signal in a predetermined frequency band. The frequency band of the signal passing through the first bandpass filter is, for example, 0.05 Hz to 0.14 Hz. A wave of about 0.1 Hz that passes through the first bandpass filter is referred to as a Mayer wave. The blood flow rate changing component is the amount of blood flowing through the blood vessels of the brain per unit time. FIG. 6B is a diagram illustrating a signal of a blood flow change component extracted from the brain activity waveform. The frequency band of the signal passing through the first band pass filter is 0.05 Hz or more and 0.14 Hz or less.

Further, the CPU 21 extracts a pulse wave component signal by applying the received brain activity waveform to the second band-pass filter. The frequency band of the signal passing through the second bandpass filter is a higher frequency band than the frequency band of the signal passing through the first bandpass filter.
The frequency band of the signal passing through the second band pass filter is, for example, 0.8 Hz to 2.0 Hz. The pulse wave component is a wave component generated by the pulse. FIG. 6C is a diagram showing a pulse wave component signal extracted from the brain activity waveform. The frequency band of the signal passing through the second band pass filter is 0.8 Hz to 2.0 Hz. The user terminal 2 stores the extracted blood flow rate change component signal and pulse wave component signal in the memory 22. Next, the CPU 21 advances the process to OP103.

In OP <b> 103, the CPU 21 performs processing (analysis processing) of analyzing data described below using the blood flow rate change component signal and the pulse wave component signal stored in the memory 22. In the present embodiment, the CPU 21 executes the analysis process of OP103, and calculates the heart rate of the user, the cycle of deep breathing, the depth of deep breathing, and the concentration change of carbon dioxide (CO ₂ ) in the blood. FIG. 7 is a flowchart showing details of the analysis process (OP103 in FIG. 5). The analysis process is, for example, a subroutine of a program executed by the CPU 21. The processing of the OP103 subroutine will be described below with reference to FIG.

  In OP 201, the CPU 21 calculates the heart rate based on the period of the pulse wave component signal stored in the memory 22. For example, the CPU 21 calculates a heart rate (referred to as “Herat Rate (HR)” or “beats per minute (bpm)”) based on a ratio between a time width between extreme values of the pulse wave component and a unit time, for example, 1 second. . The CPU 21 stores data indicating the calculated heart rate and a time zone for which the heart rate is calculated in the memory 22 in association with the identifier of the user. Next, the CPU 21 advances the process to OP202.

  In OP <b> 202, the CPU 21 calculates the breathing cycle based on the cycle of the blood flow rate change component signal stored in the memory 22. For example, the CPU 21 sets the time indicated by the period of the blood flow rate change component signal as the respiration period. In this embodiment, the reason for calculating the respiration cycle based on the signal flow of the blood flow change component is that the respiration affects the measured value of the blood flow because the blood vessels of the brain repeat expansion and contraction with respiration. It is. The CPU 21 stores, in the memory 22, data indicating the calculated respiration cycle and the time zone for which the respiration cycle is to be calculated.

  Further, in OP 203, the CPU 21 calculates the depth of respiration based on the amplitude of the blood flow rate change component signal stored in the memory 22. Here, the depth of breathing refers to the oxygen inhalation amount in one breath. For example, the unit of the amplitude of the blood flow change component signal is mM · mm, and the amplitude of the blood flow change component signal is correlated with the depth of respiration. Is regarded as the depth of breathing. Note that the CPU 21 may use the result obtained by performing predetermined weighting on the amplitude of the blood flow change component signal as the depth of respiration. The CPU 21 stores, in the memory 22, data indicating the calculated respiration depth and the time zone for which the respiration depth is to be calculated.

Next, in OP204, the CPU 21 calculates the tendency of CO ₂ concentration change in the blood of the user's head based on the signal of the blood flow change component. Here, the tendency of CO ₂ concentration change in blood is, for example, the slope of the linear function by modeling the change of the blood flow change component signal with a linear function in a period (long period) such as 1 minute. From the above, it can be judged from the increase tendency, decrease tendency or almost constant tendency of CO ₂ concentration in blood. In OP204, the CPU 21 models a change in the blood flow change component signal obtained by applying the blood flow change component signal to the low-pass filter as a linear function. Furthermore, the CPU 21 calculates whether the CO ₂ concentration in the blood tends to increase, decrease, or become substantially constant from the slope of the linear function obtained by modeling. In which range the slope of the linear function is, whether the CO ₂ concentration tends to increase, decrease or become substantially constant can be determined as appropriate. Then, the CPU 21 stores in the memory 22 data indicating the calculated tendency of the CO ₂ concentration change in the blood of the user and the time zone for which the tendency of the CO ₂ concentration change is to be calculated. Next, the CPU 21
Advances the process to OP205.

In OP201 to OP204, the time periods when the blood flow rate change component signal and the pulse wave component signal are measured are the same. Therefore, the processing of OP201 to OP204 provides data indicating the trend of heart rate, respiration cycle and depth, and CO ₂ concentration change in a certain time zone. In general, it is considered that humans have a substantially constant heart rate and blood CO ₂ concentration when sympathetic nerve activity is suppressed, that is, when they are relaxed. Therefore, in OP205, the CPU 21 suppresses the activity of the sympathetic nerve based on the data indicating the heart rate, the breathing cycle, the breathing depth, and the CO ₂ concentration change tendency stored in the memory 22 in OP201 to OP204. From the viewpoint of whether or not the user has been breathed, the user's breathing is analyzed.

  FIG. 8 shows an example of the processing of the OP205 subroutine. In OP301, the CPU 21 calculates the fluctuation range of the heart rate from the maximum value and the minimum value of the heart rate in a predetermined time width from the data indicating the heart rate. Here, the predetermined time width is a time width in which the fluctuation range of the heart rate can be calculated based on the maximum value and the minimum value of the heart rate. Then, the CPU 21 determines that the heart rate is substantially constant when the fluctuation range of the heart rate is within a predetermined range. Then, the CPU 21 stores a time zone in which the heart rate is substantially constant in the memory 22.

In OP302, the CPU 21 specifies a time zone in which the CO ₂ concentration is substantially constant from the data indicating the tendency of the calculated CO ₂ concentration change and the time zone to be calculated. Then, the CPU 21 stores the specified time zone in the memory 22.

Further, in OP 303, the CPU 21 specifies a time zone in which the heart rate is substantially constant and the CO ₂ concentration is substantially constant based on the above time zone stored in the memory 22. Then, the CPU 21 specifies the breathing cycle and depth in the specified time zone from the data indicating the breathing cycle and depth stored in the memory 22. In addition, when there is data indicating a plurality of cycles or depths in the specified time zone, any cycle or depth may be specified as the cycle and depth of breathing in the specified time zone. The average period or depth may be the period and depth of respiration in a specified time zone. The CPU 21 stores the specified breathing cycle and depth in the memory 22. Then, the CPU 21 ends this subroutine, further ends the subroutine shown in FIG. 7 from OP205, and advances the processing to OP104 in FIG.

In the present embodiment, by the processing of OP205, the time zone in which the heart rate is substantially constant and the CO ₂ concentration is substantially constant, that is, the time zone in which it can be considered that the activity of the sympathetic nerve is suppressed is specified. Can do. Then, the user's breathing cycle and depth are guided so as to be the user's breathing cycle and depth in the specified time period, so that the sympathetic activity can be suppressed. Person can be guided.

  In OP104, the CPU 21 acquires the measurement data of the brain activity state accompanying the respiration of the user wearing the head-mounted device 1, and uses it based on the acquired measurement data and the respiration cycle and depth specified in OP303. Induces the person's breathing. Specifically, when the respiration cycle calculated from the acquired measurement data is longer than the respiration cycle specified in OP303, the CPU 21 displays a message requesting to shorten the respiration cycle on the display unit 24. . When the respiration cycle calculated from the acquired measurement data is shorter than the respiration cycle specified in OP303, a message requesting to increase the respiration cycle is displayed on the display unit 24. If the difference between the breathing cycle calculated from the acquired measurement data and the breathing cycle specified in OP303 is within a predetermined time, the breathing cycle is regarded as appropriate and the breathing cycle is maintained. The requested message is displayed on the display unit 24.

  Thus, the user can adjust the breathing cycle according to the message displayed on the display unit 24. It should be noted that it is possible to appropriately determine whether the respiration cycle is determined to be long, short, or appropriate when the difference between the respiration cycle calculated from the measurement data and the respiration cycle specified in OP303 is high.

  In OP104, if the respiration depth calculated from the acquired measurement data is deeper than the respiration depth specified in OP303, the CPU 21 displays a message for requesting a shallow respiration on the display unit 24. If the breathing depth calculated from the acquired measurement data is shallower than the breathing depth specified in OP303, a message requesting deeper breathing is displayed on the display unit 24. If the difference between the breathing depth calculated from the acquired measurement data and the breathing depth specified in OP303 is within a predetermined amount, the breathing depth is regarded as appropriate and the breathing depth is maintained. The display unit 24 displays a message requesting that

  Thus, the user can adjust the breathing depth according to the message displayed on the display unit 24. It should be noted that it is possible to appropriately determine whether or not the difference between the breathing depth calculated from the measurement data and the breathing depth specified in OP303 is determined to be deep, shallow, or appropriate. The message displayed on the display unit 24 is not limited to characters, and an image that prompts the user to adjust the breathing may be displayed. As to how the above message is displayed on the display unit 24, various display forms can be applied using a known technique. Further, the message may be output from the voice output unit 26 as a voice message. The message requesting the user to adjust the breathing cycle and the message requesting the user to adjust the breathing depth may be displayed on the display unit 24 at the same time, or individually displayed on the display unit 24. You may make it do.

In OP104, the CPU 21 repeatedly executes the determination of the breathing cycle and depth based on the measurement data and the message display at predetermined time intervals. Here, examples of the predetermined time interval include one to several seconds, but can be set as appropriate. The CPU 21 performs the above-described respiration cycle and depth guidance, stores the respiration cycle and depth determination results for each time in the memory 22, and advances the process to OP105. In the present embodiment, in breathing training or the like, the blood CO ₂ concentration calculated from the temporal change of the blood flow of the user's head or the temporal change of the pulse wave, the respiratory cycle and the depth are used as indices. Objective indicators that do not depend on the experience of the instructor in charge of breathing training by guiding the breathing cycle and depth of the user so that the user can breathe with reduced sympathetic activity Breathing training based on

Next, in OP <b> 105, the CPU 21 performs respiration evaluation based on the determination result of the respiration cycle depth stored in the memory 22. FIG. 9 schematically shows the relationship between the CO ₂ concentration and the respiration depth. As shown in FIG. 9, the horizontal axis of the graph is the breathing depth and the vertical axis is the CO ₂ concentration. At this time, breathing that is deep and does not cause the CO ₂ concentration to be too low or too high can be regarded as good deep breathing with suppressed sympathetic nerve activity. However, even when a person is taking a good deep breath, if the breathing cycle and depth cannot be stabilized, the CO ₂ concentration in the blood changes, as shown by the respiration trajectory T1 in the figure, It is difficult to get good deep breathing and relax. Further, as shown by the respiration trajectory T2 in the figure, even if the human can maintain the respiration depth, the CO ₂ concentration decreases if the exhalation of respiration is small, and good deep respiration cannot be performed. Furthermore, when the person is breathing shallowly and breathing is low, the person may become hyperventilated as shown by the trajectory T3.

In the present embodiment, the CPU 21 evaluates how much the user can perform a good deep breath shown in FIG. 9 from the determination result of the depth of the breathing cycle stored in the memory 22. Further, the CPU 21 determines whether or not breathing can be regarded as hyperventilation. In this embodiment, the CO ₂ concentration when the respiration cycle and depth are specified in OP303 is regarded as the CO ₂ concentration when good deep breathing is performed. In addition, the extent to which the difference between the CO ₂ concentration and the respiration depth specified in OP303 and the CO ₂ concentration and the respiration depth calculated from the measurement data is within a range is determined as appropriate Can be determined.

  The CPU 21 performs a three-axis evaluation on the user's breathing “depth”, “periodicity”, and “heart rate” from the measurement data stored in the memory 22 and the determination result of the breathing cycle depth. The result is displayed on the display unit 24. Furthermore, the CPU 21 stores the evaluation result displayed on the display unit 24 in the memory 22 in association with the identifier of the user as a history. The history of the evaluation results stored in the memory 22 can be displayed again on the display unit 24 as the evaluation result of the past breath by the user operating the user terminal 2.

  Here, the evaluation of “depth” is an evaluation indicating how close to the depth of respiration considered to be a deep respiration with a good respiration depth. The evaluation of “periodicity” is an evaluation indicating how much respiration can be repeated at the same period, that is, reproducibility of respiration based on the respiration period. Evaluation of “periodicity” can be performed based on the correlation between the respiratory cycle and the previous cycle. The evaluation of “heart rate” is an evaluation indicating how much heart rate fluctuation can be suppressed and breathing can be performed.

  FIG. 10 shows an example of the above evaluation result displayed on the display 24a as an example of the display unit 24 of the user terminal 2 in OP105. As shown in FIG. 10, on the display 24a, the result of the three-axis evaluation on the “depth”, “periodicity”, and “heart rate” of the user's breath is displayed as an evaluation score in a triangular graph 24b. . In addition, the display 24a displays a score 24c obtained as a result of converting the “depth”, “periodicity”, and “heart rate” as the results of the triaxial evaluation.

  Evaluation of "depth", "periodicity", and "heart rate" specified the measurement data of the user's respiration measured in OP105, the respiration cycle and depth specified in OP303, and the respiration cycle and depth. This is based on comparison with heart rate data in the time zone. Then, how to convert the score may be such that a score that is easy for a user to confirm using a known technique is displayed on the display 24a. In addition, the evaluation results of “depth”, “periodicity”, and “heart rate” can be displayed on the display 24a using various display forms, not limited to the triangular graph.

  CPU21 complete | finishes the process of this flowchart, after performing display and a preservation | save of a user's respiration evaluation result.

(Second Embodiment)
Next, a second embodiment using the above measurement system will be described. In this embodiment, the process which estimates a user's overbreathing from the change of a blood flow rate is illustrated. Other configurations and operations of the present embodiment are the same as those of the first embodiment. Therefore, among the components of the second embodiment, the same components as those of the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted. In FIG. 11, an example of the flowchart of the process which CPU21 of the user terminal 2 performs in this embodiment is shown.

Since the processing of OP401 and OP402 is the same as the processing of OP101 and OP102, detailed description is omitted. Next, in OP403, the CPU 21 calculates the heart rate based on the period of the pulse wave component signal stored in the memory 22, as in OP201. Furthermore, the CPU 21 calculates whether the heart rate is in an upward tendency, a downward tendency, or a tendency to be substantially constant from the time change of the heart rate. In OP403, the CPU 21 calculates, as a calculation unit, a tendency of the user's heart rate to change over time based on the extracted component indicating the temporal change in the pulse wave of the head.

  For example, the CPU 21 models heart rate fluctuations with a linear function based on measurement data from a time traced back in the past by a predetermined time to the current time, and shows the trend of the heart rate according to the slope of the linear function. Can be calculated. Note that it is possible to appropriately determine in which range the slope of the linear function is, whether the heart rate tends to increase, decrease, or become substantially constant. When the CPU 21 calculates the trend of heart rate change and stores data indicating the calculation result in the memory 22, the process proceeds to OP404.

  In OP <b> 404, the CPU 21 calculates the tendency of the blood flow change in the user's head based on the signal of the blood flow change component. In OP <b> 404, the CPU 21 calculates, as a calculation unit, a tendency of the blood flow to change over time based on the extracted component indicating the time change of the blood flow.

  For example, the CPU 21 models the change of the blood flow rate change component signal with a linear function based on the measurement data from the time traced back in the past by a predetermined time to the current time, thereby determining the blood flow rate from the slope of the linear function. The tendency of change can be calculated. Note that it is possible to appropriately determine in which range the slope of the linear function is, the tendency of the change in blood flow tends to increase, decrease, or become substantially constant. Then, when the CPU 21 calculates the tendency of the blood flow change and stores the data indicating the calculation result in the memory 22, the process proceeds to OP405.

In OP405, as a determination unit, the CPU 21 determines whether or not the user's breathing is hyperventilation based on the calculated temporal change tendency of the blood flow rate and the calculated temporal change tendency of the user's heart rate. judge. When a user is in hyperventilation, the user's heart rate is considered to be rising. Moreover, CO ₂ concentration in the blood of the user decreases, i.e. believed blood flow is reduced. Therefore, the CPU 21 is used as a determination unit when the calculated change in blood flow over time indicates a decrease in blood flow and the change in the user's heart rate over time indicates an increase in heart rate. It is determined that the person's breathing is hyperventilation. Thereby, in this embodiment, it can be determined whether a user's respiration is a hyperventilation from the change of the blood flow rate of a user's head. Specifically, the CPU 21 determines whether or not the heart rate has increased and the blood flow volume has decreased, based on the trend in heart rate change calculated in OP403 and the trend in blood flow change calculated in OP404.

  If the CPU 21 determines that the heart rate has increased and the blood flow volume has decreased (OP405: Yes), the process proceeds to OP406. On the other hand, if the CPU 21 determines that the heart rate has not increased or the blood flow has not decreased (OP405: No), the processing of this flowchart is terminated.

  In OP406, as a notification unit, the CPU 21 regards the user's breathing as hyperventilation and notifies the user that the breathing is hyperventilation. For example, the CPU 21 displays a message on the display unit 24 notifying that breathing is hyperventilation. Instead of or along with the display of the message by the display unit 24, the CPU 21 may output a sound for notifying that the breathing is hyperventilation by the sound output unit 26. CPU21 will complete | finish the process of this flowchart, if the process which alert | reports to a user that respiration is hyperventilation is performed.

As described above, in the present embodiment, the user's breathing is based on the blood flow change tendency and the heart rate change tendency calculated from the temporal change of the blood flow of the user's head and the temporal change of the pulse wave. It is possible to determine whether or not the patient is hyperventilating and to report the hyperventilation.

  The above is the description regarding the embodiment of the present invention. However, the configuration of the measurement system is not limited to the above-described embodiment, and various configurations are possible within the scope that does not lose the technical idea of the present invention. It can be changed. For example, in the first embodiment described above, the CPU 21 specifies the respiration cycle and depth in a time zone in which the blood carbon dioxide concentration in the head blood is substantially constant and the user's heart rate is substantially constant. To do. However, the CPU 21 specifies the respiration cycle and depth in a time zone in which the concentration of carbon dioxide in the blood of the head is substantially constant, and guides the user's respiration using the specified respiration cycle and depth. May be. Alternatively, the CPU 21 may specify the respiration cycle and depth in a time zone in which the user's heart rate is substantially constant, and induce the user's respiration using the specified respiration cycle and depth. Furthermore, in the above embodiment, the change in the blood flow rate change component signal is modeled by a linear function, and the temporal change in the blood flow rate is calculated from the slope of the linear function. The method is not limited to this. For example, if the change in the blood flow over time is within a predetermined range, the blood flow is considered to be approximately constant, and the trend of the change in the blood flow over time is determined according to the change in the time change in the blood flow. May be.

  For example, in the first embodiment, when the user terminal 2 induces the user's breathing, the user may be caused to perform a predetermined action. The predetermined behavior includes, for example, zazen, meditation, yoga, sleep, video viewing, game play, music appreciation, exercise, eating and drinking, testing, application play, and the like. The predetermined action may be a specific action in a specific application. Applications include, for example, brain training applications. For example, when the user terminal 2 is allowed to view a moving image, the user terminal 2 displays the moving image on the display unit 24 and causes the audio output unit 26 to output sound associated with the moving image to allow the user to view the moving image. Further, when the user terminal 2 causes the game to be played, the user terminal 2 causes the display unit 24 and the sound output unit 26 to output a game image and sound, and causes the user to operate the game using the operation unit 25. Let the game play.

  Moreover, in said 1st Embodiment, the graph which shows the time change of the blood flow rate change component and the time change of a pulse wave component may be displayed on the display part 24 of the user terminal 2. FIG. Thereby, the user of the user terminal 2 can recognize the change of the pulse wave amplitude at the time of blood flow change (that is, the state of sympathetic nerve activity). The user of the user terminal 2 can perform training such as meditation while checking the graph and the message displayed on the display unit 24.

1 Head-mounted device 2 User terminal 21 CPU
22 Memory 24 Display unit 26 Audio output unit

Claims (6)

A receiving unit that is mounted on a user's head and receives a detection value detected by a head-mounted device that detects blood flow in the head;
An extraction unit that extracts a component indicating a temporal change in the blood flow rate and a component indicating a temporal change in the pulse wave of the head from the detection value;
Based on the extracted component indicating the temporal change in the pulse wave of the head, a calculation unit that calculates the temporal change in the user's heart rate;
A determination unit that determines whether or not the user's breathing is hyperventilation based on the time change of the extracted blood flow rate and the time change of the calculated heart rate of the user;
An information processing apparatus comprising: a notification unit that notifies that the user's breathing is hyperventilation when it is determined that the user's breathing is hyperventilation.   The determination unit determines that when the extracted time change in the blood flow rate indicates a decrease in the blood flow rate and the time change in the user heart rate indicates an increase in the heart rate, the user's breathing The information processing apparatus according to claim 1, wherein the information processing apparatus is determined to be hyperbreathing. The detection value detected by the head-mounted device that is mounted on the user's head and detects the blood flow of the head is received.
From the detected value, extract a component indicating the time change of the blood flow and a component indicating the time change of the pulse wave of the head,
Based on the extracted component indicating the temporal change in the pulse wave of the head, the temporal change in the user's heart rate is calculated,
Based on the time variation of the extracted blood flow and the time variation of the calculated heart rate of the user, it is determined whether or not the user's breathing is hyperventilation,
An information processing method characterized by notifying that the user's breathing is hyperventilation when it is determined that the user's breathing is hyperventilation.   When the time change of the extracted blood flow indicates the decrease of the blood flow and the time change of the heart rate of the user indicates an increase of the heart rate, the breathing of the user is overbreathing. The information processing method according to claim 3, wherein the determination is performed. On the computer,
Receiving a detected value that is mounted on a user's head and detected by a head-mounted device that detects blood flow in the head;
Extracting, from the detected value, a component indicating a time change of the blood flow and a component indicating a time change of the pulse wave of the head;
Calculating the time change of the heart rate of the user based on the extracted component indicating the time change of the pulse wave of the head;
Determining whether the user's breathing is hyperventilation based on the extracted temporal change in the blood flow and the calculated temporal change in the user's heart rate;
An information processing program for executing a step of notifying that the user's breathing is hyperventilation when it is determined that the user's breathing is hyperventilation.   The computer, when the time change in the calculated blood flow rate indicates a decrease in the blood flow rate and the time change in the user's heart rate indicates an increase in the heart rate, the user's breathing is excessive. 6. The information processing program according to claim 5, wherein the information processing program is determined to be respiration.

Images