JP2018083018A - Analysis apparatus, notification system, analysis method, notification method, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the accuracy of vital information.SOLUTION: The present invention relates to an analysis apparatus, which: acquires a user's vital signal from a vital sensor; acquires a non-vital signal indicating a motion causing a noise of the vital signal in the vital sensor from a non-vital sensor; estimates whether or not a noise has occurred in the vital signal based on the non-vital signal; corrects the vital signal in which occurrence of a noise is estimated or vital information obtained based on the vital signal in which occurrence of the noise is estimated; determines whether or not a notification condition is met, the notification condition which indicates a possibility of a predetermined risk occurring on a user or a possibility of an abnormality occurring on the user, based on the corrected vital signal or vital information; and when it is determined that the notification condition is met, transmits notification data indicating that the notification condition is met to an information device associated with the user.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for performing processing based on a vital signal.

  In recent years, a technique has been proposed in which a wearable device provided with an acceleration information measurement unit or the like is attached to a subject to detect the subject's posture and exercise state to perform health management and disease prevention (patent) Reference 1). In such a technique, it is important how to acquire the vital information of the subject more accurately by the wearable device.

Japanese Patent Laid-Open No. 2006-150102

However, depending on the environment in which the vital information is acquired, noise may be mixed in the acquired vital information. For example, there is a case where noise is mixed in the acquired vital information due to a deviation of the sensor electrode in accordance with the movement of the user's body. Conventionally, a technology for removing noise that occurs according to factors different from the user's body movement (such as fluctuations in contact impedance due to the effects of sweat or breathing) has been proposed, but the noise that occurs according to body movement is appropriate. Could not be removed. There is a concern that the accuracy of vital information obtained may be reduced due to such noise mixing.
In view of the above circumstances, an object of the present invention is to provide a technique capable of improving the accuracy of vital information.

  One aspect of the present invention is a vital signal acquisition unit that acquires a vital signal of a user from a vital sensor, and a non-vital signal that indicates a movement that causes noise in the vital signal in the vital sensor. A vital signal acquisition unit; a noise generation estimation unit that estimates whether noise has occurred in the vital signal based on the non-vital signal; and the vital signal that is estimated to have generated the noise, or the noise A correction unit that corrects vital information obtained based on the vital signal estimated to have occurred, and a predetermined risk has occurred to the user based on the vital signal or vital information corrected by the correction unit. Whether or not the notification condition indicating the possibility that the user is abnormal When determining that the notification condition is satisfied by the analysis unit to be determined, and transmitting the notification data indicating that the notification condition is satisfied to the information device related to the user And a notification control unit.

  One aspect of the present invention is the above-described analysis apparatus, further including a noise scale estimation unit that estimates the magnitude of noise in the vital signal, and the correction unit uses a different method depending on the magnitude of the noise. Make corrections.

  One aspect of the present invention is the above-described analysis device, wherein the non-vital sensor indicates a body motion sensor that indicates a body motion that is a motion of the user's body or a motion of a moving body that moves the user. Includes moving body sensors.

  One aspect of the present invention is a vital signal acquisition step of acquiring a vital signal of a user from a vital sensor, and a non-vital signal indicating a movement that causes noise of the vital signal in the vital sensor. A vital signal acquisition step; a noise generation estimation step for estimating whether noise has occurred in the vital signal based on the non-vital signal; and the vital signal in which the noise is estimated to be generated, or the noise A correction step for correcting vital information obtained based on the vital signal estimated to have occurred, and a predetermined risk has occurred to the user based on the vital signal or vital information corrected in the correction step. Or the possibility that the user has an abnormality An analysis step for determining whether the notification condition is satisfied, and the notification condition is satisfied for the information device related to the user when it is determined in the analysis step that the notification condition is satisfied And a notification control step of transmitting notification data indicating that this is the case.

  One aspect of the present invention is a vital signal acquisition step of acquiring a vital signal of a user from a vital sensor, and a non-vital signal indicating a movement that causes noise of the vital signal in the vital sensor. A vital signal acquisition step; a noise generation estimation step for estimating whether noise has occurred in the vital signal based on the non-vital signal; and the vital signal in which the noise is estimated to be generated, or the noise A correction step for correcting vital information obtained based on the vital signal estimated to have occurred, and a predetermined risk has occurred to the user based on the vital signal or vital information corrected in the correction step. Or the possibility that the user has an abnormality An analysis step for determining whether the notification condition is satisfied, and the notification condition is satisfied for the information device related to the user when it is determined in the analysis step that the notification condition is satisfied And a notification control step for transmitting notification data indicating that the computer program is executed.

  One aspect of the present invention is a notification system including the above analysis device and an information device that controls a device to be controlled as determined in advance when the notification data is received from the analysis device.

  One aspect of the present invention is a vital signal acquisition step of acquiring a vital signal of a user from a vital sensor, and a non-vital signal indicating a movement that causes noise of the vital signal in the vital sensor. A vital signal acquisition step; a noise generation estimation step for estimating whether noise has occurred in the vital signal based on the non-vital signal; and the vital signal in which the noise is estimated to be generated, or the noise A correction step for correcting vital information obtained based on the vital signal estimated to have occurred, and a predetermined risk has occurred to the user based on the vital signal or vital information corrected in the correction step. Or the possibility that the user has an abnormality An analysis step for determining whether the notification condition is satisfied, and the notification condition is satisfied for the information device related to the user when it is determined in the analysis step that the notification condition is satisfied A notification control step of transmitting notification data indicating that, and a control step of controlling the device to be controlled as determined in advance when the information device receives the notification data. .

  One aspect of the present invention provides a predetermined risk to the user based on a vital signal acquisition unit that acquires a vital signal of a user from a vital sensor and the vital signal or vital information obtained based on the vital signal. When it is determined that the notification condition is satisfied by the analysis unit that determines whether or not the notification condition indicating the possibility of occurrence of an error or the occurrence of an abnormality in the user is satisfied, and the analysis unit And a notification control unit that transmits notification data indicating that the notification condition is satisfied to an information device related to the user.

  According to the present invention, the accuracy of vital information can be improved.

It is a schematic block diagram which shows the system configuration | structure of the notification system 100 of this invention. 2 is a functional block diagram showing an outline of an analysis apparatus 10. FIG. It is a figure which shows the specific example of a vital signal and a non-vital signal. It is a figure which shows the specific example of the vital signal in which the small noise generate | occur | produced. It is a figure which shows the specific example of the vital signal correct | amended by the correction | amendment part. It is a figure which shows the specific example of the vital signal which large noise generate | occur | produced. It is a figure which shows the specific example of the vital signal correct | amended by the correction | amendment part. 6 is a diagram for explaining a method of detecting an R wave in the vital information acquisition unit 109. FIG. 3 is a functional block diagram showing an outline of a relay device 60. FIG. 5 is a flowchart illustrating a specific example of a flow of signal acquisition processing of the analysis device 10. 5 is a flowchart illustrating a specific example of a flow of notification processing of the analysis device 10. 3 is a sequence chart showing a first specific example of a processing flow of the notification system 100. 10 is a sequence chart showing a second specific example of a process flow of the notification system 100.

Hereinafter, specific configuration examples of the present invention will be described with reference to the drawings.
FIG. 1 is a schematic block diagram showing a system configuration of a notification system 100 of the present invention. The notification system 100 includes an analysis device 10, a vital sensor 20, a body motion sensor 30, a vehicle sensor 40, a position sensor 50, a relay device 60, and an information device 70. The relay device 60 and each sensor (the vital sensor 20, the body motion sensor 30, the vehicle sensor 40, and the position sensor 50) transmit and receive data by performing communication. Communication performed between the relay device 60 and each sensor may be wireless communication or wired communication. This communication may be, for example, short-range wireless communication (for example, Bluetooth (registered trademark)). The analysis device 10, the relay device 60, and the information device 70 communicate via the network 80. The network 80 may be a network using wireless communication or a network using wired communication. The network 80 may be configured by combining a plurality of networks. The relay device 60 transmits the data received from each sensor to the analysis device 10. The analysis device 10 transmits data to the relay device 60 and the information device 70 according to the analysis result.

  The analysis device 10 is configured using information devices such as a smartphone, a tablet terminal, a personal computer, a game device, a server device, and a cloud. The analysis device 10 wirelessly communicates the vital signal acquired by the vital sensor 20 and the non-vital signal and non-vital information acquired by non-virtual sensors (for example, the body motion sensor 30, the vehicle sensor 40, and the position sensor 50). Or it acquires by wired communication. The analysis device 10 estimates the occurrence of noise in the vital signal acquired by the vital sensor 20 based on the acquired non-vital signal. The analysis apparatus 10 performs a correction process on the vital signal acquired by the vital sensor 20 and vital information obtained from the vital signal according to the estimation result. By such processing, the analysis apparatus 10 can acquire more accurate vital signals and vital information. The analysis device 10 analyzes whether or not a predetermined notification condition is satisfied based on the acquired vital signal and vital information and the non-vital signal and non-vital information. Then, the analysis apparatus 10 transmits data to the information device that is a predetermined notification destination according to the analysis result.

  The vital sensor 20 acquires a vital signal of the user. The vital signal is a signal indicating information related to the life activity of the user's body. The vital signal is a signal indicating time-series changes such as, for example, cardiac action potential, respiratory activity, blood pressure, and the like. In the present embodiment, the vital sensor 20 acquires the action potential (cardiogram data) of the user's heart as a vital signal. The vital sensor 20 associates the acquired vital signal with the date and time when the vital signal was acquired, and transmits it to the analysis device 10 by wireless communication or wired communication. The vital sensor 20 may be configured to be wearable, for example.

  The body motion sensor 30 is an aspect of a non-vital sensor. The body motion sensor 30 acquires a user body motion signal. The body movement signal is a signal related to the movement (for example, vibration) of the user's body. The body motion sensor 30 may be configured using, for example, a triaxial acceleration sensor that is carried or attached to the user's body. The body motion sensor 30 associates the acquired body motion signal with the date and time when the body motion signal is acquired, and transmits the acquired body motion signal to the analysis device 10 by wireless communication or wired communication.

  The vehicle sensor 40 is an aspect of a non-vital sensor. The vehicle sensor 40 acquires a vehicle motion signal on which the user is riding. The vehicle movement signal is a signal related to the movement (for example, vibration) of the vehicle on which the user is riding. The vehicle sensor 40 may be configured using, for example, a triaxial acceleration sensor provided on the vehicle body. The vehicle sensor 40 associates the acquired vehicle motion signal with the date and time when the vehicle motion signal was acquired, and transmits the signal to the analysis device 10 by wireless communication or wired communication.

  The position sensor 50 is an aspect of a non-vital sensor. The position sensor 50 acquires position information indicating the position of the user. The position sensor 50 may acquire, for example, latitude and longitude values indicating the user's position as position information, may acquire an address indicating the user's position as position information, and may use other information as position information. You may get as The position sensor 50 may acquire position information using, for example, GPS (Global Positioning System).

  The relay device 60 is a communicable device. The relay device 60 receives data from each sensor by wireless communication or wired communication. The relay device 60 transmits the received data to the analysis device 10 via the network 80.

  The information device 70 is an information processing apparatus capable of communication. The information device 70 may be a general-purpose information processing device (for example, a personal computer, a server, a smartphone, or the like), or controls a specific device (for example, a vehicle brake, a vehicle engine, a factory facility motor, or the like). It may be a device or a specific device or sensor. The information device 70 receives a notification from the analysis device 10 via the network 80. The information device 70 performs a predetermined operation in response to the received notification. For example, when the information device 70 receives a notification from the analysis device 10 that the user's health condition has changed, the information device 70 responds to the notification with a specific device (for example, a factory device operated by the user or a user's operation). The vehicle driving device) is instructed to execute an operation for avoiding danger. For example, when the information device 70 receives a notification from the analysis device 10 that the user's health condition has changed, the information device 70 outputs a screen or a sound indicating the content of the notification, so that a person (relative, The supervisor, the supervisor, the management department of the corporation where the user works, etc.).

  Next, a specific functional configuration of the analysis apparatus 10 will be described. FIG. 2 is a functional block diagram illustrating an outline of the analysis apparatus 10. The analysis device 10 includes a CPU (Central Processing Unit), a memory, an auxiliary storage device, and the like connected by a bus, and executes an analysis program. By executing the analysis program, the analysis apparatus 10 includes a communication unit 101, a vital signal acquisition unit 102, a vital signal storage unit 103, a non-vital signal acquisition unit 104, a non-vital signal storage unit 105, a noise generation estimation unit 106, and a noise scale estimation. Device 107, correction unit 108, vital information acquisition unit 109, vital information storage unit 110, notification condition storage unit 111, analysis unit 112, notification control information storage unit 113, notification destination information storage unit 114, and notification control unit 115 Function as. Note that all or a part of each function of the analysis apparatus 10 may be realized by using hardware such as an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA). The analysis program may be recorded on a computer-readable recording medium. The computer-readable recording medium is, for example, a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built in the computer system. The analysis program may be transmitted / received via a telecommunication line.

  The communication unit 101 is configured using a network interface. The communication unit 101 transmits and receives data between the relay device 60 and the information device 70 via the network 80.

  The vital signal acquisition unit 102 acquires a vital signal related to the vital sensor 20 from the data received by the communication unit 101. The vital signal acquisition unit 102 writes the acquired vital signal in the vital signal storage unit 103.

  The vital signal storage unit 103 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The vital signal storage unit 103 stores the vital signal acquired by the vital signal acquisition unit 102 in association with information on the date and time when the vital signal was acquired.

  The non-vital signal acquisition unit 104 acquires a non-vital signal related to a non-vital sensor (for example, the body motion sensor 30 and the vehicle sensor 40) among the data received by the communication unit 101. The non-vital signal acquisition unit 104 writes the acquired non-vital signal in the non-vital signal storage unit 105.

  The non-vital signal storage unit 105 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The non-vital signal storage unit 105 stores the non-vital signal acquired by the non-vital signal acquisition unit 104 in association with information on the date and time when the non-vital signal was acquired.

  The noise generation estimation unit 106 estimates whether noise has occurred in the vital signal based on the non-vital signal. For example, the noise generation estimation unit 106 generates noise in the vital signal in a predetermined time width (hereinafter referred to as “noise generation interval”) in which a waveform satisfying a predetermined noise generation condition is detected in the non-vital signal. Estimate that The noise generation condition may be, for example, that an amplitude larger than the threshold value has occurred, may be that an amplitude larger than the threshold value is continuously generated in a predetermined time, or other conditions. There may be. When the signal of the triaxial acceleration sensor is obtained as the non-vital signal, the noise generation estimation unit 106 may estimate the generation of noise based on the combined value of x, y, and z, or any one of them Alternatively, noise generation may be estimated based on a plurality of values.

  The noise scale estimation unit 107 estimates the magnitude of the magnitude of noise in the section (noise generation section) where noise is estimated to be generated by the noise generation estimation unit 106. For example, when a predetermined condition (hereinafter, referred to as “large noise condition”) is satisfied in the vital signal in the noise generation section, the noise magnitude estimation unit 107 determines that the vital signal has a large noise (hereinafter, “large noise”). ”)). On the other hand, when the large noise condition is not satisfied in the vital signal in the noise generation section, the noise scale estimation unit 107 estimates that small noise (hereinafter referred to as “small noise”) is generated in the vital signal. To do.

  The large noise condition may be, for example, that a statistical value (for example, an average value, a maximum value, a median value, etc.) of the amplitude of the vital signal in the noise generation interval is equal to or greater than a predetermined threshold. The large noise condition may be, for example, that the interval between the predetermined waveforms that appear periodically in the vital signal in the noise generation interval does not satisfy the predetermined condition (for example, the predetermined waveform is not detected). Such a condition may be, for example, that a difference from an interval in a section that is not a noise generation section is larger than a predetermined threshold. Hereinafter, the large noise condition will be described by taking as an example the case where the vital signal is electrocardiographic data.

  In general, when the vital signal is electrocardiographic data, one or more waveforms of P wave, Q wave, R wave, S wave, T wave and U wave are acquired from the vital signal. it can. It may be determined that the large noise condition is satisfied when any one or a plurality of intervals of each wave is equal to or greater than a predetermined threshold. A large noise condition is that the difference between one or more intervals of each wave and the interval of each wave obtained from the same user's vital signal in a non-noise generation interval is equal to or greater than a predetermined threshold. May be. In this case, for example, if the waveform of a part of each wave (for example, R wave) is obtained in a predetermined cycle even if the amplitude is shifted, the noise is small (small noise). Detected. Thus, when the vital signal is electrocardiographic data, it can be seen that the reliability of the waveform is low because the period of each wave is deviated from a predetermined condition. Such a waveform with low reliability may be estimated as large noise. In addition, when none of the waves are detected, it may be determined that the large noise condition is satisfied.

  The correction unit 108 performs correction processing on the vital signal or vital information. The correction unit 108 records the corrected vital signal data in the vital signal storage unit 103. The correction unit 108 may overwrite the vital signal acquired by the vital signal acquisition unit 102 (the vital signal before correction) with the corrected vital signal, or may correct the vital signal after correction while leaving the vital signal before correction. The signal may be recorded separately. The correction unit 108 performs correction processing using a different method depending on the magnitude of noise. Hereinafter, each of the correction process performed when the noise scale is large and the correction process performed when the noise scale is small will be described.

(When noise level is large)
When the noise scale is large, the correction unit 108 performs correction processing (removal processing) so that the vital signal in the noise generation section is not used for subsequent processing. For example, the correction unit 108 performs processing so that a vital signal in a noise generation section having a large noise size is not used for acquisition of vital information by the vital information acquisition unit 109. For example, when the vital information acquisition unit 109 acquires vital information by counting the number of predetermined waveforms (for example, R waves) in the vital signal, the correction unit 108 generates noise to the vital information acquisition unit 109. Instructs not to count the vital signal of the section. For example, the correction unit 108 may remove the vital signal in the noise generation section by replacing it with a straight line having a zero amplitude.

(When the noise level is small)
When the noise scale is small, the correction unit 108 estimates a correct vital signal in the noise generation section, and replaces the vital signal in the noise generation section with an estimation result (signal replacement process). The correction unit 108 may estimate a correct vital signal in the noise generation section based on, for example, one or both vital signals before and after the noise generation section. For example, the correction unit 108 may use a vital signal having the same time width as that of the noise generation interval in the vital signal immediately before the noise generation interval as the estimation result. At this time, the correction unit 108 may acquire a vital signal immediately before the noise generation interval based on a part of a predetermined waveform that appears periodically as a reference position. For example, normal vital signals are always learned (so that correct vital signals can be created periodically), and in the noise generation period, the correct vital signals are estimated from the previously learned vital signals (pseudo-created) You may do it. When the vital signal is an electrocardiographic waveform, one or a plurality of predetermined waves (P wave, Q wave, R wave, S wave, T wave, and U wave) may be used as the reference position. Above, the description about the correction | amendment part 108 is finished.

  The vital information acquisition unit 109 acquires vital information based on the vital signal recorded in the vital signal storage unit 103. The vital information is information obtained by analyzing the vital signal. The vital information is, for example, information on the heart rate and the section in which the R signal is detected (for example, the RR interval).

  The vital information storage unit 110 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The vital information storage unit 110 stores vital information acquired by the vital information acquisition unit 109.

  The notification condition storage unit 111 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The notification condition storage unit 111 stores a condition (hereinafter referred to as “notification condition”) when notification is made according to the vital signal acquired by the analysis apparatus 10. The notification condition may be, for example, a condition (hereinafter referred to as “dangerous condition”) indicating a possibility that a predetermined danger has occurred in the user whose vital signal is acquired by the vital sensor 20. The notification condition may be, for example, a condition (hereinafter referred to as “abnormal condition”) indicating a possibility that the state of the user whose vital signal is acquired by the vital sensor 20 is different from the normal state.

  The dangerous condition occurs for the user when the feature amount of the vital signal or vital information and the feature amount are obtained by performing machine learning (such as deep learning) on the vital signal or vital information in advance. It may be obtained as information associating a possible dangerous state (for example, a state in which a symptom of a specific disease (arrhythmia, near-miss, panic disorder, etc.) is present). For example, by performing machine learning in advance on the value of the RR interval described later, a feature amount that is likely to cause a cardiac function state such as tachyarrhythmia or bradyarrhythmia is obtained as a risk condition. May be. Tachyarrhythmia is generally diagnosed when the heart rate per minute continuously measures 120 times or more. Therefore, regarding the tachyarrhythmia, the diagnosis condition may be defined as a dangerous condition instead of machine learning. A bradyarrhythmia is generally defined as a one minute heart rate of less than 60. Therefore, regarding the bradyarrhythmia, not the machine learning but the above-defined condition may be defined as the dangerous condition. As a dangerous condition, it may be defined that the heart rate has instantaneously increased under a predetermined condition. The predetermined condition may be defined by, for example, an absolute value of the heart rate, or may be defined by a ratio with respect to the heart rate immediately before. As a specific example of such a state, there are a near state where the user is likely to cause an accident, a state where he is surprised, and the like. A state in which it is possible to determine that sleepiness is occurring may be defined as the dangerous condition. Such a state may be defined according to the arousal level obtained based on the value of the sympathetic nerve component (LF) and the parasympathetic nerve component (HF) in the vital signal indicating the action potential of the electrocardiogram, for example. The arousal level may be defined as, for example, LF / (LF + HF). The dangerous condition may be defined as a condition indicating a possibility that heat stroke has occurred, for example. With regard to the possibility of heat stroke, it may be defined, for example, that the heart rate is higher than a predetermined value. The dangerous condition may be provided with a condition regarding a non-vital signal. As the non-vital signal, a signal indicating an operation state of a device that may be operated by the user, a signal indicating weather information (information such as temperature, humidity, and weather) around the user may be used. . For example, regarding the heat stroke described above, the temperature and humidity values around the user may be used as part of the dangerous condition. A signal indicating an electroencephalogram or a blood pressure may be used as a vital signal used for the dangerous condition. By using such a signal, a condition indicating the possibility of development of a specific disease may be defined as a risk condition.

  The abnormal condition is, for example, for each user by performing machine learning (deep learning, etc.) in advance on a vital signal or vital information in a normal state (a healthy state in which no abnormality has occurred) obtained in advance for each individual user. It may be obtained as a feature quantity that cannot be determined as a normal state. In other words, the danger condition may be defined as not satisfying the condition indicating the possibility of being in the normal state. For example, a vital signal is acquired in advance for a predetermined time (for example, several minutes) in a user's resting state (such as sitting in a chair), and is different from the resting state (corresponding to the normal state described above) based on the acquired vital signal A state may be defined as an abnormal state. Without using deep learning, a predetermined condition indicating that the heart rate is significantly different from the resting state (for example, the difference from the statistical value of the heart rate in the resting state exceeds a threshold, the ratio of the difference to the statistical value is Exceeding the threshold) may be defined as an abnormal condition. Moreover, the vital signal and the non-vital signal (for example, the signal of the body motion sensor 30) obtained in the normal state may be machine-learned in advance, and it may be defined as the dangerous state that is not the normal state. Machine learning is performed using non-vital signals such as signals that indicate the operating state of equipment that the user may be operating and signals that indicate weather information (information such as temperature, humidity, and weather) around the user. It may be done.

  The analysis unit 112 determines whether the notification condition is satisfied based on the vital signal corrected by the correction unit 108 or the vital information acquired by the vital information acquisition unit 109. The analysis unit 112 passes the analysis result to the notification control unit 115.

  The notification control information storage unit 113 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The notification control information storage unit 113 relates to a user who has acquired a vital signal, information about a notification method in the case of performing notification, and information regarding processing after the notification is performed (collectively, these are referred to as “notification control information”). ) Is memorized.

  The notification destination information storage unit 114 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The notification destination information storage unit 114 stores information about a destination to which the notification control unit 115 performs notification (hereinafter referred to as “notification destination information”). The notification destination information storage unit 114 stores notification destination information for each user, for example.

  The notification control unit 115 performs notification processing on the destination stored in the notification destination information storage unit 114 based on the notification control information stored in the notification control information storage unit 113 according to the analysis result by the analysis unit 112. .

  Next, the processing of the noise occurrence estimation unit 106 will be described more specifically. FIG. 3 is a diagram illustrating specific examples of vital signals and non-vital signals. The vertical axis in each signal in FIG. 3 indicates the amplitude of each signal, and the horizontal axis indicates time. In FIG. 3, the time on the horizontal axis in each signal is the same. In FIG. 3, a waveform 901 indicates a vital signal waveform, a waveform 902 indicates a body motion signal waveform, and a waveform 903 indicates a vehicle motion signal waveform. In a section T1 between time t1 and time t2, large amplitudes are generated in the waveform 902 of the body motion signal and the waveform 903 of the vehicle motion signal. As a result, the noise generation condition is satisfied in the section T1 of the waveform 902 and the waveform 903. Therefore, the noise generation estimation unit 106 estimates the section T1 as the noise generation section. The noise generation estimation unit 106 may estimate a section in which a predetermined section is added to one or both of the preceding and succeeding sections as a noise generation section in addition to the section in which noise is detected in the non-vital signal. Good.

  Next, the processing of the noise scale estimation unit 107 and the correction unit 108 will be described more specifically. FIG. 4 is a diagram illustrating a specific example of a vital signal in which small noise has occurred. In FIG. 4, an electrocardiographic signal is shown as a specific example of the vital signal. In FIG. 4, almost no noise is generated in the vicinity of times t11 and t13, and small-scale noise is generated in the vicinity of t12. When the noise scale is small, any one or a plurality of P waves, Q waves, R waves, T waves, and U waves can be acquired from the vital signal. For example, in the example of FIG. 4, a P wave and an R wave can be detected from a vital signal near t12. As described above, when any one or a plurality of predetermined waves are detected, the noise magnitude estimation unit 107 estimates that the noise magnitude is small.

  FIG. 5 shows a specific example of the vital signal corrected by the correction unit 108. In the example of FIG. 5, the correction unit 108 estimates the waveform of T12 that is a section near t12 estimated as the noise generation section as the waveform of the section of T11 that is the immediately preceding predetermined section. At this time, the interval between T11 and T12 is determined using the times t11 and t12 when the R wave, which is a predetermined wave, is detected as a reference position. That is, the correction unit 108 replaces the waveform of T11 with the waveform of T12 so that the position of t11 overlaps the position of t12.

  FIG. 6 is a diagram illustrating a specific example of a vital signal in which large noise has occurred. In FIG. 6, an electrocardiographic signal is shown as a specific example of the vital signal. In FIG. 6, almost no noise is generated in the vicinity of times t21 and t23, and large-scale noise is generated in the vicinity of t22. When the noise scale is large, none of the P wave, Q wave, R wave, T wave, and U wave can be acquired from the vital signal. Thus, when none of the predetermined waves is detected, the noise magnitude estimation unit 107 estimates that the noise magnitude is large.

FIG. 7 shows a specific example of the vital signal corrected by the correction unit 108. In the example of FIG. 7, the correction unit 108 replaces the waveform of T22 that is a section near t22 estimated as the noise generation section with a waveform having an amplitude of zero. For example, always learn the width of the vertical axis of the vital signal (cardiac action potential in the case of ECG: mv) and the horizontal axis (time in the case of ECG: msec) and exceed a certain threshold from the peak value of the R wave In such a case, it may be recognized that it is clearly not an R wave, and the R wave may be deleted.
For example, a wave that clearly differs from the peak value of one or a plurality of predetermined waves (P wave, Q wave, R wave, S wave, T wave, and U wave) may be deleted.

  Next, the process of the vital information acquisition unit 109 will be described more specifically. The vital information acquisition unit 109 detects an R wave from a vital signal indicating the action potential of the heart based on a predetermined threshold, for example. Each time the vital information acquisition unit 109 detects an R wave, the vital information acquisition unit 109 counts the number of times the R wave is detected (hereinafter referred to as “the number of R wave detections”). For example, the vital information acquisition unit 109 increments the R wave detection count by 1 each time an R wave is detected. The vital information acquisition unit 109 calculates a time difference (hereinafter referred to as “RR interval”) between the time when the R wave is detected and the time when the R wave is detected next.

  FIG. 8 is a diagram for explaining a detection method of the R wave in the vital information acquisition unit 109. FIG. 8 shows an electrocardiogram signal (vital signal) at a predetermined time. In FIG. 8, the vertical axis of the electrocardiogram signal represents the action potential of the heart, and the horizontal axis represents time. As shown in FIG. 8, a plurality of electrocardiogram components (P wave, Q wave, R wave, S wave, and T wave) exist in the electrocardiogram signal. The vital information acquisition unit 109 detects an R wave based on the electrocardiogram signal and a predetermined threshold value. For example, when the potential value of the electrocardiographic signal acquired periodically is substantially the same as the threshold value, the vital information acquisition unit 109 detects the heart action potential data that is substantially the same as the threshold value as an R wave. At this time, the vital information acquisition unit 109 also detects the time when the R wave is detected. In FIG. 8, R waves are detected at the times indicated by points 15-1, 15-2, and 15-3. In addition, after the R wave is detected at the time indicated by points 15-1, 15-2, and 15-3, it becomes substantially the same as the threshold value at the time indicated by points 16-1, 16-2, and 16-3. Heart action potential data is detected. However, the vital information acquisition unit 109 detects the action potential data of the heart, which is detected from when the R wave is detected until a certain time (for example, 200 milliseconds) elapses, which is substantially the same as the threshold value. It is not detected as an R wave. That is, heart action potential data that is substantially the same as the threshold value at the times indicated by points 16-1, 16-2, and 16-3 is not detected as an R wave.

  In general, since the RR interval is said to be about 500 milliseconds, there is a high possibility of noise in data detected until a certain time (for example, 200 milliseconds) elapses. Therefore, by the above-described processing, it is possible to exclude noise that causes a reduction in accuracy by not detecting all heart action potential data that is substantially the same as the threshold value as R waves. As a result, the R wave can be detected with high accuracy.

  FIG. 9 is a functional block diagram illustrating an outline of the relay device 60. The relay device 60 includes a CPU, a memory, an auxiliary storage device, and the like connected by a bus and executes a relay program. By executing the relay program, the relay device 60 functions as a device including the first communication unit 601, the second communication unit 602, the relay information storage unit 603, and the relay unit 604. Note that all or some of the functions of the relay device 60 may be realized using hardware such as an ASIC, PLD, or FPGA. The relay program may be recorded on a computer-readable recording medium. The computer-readable recording medium is, for example, a portable medium such as a flexible disk, a magneto-optical disk, a ROM, a CD-ROM, or a storage device such as a hard disk built in the computer system. Further, the relay program may be transmitted / received via a telecommunication line.

  The first communication unit 601 performs wireless communication or wired communication. The first communication unit 601 performs communication with each sensor (the vital sensor 20, the body motion sensor 30, the vehicle sensor 40, and the position sensor 50). The first communication unit 601 receives data transmitted from each sensor.

  The second communication unit 602 performs wireless communication or wired communication. The second communication unit 602 transmits data to another device (for example, the analysis device 10) via the network 80.

  The relay information storage unit 603 is configured using a storage device such as a magnetic hard disk device or a semiconductor storage device. The relay information storage unit 603 stores information related to data relay destinations. The relay information storage unit 603 stores, for example, the address of the analysis device 10 that is a transmission destination of data received from each sensor.

  The relay unit 604 transmits the data of each sensor received via the first communication unit 601 to the relay destination stored in the relay information storage unit 603 via the second communication unit 602.

FIG. 10 is a flowchart illustrating a specific example of the flow of signal acquisition processing of the analysis apparatus 10. Hereinafter, the flow of processing of the analysis apparatus 10 will be described with reference to FIG.
First, the vital signal acquisition unit 102 acquires a vital signal (step S101). The vital signal acquisition unit 102 records the acquired vital signal in the vital signal storage unit 103. Next, the non-vital signal acquisition unit 104 acquires a non-vital signal (step S102). The non-vital signal acquisition unit 104 records the acquired non-vital signal in the non-vital signal storage unit 105.

  Next, the noise occurrence estimation unit 106 estimates the occurrence of noise in the vital signal based on one or more non-vital signals (step S103). If it is estimated that no noise has occurred (step S104—NO), the process ends without performing any particular process in that section. On the other hand, when it is estimated that noise is generated (step S104-YES), the noise scale estimation unit 107 estimates the noise scale in the noise generation section (step S105). When it is estimated that the noise scale is large (step S106: YES), the correction unit 108 performs a removal process (step S107). On the other hand, when it is estimated that the noise scale is small (NO in step S106), the correction unit 108 performs signal replacement processing (step S108). The process shown in FIG. 10 may be executed after the whole of the vital signal and the non-vital signal is acquired, or may be executed in a predetermined cycle in parallel with the process of acquiring the vital signal and the non-vital signal. Good. Particularly in the latter case, the processes in steps S101 and S102 may be executed at independent timing in parallel with the processes in and after step S103. In this case, the processes after step S103 may be executed every predetermined time width.

  FIG. 11 is a flowchart illustrating a specific example of a notification process flow of the analysis apparatus 10. Hereinafter, the notification process flow of the analysis apparatus 10 will be described with reference to FIG. First, the analysis unit 112 acquires a vital signal or vital information of a user to be analyzed (step S201). The vital signal or vital information acquired by the analysis unit 112 in step S201 is corrected by the correction unit 108. The analysis unit 112 also acquires a non-vital signal of the user to be analyzed (step S202). The non-vital signal acquired by the analysis unit 112 in step S202 is, for example, a signal output by the vehicle sensor 40 or the position sensor 50. The analysis unit 112 determines whether or not the notification condition stored in the notification condition storage unit 111 is satisfied based on the acquired vital signal or vital information and the non-vital signal (step S203). When the notification condition is not satisfied (step S204—NO), the notification control unit 115 ends the process shown in FIG. On the other hand, when the notification condition is satisfied (step S204—YES), the notification control unit 115 acquires notification control information according to the analysis target user and the satisfied notification condition. In addition, the notification control unit 115 acquires notification destination information corresponding to the acquired notification control information (step S205). Then, the notification control unit 115 performs notification according to the acquired notification control information and notification destination information (step S206).

  FIG. 12 is a sequence chart showing a first specific example of the processing flow of the notification system 100. In the sequence chart illustrated in FIG. 12, a user terminal, an administrator terminal, and a control device are used as specific examples of the information device 70. The user terminal is an information processing apparatus having an input / output function, and is preferably carried by the user. The user terminal is an information device such as a smartphone, a mobile phone, a tablet terminal, a personal computer, or a game device. The administrator terminal is an information processing apparatus having an input / output function. The administrator terminal is used by, for example, an administrator (a user's boss, a service provider who watches the user, a user's relatives, etc.) who manages the user's state. The administrator terminal is an information device such as a smartphone, a mobile phone, a tablet terminal, a personal computer, or a game device. The control device is a device that controls the operation of a predetermined device related to the user. The control device may be, for example, a control device for a device operated by a user, a control device for a mobile body (vehicle, aircraft, etc.) that the user is driving, or other modes. It may be a device. The notification destination information storage unit 114 stores an address for transmitting data to the user terminal, the administrator terminal, and the control device as notification destination information.

  When analyzing that the notification condition is satisfied (step S301), the analysis apparatus 10 notifies the user terminal of the analysis result (step S302). The notification condition in the first specific example of FIG. 12 is a condition indicating, for example, that the user at that time is in a state that requires urgent action. More specifically, for example, conditions indicating abnormalities in cardiac function such as tachyarrhythmia or bradyarrhythmia, conditions indicating a state in which sleepiness can be determined, and heat stroke This is a condition indicating the possibility of occurrence.

  When notified by the analysis device 10 that the notification condition is satisfied, the user terminal displays a screen for requesting a predetermined input operation to the user (hereinafter referred to as “input request screen”) on the display device (Step S1). S303). When the user performs a predetermined input operation within a predetermined time on the input request screen, the user terminal transmits response data indicating that the input operation has been performed to the analysis apparatus 10. In this case, the analysis apparatus 10 does not perform the subsequent processing with respect to FIG. 12, but performs the processing according to the next newly obtained vital signal or the like. On the other hand, when a predetermined input is not performed from the user within a predetermined time on the input request screen, the user terminal does not transmit response data to the analysis device 10. When the analysis apparatus 10 does not receive the response data even after a predetermined time has elapsed (step S304), the analysis apparatus 10 transmits an abnormality notification indicating the possibility of abnormality to the user to the administrator terminal and the control device ( Steps S305 and S306). The abnormality notification may include information indicating the position of the user obtained according to the output of the position sensor 50.

  When the administrator terminal receives the abnormality notification, it notifies the administrator that the abnormality notification has been received. By knowing that the abnormality notification has been received, the administrator can grasp that the abnormality has occurred in the user and can quickly take the necessary response.

  When receiving the abnormality notification, the control device performs predetermined control. For example, when the control device is a vehicle control device, the control device may switch the vehicle that the user is driving to the automatic driving mode and move the vehicle to a safe position. For example, when the control device is a vehicle control device, the control device may decelerate and stop the vehicle by applying a brake of the vehicle that the user is driving. For example, when the control device is a factory device, the control device may stop the device operated by the user. For example, when the control device is a device that controls an AED (Automated External Defibrillator) worn by the user, the control device may operate the AED.

  Thereafter, the analysis device 10 executes notification processing (step S307). In the reporting process, the analysis device 10 reports to administrative organizations such as medical institutions, fire stations, and police stations. At that time, the user's current location acquired from the user's position sensor 50 may also be reported.

  FIG. 13 is a sequence chart showing a second specific example of the processing flow of the notification system 100. In the sequence chart shown in FIG. 13, an administrator terminal is used as a specific example of the information device 70. The administrator terminal is an information processing apparatus having an input / output function. The administrator terminal is used by, for example, an administrator (a user's boss, a service provider who watches the user, a user's relatives, etc.) who manages the user's state. The administrator terminal is an information device such as a smartphone, a mobile phone, a tablet terminal, a personal computer, or a game device. The notification destination information storage unit 114 stores an address for transmitting data to the administrator terminal as notification destination information.

  When analyzing that the notification condition is satisfied (step S401), the analysis apparatus 10 notifies the administrator terminal of the analysis result (step S402). The notification condition in the second specific example of FIG. 13 includes a condition indicating, for example, a state in which the user is likely to cause an accident or the like, a state in which the user is in danger, and the like. The analysis device 10 records such analysis result history. After that, the analysis apparatus 10 performs a process of analyzing in what situation the notification condition is satisfied using the history of the analysis result (step S403). For example, by drawing the position of the user when the notification condition is satisfied on one map for one or a plurality of users, it is possible to confirm on the map a place where an accident is likely to occur. Further, by outputting information (address, etc.) indicating such a position as a list, it is possible to alert the user and prevent accidents.

  In the analysis apparatus 10 configured in this way, it is possible to improve the accuracy of vital information. More specifically, it is as follows. Conventionally, some techniques have been proposed for removing noise generated with respect to vital signals when the amount of activity of the user is relatively small (at rest). On the other hand, no technique has been proposed for appropriately removing noise generated with respect to a vital signal when the amount of activity of the user is relatively large (when active). In response to such a problem, the analysis apparatus 10 estimates the occurrence of noise for the vital signal based on a non-vital signal that directly or indirectly indicates the magnitude of the activity amount of the user. Therefore, even if it is difficult to accurately estimate the presence / absence of noise based only on the vital signal, the presence / absence of noise can be estimated more accurately based on the non-vital signal. Therefore, even if the user is active by performing correction processing (such as removal of the vital signal of the noise part, estimation and replacement of the vital signal of the noise part) on the vital signal that is estimated to have noise. Even if it exists, it becomes possible to acquire vital signals and vital information with higher accuracy.

  Further, by performing the processing of the sequence chart as shown in FIG. 12, it is possible to quickly respond according to the user's state. For example, when the user is unable to drive the vehicle normally due to abnormal cardiac function such as tachyarrhythmia, the vehicle control device is immediately notified and controlled, thereby causing a vehicle accident. This can be prevented beforehand.

(Modification)
The noise occurrence estimation unit 106 may estimate the occurrence of noise based on only some of the non-vital signals among the plurality of non-vital signals. The noise generation estimation unit 106 may determine that noise generation is not estimated in other non-vital signals when noise generation is estimated in some non-vital signals among a plurality of non-vital signals. It may be estimated that noise has occurred.

  The first communication unit 601 and the second communication unit 602 of the relay device 60 may be configured as one communication unit.

  In the flowchart of FIG. 11, in the case of step S204-NO, the notification control unit 115 may notify data indicating that no problem has occurred.

  In the flowchart of FIG. 11, when the non-vital signal is not used for the notification condition, the analysis unit 112 does not need to acquire the non-vital signal. In this case, the process of step S202 is unnecessary, and in the process of step S203, the analysis unit 112 determines whether the notification condition is satisfied based on only the vital signal or vital information.

  In the sequence chart of FIG. 12, when a predetermined input is not performed from the user within a predetermined time on the input request screen, the user terminal transmits response data indicating that the input has not been performed to the analysis apparatus 10. May be. In this case, the analysis apparatus 10 performs the process after step S204.

In FIG. 12, when a predetermined input operation is requested from the user, the input request screen is not necessarily displayed. For example, when a notification indicating that the notification condition is satisfied is executed by mail, the user terminal may determine that a predetermined input operation has been performed by opening the mail.
In FIG. 12, the notification process may not be executed.
In FIG. 12, the analysis unit 112 and the notification control unit 115 of the analysis apparatus may record a history of operation results in each process (steps S301 and S304) as shown in FIG. 12 for each user. In that case, time and user position information may also be recorded. By analyzing such a history, it is possible to appropriately examine future countermeasures and preventive measures for each user and for the whole.

  The body motion sensor 30 and the vehicle sensor 40 in this embodiment are only specific examples of non-vital sensors. Other sensors may be applied to the notification system 100 as non-virtual sensors. For example, instead of the vehicle sensor 40, an acceleration sensor provided on a flying body (airplane, helicopter, etc.) on which the user is boarding may be used, or an acceleration sensor provided on a scaffold where the user is active May be used. That is, any sensor may be used as long as it is a sensor that can detect vibrations that cause the user's body to move (for example, a moving body sensor that detects the movement of a moving body that moves the user).

  The analysis device 10 may be configured using a plurality of computers. For example, the function of the analysis apparatus 10 may be implemented using a cloud system. The analysis device 10 may be configured as a device that does not include the vital information acquisition unit 109 and the vital information storage unit 110. In this case, the analysis device 10 may be configured as a device that provides the acquired vital signal to other information processing devices.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes designs and the like that do not depart from the gist of the present invention.

DESCRIPTION OF SYMBOLS 100 ... Notification system, 10 ... Analysis device, 20 ... Vital sensor, 30 ... Body motion sensor, 40 ... Vehicle sensor, 50 ... Position sensor, 60 ... Relay device, 70 ... Information equipment, 80 ... Network, 101 ... Communication part, DESCRIPTION OF SYMBOLS 102 ... Vital signal acquisition part, 103 ... Vital signal storage part, 104 ... Non vital signal acquisition part, 105 ... Non vital signal storage part, 106 ... Noise generation estimation part, 107 ... Noise magnitude estimation part, 108 ... Correction part, 109 ... Vital information acquisition unit, 110 ... Vital information storage unit, 111 ... Notification condition storage unit, 112 ... Analysis unit, 113 ... Notification control information storage unit, 114 ... Notification destination information storage unit, 115 ... Notification control unit

Claims (8)

A vital signal acquisition unit that acquires a vital signal of a user from a vital sensor;
A non-vital signal acquisition unit that acquires a non-vital signal indicating a movement that causes noise in the vital signal in the vital sensor;
A noise generation estimation unit that estimates whether noise has occurred in the vital signal based on the non-vital signal;
A correction unit that corrects the vital signal estimated to have generated the noise, or vital information obtained based on the vital signal estimated to have generated the noise, and
Based on the vital signal or vital information corrected by the correction unit, a determination is made as to whether or not a notification condition indicating a possibility that the user has a predetermined danger or a possibility that an abnormality has occurred in the user is satisfied An analysis unit to
A notification control unit that transmits notification data indicating that the notification condition is satisfied to an information device related to the user when the analysis unit determines that the notification condition is satisfied;
An analysis apparatus comprising: A noise magnitude estimation unit for estimating the magnitude of noise in the vital signal;
The analysis device according to claim 1, wherein the correction unit performs correction by a different method according to the magnitude of the noise.   The analysis according to claim 1, wherein the non-vital sensor includes a body motion sensor that indicates a body motion that is a motion of the user's body, or a mobile body sensor that indicates a motion of a moving body that moves the user. apparatus. A vital signal acquisition step of acquiring a vital signal of the user from the vital sensor;
A non-vital signal acquisition step of acquiring a non-vital signal indicating a movement causing noise of the vital signal in the vital sensor from the non-vital sensor;
A noise generation estimation step for estimating whether noise has occurred in the vital signal based on the non-vital signal;
A correction step of correcting the vital signal estimated to have generated the noise, or vital information obtained based on the vital signal estimated to have generated the noise;
Based on the vital signal or vital information corrected in the correction step, it is determined whether or not a notification condition indicating a possibility that the user has a predetermined danger or a possibility that the user has an abnormality is satisfied. An analysis step to perform,
A notification control step of transmitting notification data indicating that the notification condition is satisfied to an information device related to the user when it is determined that the notification condition is satisfied in the analysis step;
An analysis method having A vital signal acquisition step of acquiring a vital signal of the user from the vital sensor;
A non-vital signal acquisition step of acquiring a non-vital signal indicating a movement causing noise of the vital signal in the vital sensor from the non-vital sensor;
A noise generation estimation step for estimating whether noise has occurred in the vital signal based on the non-vital signal;
A correction step of correcting the vital signal estimated to have generated the noise, or vital information obtained based on the vital signal estimated to have generated the noise;
Based on the vital signal or vital information corrected in the correction step, it is determined whether or not a notification condition indicating a possibility that the user has a predetermined danger or a possibility that the user has an abnormality is satisfied. An analysis step to perform,
A notification control step of transmitting notification data indicating that the notification condition is satisfied to an information device related to the user when it is determined that the notification condition is satisfied in the analysis step;
A computer program for causing a computer to execute. The analysis device according to any one of claims 1 to 3,
An information system comprising: an information device that controls a device to be controlled as determined in advance when the notification data is received from the analysis device. A vital signal acquisition step of acquiring a vital signal of the user from the vital sensor;
A non-vital signal acquisition step of acquiring a non-vital signal indicating a movement causing noise of the vital signal in the vital sensor from the non-vital sensor;
A noise generation estimation step for estimating whether noise has occurred in the vital signal based on the non-vital signal;
A correction step of correcting the vital signal estimated to have generated the noise, or vital information obtained based on the vital signal estimated to have generated the noise;
Based on the vital signal or vital information corrected in the correction step, it is determined whether or not a notification condition indicating a possibility that the user has a predetermined danger or a possibility that the user has an abnormality is satisfied. An analysis step to perform,
A notification control step of transmitting notification data indicating that the notification condition is satisfied to an information device related to the user when it is determined that the notification condition is satisfied in the analysis step;
When the information device receives the notification data, a control step of controlling a device to be controlled as determined in advance;
A notification method. A vital signal acquisition unit that acquires a vital signal of a user from a vital sensor;
Based on the vital signal or vital information obtained based on the vital signal, a notification condition indicating that the user may have a predetermined danger or anomaly may be satisfied An analysis unit for determining whether or not
A notification control unit that transmits notification data indicating that the notification condition is satisfied to an information device related to the user when the analysis unit determines that the notification condition is satisfied;
An analysis apparatus comprising:

Images