WO2023047445A1 - 脈拍計測装置、生体情報推定装置、脈拍計測方法、および記録媒体 - Google Patents
脈拍計測装置、生体情報推定装置、脈拍計測方法、および記録媒体 Download PDFInfo
- Publication number
- WO2023047445A1 WO2023047445A1 PCT/JP2021/034502 JP2021034502W WO2023047445A1 WO 2023047445 A1 WO2023047445 A1 WO 2023047445A1 JP 2021034502 W JP2021034502 W JP 2021034502W WO 2023047445 A1 WO2023047445 A1 WO 2023047445A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- light
- pulse
- subject
- emitters
- light receiving
- Prior art date
Links
- 238000009532 heart rate measurement Methods 0.000 title claims abstract description 59
- 238000000034 method Methods 0.000 title claims description 49
- 238000010606 normalization Methods 0.000 claims abstract description 114
- 238000005259 measurement Methods 0.000 claims abstract description 69
- 239000000758 substrate Substances 0.000 claims abstract description 50
- 230000003287 optical effect Effects 0.000 claims description 96
- 230000002996 emotional effect Effects 0.000 claims description 90
- 210000004204 blood vessel Anatomy 0.000 claims description 32
- 230000008569 process Effects 0.000 claims description 19
- 238000001514 detection method Methods 0.000 claims description 11
- 238000010586 diagram Methods 0.000 description 44
- 230000008451 emotion Effects 0.000 description 30
- 239000012790 adhesive layer Substances 0.000 description 23
- 230000037007 arousal Effects 0.000 description 21
- 238000004891 communication Methods 0.000 description 16
- 238000012545 processing Methods 0.000 description 13
- 230000010365 information processing Effects 0.000 description 12
- 230000033001 locomotion Effects 0.000 description 12
- 230000010349 pulsation Effects 0.000 description 12
- 238000005457 optimization Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 8
- 230000007423 decrease Effects 0.000 description 7
- 230000000694 effects Effects 0.000 description 7
- 230000002093 peripheral effect Effects 0.000 description 6
- 239000010410 layer Substances 0.000 description 5
- 239000000853 adhesive Substances 0.000 description 4
- 230000001070 adhesive effect Effects 0.000 description 4
- 201000010099 disease Diseases 0.000 description 4
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 230000006996 mental state Effects 0.000 description 4
- 210000005037 parasympathetic nerve Anatomy 0.000 description 4
- 210000000467 autonomic pathway Anatomy 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 239000010408 film Substances 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 230000002889 sympathetic effect Effects 0.000 description 3
- 210000003462 vein Anatomy 0.000 description 3
- JOYRKODLDBILNP-UHFFFAOYSA-N Ethyl urethane Chemical compound CCOC(N)=O JOYRKODLDBILNP-UHFFFAOYSA-N 0.000 description 2
- 206010062519 Poor quality sleep Diseases 0.000 description 2
- 206010041349 Somnolence Diseases 0.000 description 2
- 238000002835 absorbance Methods 0.000 description 2
- 239000008280 blood Substances 0.000 description 2
- 210000004369 blood Anatomy 0.000 description 2
- 210000000988 bone and bone Anatomy 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000031700 light absorption Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 210000003205 muscle Anatomy 0.000 description 2
- 210000005036 nerve Anatomy 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 210000003491 skin Anatomy 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 210000002820 sympathetic nervous system Anatomy 0.000 description 2
- 239000010409 thin film Substances 0.000 description 2
- 210000001519 tissue Anatomy 0.000 description 2
- 238000009528 vital sign measurement Methods 0.000 description 2
- NOOLISFMXDJSKH-UTLUCORTSA-N (+)-Neomenthol Chemical compound CC(C)[C@@H]1CC[C@@H](C)C[C@@H]1O NOOLISFMXDJSKH-UTLUCORTSA-N 0.000 description 1
- LQIAZOCLNBBZQK-UHFFFAOYSA-N 1-(1,2-Diphosphanylethyl)pyrrolidin-2-one Chemical compound PCC(P)N1CCCC1=O LQIAZOCLNBBZQK-UHFFFAOYSA-N 0.000 description 1
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 229920000742 Cotton Polymers 0.000 description 1
- NOOLISFMXDJSKH-UHFFFAOYSA-N DL-menthol Natural products CC(C)C1CCC(C)CC1O NOOLISFMXDJSKH-UHFFFAOYSA-N 0.000 description 1
- 239000004642 Polyimide Substances 0.000 description 1
- 208000000453 Skin Neoplasms Diseases 0.000 description 1
- 206010040830 Skin discomfort Diseases 0.000 description 1
- BZHJMEDXRYGGRV-UHFFFAOYSA-N Vinyl chloride Chemical compound ClC=C BZHJMEDXRYGGRV-UHFFFAOYSA-N 0.000 description 1
- 239000006096 absorbing agent Substances 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 239000003522 acrylic cement Substances 0.000 description 1
- 230000036626 alertness Effects 0.000 description 1
- 150000001336 alkenes Chemical class 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 206010003119 arrhythmia Diseases 0.000 description 1
- 230000006793 arrhythmia Effects 0.000 description 1
- 210000003403 autonomic nervous system Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000011247 coating layer Substances 0.000 description 1
- 230000000052 comparative effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 239000011889 copper foil Substances 0.000 description 1
- 230000005281 excited state Effects 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000001404 mediated effect Effects 0.000 description 1
- 230000003340 mental effect Effects 0.000 description 1
- 229940041616 menthol Drugs 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 239000004745 nonwoven fabric Substances 0.000 description 1
- JRZJOMJEPLMPRA-UHFFFAOYSA-N olefin Natural products CCCCCCCC=C JRZJOMJEPLMPRA-UHFFFAOYSA-N 0.000 description 1
- 210000001002 parasympathetic nervous system Anatomy 0.000 description 1
- 239000002985 plastic film Substances 0.000 description 1
- 229920006255 plastic film Polymers 0.000 description 1
- 229910021420 polycrystalline silicon Inorganic materials 0.000 description 1
- 229920001721 polyimide Polymers 0.000 description 1
- 229920000642 polymer Polymers 0.000 description 1
- 230000000284 resting effect Effects 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 239000013464 silicone adhesive Substances 0.000 description 1
- 201000000849 skin cancer Diseases 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/70—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mental therapies, e.g. psychological therapy or autogenous training
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
- A61B5/02416—Detecting, measuring or recording pulse rate or heart rate using photoplethysmograph signals, e.g. generated by infrared radiation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
- A61B5/02416—Detecting, measuring or recording pulse rate or heart rate using photoplethysmograph signals, e.g. generated by infrared radiation
- A61B5/02427—Details of sensor
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
- A61B5/02438—Detecting, measuring or recording pulse rate or heart rate with portable devices, e.g. worn by the patient
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
- A61B5/0245—Detecting, measuring or recording pulse rate or heart rate by using sensing means generating electric signals, i.e. ECG signals
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/165—Evaluating the state of mind, e.g. depression, anxiety
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6802—Sensor mounted on worn items
- A61B5/681—Wristwatch-type devices
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
- A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
- A61B5/743—Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2560/00—Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
- A61B2560/02—Operational features
- A61B2560/0223—Operational features of calibration, e.g. protocols for calibrating sensors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2560/00—Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
- A61B2560/04—Constructional details of apparatus
- A61B2560/0462—Apparatus with built-in sensors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
- A61B2562/04—Arrangements of multiple sensors of the same type
- A61B2562/046—Arrangements of multiple sensors of the same type in a matrix array
Definitions
- the present disclosure relates to a pulse measuring device and the like that measures the pulse.
- Patent Literature 1 discloses a method of deriving the mental state of a subject using biosignals detected for the subject.
- biosignals detected for the subject.
- statistical variations are calculated for a plurality of physiological parameters derived from biosignals, and a subject's excitement level is determined based on the calculated statistical variations.
- a time-domain heart rate variability signal is derived from a biosignal to calculate a plurality of heart rate variability parameters, and based on the calculated values of the plurality of heart rate variability parameters, a subject's emotional valence level is calculated. demand.
- the method of Patent Document 1 derives the subject's mental state according to the excitement level and the emotional valence level.
- Non-Patent Document 1 discloses a flexible imaging device in which a high-resolution array sensor is mounted on a flexible substrate.
- the device of Non-Patent Document 1 has a structure in which a polycrystalline silicon thin film transistor readout circuit and an organic photodiode with high sensitivity in the near-infrared region are combined.
- the device of Non-Patent Document 1 can acquire biometric information such as pulse and vein image of the subject with high resolution by being attached to the skin of the subject.
- the subject's mental state can be derived by the method of Patent Document 1.
- the method of Non-Patent Document 1 measurement conditions for pulse signals detected within the plane of the array sensor are unsuitable due to the effects of the environment under the skin where the device is attached and the difference in the distance between the light source and the sensor. become uniform.
- the technique of Non-Patent Document 1 is affected by artifacts caused by heartbeats and body movements, so it is difficult to make pulse signal measurement conditions uniform within the plane of the array sensor. That is, with the method of Non-Patent Document 1, it was difficult to accurately measure the pulse of the subject.
- the purpose of the present disclosure is to provide a pulse measuring device or the like that can accurately measure the pulse of a subject.
- a pulse measurement device includes a plurality of light emitters arranged on a measurement surface of a substrate attached to the skin of a subject whose pulse is to be measured and emitting light toward the skin of the subject, and a measurement surface of the substrate.
- a light receiver including a plurality of light receiving units for receiving reflected light of light emitted from the plurality of light emitters; receiving a corresponding received signal from the light receiver, optimizing the strength of the received signal using a normalization constant set for each of the plurality of light emitters, and generating the strength-optimized received signal using the normalization constant; and a control unit for outputting as a pulse signal.
- a pulse measurement method includes a plurality of light emitters that emit light toward the skin of a subject whose pulse is to be measured, and a plurality of light receivers that receive the reflected light of the light emitted from the plurality of light emitters.
- a program includes a plurality of light emitters that emit light toward the skin of a subject whose pulse is to be measured, and a plurality of light receiving units that receive the reflected light of the light emitted from the plurality of light emitters.
- a program for controlling a light receiver comprising: a process for emitting light to a plurality of light emitters; and a process for receiving from the light receiver a received signal corresponding to the reflected light of the light received by the light receiver. , a process of optimizing the intensity of the received signal using a normalized constant set for each of the plurality of light emitters, and a process of outputting the received signal whose intensity is optimized using the normalized constant as a pulse signal. , is executed by the computer.
- a pulse measuring device or the like that can accurately measure the pulse of a subject.
- FIG. 1 is a block diagram showing an example of a configuration of a pulse measuring device according to a first embodiment
- FIG. 1 is a conceptual diagram of the pulse measuring device according to the first embodiment viewed from the measurement surface side
- FIG. 1 is a cross-sectional view for explaining the configuration of a pulse measuring device according to a first embodiment
- FIG. 1 is a conceptual diagram showing an example in which the pulse measuring device according to the first embodiment is worn on the skin of a subject
- FIG. 2 is a conceptual diagram for explaining factors affecting the light intensity of reflected light measured by the pulse measuring device according to the first embodiment
- FIG. 4 is a conceptual diagram for explaining an example of intensity of a received signal according to reflected light measured by the pulse measuring device according to the first embodiment
- FIG. 4 is a conceptual diagram for explaining an example of normalization constant setting by the pulse measuring device according to the first embodiment;
- FIG. 4 is a conceptual diagram for explaining an example of optimization of received signals by the pulse measuring device according to the first embodiment;
- FIG. 4 is a conceptual diagram showing an example of displaying a pulse rate according to a pulse signal output from the pulse measuring device according to the first embodiment;
- FIG. 4 is a conceptual diagram showing an example of displaying time-series data of a pulse signal output from the pulse measuring device according to the first embodiment;
- 4 is a flowchart for explaining an example of calibration by the pulse measuring device according to the first embodiment;
- FIG. 7 is a flowchart for explaining another example of calibration by the pulse measuring device according to the first embodiment;
- FIG. 4 is a flowchart for explaining an example of pulse measurement by the pulse measurement device according to the first embodiment; It is a conceptual diagram which shows an example of a structure of the pulse measuring device which concerns on related technology. It is a conceptual diagram which shows an example of the signal measured by the pulse measuring device which concerns on related technology. It is a conceptual diagram which shows another example of the signal measured by the pulse measuring device which concerns on related technology. It is a conceptual diagram which shows another example of the signal measured by the pulse measuring device which concerns on related technology.
- FIG. 10 is a block diagram showing an example of the configuration of a pulse measuring device according to a second embodiment; FIG. FIG. 10 is a conceptual diagram of the pulse measuring device according to the second embodiment as viewed from the measurement surface side; FIG.
- FIG. 3 is a cross-sectional view for explaining the configuration of a pulse measuring device according to a second embodiment
- FIG. 11 is a conceptual diagram for explaining an example of normalization constant setting by the pulse measuring device according to the second embodiment
- FIG. 10 is a conceptual diagram showing an example of an environment within a measurement range measured by the pulse measuring device according to the second embodiment
- FIG. 10 is a conceptual diagram for explaining an active area set in a light receiving element array of a pulse measuring device according to a second embodiment
- FIG. 10 is a conceptual diagram for explaining a modification of the pulse measuring device according to the second embodiment; 9 is a flowchart for explaining an example of calibration by the pulse measuring device according to the second embodiment; 9 is a flowchart for explaining an example of setting a measurement target range by the pulse measuring device according to the second embodiment; 9 is a flowchart for explaining an example of pulse measurement by the pulse measurement device according to the second embodiment; It is a block diagram which shows an example of a structure of the biometric information estimation apparatus which concerns on 3rd Embodiment.
- FIG. 11 is a conceptual diagram for explaining an emotional state estimated by the biological information estimation device according to the third embodiment;
- FIG. 11 is a conceptual diagram for explaining an example of generation of an estimation model used by the biological information estimation device according to the third embodiment; FIG.
- FIG. 11 is a conceptual diagram for explaining an example of emotional state estimation using an estimation model by the biological information estimation device according to the third embodiment;
- FIG. 11 is a conceptual diagram showing an example of displaying on a screen information corresponding to the pulse rate estimated by the biological information estimation device according to the third embodiment;
- FIG. 11 is a conceptual diagram showing an example of displaying on a screen information corresponding to an emotional state estimated by the biological information estimation device according to the third embodiment;
- FIG. 11 is a block diagram showing an example of the configuration of a pulse measuring device according to a fourth embodiment;
- FIG. It is a block which shows an example of a hardware configuration which implement
- the pulse measuring device of this embodiment is attached to the skin of the subject.
- the pulse measuring device of this embodiment irradiates light from the subject's skin and receives reflected light of the light.
- the pulse measuring device of this embodiment measures the subject's pulse according to the intensity change of the received reflected light.
- FIG. 1 is a block diagram showing an example of the configuration of a pulse measuring device 10 according to this embodiment.
- the pulse measuring device 10 includes a plurality of light emitters 11-1 to 11-m, a light receiver 12, and a controller 13 (m is a natural number of 2 or more).
- the photodetector 12 includes a plurality of photodetectors 120-1 to n (n is a natural number of 2 or more).
- the control unit 13 has a light emission control unit 131 , a signal acquisition unit 132 , a normalization constant setting unit 133 , a storage unit 134 , an optimization unit 135 and an output unit 136 .
- light emitter 11-m when items common to a plurality of light emitters 11-1 to 11-m are described, they may be referred to as light emitter 11-m. Similarly, in the following, when items common to the plurality of light receiving units 120-1 to 120-n are described, they may be referred to as light receiving unit 120 in some cases.
- FIG. 2 is a conceptual diagram of the measurement surface of the pulse measurement device 10.
- FIG. FIG. 3 is a cross-sectional view of the pulse measuring device 10 taken along line AA in FIG.
- An example in which the pulse measuring device 10 includes two light emitters 11 (E1, E2) and three light receivers 120 (R1, R2, R3) will be described below.
- 2 and 3 show an example in which two light emitters 11 and three light receivers 120 are arranged on the same surface (also called the measurement surface) of the substrate 14.
- An adhesive layer 17 for attaching the pulse measuring device 10 to the subject's skin is provided on the peripheral portion of the substrate 14 within the measurement surface. The pulse measuring device 10 is attached to the skin of the subject so that light from the outside does not enter the measurement surface side of the substrate 14 .
- the controller 13 is arranged on the surface facing the measurement surface.
- the position where the control unit 13 is arranged is not limited to the surface facing the measurement surface.
- the controller 13 may be arranged inside the substrate 14 or at a position away from the light emitter 11 and the light receiver 12 .
- the light emitter 11 has an emission surface for emitting light used for pulse measurement.
- the light emitted by the light emitter 11 during pulse measurement is also called an optical signal.
- the plurality of light emitters 11 are arranged so that their emission surfaces face the same direction.
- the emission surfaces of the plurality of light emitters 11 and the light receiving surfaces of the plurality of light receiving units 120 are arranged in the same direction.
- the emission surface of the light emitter 11 is directed toward the subject's skin while the pulse measuring device 10 is attached to the subject's skin.
- the light emitter 11 emits an optical signal in a wavelength band that can measure the pulse.
- the light emitter 11 is implemented by an LED (Light Emitting Diode).
- the light emitter 11 emits an optical signal in the green wavelength band.
- an optical signal in the green wavelength band is suitable.
- the light emitter 11 emits an optical signal in the near-infrared wavelength band. Near-infrared rays of about 1.1 micrometers, for example, are suitable for measuring the entire vein.
- the wavelength band of the optical signal emitted by the light emitter 11 is not particularly limited as long as it is a wavelength band that allows pulse measurement.
- the light outputs of the plurality of light emitters 11 may be the same or different.
- the light output of the plurality of light emitters 11 may be constant or adjustable. If the light outputs of a plurality of light emitters 11 are adjustable, the light output of each light emitter 11 can be adjusted.
- the light receiving section 120 has a light receiving section for receiving the reflected light of the optical signal emitted from the light emitter 11 .
- the reflected light is a light component of the optical signal emitted from the light emitter 11 that is reflected/scattered under the skin (inside the body) of the subject and reaches the light receiving section 120 .
- the light receiving section 120 is implemented by a photodiode sensitive to the wavelength band of the optical signal emitted from the light emitter 11 .
- the control unit 13 controls the multiple light emitters 11 .
- the control unit 13 is realized by a microcomputer (also called a microcomputer) or a microcontroller.
- the control unit 113 has a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), flash memory, and the like.
- the control unit 13 executes control and processing according to a pre-stored program.
- the control unit 13 executes control and processing according to a program according to a preset schedule, instructions from the outside, and the like.
- the control unit 113 causes the flash memory to store the received signal acquired from the light receiving unit 120 .
- the control unit 13 outputs digital data stored in the flash memory at a predetermined timing.
- FIG. 4 is a conceptual diagram showing how the optical signal emitted from the light emitter 11 is reflected/scattered under the skin (inside the body) of the subject.
- the reflected light of the optical signal emitted from each of the plurality of light emitters 11 is received by each of the plurality of light receiving sections 120 via different paths.
- the light signal emitted from each of the plurality of light emitters 11 varies in light intensity according to the light absorption and scattering characteristics of body tissues such as skin, blood vessels, muscles, fat, and bones. Therefore, the light intensity of the reflected light received by the light receiving unit 120 fluctuates according to the length of the optical signal/reflected light path, the environment under the skin, and the subject's body movement.
- an optical signal is emitted from the light emitter 11 into the body of the subject through the skin, and the subject's pulse is measured according to the reflected light of the optical signal.
- changes in blood volume in the body due to pulsation are measured as changes in absorbance (also referred to as changes in light intensity).
- FIG. 5 is a conceptual diagram for explaining factors affecting the light intensity of the reflected light received by the light receiving section 120.
- Factors that affect the light intensity of reflected light include fluctuating components and stationary components.
- the fluctuating component is also called an AC (Alternating Current) component.
- the AC component fluctuates due to pulsation.
- a stationary component is also called a DC (Direct Current) component.
- the DC component hardly fluctuates with pulsation.
- a pulse is measured based on the light intensity change of the reflected light according to the variation of the AC component. In this embodiment, the fluctuation of the AC component is measured as pulsation.
- FIG. 6 is a conceptual diagram for explaining the light intensity of reflected light when optical signals emitted from a plurality of light emitters 11 are received by the same light receiving section 120.
- FIG. The upper part of FIG. 6 shows the waveform at the time of emission of the optical signal emitted by the light emitters 11 (E1, E2).
- the lower part of FIG. 6 shows the waveform of the reflected light received by the light receiving unit 120 (R2) at the time of light reception.
- the light emitters E1 and E2 emit optical signals with the same light intensity and different frequencies at the same timing.
- the light emitter E1 emits an optical signal of frequency f1.
- the light emitter E2 emits an optical signal of frequency f2.
- the light receiving section R2 receives the reflected light of the optical signals emitted from the light emitters E1 and E2 at the same timing. However, it is assumed that the difference in the timing of receiving the reflected light due to the difference between the distance between the light emitter E1 and the light receiver R2 and the distance between the light emitter E2 and the light receiver R2 is less than the detection limit.
- the reflected light of the optical signal emitted from the light emitter E1 and the reflected light of the optical signal emitted from the light emitter E2 are affected by the distance of the path of the optical signal/reflected light, the environment under the skin, body movement, etc. are measured at different light intensities at the light receiving portion R2.
- the waveform of the reflected light is optimized so that the degree of influence of each light emitter 11 on each of the plurality of light receiving units 120 is uniform.
- the degree of influence of the light emitter e on the light receiver r is expressed as I(e, r).
- a normalization constant of the light receiving portion r with respect to the light emitter e is expressed as C(e, r).
- the normalization constant C(e,r) is determined by calibration. For example, when measuring the pulse, the intensity of the reflected light received by the light receiving portion r is corrected by Equation 1 below.
- M(e,r) is the normalized reflected light intensity.
- Each of the plurality of light receiving units 120 is individually standardized for each light emitter 11 .
- M(e,r) I(e,r) ⁇ C(e,r) (1) FIG.
- FIG. 7 is a conceptual diagram for explaining the degree of influence of the light-receiving unit 11 on the light-receiving unit 120 and standardization of the light-receiving unit 120 with respect to the light-emitting unit 11.
- the upper part of FIG. 7 (above the arrow) is an influence map that maps the magnitude relationship of the influence of each light emitter 11 on each light receiving unit 120 .
- the lower part of FIG. 7 (below the arrow) is a normalization map that maps the magnitude relation of the normalization constant for each light receiving unit 120 for each light emitter 11 .
- the degree of influence and the magnitude of the normalized constant are expressed by the magnitude of the radius of the circle.
- the larger the influence and the normalization constant the larger the radius of the circle, and the smaller the influence and the normalization constant, the smaller the radius of the circle. Note that the size of the circle indicating the magnitude relationship between the influence degree and the normalization constant shown in the influence map and the normalization map conceptually indicates the relative magnitude relation.
- the degree of influence of the light emitter E1 is greater in the light receiving section R1 than in the light receiving section R3. Therefore, in order to equalize the light intensity of the optical signal emitted from the light emitter E1 between the light receiving section R1 and the light receiving section R3, the normalization constant should be multiplied by .
- the light-receiving portion R3 is more influenced by the light-emitting device E2 than the light-receiving portion R1. Therefore, in order to equalize the light intensity of the optical signal emitted from the light emitter E2 between the light receiving portion R1 and the light receiving portion R3, the normalization constant should be multiplied by .
- FIG. 7 the degree of influence of the light emitter E1 is greater in the light receiving section R1 than in the light receiving section R3. Therefore, in order to equalize the light intensity of the optical signal emitted from the light emitter E1 between the light receiving section R1 and the light receiving section R3, the normalization constant should be multiplied by .
- FIG. 8 is a conceptual diagram for explaining normalization of the light intensity of reflected light when optical signals emitted from a plurality of light emitters 11 are received by the same light receiving section 120 (light receiving section R2).
- the upper part of FIG. 8 shows the waveform of the reflected light received by the light receiving section 120 (R2).
- the lower part of FIG. 8 shows the normalized waveform of the reflected light received by the light receiving section 120 (R2).
- the light emitters E1 and E2 emit optical signals with the same light intensity and different frequencies at the same timing.
- the light emitter E1 emits an optical signal of frequency f1.
- the light emitter E2 emits an optical signal of frequency f2.
- the light receiving section R2 receives the reflected light of the optical signals emitted from the light emitters E1 and E2 at the same timing. However, it is assumed that the difference in the timing of receiving the reflected light due to the difference between the distance between the light emitter E1 and the light receiver R2 and the distance between the light emitter E2 and the light receiver R2 is less than the detection limit.
- the reflected light of the optical signal emitted from the light emitter E1 and the reflected light of the optical signal emitted from the light emitter E2 are measured with different light intensities in the light receiving part R2 (upper part).
- the light intensity of the reflected light is multiplied by a normalization constant that makes the degree of influence of the plurality of light emitters 11 uniform on each of the plurality of light receiving sections 120 .
- the degree of influence of each of the plurality of light emitters 11 becomes uniform for each light receiving section 120, and the light intensity of the reflected light of the optical signals emitted from the light emitters E1 and E2 becomes equal.
- a normalization constant is set for each of the plurality of light receiving sections 120 so that the degree of influence of the light emitter E1 on the plurality of light receiving sections 120 is uniform.
- the normalization constant for the light emitter E1 is set to 0.5 for the light receiving portion R1, 1 for the light receiving portion R2, and 2 for the light receiving portion R3.
- the multiple can equalize the effects of the light emitters 11 of . For example, by adjusting the light output of the plurality of light emitters 11 based on the normalization constant for each light emitter 11 set for each of the plurality of light receivers 120, light emission to each of the plurality of light receivers 120 is performed. The influence of each device 11 may be made uniform.
- the control unit 13 individually controls each of the plurality of light emitters 11 to emit an optical signal from each of the plurality of light emitters 11 .
- the control unit 13 collectively controls the plurality of light emitters 11 so that optical signals having the same intensity are output from the plurality of light emitters 11 .
- the control unit 13 controls each of the plurality of light emitters 11 so that each of the plurality of light emitters 11 outputs an optical signal having an individual intensity.
- the control unit 13 may stop the operation of one of the plurality of light emitters 11 depending on the situation.
- the control unit 13 controls the light emitter 11 under different conditions during the calibration period and the pulse measurement period.
- the control unit 13 controls the light emitter 11 so that modulated light for calibration is emitted.
- the control unit 13 causes the plurality of light emitters 11 to emit modulated light with different frequencies.
- the modulated light emitted from the plurality of light emitters 11 is modulated with a unique frequency for each light emitter 11 . Therefore, according to the frequency of the reflected light received by each of the plurality of light receiving units 120, the light emitter 11 from which the modulated light corresponding to the reflected light is emitted can be distinguished.
- Calibration is performed at preset timings. For example, calibration is performed when the pulse measuring device 10 is attached to the subject. For example, calibration is performed when the pulse measuring device 10 is activated. For example, calibration may be performed at preset refresh timings. For example, calibration may be set to be performed at the request of a user, such as a subject. The calibration timing can be set arbitrarily.
- the control unit 13 controls the light emitter 11 so that an optical signal for pulse measurement is emitted.
- the control unit 13 causes the plurality of light emitters 11 to emit optical signals with different frequencies.
- Optical signals emitted from the plurality of light emitters 11 are emitted at frequencies unique to each light emitter 11 . Therefore, according to the frequency of the reflected light received by each of the plurality of light receiving units 120, the light emitter 11 from which the optical signal corresponding to the reflected light is emitted can be distinguished.
- the control unit 13 acquires from the plurality of light receiving units 120 reception signals corresponding to the reflected light received by each of the plurality of light receiving units 120 .
- the received signal has an intensity corresponding to the intensity of the reflected light received by each of the plurality of light receiving units 120 .
- the control unit 13 processes the received signal under different conditions during the calibration period and the pulse measurement period.
- the control unit 13 acquires a received signal from the light receiving unit 120 that received the reflected light of the modulated light for calibration.
- the control unit 13 calculates the degree of influence for each light emitter 11 with respect to each of the plurality of light receiving units 120 .
- the control unit 13 sets a normalization constant for each light emitter 11 regarding each of the plurality of light receiving units 120 based on the calculated degree of influence.
- the control unit 13 acquires a received signal from the light receiving unit 120 that receives the reflected light of the optical signal for pulse measurement.
- the control unit 13 optimizes the intensity of the received signal acquired from each of the multiple light receiving units 120 .
- the control unit 13 multiplies the intensity of the received signal acquired from each of the plurality of light receiving units 120 by a normalization constant set for each light emitting device 11 for each of the plurality of light receiving units 120, thereby obtaining the intensity of the received signal. Optimize strength.
- the control unit 13 outputs a standardized signal (also called a pulse signal).
- the control unit 13 may output the pulse signal via a cable such as a cable, or may output the pulse signal via wireless communication.
- the control unit 13 is configured to output a pulse signal via a wireless communication function (not shown) conforming to standards such as Bluetooth (registered trademark) and WiFi (registered trademark).
- the communication function of the control unit 13 may conform to standards other than Bluetooth (registered trademark) and WiFi (registered trademark).
- the control unit 13 transmits a pulse signal to a terminal device (not shown) connected to the pulse measuring device 10 .
- the control unit 13 transmits a pulse signal to a mobile terminal (not shown) carried by the user using the pulse measuring device 10 .
- the substrate 14 is a bendable substrate.
- the substrate 14 has a bendable plate-like shape.
- the substrate 14 has a structure in which a conductive layer such as copper foil is formed on the surface of a base layer made of polyimide, and the conductive layer is laminated with a covering layer of plastic film.
- the base layer and coating layer of the substrate 14 may be mainly composed of urethane nonwoven fabric, vinyl chloride, elastic cotton cloth, sponge sheet, urethane film, or olefin film.
- the light emitter 11, the light receiving section 120, and the control section 13 mounted on the substrate 14 may be configured to deform according to the deformation of the substrate 14, or may be configured not to deform.
- a plurality of light emitters 11 and a plurality of light receivers 120 are arranged on the measurement surface of the substrate 14 .
- An adhesive layer 17 is formed on the peripheral portion of the measurement surface of the substrate 14 .
- the portion on which the adhesive layer 17 is formed may be made of a different material or have a different structure from the other portions. For example, if the portion where the adhesive layer 17 is formed has a mesh-like structure, the portion of the adhesive layer 17 is less likely to get stuffy, and a decrease in the adhesive strength of the adhesive layer 17 due to perspiration or the like can be suppressed.
- a control unit 13 is arranged on the second surface of the substrate 14 facing the measurement surface. The controller 13 may be arranged inside the substrate 14 .
- the controller 13 may be arranged inside the substrate 14 in order to improve waterproofness.
- the control unit 13 may be covered with a waterproof film or the like in order to improve waterproofness.
- the substrate 14 deforms according to the shape of the attached portion.
- the material, structure, and shape of the substrate 14 are not particularly limited.
- the adhesive layer 17 is formed on the peripheral portion of the measurement surface of the substrate 14 .
- the adhesive layer 17 contains an adhesive for attaching the pulse measuring device 10 to the subject's body.
- the adhesive layer 17 contains an acrylic adhesive, a rubber adhesive, or a silicone adhesive.
- the adhesive layer 17 preferably has a light shielding property so that light from the outside does not reach the light emitter 11 and the light receiving section 120 .
- the material of the adhesive layer 17 is not particularly limited.
- the adhesive layer 17 it is better to use a material that is less irritating to the skin.
- the adhesive layer 17 may contain a substance that reduces skin discomfort.
- the adhesive layer 17 may contain menthol or the like.
- the adhesive layer 17 may contain a substance that suppresses a decrease in adhesive force due to absorption of moisture such as perspiration.
- the adhesive layer 17 may contain a polymer absorber or the like.
- control unit 13 has a light emission control unit 131 , a signal acquisition unit 132 , a normalization constant setting unit 133 , a storage unit 134 , an optimization unit 135 and an output unit 136 .
- the light emission control unit 131 controls the multiple light emitters 11 .
- the light emission control unit 131 individually controls each of the plurality of light emitters 11 to emit an optical signal from each of the plurality of light emitters 11 .
- the light emission control unit 131 collectively controls the plurality of light emitters 11 so that light signals having the same intensity are output from the plurality of light emitters 11 .
- the light emission control unit 131 controls each of the plurality of light emitters 11 so that each of the plurality of light emitters 11 outputs an optical signal having an individual intensity.
- the light emission control section 131 may stop the operation of one of the multiple light emitters 11 depending on the situation.
- the light emission controller 131 controls the light emitter 11 under different conditions during the calibration period and the pulse measurement period. During the calibration period, the light emission controller 131 controls the light emitter 11 to emit modulated light for calibration. During the calibration period, the light emission controller 131 causes the multiple light emitters 11 to emit modulated light with different frequencies. During the pulse measurement period, the light emission control unit 131 controls the light emitter 11 so that an optical signal for pulse measurement is emitted. During the pulse measurement period, the light emission control unit 131 causes the plurality of light emitters 11 to emit light signals of different frequencies. For example, when controlling each of the plurality of light emitters 11 based on a normalized constant, the light emission control section 131 controls each light emitter 11 based on the normalized constants stored in the storage section 134 .
- the signal acquisition unit 132 acquires, from the plurality of light receiving units 120, received signals according to the reflected light received by each of the plurality of light receiving units 120.
- the light intensity of the reflected light received by each of the plurality of light receiving units 120 is reflected in the received signal.
- the signal acquisition unit 132 processes received signals under different conditions during the calibration period and the pulse measurement period.
- the signal acquisition unit 132 acquires a received signal from the light receiving unit 120 that has received the reflected light of the modulated light for calibration.
- the signal acquisition unit 132 acquires a received signal from the light receiving unit 120 that has received the reflected light of the optical signal for pulse measurement.
- the normalization constant setting section 133 acquires from each of the plurality of light receiving sections 120 reception signals based on reflected light of modulated light emitted from the plurality of light emitters 11 .
- the normalization constant setting unit 133 calculates the degree of influence for each light emitter 11 with respect to each of the plurality of light receiving units 120 .
- the control unit 13 sets a normalization constant for each light emitter 11 regarding each of the plurality of light receiving units 120 based on the calculated degree of influence.
- the normalization constant setting unit 133 stores the set normalization constant in the storage unit 134 .
- the normalization constant setting unit 133 may cause the storage unit 134 to store a normalization map in which the set normalization constants are mapped.
- the storage unit 134 stores the normalization constant set by the normalization constant setting unit 133 .
- the storage unit 134 may store a normalization map in which set normalization constants are mapped.
- the normalization constants stored in the storage unit 134 are referred to by the light emission control unit 131 and the optimization unit 135 .
- the optimization unit 135 acquires received signals based on the reflected light of the optical signals emitted from the multiple light emitters 11 from each of the multiple light receiving units 120 .
- the optimization unit 135 optimizes the intensity of the received signal acquired from each of the multiple light receiving units 120 .
- the optimization unit 135 multiplies the intensity of the received signal acquired from each of the plurality of light receiving units 120 by a normalization constant set for each of the plurality of light receiving units 120 for each light emitter 11 to obtain the received signal to optimize the strength of
- the signal normalized by the optimization unit 135 is the pulse signal.
- the output unit 136 outputs the signal normalized by the optimization unit 135 (also called pulse signal).
- the output unit 136 may output the pulse signal via a cable such as a cable, or may output the pulse signal via wireless communication.
- the output unit 136 is configured to output a pulse signal via a wireless communication function (not shown) conforming to standards such as Bluetooth (registered trademark) and WiFi (registered trademark).
- the communication function of the output unit 136 may conform to standards other than Bluetooth (registered trademark) and WiFi (registered trademark).
- the output unit 136 outputs the pulse signal to a dedicated terminal device (not shown) having a screen.
- the output unit 136 outputs the pulse signal to a mobile terminal (not shown) such as a smartphone or tablet carried by the user.
- the output unit 136 outputs the pulse signal to an external system (not shown) built on a server or cloud.
- FIG. 9 is an example of displaying the pulse rate measured according to the pulse signal output from the pulse measuring device 10 on the screen of the terminal device 100.
- the pulse rate corresponds to the number of pulsations (pulses) per unit time. Here, the number of pulsations in one minute is defined as the pulse rate.
- a user who visually recognizes the pulse rate displayed on the screen can confirm the subject's pulse rate. For example, the physical condition of the subject can be verified according to the pulse rate. The pulse is derived from the beat of the heart (heartbeat). Therefore, the pulse rate corresponds to the heart rate. If the pulse rate of a subject can be measured and displayed in real time, the physical condition of the subject can be monitored accurately in real time. For example, a subject's perceived exercise intensity can be quantified according to exercise heart rate and resting heart rate values. The quantified subjective exercise intensity and the degree of fatigue corresponding to the subjective exercise intensity may be displayed on the screen of the terminal device 100 .
- FIG. 10 is an example of displaying the waveform of the time-series data of the signal output from the pulse measuring device 10 on the screen of the terminal device 100.
- FIG. A user who visually recognizes the waveform displayed on the screen can confirm the pulse state of the subject. For example, it is possible to verify the physical, health, mental, and emotional states of the subject based on the pulse intensity, interval, and time change.
- FIG. 11 is a flowchart for explaining an example of the operation of the control unit 13 of the pulse measuring device 10 during the calibration period.
- the flowchart of FIG. 11 is an example of calibrating by simultaneously operating a plurality of light emitters 11 .
- control unit 13 controls each of the plurality of light emitters 11 so as to emit unique modulated light (step S111).
- the control unit 13 causes each of the plurality of light emitters 11 to emit unique modulated light with different frequencies.
- the control unit 13 acquires reception signals corresponding to modulated light from the plurality of light emitters 11 received by each of the plurality of light receiving units 120 (step S112).
- the control unit 13 calculates the degree of influence of the plurality of light emitters 11 for each light receiving unit 120 based on the light intensity of the modulated light from the plurality of light emitters 11 (step S113).
- the intensity of the modulated light is reflected in the intensity of the received signal corresponding to the modulated light received by the light receiving section 120 .
- the control unit 13 calculates a normalization constant for normalizing the light intensity of the optical signal for each light receiving unit 120 based on the degree of influence of each of the light emitting devices 11 on the light receiving units 120 (step S114). ).
- the control unit 13 sets the calculated normalization constant for each light receiving unit 120 to each of the plurality of light receiving units 120 (step S115).
- the controller 13 sets the calculated normalization constant for each light receiver 120 to each of the plurality of light emitters 11 .
- FIG. 12 is a flowchart for explaining another example of the operation during the calibration period by the controller 13 of the pulse measuring device 10.
- FIG. The flowchart of FIG. 12 is an example of calibrating by operating the plurality of light emitters 11 one by one.
- control unit 13 first controls one of the plurality of light emitters 11 to emit modulated light (step S121).
- the frequency of the modulated light emitted from each of the plurality of light emitters 11 may be the same.
- the control unit 13 acquires a reception signal corresponding to the modulated light from the operating light emitter 11 received by each of the plurality of light receiving units 120 (step S122).
- step S123 the controller 13 determines the degree of influence of the plurality of light emitters 11 based on the light intensity of the modulated light from the plurality of light emitters 11. Calculate for each The intensity of the modulated light is reflected in the intensity of the received signal corresponding to the modulated light received by the light receiving section 120 . If the control of all the light emitters 11 has not been completed (No in step S123), the process returns to step S121.
- the control unit 13 calculates a normalization constant for normalizing the light intensity of the optical signal for each light receiving unit 120 based on the degree of influence of each of the light emitting devices 11 on the light receiving units 120 (step S125). ).
- the control unit 13 sets the calculated normalization constant for each light receiving unit 120 to each of the plurality of light receiving units 120 (step S126).
- the controller 13 sets the calculated normalization constant for each light receiver 120 to each of the plurality of light emitters 11 .
- FIG. 13 is a flowchart for explaining an example of the operation of the control unit 13 of the pulse measuring device 10 during the pulse measuring period.
- the flowchart of FIG. 13 relates to the pulse measurement period at the stage when the calibration of the plurality of light receiving units 120 is completed.
- the control unit 13 controls each of the plurality of light emitters 11 so as to emit an optical signal for pulse measurement (step S131).
- the controller 13 adjusts the light output of each light emitter 11 according to the normalization constant for each light receiver 120 .
- control unit 13 acquires a received signal corresponding to the reflected light of the optical signal from each of the plurality of light emitters 11 received by each of the plurality of light receiving units 120 (step S132).
- control unit 13 optimizes the received signal acquired from each of the plurality of light receiving units 120 using the normalization constant for each light receiving unit 120 (step S133).
- control unit 13 outputs the standardized signal (pulse signal) (step S134).
- the control unit 13 outputs a pulse signal to a terminal device, a mobile terminal, an external system, a display device, or the like (not shown).
- step S135 When terminating the pulse measurement (Yes in step S135), the control unit 13 stops the emission of optical signals from the plurality of light emitters 11 (step S136). If pulse measurement is to be continued (No in step S135), the process returns to step S132.
- the end/continuation of pulse measurement is determined according to a preset schedule. For example, the end/continuation of pulse measurement may be set at any timing according to the user's input operation.
- FIG. 14 is a conceptual diagram showing an example of the configuration of a pulse measuring device 190 according to related technology.
- FIG. 14 is a cross-sectional view of pulse measuring device 190.
- Pulse measuring device 190 includes light emitter 191 , controller 193 , multiple light receivers 192 , substrate 194 , and adhesive layer 197 .
- the arrangement and functions of a light emitter 191, a controller 193, a plurality of light receivers 192, a substrate 194, and an adhesive layer 197 are the same as in the first embodiment.
- FIG. 14 shows how the optical signal emitted from the light emitter 191 is reflected/scattered under the skin (inside the body) of the subject.
- FIG. 15 and 16 are examples of pulse signal waveforms according to the reflected light of the optical signal emitted from the light emitter 191 received by each of the plurality of light receivers 192.
- FIG. FIG. 15 shows an example in which the optical path of the optical signal is shorter and the attenuation of the optical signal is smaller than in FIG.
- FIG. 16 shows an example in which the optical path of the optical signal is longer and the attenuation of the optical signal is greater than in FIG.
- Reflected light of the optical signal emitted from the light emitter 191 is received by each of the plurality of light receivers 192 with different light intensities.
- the light intensity of the reflected light received by each of the plurality of light receivers 192 is not normalized.
- the influence of the AC component of the pulse differs for each light receiving unit 120 according to the positions of capillaries and blood vessels under the skin to which the pulse measuring device 190 is attached. Therefore, the related art approach provides a different pulse signal for each light receiver 192 depending on the environment under the skin.
- FIG. 17 is a conceptual diagram showing an example of distortion that occurs in the waveform of the pulse signal according to body motion of the subject. Fluctuations due to body motion appear as fluctuations in the DC component of the reflected light received by each of the plurality of light receivers 192 . In other words, the variation due to body motion is the baseline variability factor for the pulse. In the related art method, the baseline pulse fluctuates according to the body motion of the subject.
- the pulse signal obtained from each light receiver 192 differs due to the effects of the environment under the skin, the subject's body movement, the optical path difference of the optical signal from the light emitter 191 to the light receiver 192, and the like.
- the pulse signal for each receiver 192 can also be corrected by software.
- the light emitter 191 is single, it is difficult to accurately correct the AC and DC components contained in the pulse signal by software correction.
- the normalization constant for each of the plurality of light emitters 11 is determined based on the degree of influence of each of the plurality of light emitters 11 on each of the plurality of light receivers 120. set for each Therefore, according to the technique of the first embodiment, the light intensity of the reflected light of the light signals received by the plurality of light receiving units 120 is uniformed for each light emitter 11, so that the AC component contained in the pulse signal and the DC component can be accurately corrected.
- the pulse measuring device includes multiple light emitters, light receivers, and a controller.
- a plurality of light emitters are arranged on a measurement surface of a substrate attached to the skin of a subject whose pulse is to be measured.
- a plurality of light emitters emit light toward the subject's skin.
- a photodetector is positioned on the measurement surface of the substrate.
- the light receiver includes a plurality of light receiving sections that receive reflected light of light emitted from the plurality of light emitters.
- the controller causes the plurality of light emitters to emit light.
- the control unit receives from the light receiver a reception signal corresponding to the reflected light of the light received by the light receiver.
- the controller optimizes the strength of the received signal using normalization constants set for each of the plurality of light emitters.
- the control unit outputs the received signal, the strength of which is optimized using the normalization constant, as a pulse signal.
- the pulse measuring device of this embodiment standardizes the intensity of the received signal corresponding to the reflected light reflected/scattered inside the human body among the light emitted toward the human body from the plurality of light emitters. become According to this embodiment, the pulse of the subject can be accurately measured by uniformly standardizing the intensity of the received signal according to the reflected light of the light emitted from the plurality of light emitters.
- control unit optimizes the light output of each of the plurality of light emitters according to the normalization constant set for each of the plurality of light emitters. According to this aspect, by optimizing the light output of each of the plurality of light emitters, it is possible to optimize the intensity of the received signal corresponding to the reflected light of the light emitted from the plurality of light emitters for each light receiving section. , the pulse of the subject can be measured accurately.
- the controller causes each of the plurality of light emitters to emit modulated light modulated at a unique frequency during the calibration period.
- the control unit calculates the degree of influence of each light-receiving unit on each of the plurality of light-receiving units according to the received light intensity of the reflected light of the modulated light for each light-receiving unit.
- the control unit adjusts the intensity of the received signal corresponding to the reflected light of the modulated light emitted from each of the plurality of light emitters according to the degree of influence calculated for each light emitter on each of the plurality of light receivers. is set for each of the plurality of light receiving portions.
- the normalization constant for each of the plurality of light emitters can be set for each light receiving section.
- the controller causes each of the plurality of light emitters to emit an optical signal during the pulse measurement period.
- the control unit applies a normalization constant for each light emitter set to each of the plurality of light receivers to a received signal obtained from each of the plurality of light receivers and corresponding to the reflected light of the optical signal for each light emitter. , to optimize the strength of the received signal.
- the subject's pulse can be accurately measured by setting the normalization constant for each of the plurality of light emitters for each light receiving section.
- the pulse measuring device of this embodiment includes a light receiving element array in which a plurality of light receiving elements are arranged in an array instead of a plurality of light receiving elements.
- a photodetector array is one form of photodetector.
- FIG. 18 is a block diagram showing an example of the configuration of the pulse measuring device 20 according to this embodiment.
- the pulse measuring device 20 includes a plurality of light emitters 21-1 to m, a light receiving element array 22, and a controller 23 (m is a natural number of 2 or more).
- a plurality of light receiving portions are arranged on the light receiving surface of the light receiving element array 22 .
- the control unit 23 has a light emission control unit 231 , a signal acquisition unit 232 , a normalization constant setting unit 233 , a storage unit 234 , an optimization unit 235 and an output unit 236 .
- the light emitter 21-m when items common to the plurality of light emitters 21-1 to 21-m are described, they may be referred to as the light emitter 21-m.
- FIG. 19 is a conceptual diagram of the measurement surface of the pulse measurement device 20.
- FIG. FIG. 20 is a cross-sectional view of the pulse measuring device 20 taken along line BB in FIG.
- An example in which the pulse measuring device 20 includes six light emitters 21 will be described below.
- 19 and 20 show an example in which six light emitters 21 and one light receiving element array 22 are arranged on the same surface (also called measurement surface) of the substrate 24.
- An adhesive layer 27 for attaching the pulse measuring device 20 to the subject's skin is provided on the peripheral portion of the substrate 24 within the measurement surface.
- the pulse measuring device 20 is attached to the skin of the subject so that light from the outside does not enter the measurement surface side of the substrate 24 .
- the light emitter 21 has the same configuration as the light emitter 11 of the first embodiment.
- a plurality of light emitters 21 are arranged so that their emission surfaces face the same direction.
- the light emitting surfaces of the plurality of light emitters 21 and the light receiving surface of the light receiving element array 22 are arranged in the same direction.
- the emission surface of the light emitter 21 is directed toward the subject's skin while the pulse measuring device 20 is attached to the subject's skin.
- the light receiving element array 22 has a light receiving surface that receives the reflected light of the optical signal emitted from the light emitter 21 .
- the reflected light is a light component of the optical signal emitted from the light emitter 21 that has reached the light receiving surface of the light receiving element array 22 after being reflected/scattered under the skin (inside the body) of the subject.
- a plurality of light receiving portions are arranged in a two-dimensional array on the light receiving surface of the light receiving element array 22 . For example, on the light receiving surface of the light receiving element array 22, about 10,000 light receiving units are arranged in a two-dimensional array.
- the light intensity of the reflected light received by each of the plurality of light receiving sections arranged in a two-dimensional array is associated with the positions (addresses) of the light receiving sections and measured.
- the light receiving element array 22 can be realized by a sheet-type image sensor disclosed in Non-Patent Document 1 (Non-Patent Document 1: T. Yokota, et al., “A conformable imager for biometric authentication and vital sign measurement”, Nature Electronics, volume 3, p.p. 113-121 (2020)).
- the sheet-type image sensor of Non-Patent Document 1 has a configuration in which an organic photodiode, a thin film transistor, a CMOS (Complementary Metal-Oxide Semiconductor), and a photodetector are combined.
- the light emitter 21 and the light receiving element array 22 are configured separately. .
- the reflected light of the optical signal emitted from each of the plurality of light emitters 21 passes through different paths and is received by each of the plurality of light receiving units arranged on the light receiving surface of the light receiving element array 22 .
- the light signal emitted from each of the plurality of light emitters 21 varies in light intensity according to the light absorption and scattering characteristics of body tissues such as skin, blood vessels, muscles, fat, and bones. Therefore, the light intensity of the reflected light received by the light receiving element array 22 fluctuates according to the length of the path, the environment under the skin, and the subject's body movement.
- an optical signal is emitted from the light emitter 21 into the subject's body from the skin, and the subject's pulse is measured according to the reflected light of the optical signal.
- changes in blood volume in the body due to pulsation are measured as changes in absorbance (also referred to as changes in light intensity).
- FIG. 21 is a conceptual diagram for explaining the degree of influence of each light emitter 21 on the plurality of light receiving sections arranged on the light receiving surface of the light receiving element array 22, and the standardization of the light receiving sections for the light emitters 21.
- FIG. FIG. 21 shows an example of six light emitters 21-1 to 21-6 corresponding to the configuration of FIG.
- each of the plurality of light emitters 21-1 to 21-6 is denoted as light emitter E1, light emitter E2, . . . , and light emitter E6.
- examples of light emitters E3, E4, and E5 are omitted.
- the upper part of FIG. 21 (above the arrow) is an influence map that maps the magnitude relationship of the influence of each light emitter 21 with respect to a plurality of light receiving units arranged on the light receiving surface of the light receiving element array 22.
- the lower part of FIG. 21 (below the arrow) is a normalization map that maps the magnitude relationship of the normalization constants of the plurality of light receiving units arranged on the light receiving surface of the light receiving element array 22 with respect to each light emitter 21. be.
- the normalization map of FIG. It can be regarded as a standardized map in which the magnitude relationship is mapped.
- the degree of influence and the magnitude of the normalization constant are represented by gradation.
- the degree of influence and the magnitude of the normalization constant are represented by gradation of light and shade.
- the degree of influence by the light emitter E1 is large at the upper left of the light receiving surface and gradually decreases from the upper left to the lower right of the light receiving surface. Therefore, in order to make the light intensity of the optical signal emitted from the light emitter E1 uniform within the plane of the light receiving surface of the light receiving element array 22, the light receiving portion at the upper left position of the light receiving surface should be A large normalization constant may be multiplied by the light-receiving portion at the lower right position. As for the light emitter E1, the normalization constant gradually increases from the upper left position toward the lower right position on the light receiving surface.
- the degree of influence by the light emitter E2 is large on the left side of the light receiving surface and gradually decreases from the left side to the right side of the light receiving surface. Therefore, in order to make the light intensity of the optical signal emitted from the light emitter E2 uniform within the plane of the light receiving surface of the light receiving element array 22, the light receiving portion on the left side of the light receiving surface should A large normalization constant may be multiplied by the light-receiving portion located on the right side. As for the light emitter E2, the normalization constant gradually increases from the left side to the right side of the light receiving surface. Furthermore, the degree of influence of the light emitter E6 is large at the bottom right of the light receiving surface and gradually decreases from the bottom right to the top left of the light receiving surface.
- the light receiving surface should be multiplied by a large normalization constant.
- the normalization constant gradually increases from the lower right position toward the upper left position of the light receiving surface. Normalization constants are set for the other light emitters 21 (E3, E4, E5) in the same manner as for the light emitters E1 and the like.
- the control unit 23 has the same configuration as the control unit 13 of the first embodiment.
- the control unit 23 controls the multiple light emitters 21 .
- the control unit 23 individually controls each of the plurality of light emitters 21 to emit an optical signal from each of the plurality of light emitters 21 .
- the control unit 23 collectively controls the plurality of light emitters 21 so that optical signals having the same intensity are output from the plurality of light emitters 21 .
- the control unit 23 controls each of the plurality of light emitters 21 so that each of the plurality of light emitters 21 outputs an optical signal having an individual intensity.
- the control unit 23 may stop the operation of one of the plurality of light emitters 21 depending on the situation.
- the controller 23 controls the light emitter 21 under different conditions during the calibration period and the pulse measurement period. The control of the light emitter 21 during the calibration period and the pulse measurement period is the same as in the first embodiment.
- the control unit 23 acquires from the light receiving element array 22 a reception signal corresponding to the reflected light received by the light receiving element array 22 .
- the received signal has an intensity corresponding to the intensity of the reflected light received by each of the plurality of light receiving units arranged on the light receiving surface of the light receiving element array 22 .
- the control unit 23 processes the received signal under different conditions during the calibration period and the pulse measurement period.
- the control unit 23 acquires a received signal from the light receiving element array 22 that has received the reflected light of the modulated light for calibration.
- the control unit 23 calculates the degree of influence for each of the plurality of light emitters 21 with respect to each of the plurality of light receiving units arranged on the light receiving surface of the light receiving element array 22 . Based on the calculated degree of influence, the control unit 23 sets a normalization constant for each of the plurality of light emitters 21 for each of the plurality of light receiving units.
- the control unit 23 acquires a received signal from the light receiving element array 22 that has received the reflected light of the optical signal for pulse measurement.
- the control unit 23 acquires received signals from each of the plurality of light receiving units arranged on the light receiving surface of the light receiving element array 22 .
- the control unit 23 optimizes the intensity of the acquired received signal.
- the control unit 23 multiplies the intensity of the received signal acquired from each of the plurality of light receiving units by a normalization constant set for each light emitting device 21 for each of the plurality of light receiving units, and optimizes the intensity of the received signal. become
- the control unit 23 outputs a standardized signal (also called a pulse signal).
- the control unit 23 may output the pulse signal via a cable such as a cable, or may output the pulse signal via wireless communication.
- the control unit 23 is configured to output a pulse signal via a wireless communication function (not shown) conforming to standards such as Bluetooth (registered trademark) and WiFi (registered trademark).
- the communication function of the control unit 23 may conform to standards other than Bluetooth (registered trademark) and WiFi (registered trademark). There are no particular restrictions on the output destination or application of the pulse signal.
- the substrate 24 has the same configuration as the substrate 14 of the first embodiment.
- Substrate 24 is a bendable substrate.
- the substrate 24 has a bendable plate-like shape.
- the light emitter 21, the light receiving element array 22, and the control unit 23 mounted on the substrate 24 may be configured to deform according to the deformation of the substrate 24, or may be configured not to deform.
- the adhesive layer 27 has the same configuration as the adhesive layer 17 of the first embodiment.
- the adhesive layer 27 is formed on the peripheral portion of the measurement surface of the substrate 24 .
- FIG. 22 is a conceptual diagram showing an example of a skinned environment to which the pulse measuring device 20 is attached.
- the measurable range is the range facing the light receiving surface of the light receiving element array 22 .
- the measurable range includes multiple blood vessels.
- the measurable range includes a range A1 including a single blood vessel, a range A2 not including a blood vessel, and a range A3 including a plurality of blood vessels.
- the intensity of the pulse signal based on the reflected light received by the light receiving element array 22 at a certain timing is mapped two-dimensionally, the position of the blood vessel within the measurable range can be specified.
- FIG. 23 is an example in which part of the light receiving surface of the light receiving element array 22 is set as an active area for pulse measurement.
- the active area is a range corresponding to the measurement target area set within the measurable range.
- the measurement target area is a target range for pulse measurement. For example, when the position of the blood vessel within the measurable range is specified during the calibration period, the measurement target range is set according to the position of the blood vessel to be measured. For example, when only major blood vessels included in the measurable range are to be measured, the light-receiving range immediately above the blood vessels is set as the measurement target range.
- the light-receiving range directly above the capillaries avoiding positions directly above the major blood vessels is set as the measurement target range.
- the measurement target range is set in this way, it is possible to inspect the blood vessels and pulsations that are the measurement targets, thereby improving usability.
- the measurement target range is set, signal processing for unnecessary ranges can be omitted, so power consumption of the pulse measuring device 20 can be reduced. For example, by setting one of the plurality of light emitters 21 to stop emitting light depending on the position of the measurement target range, the power consumption related to the light emission of the light emitter 21 can be reduced.
- FIG. 24 is a modification (pulse measuring device 20-1) of the pulse measuring device 20 of FIG.
- a plurality of light emitters 21 are arranged along the four sides of the light receiving element array 22 in the pulse measuring device 20 - 1 .
- optical signals can be emitted not only from the left and right directions of the light-receiving element array 22, but also from the top and bottom directions. Therefore, it is possible to irradiate optical signals from more directions under the skin. For example, when optical signals are irradiated from two directions, left and right, there is a possibility that the optical signals may reach hidden blood vessels at positions where the optical signals are not irradiated from two directions, up and down.
- a plurality of light emitters 21 arranged around the light receiving element array 22 are operated for each arranged position (side).
- the condition of blood vessels under the skin can be grasped three-dimensionally. For example, if one of the plurality of light emitters 21 arranged on the top, bottom, left, and right of the light receiving element array 22 is selected and operated to measure blood vessels and pulsations to be measured, power consumption related to light emission of the light emitter 21 can be reduced. can be reduced.
- FIG. 25 is a flowchart for explaining an example of the operation during the calibration period by the controller 23 of the pulse measuring device 20.
- FIG. The flowchart of FIG. 25 is an example of calibrating by simultaneously operating a plurality of light emitters 21 .
- the flowchart of FIG. 25 corresponds to the flowchart of FIG. 11 used in the first embodiment.
- calibration may be performed in the same procedure as the flowchart of FIG. 12 used in the first embodiment.
- control unit 23 controls each of the plurality of light emitters 21 so as to emit unique modulated light (step S211).
- the control unit 23 causes each of the plurality of light emitters 21 to emit unique modulated light with different frequencies.
- the control unit 23 acquires reception signals corresponding to the modulated light from the plurality of light emitters 21 received by each of the plurality of light receiving units arranged on the light receiving surface of the plurality of light receiving element arrays 22 (step S212). .
- the control unit 23 calculates the degree of influence of the plurality of light emitters 21 for each light receiving unit based on the light intensity of the modulated light from the plurality of light emitters 21 (step S213).
- the light intensity of the modulated light is reflected in the intensity of the received signal corresponding to the modulated light received by the plurality of light receiving units of the light receiving element array 22 .
- the control unit 23 calculates a normalization constant for normalizing the light intensity of the optical signal for each light receiving unit based on the degree of influence of each of the plurality of light emitters 21 on each of the plurality of light receiving units (step S214). ).
- the control unit 23 sets the calculated normalization constant for each light receiving unit to each of the plurality of light receiving units (step S215).
- the control unit 23 sets the calculated normalization constant for each light receiving unit to each of the plurality of light receiving units.
- FIG. 26 is an example of setting the measurement target range in the measurable range of the light receiving element array 22 (corresponding to the example of FIG. 23). Among the plurality of light receiving portions arranged on the light receiving surface of the light receiving element array 22, the light receiving portions inside the range (active region) corresponding to the measurement target range are calibrated. The operations of the flowchart of FIG. 26 are executed prior to calibration of the light receiving sections arranged inside the active area.
- the control unit 23 controls the plurality of light emitters 21 so as to emit detection light for detecting blood vessels within the measurable range (step S221).
- the plurality of light emitters 21 may be controlled to emit detection light of the same frequency, or may be controlled to emit detection light modulated at mutually different frequencies.
- the control unit 23 acquires reception signals corresponding to the detected light from the plurality of light emitters 21 received by the plurality of light receiving units arranged on the light receiving surface of the light receiving element array 22 (step S222).
- the control unit 23 identifies the position of the blood vessel within the measurable range based on the received signals corresponding to the detected light from the plurality of light emitters 21 (step S223). For example, the control unit 23 identifies the position of the blood vessel within the measurable range according to the intensity of the pulse signal obtained from the detected light. For example, the control unit 23 identifies the position of the blood vessel within the measurable range according to the magnitude relationship of the pulse signal obtained from the detected light. For example, the control unit 23 may output the pulse signal obtained by the detected light to a terminal device or the like (not shown) to prompt the operator of the terminal device or the like to set the measurement target range.
- the control unit 23 sets a measurement target range in which measurement is performed according to the specified position of the blood vessel (step S224).
- the control unit 23 may set the measurement target range according to an instruction input by an operator who checks the screen of the terminal device or the like.
- the operator may be allowed to set the measurement target range for the two-dimensional image of the pulse signal displayed on the screen of the terminal device or the like (not shown) via a pointing device or touch panel.
- the measurement target area is not limited to a rectangular shape, and may be set to any shape.
- the measurement target range may be set by tracing the measurement target range with a finger so as to surround the measurement target range.
- the control unit 23 sets a normalization constant for the light receiving unit in the range (active area) corresponding to the inside of the set measurement target range (step S225).
- the normalization constant is set according to the procedure of the flowchart of FIG. If the measurement target range is set according to the procedure of the flowchart of FIG. 26, the power consumption in the signal processing of the received signal can be reduced. For example, the power consumption of the light emitter 21 can be reduced by selecting the light emitter 21 that emits the optical signal or setting the optical output of the light emitter 21 according to the set measurement target range.
- FIG. 27 is a flowchart for explaining an example of the operation of the control unit 23 of the pulse measuring device 20 during the pulse measuring period.
- the flowchart of FIG. 27 relates to the pulse measurement period at the stage when the calibration of the light receiving element array 22 is completed.
- the control unit 23 controls each of the plurality of light emitters 21 so as to emit an optical signal for pulse measurement (step S231).
- the controller 23 adjusts the light output of each of the plurality of light emitters 11 according to the normalization constant for each light receiver.
- control unit 23 generates a received signal corresponding to the reflected light of the optical signal from each of the plurality of light emitters 21 received by each of the plurality of light receiving portions arranged on the light receiving surface of the light receiving element array 22. Acquire (step S232).
- control unit 23 optimizes the received signal acquired from each of the plurality of light receiving units using the normalization constant for each light receiving unit (step S233).
- control unit 23 outputs the standardized signal (pulse signal) (step S234).
- the control unit 23 outputs a pulse signal to a terminal device, a mobile terminal, an external system, a display device, etc. (not shown).
- step S235 When terminating the pulse measurement (Yes in step S235), the control unit 23 stops the emission of optical signals from the plurality of light emitters 21 (step S236). If pulse measurement is to be continued (No in step S235), the process returns to step S232.
- the end/continuation of pulse measurement is determined according to a preset schedule. For example, the end/continuation of pulse measurement may be set at any timing according to the user's input operation.
- the pulse measuring device of this embodiment includes a plurality of light emitters, a light receiving element array, and a controller.
- a plurality of light emitters are arranged on a measurement surface of a substrate attached to the skin of a subject whose pulse is to be measured.
- a plurality of light emitters emit light toward the subject's skin.
- the light receiving element array is arranged on the measurement surface of the substrate.
- the light-receiving element array includes a plurality of light-receiving units that receive reflected light of light emitted from the plurality of light-emitting devices.
- the light-receiving element array has a light-receiving surface in which a plurality of light-receiving sections are arranged in a two-dimensional array.
- the controller causes the plurality of light emitters to emit light.
- the controller receives a reception signal corresponding to reflected light of light received by the light receiver from the light receiving element array.
- the controller optimizes the strength of the received signal using normalization constants set for each of the plurality of light emitters.
- the control unit outputs the received signal, the strength of which is optimized using the normalization constant, as a pulse signal.
- the light receiving element array receives the reflected light of the light emitted from the plurality of light emitters.
- the pulse measuring device of this embodiment normalizes the intensity of the received signal corresponding to the reflected light received by each of the plurality of light receiving units arranged on the light receiving surface of the light receiving element array for each light emitter. Therefore, according to the present embodiment, since the intensity of the received signal corresponding to the reflected light of the light emitted from the plurality of light emitters can be uniformly standardized in each of the plurality of light receiving units, the pulse of the subject can be measured more accurately. can be measured. Further, according to this embodiment, the state of blood vessels within the measurable range can be visualized two-dimensionally.
- the control unit causes the plurality of light emitters to emit detection light for detecting the positions of blood vessels included in the measurable range of the light receiving element array.
- the control unit sets the measurement target range in the measurable range based on the received signal corresponding to the reflected light of the detection light received by the light receiving element array.
- the control unit sets a normalization constant for the light receiving units in the range corresponding to the set measurement target range.
- the measurement target range is set according to the position of the blood vessel included in the measurable range of the light-receiving element array, and the measurement target blood vessel and pulsation can be focused on for inspection, thereby improving usability.
- signal processing in an unnecessary range can be omitted, so power consumption of the pulse measuring device can be reduced.
- the position of the blood vessel in the measurable range can be accurately grasped two-dimensionally.
- Two-dimensional blood vessel information obtained by the method of the present embodiment can be applied to biometric authentication such as vein authentication.
- the pulse in the measurable range can be accurately grasped two-dimensionally.
- Two-dimensional pulse information obtained by the method of the present embodiment can also be applied to diagnosis of skin cancer and diagnosis of sores/burns. For example, if light emitters are arranged all around the light-receiving element array, blood vessels within the measurable range can also be grasped three-dimensionally.
- the biological information estimation device of this embodiment estimates the biological information of the subject based on the pulse signal output from the pulse measurement device of the first and second embodiments.
- FIG. 28 is a block diagram showing an example of the configuration of the biological information estimation device 3 according to this embodiment.
- the biological information estimation device 3 includes a pulse measurement device 30 and an estimation device 36 .
- the pulse measuring device 30 is the pulse measuring device of the first and second embodiments. Description of the details of the pulse measuring device 30 is omitted.
- the estimating device 36 acquires the pulse signal output from the pulse measuring device 30 .
- the estimating device 36 estimates biological information of the subject according to the acquired pulse signal.
- the subject's biological information includes pulse, physical condition, emotion, and the like.
- the estimation device 36 estimates the subject's pulse based on the pulse signal. For example, the estimating device 36 estimates the pulse according to the interval between the maximum value/minimum value appearing in the time-series data of the pulse signal. For example, the estimating device 36 estimates the pulse according to the expression period of the feature amount extracted from the time-series data of the pulse signal. The estimator 36 outputs information about the pulse, such as the estimated pulse interval and the strength of the pulse signal.
- the estimation device 36 estimates the subject's physical condition based on the pulse signal. For example, the estimation device 36 estimates the physical condition of the subject based on time-series data of pulse signals. When the subject is at rest, the strength of the pulse signal decreases and the pulse intervals increase. If the subject is exercising, the intensity of the pulse signal will be greater and the pulse intervals will be shorter. If the subject has an arrhythmia, the pulse rhythm becomes irregular or interrupted.
- the subject's physical condition also affects the baseline of the pulse signal time series data. If the subject's physical condition is stable, baseline variability is small. On the other hand, if the subject's physical condition is unstable, the baseline will fluctuate significantly. For example, the baseline shows an upward trend or a downward trend depending on the subject's physical condition.
- the pulse signal may show characteristics peculiar to the disease.
- the disease that the subject is suffering from can be estimated according to the pulse signal of the subject.
- the estimator 36 outputs information about the estimated physical condition of the subject.
- the subject's physical condition such as stress, fatigue, and drowsiness
- the estimating device 36 extracts feature quantities according to physical conditions such as stress, fatigue, and drowsiness from the pulse time-series data.
- the estimating device 36 extracts feature quantities such as the average value, standard deviation, coefficient of variation, root mean square, and frequency component of the pulse time series data from the pulse time series data.
- the estimating device 36 estimates the physical condition of the subject according to the extracted feature amount.
- the estimation device 36 outputs information about the estimated physical condition of the subject, recommendation information according to the estimated physical condition, and the like.
- the estimation device 36 estimates the emotion of the subject based on the pulse signal.
- a subject's emotion can be inferred from the strength and variation of the pulse.
- the estimating device 36 estimates the degree of emotions such as emotions according to fluctuations in the pulse time series data.
- the estimator 36 may estimate the subject's emotion in response to baseline variations in pulse time series data. For example, when the "anger" of the subject gradually increases, the baseline shows an upward trend in accordance with the increase in the degree of excitement (arousal) of the subject. For example, when the subject's "sorrow” gradually increases, the baseline shows a downward trend in accordance with the decrease in the subject's degree of excitement (arousal).
- FIG. 29 is a conceptual diagram for explaining an example of estimating emotion based on pulse signals.
- emotion is estimated according to the relationship between emotional valence (horizontal axis) and arousal level (vertical axis).
- Emotional valence quantifies emotional comfort.
- Emotional valence indicates a more comfortable state toward the right, and a more unpleasant state toward the left.
- Arousal quantifies emotional heightening.
- the arousal level (vertical axis) indicates a more excited state toward the top, and a calmer state toward the bottom.
- each quadrant defined by emotional valence (horizontal axis) and arousal level (vertical axis) is associated with emotion.
- "Happiness” is associated with the first quadrant. The greater the emotional valence and the greater the degree of arousal, the greater the degree of “joy”.
- “Anger” is associated with the second quadrant. The lower the emotional valence and the higher the degree of arousal, the higher the degree of "anger”.
- “Sorrow” is associated with the third quadrant. The lower the emotional valence and the lower the degree of arousal, the higher the degree of "sorrow”.
- “Raku” is associated with the fourth quadrant.
- the association of emotions with the graph in FIG. 29 is an example, and does not limit the criteria for emotion estimation by the biological information estimation device 3 of the present embodiment.
- the subject's emotions may be classified into more detailed emotional states instead of being classified into four emotional states such as emotions.
- Emotions of the subject may be classified not only by the two-dimensional coordinate system shown in FIG. 29, but also by any emotional state classification method.
- Heart rate fluctuates under the influence of activities related to autonomic nerves such as sympathetic nerves and parasympathetic nerves.
- the pulse rate fluctuates under the influence of activities related to autonomic nerves such as sympathetic nerves and parasympathetic nerves.
- low frequency components and high frequency components can be extracted by frequency analysis of pulse rate time series data.
- the low-frequency component reflects the influence of the sympathetic and parasympathetic nerves.
- High frequency components reflect the influence of parasympathetic nerves. Therefore, for example, the activity state of the autonomic nerve function can be estimated according to the ratio of the high frequency component and the low frequency component.
- the sympathetic nervous system tends to become active when the subject is excited.
- the pulsation speeds up. That is, the higher the pulse rate, the higher the wakefulness.
- the parasympathetic nervous system tends to become active when the subject is relaxed.
- the pulsation slows. That is, the lower the pulse rate, the lower the alertness.
- the estimating device 36 can measure the wakefulness according to the pulse rate. For example, emotional valence can be assessed according to variations in pulse intervals. The more pleasant the emotional state, the more stable the emotion and the smaller the pulse interval variation. That is, the smaller the variation in the pulse interval, the greater the emotional valence.
- the estimator 36 can measure the emotional valence according to the pulse interval.
- the method of measuring arousal and emotional valence is not limited to the above methods and standards as long as the pulse signal output from the pulse measuring device 30 is used.
- the estimation device 36 estimates the arousal level and emotional valence based on the time-series data of the pulse signal.
- the estimation device 36 estimates the emotion according to the coordinates of the measured arousal level and emotional valence in the coordinate system of the graph in FIG.
- the estimator 36 estimates that the subject's emotional state is "joy.” If the measured arousal and emotional valence coordinates for a subject are in the second quadrant, the estimator 36 estimates that the subject's emotional state is "anger.” If the measured arousal and emotional valence coordinates for a subject are in the third quadrant, the estimator 36 estimates that the subject's emotional state is "sad.” If the measured arousal and emotional valence coordinates for a subject are in the fourth quadrant, the estimator 36 estimates that the subject's emotional state is "relaxed.” For example, if the emotional valence and arousal do not exceed thresholds, the estimator 36 determines that the subject's emotional state is normal.
- the estimation device 36 determines that the subject's emotional state is normal.
- a threshold value for determining that the subject's emotional state is normal can be set arbitrarily. For example, such thresholds may be different for different emotions.
- the estimation device 36 may be configured to estimate emotions using machine learning techniques.
- FIG. 30 is a conceptual diagram showing an example of learning by the learning device 340 using a data set of features (explanatory variables) and emotions (response variables) extracted from pulse signals as teacher data.
- the teacher data is data obtained by assigning a label of the emotional state at that point in time to feature values extracted from pulse signals measured for a subject in an emotional state of either joy, anger, romance, or pleasure.
- the teacher data may be data in which a pulse signal measured for a subject in an emotional state of joy, anger, romance or pleasure is labeled with the emotional state at that point in time.
- the learning device 340 generates an estimated model 360 through supervised learning using teacher data.
- the estimation model 360 is generated in advance by having the learning device 340 learn teacher data relating to a plurality of subjects.
- the estimation model 360 outputs a result of estimating the emotion of the subject according to the input of the feature amount extracted from the pulse signal. No particular limitation is imposed on the specific technique of machine learning.
- FIG. 31 is a conceptual diagram for explaining an example of emotion estimation by the estimation model 360.
- the estimation model 360 outputs an estimation result of one of emotions, anger, romance, and pleasure, according to the input of the subject's pulse signal.
- information about emotion estimation results output from the estimation model 360 is displayed on a screen of a terminal device or the like (not shown).
- FIG. 32 is an example of displaying the pulse rate measured according to the pulse signal output from the pulse measuring device 30 on the screen of the terminal device 300.
- recommendation information corresponding to the pulse rate is also displayed on the screen of the terminal device 300 .
- a subject who sees the pulse rate displayed on the screen can confirm his or her own pulse rate.
- the subject who visually recognizes the recommended information displayed on the screen can improve his or her physical condition by acting according to the recommended information.
- FIG. 33 is an example of displaying the subject's emotional state according to the pulse signal output from the pulse measuring device 30 on the screen of the terminal device 300.
- recommendation information corresponding to the subject's emotional state is also displayed on the screen of the terminal device 300 .
- the subject's emotional state is "anger".
- emoticons or icons that indicate the subject's emotional state may be displayed on the screen of the terminal device 300 .
- Subjects who visually recognize the emotional state displayed on the screen can confirm their own emotional state.
- the subject who visually recognizes the recommended information displayed on the screen can bring his or her emotional state closer to a normal state by paying attention to the recommended information.
- the recommended information displayed on the screen does not necessarily bring about expected changes in the subject's emotional state.
- the estimated emotional state of the subject may be transmitted to a terminal device (not shown) owned by the subject's family or acquaintances.
- a terminal device not shown
- the subject's emotional state can be brought closer to a normal state according to the actions of others who have a close relationship with the subject, rather than the inorganic information displayed on the screen.
- an image of a flower is also displayed on the screen of the terminal device 300 in order to ease the subject's emotional state toward a normal state.
- the image displayed on the screen may be any image that has the potential to ease the subject's emotional state. What is displayed on the screen of the terminal device 300 may be not only an image but also a video.
- music that eases the subject's emotional state may be played from the speaker (not shown) of the terminal device 300 .
- the subject's emotional state is "sad”
- the subject may be provided with content such as images, videos, or music that comforts the subject.
- the subject's emotional state is "happiness" or "comfort,” the subject may be provided with content that sustains those emotional states.
- the content provided to the subject is preferably set for each emotion of the subject. For example, a function may be added to input whether the provided information matches the subject's emotions. If it is configured to learn the user's reaction to information provided according to the estimated emotion and feed it back for subsequent emotion estimation, the subject's emotion can be estimated more accurately.
- a driver of a car may wear the pulse measuring device 30 to provide recommendation information according to the driver's emotional state.
- a safe driving environment can be provided by recommending the driver to take a rest or notifying the estimated arrival time to the next parking area according to the estimation result of the driver's emotional state.
- music or a message may be played to soothe or comfort the driver.
- music or a message may be played to encourage the driver to feel somewhat tense.
- music or a message that facilitates the maintenance of that emotional state may be played.
- it may be configured to provide recommendation information according to the driver's emotional state and driving time. For example, if the driving time becomes long and the driver shows a tendency to get angry, the system provides recommendation information such as "Let's go to the next parking area, get up and exercise.” good too. For example, if the driving time is long and the driver shows a tendency of "sorrow", recommendation information such as "Let's go to the next parking area and take a nap" may be provided to the driver. .
- the degree of distraction of the driver may be estimated based on the driver's emotional state. Distraction levels tend to be high in extreme emotional states. Therefore, for example, when the arousal level or emotional valence is extremely large or extremely small, it is estimated that the degree of distraction is high.
- a threshold for the degree of distraction may be set for the degree of arousal and emotional valence, and the driver's degree of distraction may be estimated according to the relationship with the threshold. For example, when the degree of distraction exceeds a threshold, a notification sound may be emitted to call attention.
- a user who leads a daily life may wear the pulse measuring device 30 to provide recommendation information according to the subject's emotional state. For example, if the emotional state of the user is "angry” or “sad”, recommendation information recommending exercise such as walking or running may be provided in order to distract the user. For example, if the emotional state of the user is “angry” or “sad”, music or information that easily shifts the user's emotional state to "comfort” or “joy” may be provided. For example, if the emotional state of the user is “easy” or “happiness,” music or information that enhances that emotional state may be provided. For example, if the emotional state of the user is “comfortable” or “joyful,” the provision of disturbing information may be avoided so that the environment at that point in time is maintained.
- the biological information estimation device of this embodiment includes a plurality of light emitters, light receivers, a control unit, and an estimation device.
- a plurality of light emitters are arranged on a measurement surface of a substrate attached to the skin of a subject whose pulse is to be measured.
- a plurality of light emitters emit light toward the subject's skin.
- a photodetector is positioned on the measurement surface of the substrate.
- the light receiver includes a plurality of light receiving sections that receive reflected light of light emitted from the plurality of light emitters.
- the controller causes the plurality of light emitters to emit light.
- the control unit receives from the light receiver a reception signal corresponding to the reflected light of the light received by the light receiver.
- the controller optimizes the strength of the received signal using normalization constants set for each of the plurality of light emitters.
- the control unit outputs the received signal, the strength of which is optimized using the normalization constant, as a pulse signal.
- the estimating device acquires the subject's pulse signal measured by the pulse measuring device.
- the estimation device estimates biological information of the subject based on the acquired pulse signal.
- the biological information estimating device of this embodiment uses the emotional state of the subject as biological information based on the pulse signal output from the pulse measuring device including a plurality of light receiving units standardized for each of the plurality of light emitters. presume. Therefore, according to this embodiment, the biometric information of the subject can be accurately estimated.
- the estimation device estimates the subject's pulse rate using the subject's pulse signal.
- the estimation device outputs information according to the estimated pulse rate.
- the pulse rate of the subject can be monitored by outputting information according to the pulse rate of the subject. For example, by displaying the pulse rate on the screen of a terminal device or the like, the subject's pulse rate can be visually monitored.
- the estimation device estimates the subject's emotional state using the subject's pulse signal.
- the estimation device outputs information according to the estimated emotional state.
- the subject's emotional state can be monitored by outputting information according to the subject's emotional state. For example, by displaying the emotional state on the screen of a terminal device or the like, the subject's emotional state can be visually monitored.
- FIG. 34 is a block diagram showing an example of the configuration of the pulse measuring device 40 according to this embodiment.
- the pulse measuring device 40 includes a plurality of light emitters 41-1 to 41-m, a light receiver 42, and a controller 43 (m is a natural number of 2 or more).
- a plurality of light emitters 41-1 to 41-m are arranged on the measurement surface of a substrate (not shown) attached to the skin of the subject whose pulse is to be measured.
- a plurality of light emitters 41-1 to 41-m emit light toward the subject's skin.
- a light receiver 42 is arranged on the measurement surface of the substrate.
- the light receiver 42 includes a plurality of light receiving sections that receive reflected light of the light emitted from the plurality of light emitters 41-1 to 41-m.
- the control unit 43 causes the plurality of light emitters 41-1 to 41-m to emit light.
- the control unit 43 receives from the light receiver 42 a reception signal corresponding to the reflected light of the light received by the light receiver 42 .
- the control unit 43 optimizes the strength of the received signal using the normalization constant set for each of the plurality of light emitters 41-1 to 41-m.
- the control unit 43 outputs the reception signal whose intensity is optimized using the normalization constant as a pulse signal.
- the pulse measuring device of this embodiment standardizes the intensity of the received signal corresponding to the reflected light reflected/scattered inside the human body among the light emitted toward the human body from the plurality of light emitters. become Therefore, according to the present embodiment, the influence of heartbeat and body movement artifacts is eliminated by uniformly standardizing the intensity of the received signal according to the reflected light of the light emitted from the plurality of light emitters. Therefore, according to this embodiment, the subject's pulse can be accurately measured.
- the information processing device 90 includes a processor 91, a main storage device 92, an auxiliary storage device 93, an input/output interface 95, and a communication interface 96.
- the interface is abbreviated as I/F (Interface).
- Processor 91 , main storage device 92 , auxiliary storage device 93 , input/output interface 95 , and communication interface 96 are connected to each other via bus 98 so as to enable data communication.
- the processor 91 , the main storage device 92 , the auxiliary storage device 93 and the input/output interface 95 are connected to a network such as the Internet or an intranet via a communication interface 96 .
- the processor 91 loads the program stored in the auxiliary storage device 93 or the like into the main storage device 92 .
- the processor 91 executes programs developed in the main memory device 92 .
- a configuration using a software program installed in the information processing device 90 may be used.
- the processor 91 executes control and processing according to this embodiment.
- the main storage device 92 has an area in which programs are expanded.
- a program stored in the auxiliary storage device 93 or the like is developed in the main storage device 92 by the processor 91 .
- the main memory device 92 is realized by a volatile memory such as a DRAM (Dynamic Random Access Memory). Further, as the main storage device 92, a non-volatile memory such as MRAM (Magnetoresistive Random Access Memory) may be configured/added.
- the auxiliary storage device 93 stores various data such as programs.
- the auxiliary storage device 93 is implemented by a local disk such as a hard disk or flash memory. It should be noted that it is possible to store various data in the main storage device 92 and omit the auxiliary storage device 93 .
- the input/output interface 95 is an interface for connecting the information processing device 90 and peripheral devices based on standards and specifications.
- a communication interface 96 is an interface for connecting to an external system or device through a network such as the Internet or an intranet based on standards and specifications.
- the input/output interface 95 and the communication interface 96 may be shared as an interface for connecting with external devices.
- Input devices such as a keyboard, mouse, and touch panel may be connected to the information processing device 90 as necessary. These input devices are used to enter information and settings.
- a touch panel is used as an input device, the display screen of the display device may also serve as an interface of the input device. Data communication between the processor 91 and the input device may be mediated by the input/output interface 95 .
- the information processing device 90 may be equipped with a display device for displaying information.
- the information processing device 90 is preferably provided with a display control device (not shown) for controlling the display of the display device.
- the display device may be connected to the information processing device 90 via the input/output interface 95 .
- the information processing device 90 may be equipped with a drive device. Between the processor 91 and a recording medium (program recording medium), the drive device mediates reading of data and programs from the recording medium, writing of processing results of the information processing device 90 to the recording medium, and the like.
- the drive device may be connected to the information processing device 90 via the input/output interface 95 .
- the above is an example of the hardware configuration for enabling control and processing according to each embodiment of the present invention.
- the hardware configuration of FIG. 35 is an example of a hardware configuration for executing control and processing according to each embodiment, and does not limit the scope of the present invention.
- the scope of the present invention also includes a program that causes a computer to execute control and processing according to each embodiment.
- the scope of the present invention also includes a program recording medium on which the program according to each embodiment is recorded.
- the recording medium can be implemented as an optical recording medium such as a CD (Compact Disc) or a DVD (Digital Versatile Disc).
- the recording medium may be implemented by a semiconductor recording medium such as a USB (Universal Serial Bus) memory or an SD (Secure Digital) card.
- the recording medium may be realized by a magnetic recording medium such as a flexible disk, or other recording medium.
- each embodiment may be combined arbitrarily. Also, the components of each embodiment may be realized by software or by circuits.
- Appendix 1 a plurality of light emitters arranged on a measurement surface of a substrate attached to the skin of a subject whose pulse is to be measured and emitting light toward the skin of the subject; a light receiver disposed on the measurement surface of the substrate and including a plurality of light receiving units for receiving reflected light of the light emitted from the plurality of light emitters; causing the plurality of light emitters to emit the light, receiving from the light receivers reception signals corresponding to reflected light of the light received by the light receivers, and standardization set for each of the plurality of light emitters a control unit that optimizes the strength of the received signal using a constant, and outputs the received signal, the strength of which is optimized using the normalization constant, as a pulse signal.
- Appendix 2 The control unit The pulse measuring device according to appendix 1, wherein the light output of each of the plurality of light emitters is optimized according to the normalization constant set for each of the plurality of light emitters.
- Appendix 3 The control unit During the calibration period, emitting modulated light modulated at a unique frequency from each of the plurality of light emitters; Calculate the degree of influence of each of the plurality of light receiving units on each of the plurality of light receiving units according to the received light intensity of the reflected light of the modulated light for each of the light emitters in each of the plurality of light receiving units included in the light receiver.
- the pulse measuring device according to appendix 1 or 2, wherein the strength of the received signal is optimized by multiplying by a normalization constant.
- the light receiver is 5.
- the pulse measuring device according to any one of appendices 1 to 4, wherein the plurality of light receiving units is a light receiving element array arranged in a two-dimensional array.
- the control unit causing the plurality of light emitters to emit detection light for detecting the positions of blood vessels included in the measurable range of the light receiving element array; setting a measurement target range in the measurable range based on the reception signal corresponding to the reflected light of the detection light received by the light receiving element array; 6.
- the pulse measuring device according to appendix 5, wherein the normalization constant is set for the light-receiving unit within a range corresponding to the set measurement target range.
- Appendix 7 The pulse measuring device according to any one of Appendices 1 to 6; and an estimating device that acquires a pulse signal of a subject measured by the pulse measuring device and estimates biological information of the subject based on the acquired pulse signal.
- Appendix 8) The estimation device is estimating the pulse rate of the subject using the pulse signal of the subject;
- the biological information estimation device according to appendix 7, which outputs information corresponding to the estimated pulse rate.
- the estimation device is estimating an emotional state of the subject using the pulse signal of the subject;
- the biological information estimation device according to appendix 7, which outputs information corresponding to the estimated emotional state.
- Appendix 10 A plurality of light emitters that emit light toward the skin of a subject whose pulse is to be measured, and a light receiver that includes a plurality of light receiving units that receive the reflected light of the light emitted from the plurality of light emitters are controlled.
- a control method comprising: The control unit causing the plurality of light emitters to emit the light; receiving from the light receiver a reception signal corresponding to the reflected light of the light received by the light receiver; optimizing the intensity of the received signal using a normalization constant set for each of the plurality of light emitters; A control method for outputting the received signal, the strength of which is optimized using the normalization constant, as a pulse signal.
- a plurality of light emitters that emit light toward the skin of a subject whose pulse is to be measured, and a light receiver that includes a plurality of light receiving units that receive the reflected light of the light emitted from the plurality of light emitters are controlled.
- a non-transitory recording medium recording a program for causing a computer to execute a process of outputting the received signal, the intensity of which is optimized using the normalization constant, as a pulse signal.
- 3 biological information estimation device 10 20, 30, 40 pulse measurement device 11, 21, 41 light emitter 12, 42 light receiver 13, 23, 43 controller 14, 24 substrate 17, 27 adhesive layer 22 light receiving element array 36 estimation device 100, 300 terminal device 131, 231 light emission control unit 132, 232 signal acquisition unit 133, 233 normalization constant setting unit 134, 234 storage unit 135, 235 optimization unit 136, 236 output unit
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Public Health (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Veterinary Medicine (AREA)
- Cardiology (AREA)
- Psychiatry (AREA)
- Physiology (AREA)
- Artificial Intelligence (AREA)
- Hospice & Palliative Care (AREA)
- Social Psychology (AREA)
- Psychology (AREA)
- Child & Adolescent Psychology (AREA)
- Developmental Disabilities (AREA)
- Signal Processing (AREA)
- Educational Technology (AREA)
- Evolutionary Computation (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Epidemiology (AREA)
- Primary Health Care (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
Abstract
Description
まず、第1の実施形態に係る脈拍計測装置について図面を参照しながら説明する。本実施形態の脈拍計測装置は、被験者の皮膚に貼付される。本実施形態の脈拍計測装置は、被験者の皮膚上から光を照射し、その光の反射光を受光する。本実施形態の脈拍計測装置は、受光した反射光の強度変化に応じて、その被験者の脈拍を計測する。
図1は、本実施形態に係る脈拍計測装置10の構成の一例を示すブロック図である。脈拍計測装置10は、複数の発光器11-1~m、受光器12、および制御部13を備える(mは2以上の自然数)。受光器12は、複数の受光部120-1~nを含む(nは2以上の自然数)。制御部13は、発光制御部131、信号取得部132、規格化定数設定部133、記憶部134、最適化部135、および出力部136を有する。以下において、複数の発光器11-1~mに共通の事項について説明する場合、発光器11と記載する場合がある。同様に、以下において、複数の受光部120-1~nに共通の事項について説明する場合、受光部120と記載する場合がある。
M(e、r)=I(e、r)×C(e、r)・・・(1)
図7は、受光部120に対する発光器11の影響度と、発光器11に対する受光部120の規格化とについて説明するための概念図である。図7の上段(矢印の上側)は、各々の受光部120に対する発光器11ごとの影響度に関する大小関係を、マップ化した影響度マップである。図7の下段(矢印の下側)は、各々の発光器11に対する受光部120ごとの規格化定数に関する大小関係をマップ化した規格化マップである。発光器11の出射する光信号の光強度を制御する場合、図7の規格化マップは、各々の受光部120に対する発光器11ごとの規格化定数に関する大小関係を、マップ化した規格化マップとみなすことができる。影響度マップおよび規格化定数マップにおいて、影響度や規格化定数の大小は、円の半径の大小で表現される。影響度マップおよび規格化定数マップにおいては、影響度や規格化定数が大きいほど円の半径が大きく、影響度や規格化定数が小さいほど円の半径が小さくなるように表現される。なお、影響度マップおよび規格化マップに示す影響度や規格化定数の大小関係を示す円の大きさは、相対的な大小関係を概念的に示すものである。
次に、脈拍計測装置10の制御部13の詳細構成について説明する。図1のように、制御部13は、発光制御部131、信号取得部132、規格化定数設定部133、記憶部134、最適化部135、および出力部136を有する。
次に、本実施形態に係る脈拍計測装置10の動作の一例について図面を参照しながら説明する。以下においては、脈拍計測装置10の動作の一例について、制御部13を動作主体とし、フローチャートに沿って説明する。
図11は、脈拍計測装置10の制御部13によるキャリブレーション期間における動作の一例について説明するためのフローチャートである。図11のフローチャートは、複数の発光器11を一斉に動作させて、キャリブレーションする例である。
図12は、脈拍計測装置10の制御部13によるキャリブレーション期間における動作の別の一例について説明するためのフローチャートである。図12のフローチャートは、複数の発光器11を一つずつ動作させて、キャリブレーションする例である。
図13は、脈拍計測装置10の制御部13による脈拍計測期間における動作の一例について説明するためのフローチャートである。図13のフローチャートは、複数の受光部120に関するキャリブレーションが完了している段階における、脈拍計測期間に関する。
ここで、関連技術に係る脈拍計測装置について図面を参照しながら説明する。関連技術は、第1の実施形態の比較例である。図14は、関連技術に係る脈拍計測装置190の構成の一例を示す概念図である。図14は、脈拍計測装置190の断面図である。脈拍計測装置190は、発光器191、制御部193、複数の受光器192、基板194、および粘着層197を備える。発光器191、制御部193、複数の受光器192、基板194、および粘着層197の配置や機能は、第1の実施形態と同様である。図14は、発光器191から出射された光信号が、被験者の皮膚下(体内)で反射/散乱される様子を示す。
次に、第2の実施形態に係る脈拍計測装置について図面を参照しながら説明する。本実施形態の脈拍計測装置は、複数の受光器の代わりに、複数の受光素子がアレイ状に配列された受光素子アレイを備える。受光素子アレイは、受光器の一形態である。
図18は、本実施形態に係る脈拍計測装置20の構成の一例を示すブロック図である。脈拍計測装置20は、複数の発光器21-1~m、受光素子アレイ22、および制御部23を備える(mは2以上の自然数)。受光素子アレイ22の受光面には、複数の受光部が配列さえる。制御部23は、発光制御部231、信号取得部232、規格化定数設定部233、記憶部234、最適化部235、および出力部236を有する。以下において、複数の発光器21-1~mに共通の事項について説明する場合、発光器21と記載する場合がある。
次に、本実施形態に係る脈拍計測装置20の動作の一例について図面を参照しながら説明する。以下においては、脈拍計測装置20の動作の一例について、制御部23を動作主体とし、フローチャートに沿って説明する。
図25は、脈拍計測装置20の制御部23によるキャリブレーション期間における動作の一例について説明するためのフローチャートである。図25のフローチャートは、複数の発光器21を一斉に動作させて、キャリブレーションする例である。図25のフローチャートは、第1の実施形態で用いられた図11のフローチャートに対応する。複数の発光器11の各々を一つずつ動作させてキャリブレーションする場合は、第1の実施形態で用いられた図12のフローチャートと同様の手順で、キャリブレーションされればよい。
図26は、受光素子アレイ22の計測可能範囲に計測対象範囲を設定する例である(図23の例に対応)。受光素子アレイ22の受光面に配列された複数の受光部のうち、計測対象範囲に対応する範囲(アクティブ領域)の内部の受光部がキャリブレーションされる。図26のフローチャートの動作は、アクティブ領域の内部に配列された受光部のキャリブレーションに先立って実行される。
図27は、脈拍計測装置20の制御部23による脈拍計測期間における動作の一例について説明するためのフローチャートである。図27のフローチャートは、受光素子アレイ22に関するキャリブレーションが完了している段階における、脈拍計測期間に関する。
次に、第3の実施形態に係る生体情報推定装置について図面を参照しながら説明する。本実施形態の生体情報推定装置は、第1~第2の実施形態の脈拍計測装置から出力された脈拍信号に基づいて、被験者の生体情報を推定する。
図28は、本実施形態に係る生体情報推定装置3の構成の一例を示すブロック図である。生体情報推定装置3は、脈拍計測装置30と推定装置36を備える。脈拍計測装置30は、第1~第2の実施形態の脈拍計測装置である。脈拍計測装置30の詳細については、説明を省略する。
次に、第4の実施形態に係る脈拍計測装置について図面を参照しながら説明する。本実施形態の脈拍計測装置は、第1~第3の脈拍計測装置を簡略化した構成である。図34は、本実施形態に係る脈拍計測装置40の構成の一例を示すブロック図である。脈拍計測装置40は、複数の発光器41-1~m、受光器42、および制御部43を備える(mは、2以上の自然数)。
ここで、本開示の各実施形態に係る制御や処理を実行するハードウェア構成について、図35の情報処理装置90を一例としてあげて説明する。なお、図35の情報処理装置90は、各実施形態の制御や処理を実行するための構成例であって、本開示の範囲を限定するものではない。
(付記1)
脈拍計測対象の被験者の皮膚に装着される基板の計測面に配置され、前記被験者の皮膚に向けて光を出射する複数の発光器と、
前記基板の前記計測面に配置され、複数の前記発光器から出射された前記光の反射光を受光する複数の受光部を含む受光器と、
複数の前記発光器に前記光を出射させ、前記受光器によって受光される前記光の反射光に応じた受信信号を前記受光器から受信し、複数の前記発光器の各々に関して設定された規格化定数を用いて前記受信信号の強度を最適化し、前記規格化定数を用いて強度が最適化された前記受信信号を脈拍信号として出力する制御部と、を備える脈拍計測装置。
(付記2)
前記制御部は、
複数の前記発光器の各々に設定された前記規格化定数に応じて、複数の前記発光器の各々の光出力を最適化する付記1に記載の脈拍計測装置。
(付記3)
前記制御部は、
キャリブレーション期間において、
複数の前記発光器の各々から固有の周波数で変調された変調光を出射させ、
前記受光器に含まれる複数の前記受光部の各々における、前記発光器ごとの前記変調光の反射光の受光強度に応じて、複数の前記受光部の各々に対する前記発光器ごとの影響度を計算し、
複数の前記受光部の各々に対して前記発光器ごとに算出された前記影響度に応じて、複数の前記発光器の各々から出射された前記変調光の反射光に応じた前記受信信号の強度が均一になる前記規格化定数を、複数の前記受光部の各々に設定する付記1または2に記載の脈拍計測装置。
(付記4)
前記制御部は、
脈拍計測期間において、
複数の前記発光器の各々から光信号を出射させ、
複数の前記受光部の各々から取得される、前記発光器ごとの前記光信号の反射光に応じた前記受信信号に対して、複数の前記受光部の各々に設定された前記発光器ごとの前記規格化定数を乗ずることで、前記受信信号の強度を最適化する付記1または2に記載の脈拍計測装置。
(付記5)
前記受光器は、
複数の前記受光部が二次元アレイ状に配列された受光素子アレイである付記1乃至4のいずれか一つに記載の脈拍計測装置。
(付記6)
前記制御部は、
前記受光素子アレイの計測可能範囲に含まれる血管の位置を検出するための検出光を、複数の前記発光器に出射させ、
前記受光素子アレイによって受光された前記検出光の反射光に応じた前記受信信号に基づいて、前記計測可能範囲における計測対象範囲を設定し、
設定された前記計測対象範囲に対応する範囲の前記受光部に対して、前記規格化定数を設定する付記5に記載の脈拍計測装置。
(付記7)
付記1乃至6のいずれか一つに記載の脈拍計測装置と、
前記脈拍計測装置によって計測された被験者の脈拍信号を取得し、取得した前記脈拍信号に基づいて前記被験者の生体情報を推定する推定装置と、を備える生体情報推定装置。
(付記8)
前記推定装置は、
前記被験者の前記脈拍信号を用いて前記被験者の脈拍数を推定し、
推定された前記脈拍数に応じた情報を出力する付記7に記載の生体情報推定装置。
(付記9)
前記推定装置は、
前記被験者の前記脈拍信号を用いて前記被験者の感情状態を推定し、
推定された前記感情状態に応じた情報を出力する付記7に記載の生体情報推定装置。
(付記10)
脈拍計測対象の被験者の皮膚に向けて光を出射する複数の発光器と、複数の前記発光器から出射された前記光の反射光を受光する複数の受光部を含む受光器と、を制御する制御方法であって、
制御部が、
複数の前記発光器に前記光を出射させ、
前記受光器によって受光される前記光の反射光に応じた受信信号を前記受光器から受信し、
複数の前記発光器の各々に関して設定された規格化定数を用いて前記受信信号の強度を最適化し、
前記規格化定数を用いて強度が最適化された前記受信信号を脈拍信号として出力する制御方法。
(付記11)
脈拍計測対象の被験者の皮膚に向けて光を出射する複数の発光器と、複数の前記発光器から出射された前記光の反射光を受光する複数の受光部を含む受光器と、を制御するためのプログラムであって、
複数の前記発光器に前記光を出射させる処理と、
前記受光器によって受光される前記光の反射光に応じた受信信号を前記受光器から受信する処理と、
複数の前記発光器の各々に関して設定された規格化定数を用いて前記受信信号の強度を最適化する処理と、
前記規格化定数を用いて強度が最適化された前記受信信号を脈拍信号として出力する処理と、をコンピュータに実行させるプログラムが記録された非一過性の記録媒体。
10、20、30、40 脈拍計測装置
11、21、41 発光器
12、42 受光器
13、23、43 制御部
14、24 基板
17、27 粘着層
22 受光素子アレイ
36 推定装置
100、300 端末装置
131、231 発光制御部
132、232 信号取得部
133、233 規格化定数設定部
134、234 記憶部
135、235 最適化部
136、236 出力部
Claims (11)
- 脈拍計測対象の被験者の皮膚に装着される基板の計測面に配置され、前記被験者の皮膚に向けて光を出射する複数の発光器と、
前記基板の前記計測面に配置され、複数の前記発光器から出射された前記光の反射光を受光する複数の受光部を含む受光器と、
複数の前記発光器に前記光を出射させ、前記受光器によって受光される前記光の反射光に応じた受信信号を前記受光器から受信し、複数の前記発光器の各々に関して設定された規格化定数を用いて前記受信信号の強度を最適化し、前記規格化定数を用いて強度が最適化された前記受信信号を脈拍信号として出力する制御部と、を備える脈拍計測装置。 - 前記制御部は、
複数の前記発光器の各々に設定された前記規格化定数に応じて、複数の前記発光器の各々の光出力を最適化する請求項1に記載の脈拍計測装置。 - 前記制御部は、
キャリブレーション期間において、
複数の前記発光器の各々から固有の周波数で変調された変調光を出射させ、
前記受光器に含まれる複数の前記受光部の各々における、前記発光器ごとの前記変調光の反射光の受光強度に応じて、複数の前記受光部の各々に対する前記発光器ごとの影響度を計算し、
複数の前記受光部の各々に対して前記発光器ごとに算出された前記影響度に応じて、複数の前記発光器の各々から出射された前記変調光の反射光に応じた前記受信信号の強度が均一になる前記規格化定数を、複数の前記受光部の各々に設定する請求項1または2に記載の脈拍計測装置。 - 前記制御部は、
脈拍計測期間において、
複数の前記発光器の各々から光信号を出射させ、
複数の前記受光部の各々から取得される、前記発光器ごとの前記光信号の反射光に応じた前記受信信号に対して、複数の前記受光部の各々に設定された前記発光器ごとの前記規格化定数を乗ずることで、前記受信信号の強度を最適化する請求項1または2に記載の脈拍計測装置。 - 前記受光器は、
複数の前記受光部が二次元アレイ状に配列された受光素子アレイである請求項1乃至4のいずれか一項に記載の脈拍計測装置。 - 前記制御部は、
前記受光素子アレイの計測可能範囲に含まれる血管の位置を検出するための検出光を、複数の前記発光器に出射させ、
前記受光素子アレイによって受光された前記検出光の反射光に応じた前記受信信号に基づいて、前記計測可能範囲における計測対象範囲を設定し、
設定された前記計測対象範囲に対応する範囲の前記受光部に対して、前記規格化定数を設定する請求項5に記載の脈拍計測装置。 - 請求項1乃至6のいずれか一項に記載の脈拍計測装置と、
前記脈拍計測装置によって計測された被験者の脈拍信号を取得し、取得した前記脈拍信号に基づいて前記被験者の生体情報を推定する推定装置と、を備える生体情報推定装置。 - 前記推定装置は、
前記被験者の前記脈拍信号を用いて前記被験者の脈拍数を推定し、
推定された前記脈拍数に応じた情報を出力する請求項7に記載の生体情報推定装置。 - 前記推定装置は、
前記被験者の前記脈拍信号を用いて前記被験者の感情状態を推定し、
推定された前記感情状態に応じた情報を出力する請求項7に記載の生体情報推定装置。 - 脈拍計測対象の被験者の皮膚に向けて光を出射する複数の発光器と、複数の前記発光器から出射された前記光の反射光を受光する複数の受光部を含む受光器とを用いた脈拍計測方法であって、
制御部が、
複数の前記発光器に前記光を出射させ、
前記受光器によって受光される前記光の反射光に応じた受信信号を前記受光器から受信し、
複数の前記発光器の各々に関して設定された規格化定数を用いて前記受信信号の強度を最適化し、
前記規格化定数を用いて強度が最適化された前記受信信号を脈拍信号として出力する脈拍計測方法。 - 脈拍計測対象の被験者の皮膚に向けて光を出射する複数の発光器と、複数の前記発光器から出射された前記光の反射光を受光する複数の受光部を含む受光器と、を制御するためのプログラムであって、
複数の前記発光器に前記光を出射させる処理と、
前記受光器によって受光される前記光の反射光に応じた受信信号を前記受光器から受信する処理と、
複数の前記発光器の各々に関して設定された規格化定数を用いて前記受信信号の強度を最適化する処理と、
前記規格化定数を用いて強度が最適化された前記受信信号を脈拍信号として出力する処理と、をコンピュータに実行させるプログラムが記録された非一過性の記録媒体。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2021/034502 WO2023047445A1 (ja) | 2021-09-21 | 2021-09-21 | 脈拍計測装置、生体情報推定装置、脈拍計測方法、および記録媒体 |
US18/688,832 US20240277273A1 (en) | 2021-09-21 | 2021-09-21 | Pulse measurement device, biological information estimation device, pulse measurement method, and recording medium |
JP2023549179A JPWO2023047445A5 (ja) | 2021-09-21 | 脈拍計測装置、生体情報推定装置、脈拍計測方法、およびプログラム |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2021/034502 WO2023047445A1 (ja) | 2021-09-21 | 2021-09-21 | 脈拍計測装置、生体情報推定装置、脈拍計測方法、および記録媒体 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023047445A1 true WO2023047445A1 (ja) | 2023-03-30 |
Family
ID=85720225
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2021/034502 WO2023047445A1 (ja) | 2021-09-21 | 2021-09-21 | 脈拍計測装置、生体情報推定装置、脈拍計測方法、および記録媒体 |
Country Status (2)
Country | Link |
---|---|
US (1) | US20240277273A1 (ja) |
WO (1) | WO2023047445A1 (ja) |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2016154648A (ja) * | 2015-02-24 | 2016-09-01 | セイコーエプソン株式会社 | 情報取得装置 |
JP2018029870A (ja) * | 2016-08-26 | 2018-03-01 | セイコーエプソン株式会社 | 検出装置および検出方法 |
US20180132767A1 (en) * | 2015-05-26 | 2018-05-17 | Bsx Athletics | Device and method for generating calibration factors for use in determining biological indicator levels in tissue |
WO2021009851A1 (ja) * | 2019-07-16 | 2021-01-21 | 日本電気株式会社 | 生体信号推定装置、生体信号推定方法、及び、生体信号推定プログラムが格納された記録媒体 |
-
2021
- 2021-09-21 WO PCT/JP2021/034502 patent/WO2023047445A1/ja active Application Filing
- 2021-09-21 US US18/688,832 patent/US20240277273A1/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2016154648A (ja) * | 2015-02-24 | 2016-09-01 | セイコーエプソン株式会社 | 情報取得装置 |
US20180132767A1 (en) * | 2015-05-26 | 2018-05-17 | Bsx Athletics | Device and method for generating calibration factors for use in determining biological indicator levels in tissue |
JP2018029870A (ja) * | 2016-08-26 | 2018-03-01 | セイコーエプソン株式会社 | 検出装置および検出方法 |
WO2021009851A1 (ja) * | 2019-07-16 | 2021-01-21 | 日本電気株式会社 | 生体信号推定装置、生体信号推定方法、及び、生体信号推定プログラムが格納された記録媒体 |
Also Published As
Publication number | Publication date |
---|---|
JPWO2023047445A1 (ja) | 2023-03-30 |
US20240277273A1 (en) | 2024-08-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9946344B2 (en) | Functional near infrared spectroscopy based brain computer interface | |
KR102621119B1 (ko) | 카메라 기반 감지를 이용한 심혈관 특징 결정 | |
US10363388B2 (en) | System and method for enhancing sleep slow wave activity based on cardiac characteristics or respiratory characteristics | |
Matsumura et al. | iPhone 4s photoplethysmography: which light color yields the most accurate heart rate and normalized pulse volume using the iPhysioMeter application in the presence of motion artifact? | |
US9398873B2 (en) | Method of obtaining a desired state in a subject | |
US10298282B2 (en) | Multi-modal sensing wearable device for physiological context measurement | |
US20210186347A1 (en) | Method and apparatus for determining a health status of an infant | |
Yuda et al. | Suppression of vagal cardiac modulation by blue light in healthy subjects | |
CN113260308A (zh) | 获得关于用户的血糖的信息的电子装置和方法 | |
JP6872758B2 (ja) | 動的光散乱(dls)による神経学的状態又は適合性状態の血行力学的特徴付けのための方法及び装置 | |
KR20200103397A (ko) | 생체 신호 센서 탑재 hmd 기기를 활용한 사용자의 스트레스 분석 및 개인 정신건강 관리 시스템 및 방법 | |
JP7080657B2 (ja) | 感情識別装置 | |
WO2023047445A1 (ja) | 脈拍計測装置、生体情報推定装置、脈拍計測方法、および記録媒体 | |
TWI708162B (zh) | 用於可穿戴式感測器之設備及方法、及相關電腦程式 | |
WO2023105741A1 (ja) | 計測装置、光センサ、生体データ計測システム、生体情報推定システム、計測方法、および記録媒体 | |
US10835169B2 (en) | Brain function index computing device and brain function index computing method | |
JP7361046B2 (ja) | 血圧測定値を決定する装置、方法及びコンピュータプログラム | |
US20240374155A1 (en) | Measurement device, optical sensor, biological data measurement system, biological information estimation system, measurement method, and storage medium | |
KR20080039805A (ko) | 뉴로 피드백 장치 및 방법 | |
Weaver et al. | Changes in spinal excitability during dual task performance | |
JP7146196B2 (ja) | スコア算出装置および方法ならびにスコア算出装置の制御プログラム | |
Zhang et al. | Adaptation of stimulation duration to enhance auditory response in fNIRS block design | |
Tanaka et al. | Effects of interoceptive accuracy in autonomic responses to external stimuli based on cardiac rhythm | |
JP2019528954A (ja) | 光学的バイタルサインセンサ | |
KR20220151401A (ko) | 뇌파를 이용한 인체 진단 시스템 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21958323 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2023549179 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 18688832 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21958323 Country of ref document: EP Kind code of ref document: A1 |