WO2017150169A1 - 生体情報抽出装置および生体情報抽出システム - Google Patents

生体情報抽出装置および生体情報抽出システム Download PDF

Info

Publication number
WO2017150169A1
WO2017150169A1 PCT/JP2017/005214 JP2017005214W WO2017150169A1 WO 2017150169 A1 WO2017150169 A1 WO 2017150169A1 JP 2017005214 W JP2017005214 W JP 2017005214W WO 2017150169 A1 WO2017150169 A1 WO 2017150169A1
Authority
WO
WIPO (PCT)
Prior art keywords
biological information
face
subject
person
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2017/005214
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
中村　剛
昌俊 松尾
忠則 手塚
大橋　政宏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Management Co Ltd
Original Assignee
Panasonic Intellectual Property Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Management Co Ltd filed Critical Panasonic Intellectual Property Management Co Ltd
Priority to EP17759640.0A priority Critical patent/EP3424415A4/en
Priority to US16/080,776 priority patent/US20190053715A1/en
Priority to CN201780014778.XA priority patent/CN108697345A/zh
Publication of WO2017150169A1 publication Critical patent/WO2017150169A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/024—Measuring pulse rate or heart rate
    • A61B5/02416—Measuring pulse rate or heart rate using photoplethysmograph signals, e.g. generated by infrared radiation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/024—Measuring pulse rate or heart rate
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0033—Features or image-related aspects of imaging apparatus, e.g. for MRI, optical tomography or impedance tomography apparatus; Arrangements of imaging apparatus in a room
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/024—Measuring pulse rate or heart rate
    • A61B5/0245—Measuring pulse rate or heart rate by using sensing means generating electric signals, i.e. ECG signals
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/1032—Determining colour of tissue for diagnostic purposes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6802—Sensor mounted on worn items
    • A61B5/6803—Head-worn items, e.g. helmets, masks, headphones or goggles
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
    • A61B5/6813—Specially adapted to be attached to a specific body part
    • A61B5/6814—Head
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235—Details of waveform analysis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network

Definitions

  • the present disclosure relates to a biological information extraction apparatus and a biological information extraction system that extract biological information from information obtained without contact with a human body.
  • a method such as a nurse puts a finger on the wrist of the subject to check the pulsation manually, or attaches a dedicated measuring device to the wrist or finger of the subject. Therefore, a method of automatically detecting pulsation is known.
  • the free behavior of the subject is temporarily restricted, or it is necessary to attach a measuring device to the subject, so that the subject (human body) is not contacted.
  • Techniques for estimating (detecting) the pulse have been developed. For example, a technique for extracting a pulse wave signal that is time-series data of a subject's pulse wave from image data obtained by imaging the subject and estimating (detecting) a pulse based on the pulse wave signal is known. (See Patent Document 1).
  • the worker's health condition eg, drowsiness, stress, poor physical condition
  • the worker's biological information eg, pulse wave, pulse
  • the management computer extracts the biological information of the subject based on the image data and determines the health condition (see Patent Document 2).
  • image data has a large amount of data
  • image data is compressed or image size is reduced, the extraction accuracy of biometric information based on the image data is lowered.
  • the present disclosure protects the privacy of the subject, extracts the biological information of the subject even when the subject wears a shield such as sunglasses or a mask on the face, and reduces the extraction accuracy of the biological information
  • the purpose is to reduce the amount of transmission data without causing the loss.
  • the biological information extraction apparatus is installed on a head-mounted body attached to a head of a subject, and extracts biological information of the subject from information obtained without contacting the subject.
  • a device that captures a temporally continuous captured image including at least a part of the face of the subject as a subject, a region selection unit that selects a skin color region from the captured image captured by the camera, And a data transmission unit that transmits biological data related to the subject's living body extracted based on the skin color region to a predetermined transmission destination, and the camera is arranged toward the side of the face of the subject. Is done.
  • the present disclosure it is possible to protect the privacy of the subject, extract the biological information of the subject even when the subject wears a shield such as sunglasses or a mask on the face, and the extraction accuracy of the biological information
  • the amount of transmission data can be reduced without lowering.
  • FIG. 1 is an overall configuration diagram of the biological information extraction system according to the first embodiment.
  • FIG. 2 is a functional block diagram of the biological information extraction system according to the first embodiment.
  • FIG. 3A is an explanatory diagram of a pulse wave detection process and a pulse estimation process.
  • FIG. 3B is an explanatory diagram of a pulse wave detection process and a pulse estimation process.
  • FIG. 4A is a block diagram illustrating a hardware configuration for realizing the biological information extracting apparatus according to the first embodiment.
  • FIG. 4B is a block diagram illustrating a hardware configuration for realizing the biological information extracting apparatus according to the first embodiment.
  • FIG. 5 is a flowchart showing a flow of processing by the biological information extracting apparatus according to the first embodiment.
  • FIG. 7A is a diagram illustrating a result of an experiment in which a relationship between a shield attached to a person's face and a person's heart rate is examined.
  • FIG. 7B is a diagram illustrating a result of an experiment in which a relationship between a shield worn on a person's face and a person's heart rate is examined.
  • FIG. 7C is a diagram illustrating a result of an experiment in which a relationship between a shield worn on a person's face and a person's heart rate is examined.
  • FIG. 7A is a diagram illustrating a result of an experiment in which a relationship between a shield attached to a person's face and a person's heart rate is examined.
  • FIG. 7B is a diagram illustrating a result of an experiment in which a relationship between a shield worn on a person's face and a person's heart rate is examined.
  • FIG. 7C is a diagram illustrating a result of an experiment in which a relationship between a
  • FIG. 7D is a diagram illustrating a result of an experiment in which a relationship between a shield attached to a person's face and a person's heart rate is examined.
  • FIG. 8 is an overall configuration diagram of the biological information extraction system according to the second embodiment.
  • FIG. 9 is a functional block diagram of the biological information extraction system according to the second embodiment.
  • FIG. 10 is an overall configuration diagram of the biological information extraction system according to the third embodiment.
  • FIG. 11 is a functional block diagram of the biological information extraction system according to the third embodiment.
  • FIG. 12 is a schematic diagram of the biological information extraction system 1 according to the fourth embodiment.
  • FIG. 13 is a diagram illustrating a modification of the camera of the biological information extracting apparatus.
  • FIG. 1 and FIG. 2 are an overall configuration diagram and a functional block diagram of the biological information extraction system 1 according to the first embodiment of the present disclosure, respectively, and FIG. 3 shows the biological information extraction device 3 and biological information analysis shown in FIG. It is explanatory drawing of the pulse wave detection process in the apparatus 4, and a pulse estimation process.
  • the biological information extraction system 1 extracts biological information (for example, a pulse wave and a pulse) from information (captured image) obtained without contact with a human body.
  • biological information for example, a pulse wave and a pulse
  • FIG. Installed on the head-mounted body 2 mounted on the head of H, the biological information extracting device 3 that extracts the pulse wave signal W that is the original information of the biological information of the person H, and transmitted from the biological information extracting device 3 And a biological information analyzer 4 that receives the pulse wave signal W.
  • the biometric information extraction device 3 and the biometric information analysis device 4 are connected to each other via a wireless communication network 5 such as a wireless LAN (Local Area Network) or Bluetooth (registered trademark).
  • a wireless communication network 5 such as a wireless LAN (Local Area Network) or Bluetooth (registered trademark).
  • the configuration is not limited thereto, and the biological information extracting device 3 and the biological information analyzing device 4 may be connected by a known communication cable.
  • the person H is an operator at a construction site or a construction site
  • the head-mounted body 2 is a helmet.
  • the head-mounted body 2 is also referred to as “helmet”.
  • the helmet 2 has a collar 2 a formed at the lower end over the entire circumference.
  • the person H is not limited to a worker at a construction site or a construction site.
  • operators of various heavy machinery such as cranes and excavators, drivers of various vehicles such as trucks and general vehicles, telephones of call centers, etc. It may be an operator (see FIG. 12) or the like.
  • the head-mounted body 2 is not limited to a helmet, and may be a headset (see FIG. 12), a headgear, a hat, or the like.
  • the biometric information extraction device 3 includes a camera 11 that captures a temporally continuous captured image including at least a part of the face of a person H as a subject, and a skin color from the captured image captured by the camera 11.
  • a region extraction unit 12 that extracts a region
  • a pulse wave detection unit 13 that detects a pulse wave signal W of the person H based on the skin color region extracted by the region extraction unit 12, and a pulse wave detected by the pulse wave detection unit 13
  • a data transmission unit 14 that transmits the signal W via the wireless communication network 5.
  • the biological information extraction device 3 has a thin, substantially rectangular housing, and hardware for executing the functions of each unit described later is accommodated therein.
  • the lens of the camera 11 is exposed on the side surface of the housing.
  • the upper end 3a of the biometric information extraction device 3 is fixedly attached to a portion of the collar 2a of the helmet 2 that is located on the side of the face of the person H using a known attachment mechanism (not shown).
  • the camera 11 is arranged toward the side of the face of the person H.
  • the camera 11 is disposed so as to face the side surface of the face of the person H.
  • the attachment mechanism which has the engaging part of the U-shaped cross section which can insert and fix the collar 2a is mentioned, for example.
  • the attachment method to the helmet 2 of the biometric information extraction device 3 is not specifically limited.
  • a pair of coupling mechanisms that can be coupled to each other, one installed on the helmet 2 and the other installed on the biological information extraction device 3, may be used.
  • the camera 11 is a camera having a known configuration, and forms an image of light from a subject (person H) obtained through a lens on an image sensor (CCD, CMOS, etc.) (not shown), thereby forming the light of the formed image.
  • An image sensor for converting the signal into an electric signal.
  • the camera 11 since the camera 11 is installed so as to face the side surface of the face of the person H, the camera 11 images the side face of the face of the person H.
  • the imaging region R of the camera 11 is set to a part of the side of the face, not the entire side of the face of the person H. Thereby, image data that can identify the face of the person H is not created.
  • the arrangement position of the camera 11 is set so as to image the cheek of the face of the person H. That is, the imaging region R of the camera 11 becomes the cheek of the face.
  • a pulse wave signal W that is time-series data is extracted based on a captured image of the skin of the person H captured by the camera 11. Since the pulse wave signal W is a signal extracted on the basis of a change in light absorption amount (specifically, hemoglobin concentration in blood) caused by a change in blood vessel volume due to contraction of the heart, the imaging region R is the person H It is desirable that the skin is a thin part so that imaging of the skin is easy and changes in the amount of light absorption can be accurately extracted.
  • the cheek of the face Since the cheek of the face is flat, has a large area, and has a thin skin, it is optimal as the imaging region R for extracting the pulse wave signal W.
  • the imaging region R By using the cheek of the face as the imaging region R, the pulse wave signal W of the person H can be extracted with high accuracy.
  • the area extraction unit 12 obtains a representative value representing the color (or luminance) of each pixel block of a predetermined size in the captured image (frame image), and the representative value matches a preset skin color value.
  • the pixel block or an area within a predetermined range from the pixel block is extracted as a skin color area.
  • the skin color value is automatically set based on the representative value of the skin color candidate area detected from the captured image using a known image recognition technique. Since the skin color value varies depending on the individual and the light conditions at the time of imaging, it is preferable that the skin color value is set when the person H wears the helmet 2 and every predetermined time.
  • the pulse wave detection unit 13 calculates, for example, pixel values (0-255 gradations) of each component of RGB for each pixel constituting the skin color area extracted in the temporally continuous captured image, and represents the representative value (
  • time-series data of the average value of each pixel) is generated as the pulse wave signal W.
  • the pulse wave signal W which is time-series data, can be generated based on only the pixel value of only the green component (G) that has a particularly large fluctuation due to pulsation.
  • the pulse wave signal W is waveform data (see FIG. 3A).
  • the data transmission unit 14 uses the well-known wireless communication technology such as wireless LAN or Bluetooth (registered trademark), and is related to the biological data related to the living body of the person H extracted based on the skin color region (in this embodiment, pulse wave detection)
  • the pulse wave signal W) generated by the unit 13 can be transmitted to the biological information analyzer 4.
  • the wireless communication technology used in the data transmission unit 15 is not particularly limited, and various known wireless communication technologies can be used.
  • the biological information analyzing device 4 includes a data receiving unit 21 that receives biological related data (pulse wave signal W in the present embodiment) transmitted from the biological information extracting device 3, and a data receiving unit 21. Is provided with a pulse estimation unit 22 for estimating the pulse of the person H based on the pulse wave signal W received, and a data storage unit 23 for storing the pulse estimated by the pulse estimation unit 22 as pulse data M.
  • a pulse estimation unit 22 for estimating the pulse of the person H based on the pulse wave signal W received
  • a data storage unit 23 for storing the pulse estimated by the pulse estimation unit 22 as pulse data M.
  • the data reception unit 21 uses biometric related data transmitted from the data transmission unit 15 using a known wireless communication technology such as a wireless LAN or Bluetooth (registered trademark). Can be received.
  • a wireless communication technology such as a wireless LAN or Bluetooth (registered trademark).
  • the wireless communication technology used in the data receiving unit 21 is not particularly limited as long as it can receive the biological data transmitted from the data transmitting unit 15.
  • the pulse wave signal W that is time-series data of pixel values (average values) has a slight fluctuation (for example, less than one gradation of the pixel value) based on a change in hemoglobin concentration in blood. Fluctuation). Therefore, the pulse estimation unit 22 performs a known filter process (for example, a process using a bandpass filter in which a predetermined pass band is set) on the pulse wave signal W, as shown in FIG. The pulse wave signal W from which the noise component has been removed can be extracted. Thereafter, the pulse estimator 22 calculates an interval S (see FIG.
  • an interval (pulse wave interval) S of one pulse period The pulse (pulse rate) can be estimated based on the pulse wave interval S. Since the pulse wave interval S is caused by the heartbeat, it can be considered to correspond to the heartbeat interval (RRI) in the electrocardiograph. Therefore, it is possible to estimate the pulse rate based on the pulse wave interval S.
  • RRI heartbeat interval
  • the estimation result (pulse rate) in the pulse estimation unit 22 is stored in the data storage unit 23 as pulse data.
  • Various information including the estimation result in the pulse estimator 22 (for example, the waveform of the pulse wave) is output and displayed on a display device (known display device) (not shown).
  • FIG. 4A is a block diagram showing a hardware configuration for realizing the biological information extracting apparatus 3 according to the first embodiment.
  • the biometric information extraction device 3 is a CPU (Central Processing Unit) 31 that centrally executes various information processing (for example, region extraction processing, pulse wave detection processing) and peripheral device control based on a camera 11 and a predetermined control program.
  • CPU Central Processing Unit
  • a memory 33 such as a DSP (Digital Signal Processor) 32, a RAM (Random Access Memory) functioning as a work area for the CPU 31 and the DSP 32, a ROM (Read Only Memory) for storing control programs and data executed by the CPU 31 and the DSP 32, Storage means 34 such as an HDD (Hard Disk Drive) or a memory card for accumulating the processing results in the biometric information extraction device 3, a wireless LAN that performs wireless transmission with the biometric information analysis device 4, Bluetooth (registered trademark), or the like It has a hardware configuration including a communication means 35 and a bus 36 for connecting them. Note that at least some of the functions of the respective units of the biological information extracting device 3 shown in FIG. 2 can be realized by the CPU 31 and the DSP 32 executing predetermined control programs. Moreover, you may substitute at least one part of the function of the biometric information extraction device 3 by the process by other well-known hardware.
  • FIG. 4B is a block diagram showing a hardware configuration for realizing the biological information analyzing apparatus 4 according to the first embodiment.
  • the biological information analyzer 4 is a CPU (Central Processing Unit) 41 and a DSP (Central Processing Unit) 41 that collectively execute various information processing (for example, region extraction processing, pulse wave detection processing) and peripheral device control based on a predetermined control program.
  • CPU Central Processing Unit
  • DSP Central Processing Unit
  • FIG. 5 is a flowchart showing the flow of processing by the biological information extracting apparatus 3 according to the first embodiment.
  • the camera 11 captures a temporally continuous captured image including at least a part of the face of the person H (in this embodiment, the cheek of the face) as a subject (ST101).
  • the region extraction unit 12 extracts a skin color region in the captured image (frame image) captured by the camera 11 (ST102).
  • the pulse wave detection unit 13 generates time-series data based on each pixel value constituting the skin color region extracted by the region extraction unit 12 as a pulse wave signal W.
  • the data transmitter 14 transmits the pulse wave signal W even generated by the pulse wave detector 13 to the biological information analyzer 4 as biological related data (ST104). Note that in the biological information extracting device 3, the above-described steps ST101 to ST104 are repeatedly executed in sequence.
  • FIG. 6 is a flowchart showing the flow of processing by the biological information analyzer 4 according to the first embodiment.
  • the data receiving unit 21 receives the pulse wave signal W from the data transmitting unit 14 of the biological information extracting device 3 (ST201).
  • the pulse estimator 22 performs a known filtering process on the pulse wave signal W to detect a pulse wave, and an interval S (see FIG. 3B) between adjacent peaks in the pulse wave, that is, the pulse wave.
  • An interval (pulse wave interval) S for one beat is calculated, and a pulse (pulse rate) is estimated based on the pulse wave interval S (ST202).
  • the data storage unit 23 stores the pulse estimated by the pulse estimation unit 22 as pulse data (ST203). Note that in the biological information analyzer 4, the above-described steps ST201 to ST203 are sequentially repeated.
  • FIG. 7A to 7D are diagrams showing the results of an experiment in which the relationship between the shield (sunglasses 51 and mask 52) worn on the face of the person H and the heart rate of the person H is examined.
  • FIG. 7B is a case where person H is wearing sunglasses 51 on the face
  • FIG. 7C is a case where person H is wearing a mask 52 on the face
  • FIG. A case where the person H wears sunglasses 51 and a mask 52 on the face is shown.
  • Heart rate monitor is a heart rate measured by the heart rate monitor
  • Front camera is a heart rate detected based on a captured image obtained by capturing the front of the face of the person H
  • Side camera “Indicates the heart rate detected based on the captured image obtained by capturing the side surface of the face of the person H.
  • the heart rate (side camera) detected based on the captured image obtained by capturing the side surface of the face of the person H is when the person H wears a shield on the face (FIG. 7B). 7C and 7D), even when the person H did not put a shield on the face (FIG. 7A), the heart rate measured by the heart rate monitor (heart rate monitor) was almost the same.
  • the heart rate (front camera) detected based on the captured image obtained by capturing the front of the face of the person H is the same as when the person H wears the mask 52 on the face (FIG. 7C). When wearing sunglasses 51 and mask 52 (FIG. 7D), detection was impossible.
  • the heart rate of the person H cannot be detected from a captured image obtained by imaging the front of the person H, but the side of the face of the person H is imaged. It was found that the detected image could be detected. Therefore, in consideration of the case where the person H wears a shield such as the mask 52 on the face, it has been found that the face of the person H should be imaged not on the front but on the side.
  • the camera 11 arranged toward the side of the face of the person H is configured to capture the side of the face of the person H. Even when the person H wears a shield such as sunglasses or a mask on the face, the biological information of the person H can be extracted.
  • the camera 11 is configured to image a part of the face of the person H (in this embodiment, the cheek of the face), image data that can identify the face of the person H is not created. . This makes it possible to protect the privacy of the person H even when troubles such as erroneous transmission of image data and information leakage occur.
  • the biological information extraction device 3 since the biological information extraction device 3 generates the pulse wave signal W and transmits the pulse wave signal W to the biological information analysis device 4, the image data can be stored without reducing the extraction accuracy of the biological information. Compared to the case of transmission, the amount of transmission data can be greatly reduced.
  • the imaging region R of the camera 11 is the face cheek, but the imaging region R may be a part other than the face cheek as long as it is a part of the side of the face of the person H. .
  • the region R1 above the mask 52 on the face of the person H as shown in FIG. 7C, the region R2 between the mask 52 and the sunglasses 51 on the face of the person H as shown in FIG. A part, a region in front of the ear of the person H, and the like can be set as the imaging region R.
  • the pulse wave signal W before performing the filtering process is transmitted from the biological information extracting device 3 to the biological information analyzing device 4. It is configured to do. However, you may comprise so that the pulse-wave signal after filter processing (namely, the pulse-wave signal from which the noise component was removed) may be transmitted. Even in that case, the amount of transmission data can be greatly reduced compared to the case of transmitting image data. In this case, the filtering process of the pulse wave signal W is performed in the biological information extracting device 3.
  • (Second Embodiment) 8 and 9 are an overall configuration diagram and a functional block diagram of the biological information extraction system 1 according to the second embodiment of the present disclosure.
  • symbol is attached
  • matters not particularly mentioned below are the same as those in the above-described first embodiment.
  • the biological information extraction system 1 according to the second embodiment is such that the pulse data M is transmitted as biological related data from the biological information extraction device 3 to the biological information analysis device 4. It is different from the case of form. Moreover, as shown in FIG. 9, the point from which the pulse estimation part 22 is provided in the biometric information extraction device 3 instead of the biometric information analyzer 4 differs from the case of 1st Embodiment.
  • the pulse pulse rate
  • the pulse data M is transmitted from the biological information extraction device 3 to the biological information analysis device 4. .
  • the biological information analyzer 4 stores the pulse data M received from the biological information extractor 3 in the data storage unit 23.
  • the biological information extracting device 3 generates the pulse data M and transmits the pulse data M to the biological information analyzing device 4.
  • the transmission data amount can be greatly reduced as compared with the case of transmitting image data without degrading the extraction accuracy.
  • the pulse data M which is biological information
  • the degree of freedom of the configuration of the biological information extracting system 1 is increased.
  • the camera 11 arranged toward the side of the face of the person H is configured to image a part of the side of the face of the person H (in this embodiment, the cheek of the face), the first implementation described above.
  • a shield such as sunglasses or a mask on the face.
  • FIG. 10 and 11 are an overall configuration diagram and a functional block diagram of the biological information extraction system 1 according to the third embodiment of the present disclosure.
  • symbol is attached
  • matters that are not particularly mentioned below are the same as those in the first embodiment described above.
  • the biological information extraction system 1 according to the third embodiment is such that image data P is transmitted as biological related data from the biological information extraction device 3 to the biological information analysis device 4. It is different from the case of form. Moreover, as shown in FIG. 11, the point from which the pulse-wave detection part 13 is provided not in the biometric information extraction apparatus 3 but in the biometric information analyzer 4 differs from the case of 1st Embodiment.
  • image data P is transmitted from the biological information extraction device 3 to the biological information analysis device 4, and the biological information analysis device 4 detects the pulse wave signal and the pulse wave thereof. A pulse (pulse rate) is estimated based on the signal.
  • the biological information extraction device 3 generates image data P that is time-series image data of the skin color area, and the image data P is converted into the biological information analysis device 4. Therefore, the transmission data amount can be greatly reduced as compared with the case where the entire face image is transmitted without lowering the extraction accuracy of the biological information.
  • the camera 11 arranged toward the side of the face of the person H is configured to image a part of the side of the face of the person H (in this embodiment, the cheek of the face), the first implementation described above. As in the case of the form, it is possible to protect the privacy of the person H and to extract the biological information of the person H even when the person H wears a shield such as sunglasses or a mask on the face. .
  • FIG. 12 is a schematic diagram of the biological information extraction system 1 according to the fourth embodiment of the present disclosure.
  • the same components as those in the first embodiment are denoted by the same reference numerals.
  • matters not particularly mentioned below are the same as those in the above-described first embodiment.
  • the biological information analyzer 4 is not shown.
  • the biological information extraction system 1 is different from the first embodiment in that a headset 2 is used instead of the helmet 2 as a head-mounted body.
  • the headset 2 includes a band unit 61 attached to the head of the person H, headphones 62 installed at the lower end 61a of the band unit 61, an arm 63 extending from the lower end 61a of the band unit 61, and a tip 63a of the arm 63.
  • the biological information extraction device 3 is fixed to a portion of the arm 63 positioned toward the cheek of the face of the person H using a known attachment mechanism (not shown) such as a clip. Attached to.
  • the arrangement position of the camera 11 is set so as to capture the cheek of the face of the person H. That is, the imaging region R of the camera 11 becomes the cheek of the face.
  • the biometric information extraction system 1 according to the fourth embodiment can be applied to a telephone operator at a call center.
  • a part of the side face of the person H's face with the camera 11 arranged toward the side face of the person H in this embodiment, the cheek of the face.
  • the privacy of the person H is protected, and the person H wears a shield such as sunglasses or a mask on the face.
  • a shield such as sunglasses or a mask on the face.
  • FIG. 13 is a view showing a modified example of the camera 11 of the biological information extracting apparatus 3.
  • the camera 11 has a lens 71 and an LED illumination 72.
  • the lens 71 has a visible light cut filter (not shown) that transmits infrared light and blocks visible light, and an infrared light cut filter (not shown) that transmits visible light and blocks infrared light.
  • the filter can be switched according to the brightness detected by an illuminance sensor (not shown).
  • an illuminance sensor not shown
  • the LED illumination 72 is also driven according to the brightness detected by an illuminance sensor (not shown). As a result, even when the amount of light necessary for imaging the person H is insufficient, the person H can be imaged more clearly by driving the LED illumination 72 to ensure the amount of light necessary for imaging.
  • biometric information extraction device and the biometric information extraction system according to the present disclosure are not limited to medical uses, and can be applied to various uses such as face recognition, monitoring, and life / death confirmation.
  • all the components of the biological information extraction apparatus and the biological information extraction system are not necessarily essential, and can be appropriately selected as long as they do not depart from the scope of the present disclosure.
  • the biological information extraction apparatus and the biological information extraction system according to the present disclosure protect the privacy of the subject, and extract the biological information of the subject even when the subject wears a shield such as sunglasses or a mask on the face. Therefore, the present invention is useful as a biological information extraction device and a biological information extraction system that can reduce the amount of transmission data without reducing the extraction accuracy of biological information.
  • Biometric information extraction system 2 Head-mounted body (helmet, headrest) DESCRIPTION OF SYMBOLS 3 Biological information extraction apparatus 4 Biological information analysis apparatus 5 Communication network 11 Camera 12 Area extraction part 14 Data transmission part 21 Data reception part 22 Pulse estimation part 23 Data storage part 71 Lens 72 LED illumination H Person (subject) R Imaging area W Pulse wave signal P Image data M Pulse data

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Physics & Mathematics (AREA)
  • Cardiology (AREA)
  • Physiology (AREA)
  • Signal Processing (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Dentistry (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
PCT/JP2017/005214 2016-03-03 2017-02-14 生体情報抽出装置および生体情報抽出システム Ceased WO2017150169A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP17759640.0A EP3424415A4 (en) 2016-03-03 2017-02-14 BIOLOGICAL INFORMATION EXTRACTION DEVICE AND BIOLOGICAL INFORMATION EXTRACTION SYSTEM
US16/080,776 US20190053715A1 (en) 2016-03-03 2017-02-14 Biological information extracting device and biological information extracting system
CN201780014778.XA CN108697345A (zh) 2016-03-03 2017-02-14 生物体信息提取装置和生物体信息提取系统

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016-040890 2016-03-03
JP2016040890A JP2017153773A (ja) 2016-03-03 2016-03-03 生体情報抽出装置および生体情報抽出システム

Publications (1)

Publication Number Publication Date
WO2017150169A1 true WO2017150169A1 (ja) 2017-09-08

Family

ID=59742803

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/005214 Ceased WO2017150169A1 (ja) 2016-03-03 2017-02-14 生体情報抽出装置および生体情報抽出システム

Country Status (5)

Country Link
US (1) US20190053715A1 (enExample)
EP (1) EP3424415A4 (enExample)
JP (1) JP2017153773A (enExample)
CN (1) CN108697345A (enExample)
WO (1) WO2017150169A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019111317A (ja) * 2017-12-22 2019-07-11 カシオ計算機株式会社 画像処理装置、画像処理方法及びプログラム

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7028002B2 (ja) * 2017-12-06 2022-03-02 新東工業株式会社 産業機械起動制御システム、起動制御方法、及びプログラム
WO2022201505A1 (ja) * 2021-03-26 2022-09-29 三菱電機株式会社 脈波検出装置及び脈波検出方法
JP2024518677A (ja) * 2021-03-30 2024-05-02 ハーマン ベッカー オートモーティブ システムズ ゲーエムベーハー Ｒｇｂ画像から心拍数を抽出するための方法及びシステム
JP7657092B2 (ja) * 2021-04-14 2025-04-04 シャープ株式会社 映像解析装置、映像解析方法、および脈波検出装置
WO2023048999A1 (en) * 2021-09-24 2023-03-30 Callisto Design Solutions Llc Systems and methods for measuring cardiac and respiratory signals
WO2024174130A1 (zh) * 2023-02-22 2024-08-29 南方科技大学 一种从视频中连续监测心率的多光谱成像方法、装置及终端

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010253274A (ja) * 2009-04-23 2010-11-11 Lvmh Recherche 皮膚欠陥を特性化する方法及び装置、並びに化粧用薬剤、外皮用薬剤、又は薬剤を使用する皮膚欠陥のための処置の有効性を評価する方法
JP2012114583A (ja) * 2010-11-22 2012-06-14 Sanyo Electric Co Ltd カメラ付き通信端末装置
JP2014198201A (ja) * 2013-03-29 2014-10-23 富士通株式会社 脈波検出プログラム、脈波検出方法および脈波検出装置
WO2015098977A1 (ja) * 2013-12-25 2015-07-02 旭化成株式会社 脈波測定装置、携帯機器、医療機器システム、及び生体情報コミュニケーションシステム

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
LV14444B (lv) * 2011-09-30 2012-02-20 Latvijas Universitāte Paņēmiens un ierīce perifērās reģionālās anestēzijas iedarbības noteikšanai, izmantojot bezkontakta fotopletizmogrāfiju
US8868039B2 (en) * 2011-10-12 2014-10-21 Digimarc Corporation Context-related arrangements
EP2844136A1 (en) * 2012-05-02 2015-03-11 Aliphcom Physiological characteristic detection based on reflected components of light
US20150313502A1 (en) * 2014-05-02 2015-11-05 Xerox Corporation Determining arterial pulse wave transit time from vpg and ecg/ekg signals
CN105266772B (zh) * 2014-06-20 2018-07-27 赵海 一种生理参数的测量方法
CN104013394B (zh) * 2014-06-24 2017-02-22 华北电力大学（保定） 电力工程高空作业人员个体状态监测装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010253274A (ja) * 2009-04-23 2010-11-11 Lvmh Recherche 皮膚欠陥を特性化する方法及び装置、並びに化粧用薬剤、外皮用薬剤、又は薬剤を使用する皮膚欠陥のための処置の有効性を評価する方法
JP2012114583A (ja) * 2010-11-22 2012-06-14 Sanyo Electric Co Ltd カメラ付き通信端末装置
JP2014198201A (ja) * 2013-03-29 2014-10-23 富士通株式会社 脈波検出プログラム、脈波検出方法および脈波検出装置
WO2015098977A1 (ja) * 2013-12-25 2015-07-02 旭化成株式会社 脈波測定装置、携帯機器、医療機器システム、及び生体情報コミュニケーションシステム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3424415A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2019111317A (ja) * 2017-12-22 2019-07-11 カシオ計算機株式会社 画像処理装置、画像処理方法及びプログラム
JP7415318B2 (ja) 2017-12-22 2024-01-17 カシオ計算機株式会社 画像処理装置、画像処理方法及びプログラム

Also Published As

Publication number Publication date
EP3424415A1 (en) 2019-01-09
CN108697345A (zh) 2018-10-23
JP2017153773A (ja) 2017-09-07
US20190053715A1 (en) 2019-02-21
EP3424415A4 (en) 2019-03-13

Similar Documents

Publication Publication Date Title
WO2017150169A1 (ja) 生体情報抽出装置および生体情報抽出システム
US9089310B2 (en) Method and device for removing EEG artifacts
KR102185224B1 (ko) 작업자와 작업환경의 모니터링이 가능한 헬멧 및 이를 이용한 작업현장 모니터링 시스템
CN104602594B (zh) 脉搏检测方法和脉搏检测装置
US10478079B2 (en) Pulse estimation device, pulse estimation system, and pulse estimation method
JP6098257B2 (ja) 信号処理装置、信号処理方法及び信号処理プログラム
JP2014036801A (ja) 生体状態観察システム、生体状態観察方法、およびプログラム
WO2017105720A1 (en) Electroencephalography (eeg) camera control
US9737219B2 (en) Method and associated controller for life sign monitoring
JP6115263B2 (ja) 脈波検出装置、脈波検出方法及び脈波検出プログラム
CN111297339B (zh) 一种光体积变化描记图法信号的生成方法和装置
CN111031905A (zh) 用于检测心脏异常的ecg和pcg监视系统
CN107411701A (zh) 测量眼球运动的可头戴装置
US9320440B2 (en) Discriminating between atrial fibrillation and sinus rhythm in physiological signals obtained from video
JPWO2014002276A1 (ja) バイタルサイン検出方法、バイタルサイン検出装置及びバイタルサイン検出プログラム
Dosso et al. Eulerian magnification of multi-modal RGB-D video for heart rate estimation
US11647913B2 (en) Image processing apparatus and pulse estimation system provided therewith, and image processing method
CN109171649B (zh) 智能影像式生命体征探测仪
JP6796525B2 (ja) 画像処理装置、画像処理システム及び画像処理方法
CN105125202A (zh) 一种基于低噪声放大器的心电监护系统
EP3632299A1 (en) Method and system for monitoring a subject
WO2017154477A1 (ja) 脈拍推定装置、脈拍推定システムおよび脈拍推定方法
WO2020171554A1 (en) Method and apparatus for measuring body temperature using a camera
CN110772248A (zh) 穿戴式设备心电实时监测系统及方法
KR101526774B1 (ko) 압축센싱을 이용한 심전도 신호 전송 방법 및 이를 이용한 모니터링 시스템

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2017759640

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2017759640

Country of ref document: EP

Effective date: 20181004

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17759640

Country of ref document: EP

Kind code of ref document: A1