WO2024116255A1 - Dispositif d'estimation d'onde d'impulsion, procédé d'estimation d'onde d'impulsion, système d'estimation d'état et procédé d'estimation d'état - Google Patents

Dispositif d'estimation d'onde d'impulsion, procédé d'estimation d'onde d'impulsion, système d'estimation d'état et procédé d'estimation d'état Download PDF

Info

Publication number
WO2024116255A1
WO2024116255A1 PCT/JP2022/043835 JP2022043835W WO2024116255A1 WO 2024116255 A1 WO2024116255 A1 WO 2024116255A1 JP 2022043835 W JP2022043835 W JP 2022043835W WO 2024116255 A1 WO2024116255 A1 WO 2024116255A1
Authority
WO
WIPO (PCT)
Prior art keywords
pulse wave
luminance
point
signal
luminance signal
Prior art date
Application number
PCT/JP2022/043835
Other languages
English (en)
Japanese (ja)
Inventor
雄大 中村
遼平 村地
篤 松本
信太郎 渡邉
Original Assignee
三菱電機株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 三菱電機株式会社 filed Critical 三菱電機株式会社
Priority to PCT/JP2022/043835 priority Critical patent/WO2024116255A1/fr
Publication of WO2024116255A1 publication Critical patent/WO2024116255A1/fr

Links

Images

Definitions

  • This disclosure relates to a pulse wave estimation device, a pulse wave estimation method, a condition estimation system, and a condition estimation method.
  • the pulse wave detection device described in Patent Document 1 subtracts, for example, the luminance of the red component, which has a small pulse wave component and fluctuates with the movement of the user's head, from the luminance of the green component, which has a large pulse wave component and fluctuates with the movement of the user's head, in an image of the user captured in the visible light band by an RGB camera.
  • the pulse wave detection device described above removes errors, i.e., noise, in estimating the user's pulse wave caused by the movement of the user's head, thereby improving the accuracy of estimating the pulse wave.
  • the pulse wave detection device when using the above-mentioned pulse wave detection device to monitor the pulse rate of a user who is sleeping at night, for example, it is necessary to use a near-infrared camera capable of capturing images in the near-infrared wavelength band, instead of the RGB camera capable of capturing images in the visible light band described above.
  • the pulse wave detection device has an issue in that when the near-infrared camera is used, it is not possible to estimate the pulse wave by subtracting the luminance of the green component from the luminance of the red component, as described above.
  • the objective of the present disclosure is to provide a pulse wave estimation device, a pulse wave estimation method, a condition estimation system, and a condition estimation method that can estimate a subject's pulse wave using an image captured under near-infrared light.
  • the pulse wave estimation device includes an image acquisition unit that acquires an image of a person taken under near-infrared light, a skin area detection unit that detects a skin area, which is the location of the person's skin, from the image, a measurement area setting unit that sets a plurality of measurement areas in the skin area, which are areas for measuring the luminance of the person's skin, a point identification unit that identifies a first point and a second point within one of the plurality of measurement areas and along a direction in which the person's pulse wave propagates in the image, and a first distribution that is obtained by superimposing the luminance of the first point and the luminance of the second point on the first distribution and the luminance of the second point, which are different from each other in the correspondence relationship between the position on the coordinates and the magnitude of weighting identified by the position on the coordinates, to generate a first luminance signal indicating the luminance at the first point after being weighted by the first distribution,
  • a luminance signal generating unit that generates a third luminance signal indicating the luminance at the first point after being weighted by the second distribution and a fourth luminance signal indicating the luminance at the second point after being weighted by the second distribution by superimposing the luminance of the first point and the luminance of the second point on the second distribution;
  • a pulse wave source signal generating unit that generates a first pulse wave source signal by combining the first luminance signal and the second luminance signal, and generates a second pulse wave source signal by combining the third luminance signal and the fourth luminance signal;
  • a pulse wave signal generating unit that generates a pulse wave signal indicating the person's pulse wave by subtracting one of the first pulse wave source signal and the second pulse wave source signal from the other; and a pulse wave estimating unit that estimates the person's pulse wave based on the pulse wave signal.
  • the pulse wave estimation device disclosed herein can improve the accuracy of estimating a subject's pulse wave even when using images captured under near-infrared light.
  • FIG. Fig. 2A shows an image Im of the first embodiment.
  • Fig. 2B shows a measurement region R of the first embodiment.
  • Fig. 2C shows a skin region S of the first embodiment.
  • 1 shows a basic operation for generating the first luminance signal KI1 to the fourth luminance signal KI4 in the first embodiment.
  • 1 shows the basic operation up to generation of a pulse wave signal MY in the first embodiment.
  • 10 shows detailed operations for generating the first pulse wave original signal MM1 to the second pulse wave original signal MM2 in the first embodiment.
  • 10 shows detailed operations up to generation of a pulse wave signal MY in the first embodiment.
  • 3 shows configurations of weighting function A and weighting function B according to the first embodiment.
  • FIG. 4 shows a luminance signal of a comparative example.
  • 2 shows a hardware configuration of a pulse wave estimation device MSD according to the first embodiment.
  • 2 shows a hardware configuration based on software realization of the pulse wave estimation device MSD of the first embodiment.
  • 4 is a flowchart showing the operation of the pulse wave estimation device MSD of the first embodiment.
  • 13 shows the configuration of a pulse wave estimation device MSD according to a modified example of the first embodiment.
  • FIG. 11 is a functional block diagram of a pulse wave estimation device MSD of a second embodiment.
  • 10 is a flowchart showing the operation of a pulse wave estimation device MSD of the second embodiment.
  • FIG. 13 shows the operation of the pulse wave estimation device MSD of the second embodiment up to generation of the first luminance signal KI1 (R1) to the fourth luminance signal KI4 (R1) and the first luminance signal KI1 (R1) to the fourth luminance signal KI4 (R2). 13 shows the operation up to generation of an average pulse wave signal HMY of a pulse wave estimation device MSD of embodiment 2.
  • FIG. 11 is a functional block diagram of a pulse wave source signal generating unit MMS according to a third embodiment. 11 is a flowchart showing the operation of a pulse wave estimation device MSD of embodiment 3.
  • FIG. 13 is a functional block diagram of a measurement region setting unit KRS, a point specifying unit TTO, and a luminance signal generating unit KSS according to a fourth embodiment.
  • FIG. 1 shows a measurement region R, a first point P1 to a fourth point P4, and a first luminance signal KI1 to a fourth luminance signal KI4 according to the fourth embodiment.
  • 10 is a flowchart showing the operation of a pulse wave estimation device MSD of embodiment 4.
  • FIG. 13 is a functional block diagram of a state estimation system JSS according to a fifth embodiment.
  • This section describes an embodiment of a pulse wave estimation device according to the present disclosure.
  • Embodiment 1 First Embodiment A pulse wave estimation device MSD according to the first embodiment will be described.
  • FIG. 1 is a functional block diagram of a pulse wave estimation device MSD according to the first embodiment.
  • FIG. 2 shows an image Im, a measurement area R, and a skin area S in embodiment 1.
  • FIG. 3 shows the basic operation of generating the first luminance signal KI1 to the fourth luminance signal KI4 in the first embodiment.
  • FIG. 4 shows the basic operation up to the pulse wave signal MY in embodiment 1.
  • FIG. 5 shows the detailed operation of generating the first pulse wave source signal MM1 to the second pulse wave source signal MM2 in embodiment 1.
  • FIG. 6 shows the detailed operation up to the generation of the pulse wave signal MY in embodiment 1.
  • the pulse wave estimation device MSD of the first embodiment includes an image acquisition unit GSY, a skin region detection unit HRK, a measurement region setting unit KRS, a point identification unit TTO, a luminance signal generation unit KSS, a pulse wave source signal generation unit MMS, a pulse wave signal generation unit MSS, and a pulse wave estimation unit MSU.
  • Image acquisition unit GSY corresponds to the "image acquisition unit”
  • skin area detection unit HRK corresponds to the “skin area detection unit”
  • measurement area setting unit KRS corresponds to the "measurement area setting unit”
  • point identification unit TTO corresponds to the "point identification unit TTO”
  • luminance signal generation unit KSS corresponds to the "luminance signal generation unit”
  • pulse wave source signal generation unit MMS corresponds to the "pulse wave source signal generation unit”
  • pulse wave signal generation unit MSS corresponds to the "pulse wave signal generation unit”
  • pulse wave estimation unit MSU corresponds to the "pulse wave estimation unit”.
  • the image acquisition unit GSY acquires an image Im (also shown in FIG. 2) of at least one human subject HK, taken under near-infrared light (e.g., using a near-infrared camera). Since the image Im is taken under near-infrared light, it is a single-color image (e.g., a monochrome image, or an image of only one of multiple colors).
  • near-infrared light does not mean only near-infrared light in the narrow sense, but also means, for example, a single color of visible light (e.g., green light) in the broad sense.
  • the skin area detection unit HRK detects the position of the skin of the subject HK in the image Im, for example, the skin area S (also shown in FIG. 2B), which is the area where the skin of the subject HK's face is located, by setting landmarks LM1, LM2, LM3, ... in the image Im using a conventionally known method.
  • the skin area detection unit HRK generates skin area information SJ indicating the skin area S of the subject HK.
  • the skin area information SJ specifically indicates, for example, whether or not the skin area S of the subject HK is present in the image Im, and the position and size of the skin area S of the subject HK in the image Im.
  • the measurement area setting unit KRS sets a number of measurement areas R1, R2, R3, R4, ... (also shown in Figure 2C) in the skin area S of the subject HK, which are areas for measuring the brightness of the subject HK's skin, to be used to estimate the subject HK's pulse wave M.
  • the measurement area setting unit KRS generates measurement area information RJ indicating the measurement areas R.
  • the multiple measurement regions R1, R2, R3, R4, etc. are, for example, quadrilaterals (as shown in Figure 2C).
  • the measurement area information RJ indicates, for example, the position and size of each measurement area R in the image Im, and indicates, for example, the coordinate positions of the four vertices of the measurement area R, which is a quadrilateral.
  • the point identification unit TTO identifies a first point P1 and a second point P2 within the measurement region R (e.g., within the measurement region R56) and along the direction HO in which the pulse wave M of the subject HK propagates in the image Im.
  • identifying a first point P1 and a second point P2 along the direction HO in which the pulse wave M of the subject HK propagates in the image Im should be interpreted broadly and includes at least the following: (1) (1A) along the direction HO in which the pulse wave M of subject HK propagates in image Im, or (1B) along the direction HO in which the pulse wave M of subject HK will propagate in image Im, for example, as shown in the lower left of Figure 3, identify at least one of the first points P1, P3, P5, P7, and P9 and one of the second points P2, P4, P6, P8, and P10 (identify two or more points).
  • a virtual line (not shown, same below) passing through the first point P1 and the second point P2, a virtual line passing through points P3 and P4, a virtual line passing through points P5 and P6, a virtual line passing through points P7 and P8, and a virtual line passing through points P9 and P10 are each along the above-mentioned direction HO, i.e., parallel to the direction HO.
  • the luminance signal generation unit KSS generates a first luminance signal KI1, a second luminance signal KI2, a third luminance signal KI3, and a fourth luminance signal KI4 using the luminance at the first point P1, the luminance at the second point P2, and weighting functions A and B.
  • Weighting function A and weighting function B correspond to the "first distribution” and the "second distribution”.
  • the luminance signal generating unit KSS superimposes the luminance of the first point P1 in the measurement area R and the luminance of the second point P2 in the measurement area R with the weighting function A.
  • the luminance signal generating unit KSS generates a first luminance signal KI1 indicating the luminance at the first point P1 after being weighted by the weighting function A, and a second luminance signal KI2 indicating the luminance at the second point P2 after being weighted by the weighting function A, as shown in FIG. 3.
  • the luminance signal generating unit KSS also superimposes the luminance of the first point P1 in the measurement region R and the luminance of the second point P2 in the measurement region R with weighting function B instead of weighting function A described above. As a result, the luminance signal generating unit KSS generates a third luminance signal KI3 indicating the luminance at the first point P1 after being weighted by weighting function B, and a fourth luminance signal KI4 indicating the luminance at the second point P2 after being weighted by weighting function B, as shown in FIG. 3.
  • FIG. 7 shows the configuration of weighting function A and weighting function B in embodiment 1.
  • weighting function A and weighting function B have spatially different weightings. Specifically, weighting function A has a small weighting spread, which is the degree of spread of the weighting (vertical axis) relative to the distance (horizontal axis), while weighting function B has a wide weighting spread. More specifically, comparing weighting function A and weighting function B, weighting function A has weighting values concentrated within a shorter distance range than weighting function B, or in other words, weighting function B has weighting values spread within a longer distance range than weighting function A. In further other words, weighting function A has weighting values that are substantially 0 at relatively short distance positions, while weighting function B has weighting values that are substantially 0 at relatively long distance positions.
  • Weighting function A and weighting function B can be, for example, a two-dimensional Gaussian function. Weighting function A and weighting function B using a two-dimensional Gaussian function can be expressed using, for example, the coordinate position, the weighting coefficient at the coordinate position, the coordinate position of the center of gravity, and the spread of the Gaussian function as parameters.
  • the pulse wave source signal generating unit MMS generates a first pulse wave source signal MM1 by combining the first luminance signal KI1 and the second luminance signal KI2 as shown in Figures 4 and 5.
  • the pulse wave source signal generating unit MMS also generates a second pulse wave source signal MM2 by combining the third luminance signal KI3 and the fourth luminance signal KI4 as shown in Figures 4 and 5.
  • the first pulse wave source signal MM1 has a characteristic in which the peaks of the pulse wave are emphasized, whereas the second pulse wave source signal MM2 has a characteristic in which the peaks of the pulse wave are not emphasized.
  • the pulse wave signal generating unit MSS generates a pulse wave signal MY indicating the pulse wave M of the subject HK by subtracting the second pulse wave source signal MM2 from the first pulse wave source signal MM1, as shown in Figures 4 and 6.
  • Figure 8 shows the luminance signal of a comparative example.
  • the luminance signal (red component) KIR is subtracted from the luminance signal (green component) KIG, or the luminance signal (blue component) KIB is subtracted from the luminance signal (green component) KIG.
  • the above pulse wave detection device improves the accuracy of estimating the pulse wave M of the subject HK by removing noise, which is an error in estimating the pulse wave M of the subject HK due to the movement of the subject HK's head, through the subtraction.
  • the above-mentioned first pulse wave source signal MM1 corresponds to the luminance signal (green component) KIG of the comparative example
  • the above-mentioned second pulse wave source signal MM2 corresponds to the luminance signal (red component) KIR or the luminance signal (blue component) KIB of the comparative example.
  • the pulse wave estimation unit MSU estimates the pulse wave M of the subject HK based on the pulse wave signal MY (shown in Figures 4 and 6).
  • the pulse wave estimation unit MSU generates pulse wave information MJ that indicates the pulse wave M.
  • the pulse wave information MJ indicates, for example, the pulse rate (number of beats per minute).
  • the pulse wave estimation unit MSU uses, for example, the peak frequency in the frequency power spectrum obtained by performing a Fourier transform on the pulse wave signal MY as the pulse wave rate, which is the pulse wave information MJ.
  • FIG. 9 shows a hardware configuration of the pulse wave estimation device MSD of the first embodiment.
  • the pulse wave estimation device MSD includes a processing circuit SH, and may further include an input circuit NY and an output circuit SY as necessary.
  • the processing circuit SH is dedicated hardware.
  • the processing circuit SH realizes the functions of the image acquisition unit GSY to the pulse wave estimation unit MSU (shown in Figure 1) of the pulse wave estimation device MSD.
  • the processing circuit SH may be, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination of these.
  • the input circuit NY and the output circuit SY exchange inputs and outputs related to the operation of the processing circuit SH, for example, with the outside of the pulse wave estimation device MSD.
  • FIG. 10 shows the hardware configuration based on the software implementation of the pulse wave estimation device MSD of embodiment 1.
  • the pulse wave estimation device MSD includes a processor PR and a memory circuit KI, and may further include an input circuit NY and an output circuit SY as necessary.
  • the processor PR is a CPU (also called a Central Processing Unit, central processing unit, processing unit, arithmetic unit, microprocessor, microcomputer, or DSP (Digital Signal Processing)) that executes programs.
  • the processor PR realizes the functions of the image acquisition unit GSY to the pulse wave estimation unit MSU (shown in Figure 1) of the pulse wave estimation device MSD.
  • the processor PR realizes the above functions by software, firmware, or a combination of software and firmware.
  • the software and firmware are written as programs and stored in the memory circuit KI.
  • the processor PR realizes the above-mentioned functions by reading and executing the above-mentioned programs from the memory circuit KI.
  • the above-mentioned programs can also be said to cause the computer to execute the procedures and methods of the image acquisition unit GSY through the pulse wave estimation unit MSU.
  • the memory circuit KI may be, for example, a non-volatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), etc., as well as a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a DVD (Digital Versatile Disc), etc.
  • a non-volatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM (Erasable Programmable Read Only Memory), an EEPROM (Electrically Erasable Programmable Read-Only Memory), etc.
  • a magnetic disk such as a flexible disk, an optical disk, a compact disk, a mini disk, a DVD (Digital Versatile Disc), etc.
  • Some of the functions from the image acquisition unit GSY to the pulse wave estimation unit MSU may be realized by a processing circuit SH (shown in FIG. 9), while other functions may be realized by a processor PR (shown in FIG. 10).
  • the functions of the image acquisition unit GSY to the pulse wave estimation unit MSU of the pulse wave estimation device MSD can be realized by hardware, software, firmware, or a combination of these.
  • the input circuit NY and the output circuit SY exchange inputs and outputs related to the operation of the processor PR, for example, with the outside of the pulse wave estimation device MSD.
  • FIG. 11 is a flowchart showing the operation of the pulse wave estimation device MSD of embodiment 1. The operation of the pulse wave estimation device MSD of embodiment 1 will be described with reference to the flowchart of FIG. 11.
  • Step ST11 The image acquisition unit GSY (shown in FIG. 1) acquires an image Im (shown in FIG. 1, FIG. 2A, etc.) of the subject HK (shown in FIG. 1).
  • Step ST12 The skin area detection unit HRK (shown in FIG. 1) detects the skin area S (shown in FIG. 1, FIG. 2B, etc.) of the subject HK in the image Im of the subject HK.
  • the skin area detection unit HRK generates skin area information SJ indicating the skin area S of the subject HK.
  • Step ST13 The measurement area setting unit KRS (shown in FIG. 1) sets multiple measurement areas R (shown in FIG. 1, FIG. 2C, etc.) in the skin area S of the subject HK.
  • Step ST14 The point identification unit TTO (shown in FIG. 1) identifies a first point P1 and a second point P2 (shown in FIGS. 3, 5, etc.) within the measurement region R, for example, within the measurement region R56 (shown in FIG. 3), and along the direction HO (shown in FIG. 3) in which the pulse wave M of the subject HK propagates.
  • Step ST15 The luminance signal generating unit KSS (shown in FIG. 1) generates the first luminance signal KI1 to the fourth luminance signal KI4 (shown in FIG. 3, FIG. 4, etc.) using the luminance at the first point P1 in the measurement area R and the luminance at the second point P2 in the measurement area R (shown in FIG. 3), as well as weighting function A and weighting function B (shown in FIG. 3, etc.).
  • Step ST16 The pulse wave signal generating unit MSS (shown in FIG. 1) generates a first pulse wave source signal MM1 (shown in FIGS. 4 and 5) by combining the first luminance signal KI1 and the second luminance signal KI2.
  • the pulse wave source signal generating unit MMS also generates a second pulse wave source signal MM2 (shown in FIGS. 4 and 5) by combining the third luminance signal KI3 and the fourth luminance signal KI4.
  • Step ST17 The pulse wave signal generating unit MSS (shown in FIG. 1) performs subtraction between the first pulse wave source signal MM1 and the second pulse wave source signal MM2, more specifically, subtracts the second pulse wave source signal MM2 from the first pulse wave source signal MM1, to generate a pulse wave signal MY (shown in FIGS. 4 and 6) indicating the pulse wave M of the subject HK.
  • MSS The pulse wave signal generating unit MSS (shown in FIG. 1) performs subtraction between the first pulse wave source signal MM1 and the second pulse wave source signal MM2, more specifically, subtracts the second pulse wave source signal MM2 from the first pulse wave source signal MM1, to generate a pulse wave signal MY (shown in FIGS. 4 and 6) indicating the pulse wave M of the subject HK.
  • Step ST18 The pulse wave estimation unit MSU (shown in FIG. 1) estimates the pulse wave M (shown in FIG. 1) of the subject HK based on the pulse wave signal MY.
  • the pulse wave estimation unit MSU generates pulse wave information MJ (shown in FIG. 1) indicating the pulse wave M.
  • the luminance signal generation unit KSS generates the first luminance signal KI1 to the fourth luminance signal KI4 based on the luminance at the first point P1 in the measurement region R, the luminance at the second point P2 in the measurement region R, the weighting function A, and the weighting function B
  • the pulse wave original signal generation unit MMS generates the first pulse wave original signal MM1 and the second pulse wave original signal MM2 using the first luminance signal KI1 to the fourth luminance signal KI4
  • the pulse wave signal generation unit MSS generates the pulse wave signal MY using the first pulse wave original signal MM1 and the second pulse wave original signal MM2
  • the pulse wave estimation unit MSU estimates the pulse wave M based on the pulse wave signal MY.
  • FIG. 12 shows the configuration of a pulse wave estimation device MSD that is a modified example of embodiment 1.
  • the first pulse wave source signal MM1 and the second pulse wave source signal MM2 described in the first embodiment contain various noise components NS (not shown), for example noise components NS caused by defects in some of the elements that make up the image acquisition unit GSY.
  • noise components NS for example noise components NS caused by defects in some of the elements that make up the image acquisition unit GSY.
  • the pulse wave estimation device MSD of the modified example of embodiment 1 further includes a noise removal unit NJO to perform the above-mentioned filter processing FS.
  • the noise removal unit NJO is disposed between the pulse wave source signal generation unit MMS and the pulse wave signal generation unit MSS, as shown in FIG. 12.
  • the noise removal unit NJO applies the above-mentioned filter processing FS to the first pulse wave source signal MM1 and the second pulse wave source signal MM2, for example, using a low-pass filter, a high-pass filter, or a band-pass filter.
  • the noise removal unit NJO applies a band-pass filter as the filtering process FS.
  • the above-mentioned bandpass filter is, for example, a Butterworth filter. It is desirable that the bandpass filter has a lower cutoff frequency of, for example, 0.5 Hz and a higher cutoff frequency of, for example, 5.0 Hz.
  • the noise removal unit NJO removes the noise components NS contained in the first pulse wave source signal MM1 and the second pulse wave source signal MM2 from the first pulse wave source signal MM1 and the second pulse wave source signal MM2, and outputs the first pulse wave source signal MM1 from which the noise components NS have been removed, and the second pulse wave source signal MM2 from which the noise components NS have been removed, to the pulse wave signal generation unit MSS.
  • the noise removal unit NJO applies filter processing FS to the first pulse wave source signal MM1 and the second pulse wave source signal MM2. This removes the noise components NS contained in the first pulse wave source signal MM1 and the second pulse wave source signal MM2. As a result, the noise components NS are removed from the pulse wave signal MY generated by the pulse wave source signal generation unit MMS, and the accuracy of the estimation of the pulse wave M of the subject HK by the pulse wave estimation unit MSU can be improved compared to embodiment 1.
  • Embodiment 2 Second Embodiment A pulse wave estimation device MSD according to the second embodiment will be described.
  • the pulse wave estimation device MSD of embodiment 2 estimates the pulse wave M of the subject HK based on two mutually different measurement regions R, for example, measurement regions R1 and R2 (shown in FIG. 2C).
  • FIG. 13 is a functional block diagram of a pulse wave estimation device MSD according to the second embodiment.
  • the pulse wave estimation device MSD of embodiment 2 basically has the same functions as the pulse wave estimation device MSD of embodiment 1.
  • the pulse wave estimation device MSD of embodiment 2 differs from the pulse wave estimation device MSD of embodiment 1 in that it further includes an averaging unit HKK.
  • the averaging unit HKK corresponds to the "averaging unit.”
  • the averaging unit HKK averages the pulse wave signal MY(R1) for measurement region R1 and the pulse wave signal MY(R2) for measurement region R2.
  • the hardware configuration of the pulse wave estimation device MSD of embodiment 2 and the hardware configuration based on software realization are similar to the hardware configuration of the pulse wave estimation device MSD of embodiment 1 (shown in FIG. 9 ) and the hardware configuration based on software realization (shown in FIG. 10 ).
  • FIG. 14 is a flowchart showing the operation of the pulse wave estimation device MSD of the second embodiment.
  • FIG. 15 shows the operation of the pulse wave estimation device MSD of embodiment 2 up to the generation of the first luminance signal KI1 (R1) to the fourth luminance signal KI4 (R1) and the first luminance signal KI1 (R1) to the fourth luminance signal KI4 (R2).
  • FIG. 16 shows the operation up to generation of the average pulse wave signal HMY of the pulse wave estimation device MSD of embodiment 2.
  • Step ST21 The image acquisition unit GSY (shown in FIG. 13) acquires an image Im (shown in FIG. 15) of the subject HK (shown in FIG. 13) in the same manner as in step ST11 in embodiment 1.
  • Step ST22 The skin area detection unit HRK (shown in FIG. 13) detects the skin area S (shown in FIG. 15) of the subject HK in the image Im of the subject HK, similar to step ST12 in embodiment 1.
  • the skin area detection unit HRK generates skin area information SJ indicating the skin area S of the subject HK.
  • Step ST23 The measurement area setting unit KRS (shown in FIG. 13) sets multiple measurement areas R (shown in FIG. 15) in the skin area S of the subject HK, similar to step ST13 in embodiment 1.
  • Step ST24 The point identification unit TTO (shown in FIG. 13) differs from step ST14 in embodiment 1 and, as shown in FIG. 15, identifies a first point P1 and a second point P2 in the measurement region R1 and along the direction HO in which the pulse wave M of the subject HK propagates (e.g., shown in FIG. 3 in embodiment 1), and on the other hand, identifies a first point P1 and a second point P2 in a measurement region R2 different from the measurement region R1 and along the direction HO in which the pulse wave M of the subject HK propagates.
  • Step ST25 The luminance signal generating unit KSS (shown in FIG. 13) differs from step ST15 in the first embodiment, and as shown in FIG. 15, generates a first luminance signal KI1(R1) to a fourth luminance signal KI4(R1) using the luminance at the first point P1 in the measurement area R1, the luminance at the second point P2 in the measurement area R1, and weighting functions A and B, while generating a first luminance signal KI1(R2) to a fourth luminance signal KI4(R2) using the luminance at the first point P1 in the measurement area R2, the luminance at the second point P2 in the measurement area R2, and weighting functions A and B.
  • Step ST26 The pulse wave signal generating unit MSS (shown in Figure 13) differs from step ST16 in embodiment 1 and, as shown in Figure 16, generates a first pulse wave original signal MM1 (R1) by combining the first luminance signal KI1 (R1) and the second luminance signal KI2 (R1) for the measurement region R1, and generates a second pulse wave original signal MM2 (R1) by combining the third luminance signal KI3 (R1) and the fourth luminance signal KI4 (R1).
  • the pulse wave signal generating unit MSS generates a first pulse wave source signal MM1 (R2) by synthesizing the first luminance signal KI1 (R2) and the second luminance signal KI2 (R2) for the measurement region R2, and generates a second pulse wave source signal MM2 (R2) by synthesizing the third luminance signal KI3 (R2) and the fourth luminance signal KI4 (R2).
  • Step ST27 The pulse wave signal generating unit MSS (shown in FIG. 13) differs from step ST17 in embodiment 1 and generates a pulse wave signal MY (R1) that may indicate the pulse wave M of subject HK by subtracting the second pulse wave source signal MM2 (R1) from the first pulse wave source signal MM1 (R1) for measurement region R1 as shown in FIG. 16.
  • the pulse wave signal generating unit MSS generates a pulse wave signal MY (R2) that may indicate the pulse wave M of subject HK by subtracting the second pulse wave source signal MM2 (R2) from the first pulse wave source signal MM1 (R2) for measurement region R2.
  • Step ST28 The averaging unit HKK (shown in FIG. 13) averages the pulse wave signal MY (R1) for measurement region R1 and the pulse wave signal MY (R2) for measurement region R2 as shown in FIG. 16. As a result, the averaging unit HKK generates an average pulse wave signal HMY, which is a single averaged signal, as shown in FIG. 16.
  • Step ST29 The pulse wave estimation unit MSU (shown in FIG. 13) estimates the pulse wave M of the subject HK based on the average pulse wave signal HMY.
  • the pulse wave estimation unit MSU generates pulse wave information MJ indicating the pulse wave M.
  • the image acquisition unit GSY to the pulse wave signal generation unit MSS cooperate to generate the pulse wave signal MY (R1) and the pulse wave signal MY (R2) for the two mutually different measurement regions R, i.e., the measurement regions R1 and R2, and the averaging unit HKK averages the pulse wave signal MY (R1) and the pulse wave signal MY (R2) to generate an averaged signal, the average pulse wave signal HMY.
  • the pulse wave estimation unit MSU estimates the pulse wave M of the subject HK based on the average pulse wave signal HMY instead of the pulse wave signal MY of the first embodiment.
  • Embodiment 3 Third Embodiment A pulse wave estimation device MSD according to a third embodiment will be described.
  • the pulse wave estimation device MSD of embodiment 3 subtracts the result of multiplying the second pulse wave source signal MM2 by a coefficient (multiplication coefficient c, described below) from the first pulse wave source signal MM1.
  • the pulse wave estimation device MSD of embodiment 3 basically has the same functions (shown in FIG. 1 ) as the pulse wave estimation device MSD of embodiment 1. However, the pulse wave estimation device MSD of embodiment 3 differs from the pulse wave estimation device MSD of embodiment 1 in that the pulse wave source signal generating unit MMS of embodiment 3 has a different function from the pulse wave source signal generating unit MMS of embodiment 1.
  • FIG. 17 is a functional block diagram of the pulse wave source signal generating unit MMS in embodiment 3.
  • the pulse wave source signal generating unit MMS of embodiment 3 has a coefficient calculation function KE, a multiplication function JO, and a subtraction function GE.
  • the pulse wave source signal generating unit MMS of embodiment 3 also handles first pulse wave source signal information W, second pulse wave source signal information M, and coefficient information C.
  • each piece of information indicates a first pulse wave source signal MM1.
  • Second pulse wave source signal information M indicates a second pulse wave source signal MM2.
  • Coefficient information C indicates a multiplication coefficient c.
  • the multiplication coefficient c corresponds to "coefficient.”
  • the pulse wave signal generating unit MSS generates the pulse wave signal MY based on the first pulse wave source signal information W and the second pulse wave source signal information M, in other words, generates the pulse wave signal MY based on the first pulse wave source signal MM1 and the second pulse wave source signal MM2.
  • the pulse wave signal generating unit MSS performs the following.
  • coefficient calculation function KE coefficient information C indicating a multiplication coefficient c, which is a coefficient for multiplying the second pulse wave original signal information M, is calculated based on the first pulse wave original signal information W and the second pulse wave original signal information M.
  • the multiplication function JO the second pulse wave original signal MM2 is multiplied by the multiplication coefficient c in (1) above.
  • the result of the multiplication in (2) above is subtracted from the first pulse wave original signal MM1.
  • the pulse wave signal generating unit MSS performs steps (1) to (3) to generate the pulse wave signal MY.
  • the coefficient information C described above indicates the amount, i.e., the magnitude, of the second pulse wave source signal information M to be subtracted.
  • the value of the multiplication coefficient c is adjusted so that the components necessary to estimate the pulse wave M of the subject HK remain in the pulse wave signal MY obtained by subtracting the result obtained by multiplying the second pulse wave original signal MM2 by the multiplication coefficient c from the first pulse wave original signal MM1.
  • the pulse wave signal generating unit MSS calculates the coefficient information C so as to reduce the difference between the first pulse wave source signal information W and the result obtained by multiplying the second pulse wave source signal information M by the coefficient information C. This allows the pulse wave signal generating unit MSS to adjust the amount of the second pulse wave source signal information M contained in the first pulse wave source signal information W using the coefficient information C.
  • the hardware configuration of the pulse wave estimation device MSD of embodiment 3 and the hardware configuration based on software realization are similar to the hardware configuration (shown in FIG. 9 ) and the hardware configuration based on software realization (shown in FIG. 10 ) of the pulse wave estimation device MSD of embodiment 1.
  • the operation of the pulse wave estimation device MSD of embodiment 3 is basically the same as the operation (shown in FIG. 11 ) of the pulse wave estimation device MSD of embodiment 1.
  • the pulse wave estimation device MSD of embodiment 3 differs from the pulse wave estimation device MSD of embodiment 1 in the operation of the pulse wave signal generation unit MSS. The following description will focus on the operation of the pulse wave signal generation unit MSS of embodiment 3.
  • FIG. 18 is a flowchart showing the operation of the pulse wave estimation device MSD of embodiment 3. The operation of the pulse wave estimation device MSD of embodiment 3 will be described with reference to the flowchart of FIG. 18.
  • Step ST17-1 The pulse wave signal generating unit MSS (shown in FIG. 17) receives the first pulse wave source signal MM1 and the second pulse wave source signal MM2 (shown in FIG. 17, FIG. 1, FIG. 4) from the preceding pulse wave source signal generating unit MMS (shown in FIG. 1).
  • the pulse wave signal generating unit MSS as a coefficient calculation function KE, calculates a multiplication coefficient c based on the first pulse wave source signal information W and the second pulse wave source signal information M.
  • Step ST17-2 The pulse wave signal generating unit MSS uses the multiplication function JO to multiply the second pulse wave original signal MM2 by the multiplication coefficient c calculated in step ST17-1 above.
  • Step ST17-3 The pulse wave signal generating unit MSS, as the subtraction function GE, subtracts the result of the multiplication in step ST17-2 above from the first pulse wave original signal MM1.
  • the pulse wave signal generating unit MSS calculates the pulse wave signal MY by the above subtraction.
  • the pulse wave signal generating unit MSS outputs the calculated pulse wave signal MY to the downstream pulse wave estimation unit MSU.
  • the pulse wave estimation unit MSU estimates the pulse wave M of the subject HK based on the pulse wave signal MY that is received from the pulse wave signal generation unit MSS and generated through steps ST17-1 to ST17-3 described above.
  • the pulse wave signal generator MSS calculates the pulse wave signal MY by subtracting the result obtained by multiplying the second pulse wave original signal MM2 by the multiplication coefficient c from the first pulse wave original signal MM1. This prevents signal components useful for estimating the pulse wave M of the subject HK, which are contained in the first pulse wave original signal MM1 and the second pulse wave original signal MM2, from being needlessly attenuated. As a result, the pulse wave estimation device MSD of embodiment 3 can improve the accuracy of estimating the pulse wave M of the subject HK compared to the pulse wave estimation device MSD of embodiment 1, which simply subtracts the second pulse wave original signal MM2 from the first pulse wave original signal MM1.
  • Embodiment 4 A pulse wave estimation device MSD according to a fourth embodiment will be described.
  • the pulse wave estimation device MSD of embodiment 4 differs from the pulse wave estimation device MSD of embodiment 1 (shown in FIG. 1) in that it uses weighting functions such as weighting function A and weighting function B (shown in FIG. 3, for example) to generate the fourth luminance signal KI4 from the first luminance signal KI1, and does not use the weighting functions.
  • weighting functions such as weighting function A and weighting function B (shown in FIG. 3, for example) to generate the fourth luminance signal KI4 from the first luminance signal KI1, and does not use the weighting functions.
  • the pulse wave estimation device MSD of embodiment 4 basically has the same functions as the pulse wave estimation device MSD of embodiment 1.
  • the pulse wave estimation device MSD of embodiment 4 differs from the pulse wave estimation device MSD of embodiment 1 in that the measurement region setting unit KRS, point identification unit TTO, and luminance signal generation unit KSS of embodiment 4 have different functions from the measurement region setting unit KRS, point identification unit TTO, and luminance signal generation unit KSS of embodiment 1.
  • FIG. 19 is a functional block diagram of the measurement area setting unit KRS, point identification unit TTO, and luminance signal generation unit KSS of embodiment 4.
  • FIG. 20 shows the measurement area R, the first point P1 to the fourth point P4, and the first luminance signal KI1 to the fourth luminance signal KI4 in the fourth embodiment.
  • the measurement area setting unit KRS has a function of setting a first measurement area (e.g., measurement area R34) and a function of setting a second measurement area (e.g., measurement area R56).
  • measurement area R34 and measurement area R56 have a common center of gravity O, which is the reference position on the coordinate system of measurement area R34, and a common center of gravity O, which is the reference position on the coordinate system of measurement area R56.
  • Measurement area R34 and measurement area R56 have a relationship in which measurement area R56 is wider than measurement area R34.
  • measurement area R56 may have a relationship in which measurement area R56 is narrower than measurement area R34.
  • Measurement area R34 and measurement area R56 share a corresponding relationship between a position on the coordinate system and a magnitude of weighting determined by the position on the coordinate system, and share, for example, one weight function (for example, weight function A or weight function B (shown in FIG. 7)).
  • the point identification unit TTO identifies a first point P1 and a second point P2 within the first measurement region, for example, within measurement region R34, along the direction HO in which the pulse wave M of the subject HK propagates, as shown in FIG. 20.
  • the point identification unit TTO also sets a third point P3 and a fourth point P4 within the second measurement region, for example, within measurement region R56, along the direction HO in which the pulse wave M of the subject HK propagates, as shown in FIG. 20.
  • the distance between the third point P3 and the fourth point P4 is longer than the distance between the first point P1 and the second point P2.
  • the distance between the third point P3 and the fourth point P4 is shorter than the distance between the first point P1 and the second point P2.
  • the luminance signal generating unit KSS outputs a first luminance signal KI1 indicating the luminance of a first measurement region, for example, a first point P1 in measurement region R34, and a second luminance signal KI2 indicating the luminance of a second point P2 in measurement region R34, as shown in FIG. 20.
  • the pulse wave signal generating unit MSS also outputs a third luminance signal KI3 indicating the luminance of a second measurement region, for example, a third point P3 in measurement region R56, and a fourth luminance signal KI4 indicating the luminance of a fourth point P4 in measurement region R56, as shown in FIG. 20.
  • the hardware configuration of the pulse wave estimation device MSD of embodiment 4 and the hardware configuration based on software realization are similar to the hardware configuration of the pulse wave estimation device MSD of embodiment 1 (shown in FIG. 9 ) and the hardware configuration based on software realization (shown in FIG. 10 ).
  • ⁇ Operation of the Fourth Embodiment> 21 is a flowchart showing the operation of the pulse wave estimation device MSD of embodiment 4. The operation of the pulse wave estimation device MSD of embodiment 4 will be described with reference to the flowchart of FIG.
  • step ST43 The pulse wave estimation device MSD of embodiment 4 performs steps ST11 and ST12 (shown in FIG. 11).
  • Step ST43 The measurement area setting unit KRS (shown in FIG. 19) sets a first measurement area, i.e., measurement area R34, in the skin area S, as shown in FIG. 20.
  • the measurement area setting unit KRS also sets a second measurement area, i.e., measurement area R56, in the skin area S, as shown in FIG. 20.
  • Step ST44 The point identification unit TTO (shown in FIG. 19) sets the above-mentioned first point P1 and second point P2 in the first measurement region, i.e., measurement region R34, as shown in FIG. 20.
  • the point identification unit TTO also sets the noted first point P1 and second point P2 in the second measurement region, i.e., measurement region R56, as shown in FIG. 20.
  • Step ST45 The luminance signal generating unit KSS (shown in FIG. 19) outputs a first luminance signal KI1 indicating the luminance of a first point P in the first measurement region, i.e., measurement region R34, and a second luminance signal KI2 indicating the luminance of a second point P in the measurement region R34, as shown in FIG. 20.
  • the luminance signal generating unit KSS also outputs a third luminance signal KI3 indicating the luminance of a third point P3 in the second measurement region, i.e., measurement region R56, and a fourth luminance signal KI4 indicating the luminance of a fourth point P4 in the measurement region R56, as shown in FIG. 20.
  • step ST45 The pulse wave estimation device MSD of embodiment 4 performs steps ST16 to ST18 (shown in FIG. 11).
  • the pulse wave estimation device MSD of embodiment 4 generates the first luminance signal KI1 to the fourth luminance signal KI4 in the same manner as the pulse wave estimation device MSD of embodiment 1, without using the weighting functions A and B of the pulse wave estimation device MSD of embodiment 1.
  • the pulse wave estimation device MSD of embodiment 4 can improve the accuracy of estimating the pulse wave M of the subject HK while using the image Im of the subject HK captured under near-infrared light in the same manner as the pulse wave estimation device MSD of embodiment 1.
  • FIG. 22 is a functional block diagram of a state estimation system JSS according to the fifth embodiment.
  • the state estimation system JSS of embodiment 5 includes a pulse wave estimation device MSD and a state estimation device JSD, as shown in FIG. 22.
  • the pulse wave estimation device MSD is one of the pulse wave estimation devices MSD of embodiment 1 to embodiment 4 described above.
  • the pulse wave estimation device MSD outputs a pulse wave M estimated for a person HT (e.g., a driver of a vehicle), more precisely, pulse wave information MJ of the person HT (e.g., the pulse rate of the person HT), in the same way that the pulse wave estimation devices MSD of embodiments 1 to 4 output a pulse wave M estimated for a subject HK (e.g., as shown in FIG. 1).
  • the state estimation device JSD estimates the state of the person HT based on the pulse wave information MJ of the person HT, and more specifically, estimates, for example, the degree of alertness KT of the driver of the vehicle.
  • the degree of alertness KT is expressed, for example, in two stages (1: sleepy state, 2: alert state).
  • the state estimation device JSD estimates which of the two stages of alertness the vehicle driver is in, for example, based on the pulse rate from the time the vehicle driver starts to 10 minutes after driving the vehicle. More specifically, when it is determined that the pulse rate of the vehicle driver is significantly lower than the above-mentioned standard, the state estimation device JSD estimates that the driver's level of alertness KT is "1: drowsy state.”
  • the state estimation device JSD may, for example, emit a warning sound along with the degree of wakefulness KT, which is the above-mentioned "1: sleepy state.”
  • the person HT may be, in addition to the driver of a vehicle, for example, a person in a home (e.g., a person sitting in a living room) or a person working in an office (e.g., a person traveling in an elevator).
  • a person in a home e.g., a person sitting in a living room
  • a person working in an office e.g., a person traveling in an elevator
  • condition estimating system JSS of the fifth embodiment includes one of the pulse wave estimation devices MSD of the first to fourth embodiments, and is thereby capable of estimating the condition of the person HT.
  • the pulse wave estimation device and the like according to the present disclosure can be used to improve the accuracy of estimating a subject's pulse wave, even when using images captured under near-infrared light.

Landscapes

  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)

Abstract

La présente invention concerne un dispositif d'estimation d'onde d'impulsion (MSD) comprenant : une unité d'acquisition d'image (GSY) qui acquiert une image (Im) d'une personne (HK) capturée sous une lumière proche infrarouge ; une unité de détection de zone de peau (HRK) qui détecte à partir de l'image (Im) une zone de peau (S), qui est l'emplacement de la peau de la personne (HK) ; une unité de réglage de zone de mesure (KRS) qui définit, dans la zone de peau (S), une pluralité de zones de mesure (R), qui sont des zones pour mesurer la luminance de la peau de la personne (HK) ; une unité d'identification de point (TTO) qui identifie un premier point (P1) et un second point (P2) qui sont dans l'une de la pluralité de zones de mesure (R) et le long d'une direction (HO) dans laquelle une onde d'impulsion (M) de la personne (HK) se propage dans l'image (Im) ; une unité de génération de signal de luminance (KSS) qui, parmi une première distribution (A) et une seconde distribution (B) ayant des relations de correspondance mutuellement différentes entre une position de coordonnées et la taille d'une pondération spécifiée par la position de coordonnées, superpose la luminance que le premier point (P1) a et la luminance que le second point (P2) a avec la première distribution (A) pour ainsi générer un premier signal de luminance (KI1) indiquant la luminance au niveau du premier point (P1) après avoir été pondérée par la première distribution (A) et un deuxième signal de luminance (KI2) indiquant la luminance au niveau du second point (P2) après avoir été pondérée par la première distribution (A), et superpose la luminance que le premier point (P1) a et la luminance que le second point (P2) a avec la seconde distribution (B) pour ainsi générer un troisième signal de luminance (KI3) indiquant la luminance au niveau du premier point (P1) après avoir été pondéré par la seconde distribution (B) et un quatrième signal de luminance (KI4) indiquant la luminance au niveau du second point (P2) après avoir été pondéré par la seconde distribution (B) ; une unité de génération de signal de source d'onde d'impulsion (MMS) qui génère un premier signal de source d'onde d'impulsion (MM1) en combinant le premier signal de luminance (KI1) avec le deuxième signal de luminance (KI2) et génère un deuxième signal de source d'onde d'impulsion (MM2) en combinant le troisième signal de luminance (KI3) avec le quatrième signal de luminance (KI4) ; une unité de génération de signal d'onde d'impulsion (MSS) qui génère un signal d'onde d'impulsion (MY) indiquant l'onde d'impulsion (M) de la personne (HK) en soustrayant l'un du premier signal de source d'onde d'impulsion (MM1) ou du second signal de source d'onde d'impulsion (MM2) de l'autre ; et une unité d'estimation d'onde d'impulsion (MSU) qui estime l'onde d'impulsion (M) de la personne (HK) sur la base du signal d'onde d'impulsion (MY).
PCT/JP2022/043835 2022-11-29 2022-11-29 Dispositif d'estimation d'onde d'impulsion, procédé d'estimation d'onde d'impulsion, système d'estimation d'état et procédé d'estimation d'état WO2024116255A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/043835 WO2024116255A1 (fr) 2022-11-29 2022-11-29 Dispositif d'estimation d'onde d'impulsion, procédé d'estimation d'onde d'impulsion, système d'estimation d'état et procédé d'estimation d'état

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/043835 WO2024116255A1 (fr) 2022-11-29 2022-11-29 Dispositif d'estimation d'onde d'impulsion, procédé d'estimation d'onde d'impulsion, système d'estimation d'état et procédé d'estimation d'état

Publications (1)

Publication Number Publication Date
WO2024116255A1 true WO2024116255A1 (fr) 2024-06-06

Family

ID=91323304

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/043835 WO2024116255A1 (fr) 2022-11-29 2022-11-29 Dispositif d'estimation d'onde d'impulsion, procédé d'estimation d'onde d'impulsion, système d'estimation d'état et procédé d'estimation d'état

Country Status (1)

Country Link
WO (1) WO2024116255A1 (fr)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016163019A1 (fr) * 2015-04-10 2016-10-13 株式会社日立製作所 Système d'analyse d'informations biologiques
JP2018153555A (ja) * 2017-03-21 2018-10-04 パナソニックＩｐマネジメント株式会社 脈波伝播速度測定システム、撮像装置および脈波伝播速度測定方法
JP2018197910A (ja) * 2017-05-23 2018-12-13 三菱電機株式会社 生体測定装置
WO2019102966A1 (fr) * 2017-11-22 2019-05-31 日本電気株式会社 Dispositif et procédé de détection d'onde d'impulsion, et support d'informations
WO2020054122A1 (fr) * 2018-09-10 2020-03-19 三菱電機株式会社 Dispositif de traitement d'informations, programme et procédé de traitement d'informations
US20200178809A1 (en) * 2017-08-08 2020-06-11 Koninklijke Philips N.V. Device, system and method for determining a physiological parameter of a subject
JP2021517843A (ja) * 2018-04-17 2021-07-29 日本電気株式会社 脈拍推定装置、脈拍推定方法、及びプログラム
CN113989880A (zh) * 2021-10-18 2022-01-28 浙江大学 基于人脸视频的人体心率测量方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016163019A1 (fr) * 2015-04-10 2016-10-13 株式会社日立製作所 Système d'analyse d'informations biologiques
JP2018153555A (ja) * 2017-03-21 2018-10-04 パナソニックＩｐマネジメント株式会社 脈波伝播速度測定システム、撮像装置および脈波伝播速度測定方法
JP2018197910A (ja) * 2017-05-23 2018-12-13 三菱電機株式会社 生体測定装置
US20200178809A1 (en) * 2017-08-08 2020-06-11 Koninklijke Philips N.V. Device, system and method for determining a physiological parameter of a subject
WO2019102966A1 (fr) * 2017-11-22 2019-05-31 日本電気株式会社 Dispositif et procédé de détection d'onde d'impulsion, et support d'informations
JP2021517843A (ja) * 2018-04-17 2021-07-29 日本電気株式会社 脈拍推定装置、脈拍推定方法、及びプログラム
WO2020054122A1 (fr) * 2018-09-10 2020-03-19 三菱電機株式会社 Dispositif de traitement d'informations, programme et procédé de traitement d'informations
CN113989880A (zh) * 2021-10-18 2022-01-28 浙江大学 基于人脸视频的人体心率测量方法

Similar Documents

Publication Publication Date Title
US20150294463A1 (en) Image processing device, endoscope apparatus, image processing method, and information storage device
US9301710B2 (en) Processing a video for respiration rate estimation
JP6432770B2 (ja) 画像処理装置、画像処理方法、並びにプログラム
JP5915757B2 (ja) 脈波検出方法、脈波検出装置及び脈波検出プログラム
Moço et al. Pulse oximetry based on photoplethysmography imaging with red and green light: Calibratability and challenges
WO2013051593A1 (fr) Dispositif de traitement d'image, dispositif endoscopique, procédé de traitement d'image et programme de traitement d'image
JP5603676B2 (ja) 画像処理装置及びプログラム
JP2016093210A5 (fr)
CN116269262A (zh) 生物体信息检测装置、生物体信息检测方法及存储介质
US9826884B2 (en) Image processing device for correcting captured image based on extracted irregularity information and enhancement level, information storage device, and image processing method
JP5462084B2 (ja) 画像処理装置及びプログラム
CN105748029A (zh) 一种内窥镜成像系统
US20180078123A1 (en) Image processing device, endoscope device, and image processing method
CN108042126B (zh) 一种改进的激光散斑衬比血流成像方法
WO2024116255A1 (fr) Dispositif d'estimation d'onde d'impulsion, procédé d'estimation d'onde d'impulsion, système d'estimation d'état et procédé d'estimation d'état
JP2019097757A5 (fr)
Laurie et al. Dedicated exposure control for remote photoplethysmography
WO2018235178A1 (fr) Dispositif de traitement d'image, dispositif d'endoscope, procédé de fonctionnement d'un dispositif de traitement d'image et programme de traitement d'image
JPH02268722A (ja) 電子内視鏡装置
US11341666B2 (en) Image processing device, endoscope system, operation method of image processing device, and computer-readable recording medium
JP6184928B2 (ja) 内視鏡システム、プロセッサ装置
JP6653386B2 (ja) 画像処理装置、内視鏡システム、プログラム及び画像処理装置の作動方法
JP5144922B2 (ja) 色素細胞の重層と浸潤とを鑑別するための皮膚画像の作成方法
JP6949134B2 (ja) 電子内視鏡用プロセッサ及び電子内視鏡システム
JP2768936B2 (ja) 電子内視鏡装置