JP6968285B2 - Measuring instruments, measuring methods, programs and one or more computer-readable storage media - Google Patents

Description

The present invention relates to measuring devices, measuring methods, programs and one or more computer-readable storage media.

In areas such as treatment and health care, various types of prior art have been proposed for non-contact measurement of vital data such as HR (heart rate) and RR (respiratory rate). However, when the body under test moves, less accurate vital data is measured.

In one embodiment, a first measuring unit configured to perform non-contact measurement of body vital data and a second measuring unit configured to measure body movement with respect to the first measuring unit. And the detection unit configured to detect whether the movement measured by the second measurement unit is less than the first reference value, and the movement measured by the second measurement unit is the first. A measuring device is provided with a selection unit configured to set the vital data measured by the first measuring unit to be valid data, provided that it is less than a reference value. In this way, only highly accurate vital data can be collected.

The first measuring unit may be configured to measure vital data using radar measurement. The second measuring unit may be configured to measure motion based on the results obtained by capturing an image of the body. The second measuring unit may be configured to measure motion based on the result obtained by capturing an image containing information in the depth direction. The second measurement unit may be configured to perform non-contact measurements of body vital data, and the selection unit may be configured by the second measurement unit, provided that the movement is greater than or equal to the first reference value. The measured vital data may be configured to be valid data.

In another embodiment, a first measurement using a first measuring unit that performs non-contact measurement of body vital data and a second measuring unit that measures body movement with respect to the first measuring unit. The second measurement using, the detection to detect whether the movement measured by the second measurement unit is less than the first reference value, and the movement measured by the second measurement unit are the first. A computer implementation method is provided that comprises the option of setting the vital data measured by the first measuring unit to be valid data, provided that it is less than the reference value of. In this way, only highly accurate vital data can be collected.

In another embodiment, a program is provided that causes a computer to function as the measuring device of the above embodiment.

In yet another embodiment, the computer is one or more computer-readable storage media that collectively store program instructions that can be executed by a computer, wherein the program instructions function as the measuring device of the above embodiment. One or more computer-readable storage media are provided to allow the user to do so.

The sections in this overview do not necessarily describe all the essential features of the embodiments of the present invention. The present invention may also be a subcombination of the above-mentioned features. The following description of the embodiments, together with the accompanying drawings, further clarifies the above features and other features and effects of the present invention.

The measuring device which concerns on this embodiment is shown. The first measurement unit 10 according to this embodiment is shown. The second measuring part 20 which concerns on this embodiment is shown. The operation of the measuring device is shown. A typical hardware configuration of a computer according to an embodiment of the present invention is shown.

Hereinafter, some embodiments of the present invention will be described. The embodiments do not limit the claimed invention, and all combinations of features described in the embodiments are not necessarily essential to the means provided by aspects of the invention.

(1. Configuration of measuring device)
FIG. 1 shows a measuring device 1 according to the present embodiment.
The measuring device 1 is a device that measures the vital data of the body 9 to be inspected, and is a first measuring unit 10, a second measuring unit 20, a detecting unit 30, a selection unit 40, a driving unit 50, a display 60, and a storage unit. Including part 70. At least one of the drive unit 50, the display 60 and the storage unit 70 need not be included in the measuring device 1. Each part of the measuring device 1 may be integrally formed, or may be a stationary device, for example. The subject to be examined may be a human or an animal.

(1-1 1st measuring part and 2nd measuring part)
The first measuring unit 10 performs non-contact measurement of vital data of the body 9. For example, the first measuring unit 10 may measure the vital data of the body 9 from a distance of 0.2 m to 3.0 m (for example, 1 m to 1.5 m). The first measuring unit 10 may measure vital data indicating at least one of the heart rate and the respiratory rate of the body 9. The first measuring unit 10 may be operable to adjust at least one of the orientation of the first measuring unit 10 with respect to the body 9 and the distance of the first measuring unit 10 from the body 9. As an example, the first measuring unit 10 may be provided on the movable arm. The first measuring unit 10 may provide the measured vital data to the selection unit 40.

The second measuring unit 20 measures the movement of the body 9 with respect to the first measuring unit 10. It can be said that the movement of the body 9 with respect to the first measuring unit 10 represents a change in the relative position and / or orientation of the first measuring unit 10 and the body 9. For example, the movement of the body 9 with respect to the first measuring unit 10 may be due to a change in the position and / or orientation of the body 9 and / or the first measuring unit 10. The second measuring unit 20 may measure the relative movement without touching the body 9, and may perform this measurement at a distance of 1 m to 1.5 m from the body 9, for example. The second measuring unit 20 may supply the measured motion data to the detecting unit 30.

Here, the method in which the first measuring unit 10 measures vital data and the method in which the second measuring unit 20 measures motion may be different from each other. For example, the first measuring unit 10 may perform the measurement using a more accurate measuring method when the body 9 is in a calm state than when the body 9 is moving. The second measuring unit 20 may perform the measurement using a measuring method in which the accuracy is almost the same even when the body 9 is moving. As described in more detail below, as an example, the first measuring unit 10 may perform measurements using radar, and the second measuring unit 20 may perform measurements using images of body 9. You may.

The second measuring unit 20 may perform non-contact measurement of the vital data of the body 9. The second measuring unit 20 may use the same sensor to measure the vital data of the body 9 and the movement of the body 9 with respect to the first measuring unit 10. The vital data measured by the second measuring unit 20 may be the same as or different from the vital data measured by the first measuring unit 10. The accuracy of the measured value of the vital data by the second measuring unit 20 may be lower than the accuracy of the first measuring unit 10 when the movement of the body 9 is less than the first reference value. When the movement of the body 9 is equal to or higher than the first reference value, the accuracy may be higher than the accuracy of the first measuring unit 10. The second measuring unit 20 may supply the measured vital data to the selection unit 40.

(1-3 detector)
The detection unit 30 detects whether or not the movement measured by the second measurement unit 20 is less than the first reference value. For example, the detection unit 30 may detect whether or not the index value of the measured motion is less than the first reference value. The exponential value may be, for example, a change in the relative position and / or orientation between the first measuring unit 10 and the body 9, a change in velocity, or a change in acceleration. The first reference value may be the lower limit of the movement when the measurement accuracy of the first measuring unit 10 is out of the allowable accuracy range, or is a value obtained by adding a margin to this lower limit. May be.

The detection unit 30 may detect whether or not the movement has returned to be less than the second reference value after being equal to or more than the first reference value. The second reference value may be less than the first reference value. For example, the second reference value may be the upper limit of the movement when the measurement accuracy of the first measuring unit 10 is within the allowable accuracy range, or is obtained by subtracting the margin from this upper limit. It may be a value to be calculated. The detection unit 30 may supply a detection signal indicating a detection result to the selection unit 40.

(1-4 selection part)
The selection unit 40 was acquired by the first measurement unit 10 on the condition that the movement measured by the second measurement unit 20 based on the detection signal from the detection unit 30 is less than the first reference value. Set vital data to be valid data. Here, setting the vital data to be valid data when the movement is less than the first reference value is by invalidating the vital data when the movement is greater than or equal to the first reference value. , It can be said that it indicates that the remaining vital data is set to be valid data. For example, the selection unit 40 may indicate invalid data and label the vital data that the movement is equal to or greater than the first reference value. Further, the selection unit 40 may cause the first measurement unit 10 to output an invalid value when the movement is equal to or higher than the first reference value. Furthermore, the selection unit 40 may invalidate the first measurement unit 10 to stop the supply of vital data when the movement is equal to or higher than the first reference value, and the vital data from the first measurement unit 10 may be stopped. You may stop receiving. The selection unit 40 turns the vital data measured by the first measurement unit 10 into vital data as the movement returns to be less than the second reference value after becoming equal to or more than the first reference value. It may be set as follows.

When the second measuring unit 20 measures the vital data, the selection unit 40 converts the vital data measured by the second measuring unit 20 into valid data, provided that the movement is equal to or higher than the first reference value. It may be set to be. For example, the selection unit 40 uses the same method as that used to set the vital data from the first measurement unit 10 to be valid data, and the vital data from the second measurement unit 20. May be set to be valid data. Further, the selection unit 40 has a label indicating which of the vital data measured by the first measurement unit 10 and the vital data measured by the second measurement unit 20 is valid data. May be attached to.

The selection unit 40 may supply vital data set as valid data to the display 60. The selection unit 40 may supply vital data to the storage unit 70.

(1-5 drive unit)
The drive unit 50 sets the sensor portion of the first measurement unit 10 in a predetermined position and orientation in response to a change in at least one of the position and orientation of the body 9 included in the movement measured by the second measurement unit 20. Moves to enable measurement of body 9 vital data. As an example, the drive unit 50 may drive a movable arm provided with the first measurement unit 10. It should be noted that if the first measurement unit 10 can be moved, another method may be used for the drive unit 50 to move the sensor portion of the first measurement unit 10.

(1-6 display)
The display 60 displays vital data set to be enabled. For example, the display 60 displays the vital data from the first measuring unit 10 while the vital data from the first measuring unit 10 is valid, and the vital data from the second measuring unit 20 is valid. In the meantime, the vital data from the second measuring unit 20 is displayed. The display 60 may display the measured vital data in real time, or the measured vital data may be displayed in a graph or chart in chronological order. When a plurality of types of vital data are measured, the display 60 may display each type of vital data. The display 60 may display vital data together with identification information of the subject to be examined, for example, an image of the body 9. The display 60 may be a touch panel or may display a user interface that can be operated by touch.

(1-7 Memory)
The storage unit 70 stores vital data measured by the first measurement unit 10. When the second measuring unit 20 measures the vital data, the storage unit 70 may store the vital data measured by the second measuring unit 20 in addition to the vital data measured by the first measuring unit 10. good. The storage unit 70 may store vital data in association with a label of valid data and / or invalid data attached by the selection unit 40, or only the vital data set as valid data by the selection unit 40. May be memorized. The storage unit 70 may store vital data for each test subject.

Using the above-mentioned measuring device, the vital data from the first measuring unit 10 can be valid data under the condition that the movement measured by the second measuring unit 20 is less than the first reference value. Set. Therefore, only highly accurate vital data measured when the movement of body 9 is less than the first reference value can be collected.

Since the vital data and movement of the body 9 are measured by the first measuring unit 10 and the second measuring unit 20 using different measuring methods, each of the vital data and the movement of the body 9 should be measured with high accuracy. Can be done.

Furthermore, since both the measurement of body movement 9 and the measurement of vital data are performed by the second measuring unit 20, the measuring device 1 is compared with the case where these measurements are performed by separate measuring units. It can be simplified. Furthermore, since the vital data measured by the second measuring unit 20 is set to be valid data under the condition that the movement is equal to or higher than the first reference value, the movement of the body 9 is set to be the first reference value. Even if it is above the value, highly accurate vital data can be collected. Therefore, highly accurate vital data can be reliably collected.

A label indicating which of the vital data measured by the first measuring unit 10 and the vital data measured by the second measuring unit 20 is set as valid data is attached to the valid data. .. Therefore, the vital data can be used for analysis and the like while checking whether the component that measured the vital data is the first measurement unit 10 or the second measurement unit 20.

After the movement is above the first reference value, the vital data from the first measurement unit 10 is valid as the movement becomes less than the second reference value, which is less than the first reference value. Set to be data. Therefore, compared to the case where the second reference value is equal to or higher than the first reference value, it is recommended that the components for measuring vital data be frequently switched between the first measurement unit 10 and the second measurement unit 20. Can be avoided.

Since the sensor part of the first measuring unit 10 is moved according to the movement and / or the change of the orientation of the body 9 measured by the second measuring unit 20, vital data is constantly obtained by using the first measuring unit 10. Can be measured. Therefore, highly accurate vital data can be collected more reliably.

(2. Detailed example of the first measuring unit)
FIG. 2 shows the first measuring unit 10 according to the present embodiment. As an example, the first measuring unit 10 measures vital data using radar measurement. For example, the first measuring unit 10 detects periodic movements of the chest, skin surface, etc. of the body 9 using radar measurement, and extracts HR and / or RR using a plurality of signal processing algorithms. May be good. The first measurement unit 10 may include a radar unit 101, an amplifier / filter 102, an ADC (analog digital converter) 103, a DSP (digital signal processor) 104, and a vital data extraction unit 105.

The radar unit 101 radiates a radio wave and measures the reflected wave generated from this radio wave. As an example, the radar unit 101 may perform measurements using an FMCW (Frequency Modulated Continuous Wave) radar, i.e., a continuous frequency modulated radio wave. The radar unit 101 may use an IQ signal radio wave including an I phase (in-phase) component and a Q phase (orthogonal phase) component that are phase-shifted by 90 ° from each other. The radar unit 101 may supply a measurement signal indicating the waveform of the reflected wave, for example, an IQ signal, to the amplifier / filter 102.

The amplifier / filter 102 may perform amplification and / or filtering of the measurement signal from the radar unit 101. For example, the amplifier / filter 102 may remove the noise component of the IQ signal, for example, the aliasing noise corresponding to the sampling frequency of the radar unit 101 may be removed, or the noise caused by diffused reflection of radio waves may be removed. good. The amplifier / filter 102 may supply an amplified and / or filtered IQ signal to the ADC 103.

The ADC 103 converts the IQ signal from an analog signal to a digital signal. The ADC 103 supplies the signal processed IQ signal to the DSP 104.

The DSP 104 performs various signal processing on the digitized IQ signal. For example, DSP 104 may remove the DC component of the IQ signal. The DSP 104 supplies the signal-processed IQ signal to the vital data extraction unit 105.

The vital data extraction unit 105 extracts the vital data of the body 9 from the supplied signal when the reflected wave from the body 9 is measured by the radar unit 101. For example, the vital data extraction unit 105 may extract the HR and / or RR of the body 9. As an example, the vital data extraction unit 105 calculates the phase angle of the IQ signal, calculates the beat frequency from the phase angles of the transmission signal and the reception signal, inputs the beat frequency to the FFT, and the distance from the radar unit 101 to the reflection surface. , Doppler shift frequency and signal strength may be generated to show the relationship. After that, the vital data extraction unit 105 may extract vital data by detecting the reciprocating motion of the body 9 on the chest, the skin surface, or the like from the spectrum. The vital data extraction unit 105 may supply vital data to the selection unit 40. Here, the Doppler shift frequency may be the amount of frequency shift caused by the reflecting surface that is moving with respect to the radar unit 101 and reflects radio waves. The vital data extraction unit 105 may use STFT (short-time Fourier transform) or DWT (discrete wavelet transform) to generate a spectrum. Calculation of the phase angle of the IQ signal may be performed by DSP104.

By using the first measuring unit 10 described above, the vital data can be measured by using the radar measurement, and therefore, the vital data with high accuracy can be measured when the body 9 shows almost no movement.

The first measuring unit 10 may have a different configuration. For example, if the vital data can be measured using radar measurement, one or more of the amplifier / filter 102, ADC 103, and DSP 104 may be omitted for the first measurement unit 10.

(3. Detailed example of the second measuring unit)
FIG. 3 shows a second measuring unit 20 according to the present embodiment. The second measuring unit 20 measures the movement based on the result obtained by, for example, capturing an image of the body 9. Further, the second measuring unit 20 may perform a non-contact measurement of the vital data of the body 9, for example, may measure HR and / or RR. The second measurement unit 20 may include an image sensor 201, a depth sensor 202, an ROI (Region Of Interest) extraction unit 203, a motion detection unit 204, and a vital data extraction unit 205.

The image sensor 201 may acquire a video image of the body, for example, an image at a frame rate of 15-60 fps. The image sensor 201 may acquire an image including at least the head or upper body. The image sensor 201 may acquire an RGB color image. The image sensor 201 may supply the acquired image data to the ROI extraction unit 203.

The depth sensor 202 may acquire information in the depth direction of the visual field. The depth sensor 202 may acquire depth data at the same angle of view as the image sensor 201, and may acquire a depth image including the depth of each pixel of the image sensor 201, for example. The depth sensor 202 may acquire depth data at the same frame rate as the image sensor 201. The depth sensor 202 may detect the depth using a multi-lens camera, or may calculate the depth by emitting a pulsed laser beam and receiving the reflected light generated thereby. It should be noted that the technique for detecting depth is not limited to the above.

The depth sensor 202 may supply depth data to the ROI extraction unit 203. As an example of the present embodiment, the image sensor 201 may be integrally provided with the depth sensor 202 to form an RGB-D sensor that captures an RGB-D image including information in the depth direction, and the depth sensor 202 is the same. The RGB-D image may be supplied to the ROI extraction unit 203. The depth direction may be the optical axis direction of the optical system including the image sensor.

The ROI extraction unit 203 extracts the ROI corresponding to at least a part of the body 9 in the image from the RGB-D image data. The ROI may be the entire body 9 contained within the contour, or it may be a part of the body 9. The parts of the body 9 that are ROIs are the part where vital data is measured by the first measuring unit 10 (for example, chest and skin surface) and the part where vital data is measured by the second measuring unit 20 (for example, head). And the upper body) may be at least one. The ROI extraction unit 203 may extract the ROI only from the image data from the image sensor 201, or may extract the ROI only from the depth image data from the depth sensor 202. The ROI extraction unit 203 may extract the ROI using a segmentation algorithm and pattern matching.

The ROI extraction unit 203 may supply data related to ROI in the RGB-D image data to the motion detection unit 204 and the vital data extraction unit 205. As an example, the ROI extraction unit 203 supplies the RGB-D image data of the part of the body 9 where the part whose vital data is measured by the first measurement unit 10 is the ROI to the motion detection unit 204. You may. Further, the ROI extraction unit 203 supplies the RGB-D image data of the part of the body 9 whose vital data is measured by the second measurement unit 20 to the ROI to the vital data extraction unit 205. You may. The ROI extraction unit 203 may supply the supplied RGB-D image data together with the label attached to the ROI portion, or extracts only the ROI portion from the supplied RGB-D image data and extracts this portion. May be supplied.

The motion detection unit 204 detects the motion of the body 9 based on the motion of the ROI in the image. For example, the motion detection unit 204 may detect the motion of the ROI as the motion of the body 9.

The motion detection unit 204 may measure the motion of the body 9 based on the RGB-D image including the information in the depth direction. For example, the motion detection unit 204 may detect the motion of the body 9 based on the ROI operation in the parallel direction of the object plane of the RGB-D image and / or the depth direction of the RGB-D image. The motion detection unit 204 detects the motion of the ROI by performing template collation for each frame image using the template including the shape of the ROI and detecting at least one change in the position, angle, and dimension of the ROI. May be good. When the depth sensor 202 is provided separately from the image sensor 201, the motion detection unit 204 acquires the RGB image of the ROI from the ROI extraction unit 203, acquires the depth image from the depth sensor 202, and obtains these images for motion detection. May be used. The object plane may be, for example, a plane orthogonal to the depth direction. The motion detection unit 204 may supply the measured motion data to the detection unit 30.

The vital data extraction unit 205 extracts the vital data of the body 9 from the video image supplied to the vital data extraction unit 205. For example, the vital data extraction unit 205 measures HR by detecting periodic changes in facial color from an RGB video image of the facial area using the iPPG (image photoplethysmogram) method. May be good. Further, the vital data extraction unit 205 may measure the RR by detecting the direction of the edges of the shoulder portion and the facial portion in the RGB video image and the magnitude of the gradient. Further, the vital data extraction unit 205 may extract the periodic fluctuation of the body 9 in the depth direction from the depth video image and measure the HR and / or RR of the body 9 based on the periodic fluctuation. For example, the vital data extraction unit 205 may measure the RR by detecting the reciprocating motion of the chest from the depth video image. The vital data extraction unit 205 may extract vital data from the video image of the ROI portion supplied from the ROI extraction unit 203 in the video image. In this way, the load of extracting vital data is reduced. The vital data extraction unit 205 may supply vital data to the selection unit 40.

By using the second measuring unit 20 described above, the movement is measured based on the image of the body 9, and therefore the movement of the body 9 in the object plane can be measured with high accuracy. Furthermore, since the second measuring unit 20 measures the movement based on the image including the information about the depth direction, the movement of the body 9 in the depth direction is measured with high accuracy in addition to the movement of the body 9 in the object plane. can do.

The ROI extraction unit 203 and the motion detection unit 204 extract the ROI corresponding to at least a part of the body 9 in the image, and detect the motion based on the motion of the ROI in the image. Therefore, by setting the vital data measurement accuracy of the first measuring unit 10 to be the ROI of the part of the body 9 whose measurement accuracy is affected by the occurrence of motion, the vital data with low accuracy is obtained by the first measuring unit 10. You can avoid collecting.

The second measuring unit 20 may have a different configuration. For example, if the movement of the body 9 can be measured, at least one of the image sensor 201 or the depth sensor 202, the ROI extraction unit 203, and the vital data extraction unit 205 is omitted for the second measurement unit 20. You may. Further, if the movement of the body 9 can be measured and the vital data can be measured, at least one of the image sensor 201 or the depth sensor 202 and the ROI extraction unit 203 is omitted for the second measuring unit 20. You may.

(4. Operation of measuring device)
FIG. 4 shows the operation of the measuring device 1. The measuring device 1 measures the vital data of the body 9 with high accuracy by executing the process from step S1 to step S5.

First, in step S1, the first measuring unit 10 measures vital data, and the second measuring unit 20 measures the movement of the body 9. The second measuring unit 20 may further measure vital data.

For example, the motion detection unit 204 of the second measurement unit 20 can remove the body 9 from the video image of the ROI portion (for example, the part that is the target of vital data measurement by the first measurement unit 10) in the RGB-D video image. You may detect the movement of. Further, the vital data extraction unit 205 of the second measurement unit 20 receives vital data from the video image of the ROI portion (for example, the portion that is the target of the vital data measurement by the second measurement unit 20) in the RGB-D video image. Data may be measured.

Further, the vital data extraction unit 105 of the first measurement unit 10 may generate a spectrum showing the relationship between the distance from the radar unit 101, the Doppler shift frequency, and the signal intensity to measure the vital data. The first measuring unit 10 may measure vital data based on a portion of the spectrum within a distance range including the distance of the body 9 measured by the depth sensor 202 of the second measuring unit 20. For example, the first measuring unit 10 may extract vital data from the spectrum in the distance range including the body 9. The distance of the body 9 may be the portion of the depth of each pixel of the depth image surrounded by the contour of the ROI or the average value of the depth of the body 9. One of the measurements by the first measuring unit 10 and the measurement by the second measuring unit 20 may be performed before the other.

Here, when the movement of the body 9 with respect to the first measuring unit 10 is detected by the second measuring unit 20, the driving unit 50 measures the sensor portion of the first measuring unit 10 and the vital data of the body 9. It may be moved in a position and orientation that allows it. For example, if the body 9 is moving with respect to the first measuring unit 10, the driving unit 50 will use the first measuring unit according to the movement of the body 9 so that this movement is less than the first reference value. The position and / or orientation of the 10 sensor portions may be changed. Further, when the orientation of the body 9 with respect to the first measuring unit 10 has changed, the driving unit 50 of the first measuring unit 10 maintains the orientation of the body 9 with respect to the first measuring unit 10. The position and orientation of the sensor portion may be changed.

Next, in step S3, the detection unit 30 detects whether or not the movement measured by the second measurement unit 20 is less than the first reference value. When it is detected that the motion is equal to or more than the first reference value, the detection unit 30 may further detect whether or not the motion has returned to be less than the second reference value.

Next, in step S5, the selection unit 40 sets the vital data from the first measurement unit 10 so as to be valid data, provided that the movement is less than the first reference value. The selection unit 40 may set the vital data from the second measurement unit 20 as valid data on condition that the movement is equal to or higher than the first reference value. If the motion is detected to be greater than or equal to the first reference value, the selection unit 40 will only have vitals from the second measurement unit 20 if the motion has not returned to less than the second reference value. The data may be set to be valid data, and the vital data from the first measuring unit 10 becomes valid data on condition that the movement is returned to be less than the second reference value. It may be set as follows. The selection unit 40 may display valid vital data on the display 60, and may further store the valid vital data in the storage unit 70.

Using the above operation, vital data is extracted based on a portion of the spectrum acquired by radar measurement within a distance range including the distance of the body 9 measured by the second measuring unit 20. Therefore, it is possible to extract vital data from the spectrum while excluding information within a distance range in which the body 9 does not exist, for example, noise information caused by diffuse reflection.

(5. Modification example)
In the present embodiment described above, the measuring device 1 is described as a stationary device, but may be mobile instead. For example, the measuring device 1 may move with respect to the body 9 in response to an external force by the operator, or may self-propell with a built-in mobile power source (not shown in the drawing). In this case, the moving power source may be the drive unit 50, and the first measuring unit 10 may move with respect to the body 9 as a result of the measuring device 1 self-propelling. It should be noted that if the vital data measurement accuracy is reduced while the measuring device 1 is in motion, a label indicating invalid data may be attached to the vital data acquired during the movement by the selection unit 40. be.

In the above description, the drive unit 50 moves the sensor portion of the first measuring unit 10 with respect to the body 9, but instead of or in addition to this, the body 9 moves with respect to the first measuring unit 10. It may be moved. For example, the driving unit 50 may move the body 9 with respect to the first measuring unit 10 by driving a support member (for example, a stool or a chair) that supports the body 9 to be inspected.

In the above description, HR and / or RR are measured as vital data, but HRV (heart rate variability) may be measured instead of or in addition to this.

In the above description, the second measuring unit 20 includes an image sensor 201 and a depth sensor 202 as means for measuring motion and / or vital data, but instead of or in addition to this, a thermograph. ) May be included. In this case, the second measuring unit 20 may detect the movement of the body 9 from the change of at least one of the position, angle and dimension of the contour of the body 9 shown in the thermal image. Further, the second measuring unit 20 may measure the body temperature as vital data. Furthermore, the second measuring unit 20 is RR based on the periodic changes in body temperature of the mouth and nose in the thermal image, and the direction and gradient of the edges of the shoulder and face in the thermal image. May be measured. Furthermore, the second measuring unit 20 may measure the HR from the periodic change of the thermal image due to the blood flow.

FIG. 10 shows a typical hardware configuration of a computer configured to perform the above-mentioned operations according to an embodiment of the present invention. A program installed on a computer 700 may function as one or more parts (including modules, components, elements, etc.) of a device or device of an embodiment of the invention or be associated with one or more parts of a device or device. The computer 700 can be made to perform the operation to be performed, and / or the computer 700 can be made to perform the process or the step of the process according to the embodiment of the present invention. Such a program may be executed by CPU 700-12 to cause the computer 700 to perform some operations related to some or all of the blocks in the flowcharts and block diagrams described herein. ..

The computer 700 according to this embodiment includes a CPU 700-12, a RAM 700-14, a graphics controller 700-16 and a display device 700-18, which are interconnected by a host controller 700-10. Computer 700 also includes input / output units such as communication interface 700-22, hard disk drive 700-24, DVD-ROM drive 700-26 and IC card drive, which are host controllers via input / output controller 700-20. Connected to 700-10. The computer also includes legacy input / output units such as the ROM 700-30 and keyboard 700-42, which are connected to the input / output controller 700-20 via the input / output chip 700-40.

CPU700-12 operates according to the program stored in ROM700-30 and RAM700-14, thereby controlling each unit. The graphics controller 700-16 acquires image data generated by the CPU 700-12 in a frame buffer provided in the RAM 700-14, or generated by the CPU 700-12 in the CPU 700-12 itself, and the image data is stored. Display on display device 700-18.

Communication interface 700-22 communicates with other electronic devices via network 700-50. Hard disk drive 700-24 stores programs and data used by CPU 700-12 in computer 700. The DVD-ROM drive 700-26 reads the program or data from the DVD-ROM 700-01 and provides the program or data to the hard disk drive 700-24 via the RAM 700-14. The IC card drive reads programs and data from the IC card and / or writes programs and data to the IC card.

The ROM 700-30 stores programs such as boot programs executed by the computer 700 at boot time and / or depending on the hardware of the computer 700. Further, the input / output chip 700-40 may connect various input / output units to the input / output controller 700-20 via a parallel port, a serial port, a keyboard port, a mouse port, and the like.

The program is provided by a computer-readable medium such as a DVD-ROM700-01 or an IC card. The program is read from a computer-readable medium, installed on a hard disk drive 700-24, RAM700-14 or ROM700-30 (also an example of a computer-readable medium) and executed by CPU700-12. By reading the information processing described in these programs into the computer 700, cooperation between the programs and the various types of hardware resources described above is realized. The device or method may be configured by realizing the operation or processing of information relating to the use of the computer 700-.

For example, when communication is performed between the computer 700 and an external device, the CPU 700-12 executes the communication program loaded in the RAM 700-14, and the communication interface 700- based on the processing described in the communication program. 22 may be instructed to perform communication processing. Under the control of CPU700-12, the communication interface 700-22 is stored in the transmission buffering area provided in the recording medium such as RAM700-14, hard disk drive 700-24, DVD-ROM700-01, or IC card. It reads the transmitted data and sends the read transmitted data to the network 700-50, and writes the received data received from the network 700-50 to the reception buffering area provided in the recording medium.

Furthermore, using CPU700-12, all or necessary files and databases stored in an external recording medium such as hard disk drive 700-24, DVD-ROM drive 700-26 (DVD-ROM700-01), IC card, etc. Parts may be read into RAM700-14 and various types of processing may be performed on the data on RAM700-14. After that, the CPU 700-12 may return the processed data to an external recording medium and write it.

Various information such as various programs, data, tables and databases may be stored in a recording medium so as to receive information processing. CPU700-12 has various types of operations, information processing, conditional judgment, conditional branching, unconditional branching, information retrieval / replacement, etc. for the data read from RAM700-14. The process may be performed as described throughout the present disclosure and specified by the program's directed sequence and the results may be written back to RAM 700-14. Furthermore, the CPU 700-12 may search for information in files, databases, etc. in the recording medium. For example, if a plurality of entries each having an attribute value of the first attribute related to the attribute value of the second attribute are stored in the recording medium, the CPU 700-12 is the first of the entries that meet the conditions. You may specify the attribute value of the attribute of 1 and search for the entry that meets the condition from multiple entries, and CPU700-12 reads the attribute value of the second attribute stored in the entry. Gets the attribute value of the second attribute that is related to the first attribute and meets the default conditions.

The programs and software modules described above may be stored on a computer-readable medium on the computer 700 or on a computer-readable medium near the computer 700. Further, by using a recording medium such as a hard disk or RAM provided in a dedicated communication network or a server system connected to the Internet as a computer-readable medium, the program can be provided to the computer 700 via the network.

Although embodiments of the present invention have been described, the technical scope of the invention is not limited to the embodiments described above. It will be apparent to those skilled in the art that various changes and improvements can be made to the above embodiments. It is also clear from the claims that embodiments with such modifications or improvements can be included in the technical scope of the invention.

The actions, procedures, steps and steps of each process performed by the device, system, program and method shown in the claims, embodiments and figures are ordered "prior to" and "before". ) ”, Etc., and can be executed in any order unless the output from the previous process is used by a later process. Processes run in this order, even if the process flow is described using terms such as "first" or "next" in claims, embodiments or figures. The process flow does not necessarily mean that it must be done.

It is possible to use embodiments of the invention to implement measuring devices, computer implementation methods, programs and one or more computer-readable storage media for collecting only highly accurate vital data. It becomes clear from.

1 Measuring device
9 bodies
10 First measuring unit
20 Second measuring unit
30 Detector
40 Selection
50 Drive unit
60 display
70 Memory
101 Radar section
102 Amp / Filter
103 ADC
104 DSP
105 Vital data extractor
201 Image sensor
202 Depth sensor
203 ROI Extractor
204 Motion detector
205 Vital data extraction unit
700 computers
700-01 DVD-ROM
700-10 host controller
700-12 CPU
700-14 RAM
700-16 graphics controller
700-18 Display device
700-20 input / output controller
700-22 communication interface
700-24 hard disk drive
700-26 DVD-ROM drive
700-30 ROM
700-40 Input / Output Chip
700-42 keyboard
700-50 network

Claims (16)

A first measuring unit configured to perform non-contact measurements of body vital data,
A second measuring unit configured to measure the movement of the body with respect to the first measuring unit, and a second measuring unit.
A detection unit configured to detect whether or not the movement measured by the second measurement unit is less than the first reference value, and a detection unit.
Set the vital data measured by the first measuring unit to be valid data, provided that the movement measured by the second measuring unit is less than the first reference value. Equipped with a selection section that consists of
The second measuring unit is configured to perform non-contact measurement of the vital data of the body.
The selection unit is configured to set the vital data measured by the second measurement unit to be valid data, provided that the movement is equal to or greater than the first reference value.
measuring device. The first measuring unit is configured to measure the vital data using radar measurement.
The measuring device according to claim 1. The first measuring unit is configured to measure the vital data indicating at least one of the heart rate and the respiratory rate of the body.
The measuring device according to claim 1 or 2. The second measuring unit is configured to measure the movement based on the result obtained by capturing an image of the body.
The measuring device according to any one of claims 1 to 3. The second measuring unit is configured to measure the movement based on the result obtained by capturing the image including the information in the depth direction.
The measuring device according to claim 4. The first measuring unit is configured to extract the vital data based on a portion of the spectrum acquired by radar measurement within a distance range including the body distance measured by the second measuring unit. Be done,
The measuring device according to claim 5. The second measuring unit is
An area of interest extraction unit configured to extract an area of interest corresponding to at least a portion of the body in the image.
The measuring device according to any one of claims 4 to 6, further comprising a motion detecting unit configured to detect the motion based on the motion of the region of interest in the image. The motion detection unit is configured to detect the motion based on the motion of the region of interest in the direction parallel to the object plane and the depth direction in the image including the information in the depth direction.
The measuring device according to claim 7. The selection unit has a label indicating which of the vital data measured by the first measuring unit and the vital data measured by the second measuring unit is set as the valid data. Configured to attach to the valid data,
The measuring device according to any one of claims 1 to 8. The selection unit responds to the movement returning to be less than the second reference value, which is smaller than the first reference value, after the movement is equal to or more than the first reference value. It is configured to set the vital data measured by the measuring unit of the above to be the valid data.
The measuring device according to claim 9. The second measuring unit is
An image of the body including information in the depth direction is taken and
From the image, the periodic fluctuation of the body in the depth direction is extracted.
The measuring device according to claim 9 or 10 , wherein the vital data indicating at least one of the heart rate and the respiratory rate of the body is measured based on the periodic fluctuation. The second measuring unit is configured to include a thermograph for measuring the vital data.
The measuring device according to claim 9 or 10. The sensor portion of the first measuring unit is included in the movement measured by the second measuring unit in a position and orientation in which the first measuring unit can measure the vital data of the body. measurement apparatus according to a position further to any one of claims 1 1 2 with a configured driver to move relative according to at least one of a change in said direction of said body. The first measurement using the first measurement unit, which performs non-contact measurement of body vital data,
A second measurement using the second measuring unit, which measures the movement of the body with respect to the first measuring unit and measures the vital data of the body in a non-contact manner,
Detection for detecting whether or not the movement measured by the second measuring unit is less than the first reference value, and
The vital data measured by the first measuring unit is set to be valid data under the condition that the movement measured by the second measuring unit is less than the first reference value. A computer implementation method comprising the option of setting the vital data measured by the second measuring unit to be valid data, provided that the movement is greater than or equal to the first reference value. Program for causing to function as a measuring apparatus according to any one of claims 1 1 3 to the computer. And one or more computer-readable storage medium that collectively stores program instructions executable by a computer, said program instructions, functions as a measurement apparatus according to any one of claims 1 1 3 One or more computer-readable storage media that causes the computer to do so.

Images