CN218484554U - Multifunctional fusion detection device - Google Patents
Multifunctional fusion detection device Download PDFInfo
- Publication number
- CN218484554U CN218484554U CN202123429737.XU CN202123429737U CN218484554U CN 218484554 U CN218484554 U CN 218484554U CN 202123429737 U CN202123429737 U CN 202123429737U CN 218484554 U CN218484554 U CN 218484554U
- Authority
- CN
- China
- Prior art keywords
- signal
- detection
- vital sign
- person
- radar
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
The utility model relates to a multi-functional fusion detection device, including camera, radar sensor, infrared sensor and driver, this driver coupling is in this camera and this radar sensor, and this driver is set up to make this radar sensor align the chest of target based on the image information that this camera gathered, and infrared sensor aims at the forehead of target to carry out the measurement of the height of preferred non-contact, rhythm of the heart, breathing, body temperature and blood pressure for this target.
Description
Technical Field
The utility model relates to a health detection, concretely relates to multi-functional fusion detection device.
Background
The existing vital sign information acquisition mainly comprises that medical personnel operate a detection instrument to detect a person to be detected. Because the detection of multiple vital signs such as blood pressure, heart rate and respiratory rate needs to fix the detecting instrument on the corresponding body part of the person to be detected, the existing detection operation process of the vital signs is tedious, the efficiency is low, and the discomfort brought to the person to be detected in the detection process can cause inaccurate detection results due to the contact between the detecting instrument and the body of the person to be detected. In addition, different vital sign information needs to be separately performed by using different instruments, and under the condition that a plurality of vital signs need to be detected, a plurality of procedures are needed for completing all detection, so that the time consumption is long. In situations where medical personnel are not available, the detection of some vital signs is limited or cannot be accomplished at all.
For example, a current blood pressure measurement apparatus needs to contact the body surface of a subject using a member such as a cuff and measure the blood pressure by compressing a blood vessel of the subject. The contact type blood pressure measuring method has large influence interference of the measuring equipment on the tested person, and is particularly not suitable for dynamic continuous blood pressure monitoring in the sleeping process. Through the blood pressure monitoring of physical sign information such as electrocardio, hand blood oxygen signal, still need lay devices such as monitoring electrode and blood oxygen probe at the tester body surface. There are still major limitations to the effective application of such contact measurements, for example in burn patients or in the case of new coronary pneumonia epidemics.
SUMMERY OF THE UTILITY MODEL
According to one aspect, the present invention provides a vital sign detection device for measuring vital sign information of a person to be measured in a non-contact manner. The utility model discloses a detection device includes the main part, be coupled in a plurality of sensors of main part and with a plurality of sensor data connection director. The plurality of sensors are configured to simultaneously detect a plurality of corresponding vital sign signals of a subject, and the controller is configured to receive the plurality of vital sign signals from the plurality of sensors and provide at least one vital sign information of the subject based on at least one of the plurality of received vital sign signals.
According to a preferred embodiment, the controller is configured to obtain a vital sign information of the subject according to a plurality of vital sign signals. For example, among the plurality of vital sign signals, a respiration signal, a heartbeat signal, and a blood pressure signal. According to the scheme, the respiration rate and/or the heart rate of the person to be tested in a certain time period are/is obtained by processing the respiration signal and/or the heartbeat signal, and whether the person to be tested is in a static body state suitable for vital sign detection or not is judged according to the respiration rate and/or the heart rate, and if yes, the blood pressure signal detected in the same time period can be judged as the real blood pressure of the person to be tested. If not, the scheme can determine the blood pressure signal measured in the period of time when the body state of the person to be measured is in a static state and suitable for vital sign detection according to the respiration rate and/or the heart rate, and then the blood pressure signal is determined to correspond to the real blood pressure of the person to be measured.
According to an alternative, the controller is configured to obtain a plurality of vital sign information of the subject based on the at least one vital sign signal.
According to another preferred scheme, the utility model discloses a detection device still including coupling in the human-computer interface of controller, the human-computer interface sets up to can verify the identifying information of person under test and provides at least one vital sign information that corresponds with the identifying information of person under test to the person under test.
According to another preferred aspect, the detection device of the present invention further comprises a driver, the main body is installed in the driver and coupled to the controller, and the driver is configured to carry the main body to move between a plurality of preset detection positions.
According to further preferred scheme, the utility model discloses a detection device still including be coupled in the position sensor and the proximity sensor of controller, wherein the controller sets up to work as position sensor confirms detection device reachs arbitrary preset detection position in a plurality of preset detection positions, and proximity sensor confirms that to wait to examine the person and is located start detection device when arbitrary preset detection position to carry out the vital sign detection.
According to still another preferred aspect, the detection apparatus of the present invention further comprises a communication device coupled to the controller, the communication device being configured to be connected to a remote data.
According to yet another preferred aspect, the detection device of the present invention further comprises a support portion movably coupled to the main body, wherein at least one of the plurality of sensors is disposed toward the support portion; the support is displaceable relative to the body between an open position and a closed position; in the open position, the support portion protrudes from the main body to constitute an accommodation space between the support portion and the main body, and the at least one sensor is disposed such that a detection range thereof covers the accommodation space; in the closed position, the support part withdraws the main body to remove the accommodation space.
According to another aspect, the present invention provides a vital sign detection system, the system comprising a controller, a plurality of sensors coupled to the controller, a processor in remote data connection with the controller, and a human-machine interface coupled to the controller and to at least one of the processors. The plurality of sensors are configured to detect a plurality of vital sign signals of a subject and transmit the plurality of vital sign signals to the controller. The processor is configured to receive the plurality of vital sign signals from the controller and obtain at least one vital sign information of the person under test according to at least one of the plurality of received vital sign signals, and the human-machine interface is configured to output the at least one vital sign information.
According to another aspect, the present invention provides a method for processing vital sign detection data, the method comprising receiving a plurality of vital sign signals, wherein the plurality of vital sign signals includes a first vital sign signal and a second vital sign signal, and determining a detection status of the second vital sign signal according to the first vital sign signal. And when the detection state of the second vital sign signal is judged to be in accordance with the preset state, determining the second vital sign signal as actual sign information.
According to an embodiment, the utility model provides a multi-functional fusion detection device, it includes camera, radar sensor, infrared sensor and driver, and this driver is coupled in this camera and this radar sensor, and this driver is set up to make this radar sensor align the person's of awaiting measuring chest position based on the image information that this camera gathered, and infrared sensor aligns the person's of awaiting measuring forehead to carry out the measurement of the height of preferred non-contact, rhythm of the heart, breathing, body temperature and blood pressure for this person of awaiting measuring.
According to another embodiment, the utility model provides a multi-functional fusion detection device, the device includes: camera, radar sensor, infrared sensor, processor and at least one driver. The processor is coupled to the camera and the radar sensor, and the at least one driver is coupled to the camera, the radar sensor and the infrared sensor respectively. The at least one driver is configured to drive the radar sensor to shift to the position aligned with the chest of the person to be measured to collect information in response to the instruction sent by the processor, so that the radar sensor can determine the blood pressure of the person to be measured, wherein the respective shifts of the radar sensor and the infrared sensor depend on the information collected by the camera.
The multifunctional fusion detection apparatus as described above, wherein the radar sensor comprises an antenna main lobe, wherein the at least one driver is arranged such that the antenna main lobe is aligned with the chest of the subject and the respiration and heart rate of the subject are acquired while the antenna main lobe is aligned with the chest of the subject.
The multifunctional fusion detection device may further comprise: the processor is configured to perform an alignment step, wherein the alignment step comprises: acquiring a key node of a person to be detected based on non-infrared image information acquired by a camera; acquiring the position of the chest of a person to be measured; and sending a movement instruction to the at least one driver to align the radar sensor with a chest position of the subject.
The multifunctional fusion detection device may further comprise: the processor may be further configured to: periodically collecting preliminary information from a detection area through one of a camera and a radar sensor; determining whether the person to be tested is in the detection area based on the preliminary information; and if the person under test is determined to be in the detection zone, starting a vital sign detection program, wherein the vital sign detection program comprises a blood pressure measurement program.
The multifunctional fusion detection device may be configured wherein the blood pressure measurement procedure comprises: acquiring image information of a reference object from a camera; estimating the distance information of the person to be detected according to the radar signal; and acquiring the height of the person to be measured according to the image information of the person to be measured, the image information of the reference object and the distance information.
The multifunctional fusion detection device may be configured such that the blood pressure measurement procedure includes: acquiring the respiratory frequency of a person to be detected based on a radar signal acquired by a radar sensor; acquiring a heart rate waveform of a person to be measured based on the radar signal; and estimating the blood pressure of the person to be measured based on the height, the heart rate waveform and other pre-obtained vital sign information.
The processor of the multifunctional fusion detection device may be configured to acquire a position of a forehead of the person to be measured, and measure a forehead temperature of the person to be measured by the infrared sensor with a preset distance between the infrared sensor and the forehead of the person to be measured.
The processor of the multifunctional fusion detection apparatus may be configured to: and if the person to be measured without vital signs in the detection area is determined, continuously acquiring preliminary information from the detection area at intervals of 5 seconds.
The processor of the multifunctional fusion detection apparatus may be configured to: after a vital sign detection program is started, finishing the acquisition of the vital signs of the person to be detected within 15 to 30 seconds; and sending the collected vital signs of the person to be tested and the estimated blood pressure of the person to be tested to a remote server.
The processor of the multifunctional fusion detection device may be configured to provide a prompt for a physiological detection program status update to a test subject located in the detection zone.
According to another aspect, the present invention provides a non-contact blood pressure measurement method. The method comprises the steps of receiving radar echo of a first part of a person to be detected, and extracting a first pulse wave signal from the radar echo; receiving a video signal stream of a second part of the person to be detected, and extracting a second pulse wave signal from the video signal stream; and matching the actually measured pulse wave transmission time with the reference pulse wave transmission time so as to obtain a blood pressure value corresponding to the actually measured pulse wave transmission time.
Preferably, extracting the first pulse wave signal from the radar echo includes demodulating an in-phase signal and a quadrature signal in the radar echo to obtain an initial radar signal; the method comprises the steps of performing phase compensation on an initial radar signal to obtain a complete radar signal, and performing first filter filtering on the complete radar signal to obtain the first pulse wave signal.
Preferably, the utility model discloses a non-contact blood pressure measurement method still includes, carries out Fourier transform to complete radar signal before carrying out filtering process to complete radar signal, becomes complete radar signal from the time domain to the frequency domain to obtain the reference frequency that corresponds with the highest range, and set up and carry out filtering process to complete radar signal first filter interval upper limit, wherein first filter interval upper limit is followed reference frequency changes.
Preferably, extracting the second pulse wave signal from the video signal stream includes extracting an original green channel signal from the video signal stream and removing the interference signal from the original green channel signal to obtain a green channel signal with the baseline shift removed; setting an interval upper limit of a second filter; and filtering the baseline wander eliminated green channel signal through a second filter to obtain the second pulse wave signal, wherein the upper interval limit of the second filter is changed along with the reference frequency.
Preferably, removing the interference signal from the original green channel signal further comprises extracting a signal intensity value of the original green channel, and subtracting a mean of the signal intensity values of the green channel from the signal intensity value of the original green channel.
Preferably, the distance between the first part and the pulse source of the testee is smaller than the distance between the second part and the pulse source.
According to another aspect, the present invention provides a non-contact blood pressure measuring device. According to one embodiment, the non-contact blood pressure measurement device includes a radar apparatus, a radar signal processor coupled to the radar apparatus, a video signal processor coupled to the video apparatus, and a data processor coupled to the radar signal processor and the video signal processor. The radar signal processor is configured to transmit a radar signal to the person under test and receive a radar echo of a first portion of the person under test. A radar signal processor is arranged to extract a first pulse wave signal from the radar echo. The video apparatus is arranged to receive a stream of video signals from a second location on the subject. The video signal processor is arranged to extract a second pulse wave signal from the video signal stream. The data processor is arranged to obtain a measured pulse wave transit time from the first pulse wave signal and the second pulse wave signal, and to match the measured pulse wave transit time with a reference pulse wave transit time, thereby obtaining a corresponding blood pressure value.
Preferably, the radar signal processor is further configured to demodulate the in-phase signal and the quadrature signal in the radar echo to obtain an initial radar signal, and perform phase compensation on the initial radar signal to obtain a complete radar signal.
Preferably, the non-contact blood pressure measuring device according to the embodiment of the present invention further includes a first filter and a second filter. The radar signal processor is further arranged to transform the complete radar signal from the time domain to the frequency domain to obtain a reference frequency corresponding to the highest amplitude. The first filter is arranged to filter the complete radar signal to obtain the first pulse wave signal, wherein an upper limit frequency of the first filter is arranged to vary with the reference frequency.
Preferably, the video signal processor is further configured to extract an original green channel signal from the video signal stream, remove an interference signal from the original green channel signal to obtain a baseline wander eliminated green channel signal, set an upper limit of an interval of the second filter, and subject the baseline wander eliminated green channel signal to the second filter filtering to obtain the second pulse wave signal, wherein the upper limit of the interval of the second filter varies with the reference frequency.
Preferably, the device further comprises a carrier. The bearing frame is provided with a first surface, a second surface opposite to the first surface, and a window penetrating through the first surface and the second surface. The radar apparatus is fixed at a first position at which a side of the carrier facing the first surface is spaced apart from the carrier. An accommodating space for receiving a person to be measured on the first surface is formed between the radar equipment and the bearing frame, and the first position is opposite to the first part of the person to be measured in a spaced mode, so that the radar equipment transmits radar signals to the person to be measured and receives radar echoes of the first part of the person to be measured. The video apparatus is fixed at a second position facing the second surface and spaced apart from the carrier, the second position being aligned with a second part of the person to be measured through the window such that the video apparatus receives a video signal of the second part of the person to be measured through the window.
The following detailed description of specific examples is provided in conjunction with the accompanying drawings to further illustrate the technical solutions of the present invention.
Brief description of the drawings
Fig. 1 is a schematic view of a framework and an application scenario of a vital sign detection apparatus according to an embodiment of the present invention.
Fig. 2 is a schematic view of the architecture and application scenario of the vital sign detection device according to another embodiment of the present invention.
Fig. 3A is a top view of the vital signs detector of fig. 2, with the support in an open position;
fig. 3B is a top view of the vital signs detector of fig. 2, with the support in a closed position;
fig. 3C is a top view of an application scenario of the vital sign detection device shown in fig. 2.
Fig. 4A, fig. 4B and fig. 4C are schematic diagrams illustrating the architecture and application scenario of the vital sign detection device according to another embodiment of the present invention.
Fig. 5 is a schematic view of a framework and an application scenario of a vital sign detection apparatus according to a specific example of the present invention.
Fig. 6 is a flow chart of processing vital sign signals and data measured by the vital sign detection device shown in fig. 5.
Fig. 7 is a schematic view of the architecture and application scenario of the vital sign detection device according to another embodiment of the present invention.
Fig. 8 is a schematic view of a vital sign detection system and an application scenario according to an embodiment of the present invention.
Fig. 9 is a flowchart of a vital sign data processing method according to an embodiment of the present invention.
Fig. 10 is a schematic view of a multifunctional fusion detection device according to an embodiment of the present invention;
fig. 11 is a schematic view of a multifunctional fusion detection device according to another embodiment of the present invention;
fig. 12 is a schematic view of a multifunctional fusion detection apparatus according to another embodiment of the present invention;
fig. 13 is a schematic view of a multifunctional fusion detection apparatus according to another embodiment of the present invention;
fig. 14 is a flow chart illustrating the operation of a multifunctional fusion detection device according to an embodiment of the present invention;
fig. 15 is a flow chart of blood pressure measurement according to an embodiment of the present invention.
Fig. 16 is a schematic flow chart of a non-contact blood pressure measurement method according to an embodiment of the present invention.
FIG. 17 is a block diagram of the method of FIG. 16.
Fig. 18 is a schematic diagram of a radar signal processing flow in a non-contact blood pressure measurement method according to a preferred example of the present invention.
FIG. 19 is a schematic illustration of radar signals processed in the method of FIG. 18;
fig. 20 is a schematic diagram of a video signal stream for receiving a second portion of the subject in the method of fig. 19.
Fig. 21 is a schematic view of a video signal processing flow in the non-contact blood pressure measuring method according to a preferred example of the present invention.
FIG. 22 is a schematic illustration of a video signal processed in the method of FIG. 21;
fig. 23 is a schematic view of a video signal processing flow in a non-contact blood pressure measuring method according to a preferred example of the present invention.
Fig. 24 is a perspective view of a non-contact blood pressure measuring device according to an embodiment of the present invention.
Fig. 25 is a perspective view of a blood pressure measurement scenario of the device shown in fig. 24.
Fig. 26 is a bottom perspective view of portion 26 of fig. 25.
Detailed Description
The vital sign information includes basic vital sign information and other vital sign information. The basic vital sign information is an important index reflecting the health condition of a human body, and mainly includes body temperature, respiratory rate, heart rate, blood pressure, blood oxygen concentration and the like. According to the utility model discloses a vital sign detection device, including a plurality of sensors of different grade type, detecting instrument, probe, signal acquisition equipment etc. wherein need not with the person's of awaiting measuring health direct contact, can detect a plurality of vital sign signals of the person of awaiting measuring with the non-contact mode respectively or simultaneously to a plurality of vital sign information that the output corresponds, thereby realize quick, accurate vital sign and detect in the convenient comfortable experience of the person of awaiting measuring.
According to one embodiment, as shown in fig. 1, the present invention provides a vital signs detection device 100. The vital signs detector 100 may be configured as a stationary detector, such as a detector located in a hospital, nursing home, or physical examination center. The vital sign detection device 100 may also be configured as a movable detection device, for example, to move between a plurality of preset detection positions within a certain range in a hospital, a nursing home, or a physical examination center, so as to detect the testees one by one without moving the testees at the preset detection positions. The vital signs detection device 100 may also be provided as a portable detection device, for example a detection device suitable for home use.
Specifically, the vital signs detection device 100 includes a body 110, a plurality of sensors 120 coupled to the body 110, and a controller 130 in data communication with the plurality of sensors 120. The controller 130 may be disposed inside the body 110 or outside the body 110, and is in data connection with each sensor module 120. The sensor 120 block includes a plurality of non-contact sensors 122. The plurality of non-contact sensors 122 are configured to each independently detect different vital signs, such as respiration rate, heart rate, blood pressure, and the like. The non-contact sensor 122 may also be configured such that two or more thereof cooperate to detect a vital sign of the subject 80. The controller 130 is configured to receive a plurality of vital sign signals from each of the non-contact sensors 122 and to process at least one of the plurality of received vital sign signals and generate corresponding vital sign information.
The vital sign signals are raw data signals acquired directly or indirectly by the sensors and correspond to one or more vital signs of the subject 80. The vital sign signal may be a signal output from a direct detection result of a certain sensor, or may be a signal obtained by processing a direct detection result of a certain sensor, for example, a signal with a high signal-to-noise ratio obtained by eliminating or reducing noise of raw detection data. The vital sign signal can be a signal corresponding to a certain vital sign in the form of a waveform, a numerical value, a curve, etc. For example, the vital sign signals may include respiration signals, heartbeat signals, pulse wave signals, temperature signals, and the like. The corresponding vital sign information may include respiration rate, heart rate, blood oxygen concentration, blood pressure, etc. The non-contact sensor 122 can synchronously, real-timely or simultaneously acquire a plurality of signals and values related to the vital sign information, thereby reducing the detection time and avoiding the influence of the possible discomfort brought to the person to be detected 80 due to the contact detection on the detection precision. In addition, the non-contact sensor 122 can also avoid detection errors caused by different body postures of the testee 80.
The controller 130 may be configured to have a signal processing function, or may transmit the received signal to a remote processor for signal processing. The controller 130 is configured to obtain the vital sign signals from the plurality of non-contact sensors 122 and further process the vital sign signals using a relevant data processing method, such as an algorithm or model, to obtain corresponding vital sign information. The signal data processing, algorithms or models may include, but are not limited to: empirical models, machine learning models, deep learning models, and the like. Inputs to these models include, but are not limited to, multiple or single data waveforms, multiple or single values. The algorithm or model may further include: batt worthwhile filtering, empirical Mode Decomposition (Empirical Mode Decomposition), wavelet transform, and the like.
As shown in fig. 2, the vital signs detection device 100 according to the present invention may further comprise a human-machine interface 140. The human-machine interface 140 is configured to interact with the person 80 during the detection process, such as providing instructions for operation steps to the person 80, detecting and receiving operation instructions of the person 80, and the like. The human-computer interface 140 is further configured to identify and verify identity information of the person 80 under test, determine whether the person 80 under test has entered the detection area and is ready, for example, verify the identity of the person under test through face recognition, id card scanning, and start the detection procedure after confirming that the person under test meets the preset test conditions. In one embodiment, the human-machine interface 140 may include a display 142, a voice device 144, and a scanner 146. The distance, body posture and breathing state required for detection are prompted and guided by the display 142 or the voice device 144, for example, the testee is prompted to keep a static body posture and a stable breathing state for 15 to 30 seconds before the test is started, so as to meet the detection requirements of the plurality of non-contact sensors 122. In addition, the display 142 may be configured to output the detection result of the person 80, for example, to output the detection result of the person 80 and/or the real-time vital sign information in a display and/or printing manner.
According to another embodiment, the vital signs detector 100 further comprises a supporting portion 112 movably coupled to the main body 110, wherein one or more sensors of the plurality of sensors 112, such as a hand camera 122c, an infrared sensor 122d, etc. for collecting palm and wrist signals. Sensors such as a hand camera 122c and an infrared sensor 122d are provided toward the support portion 112. The support portion 112 is displaceable relative to the main body 110 between an open position 112b and a closed position 112 a. In the open position 112b, the support portion 112 protrudes from the main body 110 to constitute an accommodation space 111 between the support portion 112 and the main body 110. The hand camera 122c, the infrared sensor 122d, and the like are disposed such that the detection range thereof covers the accommodation space 111. In the closed position 112a, the support portion 112 withdraws the main body 110 to remove the accommodating space 111, so that the vital sign detection device 100 is compact in structure in the non-use state, and the support portion 112 covers and protects the hand camera 122c and the infrared sensor 122d.
The support portion 112 may support a certain body part of the subject 80, such as the palm 86 of the subject 80, according to the detection requirements. During the inspection, the support 112 is located at the open position 112b, and the palm of the subject 80 is placed in the accommodating space 111 and supported by the support 112, so that the support 112 assists in keeping the hand in a relatively stationary state with respect to the main body 110. Meanwhile, the palm of the person 80 faces the hand camera 122c and the infrared sensor 122d, so that the hand camera 122c, the infrared sensor 122d and the like can collect vital sign signals of the hand. The main body 110 may further include a shelf 114 for placing auxiliary items required for inspection, such as a container for sterilizing fluid.
The vital signs detection device 100 may further comprise a communication device 150 coupled to the controller 130. The communication device 150 is configured to be in data connection with a remote location, for example, in a wireless communication manner, so as to transmit the raw detection data received by the controller 130 from each sensor to a cloud or a remote location, for example, a data processing terminal of a medical staff, so as to perform interpretation analysis on the raw detection data, and obtain and present a vital sign detection result. In one application scenario, the person to be tested 80, as a home user, may transmit the vital sign information to the medical staff for diagnosis through the communication device 150.
Fig. 4A and 4B show another embodiment of a vital signs detection device 100. The vital sign detection device 100 further includes a driver 160, the main body 110 is supported and mounted to the driver 160, and the driver 160 is coupled to the controller 130. The actuator 160 is configured to displace the portable body 110 between a plurality of preset sensing positions. The drive 160 may be, for example, a mobile base or a mobile robot. The controller 130 can drive the main body 110 to move within a preset range by controlling the driver 160, so as to continuously detect a plurality of testees 82/84 at different positions, for example, for detecting a tester with inconvenient actions, thereby obtaining the vital sign information of the tester 82 in a standing posture or the tester 84 in a sitting posture.
As shown in fig. 4C, the vital signs detector 100 according to the present invention may further include a positioning sensor 132 and a proximity sensor 134 coupled to the controller 130. The controller 130 is configured to activate the detecting device to perform the vital sign detection on the first candidate 812 when the positioning sensor 132 determines that the detecting device reaches any one of the plurality of preset detecting positions 412, 414, 416, such as the first preset detecting position 412, and the proximity sensor 134 determines that the first candidate 812 is in position in the first preset detecting position 412. The controller 130 may be further configured to activate the driver 160 to move the inspection device 100 toward the second preset inspection position 414 after completing the inspection of the first suspect 812. The detection device is activated to perform vital sign detection on the second suspect 814 when the positioning sensor 132 determines that the detection device 100 has reached the second preset detection location 414 and the proximity sensor 134 determines that the second suspect 812 has been in place at the second preset detection location 414. The inspection apparatus 100 can inspect the first, second and third candidates 812, 814 and 816 at the first, second and third predetermined inspection positions 412, 414 and 416 one by one in the above-mentioned manner.
The vital signs detection apparatus 100 may further include a navigation system and a face recognition device in combination with the human-machine interface 140, so that the apparatus can be accurately positioned in front of the person 82/84 to be detected. In addition, the driver 160 can be controlled from the remote end 170 through the communication device 150 to sequentially move the detecting device 100 to the different testees 812, 814 and 816. In addition, the identity information of the person to be detected can be sent from the remote end 170 to the controller 130 through the communication device 150, and the controller 130 can move the detection apparatus 100 to the person to be detected matching with the identity information according to the identity information to perform the detection.
Fig. 5 shows a specific example of a vital signs detection device 100. The vital signs detection device 100 includes a body 110, a plurality of different types of non-contact sensors 122a/122b/122c/122d coupled to the body 110, a controller 130, a human-machine interface 140, a communication device 150, and a mobile device 160. The main body 110 is provided with a housing and a support portion 112, and the support portion 112 is used to support the palm of the subject 80. The plurality of non-contact sensors 122a/122b/122c/122d may be a main camera 122a and a radar sensor 122b disposed on the body 110, and a hand camera 122c and an infrared sensor 122d disposed on the support 112, respectively. The main camera 122a is used to capture a face image of the person 80 to be tested for authentication by face recognition. The radar sensor 122b is configured to detect vital sign signals of the subject 80, such as respiration and heartbeat, by using a radar signal. The hand camera 122c is used to detect a wrist pulse signal of the subject 80. The infrared sensor 122d is used to detect a hand temperature signal of the subject 80.
The human-computer interface 140 may include a display 142, a voice device 144, and a scanner 146. The speech device 144 may include speech recognition, natural language processing, voice question answering, and the like. The human-computer interface 140 interacts with the person 80 through the use of a display 142 and a voice device 144. And at least one piece of other vital sign information of the person to be tested, such as vision, hearing, reaction and the like of the person to be tested, can be obtained through interaction with the person to be tested.
As shown in fig. 6, according to one embodiment of the present invention, the controller can process and obtain corresponding vital sign information 400 according to one or more vital sign signals 300. The vital sign detection device 100 can obtain vital sign signals 300 such as respiration signals and heartbeat signals (distance signals) using the radar sensor 122 b. The same sensor 122 can measure multiple vital sign signals 300. At the same time, a pulse signal (image signal) is obtained using the hand camera 122 c. The heartbeat signal corresponds to a signal of the chest portion of the subject 80. The pulse signal corresponds to the hand image signal of the subject 80. The plurality of different vital sign signals 300 may correspond to the same vital sign information 400 of the subject 80. The plurality of different vital sign signals 300 can be different types of signals, such as distance signals and image signals.
After receiving a plurality of vital sign signals 300 measured simultaneously, the controller may process the vital sign signals 300 one by one to obtain corresponding vital sign information 400. For example, the controller 130 receives and processes the respiration signal to obtain the respiration rate and the body temperature of the subject 80. The controller 130 may also process using a combination of the plurality of vital sign signals 300 to obtain one vital sign information of the subject 80. For example, a combination of the heartbeat signal and the pulse signal is processed using a machine learning model to obtain the blood pressure of the subject 80. In addition, the controller 130 can also obtain the blood pressure and the blood oxygen concentration of the subject 80 according to the same vital sign signal 300, such as a pulse signal.
In some embodiments, the controller 130 may perform comparison or signal processing on a plurality of different vital sign signals 300, such as a heartbeat signal and a pulse signal, to improve the reliability of the same vital sign information (e.g., heart rate) measurement of the subject. The controller 130 can also obtain the blood pressure of the person 80 to be measured through the heartbeat signal, the pulse signal or the phase shift parameter between the heartbeat signal and the pulse signal. In addition, the frequency measured by the pulse signal is the middle frequency of the filter, and the filter is used for removing the noise in the heartbeat signal and improving the signal-to-noise ratio of the heartbeat signal. On the contrary, the measured frequency of the heartbeat signal is the middle frequency of the filter, and the noise in the pulse signal is removed by using the filter, so that the signal-to-noise ratio of the pulse signal is improved. A separate sensor, such as a radar or camera, may enable blood pressure detection and estimation. And by adopting the scheme of simultaneously using a plurality of sensors of different types such as radars, cameras and the like, the blood pressure can be more accurately detected and estimated.
Table 1 below shows the comparison of vital sign information measured by the vital sign detection device according to an embodiment of the present invention and an existing touch sensor. As shown in table 1, the utility model discloses a vital sign information that non-contact sensor's detection device surveyed and the deviation between the testing result through current contact detection device are less than the error between the different times testing result of current contact detection device. Therefore, the detection device can accurately estimate and acquire each vital sign information of the person to be detected.
Table 1: the utility model discloses a vital sign detects device and contact sensor's contrast
| Vital sign information | The utility model discloses a detection device | Touch sensor |
| Heart rate | 69.5bpm | 67bpm |
| Respiration rate | 15.2bpm | - |
| Blood pressure (systolic pressure) | 109mmHg | 118mmHg |
| Blood pressure (diastolic pressure) | 57mmHg | 52mmHg |
| Blood oxygen (SpO 2) | 99％ | 99％ |
| Body temperature | 36.3 | 36.6 |
In some embodiments, the vital signs detection device 100 may also include a plurality of cameras 128 disposed facing different directions. The camera 128 may be arranged to have a 360 degree view angle and may be used to detect the surrounding environment, alternatively or additionally, in an application scenario with privacy considerations, the vital sign detection apparatus 100 may employ a radar sensor or a radar sensor array for detecting the surrounding environment, such as performing fall detection on surrounding pedestrians or people in and near the detection area, to warn of a possible fall accident, and issue an alarm if a fall is detected. Therefore, according to the utility model discloses a vital sign detection device 100 can utilize radar sensor array or wide angle camera, through gesture recognition technology such as time frequency analysis, video analysis, machine learning, realizes early warning and the alarm to tumbleing.
According to another embodiment, as shown in fig. 7, the vital signs detecting device 100 of the present invention is provided to lay a subject 80 on a detection bed 190 in a supine body position. The vital signs detection device 100 can include a plurality of sensors 120a/120b secured to the detection bed 190 and a plurality of corresponding communication devices 150a/150b. Sensor 120a is spaced apart from sensor 120 b. For example, the sensor 120a may be disposed on the fixing frame 192, and the sensor 120b may be coupled to the detection bed 190. The sensors 120a/120b are each in data communication with a controller 130. The sensor 120b may communicate wirelessly via the communication devices 150a, 150b to transmit data to the controller 130.
Fig. 8 shows an embodiment of a vital signs detection system 500 according to the invention. The vital signs detection system 500 includes a detection end 510 and a processing end 520. The detecting end 510 may include a sensor 120, which is used to measure and collect a plurality of vital sign signals of the person 80 to be measured, and transmit the plurality of vital sign signals to the processing end 520 using the communication device 150. The detection end 510 further includes a human-computer interface 140 for interacting with the testee 80. The processing end 520 may be configured as a cloud end or an information processing end, and is far away from the detecting end 510 and the dut 80. The processing terminal 520 includes a controller 530, and the controller 530 is configured to receive a plurality of vital sign signals of the person 80 to be measured simultaneously, and obtain at least one vital sign information of the person 80 to be measured according to at least one of the received plurality of vital sign signals.
Fig. 9 shows a vital sign detection method 600 according to an embodiment of the invention. The method 600 comprises: at step 610, receiving a plurality of vital sign signals, wherein the plurality of vital sign signals includes a first vital sign signal and a second vital sign signal; in step 630, determining a detection state of the second vital sign signal according to the first vital sign signal, and in step 650, determining the second vital sign signal as actual vital sign information when the detection state of the second vital sign signal is determined to be in accordance with a preset state.
FIG. 10 schematically illustrates a multifunctional fusion detection device 2100 that includes a variety of non-contact sensors. Including camera 2100, infrared sensor 2120), and radar sensor 2130. The multifunctional fusion detection device 2100 includes a processor 2140 that is coupled to each sensor.
The multifunctional fusion detection device includes at least one driver. In one example, each driver is respectively coupled to at least one of a camera, a radar sensor, and an infrared sensor. The drive may be configured as an actuator such as a pneumatic actuator, an electric actuator, or a hydraulic actuator. The driver may be arranged to receive and execute instructions of the processor. The driver may include an infrared driver and a radar sensor driver. The driver may be arranged to drive the infrared sensor and the radar sensor to any vertical position and to any angle in a horizontal plane. For example, the multifunctional fusion detection device can include an infrared driver 2122 coupled to an infrared sensor and a processor. The infrared driver is configured to adjust a physical position and/or other physical settings of the infrared sensor based on instructions provided by the processor such that the infrared sensor is a predetermined distance from the test subject. As another example, the multifunction fusion detection device can include a radar sensor driver 2132 coupled to a radar sensor and a processor. The radar sensor driver is configured to adjust a physical position and/or other physical settings of the radar sensor based on instructions provided by the processor such that the radar sensor is aligned with the test subject.
The multifunctional fusion test device includes a reference 2150. In one example, the reference object may be provided as an object having a scale or a preset length. The reference object may be disposed within or adjacent to the detection zone and within the field of view of the camera. The multifunctional fusion detection device can be configured to define a detection zone 21500, wherein the camera and the reference object are configured such that, when the subject is located in the detection zone, the camera captures an image showing the reference object located behind or to the side of the subject without contact between the reference object and the subject.
In addition to the situation that the examinee can be in a standing posture as shown in fig. 10, the multifunctional fusion examination apparatus according to the present invention can be applied to other situations. In another example, as shown in fig. 11, the subject may also be in a supine position. In another example, as shown in fig. 12, the subject may also be in a sitting position. The detection device may be provided as a fixed detection station or as a mobile device. In one example, the multi-functional fusion test device is configured to provide an entrance for a test subject to enter a test area and an exit for the test subject to exit the test area, wherein the entrance and the exit may be a common entrance and exit. Preferably, the inlet and the outlet are spaced apart from each other. The multifunctional fusion detection device is arranged to provide a person to be detected to enter a specified detection area through an inlet and stand at the specified detection area. As shown in fig. 10, the multifunctional fusion test device can be configured such that the defined test area can be moved into the test area, stood in the test area to be tested, and moved out of the test area by a person. As shown in fig. 12, the multifunctional fusion detection device can be configured such that a defined detection zone can be entered into the detection zone by a person sitting in a wheelchair, be located in the detection zone, be detected, and then leave the detection zone. The detection area can be defined by the visual field of the camera and physically defines the preferred position of the testee for detection. The whole course of the vital sign detection procedure is non-contact.
As shown in fig. 13, the multifunctional fusion detecting device may also be equipped with a moving member 2102 so that the multifunctional fusion detecting device can be moved as needed, that is, the detection region can be moved. The multifunctional fusion detection device can not only realize medical detection platform in a ward or provide multifunctional fusion health information detection at a fixed detection platform station, but also realize a mobile or movable medical information detection robot platform.
In one example, the camera may be configured as a digital camera or an analog camera, the image sensor of the camera may be configured as a ccd sensor or a cmos sensor, and the lens of the camera may be configured as a plastic lens or a glass lens. In addition, the camera can rotate a certain angle, for example, rotate 320 degrees from side to side, rotate 60 degrees from top to bottom, and can carry out image information collection including photo information and video information on the detection area. The camera may be arranged to send the image information it has collected to the processor for further processing of the image information.
In one example, the radar sensor may be provided as a mechanically scanned antenna, an electrically scanned antenna, or an electro-mechanically scanned antenna. The radar sensor may send and collect radar signals. The radar sensor can be installed on a driver, and the driver can adjust the horizontal position, the vertical position and the angle of the radar sensor and enable the radar sensor to be aligned with the chest part of the person to be measured based on the image information collected by the camera. The radar sensor may include an antenna main lobe, and the driver may direct the antenna main lobe toward a chest portion of the subject. The radar signals collected by the radar sensor may be sent to a processor.
In one example, the infrared sensor may be provided as a thermal type infrared sensor or a quantum type infrared sensor. The infrared sensor may be defined as a fully automatic infrared body temperature detector or an infrared thermal imager. The operating wavelength of the infrared sensor may be set to 3 to 5 microns or 8 to 12 microns. The photosensitive material of the infrared sensor can be lead sulfide, lead selenide, indium telluride, tellurium tin lead, tellurium cadmium mercury, doped germanium or doped silicon and the like. The infrared sensor may be configured to detect the body temperature of the subject based on an exposed body surface portion of the subject, such as an auricle or a forehead. The infrared sensor is coupled to the processor, and the processor can acquire the body temperature of the person to be measured by the infrared sensor, wherein the infrared sensor is configured to detect the body temperature of the person to be measured based on a certain part of the person to be measured.
The multifunctional fusion detection device comprises a processor. The processor is coupled to the sensors of the multifunctional fusion detection device, wherein the sensors comprise a plurality of types. The processor is configured to obtain information collected by each of the sensors, respectively. The processor is further configured to make a corresponding adjustment to at least one other of the sensors based on information collected by at least one of the sensors. The adjustment may include an adjustment to the physical location of the sensor and/or other physical settings of the collected information so that the information provided to the processor by the adjusted sensor has a better signal quality.
Fig. 14 shows a schematic workflow diagram 2160 of a non-contact multifunctional fusion detection device according to an embodiment of the present invention. The workflow of the non-contact multifunctional fusion detection device includes automatically starting a vital sign detection program 2162, collecting information by sensors 2164, adjusting settings of other sensors based on the information collected by the sensors 2166, and collecting information 2168.
The multifunctional fusion detection device is configured to automatically switch from a standby mode to an operational mode, i.e., to automatically initiate the vital sign detection routine 2162. According to one example, the processor of the multifunctional fusion detection device is configured to cause a sensor of the detection device to periodically collect preliminary information from the detection zone and determine whether to initiate a vital sign detection procedure based on the preliminary information. The sensor used in the standby mode to gather preliminary information may be one of any non-contact sensor used in the operational mode for vital sign detection. For example, the camera of the detection device may be set to collect image information as preliminary information, or the radar sensor may transmit and collect a radar signal as preliminary information. The processor is set up to gather preliminary information from the detection zone periodically through one of camera and radar sensor to whether the person under test is in the detection zone based on preliminary information determination, whether have the person under test who treats with vital sign in the monitoring detection zone promptly.
If the processor determines that the person to be detected is in the detection area (namely, the person to be detected in the detection area), the multifunctional detection device is switched from the standby mode to the running mode, and the vital sign detection program is started, wherein the vital sign detection program comprises a non-contact blood pressure measurement program. The processor may be configured to: periodically collecting preliminary information from a detection area by one of a camera and a radar sensor; determining whether the person to be tested is in the detection area based on the preliminary information; and if the person under test is determined to be in the detection zone, initiating a vital sign detection procedure, wherein the vital sign detection procedure comprises a blood pressure measurement procedure. The multi-function sensing device is configured to use the measurement information 2164 from each sensor in an operational mode to adjust the position, angle, etc. of other sensors based on the method of sensor fusion so that each sensor can perform vital sign measurements 2168 at a preferred setting (e.g., position 2166, etc.). Wherein the non-contact vital sign measurements include non-contact blood pressure measurements. The processor is configured to aggregate the collected information and send it to a remote server for further processing, analysis and storage.
If the processor determines that the detection area is not provided with a person to be detected with vital signs, the detection device is continuously in a standby mode, and the processor continuously and periodically collects preliminary information from the detection area. If the person to be detected leaves the detection area after the detection is finished for one person to be detected, the processor can automatically determine that no person to be detected with vital signs exists in the detection area and change the operation mode into the standby mode. Preferably, the camera or radar sensor is arranged to collect preliminary information every 5 seconds. The processor is configured to: and if the detection area is determined to be free of the person to be measured with the vital signs, continuously acquiring preliminary information from the detection area at intervals of 5 seconds. The multifunctional physiological detection device is set to be in a non-contact whole course and automatically enter a standby mode or an operation mode according to requirements, and does not need field operation of medical staff, so that the workload of the medical staff is reduced, and infection and cross infection caused by contact between patients and the medical staff and between the patients are also reduced.
Fig. 14 illustrates a vital sign detection procedure 2170 of a non-contact multi-functional fusion detection device according to an embodiment of the present invention, including a non-contact blood pressure detection procedure. Vital signs detection program 2170 includes: height estimate 2172, chest position estimate 2174, radar sensor alignment at chest 2175, heart rate measurement 2176, blood pressure estimate 2178, etc.
The vital sign detection program 2170 may further include other vital sign measurements, for example, in one example, the processor is configured to estimate a position of a forehead of the subject (or a region above a chest of the subject) based on the obtained height or chest position. The processor sends an instruction to the corresponding driver, the infrared sensor is adjusted to the position aligned with the forehead of the person to be measured through the driver, and the forehead temperature of the person to be measured is measured as the body temperature value after the distance between the infrared sensor and the forehead is adjusted to a preset value. This makes the method of body temperature detection more consistent, more standardized. The measurement of the body temperature of the person to be measured can be synchronized with the acquisition of other vital signs, so that all information acquisition is completed within 30 seconds. Therefore, the multifunctional fusion detection device not only can provide a medical detection platform in a fixed detection platform station or a ward, but also can realize a movable medical information detection robot platform. According to another example, the processor is configured to identify a preferred body temperature measurement location (e.g., a location not covered by clothing, an auricle, a forehead, etc.) based on information provided by the camera, and place the infrared sensor at a preferred distance from the body temperature measurement location for body temperature measurement. The processor is configured to aggregate the body temperature information of the person to be measured and other vital signs and send the aggregated body temperature information and other vital signs to the remote server. An infrared driver is coupled to the infrared sensor and configured to drive the infrared sensor to move vertically up or down in a direction 2122a and to rotate clockwise or counterclockwise in a horizontal plane in a direction 2122b, and may be further configured to align the infrared sensor with a preferred body temperature measurement site of the subject, such as the forehead, based on image information collected by the camera. Preferably, the infrared sensor is coupled to the processor, wherein the processor is configured to acquire a position of a forehead of the person to be measured, and measure a forehead temperature of the person to be measured by the infrared sensor with a preset distance between the infrared sensor and the forehead of the person to be measured.
With continued reference to FIG. 15, the multi-function fusion detection apparatus is configured to perform a height estimation 2172. The processor is configured to acquire image information acquired by the camera and/or radar signals acquired by the radar sensor to estimate the height of the person under test. The image information may define reference object information. The processor may acquire distance information of the person under test from the radar sensor based on the radar signal. The processor may be configured to obtain the height of the subject based on the image information and the distance information defining the reference object information. The blood pressure measuring program which is set to be executed by the processor can comprise the steps of obtaining image information of a reference object from the camera; estimating the distance information of the person to be detected according to the radar signal; and acquiring the height of the person to be measured according to the image information of the person to be measured, the image information of the reference object and the distance information.
The multi-function fusion detection device is configured to perform a chest position estimate 2174 of the subject. According to one example, the processor is configured to acquire image information of a reference object from the camera, estimate distance information of the person to be measured from the radar signal, and acquire a height of the person to be measured from the image information of the person to be measured, the image information of the reference object, and the distance information. The processor may be configured to estimate a position of a chest of the subject based on the height of the subject. The processor may be arranged to obtain key joint points of the subject, which may include key nodes of the body structure of the subject, such as shoulders, forehead, pinna, joints, etc., based on image processing of the image obtained by the camera. The processor may be arranged to estimate the position of the chest of the subject from the positions of the two shoulder joint points and the head joint point.
The multifunctional fusion detection device is configured to align the antenna main lobe of the radar sensor with the chest 2175 of the subject. The radar sensor may be arranged to transmit radar signals and to collect reflected radar signals. The radar sensor driver is coupled to the radar sensor and is configured to drive the radar sensor to move vertically upward or vertically downward in a direction 2132a and to rotate clockwise or counterclockwise in a direction 2132b in a horizontal plane to adjust an antenna main lobe position of the radar sensor. The spatial position of the radar sensor is not limited to a person to be measured with a predetermined body type or height, but can be automatically adjusted in response to the body type, height and the like of the person to be measured. The processor is configured to send a movement instruction to the associated driver based on the position of the chest of the person to be measured obtained from the image information acquired by the camera, wherein the movement instruction may include at least one of linear movement and rotation, so that the setting of the radar sensor is adjusted such that the antenna main lobe of the radar sensor is aligned with the chest of the person to be measured. The processor is configured to extract radar signal phase information corresponding to a distance between the radar sensor and a chest of the subject in a case where an antenna main lobe of the radar sensor is aligned with the chest of the subject. The processor is configured to obtain the respiratory rate and heart rate of the person under test 2176 through signal processing such as filtering, principal component analysis, and the like. Therefore, accurate heart rate waveform acquisition can be realized, and accurate blood pressure measurement is further realized.
The processor is configured to obtain the blood pressure of the person to be measured based on the information of the person to be measured acquired by the camera and the radar sensor. In an example, the processor obtains a blood pressure 2178 of the subject based on at least one of a height and a heart rate waveform of the subject. The blood pressure measurement procedure that the processor is arranged to perform may comprise: acquiring the respiratory frequency of a person to be detected based on a radar signal acquired by a radar sensor; acquiring a heart rate waveform of a person to be measured based on the radar signal; and inputting the obtained height, heart rate waveform and other constant vital sign information as input variables into a neural network model established according to a medical database, and further estimating the blood pressure of the person to be measured.
The processor can obtain the blood pressure of the person to be measured based on information such as heart rate, height and the like according to an empirical formula or a machine learning algorithm. Machine learning algorithms may include, but are not limited to, linear regression, support vector machines, k-nearest neighbor algorithms, logistic regression, decision trees, k-means, random forests, naive bayes, dimension reduction, gradient enhancement algorithms.
Preferably, the multifunctional physiological detection device is configured to complete vital sign acquisition within a preset time, for example, 15 seconds to 30 seconds, wherein the acquired information is suitable for estimating the blood pressure of the subject. The testee does not need to keep a fixed posture for a long time, and the detection device can still acquire information with relatively high quality for estimating the blood pressure. A processor is configured to provide a prompt for a physiological test procedure status update to the test subject in the test zone. Optionally, the multifunctional physiological detection device may include a human-computer interaction device, and prompt the to-be-detected person to keep the posture as much as possible to reduce the shaking through voice, images, videos and the like. The processor may then aggregate the subject's respiratory rate, heart rate waveform, blood pressure, body temperature, etc. The information may further be sent to medical personnel for diagnosis, treatment, etc. of the subject, or to a memory, server, etc. The multi-functional physiological detection apparatus may include a communication transmission device to transmit the detected information to a remote server. The processor may be configured to: after the vital sign detection program is started, the vital sign of the person to be detected is collected within a preset time, such as 30 seconds, and the collected vital sign of the person to be detected and the estimated blood pressure of the person to be detected are sent to a remote server. The detection means may be arranged to estimate more medical health information in combination with the detected information, according to empirical formulas, machine learning, etc.
According to one embodiment, the utility model provides a multi-functional fusion detection device, it includes camera, radar sensor, treater and at least one driver. The at least one driver is coupled to the camera and the radar sensor. The at least one driver is configured to perform a non-contact blood pressure measurement for the subject after the radar sensor is aligned with the chest of the subject based on the image information acquired by the camera. In other words, the drivers are respectively coupled with the camera and the radar sensor, and at least one driver is set to enable the radar sensor to shift to the position aligned with the chest of the testee to collect information in response to the instruction sent by the processor, so that the sensor can determine the blood pressure of the testee, wherein the shift of the radar sensor depends on the information collected by the camera. The detection device is set to be used for setting other sensors (such as displacement) and estimating blood pressure or other vital signs, so that a multifunctional fusion detection program is fully played, and the time for a person to be detected to keep a fixed posture is shortened.
The radar sensor comprises an antenna main lobe, wherein at least one driver is arranged such that the antenna main lobe is aligned with a chest of a subject and a heart rate of the subject is acquired when the antenna main lobe is aligned with the chest of the subject. The multifunctional fusion detection device comprises a processor. The processor is coupled to the camera and the radar sensor. The processor is configured to perform an alignment step, wherein the alignment step comprises: acquiring a key node of a person to be detected based on non-infrared image information acquired by a camera; acquiring the position of the chest (which may be relative to the position of the radar sensor); and sending a movement instruction to the at least one driver to align the radar sensor with the position of the chest of the person to be measured, so that the radar receives signals reflected from the chest with optimal quality. The detection device can be used under the condition of more complex environment, for example, more accurate and more reliable detection information can be obtained even if no medical staff is present. The detection device is wide in application and suitable for places with relatively large pedestrian volume or crowd gathering (such as airports, shopping malls, concert places, meeting places, tourist attractions and the like). This aspect not only allows the testing to be performed efficiently in the case of an increasing shortage of medical personnel, but also reduces the risk of infection of medical personnel.
As shown in fig. 16-19, according to one embodiment, the present invention provides a non-contact blood pressure measurement method 3100. The method 3100 includes a step 3110 of receiving a radar echo 3210 of a first portion of a subject 3050, a step 3120 of extracting a first pulse wave signal 3230 from the radar echo 3210, a step 3140 of receiving a video signal stream 3240 of a second portion of the subject 3050, a step 3150 of extracting a second pulse wave signal 3260 from the video signal stream 3240, and a step 3170 of obtaining a measured pulse wave transit time 3270 from the first pulse wave signal 3230 and the second pulse wave signal 3260. Thereafter, at step 3180, the method matches the measured pulse wave transit time 3270 with the reference pulse wave transit time 3870 to obtain a blood pressure value 3880 corresponding to the measured pulse wave transit time 3270.
The first region may be a body region having an artery point at a first distance between the body surface of the subject 3050 and the heart, for example, a chest region 3051 corresponding to the position of the heart. The second portion is a body portion having another artery point, such as the palm portion 3052, at a second distance between the body surface of the subject 3050 and the heart. I.e. the second distance is larger than the first distance.
According to a preferred example, the step 3120 of extracting the first pulse wave signal 3230 from the radar echo 3210 includes a step 3122 of demodulating an in-phase signal (I) 3210a and a quadrature signal (Q) 3210b in the radar echo 3210 to output the radar echo 3210 as an initial radar signal 3212, for example, demodulating according to the following formula:
in formula (1), Q (t) represents a quadrature signal in the radar echo 3210, I (t) represents an in-phase signal in the radar echo 3210, and R (t) represents an initial radar signal 3212 output after demodulation processing, where Q (t) and I (t) are respectively expressed as:
in the formula (2), x (t) and y (t) represent the displacement of the chest wall of the person to be measured caused by the heart activity and respiration respectively,
is residual phase noise.
After obtaining the initial radar signal 3212, in step 3124, the method performs phase compensation processing on the initial radar signal 3212 to reduce the influence of phase offset, gain imbalance, and other factors, thereby obtaining a complete radar signal 3224.
At step 3126, the method performs a fourier transform on the complete radar signal 3224, changes the complete radar signal 3224 from the time domain to the frequency domain, and uses the frequency f corresponding to the highest amplitude in the complete radar signal 3224 RF For reference, the estimated heart rate value HR is obtained according to the following formula (3):
HR＝f RF *60 (3)
in step 3127, the method sets an upper limit for the first filter interval over which the complete radar signal is filteredThe limit varies with the reference frequency. For example, f is RF As a reference frequency, the upper limit of the interval of the filter is set to be as defined by the following equation (4) with the reference frequency f RF The function of the correlation, i.e. the upper interval limit of the filter varies with the reference frequency:
f up ＝f RF +0.6 (4)
in the formula (4), f up The upper and lower limits of the filter are [0.7, f ] up ]。
In step 128, the method inputs the complete radar signal 3224 to a Butterworth filter configured according to the upper and lower limits to perform filtering processing, so as to output a first pulse wave signal (rPPG-1) 3230 related to the heartbeat of the subject from the filter.
As shown in fig. 17 and 20-24, the step 3150 of extracting the second pulse wave signal 3260 from the video signal stream 3240 includes a step 3152 of extracting an original green channel signal 3242 from the video signal stream 3240, and a step 3154 of removing an interference signal from the original green channel signal 3242 to obtain a green channel signal 3254 with baseline wander removed.
As shown in fig. 20, the vascular artery-induced optical signal distributed at the palmar region 3052 is suitable for capturing and receiving the video signal stream at the region. In addition, since the palm part 3052 of the testees with different skin colors is also smaller, the received video signal is also less influenced by the skin color.
Each frame of image input to the video stream 3240 is represented by M × N × 3, where M and N represent the height and width of the video image, respectively, and 3 represents three channels of RGB, red, green, and blue in the video stream 3240.
In the present method, the step 3154 of removing the interference signal may include a step 3154a of extracting a signal intensity value of the original green channel, and a step 3154b of subtracting an average value of the signal intensity values of the green channel from the signal intensity value of the original green channel.
For example, the step 3154 of removing the interference signal may be performed in a manner as expressed by the following equation (5):
G new ＝G raw -G mean (5)
in the formula (5), G new Green channel signal 3254, G indicating baseline wander cancellation raw Representing the originally sorted green channel signal, G mean The mean value of the green channel is calculated by the following formula:
in equation (6), I is the input green channel image with size M × N. After obtaining the green channel signal 3254 with baseline wander removed, the method sets the upper interval limit for the second filter at step 3156. In step 3158, the method performs band-pass filter filtering on the green channel signal 3254 after removing the baseline drift to remove the high frequency interference, so as to obtain a second pulse wave signal (rPPG-2) 260, wherein the upper limit frequency of the passband of the band-pass filter is according to the reference frequency f defined by the foregoing step 3128 and formula (4) RF Setting, e.g. upper limit frequency of filter passband with reference frequency f RF And (6) changing.
The step 170 of obtaining the measured pulse wave transit time 3270 from the first pulse wave signal 3230 and the second pulse wave signal 3260 includes extracting the time difference between the arrival of the blood flow signal at the first part (chest) and the arrival of the blood flow signal at the second part (palm) from the heart of the subject from the first pulse wave signal 3230 and the second pulse wave signal 3260, i.e. obtaining the measured pulse wave transit time (nPTT) 3270 according to the delay of the pulse wave peak in the same cardiac cycle, and then matching the measured pulse wave transit time (nPTT) 3270 with the reference pulse wave transit time to obtain the blood pressure value corresponding to the measured pulse wave transit time.
According to a specific example, the correspondence between the non-contact pulse transit time (nPTT) and the blood pressure is determined according to the following equation (7):
in the formula (7), α 1 ,β 1 ,γ 1 ,α 2 ,β 2 ,γ 2 Fitting coefficients are respectively used for reflecting the change of blood pressure under different vascular physiological conditions, and SBP and DBP respectively represent diastolic pressure and systolic pressure in the blood pressure. According to the electrocardiosignals and the pulse wave signals in the MIMIC public data set, blood pressure values corresponding to the pulse wave transmission time (PTT), namely a systolic pressure value and a diastolic pressure value, are obtained, and a more accurate nPTT-blood pressure regression model is fitted in a nonlinear way, so that the corresponding relation between the reference pulse wave transmission time and the blood pressure is established. Will be according to the utility model discloses pulse wave transmission time (nPTT) 270 that the embodiment measuring result obtained and reference pulse wave transmission time phase-match can obtain with the corresponding blood pressure diastolic pressure of actual measurement pulse wave transmission time and systolic pressure value. Or, can be with according to the utility model discloses the pulse wave transmission time substitution that embodiment measuring result obtained above-mentioned nPTT-blood pressure regression model, promptly obtain with the corresponding blood pressure diastolic pressure and systolic pressure value of actual measurement pulse wave transmission time.
Table 2 shows the blood pressure obtained by the method according to the present invention for 4 testees compared to the results obtained by the conventional contact blood pressure measurement method.
TABLE 2 comparison of blood pressure test results with conventional methods
According to table 2, the diastolic blood pressure and systolic blood pressure error rates measured according to the method of the present invention were 4.97% and 9.22%, respectively, as compared to the conventional method. The result shows, according to the utility model discloses the blood pressure measurement result of method is more close traditional method, and measurement accuracy is higher.
As shown in fig. 24, 25 and 26, a non-contact blood pressure measuring device 3600 according to an embodiment of the present invention includes a radar device 3610, a radar signal processor 3612 coupled to the radar device 3610, a video device 3630, a video signal processor 3632 coupled to the video device 3630, and a data processor 3652 coupled to the radar signal processor 3612 and the video signal processor 3632. The radar device 3610 is arranged to transmit a radar signal 3202 to the person 3050 to be measured and to receive a radar echo 3210 of the first portion 3051 of the person 3050 to be measured. The radar signal processor 3612 is arranged to extract a first pulse wave signal from the radar echo 3210. The video apparatus 3630 is arranged to receive a stream of video signals from the second part 3052 of the person 3050 to be measured. The video signal processor 3632 is arranged to extract a second pulse wave signal from the video signal stream. The data processor 3652 is arranged to obtain a measured pulse wave transit time from the first pulse wave signal and the second pulse wave signal and to match the measured pulse wave transit time with a reference pulse wave transit time, thereby obtaining a corresponding blood pressure value.
According to a preferred example, the radar signal processor 3612 is further arranged to demodulate the in-phase signal and the quadrature signal in the radar echo to obtain an initial radar signal, and to phase compensate the initial radar signal to obtain a complete radar signal.
According to a preferred example, the apparatus further comprises a first filter and a second filter, said radar signal processor being further arranged to transform said complete radar signal from the time domain to the frequency domain to obtain a reference frequency corresponding to the highest amplitude; the first filter is arranged to filter the complete radar signal to obtain the first pulse wave signal, wherein an upper limit frequency of the first filter is arranged to vary with the reference frequency;
the video signal processor is further configured to extract an original green channel signal from the video signal stream, remove an interference signal from the original green channel signal to obtain a baseline wander canceled green channel signal, set an interval upper limit of the second filter, and subject the baseline wander canceled green channel signal to the second filter filtering to obtain the second pulse wave signal, wherein the interval upper limit of the second filter varies with the reference frequency.
According to a preferred example, the non-contact blood pressure measuring device 3600 according to an embodiment of the present invention further includes a bearing frame 3640, such as a bed or the like, a table, a bearing plate, or the like, on which the subject can be supported in a supine body posture, for receiving and supporting the subject 3050. Support 3640 has a first surface 3642, such as an upper surface of bed 3640, a second surface 3648 opposite first surface 3642, such as a lower surface of bed 3640, and a window 3645 extending through first surface 3642 and second surface 3648.
The radar apparatus 3610 is secured to the carriage 3640 at a first location spaced from the carriage 3640 on a side of the carriage 3640 facing the first surface 3642, i.e., above the bed. An accommodating space 3620 for receiving the first surface 3642 of the object 3050 is formed between the radar device 3610 and the bearing frame 3640. The first position is opposite to a first part of the person 3050 to be measured, for example, the chest part 3051, in a spaced manner, so that the radar apparatus 3610 can transmit a radar signal 3202 to the person 3050 to be measured and receive a radar echo 3210 of the first part 3051 of the person 3050 to be measured.
The video apparatus 3630 is secured to the underside of the bed, i.e., to the other side of the carriage 3640 facing the second surface 3648, in a second position spaced from the carriage. The second position is aligned with the second part 3052 of the person under test, i.e., the palm part, through the window 3645, so that the video apparatus 3630 can photograph the second part 3052 of the person under test 3050 through the window 3645 and receive a video signal of the second part 3052 of the person under test 3050.
As used herein, the singular forms "a", "an" and "the" are to be construed to include the plural forms "one or more" unless expressly stated otherwise.
The invention has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited. Many modifications and variations will be apparent to practitioners skilled in this art. The example embodiments have been chosen and described in order to explain the principles and practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.
Thus, although the illustrative example embodiments have been described herein with reference to the accompanying drawings, it is to be understood that such description is not limiting, and that various other changes and modifications may be affected therein by one of ordinary skill in the related art without departing from the scope of the application.
Claims (8)
1. A vital sign detection device, characterized in that the detection device comprises:
a main body;
a plurality of sensors coupled to the body, the plurality of sensors configured to simultaneously detect a plurality of corresponding vital sign signals of a subject;
a controller in data communication with the plurality of sensors; and
a support movably coupled to the body, wherein at least one of the plurality of sensors is disposed toward the support; the support is displaceable relative to the body between an open position and a closed position; in the open position, the support portion protrudes from the main body to constitute an accommodation space between the support portion and the main body, and the at least one sensor is disposed such that a detection range thereof covers the accommodation space; in the closed position, the support portion withdraws the main body to remove the accommodation space.
2. The detecting device according to claim 1, wherein the supporting portion is provided to support a palm of the subject such that the supporting portion assists in maintaining the palm in a relatively stationary state with respect to the main body.
3. A testing device according to claim 1 wherein said plurality of sensors comprise hand cameras, radar sensors and/or infrared sensors.
4. A detection arrangement as claimed in claim 3, characterised in that the radar sensor comprises an antenna main lobe, wherein the radar sensor driver is arranged such that the antenna main lobe is aligned with the chest of the subject and the respiration and heart rate of the subject are acquired with the antenna main lobe aligned with the chest of the subject.
5. The sensing device of claim 1, further comprising a driver coupled to the controller, the body being mounted to the driver, the driver being configured to carry the body for displacement between a plurality of predetermined sensing positions.
6. The sensing device of claim 5, further comprising a position sensor coupled to the controller, wherein the position sensor is configured to determine that the sensing device has reached any of the plurality of predetermined sensing positions.
7. The inspection device of claim 6, further comprising a proximity sensor coupled to the controller, wherein the proximity sensor is configured to determine that the suspect is at any of the predetermined inspection positions.
8. The detection device of claim 1, further comprising a communication device coupled to the controller, the communication device configured to communicate with a remote data source.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2021104762606 | 2021-04-29 | ||
| CN202110476260 | 2021-04-29 | ||
| CN202110474401 | 2021-04-29 | ||
| CN2021104744010 | 2021-04-29 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN218484554U true CN218484554U (en) | 2023-02-17 |
Family
ID=85183054
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202123429737.XU Active CN218484554U (en) | 2021-04-29 | 2021-12-31 | Multifunctional fusion detection device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN218484554U (en) |
-
2021
- 2021-12-31 CN CN202123429737.XU patent/CN218484554U/en active Active
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106580294B (en) | Physiological signal remote monitoring system based on multi-mode imaging technology and application | |
| US9854976B2 (en) | Pulse wave velocity measurement method | |
| WO2018107915A1 (en) | General noninvasive blood glucose prediction method based on timing analysis | |
| CN102469981B (en) | Ultrasonic diagnostic apparatus and region-of-interest | |
| US20160150976A1 (en) | High-resolution thermal imaging system, apparatus, method and computer accessible medium | |
| CN103263271A (en) | Non-contact automatic blood oxygen saturation degree measurement system and measurement method | |
| KR102376330B1 (en) | Hybrid type gait analysis apparatus for preventing fall and management system including the same | |
| CN112232256A (en) | Non-contact motion and body measurement data acquisition system | |
| CN116407096A (en) | Vital sign detection device, system and data processing method | |
| US20230172562A1 (en) | Disease detection system | |
| US11529094B2 (en) | System, method, and apparatus for temperature asymmetry measurement of body parts | |
| CN218484554U (en) | Multifunctional fusion detection device | |
| CN114795125A (en) | Middle and old aged physical examination system and device based on multi-modal physiological signal processing | |
| EP4331477A1 (en) | Vital sign detection apparatus and system and data processing method | |
| WO2022258560A1 (en) | System for assisting with provision of diagnostic information | |
| KR102335770B1 (en) | Devices and methods for noninvasive physiological analysis | |
| CN203524643U (en) | OCT scanning device and OCT device for ophthalmology department | |
| Armanfard et al. | Development of a Smart Home-Based Package for Unobtrusive Physiological Monitoring | |
| CN109009158A (en) | A kind of system for detecting blood sugar and method based on robot | |
| CN118055727A (en) | System for aiding in providing diagnostic information | |
| CN213821386U (en) | Sign data acquisition device | |
| WO2022064825A1 (en) | Electronic device, control program for electronic device, and control method for electronic device | |
| Alhammad | Face detection for pulse rate measurement | |
| KR101264119B1 (en) | Apparatus for diagnosing patient by oriental medicine | |
| US20220296158A1 (en) | System, method, and apparatus for temperature asymmetry measurement of body parts |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |