Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N7/00—Television systems
  • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
  • A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
  • A61B5/0205—Simultaneously evaluating both cardiovascular conditions and different types of body conditions, e.g. heart and respiratory condition
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
  • A61B5/0507—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves  using microwaves or terahertz waves
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/08—Detecting, measuring or recording devices for evaluating the respiratory organs
  • A61B5/0816—Measuring devices for examining respiratory frequency
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
  • A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
  • A61B5/1102—Ballistocardiography
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/117—Identification of persons
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/74—Details of notification to user or communication with user or patient ; user input means
  • A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
  • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
  • G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
  • G01S13/06—Systems determining position data of a target
  • G01S13/08—Systems for measuring distance only
  • G01S13/32—Systems for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated
  • G01S13/34—Systems for measuring distance only using transmission of continuous waves, whether amplitude-, frequency-, or phase-modulated, or unmodulated using transmission of continuous, frequency-modulated waves while heterodyning the received signal, or a signal derived therefrom, with a locally-generated signal related to the contemporaneously transmitted signal
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
  • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
  • G01S7/003—Transmission of data between radar, sonar or lidar systems and remote stations
  • G01S7/006—Transmission of data between radar, sonar or lidar systems and remote stations using shared front-end circuitry, e.g. antennas
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
  • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
  • G01S7/02—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00
  • G01S7/41—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S13/00 using analysis of echo signal for target characterisation; Target signature; Target cross-section
  • G01S7/415—Identification of targets based on measurements of movement associated with the target
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V20/00—Scenes; Scene-specific elements
  • G06V20/50—Context or environment of the image
  • G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
  • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
  • G06V40/161—Detection; Localisation; Normalisation
  • G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
  • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
  • A61B5/6887—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
  • A61B5/6891—Furniture
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F2218/00—Aspects of pattern recognition specially adapted for signal processing
  • G06F2218/12—Classification; Matching
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
  • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
  • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
  • G06V40/15—Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04W—WIRELESS COMMUNICATION NETWORKS
  • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
  • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Definitions

• the present disclosure relates to home security systems and health monitoring. More particularly, the present disclosure is directed to a system for detecting, identifying, and monitoring individuals in a home or business by using their heartbeat, respiration, or other vital signals, a camera that remotely detects the vitals of individuals, a light bulb that monitors vital statistics of occupants in a room, and a remote monitor for detecting infant vital signs.
• Modem home and commercial security systems are generally comprised of three primary detection methods to detect intruders: door/window sensors, motion sensors, and glass break sensors. While these technologies can be effective in some situations, they are all possible to defeat so as to miss an intruder or unwanted occupant.
• glass break sensors can be defeated by a glass cutter or by simply breaking a window with minimal sound; motion sensors can be defeated by crawling or otherwise keeping a low profile while moving close to walls; and door/window sensors can be overcome with the use of magnets.
• Other means and methods may be available to defeat these technologies.
• intruders can gain access to a home or business when an alarm is not activated, lying in wait until other occupants have gone to sleep or left the business.
• such systems require time money and time in installing and maintaining a sensor at each door, window or other potential entry point.
• Other existing remote monitoring systems may monitor vital information, such as heart rate, by using a sensor that contacts the child.
• existing monitors may use a pulse- oximeter that may be place, for example, in a sock.
• monitors may lose contact with the child’s body rendering the system incapable of monitoring. Having such contact sensors also poses a potential health hazard when positioned in an infant’s crib where the monitoring equipment may pose an entanglement or choking hazard.
• the present invention seeks to solve these and other problems.
• a home occupant detection and monitoring system comprises a sensor unit comprising a radio wave transmitter, a radio wave receiver, and a wireless transmitter; a user interface comprising a microcontroller, a wireless receiver configured to receive the wireless signals transmitted from the sensor unit, a means for user input, and a network card; and, a means for alerting occupants and third-parties to a triggering event; wherein the microcontroller, based upon logic, activates the alerting means at a triggering event.
• a home occupant detection and monitoring system further comprises one or more cameras aligned with the sensor unit, the camera configured to activate and/or record at a triggering event.
• a home occupant detection and monitoring system comprises a radio wave transmitter capable of transmitting Frequency Modulated Continuous Wave (FMCW) signals; one or more radio wave receivers positioned in orthogonal locations (or, in general, non parallel locations) around an environment to be monitored; a user interface comprising a microcontroller, a wireless transceiver, a means for user input, and a network card; and, a means for alerting occupants and third-parties to a triggering event; wherein the microcontroller, based upon logic, activates the alerting means at a triggering event.
• FMCW Frequency Modulated Continuous Wave
• a home occupant detection and monitoring system comprises a radio wave transmitter capable of transmitting FMCW, wherein the FMCW is configured to map walls of a structure by measuring distance of walls and objects with maximum return.
• an antenna of the radio wave transmitter, receiver, or transceiver rotates, either electronically or mechanically, to monitor an environment using narrow beam scanning (e.g., +/-45 deg.).
• the antenna would use wide (e.g., 90 deg.) beam scanning with a moveable, higher gain antenna to scan the environment for vital signals.
• a method of detecting occupants in a structure comprises using radar to detect one or more occupants within a structure, comparing the total number of occupants within the structure with the total number of occupants allowed in the structure as programmed by a user; and, alerting one or more individuals when the number of occupants within a structure drops below, or exceeds, a predetermined threshold.
• a method of detecting occupants in a structure comprises using radar to detect one or more occupants within a structure, using programmed logic to compare the radar signals with one or more stored signals, and identifying the occupants based upon the radar signals.
• a method of detecting, identifying, and monitoring users comprises using radar to detect one or more occupants within a structure, using programmed logic to compare the radar signals with one or more stored signals, and identifying the occupants based upon the radar signals, wherein when an irregular radar signal is received from one or more known occupants, alerting one or more occupants to the irregular radar signal received.
• Fig. l is a flowchart of a home occupant detection and monitoring system
• FIG. 2 is a flowchart of a home occupant detection and monitoring system
• FIG. 3 is a flowchart of a home occupant detection and monitoring system
• FIG. 4 is a flowchart of a home occupant detection and monitoring system
• FIG. 5 is a block diagram showing components of a sensor for use with a home occupant detection and monitoring system.
• Fig. 6 is a schematic diagram of certain components of a home occupant detection and monitoring system.
• Fig. 7 is a block diagram showing components of a camera.
• Fig. 8 is a perspective view of a contactless vital sign monitor.
• Fig. 9 is a partially cutaway perspective view of the contactless vital sign monitor of Fig. 8
• Fig. 10 is a schematic diagram of a vital sign monitoring system.
• Fig. 11 illustrates a variety of potential placement positions for a contactless vital sign monitor.
• Fig. 12 is a perspective view of a contactless vital sign monitor.
• Fig. 13 is a partially cutaway perspective view of the contactless vital sign monitor of Fig. 12.
• references to“one embodiment,”“an embodiment,”“various embodiment,” and the like, may indicate that the embodiment(s) so described may include a particular feature, structure, or characteristic, but not every embodiment necessarily includes the particular features, structure, or characteristic. Further, repeated use of the phrase“in one embodiment,” or“in an embodiment,” do not necessarily refer to the same embodiment, although they may.
• Coupled may mean that two or more elements are in direct physical or electrical contact. However,“coupled” may also mean that two or more elements are not in direct contact with each other, but yet still cooperate or interact with each other.
• an“home” may be used throughout the disclosure, the scope of the invention is not so limited. In other words, the system disclosed herein may be used in any structure or environment. Further, as used herein, an“occupant” may refer to a person or an animal.
• the home occupant detection and monitoring system solves the problems in the prior art—namely, the ability to monitor more than entry/exit points, and detecting the presence of an individual without the shortcomings of motion sensors. Further, the ability to monitor various health aspects of individuals within a home is an added benefit of the system disclosed herein.
• Some benefits of using heartbeat and breathing detection to monitor occupants include: 1) the ability to penetrate walls and concrete using radio waves so that an intruder cannot hide from detection, which would more readily detect and deter intruders from entering a premise; 2) the ability to detect when an individual has left the premise, such as a child sneaking out at night or other similar situations; and 3) the ability to monitor the health of individuals within a home or structure and potentially prevent injury or death by alerting occupants or authorities to potential health events, such as a child choking, an infant not breathing while asleep, an occupant experiencing a stroke, cardiac event, or respiratory distress, or other health event.
• This system disclosed herein is programmable to the specific occupants of the home and is able to alert other occupants of the home when one of the occupants is experiencing a health issue, has left the premises, or other programmable event. It also has the ability to alert the occupants to the entry of an unknown occupant.
• a home occupant detection and monitoring system comprises a sensor unit 500 comprising a radio wave transmitter 502, a radio wave receiver 504, and a wireless transmitter 506.
• the radar components e.g., radio wave transmitter and receiver
• a radar system comprises a transmitter producing electromagnetic radio waves, a transmitting antenna, a receiving antenna, and a receiver.
• the transmitter 502 and receiver 504 may use the same antenna for transmitting and receiving.
• the wireless transmitter may be capable of both sending and receiving signals.
• the sensor unit 500 may include electronic circuitry 508 as would be understood by one of ordinary skill in the art.
• Such circuitry 508 may include provisions for transforming, analyzing, digitizing or otherwise manipulating signals or information received by the sensor unit 500.
• the circuitry 508 may comprise an analog-to-digital converter, a digital-to-analog converter, memory, logic circuits or other components.
• the circuitry 508 may comprise individual components or one or more integrated circuit boards having one or more such components.
• the sensor unit(s) 500 may be placed at any number of locations, as discussed in more detail below.
• the transmitter 502 then transmits a radio wave signal and the receiver 504 receives the returned signal.
• a monitoring system may comprise a number of elements connected into a network.
• the monitoring system may comprise multiple sensors 500A, 500B. While two sensors 500A, 500B are illustrated, the system may employ many more sensors distributed in a single room or in multiple rooms.
• the sensor transmitter 502 transmits a radio wave signal and the receiver 504 receives the returned signal.
• the returned signal received by the sensor 500, or a signal representative of information contained in the returned signal is transmitted to a control unit 602 for analysis via the wireless transmitter 506.
• wireless transmitters are preferred, they are not required, and wired connections may be used.
• the network need not require the internet and may be a local area network, mesh network, or other method of communication.
• the control unit 602 ideally comprises a user interface, a microcontroller, a wireless receiver 606 configured to receive the wireless signals transmitted from the sensor unit 500A, 500B, a user input device, and a network communication device such as a network card (wired, wireless, or equivalent communication protocol, including, Bluetooth, ZigBee, Wi-Fi, cellular, LoRa, IR, UART, ASK, FSK and others).
• the user interface, microcontroller, user input device and other elements of the control unit 602 may form part of a user terminal 604.
• the user terminal 604 may be a personal computer, a personal electronic device such as a tablet or smartphone, including apps for such, a dedicated hardware interface, or another appropriate user interface mechanism.
• the user input device may be a physical device or software application, including a keyboard, a touchscreen, voice commands, or wireless connections with a smart device (e.g., smartphone app or similar).
• the sensor unit of the system transmits a radio wave signal and then receives the signal back in step 102 (i.e., radar).
• the received signals are transmitted to a control unit, where, in step 104, they are analyzed using logic programmed on the microcontroller or other processor.
• the received signals may also be stored in memory (e.g., flash memory).
• the microcontroller in step 106, is configured to identify whether a signal received is static (i.e., non-moving) or dynamic/phase varying signal (e.g., heartbeat, lungs, skin displacement, etc.). This may be accomplished using a human-determining radar application (software that is programmed to extract and compare the dynamic signal to the dynamic signals stored in memory). While the foregoing radar description is not exhaustive, an exemplary radar system is disclosed in U.S. Patent Application US20140316261 Al titled,“Life Detecting Radars” to Lux et al., which is incorporated herein by reference in its entirety. Continuing, if no human signal is present (i.e., all radio wave signals received were static), then the structure is secure (step 108).
• a signal is dynamic (i.e., consistent with that of an occupant (e.g., heartbeat and/or breathing detected))
• the signal is compared in step 110 to signals stored in memory.
• the signals in memory were recorded at installation of the system, according to the user’s desires. If in steps 112 and 114, the signal is authorized (i.e., the received signal matches a signal in memory), then the house is secure. In steps 112 and 116, if, based upon the logic, a triggering event has occurred (i.e., the received signal does not match a signal in memory), an alert is activated.
• Triggering events may vary according to user desire and according to the number of sensor units deployed in the house.
• Example triggering events are as follows: the number of heartbeats in a home drops below, or exceeds, a predetermined threshold; an unrecognized heartbeat enters the home; a known heartbeat is in the home during unauthorized hours; a known heartbeat becomes irregular; and others.
• the alert may comprise an alert device that provides an alert to a user of the monitoring system, including: 1) a home alarm such as an audible speaker or visually detectable indicator or light; 2) a notification to an internet connected device (e.g., smartphone, tablet, vehicle, etc.); 3) contacting emergency responders or other third-parties; and others.
• the control unit may be programmed to recognize heartbeats of specific people. This may be accomplished during an initial configuration of the system. For example, each occupant’s unique heartbeat and/or breathing pattern may be read and stored in memory of the system. For example, a particular sensor may be used for a calibration mode, wherein when a heartbeat is received by the control unit from the sensor in calibration mode, an option is made available to name the received signal and set a trust level. Various trust levels may be assigned by a user, allowing the user to distinguish between occupants who live there and visitors.
• a control unit may be programmed to recognize familiar heartbeats based upon the number of visits to the house, and, if the user desires, the alert may be deactivated.
• the homeowner may simply set the system to not activate an alert after the fourth separate entry of the occupant (or whatever number the homeowner desires).
• the homeowner/user can select the type of alerting means to be activated. For example, a user may select a mobile alert (e.g., text message) vs. house alarm (e.g., audible alarm using speakers) vs. contacting emergency responders, etc., depending upon the triggering event. For example, an unknown heartbeat being detected in the middle of the night may warrant more aggressive alerting means (e.g., home loudspeaker) than during the late afternoon when friends are known to visit (e.g., text message).
• the types of alerts are selectable by a user, along with the triggering events, using programmed computer software.
• a method of detecting occupants in a structure comprises using radar (e.g., radio waves) to detect one or more occupants within a structure and compares the total number of occupants within the structure with the total number of occupants allowed in the structure, as programmed by a user.
• Fig. 4 illustrates a flowchart of this embodiment. As shown in step 402, radio wave signals are received by a sensor unit and are transmitted to a control unit, where, in step 404, the number of human signals (e.g., received signals that are indicative of human life, such as a heartbeat or breathing patterns, etc.) are compared against the total number of authorized individuals.
• radar e.g., radio waves
• step 406 if the number of received signals do not exceed the number of allowed signals, the system loops. However, if the microcontroller concludes that the number of received signals exceeds the number authorized, an alert is initiated in step 408. For example, a user having a house with four occupants may configure the control unit to activate the alerting means if the number of heartbeats exceeds four within the structure. To prevent unwanted alerts, a user may choose a timeframe for notification (e.g., 10 pm to 7 am) or another parameter.
• a timeframe for notification e.g. 10 pm to 7 am
• the system may be programmed to initiate an alert/alarm if the number of human signals received drops below a given number, which may be useful in detecting when, for example, teens are sneaking out, when a handicapped or otherwise impaired individual (e.g., Alzheimer’s disease) wanders off, or other uses, as desired by a user.
• the sensor unit may continuously transmit (e.g., continuous radio wave/FMCW) and receive signals, or may do so intermittently.
• the sensor unit(s) may be placed in one or more locations, depending upon the structure and the notifications desired by a user.
• a single sensor unit may be placed in the apex of an attic, where it may transmit radio wave signals downward throughout an entire house for the purpose of monitoring the entire house with a single sensor unit.
• the control unit may not be able to adequately detect when an occupant has left the structure vs. suffered from cardiac arrest. Therefore, in another embodiment, a user may place additional sensors at thresholds so as to accurately identify who and when an occupant exits the home.
• FIG. 2 illustrates a flowchart wherein the system both verifies that the human is authorized to be in the home, and likewise compares the signal against known, previously inputted signals, to verify the health status of the individual.
• signals indicative of health concerns may be when the heart rate is increased or decreased beyond a set of preprogrammed parameters (which may be known standards in healthcare or specific to an individual—which may be accomplished during calibration by taking several readings over the course of time and perhaps days, and including pre- and post-workout, etc.), when the respiration rate is outside of programmed parameters, and others.
• preprogrammed parameters which may be known standards in healthcare or specific to an individual—which may be accomplished during calibration by taking several readings over the course of time and perhaps days, and including pre- and post-workout, etc.
• a plurality of sensor units may be used and may be placed in individual rooms for more direct readings and for the purpose of more easily identifying the location of the heartbeat.
• the sensor units may also be concealed behind walls, ceilings, in fixtures (e.g., appliances, light bulbs) or personal items (e.g., picture frames).
• each sensor unit may be uniquely identifiable (e.g., MAC address, IP address, etc.) such that the control unit is able to determine which sensor unit sent the signal to the control unit.
• a control unit may be programmed at installation/calibration when the sensor units are installed (e.g., sensor unit“Five” is located in the“living room”).
• the alerting means may indicate to a user not only that an unknown heartbeat has entered the structure but may also actively determine which room the stranger is located. Further, if the system is also configured to monitor health (as discussed elsewhere herein), the system may be able to identify the occupant and the location of the occupant having an emergency (e.g., respiratory distress in a child’s room).
• Each sensor unit may be in direct communication with the control unit or may be configured in a mesh network with signals being relayed to the control unit for analysis. Further, it will be appreciated that the sensor units may be omnidirectional, unidirectional, fixed, pivotable, etc. Further, the antenna of the sensor unit may be pivotable in relation to the sensor unit.
• a method of detecting occupants in a structure comprises using radar to detect one or more occupants within a structure, using programmed logic to compare the received radar signals with one or more stored signals, and identifying the occupants based upon the radar signals.
• the system may be used to only identify health concerns. In other words, it is not necessary for the system to be used as both security and health monitoring.
• a health monitoring system as shown in Fig. 3 may be well suited for care facilities, schools, or other situations where the need to monitor specific/special needs individuals is critical.
• radar may be used to generate a signal of each individual that needs monitoring.
• the returned radar signal i.e., the received signal
• the control unit compares those received signals with the signals in memory (step 306) to determine if the received signals are irregular radar signals (e.g., increased heart rate, increased respiration, etc.).
• an alert/alarm is initiated in step 308.
• the system may be configured to monitor thresholds to help prevent unwanted wandering off of specific/special needs individuals, which may be particularly beneficial in schools and care facilities where it may be difficult for adults to maintain constant care of individuals.
• a method of detecting, identifying, and monitoring users comprises using radar to detect one or more occupants within a structure, using programmed logic to compare the radar signals with one or more stored signals, and identifying the occupants based upon the radar signals, wherein when an irregular radar signal is received from one or more known occupants, alerting one or more occupants to the irregular radar signal received.
• the alerts may take the form of phone calls, text messages or emails, third-party contact, audible house alarms or verbal information via speakers, or contacting emergency responders.
• received signals may be recorded/stored for additional uses, such as by law enforcement in prosecuting an individual.
• heartbeat and respiration patterns e.g., heartbeat and respiration patterns
• an invader e.g., an invader’s heartbeat data would be collected and stored by the control unit. The information may then be used to verify that the correct individual has been apprehended— like fingerprint or DNA evidence is currently used.
• Convenience stores or other establishments may place a sensor at the threshold for the purpose of cataloging individuals. If an individual were to attempt to rob the store, the data may be used in
• the radar signals may be compared for confirmation.
• a home occupant detection and monitoring system comprises a radio wave transmitter capable of transmitting Frequency Modulated Continuous Wave (FMCW) signals; one or more radio wave receivers positioned in orthogonal locations (or, in general, non parallel locations) around an environment to be monitored; a user interface comprising a microcontroller, a wireless transceiver, a means for user input, and a network card; and, a means for alerting occupants and third-parties to a triggering event; wherein the microcontroller, based upon logic, activates the alerting means at a triggering event.
• the FMCW allows for
• a home occupant detection and monitoring system comprises a radio wave transmitter capable of transmitting FMCW, wherein the FMCW is configured to map walls of a structure by measuring distance of walls and objects with maximum return.
• the FMCW is configured to map walls of a structure by measuring distance of walls and objects with maximum return.
• a user may transmit a signal from a smartphone to a server or other network-connected device requesting the map.
• the map may then be transmitted to the user, wherein occupants are displayed on the map.
• an alert and the map are transmitted to a user at a triggering event (i.e., home should be vacant when away on vacation, and an occupant is detected).
• cameras may couple to the system such that a user may view the room/occupant in real-time.
• an antenna of the radio wave transmitter, receiver, or transceiver rotates, either electronically or mechanically, to monitor an environment using narrow beam scanning (e.g., +/-45 deg.).
• the antenna would use wide (e.g., 90 deg.) beam scanning with a moveable, higher gain antenna to scan the environment for vital signals.
• the higher gain antenna would continually sweep the room, detecting vital signs of occupants.
• One example radar technology capable of detecting heartbeats is NASA’s Finder technology.
• the Finder technology is a mobile system intended for locating live occupants in disaster scenarios. For example, if a building collapses as the result of an earthquake, the Finder system may be used to scan the rubble and detect any living individuals.
• the technology is disclosed in U.S. Patent Publication US20140316261 Al and is incorporated herein by reference in its entirety. While this system is very beneficial for that use, it is not capable of detecting occupants in a home and activating alerting means in response to triggering events.
• Another technology known as HERMA and disclosed in U.S. Patent Publication
• a life detection and bio-identification camera uses radio frequency life detection technology to detect the presence of an individual and register their unique heart rhythm for identification purposes.
• This camera can be installed at the entry points of a home, behind the counter of a business near a cash register or at a bank or any other place that desires to use surveillance as a form of security.
• embodiments of the bio identification camera 700 may include a camera module 702.
• the camera module may comprise a lens and appropriate circuitry to render, record, or transmit still photographs or motion video.
• Embodiments of the camera 700 may also contain a radio wave transmitter 502 and receiver 504.
• the sensor transmitter 502 transmits a radio wave signal and the receiver 504 receives the returned signal.
• the bio identification camera 700 may detect the motion of the heart of the subject that the camera is recording.
• the signal from the motion of the heart of the subject is received by an antenna in the camera.
• a signal processor 508 and/or microcontroller stores the unique rhythm of the heart being recorded.
• a software algorithm can compare the data to any future recording of the heart rhythm and be used to identify the person.
• Embodiments of such a camera with life detection and non-contact bio-identification capabilities may further comprise a wireless transmitter 506 with the ability to communicate wirelessly with another device by means such, as but not limited to Bluetooth, Wi-Fi, cellular or any other wireless means.
• a wireless transmitter 506 with the ability to communicate wirelessly with another device by means such, as but not limited to Bluetooth, Wi-Fi, cellular or any other wireless means.
• Embodiments may also include a remote database that receives and stores signals for analysis.
• storage/memory device to store images and RF signals (or their encoding); and a processor to run the necessary algorithm for people identification.
• Identification on images can be done using several algorithms including, but not limited to, those described in "DeepFace: Closing the Gap to Human-Level Performance in Face Verification” by Taignman, Yang, Ranzato, & Wolf, last accessed on Feb. 06, 2018 at https://www.cs.toronto.edu/ ⁇ ranzato/publications/taigman_cvprl4.pdf; and "FaceNet: A Einified Embedding for Face Recognition and Clustering" by Schroff, Kalenichenko, and Philbin, last accessed on Feb. 06, 2018 at https://arxiv.org/abs/l503.03832. This publication is incorporated herein by reference.
• the algorithm generates an encoding of the image.
• An encoding is any function applied to the raw pixels of the image and that outputs a N dimensional vector of real numbers.
• Identification is accomplished by defining a similarity metric which takes as input the encoding of two images and outputs a "small” number if the two images belong to the same person or a "large” number otherwise.
• the threshold to discriminate between "small” and “large” is a parameter of the algorithm and is set by analyzing known data. Examples of similarity metrics could be, but are not limited to, Euclidean or L2 distance, Ll or Minkowski distance, correlation etc.
• Sample images taken from the camera are processed by a detection algorithm with the purpose of identifying the presence of a face in the image and the bounding boxes containing the face.
• Identification via RF signal can be done by applying algorithms similar to those aforementioned where, in this case, the inputs are few second-long samples of the returned RADAR signal after being processed to extract the heartbeat signal.
• Embodiments of a system in accordance with the present invention may constantly sample camera frames and the returned signal of the RADAR system to perform identification. Every time an image of a face is extracted from the captured frame, the image is processed through one of the above-mentioned algorithms to check if such a face belongs to one of the subjects that are allowed on the premises by comparing the encoding of the new image with those present in the stored database of the subjects who have been granted access to the premises. A similar procedure is applied to the heartbeat signal extracted from the RADAR returned signal.
• Embodiments may apply a multiple step approach to identification and notification.
• An identification system may first employ a method as described herein to identify a person using heart rhythm or a radar signal indicative of other information. If the initial first step fails to identify a person, the system may start recording the images captured by the camera as well as the RF signal and may take other actions, such as trigger an alarm, send notifications to a user or system manager, and/or contact law enforcement. Such correlated recordings of the camera and RF signal may be later used to positively identify the person recorded if the person is again presented to an embodiment of the camera, such as in a police line-up. Alternatively, the recording may be used to identify an individual by comparing the recording with sample recordings previously stored in a database.
• an algorithm adapted for face recognition could be enhanced to identify an individual wearing a mask or other means intended to hide or camouflage their identity. Identification could trigger an alarm response, as discussed above. Alternatively, identification could trigger the system to take other actions such as locking doors, restricting access to resources, for example a safe or cash register, or any other appropriately automated response.
• embodiments of a system may comprise a light bulb that contains the transmitting, receiving and processing components described above. Such a light bulb may be used to perform any or all of the functions of the various systems described above.
• Embodiments of the light bulb may be made as a standard bulb that can be inserted into any light fixture. This light can also be a small light that can be plugged into any standard outlet such as a night light.
• FIG. 8 Further embodiments include a contactless vital sign monitoring system.
• contactless means that the monitoring system does not require touching the subject being monitored or attaching or connecting any component to the subject except for the use of radio waves as described above. As such, contacting would include physical touching but does not include directing radio waves or other electromagnetic radiation at the subject.
• Such a monitoring system may be used to monitor vital signs of an infant or child during periods without direct supervision, such as during periods of sleep.
• the vital signs may include various attributes that it may be useful to monitor, including heart rate and breathing as discussed above.
• the monitor may include sensors or systems to monitor other vital signs, such as temperature, or other movements and activity.
• vital sign monitor 800 may comprise a case 802.
• the case may comprise a length 802a, width 802b, and thickness 802c. Embodiments of the case may be configured such that the length is greater than the width, which is greater that the thickness. Further, the case may be generally rectangular and may comprise a generally flat face 804.
• the face 804 of the monitor case 802 may comprise a monitoring lens 806 through which monitoring signals, as described above, are transmitted and received.
• the lens may be formed of an appropriate material that is transparent to the radio signals used by the monitoring system, which may include plastic or glass.
• the face may further comprise a power/activity indicator 808.
• This indicator may comprise a light, such as an LED, that emits light in one or more colors to indicate the status of the monitor, such as whether the monitor: is connected to a power source, has been turned on, is actively monitoring one or more vital signs, has triggered an alarm, or any number of other possible states. While these elements have been illustrated as positioned on the face 804 of the monitor case 802. It should be understood that they may also be positioned on other portions of the case.
• the monitor 800 may further comprise a wireless communication module 810 with the ability to communicate wirelessly with another device by means such, as but not limited to Bluetooth, Wi-Fi, cellular or any other wireless means.
• the monitor may comprise a cable 812 extending from the case.
• the cable 812 may be used to provide power to the monitor.
• the cable may be used to provide communications between the monitor and other devices or systems. In embodiments of the cable is a EiSB cable.
• the monitor case 802 may comprise one or more internal cavities that at least partially house various components of the monitor. Such components may include a monitoring antenna 814 that provides for sending and/or receiving the RF signal used to monitor the vital signs.
• the monitor may also comprise a printed circuit board 816 or other circuitry that analyzes, manipulates, records, stores or otherwise process the signals sent or received by the antenna 814.
• the monitor may further comprise a battery 818.
• the battery may allow the monitor to function for a period of time without connection to another power source.
• the battery 818 may be rechargeable, and the cable 812 may provide power to recharge the battery in additions to or instead of providing power to operate the monitor.
• the communication module 810 of embodiments of the monitor may comprise a printed circuit board 820 containing electronic circuitry to control operation of the wireless module.
• the wireless module may also comprise an antenna 822 for wireless communication.
• a contactless vital sign monitor may comprise the monitor 800.
• the monitor may be capable of communications with a remote receiving device 824, which may be a communication device specifically adapted to provide vital sign
• the monitor may be a monitor panel or station provided in conjunction with the monitor 802.
• the receiving device may be a multipurpose handheld device, such as a smartphone, mobile phone, tablet or computer.
• the monitoring system may comprise a software application (app) that operates on the receiving device to display information regarding one or more vital signs of the child.
• the monitor 800 may communicate directly with the receiving device 824 through either a wired or wireless connection. Alternatively, the monitor 800 may communicate with the receiving device 824 by way of a network 826.
• the network may comprise a local area network, the Internet, or any other appropriate network using protocols that would be known to one of ordinary skill in the art.
• Other monitoring devices may also be connected to the monitor 800 through the network 826, and the same or different information by be sent to each of the multiple devices. For example, a first set of information may be provided to a monitoring device positioned in proximity to the child or within the same dwelling, while a second set of information, which may include less information or fewer details, is communicated to a more remote monitoring device.
• the monitor may be placed in a variety of different positions as long as the child is positioned within the range and path of the RF transmissions and nothing that is opaque to the RF transmissions blocks the path.
• the monitor employs a floor mount (A) where the monitor is placed on the floor or another surface below the bed, which may be a crib 828 or other furniture supporting the child for rest or sleeping.
• the monitor may employ: a crib mount (B) where the monitor is attached to the structure of the crib or bed; a wall mount (C) where the monitor is attached to a wall or other architectural feature that is sufficiently adjacent to the crib; a tabletop mount (D) where the monitor is positioned on a table, shelf or other piece of furniture sufficiently adjacent to the crib; or a stand mount (E) where the monitor is attached to a self-supporting stand that is positioned sufficiently adjacent to the crib.
• a crib mount B
• C wall mount
• D tabletop mount
• E stand mount
• Figs. 12-13 illustrate an alternative embodiment of the monitor 800.
• Vital sign monitor 800 may comprise a case 902.
• the case may comprise a length 902a, width 902b, and height 902c.
• Embodiments of the case may be configured such that the height is greater than the width and length such that the case extends upward from a supporting surface.
• the case may be generally cylindrical and may comprise a generally flat face 904.
• the case may further comprise one or more covers 905 that follow the cylindrical lines of the case to maintain the general, overall cylindrical shape.
• the case may have the general shape of a truncated cone, a rectangular cuboid, a hemispherical cylinder or another shape capable of accommodating the components discussed below.
• the face may have other shapes and may be rounded or angled, may have steps, protrusions, or subsections, or may have other nonplanar shapes or features.
• the face 904 of the monitor case 902 may comprise a monitoring lens 806 through which monitoring signals, as described above, are transmitted and received.
• the lens may be formed of an appropriate material that is transparent to the radio signals used by the monitoring system, which may include plastic or glass.
• the face may further comprise a power/activity indicator 808.
• This indicator may comprise a light, such as an LED, that emits light in one or more colors to indicate the status of the monitor, such as whether the monitor: is connected to a power source, has been turned on, is actively monitoring one or more vital signs, has triggered an alarm, or any number of other possible states. While these elements have been illustrated as positioned on the face 904 of the monitor case 902. It should be understood that they may also be positioned on other portions of the case.
• the monitor 800 may further comprise a communication module 810 with the ability to communicate with another device by means such, as but not limited to Bluetooth, Wi-Fi, cellular or any other wireless means.
• the monitor may comprise a cable 812 extending from the case.
• the cable 812 may be used to provide power to the monitor.
• the cable may be used to provide communications between the monitor and other devices or systems. In embodiments of the cable is a USB cable.
• the monitor may comprise other component useful in the monitoring of a child.
• the monitor 800 may comprise a still photograph or video camera 930.
• a light source 934 may also be provided.
• the light source may be an infrared light that is not perceptible to the child but that may provide illumination that the video camera 930 is capable of perceiving.
• Further embodiments may comprise a microphone 932.
• the monitor 800 may process and transmit a combination of vital sign information together with video and audio information to provide a more complete assessment of the condition of the child.
• the monitor 800 may comprise a base 936 that supports the case 902 and is rotatably connected to the case. The viewing angle of the monitor may thereby be adjusted without the need to move the base.
• the monitor may comprise motors, gearing and circuitry that allow for remotely controlling movement of the case 902 relative to the base 936 so that the area being a monitored may be adjusted.
• the monitor case 902 may comprise one or more internal cavities that at least partially house various components of the monitor. Such components may include a monitoring antenna 814 that provides for sending and/or receiving the RF signal used to monitor the vital signs.
• the monitor may also comprise a printed circuit board 816 or other circuitry that analyzes, manipulates, records, stores or otherwise process the signals sent or received by the antenna 814.
• the monitor may further comprise a battery 818.
• the battery may allow the monitor to function for a period of time without connection to another power source.
• the battery 818 may be rechargeable, and the cable 812 may provide power to recharge the battery in additions to or instead of providing power to operate the monitor.
• the communication module 810 of embodiments of the monitor may comprise a printed circuit board and antenna 821 containing electronic circuitry to control operation of the communication module and an antenna for wireless communication.
• the monitor may further comprise optics 938 and a printed circuit board 940 or other circuitry for the video camera 930.
• the monitor system has been indicated as monitoring the vital signs of an infant or child.
• embodiments of the monitoring system could be used in any situation where contactless monitoring of vital signs would be advantageous.
• the system may be advantageous for monitoring the vital signs of hospital patients in order to reduce the need for contact monitoring or for disturbing the patient.
• the home occupant detection and monitoring system solves the problems in the prior art, including the ability to detect an occupant without the need of monitoring structural items (e.g., doors and windows), the ability to determine the number of occupants within a structure, their location, and their current health status, the ability accurately detect and record the vital signs of individuals for bio-identification, and the ability to monitor vital sign information of an infant or child.
• structural items e.g., doors and windows

Landscapes

• Health & Medical Sciences (AREA)
• Engineering & Computer Science (AREA)
• Life Sciences & Earth Sciences (AREA)
• Physics & Mathematics (AREA)
• General Health & Medical Sciences (AREA)
• Animal Behavior & Ethology (AREA)
• Public Health (AREA)
• Veterinary Medicine (AREA)
• Surgery (AREA)
• Biophysics (AREA)
• Pathology (AREA)
• Biomedical Technology (AREA)
• Heart & Thoracic Surgery (AREA)
• Medical Informatics (AREA)
• Molecular Biology (AREA)
• Remote Sensing (AREA)
• Radar, Positioning & Navigation (AREA)
• Computer Networks & Wireless Communication (AREA)
• General Physics & Mathematics (AREA)
• Physiology (AREA)
• Pulmonology (AREA)
• Cardiology (AREA)
• Multimedia (AREA)
• Oral & Maxillofacial Surgery (AREA)
• Signal Processing (AREA)
• Theoretical Computer Science (AREA)
• Dentistry (AREA)
• Computer Security & Cryptography (AREA)
• Human Computer Interaction (AREA)
• Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
• Radiology & Medical Imaging (AREA)
• Alarm Systems (AREA)
• Measuring And Recording Apparatus For Diagnosis (AREA)

Applications Claiming Priority (5)

Publications (2)

Family

ID=66750349

Family Applications (1)

Country Status (3)

Families Citing this family (4)

Family Cites Families (10)

• 2018
  • 2018-12-06 EP EP18887010.9A patent/EP3720342A4/de active Pending
  • 2018-12-06 BR BR112020011425-1A patent/BR112020011425A2/pt unknown
  • 2018-12-06 WO PCT/US2018/064273 patent/WO2019113332A1/en unknown

Also Published As

Similar Documents

Legal Events