WO2023012780A1 - Systems, methods and smart mattresses for monitoring a subject in a specific environment - Google Patents

Systems, methods and smart mattresses for monitoring a subject in a specific environment Download PDF

Info

Publication number
WO2023012780A1
WO2023012780A1 PCT/IL2022/050787 IL2022050787W WO2023012780A1 WO 2023012780 A1 WO2023012780 A1 WO 2023012780A1 IL 2022050787 W IL2022050787 W IL 2022050787W WO 2023012780 A1 WO2023012780 A1 WO 2023012780A1
Authority
WO
WIPO (PCT)
Prior art keywords
subject
devices
mattress
sensor
controllable devices
Prior art date
Application number
PCT/IL2022/050787
Other languages
French (fr)
Inventor
Yaniv Shtalryd
Original Assignee
Hisense Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Ltd. filed Critical Hisense Ltd.
Publication of WO2023012780A1 publication Critical patent/WO2023012780A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/68Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
    • A61B5/6887Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient mounted on external non-worn devices, e.g. non-medical devices
    • A61B5/6892Mats
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • A61B5/0015Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by features of the telemetry system
    • A61B5/0022Monitoring a patient using a global network, e.g. telephone networks, internet
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/01Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/024Detecting, measuring or recording pulse rate or heart rate
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/08Detecting, measuring or recording devices for evaluating the respiratory organs
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition

Definitions

  • the invention generally relates to systems, devices and methods for monitoring a subject and more particularly to systems, devices and methods for monitoring and attending to a subject using at least a motion sensing device for sensing vital signs of the monitored subject.
  • Caregivers such as parents who are responsible for the well-being of their wards, such as an infant, an elderly subject, or someone who is infirm, may occasionally have to step away from the subject in their care, especially when the subject is sleeping. Nevertheless, the caregiver needs to remain aware of any changes in their ward's state. People requiring assistance, for example when leaving their bed, may also be unable to articulate their needs and comfort level.
  • aspects of disclosed embodiments pertain to a method for monitoring and attending to a subject in a specific environment, where the method may include at least:
  • aspects of disclosed embodiments may also pertain to a system for monitoring and attending to a subject located in a specific environment, where the system may include at least:
  • PCS processing and control subsystem
  • [0012] receive sensor data from one or more sensors located in the environment, the one or more sensors being configured to sense one or more physical characteristics of the subject and/or of the environment;
  • [0015] accumulate sensor data and analyzing accumulated sensor data to determine personal behavior characteristics of the specific subject, based on behavior of the accumulated sensor data;
  • a smart mattress which may include at least:
  • a monitoring device located within the pocket, the monitoring device having one or more sensors being configured at least to sense one or more characteristics of a subject lying over the mattress.
  • the mattress element may also include a closing mechanism for enabling closing and opening an opening in the pocket for removal and insertion of the monitoring device out of and into the pocket of the mattress element.
  • the smart mattress may be used as part of the above described system at least as one of its monitoring devices located in the subject bed or any other resting apparatus.
  • FIG. 1 is a schematic block diagram of a system for monitoring and responding to a subject in a particular monitored and subject environment such as a smart nursery, according to some embodiments;
  • FIG. 2 is a flow diagram of a method for monitoring and responding to a subject in a particular monitored and subject environment such as a smart nursery, according to some embodiments;
  • FIG. 3 is a block diagram of a system for monitoring a subject and responsively controlling one or more controllable devices that are located in an environment of the subject, according to some embodiments;
  • FIG. 4 is a flowchart, schematically illustrating a process for monitoring a subject and responsively controlling one or more controllable devices that are located in an environment of the subject, according to some embodiments;
  • Fig. 5 is a flowchart, schematically illustrating a personalization process, in which the personal behaviors of the subject are measured via the system sensors, and sensor data analysis is personally adjusted, based on typical subject behavior in different behavior types, according to some embodiments;
  • Figures 6A-6D show a smart mattress having a monitoring device embedded therein, according to some embodiments: Fig. 6A shows an isometric view of the smart mattress; Fig. 6B shows a cross sectional view of the smart mattress; and Fig. 6C shows a side view of the smart mattress; and Fig. 6D shows an elevated isometric view of the smart mattress having a rigid frame surrounding its circumference; and [0029] Fig. 7 shows an illustration of some optional components of a monitoring device for smart mattresses, according to some embodiments.
  • Embodiments of the present invention pertain to methods, devices and systems for monitoring and attending to a subject in a specific (e.g., confined) environment such as a room, in which the subject is frequently, permanently, or occasionally located such as a bedroom of the subject, a confined compartment in a nursery institution, etc.
  • a specific (e.g., confined) environment such as a room, in which the subject is frequently, permanently, or occasionally located such as a bedroom of the subject, a confined compartment in a nursery institution, etc.
  • subject used herein may refer to any human or animal that should be under supervision and care.
  • aspects of disclosed embodiments pertain to a system for monitoring and attending a subject located in a subject environment (shortly referred to herein also as a “smart room”) including one or more controllable devices located withing the subject environment, according to some embodiments of the present invention.
  • the smart-room system may include, for example, at least:
  • one or more sensors located in the monitored environment (e.g., room) and configured and located for sensing one or more characteristics of the subject and/or of the room/environment; and
  • one or more processing and control means for processing (analyzing) received sensors data/signals from the one or more sensors and determining an updated condition of the subject and/or of the subject environment, based on sensors data analysis, and controlling operation of one or more controllable devices located in the subject environment (also referred to herein as “controllable devices”, attending devices” or ’’output devices”) based on sensor data analysis results and determined subject/environment condition.
  • controllable devices are configured for example, for one or more of: [0036] stimulating the subject using one or more controllable devices referred to herein as “stimulation type” devices (for example, by applying auditory stimuli e.g., by outputting calming music or a caregiver’s recorded or real time transmitted voice or heartbeat sounds, controlling room illumination, applying tactile stimuli to the subject such as by applying tactile vibrations or rocking of the subject/bed, outputting a pleasant odor using a spraying device, heating/cooling of the room, adding/reducing humidity of the air in the room, filtering the air in the room, operating a crib-mobile device, applying visual stimuli, etc.),
  • stimulation type for example, by applying auditory stimuli e.g., by outputting calming music or a caregiver’s recorded or real time transmitted voice or heartbeat sounds, controlling room illumination, applying tactile stimuli to the subject such as by applying tactile vibrations or rocking of the subject/bed, outputting a pleasant odor using a spraying device, heating/cooling of
  • treatment type devices for example, automatic medication delivery, automatic meal/formula-milk preparation, warming, and/or delivery, automatic inhalation and/or increasing of the oxygen level in the vicinity of the subject, and the like
  • the processing and control means may be configured to use accumulated sensor data associated with the subject’s behavior (optionally responsive to operation of the controllable devices) to predict future behavioristic characteristics such as subject’s typical feeding and/or sleep times, stimulations that cause desired and undesired effects such illumination/sound stimuli that causes the subject to fall asleep better/quicker, illumination calming or agitating the subject and the like.
  • parental heartbeat sounds may be recorded or acquired in real time and played (outputted) to the subject in real time or offline.
  • vibration stimuli applied over the subject and/or rocking/swinging stimuli may be synchronized with the rhythm of played parental heartbeat sound.
  • the monitored environment/room characteristics may pertain to, for example, to one or more of: sound/noise, illumination, air parameters (quality, humidity, temperature, etc.), devices’ operation characteristics such as malfunctioning, activated/deactivated state of each device, etc. and the subject’s conditions may include vital signs of a subject such as breathing, presence in bed or in the room (in/out of bed/room), pulse/heartbeat condition, body temperature, voice patterns (crying, awake, volume and/or pitch of voice, calling to a caregiver, et.), and the like.
  • the room may be an infant's nursery (in which case the bed is typically an infant's crib), a hospital room or compartment etc., a room of a bedridden subject, an incubator, or any other confined environment in which the subject is routinely located.
  • controllable devices may also be configured for influencing room/environment conditions in order to ultimately improve the subject’s conditions in order to improve comfort and safety of the subject.
  • FIG. 1 showing a block diagram of a smart-room system 20 (shortly referred to herein as “system” 20), according to some embodiments.
  • the system 20 may include multiple sensors such as sensors 31-36 configured and located for sensing one or more characteristics of the subject and/or the room. Sensor signals, from the smart-room system’s sensors, may be transmitted to a main processor, which processes the signals to determine appropriate, real-time settings for the operation of one or more smart-controllable devices such as devices 38-49.
  • the main processor may be a cloud-based, remote server 24, which may communicate with the controllable devices 38-49 through a smart-room hub 26.
  • Communications between the smart-controllable devices 38-49, the sensors 31-36 and the smart-room hub 26 may be by any wired and/or wireless communications protocol, such as the Bluetooth Low Energy (BLE) protocol.
  • BLE Bluetooth Low Energy
  • the smart-room hub rather than being an independent device may be integrated into one of the other smart- controllable devices described hereinbelow.
  • the system 20 may also enable receiving sensor data/signals from a secretion sensor 39 configured to sense secretion of the subject to enable alerting the caregiver(s) when the subject needs attending cleaning or diaper changing.
  • the secretion sensor 39 may be configured, for example, to sense dryness level, chemical substances that are associated with various subjects secretions such as urine, vomit, feces, neonatal milk secretion, etc. by being located in proximity to the subject such as over the bed/crib mattress or by being attached to the subject.
  • the secretion sensor may include a humidity sensor, a proximity sensor and the like.
  • the remote server 24 may be configured by a machine learning training process to optimize the operation of controllable devices 38-48 in response to the received sensor signals, that is, to optimize the control signals that are sent to the controllable devices as described further hereinbelow with respect to Fig. 2.
  • the optimization of control signals is typically designed to provide optimal sleeping conditions, which may include conditions for putting a subject to sleep, extending a subject's sleep, and avoiding health risks such as sudden infant death syndrome (SIDS).
  • SIDS sudden infant death syndrome
  • a human operator such as a caregiver, may operate a mobile device 28 on which an application, referred to hereinbelow as a "smart-room app," may be installed.
  • the smart-room app may provide a human interface for interacting with the smart-room, including interacting with the remote server, the hub, the sensors and the devices for performing tasks, such as setup, monitoring, and maintenance.
  • the mobile device 28 may communicate by wireless means, such as Bluetooth or Wi-Fi Direct wireless standards with smart-room sensors and devices, either directly, or through the smart-room hub 26.
  • the mobile device 28 may communicate by mobile device communication protocols with the cloud-based, remote server 24, which in turn provides a communications path, typically by internet communications protocols, to the smart-room hub 26.
  • the mobile device may be a smart phone, such as an Android compatible device.
  • Other processing devices—such as work- stations, smart TVs, and internet of things (IOT) devices may also be configured to execute a similarly configured smart-room app for providing a user interface, thereby enabling a caregiver to interact with the other smart- controllable devices.
  • IOT internet of things
  • Typical smart-room sensors for sensing room conditions include a microphone 31, a video monitor 32, a smoke detector 33, a bed motion sensor 34 (which may operate as an “under-the-mattress” pressure sensor) and an air quality sensor 36 (which may include multiple sensors for sensing aspects of the air, such as particulates, humidity, and temperature).
  • the smart-room system 20 may additionally include a combined sensor unit 30 having several of the sensors embedded therein such as the motion sensor 34, the microphone 31, an optical sensor, a camera, and a pressure sensor (not shown) for measuring subject’s weight while rested over the bed.
  • the combined sensor unit 30 may be configured to be located at the subject’s bed for sensing vital subject signs such as breath, heartbeat rate, sound.
  • the microphone 31 may also be used to detect the subject’s voice to identify voice patterns and determine characteristics of the subject’s behavior based on sound/voice/speech detection and analysis.
  • the analysis module may perform sound or voice analysis of sounds of the subject to identify if the subject is crying or screaming and other associated properties of the subject’s voice such as duration of crying/screaming and/or identify other vices of caregivers (e.g. to detect caregiver’s negligence if the subject is left without anyone addressing/attending to him/her for too long etc.).
  • Alarming situations may be determined under certain conditions and criteria such as for example, when the subject cries or screams for a continuous period of time that exceeds a predefined threshold.
  • alerts may be sent to one or more mobile devices of one or more caregivers.
  • Caregivers such as parents relying on other people to assist them in attending the subject when they are not available to do so, can be provided with periodic reports (generated via the processing means) indicative of the other caregivers’ functioning and performances, e.g., based on ongoing tracking of other caregivers’ responsiveness times (in terms of time it takes the other caregiver to respond to the subject when required), analysis of recorded voice of the caregiver to identify how the caregiver addresses the subject etc.
  • the motion sensor 34 is typically an “under-the-mattress” sensor pad or platform having a large surface area (formed by a length and width thereof) in respect to its height, that is configured to detect a subject's vital signs, such as heart rate and/or respiratory rate.
  • the motion sensor may process the signals and transmit a post-processed signal at regular intervals indicating a sleeper's vital signs including heart rate, heart rate variability (HRV) and/or breathing rate. Additional processing functions, described further hereinbelow, may include recognizing, based on the vital signs and movement, a subject's sleep status (whether sleeping or not, level of relaxation, etc.) as well as learning infant sleeping patterns. Processing by the remote server may include determining appropriate settings of the smart-controllable devices based on the infant's sleep status and sleeping patterns.
  • the bed motion sensor may also monitor whether or not a subject is in the bed (or a baby is in its crib). When there is no one in bed, other monitor and control functions may be automatically stopped.
  • the bed motion sensor may also be configured to automatically transmit an immediate alarm signal if an infant has stopped breathing, indicating that the infant is experiencing SIDS.
  • the video monitor (i.e., camera) and/or the microphone may be configured to monitor a sleeper's presence in the bed. If a subject is not present, some or all automated actions of the smart-room, such as issuing controls and alerts, are typically disabled.
  • the video monitor (i.e., camera) and microphone may also be configured to sense a subject's vital signs, determining a subject's breathing, for example, from audio and/or visual signs.
  • the video monitor and microphone may monitor other respective video and audio signals in the room, such as movement, light levels, human features, such as facial features (for facial recognition) and voices (for voice recognition).
  • the video monitor may also include infrared sensitivity for detecting low light images.
  • the smart-room hub is integrated into one of the sensors or devices, such as the video monitor.
  • Signals from the various sensors are typically transmitted to the smart-room hub 26, which in turn may transmit the signals to the remote server 24 for processing that determines settings of the smart-controllable devices. Alternatively or additionally, some or all of the processing may be done directly by the smart-room hub or by the mobile device 28.
  • the smart-controllable devices that affect various conditions in the sleeper's environment may include a bed motion generator 38, a speaker 40, an air purifier 42, a humidifier 44, a thermostat 46, and a light 46.
  • the motion generator 38 is typically configured to apply soothing motion, such as a rocking and/or vibration motion, to the bed, and, in particular, to an infant's crib.
  • soothing motion such as a rocking and/or vibration motion
  • the type of motion can be controlled in real time, such that the motion may be applied at different frequencies and at different power levels.
  • rocking vibrations may sooth people, particularly infants.
  • the speaker in some embodiments may be a "white noise” generator, programmed to generate low frequency sounds like a "rumble,” which may help to calm a someone trying to fall asleep.
  • the speaker is also configured to play additional sounds, such as a soft heartbeat, which may mimic the sound of a mother's heart, or soft music.
  • the various audio options may be pre-recorded and stored in the speaker, or in some embodiments the audio may be transmitted from the mobile device or remote server.
  • the air purifier 42, the humidifier 44, and the thermostat 46 may all be set remotely from the mobile device or remote server. Settings may be modified according to signals received related to room conditions and a sleeper's vital signs, as described further hereinbelow.
  • the light 48 is typically a red-green-blue (RGB) variable night light, which can be modified in real time to change light levels and colors.
  • RGB red-green-blue
  • the system 20 may further include one or more treatment devices 49 such as a food/drink preparation and/or warming device(s) for automatic preparation of the food once the subject is awake (e.g., in case of a baby or toddler subject preparation and/or warming of formula milk via a milk warmer/preparation device).
  • Fig. 2 is a flow diagram of a process 200 for monitoring and attending to sleeper's needs, according to some embodiments of the present invention.
  • the process includes an operational stage 202 that typically operates continuously, regardless of whether or not a subject is in the bed.
  • recognition of a subject's presence may be one of the functions of the system, such that stage 202 may operate regardless of whether a subject is present or not in the bed of the smart-room.
  • signals from the smart-room sensors are acquired for processing, typically, by the remote server 24. (Alternatively or additionally, processing may be performed at the smart-room hub 26 and/or at the mobile device 28).
  • the acquired signals are processed by signal processing methods to extract characteristics, or features, of those signals that correspond to predefined rules.
  • the predefined rules indicate automated actions to be implemented when given characteristics of the signals are identified. Examples of such actions are described further hereinbelow.
  • the predefined rules may be configured as a neural network or as other frameworks of artificial intelligence known in the art. Alternatively or additionally, the predefined rules may be configured as a rules table, specifying signal thresholds that activate the corresponding automated actions.
  • the rules may include recognition methods for identifying caregivers, based on audio and/or visual signals.
  • the rules may also include recognizing sleep patterns, including expected remaining sleep time, based on motion signals received from the bed motion sensor. Automated actions defined by the rules may include setting environmental controls to optimize comfort for the sleeper, including helping the sleeper to fall asleep and extending sleep time.
  • the application of the rules determined at the step 206 may include issuing control signals to operate and/or change settings of smart-controllable devices, such as the light, speaker, bed vibrator, etc. Additional actions may include transmitting signals, including notices and alerts, to the mobile device 28, as well as to other possible user interfaces. Actions performed at the step 208 are typically performed in parallel with the continued acquisition of sensor signals and the processing of those signals. That is, the steps of the operational stage 202 are generally performed continuously as a real-time monitoring and control process.
  • the predefined rules may be generated and/or improved by a training, or machine learning, stage 210, which may operate in parallel with the operational stage 202.
  • operational goals are set, such as goals of helping a subject to fall asleep more quickly, extending sleep time, or setting sleep goals according to the time of day.
  • the goals are compared with actual results of the current smart-room device settings. The validation step determines whether current rules are meeting the goals, and, if not, changes are made to the rules according to preset change patterns. Change patterns may include, for example, incremental lighting and audio changes.
  • stage 210 is a machine learning framework, such as a neural network generator.
  • the machine learning may be based on multiple iterative tests of one smart-room, or on multiple tests from multiple smart-rooms.
  • the training process "learns" correlations between vital signs, sleeper motions, and room conditions (e.g., lighting, crib vibration, and sounds), in order to determine the sleeper's "preferences," that is, conditions such as sound, lighting, and crib vibration patterns, that may help the subject to fall asleep or extend the subject's sleep time.
  • the correlations with the subject’s preferences are then incorporated into the preset rules.
  • Stage 210 is typically implemented by the remote server 24; but alternatively or additionally, this processing may be performed at the smart-room hub 26 and/or at the mobile device 28.
  • the main processor may provide to a caregiver a notification of expected remaining sleep time (or expected time until falling asleep).
  • a caregiver may have an option for modifying the room conditions to support or effect the sleeper's sleep patterns, such as extending the sleep time (for example, by changing the lighting, bed vibration, and sounds), reducing noise, etc.
  • the main processor monitors movement, video, and/or audio signals and determines a sleeper's sleep patterns (also referred to herein as "sleep cycles"), including making a determination of when a subject is about to wake up.
  • a sleeper's sleep patterns also referred to herein as "sleep cycles”
  • the main processor may start playing sounds determined to be soothing (such as white noise), to help the sleeper to continue sleeping.
  • the main processor turns on the smart-room light to a preset low light level, to help the caregiver care for the subject.
  • the light is then turned off when received signals, such as video monitor signals, indicate that the caregiver is exiting the room.
  • the main processor detects from audio signals that a mother has attached the microphone to her chest.
  • the heartbeats are then played on the room’s speaker, soothing an infant in real-time.
  • the caregiver can also select a given item of music, such as a lullaby, from the smart-room app, or other audio item, such as a parent reading a story.
  • the app transmits the selection to the main processor, which then plays the selected item from the smart-room speakers.
  • the preset rules may also determine lighting and crib motions that are appropriate for the given item.
  • Audio items, such as lullabies, may also be recorded by the caregiver from the smart-room app, and stored so that they can be subsequently selected for playing.
  • the main processor may determine a subject's sleeping behavior and sleeping status and may notify the caregiver that the current sleep is expected to continue for a certain period of time.
  • the main processor detects that a sleeping subject is not moving or in distress, and responsively notifies the caregiver with critical information about the nature of the emergency. During this time, the main processor may also instruct the in-room speakers to play alarm sounds, as caregivers may be in hearing range.
  • the main processor detects that there is no subject in the bed. Rules for controlling the environment for encouraging sleep may not be activated until someone returns to bed (or an infant is set in the crib).
  • the humidifier when the air sensor detects that humidity is below a desired rate, the humidifier is instructed by the main processor to start working. This action may be set to operate continuously or only when a subject is in the bed.
  • comprehensive reports about a subject's sleeping cycle are provided to the caregiver (that is, to the smart-room app on the mobile device).
  • the report may include sleep analytics, vital signs, images captured by the video monitor, the times that the sleeper was attended, and by whom (which may be determined according to image or voice processing), the number of movements and times the sleeper moved, or turned over, etc.
  • Computational aspects of system 20 and of process 200 may be implemented in digital electronic circuitry, or in computer hardware, embedded firmware, software, or in combinations thereof.
  • All or part of the process may be implemented as a computer program product, tangibly embodied in an information carrier, such as a machine-readable storage device or in a propagated signal, for execution by, or to control the operation of, data processing apparatus, such as a programmable processor, computer, or deployed to be executed on multiple computers at one site, or distributed across multiple sites, including cloud configurations.
  • Memory storage may also include multiple distributed memory units, including one or more types of storage media.
  • a computing system configured to implement the system may have one or more processors and one or more network interface modules, using one or more communication networks, links and/or protocols. Processors may be configured as a multi-processing or distributed processing system. Network interface modules may control the sending and receiving of data packets over networks.
  • FIG. 3 schematically illustrating a system 100 for monitoring a subject and/or an environment such as a room in which the subject is mostly or occasionally located, and responsively and adjustably controlling controllable devices located in that environment for improving/optimizing subject condition/state and monitoring subject’s vital signs, according to some embodiments.
  • the system 100 may include at least:
  • a sensors subsystem 110 including multiple sensors such as, yet not limited to, one or more of: movement sensor(s) (e.g., based on piezoelectric element(s)), proximity sensor(s), heartbeat meter, weight, pressure sensor(s), temperature sensor(s), humidity sensor(s), air pollution sensor, microphone(s), camera(s), etc.;
  • a processing and control subsystem (PCS) 150 which may include one or more software and/or hardware means, configured for receiving sensor signals/data (herein also referred to as “sensor data”), analyze the received sensor data to determine one or more conditions of the subject/environment and control operation of one or more controllable devices in the environment of the subject (e.g., room) based on determined one or more subject/environment condition(s), and optionally also to receive users input data and display information via one or more output devices, the information being indicative of analysis results, subject status, input selection and interface screens/pages and the like; and
  • At least one server such as server 170, which may be a local computer device operating the PCS 150 or a remote server enabling to receive sensor data and input data via one or more communication links such as link 17.
  • the server 170 used may also operate a central processing module 171 configured to:
  • PCSs of multiple monitoring systems each associated with a different subject
  • (iii) receive information indicative of various responses of subjects (e.g. of the same subject type such as same age group), to various actions related to various modes of operation of various controllable devices, taken in response to identified behavioral patterns of the subjects;
  • subjects e.g. of the same subject type such as same age group
  • each monitoring system adjusts the analysis algorithms used by each monitoring system based on accumulated sensor data (e.g., by adjusting threshold and parameters normal averages ranges etc.) and/or adjust operation programs for operating one or more of the controllable devices in response to identified subject behavior pattern(s).
  • statistical survey of multiple baby and toddler subjects may result in identifying that upon identification of a sleep pattern indicative of early awakening stages in hours in which the baby/toddler should be put back to sleep (e.g. settable by caregiver), operating a static noise/sound or calming music, for example, will help the subject to fall back into sleep without requiring alarming the caregiver(s) and will help the subject to develop healthy falling-asleep skills and habits.
  • controllable devices 160 used by the system 100 may be a part of the system 100, wherein the system 100 is adapted to connect to and/or communicate with designated known system controllable devices 160 and optionally also to external controllable devices, e.g. via standard communication/connection links such as via USB link, wireless (WiFi/Bluetooth) links etc.
  • standard communication/connection links such as via USB link, wireless (WiFi/Bluetooth) links etc.
  • the PCS 150 may include:
  • a sensors module 151 configured to receive sensor data from all operated sensors of the system 100 (e.g., in real time (RT) or near real time (NRT));
  • an analysis module 152 configured to analyze received sensor data in Real Time (RT), near real time and/or offline, to determine various conditions, typical behavior, and states of the subject such as sleeping, awakening, awake, agitated, crying, distressed, in physical hazard such as high/low fever, breathing problems/risk of apnea etc., identify hazardous situations and set alerts and/or messages and/or display information indicative of determined condition, as well as to select which controllable device to operate to assist the subject in optimizing/improving his/her condition and how to operate each selected controllable device.
  • RT Real Time
  • the analysis module 152 may be further configured to predict subject’s behavioral characteristic such as feeding and sleeping times and operate the one or more controllable devices based also on the predicted subject behavior and predicted responsiveness to the specific devices’ operation features; [0094] a devices control module 153 configured to carry out the actual control of operation of each selected controllable device, e.g., via selected/generated control plans, each including control command(s) for each selected controllable device;
  • a communication module 154 configured to control communication with the server 170, the sensors subsystem 110, the controllable devices 160, external caregivers’ mobile devices such as smartphone 10, etc. via one or more communication links, networks, protocols and methods;
  • a calibration and adjustment module 155 configured, inter alia, to adjust and/or calibrate analysis algorithm(s), which may be based on machine-learning, external (e.g., statistical) information, and on caretaker(s) feedback, where the calibration and/or ongoing adjustment is done based on identification of specific and personal sensor data patterns for several sensors of the sensors subsystem 110 of the specific subject, indicative of specific physical patterns and behavior of the subject such as specific breathing and/or heartbeat patterns when sleeping/awake/awakening, specific vocal behavior/patterns of the subject in different states such as specific crying voice patterns, etc.;
  • a user interface (UI) 156 supported by the PCS 150 and operable via one or more computer and communication devices such as mobile devices having one or more display and input means such as a touch screen, microphone, screen, keyboard etc. for enabling users such as caregivers to input/select information associated with the specific subject such as: [0098] subject (updated) personal details such as name, age, gender, weight, height, etc.
  • caregivers details such as name and phone number etc.
  • information pertaining to habits and schedules of the subject such as typical feeding times, cleaning time, medication intake dosages, schedules and conditions/requirements (e.g. intake can be done only after eating, before bedtime, and the like), etc.
  • the calibration and adjustment module 155 may be further configured for automatic accumulation of sensor data over time from each sensor, analysis results of each event e.g., especially alarming events, learning personal sensor data behaviors of the specific subject in various conditions/states of the specific subject, and adjust/calibrate the analysis algorithm(s) used by the analysis module 152. Since for many subjects such as infants the typical specific subject behaviors and consequent sensor data behavior may change over time, therefore the ongoing automatic data accumulation and analysis algorithms’ adjustment may dramatically improve sensor data interpretation and the manner in which the condition of the subject/environment is determined. For example, babies may change sleeping, feeding and even heartbeat and breathing normal rates and patterns every few months or even within a few weeks as they quickly develop.
  • Automatically adapting the analysis algorithms to the personal developmental normal changes in the subject may enable avoiding false alarms and a more personalized and precise monitoring, for example, by setting thresholds according to the updated normal breathing rate of the subject as measured within a time span that is close to the current RT monitoring time.
  • the calibration and adjustment module 155 may be further configured to control and initiate a calibration testing procedure, testing the subject’s personal responsivity to various stimulations at various stimulation modes, volumes, intensities, types, etc. To do so, the calibration and adjustment module 155 may operate each stimulation controllable device at its different enabled modes/intensities etc. and analyze RT received sensor data to check the subject’s responsivity to the particular stimuli at the particular operation mode and intensity.
  • the measured responsivity characteristics of the subjects to the various stimulations and stimulation modes and intensities applied thereover, are then used to determine personalized response operation programs or commands, where each conditioned determined in RT by the PCS 150 is associated with a specific control devices’ operation program that is calibrated/adjusted based on the preliminary personalized subject’s responsivity to the various controllable devices’ stimulation features such as stimulation types, modes and intensities.
  • the PCS 150 may further be configured to process inputted information and accumulated sensor data to generate one or more recommendations for the caregivers.
  • the generated recommendations may be outputted, displayed and/or transmitted for being displayed to the one or more caregivers or other authorized users for further treatment.
  • the recommendation may include, for example:
  • treatment recommendations e.g., recommended times in which the subject should be put to sleep based on measured actual sleep patterns, etc.
  • system optimization recommendations e.g., recommendations for adding, removing and/or replacing controllable devices and/or sensors form improved sensing and responsive feedback.
  • the system 100 may further use one or more data bases such as internal database 157 and/or external database 180 and/or data storage units for orderly storing one or more of: accumulated sensor data and/analysis results and their associated acquisition times, sensor type, determined conditions, personal details of the subject and of the caregiver(s), inputted preferences, control program and commands, control and communication protocols, defined system’s 100 controllable devices information (e.g., for enabling operation and operation control such as power control ranges, on/off switching requirements, modes selection options etc.) and operation-control), rules, thresholds and ranges, system requirements, and the like.
  • data bases such as internal database 157 and/or external database 180 and/or data storage units for orderly storing one or more of: accumulated sensor data and/analysis results and their associated acquisition times, sensor type, determined conditions, personal details of the subject and of the caregiver(s), inputted preferences, control program and commands, control and communication protocols, defined system’s 100 controllable devices information (e.g., for enabling operation and operation control such as power control ranges
  • FIG. 4 is a flowchart, schematically illustrating a process for monitoring a subject and controlling one or more controllable devices that are located in an environment of the subject, in response to ongoing RT or near RT monitoring data analysis, according to some embodiments.
  • This process may be carried out using one or more sensing, computer operated and communication means and may include at least the step of:
  • acquiring RT sensor data from one or more sensor the sensor data being indicative of subject and/or environment (e.g., room) characteristics 401;
  • an “at risk” (hazardous/al arming) situation is identified/determined, based on determined condition(s) (e.g., by checking whether measured parameter values such as pulse, breathing rate etc. exceeds a threshold) 404, an alarm (such as auditory alarm) may be set and/or alert messages may be transmitted to caregiver(s) mobile device(s) 405;
  • determining operation commands e.g., by selection of preprogrammed control plans) for controlling one or more controllable devices located within the environment, based on current/updated determined subject/environment condition(s) 406;
  • updating/adjusting/calibrating analysis algorithms 410 e.g., based on ongoing analysis of accumulated data.
  • Fig. 5 is a flowchart, schematically illustrating a personalization process, in which the personal behaviors of the subject are measured via the system sensors, and sensor data analysis is personally adjusted, according to some embodiments.
  • the personalized adjustment of the analysis of sensor data may be done by measuring typical sensor output signals/data behavior (patterns) over periods of time during various states of the subject such as, for example, breathing, heartbeat and/or movement patterns during different subject’s states such as sleeping, awakening, agitation, hunger, crying, calmness, fully awake, and the like.
  • These sensors’ signals/data patterns may be used for adjusting typical parameters’ values or ranges thereof in the sensor data analysis algorithms such as ranges of heartbeat and/or breathing cycles’ rates, where each range of each type of parameter/sensor is associated with a different subject state.
  • aspects of disclosed embodiments pertain to a smart mattress and smart mattresses systems having a monitoring device embedded therein, where the monitoring device is configured at least to monitor vital signs such as movement, breathing and/or heartbeat of a subject lying over the mattress.
  • the smart mattress has an inner pocket that allows removable placing the monitoring device therein such that the monitoring device is located between two parts/layers of the mattress forming an upper mattress layer located above an upper surface of the monitoring device and a lower mattress layer located below a lower surface of the monitoring device.
  • the monitoring device may include one or more movement sensors such as one or more piezoelectric transducers and also optionally a weight sensor for measuring the subject’s weight when lying over the mattress.
  • the movement sensors may be spread along the surface area of the monitoring device such as to cover maximal surface area of the mattress.
  • the smart mattress may be designed according to the subjects’ requirements and measures such as for babies, infants, toddlers or young children between certain ages range (designed in size, safety and materials designated for baby crib or children beds etc.), elderly people etc.
  • the mattress may be made from firmer materials for prevention of SIDS often caused due to sudden apnea, using a “breathing mattress” material and structure design such as using a three-dimensional (3D) polymer coiled mattress such as Polyethylene (PE) or Polyolefin (POE) coil mattresses in which a polymeric material is formed into weaved or entangled coils or strings that are substantially rigid yet elastic enough to allow dispersed spring like movement responsive to the subject’s movement and that forms air pockets between the polymeric coils/strings for allowing air to pass therethrough.
  • a “breathing mattress” material and structure design such as using a three-dimensional (3D) polymer coiled mattress such as Polyethylene (PE) or Polyolefin (POE) coil mattresses in which a polymeric material is formed into weaved or entangled coils or strings that are substantially rigid yet elastic enough to allow dispersed spring like movement responsive to the subject’s movement and that forms air pockets between the polymeric coils/strings for allowing air to pass therethrough
  • the monitoring device may be designed as a flat plate-like shape having a casing for encasing sensors, processing unit and other components thereof, with a surface area that is dramatically larger than its width - to allow sensing movement signals from the majority of the mattress’s surface area.
  • Figures 6A-6D and Fig. 7 show a smart mattress 1000 or parts thereof, the smart mattress 1000 has a monitoring device 1500 embedded therein, for monitoring at least vital signs of a subject, according to some embodiments.
  • the smart mattress 1000 may include a mattress element 1100 having a pocket 1140 (an enclave or inner cavity) of a surface area that is equal or approximated to the surface area of the mattress element 1100.
  • the pocket 1140 may form an upper mattress layer 1110 and a lower mattress layer 1120, made from polymer coiled mattress material, where the upper mattress layer 1110 may also be covered at an upper surface thereof with a cover layer 1300 made of a different mattress material such as a waterproof material.
  • the pocket 1140 may also be surrounded by an inner lining 1145 that may be made from a waterproof material to prevent liquid (e.g. caused by subject’s secretions) to engage the monitoring device 1500.
  • the smart mattress 1000 may be designed in size and dimensions to fit a specific bed size, and the upper and lower mattress layers may be made from a breathing mattress material and strings/coils structure.
  • the monitoring device 1500 may be configured at least to sense movements of the subject lying over the mattress 1000, where its location between the upper and lower mattress layers 1110 and 1120 allows improving movement detection since the movements of the subject can be reflected from a lower bed support 60 over which the mattress is located through the strings of the lower mattress layer 1120 as well as the movements translated through the strings of the upper mattress layer 1110.
  • the smart mattress 10000 may also include a closing mechanism 1600 including one or more sealing or closing means such as a zipper 1610 and/or a hook-and-loop fastener 1620 for enabling opening and closing the pocket 1140 for removal and placement of the monitoring device 1500 therein.
  • the hook-and-loop fastener 1620 may be used to enable at least partial waterproofing of the pocket 1140 inner lining 1145.
  • the smart mattress 1000 may also include or allow using a rigid frame 1700 surrounding and engaging the side perimeter of the smart mattress 1000 for improving movement/motion detection e.g., by enabling movement signals’ reflection from the frame 1700 towards the mattress 1000.
  • the monitoring device 1500 may include, inter alia:
  • one or more sensors such as motion sensors 1511 and 1512 and a weight sensor 1515, and other sensors (not shown) such as, for example, at least one: humidity/chemical sensor (to detect chemical/moisture substances presence that can potentially damage the monitoring device 1500 and may also indicate that the subject needs diaper changing), microphone, proximity sensor (e.g. to detect presence of the subject in bed (in/out of bed), a thermometer, a pressure sensor, etc.;
  • sensors such as motion sensors 1511 and 1512 and a weight sensor 1515, and other sensors (not shown) such as, for example, at least one: humidity/chemical sensor (to detect chemical/moisture substances presence that can potentially damage the monitoring device 1500 and may also indicate that the subject needs diaper changing), microphone, proximity sensor (e.g. to detect presence of the subject in bed (in/out of bed), a thermometer, a pressure sensor, etc.;
  • a processing unit such as a printed circuit bard (PCB) 1550 that can collect in RT sensors signals/data and transmit sensor data to external devices such as to a PCS of the smart room system 100 and/or to a processing and control unit 1800 that is connected (e.g., wired) to the PCB 1550 capable for example, of receiving sensor data, analyzing the received sensor data in RT to detect the condition of the subject and output alerts and/or information indicative of detected (updated/current( subject’s condition;
  • PCB printed circuit bard
  • a power source such as battery(ies) 1560 that can be located at the monitoring device 1500 or at the PCU 1800 allowing powering at least the PCB 1550 and the sensors 1511-1515.
  • the power source (whether via battery(ies) or main power supply line connection) may be connected only to the PCU 1800 where the PCU 1800 also serves as a the power source of the monitoring device 1500; and
  • one or more stimulation devices such as a vibration device 1570 for applying stimuli over the subject such as vibrations, swinging, etc.
  • the PCU 1800 may include one or more of: [00140] a processor for processing received sensor data and determining subject’s condition;
  • one or more alert devices such as an alarm device, at least one controllable visual indication lamp (e.g., for indication of alarm/on/off states/power state), etc.;
  • a communication unit for transmitting alerts/information indicative of the subject’s condition to one or more remote device such as mobile devices, etc.;
  • display means such as a screen, e.g., for displaying information indicative of the subject’s condition
  • alert output means such as one or more speakers
  • control and input means such as on/off switch, mode selection switches/buttons etc.
  • the PCU 1800 may further include one or more detectors such as a camera and/or a microphone to sense subject and/or environmental characteristics that cannot be sensed via sensors embedded within the smart mattress 1000 such as presence voice, visuals of other subjects in the vicinity of the subject, the subject’s visual and/or audio characteristics, environmental conditions such as humidity and/or illumination characteristics etc.
  • detectors such as a camera and/or a microphone to sense subject and/or environmental characteristics that cannot be sensed via sensors embedded within the smart mattress 1000 such as presence voice, visuals of other subjects in the vicinity of the subject, the subject’s visual and/or audio characteristics, environmental conditions such as humidity and/or illumination characteristics etc.
  • the PCU 1800 may also enable controlling controllable device located in an environment of the subject practically serving as a hub 26 or PCS 150 of other sensory and/or controllable devices located in the subject’s environment, including the monitoring device 1500 as part of the smart room system 100 sensors and optionally also controllable devices of the system 100.
  • the two upper and lower supports 1521 and 1522 may have a size that fits into the pocket 1140 of the smart mattress 1000.
  • Example 1 is a method for monitoring and attending to a subject in a specific environment, the method comprising at least:
  • example 2 the subject matter of example 1 may include, wherein the method further comprises predicting personal subject’s behavioral characteristics and controlling at least one of the one or more controllable devices, based on predicted subject’s behavioral characteristics, the behavioral characteristics comprising at least: physical behavioral characteristics.
  • example 3 the subject matter of example 2 may include, wherein the predicting of personal subject’s behavioral characteristics comprises predicting one or more of: falling asleep, sleep and awakening schedules, feeding schedules, secretion schedules, changing of a sleep stage schedules.
  • any one or more of examples 1 to 3 may include, wherein the method further comprises initiating a calibration process comprising:
  • controllable devices configured for applying stimuli over the subject at different stimulations modes and intensities
  • controllable devices are configured for one or more of: stimulating the subject; treating the subject; displaying visual and/or auditory display of content to the subject; outputting and/or transmitting information to caregivers, the information being indicative of determined at least one updated condition.
  • the subject matter of any one or more of examples 1 to 5 may include, wherein the one or more controllable devices comprise one or more of: at least one illumination device, at least one audio speaker, at least one crib vibrator, at least one air humidifier, at least one air conditioning device, at least one bottles warming device, at least one formula milk preparation machine, at least one medication delivery device, at least one food and/or drink preparation and/or delivery device, at least one bed heater, at least one motion generator, at least one air purifier, at least one communication device, at least one oxygen supply device, at least one inhalation device.
  • the one or more controllable devices comprise one or more of: at least one illumination device, at least one audio speaker, at least one crib vibrator, at least one air humidifier, at least one air conditioning device, at least one bottles warming device, at least one formula milk preparation machine, at least one medication delivery device, at least one food and/or drink preparation and/or delivery device, at least one bed heater, at least one motion generator, at least one air purifier, at least one communication device, at
  • the subject matter of any one or more of examples 1 to 6 may include, wherein the one or more sensors comprise one or more of: at least one microphone, at least one motion sensor; at least one pressure sensor; at least one thermometer; at least one humidity sensor; at least one air quality sensor; at least one camera, at least one optical sensor; at least one chemical sensor, at least one weight sensor, smoke detector.
  • the one or more sensors comprise one or more of: at least one microphone, at least one motion sensor; at least one pressure sensor; at least one thermometer; at least one humidity sensor; at least one air quality sensor; at least one camera, at least one optical sensor; at least one chemical sensor, at least one weight sensor, smoke detector.
  • the subject matter of any one or more of examples 1 to 7 may include, wherein at least one of the one or more sensors is configured to detect one or more of: heartbeat, breathing, motion of the subject, voice, sound, secretions, temperature, air quality, smoke, subject’s presence, subject’s weight.
  • the subject matter of any one or more of examples 1 to 8 may include, wherein the determinable conditions of the subject comprise at least one of: sleep, awake, in bed, out of bed, distressed, crying, agitated, in convulsions, having fever, hypothermia, hungry, in pain, thirsty, calm, calling a caregiver, shivering, in seizures, screaming, awakening, falling asleep, in spasms, apnea, sudden infant death syndrome (SIDS), wherein the determinable conditions of the environment comprise at least one of: too cold or hot, too humid or dry, fire/smoke, endangering pollution, over or under illuminated, noisy, sensory agitating, wherein each determinable condition is associated with one or more detectable characteristics and/or behavior over a period of time of the one or more detectable characteristics, and wherein each determinable condition is associated with one or more control commands for controlling one or more of the controllable devices, based on the determined condition.
  • the determinable conditions of the subject comprise at least one of:
  • example 10 the subject matter of example 9 may include, wherein at least one of the determinable conditions is further associated with an alarming state, and a set of alert commands, for operating or outputting of one or more alerts and/or transmitting alerts to one or more remote devices.
  • any one or more of examples 1 to 10 may include, wherein the method further comprises:
  • [00170] receiving information indicative of various responses of multiple subjects of the same subject type, to various actions related to various modes of operation of various controllable devices, the actions taken in response to identified behavioral patterns of the subjects generating accumulated responses data for the respective subject group type;
  • example 12 the subject matter of example 11 may include, wherein the method further comprises outputting, displaying and/or transmitting the generated one or more recommendations to the one or more caregivers and/or other authorized users.
  • any one or more of examples 1 to 12 may include, wherein the conditions of the environment comprise at least one of: too dry, too humid, hot, cold, over polluted, noisy, over/under illuminated, number or people in the environment.
  • the subject matter of any one or more of examplesl to 13 may include, wherein the at-risk condition is an indication of an acute safety hazard including at least one of: sudden infant death syndrome (SIDS), apnea, fall, severely high fever, sever hypothermia, panic, seizure, convulsions, wherein upon identification of an at-risk condition, one or more automatic emergency operations are executed including at least one of: operating an auditory and/or visual alarm, sending of alert messages to caregivers mobile devices, alerting one or more emergency authorities, operating one or more controlled devices used also for assisting in treating the subject in emergency situations.
  • SIDS sudden infant death syndrome
  • apnea fall
  • severely high fever
  • sever hypothermia panic
  • seizure seizure
  • convulsions wherein upon identification of an at-risk condition, one or more automatic emergency operations are executed including at least one of: operating an auditory and/or visual alarm, sending of alert messages to caregivers mobile devices, alerting one or more emergency authorities, operating one
  • any one or more of examples 1 to 14 may include, further comprising providing updated status notifications to at least one caregiver indicative of the determined subject and/or environment condition.
  • example 16 the subject matter of example 15 may include, wherein the status notifications are provided at regular time intervals.
  • example 17 the subject matter of example 7 may include, wherein the status notifications are transmitted to mobile device of each caregiver.
  • any one or more of examples 1 to 17 may include, wherein the processing of the sensor data and the controlling of the one or more controllable devices is done via a local server and/or a remote server configured for data storage, communication, processing, display, output, devices control, and devices control.
  • any one or more of examples 1 to 18 may include, wherein the method further comprises:
  • any one or more of examples 1 to 19 may include, wherein the method further comprises: recording and/or real time acquiring of parental heartbeat sound; and playing the acquired or recorded parental heartbeat sounds to the subject, in real time or offline in respect to the time of recording or acquisition.
  • example 21 the subject matter of example 20 may include, wherein the method further comprises applying tactile stimuli over the subject that is synchronized with rhythm of the played parental heartbeat.
  • any one or more of examples 1 to 21 may include, wherein the method further comprises detecting functionality characteristics of the one or more controllable devices and, upon identification of a malfunctioning or impairment in a controllable device deactivating the controllable device and/or generate and display and/or send alert to the at least one caregiver.
  • any one or more of examples 1 to 22 may include, wherein the controlling of operation of at least one of the one or more controllable devices is done automatically.
  • Example 24 is system for monitoring and attending to a subject located in a specific environment, the system comprising at least:
  • each sensor located in the specific environment, each sensor being configured to sense one or more characteristics of the subject and/or of the environment;
  • a processing and control subsystem configured at least to: [00192] receive sensor data from one or more sensors located in the environment, the one or more sensors being configured to sense one or more physical characteristics of the subject and/or of the environment;
  • [00193] process the received sensor signals to determine at least one updated condition of the subject being monitored and/or at least one updated condition of the environment, using one or more analysis algorithms;
  • control operation of one or more controllable devices based on the determined at least one updated condition, wherein the one or more controllable devices are located in the environment;
  • [00195] accumulate sensor data and analyzing accumulated sensor data to determine personal behavior characteristics of the specific subject, based on behavior of the accumulated sensor data;
  • example 25 the subject matter of example 24 may include, wherein the PCS is further configured to predict personal subject’s behavioral characteristics and controlling at least one of the one or more controllable devices, based on predicted subject’s behavioral characteristics.
  • example 26 the subject matter of any one or more of examples 24 to 25 may include, wherein the OCS is further configured to initiate a calibration process comprising:
  • controllable devices configured for applying stimuli over the subject at different stimulations modes and intensities
  • measuring subject’s responsivity to applied stimulations [00200] measuring subject’s responsivity to applied stimulations; [00201] calibrating and/or determining features of one or more operation programs for operating of the controllable devices responsively to the determined condition of the subject, based on measured subject’s stimulation responsivity.
  • controllable devices are part of the system and are configured for one or more of: stimulating the subject; treating the subject; displaying visual and/or auditory display of content to the subject; outputting and/or transmitting information to caregivers, the information being indicative of determined at least one updated condition.
  • the subject matter of example 27 may include, wherein the one or more controllable devices comprise one or more of: at least one illumination device, at least one audio speaker, at least one crib vibrator, at least one air humidifier, at least one air conditioning device, at least one bottles warming device, at least one formula milk preparation machine, at least one medication delivery device, at least one food and/or drink preparation and/or delivery device, at least one bed heater, at least one bed motion generator, at least one air purifier, at least one communication device, at least one oxygen supply device, at least one inhalation device.
  • the one or more controllable devices comprise one or more of: at least one illumination device, at least one audio speaker, at least one crib vibrator, at least one air humidifier, at least one air conditioning device, at least one bottles warming device, at least one formula milk preparation machine, at least one medication delivery device, at least one food and/or drink preparation and/or delivery device, at least one bed heater, at least one bed motion generator, at least one air purifier, at least one communication device, at least one oxygen supply device
  • any one or more of examples 24 to 28 may include, wherein the one or more sensors comprise one or more of: at least one microphone, at least one motion sensor; at least one pressure sensor; at least one thermometer; at least one humidity sensor; at least one air quality sensor; at least one camera, at least one optical sensor; at least one chemical sensor, at least one weight sensor, smoke detector.
  • the one or more sensors comprise one or more of: at least one microphone, at least one motion sensor; at least one pressure sensor; at least one thermometer; at least one humidity sensor; at least one air quality sensor; at least one camera, at least one optical sensor; at least one chemical sensor, at least one weight sensor, smoke detector.
  • any one or more of examples 24 to 29 may include, wherein at least one of the one or more sensors is configured to detect one or more of: heartbeat, breathing, motion of the subject, voice, sound, secretions, temperature, air quality, smoke, subject’s presence, subject’s weight.
  • example 31 the subject matter of example 30 may include, wherein at least one of the determinable conditions is further associated with an alarming state, and a set of alert commands, for operating or outputting of one or more alerts and/or transmitting alerts to one or more remote devices.
  • example 32 the subject matter of any one or more of examples 24 to 31 may include, wherein the PCS is further configured to receive and process accumulated sensor data and inputted information, inputted by the one or more caregivers, and to generate one or more recommendations for the one or more caregivers.
  • example 33 the subject matter of example 32 may include, wherein the system further comprises one or more output devices, display devices and/or communication means for outputting, displaying and/or transmitting the generated one or more recommendations to the one or more caregivers and/or other authorized users.
  • example 34 the subject matter of any one or more of examples 24 to 33 may include, wherein the PCS is further configured to provide caregiver and/or other users with updated status notifications, the update status reports being indicative of updated determined subject and/or environment condition.
  • any one or more of examples 24 to 34 may include, wherein the processing of the sensor data and the controlling of the one or more controllable devices is done via a local server and/or a remote server configured for data storage, communication, processing, display, output, devices control, and devices control.
  • the subject matter of any one or more of examples 24 to 35 may include, wherein the system further comprises at least one remote server operating a central processing module, configured for:
  • any one or more of examples 24 to 36 may include, wherein the one or more sensors are further configured to record and/or acquire in real time of parental heartbeat sounds; and the one or more controllable output devices are configured for playing the acquired or recorded parental heartbeat sounds to the subject, in real time or offline in respect to the time of recording or acquisition.
  • example 38 the subject matter of example 37 may include, wherein the system is further configured for applying of tactile stimuli over the subject that is synchronized with rhythm of the played parental heartbeat.
  • any one or more of examples 24 to 37 may include, wherein the controlling of operation of at least one of the one or more controllable devices is done automatically.
  • Example 40 is a smart mattress comprising: [00219] (a) a mattress element having a pocket therein forming an upper mattress layer and a lower mattress layer;
  • a monitoring device located within the pocket, the monitoring device having one or more sensors being configured at least to sense one or more characteristics of a subject lying over the mattress,
  • the mattress element further comprises a closing mechanism for enabling closing and opening an opening in the pocket for removal and insertion of the monitoring device out of and into the pocket of the mattress element.
  • example 41 the subject matter of any one or more of examples 39, wherein the upper and lower mattress layers are made from a breathing mattress material and structure.
  • example 42 the subject matter of example 41 may include, wherein the upper and lower layers of the mattress element are made of three-dimensional (3D) strings or coils polymer.
  • example 43 the subject matter of example 42 may include, wherein the three- dimensional (3D) strings or coils polymer comprises a Polyethylene (PE) or Polyolefin (POE) polymer.
  • PE Polyethylene
  • POE Polyolefin
  • any one or more of examples 40 to 43 may include, wherein the smart mattress further comprises a rigid frame surrounding a periphery of the mattress element.
  • the subject matter of any one or more of examples 40 to 44 may include, wherein the monitoring device is configured in size, shape and dimensions to fit into the pocket of the mattress element.
  • the subject matter of any one or more of examples 40 to 45 may include, wherein the mattress element further comprises an inner lining coating the pocket.
  • any one or more of examples 40 to 46 may include, wherein the mattress element has a coating layer over the upper mattress layer.
  • the subject matter of any one or more of examples 40 to 47 may include, wherein the monitoring device comprises at least one of: one or more motion sensors; at least one weight sensor; at least one pressure sensor; at least one microphone; at least one humidity sensor; at least one secretions sensor; a processing unit; a power source; at least one stimulation device for applying one or more stimulations over the subject lying over the mattress.
  • the monitoring device comprises at least one of: one or more motion sensors; at least one weight sensor; at least one pressure sensor; at least one microphone; at least one humidity sensor; at least one secretions sensor; a processing unit; a power source; at least one stimulation device for applying one or more stimulations over the subject lying over the mattress.
  • any one or more of examples 40 to 48 may include, wherein the monitoring device has a flat shape such that a surface thereof formed by a length and width thereof is larger than its height.
  • any one or more of examples 40 to 49 may include, wherein the monitoring device is configured to communicate via wired and/or wireless connection with a processing and control unit (PCU), the PCU being configured to receive data from the monitoring device and perform one or more of: process the data to identify alarming states, initiate alarms; transmit information indicative of the received and/or processed data to one or more remote devices of one or more users.
  • PCU processing and control unit
  • any one or more of examples 40 to 50 may include, wherein the PCU is comprises one or more of:
  • one or more alert devices one or more alert devices;
  • a communication unit for transmitting alerts and/or information indicative of the subject’s condition to one or more remote devices;
  • display means for displaying information indicative of the subject’s condition
  • alert output means such as one or more speakers
  • control and input means
  • one or more detectors configure and positioned to sense subject and/or environmental characteristics.
  • the system, module, unit, device etc. or parts thereof, may be programmed to perform particular functions pursuant to computer readable and executable instructions, rules, conditions etc. from programmable hardware and/or software based execution modules that may implement one or more methods or processes disclosed herein, and therefore can, in effect, be considered as disclosing a “special purpose computer” particular to embodiments of each disclosed method/process.
  • a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof.
  • a computer readable signal medium may be any computer readable medium that is not a non-transitory computer or machine-readable storage device and that can communicate, propagate, or transport a program for use by or in connection with apparatuses, systems, platforms, methods, operations and/or processes discussed herein.
  • non-transitory computer-readable storage device and “non- transitory machine-readable storage device” may also include distribution media, intermediate storage media, execution memory of a computer, and any other medium or device capable of storing for later reading by a computer program implementing embodiments of a method disclosed herein.
  • a computer program product can be deployed to be executed on one computer or on multiple computers at one site or distributed across multiple sites and interconnected by one or more communication networks.
  • the computer readable and executable instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
  • a module, a device, a mechanism, a unit and or a subsystem may each comprise a machine or machines executable instructions (e.g. commands).
  • a module may be embodied by a circuit or a controller programmed to cause the system to implement the method, process and/or operation as disclosed herein.
  • a module may be implemented as a hardware circuit comprising, e.g., custom very large-scale integration (VLSI) circuits or gate arrays, an Application-specific integrated circuit (ASIC), off-the- shelf semiconductors such as logic chips, transistors, and/or other discrete components.
  • VLSI very large-scale integration
  • ASIC Application-specific integrated circuit
  • a module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices and/or the like.
  • processing may refer to operation(s) and/or process(es) of a computer, a computing platform, a computing system, or other electronic computing device(s), that manipulate and/or transform data represented as physical (e.g., electronic or optical signal) quantities within the computer's registers and/or memories into other data similarly represented as physical quantities within the computer's registers and/or memories or other information storage medium that may store instructions to perform operations and/or processes.
  • processing may refer to operation(s) and/or process(es) of a computer, a computing platform, a computing system, or other electronic computing device(s), that manipulate and/or transform data represented as physical (e.g., electronic or optical signal) quantities within the computer's registers and/or memories into other data similarly represented as physical quantities within the computer's registers and/or memories or other information storage medium that may store instructions to perform operations and/or processes.
  • physical e.g., electronic or optical signal
  • each of the verbs, "comprise” “include” and “have”, and conjugates thereof, are used to indicate that the object or objects of the verb are not necessarily a complete listing of components, elements or parts of the subject or subjects of the verb.

Abstract

Methods, devices and systems for monitoring and attending to a subject when located in a specific environment, using one or more monitoring devices and/or sensors and operating controllable devices that are located in the specific environment in response to analysis of data arriving from the sensors and/or monitoring devices. The disclosure also discloses embodiments of a smart mattress having a monitoring device embedded therein.

Description

SYSTEMS, METHODS AND SMART MATTRESSES FOR MONITORING A SUBJECT IN A SPECIFIC ENVIRONMENT
FIELD OF THE INVENTION
[0001] The invention generally relates to systems, devices and methods for monitoring a subject and more particularly to systems, devices and methods for monitoring and attending to a subject using at least a motion sensing device for sensing vital signs of the monitored subject.
BACKGROUND
[0002] Caregivers (such as parents) who are responsible for the well-being of their wards, such as an infant, an elderly subject, or someone who is infirm, may occasionally have to step away from the subject in their care, especially when the subject is sleeping. Nevertheless, the caregiver needs to remain aware of any changes in their ward's state. People requiring assistance, for example when leaving their bed, may also be unable to articulate their needs and comfort level.
SUMMARY OF THE INVENTION
[0003] Aspects of disclosed embodiments pertain to a method for monitoring and attending to a subject in a specific environment, where the method may include at least:
[0004] receiving sensor data from one or more sensors located in the environment, the one or more sensors being configured to sense one or more physical characteristics of the subject and/or of the environment; [0005] processing the received sensor signals to determine at least one updated condition of the subject being monitored and/or at least one updated condition of the environment, using one or more analysis algorithms;
[0006] controlling operation of one or more controllable devices, based on the determined at least one updated condition, wherein the one or more controllable devices are located in the environment;
[0007] accumulating sensor data and analyzing accumulated sensor data to determine personal behavior characteristics of the specific subject, based on behavior of the accumulated sensor data; and
[0008] adjusting the one or more analysis algorithms, based on determined personal behavior characteristics of the specific subject.
[0009] Aspects of disclosed embodiments may also pertain to a system for monitoring and attending to a subject located in a specific environment, where the system may include at least:
[0010] (i) one or more sensors, located in the specific environment, each sensor being configured to sense one or more characteristics of the subject and/or of the environment; and [0011] (ii) a processing and control subsystem (PCS) configured at least to:
[0012] receive sensor data from one or more sensors located in the environment, the one or more sensors being configured to sense one or more physical characteristics of the subject and/or of the environment;
[0013] process the received sensor signals to determine at least one updated condition of the subject being monitored and/or at least one updated condition of the environment, using one or more analysis algorithms; [0014] control operation of one or more controllable devices, based on the determined at least one updated condition, wherein the one or more controllable devices are located in the environment;
[0015] accumulate sensor data and analyzing accumulated sensor data to determine personal behavior characteristics of the specific subject, based on behavior of the accumulated sensor data; and
[0016] adjust the one or more analysis algorithms, based on determined personal behavior characteristics of the specific subject.
[0017] Aspects of disclosed embodiments may further pertain to a smart mattress which may include at least:
[0018] (a) a mattress element having a pocket therein forming an upper mattress layer and a lower mattress layer;
[0019] (b) a monitoring device located within the pocket, the monitoring device having one or more sensors being configured at least to sense one or more characteristics of a subject lying over the mattress.
[0020] According to some embodiments the mattress element may also include a closing mechanism for enabling closing and opening an opening in the pocket for removal and insertion of the monitoring device out of and into the pocket of the mattress element.
[0021] The smart mattress may be used as part of the above described system at least as one of its monitoring devices located in the subject bed or any other resting apparatus.
BRIEF DESCRIPTION OF DRAWINGS
[0022] For a better understanding of various embodiments of the invention and to show how the same may be carried into effect, reference will now be made, by way of example, to the accompanying drawings. Structural details of the invention are shown to provide a fundamental understanding of the invention, the description, taken with the drawings, making apparent to those skilled in the art how the several forms of the invention may be embodied in practice. In the accompanying drawings:
[0023] Fig. 1 is a schematic block diagram of a system for monitoring and responding to a subject in a particular monitored and subject environment such as a smart nursery, according to some embodiments;
[0024] Fig. 2 is a flow diagram of a method for monitoring and responding to a subject in a particular monitored and subject environment such as a smart nursery, according to some embodiments;
[0025] Fig. 3 is a block diagram of a system for monitoring a subject and responsively controlling one or more controllable devices that are located in an environment of the subject, according to some embodiments;
[0026] Fig. 4 is a flowchart, schematically illustrating a process for monitoring a subject and responsively controlling one or more controllable devices that are located in an environment of the subject, according to some embodiments;
[0027] Fig. 5 is a flowchart, schematically illustrating a personalization process, in which the personal behaviors of the subject are measured via the system sensors, and sensor data analysis is personally adjusted, based on typical subject behavior in different behavior types, according to some embodiments;
[0028] Figures 6A-6D show a smart mattress having a monitoring device embedded therein, according to some embodiments: Fig. 6A shows an isometric view of the smart mattress; Fig. 6B shows a cross sectional view of the smart mattress; and Fig. 6C shows a side view of the smart mattress; and Fig. 6D shows an elevated isometric view of the smart mattress having a rigid frame surrounding its circumference; and [0029] Fig. 7 shows an illustration of some optional components of a monitoring device for smart mattresses, according to some embodiments.
DETAILED DESCRIPTION
[0030] It is to be understood that the invention and its application are not limited to the methods and systems described below or to the arrangement of the components set forth or illustrated in the drawings, but are applicable to other embodiments that may be practiced or carried out in various ways.
[0031] Embodiments of the present invention pertain to methods, devices and systems for monitoring and attending to a subject in a specific (e.g., confined) environment such as a room, in which the subject is frequently, permanently, or occasionally located such as a bedroom of the subject, a confined compartment in a nursery institution, etc.
[0032] The term “subject” used herein may refer to any human or animal that should be under supervision and care.
[0033] Aspects of disclosed embodiments pertain to a system for monitoring and attending a subject located in a subject environment (shortly referred to herein also as a “smart room”) including one or more controllable devices located withing the subject environment, according to some embodiments of the present invention. The smart-room system may include, for example, at least:
[0034] one or more sensors located in the monitored environment (e.g., room) and configured and located for sensing one or more characteristics of the subject and/or of the room/environment; and
[0035] one or more processing and control means for processing (analyzing) received sensors data/signals from the one or more sensors and determining an updated condition of the subject and/or of the subject environment, based on sensors data analysis, and controlling operation of one or more controllable devices located in the subject environment (also referred to herein as “controllable devices”, attending devices” or ’’output devices”) based on sensor data analysis results and determined subject/environment condition. According to some embodiments, the controllable devices are configured for example, for one or more of: [0036] stimulating the subject using one or more controllable devices referred to herein as “stimulation type” devices (for example, by applying auditory stimuli e.g., by outputting calming music or a caregiver’s recorded or real time transmitted voice or heartbeat sounds, controlling room illumination, applying tactile stimuli to the subject such as by applying tactile vibrations or rocking of the subject/bed, outputting a pleasant odor using a spraying device, heating/cooling of the room, adding/reducing humidity of the air in the room, filtering the air in the room, operating a crib-mobile device, applying visual stimuli, etc.),
[0037] providing the subject with treatment including, using controllable devices referred to herein as “treatment type” devices, for example, automatic medication delivery, automatic meal/formula-milk preparation, warming, and/or delivery, automatic inhalation and/or increasing of the oxygen level in the vicinity of the subject, and the like),
[0038] automatic outputting of alerts such as sound alerts for alerting the subject’s caregiver(s) etc.,
[0039] automatic real time transmitting of information indicative of the sensed subject and/or room characteristics and/or of determined one or more conditions of the subject and/or room, to one or more remote devices accessed by one or more caregivers, and/or to at least one remote server controlling inter alia messages transmission to the remote device(s) of the caregiver(s);
[0040] displaying auditory and/or visual content using controllable devices referred to herein as “stimulation type” devices. [0041] According to some embodiments, the processing and control means may be configured to use accumulated sensor data associated with the subject’s behavior (optionally responsive to operation of the controllable devices) to predict future behavioristic characteristics such as subject’s typical feeding and/or sleep times, stimulations that cause desired and undesired effects such illumination/sound stimuli that causes the subject to fall asleep better/quicker, illumination calming or agitating the subject and the like.
[0042] According to some embodiments, parental heartbeat sounds may be recorded or acquired in real time and played (outputted) to the subject in real time or offline. According to some embodiments, vibration stimuli applied over the subject and/or rocking/swinging stimuli may be synchronized with the rhythm of played parental heartbeat sound.
[0043] According to some embodiments, the monitored environment/room characteristics may pertain to, for example, to one or more of: sound/noise, illumination, air parameters (quality, humidity, temperature, etc.), devices’ operation characteristics such as malfunctioning, activated/deactivated state of each device, etc. and the subject’s conditions may include vital signs of a subject such as breathing, presence in bed or in the room (in/out of bed/room), pulse/heartbeat condition, body temperature, voice patterns (crying, awake, volume and/or pitch of voice, calling to a caregiver, et.), and the like. The room may be an infant's nursery (in which case the bed is typically an infant's crib), a hospital room or compartment etc., a room of a bedridden subject, an incubator, or any other confined environment in which the subject is routinely located.
[0044] The controllable devices may also be configured for influencing room/environment conditions in order to ultimately improve the subject’s conditions in order to improve comfort and safety of the subject.
[0045] Reference is made to Fig. 1, showing a block diagram of a smart-room system 20 (shortly referred to herein as “system” 20), according to some embodiments. The system 20 may include multiple sensors such as sensors 31-36 configured and located for sensing one or more characteristics of the subject and/or the room. Sensor signals, from the smart-room system’s sensors, may be transmitted to a main processor, which processes the signals to determine appropriate, real-time settings for the operation of one or more smart-controllable devices such as devices 38-49. The main processor may be a cloud-based, remote server 24, which may communicate with the controllable devices 38-49 through a smart-room hub 26. Communications between the smart-controllable devices 38-49, the sensors 31-36 and the smart-room hub 26 may be by any wired and/or wireless communications protocol, such as the Bluetooth Low Energy (BLE) protocol. In further embodiments, the smart-room hub, rather than being an independent device may be integrated into one of the other smart- controllable devices described hereinbelow. According to some embodiments, the system 20 may also enable receiving sensor data/signals from a secretion sensor 39 configured to sense secretion of the subject to enable alerting the caregiver(s) when the subject needs attending cleaning or diaper changing. The secretion sensor 39 may be configured, for example, to sense dryness level, chemical substances that are associated with various subjects secretions such as urine, vomit, feces, neonatal milk secretion, etc. by being located in proximity to the subject such as over the bed/crib mattress or by being attached to the subject. The secretion sensor may include a humidity sensor, a proximity sensor and the like.
[0046] The remote server 24 may be configured by a machine learning training process to optimize the operation of controllable devices 38-48 in response to the received sensor signals, that is, to optimize the control signals that are sent to the controllable devices as described further hereinbelow with respect to Fig. 2. The optimization of control signals is typically designed to provide optimal sleeping conditions, which may include conditions for putting a subject to sleep, extending a subject's sleep, and avoiding health risks such as sudden infant death syndrome (SIDS). [0047] In some embodiments of the present invention, a human operator, such as a caregiver, may operate a mobile device 28 on which an application, referred to hereinbelow as a "smart-room app," may be installed. The smart-room app may provide a human interface for interacting with the smart-room, including interacting with the remote server, the hub, the sensors and the devices for performing tasks, such as setup, monitoring, and maintenance. The mobile device 28 may communicate by wireless means, such as Bluetooth or Wi-Fi Direct wireless standards with smart-room sensors and devices, either directly, or through the smart-room hub 26. In further embodiments, the mobile device 28 may communicate by mobile device communication protocols with the cloud-based, remote server 24, which in turn provides a communications path, typically by internet communications protocols, to the smart-room hub 26. The mobile device may be a smart phone, such as an Android compatible device. Other processing devices— such as work- stations, smart TVs, and internet of things (IOT) devices may also be configured to execute a similarly configured smart-room app for providing a user interface, thereby enabling a caregiver to interact with the other smart- controllable devices.
[0048] Typical smart-room sensors for sensing room conditions include a microphone 31, a video monitor 32, a smoke detector 33, a bed motion sensor 34 (which may operate as an “under-the-mattress” pressure sensor) and an air quality sensor 36 (which may include multiple sensors for sensing aspects of the air, such as particulates, humidity, and temperature).
[0049] The smart-room system 20 may additionally include a combined sensor unit 30 having several of the sensors embedded therein such as the motion sensor 34, the microphone 31, an optical sensor, a camera, and a pressure sensor (not shown) for measuring subject’s weight while rested over the bed. According to embodiments, the combined sensor unit 30 may be configured to be located at the subject’s bed for sensing vital subject signs such as breath, heartbeat rate, sound.
[0050] According to some embodiments, the microphone 31 may also be used to detect the subject’s voice to identify voice patterns and determine characteristics of the subject’s behavior based on sound/voice/speech detection and analysis. For example, for infant subjects, the analysis module may perform sound or voice analysis of sounds of the subject to identify if the subject is crying or screaming and other associated properties of the subject’s voice such as duration of crying/screaming and/or identify other vices of caregivers (e.g. to detect caregiver’s negligence if the subject is left without anyone addressing/attending to him/her for too long etc.). Alarming situations may be determined under certain conditions and criteria such as for example, when the subject cries or screams for a continuous period of time that exceeds a predefined threshold. Upon identification of such emergency, alerts may be sent to one or more mobile devices of one or more caregivers. Caregivers such as parents relying on other people to assist them in attending the subject when they are not available to do so, can be provided with periodic reports (generated via the processing means) indicative of the other caregivers’ functioning and performances, e.g., based on ongoing tracking of other caregivers’ responsiveness times (in terms of time it takes the other caregiver to respond to the subject when required), analysis of recorded voice of the caregiver to identify how the caregiver addresses the subject etc.
[0051] The motion sensor 34 is typically an “under-the-mattress” sensor pad or platform having a large surface area (formed by a length and width thereof) in respect to its height, that is configured to detect a subject's vital signs, such as heart rate and/or respiratory rate. In some embodiments, rather than sending pressure or motion signals from the bed motion sensor directly to the remote server 24, the motion sensor may process the signals and transmit a post-processed signal at regular intervals indicating a sleeper's vital signs including heart rate, heart rate variability (HRV) and/or breathing rate. Additional processing functions, described further hereinbelow, may include recognizing, based on the vital signs and movement, a subject's sleep status (whether sleeping or not, level of relaxation, etc.) as well as learning infant sleeping patterns. Processing by the remote server may include determining appropriate settings of the smart-controllable devices based on the infant's sleep status and sleeping patterns.
[0052] The bed motion sensor may also monitor whether or not a subject is in the bed (or a baby is in its crib). When there is no one in bed, other monitor and control functions may be automatically stopped. The bed motion sensor may also be configured to automatically transmit an immediate alarm signal if an infant has stopped breathing, indicating that the infant is experiencing SIDS.
[0053] The video monitor (i.e., camera) and/or the microphone may be configured to monitor a sleeper's presence in the bed. If a subject is not present, some or all automated actions of the smart-room, such as issuing controls and alerts, are typically disabled. The video monitor (i.e., camera) and microphone may also be configured to sense a subject's vital signs, determining a subject's breathing, for example, from audio and/or visual signs. Alternatively or additionally, the video monitor and microphone may monitor other respective video and audio signals in the room, such as movement, light levels, human features, such as facial features (for facial recognition) and voices (for voice recognition). The video monitor may also include infrared sensitivity for detecting low light images. As mentioned above, in some embodiments the smart-room hub is integrated into one of the sensors or devices, such as the video monitor.
[0054] Signals from the various sensors are typically transmitted to the smart-room hub 26, which in turn may transmit the signals to the remote server 24 for processing that determines settings of the smart-controllable devices. Alternatively or additionally, some or all of the processing may be done directly by the smart-room hub or by the mobile device 28.
The smart-controllable devices that affect various conditions in the sleeper's environment may include a bed motion generator 38, a speaker 40, an air purifier 42, a humidifier 44, a thermostat 46, and a light 46.
[0055] The motion generator 38 is typically configured to apply soothing motion, such as a rocking and/or vibration motion, to the bed, and, in particular, to an infant's crib. Typically the type of motion can be controlled in real time, such that the motion may be applied at different frequencies and at different power levels. Such rocking vibrations may sooth people, particularly infants.
[0056] The speaker in some embodiments may be a "white noise" generator, programmed to generate low frequency sounds like a "rumble," which may help to calm a someone trying to fall asleep. Typically, the speaker is also configured to play additional sounds, such as a soft heartbeat, which may mimic the sound of a mother's heart, or soft music. The various audio options may be pre-recorded and stored in the speaker, or in some embodiments the audio may be transmitted from the mobile device or remote server.
[0057] The air purifier 42, the humidifier 44, and the thermostat 46 may all be set remotely from the mobile device or remote server. Settings may be modified according to signals received related to room conditions and a sleeper's vital signs, as described further hereinbelow.
[0058] The light 48 is typically a red-green-blue (RGB) variable night light, which can be modified in real time to change light levels and colors.
[0059] According to some embodiments, the system 20 may further include one or more treatment devices 49 such as a food/drink preparation and/or warming device(s) for automatic preparation of the food once the subject is awake (e.g., in case of a baby or toddler subject preparation and/or warming of formula milk via a milk warmer/preparation device). [0060] Fig. 2 is a flow diagram of a process 200 for monitoring and attending to sleeper's needs, according to some embodiments of the present invention. The process includes an operational stage 202 that typically operates continuously, regardless of whether or not a subject is in the bed. As described above, recognition of a subject's presence may be one of the functions of the system, such that stage 202 may operate regardless of whether a subject is present or not in the bed of the smart-room.
[0061] At a step 204, signals from the smart-room sensors are acquired for processing, typically, by the remote server 24. (Alternatively or additionally, processing may be performed at the smart-room hub 26 and/or at the mobile device 28).
[0062] At a step 206, the acquired signals are processed by signal processing methods to extract characteristics, or features, of those signals that correspond to predefined rules. The predefined rules indicate automated actions to be implemented when given characteristics of the signals are identified. Examples of such actions are described further hereinbelow. In some embodiments, the predefined rules may be configured as a neural network or as other frameworks of artificial intelligence known in the art. Alternatively or additionally, the predefined rules may be configured as a rules table, specifying signal thresholds that activate the corresponding automated actions. The rules may include recognition methods for identifying caregivers, based on audio and/or visual signals. The rules may also include recognizing sleep patterns, including expected remaining sleep time, based on motion signals received from the bed motion sensor. Automated actions defined by the rules may include setting environmental controls to optimize comfort for the sleeper, including helping the sleeper to fall asleep and extending sleep time.
[0063] At a step 208, the application of the rules determined at the step 206 may include issuing control signals to operate and/or change settings of smart-controllable devices, such as the light, speaker, bed vibrator, etc. Additional actions may include transmitting signals, including notices and alerts, to the mobile device 28, as well as to other possible user interfaces. Actions performed at the step 208 are typically performed in parallel with the continued acquisition of sensor signals and the processing of those signals. That is, the steps of the operational stage 202 are generally performed continuously as a real-time monitoring and control process.
[0064] The predefined rules may be generated and/or improved by a training, or machine learning, stage 210, which may operate in parallel with the operational stage 202. At a configuration step 220, operational goals are set, such as goals of helping a subject to fall asleep more quickly, extending sleep time, or setting sleep goals according to the time of day. At a validation step 222, the goals are compared with actual results of the current smart-room device settings. The validation step determines whether current rules are meeting the goals, and, if not, changes are made to the rules according to preset change patterns. Change patterns may include, for example, incremental lighting and audio changes.
[0065] Modifications to the rules may be applied at a step 224. In some embodiments, stage 210 is a machine learning framework, such as a neural network generator. The machine learning may be based on multiple iterative tests of one smart-room, or on multiple tests from multiple smart-rooms. In some embodiments, the training process "learns" correlations between vital signs, sleeper motions, and room conditions (e.g., lighting, crib vibration, and sounds), in order to determine the sleeper's "preferences," that is, conditions such as sound, lighting, and crib vibration patterns, that may help the subject to fall asleep or extend the subject's sleep time. The correlations with the subject’s preferences are then incorporated into the preset rules. Stage 210 is typically implemented by the remote server 24; but alternatively or additionally, this processing may be performed at the smart-room hub 26 and/or at the mobile device 28. [0066] Subsequently, during the operational stage, the main processor may provide to a caregiver a notification of expected remaining sleep time (or expected time until falling asleep). A caregiver may have an option for modifying the room conditions to support or effect the sleeper's sleep patterns, such as extending the sleep time (for example, by changing the lighting, bed vibration, and sounds), reducing noise, etc.
[0067] The various scenarios described below indicate typical signal processing situations in which the smart-room sensor signals are received by the main processor and the main processor responsively changes device settings.
[0068] In one exemplary scenario, the main processor monitors movement, video, and/or audio signals and determines a sleeper's sleep patterns (also referred to herein as "sleep cycles"), including making a determination of when a subject is about to wake up. In response, if the caregiver has set the smart-room to extend sleep time to a maximum, the main processor may start playing sounds determined to be soothing (such as white noise), to help the sleeper to continue sleeping.
[0069] In another exemplary scenario, when a caregiver enters the smart-room and approaches his sleeping ward at night, the main processor turns on the smart-room light to a preset low light level, to help the caregiver care for the subject. The light is then turned off when received signals, such as video monitor signals, indicate that the caregiver is exiting the room.
[0070] In another exemplary scenario, particularly designed for infants, the main processor detects from audio signals that a mother has attached the microphone to her chest. The heartbeats are then played on the room’s speaker, soothing an infant in real-time.
[0071] From the mobile device, the caregiver can also select a given item of music, such as a lullaby, from the smart-room app, or other audio item, such as a parent reading a story. The app transmits the selection to the main processor, which then plays the selected item from the smart-room speakers. The preset rules may also determine lighting and crib motions that are appropriate for the given item. Audio items, such as lullabies, may also be recorded by the caregiver from the smart-room app, and stored so that they can be subsequently selected for playing.
[0072] In another exemplary scenario, the main processor may determine a subject's sleeping behavior and sleeping status and may notify the caregiver that the current sleep is expected to continue for a certain period of time.
[0073] In another exemplary scenario, the main processor detects that a sleeping subject is not moving or in distress, and responsively notifies the caregiver with critical information about the nature of the emergency. During this time, the main processor may also instruct the in-room speakers to play alarm sounds, as caregivers may be in hearing range.
[0074] In another exemplary scenario, based on signals from one or more of the video monitor, the microphone, and the bed motion sensor, the main processor detects that there is no subject in the bed. Rules for controlling the environment for encouraging sleep may not be activated until someone returns to bed (or an infant is set in the crib).
[0075] In another exemplary scenario, when the air sensor detects that humidity is below a desired rate, the humidifier is instructed by the main processor to start working. This action may be set to operate continuously or only when a subject is in the bed.
[0076] In another exemplary scenario, comprehensive reports about a subject's sleeping cycle are provided to the caregiver (that is, to the smart-room app on the mobile device). The report may include sleep analytics, vital signs, images captured by the video monitor, the times that the sleeper was attended, and by whom (which may be determined according to image or voice processing), the number of movements and times the sleeper moved, or turned over, etc. [0077] Computational aspects of system 20 and of process 200 may be implemented in digital electronic circuitry, or in computer hardware, embedded firmware, software, or in combinations thereof. All or part of the process may be implemented as a computer program product, tangibly embodied in an information carrier, such as a machine-readable storage device or in a propagated signal, for execution by, or to control the operation of, data processing apparatus, such as a programmable processor, computer, or deployed to be executed on multiple computers at one site, or distributed across multiple sites, including cloud configurations. Memory storage may also include multiple distributed memory units, including one or more types of storage media. A computing system configured to implement the system may have one or more processors and one or more network interface modules, using one or more communication networks, links and/or protocols. Processors may be configured as a multi-processing or distributed processing system. Network interface modules may control the sending and receiving of data packets over networks.
[0078] Reference is now made to Fig. 3 schematically illustrating a system 100 for monitoring a subject and/or an environment such as a room in which the subject is mostly or occasionally located, and responsively and adjustably controlling controllable devices located in that environment for improving/optimizing subject condition/state and monitoring subject’s vital signs, according to some embodiments.
[0079] The system 100 may include at least:
[0080] a sensors subsystem 110 including multiple sensors such as, yet not limited to, one or more of: movement sensor(s) (e.g., based on piezoelectric element(s)), proximity sensor(s), heartbeat meter, weight, pressure sensor(s), temperature sensor(s), humidity sensor(s), air pollution sensor, microphone(s), camera(s), etc.;
[0081] a processing and control subsystem (PCS) 150, which may include one or more software and/or hardware means, configured for receiving sensor signals/data (herein also referred to as “sensor data”), analyze the received sensor data to determine one or more conditions of the subject/environment and control operation of one or more controllable devices in the environment of the subject (e.g., room) based on determined one or more subject/environment condition(s), and optionally also to receive users input data and display information via one or more output devices, the information being indicative of analysis results, subject status, input selection and interface screens/pages and the like; and
[0082] at least one server such as server 170, which may be a local computer device operating the PCS 150 or a remote server enabling to receive sensor data and input data via one or more communication links such as link 17.
[0083] According to some embodiments, if the server 170 used is used as a share server for several monitoring systems of different subjects, the server 170 may also operate a central processing module 171 configured to:
[0084] (i) receive sensor data and optionally also inputted information from multiple
PCSs of multiple monitoring systems, each associated with a different subject;
[0085] (ii) accumulate received sensor data;
[0086] (iii) receive information indicative of various responses of subjects (e.g. of the same subject type such as same age group), to various actions related to various modes of operation of various controllable devices, taken in response to identified behavioral patterns of the subjects;
[0087] (iii) process the accumulated sensor data and responses data, by using one or more algorithms (e.g., based on statistical calculations/models); and
[0088] adjust the analysis algorithms used by each monitoring system based on accumulated sensor data (e.g., by adjusting threshold and parameters normal averages ranges etc.) and/or adjust operation programs for operating one or more of the controllable devices in response to identified subject behavior pattern(s). [0089] For example, statistical survey of multiple baby and toddler subjects may result in identifying that upon identification of a sleep pattern indicative of early awakening stages in hours in which the baby/toddler should be put back to sleep (e.g. settable by caregiver), operating a static noise/sound or calming music, for example, will help the subject to fall back into sleep without requiring alarming the caregiver(s) and will help the subject to develop healthy falling-asleep skills and habits.
[0090] According to some embodiments, as shown in Fig. 3, at least some of the controllable devices 160 used by the system 100 may be a part of the system 100, wherein the system 100 is adapted to connect to and/or communicate with designated known system controllable devices 160 and optionally also to external controllable devices, e.g. via standard communication/connection links such as via USB link, wireless (WiFi/Bluetooth) links etc.
[0091] According to some embodiments, the PCS 150 may include:
[0092] a sensors module 151 configured to receive sensor data from all operated sensors of the system 100 (e.g., in real time (RT) or near real time (NRT));
[0093] an analysis module 152 configured to analyze received sensor data in Real Time (RT), near real time and/or offline, to determine various conditions, typical behavior, and states of the subject such as sleeping, awakening, awake, agitated, crying, distressed, in physical hazard such as high/low fever, breathing problems/risk of apnea etc., identify hazardous situations and set alerts and/or messages and/or display information indicative of determined condition, as well as to select which controllable device to operate to assist the subject in optimizing/improving his/her condition and how to operate each selected controllable device. The analysis module 152 may be further configured to predict subject’s behavioral characteristic such as feeding and sleeping times and operate the one or more controllable devices based also on the predicted subject behavior and predicted responsiveness to the specific devices’ operation features; [0094] a devices control module 153 configured to carry out the actual control of operation of each selected controllable device, e.g., via selected/generated control plans, each including control command(s) for each selected controllable device;
[0095] a communication module 154 configured to control communication with the server 170, the sensors subsystem 110, the controllable devices 160, external caregivers’ mobile devices such as smartphone 10, etc. via one or more communication links, networks, protocols and methods;
[0096] a calibration and adjustment module 155 configured, inter alia, to adjust and/or calibrate analysis algorithm(s), which may be based on machine-learning, external (e.g., statistical) information, and on caretaker(s) feedback, where the calibration and/or ongoing adjustment is done based on identification of specific and personal sensor data patterns for several sensors of the sensors subsystem 110 of the specific subject, indicative of specific physical patterns and behavior of the subject such as specific breathing and/or heartbeat patterns when sleeping/awake/awakening, specific vocal behavior/patterns of the subject in different states such as specific crying voice patterns, etc.;
[0097] a user interface (UI) 156 supported by the PCS 150 and operable via one or more computer and communication devices such as mobile devices having one or more display and input means such as a touch screen, microphone, screen, keyboard etc. for enabling users such as caregivers to input/select information associated with the specific subject such as: [0098] subject (updated) personal details such as name, age, gender, weight, height, etc.
[0099] caregivers’ details such as name and phone number etc.;
[00100] information pertaining to the controllable devices available in the subject’s environment;
[00101] information pertaining to habits and schedules of the subject such as typical feeding times, cleaning time, medication intake dosages, schedules and conditions/requirements (e.g. intake can be done only after eating, before bedtime, and the like), etc.
[00102] According to some embodiments, the calibration and adjustment module 155 may be further configured for automatic accumulation of sensor data over time from each sensor, analysis results of each event e.g., especially alarming events, learning personal sensor data behaviors of the specific subject in various conditions/states of the specific subject, and adjust/calibrate the analysis algorithm(s) used by the analysis module 152. Since for many subjects such as infants the typical specific subject behaviors and consequent sensor data behavior may change over time, therefore the ongoing automatic data accumulation and analysis algorithms’ adjustment may dramatically improve sensor data interpretation and the manner in which the condition of the subject/environment is determined. For example, babies may change sleeping, feeding and even heartbeat and breathing normal rates and patterns every few months or even within a few weeks as they quickly develop. Automatically adapting the analysis algorithms to the personal developmental normal changes in the subject may enable avoiding false alarms and a more personalized and precise monitoring, for example, by setting thresholds according to the updated normal breathing rate of the subject as measured within a time span that is close to the current RT monitoring time.
[00103] According to some embodiments, the calibration and adjustment module 155 may be further configured to control and initiate a calibration testing procedure, testing the subject’s personal responsivity to various stimulations at various stimulation modes, volumes, intensities, types, etc. To do so, the calibration and adjustment module 155 may operate each stimulation controllable device at its different enabled modes/intensities etc. and analyze RT received sensor data to check the subject’s responsivity to the particular stimuli at the particular operation mode and intensity. The measured responsivity characteristics of the subjects to the various stimulations and stimulation modes and intensities applied thereover, are then used to determine personalized response operation programs or commands, where each conditioned determined in RT by the PCS 150 is associated with a specific control devices’ operation program that is calibrated/adjusted based on the preliminary personalized subject’s responsivity to the various controllable devices’ stimulation features such as stimulation types, modes and intensities.
[00104] According to some embodiments, the PCS 150 may further be configured to process inputted information and accumulated sensor data to generate one or more recommendations for the caregivers. The generated recommendations may be outputted, displayed and/or transmitted for being displayed to the one or more caregivers or other authorized users for further treatment. The recommendation may include, for example:
[00105] (i) treatment recommendations (e.g., recommended times in which the subject should be put to sleep based on measured actual sleep patterns, etc.);
[00106] (iii) further investigation recommendations for farther diagnosis by professionals (e.g., if the subject is suspected to be ill or have a chronical condition such as chronical breathing problems, deduced based on analysis of accumulated sensory data of a period of time, a recommendation for further professional diagnosis and treatment may be generated;
[00107] (iii) system optimization recommendations e.g., recommendations for adding, removing and/or replacing controllable devices and/or sensors form improved sensing and responsive feedback.
[00108] According to some embodiments, as shown in Fig. 3, the system 100 may further use one or more data bases such as internal database 157 and/or external database 180 and/or data storage units for orderly storing one or more of: accumulated sensor data and/analysis results and their associated acquisition times, sensor type, determined conditions, personal details of the subject and of the caregiver(s), inputted preferences, control program and commands, control and communication protocols, defined system’s 100 controllable devices information (e.g., for enabling operation and operation control such as power control ranges, on/off switching requirements, modes selection options etc.) and operation-control), rules, thresholds and ranges, system requirements, and the like.
[00109] Reference is now made to Fig. 4, which is a flowchart, schematically illustrating a process for monitoring a subject and controlling one or more controllable devices that are located in an environment of the subject, in response to ongoing RT or near RT monitoring data analysis, according to some embodiments. This process may be carried out using one or more sensing, computer operated and communication means and may include at least the step of:
[00110] acquiring RT sensor data from one or more sensor, the sensor data being indicative of subject and/or environment (e.g., room) characteristics 401;
[00111] analyzing the acquired sensor data to determine one or more physical characteristics of the subject and/or of the environment (room) 402) using one or more analysis algorithms to determine subject and/or environment condition(s) 403, which may be machine learning algorithms or may be adjusted via using other machine learning algorithms for analysis of accumulated sensor data and optionally other added information;
[00112] if an “at risk” (hazardous/al arming) situation is identified/determined, based on determined condition(s) (e.g., by checking whether measured parameter values such as pulse, breathing rate etc. exceeds a threshold) 404, an alarm (such as auditory alarm) may be set and/or alert messages may be transmitted to caregiver(s) mobile device(s) 405;
[00113] determining operation commands (e.g., by selection of preprogrammed control plans) for controlling one or more controllable devices located within the environment, based on current/updated determined subject/environment condition(s) 406;
[00114] controlling the controllable devices based on the determined operation commands
407; [00115] (optionally) sending (frequent) updates to caregiver(s) mobile devices 408 e.g., informative of the determined condition(s) of the subject/environment;
[00116] storing accumulated sensor data and/or analysis results and their associated information 409 such as time and date of acquisition etc., in one or more data storage modules/units/databases; and
[00117] updating/adjusting/calibrating analysis algorithms 410 e.g., based on ongoing analysis of accumulated data.
[00118] Fig. 5 is a flowchart, schematically illustrating a personalization process, in which the personal behaviors of the subject are measured via the system sensors, and sensor data analysis is personally adjusted, according to some embodiments. The personalized adjustment of the analysis of sensor data may be done by measuring typical sensor output signals/data behavior (patterns) over periods of time during various states of the subject such as, for example, breathing, heartbeat and/or movement patterns during different subject’s states such as sleeping, awakening, agitation, hunger, crying, calmness, fully awake, and the like. These sensors’ signals/data patterns may be used for adjusting typical parameters’ values or ranges thereof in the sensor data analysis algorithms such as ranges of heartbeat and/or breathing cycles’ rates, where each range of each type of parameter/sensor is associated with a different subject state.
[00119] Aspects of disclosed embodiments pertain to a smart mattress and smart mattresses systems having a monitoring device embedded therein, where the monitoring device is configured at least to monitor vital signs such as movement, breathing and/or heartbeat of a subject lying over the mattress.
[00120] According to some embodiments, the smart mattress has an inner pocket that allows removable placing the monitoring device therein such that the monitoring device is located between two parts/layers of the mattress forming an upper mattress layer located above an upper surface of the monitoring device and a lower mattress layer located below a lower surface of the monitoring device.
[00121] According to some embodiments, the monitoring device may include one or more movement sensors such as one or more piezoelectric transducers and also optionally a weight sensor for measuring the subject’s weight when lying over the mattress. The movement sensors may be spread along the surface area of the monitoring device such as to cover maximal surface area of the mattress.
[00122] The smart mattress may be designed according to the subjects’ requirements and measures such as for babies, infants, toddlers or young children between certain ages range (designed in size, safety and materials designated for baby crib or children beds etc.), elderly people etc.
[00123] For example, for babies and/or toddlers beds/cribs, the mattress may be made from firmer materials for prevention of SIDS often caused due to sudden apnea, using a “breathing mattress” material and structure design such as using a three-dimensional (3D) polymer coiled mattress such as Polyethylene (PE) or Polyolefin (POE) coil mattresses in which a polymeric material is formed into weaved or entangled coils or strings that are substantially rigid yet elastic enough to allow dispersed spring like movement responsive to the subject’s movement and that forms air pockets between the polymeric coils/strings for allowing air to pass therethrough.
[00124] According to some embodiments, the monitoring device may be designed as a flat plate-like shape having a casing for encasing sensors, processing unit and other components thereof, with a surface area that is dramatically larger than its width - to allow sensing movement signals from the majority of the mattress’s surface area. [00125] Figures 6A-6D and Fig. 7 show a smart mattress 1000 or parts thereof, the smart mattress 1000 has a monitoring device 1500 embedded therein, for monitoring at least vital signs of a subject, according to some embodiments.
[00126] In some embodiments, as shown in Fig. 6B the smart mattress 1000 may include a mattress element 1100 having a pocket 1140 (an enclave or inner cavity) of a surface area that is equal or approximated to the surface area of the mattress element 1100. The pocket 1140 may form an upper mattress layer 1110 and a lower mattress layer 1120, made from polymer coiled mattress material, where the upper mattress layer 1110 may also be covered at an upper surface thereof with a cover layer 1300 made of a different mattress material such as a waterproof material.
[00127] The pocket 1140 may also be surrounded by an inner lining 1145 that may be made from a waterproof material to prevent liquid (e.g. caused by subject’s secretions) to engage the monitoring device 1500.
[00128] The smart mattress 1000 may be designed in size and dimensions to fit a specific bed size, and the upper and lower mattress layers may be made from a breathing mattress material and strings/coils structure.
[00129] The monitoring device 1500 may be configured at least to sense movements of the subject lying over the mattress 1000, where its location between the upper and lower mattress layers 1110 and 1120 allows improving movement detection since the movements of the subject can be reflected from a lower bed support 60 over which the mattress is located through the strings of the lower mattress layer 1120 as well as the movements translated through the strings of the upper mattress layer 1110.
[00130] According to some embodiments, the smart mattress 10000 may also include a closing mechanism 1600 including one or more sealing or closing means such as a zipper 1610 and/or a hook-and-loop fastener 1620 for enabling opening and closing the pocket 1140 for removal and placement of the monitoring device 1500 therein. The hook-and-loop fastener 1620 may be used to enable at least partial waterproofing of the pocket 1140 inner lining 1145.
[00131] According to some embodiments, the smart mattress 1000 may also include or allow using a rigid frame 1700 surrounding and engaging the side perimeter of the smart mattress 1000 for improving movement/motion detection e.g., by enabling movement signals’ reflection from the frame 1700 towards the mattress 1000.
[00132] According to some embodiments, as illustrated in Fig. 7, the monitoring device 1500 may include, inter alia:
[00133] an upper casing element 1521;
[00134] a lower casing element 1522;
[00135] one or more sensors such as motion sensors 1511 and 1512 and a weight sensor 1515, and other sensors (not shown) such as, for example, at least one: humidity/chemical sensor (to detect chemical/moisture substances presence that can potentially damage the monitoring device 1500 and may also indicate that the subject needs diaper changing), microphone, proximity sensor (e.g. to detect presence of the subject in bed (in/out of bed), a thermometer, a pressure sensor, etc.;
[00136] optionally a processing unit such as a printed circuit bard (PCB) 1550 that can collect in RT sensors signals/data and transmit sensor data to external devices such as to a PCS of the smart room system 100 and/or to a processing and control unit 1800 that is connected (e.g., wired) to the PCB 1550 capable for example, of receiving sensor data, analyzing the received sensor data in RT to detect the condition of the subject and output alerts and/or information indicative of detected (updated/current( subject’s condition;
[00137] a power source such as battery(ies) 1560 that can be located at the monitoring device 1500 or at the PCU 1800 allowing powering at least the PCB 1550 and the sensors 1511-1515. In other embodiments the power source (whether via battery(ies) or main power supply line connection) may be connected only to the PCU 1800 where the PCU 1800 also serves as a the power source of the monitoring device 1500; and
[00138] one or more stimulation devices such as a vibration device 1570 for applying stimuli over the subject such as vibrations, swinging, etc.
[00139] According to some embodiments the PCU 1800 may include one or more of: [00140] a processor for processing received sensor data and determining subject’s condition;
[00141] one or more alert devices such as an alarm device, at least one controllable visual indication lamp (e.g., for indication of alarm/on/off states/power state), etc.;
[00142] a communication unit for transmitting alerts/information indicative of the subject’s condition to one or more remote device such as mobile devices, etc.;
[00143] display means such as a screen, e.g., for displaying information indicative of the subject’s condition;
[00144] alert output means such as one or more speakers;
[00145] control and input means such as on/off switch, mode selection switches/buttons etc.
[00146] According to some embodiments, the PCU 1800 may further include one or more detectors such as a camera and/or a microphone to sense subject and/or environmental characteristics that cannot be sensed via sensors embedded within the smart mattress 1000 such as presence voice, visuals of other subjects in the vicinity of the subject, the subject’s visual and/or audio characteristics, environmental conditions such as humidity and/or illumination characteristics etc.
[00147] According to some embodiments, the PCU 1800 may also enable controlling controllable device located in an environment of the subject practically serving as a hub 26 or PCS 150 of other sensory and/or controllable devices located in the subject’s environment, including the monitoring device 1500 as part of the smart room system 100 sensors and optionally also controllable devices of the system 100.
[00148] According to some embodiments, the two upper and lower supports 1521 and 1522 may have a size that fits into the pocket 1140 of the smart mattress 1000.
[00149] EXAMPLES
[00150] Example 1 is a method for monitoring and attending to a subject in a specific environment, the method comprising at least:
[00151] receiving sensor data from one or more sensors located in the environment, the one or more sensors being configured to sense one or more physical characteristics of the subject and/or of the environment;
[00152] processing the received sensor signals to determine at least one updated condition of the subject being monitored and/or at least one updated condition of the environment, using one or more analysis algorithms;
[00153] controlling operation of one or more controllable devices, based on the determined at least one updated condition, wherein the one or more controllable devices are located in the environment;
[00154] accumulating sensor data and analyzing accumulated sensor data to determine personal behavior characteristics of the specific subject, based on behavior of the accumulated sensor data; and
[00155] adjusting the one or more analysis algorithms, based on determined personal behavior characteristics of the specific subject.
[00156] In example 2, the subject matter of example 1 may include, wherein the method further comprises predicting personal subject’s behavioral characteristics and controlling at least one of the one or more controllable devices, based on predicted subject’s behavioral characteristics, the behavioral characteristics comprising at least: physical behavioral characteristics.
[00157] In example 3, the subject matter of example 2 may include, wherein the predicting of personal subject’s behavioral characteristics comprises predicting one or more of: falling asleep, sleep and awakening schedules, feeding schedules, secretion schedules, changing of a sleep stage schedules.
[00158] In example 4, the subject matter of any one or more of examples 1 to 3 may include, wherein the method further comprises initiating a calibration process comprising:
[00159] operating at least one of the controllable devices configured for applying stimuli over the subject at different stimulations modes and intensities;
[00160] measuring subject’s responsivity to applied stimulations;
[00161] calibrating and/or determining features of one or more operation programs for operating of the controllable devices responsively to the determined condition of the subject, based on measured subject’s stimulation responsivity.
[00162] In example 5, the subject matter of any one or more of examples 1 to 4 may include, wherein the controllable devices are configured for one or more of: stimulating the subject; treating the subject; displaying visual and/or auditory display of content to the subject; outputting and/or transmitting information to caregivers, the information being indicative of determined at least one updated condition.
[00163] In example 6, the subject matter of any one or more of examples 1 to 5 may include, wherein the one or more controllable devices comprise one or more of: at least one illumination device, at least one audio speaker, at least one crib vibrator, at least one air humidifier, at least one air conditioning device, at least one bottles warming device, at least one formula milk preparation machine, at least one medication delivery device, at least one food and/or drink preparation and/or delivery device, at least one bed heater, at least one motion generator, at least one air purifier, at least one communication device, at least one oxygen supply device, at least one inhalation device.
[00164] In example 7, the subject matter of any one or more of examples 1 to 6 may include, wherein the one or more sensors comprise one or more of: at least one microphone, at least one motion sensor; at least one pressure sensor; at least one thermometer; at least one humidity sensor; at least one air quality sensor; at least one camera, at least one optical sensor; at least one chemical sensor, at least one weight sensor, smoke detector.
[00165] In example 8, the subject matter of any one or more of examples 1 to 7 may include, wherein at least one of the one or more sensors is configured to detect one or more of: heartbeat, breathing, motion of the subject, voice, sound, secretions, temperature, air quality, smoke, subject’s presence, subject’s weight.
[00166] In example 9, the subject matter of any one or more of examples 1 to 8 may include, wherein the determinable conditions of the subject comprise at least one of: sleep, awake, in bed, out of bed, distressed, crying, agitated, in convulsions, having fever, hypothermia, hungry, in pain, thirsty, calm, calling a caregiver, shivering, in seizures, screaming, awakening, falling asleep, in spasms, apnea, sudden infant death syndrome (SIDS), wherein the determinable conditions of the environment comprise at least one of: too cold or hot, too humid or dry, fire/smoke, endangering pollution, over or under illuminated, noisy, sensory agitating, wherein each determinable condition is associated with one or more detectable characteristics and/or behavior over a period of time of the one or more detectable characteristics, and wherein each determinable condition is associated with one or more control commands for controlling one or more of the controllable devices, based on the determined condition.
[00167] In example 10, the subject matter of example 9 may include, wherein at least one of the determinable conditions is further associated with an alarming state, and a set of alert commands, for operating or outputting of one or more alerts and/or transmitting alerts to one or more remote devices.
[00168] In example 11, the subject matter of any one or more of examples 1 to 10 may include, wherein the method further comprises:
[00169] receiving and processing accumulated sensor data and inputted information, inputted by the one or more caregivers;
[00170] receiving information indicative of various responses of multiple subjects of the same subject type, to various actions related to various modes of operation of various controllable devices, the actions taken in response to identified behavioral patterns of the subjects generating accumulated responses data for the respective subject group type;
[00171] processing the accumulated sensor data and responses data, by using one or more algorithms (e.g., based on statistical calculations/models);
[00172] adjusting the analysis algorithms used by each monitoring system based on accumulated sensor data; and/or adjusting operation programs for operating one or more of the controllable devices based on accumulated Reponses data; and
[00173] generating one or more recommendations for the one or more caregivers.
[00174] In example 12, the subject matter of example 11 may include, wherein the method further comprises outputting, displaying and/or transmitting the generated one or more recommendations to the one or more caregivers and/or other authorized users.
[00175] In example 13, the subject matter of any one or more of examples 1 to 12 may include, wherein the conditions of the environment comprise at least one of: too dry, too humid, hot, cold, over polluted, noisy, over/under illuminated, number or people in the environment.
[00176] In example 14, the subject matter of any one or more of examplesl to 13 may include, wherein the at-risk condition is an indication of an acute safety hazard including at least one of: sudden infant death syndrome (SIDS), apnea, fall, severely high fever, sever hypothermia, panic, seizure, convulsions, wherein upon identification of an at-risk condition, one or more automatic emergency operations are executed including at least one of: operating an auditory and/or visual alarm, sending of alert messages to caregivers mobile devices, alerting one or more emergency authorities, operating one or more controlled devices used also for assisting in treating the subject in emergency situations.
[00177] In example 15, the subject matter of any one or more of examples 1 to 14 may include, further comprising providing updated status notifications to at least one caregiver indicative of the determined subject and/or environment condition.
[00178] In example 16, the subject matter of example 15 may include, wherein the status notifications are provided at regular time intervals.
[00179] In example 17, the subject matter of example 7 may include, wherein the status notifications are transmitted to mobile device of each caregiver.
[00180] In example 18, the subject matter of any one or more of examples 1 to 17 may include, wherein the processing of the sensor data and the controlling of the one or more controllable devices is done via a local server and/or a remote server configured for data storage, communication, processing, display, output, devices control, and devices control.
[00181] In example 19, the subject matter of any one or more of examples 1 to 18 may include, wherein the method further comprises:
[00182] receiving and accumulating sensor data from multiple monitoring systems each monitoring system being configured to monitor a different subject and control controllable devices in different environments;
[00183] analyze the received and accumulated sensor data to determine one of more statistical characteristics of subjects and/or of environments; [00184] adjusting one or more analysis algorithms and/or control programs in the monitoring systems based on determined statistical characteristics.
[00185] In example 20, the subject matter of any one or more of examples 1 to 19 may include, wherein the method further comprises: recording and/or real time acquiring of parental heartbeat sound; and playing the acquired or recorded parental heartbeat sounds to the subject, in real time or offline in respect to the time of recording or acquisition.
[00186] In example 21, the subject matter of example 20 may include, wherein the method further comprises applying tactile stimuli over the subject that is synchronized with rhythm of the played parental heartbeat.
[00187] In example 22, the subject matter of any one or more of examples 1 to 21 may include, wherein the method further comprises detecting functionality characteristics of the one or more controllable devices and, upon identification of a malfunctioning or impairment in a controllable device deactivating the controllable device and/or generate and display and/or send alert to the at least one caregiver.
[00188] In example 23, the subject matter of any one or more of examples 1 to 22 may include, wherein the controlling of operation of at least one of the one or more controllable devices is done automatically.
[00189] Example 24 is system for monitoring and attending to a subject located in a specific environment, the system comprising at least:
[00190] (i) one or more sensors, located in the specific environment, each sensor being configured to sense one or more characteristics of the subject and/or of the environment; and
[00191] (ii) a processing and control subsystem (PCS) configured at least to: [00192] receive sensor data from one or more sensors located in the environment, the one or more sensors being configured to sense one or more physical characteristics of the subject and/or of the environment;
[00193] process the received sensor signals to determine at least one updated condition of the subject being monitored and/or at least one updated condition of the environment, using one or more analysis algorithms;
[00194] control operation of one or more controllable devices, based on the determined at least one updated condition, wherein the one or more controllable devices are located in the environment;
[00195] accumulate sensor data and analyzing accumulated sensor data to determine personal behavior characteristics of the specific subject, based on behavior of the accumulated sensor data; and
[00196] adjust the one or more analysis algorithms, based on determined personal behavior characteristics of the specific subject.
[00197] In example 25 the subject matter of example 24 may include, wherein the PCS is further configured to predict personal subject’s behavioral characteristics and controlling at least one of the one or more controllable devices, based on predicted subject’s behavioral characteristics.
[00198] In example 26 the subject matter of any one or more of examples 24 to 25 may include, wherein the OCS is further configured to initiate a calibration process comprising:
[00199] operating at least one of the controllable devices configured for applying stimuli over the subject at different stimulations modes and intensities;
[00200] measuring subject’s responsivity to applied stimulations; [00201] calibrating and/or determining features of one or more operation programs for operating of the controllable devices responsively to the determined condition of the subject, based on measured subject’s stimulation responsivity.
[00202] In example 27 the subject matter of any one or more of examples 24 to 26 may include, wherein the controllable devices are part of the system and are configured for one or more of: stimulating the subject; treating the subject; displaying visual and/or auditory display of content to the subject; outputting and/or transmitting information to caregivers, the information being indicative of determined at least one updated condition.
[00203] In example 28 the subject matter of example 27 may include, wherein the one or more controllable devices comprise one or more of: at least one illumination device, at least one audio speaker, at least one crib vibrator, at least one air humidifier, at least one air conditioning device, at least one bottles warming device, at least one formula milk preparation machine, at least one medication delivery device, at least one food and/or drink preparation and/or delivery device, at least one bed heater, at least one bed motion generator, at least one air purifier, at least one communication device, at least one oxygen supply device, at least one inhalation device.
[00204] In example 29 the subject matter of any one or more of examples 24 to 28 may include, wherein the one or more sensors comprise one or more of: at least one microphone, at least one motion sensor; at least one pressure sensor; at least one thermometer; at least one humidity sensor; at least one air quality sensor; at least one camera, at least one optical sensor; at least one chemical sensor, at least one weight sensor, smoke detector.
[00205] In example 30 the subject matter of any one or more of examples 24 to 29 may include, wherein at least one of the one or more sensors is configured to detect one or more of: heartbeat, breathing, motion of the subject, voice, sound, secretions, temperature, air quality, smoke, subject’s presence, subject’s weight.
[00206] In example 31 the subject matter of example 30 may include, wherein at least one of the determinable conditions is further associated with an alarming state, and a set of alert commands, for operating or outputting of one or more alerts and/or transmitting alerts to one or more remote devices.
[00207] In example 32 the subject matter of any one or more of examples 24 to 31 may include, wherein the PCS is further configured to receive and process accumulated sensor data and inputted information, inputted by the one or more caregivers, and to generate one or more recommendations for the one or more caregivers.
[00208] In example 33 the subject matter of example 32 may include, wherein the system further comprises one or more output devices, display devices and/or communication means for outputting, displaying and/or transmitting the generated one or more recommendations to the one or more caregivers and/or other authorized users.
[00209] In example 34 the subject matter of any one or more of examples 24 to 33 may include, wherein the PCS is further configured to provide caregiver and/or other users with updated status notifications, the update status reports being indicative of updated determined subject and/or environment condition.
[00210] In example 35 the subject matter of any one or more of examples 24 to 34 may include, wherein the processing of the sensor data and the controlling of the one or more controllable devices is done via a local server and/or a remote server configured for data storage, communication, processing, display, output, devices control, and devices control. [00211] In example 36 the subject matter of any one or more of examples 24 to 35 may include, wherein the system further comprises at least one remote server operating a central processing module, configured for:
[00212] receiving and accumulating sensor data from multiple monitoring systems each monitoring system being configured to monitor a different subject and control controllable devices in different environments;
[00213] analyze the received and accumulated sensor data to determine one of more statistical characteristics of subjects and/or of environments;
[00214] adjusting analysis algorithms in the monitoring systems based on determined statistical characteristics.
[00215] In example 37 the subject matter of any one or more of examples 24 to 36 may include, wherein the one or more sensors are further configured to record and/or acquire in real time of parental heartbeat sounds; and the one or more controllable output devices are configured for playing the acquired or recorded parental heartbeat sounds to the subject, in real time or offline in respect to the time of recording or acquisition.
[00216] In example 38 the subject matter of example 37 may include, wherein the system is further configured for applying of tactile stimuli over the subject that is synchronized with rhythm of the played parental heartbeat.
[00217] In example 39, the subject matter of any one or more of examples 24 to 37 may include, wherein the controlling of operation of at least one of the one or more controllable devices is done automatically.
[00218] Example 40 is a smart mattress comprising: [00219] (a) a mattress element having a pocket therein forming an upper mattress layer and a lower mattress layer;
[00220] (b) a monitoring device located within the pocket, the monitoring device having one or more sensors being configured at least to sense one or more characteristics of a subject lying over the mattress,
[00221] wherein the mattress element further comprises a closing mechanism for enabling closing and opening an opening in the pocket for removal and insertion of the monitoring device out of and into the pocket of the mattress element.
[00222] In example 41 the subject matter of any one or more of examples 39, wherein the upper and lower mattress layers are made from a breathing mattress material and structure.
[00223] In example 42, the subject matter of example 41 may include, wherein the upper and lower layers of the mattress element are made of three-dimensional (3D) strings or coils polymer.
[00224] In example 43, the subject matter of example 42 may include, wherein the three- dimensional (3D) strings or coils polymer comprises a Polyethylene (PE) or Polyolefin (POE) polymer.
[00225] In example 44, the subject matter of any one or more of examples 40 to 43 may include, wherein the smart mattress further comprises a rigid frame surrounding a periphery of the mattress element.
[00226] In example 45, the subject matter of any one or more of examples 40 to 44 may include, wherein the monitoring device is configured in size, shape and dimensions to fit into the pocket of the mattress element. [00227] In example 46, the subject matter of any one or more of examples 40 to 45 may include, wherein the mattress element further comprises an inner lining coating the pocket.
[00228] In example 47, the subject matter of any one or more of examples 40 to 46 may include, wherein the mattress element has a coating layer over the upper mattress layer.
[00229] In example 48, the subject matter of any one or more of examples 40 to 47 may include, wherein the monitoring device comprises at least one of: one or more motion sensors; at least one weight sensor; at least one pressure sensor; at least one microphone; at least one humidity sensor; at least one secretions sensor; a processing unit; a power source; at least one stimulation device for applying one or more stimulations over the subject lying over the mattress.
[00230] In example 49, the subject matter of any one or more of examples 40 to 48 may include, wherein the monitoring device has a flat shape such that a surface thereof formed by a length and width thereof is larger than its height.
[00231] In example 50, the subject matter of any one or more of examples 40 to 49 may include, wherein the monitoring device is configured to communicate via wired and/or wireless connection with a processing and control unit (PCU), the PCU being configured to receive data from the monitoring device and perform one or more of: process the data to identify alarming states, initiate alarms; transmit information indicative of the received and/or processed data to one or more remote devices of one or more users.
[00232] In example 51, the subject matter of any one or more of examples 40 to 50 may include, wherein the PCU is comprises one or more of:
[00233] a processor for processing received sensor data and determining subject’s condition;
[00234] one or more alert devices; [00235] a communication unit for transmitting alerts and/or information indicative of the subject’s condition to one or more remote devices;
[00236] display means, for displaying information indicative of the subject’s condition;
[00237] alert output means such as one or more speakers;
[00238] control and input means;
[00239] one or more detectors configure and positioned to sense subject and/or environmental characteristics.
[00240] It is to be understood that the scope of the present invention includes variations and modifications thereof which would occur to subjects skilled in the art upon reading the foregoing description and which are not disclosed in the prior art.
[00241] The method and/or processes described herein may be implemented by any one or more software, and/or hardware, element apparatus, device, mechanism, electronic and/or digital computerized system, unit, processing module, device, machine, engine, etc.
[00242] The system, module, unit, device etc. or parts thereof, may be programmed to perform particular functions pursuant to computer readable and executable instructions, rules, conditions etc. from programmable hardware and/or software based execution modules that may implement one or more methods or processes disclosed herein, and therefore can, in effect, be considered as disclosing a “special purpose computer” particular to embodiments of each disclosed method/process.
[00243] Additionally or alternatively, the methods and/or processes disclosed herein may be implemented as a computer program that may be tangibly or intangibly embodied by a special purpose computer readable signal medium. A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a non-transitory computer or machine-readable storage device and that can communicate, propagate, or transport a program for use by or in connection with apparatuses, systems, platforms, methods, operations and/or processes discussed herein.
[00244] The terms “non-transitory computer-readable storage device” and “non- transitory machine-readable storage device” may also include distribution media, intermediate storage media, execution memory of a computer, and any other medium or device capable of storing for later reading by a computer program implementing embodiments of a method disclosed herein. A computer program product can be deployed to be executed on one computer or on multiple computers at one site or distributed across multiple sites and interconnected by one or more communication networks.
[00245] The computer readable and executable instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
[00246] A module, a device, a mechanism, a unit and or a subsystem may each comprise a machine or machines executable instructions (e.g. commands). A module may be embodied by a circuit or a controller programmed to cause the system to implement the method, process and/or operation as disclosed herein. For example, a module may be implemented as a hardware circuit comprising, e.g., custom very large-scale integration (VLSI) circuits or gate arrays, an Application- specific integrated circuit (ASIC), off-the- shelf semiconductors such as logic chips, transistors, and/or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices and/or the like.
[00247] In the above disclosure, unless otherwise stated, terms such as “substantially”, “about”, approximately, etc., that specify a condition or relationship characterizing a feature or features of an embodiment of the invention, are to be understood to mean that the condition or characteristic is defined to within tolerances that are acceptable for operation of the embodiment for an application for which it is intended.
[00248] It is important to note that the methods/processes and/or systems/devices/subsystems/apparatuses etc., disclosed in the above Specification, are not to be limited strictly to flowcharts and/or diagrams provided in the Drawings. For example, a method may include additional or fewer processes or steps in comparison to what is described in the figures. In addition, embodiments of the method are not necessarily limited to the chronological order as illustrated and described herein.
[00249] It is noted that terms such as "processing", "computing", "calculating", "determining", "establishing", "analyzing", "checking", “estimating”, “deriving”, “selecting”, “inferring”, identifying”, “detecting” and/or the like, may refer to operation(s) and/or process(es) of a computer, a computing platform, a computing system, or other electronic computing device(s), that manipulate and/or transform data represented as physical (e.g., electronic or optical signal) quantities within the computer's registers and/or memories into other data similarly represented as physical quantities within the computer's registers and/or memories or other information storage medium that may store instructions to perform operations and/or processes.
[00250] Terms used in the singular shall also include a plural scope, except where expressly otherwise stated or where the context otherwise requires.
[00251] In the description and claims of the present application, each of the verbs, "comprise" "include" and "have", and conjugates thereof, are used to indicate that the object or objects of the verb are not necessarily a complete listing of components, elements or parts of the subject or subjects of the verb.
[00252] Unless otherwise stated, the use of the expression “and/or” between the last two members of a list of options for selection indicates that a selection of one or more of the listed options is appropriate and may be made i.e. enabling all possible combinations of one or more of the specified options. Further, the use of the expression “and/or” may be used interchangeably with the expressions “at least one of the following”, “any one of the following” or “one or more of the following”, followed by a listing of the various options. [00253] It is appreciated that certain features of the invention, which are, for clarity, described in the context of separate embodiments or example, may also be provided in combination in a single embodiment. Conversely, various features of the invention, which are, for brevity, described in the context of a single embodiment, example and/or option, may also be provided separately or in any suitable sub -combination or as suitable in any other described embodiment, example or option of the invention. Certain features described in the context of various embodiments, examples and/or optional implementation are not to be considered essential features of those embodiments, unless the embodiment, example and/or optional implementation is inoperative without those elements.
[00254] The number of elements shown in the Figures should by no means be construed as limiting and is for illustrative purposes only.

Claims

1. A method for monitoring and attending to a subject in a specific environment, the method comprising at least: receiving sensor data from one or more sensors located in the environment, the one or more sensors being configured to sense one or more physical characteristics of the subject and/or of the environment; processing the received sensor signals to determine at least one updated condition of the subject being monitored and/or at least one updated condition of the environment, using one or more analysis algorithms; controlling operation of one or more controllable devices, based on the determined at least one updated condition, wherein the one or more controllable devices are located in the environment; accumulating sensor data and analyzing accumulated sensor data to determine personal behavior characteristics of the specific subject, based on behavior of the accumulated sensor data; and adjusting the one or more analysis algorithms, based on determined personal behavior characteristics of the specific subject.
2. The method of claim 1 further comprising predicting personal subject’s behavioral characteristics and controlling at least one of the one or more controllable devices, based on predicted subject’s behavioral characteristics, the behavioral characteristics comprising at least: physical behavioral characteristics.
45
3. The method of claim 2, wherein the predicting of personal subject’s behavioral characteristics comprises predicting one or more of: falling asleep, sleep and awakening schedules, feeding schedules, secretion schedules, changing of a sleep stage schedules.
4. The method of any one or more of claim 1 to 3 further comprising initiating a calibration process comprising: operating at least one of the controllable devices configured for applying stimuli over the subject at different stimulations modes and intensities; measuring subject’s responsivity to applied stimulations; calibrating and/or determining features of one or more operation programs for operating of the controllable devices responsively to the determined condition of the subject, based on measured subject’s stimulation responsivity.
5. The method of any one or more of claims 1 to 4, wherein the controllable devices are configured for one or more of:
- stimulating the subject;
- treating the subject;
- displaying visual and/or auditory display of content to the subject;
- outputting and/or transmitting information to caregivers, the information being indicative of determined at least one updated condition.
6. The method of any one or more of claims 1 to 5, wherein the one or more controllable devices comprise one or more of: at least one illumination device, at least one audio speaker, at least one crib vibrator, at least one air humidifier, at least one air conditioning device, at least one bottles warming device, at least one formula milk preparation machine, at least one
46 medication delivery device, at least one food and/or drink preparation and/or delivery device, at least one bed heater, at least one motion generator, at least one air purifier, at least one communication device, at least one oxygen supply device, at least one inhalation device.
7. The method of any one or more of claims 1 to 6, wherein the one or more sensors comprise one or more of: at least one microphone, at least one motion sensor; at least one pressure sensor; at least one thermometer; at least one humidity sensor; at least one air quality sensor; at least one camera, at least one optical sensor; at least one chemical sensor, at least one weight sensor, smoke detector.
8. The method of any one or more of claims 1 to 7, wherein at least one of the one or more sensors is configured to detect one or more of: heartbeat, breathing, motion of the subject, voice, sound, secretions, temperature, air quality, smoke, subject’s presence, subject’s weight.
9. The method of any one or more of claims 1 to 8, wherein the determinable conditions of the subject comprise at least one of: sleep, awake, in bed, out of bed, distressed, crying, agitated, in convulsions, having fever, hypothermia, hungry, in pain, thirsty, calm, calling a caregiver, shivering, in seizures, screaming, awakening, falling asleep, in spasms, apnea, sudden infant death syndrome (SIDS), wherein the determinable conditions of the environment comprise at least one of: too cold or hot, too humid or dry, fire/smoke, endangering pollution, over or under illuminated, noisy, sensory agitating, wherein each determinable condition is associated with one or more detectable characteristics and/or behavior over a period of time of the one or more detectable characteristics, and
47 wherein each determinable condition is associated with one or more control commands for controlling one or more of the controllable devices, based on the determined condition.
10. The method of claim 9, wherein at least one of the determinable conditions is further associated with an alarming state, and a set of alert commands, for operating or outputting of one or more alerts and/or transmitting alerts to one or more remote devices.
11. The method of any one or more of claims 1 to 10 further comprising: receiving and processing accumulated sensor data and inputted information, inputted by the one or more caregivers; receiving information indicative of various responses of multiple subjects of the same subject type, to various actions related to various modes of operation of various controllable devices, the actions taken in response to identified behavioral patterns of the subjects generating accumulated responses data for the respective subject group type; processing the accumulated sensor data and responses data, by using one or more algorithms (e.g., based on statistical calculations/models); and adjusting the analysis algorithms used by each monitoring system based on accumulated sensor data; and/or adjusting operation programs for operating one or more of the controllable devices based on accumulated Reponses data; and generating one or more recommendations for the one or more caregivers.
12. The method of claim 11 further comprising outputting, displaying and/or transmitting the generated one or more recommendations to the one or more caregivers and/or other authorized users.
13. The method of any one or more of claims 1 to 12, wherein the conditions of the environment comprise at least one of: too dry, too humid, hot, cold, over polluted, noisy, over/under illuminated, number or people in the environment.
14. The method of any one or more of claims 1 to 13, wherein the at-risk condition is an indication of an acute safety hazard including at least one of: sudden infant death syndrome (SIDS), apnea, fall, severely high fever, sever hypothermia, panic, seizure, convulsions, wherein upon identification of an at-risk condition, one or more automatic emergency operations are executed including at least one of: operating an auditory and/or visual alarm, sending of alert messages to caregivers mobile devices, alerting one or more emergency authorities, operating one or more controlled devices used also for assisting in treating the subject in emergency situations.
15. The method of any one or more of claims 1 to 14, further comprising providing updated status notifications to at least one caregiver indicative of the determined subject and/or environment condition.
16. The method of claim 15, wherein the status notifications are provided at regular time intervals.
17. The method of claim 17, wherein the status notifications are transmitted to mobile device of each caregiver.
18. The method of any one or more of claims 1 to 17, wherein the processing of the sensor data and the controlling of the one or more controllable devices is done via a local server and/or a remote server configured for data storage, communication, processing, display, output, devices control, and devices control.
19. the method of any one or more of claims 1 to 18 further comprising: receiving and accumulating sensor data from multiple monitoring systems each monitoring system being configured to monitor a different subject and control controllable devices in different environments; analyze the received and accumulated sensor data to determine one of more statistical characteristics of subjects and/or of environments; adjusting one or more analysis algorithms and/or control programs in the monitoring systems based on determined statistical characteristics.
20. The method of any one or more of claims 1 to 19 further comprising: recording and/or real time acquiring of parental heartbeat sound; and playing the acquired or recorded parental heartbeat sounds to the subject, in real time or offline in respect to the time of recording or acquisition.
21. The method of claim 20 further comprising applying tactile stimuli over the subject that is synchronized with rhythm of the played parental heartbeat.
22. The method of any one of more of claims 1 to 21 further comprising detecting functionality characteristics of the one or more controllable devices and, upon identification of a malfunctioning or impairment in a controllable device deactivating the controllable device and/or generate and display and/or send alert to the at least one caregiver.
23. The method of any one or more of claims 1 to 22, wherein the controlling of operation of at least one of the one or more controllable devices is done automatically.
24. A system for monitoring and attending to a subject located in a specific environment, the system comprising at least:
(i) one or more sensors, located in the specific environment, each sensor being configured to sense one or more characteristics of the subject and/or of the environment; and
(ii) a processing and control subsystem (PCS) configured at least to: receive sensor data from one or more sensors located in the environment, the one or more sensors being configured to sense one or more physical characteristics of the subject and/or of the environment; process the received sensor signals to determine at least one updated condition of the subject being monitored and/or at least one updated condition of the environment, using one or more analysis algorithms; control operation of one or more controllable devices, based on the determined at least one updated condition, wherein the one or more controllable devices are located in the environment;
51 accumulate sensor data and analyzing accumulated sensor data to determine personal behavior characteristics of the specific subject, based on behavior of the accumulated sensor data; and adjust the one or more analysis algorithms, based on determined personal behavior characteristics of the specific subject.
25. The system of claim 24, wherein the PCS is further configured to predict personal subject’s behavioral characteristics and controlling at least one of the one or more controllable devices, based on predicted subject’s behavioral characteristics.
26. The system of any one or more of claim 24 to 25, wherein the OCS is further configured to initiate a calibration process comprising: operating at least one of the controllable devices configured for applying stimuli over the subject at different stimulations modes and intensities; measuring subject’s responsivity to applied stimulations; calibrating and/or determining features of one or more operation programs for operating of the controllable devices responsively to the determined condition of the subject, based on measured subject’s stimulation responsivity.
27. The system of any one or more of claims 24 to 26, wherein the controllable devices are part of the system and are configured for one or more of:
- stimulating the subject;
- treating the subject;
- displaying visual and/or auditory display of content to the subject;
52 - outputting and/or transmitting information to caregivers, the information being indicative of determined at least one updated condition.
28. The system of claim 27, wherein the one or more controllable devices comprise one or more of: at least one illumination device, at least one audio speaker, at least one crib vibrator, at least one air humidifier, at least one air conditioning device, at least one bottles warming device, at least one formula milk preparation machine, at least one medication delivery device, at least one food and/or drink preparation and/or delivery device, at least one bed heater, at least one bed motion generator, at least one air purifier, at least one communication device, at least one oxygen supply device, at least one inhalation device.
29. The system of any one or more of claims 24 to 28, wherein the one or more sensors comprise one or more of: at least one microphone, at least one motion sensor; at least one pressure sensor; at least one thermometer; at least one humidity sensor; at least one air quality sensor; at least one camera, at least one optical sensor; at least one chemical sensor, at least one weight sensor, smoke detector.
30. The system of any one or more of claims 24 to 29, wherein at least one of the one or more sensors is configured to detect one or more of: heartbeat, breathing, motion of the subject, voice, sound, secretions, temperature, air quality, smoke, subject’s presence, subject’s weight.
31. The system of claim 30, wherein at least one of the determinable conditions is further associated with an alarming state, and a set of alert commands, for operating or outputting of one or more alerts and/or transmitting alerts to one or more remote devices.
53
32. The system of any one or more of claims 24 to 31, wherein the PCS is further configured to receive and process accumulated sensor data and inputted information, inputted by the one or more caregivers, and to generate one or more recommendations for the one or more caregivers.
33. The system of claim 32 further comprising one or more output devices, display devices and/or communication means for outputting, displaying and/or transmitting the generated one or more recommendations to the one or more caregivers and/or other authorized users.
34. The system of any one or more of claims 24 to 33, wherein the PCS is further configured to provide caregiver and/or other users with updated status notifications, the update status reports being indicative of updated determined subject and/or environment condition.
35. The system of any one or more of claims 24 to 34, wherein the processing of the sensor data and the controlling of the one or more controllable devices is done via a local server and/or a remote server configured for data storage, communication, processing, display, output, devices control, and devices control.
36. The system of any one or more of claims 24 to 35 further comprising at least one remote server operating a central processing module, configured for:
54 receiving and accumulating sensor data from multiple monitoring systems each monitoring system being configured to monitor a different subject and control controllable devices in different environments; analyze the received and accumulated sensor data to determine one of more statistical characteristics of subjects and/or of environments; adjusting analysis algorithms in the monitoring systems based on determined statistical characteristics.
37. The system of any one or more of claims 24 to 36, wherein the one or more sensors are further configured to record and/or acquire in real time of parental heartbeat sounds; and the one or more controllable output devices are configured for playing the acquired or recorded parental heartbeat sounds to the subject, in real time or offline in respect to the time of recording or acquisition.
38. The system of claim 37 is further configured for applying of tactile stimuli over the subject that is synchronized with rhythm of the played parental heartbeat.
39. The system of any one or more of claims 24 to 37, wherein the controlling of operation of at least one of the one or more controllable devices is done automatically.
55
40. A smart mattress comprising:
(a) a mattress element having a pocket therein forming an upper mattress layer and a lower mattress layer;
(b) a monitoring device located within the pocket, the monitoring device having one or more sensors being configured at least to sense one or more characteristics of a subject lying over the mattress, wherein the mattress element further comprises a closing mechanism for enabling closing and opening an opening in the pocket for removal and insertion of the monitoring device out of and into the pocket of the mattress element.
41. The smart mattress of claim 40, wherein the upper and lower mattress layers are made from a breathing mattress material and structure.
42. The smart mattress of claim 41, wherein the upper and lower layers of the mattress element are made of three-dimensional (3D) strings or coils polymer.
43. The smart mattress of claim 42, wherein the three-dimensional (3D) strings or coils polymer comprises a Polyethylene (PE) or Polyolefin (POE) polymer.
44. The smart mattress of any one or more of claims 40 to 43 further comprising a rigid frame surrounding a periphery of the mattress element.
56
45. The smart mattress of any one or more of claims 40 to 44, wherein the monitoring device is configured in size, shape and dimensions to fit into the pocket of the mattress element.
46. The smart mattress of any one or more of claims 40 to 45, wherein the mattress element further comprises an inner lining coating the pocket.
47. The smart mattress of any one or more of claims 40 to 46, wherein the mattress element has a coating layer over the upper mattress layer.
48. The smart mattress of any one or more of claims 40 to 47, wherein the monitoring device comprises at least one of: one or more motion sensors; at least one weight sensor; at least one pressure sensor; at least one microphone; at least one humidity sensor; at least one secretions sensor; a processing unit; a power source; at least one stimulation device for applying one or more stimulations over the subject lying over the mattress.
49. The smart mattress of any one or more of claims 40 to 48, wherein the monitoring device has a flat shape such that a surface thereof formed by a length and width thereof is larger than its height.
50. The smart mattress of any one or more of claims 40 to 49, wherein the monitoring device is configured to communicate via wired and/or wireless connection with a processing and control unit (PCU), the PCU being configured to receive data from the monitoring device and
57 perform one or more of: process the data to identify alarming states, initiate alarms; transmit information indicative of the received and/or processed data to one or more remote devices of one or more users.
51. The smart mattress of any one or more of claims 40 to 50, wherein the PCU is comprises one or more of: a processor for processing received sensor data and determining subject’s condition; one or more alert devices; a communication unit for transmitting alerts and/or information indicative of the subject’s condition to one or more remote devices; display means, for displaying information indicative of the subject’s condition; alert output means such as one or more speakers; control and input means; one or more detectors configure and positioned to sense subject and/or environmental characteristics.
58
PCT/IL2022/050787 2021-08-02 2022-07-21 Systems, methods and smart mattresses for monitoring a subject in a specific environment WO2023012780A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202163203842P 2021-08-02 2021-08-02
US63/203,842 2021-08-02

Publications (1)

Publication Number Publication Date
WO2023012780A1 true WO2023012780A1 (en) 2023-02-09

Family

ID=85155345

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2022/050787 WO2023012780A1 (en) 2021-08-02 2022-07-21 Systems, methods and smart mattresses for monitoring a subject in a specific environment

Country Status (1)

Country Link
WO (1) WO2023012780A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110001622A1 (en) * 2004-02-18 2011-01-06 Hoana Medical, Inc. Method and system for integrating a passive sensor array with a mattress for patient monitoring
EP3320809A1 (en) * 2016-11-14 2018-05-16 Plasti Temple Sleep device and sleep installation comprising such a sleep device
US20190008283A1 (en) * 2015-12-30 2019-01-10 Dewertokin Gmbh Mattress and piece of sleeping or reclining furniture having a mattress
US20190306465A1 (en) * 2014-04-08 2019-10-03 Udisense Inc. Systems and methods for configuring baby monitor cameras to provide uniform data sets for analysis and to provide an advantageous view point of babies
US20190340515A1 (en) * 2018-05-04 2019-11-07 Verily Life Sciences Llc Sensing and activity classification for infants
US20200315368A1 (en) * 2016-07-29 2020-10-08 Bryte, Inc. Adaptive sleep system using data analytics and learning techniques to improve individual sleep conditions
US20200397349A1 (en) * 2019-06-20 2020-12-24 Hb Innovations, Inc. System and method for monitoring/detecting and responding to infant breathing
WO2021041747A1 (en) * 2019-08-29 2021-03-04 The Brigham And Women's Hospital, Inc. Smart mattress system and methods for patient monitoring and repositioning

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110001622A1 (en) * 2004-02-18 2011-01-06 Hoana Medical, Inc. Method and system for integrating a passive sensor array with a mattress for patient monitoring
US20190306465A1 (en) * 2014-04-08 2019-10-03 Udisense Inc. Systems and methods for configuring baby monitor cameras to provide uniform data sets for analysis and to provide an advantageous view point of babies
US20190008283A1 (en) * 2015-12-30 2019-01-10 Dewertokin Gmbh Mattress and piece of sleeping or reclining furniture having a mattress
US20200315368A1 (en) * 2016-07-29 2020-10-08 Bryte, Inc. Adaptive sleep system using data analytics and learning techniques to improve individual sleep conditions
EP3320809A1 (en) * 2016-11-14 2018-05-16 Plasti Temple Sleep device and sleep installation comprising such a sleep device
US20190340515A1 (en) * 2018-05-04 2019-11-07 Verily Life Sciences Llc Sensing and activity classification for infants
US20200397349A1 (en) * 2019-06-20 2020-12-24 Hb Innovations, Inc. System and method for monitoring/detecting and responding to infant breathing
WO2021041747A1 (en) * 2019-08-29 2021-03-04 The Brigham And Women's Hospital, Inc. Smart mattress system and methods for patient monitoring and repositioning

Similar Documents

Publication Publication Date Title
US11491300B2 (en) Robot-connected IoT-based sleep-caring system
US20170258398A1 (en) Child monitoring system
US8502679B2 (en) Noninvasive motion and respiration monitoring system
US10912492B2 (en) Method and device for sleep posture correction
US20150105608A1 (en) Infant Sleeping Aid and Infant-Bed Accessory
US20200334967A1 (en) Monitor and System for Monitoring
CN107949312A (en) Infant's nursing system, infant's data gathering system, aggregation the observation result related with infant's data and the aggregation inference related with infant's data
US20200281521A1 (en) Apparatus, system, and method for monitoring sleep patterns
KR20030001504A (en) Automatic system for monitoring person requiring care and his/her caretaker
US20210146091A1 (en) Devices And Systems For Promoting Continuous Sleep Of A Subject And Methods Of Using Same
GB2549099A (en) Monitor and system for monitoring
CN108024712A (en) Prediction infant sleeping sleep mode simultaneously derives infant's model based on the observation result associated with infant
CN108012560A (en) Intelligent infant monitors system and infant monitoring center and infant learns acceptance detecting system
KR20060059248A (en) Multipurpose intelligent mat system for infant and special use
WO2019207570A1 (en) An autonomous intelligent mattress for an infant
CN114828737A (en) System and method for alerting a caregiver based on the status of a person in need thereof
CN107924643A (en) Remotely assemble and analyze the measurement data that system is monitored from multiple infants
WO2023012780A1 (en) Systems, methods and smart mattresses for monitoring a subject in a specific environment
US20220296127A1 (en) Smart infant monitoring system and method
US11730916B1 (en) Device and system for hands free monitoring and comforting
JP2018051188A (en) Activity state management device
WO2020157755A1 (en) Smart interactive sleep monitor
US20220071558A1 (en) System, device, and method for wireless health monitoring
KR102267786B1 (en) Smart infant monitoring system, server and method
KR102039366B1 (en) Apparatus of outputting sound for giving comfort to newborn

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22852481

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE