EP4123613B1 - Telemedizinisches gesundheitssystem - Google Patents

Telemedizinisches gesundheitssystem Download PDF

Info

Publication number
EP4123613B1
EP4123613B1 EP21187266.8A EP21187266A EP4123613B1 EP 4123613 B1 EP4123613 B1 EP 4123613B1 EP 21187266 A EP21187266 A EP 21187266A EP 4123613 B1 EP4123613 B1 EP 4123613B1
Authority
EP
European Patent Office
Prior art keywords
client
pattern
sound waves
ultrasonic sound
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP21187266.8A
Other languages
English (en)
French (fr)
Other versions
EP4123613C0 (de
EP4123613A1 (de
Inventor
Terry PARKERPAYNE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tunstall Integrated Health and Care Ltd
Original Assignee
Tunstall Integrated Health and Care Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tunstall Integrated Health and Care Ltd filed Critical Tunstall Integrated Health and Care Ltd
Priority to EP21187266.8A priority Critical patent/EP4123613B1/de
Priority to ES21187266T priority patent/ES2967807T3/es
Priority to PCT/GB2022/051866 priority patent/WO2023002174A1/en
Publication of EP4123613A1 publication Critical patent/EP4123613A1/de
Application granted granted Critical
Publication of EP4123613B1 publication Critical patent/EP4123613B1/de
Publication of EP4123613C0 publication Critical patent/EP4123613C0/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0407—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
    • G08B21/0423—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis detecting deviation from an expected pattern of behaviour or schedule
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0407—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
    • G08B21/0415—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis detecting absence of activity per se
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/02—Alarms for ensuring the safety of persons
    • G08B21/04—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons
    • G08B21/0407—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis
    • G08B21/043—Alarms for ensuring the safety of persons responsive to non-activity, e.g. of elderly persons based on behaviour analysis detecting an emergency event, e.g. a fall

Definitions

  • the present disclosure relates to a telehealth care system and a method of operation thereof.
  • the present disclosure relates to a telecare system which provides predictive care for a client via contactless sensing of the client's current condition.
  • Telehealth care systems used in social care environments to socially monitor a client are well known.
  • Typical systems include a range of wearable sensors - i.e. contact sensors - which collect data on the client and relay that data to a remote monitoring site, such as a call centre, via a hub unit installed in the client's dwelling.
  • a remote monitoring site such as a call centre
  • one sensor might monitor a breathing rate of the client, while another sensor monitors hearth rate.
  • an alarm is raised with the call centre which dispatches aid to the client accordingly.
  • a phone call is established between the call centre and the client's hub unit (which has suitable audio inputs/outputs) so that the client and call centre operator may converse; e.g. so that the operator may provide status updates and reassurance to the client.
  • the alarm is raised to the call centre upon the sensor detecting a signal which passes a certain predefined threshold that signifies that a sufficiently bad event has happened / is happening to the client.
  • a certain predefined threshold that signifies that a sufficiently bad event has happened / is happening to the client.
  • One limitation of these systems is that events that do not cause a sensor signal above the threshold are not reported, even if it is an event which may be causing the client discomfort and distress, requiring the client to manually request aid (typically the wearable device includes a manually operated alarm button).
  • sensors are only operable if the client chooses to wear them, which may not always be the case, and the client may even unintentionally forget to wear the sensor. It will be appreciated that an emergency situation is not detectable in such scenarios.
  • Some systems monitor that the sensors are being worn, and notify the client if they are not, but there is still a period of inoperability in the intervening time.
  • US 2021/0169375 discusses a lung function analysis system including motion sensing devices.
  • the example embodiments utilise a contactless sensing technique.
  • the client may be monitored in a contactless, non-invasive, fashion, and may even be directly informed of a possible emergency via a suitable audible alert signal issued to them by e.g. speakers within the dwelling.
  • a suitable audible alert signal issued to them by e.g. speakers within the dwelling.
  • the client may conduct themselves within their dwelling without worrying about whether they are wearing a suitable sensor or whether the sensor may have sufficient battery power.
  • an alert signal issued to a remote alarm centre may include data relating to the alert event (e.g. pattern data, prediction data) so that an operator may make an informed decision on escalating the alert to e.g. dispatch aid (i.e. allowing the operator to make an informed, human, opinion on the automatic prediction).
  • data relating to the alert event e.g. pattern data, prediction data
  • dispatch aid i.e. allowing the operator to make an informed, human, opinion on the automatic prediction.
  • the alert event may be any suitable event that may desirable for an operator of the telehealth care system - typically located at a remote monitoring centre - to know about.
  • the predicted alert event may be one of difficulty breathing, heart attack, arrythmia, and infection.
  • the pattern(s) which are identified (and accordingly the expected pattern(s) they are compared to) may correspond to one or both of a breathing rate of the client and heart rate of the client.
  • the pattern may be a waveform which is determined by measuring received reflected ultrasonic sound waves at a suitable sampling frequency.
  • the sampling frequency may be at least 100 Hz to measure breathing rate and at least 480 Hz to measure heart rate.
  • the waveform may be suitably analysed using digital processing to extract the waveform from background noise using real-time recorded ambient noise from a plurality of audio input devices.
  • a computer program comprising instructions which, when executed by a computer, cause the computer to carry out at least some of the method as substantially described above.
  • a telehealth care system arranged to implement the above techniques.
  • Such a system comprises a communication module, one or more audio outputs and inputs, and a computing unit.
  • the communication module is arranged to communicate with a remote alarm centre.
  • the audio outputs are arranged to output ultrasonic sound waves, and the audio inputs are arranged to receive the ultrasonic sound waves which are reflected from a client.
  • the computing unit is arranged to, in real-time, identify a pattern in the reflected ultrasonic sound waves corresponding to chest movements of the client and, in response to determining that the real-time identified pattern deviates from an expected pattern, predict an alert event based on the deviation.
  • the computing unit then may then control either an audio output (including the possibility of multiple audio outputs), or the communication module, or indeed both an audio output and communication module, to issue an alert signal.
  • each of the elements may be part of separate devices, or any logical combination thereof.
  • the audio inputs and outputs are configured as one type of device, while the communication module and computing unit are arranged together in a single device.
  • the computing unit is provided as part of a server, and therefore may not even be housed within the client's dwelling.
  • One solution to the problem of clients not wearing a monitor assigned to them, or overcoming issues with clients not wearing or configuring the devices in a manner suitable for proper monitoring, is to move to a contactless system of client monitoring. Moreover, it is desirable that such a contactless system be operable with as little input or configuration from a client as possible.
  • a monitoring e.g. sensor
  • the approach to contactless monitoring taken in the present disclosure is to use sound waves (more specifically ultrasonic waves) to measure, in real time, movements in a client's chest to determine at least one of a breathing rate and heart rate of the client.
  • sound waves more specifically ultrasonic waves
  • Breathing rate and heart rate provide a useful indication of a current status of a client because changes in breathing and/or heart rate may be correlated with a number of different situations for which the client may require aid. For example: low breathing rate may correspond to difficulty breathing, and so to gasping motions; shallow breathing may correspond to an imminent heart attack; erratic heart rate may correspond to arrythmia and also indicate heart trouble; increased heart rate and pulse (particularly while the client is stationary) may indicate that the client has an infection or a potentially more serious condition; and of course it is extremely useful to know whether a client's breathing or heart rate has stopped entirely.
  • Figure 1 shows the general principle of using sound waves to measure the position of an object.
  • sound waves 10 are emitted (at a predetermined frequency) from an emitter 12 and reflected from an object 14.
  • the object 14 When used in a telehealth care system, the object 14 would be the client in their dwelling, and more than one emitter and receiver may be provided.
  • the reflected waves 16 are captured by a receiver 18 (usually embodied in the same device as the emitter 12 for simplicity, as shown) and a time of flight from emission of the emitted waves 10 and receipt of the reflected waves 16 may be used to determine a distance to the object 14.
  • Figure 2 demonstrates measuring chest motions of a client 1 (in a social care environment) based on measuring reflected sound waves; i.e. measuring displacement of the chest.
  • Figure 2A shows the position of the client's chest 2 after inhaling.
  • Figure 2B shows the position of the client's chest 2 after exhaling. Measuring the client's chest position as it transitions between the inhale and exhale positions yields a pattern from which the client's breathing rate may be determined (i.e. based on time between inhaling and exhaling). More specifically, the breathing rate may be measured as a function of time to look for changes in the breathing rate.
  • the fluctuation in position of the chest 2 - i.e. the rise and fall of the chest - can be measured provided it is sampled at a sufficient frequency; this is because the chest motion of a client is an inherently continuous motion however analysing the reflected sound waves must be done in a discrete fashion.
  • the Nyquist-Shannon theorem establishes that in order to accurately resolve a periodic signal it must be sampled at twice the highest frequency component of the waveform of the signal in question.
  • Human resting breathing rates are typically in the range of 12-25 breaths per minute 'bpm', with breathing rates under duress not typically exceeding around 50 bpm.
  • the Nyquist rate for sampling normal breathing is therefore around 50 Hertz 'Hz', and during duress around 100 Hz. Therefore, by sampling the sound waves reflected from the client's chest at a frequency of at least 100 Hz, a pattern corresponding to the breathing rate of the client may be established. It will however be appreciated that such sampling rates are minimums which correspond to idealised, repetitive, stable patterns.
  • a client's breathing rate may not however be nicely repetitive and stable, and may fluctuate considerably, particularly when in distress, and so in general the higher the sampling rate the better.
  • the sound waves should have wavelengths of the same order (or shorter) than the rise and fall.
  • chest movements due to breathing are between 5 and 15 centimetres 'cm'.
  • those with lung conditions, or generally lower lung capacity will have shallower breaths and correspondingly shorter chest movements; possibly in the range of around 1 to 2 centimetres.
  • the sound waves should preferably have a frequency of at least 7 kHz (corresponding to chest movements of 5 cm), and further preferably of at least 17 kHz to 34 kHz (corresponding to chest movements of 1 to 2 cm).
  • ultrasonic frequencies above 20 kHz
  • monitoring should be conducted at 22 kHz or above.
  • ultrasonic frequencies are far in excess of the Nyquist rates for sampling breathing motion, and also allow for chest motions as small as 1.5 cm (22 kHz) to be measured.
  • ultrasonic frequencies may be achieved using common audio technology such as paper cone/magnet loudspeakers, which also allows such speakers to be used for normal audible frequency output.
  • measuring the chest motion of the client 1 may yield information on the client's heart rate; again, provided that it is suitably sampled and resolved. That is, deflections in the client's chest position due their heartbeat will yield a pattern which may be analysed to determine the client's heart rate.
  • Human heart rates typically range from 40 to 150 beats per minute 'bpm' in adults and around 150 to 240 bpm in infants.
  • the Nyquist rate for sampling an adult heart rate is therefore around 300 Hz, and for infants up to around 480 Hz.
  • the typical range of chest motion arising due to heartbeat is between 4 millimetres 'mm' and 12 mm.
  • the corresponding sound frequency range to resolve such motion is 28.5 kHz to 86 kHz. That is, using sound waves of at least 86 kHz should be able to resolve chest motions due to heartbeats of as small as 4 mm. Frequencies above 28.5 kHz are already well above audible frequencies and so suitable for use in a client dwelling.
  • monitoring a client using ultrasonic sound waves allows for both breathing rate and heart rate to be measuring simultaneously.
  • such monitoring should be conducted using sound waves of at least 28.5 kHz, and further preferably of substantially at least 86 kHz.
  • Frequencies closer to the lower end of the range may advantageously be achievable using common audio equipment which may also output audible frequency sound - e.g. paper cone/magnet loudspeakers.
  • Frequencies at the upper end of the range i.e. around 86 kHz
  • Figure 3 is an idealised illustrative example of a pattern that might arise from suitably sampling a client's chest motion using ultrasonic waves. More specifically, Figure 3 illustrates a waveform 20 that might be expected to arise from plotting the position (x) of the client's chest as a function of time t based on measurements of the time of flight of ultrasonic waves. It will be appreciated that an offset of the waveform on the x axis (i.e. distance from 0) may be used to approximate a general position of the client 1 from the emitter/receiver 12/18. It will also be appreciated that other methods of analysing patterns in the reflected wave measurements may also be employed without visualising and analysing them specifically as a waveform.
  • the waveform 20 is a superposition of a first waveform 22 corresponding to the breathing motion of the chest and a second waveform 24 corresponding to the heartbeat motion.
  • details relating to the constituent first & second waveforms 22 & 24 may be extracted, and the breathing rates and heart rates determined accordingly.
  • the peak to peak separation corresponds to one full exhale followed by one full inhale.
  • the second waveform 24 corresponds to the smaller sinewave following the larger one in waveform 20
  • the peak to peak separation corresponds to the time between heartbeats.
  • the superimposed waveform 20, corresponding to the chest deflections measured from the reflected ultrasonic waves 16, will be mixed in with ambient noise from the environment; for example, noise from a television, mobile phone, and/or cooker, to name but a few possible sources.
  • the waveform 20 corresponding to the chest motion will typically need to be extracted from this background noise (at least in all but the quietest environments).
  • This is achieved by recording ambient noise using multiple audio inputs (e.g. an array of microphones) and digitally processing it to remove the unwanted noise or otherwise extract the first and second waveforms 22, 24.
  • the array of audio inputs could be the same as, or separate to, the audio inputs used to receive the reflected ultrasonic waves 16.
  • the array of audio inputs may be formed as part of a single device unit (provided there was some spatial separation of the audio inputs within the device), or could be positioned throughout the dwelling as part of separate devices in communication with each other.
  • FIG. 4 shows an example of digital processing for noise cancellation.
  • a first signal 26 is a signal received by an audio input acting as a receiver 18 for ultrasonic sound waves.
  • the first signal 26 comprises noise 28 and a waveform 30 corresponding to chest motions of the client 1 hidden within the noise 28.
  • a second (noise) signal 32 is formed based on audio recorded by one or more additional audio inputs which is inverted; that is, the second signal represents a signal inversion of ambient noise.
  • the two signals 28 and 32 are superimposed which results in the third signal 34, where it can be seen that the waveform 30 can now be resolved from on top of a low level white noise signal 36.
  • Obtaining current (i.e. real time) breathing and heart rate information from a client does not in itself provide information which is useful to predicting an alert event; that is; a situation relating to the client which would be cause for raising an alarm with an alarm / call centre.
  • the aim of the predictive care is to trigger an alert signal before the alert event becomes a reality; e.g. to alert an alarm centre before a heart attack has occurred, rather than during or after (although the present techniques would certainly indicate such events too). In this way, valuable seconds may be saved in dispatching aid to a client (if necessary), thereby potentially saving lives.
  • the real-time chest motion data is compared with an expected normal chest motion for the client.
  • the current chest motion data derived from reflected ultrasonic waves corresponding to the client's chest movement is compared in real-time with expected chest motion data for the client. Deviations in the real-time data compared to the expected data are then used to predict whether an alert event is likely to occur.
  • Figure 5 shows examples of a deviation in a currently measured pattern from an expected pattern. More specifically, Figure 5 shows a comparison of current to expected waveforms for a client.
  • the various signals are measured over 1 minute (x axis) with amplitude corresponding to the measured range of chest motion.
  • the large amplitude signals correspond to chest motions due to breathing.
  • Barely visibly are small amplitude signals following the large amplitude wave which correspond to chest motions due to heart rate.
  • the signals are separated on the y axis with respect to an average number of heart beats per minute determined from the small amplitude signals.
  • a baseline waveform 38 represents an expected "normal" pattern for the client 1. By way of example, this waveform corresponds to approximately 7.5 breaths per minute and an average heart rate of 83 bpm. Analysis of the deviation of other signals from this baseline may be used to predict the onset of an alert event.
  • a first waveform 40 corresponds to a first example state of the client 1.
  • the client 1 is measured as having only 5 breaths per minute and an average heart rate of 77 bpm.
  • the client's breathing rate has decreased, this indicates that the client might be having difficulty breathing, and is taking large gulps of air to compensate (corresponding to large amplitude chest measurements).
  • it may also be appropriate to augment the analysis with audio recording e.g. via the ultrasonic audio input, or another audio input such as might be used for noise cancellation) in order to establish whether the client is indeed gulping for air (and possible choking).
  • a second waveform 42 corresponds to a second example state of the client 1.
  • the client 1 is measured as having 15 breaths per minute and an average heart rate of 86 bpm. As the client's breathing rate and heart rate has increased moderately, this might indicate that the client 1 is fighting an infection.
  • the pattern analysis may also be appropriate to combine the pattern analysis with real-time absolute measurements of the client's position relative to the ultrasonic receiver, so as to check whether the client is exerting themselves by moving or is stationary. Put another way, locomotion of the client may be analysed. In this way false positives may be prevented. Measuring absolute position of the client may also be useful in other situations, not only predicting infection.
  • a third waveform 44 corresponds to a third example state of the client 1.
  • the client 1 is measured as having 30 breaths per minute and an average heart rate of 92 bpm.
  • the baseline pattern is updated regularly; i.e. continuous re-baselining is performed. This is because what is considered 'normal' for a client 1 will change over time due to age, illness, fitness, etc.
  • data from a measurement window sometime in the past may be used to determine the baseline pattern.
  • An example measurement window is a couple of days centred one week in the past; though it will be appreciated other values could also be chosen.
  • Such a trailing calibration window provides a profile for the client 1, on the assumption that such a window corresponds to what is normal for the client. In this way re-baselining is performed automatically, without any specific client involvement. Accordingly, data corresponding to alert events may be flagged such that said data may be easily recognised and ignored if it later falls within the trailing calibration window.
  • calibration is performed by measuring the client's chest motion during a specific time and/or while performing a specific task. Such an approach is not generally preferred, however, as requiring a client to "do" something for the calibration to take effect is unlikely to be performed regularly, even if done properly.
  • analysis of the real-time chest motion pattern in comparison to an expected pattern is conducted using a suitable Machine Learning 'ML' algorithm implemented on a suitable computer (or network of computing devices).
  • ML provides significant advantages for quickly classifying certain waveforms as being related to a certain condition. More specifically, a classification type ML algorithm may be employed to classify a particular waveform (which is a deviation from the baseline waveform) as being produced by a particular condition effecting the client (i.e. which would give rise to an alert event).
  • an ML algorithm may be able to more readily identify certain patterns as being related to a certain activity that does not correspond to an alert event. That is, in addition to classifying waveforms for predicting alert events, the ML algorithm may classify waveforms that do not correspond to an alert event.
  • the client's breathing and heart rate are likely to increase by measurable degrees when doing certain 'normal' tasks like exercising, standing up and sitting down, and moving around the dwelling.
  • events which are classified as non-alert events may be flagged and excluded from calibration if they should fall within the calibration window, and so what is considered 'normal' chest motion for a client may be better established (i.e. by excluding anomalous data corresponding to activity).
  • an alert signal is issued.
  • the alert signal may be issued to the client 1, an alarm centre (to be received by an operator there), and/or both.
  • an alert signal issued to the client may take the form of a voice communication, for example using a suitable audio output device provided within the client's dwelling (which may even be the ultrasonic emitter operating at audible frequency ranges). This could be specific information on the type of event being detected, or a more general instruction to contact the alarm/call centre.
  • the client alert may be a signal transmitted to a wearable social care device (such as an alarm trigger) which causes a light to turn on, or periodically flash, etc, so as to inform the client that an abnormal breathing or heartrate has been detected; the client may be trained accordingly to recognise that the light means an abnormal status has been detected and to contact the alarm/call centre.
  • an alert signal issued to the alarm centre may be an alarm notification which includes information on the client and the alert event which is being predicted, by which an operator is made aware that a potentially deteriorating condition of the client 1 has been detected.
  • the alert signal may comprise data relating to the predicted alert event; for example, the alert signal may include data on the measured waveform giving rise to the prediction, a sound recording captured by audio inputs in the client dwelling, and/or video data captured from a camera device within the client dwelling. In this way an operator at the alarm centre may be provided with additional information upon which to base an appropriate course of action.
  • an operator at the alarm centre may contact the client so as to ascertain whether the client is e.g. in pain, distress, feeling unwell, or otherwise impaired.
  • the operator may also dispatch aid to the client such as onsite careers, first aiders, paramedics, etc, either before or after contacting the client (or even forgoing contacting the client at all). Dispatching aid immediately may be appropriate in situations where a serious alert event is being predicted, and so it is vital for aid to get to the client without delay.
  • notification of the alert signal may be handled using appropriate software and computing and communication modules.
  • FIG. 6 summarises a method of operation of a telehealth care system consistent with the above disclosed techniques.
  • step 601 ultrasonic waves are emitted from a suitable output unit within a client's dwelling.
  • step 602 the ultrasonic waves which have been reflected from a client and received by a suitable input unit, are analysed in real-time to identify a pattern corresponding to chest movements of the client.
  • step 603 a deviation of the real-time identified pattern from an expected pattern is determined.
  • an alert event is predicted based on the deviated pattern.
  • step 605 a suitable alert signal is issued.
  • Figure 7 demonstrates an example telehealth care installation (or system) 100 as arranged within a client's dwelling 1.
  • Figure 8 illustrates an example hub unit 110 compatible with the system 100.
  • Figure 9 illustrates an example audio input/output 'IO' unit 120 compatible with the system 100.
  • the system 100 comprises a communication module 112 arranged to communicate with a remote alarm centre (not shown).
  • the communication module 112 is configured to establish communication with the alarm centre using an appropriate communication network; for example, and without limitation, a public switched telephone network 'PSTN', Voice over Internet Protocol 'VoIP', and/or a cellular telecommunications network.
  • an appropriate communication network for example, and without limitation, a public switched telephone network 'PSTN', Voice over Internet Protocol 'VoIP', and/or a cellular telecommunications network.
  • the communication module 112 is configured as part of the hub unit 110.
  • the hub unit 110 may be configured to receive an alarm signal from a social alarm trigger device wearable by a client 2.
  • the social alarm trigger device may transmit a radio frequency signal to the hub unit 110 in response to an event such as a client falling over, and in turn the hub unit 110 may raise an alarm with the alarm centre.
  • the system 100 also comprises one or more audio inputs 122 (i.e. ultrasonic receivers 18) and one or more audio outputs 124 (i.e. ultrasonic emitters 12); e.g. one or more speakers (outputs) and one or more microphones (inputs).
  • the audio inputs 122 and outputs 124 are configured as part of one or more audio IO devices 120 (two such devices are shown in Figure 7 ).
  • the audio IO devices 120 are preferably distributed throughout the dwelling 1 - i.e. they are remote from the hub unit 110 - in order to provide audio coverage throughout the dwelling, particularly when the dwelling has separate distinct rooms (as is usually the case).
  • the audio IO devices 120 are arranged to electronically communicate with the hub unit 110 (either wired or wirelessly) to facilitate transfer of data between the devices.
  • audio input(s) 122 and output(s) 124 may be provided as part of the hub unit 110, either in addition to or instead of the audio IO devices 120.
  • audio inputs and outputs may be implemented as separate devices; such an arrangement may be beneficial if it is desired to move bulky speaker equipment onto shelving at edges of the dwelling 1, but it is desirable to have microphones more centrally within the dwelling 1 (e.g. on a coffee table).
  • the audio output(s) 124 are configured to output ultrasonic sound waves while the audio inputs 122 are configured to receive ultrasonic sound waves. More specifically, the audio inputs 122 are arranged to receive ultrasonic sound 16 reflected from the client 2; i.e. receive and measure ultrasonic sound at frequencies emitted by the output(s) 124. In this example, the audio outputs may output sound in a frequency range between 22 kHz and 28.5 kHz. That is, a frequency range which is suitably above audible hearing frequencies but possible to produce using common paper cone/magnet speakers, and which may be suitable for resolving both breathing rate and heart rate of the client 1.
  • the system 100 comprises a computing unit 114 arranged to identify a pattern in the reflected ultrasonic sound waves corresponding to the chest movements of the client of the client 2.
  • the pattern is identified in substantially real time (i.e. with as small a delay as possible between receiving the reflected ultrasonic waves and analysing the corresponding data to identify a pattern).
  • the computing unit 114 is configured to determine whether the real-time identified pattern deviates from an expected chest movement pattern of the client. If so, the computing unit 114 is arranged to predict an alert event based on the detected deviation and control the communication module 112 to issue an alert signal.
  • the computing unit 114 is arranged to perform the contactless client monitoring techniques described above.
  • the computing unit 114 is configured as part of the hub unit 110.
  • connection to the communication module 112 is more readily achieved, and indeed could be configured to be controlled by the same processor.
  • a single device may both analyse the ultrasonic data and raise an alert signal with the remote alarm centre, which reduces the possible fail points in the system (thereby providing robustness) and beneficially ensures that client data does not have to be transferred out of the device (except when optionally included as part of an alarm signal).
  • the audio IO devices 120 may forward data corresponding to the received ultrasonic sound waves via a suitable inbuilt communication module 126 to the hub unit 110 via its communication module 112.
  • each of the audio IO devices 120 may be provided with a suitably configured computing unit 128 (i.e. processor) to analyse ultrasonic waves specifically received by an audio input 122 associated with that particular audio IO device 120 (and also to control the ultrasonic output through output 124). The audio IO devices may then communicate the processed data to the hub unit 110, or send a notification to the hub unit 110 indicating that it should issue an alert.
  • a suitably configured computing unit 128 i.e. processor
  • the computing unit 114 may be provided as part of a remote server which is configured to receive and process the ultrasonic wave measurements from the system audio inputs 122.
  • the server may receive data direct from the audio inputs if the IO devices 120 have been provided with a suitable network (e.g. internet) connection, or may receive data from the hub unit 110 (e.g. via the communication module 112) if the audio input data is transferred to the hub unit 110 from the IO devices 120 first.
  • a suitable network e.g. internet
  • the alert signal may take a variety of forms.
  • the alert signal may be an audio alert output via the same audio outputs 124 which are acting as ultrasonic emitters.
  • the alert signal may be a recorded voice warning output through the IO devices 120 and intended to make the client 2 aware of a possible medical situation.
  • the alert signal may be an alarm notification issued to an operator of the remote alarm centre via the communication module 112.
  • exemplary embodiments of an improved telehealth care system which contactlessly monitors a client's wellbeing has been described.
  • the exemplary embodiments monitor heart rate and breathing rate to identify events warranting an alert to a remote alarm centre - sometimes termed emergency events, such as a heart attack - at an early stage of the event, i.e. before existing techniques for monitoring a client would register a problem and raise an alarm.
  • emergency events such as a heart attack - at an early stage of the event, i.e. before existing techniques for monitoring a client would register a problem and raise an alarm.
  • valuable seconds or even minutes may be saved when raising an alarm and getting aid dispatched to a client.
  • the system and its components may be manufactured industrially. An industrial application of the example embodiments will be clear from the discussion herein.
  • the present techniques may be embodied as a system, method or computer program product. Accordingly, aspects of the techniques described herein may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects.
  • the present techniques may take the form of a computer program product embodied in a computer readable medium having computer readable program code embodied thereon.
  • the computer readable medium may be a computer readable signal medium or a computer readable storage medium.
  • a computer readable medium may be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing.
  • Computer program code for carrying out operations of the present techniques may be written in any combination of one or more programming languages, including object-oriented programming languages and conventional procedural programming languages.
  • Code components may be embodied as procedures, methods or the like, and may comprise subcomponents which may take the form of instructions or sequences of instructions at any of the levels of abstraction, from the direct machine instructions of a native instruction set to high-level compiled or interpreted language constructs.
  • Embodiments of the present techniques also provide a non-transitory data carrier carrying code which, when implemented on a processor, causes the processor to carry out any of the methods described herein.
  • the techniques further provide processor control code to implement the above-described methods, for example on a general purpose computer system or on a digital signal processor (DSP).
  • DSP digital signal processor
  • the techniques also provide a carrier carrying processor control code to, when running, implement any of the above methods, in particular on a non-transitory data carrier.
  • the code may be provided on a carrier such as a disk, a microprocessor, CD- or DVD-ROM, programmed memory such as non-volatile memory (e.g. Flash) or read-only memory (firmware), or on a data carrier such as an optical or electrical signal carrier.
  • Code (and/or data) to implement embodiments of the techniques described herein may comprise source, object or executable code in a conventional programming language (interpreted or compiled) such as Python, C, or assembly code, code for setting up or controlling an ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array), or code for a hardware description language such as Verilog (RTM) or VHDL (Very high speed integrated circuit Hardware Description Language).
  • a controller which includes a microprocessor, working memory and program memory coupled to one or more of the components of the system.
  • a logical method may suitably be embodied in a logic apparatus comprising logic elements to perform the steps of the above-described methods, and that such logic elements may comprise components such as logic gates in, for example a programmable logic array or application-specific integrated circuit.
  • Such a logic arrangement may further be embodied in enabling elements for temporarily or permanently establishing logic structures in such an array or circuit using, for example, a virtual hardware descriptor language, which may be stored and transmitted using fixed or transmittable carrier media.
  • the present techniques may be realised in the form of a data carrier having functional data thereon, said functional data comprising functional computer data structures to, when loaded into a computer system or network and operated upon thereby, enable said computer system to perform all the steps of the methods described herein.
  • the methods described herein may be wholly or partly performed on an apparatus, i.e. an electronic device, using a machine learning or artificial intelligence model.
  • a function associated with AI may be performed through the non-volatile memory, the volatile memory, and the processor.
  • the AI model may be processed by an artificial intelligence-dedicated processor designed in a hardware structure specified for artificial intelligence model processing.
  • the processor may include one or a plurality of processors.
  • one or a plurality of processors may be a general purpose processor, such as a central processing unit (CPU), an application processor (AP), or the like, a graphics-only processing unit such as a graphics processing unit (GPU), a visual processing unit (VPU), and/or an Al-dedicated processor such as a neural processing unit (NPU).
  • the one or a plurality of processors control the processing of the input data in accordance with a predefined operating rule or artificial intelligence (Al) model stored in the non-volatile memory and the volatile memory.
  • the predefined operating rule or artificial intelligence model is provided through training or learning.
  • being provided through learning means that, by applying a learning algorithm to a plurality of learning data, a predefined operating rule or AI model of a desired characteristic is made.
  • the learning may be performed in a device itself in which AI according to an embodiment is performed, and/o may be implemented through a separate server/system.
  • the learning algorithm is a method for training a predetermined target device (for example, a robot) using a plurality of learning data to cause, allow, or control the target device to make a determination or prediction.
  • Examples of learning algorithms include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.
  • the artificial intelligence model may include a plurality of neural network layers.
  • Each of the plurality of neural network layers includes a plurality of weight values and performs neural network computation by computation between a result of computation by a previous layer and the plurality of weight values.
  • Examples of neural networks include, but are not limited to, convolutional neural network (CNN), deep neural network (DNN), recurrent neural network (RNN), restricted Boltzmann Machine (RBM), deep belief network (DBN), bidirectional recurrent deep neural network (BRDNN), generative adversarial networks (GAN), and deep Q-networks

Landscapes

  • Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Psychology (AREA)
  • Social Psychology (AREA)
  • General Health & Medical Sciences (AREA)
  • Gerontology & Geriatric Medicine (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Alarm Systems (AREA)

Claims (14)

  1. Verfahren zum Betreiben eines Telegesundheitssystems (100), umfassend:
    Analysieren von Ultraschallwellen (16), die von einem Klienten (1) reflektiert werden, um in Echtzeit ein Muster in den reflektierten Ultraschallwellen (16) zu identifizieren, das Brustbewegungen des Klienten (1) entspricht, und
    als Reaktion auf die Feststellung einer Abweichung des in Echtzeit identifizierten Musters (40, 42, 44) von einem erwarteten Muster (38), Vorhersagen eines Alarmereignisses basierend auf der Abweichung und Ausgeben eines Alarmsignals,
    wobei das Vorhersagen des Alarmereignisses weiterhin auf Umgebungsgeräuschen basiert, die im Wesentlichen gleichzeitig mit den analysierten reflektierten Ultraschallwellen (16) aufgezeichnet werden.
  2. Verfahren nach Anspruch 1, wobei das in Echtzeit identifizierte Muster (40, 42, 44) und das erwartete Muster (38) Brustbewegungen entsprechen, die sich aus einer Atemfrequenz des Klienten (1) ergeben.
  3. Verfahren nach Anspruch 1 oder 2, wobei das in Echtzeit identifizierte Muster (40, 42, 44) und das erwartete Muster (38) Brustbewegungen entsprechen, die sich aus einer Herzfrequenz des Klienten (1) ergeben.
  4. Verfahren nach einem der vorhergehenden Ansprüche, wobei das Muster eine Wellenform ist.
  5. Verfahren nach Anspruch 4, wobei das Analysieren der Ultraschallwellen eine digitale Verarbeitung umfasst, um die Wellenform aus Hintergrundgeräuschen mithilfe von in Echtzeit aufgezeichneten Umgebungsgeräuschen von mehreren Audioeingabegeräten zu extrahieren.
  6. Verfahren nach einem der vorhergehenden Ansprüche, wobei das Vorhersagen eines Alarmereignisses weiterhin auf dem Messen einer Fortbewegung des Klienten (1) basiert.
  7. Verfahren nach einem der vorhergehenden Ansprüche, wobei das erwartete Muster (38) aus historischen Daten von Ultraschallwellen (16) bestimmt wird, die vom Klienten (1) reflektiert werden.
  8. Verfahren nach einem der vorhergehenden Ansprüche, wobei das Vorhersagen eines Alarmereignisses auf der Grundlage der Abweichung das Überprüfen umfasst, ob die Abweichung einem Nicht-Alarmereignis, beispielsweise einer vom Klienten (1) durchgeführten normalen Aktivität entspricht.
  9. Verfahren nach einem der vorhergehenden Ansprüche, wobei das vorhergesagte Alarmereignis mindestens eines von Atembeschwerden, Herzinfarkt, Herzrhythmusstörungen und Infektionen umfasst.
  10. Verfahren nach einem der vorhergehenden Ansprüche, wobei das Ausgeben des Alarmsignals das Ausgeben einer akustischen Warnung an den Klienten (1) umfasst.
  11. Verfahren nach einem der vorhergehenden Ansprüche, wobei das Ausgeben des Alarmsignals das Übertragen einer Alarmmeldung an eine Alarmzentrale zusammen mit Daten umfasst, die dem identifizierten Muster entsprechen, auf dem das vorhergesagte Alarmereignis basiert.
  12. Verfahren nach Anspruch 11, das weiterhin als Reaktion auf das Empfangen der Alarmmeldung durch die Alarmzentrale das Versenden von Hilfe an den Klienten (1) umfasst.
  13. Computerprogramm, das Anweisungen umfasst, die, wenn sie von einem Computer ausgeführt werden, den Computer veranlassen, das Verfahren nach einem der Ansprüche 1 bis 11 auszuführen.
  14. Telegesundheitssystem (100), umfassend:
    ein Kommunikationsmodul (112), das so angeordnet ist, dass es mit einer entfernten Alarmzentrale kommuniziert,
    einen oder mehrere Audioausgänge (120), die zur Ausgabe von Ultraschallwellen (10) angeordnet sind, einen oder mehrere Audioeingänge (120), die so angeordnet sind, dass sie von einem Klienten (1) reflektierte Ultraschallwellen (16) empfangen, und einen oder mehrere Audioeingänge, die dafür ausgelegt sind, Umgebungsgeräusche im Wesentlichen gleichzeitig mit den reflektierten Ultraschallwellen (16) aufzuzeichnen, und eine Recheneinheit (114), die dazu eingerichtet ist, in Echtzeit, ein Muster in den reflektierten Ultraschallwellen (16) zu identifizieren, das den Brustbewegungen des Klienten (1) entspricht und, als Reaktion auf die Feststellung, dass das in Echtzeit identifizierte Muster (40, 42, 44) von einem erwarteten Muster (38) abweicht, ein Alarmereignis basierend auf der Abweichung und dem Umgebungsgeräusch vorherzusagen, das im Wesentlichen gleichzeitig mit den reflektierten Ultraschallwellen (16) aufgezeichnet wird, und um einen Audioausgang und/oder das Kommunikationsmodul (112) zu steuern, um ein Alarmsignal auszugeben.
EP21187266.8A 2021-07-22 2021-07-22 Telemedizinisches gesundheitssystem Active EP4123613B1 (de)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP21187266.8A EP4123613B1 (de) 2021-07-22 2021-07-22 Telemedizinisches gesundheitssystem
ES21187266T ES2967807T3 (es) 2021-07-22 2021-07-22 Sistema de atención médica a distancia
PCT/GB2022/051866 WO2023002174A1 (en) 2021-07-22 2022-07-19 Telehealth care system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP21187266.8A EP4123613B1 (de) 2021-07-22 2021-07-22 Telemedizinisches gesundheitssystem

Publications (3)

Publication Number Publication Date
EP4123613A1 EP4123613A1 (de) 2023-01-25
EP4123613B1 true EP4123613B1 (de) 2023-12-27
EP4123613C0 EP4123613C0 (de) 2023-12-27

Family

ID=77367216

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21187266.8A Active EP4123613B1 (de) 2021-07-22 2021-07-22 Telemedizinisches gesundheitssystem

Country Status (3)

Country Link
EP (1) EP4123613B1 (de)
ES (1) ES2967807T3 (de)
WO (1) WO2023002174A1 (de)

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6862472B2 (en) * 2001-07-26 2005-03-01 Ge Medical Systems Information Technologies, Inc. Medical testing system with an illuminating component
US20090048500A1 (en) * 2005-04-20 2009-02-19 Respimetrix, Inc. Method for using a non-invasive cardiac and respiratory monitoring system
US11684293B2 (en) * 2019-12-09 2023-06-27 Arizona Board Of Regents On Behalf Of The University Of Arizona Sensors and method for defining breathing signatures for identifying respiratory disease

Also Published As

Publication number Publication date
WO2023002174A1 (en) 2023-01-26
EP4123613C0 (de) 2023-12-27
ES2967807T3 (es) 2024-05-03
EP4123613A1 (de) 2023-01-25

Similar Documents

Publication Publication Date Title
US10446017B1 (en) Smart personal emergency response systems (SPERS)
US20220401040A1 (en) Health monitor wearable device
US11837066B2 (en) Fall detection apparatus, a method of detecting a fall by a subject and a computer program product for implementing the method
JP2022544757A (ja) ウェアラブルセンサを用いて被験者の転倒を検出するシステム及び方法
KR102212200B1 (ko) 사물인터넷 기반의 조명장치를 이용한 독거노인 모니터링 시스템 및 방법
KR20190125080A (ko) 수면 관리 시스템
US11317859B2 (en) System for determining sound source
EP4123613B1 (de) Telemedizinisches gesundheitssystem
KR20170082951A (ko) 환자 객담을 확인할 수 있는 환자 감시 장치
TWI772762B (zh) 照護系統與自動照護方法
US11282364B2 (en) Wrist-worn medical alert device for conveying an emergency message to a caregiver
KR102212173B1 (ko) 사물인터넷 기반의 조명장치를 이용한 수면 모니터링 시스템 및 방법
JP7468350B2 (ja) 状態監視装置および状態監視装置の制御方法
KR102031551B1 (ko) 위급 상황 판단 장치
US20210177300A1 (en) Monitoring abnormal respiratory events
KR102236727B1 (ko) 사물인터넷 기반의 조명장치를 이용한 헬스 케어 시스템 및 방법
KR102212187B1 (ko) 수유를 위한 IoT 조명장치의 제어 시스템 및 방법
KR102384211B1 (ko) 센서를 이용한 환자 모니터링 시스템 및 그 방법
KR102405957B1 (ko) 음파 및 전파를 이용한 생활안전 모니터링 시스템
EP4293646A1 (de) Babyüberwachungssystem und -verfahren
JP7233080B2 (ja) 生体検知装置、生体検知システム、生体検知方法及び生体データ取得装置
US20230073613A1 (en) Automatic classification of heart sounds on an embedded diagnostic device
EP3838127A1 (de) Vorrichtung, system und verfahren zur überwachung einer person
WO2023232533A1 (en) A system and method for determining an emotional state of a user based on one or more physical and/or physiological parameters

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN PUBLISHED

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20230711

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20230920

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602021008039

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

U01 Request for unitary effect filed

Effective date: 20240110

U07 Unitary effect registered

Designated state(s): AT BE BG DE DK EE FI FR IT LT LU LV MT NL PT SE SI

Effective date: 20240118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240328

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20240328

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2967807

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20240503