GB2563874A

GB2563874A - Message delivery system and method

Info

Publication number: GB2563874A
Application number: GB1710309.4A
Authority: GB
Inventors: Moorhead Paul
Original assignee: Kraydel Ltd
Current assignee: Kraydel Ltd
Priority date: 2017-06-28
Filing date: 2017-06-28
Publication date: 2019-01-02
Anticipated expiration: 2037-06-28
Also published as: GB2563874B; GB201710309D0; WO2019002418A1

Abstract

A message delivery system 10 comprises a television set 14 for delivering at least one message to a user, and a primary messaging device 12. The primary messaging device 12 stores at least one message, determines when to deliver the at least one message to a user, and causes the television set 14 to deliver the at least one message. The primary messaging device 12 may receive an input from the user in response to receipt of the message, and transmit an alert message if it does not receive a user response input. The primary messaging device 12 may also include an output device for delivering the message and receive an input from the user on receipt of the message, and may be configured such that if the user input is not received, it then sends the at least one message to the television set 14. The system may also include sensor for detecting presence of the user, and may deliver the message/alert message based upon detection of presence. The primary messaging device 12 may also communicate with and operate a remote control 34 of the television set 14 to send signals to the television set 14.

Description

Message Delivery System and Method

Field ofthe Invention

The present invention relates to message delivery systems. The invention related particularly to the delivery of reminders to individuals in a domestic environment.

Background to the Invention A growing number of people, in particular the elderly, and those suffering from dementia, have difficulty in remembering to carry out important tasks, including, but not limited to: taking medication, locking doors at night, drinking and eating. Keeping appointments and remembering important events can also be a challenge.

The currently conventional means of addressing this problem is through PC, smartphone or tablet devices - but such devices can be difficult forthe elderly to use. In addition, although smartphones and the like have the advantage being mobile, they are easy to forget, or to ignore for those with hearing or visual impairment. Relatively few elderly people use smartphones and similar devices and they do not tend to keep them nearby when in the home.

It would be desirable to mitigate the problems outlined above.

Summary ofthe Invention A first aspect ofthe invention provides a message delivery system comprising: a primary messaging device configured to store at least one message and to determine when to deliver said at least one message to a user; and a television set for delivering said at least one message to a user, wherein said primary messaging device is configured to cause said television set to deliver said at least one message. A second aspect ofthe invention provides a message delivery system comprising: a primary messaging device configured to store at least one message and to determine when to deliver said at least one message to a user; and an auxiliary messaging device having at least one output device for delivering said at least one message to a user, wherein said primary messaging device is configured to send said at least one message to said auxiliary messaging device and to cause said auxiliary messaging device to deliver said at least one message via said at least one output device. The auxiliary messaging device may be a television set but may alternatively be any other device that is capable of delivering audio and/or visual messages to the user.

Said primary messaging device and said auxiliary messaging device may be connected by at least one communications link.

Said primary messaging device may be configured to receive an input from the user in response to delivery ofthe or each message by said auxiliary device, and to transmit an alert message in response to not receiving said user response input.

Said primary messaging device may be configured to transmit said alert message to one or more message-receiving device across a telecommunications network.

Said primary messaging device may include at least one output device for delivering said at least one message to the user, and is configured to deliver said at least one message to the user by said at least one output device, and wherein said primary messaging device is configured to receive an input from the user in response to delivery ofthe or each message by said at least one output ofthe primary messaging device, and, in response to not receiving the user response input, to send said at least one message to said auxiliary messaging device and to cause said auxiliary messaging device to deliver said at least one message via said at least one output device of said auxiliary messaging device.

Said primary messaging device may include at least one sensor for detecting the presence of said user, and is configured to cause said at least one message to be delivered to said user upon detection ofthe user by said at least one sensor.

Said primary messaging device may include at least one sensor for detecting the presence of said user, and is configured to cause the delivery of a delivered one of said at least one message to be repeated upon detection ofthe user by said at least one sensor.

Said primary messaging device may include at least one sensor for detecting the presence of said user, and is configured to transmit said alert message depending on whether or not the user’s presence is detected, preferably if said user’s presence is detected.

Said primary messaging device may include at least one sensor for detecting the presence of said user, and is configured to cause said auxiliary messaging device to deliver said at least one message depending on whether or not the user’s presence is detected, preferably if said user’s presence is detected.

Said primary messaging device may be connected to an audio and/or video input of said television set (or other auxiliary messaging device) for sending said at least one message to said television set(or other auxiliary messaging device).

Said primary messaging device may be configured to send control signals directly or indirectly to a control input ofthe auxiliary messaging device.

Said primary messaging device may include a wireless transmitter, preferably an infrared transmitter, for sending said control signals to a corresponding wireless receiver, preferably an infrared receiver, provided on the auxiliary messaging device.

Said primary messaging device may be in communication with a remote control device of said auxiliary messaging device and is configured to operate said remote control device to send said control signals to said auxiliary messaging device.

Said control signals may be configured to cause said auxiliary messaging device to select the audio and/or visual input by which said primary messaging device delivers said at least one message to said auxiliary messaging device.

The primary messaging device may be configured to monitor operation of a remote control device and to cause one or more messages to be delivered via the auxiliary messaging device in response to determining that the remote control device is being operated and/or in response to determining that the remote control device is moving.

From another aspect the invention provides a method of delivering messages comprising: storing at least one message determining when to deliver said at least one message to a user; and causing an auxiliary messaging device to deliver said at least one message via at least one output device. The auxiliary messaging device is preferably a television set.

In preferred embodiments, the invention makes use of a television set, since it is a direct, convenient and familiar means to make an elderly person aware of something important.

Preferred systems embodying the invention provide a highly reliable means of reminding, and confirming that the reminder has been seen and the necessary action taken, or not taken, advantageously employing a progression of steps to provide the highest level of usability and effectiveness.

Further advantageous aspects ofthe invention will become apparent to those ordinarily skilled in the art upon review ofthe following description of a specific embodiment and with reference to the accompanying drawings.

Brief Description ofthe Drawings

An embodiment of the invention is now described by way of example and with reference to the accompanying drawings in which:

Figure 1 is a schematic diagram of a system embodying one aspect ofthe invention; and

Figure 2 is a flow diagram illustrating a preferred operation ofthe system of Figure 1.

Detailed Description ofthe Drawings

Referring now to Figure 1 there is shown, generally indicated as 10, a message delivery system embodying one aspect ofthe invention. The system 10 comprises a primary messaging device 12 connected or connectable to an auxiliary messaging device 14. The auxiliary messaging device 14 comprises at least one output device capable of delivering messages to a user, preferably comprising a visual display unit (VDU) and/or one or more loudspeakers. In preferred embodiments, the auxiliary messaging device 14 is a television set.

In the illustrated embodiment, the primary messaging device 12 and the auxiliary messaging device 14 are not integrated with each other, typically being physically separate devices that can be connected to each other by one or more wired and/or wireless communication link. In alternative embodiments the primary messaging device 12 and the auxiliary messaging device 13 may integrated into a common apparatus, for example a smart television or as parts of a computer or computer system.

The primary messaging device 12 comprises a computing device having a controller 16, which typically comprises a central processing unit (CPU) or other processing device, suitable programmed or otherwise configured to perform the tasks described herein. Computer memory 18 is provided as required. The device 12 comprises, or is connected or connectable to, input /output (I/O) devices, which in preferred embodiments comprise any one or more ofthe following: one or more visual display unit 20; one or more loudspeaker 22; one or more lamp (e.g. LED); a keyboard or keypad (and/or other user interface) 26; and a motion detector 28 (and/or other personnel sensor, e.g. a thermal sensor, thermal imaging camera). Other I/O devices may be provided as required, e.g. a buzzer or other alerting device, infrared receiver and/or microphone(s). The device 12 has a timing device 30 for controlling the timing of message delivery.

The primary messaging device 12 also includes one or more communications module(s) 32 (including ay necessary hardware and/or software as applicable) 32 for supporting wired and/or wireless communication between the device 12 and any relevant I/O device, the auxiliary messaging device 14 and/or other device or system (such as a remote control device 34, an email server, an SMS server, an MMS server, a paging system, a telephone, computer and/or any other device, either directly (e.g. by HDMI, USB or other wired connection, Bluetooth, Wifi, and/or infrared) or via a telecommunications network e.g. a telephone network and/or a computer network (such as the internet) with which the primary messaging device 12 may communicate depending on the embodiment.

The primary messaging device 12 is programmable by a user (not shown) to store one or more messages for delivery to the user, or another user. The message may comprise a simple alert or alarm, and/or may include a verbal element (e.g. text or speech). Typically the message is a reminder for the user to perform a task, for example taking medication, locking doors at night, drinking and eating, keeping an appointment and so on.

The primary messaging device 12 may include any convenient user interface for allowing a user to create and store messages. In the illustrated example this may be achieved using the keyboard or keypad 26, and/or via the VDU 20 in embodiments where it supports touch-screen inputs. In alternative embodiments the device 12 may include a voice recognition user interface for creating messages. Optionally, the device 12 may support the creation of messages by a remote device, such as the remote control device 34, via a suitable wireless link (typically infrared or Bluetooth) between the device 12 and the remote device. Optionally, the device 12 may support the creation of messages by the auxiliary device 14, via any suitable wired or wireless connection between the devices 12, 14. Optionally, the device 12 may support the creation of messages via a remote system or device (such as a computer or smartphone - not shown) using wired or wireless connection and/or a telecommunications network (not illustrated), e.g. a computer network (such as the internet), a telephone network. The or each message is typically associated with a delivery date and/or time, and may be a one-off message or on a repeat cycle. The timing device 30 typically has clock and/or calendar functionality to facilitate the delivery of messages at the desired time. For example, a typical message may be created with information such as (as applicable): delivery time; frequency of delivery; duration of delivery; verbal information to be delivered; an indication as to whether the message is critical. Each message may also be associated with an indication that a user response is required, and optionally an indicated as to what action is to be taken if the response is received, and/or what action is to be taken if a user response is not received within a specified time period.

In preferred embodiments, the primary messaging device 12 includes at least one output device for delivering messages to the user. Typically, the output devices comprise any one or more of: the loudspeaker(s) 22 (through which verbal messages may be played and/or alert sounds may be issued; the VDU 20 (which may display verbal messages and/or alert visual effects); the light(s) 24; and/or a buzzer. Verbal messages that are to be delivered as audio may comprise pre-recorded speech or synthesised speech as is convenient. The device 12 may be correspondingly equipped to store voice messages and/or to generate synthesised speech as applicable.

The primary messaging device 12 is able to deliver messages to the user via the auxiliary messaging device 14. To this end, the primary messaging device 12 is connected to the auxiliary messaging device 14 by any suitable wired and/or wireless communications link. In the case of a wired link, the devices 12, 14 are connected by one or more relevant cables, connectors and interfaces depending on the technology used e.g. HDMI, USB, SCART, RCA. In the case of a wireless link (e.g. Bluetooth, WiFi, infrared), each device 12, 14 is equipped with the corresponding software and hardware. The wireless connection^) may be maintained while the device 12 is operating or only when required, as is desired.

In preferred embodiments, the auxiliary messaging device 14 is a television set. In this context, the term television set is intended to embrace any electronic apparatus that includes a television receiver (including terrestrial television receivers and satellite television receivers) and means for rendering received television signals to a user (typically comprising a display screen (VDU) and one or more loudspeakers). For example the auxiliary messaging device may be a conventional television (TV), including a smart TV, or a computer equipped to receive and deliver television signals to a user.

Typically the primary messaging device 12 is connected to an input ofthe television 14 that supports communication ofthe messages, which typically comprise audio and video data (but may comprise only one or the other). The device 12 is therefore connected to the TV 14 via one of its audio and/or video inputs, for example an HDMI input, although it will be understood that other input may be used as appropriate. In alternative embodiments (not illustrated), the auxiliary messaging device 14 may comprise any other device, especially a common household device, that is capable of receiving and delivering audio and or video/visual messages (including verbal messages and/or simple alerts) to the user, e.g. a radio (especially a digital radio), a computer, smart speaker or a telephone.

The primary messaging device 12 is typically also capable of directly or indirectly sending control signals to the auxiliary device 14 via a control input ofthe auxiliary device 14, which may be separate from the input for receiving audio/video signals. In preferred embodiments, in particular wherein the auxiliary device 14 is a television set or other device that is operable by remote control, the primary messaging device 12 may be configured and equipped to control the auxiliary device 14 by remote control. To this end, the communications modules 32 ofthe device 12 may include an infrared controller/transmitter (not shown) for controlling the auxiliary device 14. The infrared controller may be conventional, e.g. ofthe type commonly used to control televisions. Alternatively, the primary messaging device 12 may be configured to control the auxiliary device 14 indirectly by controlling the remote control device 34. To this end, the primary messaging device 12 may be connected (by any convenient wired or wireless link supported by the remote control device 34 and the communications modules 32) to the remote control device 34 and configured to control it to operate the auxiliary device 14. Advantageously the infrared controller may be equipped with multiple transmitting LEDs such that it can control the television regardless of its orientation. Alternatively or in addition, the primary control device 12 may be configured to control the auxiliary device 14 directly or indirectly by any convenient communications link, e.g. WiFi, Bluetooth, HDMI, or whatever else may be supported by the devices 12, 14.

By way of example, activation and input selection of the auxiliary device may alternatively be performed by any one or more ofthe following means: 1) Use ofthe Consumer Electronics Control channel which is part ofthe HDMI standard. 2) Use of the control capabilities exposed over WiFi. Many smart TVs can connect to the home network and support a range of commands over such network. 3) Bluetooth: some more recent models of television use a “magic wand” rather than a conventional infra-red remote control. The device may pair with the TV to carry out the operations desired.

In any case, the primary messaging device 12 is configured to control the auxiliary message device 14 in order to cause the auxiliary device 14 to deliver one or more messages to the user. Typically the control includes turning the auxiliary device 14 on (if it is not already on) and, if required, causing the auxiliary device 14 to select the appropriate input source by which it can receive and deliver messages from the primary messaging device 12. For example, in the case where the auxiliary device 14 is a television set, the primary messaging device 12 may be connected to any one of its input sources (e.g. one of a number of available HDMI or USB ports) for sending messages to the TV 14, and may be able to control the TV directly via an infrared controller or indirectly via the remote control 34 to turn the TV on (if required) and to select the relevant input source so that messages sent from the primary messaging device 12 are delivered to the user via the auxiliary messaging device 14.

In such embodiments, the primary messaging device 12 controls the auxiliary device 14 and sends messages to the auxiliary device 14 using separate communications links. In alternative embodiments, controlling the auxiliary device 14 and sending messages to the auxiliary device 14 may be performed using the same communications links depending on what communications links are supported by the devices 12, 14.

The motion detector 28 may comprise any conventional motion detecting device (e.g. optical, microwave or acoustic) and detects, in use, movement in the room in which the device 12 is located. The device 12 may be responsive to detected movement to perform one or more tasks as described in more detail hereinafter.

The primary messaging device 12 is configured to await a user response to messages that it delivers. The response may comprise a simple acknowledgement. The device 12 may be configured to take one or more actions if the response is not received within a specified time period. Any one or more ofthe following: whether or not a response is required; the response period; and/or what action(s) are to be taken if the response is not received, may be defined for each message (e.g. as part ofthe message creation) and/or as a setting ofthe device 12 itself.

The primary messaging device 12 is configured to receive the response from the user via any one or more of its input devices, user interfaces or other input means. For example, the user response may be received directly via the keyboard/keypad 26, the VDU 20 (if it supports touch-input), via the remote controller 34 (in which case the device 12 includes a compatible infrared receiver), by voice recognition (in which case the device 12 includes at least one microphone and voice recognition software) and/or by gesture recognitions (in which case the device 12 includes at least one motion detector and gesture recognition software). The user response may be received indirectly via the auxiliary device 14. For example, the remote control device 34 may send a signal corresponding to the user response to the auxiliary device 14 which may relay the response on to the device 12. Alternatively or in addition, the user response may be received by the auxiliary device 14 by any other means (e.g. voice recognition, gesture recognition, or other user interface) and relayed on to the primary messaging device 12. The user response may comprise an acknowledgement signal.

In a preferred embodiment, the infrared controller 34 has sufficient buttons to allow confirmation, or dismissal of any reminder with a single button press. Alternatively voice recognition or gesture recognition may be used.

Optionally, the primary messaging device 12 may be configured to monitor operation ofthe remote control device 34 and to cause one or more messages to be delivered via the auxiliary messaging device 14 in response to determining that the remote control device 34 is being operated and/or in response to determining that the remote control device 34 is moving (in which case the remote control device 34 may be provided with one or more motion sensor that generates an output signal to indicate that the device 34 is moving). To this end the primary messaging device 12 is in wired or wireless communication with the remote control device 34 so that it can detect movement ofthe remote control device 34. For example this may be achieved by receiving the output signal ofthe motion sensor and/or by detecting infra red or other control signals emanating from the control device 34 (e.g. via an infrared receiver provided on the primary messaging device).

In relation to infrared control, it is noted that manufacturers may have a standardised and unique set of infra-red control commands. These typically include codes referred to as “discrete codes” which carry out a single distinct action. Whereas most remote-controls offer a power button which “toggles” the power i.e. turns a TV off if it’s on, and on if it’s off, the discrete codes allow for commands that will only turn-on, or will only turn-off the TV. In other words, it is not necessary to know whether the TV is on or off in advance of attempting to activate the TV to display the information. Since the “power on” and input selection commands have no negative effects, they may be sent as often as desired e.g. with each motion triggered re-reminder, to ensure that the TV is on and configured correctly. The discrete codes for each manufacturer are usually in the public domain and readily obtainable.

The operation ofthe preferred system 10 is now described with reference to Figure 2. At 201, when a reminder falls due the primary messaging device 12 may initially attempt to deliver the relevant message using one or more of its integral output devices as appropriate. For example this may involve delivering a pre-recorded or synthesised voice message via the loudspeaker(s) 22, and/or operating the lights 24 and/or operating a buzzer or other alarm device.

If the device 12 receives a response from the user, then no further action may be required (until the next message is due or until the same message is due to be repeated). If the device 12 does not receive the user response, then the device 12 causes the auxiliary device 14 to deliver the message to the user (202). This may be the same message in respect of which no response was received, or other relevant message. In the preferred embodiment where the auxiliary device 14 is a TV, this may involve turning on the TV (if it is not already on) and selecting the relevant input source so that the message sent by the primary messaging device 12 is delivered by the TV. This may involve delivering a verbal message (text and/or speech) and/or any other relevant visual and/or audio output.

If the device 12 receives a response from the user, then no further action may be required (until the next message is due or until the same message is due to be repeated). If the device 12 does not receive the user response, then the device 12 may send an alert message to a message receiving device (typically a telephone, computer or smartphone - not shown) of one or more third party (typically including a carer) by one or more supported communication means, e.g. email, SMS, MMS, phone call or voice message (e.g. using text to speech or pre-recorded message) or other messaging means (204). Optionally, stage 204 is only enacted if the message is designated as critical. Optionally, an explicit rejection of a reminder e.g. by pressing the “no” button on the remote control, might also raise an alert to a care-giver. Optionally, the alert might also be sent to a phone or other device ofthe originally intended reminder recipient so that they be reminded when not at home. Such reminders can then be acknowledged or rejected using a return SMS or email, or, in the case of a voice call - key presses or voice responses.

At any stage (201,202) the device 12 may take one or more other actions before escalating to the next stage (202, 203). For example, the message may be delivered two or more times at each stage (201,202) before proceeding to the next stage (202, 204). For successive message deliveries, the device 12 may cause the volume and/or brightness ofthe message to be increased. When the message is being delivered via the auxiliary device 14, this may be achieved in the same way that the device 14 is turned on and the input source is selected.

At any stage (201,202) the device 12 may take one or more other actions depending on an input received from one or more sensors for detecting the presence of a person in the vicinity of the device 12. To this end the device 12 may include any convenient sensors, for example the motion detector 28, a thermal sensor or thermal imaging camera. People may also be detected by analysing sounds captured by one or more microphones and so the device 12 may include one or more microphones and appropriate sound recognition software.

Optionally, the primary messaging device 12 may, at any stage (201,202) repeat delivery of a message one or more times upon detecting the presence of a person in the vicinity ofthe device 12, particularly if such detection occurs after a period in which the device 12 has not detected the presence of a person (203). Motion sensors are advantageous in that they can be activated not only when a person enters a room but also when he wakes up. For example in the event that motion is detected, this may be taken to indicate that a room was previously unoccupied or the message recipient was previously asleep, and the reminder may be re-activated, the TV activated again as desired.

Alternatively or in addition, the primary messaging device 12 may at any stage (201,202) determine whether or not to progress to the next stage (202, 204) depending on whether or not a person is detected in the vicinity ofthe device 12. For example, the device 12 may elect not to deliver a message via the TV unless it detects that someone is in the vicinity. Alternatively or in addition the device 12 may elect to contact a carer (204) only if no user response is received and if a person is detected in the vicinity.

It is noted that, at stage 201, delivering the message via output devices ofthe primary messaging device 12 itself is optional; the device 12 may instead deliver messages via the auxiliary device 14 in the first instance (in which case the primary messaging device 12 need not necessarily include any message delivery output devices of its own). Delivering messages via the device 12 itself in the first instance is advantageous in that it avoids spoiling the enjoyment of TV programmes through unnecessary interruptions.

Preferably, the device 12 keeps a record of messages that are delivered, responses, if any, that are received, and levels of escalation, if any, that are taken.

The invention is not limited to the embodiment(s) described herein but can be amended or modified without departing from the scope ofthe present invention.

Claims

CLAIMS:

1. A message delivery system comprising: a primary messaging device configured to store at least one message and to determine when to deliver said at least one message to a user; and a television set for delivering said at least one message to a user, wherein said primary messaging device is configured to cause said television set to deliver said at least one message.

2. The system of claim 1, wherein said primary messaging device and said television set are connected by at least one communications link, said primary messaging device being configured to send said at least one message to said television set via said at least one communications link.

3. The system of claim 1 or 2 wherein said primary messaging device is configured to receive an input from the user in response to delivery ofthe or each message by said television set, and to transmit an alert message in response to not receiving said user response input.

4. The system of claim 3, wherein said primary messaging device is configured to transmit said alert message to one or more message-receiving device across a telecommunications network.

5. The system of any preceding claim wherein said primary messaging device includes at least one output device for delivering said at least one message to the user, and is configured to deliver said at least one message to the user by said at least one output device, and wherein said primary messaging device is configured to receive an input from the user in response to delivery ofthe or each message by said at least one output ofthe primary messaging device, and, in response to not receiving the user response input, to send said at least one message to said television set and to cause said television set to deliver said at least one message.

6. The system of any preceding claim, wherein said primary messaging device includes at least one sensor for detecting the presence of said user, and is configured to cause said at least one message to be delivered to said user upon detection ofthe user by said at least one sensor.

7. The system of any preceding claim wherein said primary messaging device includes at least one sensor for detecting the presence of said user, and is configured to cause the delivery of a delivered one of said at least one message to be repeated upon detection ofthe user by said at least one sensor.

8. The system of any one of claims 3 to 7, wherein said primary messaging device includes at least one sensor for detecting the presence of said user, and is configured to transmit said alert message depending on whether or not the user’s presence is detected, preferably if said user’s presence is detected.

9. The system of any one of claims 5 to 8, wherein said primary messaging device includes at least one sensor for detecting the presence of said user, and is configured to cause said television set to deliver said at least one message depending on whether or not the user’s presence is detected, preferably if said user’s presence is detected.

10. The system of any preceding claim, wherein said primary messaging device is connected to an audio and/or video input of said television set for sending said at least one message to said television set.

11. The system of any preceding claim, wherein said primary messaging device is configured to send control signals directly or indirectly to a control input ofthe television set.

12. The system of claim 11, wherein said primary messaging device includes a wireless transmitter, preferably an infrared transmitter, for sending said control signals to a corresponding wireless receiver, preferably an infrared receiver, provided on the television set.

13. The system of claim 11, wherein said primary messaging device is in communication with a remote control device of said television set and is configured to operate said remote control device to send said control signals to said television set.

14. The system of any one of claims 11 to 13, wherein said control signals are configured to cause said television set to select the audio and/or visual input by which said primary messaging device delivers said at least one message to said television set.

15. The system of any preceding claim wherein the primary messaging device is configured to monitor operation of a remote control device and to cause one or more messages to be delivered via the television set in response to determining that the remote control device is being operated and/or in response to determining that the remote control device is moving.

16. The system of any preceding claim wherein said primary messaging device and said television set are not integrated with one another, being connected with each other by one or more wired and/or wireless communications link.

17. The system of any preceding claim wherein said primary messaging device and said television set are integrated with one another.