WO2020012180A2

WO2020012180A2 - Human interface device

Info

Publication number: WO2020012180A2
Application number: PCT/GB2019/051944
Authority: WO
Inventors: Stephen Pearson
Original assignee: Stephen Pearson
Priority date: 2018-07-13
Filing date: 2019-07-11
Publication date: 2020-01-16
Also published as: WO2020012180A3; GB201811515D0; GB2575506A; GB201819897D0

Abstract

A human interface device (10) comprising a sender (12) operatively connected to a receiver (14), the sender (12) comprising a short-range wireless receiver (16) and the receiver (16) comprising a processor and an output device (24), wherein the processor is adapted, upon detection of a signal (26) by the short-range wireless receiver (16), to output a signal (30) via the output device (24), the output signal (30) being a speech-audio signal. In addition, the human interface device (10) may further comprise a camera (55), which captures a forward-facing image (400), the image being notionally divided into columns and rows, and the processor being adapted to perform image analysis to recognise objects (402, 404) in the image (400) and to output synthesized plain-language warning to the user upon detection and recognition of objects (402, 404) in the image (400).

Description

HUMAN INTERFACE DEVICE

This invention relates to a human user interface device, and in particular, to a human user interface device that can be incorporated into a cane suitable for use by the visually impaired.

Visually impaired people often use a cane to help them to locate objects in their path when walking. A cane typically comprises a lightweight, slender rod with a handle at one end, and a tip at the other. The tip can take various forms, but sometimes comprises a low-friction (e.g. PTFE) end cap, or a ball, which facilitates sliding it over a floor surface. In use, the person holds the cane out in front of themselves and uses the tip to feel the floor ahead for objects, steps and drop-offs. In the UK, the rod of the cane is typically coloured white or red/white (to signify blind, or deaf-blind, respectively), although the colour specifications/schemes can vary from country to country, and this helps to indicate to other people that the person using the cane has, or may have, special needs and/or require assistance from time to time.

Whilst canes of the type described have their uses, people using them nevertheless often require third-party assistance, for example, when crossing busy roads, or finding their way around in unfamiliar environments. It is an object of the present invention to improve the functionality and/or usefulness of a cane, and thereby help to promote greater independence and confidence.

Aspects of the invention are set forth in the appended independent claims. Preferred and/or optional features of the invention are set forth in the appended dependent claims.

According the invention, there is provided a human interface device comprising a sender operatively connected to a receiver, the sender comprising a short-range wireless receiver and the receiver comprising a processor and an output device, wherein the processor is adapted, upon detection of a signal by the short-range wireless receiver, to output a signal via the output device, the output signal being a speech-audio signal.

Suitably, the short-range wireless receiver comprises an RFID reader. The RFID reader is suitably configured to output an electrical field, which powers-up a passive RFID tag, and which receives a signal from the RFID tag, the received signal from the RFID tag being the said detected signal of the short-range wireless receiver.

The received signal from the RFID tag suitably comprises a code, and the processor is adapted to parse the code to determine a meaning therefrom. The human interface device suitably comprises a memory containing a database of RFID tag code-meaning pairs, and so the processor is able, upon receipt of a code, to determine the meaning of that code.

The output device suitably comprises an audio output device. The audio output device may comprise a headphone jack-type connector, or a wireless headphone connection (e.g. Bluetooth^®), which connects, in use, to an earpiece and/or headphone worn by a user of the device, or to a speaker of the device.

The processor suitably comprises a text-to-speech synthesiser, which outputs, via the audio output device, an audio signal, which contains speech that a user of the device can understand in plain language. The audio signal, in plain speech, suitably corresponds to the meaning, which corresponds to the received code signal from the RFID tag.

As previously mentioned, the human interface device suitably comprises a memory containing a database of RFID tag code-meaning pairs, and so the processor is able, upon receipt of a code, to determine the meaning of that code. Flowever, in certain embodiments of the invention, the memory also contains a set of sound files (e.g. .wav or .mp3 files), which are effectively, pre-recorded speech snippets (in any one or more desired languages) that correspond to the said meanings, which can be played-back, for example, by an audio playback module of the processor, via the audio output device.

It will be appreciated that the "database" of codes, meanings and/or sound files can be updated or edited at will. This enables the list of code-meaning pairs to be expanded, adjusted, updated or pared-down.

In one embodiment of the invention, the sender is incorporated into an insert that can be affixed to, or worn inside, a shoe of a user. In another embodiment of the invention, the sender is incorporated into the distal (tip) end of a cane. The receiver can be a wearable device, or it can be incorporated into the proximal (handle) end of a cane. An elongate main body suitably interconnects the sender and receiver when the human interface device is formed as a cane.

Suitably, the elongate main body is manufactured from a lightweight material, such as aluminium tubing or a glass or carbon fibre composite material. This reduces the overall weight of the cane, making it easier to hold and/or manipulate, in use. Preferably, the main body is foldable and/or telescopic, that is to say, being formed in sections that telescope, or which can be fitted together end- to-end. This enables the main body to be shortened for ease of transport, storage, etc., when not in use.

Where the main body is telescopic or formed from several fit-together pieces, its cross-section is preferably rotationally asymmetric, so as to ensure a particular, consistent alignment or rotational relationship between the handle and the tip. For example, the main body may have an oval cross- section, which ensures that when the main body is assembled/extended, the tip is correctly aligned relative to the handle.

The handle is preferably ergonomically shaped such that when gripped comfortably by a user, the tip faces in a consistent direction, for example facing forward of the user.

The sender (or tip of the cane) preferably comprises means for maintaining it at a certain position and/or orientation relative to a floor surface, which, for reasons that shall become apparent from the following description, ensures that the distance and orientation of the short-range wireless receiver relative to a floor surface is maintained, or substantially maintained, in use. For example, the tip may comprise several "ball transfer units", that is to say captive balls, that roll along the floor surface, in use. The use of, for example, three ball transfer units may usefully ensure that the orientation of the tip relative to the floor surface is consistent (e.g. parallel thereto) when the ball transfer units are all in contact with the floor; and/or that the spacing between the floor surface and the short-range wireless receiver incorporated into the tip is consistent.

The receiver (or the handle of the cane, when so incorporated) suitably comprises a user interface, via which a user of the cane can provide control inputs to the processor. In one embodiment, the user interface comprises a button, which can be short-pressed, repeatedly-pressed or held-on by the user to interact with the processor. In certain embodiments, more than one button may be provided, and/or a "cursor" and/or "track ball" type device may be provided.

The device is suitably powered by a power supply, which suitably comprises a rechargeable battery. This can be built into a housing of the receiver and/or the handle of the cane. By locating the (rechargeable) battery within the handle of a cane, the centre of gravity of the cane can be moved closer towards the pivot point of the cane, and/or it can be used to counterbalance, to a certain extent, the mass of the cane extending forwards from the user's hand, in use.

A charging device is suitably provided for recharging the rechargeable battery. This suitably comprises a charging circuit having a power input and a power output connected to the terminals of the rechargeable battery. The power input could be power jack or USB port into which a user can plug a USB power cable or mains charging plug. Additionally or alternatively, the power input may comprise an induction coil, such that the rechargeable battery can be recharged wirelessly, for example, by placing it in an induction-charging cradle or on a wireless charging pad.

The charging circuit, where provided, suitably has an interface with the processor and/or output device, such that it can emit a signal indicating, for example, "low battery charge", "battery fully charged", "battery charging", etc. signals. The battery status signal is suitably a plain speech message, which is outputted to a speaker or ear piece of the apparatus.

The short-range wireless receiver suitably comprises an RFID reader, which is preferably adapted to power-up and receive signals from, passive RFID tags. The advantage of this configuration is that the RFID tag(s) do not need their own power source(s).

The processor is suitably configured to parse signals received by the short-range wireless receiver and to provide human-understandable signals to the output device. Preferably, the output device comprises an audio output device, which can be an earbud-type speaker, which a user of the device inserts into his/her ear, when using it. The earbud-type speaker can be connected to the device via a wire, in which case, the receiver or cane handle suitably comprises a "headphone jack' connector, but preferably, the connection between the device and the earbud-type speaker is wireless, such as via a Bluetooth^® audio connection or a T-coil circuit, which can be used with many types of hearing aid.

Additionally or alternatively, the output device comprises any one or more of a speaker; an LED; a light; a display screen; and a vibrator.

The processor is adapted, upon detection of a signal by the short-range wireless receiver, to output a signal via the output device. As previously mentioned, the device is preferably configured to output human-understandable signals to, or via, the output device. To achieve this, the processor suitably comprises, or is connected to, a memory, which contains a list of look-up phrases and corresponding codes; and a text-to-speech-type processor, which can output human-understandable speech. Thus, upon receipt of a "low battery" signal from the charging circuit, the processor can be adapted to output a synthesised or recorded voice message, via the earbud-type speaker, to the user, which says, for example, "battery charge low", thus prompting the user to recharge the battery. In alternative embodiments, the processor may be configured to cause a vibrator to vibrate (to attract the user's attention) and then optionally to display a text message on a screen reading the same, or something similar. Upon detection of an RFID tag, the processor can be adapted to receive the RFID tag's code; look-up the corresponding meaning for that code; and synthesise a speech snippet stating that meaning in user-understandable language. In other embodiments, where there is no speech synthesiser, the processor can be adapted to look-up a sound file corresponding to the code and play that back to the user, via an audio output of the device.

Preferably, the sender of the invention is used in conjunction with coded, passive RFID tags embedded into the user's environment, which are detectable by the short-range wireless receiver incorporated into it.

For example, a pedestrian crossing of a road may have coded, passive RFID tags incorporated into the paving adjacent the crossing. In the case of a cane embodiment of the invention, a user of the device approaching the crossing may pass the tip of the cane over one or more of these coded, passive RFID tags, which is/are activated by the short-range wireless receiver (RFID reader) incorporated into the tip, which then receives a code signal back from the RFID tag. The processor parses the code, and outputs a message to the earbud-type speaker, for example, "pedestrian crossing five metres ahead". The user is thus alerted to the presence of the pedestrian crossing and can take appropriate action.

By enabling the processor to parse codes, it can be configured to provide different signals to the user in different situations. Preferably, there is a set of standard code-meaning pairs, which are ubiquitous, and which can be used in a variety of public spaces. Examples of "stock" code-meaning pairs may relate to entities such as pedestrian crossings, bus stops, train stations, help/assistance points and so on. Flowever, the processor may comprise an external I/O interface, which enables custom codes to be added to its database. As such, third-party (as opposed to public service) codes could be used in conjunction with the device, which could relate to particular service providers' products/services. For example, the proprietor of a retail establishment may purchase and/or upload to a central server, bespoke code-meanings, such as "Bob's coffee entrance now on your right".

It will be appreciated that the processor uses code-meaning pairs, and so the codes can be easily reassigned, and/or the meanings updated by updating the software in the device. Likewise, as the cane uses, in certain embodiments, RFID tags, the RFID tags can be re-programmed with different codes using an RFID writer device. Further, the meanings can be reassigned via the software, so they could be configured to output verbose or terse "meanings" in any language - according to user preference.

The tip may additionally comprise further sensors, such as one or more proximity sensors. In one embodiment, there are two proximity sensors that are angled differently relative to the floor surface, and which, when used together, as shall be described hereinbelow, can be used to signal an obstruction and/or a drop-off in the vicinity of the cane's tip, which can help to avoid trip and/or collision accidents. Embodiments to the invention shall now be described, by way of example only, with reference to the accompanying drawings in which:

Figure 1 is a schematic block diagram of a device in accordance with the invention;

Figure 2 is schematic view of a first embodiment of a device in accordance with the invention;

Figure 3 is a schematic partial cross-section of a second embodiment of a device in accordance with the invention;

Figure 4 is a cross-section of Figure 1 on ll-ll;

Figure 5 is a schematic plan view of the device shown in Figure 1;

Figure 6 is a schematic view of an RFID arrangement in accordance with the invention;

Figure 7 is a schematic sequence showing the installation of RFID in accordance with the invention;

Figure 8 is a plan view of the RFID system, installed;

Figure 9 is a schematic plan view of an arrangement in accordance with the invention;

Figure 10 is a schematic view of another arrangement in accordance with the invention;

Figure 11 is a plot of sensor beam distance as a function of time;

Figure 12 is a schematic view of a first sensor measurement;

Figure 13 is a schematic view of a second sensor measurement; and

Figure 14 is a schematic view from a further sensor arrangement in accordance with the invention.

Referring to Figure 1 of the drawings, a user interface device 10 in accordance with the invention comprises a sender 12 and a receiver 14. The sender 12 has a short-range wireless receiver 16, in the form of an RFID reader. The sender 12 is operatively connected to the receiver 14 via a data cable or wireless connection 18. The receiver 14 has a processor 20, a power supply 22 and an output device 24.

The short-range wireless receiver 16 is configured to receive a signal 26 from, for example, an

RFID tag 28 in range thereof, and to transmit that signal 26, via the data connection 18, to the receiver 14. The receiver 14 receives the signal 26 and the processor 20 parses the signal 26 and outputs a speech-audio signal 30 via the output device 24.

The receiver 14 also comprises a memory device 32, which contains a database of code meaning pairs, which the processor 20 can interrogate 34, upon receipt of the signal 26 to look-up the meaning associated with a particular received signal code 26, the signal code 26, of course, being determined by the programming of the RFID tag 28.

Once the processor 20 has obtained a meaning corresponding to the received signal 26, it runs the meaning through a text-to-speech synthesiser 36 and outputs 38, via the output device 24, the speech-audio signal 30. In other embodiments, the database on the memory device 32 contains sound files corresponding to each meaning, in which case, the processor 20 uses an audio playback processor 40 to output 38, via the output device 24, the speech-audio signal 30.

The power supply 22 conveniently takes the form of a rechargeable battery, which is recharged via a charging circuit 40, which receives input power from a power jack 42, which can be connected to an external power source (not shown). The power jack 42 is suitably a micro-USB socket, into which can be plugged a ubiquitous USB power cable (not shown).

The processor 20 has an I/O interface 46, which is operatively connected to a human interface device (HID) 48. The HID 48 has any one or more of: a button, track ball, scroll wheel, display screen, touch screen, LED and/or light, via which a user (not shown) can interact with the receiver 14 to control the device 10.

The receiver 14 also has a GPS or positioning module 50, using which, the receiver is able to determine its location.

A mobile telephony / Wi-Fi module 52 is also provided, enabling the receiver 14 to communicate with the internet, loT or a PSTN using a telephone, SMS and/or mobile data connection. The mobile telephony / Wi-Fi module 52 enables the receiver 14 to obtain or transmit updates, new programming and/or data via an internet/data connection or push traffic. The sender 12 additionally comprises one or more proximity sensors 54, one or more attitude/position sensors 56 and a camera 58.

A first embodiment of the invention 10 is shown in Figure 2 of the drawings, in which the sender 12 is worn as an insole 60 in a user's shoe 62. The insole 60 has a loop antenna 64 built into it, which picks-up a signal 26 from a nearby RFID tag 28, which can be placed on a floor surface 66. When a user of the device 10 walks over the RFID tag 28, the signal 26 is received, and sent, wirelessly 18 to the receiver 14, via a wireless connection between a main body part 68 of the sender 12 and the receiver 14. The receiver 14 can be belt-worn or otherwise carried by the user (not shown).

Referring now to Figures 3, 4 and 5 of the drawings, a smart cane 10 in accordance with the invention comprises a sender unit 12 and a receiver 14 formed into the handle of the cane 10, which handle houses the processor 20, power supply 22, etc. (not visible) previously described.

The sender head 12 is connected to the handle of the cane via a telescopic rod 70, which has an oval cross-section, as can be seen in Figure 4, such that the orientation of the sender head 12 relative to the handle 14 is maintained. Other cross-sectional shapes could be used, but it is important that the relative orientation of the sender head 12 to the handle 14 is maintained for reasons that shall become apparent later.

The sender head 12 comprises a main body, which is manufactured from a plastics material, and which is arranged to roll or slide over a floor surface 66 by virtue of three "ball transfer units" 74 which, in the illustrated embodiment, comprise captive balls. A loop antenna 64 is provided, which emits a signal towards the floor surface 66, in use. The sender head 12 also comprises a forward-facing distance/proximity sensor 54 and a downwardly-inclined distance/proximity sensor 55, which is inclined at an angle Q to the horizontal downwardly ahead of the sender head 12.

The sender head 12 is pivotally connected to the shaft 70 via a pivotal connection 76 such that the orientation of the sender head 12 relative to the floor surface 66 is maintained, regardless of the angle of inclination of the rod 70. The handle 14 contains a circuit board which suitably has the features described above with reference to Figure 1 of the drawings.

The HID 48 has forefinger 78 and thumb 80 push buttons, which a user (not shown) can operate in use. The handle 14 also has a lanyard 82, a charging port 44, and audio jack 24, into which a wired earbud type device 84 can be plugged. However, the circuit within the handle 14 also comprises a wireless transceiver 24/52, which enables a wireless earbud 86 to be used in conjunction with the invention 10. As can be seen from Figure 5 of the drawings, the sensor head 12 also has forward-facing 54 and side-facing 57 proximity sensors.

The sender head 12 can interact with RFID tags 28 embedded within the floor surface 66 as it passes thereover.

As previously described, each RFID tag 28 is programmed with a code, for example, a 4-digit code, which the database 32 can be programmed to associate with a corresponding meaning. As the sender head 12 passes over the RFID tag 28, the RFID reader 16 picks-up the signal 26, which the processor 20 parses into a meaning, and outputs a pre-recorded or synthesised audio signal 30, which is monitored/outputted by the earbud 84/86 worn by the user (not shown).

Referring now to Figures 6, 7 and 8 of the drawings, the RFID tags 28 can be secured to a floor surface 66 using a modular tactile indicator system 90. The modular tactile indicator system 90 is formed by a set of generally L-shaped components 92, each having a hub part 94 and a pair of orthogonal limbs 96. The distal ends of each limb 96 has a ball-shaped end 98, which fits into a correspondingly-shaped recess 100 in the flat underside of a hub 94. The other side of each hub 94 is domed/rounded.

By fitting the generally L-shaped components 92 together, as shown in Figure 6, it is possible to form a grid structure, with the hubs providing raised, domed tactile indicators, which can be felt by users walking over them. The limbs 96 equally space and align the hubs 94 in a square-grid arrangement, as shown in Figure 6. A flat RFID card 104, which has a generally concave-rounded-cruciform shape, is shaped and dimensioned to fit 106 neatly into a space between four of the limbs 96. It has an RFID tag 28 embedded within it, as shown. In the lower part of Figure 8 it can be seen that the RFID card 104 is formed as an elongate unit, which occupies two spaces in the grid 90. The advantage of this configuration is that the loop antenna 29 for the RFID tag 28 can be increased in size, thereby increasing the range of the signal 26 from the RFID tag.

The modular tactile indicator system 90 can be installed by the process shown in Figure 7 of the drawings, whereby a grid is formed, as shown in Figure 6, before being placed on the floor surface 66. The RFID card 104 can be dropped into position, and a layer of resin 106 poured over the arrangement. When the resin 106 has set, the RFID card 104 is embedded within the grid 90/resin layer 106, and can emit its signal 26, when activated by a passing sender unit 12.

Possible arrangements of the invention are shown in Figures 9 and 10 of the drawings. In Figure 9, the invention is used at a road crossing 200, which as opposite walkways 202, a marked pedestrian crossing 206 and a traffic island 208. A set of modular tactile indicator systems 90 are provided on either walkway 202 and on the traffic island 208. Each modular tactile indicator system 90 is fitted with a set of RFID cards 104, indicated in Figure 9 by small circles. The RFID cards 104 are arranged in staggered rows in each of the modular tactile indicator systems 90, and this increases the likelihood of an RFID tag 28 being detected by a passing sender unit 12.

The RFID tags labelled 282 are programmed with a code corresponding to "pedestrian crossing coming up on the left". The RFID tags labelled 284 are programmed with a code corresponding to "pedestrian crossing coming up on the right". The RFID tags labelled 286 are programmed with a code corresponding to "pedestrian crossing left". The RFID tags labelled 288 are programmed with a code corresponding to "pedestrian crossing right". The RFID tags labelled 290 are programmed with a code corresponding to "kerb, stop". The RFID tags labelled 292 are programmed with a code corresponding to "island, halt". A walking path is denoted by the arrows in Figure 6. A user, using a smart can in accordance with the invention would experience the following: When approaching the crossing 200 on the upper walkway, the sender 12 would first encounter an RFID tag 284, and the signal 26 therefrom would be parsed as "pedestrian crossing coming up on the right". This would be outputted to the user's earbud 84/86 in plain speech, and the user would be alerted to the presence of the crossing. As the user approaches the crossing point, the sender unit 12 picks-up as signal from the next set of RFID tags 288, whereupon a plain speech message is heard in the earbud 84/86 "pedestrian crossing right".

If the user decides to proceed (not cross), then the next RFID tags 286 (which would signal "pedestrian crossing left") are automatically ignored by the processor, which is configured to recognise deliberate actions by the user.

If, however, the user turns to cross the crossing 200, the next set of RFID tags that the sender unit 14 encounters are those 290 programmed with "kerb, stop" prompting the user to listen out for traffic, or await a safe-to-cross signal. Proceeding to cross the road, the user next encounters the "kerb, stop" RFID tags as the leading edge of the traffic island 208, but these are ignored by the processor. Next, the user encounters the "island, halt" RFID tags 292, which prompts the user to stop and listen out for traffic again. A further "kerb, stop" set of RFID tags 290 helps the user to know where to stop.

Upon approaching the opposite kerb, the user will encounter further RFID tags, and these will either output plain-speech audio messages via the earbud 84/86, or not, according to the processor's programming.

A further arrangement is shown in Figure 10 of the drawings, but this time, the RFID cards 104 have been used in a supermarket setting to indicate products and to aid navigation. There are floor- mounted RFID cards 1042, and shelf-mounted RFID cards 1044, which the user can probe using the smart cane in an extended (walking cane) configuration, or in a retracts/shortened (wand) configuration, respectively. In this case, the RFID codes of the RFID cards 1042, 1044 are programmed by the shop owner, and are uploaded to a web server, which the processor can download in advance, or in real-time using its Wi-Fi or internet connection. Now, the floor-mounted RFID cards 1042 are used to aid the navigation of the user, by, in the illustrated example, calling-out product categories e.g. "cereals" 10422 or "baking products" 10424 at the ends of the aisles, or sub-categories, e.g. "cornflakes" 10426, "rice crispies" 10428, "oats" 10430. The shelf-mounted RFID cards 1044 can be used to identify promotions, prices, or individual products. As such, a user can scan the floor for RFID tags that aid with navigation, and the shelves for detailed product information.

As previously mentioned, the sender head 14 has a forward-facing proximity sensor 54 and a downwardly-inclined proximity sensor 55. These sensors measure the distance to objects in front of them. By monitoring these distances, it is possible to identify obstructions in the path of the sender head 12, or drop-offs, as shown in Figures 11, 12 and 13.

Figure 11 is a graph of measured distance d versus time t for the forward-facing proximity sensor 54 and the downwardly-inclined proximity sensor 55, indicated by chain-link, ands solid lines, respectively. In Figure 12, the sender head 12 is approaching an obstruction, and the measured distance 302 reduces as the obstruction nears. The processor 20 can be configured to output a plain speech warning message (e.g. "obstruction ahead") to warn the user. Similarly, as shown in Figure 13, as the sender head 12 approaches a drop-off 306, and the measured distance 302 increases suddenly as the sensor beam passes over the edge of the drop-off 306. The processor 20 can be configured to output a plain speech warning message (e.g. "drop ahead") to warn the user.

Finally, Figure 12 is a schematic view of an image 400 captured by a camera 58 fitted to the sender head 12, which captures a forward-facing image. The image 400 is notionally divided into five columns, and three rows, and the processor 20 is adapted to perform image analysis for objects in the image. In the example shown, there is a waste bin 402 and a person 404 in front of the user. The processor 20 has object-recognition capability, and is programmed to recognise commonplace obstructions, such as vehicles, people and street furniture. Due to the fact that the image 400 is segmented into rows and columns, the processor is able to create and output synthesised, plain- language warnings to the user via the earbud 84/86, such as (in the illustrated example) "person straight ahead", or "waste bin ahead left". This functionality can be useful to warn a poor-sighted user about transient, or unmarked (i.e. without RFID tags fitted) obstructions ahead of the user. Similarly, the side-facing proximity sensors 57 can be used to warn the user of obstructions to the left or right of the direction of travel, and/or to signal when an obstruction has been passed.

Further functions of the invention are also possible, such as by using the attitude/position sensors 56 to detect when the cane has been dropped, in which case, an alert, for example, "cane dropped" can be sent to the user's earbud. In addition, location of a dropped/misplaced cane may be possible by using the built-in GPS or positioning module 50. In certain embodiments, where the device is fitted with a mobile telephony / Wi-Fi module 52, the user may be able to connect to the cane using a smartphone or other device, to "call" the mobile telephony / Wi-Fi module 52, for example, on a dedicated mobile phone number for the cane, and upon receipt of a "call" or message on that dedicated mobile phone number, the cane can be configured to vibrate or emit an audible signal to assist the user in relocating the cane. In certain embodiments, upon receipt of a call or message, the device can be configured to telephone or SMS message an "SOS centre", which can be an emergency services provider and/or a nominated person/assistant.

To conserve power, the battery 22 or charging circuit 42 may be configured to put the device 10 into a "sleep" or power-saving mode when it is not in use. Flowever, by using the attitude/position sensors 56, for example, an accelerometer, compass or gyroscope sensor, picking the device 10 up might trigger a power-up sequence, which restores the device to an active state. Reverting to sleep mode may occur after a predetermined period of non-use, detected by minimal or no activity detected by the attitude/position sensors 56.

The use of the attitude/position sensors 56 and/or a GPS receiver 50 can be used to output satellite navigation commands to the user - in the same way that vehicle GPS system output driving commands to users of GPS-enabled vehicles. In this case, the direction commands are outputted via the earbud 84/86, as opposed to the vehicle's speakers. The following statements are not the claims, but relate to various possible features of embodiments of the invention:

Statement 1. A human interface device comprising a sender operatively connected to a receiver, the sender comprising a short-range wireless receiver and the receiver comprising a processor and an output device, wherein the processor is adapted, upon detection of a signal by the short-range wireless receiver, to output a signal via the output device, the output signal being a speech-audio signal; the human interface device further comprising a camera, which captures a forward-facing image, the image being notionally divided into columns and rows, and the processor being adapted to perform image analysis to recognise objects in the image, the processor being further adapted to output synthesized plain-language warning to the user upon detection and recognition of objects in the camera's field, the synthesized plain-language warning comprising identifying information, which identifies the object, and relative position data based on apparent position of the object in the image based on its column/row in the image.

Statement 2. The human interface device of statement 1, wherein the short-range wireless receiver comprises an RFID reader, which is configured to output an electrical field for powering-up a passive RFID tag, and which receives a signal from the powered-up RFID tag, the received signal from the RFID tag being the said detected signal of the short-range wireless receiver.

Statement 3. The human interface device of statement 1 or statement 2, wherein the detected signal comprises a code, and wherein the processor is adapted to parse the code to determine a meaning therefrom.

Statement 4. The human interface device of statement 3, comprising a memory containing a database of code-meaning pairs, such that upon receipt of a code, the processor is able to look-up a meaning corresponding to that code.

Statement 5. The human interface device of statement 4, wherein the processor comprises a text-to-speech synthesiser, which outputs, via the audio output device, an audio signal comprising plan-language speech, the plain speech audio signal being the meaning, which corresponds to the received code signal.

Statement 6. The human interface device of statement 4, wherein the memory contains a plain-language sound file corresponding to each meaning, and wherein the processor is adapted to playback an appropriate sound file, via the audio output device, upon receipt of a corresponding code signal.

Statement 7. The human interface device of any preceding statement, wherein the output device comprises an audio output device, which connects to a headphone or earbud worn, in use, by a user of the device, or to a speaker of the device.

Statement 8. The human interface device of any preceding statement, comprising an interface via which the database of code-meaning pairs can be updated and/or edited.

Statement 9. The human interface device of any preceding statement, wherein the sender is formed at the distal end of a cane, and wherein the receiver is formed within the handle of the cane, and further comprising an elongate main body connecting the sender to the receiver.

Statement 10. The human interface device of statement 9, wherein the main body is foldable and/or telescopic.

Statement 11. The human interface device of statement 9 or statement 10, wherein the sender comprises means for maintaining it at a certain position and/or orientation relative to a floor surface.

Statement 12. The human interface device of any preceding statement, comprising a rechargeable battery and a charging circuit for recharging the rechargeable battery, wherein the charging circuit comprises an interface with the processor and/or output device, such that the human interface device can emit plain-language signals to a user of the device regarding the battery charge status.

Statement 13. The human interface device of any preceding statement, further comprising any one or more of the group comprising: a proximity sensor adapted to detect obstructions; a proximity sensor adapted to detect drop-offs; a camera, a GPS receiver, a gyroscope, an accelerometer, an attitude sensor, a mobile telephony module, a Wi-Fi transceiver, and an internet connection device.

Statement 14. The human interface device of statement 13, wherein the attitude sensor and/or accelerometer is used to detect when the cane has been dropped, and upon detection of such an event, the processor is adapted to output a plain-language audio alert to the user.

Statement 15. The human interface device of statement 13, which can be located by calling or messaging the mobile telephony module, and upon receipt of a call or message, the human interface device being configured to vibrate or emit an audible signal to assist a user in relocating the human interface device and/or contacting an SOS centre.

Statement 16. The human interface device of statement 13 when dependent on statement 12, wherein the charging circuit is configured to put the human interface device into a power-saving mode after a certain amount of inactivity time detected by the accelerometer, compass, gyroscope and/or attitude sensor, and upon detection of movement by the accelerometer, compass, gyroscope and/or attitude sensor, to restore the human interface device to an active mode.

Claims

1. A human interface device comprising a sender operatively connected to a receiver, the sender comprising a short-range wireless receiver and the receiver comprising a processor and an output device, wherein the processor is adapted, upon detection of a signal by the short-range wireless receiver, to output a signal via the output device, the output signal being a speech- audio signal.

2. The human interface device of claim 1, wherein the short-range wireless receiver comprises an RFID reader, which is configured to output an electrical field for powering-up a passive RFID tag, and which receives a signal from the powered-up RFID tag, the received signal from the RFID tag being the said detected signal of the short-range wireless receiver.

3. The human interface device of claim 1 or claim 2, wherein the detected signal comprises a code, and wherein the processor is adapted to parse the code to determine a meaning therefrom.

4. The human interface device of claim 3, comprising a memory containing a database of code meaning pairs, such that upon receipt of a code, the processor is able to look-up a meaning corresponding to that code.

5. The human interface device of claim 4, wherein the processor comprises a text-to-speech synthesiser, which outputs, via the audio output device, an audio signal comprising plan- language speech, the plain speech audio signal being the meaning, which corresponds to the received code signal.

6. The human interface device of claim 4, wherein the memory contains a plain-language sound file corresponding to each meaning, and wherein the processor is adapted to playback an appropriate sound file, via the audio output device, upon receipt of a corresponding code signal.

7. The human interface device of any preceding claim, wherein the output device comprises an audio output device, which connects to a headphone or earbud worn, in use, by a user of the device, or to a speaker of the device.

8. The human interface device of any preceding claim, comprising an interface via which the database of code-meaning pairs can be updated and/or edited.

9. The human interface device of any preceding claim, wherein the sender is formed at the distal end of a cane, and wherein the receiver is formed within the handle of the cane, and further comprising an elongate main body connecting the sender to the receiver.

10. The human interface device of claim 9, wherein the main body is foldable and/or telescopic.

11. The human interface device of claim 9 or claim 10, wherein the sender comprises means for maintaining it at a certain position and/or orientation relative to a floor surface.

12. The human interface device of any preceding claim, comprising a rechargeable battery and a charging circuit for recharging the rechargeable battery, wherein the charging circuit comprises an interface with the processor and/or output device, such that the human interface device can emit plain-language signals to a user of the device regarding the battery charge status.

13. The human interface device of any preceding claim, further comprising any one or more of the group comprising: a proximity sensor adapted to detect obstructions; a proximity sensor adapted to detect drop-offs; a camera, a GPS receiver, a gyroscope, an accelerometer, an attitude sensor, a mobile telephony module, a Wi-Fi transceiver, and an internet connection device.

14. The human interface device of any preceding claim, further comprising a camera, which captures a forward-facing image, the image being notionally divided into columns and rows, and the processor being adapted to perform image analysis to recognise objects in the image, the processor being further adapted to output synthesized plain-language warning to the user upon detection and recognition of objects in the camera's field, the synthesized plain- language warning comprising identifying information, which identifies the object, and relative position data bases on apparent position of the object in the image based on its column/row in the image.

15. The human interface device of claim 13 or claim 14, wherein the attitude sensor and/or accelerometer is used to detect when the cane has been dropped, and upon detection of such an event, the processor is adapted to output a plain-language audio alert to the user.

16. The human interface device of claim 13, wherein the human interface device can be located by calling or messaging the mobile telephony module, and upon receipt of a call or message, the human interface device being configured to vibrate or emit an audible signal to assist a user in relocating the human interface device and/or contacting an SOS centre.

17. The human interface device of claim 13 when dependent on claim 12, wherein the charging circuit is configured to put the human interface device into a power-saving mode after a certain amount of inactivity time detected by the accelerometer, compass, gyroscope and/or attitude sensor, and upon detection of movement by the accelerometer, compass, gyroscope and/or attitude sensor, to restore the human interface device to an active mode.

18. A system comprising the human interface device of any of claims 2 to 17, and one or more coded passive RFID tags embedded into a user's environment, which passive RFID tags are arranged so as to be detectable by the RFID reader.

19. The system of claim 18, wherein the or each coded passive RFID tag is embedded into a card, which can be affixed to a surface.

20. The system of claim 19, wherein the cards are formed into, or as part of, a tactile indicator system.