GB2390733A

GB2390733A - Navigation and communication aid for the blind

Info

Publication number: GB2390733A
Application number: GB0215762A
Authority: GB
Inventors: Baback Asady
Original assignee: Individual
Current assignee: Individual
Priority date: 2002-07-08
Filing date: 2002-07-08
Publication date: 2004-01-14
Anticipated expiration: 2022-07-08
Also published as: GB2390733B; GB0215762D0

Abstract

A navigation and communication aid for use by blind people comprises a processor unit 1 for controlling external devices, evaluating distances to nearby objects and obstacles, where the information from the range finder 2 communicates the information to the processor and or computer and user. An air pressure unit 3, which may be a fan produces an air flow at various pressures controlled by the processor unit through a series of electromechanical valves 4 to a set of tubes 5 to a user interface 7. A set of pressure sensors 6 within the connecting tubes provide feedback to the processor unit and the user interface in which a number of holes allow air at various intensities, duration and frequency convey information to the user. The processor allows the input and output of data to and from the user to be via a keyboard, audible and or visual commands.

Description

Navigation and Communication Aid for the Blind This invention relates to a

device that can be used by the blind to navigate and exchange data with electronic devices such as computers.

The blind use aids, such as walking sticks or guide dogs, to navigate. They also use Braille textbooks and newspapers to obtain information. There are also special computer keyboards and speech synthesizer software to enable them to exchange data with computers. The relatively high cost and the preparation time for such aids, for example training the guide dogs or producing the Braille text or adapting the computer software results in limited uses and users.

With the ever-increasing role of computers in todays society and the advent of the internet. the blind are generally unable to take advantage of the wealth of information and services that may be readily available to them. The lack of an adaptable, flexible and user-friendly device that enables the effective use of computers by the blind. not only deprives them of these technological advances but also undermines their job prospects.

The proposed device aims to address these problems.

The proposed device may provide the following aides to the user (i.e. a blind person): À Inform the user of the approximate or absolute direction and proximity of any object or obstacle.

À Retrieve data from the computer (i.e. a web page or any other data without the need for special software).

Convey data from the user to the computer.

À Convey a relative profile of an object to user À Convey the outline of a picture or character to the user.

According to the present invention, there is provided an aid comprising an electronic processor unit, providing means for calculating, storing data and program, connecting to and controlling external devices, communicating data with an external computer, speech and manual commands input and visual and audio output, a range finder for enabling evaluation of distances from objects or obstacles to the aid. an interface unit for communicating data to and from the user, a transducer providing air pressure which is controlled by the processor unit, a set of valves and tubes for transmission of air pressure selectively to the interface unit, a set of air pressure sensors within the air tubes to provide feedback to the processor and means for connecting the processor to an external computer for purpose of data communication.

The proposed aid will now be described with reference to the accompanying drawing in which: Figure I shows the overall aid with different parts; Figure 2 shows the user interface unit with compass directions.

The device is best described by first describing the individual parts and then explaining the overall operation of the device to achieve the previously mentioned functions.

Processor unit 1 through either the keyboard or speech provides means for selecting between different functions, which are carried out by the appropriate software and the relevant parts. Processor unit 1 receives data from range finder 2 and translates them into distances of objects and obstacles from the range finder 2. The Processor unit 1 also regulates the air pressure produced by the air unit 3 and allows selectively the airflow through the connecting tubes 5 and the user interface 7. It also has a set of buttons 14 and a microphone 13 for inputting manual or speech commands and can also output information to the user either visually through the display unit 12 or audio through the speaker 11. Processor unit 1 is also responsible for data communication between the device and computer through port 8.

Range finder 2 contains a transducer, which emits pulses of energy that travel out to the nearby objects and obstacles and bounce back and detected by another transducer (not shown) in the range finder 2, which translates these into electrical pulses and convey them to the Processor unit 1. The transmitted energy and hence the emitting and detecting transducers can be of two different types, ultrasound or electromagnetic radiation. which can in turn be either radio frequency, infrared or laser.

The emission of pulses of energy is controlled by Processor unit l.The reflected energy is also detected by the Processor unit 1. By knowing the speed of travel of the energy waves and the time interval between the emission and detection of the energy pulses, the distance between the range finder and the object or obstacle responsible for the reflection can be evaluated.

Range Finder 2 can either be directed by the user or alternatively be mounted on a stepper motor (not shown), whereby a 360 degrees topography. at certain angle intervals, of the surroundings can be obtained.

Air unit 3 produces air at high pressure and blows it against the air valves 4. The air pressure can produced by different mechanisms such as an air pump or a high speed fan or any other air pressure producing transducer such as a piezoelectric device. In Fig 1, the air unit 3 is shown to comprise of fan 9 and the air vent 10. This is merely- done to show the principle of the operation of the unit, the air pressure, as already mentioned, can be produced by an air pump or another air pressure producing device.

The air pressure produced by the unit is transferred to the user interface 7 via valves 4 and the connecting tubes 5. The operation of the air unit 3 and hence the air pressure produced is controlled by the processor unit 1. Air pressure sensors 6 placed in the path of the air flow provide feedback to the processor.

Air valves 4 are each connected at one end to the air unit 3 and at the other end to the air carrying tubes 5, which are in turn connected to the corresponding holes 16 on the user interface 7. The valves are electromechanical devices such as relays or stepper motors, which can be fully or partially opened or closed under the command of the Processor unit 1' hence allowing selective flow of air to the user interface 7 via the connecting tubes 5.

For clarity, in Fig I only two connecting tubes 5 are shown connecting two valves 4 to the corresponding two holes on the user interface 7.

User interface 7 can be a circular disk as in this example or any other desired shape with a number of holes 16 (8 holes in this example). The air carrying tubes 5 each connect to a

hole on one end of the user interface and the resulting jets of air are transmitted out through the other end of the interface. The air pressure produced by the air unit 3 is selectively channelled through the valves 4, under the control of the processor. to the desired tubers 5 and the resulting jets of air are transmitted out through the relevant holes on the interface to the outside.

Now if the user places a hand or part of limb or body close to the interface. without blocking the holes, the exiting air pressure can be sensed on the skin. The relative distances between the holes on the user interface 7 can be adjusted in such a waY that the airflow from a specific hole could be distinguishable by the user.

Connection 8 is a mean of connecting the Processor unit 1 to an external computer for the purpose of data communication between the computer and the device. This can be in the shape of either a parallel or serial port or a universal port (i.e. a USl3 port).

The air unit 3, valves 4 and air pressure sensors 6 and the range finder 2 are connected by connecting wires 17 to processor unit 1 via the connection port 15. The air units and valves 4, connecting tubes 5, user interface 7, range finder 2 and the processor unit 1 can be encased either as one unit or individual units or a combination of individual and combined units.

The operation of the device for providing the functions mentioned previously, are no described in detail.

Navigation In navigation mode, the transmitter in the range finder 2 sends out pulses of energy under the control of the processor unit 1 and then the reflected pulses are detected by the transducer, which in turn signals the processor unit 1. The processor unit 1 then evaluates the distance between the range finder 2 and the object or obstacle responsible for the reflected energy. The relative distances of the objects can then be conveyed to the user as air pressures of different intensity through a designated hole on the user interface 7 (i.e. high pressure for very close objects, medium pressure for not very close objects and low pressure for distant objects).

The closeness of objects can also be conveyed to the user through the user interface 7 as pulses of air, frequencies of which vary according to the closeness of the object (i.e. air pulses of high frequency for close objects, medium frequency for not so close objects and low frequencies for distant objects).

The distance between the range finder 2 and the object can also be conveyed to the user as an exact value by representing it in a binary format (1 or 0: presence or absence of air) through the appropriate holes in the user interface the same way as number presentation in computer systems (to be explained later in the text).

In the case of range finder 2 being mounted on a stepper motor (not shown) and moved automatically in a circular fashion to give an all round information of close objects the motor is moved in steps under the control of the processor and the distance between the range finder 2 and the object or obstacle is evaluated by the processor unit 1 and the information is convey-cd to the user through the user interface 7 as already explained but the direction of object can also be conveyed by directing the air pressure through certain holes designated to represent direction.

For example on the user interface 7 the holes I to 8 (as shown in Roman numerals in Fig 2) can be designated to represent the 8 different compass directions _North, North East, East, South East, South, South West, West, North West_ (Abbreviated N. NE, E, SE, S. SW, W. NW respectively in Fig 2) . One possible use of this motorised technique is that if the user is stationary and wishes to be warned of any approaching bodies.

Retrieve data from the computer The characters in a computer system are represented by a number of "bytes" (as in ASCII code), which are made up of 8 bits of information, each of which can have two states (i.e. O or 1, On or Off). In this case the two binary states can be represented by presence or absence of air flowing through a hole on the user interface 7. Each hole on the user interface 7 can be designated to represent a certain data "bit" of a data 'byte". For example holes I to 8 can represent bits 0 to 7 of a byte of data.

Bit7 Bit6 Bits Bit4 Bit3 Bit2 Bit I Bit O Hole VIII Hole VII Hole VI Hole V Hole IV HoleIII HolelI HoleI With the holes on the face of user interface 7 (as shown in Fig 2) 1 2X characters can represented which coffers the range of ASCII characters.

To retrieve data from the computer, the processor unit I is connected to the computer via connection 8, which can either act as a parallel or serial port. The processor unit 1 then communicates with the computer as if it was a printer. Once the initialization process is complete, the computer "sees" the device as a printer. Provided the desired software application is loaded on the computer, the user may retrieve information on bv pressing the appropriate keys on the computer keyboard to print out the data.

The Processor unit 1 then retrieves the data from the computer and stores it in its memory. Once the desired information has been downloaded, the Processor unit 1 can then signal to the user that it is ready for conveying the data to the user through the user interface 7. The user can then start the process and set the rate of information flow.

Processor unit I then represents the data, one byte at a time, by directing the airflow through certain hole/e on the user interface 7 while preventing airflow through other hole/e, in accordance with the binary information necessary to represent the desired "byte" of data.

For example with reference to Fig 2, if Processor unit 1 is conveying the data "byte" 11101110, then air would be flowing from holes VIII, VII, \71, IV, III, 11 while no air would be flowing out of holes V and 1.

The information can also be conveyed to the user as "bit', by "bit ' or a combination of debits '. The user can hence receive the information on the computer. As mentioned before the rate of information flow by Processor unit 1 can be set by the user but in case if the user misses something The can go over it again by instructing the processor. through function keys, to re-represent the same data.

In case of web pages provided the internet software is active on the computer, the user can type in the address of the desired page either through the computer keyboard or the aid (as shall be explained shortly) and once the desired page is loaded. the user can then press the print button and the contents of the page are downloaded into the device and can then be read out as explained above.

Conveving data from the user to the computer User Interface 7 can also act a keyboard for inputting data or instructions from the user to the computer. The desired information can be conveyed by the user to the computer as a number of characters or binary "bytes" (i.e. ASCII code).

The user can instruct the Processor unit 1 to set the interface 7 as an input device by pressing the appropriate command button/s. The processor unit I then communicates with the computer as if it was a keyboard. Once the initialization process is complete. the computer 'sees" the device as a keyboard.

Processor unit 1 then opens all the valves 4 and sets the air pressure in the connecting tubes 5 to a certain level. The air pressure in connecting tubes 5, is monitored by the processor unit via the air pressure sensors 6. If one or more of the holes on the user interface 7 are then covered by the user, the air pressure in the corresponding tube/e increases and this change of air pressure is conveyed by the air pressure sensors to the Processor unit 1. The processor can hence evaluate which hotels are being covered. The combination of holes covered can be interpreted as the binary information to represent the inputted "byte" or character. In this mode each hole or a combination of holes on the user interface 7 can also be used as command keys to the device or the computer.

Conveyins, a relative profile of an object to the user The profile of an object can be conveyed to the user by first moving the range finder linearly over the profile of the desired object placed on a plane, which can act as the plane of reference and then measuring the distances between the range finder and the object at certain inten als depending on the level of detail required.

For example the object can be placed upon a flat table and then the range finder 2 can then be passed linearly over the table and the object and the distances at certain point intervals can be measured by the processor as explained above. These distances can then be conveyed individually to the user through the user interface 7 in a manner already explained. The user can then deduce the profile of the object by comparing the distances and their relative differences.

Conveying the outline of a picture or character to the user The outline of a picture or character can be conveyed to the user by first scanning the I document or the picture onto the computer using a scanner or a camera. The scanned information is then transferred to the processor unit I through communication port 8. The; Processor unit I then uses software to isolate the characters or pictures and obtain their profiles. The profile of each character can then be divided into a number of lines of different length and direction. For example character "A" can be divided into three lines /t7 ,.. and.\1' The direction of the lines can be categorised into the eight directions of the compass already mentioned above (namely N. S. W. E, NW, NE, SW, SE). The length and the direction of the lines making up the character or picture can then be conveyed to the user by the Processor unit I through the user interface 7. Considering the X hole interlace of Fig 2, each hole can correspond to one of the compass directions. for example hole II in Fig 2 can represent the direction "North East" or line "/''. The direction of the lines can also be represented by- a combination of holes. i

For example the combination of holes III and VII can represent the line "_" or holes IV and VIII can represent the diagonal line '\".; The relative intensity or the relative time period of the airflow through a specific hole or holes can represent the length of a line whereas the location of the hole/e can convey the direction. For example an air pressure of relatively high intensity through hole II in Fig 2, can represent a rather long diagonal in the "North East" direction (i.e. "/"). The length of the line can also be represented by varying the length of time of airflow through a specific hole. The selection of the holes and the intensity or the period of the airrlov, through them is done by the Processor unit 1.

This method may be useful in enabling the blind to read hand written characters.

Claims

1 A communication and navigation aid comprising an electronic processor, providing means for calculating, storing data and program, connecting to and controlling external devices, communicating data with an external computer, speech and manual commands input and visual and audio output, a range finder for enabling evaluation of distances from objects or obstacles from the aid, an interface unit for communicating data to and from the user, a transducer providing air pressure which is controlled by the processor unit, a set of valves and tubes for transmission of air pressure selectively to the interface unit, a set of air pressure sensors within the air tubes to provide feedback to the processor and means for connecting the processor to an external computer for purpose of data communication.

2 A communication and navigation aid as clair^!led in claim 1, wherein the processor unit comprises an integrated circuit that contains all the functions of a central processing unit of a computer, storage of data and program and output and input to and from external devices, a connection port for data communication with an external computer. a keyboard, a microphone, a speaker and visual display unit.

3 A communication and navigation aid as claimed in claim 1, wherein the processor unit comprises integrated circuits that collectively contain all the functions of a central processing unit of a computer, storage of data and program and output and input to and from external devices, a connection port for data communication with an external computer, a keyboard. a microphone, a speaker and a visual display unit.

4 A communication and navigation aid as claimed in claim 1, wherein the user interface unit is a panel with a number of holes for, providing means for transmission of air Row from the connecting tubes to the user.

5 A communication and navigation aid as claimed in claim I or claim 4, wherein the user interface unit is a panel, in which the holes are relatively spaced in a manner such that the airflow out of each hole to be distinguishable by the user.

6 A communication and navigation aid as claimed in claim I or claim 4 or claim 5-

wherein the interface unit is a circular disk with 8 holes arranged and marked as points of; compass directions, namely North, South, East, West, North West, North East. South West and South East.

7 A communication and navigation aid as claimed in claim 1, wherein the air valves are electromechanically closed or opened fully or partially. under the control of the processor, to allow airflow through the connecting tubes and the user interface.

8 A communication and navigation aid as claimed in claim 1, wherein the air pressure is produced by an air pump controlled by the processor.

9 A communication and navigation aid as claimed in claim 1, wherein the air pressure is i produced by a piezoelectric device controlled by the processor.

10 A communication and navigation aid as claimed in claim I, wherein the air pressure is produced by a fan controlled by the processor.

11 A communication and navigation aid as claimed in claim 1, wherein the airtlou through the valves are transmitted to the user interface unit with the aid of flexible connecting tubes.

12 A communication and navigation aid as claimed in claim 1, wherein the airflow through the valves are transmitted to the user interface unit with the aid of rigid connecting tubes.

13 A communication and navigation aid as claimed in claim 1, wherein the range finder uses transmission and detection of waves of energy for detecting objects and obstacles.

14 A communication and navigation aid as claimed in claim 1 or claim 13, wherein the range finder uses ultrasound energy for detecting objects and obstacles. I

15 A communication and navigation aid as claimed in claim 1 or claim 13, wherein the range finder uses electromagnetic radiation for detecting objects and obstacles.

16 A communication and navigation aid as claimed in claim I or claim 13 or claim 15.

wherein the range finder uses infrared energy for detecting objects and obstacles.

17 A communication and navigation aid as claimed in claim I or claim 13 or claim 15.

wherein the range finder uses laser energy for detecting objects and obstacles.

18 A communication and navigation aid as claimed in claim I or claim 13 or claim 15, wherein the range finder uses radio waves for detecting objects and obstacles.

19 A communication and navigation aid as claimed in claim 1 or claim 13 or claim 14 or claim 15 or claim 16 or claim 17 or claim 18, wherein the range finder is moved by means of a motor.

20 A communication and navigation aid as claimed in claim 1, wherein the air pressure unit and valves, connecting tubes, user interface, range finder and the processor unit are all encased as one unit

21 A communication and navigation aid as claimed in claim 1, wherein the air pressure unit and valves, connecting tubes, user interface, range finder and the processor unit are encased as individual units.

22 A communication and navigation aid as claimed in claim 1, wherein the air pressure unit and valves, connecting tubes, user interface, range finder and the processor unit are encased as a combination of individual and combined units.

23 A communication and navigation aid as described substantially herein with reference to Figures 1-2 of the accompanying drawing.