WO2011104589A1

WO2011104589A1 - Virtual walking stick for assisting blind people

Info

Publication number: WO2011104589A1
Application number: PCT/IB2010/055690
Authority: WO
Inventors: Ricardo Faria Ribeiro; David Crespo Ferreira; Luís Filipe ROSÁRIO LUCAS; Edson Rogério TAVARES DE SOUSA
Original assignee: INSTITUTO POLITéCNICO DE LEIRIA
Priority date: 2010-02-24
Filing date: 2010-12-09
Publication date: 2011-09-01
Also published as: ES2401252A2; ES2401252B1; ES2401252R1; ES2401252A8; PT104980A

Abstract

The present invention aims to provide aid in everyday life to blind people or to those with visual impairment. Such people, on a daily basis, encounter problems arising from their visual deficiency. In order to minimize the problems arising from this deficiency, the present invention aims to provide the user with a variety of helpful information, allowing the detection of obstacles (3, 5, 7), identification of colours (18), recognition of products/objects via the reading of barcodes or RFID codes (44), orientation via the system thereof for indicating places of interest in public spaces (39, 59, 60), reproduction of audio content (67), signalling the user (72) in dark environments (33) and recognition of letters, words, sentences and/or texts via a digital camera. The invention also has a time indicator (69) and a voice synthesizer (10). This is an invention that aims to integrate functionalities that hitherto had a limited use with new functionalities.

Description

DESCRIPTION

"VIRTUAL BENGALA FOR AID TO INVISUAL PEOPLE" Technical Field of the Invention

Blind or visually impaired people find their daily lives difficult due to the limitations caused by their poor eyesight. Today's societies and their infrastructures are not yet designed to make life easier for blind people. A clear example of this is the case of commercial establishments and their location of products. Another difficulty felt by the blind is related to the use of public spaces and the infrastructures in them, two examples are cited: locating a garden bench or toilet (toilets). This type of environment is an impossible orientation and location challenge for the blind person. Equally impossible is the identification of colors, without the prior indication by people with minimally able vision to identify them. In terms of mobility aids, blind people have long had at their disposal the traditional walking sticks. Technologically it is still possible to develop products for this technical area.

Description of the prior art

There are some products on the market that use obstacle detection and distance detection systems such as ultrasonic sensors. There are also watches for the blind and audio players. However there is not a single product that integrates all these features, the user being obliged to carry several devices.

In the following will be presented documents which are part of the state of the art of the present invention.

US Patent 2008120029 characterized in that it consists of a belt bearing direction indicating motors and characterized in that it has various equipment spread throughout the body. In addition to the discomfort that this causes the user this system makes it impossible to wear fairer clothing in the heat period. It is also disadvantageous because the equipment causes relief on the body of the user.

US Patent 4,280,204, characterized by adding a distance sensor to the traditional cane, has the disadvantage of only using said sensor for obstacle detection in one direction only. Not allowing monitoring at all times of the user.

General Description of the Invention

The present invention relates to an apparatus for improving the daily lives of blind or partially sighted persons. It is well known that blind people have a difficult life because of their visual impairment. In order to minimize the difficulties experienced, this product provides the user with useful information for his daily life that would otherwise be complex without the help of third parties. That is, the user has the ability to detect obstacles through ultrasound, a color identifier, a calendar clock and configurable alarms, a signaling system for the presence of the blind in dark environments and an audio player. It is also intended to highlight two important innovations that give blind people a significant improvement in autonomy. It is a product identification system with the consequent indication of some of its most important characteristics namely name and validity, among others, and a guidance system with the indication of places of interest in public spaces. In order to give the blind the ability to read information that is not written in Braille the present invention gives the blind the option of having a text recognition system. Allied to the technical features, the present invention is also portable and ergonomic to allow prolonged use without causing side effects arising from use.

The present invention has to highlight advantages and innovations that do not exist or are isolated in the present products, integrating them in one product: detection of obstacles from the ground up to the level of the head without contact with them, indication of hours, calendar and color, give blind people the ability to orient themselves and locate products in commercial, warehouse or other spaces, tell blind people places of interest based on their location, give blind people listen to audiobooks or other audio anywhere , flag the blind in dark places, detect equipment drop and perform text recognition.

The present invention aims to give the user more autonomy in his daily life, since it provides varied information with great usefulness to his daily life. Information that otherwise it could probably only be given by others to whom the blind person asked for help. The system consists of: a cane with ergonomic and hypoallergenic handle where the sensors and the corresponding electronics are located; and a central processing box that the wearer may wear at the waist.

In the following the various constituents of the present invention will be described.

Ultrasound sensors

One of the main objectives of the project is to replace the traditional cane, which uses the "touch" on the obstacle, with a cane (handle) equipped with technology capable of providing more information about the obstacles in the surroundings to the blind, without this being necessary. have to make any physical contact with obstacles. Thus the equipment is equipped with three ultrasound sensors. A sensor will be directed towards the ground, so it is intended to detect holes, speed bumps, steps and various obstacles such as stones. Another ultrasound sensor will monitor for possible obstacles at leg and waist level. The use of these two sensors is intended in some way to play the role of the traditional cane, but in such a way that contact with the obstacle is not necessary. That is, the user performing a search movement with the forearm will receive information about the presence of the obstacle in the direction the wrist is in, whenever the sensor finds something. This the traditional cane did, but had to do the touch, sometimes being a disadvantage because there is a risk of accidental tipping of objects in which the cane or extension Touch. The third sensor will monitor for obstacles above the waist and head level, and this is where a major innovation lies with the traditional cane. Since the traditional walking stick did not allow the user, due to his normal use, to check if there were obstacles above his waist level, such as traffic signs, signs, etc., they constituted a serious risk of collision, since for the blind these obstacles were invisible.

With the present invention the existence of obstacles is communicated to the user through small vibration motors which, depending on the distance from the obstacle to the user, produce different and easily intelligible vibration codes. For situations of imminent danger (holes in the floor, obstacles with self-motion that suddenly arise, etc.) an alert will be triggered by the speech synthesizer or pre-recorded on a memory card. These two systems prevent the use of whistles or other beeps, which would continuously provide information to the user. This has huge advantages for the user, as it is thus with the ear canal available to hear all the ambient sounds and with them have a better perception of the surrounding environment and the action that takes place in it. The way the sensors are positioned makes it possible to use the handle at an angle of approximately 45 °, which translates into a comfortable wearing position thus avoiding prolonged fatigue. It is also given the option of the invention to include a retractable or removable rod which will facilitate adaptation and give additional confidence to the user. The obstacle detection system also offers the option of indoor or outdoor use. Indoor mode may be used for spaces where there are many nearby obstacles (eg indoors) as the range of distances to be detected will be smaller and outdoor mode may be used in more open spaces where detection will be higher.

Speech Synthesizer

The system is also equipped with a speech synthesizer that makes it possible to verbally communicate various information, such as alerts, menu navigation and configuration options provided by the functional parts of the system as a whole. Providing the blind with this audio information through a wireless headset or an ordinary wired headset.

Using the speech synthesizer or prerecorded audio it is also possible to tell the user what colors of clothing or other objects are analyzed by a color sensor integrated in the wrist. The user can also know the time, have access to the calendar and an easily configurable alarm using the speech synthesizer.

Barcode or rflD scanning system

Below is a very important innovation that gives the blind significant autonomy. With this invention the user can make purchases in shopping centers, shopping malls or similar areas, orient themselves in warehouses, work or leisure spaces, etc. (hereinafter referred to as establishment or establishments). The choice of products you want can be made without the help of third parties even if the products do not have Braille information. To this end, the all products have barcodes or rfIDs. Using the barcode reader or handheld rfID reader the system determines the product code. With this code the system will wirelessly request the name of the product from a database in the establishment, and will then be asked if the user wants to hear more information about that product. If so, the database will provide additional information that facility staff have added to the database (eg expiration date, if it contains allergens, etc.). This information may be stored in a database existing internally in the system of this invention if the user so wishes. In this way the user can again have access to the product information whenever and wherever he wants (for example at home), just by re-reading the code in the product or object.

In order for the user to take full advantage of the above functionality, it presupposes the existence or future implementation of suitable systems at the locations indicated above, and where the user wishes to obtain information, which communicates with the present invention and which should preferably consist of bases. of on-site managed data and antenna circuits.

Said database shall have wireless communication capabilities in order to be able to exchange information with the system of this invention and the antenna circuit shall be implemented so that each product shelf (or other equally suitable location) is placed in its vicinity. a short range antenna that does not interfere with neighboring antennas. The antenna circuit may be powered by photovoltaic power or by the power supply of the establishment.

Thus, when the blind person approaches the antenna, it will tell you what kind of products can be found there.

Antennas may also be installed on the floor of the establishment if the owner so wishes, and may thus provide other information that the establishment wishes to give to the blind.

It is further expected that on the shelves of each shelf or in the most suitable place rflD tags (passive or active) will be used which indicate which product is in that area, such that the user when navigating the shelf or the proximity of the covered area through the antenna, learn about the products there through the cane handle. If the establishment does not wish to place rflD tags, they may be replaced by standard Braille tags with the product name or other information.

In order to further complement the use of the present invention it is envisioned that the packaging of the products to be identified contains embossed (Braille) labels next to the bar code indicating to the blind the location and reading direction thereof.

Guidance System

This invention incorporates another innovative feature that will facilitate the way blind people use public spaces and roam the streets. For this purpose a GPS receiver and a digital compass that serve as functional modules to the system that indicate to the user the location of infrastructures and places of interest.

There are numerous scenarios where this feature can be of great use as p. ex. subway exits, train stations, bus stops, public gardens, etc. This feature is even more relevant in scenarios where antennas that transmit various information in distributed databases are included in the locations described above. For example in public places such as bus stops, the antennas may issue information about places of interest, directions, bus times or other information that is useful for the place in question, which you will receive as soon as you approach. from the stop. Another example is the implementation of the same type of antennas along the streets which may indicate the location of walkways, garden benches, building entrances, unprotected wharfs, etc. Databases can be upgraded and the system powered by photovoltaic or mains power if available locally, so antennas can be placed in a variety of locations. This type of scenario including the public or private installation of antennas in larger areas as much as the requesting entity (eg a town hall) wishes to make maximum use of the functionality described above.

Media player

The user also has the possibility to play audio files, as if it were a media player (mp3 player) allowing him to bring music or audio audio books wherever you go and take up your free time. To record the audio files on the memory card of this invention the user will only have to transfer them through their personal computer using a USB connection or memory card reader from the computer.

Light and sound signaling

If the blind man drops the handle, the fall is detected using the accelerometer on the handle. At that moment an audible warning will sound indicating the place where the handle was left after the fall. The blind can also locate the handle in case he cannot remember where he left it, simply by pressing the corresponding button on the central processing box, and also provided in this invention, which will communicate with the cane via wireless and which it will activate a beep on the cane indicating its location.

The present invention also has a night mode of use. That is, this mode allows to identify / signal the user when moving in dark places or at night. Using a light sensor and two LEDs placed on the handle, these will be activated whenever the blind enter dark places or move at night. This way the other passers-by will be alerted to the existence of a person, so they can take some precautions to avoid accidents.

Text Recognition System

In order to provide access to information that has not been written in Braille. The present apparatus allows add as an option a text recognition system that makes it possible for example to recognize what is written in titles and texts of newspaper, magazines, posters and others. For this purpose, a digital camera is acquired that acquires an image and is processed by image processing and the identified text is communicated to the blind using the speech synthesizer present in the system.

Brief Description of the Figures

Fig 1a - represents the general view of the invention.

Fig 1b - illustrates the cane and part thereof, does not represent the design of the cane nor the arrangement of the constituent components, serving only as an illustrative example.

Fig 2 - represents the modules involved in obstacle detection.

Fig 3 - represents the color identifier system.

Fig 4 - represents the detection of cane fall.

Fig 5 - represents the system that allows to locate the cane remotely.

Fig 6 - represents the signaling system of the user.

Fig. 7 represents a product of the objects with said codes and said location label of said codes.

Fig 8 - represents the system responsible for reading the information obtained based on said codes.

Fig 9 - represents the digital clock

Fig 10 - represents the navigation system

Fig. 11 - represents the system that reproduces audio content. Fig. 12 - represents the recognition system of letters and printed words.

Brief Description of Reference Signs

1 - Processing and control unit 2, 4 and 6 - Independent channels or via a channel bus

3, 5 and 7 - Sensors

10 - Voice Alert

11 - Vibration Alert

13 - Headset

14, 15, 16 - Obstacles

18 - Color Sensor

19 - Subject

20 - Accelerometer

23 - Audible Alert

24 - Cane Location System Signal Receiver 26, 63, 49 - Wireless Signals

27 - Cane location system issuer

29 - Cane Tracking System Trigger

30 - Light Sensor

33 - Leds

34 - Exhibitor

36 - Product or object to analyze / read

37 - Shelf

38 - Barcode or rflD codes on the product or object to be analyzed / read

39 - Antenna

40 - Bar Code

41 - rflD Code

42 - Barcode Reader

43 - Wireless Bar Code Scan Signal

44 - rflD Code Reader

45 - rflD code reading wireless signal 46- Remote Type 1 Antenna Databases

48 - Type 1 Antenna Transmitter and Receiver

50 - Transmitter and receiver of the communication system of the place where the user wishes to request information. 55 - Local database of the cane's internal memory.

56 - Interface

58 - Tactile relief mark

59 - GPS

60 - Compass

61 - Remote Type 2 Antenna Database

62 - Type 2 antenna transmitter and receiver

64 - Cane Communication System Receiver

65 - Local Map Storage Database

66 - Database for storing audio content

67 - Audio Player

68 - Digital Camera

69 - Digital Clock

70 - Retractable or removable cane extension

71 - Cane handle

72 - User

8, 9, 12, 17, 21, 22, 25, 28, 31 32, 47, 51, 52, 53, 54, 57

- Signals between system units

Description of preferred setting

In the following, the preferred embodiment of the invention is described, wherein the apparatuses consist of a set of organs mostly represented in the figures. The support structures, usually called boxes are not represented, being the main blocks that are fundamental to the understanding of the event, but not limited to them. The processing and control unit (1) communicates, via independent channels or through a channel bus (2, 4, 6), with sensors (3, 5, 7) that allow the detection of obstacles (14, 15, 16 ). Said sensors are differentiated according to the direction in which they are directed, this allows to give each sensor a preferential zone of detection. facilitating identification of the location of the detected obstacle, thus taking advantage of the anatomical and design characteristics of the handle (71) and assuming that the user uses the handle according to his natural position of use, one of the sensors (7) will cover the whole it is the closest area to the ground including the ground, and by way of example this sensor has the possibility of detecting uneven holes and is not limited to them alone (16). Another sensor (5) has a detection area that covers the entire front of the leg area to the front of the waist, and the distance from said body parts to the obstacle can be predefined or user defined. There is the possibility to select a mode of operation for enclosed spaces (eg interior housing) where the distances of analysis of obstacles will be shorter than the mode of operation for wider spaces (eg a pedestrian street). ) where given the greater dispersion of obstacles (15) it is possible to have a larger analysis radius. A third sensor is positioned to analyze the entire front of the waist including the head area, allowing to detect obstacles such as signs, not only being limited to them (14). Whenever one of the sensors gets a reflection of its signal the processing and control unit (1) to which it is connected will determine which sensor it was and whether the distance the obstacle is at or below the range. If the distance is greater than the range, the user will not be informed of the presence of the obstacle. If the distance is equal to or less than the range, the unit (1) informs the user by two possible modes of communication, by voice prompts ( 10) consisting of a speech synthesizer or pre-recorded audible phrases / sounds such varied information as for example the distance of the object, "uneven danger" or "obstacle hazard at head level" just to name a few and which will be reproduced by an ear-type mechanism (13) which is connected to the system by means of lead wire or wireless connection. Communication of the distance to the user may further be made by use of a vibration system (11) which for different distances vibrates differently, as the distance from the user to the obstacle decreases the frequency of vibration will be increased.

This invention has a color identification system. Use is made of a color sensor 18 which can identify in alphanumeric format the color of the object being analyzed. Signal 17 is handled by the processing and control unit 1, which assigns to each color identified by said unit 18 a name which is easily intelligible to the user, by way of example only red, green , etc. Said name is sent to said voice alert system (10) and its signal (12) is reproduced by an ear-type mechanism (13) which is connected to the system by a conductive wire or connected by a wireless connection. .

This invention has a system that detects the fall of the cane (70, 71). Said system is constituted by an accelerometer (20) which detects the fall of said cane (70, 71) and the signal (21) is sent by an accelerometer (20) to the processing and control unit (1) which is in charge of activate a sound signal produced through a buzzer or speaker or similar sound system (23). The handle can also be located remotely via wireless (26) by pressing a button, switch or the like (29) on the auxiliary box that sounds an alarm by means of an audible alert (23) on the handle of the cane.

The handle in dark or night environments uses a light sensor (30) which by means of the processing and control unit (1) automatically activates a system which signals the user by means of luminous LEDs (33) which are always on to emit light or intermittent emission. In the situation where the user is no longer in dark environments said system (33) is shut down by said unit (1).

This invention makes use of a barcode reader (40) and an rflD code reader (41) which may be used to obtain information about products or objects (36) having said codes (38). The user when approaching the handle of the product or object (36) receives information wirelessly (43.45) present on the rflD tag or device (38). With said information received and identifying the product or object (36) being analyzed, the processing unit (1) and the communication system (50, 51) establish a wireless connection (49) with a database. (46, 48) sending back to the processing unit (1) additional information in the database about said product or object (36) being analyzed. The user (1,50,51,56) is then asked if he wishes to receive further information about said product or object (36), if so said processing unit (1) and communication system (50, 51 ) re-establish a wireless connection (49) with the base (46, 48) for additional information. All information collected is communicated to the user using said voice player system (10, 12, 13). Any information received about the product or object (36) can be stored in the database in the internal memory (55) of the invention, allowing the user to have access to the information again by simply reading the code (38) in the product. or object (36), so it is not necessary to be in the location covered by the remote database (46) to access the information again. In case said code (38) in said product or object (36) is a barcode (40), the location of this code (40) is indicated using a tactile relief mark (58). Said embossing mark may be represented by a tactile embossed adhesive label or affixed by another method to the product or object (36), or said mark (58) to be engraved on the product or object itself (36). The mark (58) may be represented in other ways depending on the constitution of the surface of the product or object (36) where said code (40) is located. The user may be guided to said product or object (36) via antennas (39) which may be conveniently spread around or near said product or object (36) and which may provide the user with various information, the said antennas are supplied with on-site mains power or photovoltaic power.

This invention incorporates a Global Positioning System (GPS) module (59) and digital compass (60), which together with the processing unit (1) and a map-holding database (65), provide information about your location. and on matters of interest in relation to the proximity of the place where the user is. Said information stored in the database may be communicated to the user using the voice player (10, 12, 13). This invention can further utilize its communication system (64) to communicate wirelessly (63) with antennas (61, 62) conveniently placed in various locations, for example: public gardens, museums, sidewalks, walkways, among others. . In this way the user may receive information present in said databases (61, 62). Said antennas (61, 62) may be powered from on-site mains power or photovoltaic power. The information received can be communicated to the user using the voice player (10, 12, 13).

Using an audio player (67) this invention can reproduce audio content in database (66) by communicating said audio content through the headset (12, 13).

Using a digital camera (68) this invention can recognize letters, words and / or text written in a normal manner (press writing for example). Images captured by camera (68) are digitally processed in the processing and control unit (1) and then converted to voice using the voice player (10). The result of the conversion is communicated to the user via headset (12, 13).

Claims

1. Virtual Walking Stick To Assist The Visually Impaired, characterized by having at least one distance sensor (3, 5, 7), at least one vibration motor (11), GPS receiver (59) and or digital compass (60) , wireless communication module (50, 64) and or location (24, 27, 29), processing and control unit (1), have a USB data connection, have digital storage media capable of storing data ( 55, 65, 66), have a buzzer or loudspeaker alert mechanism or the like (23), digital clock with preferably calendar and alarm functionality (69), have a wireless or wired headset (13) and a system feed.

Cane according to claim 1, characterized in that the sensors are three ultrasonic sensors (3, 5, 7) and are oriented and configured to detect obstacles or gaps or holes or other barriers to normal circulation of the sensor. (72) from ground level to above head level.

Cane according to Claim 1 or 2, characterized in that the vibration motor or motors (11) are configured to vibrate at different intervals according to the distance to the object or obstacle, and these intervals may be adjusted according to each other. where the appliance is used.

Walking stick according to claim 1, 2 or 3, characterized by a speech synthesizer (10, 12, 13) or a digitally pre-recorded message carrier (67, 12, 13) alerting the user to possible dangers. .

Walking stick according to one of the preceding claims, characterized by an interface (56) for setting the time, calendar and alarm.

Walking stick according to one of the preceding claims, characterized by a sensor capable of identifying the colors of the objects analyzed.

Cane according to one of the preceding claims, characterized in that it has a barcode reader (42) and or rflD reader (44) capable of reading the respective codes (40, 41) optionally indicated by a raised tactile mark ( 58) and pass the information to a storage-capable storage medium (55) or update thereof, the information can be consulted again by simply re-scanning the barcode (40) or rflD (41).

Walking stick according to one of the preceding claims, characterized by a digital audio file decoder (67).

Cane according to one of the preceding claims, characterized by an acceleration sensor (20) which detects the equipment falling and is configurable to activate an audible warning.

Walking stick according to one of the preceding claims, characterized by a light signaling (33) and / or light detection (30) system.

Walking stick according to one of the preceding claims, characterized in that it has at least one digital camera (68).

Walking stick according to one of the preceding claims, characterized by an image processing system configurable to recognize letters, words, phrases or text.

Walking stick according to one of the preceding claims, characterized in that it has a retractable and or removable extension.

Walking stick according to one of the preceding claims, characterized in that it has an ergonomic and hypoallergenic handle.

System for Assisting the Invisible Persons characterized by a virtual cane described by any of the preceding claims and a central processing box with a wireless communication system with the cane to activate a sound signal on the cane indicating its location.