EP1200034A1 - Device for aiding the orientation of the blind - Google Patents

Device for aiding the orientation of the blind

Info

Publication number
EP1200034A1
EP1200034A1 EP00944131A EP00944131A EP1200034A1 EP 1200034 A1 EP1200034 A1 EP 1200034A1 EP 00944131 A EP00944131 A EP 00944131A EP 00944131 A EP00944131 A EP 00944131A EP 1200034 A1 EP1200034 A1 EP 1200034A1
Authority
EP
European Patent Office
Prior art keywords
microprocessor
unit
picture
information
serving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP00944131A
Other languages
German (de)
French (fr)
Inventor
Janos Fekete
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of EP1200034A1 publication Critical patent/EP1200034A1/en
Withdrawn legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61HPHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
    • A61H3/00Appliances for aiding patients or disabled persons to walk about
    • A61H3/06Walking aids for blind persons
    • A61H3/061Walking aids for blind persons with electronic detecting or guiding means
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F9/00Methods or devices for treatment of the eyes; Devices for putting-in contact lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
    • A61F9/08Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001Teaching or communicating with blind persons
    • G09B21/006Teaching or communicating with blind persons using audible presentation of the information

Definitions

  • the invention relates to a device that aids the orientation of the blind, which contains a sensing unit that can be fixed to the body surface of the person using it and a processing unit that is connected to the sensing unit.
  • microprocessors with a high operating speed and a large memory capacity in a sufficiently small size, cheaply, and they can be programmed as required, so they may become mass produced articles, like for example, the hearing aid.
  • our aim was to overcome the deficiencies of the known aiding devices and to create a device that supports the picture creating ability of the blind and so improves their sureness of movement and aids better and more precise orientation.
  • the basis of the idea of the invention was formed by the recognition that if with the help of an optical device fixed to the head capable of producing pictures of objects, comparing these with the pictures of groups stored earlier in a database with the help of a computing device we select a sound identifier that the most closely relates to the object and this is played to the blind person in an audible form, then carrying out the simple picture-sound transformation the task may become solvable.
  • the device to aid the orientation of the blind - which contains a sensing unit fixed to the body surface of the person using it and processing unit connected to the sensing unit - is formed in such a way that the sensing unit has a CCD camera and the processing unit has a microprocessor, the microprocessor has an analogue input, external bus and output, through the signal forming unit of the camera it is connected to the analogue input of the microprocessor, picture memory and sound memory is connected to the external bus of the microprocessor, and with the implementation of an amplifier a loudspeaker suitable for transmitting speech information is connected to the output of the microprocessor.
  • a further criterion of the device according to the invention is that the microprocessor has a data transfer input, and through a recording unit temporarily connected to the data transfer input a microphone is connected serving to read in verbal information.
  • the microprocessor has a controller part unit suitable for reading in and processing picture and sound information at the same time, the controller part unit is connected to the internal memory unit serving as a store for the picture information and a second internal memory unit serving as a store for the sound information, the two internal memory units are connected to an identifying unit serving the searching according to picture information and also serving to connect up the picture and sound information.
  • the device has numerous advantageous features.
  • An important advantage is that in the brain of a person blinded in an accident there is a kind ofcrowdedpicture" of the environment and the world, so it is easier to give back the concrete pictures of the objects in their area of movement, of his/her home and neighbourhood by naming them.
  • Another advantage is that on the one hand that the picture and word vocabulary of the device is programmed in a fixed way during manufacture, and on the other hand that a seeing person in the environment of the person using the device can carry out customised programming, so the device can become language independent and be simply used anywhere in the world.
  • Figure 1 is the outline sketch of a version of the device
  • Figure 2 is a picture showing the video signal mapping
  • Figure 3 is the block diagram of the steps of the operating program
  • FIG. 1 shows the outline of the important elements of the device
  • the CCD camera 1 provides the basic signal of the device, which the joining module 2 edits and adjusts in amplitude for the microprocessor 3
  • the sample-taking subroutine of the processing program stores the video signal coming into the analogue input 3a of the microprocessor 3 in 64 pieces, 8 bit words - as shown in figure 2 - as one block in the working register This low resolution gives the device the advantage that it sees quite a lot of similar objects to be the same The procedure can continue here in two directions
  • the writing unit 8 tempora ⁇ ly to the data transfer input 3d of the microprocessor 3 then it w ⁇ tes the contents of a given block into the picture memory 4, provides it with a serial number, which it then uses as an index du ⁇ ng the search process At the same time it stores the short describing expression ar ⁇ ving through the microphone 9 into the sound memory 5
  • the program - the block outline of which is shown by figure 3 - takes the blocks from the picture memory 4 in line, compares them with the blocks to be found in the working register, then in the case of sameness on the basis of the index belonging to the given block the expression belonging to the index is selected from the sound memory 5, transfe ⁇ ed to the output register, then prominencesent" out through the output to the amplifier 6, then to the loudspeaker 7. The process is repeated like this, then if there is no identifiable block a message locallyunknown obstacle" is heard.

Landscapes

  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biomedical Technology (AREA)
  • Business, Economics & Management (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Ophthalmology & Optometry (AREA)
  • Pain & Pain Management (AREA)
  • Epidemiology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Vascular Medicine (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Rehabilitation Therapy (AREA)
  • Physics & Mathematics (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention relates to a device to aid the orientation of the blind, which contains a sensing unit fixed to the body surface of the person using it and processing unit connected to the sensing unit. The characteristic feature of the solution is that the sensing unit has a CCD camera (1) and the processing unit has a microprocessor (3), the microprocessor (3) has an analogue input (3a), external bus (3b) and output (3c), through the signal forming unit (2) of the camera (1) it is connected to the analogue input (3a) of the microprocessor (3), picture memory (4) and sound memory (5) is connected to the external bus (3b) of the microprocessor (3), and with the implementation of an amplifier (6) a loudspeaker (7) suitable for transmitting speech information is connected to the output (3c) of the microprocessor (3).

Description

Device for aiding the orientation of the blind
The invention relates to a device that aids the orientation of the blind, which contains a sensing unit that can be fixed to the body surface of the person using it and a processing unit that is connected to the sensing unit.
There are many types of device today that aid the blind to move about, of these there is the stick, the disadvantage of which is that the sensing distance is small. A significant aiding partner is a trained guide dog, the acquisition and keeping of which is very expensive. The general deficiencies of the known aiding devices are that they do not give information regarding the pictures and the direction of the obstacles, only of their presence.
The software that is available commercially is capable of producing a relationship between pictures and sounds, but it requires a great deal of hardware, so because of its dimensions and high price it will not become a mass produced article. Due to the development of microchips development engineers are provided with microprocessors with a high operating speed and a large memory capacity in a sufficiently small size, cheaply, and they can be programmed as required, so they may become mass produced articles, like for example, the hearing aid.
With the invention our aim was to overcome the deficiencies of the known aiding devices and to create a device that supports the picture creating ability of the blind and so improves their sureness of movement and aids better and more precise orientation.
Our aim was for the device to be small and its production cost and selling price allow it to be sold as a mass produced article.
The basis of the idea of the invention was formed by the recognition that if with the help of an optical device fixed to the head capable of producing pictures of objects, comparing these with the pictures of groups stored earlier in a database with the help of a computing device we select a sound identifier that the most closely relates to the object and this is played to the blind person in an audible form, then carrying out the simple picture-sound transformation the task may become solvable. In accordance with the set aim the device according to the invention to aid the orientation of the blind - which contains a sensing unit fixed to the body surface of the person using it and processing unit connected to the sensing unit - is formed in such a way that the sensing unit has a CCD camera and the processing unit has a microprocessor, the microprocessor has an analogue input, external bus and output, through the signal forming unit of the camera it is connected to the analogue input of the microprocessor, picture memory and sound memory is connected to the external bus of the microprocessor, and with the implementation of an amplifier a loudspeaker suitable for transmitting speech information is connected to the output of the microprocessor.
A further criterion of the device according to the invention is that the microprocessor has a data transfer input, and through a recording unit temporarily connected to the data transfer input a microphone is connected serving to read in verbal information.
In a possible version of the device the microprocessor has a controller part unit suitable for reading in and processing picture and sound information at the same time, the controller part unit is connected to the internal memory unit serving as a store for the picture information and a second internal memory unit serving as a store for the sound information, the two internal memory units are connected to an identifying unit serving the searching according to picture information and also serving to connect up the picture and sound information.
The device has numerous advantageous features. An important advantage is that in the brain of a person blinded in an accident there is a kind of „picture" of the environment and the world, so it is easier to give back the concrete pictures of the objects in their area of movement, of his/her home and neighbourhood by naming them.
Those born blind participate in different training processes, where with the help of touch, feel and explanation they carry the visible pictures of only a few objects and situations, so for them the advantage of the device is that making use of its free programming ability so- called global pictures can be produced in accordance with the person's „ vocabulary". A favourable point is that due to the transformation of new picture information to sound information recognising, identifying obstacles occurring while moving about as pictures, then playing them as sound, the device guarantees a much better feeling of security than the already realised bleeper, signalling devices.
Another advantage is that on the one hand that the picture and word vocabulary of the device is programmed in a fixed way during manufacture, and on the other hand that a seeing person in the environment of the person using the device can carry out customised programming, so the device can become language independent and be simply used anywhere in the world.
Another favourable feature is that the information stored in the device does not use the „usual: bmp, jpg, ... " picture storage procedures, but its unique resolution is low (64x8 bit is one picture), so due to the small amount of space required the upper limit of the number of pictures that can be stored is only a question of memory capacity, it is possible to produce cheaper, more modest one hundred word devices, or more expensive devices containing even one thousand picture word connections.
Due to the low resolution an advantage is that many different objects, but similar in profile are forced into one group, but the aim is not to recognise a type, or the brand of a motor vehicle, differentiating is satisfactory.
Another advantage that has to be mentioned is that the weight of the device is low, as its consumption, its price is modest, affordable by all, its covering is protected against rain, its sensitivity even in dusk is satisfactory, as it ensures stable operation even in environmental light of 0.2 lux.
It is also important to emphasise the advantageous feature that technically a resolution may be attained with which letters, characters may be „read out", and with this a new area of use opens, not only for the blind, but also for those with poor sight. It is practical for the device to be fitted to the arms of a spectacles frame (also ensuring its aesthetic production), in accordance with the head movement-seeing psychological effect it is turned in the direction of „vιewιng" and so the optical sensor of the device fixed in this way sees a real, black and white picture A microcomputer transforms the produced signal seπes with AD conversion, stores it, then compares it with the bit pictures of signal forms belonging to an average of one hundred pictures recorded duπng programming In accordance with the result of the comparison an expression is selected that was associated with the picture duπng programming and the name of the picture is read out through miniature loudspeakers
In connection with the example the invention is presented in more detail on the basis of drawings On the drawing
Figure 1 is the outline sketch of a version of the device, Figure 2 is a picture showing the video signal mapping, Figure 3 is the block diagram of the steps of the operating program
Figure 1 shows the outline of the important elements of the device The CCD camera 1 provides the basic signal of the device, which the joining module 2 edits and adjusts in amplitude for the microprocessor 3
The sample-taking subroutine of the processing program stores the video signal coming into the analogue input 3a of the microprocessor 3 in 64 pieces, 8 bit words - as shown in figure 2 - as one block in the working register This low resolution gives the device the advantage that it sees quite a lot of similar objects to be the same The procedure can continue here in two directions
In the case that we are in the „learmng" status, in other words we connect the writing unit 8 temporaπly to the data transfer input 3d of the microprocessor 3 then it wπtes the contents of a given block into the picture memory 4, provides it with a serial number, which it then uses as an index duπng the search process At the same time it stores the short describing expression arπving through the microphone 9 into the sound memory 5 If we are in the recognition or user status, the program - the block outline of which is shown by figure 3 - takes the blocks from the picture memory 4 in line, compares them with the blocks to be found in the working register, then in the case of sameness on the basis of the index belonging to the given block the expression belonging to the index is selected from the sound memory 5, transfeπed to the output register, then „sent" out through the output to the amplifier 6, then to the loudspeaker 7. The process is repeated like this, then if there is no identifiable block a message „unknown obstacle" is heard.
In the interest of reliable identification the picture needs to be a standing picture for one second!
Deriving from the video signal frequency and the type of microprocessor and its clock pulse (100 MHz) approx. ten measurement take place in one second, this is enough of a guarantee for reliable recognition. This value is close to the human recognising ability, e.g. the running into one another of pictures while you shake your head.
List of references
camera joining module microprocessor 3 a analogue input 3 b external bus 3 c output 3d data transfer input picture memory sound memory amplifier loudspeaker writing unit microphone

Claims

Claims
1. A device to aid the orientation of the blind, which contains a sensing unit fixed to the body surface of the person using it and processing unit connected to the sensing unit, characterised by that that the sensing unit has a CCD camera (1) and the processing unit has a microprocessor (3), the microprocessor (3) has an analogue input (3a), external bus (3b) and output (3 c), through the signal forming unit (2) of the camera (1) it is connected to the analogue input (3a) of the microprocessor (3), picture memory (4) and sound memory (5) is connected to the external bus (3b) of the microprocessor (3), and with the implementation of an amplifier (6) a loudspeaker (7) suitable for transmitting speech information is connected to the output (3c) of the microprocessor (3).
2. Device according to claim 1 characterised by that the microprocessor (3) has a data transfer input (3d), and through a recording unit (8) temporarily connected to the data transfer input (3d) a microphone (9) is connected serving to read in verbal information.
3. Device according to claims 1 or 2 characterised by that the microprocessor (3) has a controller part unit suitable for reading in and processing picture and sound information at the same time, the controller part unit is connected to the internal memory unit serving as a store for the picture information and a second internal memory unit serving as a store for the sound information, the two internal memory units are connected to an identifying unit serving the searching according to picture information and also serving to connect up the picture and sound information.
EP00944131A 1999-07-07 2000-07-07 Device for aiding the orientation of the blind Withdrawn EP1200034A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
HU9902295 1999-07-07
HU9902295A HU221967B1 (en) 1999-07-07 1999-07-07 Set of devices for promoting orientation of the blind
PCT/HU2000/000076 WO2001003635A1 (en) 1999-07-07 2000-07-07 Device for aiding the orientation of the blind

Publications (1)

Publication Number Publication Date
EP1200034A1 true EP1200034A1 (en) 2002-05-02

Family

ID=89998668

Family Applications (1)

Application Number Title Priority Date Filing Date
EP00944131A Withdrawn EP1200034A1 (en) 1999-07-07 2000-07-07 Device for aiding the orientation of the blind

Country Status (5)

Country Link
EP (1) EP1200034A1 (en)
AU (1) AU5836500A (en)
HU (1) HU221967B1 (en)
PL (1) PL364170A1 (en)
WO (1) WO2001003635A1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE10334009A1 (en) * 2003-07-25 2005-02-10 Diehl Munitionssysteme Gmbh & Co. Kg Blind and partially sighted persons orientation aid is integrated in blind persons stick and uses modulated transmission and array detector to measure distance to objects
GB2441434B (en) * 2006-08-29 2010-06-23 David Charles Dewhurst Audiotactile vision substitution system
WO2013067513A1 (en) 2011-11-04 2013-05-10 Massachusetts Eye & Ear Infirmary Contextual image stabilization
EP2629241A1 (en) * 2012-02-16 2013-08-21 Orcam Technologies Ltd. Control of a wearable device
AU2015311663B2 (en) 2014-09-03 2019-02-28 Aira Tech Corporation Media streaming methods, apparatus and systems
AT14790U1 (en) * 2015-01-30 2016-06-15 Veronika Mayerboeck Setting of light by mobile portable radio-linked light sensor system with integrated sound processing and light control

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1995027456A1 (en) * 1994-04-11 1995-10-19 Nauchno-Vnedrencheskoe Proizvodstvennoe Predpriyatie 'reabilitatsia' Guide device for the blind
US5818381A (en) * 1994-06-24 1998-10-06 Roscoe C. Williams Limited Electronic viewing aid

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB8602761D0 (en) * 1986-02-05 1986-03-12 Al Basri A Blind persons transformer of vision to sound
DE4004438A1 (en) * 1990-02-14 1991-08-22 Manfred Laschuetza Specially equipped walking stick for blind person - gives all round acoustic picture of immediate area and direction and range of nearby objects
US5097856A (en) * 1991-01-14 1992-03-24 Chi Sheng Hsieh Electronic talking stick for the blind
DE29707020U1 (en) * 1997-03-18 1997-09-25 Förster, Katrin, 39576 Stendal Device for clearly assigning information in speech form to an object

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1995027456A1 (en) * 1994-04-11 1995-10-19 Nauchno-Vnedrencheskoe Proizvodstvennoe Predpriyatie 'reabilitatsia' Guide device for the blind
US5818381A (en) * 1994-06-24 1998-10-06 Roscoe C. Williams Limited Electronic viewing aid

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO0103635A1 *

Also Published As

Publication number Publication date
AU5836500A (en) 2001-01-30
HU9902295D0 (en) 1999-09-28
WO2001003635A1 (en) 2001-01-18
HUP9902295A2 (en) 2001-09-28
HU221967B1 (en) 2003-03-28
PL364170A1 (en) 2004-12-13

Similar Documents

Publication Publication Date Title
US8538750B2 (en) Speech communication system and method, and robot apparatus
KR100941638B1 (en) Touching behavior recognition system and method
US7035440B2 (en) Image collecting system and method thereof
US7472134B2 (en) Image distributing system
US7219064B2 (en) Legged robot, legged robot behavior control method, and storage medium
CN209364629U (en) Information processing unit
CN109108961A (en) Robot, the control method of robot and storage medium
US10867527B2 (en) Process and wearable device equipped with stereoscopic vision for helping the user
US20060047362A1 (en) Dialogue control device and method, and robot device
JP2000210886A (en) Robot device
CN102500113A (en) Comprehensive greeting robot based on smart phone interaction
CN106029192A (en) Toy
CN106464793B (en) Photographic device and camera shooting householder method
WO2019216016A1 (en) Information processing device, information processing method, and program
CN109313935A (en) Information processing system, storage medium and information processing method
JP2002049385A (en) Voice synthesizer, pseudofeeling expressing device and voice synthesizing method
KR20200092207A (en) Electronic device and method for providing graphic object corresponding to emotion information thereof
EP1200034A1 (en) Device for aiding the orientation of the blind
CN110364164B (en) Dialogue control device, dialogue system, dialogue control method, and storage medium
KR102171428B1 (en) Dancing Robot that learns the relationship between dance and music
US20190295526A1 (en) Dialogue control device, dialogue system, dialogue control method, and recording medium
US20100028842A1 (en) Interactive Learning Toy
CN107754304A (en) Interactive magic cube
CN109542220A (en) A kind of sign language gloves, system and implementation method with calibration and learning functionality
CN209486938U (en) A kind of intelligent point-reading stick

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20020207

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO PAYMENT 20020207;SI PAYMENT 20020207

17Q First examination report despatched

Effective date: 20030428

RTI1 Title (correction)

Free format text: SET OF EQUIPMENT FOR AIDING THE ORIENTATION OF THE BLIND

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20041008