DE102009059821A1 - Method for acoustic perception of points and/or lines in e.g. residence area for blind person, involves acoustically describing points and/or lines formed points in plane or space by coordinate of stereophony, sound dynamics and pitch - Google Patents

Abstract

The method involves recording a plane or a space by an optical recording device such as laser scanner and camera. Projection of the plane or the space is computed from the recording and is electronically recorded as a coordinate system. Points and/or lines formed the points in the plane or the space are acoustically described by a coordinate of stereophony, sound dynamics and tone pitch. A compass, a water weighing machine and a protactor are used for taking out measurements. An independent claim is also included for a device for orientation by hearing sense, comprising an acoustic transmission unit.

Description

It is a method that represents the environment of a blind person in their area or space coordinates via the sense of hearing and thus acoustically point in directions, locate and display objects or create whole sound images of the environment of a blind person.

description

The blind have a sharpened sense of touch and hearing, possibly as compensation for the loss of their sight. So blind people have learned to read with the sense of touch. With the sense of hearing they can interpret sounds better and perceive so much of their environment that can lead to the recognition of objects or interpret situations. For example, they draw conclusions about their size from the sound in a room. However, these perceptions are only of a qualitative nature and can not reliably contribute to orientation.

The purpose of this invention is to make blind people aware of their surroundings, part of their environment or objects in their environment via the sense of hearing, so that they can move safely in this environment, locate and grasp objects and move in a direction of their own or be directed in this direction by listening.

It has been found that it is possible to acoustically represent an optical image, an environment or individual objects and perceive them via the sense of hearing. The sound does not emanate from the objects themselves.

This happens, for example, when an object in the picture above is represented by a high tone and a lower object by a correspondingly low tone.

By stereophonic image representation, objects in the right part of the image can be heard more or less preferably in the right ear, depending on their distance from the center of the image. The same applies to the left side of the picture in the left ear.

To show this will be in 1 , through a grading system ( 1 ) Coordinates are drawn, the horizontal coordinate ( 2 ) along the chamber tone a (435 Hz) ( 7 ), and the vertical coordinate ( 3 ) through the center of the picture. The picture is divided into a right and a left half of the picture.

Here are the staves ( 4 ) the scale for the pitch or for the height of the object represented by the sound in the picture (of course, the pitch can be displayed in Hz or in semitones instead of a staff system). The scaling on the horizontal results from the lateral position of the object in the image and can be displayed in% ( 5 ) or in angles. After that, a sound representing an object in the center of the picture is heard at 50% in the right ear and 50% in the left ear. The further you move to the right or left in the picture, the larger the sound volume in the corresponding ear. At the same time, the volume in the other ear then also decreases, until then sounds representing objects at the edge of the picture are only transmitted to the ear, which lies on the side of the object shown.

According to this method, surface coordinates can be reproducibly acoustically described. In the 1 the position of the object A ( 6 ) by the tone f (690.5 Hz) ( 8th ) and the sound distribution right / left ear 75/25% ( 10 ).

If one also draws on the sound dynamics, then the spatial coordinates of an object can also be described (an object shown aloud is at the front, a quieter one at the back of the image).

The acoustic representation of images and objects according to the invention preferably takes place in the case of tone sequences or harmonies in the tonal range and is thus perceived as music rather than as sound. In contrast, in single tones (exact localization of individual objects or approximation of two objects) in order to use the full acoustic resolution (the difference threshold for the pitch is only 0.1%) a stepless tone scale is preferred.

Even colors can be acoustically reproduced by the method according to the invention by assigning certain colors certain timbres or simply certain musical instruments. So z. B. a violin the color yellow, a trombone the color blue and a clarinet the color red u. s. w. Thus, if the object A in drawing 1 is yellow, then the sound f should be played by a violin. However, the timbre can also be used generally to characterize objects without reference to their color.

The method according to the invention is suitable for making forms, pictorial representations and figures perceptible to the blind. Also, blind people can locate individual objects in the room or on the surface and, if necessary, take targeted action. Further, sound coming from a particular direction may cause the blind to turn in that direction or to go in that direction or to receive information from that direction, such as the distance to particular and location of particular objects.

To achieve this goal, the blind's environment is captured by devices that optically capture and / or measure the environment, or locate nearby objects and determine their spatial or surface coordinates. The data obtained is processed by electronic data processing so that with the help of stored sounds and sounds they are transmitted to the headphones according to the inventive method. The photograph may be a photographic image, the vertical projection onto a surface or a hologram by a laser scanner

The subject of the present invention is thus a method for the acoustic perception of surfaces and / or lines and / or points and / or curves in the plane or in space, characterized in that the plane or the space is received by an optical device from which resulting recording whose vertical projection is produced and electronically recorded and described from the recording surfaces and / or lines and / or points and / or curves in the plane or in space by the coordinates pitch and / or stereophony and / or sound dynamics.

Also claimed in accordance with the present invention is an apparatus which preferably images optical images to scale and converts them to acoustic reproduction so that a visually impaired person can locate objects in the room or on the surface acoustically. For the latter, it may be advantageous if the device according to the invention can filter out certain objects from the image. This can be done either by marking the object (eg reflector, bar code), or by equipping the recording device with a device for object recognition or - as will be shown - the position of the objects to be highlighted in the electronic record is integrated.

The device according to the invention consists of a recording device, a stereophonic playback device (headphones or earphones) and a computer that transmits the recordings or parts of the recording or results, which are calculated from the recording in a manner described in this invention in the headphones as sounds and sounds ,

Here, the division of labor between the recorder and the computer is as follows: The laser scanner or the camera takes a contoured area in which the visually impaired person is on. This outlined area is referred to below as the residence area or work area. This recording is transmitted to the computer, which represents an electronic record of the projection of the field of residence, the computer field. This computer field remains unchanged as long as the visually impaired person is in the corresponding resident field.

The laser or ultrasound measuring device built into the recording device now determines the location of the wearer of the device according to the invention by measuring the distance from the device to two measuring points contained in the coordinate system of the computer field (and residence field), referred to hereinafter as fixed points (see below). If the carrier changes its location in the residence field, its location recorded in the computer field is changed accordingly. All acoustic signals according to the invention are directed to the location currently determined in the computer field and thus form the auditory field.

In contrast, at work z. B. at a table, the carrier of the device static and the work area, hereinafter referred to as working field, can change in the computer field. Here, the focus is on recording and determining the position of the working hands as well as the workpieces to be processed. Here, the computer has to make changing locations of the hands and objects acoustically perceptible to the stationary wearer of the device. The same applies to the work on the PC, where z. B. the moving mouse is acoustically represented.

The recording device may also be a photographic device. However, since the acoustic representation according to the invention is the representation of spatial or surface coordinates, a device is preferred which displays the environment as a hologram. A laser scanner is preferred. The recording device, which is to record surfaces or objects lying in front of the blind, is to be mounted in an elevated position, preferably on the head of the blind person as glasses or helmet. Also preferred in accordance with the invention are aerial photographs or satellite images, especially if they have been recorded vertically or approximately vertically from above.

• – Das Aufenthaltsfeld wird durch einen Laserscanner aufgenommen und Fixpunkte (s. u.) werden ausgewählt und eingemessen.
• – Baupläne werden in den Rechnerteil eingelesen und beim Betreten der Gebäuderäume werden die im Raum befindlichen Objekte über den Laserscanner eingemessen. Anschließend bestimmt das Aufnahmegerät die Fixpunkte (Raumecken).
• – Das Sattelitenbild eines Straßenzuges wird in Aufenthaltsfelder aufgeteilt (am PC) und dann werden erdgebunden und vor Ort die Fixpunkte ausgesucht und eingemessen. So entstehen am PC vorgefertigte Rechnerfelder. Der Laserscanner des Gerätes hat dann beim Betreten des jeweiligen Aufenthaltsfeldes, wobei dann auch das entsprechende Rechnerfeld aufgerufen wird, die Aufgabe, in dem vorgefertigten Rechnerfeld nicht verzeichnete Hindernisse einzumessen; sozusagen das Rechnerfeld zu aktualisieren.

The computer field can, as will be shown, come about in various ways:

• - The resident field is recorded by a laser scanner and fixed points (see below) are selected and calibrated.
• - Construction plans are read into the computer part and upon entering the building spaces, the objects in the room are measured via the laser scanner. Subsequently, the recording device determines the fixed points (room corners).
• - The satellite image of a street is divided into stay fields (on the PC) and then are earthbound and selected the fixed points on site and measured. That's how you get started PC ready-made computer fields. The laser scanner of the device then entering the respective residence field, in which case the corresponding computer field is called, the task to measure in the prefabricated computer field unrecorded obstacles; so to speak to update the computer field.

Fixed points are, as will be shown, with respect to their space or surface coordinates part of the residence field and serve to determine location and orientation.

• – zur Richtungsangabe, vorzugsweise durch Stereophonie und Dynamik
• – in der Ebene durch Stereophonie und Dynamik oder Variation der Tonhöhe (1 und 9a–e) und
• – dreidimensional, mit Stereophonie, Variation der Tonhöhe und Dynamik

anwenden.The described method can be acoustically

• - To indicate direction, preferably by stereophony and dynamics
• - in the plane through stereophony and dynamics or variation of the pitch ( 1 and 9a -E) and
• - three-dimensional, with stereophony, variation of pitch and dynamics

apply.

1. DIRECTION

When indicating the direction stereophonic hearing is preferably used. It is suitable to guide the blind on a predetermined path from A to B by the device by a sound showing the direction in which the path runs. D. h .: sound right ear: go to the right, sound left ear: go to the left and sound both ears (50/50): go straight out (horizontal axis in 1 ). Of course, the blind man can not only be pointed in the directions right, left and straight, but the entire front semicircle of 180 ° between the two ears is available for precise direction indication. If you give the back a lower tone than the front, that's 360 °. As a sound, a beep is used with advantage. In the following, this (basic) application is called Pieper

For this, however, the device must know the way. For routes, which are often committed by the blind, he can first go along the route and thereby give the device the opportunity to "get to know the route" and save as a route. The recording is preferably carried out with a laser scanner, the route being divided into sections (5-50 m), which are recorded individually. This creates a hologram of each section in which the route is stored. That is, the route measured and stored in the section passes around all the obstacles. Each section remains active and virtually frozen in the machine's calculator as long as the blind person stays in that section and is then saved. For location detection, a very distinctive and easy-to-touch point (lamppost, road sign, wall corner or gate entrance) is stored by the device in each section and its space coordinates are associated with the section in question. This point is called a fixed point. As will be shown later, the respective location of the blind is determined by measuring the line blind spot by a laser gauge and the angle this line results with the north arrow from a compass carried in the recorder. Namely, the device according to the invention must know the route (route) and the location of the wearer of the device. If it now wants to show its wearer the direction in which it should turn, it must also know its current direction of view, d. H. the direction in which the wearer of the device according to the invention is currently turning. Important here: the recording device is located on the head. The recorder reads the viewing direction from the angle it forms with the north arrow (example 2). If the blind man then walks alone, the laser scanner identifies the route in each section one after the other, keeps track of the current location on the route, recognizes the obstacles and allows the blind man to navigate past the headphones to the destination. On the way, the blind can be given standard sounds, which can be assigned to specific sections, or simply information and warnings via voice information as with navigation devices. Also to be noted places, such. As a step, can be measured in the recording so that the blind are given appropriate instructions. Conversely, the blind person could call specific objects via speech function and object recognition and let them be represented by the device according to the invention.

But it is also possible to take larger areas or entire streets on a recording device to store centrally and make available if needed. The recording device can be mounted on the roof of a motor vehicle and the vehicle can thus systematically, street by street, whole neighborhoods measured in accordance with the invention. Then the track is divided into sections. Each section is assigned a fixed point measured during recording (see below). Based on the measurements, a navigation device for the blind can be developed, in which a city map is divided into sections that are available and stored as individual computer fields. A route is then a series of computer fields. The course of the route is precisely defined in each section, ie the exact course of the route is measured in each individual section. The individual sections or several adjacent sections are then determined with respect to their GPS coordinates. It makes sense for the section coordinates to run parallel to the GPS coordinates (UTM grid). In which The route is then called by the device one section at a time. The recorder then updates, if necessary, the section that is about to be entered with respect to obstacles not present in the stored section (eg, a motor vehicle parked on the sidewalk). The carrier of the device is kept on the route by the measured location is continuously compared with the desired location.

It is also possible to use satellite images, preferably 3D images or vertically recorded aerial or satellite images, by dividing entire streets into the sections according to the invention and providing them with GPS coordinates as well as earthbound with fixed points (s, next paragraph). Example 3 shows the efficient use of satellite images. Important: Fixed points are characterized by space or surface coordinates of the section, sections (middle section) by their GPS coordinates.

If one integrates a compass into the recording device, the distance of the blind person to the fixed point and the angle formed by the line fixed point blind with the north arrow, the respective location of the blind is calculated in the relevant section. In addition, the device recognizes the viewing direction from the angle formed by the line of sight with the north arrow. With the aid of the fixed points and the compass, the blind person can be kept on the route measured in the respective section and thus reach the target entered into the device section by section. The geometrical relationships between viewing direction, location and fixed points are shown in Example 2 4 to 6 explained.

For horizontal stabilization of the recording device and a spirit level or a functionally identical instrument is installed in the recording device.

The described function of the device can be imagined as follows:
In a labyrinth is a subject. The subject is blindfolded and stereo headphones are attached. At the edge of the labyrinth stands an observer. His location is chosen so that he can see the entire labyrinth from above and also has the subject in view everywhere. The observer holds in his hand a remote control with which he stereophone sounds sent to the subject via the headphones (sometimes in the right ear, sometimes in the left ear and sometimes equally strong in both ears). The subject always follows the direction from which the sound comes and is thus guided blindfolded safely out of the labyrinth by the observer. In the present invention, the blind person is the subject and the apparatus of the present invention is the observer.

Following the same procedure, the blind person can also move in rooms or generally in buildings. However, the compass can fail in buildings. The measurement of the location is then done by measuring the distances of the blind to two fixed points, preferably room corners, as they are easy to be targeted by the laser. The viewing direction then detects the device at the angle that forms one of the lines Blinder fixed point with the line of sight.

It can also be read in for blind buildings to be entered building plans before the device. Thus, when entering the respective rooms by the blind the room dimensions are known and the room can be placed directly in the computer field. Then only furniture and other objects in the room must be detected and recorded by the recording device. In this case, it is expedient that, while the blind is guided safely through the room by obstacles through Stereophone's hearing through the beep, a standardized, periodic tone from the direction of the entrance door conveys to him the perception in which direction he is currently turning (example 2) The door or entrance because it is the path to the room where it creates an acoustic point of reference from the beginning. Such coordinate points serving orientation purposes are called landmarks in the following. In the computer, therefore, data about all objects (obstacles!) Protruding from the plane, the space or path boundaries, possibly the prepared and registered route, lie for the section or space just entered. the current location and the viewing direction of the wearer of the device according to the invention. In addition, the fixed points and the landmarks are stored. The wearer selects the target (eg via voice function), the device knows or decides the route and, in the simplest case, points the way with the beeper. You can also use the pitch for horizontal direction indication. The chamber tone "a" could then be the middle. Higher tones on the right, lower notes on the left; or the other way around.

The comparatively poor resolution in stereophony can be improved by the full semicircle between the right and left ear in the computer field only a small angle, z. B. 10 ° in the residence field is assigned. In this way you can focus with your hearing.

2nd LEVEL APPLICATION

The planar application is two-dimensional. It can be stereophonic against pitch or Stereophony are applied against dynamics. In principle, of course, dynamics against pitch can also be applied. The two-dimensional combination possibilities are in 9a , b, and e shown.

Since the pitch is most accurate (see below), the ordinate and abscissa can also be indicated by the pitch. Conveniently, the coordinate points are described by two consecutive tones played in staccato with different timbre (eg abscissa: violin / ordinate: piano).

In the mobility phase, stereophony is preferably applied against dynamics (Example 2).

Preferred in the representation of a work surface or generally in manual work, the combination of stereophonic hearing as the abscissa with the pitch as the ordinate, since the pitch of the above parameters has the lowest threshold of discrimination. The recording is also here preferably as a projection of the work surface.

A fixed point in the middle of the work surface ensures that the unit is recognized by the device at the angle blind fixed point with the viewing direction. In two-dimensional application, the fixed point may also be the center of the coordinate system, ie z. B. at the intersection of the center of the image with the sound a. By periodically sounding this tone, the orientation is substantially simplified during the activity on this work surface by the constant localization of the center of the table. The "a" sounds intermittently to center the work surface during the process described in the next paragraph.

In the 2 framed area ( 1 ) should represent a work table of 100 by 70 cm. The object (A) should be grasped by the hand of a blind man (B). The hand is marked and recognized and located by the recorder. If the blind man approaches the point A with the recording device in such a way that A moves into the center of the picture, that is, the sound f is in balance in the right and left ears, A is perceived at A '.

At the same time B moves to B '. Now the blind man brings his hand upwards ( 2 ), where successively the tone f ( 3 ) and then the sound indicating the respective height of the hand can be heard. If both successive notes are equal, ie an "f", then the hand is on the table ( 4 ) in the height of the object to be gripped. The hand now only has to be moved to the left and if the sound f is perceived consecutively in the same place, he can grasp the object. When moving to the left, the successive tones (both tones in "f") again control that the hand stays on the contour line. Of course, this whole process can be done very quickly as a normal exercise with the appropriate exercise.

According to this principle can be blind for. For example, search and find a link on the PC screen.

The difference threshold for the pitch is 0.1% in the frequency range used here. Thus, it can be estimated that an object of about 2 mm in size can be found and grasped on the above table. See.: M. Schneider "Physiology of Man" Springer Verlag 1966. Page 684 (Copy p. 684 in Appendix). In the table 62 on the same page, the frequencies are given to the tones in halftone steps

3. THREE-DIMENSIONAL APPLICATION (stereophonic hearing + variation of pitch + tone dynamics)

The three-dimensional application is used with advantage representation of sound images or in the acoustic representation of the movement of objects. In particular, the blind can thus recognize objects approaching him.

The three-dimensional shape can also be used to direct the blind's attention to a specific point in the room. If in the 2 the object for which A stands would not be on the same plane as B, but farther away in space, A would have to be played softer than B, according to its distance from the plane passing through B. The blind man would then have to do his hand first move away until the hand (B) is at the level of A and both tones have the same volume. Then, as in 2nd and in 1a be continued.

As example 1 shows, whole images can also be reproduced with the device according to the invention. In the acoustic reproduction of such sound clips either all sounds can be played simultaneously as a chord, with the sounds of the individual instruments coming from different directions according to the position of the objects they represent; or the score is played from left to right, or rather from the left ear to the right ear, as is customary in music. In this way of playing, the length of the sound can indicate the width of the respective object. It can be seen that in the method according to the invention the time can be used as additional coordinate. As in music.

This in 1 The image displayed is acoustically reproduced three-dimensionally, with the mountain in the foreground ( 5 in the picture and in the score) is played and all other objects with increasing distance ever quieter.

Instead of drawing entire sound images, as shown in example 1, individual objects can also be acoustically displayed in size and shape before the blind person (eg only the mountain in the foreground). Even in the way standing objects can be represented in real size, if you z. B. the sound settles at eye level. If the corresponding tone is higher, the object is larger, if it is deeper, the object is smaller. The width of the object can be described by the note value or the duration of the tone.

It can be seen that in contrast to the simple indication of direction under 1. the blind person no longer "blindly" follows the tone guiding him but can very well perceive his environment and, for B. himself can decide on which side he walks around an obstacle. Of course, the device continues to know its route and can guide the blind man back to the "right path" if the deviations are too great due to the stereophonic beeping used in 1..

It turns out that with the three-dimensional representation whole sound images of the surroundings of a blind person can be created. These soundscapes have to be constantly updated when walking along a route with each new location, if the blind person wants to perceive a "full picture" of his surroundings. In a three-dimensional representation, a perspective image can also be generated. However, this is not always necessary for his orientation. Instead, it may be advantageous to head for a prominent point (a section of the image) which is at a medium distance (about 50 m) and which, as in 5 can be characterized by tone sequences (sound logo) and whose tone sequence then periodically sounds as a direction sign. Such points can already be measured when creating the route, with their space or area coordinates in the sections that belong to this point, recorded and stored together with the tone sequence. These points then correspond to landmarks that people with normal vision notice along a route to find their way around (see Example 3). However, selected fixed points can also serve as landmarks at the same time. If they are not fixed points at the same time, landmarks are normally not measuring points for the laser but only coordinate points recorded in the computer.

In practice, the three applications described run mostly parallel. For example, a blind person who walks along a route can be guided by the beeper and at the same time hear the rising and falling sound logo of a landmark on the way (as long as he does not deviate from the route, the beeper can be quiet). The blind man can also pause and create a sound from the surroundings. So the blind man safely walks in his sound world and finds his way.

For a better understanding, the device components required for the method according to the invention are to be described once again individually and their tasks explained in connection.

The device consists of a recording device, a computer and a playback device.

The recording device, which is preferably carried on the head, consists of an optical recording device, for. As a camera or a laser scanner for producing a 3D image from the environment of the wearer of the device, a laser or ultrasonic distance measuring device for measuring the distance of the carrier to the fixed points and a compass for determining the location and the viewing direction.

Furthermore, the recording device includes a spirit level for horizontal stabilization and an angle measuring device.

• – aus der Entfernung des Trägers zu den Fixpunkten und/oder aus dem Winkel der Blickrichtung mit dem Nordpfeil den Standort und die Blickrichtung des Trägers berechnen und bei wechselndem Standort oder Blickrichtung das Hörfeld anpassen.
• – Routen über ein angeschlossenes Navigationsgerät herunterladen, abschnittsweise aufrufen, über das Aufnahmegerät aktualisieren den Träger in jedem Abschnitt auf der Route in der Bewegungsphase fortlaufend einmessen und ihn akustisch durch Richtungssignale des Piepers navigieren.
• – Aufzeichnungen von Aufnahmen speichern und bei Bedarf aufrufen.
• – Über Zusatzgeräte Baupläne einlesen und der erfindungsgemäßen Verwendung anpassen (Maßstab, Bestimmen der Fixpunkte, Reihenfolge der zu betretenden Räume)
• – Über einen geeigneten Speicher an Tönen und Klängen verfügen
• – Sound-Logo oder Klänge Objekten und Landmarken zuordnen und aus der relativ zur Blickrichtung des Trägers passenden Richtung und zum Standort passenden Dynamik erklingen lassen, d. h. das Hörfeld zu dem jeweiligen Standort und der Blickrichtung errechnen.
• – Zwei- und dreidimensionale Klangbilder aus der Perspektive des Trägers elektronisch erstellen.

The computer generally has the task of transferring the recording into a projection of the recorded plane or the recorded space, the computer field, and to make certain line points or directional angles or area coordinates (in two-dimensional application) or spatial coordinates (in three-dimensional application) acoustically perceptible according to the invention. In detail, the calculator must:

• - From the distance of the carrier to the fixed points and / or from the angle of the line of sight with the north arrow calculate the location and the gaze direction of the wearer and adjust the field when changing location or line of sight.
• - download routes via a connected navigation device, call sections, continuously update the carrier in each section of the route in the movement phase via the recording device and acoustically navigate it by means of direction signals from the beeper.
• - Save recordings of recordings and call them up if necessary.
• - read in blueprints via ancillary equipment and adapt to the use according to the invention (scale, determination of fixed points, sequence of rooms to be entered)
• - Have a suitable memory of sounds and sounds
• - Assign sound logo or sounds to objects and landmarks and from relative to Viewing direction of the wearer sound appropriate direction and the location appropriate dynamics, ie calculate the listening field to the respective location and the line of sight.
• - electronically create two- and three-dimensional sound images from the perspective of the wearer.

The playback device is a stereophonic hearing aid such. As a headphone that transmits the inventively created data of the computer as sounds and / or sounds to the ears.

Above all, the device according to the invention serves to transmit acoustic information from the environment and has an enormous potential for this purpose. It is able to display descriptions of surroundings, characterization and localization of objects, ways in directions, approach of objects and objects to the blind. It even allows a full soundscape of the environment. For this purpose, the parameters of stereophony, dynamics, pitch, tone sequence, tone length, tempo of the tone sequence, rhythm, timbre and polyphony - ie the entire range of variation of the music - are available to the device. This is subtly differentiated from the human ear and perceived with great accuracy.

Certainly, the device according to the invention is complicated to handle and it takes a lot of practice. Through further development, especially in the application, blind people can convey information about their surroundings in the future, which go far beyond the examples shown.

Due to its ability to guide its wearer on a route, the device according to the invention is also suitable for navigation of persons who have orientation deficiencies due to dementia. During the progressive development of such diseases, there are long periods in which the patient still has essentially his mental abilities, but lives in constant fear due to memory problems outside his home, to find no more home. Here, the device according to the invention can be of great help.

This invention is not intended to replace the blind stick. The blind are used to it and it gives them great security in locomotion. The main task of the method according to the invention begins beyond the reach of the blind stick.
After about 1.50 m

PATE EXAMPLES

Example 1 Development of a sound image

3 , shows in a staff ( 1 ) a beach ( 2 ) (yellow / violin) with sea behind ( 3 ) (blue / trombone) and overlying sky ( 4 Oboe). In front of it rises a wooded mountain ( 5 ) (green / French horn). At the far right of the sea a sailboat can be seen in the distance ( 6 ). Acoustically represented by a short flute sound.

The picture is in a staff with treble clef ( 7 ). As in the first drawing, the same coordinate system is underlined again. It can be tapped on the upper color contours of music notes that are played as a tone sequence on the specified instruments. Below the drawing is the corresponding "score" ( 9 ) with the projection of the notes belonging to the pixels (same numbering). To use the same scaling, all instruments are in treble clef ( 8th ) set. It can be seen that lines in the picture above are represented by high and in the picture by lower tones.

The acoustic reproduction of the image can now be done by the score from left (left ear) to right (right ear) of the specified instruments played out at a moderate pace.

If all instruments play the recorded notes equally loud, the result is a two-dimensional representation. If the sounds are played with different volumes (dynamics) according to the distance of the objects representing them, the perception becomes three-dimensional. Then the green mountain in the foreground of the Horn forte ( 5 ), the beach behind the violin ( 2 ) mezzoforte and the sea from the trombone ( 3 ) played piano. The sailboat in the distance is represented by a short piano sound on the flute ( 6 ). The sky can be interspersed with oboe tones ( 8th ), which represent sheep clouds, are indicated.

In 1 , you can also see that wide objects are affected by long note values (beach: 2 )), small ones by short note values (sailboat: 6 )) become perceptible. Shapes are represented by tones being taken along the contour of the form in the staff (Berg: 5 ) and written down as grades. According to this principle, it is also possible to represent individual objects which have been filtered out of a picture.

Certainly only after some practice from this - played in about three seconds - "piece of music" to perceive the environment shown. But it also took a lot of practice to learn braille. However, a picture may not be much more complex if details are still to be perceived. This is mainly because the ear can not focus - like the eye. However, the music offers many possibilities to draw attention to special objects in such a sound image. Examples include: dissonance or rhythmic effects such as syncopation, triplets, hemiols, etc.

Example 2 Navigation and Orientation (Fig. 4)

A blind person equipped with the device according to the invention enters a room ( 1 ) through the door ( 2 ). In the middle of the room is a table ( 3 ). At the door ( 2 ) he stops briefly so that the scanner can record a hologram of the room. Useful for orientation is to let the coordinates of the hologram run parallel to the walls. The laser measuring device aims at the opposite corners of the room as fixed points ( 8th and 9 ) to determine the location of the blind and possible routes in the room. At the same time, the device measures the angle between the line of sight and the blind line to one of the fixed points (the device selects a fixed point for the determination of the line of sight and remains during the stay in this room then also at this fixed point as a reference point for the line of sight) always to know the current direction of the blind person in the room. The blind man wants to go to the opposite side of the room. He sets in motion, the laser measuring device follows its position and the device steers it around the table with the beeper. At the same time, a "sound logo" sounds at regular intervals, which is generally assigned to doors. This sound logo is also transmitted stereophonically to the headphones and becomes quieter as the blind man moves away from the door. To distinguish whether the door is in front of him or behind him, the logo, the door behind him, is played deeper than if it were in front of him. The blind man now knows in which direction he turns in the room. He can familiarize himself with the geometry of the room and move independently, and if he wants, he can go out of the room on his own. Meanwhile, the device according to the invention always knows and monitors the position and the line of sight of the blind and the beeper keeps him from colliding with the wall or the table.

4 , is a snapshot: the wearer of the device ( 4 ) is - seen from the door - behind the table and turns, as the directional arrow ( 5 ) points to the corner to the right of the door. Its location is calculated from the length of the lines carrier ( 4 ) to the two fixed points ( 8th and 9 ) From the direction of the door ( 7 ) he periodically hears the corresponding logo at a volume corresponding to the distance and locates the door (when entering the room the volume has decreased continuously with the removal of the door). He begins to move and is left by the beeper ( 6 ) so as not to bump into the table. The computer has identified the route to the left of the carrier around the table as the nearest way to the door and points to the resting point 6a as acoustically by the beeper to be controlled point.

5 , shows (for simplicity in a rough grid) the configuration of 4 , in the calculator. In this case also the locking points are drawn, on which the directional arrows are directed ( 5a For 5 . 6a For 6 . 7a is the detent point in the middle of the door, which the device used as a reference point for the logo door when the room was occupied). All other numberings as in 4 , Note: the resting point 5a , which points in the momentary line of sight, is calculated from the angle ( 12 ), the line carrier fixed point ( 8th ) forms with the viewing direction. Important: the configuration of the room with its outer boundaries and the furniture remains unchanged in the computer as long as the wearer of the device is in the room.

5a shows that to the in 5 described location and viewing direction the field.

In 6 , are the listening directions of Pieper ( 6 ) and logo door ( 7 ) as they are from the in 5 calculated configuration shown in a 180 ° semicircle. Previously, the wearer of the device turned his head towards the door. At the head position at 13 the device believes that its wearer wants to leave the room and leads him around the table. At this moment, the logo door are in a semicircle ( 7 ) and the beeper ( 6 ) to listen. If one forms the vertical of the intersection of the arrows with the semicircle on the baseline, one obtains the volume distribution of Pieper ( 6c ) and door logo ( 7c ) on the two ears ( 11 and 12 ). The volume distribution out of the semicircle is just a suggestion. It is recommended to set the volume distribution between the two ears individually for each wearer of the device according to the invention. In 4 to 6 are the directional arrows 6 and 7 consistently marked and run parallel on the page in all figures. They show these directional arrows of the geometric conditions ( 4 ) via the electronic record ( 5 ) to the acoustic representation ( 6 ).

It could also be associated with a standing in the room person or object, a sound logo, which (r) then make correspondingly noticeable and could be detected and located by the blind.

This application example can be applied to any number of situations and to important objects in everyday life. Applies the above sound Logo generally for doors, so you can z. B. set a specific logo for traffic lights, the blind allows the crossing of a road in the right direction.

If you develop a specific sound logo for important objects with a dictionary for sound logo, the blind person, navigated by the beeper, can perceive these objects as they pass by, distinguish them and recognize their position and viewing direction in relation to these objects. In the ideal case, these objects are also the landmarks measured in the route or fixed points serving as landmarks. Thus, blind people are not only navigated by the beeper, so they are not led "blindly", but consciously orient themselves in the environment. Especially important: if the route is done more often, you can see individual places and know where you are. We know each other!

Example 3. Development of a route based on satellite images

7 shows a satellite image with road bifurcation and visible sidewalks ( 8th ). First, on the PC in the satellite image the route ( 1 ) and then into sections ( 2 ) divided. In this case, the path limitations such. Curb on one side and house wall on the other side. Then the fixed point are selected on site, measured in the sections and incorporated into their coordinate systems.

On this occasion, even on the satellite photograph not visible obstacles or hidden surfaces are measured later in the route.

The fixed points are a house corner ( 3 ), a street lamp ( 4 ) and a traffic light ( 5 ). The fixed points serve here simultaneously as landmarks. Below the picture is the length measure indicated ( 9 )

If a wearer of the device according to the invention now walks the route along the road, section after section is called and remains active in the computer as long as the carrier is in the relevant section (that is, the configuration of the section with the adjacent sections remains unchanged). He himself is only guided by the beeper and hears if necessary additionally the logo of the for the or just passed sections. He hears the logo from the direction in which the fixed point or the respective landmark is located. It gets louder as he nears the point, playing deeper as he passes by because he then hears it behind him and goes down until he comes within range of the new logo, which he initially hears softly and from another direction. The logo not only gives the blind man orientation, but also structures his route by giving a certain distance a recognizable and perceptible impression of the blind in the direction and distance.

On the sidewalk a vehicle was parked ( 6 ), which was not present on the satellite picture. It stands directly on the saved route. The entrained recording device detects the unsaved obstacle, measures it in the section, changes the route and guides the blind man around the obstacle.

8th shows in detail the connections of three route sections ( 1 ) with route ( 2 ) and path limitations ( 3 ). The scale is 1: 200, the distance he rest points is 1 m ( 4 ) for the schematic representation deliberately coarsely chosen. Each section has a fixed point ( 5a c). The coordinates for the three sections are continuous. At the place of the direction changes of the route are the waypoints ( 6a c). At the waypoint 6b is the location of the device or its carrier. He turns in the direction from which he comes 6a - 6b , what through the angle ( 7 ), this direction with the north arrow ( 9 ) can be read. The location itself can be determined either by measuring the line 5b - 6b together with the angle that this line with the north arrow ( 9 ) or by measuring the two lines 5a - 6b such as 5b - 6b be determined. Since every movement of the head results in a change of the auditory field, the head should be kept as calm as possible in the mobility phase and the orientation of the head, the direction of view, should correspond to the direction of movement.

At the rest stop 6b will also change the direction in the direction 6c triggered by the beeper. By controlling the angle between north arrow and the line 6b -C ( 10 ) the device holds its carrier on the line 6b - 6c ,

Example 4.

In 9a -E the parameters pitch, stereophony and dynamics in different combinations are shown by way of example as area or space axes.

QUOTES INCLUDE IN THE DESCRIPTION

This list of the documents listed by the applicant has been generated automatically and is included solely for the better information of the reader. The list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited non-patent literature

• M. Schneider "Physiology of Man" Springer Verlag 1966. Page 684 [0043]

Claims (10)

A method for the acoustic perception of points and / or lines formed by points in the plane or in space, characterized in that the plane or space (field of residence, working field) is recorded by an optical device, calculated from the recording of their projection and electronically as Coordinate system (computer field) is recorded and the points and / or lines formed therefrom acoustically by at least one of the coordinates stereophony, sound dynamics and pitch (field) are described. A method according to claim 1, characterized in that the resident field or working field by a laser scanner or a camera, which is preferably located on the head of the wearer, recorded and recorded as a projection of a device belonging to the device as a computer field and the inventive acoustic perception of the ear done by headphones or earphones Method according to one of claims 1 and 2, characterized in that the surrounding space or the surrounding plane of a visually impaired person is confined in a contoured section, the residence field, the position of the visually impaired person in the occupied field from the measurement of the distance from the visually impaired person to two points whose space or area coordinates are measured in the resident field (fixed points) and whose surfaces or spatial coordinates are part of the resident field, but which need not necessarily lie in the resident field, is calculated and that the distance measurement by means of laser or ultrasound measuring device takes place and that the viewing direction Furthermore, the position and viewing direction of the visually impaired person in the field of residence is recorded by the data carrier in the device, the computer field, and the sounds and sounds according to the invention are recorded in the angle formed by one of the lines of the visually impaired fixed point e be perceived as a listening field from this position and this viewing direction. Method according to one of claims 1 to 3, characterized in that in the recording device, a compass is integrated and the position of the visually impaired from the distance between him / her and a fixed point and the angle that forms the line Fixpunkt-Sehbehinderter with the north arrow, and the viewing direction is calculated from the angle between the north arrow and the viewing direction, and the listening field is perceived from this position and viewing direction. Method according to one of claims 1 to 4, characterized in that the computer field remains unchanged, as long as the carrier of the device is in the corresponding residence field and a change in position of the carrier in the residence field, the same change in position in the computer field together with the changes described in claims 3 to 5 of the auditory field has the consequence. Method according to one of claims 1 to 6, characterized in that electronic records of construction plans or aerial and satellite photographs are divided into residence fields and provided with fixed points, in a further step in the residence fields a route is measured and the visually impaired by stereophonic transmission of acoustic Directional signals are held on this route, wherein he / she follows the direction from which the signal comes. Method according to one of claims 1 to 7, characterized in that different sounds are assigned to different objects, wherein the different timbres are preferably generated by different musical instruments. Method according to one of Claims 1 to 8, characterized in that objects to be highlighted on the route or in a section or on a worktable are identified by a sound logo (catchy sound or short melody) and that preferably this sound logo when approaching the corresponding object louder sounds periodically and after passing the object with increasing distance becomes quieter again (dynamics: crescendo / decrescendo) and that preferably the sound logo sounds higher or lower when approaching the object than when removing the object. Device for orientation through the sense of hearing, characterized in that the device consists of 1.) an optical recording device, preferably a laser scanner or a camera, 2.) a distance measuring device, preferably a laser or ultrasonic measuring device, 3.) a compass, 4 .) a spirit level, 5.) one in one or two levels measuring protractor, 6.) a computer and 7.) an acoustic transmission device, preferably a headphone or earphone, and that the components 1. to 5. preferably on Be worn head. Apparatus according to claim 10, characterized in that the recording of the residence field is carried out separately and the device uses or contains only the components 2 to 7.

Images