EP1405121A1

EP1405121A1 - Information system which detects an image of the outside world on the retina

Info

Publication number: EP1405121A1
Application number: EP00972696A
Authority: EP
Inventors: Roland H. C. Physoptics Opto-Elect. GmbH EBERL; Heinrich A. Physoptics Opto-Elect. GmbH EBERL
Original assignee: Dickerson David
Current assignee: Dickerson David
Priority date: 2000-10-07
Filing date: 2000-10-07
Publication date: 2004-04-07
Also published as: WO2002031577A1; AU2001211340A1

Abstract

The invention relates to an information system comprising a signal detection system (350D) which detects an image of the outside world represented on the retina (380) of one eye; an information device; an output device which provides information in conjunction with the information device according to the signals thus detected. The signal detection device comprises a scanning device (350D) which detects at least partially retinal reflex images of the retina. The provision of information does not contain any information projections onto the retina.

Description

INFORMATION SYSTEM

description

Field of the Invention

The invention relates to an information system based on a visual field detection device which detects visible light from the naturally perceived visual field of an eye, and a corresponding method for making information available.

Related registrations

Optical devices are known from German laid-open publications DE 196 31 414 AI and DE 197 28 890 which enable the retinal reflex image to be recorded and additional images to be superimposed in the eye. Two German patent applications, the filing date and applicant of which correspond to that of this application, describe further developments of these optical devices as well as systems which supplement or even replace these devices. In particular, it describes the adjustment of the above-mentioned optical device and a system which is also able in a new way to project images onto an eye. The latter system is based on a projection of an image onto the retina of the eye, which takes place at the same time, but lagging behind a scan-like detection of the retinal reflex image.

Since the devices and systems described in the abovementioned applications are preferably designed in the form of glasses, for the sake of simplicity they are also referred to below as a glasses system. This designation does not imply any restriction. Of course, other embodiments of such devices and systems in the contexts described below can also be used instead of the "spectacle system". DE 196 31 414 AI addresses numerous possible uses of the glasses system disclosed therein, without these being able to be described in more detail. A co-inventor of the original glasses system has now, in collaboration with a research team, investigated the possible uses of the above-mentioned glasses systems in more detail. From considerations of the economic implementability, further developments and modifications of the previously disclosed glasses systems have arisen, which are registered within the scope of this and two further patent applications of the same filing date and the same applicant. System features developed by the research team that recur in many of the described embodiments include that the system: at least partially captures a corneal reflex image of the eye; - directs part of the light incident on the eye into a sensor device by means of a spherical or spherically acting reflection layer; the retinal image is determined via the degree of oxidation of the retinal caps and / or the retinal rods; - only partially records a retinal reflex image; and / or a visual field detection device which detects visible light from the naturally perceived visual field without acquiring a retinal reflex image.

For the purposes of process economy, the content of these three patent applications was not divided according to these system features. Instead, each of these three applications relates to a respective, summarizing basic concept. These are: - the design of the glasses system as an information system which provides information depending on a naturally perceived visual field of a person; the design of the eyeglass system as an information system which displays information as a function of provides signals, but does not project them into the eye from which the signals were acquired; and the design of the glasses system as an information system which provides information as a function of signals acquired from one eye, the information being projected at least partially into the eye but the signals not being recorded in the manner known from DE 19631414 AI ,

It should be noted that many applications of the designed eyeglass systems are based on a combination of several of the above-mentioned basic concepts, which results in a natural interweaving of the associated three applications. Accordingly, there is some redundancy between these three applications. However, in the case of details, which primarily deal with only one of the system concepts, we hereby explicitly refer to the application relating to this basic concept.

State of the art / technical background

Many everyday cases are known in which it would be useful and / or desirable to immediately have information that goes beyond our personal knowledge and senses. Examples of this include searching for a flush-mounted electrical cable in a wall, navigating in a foreign city, collecting wild mushrooms and examining a potentially dangerous object using a remote-controlled robot.

The strong dependence on sighted people on their visual perceptions clearly contributes to the fact that additional information can only be provided with difficulty. Because the fact that sighted people perceive primarily with the eyes makes it necessary in many cases that the additional information is either fed through the eyes or determined on the basis of the information seen. With a feed over the eyes must however, eye alignment must be carefully considered to avoid proper "placement" and "blurring" or "blurring" of the information being fed. In addition, the information should in many cases be made accessible without deliberate movement of the eyeballs; a driver may have a map on his lap, but is reluctant to look away from the road.

Due to their binding to solid media, e.g. Paper, CRT and LCD screens, etc., previous visual information systems have not been able to adequately meet the comfort needs of a sighted person. Until now, non-visual information systems lacked the link to what they see, which is a matter of course for sighted people.

More information on the prior art is contained in DE 196 31 414 AI, the introduction of which describes several modern information systems, in particular from the military sector.

Summary of the invention

The aim of the invention is to provide an information system whose information processing meets the natural needs of a sighted person in an unprecedented manner. It is a further object of the invention to provide such an information system which has been improved over the prior art in terms of implementability and economy. The aim of the invention is also to provide corresponding methods for making information available.

According to the invention, this aim is achieved by the information system according to claim 1 and the method for providing information according to claim 13. Preferred embodiments of the invention are described in the subclaims. In its most general form, the information system according to the invention comprises a signal detection device which detects signals reflected back from an eye having a retina, an information device and an output device which, in cooperation with the information device, provides information in correlation with the detected signals. The information is preferably made available as a function of the detected signals and / or as a function of visible light detected from the naturally perceived visual field.

One of the glasses systems discussed above is preferably used as the signal detection device, in which a scanning scanning device at least partially detects a retinal reflex image of the retina. A modification of this scanning device, which detects light reflected on the cornea of the eye instead of the retinal reflex image, is particularly advantageous in infrared applications, since the cornea strongly reflects light with a wavelength of approximately 1.1 μm. By recording the chemical changes in the rods and / or suppositories, it is also possible in principle to make correspondingly usable statements about the image incident on the retina.

The inventors of this invention have also found that a detection of the field of view which is complementary to the detection of signals reflected back from the eye has particular advantages. For the purpose of such a complementary detection, the visual field detection device and / or the information device of the information system according to the invention preferably comprises an essentially confocal, sparingly or spherically acting reflection layer which deflects part of the light directed onto the eye into a sensor device for detection. Due to the fact that the reflection layer is many times more reflective than the retinal or corneal reflex, it becomes an essential factor for photosensors of the same sensitivity Light gain achieved. Correspondingly inexpensive photosensors could also be used in the sensor device. It can therefore be advantageous if the light falling on the eye is not detected only partially or not at all via the retinal reflex.

Depending on the target application, not all spatial areas of the visual field need to be captured. For example, in an application in which additional information regarding an object aimed at by the eye is made available by the information system according to the invention, it could be sufficient to detect the light falling on the retinal pit (fovea) and to subject it to a pattern recognition or other analysis. This is because an object targeted by the eye is typically imaged on the retinal pit, which represents the area of sharpest vision. The detection of the light falling on this part of the retina would thus possibly be sufficient to be able to determine a sufficient number of characterizing object features.

It is also useful if only a limited spectral range of the light falling on the eye is detected. If, for example, the infrared light falling on an eye is detected, the orientation of the eye can also be determined at night and / or valuable information can be obtained from the visual field.

Accordingly, any restrictions regarding the detection of the light falling on an eye can be expedient. In particular, restrictions of the recorded spectral range, the recorded field of view and the recorded time segments are possibly applied.

For the purpose of redundant or stereoscopic image acquisition, the device of the information system according to the invention intended for this purpose can be designed to acquire the light falling on several eyes. Depending on the area of application, the eyes do not have to necessarily belong to a single person. For example, it would be possible to import the images perceived by the eyes of several firefighters plus position and fire strength information determined from an infrared spectral analysis of the images onto monitors in an operations center.

In ophthalmology, a distinction is made between the terms "visual field" and "visual field". A visual field is the part of a room that can be captured with the eye still. A field of view is the area that can be seen with the eyes. Thus, as in the rest, the visual field is to be understood as the cause of the light that naturally falls on an eye.

The visual field detection

Due to the integration of a visual field detection device, the information system is able to convert visible light from the visual field assigned to the eye into a quality, i.e. with a sensitivity, a resolution, a sharpness, etc., which far exceeds the natural perception of the eye. In addition, the correlation according to the invention of the provision of information with the signals detected by the signal detection device makes it possible to treat corresponding parts of the detected light during processing that occurs in the course of the provision of information as if they were reflex images acquired from the eye, i.e. as if they were what you actually saw. Such an embodiment of the information system according to the invention thus combines the advantages of an information system that obtains high-quality visual field information directly from the visual field with the advantages of an information system that extracts actual visual field information from the eye.

The correlation of the provision of information with the detected signals reflected back from the eye can, for example, be This is done by capturing several image points of an eye reflex image, for example a cornea or retinal reflex image, which are connected to corresponding image points from the detected field of view via an evaluation device. A gaze direction of the eye determined by the detected signals can also serve to create a correlation between visual field information obtained from the detected visual field and what is actually seen. However, as described below, the correlation can also consist of projecting visual field information obtained onto the retina in a manner correlated with the seen.

Of course, the field of view detection device need not be limited to a detection of the field of view, but can also include a partial or complete detection of the field of view, which includes an at least partial detection of the field of view.

The high quality of the image captured from the field of view or visual field can also serve as the basis for an oversensory information presentation. For example, visual field information could be obtained from the detected field of view light and projected onto the retina in such a way that the image perceived by the eye appears at least partially sharper, closer, more wide-angle or otherwise supernatural.

The invention provides an information source, which can include a database, a sensor system, an information network connection and / or an evaluation device.

A particularly interesting embodiment of the invention comprises a sensor system as a source of information. Because this enables a supersensible perception to be brought into connection with what is seen. In the aforementioned example of searching for an electrical line, the information source according to the invention could Magnetic field sensors that are able to locate metallic lines with respect to a known coordinate system, for example the detected field of view. It would thus be possible, for example by means of suitable image processing software, to superimpose the course of existing electrical lines by means of a projection of an additional image as described in the above-mentioned patent applications onto the image seen by the eye.

All types of known sensors are suitable for use as a source of information, in particular when the sensor is activated or queried on the basis of the captured light image. For example, when testing an integrated electronic circuit, it would be possible for the position of this line to be calculated on a finished chip after a targeted view of a line on a circuit diagram of the circuit and a keystroke, so that the current and voltage values of the line by means of a contactless one Measuring device detected and presented to the user via the glasses system.

An example of an information system comprising a database and an information network connection would be an in-house mail distribution system in which files are provided with barcode stickers which uniquely identify the respective file. If a file is to be sent in-house, the sender enters, for example, the extension number of the recipient and a code that designates the file using software that stores this data in a database in one of the many known ways. During a later sorting of the file, the identifying barcode is detected via the glasses system worn by a mail distribution employee, for example with a targeted look and a button click, and recognized by a recognition device or software. The post-distribution-relevant data assigned to the file is fetched from the database via radio link with an internal data network and, after preparation, sent to the mail distribution system via a suitable output device. announced, for example as an announcement via headphones "Mr. Schmidt, finance, Building G, 3rd floor, room 310".

An evaluation device is to be understood to mean all types of evaluation devices, in particular image processing devices. Such evaluation devices have also been discussed in the examples above.

According to the invention, the information can be made available in a tactile, visual, audible, smellable and / or flavored manner. It is an object of the invention to enable information to be provided that meets the needs of a sighted person in a way never before achieved. This can include that the information can be made available to humans in a suitable manner, that is to say using one or more of the five senses. However, the information can be made available in any way and does not require a specific addressee. For example, the information can be made available to a further system or can be emitted into the surroundings by an optical or acoustic output device. Already by the dependency according to the invention between the provision of information and the light image falling on the eye, it is achieved that the connection expected by the seeing person exists between what is seen and the information made available.

This dependency is taken into account by the device according to the invention when determining the information, when making the information available or during both of these inherent processes. Examples of taking this dependency into account when determining the information are given above. When making the information available, this dependency can be taken into account, for example, in that the information is superimposed on the viewed image by means of a back projection into the eye in such a way that a temporal, color rather, spatial, contrast-related, or other meaningful connection between the information and the image viewed. In particular, the dependency can be that the captured light image is used to determine the position and orientation of the eyeball, so that an image projected onto the eye for the purpose of providing the information appears to be fixed when the eye moves seems to move along with a movement of the eye or seems to move during a movement of the eye according to a predetermined course. In particular, the effect of the saccade movements of the eye on these processes can be taken into account or compensated for.

Of course, the information does not necessarily have to be given to a person, but can also be made available to another system.

tracking

It is therefore possible with the information system according to the invention to determine the position and orientation of at least one eye quickly, precisely and with little effort, for example with a determination rate of 100 Hz, a positional accuracy of a few micrometers and a device with a portable design. Using the information system according to the invention in the dynamic determination of the orientation of the eye, the processing can take place so quickly that the accuracy is not falsified by the saccade movements of the eye. This is achieved in that the information system has a signal detection device that does not touch the eye and detects signals that are reflected back by the eye. Reflectable signals, for example sound or electromagnetic signals, allow high-frequency detection, so that the processing speed is mainly determined by an evaluation device included in the information system. In the field of signal processing hardware, however, are significant Progress has been made in recent years in terms of work speed, power consumption and system size. The inventors' research has shown that an information system of this type can achieve the desired processing speed.

Typically, part of the information system itself serves as a reference coordinate system. However, it is also possible that the information system merely represents a reference coordinate system in another reference coordinate system, and that the relationship between the reference coordinate system and the reference coordinate system is determined, for example, by the evaluation device or another mechanism.

The signal detection device preferably detects light reflected back by the eye. Light forms an excellent medium for the transmission of the signals reflected back by the eye, since the operational capability of the eye requires the presence of light. However, there is a superimposition of the visual field signal information transmitted by the light from the visual field with the eye reflex signal information, which is produced by the reflection on the eye. This different information can, however, be distinguished using known signal processing methods and used sensibly to determine the orientation of the eye. This is particularly the case when the signal transmission medium comes from a signal source belonging to the information system, which applies a predetermined signal to the medium before it is reflected on the eye.

Similarly, the detection of signals from signal transmission media other than light can also be advantageous. For example, components for generating and recording sound waves are available on the market in various inexpensive and compact versions. Such components can also be implemented as integrated elements of an integrated circuit. Similar 1577

13

Considerations apply to the invisible frequency ranges of electromagnetic waves.

Although not fully researched, it is conceivable that an information system with a plurality of signal detection devices that detect signals from different media or spectral ranges could have improved system properties. This knowledge is the basis of the considerations that the evaluation device could also take on other system tasks in the event of an underload, and that the signal processing carried out by the evaluation device depends strongly on the information content of the signal to be processed. It would be advantageous to base the information system on a signal acquisition that only requires little work from the evaluation device for evaluation, but may not alone provide the basis for sufficient accuracy, and this low-processing signal acquisition through the results of an accurate and processing-intensive but only intermittent signal acquisition to be completed or calibrated so that the necessary accuracy is achieved at all times.

Retinal reflex detection has proven to be useful, in which the retinal reflex of natural or artificial light is intermittently or partially detected as a signal reflected back from the eye. A complete detection of the retinal reflex is both time-consuming and labor-intensive. On the other hand, it makes sense to record the retinal reflex insofar as it allows a direct determination of the perceived visual field in relation to the retina. Because, as mentioned above, processing the detected retinal reflex reveals both retinal features, such as the fovea centralis or the blind spot, and the reflection image of the light falling on the eye. The blood vessel network in the choroid is also visible when the retinal reflex image is appropriately prepared, which provides a very good basis for determining the orientation of the eyeball. Will that Retinal reflexes are therefore detected intermittently or partially, so the processing effort can be reduced, while an exact determination of the relation of the perceived visual field to the retina is not dispensed with. Of course, retinal features can be tracked without retinal reflex detection. For example, the blood vessels of the choroid can be recognized by their heat radiation visible in the infrared range.

The present invention is described below with reference to the description of exemplary embodiments with reference to the drawing. Many features of the invention are explained in the close connection of the respective, specifically illustrated exemplary embodiment. Of course, each individual feature of the invention can be combined with any other feature, as far as the resulting combination does not lead to a result which the person skilled in the art can immediately recognize as senseless. This statement does not concern the determination of the industrial scope of protection of this patent application / patent if a scope of protection according to applicable law is conferred by the claims.

Show it:

Figure 1 shows an information system according to a first embodiment of the invention;

Figure 2 is a detailed cross-sectional view of an eye;

FIG. 3 shows a known embodiment of an interactive glasses system in which a signal detection device in the form of a scanning eye scanner is provided;

Figure 4 shows a known embodiment of an interactive goggle in which an output device is provided in the form of a scanning projection device; FIG. 5A shows interactive glasses according to a first exemplary embodiment;

FIG. 5B shows a detailed drawing of a combined signal detection and projection device shown in FIG. 5;

FIG. 6A shows interactive glasses according to a second exemplary embodiment;

FIG. 6B shows a detailed drawing of a combined signal detection and projection device shown in FIG. 6A;

FIG. 7A shows interactive glasses according to a third exemplary embodiment;

FIG. 7B shows a detailed drawing of a combined signal detection and projection device shown in FIG. 7A;

FIG. 8 shows interactive glasses according to a fourth exemplary embodiment;

FIG. 9 shows interactive glasses according to a fifth exemplary embodiment;

FIG. 10A shows a top view of a pair of glasses according to a sixth exemplary embodiment;

FIG. 10B shows a front view of glasses according to a sixth exemplary embodiment;

FIG. HA shows the naturally perceived visual field of a user of an information system designed according to a seventh exemplary embodiment; FIG. 11B shows the naturally perceived visual field of a user ^{• of} an information system designed according to a seventh exemplary embodiment;

Figure 11C is a schematic representation of a scan pattern;

Figure HD is a schematic representation of a modified scanning pattern;

FIG. 12A shows the naturally perceived visual field of a user of an information system designed according to an eighth exemplary embodiment;

FIG. 12B shows the naturally perceived visual field of a user of an information system designed according to an eighth exemplary embodiment;

FIG. 12C shows the naturally perceived visual field of a user of an information system designed according to an eighth exemplary embodiment;

FIG. 12D shows the naturally perceived visual field of a user of an information system designed according to an eighth exemplary embodiment;

FIG. 12E shows the naturally perceived visual field of a user of an information system designed according to an eighth exemplary embodiment;

FIG. 13A shows the naturally perceived visual field of a user of an information system designed according to a ninth exemplary embodiment; FIG. 13B shows the naturally perceived visual field of a user of an information system designed according to a ninth exemplary embodiment;

FIG. 14A shows an information system according to the invention in accordance with a tenth exemplary embodiment;

FIG. 14B shows an information system according to the invention in accordance with a tenth exemplary embodiment;

FIG. 15 shows an information system according to the invention in accordance with an eleventh exemplary embodiment;

FIG. 16 shows a schematic illustration of an information system according to the invention in accordance with a twelfth exemplary embodiment; and

Figure 17 is an optical system according to a thirteenth embodiment.

In the description of the figures, similar or identical objects are designated with similar or identical reference numerals. Many of the items shown have symmetrical or complementary components, which are distinguished by an additional letter, for example "L" for left and "R" for right, after the reference number. If the statement concerns each individual component of such a symmetrical or complementary grouping, the additional letters are omitted in some cases for the sake of clarity.

Figure 1

Figure 1 shows an information system 100 in accordance with a first embodiment of the invention. The information system 100 is implemented in the form of an interactive glasses system 120 or an interactive glasses 120, respectively comprises two optical devices 150. The optical devices 150 are preferably located on the inside of a left 121L or right 121R temple part of the glasses 120. Depending on the area of use, there are also other arrangements of the optical devices that do not obstruct the view, for example in the area of a nose bridge 122 running over the nose root of a user the glasses 120, useful.

The optical device 150 of the glasses 120 is connected to a processor unit 140 via connecting lines 101. If photodetectors and / or light sources are included in the optical devices, the connecting lines serve for the transmission of electrical detector or control signals. However, the photodetectors or light sources can be arranged in the processor unit 140 and connected to the optical devices 150 of the glasses 120 via light-conducting connecting lines 101. This contributes to the weight reduction of the glasses 120.

Figure 2

FIG. 2 shows a detailed view of an eye 280 in cross section for the purpose of understanding the invention. The eye 280, which is housed in an eye socket 20 (lat. Orbita) in the head of a human being and is to be understood here in the sense of an eyeball 280, consists of a translucent cornea 283 (lat. Cornea) and a visible one white leather skin 28 (lat. Sclera) surrounding chamber. The sclera 28 is covered on its side facing the inside of the eye 280 by a choroid 287 (lat. Choroid) which bears a light-sensitive retina 281 (lat. Retina) on its inner side and supplies it with blood. Because of its pigmentation, choroid 287 prevents control of the incident light, which could interfere with vision. The tissue of the retina 281 comprises two types of photoreceptor cells, rods and cones (both not shown), which enable humans to see. These photoreceptor cells absorb the light bundled through an eye lens 282 in a wavelength range of approx. 380-760 nm and convert it into electrical nerve signals through a series of chemical reactions. The signals from the various nerve cells of the retina 281 are then passed on to the brain via an optic nerve 25 and processed there to form a perceptible image. The numerous, approx. 120 million and highly light-sensitive rods are specialized in signal recording in dim light (so-called scotopic vision) and provide a grayscale image. The approximately 6.5 million, comparatively less light-sensitive cones, on the other hand, are responsible for color vision in daylight (so-called photopic vision). When light is absorbed, pigments are oxidized in the photoreceptor cells. It takes about 6 minutes to regenerate the pigments and about 30 minutes for the rods. A viewing period of approx. 200 msec is necessary until the visual stimulus via the photoreceptors begins and information is recorded via the retina 281.

The retina 281 has a depression 286, which appears to be somewhat more pigmented due to its higher density of cones than the rest of the retina. This depression 286, which is usually called the visual pit 286 (fovea centralis), lies in an area of the retina known as the "yellow spot" (lat. Macula) and represents the area of the sharpest vision. The fovea centralis 286 is only included Occupied cones, has a very high cone density and only takes up approx. 0.01% of the surface of the retina. At the point vis-à-vis the lens 282 identified by the reference numeral 288, the optic nerve 25 enters the interior of the eye through a sieve-like opening in the dermis 28. This location 288 has no photoreceptor cells, which is why it is referred to as a "blind spot". The chamber formed by the cornea 283 and the dermis 28 is divided by a deformable lens 282 and a muscular radiation body 23 (also called ciliary body) which supports the lens 282. The part of the chamber lying between the lens 282 and the retina 281, which makes up approximately 2/3 of the eyeball, forms a so-called glass body 21, a gelatinous structure which consists of over 98% water and supports the retina 281 and protects. The part of the chamber, which is referred to as anterior chamber 22 and lies between cornea 283 and lens 282, contains a liquid which nourishes cornea 283. In its original form, the lens 282 typically refracts the light falling on the eye in such a way that the far field of view is sharply imaged on the retina 281. By tightening / relaxing the muscles of the ciliary body 23, the shape and thus also the refraction characteristics of the lens 282 can be changed over a wide range, for example to enable sharp imaging of nearby objects of the visual field on the retina 281. In most cases, this process takes place unconsciously for the person concerned.

Immediately in front of the lens 282 there is a diaphragm 285 of variable diameter consisting of colored tissue, which regulates the incidence of light on the light-sensitive parts of the eye 280 and gives the eye 280 its characteristic color. This aperture 285 is therefore called the iris 285 (lat. Iris). Due to the low light reflection of the lens 282, the vitreous body 21 and the retina 281, the central area of the iris 285 appears black and is called the pupil 284. The regulation of the pupil size is also unconscious for humans.

The eye 280 is connected to the skull via six muscles 24, some of which are parallel, some of which are oblique to one another, which allow the eye 280 to pivot and consequently change the direction of view. The binocular, without eye movement 280 The visual field is approximately 170 ° horizontally and approximately 110 ° vertically. If the eyes 280 are moved, a binocular field of view of approximately 290 ° horizontally and approximately 190 ° vertically can be captured. The area of sharp vision covered by the fovea centralis 286 covers only about 1 °. A fictitious axis through the middle of this area is called the visual axis and corresponds to the viewing direction. A rotation of the eye around the visual axis is also made possible by the muscles 24.

The six muscles 24 are responsible for all eye movements. When considering a fixed point, so-called microtreors of the eye 280 take place, in which the eye 280 trembles slightly in order to avoid a temporary exhaustion of the chemical reactivity of the affected photoreceptor cells while the stimulus remains the same. During a change of direction or a head movement, so-called saccade movements take place, with the help of which the fovea centralis 286 is aimed at its new fixation target or is held at its previous fixation target. During this very complex movement, the eye 280 is moved involuntarily with a small amplitude of up to several tens of degrees and an extremely fast angular velocity of up to several hundred degrees per second. When tracking a moving object, the eye reaches 280 angular speeds of just one to two hundred degrees per second.

To protect the eyeball 280, man has movable skin folds, namely an upper eyelid 27a and a lower eyelid 27b, which enables the eye socket 20 to be closed against external influences. The lids 27a and 27b close reflectively in the case of incoming foreign bodies and strong glare. In addition, the eyelids 27a and 27b provide regular, usually involuntary blinking of the eyes for a tear film evenly distributed on the cornea 283, which protects and washes the outer surface of the cornea 283 from drying out. The eyelids 27a and 27b also have eyelashes 27c, which Protect eye 280 from dust as well. A conjunctiva 26 lines the space between the eyelids 27a and 27b, the eye cavity 20 and the eyeball 280. The conjunctiva 26 merges into the inside of the lid on the one hand, and into the cornea 283 on the other hand, and represents a second protective wall against the penetration of germs and foreign bodies.

Figure 3

FIG. 3 shows a known embodiment of the interactive spectacle system or spectacles 320 as described above, in which a signal detection device in the form of a scanning eye scanner 350D is provided. The left half of the image represents a top view of the head of a user 302 together with glasses 320 with the right temple part 321R, while the right half of the image shows a cross section of the glasses 320 running through the left temple part 321L. Apart from the devices belonging to the interactive glasses 320, no further components of the information system 100 according to the invention are shown in FIG.

According to the illustrated embodiment, light rays 333a and 333b falling on the eye 380, which originate, for example, from the visual field, are sharply imaged by the lens 382 on the retina 381 as a coherent image and reflected back by it as a retinal reflex image. A light beam 331 thus reflected back passes through the lens 382 again in the opposite direction, is focused via two concave mirrors 322 and 323 belonging to the mirror system of the glasses 320 and is directed onto a scanning eye scanner 350D as shown. The eye scanning device 350D comprises a signal detection device 351 in the form of a photodetector 351, which detects the light beam 331 reflected back by the retina 381, and two movable flat mirrors 352H and 353V, which cause a horizontal or vertical deflection of the light beam 331 onto the photodetector 351 , According to the embodiment in FIG. 3, the glasses 320 additionally comprise a light trap 324, which prevents light from coming in from undesired directions of incidence. To simplify the mirror system of the glasses 320, the mirror 323 can be realized by a mirrored inner surface of the glasses. However, the surface must have a certain shape in order to enable the entire retinal reflex image to be recorded even if the eye 380 is possibly rotated. This in turn limits the design options for the glasses 320.

The combination of a point-shaped detector 351 with corresponding control of the flat mirrors 352H and 352V results in serial point-by-point scanning of the retinal reflex image as a sequence of pixels. The retina 381, as described in DE 196 31 414 AI and DE 197 28 890, is preferably scanned with a circular, spiral or elliptical scan pattern. This has the advantage that the flat mirrors 352 can be driven without backward movements and that a higher pixel density (number of pixels per unit area of the retina) in the area of the fovea centralis 286 can be detected.

A suitable synchronization process for determining the instantaneous visual axis is preferably preceded by the recording process, if this has not yet been done in a previous projection process, so that the scanning process can be carried out eye-centered.

Figure 4

FIG. 4 shows a known embodiment of the interactive glasses 420 described above, in which an output device in the form of a scanning projection device 450P is provided. The left half of the image represents a top view of the head of a user 402 together with glasses 420 with the right temple part 421R, while the right half of the image shows a cross section of the glasses 420 running through the left temple part 421L. Except for the Devices belonging to interactive glasses 420 are shown in FIG. 2 no further components of the information system 100 according to the invention.

According to the illustrated embodiment, the scanning projection device 450P comprises a light source 453 emitting a projection light beam 432, for example a laser diode or an LED focused via a lens system, and two movable flat mirrors 454H and 454V. The projection light beam 432 is directed via the movable flat mirrors 454H and 454V onto a mirror system of the glasses 420, which comprises two concave mirrors 422 and 423, which throw the projection light beam 432 onto the lens 482 of an eye 480 and finally onto the retina 481. In order to simplify the mirror system of the glasses 420, the mirror 423 can be realized by a mirrored inner surface of the glasses lens. However, the surface must have a certain shape in order to enable a projection onto all areas of the retina 481 even if the eye 480 is possibly rotated. This in turn limits the design options for the glasses 420. To avoid disturbing incidence of light, the glasses 420 can be equipped with a light trap 424, which prevents incidence of light from undesired directions of incidence.

The combination of a punctiform light source 453 with corresponding control of the flat mirrors 452H and 452V, which each cause a horizontal or vertical deflection of the projection light beam 432, results in a serial punctiform projection of an image. The projection, as described in DE 196 31 414 AI and DE 197 28 890, is preferably carried out using a circular, spiral or elliptical scan pattern. This has the advantage that the flat mirrors 452 can be driven without backward movements and that a higher pixel density in the area of the fovea centralis 286 can be projected onto the retina 481.

projection The degree of perception of an image projected into the eye 480 can be controlled in relation to the naturally perceived image by the brightness of the projected pixels. However, retinal perception is a deeply complex process in which psychological effects also play a very strong role. Here, reference is made to the relevant specialist literature.

Simplified, however, it can be said that the retina 481 adjusts itself to the brightness of the light falling on it as a whole. For example, it is known that the faint glow of a clock radio clock that is not perceived in daylight can appear to illuminate an entire room in the dark. Conversely, the strong headlights of oncoming vehicles are hardly noticeable in daylight. The brightness of an individual pixel in relation to the otherwise perceived pixels is therefore felt. When viewed locally, the Retina 481 works similarly. If the brightness of a pixel projected on an area of the retina 481 exceeds the brightness of the light otherwise falling on this area by approx. 10%, only the projected pixel is effectively perceived by this area of the retina 481 instead of the other light. Due to psychological effects, the exact value can be between 5% -10%, 10% -15% or even 15% -20% instead of 10%.

If necessary, a suitable synchronization process for determining the current visual axis is preferably connected upstream of the projection process, if this has not yet been done in a previous scan process, so that the projection process can be carried out eye-centered.

Figure 5

Figure 5A shows an interactive goggle 520 according to a first preferred exemplary embodiment, in which a combined signal is generated. Detection and projection device 550 is attached to the glasses 520 in the region of the nose bridge 522. According to detail drawing 5B, the combined signal detection and projection device 550 comprises both a projection device 553 and a signal detection device, which are accommodated together in a protective housing 558. Light rays 530 enter the interior of the housing 558 and vice versa through a translucent window 559 in an outer wall of the housing 558. However, closing the housing 558 through the window 559 prevents dust, sweat and other foreign matter from interfering with the operation of the combined signal acquisition and projection device 550.

3 and 4, light beams 530, 530a, 530b are detected or projected. However, the construction of the interactive glasses 520 can be simplified in that the mirrors 352 and 452, which are separate in the prior art, for vertical and horizontal deflection of the respective light beam 331 and 432 are replaced by a swash mirror 552 and 554. For the purpose of a compact design, a partially transparent mirror 556 can serve to enable separate beam paths within the housing 558 for the light 530 falling or projected through the window 559. The inside of the spectacle lens is preferably provided with a surface 523 which is highly reflective for rays incident from this direction and which is used as a mirror for the beam path between the eye 580 and the combined signal detection and projection device 550. This contributes to a reduction in the necessary components and, in the embodiment shown, leads to a simplified, bright beam path 530 in which the light beam 530 is only reflected three times between the eye 580 and the projection or signal detection device 553 or 551. As described above, however, this results in a restriction of the design options for the glasses 520. The freedom of movement necessary for a tumbling movement of the mirror 552, 554 can be achieved, for example, by a gimbal or spring suspension of the mirror 552, 554. Possible embodiments of such a wobble mirror are known to the person skilled in the art, for example from the field of microtechnology. Further solutions to the present deflection problem, in which the respective light beam 530 is guided on the basis of electrochromic, holographic, electroholographic or other light refraction or light reflection mechanisms, are readily conceivable and can also be used.

Although the interactive glasses 520 is shown in a minimalist embodiment, in which a combined signal detection and projection device 550 is provided only for the left eye 580, it goes without saying that a mirror-inverted second combined signal detection and projection device 550 is in the area the right half of the nose bridge 522 can be provided for the right eye, not shown, if necessary.

Figure 6

FIG. 6A shows, in the form of a modification of the glasses 520 shown in FIGS. 5A and 5B, interactive glasses 620 according to a second preferred exemplary embodiment, in which the left combined signal detection and projection devices 650L in the between the left lens 624L and the left temple Part 621L area and the right combined signal detection and projection devices 650R are arranged in the area lying between the right spectacle lens 624R and the left temple part 621R.

Such an arrangement of the combined signal acquisition and projection devices 650L, 650R in relation to the respective spectacle lenses 624L, 624R and the respective eyes 680 is normal associated with the need either to provide a plurality of mirrors along the beam path 630 (cf. mirrors 322 and 323 in FIG. 3) or to give the respective spectacle lens 624L, 624R a special shape in order to ensure detection of all areas of the retina 681. However, this considerably limits the design options for the glasses 620. In order to avoid this problem, the interactive glasses 620 according to FIG. 6 provide glasses 624L, 624R, the inside of which are provided with a respective holographic coating 623L, 623R. Such holographic coatings 623 are able to emulate any reflection topology. For example, a holographically coated, flat surface can act like a spherically curved surface. A holographically coated, spherically curved surface can also act like a flat surface. The change in the effective reflection topology depends only on the holographic content of the coating. As shown, the holographic coatings 623L and 623R mirrors are formed and arranged symmetrically to one another.

Figure 6B contains a detailed drawing of the combined signal acquisition and projection devices 650L. Analogously to the combined signal detection and projection device 550 shown in FIG. 5B, it comprises a housing 658, a projection device 653 and a signal detection device 651, respective wobble mirrors 652 and 654, a partially transparent mirror 656 and a housing window 659.

Figure 7

Similar to FIGS. 6A and 6B, FIG. 7A shows, in the form of a modification of the glasses 520 shown in FIGS. 5A and 5B, interactive glasses 720 according to a third preferred exemplary embodiment, in which the left combined signal detection and projection devices 750L in the between the left glasses glass 724L and the left bracket 721L lying area and the right combined signal detection and projection devices 750R are arranged in the area lying between the right spectacle lens 724R and the left temple part 721R.

Figure 7B contains a detailed drawing of the combined signal acquisition and projection devices 750L. Analogous to the combined signal detection and projection device 550 shown in FIG. 5B, it comprises a housing 758, a projection device 753 and a signal detection device 751, respective wobble mirrors 752 and 754, a partially transparent mirror 756 and a housing window 759.

In this exemplary embodiment, the above-mentioned problem of the beam path 730 is solved in a space-saving manner by specially designed pads 725L and 725R. Typically, glasses 720 are supported either on the nose bridge by the nose bridge 722 or by so-called pads 725. In their commercial form, pads are relatively flat, slightly curved and oval. In addition, they are either pivoted or tumbling on a projection extending from the nose bridge 722 in order to ensure that the pads fit snugly against the side surfaces of the nose root. In the exemplary embodiment shown, the pads 725 are designed as dimensionally stable, elongated units which protrude from the glasses 720 in the direction of the eye 780 in the region of the nose bridge 722. On their respective elongated sides facing the nose, the pads 725 form the support surface which rests on the root of the nose. In their end region opposite the glasses 720, the pads 725 have a wing on the side facing the eye, which is provided with a mirror or a reflective coating, for example a metal coating or a holographic coating.

Although the frame of the glasses 720, including the pads 725, has a basically solid shape, both quasi-static, eg due to material fatigue and / or temperature changes, as well as dynamic deformations of the frame. In particular when putting on the glasses 720 And in the event of vibratory activities, there are changes in the relative arrangement of the respective glasses components. The relative arrangement of the glasses 720 with respect to the eye 780 is also not a constant. Accordingly, both the optical system of the glasses 720, that is to say those system components which contribute to the optical signal detection or optical projection, and any processing system which may be connected to it, must be designed and designed in such a way that such changes in arrangement are taken into account and / or compensated for may or may not cause extraordinary malfunctions. This applies to all types of interactive glasses systems.

According to the invention, the problem mentioned above can be overcome in particular by suitable signal processing of the detected and of the signals to be generated. Optical markings fixed to the spectacle frame in the vicinity of the usual beam path 730 can also be detected regularly or as required by the signal detection device 751 for the purpose of calibrating its optical system.

Figure 8

FIG. 8 shows, in the form of a modification of the glasses 520 shown in FIGS. 5A and 5B, interactive glasses according to a fourth preferred exemplary embodiment, in which the signal detection device 851 of the combined signal detection and projection devices 850 is able to record the corneal reflex image at least partially.

The cornea is usually rotationally symmetrical to the visual axis. Rays that fall perpendicularly onto a central area of the cornea are thus confocal to the optical system of the eye 880 and form the basis of what is actually lent perceived image. In addition, the cornea 883 consists largely of water and therefore has a very high degree of reflection at a wavelength of approximately 1.1 μm. Since this wavelength is in the infrared spectral range, the corneal reflex image is primarily suitable for infrared applications, for example in night vision devices. However, reflections do not only take place on the outer, concave corneal surface, but also inside the cornea. In addition, due to its structure, the cornea 883 does not cause a mirror-like reflection but a diffuse one, which becomes more diffuse with increasing depth of the reflection event inside the cornea.

In order to obtain a meaningful corneal reflex image, only those rays that fall perpendicularly on a central area of the cornea are effectively detected in the exemplary embodiment shown. This is achieved through several measures. First, the spectacle lens 824, which is placed in front of the eye and whose side facing the eye 880 is provided with a surface 823 which is highly reflective for rays incident from this direction, has a specially designed shape which bundles the light reflected perpendicularly from the cornea in such a way that it as almost parallel light rays 834 fall on the signal detection device 851, while light not reflected perpendicularly from the cornea is directed in another direction. Alternatively, the spectacle lens 824 can be designed differently, but have a partially transparent holographically reflecting layer 823, which likewise effects such a concentration of the light reflected perpendicularly from the cornea that it strikes the signal detection device 851 as almost parallel light beams 834, while not perpendicularly from light reflected from the cornea is directed in a different direction. Secondly, an aperture 857 is provided shortly in front of the signal detection device 851, which prevents detection of those light beams whose angle of incidence lies outside a narrow angle of incidence range such as Light rays 834 described above, running almost parallel.

Figure 9

FIG. 9 shows, in the form of a modification of the glasses 520 shown in FIGS. 5A and 5B, interactive glasses according to a fifth preferred exemplary embodiment, in which a spherical or spherically acting, partially transparent, reflective additional element 929 is arranged between the spectacle lens 924 and the eye 980. The additional element 929 is preferably arranged confocal to the optical system of the eye 980.

The degree of reflection of such an additional element 929 can be adapted to the needs of the information system. You can choose between a high degree of reflection, which enables very good detection of light rays 933a-933c directed towards the eye 980, and a low degree of reflection, which avoids impairing the perception by the eye 980. The additional element 929 preferably has a low (for example less than 10%), homogeneous degree of reflection over its entire reflection surface. In contrast, reflective organs of the eye 980, for example the cornea 983 or the retina 981, sometimes have very strong local reflection dependencies. Similar statements concern the spectral reflection dependencies of the additional element or the reflecting organs of the eye 980. While the additional element 929 can preferably be designed such that it has a homogeneous degree of reflection over all relevant spectral ranges, the different organs of the eye 980 have very different features Degrees of absorption, which in many cases are also subject to strong local fluctuations.

Except for the partial reflection, the additional element 929 should have as little effect as possible on the light falling on it. For this reason, the additional element 929 is preferably made of a homogeneous translucent and undyed material and with a constant thickness in the direction of the light rays directed towards the center of the eye. By applying an anti-reflective coating on the side of the additional element 929 facing the eye 980, improved light transmission can be achieved.

The reflective contour of such an additional element 929 is well defined and can accordingly be made available to the information system as known information, while the contour of the relevant reflective organs of the eye 980 must first be determined. The latter can involve considerable effort in some cases. The detection of light rays 933a-933c directed towards the eye 980 via such an additional element 929 can thus provide high-quality images of the field of view.

In the exemplary embodiment shown, only those rays that fall perpendicularly on the additional element 929 are effectively detected. This is achieved through the following measures:

Due to the partially reflecting surface of the additional element 929, a corresponding part of those rays 933a-933c that fall perpendicularly onto the surface of the additional element 929 is reflected back vertically, while other rays from the surface of the additional element 929 correspond in accordance with the reflection law "angle of incidence equals reflection angle" be reflected back at an angle. The light rays reflected back perpendicular to the surface of the additional element 929 cover the same path as they came and thus strike the spectacle lens 924 in front of the eye. The side of the spectacle lens 924 facing the eye 9 is strong for rays incident from this direction reflecting surface 923, and has a specially designed shape or a specially designed coating that bundles the light rays reflected perpendicularly from the additional element in such a way that they are almost parallel light rays 934 fall on the signal detection device 951, while light rays not reflected perpendicularly by the additional element are directed in another direction. Furthermore, an aperture 957 is provided shortly in front of the signal detection device 951, which prevents detection of those light rays whose angle of incidence lies outside a narrow angle of incidence of the light rays 934 which run almost parallel, as described above.

If the image of the visual field acquired via the additional element 929 is to form the basis for a projection correlated with the actually perceived visual field, then the correlation between the detected light and the perceived visual field must be determined. According to the fifth exemplary embodiment shown, this correlation is achieved by a preferred confocal arrangement of the additional element 929 for the optical system of the eye 980. It is therefore preferred that the additional element 929 is attached to the glasses via an adjustable suspension in such a way that the position of the additional element 929 can be readjusted both in vertical and in two horizontal directions.

Basically, confocality is given when the additional element 929, seen optically, is arranged rotationally symmetrically to the visual axis and at a distance from the lens 982, that the optical center of the optical system of the eye with the center of the additional element acting through the spherical or spherical defined ball matches. For this purpose, the visual axis can be adequately determined via the orientation of the pupil 984, which can be easily recognized by its sharp contours, and the orientation of which can be determined easily due to its round shape. In addition, due to the spherical or spherical shape of the additional element 929, no pivoting of the additional element 929 about the possible pivot axes of the eye 980 is necessary to ensure confocality. Because even when the eye is twisted by a corresponding vertical and / or horizontal Displacement of the additional element 929 at least a substantial part of the additional element 929, optically seen, rotationally symmetrical to the visual axis. As far as the distance to the lens 982 is concerned, there are various ways of determining the necessary distance. For example, an optical or acoustic measurement of the cornea 983 can be carried out, the curvature of which gives a very good guide value for the correct arrangement of the additional element 929. Retinal or corneal reflex images can also be acquired at least partially, and the correct distance can be determined on the basis of a comparison of the reflex images with the light acquired via the additional element 929.

Due to the spherical or spherical effect, for example by means of a holographic coating, the partially reflecting surface of the additional element 929 and this confocal arrangement of the additional element to the eye 980, only those rays 933a-933c that perpendicularly fall onto the surface of the additional element 929 are confocal to the optical system of the 980 eye and thus coincide with the rays falling on the retina.

Figure 10

FIG. 10 shows a top view (FIG. 10A) and a front view (FIG. 10B) of a pair of glasses 1020 according to a sixth exemplary embodiment, in which two sensor devices 1061R and 1061L, for example two solid-state cameras, for example CCD or TTL cameras, for the purpose further signal detection, in particular from the visible field of view, are provided. FIG. 10B also shows the left and right eyes 1080L and 1080R of a possible wearer 1002 of the glasses 1020. However, for the sake of clarity, no other features of the user 1002 are shown in FIG. 10B.

To prevent parallax from occurring between the camera 1061R, 1061L and the eye assigned to it, To avoid perceived images, the cameras 1061 should be arranged as axially as possible with respect to their "visual axes". In view of the system size of such solid-state cameras 1061, it has proven expedient in the current state of the art to arrange the cameras 1061 in the front area of the respective bracket parts 1021L, 1021R as shown. Installation in the area of the nose bridge 1022, for example in the pads 1025, also makes sense. After a further miniaturization, the solid-state cameras 1061 can be arranged in the spectacle frame above the respective spectacle lenses 1024L, 1024R in order to achieve a further axis alignment. It is foreseeable that solid-state or other types of light detection systems can be installed in the eyeglass lens 1024 in the future, which can of course also be a plastic or other translucent material. Such an arrangement of the cameras 1061 would enable an almost confocal signal acquisition with the respective eye 1080L, 1080R.

In the case of an arrangement of the sensor devices 1061 that is not aligned with the axis in relation to the respective eyes 1080L, 1080R, the information obtained from the sensor devices 1061 should possibly be correlated with the eyes 1080. Such a correlation is particularly important if the sensor devices 1061 are real ized by cameras 1061 and an overlay image is to be projected into the respective eye 1080L, 1080R on the basis of image information obtained from the cameras 1061.

If the image recorded by cameras 1061 is simply projected onto the respective eye 1080L, 1080R, so-called parallax occurs, in which the “field of view” of the respective camera 1061L, 1061R does not match the naturally perceived field of view. The parallax would lead to an abnormal perception, especially if the eyes were rotated 1080 from the rest position or if there were objects in the near field of view. Because in such cases ge the visual axis of the eye 1080 obliquely to the "visual axis" of the respective camera 1061L, 1061R.

In the correlation in this sense, only that part of the image captured by the cameras 1061 is projected into the respective eye 1080L, 1080R which is in a corresponding “correlation” to the visual axis of the respective eye 1080L, 1080R. In the simplest case, the signal detection device 1051 detects an at least partial reflection image of the field of view from the respective eye 1080L, 1080R. Characteristic pixels that can be found both in the captured reflex image and in the images captured by the cameras 1061 then serve as reference points for a perspective-correct projection of the image information captured by the cameras 1061 onto the eye 1080. Similarly, those captured from the eye 1080 can be used Signals serve to determine the viewing direction of the respective eye 1080L, 1080R with respect to the coordinate system of the glasses 1020 in order to carry out a mathematically based correlation from this angle.

However, a correlation also makes sense in system applications in which the eyes 1080 are prevented from perceiving the visual field. This is the case, for example, when using closed, so-called "virtual reality" glasses 1020 (as shown, but with opaque glasses 1024) in which only an artificially generated image is presented to the eyes 1080. In such a case, the correlation discussed could consist, for example, in that the viewing direction of the eye 1080 is detected as described above and that a virtually generated image corresponding to the orientation of the respective eye 1080L, 1080R is projected into it. However, the glasses 1020 serve as the coordinate system here. If, however, the position and orientation of the glasses 1020 is still determined, for example on the basis of the images captured by the cameras 1061, a correlation can be established between the respective eye 1080L, 1080R and the surroundings. Such a system could be for example in a virtual adventure house, similar to a haunted house. For example, anyone who is currently on a running track could be projected with a virtual image that gives them the feeling that they are walking on floating tree trunks in the middle of a wild river.

It should be emphasized at this point that the information system described above with reference to FIGS. 5 to 10 does not necessarily have to work with a combined signal detection and projection device. It is equally possible to work with an embodiment of the system in which the signal detection device is separate from the projection device or in which one of the two devices is missing.

Figure 11

According to a seventh exemplary embodiment, the information system according to the invention comprises means which make it possible to provide a binocular function. FIGS. HA and 11B illustrate the perceptible effect of the binocular function on a user. FIG. HA shows the naturally perceived field of view 1190 of a user of an information system designed according to the seventh exemplary embodiment. Although the field of view 1190 includes approximately 170 ° horizontally and approximately 110 ° vertically of the surroundings, only a small area 1191 of a few degrees around the visual axis forms the area of the sharpest vision 1191.

Due to its detection of light from the field of view and the previously described possibility of projecting image information into the eye, the information system can be designed in such a way that this area 1191 is optically enlarged, for example at the push of a button after appropriate processing of the detected image points by means of an evaluation device included in the information device the area of sharpest vision is projected 1191. As previously described, the level of perception of a person projected image in relation to the naturally perceived image can be controlled by the brightness of the projected pixels. If the field of view light is detected, for example, as a reflex image from the eye, a spatial or temporal separation of the detection and the projection ensures that the projection does not influence the detection.

In the case of commercially available binoculars, the fact that the entire field of vision is shown enlarged means that the spatial reference to the surroundings is lost. As a consequence, a person looking through binoculars is unable to move at the same time. This phenomenon is well known.

Because the information system according to the invention can determine the visual axis or the position of the fovea centralis relative to the optical system of the glasses by detecting signals from the eye, the information system is able to avoid this disadvantage of standard binoculars. For example, the projection can be carried out in a manner as shown in FIG. 11B, in which only a small area 1191, which lies in the natural field of view immediately around the visual axis, is projected enlarged onto the fovea centralis, while no projected image information is superimposed on the rest of the field of view , Thus, the scene perceived peripherally by the user remains the same despite the telescopic presentation of the most relevant area of the visual field. In order to achieve this effect, the brightness of the image information projected into the eye must of course be selected so that the desired perceptual relationship between the natural and the projected image is created. This system also has the advantage that the effort required for enlarging the image processing is kept within limits, because only a selected image area 1191 of the field of view 1190 is processed. According to an elegant embodiment (not shown), a magnified image is projected into the eye in such a way that the projected image is enlarged more in an annular border area between the area of the sharpest vision 1191 and the remaining area of the retina with increasing proximity to the visual axis. The outer edge is not enlarged at all and the inner edge is enlarged with the same "zoom factor" as the enlarged image projected into the inside of the ring, ie onto the fovea centralis. With a correspondingly selected brightness of the projected image information, there is a smooth transition between the peripheral scene and the telescopically seen.

FIGS. 11C and HD show schematically how an enlargement of the image naturally falling on the fovea centralis can be achieved by changing a scanning pattern 1138, 1139 when scanning a reflex image. Although projection patterns 1137 and scanning patterns 1138, 1139 are shown in a common plane in FIGS. 11C and HD for the sake of explanation, it may be the case in the information system according to the invention that the retina is projected while the scanning, for example, from the cornea he follows.

Figure 11C schematically illustrates a typical scan pattern 1138 that scans the corneal or retinal area 1189 reflecting the field of view. In this very simplified example, for the sake of clarity, it is assumed that the respective pixels of the sequentially scanned image, after possible image processing, are re-projected as corresponding pixels of the image sequentially projected into the eye. In the example shown, the scanning pattern 1138 thus coincides with the projection pattern 1137 despite possible spatial or temporal separation of the scanning and projection beams. If an enlargement of a central area of the field of view is desired, the scanning can be carried out according to a modified scanning pattern 1139 which is shown in in a central area with an increase in the density of the scanned image points. If these image points recorded with increased densities are correspondingly projected in the projection, but are projected back with lower densities, this results in an enlarged image.

Figure 12

According to an eighth exemplary embodiment, the information system according to the invention represents a guidance system. For this purpose, the information device of the information system comprises position sensors, for example acceleration measuring devices or GPS receivers, and a database or database connection which provides orientation data. Such a database can be implemented, for example, via a CD-ROM carrying the data, a DVD or another exchangeable storage medium in connection with a corresponding reading device. Methods and devices for obtaining location information, for example determining the location or making it possible to determine it, by combining such orientation data with data obtained from the position sensors are known. In a typical device, the orientation data comprise map information which is used in connection with signals provided by the position sensors for determining the location. Establishing a correlation or a dependency, for example, in the acquisition or display of such location information between signals detected from the eye or light detected from the visual field and the provision of the information, however, far exceeds the technical nature.

FIGS. 12A to 12E show the perceived visual field 1290 of a user of an information system designed according to the eighth exemplary embodiment. In the case of such an information or management system, the detected field of view light is, in view of the location information obtained, by means of a pattern recognition, taking into account those for the determined location Available data evaluated. Orientation indications to be expected for the determined location, such as striking buildings, side streets, or the like, are recognized so that, for example, visual or acoustic guidance or identification can take place, if necessary.

In the example shown in FIG. 12A, the guidance system is used for navigation. Here, for example, on the basis of a calculated or predefined route, available map information and the current location, it is determined that the next street on the right is to be turned. This street is recognized on the basis of the detected field of view light by means of a pattern recognition, whereupon an arrow pointing towards the street is projected into the field of view in accordance with the location, taking into account the viewing direction determined by the system. Similarly, the guidance system could provide the road user with acoustic messages, for example "turn right after 50m" or "now right".

In the example shown in FIGS. 12B and 12C, the guidance system is used for information. For example, information about his immediate environment can optionally be made available to a user. According to FIG. 12B, a tourist using the information system looks at a striking building and actuates an activation button that is physically present or virtually displayed in the visual field. The building is then determined on the basis of the determined location and a pattern recognition based on the detected field of view light or an electronic compass determining the head direction, whereupon information about the building is made available. These can come from a database or other information source and can be selected, for example, interactively using a context-sensitive menu that visually or acoustically lists the information available for the respective building. The selection could be via voice control or via a fi xation done with the eyes. More on eye-controlled menu navigation is explained in a later section of this description.

According to FIG. 12B, historical data are faded into the visual field by projection. The system uses the visual field light to determine a suitable fade-in point, for example in front of a monotonous roof or against the sky. The data is displayed in accordance with the insertion point. Typically, the fovea centralis will initially not be directed at the fade-in point, which is why the faded-in data is initially perceived as a fuzzy peripheral phenomenon. Only by correspondingly swiveling the viewing direction according to FIG. 12C is the stationary data displayed on the fovea centralis. If the view is directed to another building recognized by the system, the information displayed can change according to FIGS. 12D and 12E. In the figures, the circle 1290 represents the perceived visual field, while the circle 1291 identifies the area of the visual field covered by the fovea centralis.

With such a compact and portable construction as shown in FIG. 1, such an orientation system could be carried by a pedestrian, a cyclist, a motorcyclist or another vehicle driver.

Figure 13

According to a ninth exemplary embodiment shown in FIGS. 13A and 13B, the information system according to the invention functions as a driving aid. The figures show the perceived field of view 1390 of a user of such a system.

The information device of the information system preferably comprises a distance sensor, for example an optical or acoustic distance measuring device or a radar device, or is connected to a corresponding distance measuring system that determines the distance between a vehicle and objects in front of the vehicle in the direction of travel. In a stereoscopic view of light from the visual field, the distance could be determined by means of a paralax calculation, in which the change in the position of the object in a respective image captured on the left and right provides information about the distance.

If, for example, it is determined via an evaluation device, which is also included in the information device, that the vehicle is on collision courses with the object, a warning sign 1395 in the area of sharpest vision 1391 and a warning circle 1394 around the dangerous object can be used, for example, by means of an as described above Projection. If the object is outside or on the edge of the area of peripheral vision, another warning sign 1395a can indicate where the danger is. This is shown in Figure 13A.

Other information relevant to driving safety can also be determined via sensors or the detected field of view light. For example, an evaluation device could recognize the lane markings of a lane lying within the field of vision by pattern recognition and use them to calculate the highest possible speed, in particular when cornering. If the information system independently or by connection to the instrument system of a vehicle determines that the vehicle has exceeded this calculated maximum speed, a warning sign 1395 can be displayed in the area of the keenest vision 1391. This is shown in Figure 13B. The advantage of displaying the warning sign 1395 in the area of the sharpest vision 1391 is that the sign 1395 appears where the eye is looking, and therefore does not lead the eye to look away from the present scene. For this reason, the brightness should be faded in Characters are chosen so that the characters appear translucent. The danger can also be indicated acoustically.

Figure 14

FIGS. 14A and 14B show an information system according to the invention in accordance with a tenth exemplary embodiment, which illustrates the possibilities of a complex, versatile information system. In the example specifically shown, the information system shown has a mobile fire control center 1410, which includes a control panel 1412, and a plurality of helmet systems 1411.

Each of the helmet systems 1411 includes a signal detection device as described above and a field of view detection device. Each of the helmet systems 1411 can optionally be equipped with a projection device, infrared sensors and / or position sensors. They can also be equipped with additional sensors that, for example, enable air quality to be determined. ^'For communication purposes, each of the helmets 1411 at - equipped playing with a radio communication system that communicates with the control center 1410 or the control console 1412 and the accepts through its sending and receiving information on both tasks of an information apparatus and tasks of an output device.

The visual field images captured by the respective helmets 1411, which can be matched to the actually perceived visual field of the respective firefighter on the basis of the signals acquired from the eyes, are transmitted to the control console 1412 and displayed there on monitors. In order to reduce the amount of data to be transmitted, operators of the control console 1412 could also wear a projecting spectacle system, so that only the image data falling on the area of the fovea centralis of the operator must be transmitted or recorded in high resolution. In the eye of the operator A correlated visual field image of a single firefighter or a mosaic of several images could also be projected into it. The operator could see exactly what the firefighter sees, or an image that changes depending on his own eye movements could be made available to the firefighter.

In the event of any projections, additional information could be woven into the projected image for the operator and / or the fireman. For example, orientation or temperature information obtained by the position sensors or infrared sensors could be blended into the visual field. The constant display of certain cardinal points, such as north and west, as well as elevations, would be a helpful reference for both the operator, who is distant from what is happening, and the fireman, who is covered by smoke and smoke.

Appropriate processing of the recorded location information could, due to the inherent networking of the system components, give each firefighter the position of his colleagues, for example with a distinctive "X", or the location and severity of the sighted or otherwise detected fire sources, for example with a color corresponding to the fire strength marked point. This would make firefighting easier and reduce the chance of accidental injury to a colleague who is invisible behind smoke or a wall.

Figure 15

FIG. 15 shows an information system according to the invention in accordance with an eleventh exemplary embodiment, in which the information system is used to operate an external system, for example a remote-controlled robot 1570 designed to move dangerous objects. As shown, the robot 1570 movable on wheels includes a chamber device 1571 and a gripper arm 1572. The robot 1570 is connected, for example, via a radio link to an eyeglass system 1520 worn by a user 1502. The images recorded monoscopically or stereoscopically via the camera device 1571 could be monoscopically or stereoscopically projected onto the retina of the user 1502 using a projection device comprised by the glasses system 1520. With stereoscopic projection, spatial vision would be guaranteed.

If the camera device 1571 has a macroscopic lens which has a wider “field of view” than the field of view of the user 1502, the field of view seen by the user 1502 can be selected by selecting an image section from the image provided by the camera device 1571, as described above , depending on the detected eye movements of the user 1502 are kept in correlation with the distant image. Otherwise, the camera device 1571 could be swiveled in correlation with the eye movements. The movements of the head of the user 1502 can also be detected via position sensors in such a way that the camera device 1571 pivots in correlation with the head movements. The information system according to the invention thus offers an unprecedented level of visual authenticity when perceiving a distant scene, which considerably simplifies the control of such an external system 1570.

By attaching a microphone, in particular a directional microphone that is oriented as a function of the head position or the viewing direction, to the external system in connection with a headphone arrangement on the glasses system, a further sensory dimension can be realized. In order to enable further operation of the robot 1570, a manually operated control stick 1525 is connected to the spectacle system 1520, for example via a cable 1526. In this way, for example, the gripper arm 1572 or the direction of travel of the robot 1570 could be controlled in several directions.

Figure 16

FIG. 16 schematically shows an information system according to the invention in accordance with a twelfth exemplary embodiment, in which an eyeglass system 1620 functions as a universal remote control for one or more devices, for example a computer, a video recorder 1676, a printer 1677, a slide projector and / or a telephone 1679 ,

In the system shown, the glasses system 1620 provides a two-way interface between a user 1602 and the device 1675-1679 to be operated. First the device 1675- 1679 must be recognized. In the sense of the invention, this is basically done by aiming at the device 1675-1679 to be operated with the fovea centralis. The identity of the targeted device 1675-1679 can be determined either with or without the help of the device 1675-1679. In the following it is assumed that both the device 1675-1679 and the glasses 1620 are equipped with the signal reception or transmission device necessary for the described processes.

If the identity is determined with the aid of the device 1675-1679, this device 1675-1679 either emits an identification signal at more or less regular intervals, for example an infrared or ultrasound signal, or it is emitted by one of the glasses 1620 broadcast request signal prompted to broadcast an identification signal. The request signal must be broadcast locally in the direction of the gaze in order to prevent other devices from responding. The one broadcast by the device 1675-1679 Identification signal is recognized by the glasses, from which the identity of the device is deduced.

If the identity is determined without the aid of the device 1675-1679, the glasses 1620, in cooperation with a database or other information source 1640, which contains pattern recognition data for the respective addressable devices 1675-1679, perform a pattern recognition of the targeted area of the visual field.

On the basis of the identity of the device 1675-1679, a menu adapted to the possible functions of the device is faded into the field of view of the user 1602, possibly at the touch of a button or with a wink. If the functionality of the glasses is not readily known, the corresponding information from a database or another information source 1640 is first brought to the knowledge, for example by standardized query of the device itself. Identification of the device embedded in the query signal can ensure that only the desired device responds to the query. Because the menu is superimposed on the field of view, the user 1602 can operate the hierarchical menu, if necessary, by slight eye movements like a computer menu.

After the desired function has been selected, a signal corresponding to the function is sent from the glasses 1620 to the device 1675-1679. Identification of the device embedded in the signal can ensure that only the desired device responds to the signal.

In this way, many devices could be operated quickly and easily with little hardware expenditure.

Figure 17 FIG. 17 shows an optical system according to a thirteenth exemplary embodiment, in which a tilting mirror 1755 enables switching between an image from the visual field and an image from the eye 1780 or a projection onto the retina 1781.

The advantage of this optical system is that the same swash mirrors 1754H and 1754V can be used for a picture from the visual field and for a projection onto the retina 1781, and that the beam path for a picture from the visual field and the beam path for a picture from the eye 1780 or a projection onto the retina 1781 are accordingly largely identical. The optical system thus already achieves a high correlation between the light detected from the visual field and the signals detected from the eye or a high correlation between the light detected from the visual field and the image projected onto the retina. This means that no additional correlation errors are attempted by the fact that the beam paths discussed run over different wobble mirrors, which could have different rotation characteristics. The same light detection device 1751 can even be used for light detection from the visual field and light detection from the eye. The correlation can only be negatively influenced by the reflection on the spectacle lens 1724 and the optical system of the eye 1780.

Not illustrated embodiment examples

In addition to the exemplary embodiments shown in the figures, further possible embodiments of the information system according to the invention are described below for a better understanding of the invention.

TV / newspaper Previous electronic books or newspapers have the disadvantage of being too heavy and / or too unwieldy, and can also only represent a limited amount of information per page. Portable video and television sets are also heavy and / or unwieldy. If the information system according to the invention is designed in such a way that the provision of information comprises a projection of image information into the eye, various visually related media, for example electronic books or newspapers, television or video games, can be realized by the information system. Here, the information system according to the invention is implemented, for example, as described above, in the form of portable glasses, which are connected via a cable, infrared or radio link, for example to an information network, a portable storage device, for example a CD-ROM or DVD reader, or a other source of information can be connected.

An advantage of such an embodiment of the information system according to the invention is that its detection of signals from the eye in connection with its detection of the visual field enables a projection in which the projected text or the projected images appear to be fixed in space. For this purpose, the information device comprises an evaluation device which determines the correlation of the visual axis to the field of view and which controls the projection accordingly, so that the information projected onto the eye appears to be immovable vis-à-vis the field of view despite movements of the eye. The determination of the correlation of the visual axis to the surroundings can also be supported by position sensors mounted in the glasses.

The virtual location of the fixation can be determined, for example, by means of a fixation with the eyes in connection with a wink or a keystroke, or also automatically, for example by means of an image-processing evaluation of the field of vision, which determines an area of the field of vision that is as low in content as possible. The disruptive effect of the natural field of view, which is not necessarily covered by the projection of the information, could be reduced by a color-complementary “wiping out”, in which complementary-colored image points are determined on the basis of the light detected from the field of view, the correlated projection of which on the respectively assigned areas of the Retina makes the natural background appear white by adding color. If a black background is desired, the perceived overall brightness of the projection must exceed the perceived overall brightness of the natural visual field by approximately 10% to 20%, so that even the brightest points of the natural visual field are perceived as black.

For operational purposes, image information representing virtual control buttons could be projected into the eye in such a way that they also appear fixed in the visual field in the vicinity of the text or image. Thus, the virtual information medium could be remotely operated by targeting the corresponding control button with the fovea centralis plus pressing a button or winking, i.e. Turning, fast-forwarding, rewinding, etc. Similarly, access to dictionaries, databases, etc. be made possible by targeting words or parts of pictures. Instead of operating buttons, the information system could also be operated, for example, by means of a menu guidance, in which operating menus “jump open” when viewing certain image areas, in order to enable eye-controlled selection from the hierarchical menu, if any.

Another advantage of such an embodiment of the information system according to the invention is that the amount of data required for a sufficient instantaneous display is far less than the amount of data that would be necessary for high-resolution display of the entire field of view. This is due to the fact that the information system knows the area of sharpest vision. Thus, only those parts of the project tion with high resolution that affect the area of the fovea centralis. A projection with a low pixel density is sufficient on other areas of the retina. Accordingly, the amount of data required for a current display is reduced, which brings clear system advantages. In particular, the perceived size of the projected image can be chosen as desired without the result that large amounts of data cannot be processed to present the current image.

If the projected image is larger than the field of view, then the current visual axis determines the image section. The projection takes place in such a way that the current image section fills the entire active area of the retina. Additional sections of the image can be brought into the field of vision by moving the eyes. If the projected image is smaller than the visual field, then only a limited part of the retina has to be projected. If the natural background of the visual field is not hidden, it changes with eye movements. Particularly in the case of television or cinema-like information displays, a projection that fills the visual field is preferred.

If signals from both eyes of a user are detected, the projection can be carried out stereoscopically, with each eye being fed a picture which is so slightly different that the brain believes it is able to perceive a three-dimensional overall picture. Thus, an optimal system-human interface could be realized, for example, for 3D television, 3D video games, 3D CAD applications or other, in particular interactive, 3D applications. The information system preferably comprises further operating elements, for example a control stick, pedal or steering wheel, which enables navigation or a change of perspective within the displayed virtual image or any other influence on the information presentation or a system connected to the information system. As described above, the eye itself can also act as a control element. With appropriate application of the measures required above for the positioning of an electronic newspaper at a virtual location, it is equally possible for the wearer of the information system according to the invention to play other orientation aids on the retina, such as an artificial horizon.

Ophthalmic applications / visual aids

Due to its detection of signals reflected back from the eye, the information system according to the invention is eminently suitable for configuration as an ophthalmic system. For example, the information system according to the invention can be implemented as a positioning system for ophthalmic surgery, in particular for ophthalmic laser surgery. The information system according to the invention is also used, for example, as an ophthalmic diagnostic system, visual aid system and / or visual defect correction system.

Most structures or organs of the eye are very small compared to manual movements. Diseases and damage to these structures or organs often only affect a small, microscopic area. In contrast to many other parts of the body, the eyes cannot be fixed, which makes treatment of diseases or injuries to the eye particularly difficult.

Due to the ability of the information system according to the invention to precisely follow movements of the eye and to be able to provide information regarding the instantaneous position of the eye to other systems, these difficulties can be overcome by a therapeutic system based on the information system according to the invention. For example, the therapeutic system can be connected to the information system according to the invention for the purpose of exchanging information in such a way that information Mations with regard to the instantaneous position of the eye are made available to the therapeutic system, so that precise, automated therapy of the eye can also take place when the eyes are moving.

According to another exemplary embodiment, a therapeutic laser beam is directed over the optical system of the information system according to the invention. Laser treatment of the eye, in particular the retina, can thus be carried out in the same way as a projection described above. For example, pathological veins of the choroid can be obliterated by injecting or ingesting a photosensitive agent and by irradiating pathological areas of the choroid with pinpoint accuracy for several tens of seconds. Such therapy can be carried out precisely using the information system according to the invention.

In order to be used as a vision correction and / or vision defect correction system, the output device of the information system comprises a projection device that projects vision-improving image information onto the retina. In addition, the information device will include an evaluation device which determines the vision-improving image information on the basis of the light detected from the visual field. The view-improving image information is preferably projected onto the retina in correlation with the signals detected from the eye in such a way that the naturally perceived field of view and the projected image information are perceived as a uniform image. In extreme cases, the vision-improving image information is projected onto the retina in such a way that the otherwise naturally perceived visual field is not perceived by the eye at all. As described above, the degree of perception of an image thus projected in relation to the naturally perceived image can be controlled by the brightness of the projected image points. Such an information system can be used, for example, to correct vision defects for short-sighted or far-sighted people and those with poor color vision. When correcting nearsightedness or farsightedness, the information system can be set to a (quasi -) fixed correction, enable a changeable correction, or adapt dynamically to the visual defect. The correction is carried out via an optionally adjustable optical focusing system within the projection device or by means of image processing measures. The latter can be achieved with less system effort.

Implementations with (quasi) fixed or changeable correction can be understood by the person skilled in the art without further explanation due to their inherent similarity to similar optical systems. A realization with a dynamic, automatic correction of the natural imaging error includes, in addition to the correlation described above, a further dependence on the signals detected by the eye. In particular, a retinal reflex image is recorded, which provides information about the sharpness of the image imaged on the retina by comparison with the light detected from the visual field and / or by an image processing evaluation. Accordingly, the light captured from the visual field is processed into vision-enhancing image information and projected onto the retina. By outputting the correction value determined in this way, the information system can function as a diagnostic system.

By detecting signals reflected back from the eye and light originating from the visual field, the information system according to the invention is able to provide information about many ophthalmologically relevant properties of the eye by means of an appropriately programmed evaluation device. For example, squint angles, primary positions (PP), visual field determinations with colors, smoldering value tests, standardized test procedures for glaucoma diagnosis, tests of retinal functions (e.g. ERG and VEP) can also be carried out at selected locations and perform or determine against the receptive fields. The person skilled in the art selects the signals to be recorded for this purpose from the eye, the visual field stimuli required for this and the processing algorithms required for this, based on his specialist knowledge and in consideration of the invention described above.

For example, while the visual acuity can be determined by an evaluation of signals reflected back from the eye and then corrected, the correction of some other visual defects requires a system-independent determination of the defect, for example by an ophthalmologist. A suitable setting of the correction made by the information system can be carried out recursively or simply.

In the case of a recursive setting 1 operation, a correction according to the previous setting is made by the information system while the eyesight of the defective person is tested. A new setting of the information system is selected based on the results of the tests. This process is carried out repeatedly until the visual defect has been sufficiently compensated. In this sense, the information system nevertheless functions as a diagnostic system; because the best correcting final setting can be used to determine the visual defect.

In a simple adjustment process, the eyesight of the defective person is tested without any compensation. On the basis of the results of the tests, a suitable setting of the information system is selected, which, in later use, then processes the light captured from the visual field into vision-improving image information according to this setting and projects it onto the retina. During processing, according to the setting, ie the original visual defect, for example certain spectral components or certain areas of the Field of view highlighted or changed by other image processing measures.

For night blind people, for example, a visual aid can be implemented by the information system according to the invention in that the light detected from the visual field, for example by means of highly light-sensitive photodetectors, is projected onto the retina in a greatly increased manner. The cones can be excited in such a way that predominantly colored, photopic vision takes place instead of scotopic vision. The maximum permitted brightness of the individual projected image points is also limited to a predetermined threshold value in order to avoid dazzling from brightly illuminated objects such as street lamps and oncoming cars. Such a system is therefore also suitable as an anti-blend system. Because if the brightness of the entire field of view is increased while the "excessive" brightness of individual points remains unchanged, the "excessively" bright points are no longer perceived as "excessively" bright. If the information device also includes an infrared sensor that detects infrared light from the field of view, additional monochrome image information relating to the field of view at night or in fog can be obtained, which can be transformed into the visible spectral range, by means of which the detection device and the field of view can be used Evaluation device obtained to evaluate image information.

In general, the information system according to the invention can also be suitable for improving vision. For example, in the case of strong or weak contrasts or in the case of low brightness in the visual field, image information whose brightness has been adjusted can be projected into the eye in order to enable improved vision.

Helmets The integration of the information system according to the invention in a firefighter's helmet was explained above. Similar configurations, for example as soldiers, drivers, crane drivers, athletes or pilots helmets or glasses, are also conceivable.

A soldier's helmet or glasses based on the information system according to the invention could help the soldier, for example, with orientation and / or with the search for a target. In such a case, the information device of the information system preferably comprises sensors and / or radio receivers that enable a supernatural perception of the environment and / or the reception of information from a command center. The output device will provide information preferably visual, audible or tactile, for example in the form of short electrical stimulation currents on the skin. The latter could be used to immediately inform a soldier of the direction of a foreign object to be moved from behind.

As a night vision device, the information system would also detect infrared light from the field of view in addition to the detection of visible light from the visual field. As described above, image information can be obtained from such detected infrared light and used in the upgrading of image information to be projected into the eye.

If the information device has a GSP-E receiver, for example, the helmet could project position information or orientation aids onto the retina. The projection of such information into the eye is preferably similar to the projection of an electronic newspaper. This means that a distraction of the soldier is avoided by the fact that the image of the information appears to be fixed in space or vis-à-vis a neutral position of the eye. Adaptation of the image information to the background perceived behind it for the best possible result Readability takes place through an evaluation device belonging to the information device.

Even if radio or other data transmission from the soldier to a command center is generally to be avoided for strategic camouflage reasons, a transmission of visual field data correlated with the soldier's eye movements to a command center could also make sense in certain cases.

In an embodiment which is particularly interesting for soldiers, the information device comprises one or more cameras which record images from outside the field of vision. The image information obtained in this way is then projected onto the retina via a projection device. The additional image projected onto the visual field image could, for example, be projected as an image in the image as a small image in the corner of the natural or projected visual field image or appear as a longitudinal stripe at the bottom. The detection of signals from the eye together with the detection of the visual field serves to keep the projected images in correlation with the movements of the eye.

It would also be helpful for the crane driver to project additional images into the field of vision from other perspectives. Likewise, the information system according to the invention could include additional sensors, with the aid of which distance or weight information can be determined in order to be projected into the visual field. Such information can be made audible or visual, for example, when the load is viewed in combination with a button click. The light determined from the visual field serves as the basis for image recognition, while the signals from the eye, as described above, enable the detected visual field to be correlated with the visual axis. The information system according to the invention could make a lot of different information available to a pilot. By connecting to the aircraft's information system, for example, relevant data such as flight altitude, speed or direction of flight or an artificial horizon could be faded into the pilot's field of vision as described. On the approach, landing aid information could also be displayed, which represent a virtual landing corridor, or specify altitude or direction correction values. For military use, friend / enemy and target help information can be provided to the pilot. Here, the pilot's line of sight plays a role both in the spatial overlay of the information and in the selection of information. The pilot wants a missile that he is sighting to be identified. If the identification is visual, he wants the overlay not to cover any relevant areas of his field of vision. The opposite requirements must be taken into account that the relevant areas of the visual field are typically imaged on the fovea centralis, but also that only those images that are projected onto the fovea centralis are imaged sharply. Intelligent fade-in must therefore take place, in which the relevant areas of the visual field are recognized, for example, by image recognition and not merely by the orientation of the fovea centralis. In this context, the information system according to the invention can also function as a subsystem for the information system of the aircraft and provide it with information. For example, information about where the pilot is looking could be supplied by the information system according to the invention to the aircraft information system and could contribute to target acquisition there. In an emergency, the information system could locate enemy radar positions via sensors and display their position with the associated terrain in three dimensions. Various information could be made available to athletes by the information system according to the invention, as in the previous examples. By means of a projection of information into the eye, for example, orientation aids, speed information and / or upgraded ones

Visual field information that provides better visibility at dusk, night, rain spray or fog is provided. A non-visual provision of the information is particularly suitable for low-salary information. Similar to the previous examples, an information system according to the invention carried by an athlete can function as a subsystem of a sports device or a vehicle.

Pure information systems

A supernatural perception can be achieved by embodiments of the information system according to the invention, in which the information device comprises one or more sensors, for example magnetic field detectors, pressure sensors, thermometers, spectral sensors, optical or acoustic interference measuring devices. In particular, by superimposing an image representation projected into the eye of the information obtained from the sensors on the natural visual field, the representation corresponds to the needs of a sighted person. The information system according to the invention can appear as a component, in particular as a presentation device, of a complex measuring device.

An example of such a system is an eyeglass system equipped with sensitive magnetic sensors, which is able to locate current-carrying or metallic objects in relation to the eyeglasses. If such localized objects are color-coded in the natural field of view using a projection as described above, then water or power lines running under plaster, for example, could be found very easily. the. A fitter wearing such a spectacle system would see the course of the lines, so to speak, "brushed on the wall".

If a two- or three-dimensional array or other one-dimensional or multi-dimensional distribution of the sensors is selected, very complex vector fields or gradient profiles can also be made visible to an observer via the associated object or arrangement. For example, an arrangement of pressure sensors around a test object in a wind tunnel could provide pressure information which the information system according to the invention processes as described above and projects into the eyes of a viewer who is observing the test object through a window so that he can see it through the test object the resulting pressure gradients can be seen by means of the corresponding colored marking of the pressure values where they exist. A welder could be shown temperature information obtained by means of an infrared camera in his field of vision in such a way that the local surface temperature along the processed objects is recognizable.

Similarly, spectral sensors can be used to provide a user with information about exact color values or material compositions. Here it also makes sense to present the determined information audibly, depending on where the user is looking. In cooperation with a database and pattern recognition, such a system could, for example, be used to at least approximately identify fungi or plants by the user looking at certain parts of the fungus or plant when prompted by the system or by using the sensors.

Summary

In the following, the essential points are summarized again on the basis of groups of characteristics, each for and in combination. bi nati on mi tei nander mark the invention in a special way:

1. Information system mi t - a signal detection device that detects back-reflected signals from at least one eye having a retina; an information device of an output device which provides information in cooperation with the information device and in dependence on the detected signals, the signal detection device comprising a scanning scanning device which makes at least partial detection of a retinal reflex image of the retina, and the provision of the information does not project from Includes information on the retina.

2. Information system according to item 1, wherein said dependency comprises a temporal or spatial correlation between the provision of the information and the detected signals.

3. Information system in which the information device comprises an evaluation device which obtains image information relating to the visual field from the detected light; and the output device comprises a projection device that projects the image information onto the retina in correlation with the detected signals such that a naturally perceived one

Field of view and the projected image information are perceived by the retina as a uniform image.

4. Information system according to one of the preceding points, wherein said dependence comprises a temporal or spatial correlation between the provision of the information and the detected light. 5. Information system according to one of the preceding points, wherein said dependency comprises a pattern identifier which provides at least one information key, and the information keys are used for an information query supported by the information device.

6. Information system according to one of the preceding points, wherein the signal detection device comprises a scanning device which records an at least partial detection of the retinal reflex image in a first scanning operation and undertakes a less extensive detection of the retinal reflex image in a later scanning operation.

7. Information system according to one of the preceding points, wherein the signal detection device only partially or not at all detects the retinal reflex image.

8. Information system according to one of the preceding points, wherein the visual field detection device has a spherical or spherical reflection layer that deflects part of the light directed onto the eye into a sensor device for detection.

9. Information system according to one of the preceding points, wherein the visual field detection device and / or the signal detection device at least partially detects the corneal reflex image of the eye.

10. Information system according to one of the preceding points, wherein the signal detection device and the visual field detection device are designed as a portable unit. 11. Information system according to one of the preceding points, the output device providing the information in a tactile, visual, audible, smellable and / or flavored manner.

12. Information system according to one of the preceding points, the information device being a database, a sensor system, an information network connection and / or an evaluation device.

13. Information system according to one of the preceding points, the information system being carried out in a portable form.

14. A method of providing information comprising the steps:

Detection of signals which have been reflected back by an eye with a retina; and

Providing the information in cooperation with an information device, depending on the detected signals, wherein the signal detection comprises a scanning scan, whereby an at least partial retinal reflex image of the retina is obtained, and the making available of the information does not include any projection of information onto the retina

15. Procedure according to point 14, with the steps:

Obtaining image information relating to the field of view from the detected light; and

Projection of the image information onto the retina in correlation with the detected signals in such a way that the naturally perceived visual field and the projected image information are perceived by the retina as a uniform image.

16. The method according to item 14 or 15, wherein said dependence comprises a temporal or spatial correlation between the provision of the information and the detected light. 17. The method according to any one of items 14-16, wherein said dependency comprises a pattern identifier providing at least one information key, and the information keys are used for an information query supported by the information device.

18. The method according to any one of items 14-17, wherein the signal detection comprises scanning processes, wherein in a first scanning process an at least partial detection of the retinal reflex image takes place and in a later scanning process a less extensive detection of the retinal reflex image is carried out.

19. The method according to any one of items 14-17, wherein the signal detection only partially detects the retinal reflex image.

20. The method according to one of the items 14-19, wherein the detection of visible light takes place via a spherical or spherical reflecting layer which deflects part of the light directed onto the eye into a sensor device for detection.

21. The method according to any one of items 12-20, wherein the detection of visible light and / or the signal detection comprises an at least partial detection of the corneal reflex image of the eye.

22. The method according to any one of items 14-21, wherein the information device is a database, a sensor system, an information network connection and / or an evaluation device.

23. A method for transferring optical information onto the human retina using a preferably serial scanning system that records an image incident on the retina and an information projection system, wherein the scanning and projection beam has a predetermined movement pattern and the information is preferably from the signals depends on the scanning system, characterized in that the projection process takes place while the scanning process is running;

24. The method according to item 23, in which a partial projection process takes place after a partial scanning of the image.

25. Device for performing the method according to item 23 or 24, with a preferably serial scanning system, with which an image incident on the retina can be recorded, and with an information projection system, the scanning and projection beam by means of a control device according to a predetermined Movement pattern is controllable, characterized by a device that allows the projection process while the scanning process is running.

26. Device for transferring optical information onto the human retina using a serial scanning and projection system with a predetermined movement pattern of the scanning and projection beam, in which the beam (846) of the projected light lags behind the beam (843) of the received light.

27. Device according to item 26, in which the minimum time offset between the recording and projection of a pixel essentially corresponds to the processing time of the previously recorded image signal.

28. Device according to item 26 or 27, in which the scanning and the projection system have a common or different beam path.

29. Device according to item 26 for transferring optical information onto the human retina using a serial scanning and projection system with a predetermined movement pattern of the scanning and projection beam, thereby indicates that the movement patterns (1502a, 1502b) of the scanning and projection beams are offset from one another.

30. Device according to item 29, in which the movement patterns of the scanning and projection beams are offset from one another by a predetermined small angle.

31. Device according to item 29, in which the movement patterns of the scanning and projection beams are radially offset from one another by a predetermined small distance (11VA).

32. Device according to one of the preceding points, in which the scanning and the scanning system have separate beam paths.

33. Device according to one of the preceding points, in which the scanning system scans the image incident on the retina at a point (929) of the optical system upstream of the retina.

34. Device according to one of the preceding points, in which the movement pattern of the scanning and projection beam corresponds to a spiral.

35. Device according to one of the preceding points, in which the movement pattern of the scanning and projection beam corresponds to a circle or ellipse scan.

36. Device according to one of the preceding points, using a constant scanning speed, or a constant angular speed of the scanning and projection beam, or a speed adapted to the density of the receptors in the human eye, so that the per unit time of the projection beams swept receptors is essentially constant. 37. Use and / or design of the systems and / or methods according to one of the above points for analyzing the eyesight of a patient by generating a predetermined pattern or a predetermined pattern distribution on the retina or on selected areas of the retina by means of the projection unit becomes.

38. Use and / or training of the systems and / or methods according to one of the above points for analyzing the movement patterns and / or the noise fields and / or the spatial vision of a patient's eye, by using the projection unit on the retina for random testing purposes Dot patterns are generated.

39. Use and / or training of the systems and / or methods according to one of the above points for determining abnormalities of the eyeball motor by integrating a device for determining and monitoring the position and / or orientation of the eyeball in the system.

40. Use and / or training for determining the squint angle, in that a device for determining and monitoring the center of the eye of both eyes is integrated.

41. Use and / or training of the systems and / or methods according to one of the above points to uncover parasympathetic / sympathetic efferences by monitoring and evaluating the pupil motor system by means of a detector device.

42. Use and / or formation of the systems and / or methods according to one of the above points as a synoptophore or synoptometer without apparatus convergence. 43. Use and / or training of the systems and / or methods according to one of the above points as a device for determining the cyclodeviation.

44. Use and / or training of the systems and / or methods according to one of the above points as a phase difference haploscope.

45. Use and / or formation of the systems and / or methods according to one of the above points as a device for the visual axis-identical detection of pnories with different viewing directions.

46. Use and / or training of the systems and / or methods according to one of the above points for the functional test of the

Retina, using a sample electro-retinogram (ERG) and a correlation device with which an image played on the retina can be brought into correlation with the actually determined ERG.

47. Use and / or formation of the systems and / or methods according to one of the above points for measuring the contrast sensitivity of a patient's eyesight, preferably as a function of the spatial frequency.

48. Use and / or training of the systems and / or methods according to one of the above points for noise field amimetry.

49. Use and / or training of the systems and / or methods according to one of the above points for determining the extent and the location of central visual field defects (scotomas).

50. Use and / or training of the systems and / or methods according to one of the above points as a VEP (Visual Enabling for Precision Surgery) device. 51. Use and / or training of the systems and / or methods according to one of the above points as an SLO (Scanning Laser Ophthalmoloskop) device.

Claims

Expectations

1. Information system mi t - a signal detection device that detects back-reflected signals from at least one eye having a retina; an information device of an output device which provides information in cooperation with the information device and in dependence on the detected signals, the signal detection device comprising a scanning scanning device which makes at least partial detection of a retinal reflex image of the retina, and the provision of the information is not a projection of information on the retina.

2. Information system according to claim 1, wherein said dependency comprises a temporal or spatial correlation between the provision of the information and the detected signals.

3. Information system according to one of the preceding claims, wherein said dependency comprises a pattern identifier providing at least one information key, and the information keys serve an information query supported by the information device.

4. Information system according to one of the preceding claims, wherein the scanning scanning device records the at least partial detection of the retinal reflex image in a first scanning process and carries out a less extensive recording of the retinal reflex image in a later scanning process.

5. Information system according to one of claims 1-4, wherein the signal detection device only partially detects the retinal reflex image.

6. Information system according to one of the preceding claims, wherein the information device has a spherical or spherically acting reflection layer which deflects part of the light directed onto the eye into a sensor device for detection.

7. Information system according to one of the preceding claims, wherein the signal detection device and / or the information device at least partially detects the corneal reflex image of the eye.

8. Information system according to one of the preceding claims, wherein the signal detection device is designed as a portable unit.

9. Information system according to one of the preceding claims, wherein the output device provides the information tactile, visual, audible, smellable and / or taste.

10. Information system according to one of the preceding claims, wherein the information device is a database, a sensor system, an information network connection and / or an evaluation device.

11. Information system according to one of the preceding claims, wherein the information system is carried out in a portable form.

12. A method for making information available, comprising the steps of: detecting signals which have been reflected back by an eye with a retina; and

Providing the information in cooperation with an information device, depending on the detected signals, wherein the signal acquisition comprises a scanning scan, as a result of which an at least partial retinal reflex image of the retina is obtained, and the provision of the information does not include any projection of information onto the retina.

13. The method according to claim 12, wherein said dependency comprises a temporal or spatial correlation between the provision of the information and the detected signals.

14. The method according to claim 12 or 13, wherein said dependency comprises a pattern identifier providing at least one information key, and the information keys are used for an information query supported by the information device.

15. The method according to any one of claims 12-14, wherein the scanning scan comprises a first scanning process in which the at least partial detection of the retinal reflex image takes place, and a later scanning process in which a less extensive detection of the retinal reflex image is carried out.

16. The method according to any one of claims 12-15, wherein the signal detection only partially detects the retinal reflex image.

17. The method according to any one of the preceding claims, wherein the information device has a spherical or spherical acting reflection layer, which deflects part of the light directed onto the eye into a sensor device for detection.

18. The method according to any one of the preceding claims, wherein the signal detection and / or the information device at least partially detects the corneal reflex image of the eye,

19. The method according to any one of the preceding claims, wherein the information is provided tactile, visual, audible, smellable and / or taste.

20. The method according to any one of the preceding claims, wherein the information device is a database, a sensor system, an information network connection and / or an evaluation device.