EP3036580A1 - Spectacles and method for determining the centre of the pupil of both of the wearer's eyes - Google Patents
Spectacles and method for determining the centre of the pupil of both of the wearer's eyesInfo
- Publication number
- EP3036580A1 EP3036580A1 EP14742450.1A EP14742450A EP3036580A1 EP 3036580 A1 EP3036580 A1 EP 3036580A1 EP 14742450 A EP14742450 A EP 14742450A EP 3036580 A1 EP3036580 A1 EP 3036580A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- pupil
- spectacles
- frame
- glasses
- detection camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 210000001747 pupil Anatomy 0.000 title claims description 54
- 238000000034 method Methods 0.000 title claims description 22
- 238000001514 detection method Methods 0.000 claims description 79
- 239000011521 glass Substances 0.000 claims description 68
- 238000012545 processing Methods 0.000 claims description 21
- 210000000744 eyelid Anatomy 0.000 claims description 19
- 241000282414 Homo sapiens Species 0.000 claims description 18
- 230000002269 spontaneous effect Effects 0.000 claims description 11
- 210000003128 head Anatomy 0.000 claims description 9
- 238000004146 energy storage Methods 0.000 claims description 7
- 230000005484 gravity Effects 0.000 claims description 7
- 230000000007 visual effect Effects 0.000 claims description 7
- 230000006978 adaptation Effects 0.000 claims description 4
- 230000001179 pupillary effect Effects 0.000 claims description 3
- 241000282412 Homo Species 0.000 claims 2
- 238000005259 measurement Methods 0.000 description 18
- 238000012360 testing method Methods 0.000 description 14
- 230000006399 behavior Effects 0.000 description 8
- 230000004424 eye movement Effects 0.000 description 4
- 238000011161 development Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 239000004020 conductor Substances 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 210000000720 eyelash Anatomy 0.000 description 2
- 230000004438 eyesight Effects 0.000 description 2
- 230000006996 mental state Effects 0.000 description 2
- 230000000506 psychotropic effect Effects 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 210000001525 retina Anatomy 0.000 description 2
- 239000005336 safety glass Substances 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 230000003867 tiredness Effects 0.000 description 2
- 208000016255 tiredness Diseases 0.000 description 2
- 208000003443 Unconsciousness Diseases 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 239000000969 carrier Substances 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000006735 deficit Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000003292 diminished effect Effects 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 229920001971 elastomer Polymers 0.000 description 1
- 239000000806 elastomer Substances 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000005304 optical glass Substances 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 229920001296 polysiloxane Polymers 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/11—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for measuring interpupillary distance or diameter of pupils
- A61B3/111—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for measuring interpupillary distance or diameter of pupils for measuring interpupillary distance
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/0016—Operational features thereof
- A61B3/0025—Operational features thereof characterised by electronic signal processing, e.g. eye models
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/0091—Fixation targets for viewing direction
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/14—Arrangements specially adapted for eye photography
- A61B3/145—Arrangements specially adapted for eye photography by video means
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C11/00—Non-optical adjuncts; Attachment thereof
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C11/00—Non-optical adjuncts; Attachment thereof
- G02C11/10—Electronic devices other than hearing aids
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C13/00—Assembling; Repairing; Cleaning
- G02C13/003—Measuring during assembly or fitting of spectacles
- G02C13/005—Measuring geometric parameters required to locate ophtalmic lenses in spectacles frames
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C5/00—Constructions of non-optical parts
- G02C5/02—Bridges; Browbars; Intermediate bars
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C5/00—Constructions of non-optical parts
- G02C5/12—Nose pads; Nose-engaging surfaces of bridges or rims
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C5/00—Constructions of non-optical parts
- G02C5/12—Nose pads; Nose-engaging surfaces of bridges or rims
- G02C5/126—Nose pads; Nose-engaging surfaces of bridges or rims exchangeable or otherwise fitted to the shape of the nose
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C7/00—Optical parts
- G02C7/02—Lenses; Lens systems ; Methods of designing lenses
- G02C7/08—Auxiliary lenses; Arrangements for varying focal length
- G02C7/081—Ophthalmic lenses with variable focal length
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Definitions
- the invention relates to a pair of spectacles according to the preamble of claim 1.
- Glasses which have a camera which is directed to an eye of the relevant spectacle wearer. By recording an eye video, the coordinates of the pupil and the viewing direction of the eye can be determined with such spectacles. Together with a so-called. Field of view video, which further arranged from one in the direction of a user on the glasses
- Field of view camera is created, can be determined with such glasses on which point the user looks.
- a disadvantage of such known glasses is that the arrangement of the cameras can lead to an impairment of the behavior of the user himself.
- Such glasses are usually designed as a measuring device or research utensil and as such also clearly visible.
- test persons accept the glasses concerned in areas that are separated from the public, such as a vehicle or a special test environment, these lead, above all, in environments in which the test subject in question is not shielded from the surrounding environment
- Such known glasses take the eye of the subject from the bottom front. It has been shown that this camera position can have negative effects on the accuracy and quality of the measurement results obtained.
- These known glasses also have the disadvantage that the protruding parts, such as cameras and cables, limit the possible uses of such known glasses on research missions. For example, such goggles pose a significant risk of accident in the vicinity of high-speed rotating machinery. Garments or body-worn garments with loops or protruding parts are useful in many work environments
- the object of the invention is therefore to provide a pair of spectacles of the type mentioned, with which the disadvantages mentioned can be avoided, which has a high accuracy in the detection of the pupils of a subject, with which the influence of the glasses are reduced even to the gaze behavior of the subject and which can be used in accident-prone environments.
- Eye detection camera are visible, done with unprecedented accuracy, and at the same time in so-called. Lateral position of the eyes, therefore, in situations in which the subject so to speak "out of the corner of the eye", only a measurement made by the detection of both eyes from the area of the nose pad or nasal subframe out, at any time at least one of the eyes can be taken from an advantageous angle for the measurement accuracy, whereby good measurement results can be achieved.
- Focusing distance are determined, therefore, the distance to which the subject in question focuses.
- Eye deformities are detected. For this purpose, it may be necessary to individually calibrate the respective glasses on the eyes of the subject. Furthermore, measurements can be carried out on individual eyes with the objective glasses, for example, in which the other eye is covered.
- darkened environment can also be done with the objective glasses analysis of the retina or other parts of the auger.
- spectacles By arranging the eye detection cameras in the nose subframes, spectacles can be provided which have a high measuring accuracy with respect to the viewing direction of the eyes of a user, and which can be carried inconspicuously, so that no influence on the behavior of the user due to wearing the spectacles is given. As a result, significantly improved results can be achieved, especially in public use of the spectacles, since both the measurement accuracy is increased, and the measuring apparatus is now improved by the
- this can be used to monitor the ability to guide a machine, as it can be concluded on the basis of the eye movements on the physical and mental state of the person concerned, such as whether he is overtired or is under the influence of psychotropic substances.
- the invention further relates to a method for the determination of PupiUen centers of both eyes of a person according to the preamble of claim 11.
- the object of the invention is therefore to provide a method of the aforementioned type, with which the aforementioned disadvantages can be avoided, with which with high accuracy, the viewing direction, the
- Focusing or the focusing distance of the eyes of the person concerned are determined. This makes it possible to detect a blink of the eye as a spontaneous blink of the eye, which can safely distinguish between different states of the person concerned, for example between a state of high concentration and a state of tiredness.
- FIG. 1 shows a preferred embodiment of an objective glasses in elevation
- FIG. 2 shows the spectacles according to FIG. 1 in plan view
- FIG. Fig. 3 the glasses of Figure 1 in side elevation.
- FIG. 4 shows the spectacles according to FIG. 1 in a first axonometric representation
- FIG. FIG. 5 shows the spectacles according to FIG. 1 in a second axonometric view
- FIG. FIG. 6 shows the spectacles according to FIG. 1 in a third axonometric view
- Fig. 7 is a block diagram of a preferred embodiment of a
- FIG. 8 shows a detail of a pair of spectacles according to FIG. 1 in plan view
- FIG. 9 shows a detail of a pair of spectacles according to FIG. 1 in side elevation; FIG. and
- Fig. 10 shows a detail of a pair of spectacles according to FIG. 1 in a fourth axonometric representation.
- FIG. 1 to 10 show a pair of glasses 1 with a frame 2, wherein the frame 2 has at least one Scheibenauf receiving opening 3 for a disc, and wherein the frame 2 has a right nose frame 5 and a left nose frame 6, wherein in the right nose frame 5 a right
- Eye detection camera 7 is arranged, and that in the left nose sub-frame 6, a left eye detection camera 8 is arranged.
- Eye detection camera 7, 8 are visible, done with unprecedented accuracy, and at the same time in so-called. Sides of the eyes 24, therefore, in situations in which the subject so to speak "out of the corner of the eye", only a measurement made., By the detection of both eyes 24 out of the area of the nose pad or nose sub-frame 5, 6, at any time at least one of the eyes 24 can be taken from an advantageous angle for the measurement accuracy, whereby good measurement results can be achieved.
- the arrangement of the eye detection cameras 7, 8 in the nose sub-frame 5, 6 can influence the pupil detection by, the eye 24 surrounding eyelashes are reduced. Furthermore, the influence can be more disturbing Reflections on the pupils are diminished. Also, the detection of both eyes 24 of a subject can be recognized more accurately than previously the blink of the subject.
- Focusing distance are determined, therefore, the distance to which the subject in question focuses.
- Focusing distance are determined, therefore, the distance to which the subject in question focuses.
- each eyeglass to calibrate individually on the eyes 24 of the subject. Furthermore, with the objective spectacles 1 measurements on individual eyes 24 can be carried out, for example by covering the respective other eye 24.
- the glasses 1 has no protruding parts, and is therefore suitable to be worn as safety glasses or goggles.
- the eye movements of a worker or of a person operating a machine can not only be monitored and evaluated, but used directly to control the machine.
- this can be used to monitor the ability to drive a machine, as it can be concluded from the eye movements on the physical and psychological state of the person concerned, such as whether he is overtired or is under the influence of psychotropic substances.
- the information "right” or "left” are based on the intended carrying the glasses 1 by a human.
- the subject invention relates to glasses 1 for wearing on the head of a human.
- the glasses 1 has a frame 2, which may also be referred to as a middle part. Furthermore, the glasses 1 on a first bracket 15 and a second bracket 16, which are connected to the frame 2.
- the two brackets 15, 16 are preferably integrally formed on the central part, approximately below
- bracket 15, 16 Forming a flexible area, which allows a bending of the bracket 15, 16. It can also be provided that the two brackets 15, 16 are connected by means of a hinge to the central part.
- the brackets 15, 16 are provided, as is known, to hold the glasses 1 on the head of the wearer, such as these are designed to engage behind the ears of the person wearing the glasses 1.
- the frame 2 and the two brackets 15, 16 are preferably comprising one
- the frame 2 has at least one disc receiving opening 3, in which preferably a disc is arranged, which disc colloquially and regardless of their material is also referred to as glass or spectacle lens.
- the glasses 1 has two disc receiving openings 3, and that in each of the two Scheibenauf openings 3 a disc is arranged.
- the discs may also be optical and / or tinted discs. Through the subject glasses 1 also such look analyzes in carriers of optical glasses are possible.
- the frame 2 has, in a conventional manner, a U-shaped
- Nasenabilityaussparung which is provided for the arrangement of the glasses 1 on the nose of a human.
- right and left nasal sub-frames 5, 6 are preferably areas of the frame 2 surrounding the disc-receiving openings 3, which frame directly and / or integrally into the frame 2 pass over other areas of the frame 2.
- the nose sub-frames 5, 6 may also be referred to as nose-piece frames 5, 6.
- the frame 2 the at least one
- Disk receiving opening 3 does not surround all sides, and the
- Disk receiving opening 3 is therefore designed as open-edged recess.
- Nasenetzlagef laugh 20 The surfaces which are intended for direct contact with the nose of the spectacle-wearing man is referred to as Nasenetzlagef laugh 20. It can be provided that these Nasenauf bearing surfaces 20 are formed as one-piece components of the frame 2. It is preferably provided that the spectacles 1 at least one Nasenstegauf wouldme 11 has, for receiving at least one nose bridge 12th
- the Nasenstegiere 11 is in or on the U-shaped
- Nasenermoreaussparung the frame 2 arranged. It is preferably provided that the Nasenstegititor 11 has a portion of a snap-in connection, and that the provided for arrangement in the Nasenstegor 11 nose ridges 12 have the corresponding other part of such a locking connection.
- the spectacles as shown in the figures, only a single nose bridge recording 11, in which an integral U-shaped nose bridge 12 is arranged, which is also referred to as saddle bridge.
- a nose bridge holder 11 is arranged on each of the two nose piece frames 5, 6, each for receiving a nosepiece 12.
- the nosepiece holder 11 can have different shapes
- the shaped nose pieces 12 are inserted into the glasses 1, which can be adapted to different nose geometries thereby, whereby the glasses 1 can be adapted to different people with simple means, in particular, can also be provided to adapt appropriate nose pads 12 targeted to individual individuals. It can be provided to provide the spectacles 1 in a set or system together with differently shaped nosepieces 12 for the predefinable adaptation of the spectacles 1 to different persons by replacement of the nosepieces 12.
- the at least one nosepiece 12 is preferred comprising silicone and / or an elastomer formed.
- Eye detection camera 7 is arranged, and that in the left nose sub-frame 6, a left eye detection camera 8 is arranged.
- Eye detection cameras 7, 8 are arranged in the parts of the frame 2, which are arranged next to the Nasenholz receiving recess. The two
- Eye detection cameras 7, 8 are designed as digital cameras and have a lens.
- the two eye-detection cameras 7, 8 are each intended to film one eye of the person wearing the respective spectacles 1, and in each case to create an eye video consisting of individual eye images or individual images.
- a main purpose of the eye detection cameras 7, 8 is to detect the pupil of the person wearing the glasses 1. It may therefore be sufficient if the entire eye is not or can not be detected by the respective eye detection camera 7, 8, but only an area around the pupil of the respective eye.
- the eye detection cameras 7, 8 can also be used as
- the eye detection cameras 7, 8 have a suitable focal length to detect the corresponding areas of the eye from the position in the nose subframe.
- the focal length and the detectable with a focal opening angle are dependent on the sensor size of the camera and easily selectable by the executing professional with the subject information.
- the right eye detection camera 7 is directed to a right area 9, in which, when the glasses 1 are arranged on the head of a human being, in a plurality of people at least partially, the right eye 24 of this
- the left eye detection camera 8 is directed to a left area, in which, in a plurality of people at least partially, the left eye of this person is arranged.
- Viewing direction of the two eye detection cameras 7, 8 are individual
- the right-hand region 9 is between 20 mm and 40 mm, in particular between 25 mm and 35 mm, to the right of a spectacle center 10, the corresponding distance 25 is shown in FIG. 8, and between 10 mm and 25 mm
- spectacles 1 are generally constructed symmetrically, they also have a clearly defined center.
- the distance from the eye detection cameras 7, 8 is to be measured in the direction of extension of the brackets 15, 16 or of the head receiving region of the spectacles 1. The given values can be used to achieve a good basic fit to the head shape in Europe and North America. Eyewear for Asian, African,
- FIGS. 8, 9 and 10 respectively show detailed views of the subject spectacles 1.
- a coordinate system is shown. This was, based on the symmetry of the respective glasses 1, chosen such that the spanned by the Y-axis and the Z-axis YZ plane on the right and left sides of the glasses respectively gegen Eisene or symmetrically arranged areas intersects. Normal and parallel to the YZ plane
- Symmetry plane of the glasses is arranged by the X-axis and the Z-axis spanned XZ plane. Normal to the YZ plane and the XZ plane is the XY plane arranged.
- Eye detection camera 8 are each inclined relative to these planes or axes. It is according to a preferred embodiment
- Eye detection cameras 7, 8 at a first angle 21 with respect to the Y-axis are arranged, and that the first angle 21 is between 30 and 50 1 .
- each optical axis 23 of the two eye detection cameras 7, 8 are arranged at a second angle 22 with respect to the X axis, and that the second angle 22 is between 25 and 35 '.
- the right eye detection camera 7 and / or the left eye detection camera 8 at least about an axis, in particular about 2 axes, pivotable in the right nose sub-frame 5 and the left
- Nasenteilteilen 6 are arranged. Thereby, the viewing direction of the right and left eye detection cameras 7, 8 can be adjusted. As a result, an adaptation of the glasses 1 to different head shapes is possible.
- At least one field of view camera 13 is arranged on the frame 2.
- the field of view camera 13 is intended to record existing field of view video consisting of individual and successive field of view images.
- the respective viewpoint can be entered in the field of view video.
- the field of view camera 13 is explicitly indicated only in FIG. 1 on the spectacles 1.
- the at least one field of view camera 13 is arranged in a region or web between the right nose part frame 5 and the left nose part frame 6. It can also be provided to arrange a larger number of field of view cameras 13 in the spectacles 1, wherein in particular one left and one right field of view camera in the frame 2 is provided in the region of the transition to the first or second bracket 15, 16.
- the spectacles 1 have a data processing unit 17 and a data interface 18, that the data processing unit 17 is connected to the right eye detection camera 7 and the left eye detection camera 8, that the spectacles 1 further an energy storage 19 for Power supply of the right eye detection camera 7 and the left eye detection camera 8 and the data processing unit 17 and the
- Data interface 18 has.
- first bracket 15 in the first bracket 15, the data processing unit 17 and the data interface 18 are arranged, and that in the second bracket 16 of the energy storage 19 is arranged.
- the first bracket 15 may be either the right or the left bracket, and vice versa. This allows the entire
- Fig. 7 shows a block diagram of a correspondingly formed glasses 1, wherein the outer contours of the block diagram to symbolize the glasses 1.
- the three cameras, the field of view camera 13, the right eye detection camera 7 and the left eye detection camera 8 are arranged. These are each connected to the arranged in the second bracket 16 energy storage 19, which is preferably designed as an accumulator, circuit technology, at least indirectly connected.
- a data processing unit 17 is arranged, which includes a data memory. This is preferred as a combination of a microcontroller or DSP together with a RAM
- the data processing unit 17 is connected to a data interface 18 by signal conductors. It can also be provided that the
- Data interface 18 and the data processing unit 17 are formed in hardware together, such as an ASIC or an FPGA.
- the interface is designed as a wireless interface, such as the Bluetooth standard or IEEE 802.x, or as a wired interface, such as the USB standard, in which case the glasses 1 a corresponding outlet, such as Micro-USB , having.
- the data processing unit 17 and the data interface 18 are circuitry at least indirectly connected to the energy storage 19, and signal conductor technology with the three cameras, the field of view camera 13, the right eye detection camera 7 and the left
- the spectacles 1 described above are particularly suitable for carrying out a method for the determination of
- Eye detection camera 7 is detected, wherein the right eye detection camera 7, consisting of successive right frames existing right
- Eye video is created, wherein right pupil coordinates are determined within the right eye images of the - right pupil center - right eye pupil of the right eye images, wherein the left pupil of the human is detected by the left eye detection camera 8, the left eye detection camera 8 a from each other existing left eye images existing left eye video created, with pupil coordinates within the left eye images of a - the left
- Pupil center corresponding to the center of gravity of the left pupil are determined from the left eye images, and wherein the right pupil center and / or the left pupil center is stored and / or output.
- a detection of the viewing direction of both eyes 24 of a human can be detected.
- the viewing direction of a person can be determined with high accuracy.
- the focus distance or the focusing distance of the eyes of the relevant person can be determined. This makes it possible to detect a blink of the eye as a spontaneous blink of the eye, which can safely distinguish between different states of the person concerned, for example between a state of high concentration and a state of tiredness.
- a computational lens equalization is performed to the two eye detection cameras 7, 8 and the field of view camera 13, as well as a correction of perspective distortions.
- the two eye videos and the field of view video are recorded synchronized in time, which is controlled by the data processing unit 17.
- the exact pupil coordinates of the pupil center in the eye video are determined by an image recognition program.
- the pupil coordinates are determined for each frame of the eye video.
- the determination of the pupil coordinates preferably takes place automatically with an image recognition program.
- the contrasts of the pupil to the environment are registered for each individual image of the eye video, and all points of the individual image that are darker than a set darkness level are searched for. These points fully capture and delineate a dark area, and then automatically determine the center of gravity of that dark area. Since the dark area corresponds to the pupil of the subject, the center of gravity of the dark area represents the pupil center.
- the image recognition program provides
- the gray level threshold is that value which is e.g.
- digitized form is between 1 and 256, and defines the percentage of black and white on a pixel.
- the highest achievable value corresponds to a full black, the lowest value to the white. Since the pupil is unlikely to reach the full black level during recording, a value must be defined which, at least for this image, corresponds to the pupil gray actually present.
- the threshold eliminates all pixels that are lighter than the defined gray, all darker areas are used to find the center of gravity. Three parameters make it possible to optimize the threshold definition. Since during the experiments within a sequence the
- Pupillenstoff is calibrated using a predetermined visual sequence.
- a sample look sequence is a look sequence that is recorded for calibration only and that the subject looks for given pass points.
- a particular control point may be marked on a wall.
- a black mark on an otherwise white surface can be selected as a control point.
- the control point is usually a cross or a glowing point or similar. The subject is instructed to fix this point of control, with the subject's field of vision and eye being captured by the two eye detection cameras and the field of view camera.
- the control points to be targeted are also preferably arranged at different defined intervals.
- the front side of the spectacles 1 is the wearer of the spectacles 1 side facing away.
- Data processing unit 17 is activated.
- Illuminant By specifiable changing the position of the head with constant fixation of the light source image in the mirror, the positions of the pupils with respect to the glasses 1 and the eye detection cameras 7, 8 change. Since the wavelength or color of the light bulb 26 is known, this can by the field of view camera 13th and the data processing unit 17 can be easily recognized.
- the center of the pupil is hidden and in a single image of the eye a left eyelid obscures the left pupil center producing a message of a spontaneous blink and issuing and / or storing it.
- the respective right and left frames which are listed in the stated condition, are each time substantially simultaneously recorded frames.
- Pattern recognition makes it easily possible to recognize the pupil as such constantly moving from one image to the next and to distinguish it from a highlight. In this way, a partial covering of the respective pupil can be easily and reliably attributed to a blink.
- a visual failure time between the beginning of a spontaneous eyelid strike and the end of the same spontaneous eyelid strike is measured, and that generates a warning message when a time limit is exceeded by the visual failure time and / or issued becomes.
- the glasses 1 Cooperating with a machine to monitor whether the person operating the machine is paying attention to what is considered necessary for the job.
- the glasses 1 based on the eyelid activities of the concerned
- the glasses 1 can then give, for example, a warning message, turn off the relevant machine or other
- Focus distance determined and preferably stored and / or output.
- switching pulses or switching commands can be generated and output.
- the interpupillary distance forms the basis of a fictitious triangle, with the viewing angles of the two eyes representing the angles which the two sides occupy towards the base. From this, the height of the triangle in question can be determined simply as the focus distance or the eye setting distance, which makes it possible to determine even more precisely the point at which a person actually looks.
- Disc lenses to be adjusted or controlled to accommodate openings 3 or lenses with variable or predeterminable variable geometry. It is preferably provided that the at least one lens with the
- Data processing unit 17 is connected.
- the memory associated with the data processing unit 17 In order to set the relevant geometric parameters on the respective lens, it is necessary for the memory associated with the data processing unit 17 to be stored in each case at specific focal distances or distance intervals.
- the respective parameters can contain several variables for each focus distance.
- To adjust the geometry of the respective lenses it is preferably provided that at least one value assigned to the determined focus distance is taken from the data memory for geometrically determining the lens with a predeterminable variable geometry, and that the geometry of the lens is adjusted on the basis of the value.
- a pair of glasses 1 can be created, which can provide a reliable remedy even in complicated eyesight.
- anomalies preceding the pupil and / or iris can be recognized from the images of the two eyes.
- the navigational structures or patterns of the eyes can be recorded in connection with predeterminable examination procedures.
- these can be analyzed and compared so that real eye medical recordings are possible.
Landscapes
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Engineering & Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Molecular Biology (AREA)
- Veterinary Medicine (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Biophysics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Biomedical Technology (AREA)
- Public Health (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Acoustics & Sound (AREA)
- Otolaryngology (AREA)
- Geometry (AREA)
- Signal Processing (AREA)
- Eye Examination Apparatus (AREA)
- Eyeglasses (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
ATA657/2013A AT513987B1 (en) | 2013-08-23 | 2013-08-23 | Spectacles and methods for determining pupil centers of both eyes of a human |
PCT/AT2014/000107 WO2015024031A1 (en) | 2013-08-23 | 2014-05-05 | Spectacles and method for determining the centre of the pupil of both of the wearer's eyes |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3036580A1 true EP3036580A1 (en) | 2016-06-29 |
Family
ID=51224634
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14742450.1A Pending EP3036580A1 (en) | 2013-08-23 | 2014-05-05 | Spectacles and method for determining the centre of the pupil of both of the wearer's eyes |
Country Status (10)
Country | Link |
---|---|
US (1) | US9668648B2 (en) |
EP (1) | EP3036580A1 (en) |
CN (1) | CN105579884B (en) |
AT (1) | AT513987B1 (en) |
AU (1) | AU2014308570B2 (en) |
CA (1) | CA2959078C (en) |
IL (1) | IL244230A0 (en) |
RU (1) | RU2016110406A (en) |
SG (1) | SG11201601286SA (en) |
WO (1) | WO2015024031A1 (en) |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20150055121A (en) * | 2013-11-06 | 2015-05-21 | 한국전자통신연구원 | Apparatus and method for displaying hologram image using pupil tracking |
US20150331260A1 (en) * | 2014-05-15 | 2015-11-19 | Kessler Foundation Inc. | Wearable systems and methods for treatment of a neurocognitive condition |
CN106019588A (en) * | 2016-06-23 | 2016-10-12 | 深圳市虚拟现实科技有限公司 | Near-to-eye display device capable of automatically measuring interpupillary distance and method |
CN106054386A (en) * | 2016-06-25 | 2016-10-26 | 深圳市虚拟现实科技有限公司 | Self-adaptive near-eye display device |
CN108572450B (en) * | 2017-03-09 | 2021-01-29 | 宏碁股份有限公司 | Head-mounted display, visual field correction method thereof and mixed reality display system |
JP6953247B2 (en) * | 2017-09-08 | 2021-10-27 | ラピスセミコンダクタ株式会社 | Goggles type display device, line-of-sight detection method and line-of-sight detection system |
AT520705B1 (en) * | 2017-11-16 | 2021-06-15 | Viewpointsystem Gmbh | EYEGLASSES HOLDER |
CN108257091B (en) * | 2018-01-16 | 2022-08-05 | 北京小米移动软件有限公司 | Imaging processing method for intelligent mirror and intelligent mirror |
WO2019154510A1 (en) | 2018-02-09 | 2019-08-15 | Pupil Labs Gmbh | Devices, systems and methods for predicting gaze-related parameters |
WO2019154509A1 (en) * | 2018-02-09 | 2019-08-15 | Pupil Labs Gmbh | Devices, systems and methods for predicting gaze-related parameters |
US11556741B2 (en) | 2018-02-09 | 2023-01-17 | Pupil Labs Gmbh | Devices, systems and methods for predicting gaze-related parameters using a neural network |
AT521860B1 (en) | 2018-11-09 | 2021-02-15 | Viewpointsystem Gmbh | METHOD OF MANUFACTURING AT LEAST ONE NOSE PAD |
AT522012A1 (en) * | 2018-12-19 | 2020-07-15 | Viewpointsystem Gmbh | Method for adapting an optical system to an individual user |
WO2020147948A1 (en) | 2019-01-16 | 2020-07-23 | Pupil Labs Gmbh | Methods for generating calibration data for head-wearable devices and eye tracking system |
US11676422B2 (en) | 2019-06-05 | 2023-06-13 | Pupil Labs Gmbh | Devices, systems and methods for predicting gaze-related parameters |
EP3987380B1 (en) * | 2019-06-18 | 2024-10-16 | Pupil Labs GmbH | Systems and methods for determining one or more parameters of a user's eye |
JP6808808B1 (en) * | 2019-12-24 | 2021-01-06 | 湯田 秋夫 | AI assistant in glasses, storage aid for image recognition function. |
US11768368B2 (en) * | 2020-05-14 | 2023-09-26 | Viewpointsystem Gmbh | Spectacles and method for determining the pupil center |
WO2022069018A1 (en) | 2020-09-29 | 2022-04-07 | Viewpointsystem Gmbh | Additively manufactured eye tracking spectacles |
WO2022122117A1 (en) | 2020-12-07 | 2022-06-16 | Viewpointsystem Gmbh | Method for implementing a zooming function in an eye tracking system |
JP2023554490A (en) | 2020-12-21 | 2023-12-27 | ヴューポイントシステム ゲー・エム・ベー・ハー | Eye tracking kit adaptable to glasses |
WO2022237954A1 (en) | 2021-05-10 | 2022-11-17 | Viewpointsystem Gmbh | Eye tracking module wearable by a human being |
WO2022262936A1 (en) | 2021-06-14 | 2022-12-22 | Viewpointsystem Gmbh | Gaze based method for triggering actions on an operable device |
WO2023036414A1 (en) | 2021-09-09 | 2023-03-16 | Viewpointsystem Gmbh | Nose pad eye/gaze tracking module applicable to smart glasses |
CN117814794B (en) * | 2023-12-13 | 2024-08-27 | 山东省体育科学研究中心 | Eye movement feedback instrument for monitoring and evaluating motor psychological quality |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4300818A (en) | 1978-03-13 | 1981-11-17 | Schachar Ronald A | Multifocal ophthalmic lens |
DE3436133A1 (en) * | 1984-10-02 | 1986-04-10 | Wilhelm St. Moritz Anger | METHOD FOR PRODUCING EYEWEAR |
WO2001069933A1 (en) | 2000-03-15 | 2001-09-20 | Next Level Communications, Inc. | Method and apparatus for transmitting wireless signals over media |
US6997556B2 (en) | 2001-10-01 | 2006-02-14 | Ernst Pfleger | Method for detecting, evaluating, and analyzing look sequences |
JP4580678B2 (en) * | 2004-04-28 | 2010-11-17 | 株式会社ディテクト | Gaze point display device |
AT505338B1 (en) | 2007-06-12 | 2009-03-15 | Ernst Dipl Ing Dr Pfleger | PROCEDURE FOR PERFORMANCE MEASUREMENT |
EP2499964B1 (en) * | 2011-03-18 | 2015-04-15 | SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH | Optical measuring device and system |
CN202057914U (en) * | 2011-04-29 | 2011-11-30 | 许骅 | Camera glasses |
US8885877B2 (en) * | 2011-05-20 | 2014-11-11 | Eyefluence, Inc. | Systems and methods for identifying gaze tracking scene reference locations |
US8752963B2 (en) * | 2011-11-04 | 2014-06-17 | Microsoft Corporation | See-through display brightness control |
GB2496064B (en) * | 2012-12-31 | 2015-03-11 | Nicholas Jamie Marston | Video camera shooting glasses |
-
2013
- 2013-08-23 AT ATA657/2013A patent/AT513987B1/en active
-
2014
- 2014-05-05 EP EP14742450.1A patent/EP3036580A1/en active Pending
- 2014-05-05 WO PCT/AT2014/000107 patent/WO2015024031A1/en active Application Filing
- 2014-05-05 CA CA2959078A patent/CA2959078C/en active Active
- 2014-05-05 SG SG11201601286SA patent/SG11201601286SA/en unknown
- 2014-05-05 US US14/913,633 patent/US9668648B2/en active Active
- 2014-05-05 AU AU2014308570A patent/AU2014308570B2/en not_active Ceased
- 2014-05-05 CN CN201480052409.6A patent/CN105579884B/en active Active
- 2014-05-05 RU RU2016110406A patent/RU2016110406A/en not_active Application Discontinuation
-
2016
- 2016-02-22 IL IL244230A patent/IL244230A0/en unknown
Non-Patent Citations (2)
Title |
---|
None * |
See also references of WO2015024031A1 * |
Also Published As
Publication number | Publication date |
---|---|
RU2016110406A (en) | 2017-09-28 |
AT513987A4 (en) | 2014-09-15 |
US20160206196A1 (en) | 2016-07-21 |
SG11201601286SA (en) | 2016-03-30 |
AT513987B1 (en) | 2014-09-15 |
WO2015024031A1 (en) | 2015-02-26 |
US9668648B2 (en) | 2017-06-06 |
AU2014308570B2 (en) | 2017-02-02 |
CA2959078A1 (en) | 2015-02-26 |
CA2959078C (en) | 2017-10-10 |
CN105579884A (en) | 2016-05-11 |
IL244230A0 (en) | 2016-04-21 |
AU2014308570A1 (en) | 2016-03-24 |
CN105579884B (en) | 2019-12-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
AT513987B1 (en) | Spectacles and methods for determining pupil centers of both eyes of a human | |
EP3355104B2 (en) | Method and device and computer program for determining a representation of a spectacle glass rim | |
EP2157903B1 (en) | Method for perception measurement | |
EP3956721B1 (en) | Determination of at least one optical parameter of a spectacle lens | |
DE69906139T2 (en) | DEVICE FOR TRACKING EYE MOVEMENT | |
EP3958726B1 (en) | Determination of a refraction error of an eye | |
EP2582284B1 (en) | Method and device for determining eye position | |
EP3235422A1 (en) | Device and method for determining the eye's centre of rotation | |
EP3210071B1 (en) | Apparatus and method for determining optical parameters | |
DE102016201531A1 (en) | Method and device for detecting fatigue of a driver | |
EP3195052B1 (en) | Method for determining centering data of a test subject with measurement accuracy in order to adapt a pair of eyeglasses to the test subject, and immobile video centering system | |
EP3955800A1 (en) | Determination of a refractive error of an eye | |
DE102013021974B3 (en) | Device for determining an ametropia of an eye | |
EP3972478B1 (en) | Joint determination of accommodation and vergence | |
WO2011131169A1 (en) | Video centering system having visual-field evaluation and method for evaluating visual fields | |
CN116113867B (en) | Method and glasses for determining pupil center | |
WO2017220667A1 (en) | Method and device for modifying the affective visual information in the field of vision of an user | |
DE102011009261B4 (en) | Determination of the rotation parameters of the eyes | |
DE102004020356A1 (en) | Eye`s multidimensional movement detecting method for use by e.g. scientist, involves determining movement of eye and head using series of values that are acquired by taking into consideration pupil position and markings at head | |
DE10138158A1 (en) | Contact free magnified imaging of a section of the epithelium or endothelium of the eye using a slit illumination arrangement that is used to record multiple images of the cornea | |
DE102020109982A1 (en) | Method for measuring a pupil and device for carrying out the method | |
DE102010021346B4 (en) | Ophthalmological examination device | |
DE102014015345A1 (en) | Method for the accurate determination of optic-physiognomic parameters of a subject for the adaptation of spectacle lenses to the subject for the near vision situation | |
DE102014208966A1 (en) | System for detecting the viewing direction | |
DE102012019463A1 (en) | Device for automatic rough positioning of measuring head of ophthalmologic apparatus over eye of patient, uses specific algorithm to determine probable location of to-be-examined eye and to activate existing actuators accordingly |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20160316 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20190711 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
APBK | Appeal reference recorded |
Free format text: ORIGINAL CODE: EPIDOSNREFNE |
|
APAF | Appeal reference modified |
Free format text: ORIGINAL CODE: EPIDOSCREFNE |
|
19A | Proceedings stayed before grant |
Effective date: 20200228 |
|
RAP3 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: PFLEGER, CHRISTOPH Owner name: PFLEGER, ERNST |
|
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: PFLEGER, CHRISTOPH Inventor name: PFLEGER, ERNST |