JP3186249B2 - Eye gaze detection device and eye gaze detection method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a rotation angle of the eyeball optical axis
Detected and corrected for individual differences
The present invention relates to an improvement in a line-of-sight detection device and a line-of-sight detection method for obtaining a line .

[0002]

2. Description of the Related Art Various devices (for example, eye cameras) for detecting a so-called line of sight (a visual axis) for detecting which position on an observation surface the observer is observing have been proposed.

[0003] For example, in JP-flat 1-274736, projecting a collimated light beam from a light source of the viewer's eye to the anterior segment, utilizing the imaging position of the corneal reflection image and the pupil due to reflected light from the cornea And seek the visual axis.

[0004] The applicant of the present invention has disclosed Japanese Patent Application No. 3-1149.
No. 2 proposes an optical device having a line-of-sight detection function for performing various types of photographing using a correction data collection (hereinafter, referred to as calibration) function for correcting individual differences in the line of sight of the photographer. ing.

FIG. 25 is a diagram for explaining the principle of the visual line detection method.
6A and 6B are explanatory diagrams of an eyeball image projected on the surface of the image sensor 14 in FIG. 25 and the output intensity from the image sensor 14.

Next, a gaze detection method will be described with reference to FIGS. 25 and 26.

The infrared light emitting diodes 13a and 13b are arranged substantially symmetrically in the X direction with respect to the optical axis A of the light receiving lens 12, and divergently illuminate the eyes of the observer (photographer).

The infrared light emitted from the infrared light emitting diode 13b illuminates the cornea 16 of the eyeball 15. At this time, the cornea 1
The corneal reflection image d due to a part of the infrared light reflected on the surface of No. 6 is condensed by the light receiving lens 12 and re-formed at the position d 'on the image sensor 14.

Similarly, the infrared light projected from the infrared light emitting diode 13a illuminates the cornea 16 of the eyeball 15. At this time, a corneal reflection image e due to a part of the infrared light reflected on the surface of the cornea 16 is condensed by the light receiving lens 12 and re-images at a position e ′ on the image sensor 14.

Light beams from the ends a and b of the iris 17 form images of the ends a and b on the image sensor 14 via the light receiving lens 12 at positions a 'and b'. When the rotation angle θ of the optical axis a of the eyeball 15 with respect to the optical axis a of the light receiving lens 12 is small, the X coordinates of the ends a and b of the iris 17 are xa and xb
Then, the coordinate xc of the center position c of the pupil 19 is expressed as xc ≒ (xa + xb) / 2.

Further, since the X coordinate of the midpoint between the corneal reflection images d and e coincides with the X coordinate xo of the center of curvature o of the cornea 16, the X coordinates of the positions where the corneal reflection images d and e are generated are xd and x.
e, a standard distance between the center of curvature o of the cornea 16 and the center c of the pupil 19 is L _oc, and a coefficient that considers an individual difference with respect to the distance L _oc is A1, and the rotation angle θ of the optical axis a of the eye 15
Satisfies the relational expression of (A1 * L _oc ) * sin θ ≒ xc− (xd + xe) / 2 (1). Therefore, in the eye-gaze calculation processing device, as shown in FIG. 26B, each feature point (corneal reflection images d and e and iris 1) projected on a part of the image sensor 14 is displayed.
7 by detecting the position of the end portions a, b) of the eyeball 1
5, the rotation angle θ of the optical axis a can be obtained. In this case equation _{(1), β (A1 * L oc)} * sinθ ≒ (xa' + xb') / 2 - rewritten as (xd' + xe') / 2 ......... (2). Here, β is a magnification determined by the position of the eyeball 15 with respect to the light receiving lens 12, and is substantially obtained as a function of the interval | xd'-xe '| of the corneal reflection image. The rotation angle θ of the optical axis a of the eyeball 15 is rewritten as θ ≒ ARCSIN ｛(xc′−xf ′) / β / (A1 * L _oc )｝ (3) However, xc '≒ (xa' + xb ') / 2 xf' ≒ (xd '+ xe') / 2.

By the way, since the optical axis A of the photographer's eyeball 15 does not match the visual axis, when the horizontal rotation angle θ of the optical axis A is calculated, the angle correction δ between the optical axis A and the visual axis is calculated. , The horizontal line of sight θH of the photographer is obtained. Assuming that a coefficient considering the individual difference with respect to the correction angle δ between the optical axis A of the eyeball 15 and the visual axis is B1, the horizontal line of sight θ of the photographer
H is obtained as follows: θH = θ ± (B1 * δ) (4) Here, as for the sign ±, if the rotation angle to the right with respect to the photographer is positive, the sign of + is selected when the photographer's eye looking into the observation device is the left eye, and the sign is-when the photographer's eye is the right eye.

In the same figure, the eyeball of the photographer is Z
Although an example in which the image is rotated in the -X plane (for example, a horizontal plane) is shown, the same can be detected when the eyeball of the photographer rotates in the XY plane (for example, a vertical plane). However, since the vertical component of the line of sight of the photographer matches the vertical component θ 'of the optical axis A of the eyeball 15, the vertical line of sight θV is θV = θ ′. Further, the position (xn, y) on the focus plate in the viewfinder field viewed by the photographer from the line-of-sight data θH, θV.
n) is xn ≒ m * θH ≒ m * [ARCSIN {(xc'-xf ') / β / (A1 * L oc)} ± (B1 * δ)] .................. (5) yn ≒ m * ΘV. Here, m is a constant determined by the finder optical system of the camera.

Here, the values of the coefficients A1 and B1 for correcting the individual difference of the photographer's eyeball 15 are obtained by having the photographer fixate the target located at a predetermined position in the viewfinder of the camera. It is determined by matching the position of the target with the position of the fixation point calculated according to the above equation (5).

Normally, the calculation for obtaining the line of sight and the gazing point of the photographer is executed by the software of the microcomputer of the line-of-sight calculation processing device based on the above equations.

Further, since the coefficient for correcting the individual difference in the line of sight normally corresponds to the horizontal rotation of the eyeball of the photographer, the two targets provided in the viewfinder of the camera are not provided to the photographer. It is set to be horizontal with respect to the horizontal direction.

A coefficient for correcting the individual difference of the line of sight is determined, the position of the line of sight of the photographer who looks through the viewfinder of the camera is calculated using the above equation (5), and the line of sight information is used to adjust the focus of the photographing lens. Alternatively, it is used for exposure control and the like.

[0018] Correction data for correcting errors due to individual differences in the line of sight is collected, that is, as a calibration method, the ratio between the line of sight of the photographer and the rotation angle of the eyeball is the luminance of the observation target at that time, and thus the photographer. Since the pupil depends on the size of the pupil, a calibration method for collecting the line-of-sight data and the pupil diameter at that time when the aperture of the taking lens is opened and at the minimum aperture, and collecting correction data based on this is disclosed by the present applicant. Proposed.

[0019]

However, in the above-mentioned calibration method, even if the aperture of the photographing lens is set to the minimum aperture from the open state , the diameter of the pupil of the photographer does not change so much. It has been difficult to accurately obtain individual difference data depending on the diameter.

Further, since the correction data is uniquely calculated from one individual difference data, if the individual difference data contains an error, there is a problem that the correction data calculated therefrom still contains the error. there were.

(Object of the Invention) An object of the present invention is to provide a gaze detection device and a gaze detection device capable of further reducing a gaze detection error.
And a gaze detection method .

[0022]

Means for Solving the Problems In order to achieve the above object, the present invention according to claim 1, in a gaze detection device, an eyeball rotation angle detection means for detecting a rotation angle of an eyeball optical axis, Personal difference data detecting means for detecting personal difference data, and correction data forming means for forming correction data for correcting personal differences of the eyeballs from statistical calculation of the personal difference data,
A visual axis detecting means for detecting a line of sight from the correction data formed by the rotation angle and the correction data forming means of the detected eyeball optical axis by said eyeball rotation angle detecting means, the correction data type
When the individual difference data is detected by the individual difference data detecting means after forming, carried out different operations from the statistical calculation using the detected after the correction data forming pieces <br/> human difference data
It is characterized by having a correction data updating means for updating the correction data Te. Also in order to achieve the above object, the present invention according to claim 6 is the visual axis detecting method, and the eyeball rotation angle detecting step of detecting a rotation angle of the eyeball optical axis, individual differences to detect the individual difference data of the eye A data detection step, a correction data forming step of forming correction data for correcting an individual difference of an eyeball from a statistical operation of the individual difference data , and a rotation angle of an optical axis of the eyeball detected in the eyeball rotation angle detection step. and line-of-sight detection step of detecting a line of sight from the correction data formed by the correction data forming step, when the individual difference data at the personal difference data detecting step after said correction data forming is detected, 該補
Using the individual difference data detected after the formation of the positive data,
A correction data updating step of performing an operation different from the statistical operation to update the correction data.

[0023]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail based on the illustrated embodiment, but before that, a method of correcting individual differences in the line of sight in this embodiment will be described.

First, regarding the horizontal direction, assuming that the horizontal eyeball rotation angle is θx and the pupil diameter at that time is Rpp, it is assumed that the horizontal line-of-sight coordinate x is obtained by the following equation.

X = m * {θx- (cx * Rpp + dx)} / (ax * Rpp + bx) (6) where m is a conversion coefficient of rotation angle / coordinate and is a constant, ax to dx
Is an individual difference correction coefficient in the horizontal direction, which is calculated from individual difference data.

Since the observed rotation angle θx depends on the pupil diameter Rpp, it can be set as follows: θx = Kx * Rpp + Lx (7)

Assuming that the coefficients Kx and Lx in the above equation (7) are linear functions of the line-of-sight coordinates, Kx = ax * x / m + cx (8) Lx = bx * x / m + dx (8) ... (9) When the target 1 (horizontal coordinate x1) is observed at a certain luminance, assuming that the rotation angle θx1 and the pupil diameter Rpp1 at that time, θx1 = Kx1 * Rpp1 + Lx1 (7 ′) Kx1 = ax * x1 / m + cx (8 ′) Lx1 = bx * x1 / m + dx (9 ′) Similarly, at target 2 (horizontal coordinate x2), θx2 = Kx2 * Rpp2 + Lx2. (7 ") Kx2 = ax * x2 / m + cx (8") Lx2 = bx * x2 / m + dx (9 ")

In the method described later, Kx1 and Kx2 in the above equation (7 ') are replaced by Kx2 and Lx in the above equation (7 ").
When 2 is determined, ax = {m * (Kx1−Kx2)} / (x1−x2) (10) cx = (Kx1 + Kx2) / 2 from the above equations (8 ′) and (8 ″). ... (11), and from the above equations (9 ′) and (9 ″), bx = {m * (Kx1−Kx2)} / (x1−x2) (12) dx = (Kx1 + Kx2) / 2 ... (13)

Next, regarding the vertical direction, assuming that the vertical eyeball rotation angle is θy and the pupil diameter at that time is Rpp, the vertical line-of-sight coordinate y is obtained by the following equation.

Y = m * {θy- (cy * Rpp + dy)} / (ay * Rpp + by) (14) where m is a constant which is a conversion coefficient of the rotation angle / coordinate as described above. dy is a vertical direction individual difference correction coefficient, which is calculated from individual difference data.

Since the observed rotation angle θy depends on the pupil diameter Rpp, it can be set as follows: θy = Ky * Rpp + Ly (15)

Assuming that the coefficients Ky and Ly in the above equation (15) are linear functions of the line-of-sight coordinates, Ky = ay * y / m + cy (16) Ly = by * y / m + dy (16) (17)

By the way, the two targets for calibration are arranged apart from each other in the horizontal direction, but have the same coordinates in the vertical direction. Therefore, the horizontal individual difference correction coefficients ax to dx can be obtained as described above,
The individual difference correction coefficients ay to dy in the vertical direction cannot be similarly obtained.

Therefore, the following assumption is made for the denominator of the above equation (14).

[0035] ay * Rpp + by = ax * Rpp + b
x = constant therefore ay = 0 (18) by = ax * Rpp _ABE + bx = constant (19) Here, Rpp _ABE represents the average of the pupil diameters detected a plurality of times.

From the above equations (16) and (17), cy = Ky (20) dy = Ly-by * y / m Since the vertical coordinate y of the target is "0", dy = Ly. (21) Next, a method of obtaining Kx1, Lx2, Kx2, Lx2, Ky, and Ly will be described.

The basic idea is that a plurality of θx, θy, Rp input at intervals in the calibration operation
p is stored and is used to determine Kx1 to Ly that satisfy the expressions (7) and (15) as much as possible. For this purpose, “simple averaging” and “least square method” are used. In the first place, since it is desired to detect the dependence of the eyeball rotation angles θx and θy on the pupil diameter Rpp, if there is little change in the stored values of the plurality of pupil diameters Rpp, Kx is obtained by a simple average.
1, Lx1, or Kx2, Lx2, or Ky, Ly
Is calculated, and if the change is large, K is calculated by the least squares method.
x1 to Ly are determined. When the number of input data is small, a simple average is used.

Specifically, the following calculation is performed.

In a certain calibration operation,
The data obtained when the rightmost target 1 is observed is [θx1, θy
1, Rpx1 ] and data obtained when the leftmost target 2 is observed are [θx2, θy2, Rpx2 ], and θy = (θy1 + θy2) / 2 Rpy = (Rpx1 + Rpx2) / 2 A) The number of data n <ns (for example, 2), or when the change (or deviation amount) of the pupil diameter Rpp is small, Kx1 to Ly are calculated from the following equations using a simple average.

Kx1 = 0 (22) Lx1 = Σθx1 / n (23) Kx2 = 0 (24) Lx2 = Σθx2 / n (25) Ky = 0 (26) Ly = Σθy / n (27) B) When the number of data n ≧ ns and the change in the pupil diameter Rpp is large, the least squares method is used. , Kx1 to
Calculate Ly.

[0041] Kx1 = (nΣRpx1 * θx1-ΣRpx1 * Σθx1) / {nΣRpx1 2 - (ΣRpx1) 2} ......... (28) Lx1 = (ΣRpx1 2 * θx1-ΣRpx1 * ΣRpx1 * θx1) / {nΣRpx1 2 - ( ΣRpx1) ² ｝ (29) Kx2 = (nΣRpx2 * θx2-ΣRpx2 * Σθx2) / ｛nΣRpx2 ^2- (ΣRpx2) ² ｝ ... (30) Lx2 = (ΣRpx2 ² * Σθx2-Σpx2Σx2Σx2Σx2x) ^{) / {nΣRpx2 2 - (ΣRpx2} ) 2} ......... (31) Ky = (nΣRpy * θy-ΣRpy * Σθy) / {nΣRpy 2 - (ΣRpy) 2} ......... (32) Ly = (nΣRpy * Σθy -ΣRpy * ΣRpy * θy) / { nΣRpy 2 - (ΣRpy) 2} ......... (33) further, the above case B) in the present invention When calculating each sigma, so that priority is given to the new data.

In general, when operating a device, the more the same operation is performed, the more the user becomes proficient. From such a viewpoint, the latest individual difference data is given the highest priority in the calibration operation.

Specifically, ΣRpx1, Σθx1,
ΣRpx1 * θx1, ΣRpx1 ² , n is Rx
1, Tx1, RTx1, RSx1, Nx1, ΣRpx
2, Σθx2, ΣRpx2 * θx2, ΣRpx2 ² , n
To Rx2, Tx2, RTx2, RSx2, Nx
2, ２Rpy, Σθy, ΣRpy * θy, ΣRpy
² and n are Ry, Ty, RTy, RSy, and Ny, respectively.
(28) to (33) are converted as follows.

Kx1 = (Nx1 * RTx1-Rx1 * Tx1) / (Nx1 * RSx1-Rx1 ² ) (34) Lx1 = (RSx1 * Tx1-Rx1 * RTx1) / (Nx1 * RSx1-Rx1 ² ) (35) Kx2 = (Nx2 * RTx2-Rx2 * Tx2) / (Nx2 * RSx2-Rx2 ² ) ... (36) Lx2 = (RSx2 * Tx2-Rx2 * RTx2) / (Nx2 * RSx2-Rx2 ²⁾ ) ......... (37) Ky = ( Ny * RTy-Ry * Ty) / (Ny * RSy-Ry 2) ......... (38) Ly = (RSy * Ty-Ry * RTy) / (Ny * RSy- Ry ² ) (39) Then, in order to give priority to the latest data as much as possible, Rx
1, Tx1, RTx1, RSx1, and Nx1 are calculated as follows.

Latest pupil diameter Rpx1, eyeball rotation angle θx1
Is obtained, the average mRx1 of the stored data of the pupil diameter is calculated. MRx1 = Rx1 / Nx1 (40) For example, the following weight coefficient w is calculated.

Rdx1 = | mRx1-Rpx1 |
(41) 1) Rdx1> Rdth (for example, 4 mm) (when the difference between the stored pupil diameter data and the new pupil diameter is sufficiently large) w = 1.0 2) Rdx1 ≦ Rdth (stored) When the difference between the pupil diameter data and the new pupil diameter is small) w = cwa * Rdx1 + cwb For example, cwa = 0.025, cwb = 0.9 Using the weight coefficient w, Rx1, Tx1, RTx1, RS
x1 and Nx1 are calculated by the following equations.

Rx1 = Rx1 * w + Rpx1 (42) Tx1 = Tx1 * w + θx1 (43) RTx1 = RTx1 * w + Rpx1 * θx1 (44) RSx1 = RSx1 ^{* w + Rpx1 2 .................. (45} ) Nx1 = Nx1 * w + 1 .................. (46) i.e., the value of new pupil diameter to the average value of the pupil diameter that is stored is not sufficiently apart If the stored data and the brightness at the time of acquisition of new data are different,
The weight in the addition is increased so as to utilize the stored data. Conversely, if the values do not differ, it is assumed that the data is acquired under similar luminance, and the weight of the stored data is reduced to give priority to the latest data.

FIG. 1 is a schematic view showing a main part of an embodiment in which an optical device having the above-mentioned method of correcting individual differences in the line of sight is applied to a single-lens reflex camera. 3) is a schematic view of the upper surface and the rear surface thereof, and FIG. 3 is an explanatory diagram in the viewfinder field of FIG.

In these figures, 1 is a taking lens,
Although shown with two lenses for convenience, it is actually composed of a larger number of lenses. Reference numeral 2 denotes a main mirror, which is inclined to the photographing optical path or retreated depending on the state of observation of the subject image by the finder system and the state of photographing of the subject image. Reference numeral 3 denotes a sub-mirror, which reflects a light beam transmitted through the main mirror 2 toward a later-described focus detection device 6 below the camera body.

Reference numeral 4 denotes a shutter, and reference numeral 5 denotes a photosensitive member, which is a silver halide film, a solid-state image pickup device such as a CCD or MOS type, or an image pickup tube such as a vidicon.

Reference numeral 6 denotes a focus detection device, which is a field lens 6a and reflection mirrors 6b and 6 arranged near the image plane.
c, a secondary imaging lens 6d, an aperture 6e, a line sensor 6f including a plurality of CCDs, and the like.

The focus detection device 6 in the present embodiment performs focus detection by a well-known phase difference method. As shown in FIG. 3, as shown in FIG. ) Is set as a distance measuring point so that the focal point can be detected.

Reference numeral 7 denotes a focusing plate arranged on a predetermined imaging plane of the photographing lens 1, 8 denotes a pentaprism for changing the optical path of a finder, 9 and 10 each denote an imaging lens for measuring the luminance of a subject in an observation screen. It is a photometric sensor. The imaging lens 9 conjugately connects the focusing plate 7 and the photometric sensor 10 via the reflected optical path in the pentaprism 8.

Next, an eyepiece 11 provided with a light splitter 11a is disposed behind the exit of the pentaprism 8, and is used for observation of the focus plate 7 by the photographer's eye 15. The light splitter 11a is composed of, for example, a dichroic mirror that transmits visible light and reflects infrared light.

Reference numeral 12 denotes a light receiving lens, and reference numeral 14 denotes an image sensor in which a photoelectric conversion element array such as a CCD is two-dimensionally arranged.
Are arranged to be conjugate with the vicinity of the pupil. 13a
Reference numerals 13f to 13f denote infrared light emitting diodes, each of which is an illumination light source, and are arranged around the eyepiece lens 11 as shown in FIG.

Reference numeral 21 denotes a high-brightness superimposing LED that can be visually recognized even in a bright subject. Light emitted from the superimposing LED is reflected by the main mirror 2 via a light projecting prism 22 and is displayed on a display section of the focus plate 7. The light is bent in the vertical direction by the provided small prism array 7 a and reaches the photographer's eye 15 through the pentaprism 8 and the eyepiece 11.

The micro prism array 7 is located at a plurality of positions (ranging points) corresponding to the focus detection area of the focus plate 7.
a are formed in a frame shape, and are formed into five superimposing LEDs 21 (each of which is LED-L1, LE-
D-L2, LED-C, LED-R1, LED-R2).

Thus, as can be seen from the finder field of view shown in FIG.
Reference numerals 1, 202, 203, and 204 illuminate in the finder visual field, and can display a focus detection area (distance measurement point) (hereinafter, this is referred to as a superimposed display).

Here, the distance measuring point marks 200, 2 at the left and right ends
Dot marks 205 and 206 are engraved inside 04, which collects line-of-sight correction data for correcting a line-of-sight detection error due to individual differences in the eyeballs, as described later, that is, at the time of calibration. It forms a target.

Reference numeral 23 denotes a field mask for forming a finder field area, 24 denotes an LCD in the finder for displaying photographing information outside the field of view of the finder, and an illumination LED (F-LE).
D) Illuminated by 25.

The light transmitted through the LCD 24 in the finder is guided into the finder visual field by the triangular prism 26, and is displayed outside the finder visual field as shown by 207 in FIG. 3, so that the photographer can know the photographing information. Reference numeral 27 denotes a known mercury switch for detecting the attitude of the camera.

Reference numeral 31 denotes an aperture provided in the taking lens 1;
A diaphragm driving device including a diaphragm driving circuit 111 described later;
Reference numeral 3 denotes a lens driving motor, and reference numeral 34 denotes a lens driving member including a driving gear and the like. Reference numeral 35 denotes a photocoupler which detects the rotation of the pulse plate 36 interlocked with the lens driving member 34 and transmits the rotation to the lens focus adjustment circuit 110. The focus adjustment circuit 110 drives the lens drive motor 33 by a predetermined amount based on this information and the information on the lens drive amount from the camera side, and moves the photographing lens 1 to a focus position. Reference numeral 37 denotes a mount contact which serves as an interface between a known camera and a lens.

In FIG. 2, reference numeral 41 denotes a release button, reference numeral 42 denotes a monitor LCD as an external monitor display device, and a fixed segment display section 42 for displaying a predetermined pattern.
a and a 7-segment display section 42b for displaying a variable numerical value. 43 is an AE lock button for holding a photometric value,
Reference numeral 44 denotes a mode dial for selecting a shooting mode and the like. 55 is an index. The other operation members are not directly related to the present invention, and the description thereof is omitted.

FIGS. 4A and 4B are views showing the configuration of the mode dial 44. When the display is matched with the index 55 engraved on the camera body, the shooting mode is set based on the display contents. .

In FIG. 4A, 44a is a lock position for disabling the camera, 44b is a position in an automatic photographing mode controlled by a photographing program preset by the camera, and 44c is a photographer can set photographing contents. The manual shooting mode includes shooting modes of program AE, shutter priority AE, aperture priority AE, depth of field priority AE, and manual exposure. Reference numeral 44d denotes a “CAL” position in a calibration mode for performing a line-of-sight calibration described later.

FIG. 4B shows the internal structure of the mode dial 44. Reference numeral 46 denotes a flexible printed circuit board, and a switch pattern (M1, M2, M3, M4) as a mode dial switch and a GND pattern are shown. Mode dial 44
By sliding the four contact pieces (47a, 47b, 47c, 47d) of the switch contact piece 47 interlocked with the rotation of, the 4 bits indicated by the mode dial 44 in 12 bits.
Position can be set.

Referring back to FIG. 2, reference numeral 45 denotes an electronic dial for selecting a set value which can be further selected from among the modes selected by the mode dial 44 by rotating and generating a click pulse. is there. For example,
When the photographing mode with shutter priority is selected by the mode dial 44, the LCD 24 in the viewfinder and the LCD for monitoring are selected.
The currently set shutter speed is displayed at 42. When the photographer rotates the electronic dial 45, the shutter speed is sequentially changed from the currently set shutter speed in accordance with the rotation direction.

FIGS. 5A and 5B show the electronic dial 4.
FIG. 5 is a detailed view showing an internal structure of No. 5;

In the figure, a click plate 48 that rotates together with the electronic dial 45 is arranged, and
Has been fixed. Switch patterns 49a (SWDIAL-1) and 49b (SWDIA) are provided on the printed circuit board 49.
L-2) and the GND pattern 49c are arranged as shown, and the switch contact piece 50 having three sliding contact pieces 50a, 50b, 50c is fixed to the fixing member 51.

A click ball 52 which fits into a concave portion 48a formed on the outer peripheral portion of the click plate 48 is arranged.
The coil spring 53 urging the ball is fixed to the fixing member 5.
It is held at 1.

In the normal position (the state where the click ball 52 is fitted in the concave portion 48a), the sliding contact piece 5
0a and 50b are not in contact with either of the switch patterns 49a and 49b.

The electronic dial 4 thus formed
5, when the photographer rotates the dial clockwise in FIG. 5, the sliding contact 50a first contacts the switch pattern 49a, and then the sliding contact 50b contacts the switch pattern 49a. Use to increment the set value. In the case of counterclockwise rotation, the relationship between the sliding contact and the switch pattern is exactly the opposite, and the set value is counted down at the same timing.

FIG. 5B is a timing chart showing this state, and shows pulse signals generated in the switch patterns 49a and 49b when the electronic dial 45 is rotated and their timings. The upper part shows the case of one click rotation in the counterclockwise direction, and the lower part shows the case of the rotation in the clockwise direction. In this way, the timing of count-up and the rotation direction are detected.

FIG. 6 is an explanatory diagram of an electric circuit diagram incorporated in the single-lens reflex camera having the above-mentioned structure. The same parts as those in FIG. 1 are denoted by the same reference numerals.

A central processing unit (CPU) 100 of a microcomputer built in the camera body includes a line-of-sight detection circuit 101, a photometry circuit 102, an automatic focus detection circuit 103,
A signal input circuit 104, an LCD drive circuit 105, an LED drive circuit 106, an IRED drive circuit 107, a shutter control circuit 108, a motor control circuit 109, and a sound generator 112 are connected. Further, signals are transmitted to the focus adjustment circuit 110 and the aperture driving circuit 111 arranged in the taking lens 1 via the mount contact 37 shown in FIG.

EEPROM 10 attached to CPU 100
Reference numeral 0a has a storage function of a line of sight correction data for correcting an individual difference in line of sight as storage means. Mode dial 44
When the "CAL" position is adjusted to the index 55, the calibration mode for correcting the individual difference in the line of sight can be selected, the selection of the calibration number corresponding to each calibration data, the OFF of the calibration operation, and The setting of the line-of-sight detection prohibition mode is enabled by the electronic dial 45.

A plurality of sets of calibration data can be set, which can be distinguished by the person who uses the camera, when the same user has different observation conditions, for example, when using glasses or not, or when viewing This is effective for setting the difference between the case where the degree correction lens is used and the case where the degree correction lens is not used.

At this time, the calibration number selected at this time or the state of the set line-of-sight inhibition mode is also set as the calibration data number (1,
2, 3,... Or 0) as the EEPROM 100a
Is stored.

The line-of-sight detection circuit 101 converts an eyeball image signal from the image sensor 14 (CCD-EYE) into an A / D signal.
The image information is converted and transmitted to the CPU 100. CPU
As will be described later, 100 extracts feature points of the eyeball image necessary for gaze detection in accordance with a predetermined algorithm, and further calculates the gaze of the photographer from the positions of the feature points.

The photometric circuit 102 amplifies the signal from the photometric sensor 10, performs logarithmic compression and A / D conversion, and transmits the result to the CPU 100 as luminance information of each sensor. The photometry sensor 10 performs SPC-photometry of a left area 210 including left ranging points 200 and 201 in the finder visual field shown in FIG.
L and C for metering the central area 211 including the ranging point 202
It is composed of an SPC-C, an SPC-R for measuring light in a right area 212 including right ranging points 203 and 204, and an SPC-A for measuring light in these peripheral areas 213, and a photodiode for measuring light in four areas. ing.

As shown in FIG. 3, the line sensor 6f includes five sets of line sensors CCD-L2, CCD-L1, and CC corresponding to five ranging points 200 to 204 on the screen.
It is a known CCD line sensor composed of DC, CCD-R1, and CCD-R2.

The automatic focus detection circuit 103 A / D converts the voltage obtained from the line sensor 6f,
Send to 00.

SW-1 is a switch for turning on the first stroke of the release button 41 to start photometry, AF, line-of-sight detection operation, etc., SW-2 is a release switch for turning on the second stroke of the release button, SW -ANG is an attitude detection switch detected by the mercury switch 27 shown in FIG. 1, SW-AEL is an AE lock switch that is turned on by pressing an AE lock button 43, and SW-DI.
AL1 and SW-DIAL2 are dial switches provided in the electronic dial 45 described above, and are input to the up / down counter of the signal input circuit 104, and count the click amount of rotation of the electronic dial 45. SW-M1
M4 to M4 are also dial switches provided in the mode dial 44 already described.

The state signals of these switches are input to the signal input circuit 104 and transmitted to the CPU 100 via the data bus.

The LCD drive circuit 105 has a known configuration for driving the liquid crystal display element LCD. The LCD drive circuit 105 displays an aperture value, a shutter time, a set photographing mode, and the like in accordance with a signal from the CPU 100. L for monitor
It can be displayed on both the CD 42 and the LCD 24 in the finder at the same time.

The LED drive circuit 106 includes an illumination LE
D (F-LED) 25 and Superimpose LED2
1 is turned on and off.

The IRED drive circuit 107 selectively turns on the infrared light emitting diodes (IRED1 to 6) 13a to 13f according to the situation.

The shutter control circuit 108 controls the magnet MG-1 for running the front curtain and the magnet MG-2 for running the rear curtain when energized, and exposes the photosensitive member with a predetermined amount of light.

The motor control circuit 109 controls the motor M1 for winding and rewinding the film and the motor M2 for charging the main mirror 2 and the shutter 4.

A series of camera release sequences is operated by the shutter control circuit 108 and the motor control circuit 109.

As will be described later, the sounding body 112 is used as an indication of completion of collection of correction data and as a warning display when collection of correction data has failed.

FIGS. 7A and 7B show the contents of all display segments of the monitor LCD 42 and finder LCD 24 shown in FIGS.

In FIG. 7A, in addition to the display of a known photographing mode, the fixed segment display section 42a detects a line of sight and performs a photographing operation such as an AF operation of a camera or selection of a photographing mode using the line of sight information. A line-of-sight input mode display 61 indicating that control is being performed is provided. 7 for variable numeric display
The segment display section 42b displays a shutter time 4
7-segment portion 62 of digits, 2-segment 7-segment portion 63 for displaying aperture value, decimal point 64, limited numerical value display segment portion 65 for displaying the number of films, and 1-segment 7-segment portion 6
6. Other description is omitted.

In FIG. 7B, reference numeral 71 denotes a camera shake warning mark, reference numeral 72 denotes an AE lock mark, reference numerals 73, 74, and 75 denote display segment portions which are the same as those for the shutter speed display and the aperture value display, and 76 denotes an exposure. A correction setting mark, 77 is a flash charging completion mark, 78 is a line-of-sight input mark indicating that the line of sight is being input, and 79 is a focus mark that indicates the state of focus of the photographic lens 1.

Next, the operation of the camera having the line-of-sight detection function will be described with reference to FIGS. 9 and 10 in accordance with the flowchart of FIG.

When the mode dial 44 is rotated to set the camera from a non-operation state to a predetermined photographing mode (this embodiment will be described based on a case where the shutter priority AE is set), the camera is turned on. (Step 100),
Variables used for line-of-sight detection other than line-of-sight calibration data stored in the EEPROM 100a of the CPU 100 are reset (step 101).

Then, the camera stands by until the release button 41 is pressed and the switch SW1 is turned on (step 102). Release button 41 is pushed in and switch S
When the signal input circuit 104 detects that W1 has been turned on, the CPU 100 checks which calibration data is to be used when performing line-of-sight detection via the line-of-sight detection circuit 101 (step 103).

At this time, if the calibration data of the confirmed calibration data number remains unchanged from the initial value or is set to the line-of-sight prohibition mode, the line-of-sight detection is not executed, that is, the line-of-sight information is not executed. A specific focus point is selected by the focus detection point automatic selection subroutine (step 116) without using. At this distance measuring point, the automatic focus detection circuit 103 performs a focus detection operation (step 107).

Thus, both the line-of-sight prohibition mode for selecting a ranging point without using line-of-sight information and the line-of-sight mode for selecting a ranging point using line-of-sight information are provided. It is possible for the user to arbitrarily select these.

There are several possible algorithms for automatic selection of ranging points. A near-point priority algorithm in which weights are assigned to central ranging points is effective. One example is shown in FIG. This will be described later.

When the gaze calibration data corresponding to the calibration data number is set to a predetermined value and it is confirmed that the data is input by the photographer, the gaze detection circuit 101 Performs line-of-sight detection according to the calibration data (step 104).

In this embodiment, the mode dial 44
Is assumed to be at the position of the shutter priority AE, the gaze position of the photographer is calculated by the gaze detection subroutine (step 104). Then, the line-of-sight detection circuit 1
The line of sight detected at 01 is converted into the coordinates of the gazing point on the focusing screen 7. The CPU 100 selects a distance measuring point close to the gazing point coordinates, transmits a signal to the LED drive circuit 106, and blinks the distance measuring point mark using the superimposing LED 21 (step 105). Also,
The CPU 100 drives the LCD drive circuit 105 to turn on the line-of-sight input mark 78 of the LCD 24 in the finder, so that the photographer can confirm that the camera is performing line-of-sight detection outside the finder screen 207 ( FIG. 9A). Further, the set shutter time is displayed on the 7-segment portion 73 (1/2 as an embodiment).
A case of a shutter priority AE of 50 seconds is shown).

FIGS. 9A and 9C show an example in which the distance measuring point mark 201 is selected. or,
At this time, when the reliability of the gazing point coordinates detected by the eye-gaze detecting circuit 101 is low, the CPU 100 transmits a signal so that the number of ranging points selected according to the degree of the reliability is changed and displayed. ing.

FIG. 9B shows a state in which the reliability of the gazing point is lower than in the state of FIG. 9A, and the distance measuring point marks 201 and 202 are selected.

When the photographer looks at the display of the focus detection point selected by the line of sight, recognizes that the focus detection point is incorrect, releases the release button 41 and turns off the switch SW1 (step 106). It waits until the switch SW1 is turned on (step 102).

As described above, the fact that the focus detection point has been selected based on the line-of-sight information is indicated by blinking the focus detection point mark in the viewfinder field, so that the photographer can be selected as desired. You can check whether or not.

If the photographer looks at the display of the distance measuring point selected by the line of sight and continues to turn on the switch SW1 (step 106), the automatic focus detection circuit 10
3 executes focus detection of one or more ranging points using the detected line-of-sight information (step 107).

Next, it is determined whether or not the selected ranging point cannot be measured (step 108).
00 sends a signal to the LCD drive circuit 105 to blink the focus mark 79 of the LCD 24 in the finder as shown in FIG. 9C, and warns the photographer that the distance measurement is NG (impossible) (step). 118), this operation is continued until the switch SW1 is turned off.

If the distance measurement is possible and the focus adjustment state of the distance measurement point selected by a predetermined algorithm is not in focus (step 109), the CPU 100 sends a signal to the lens focus adjustment circuit 110 to send a signal. The fixed quantity photographing lens 1 is driven (step 117). After driving the lens, the automatic focus detection circuit 103 performs focus detection again (step 107), and determines whether or not the photographing lens 1 is in focus (step 109).

If the photographing lens 1 is in focus at a predetermined distance measuring point, as shown in FIG.
0 sends a signal to the LCD drive circuit 105 to turn on the focus mark 79 of the LCD 24 in the finder,
A signal is also sent to the ED drive circuit 106 to display a focus on the focus detection point 201 (step 110).

At this time, the blinking display of the focusing point selected by the line of sight is turned off, but the focusing point displayed by focusing often coincides with the ranging point selected by the line of sight. The focusing distance measuring point is set to a lighting state in order to make the photographer recognize that focusing has been achieved. The photographer observes that the focused ranging point is displayed in the viewfinder, recognizes that the ranging point is incorrect, releases the release button 41, and turns off the switch SW1 (step 111). The camera waits until the switch SW1 is turned on (step 102).

Further, if the photographer sees the focusing point displayed in focus and continues to turn on the switch SW1 (step 111), the CPU 100 transmits a signal to the photometry circuit 102 to perform photometry. (Step 112). At this time, an exposure value is calculated by weighting the photometric areas 210 to 213 including the focused distance measuring point.

In the case of the present embodiment, a well-known photometric operation weighted to the photometric region 210 including the distance measuring point 201 is performed, and as a result of this operation, the aperture value (F5.6) is calculated using the 7-segment 74 and the decimal point 75. Is displayed (see FIG. 10A).

Further, it is determined whether or not the release button 41 is depressed and the switch SW2 is turned on (step 113). If the switch SW2 is off, the state of the switch SW1 is checked again (step 11).
1). As a result, if the switch SW2 is turned on, C
The PU 100 transmits a signal to each of the shutter control circuit 108, the motor control circuit 109, and the aperture drive circuit 111.

That is, first, the motor M2 is energized, the main mirror 2 is raised, the aperture 31 is stopped down, and then the magnet MG1 is energized to release the front curtain of the shutter 4. The aperture value of the aperture 31 and the shutter speed of the shutter 4 are determined from the exposure value detected by the photometric circuit 102 and the sensitivity of the film 5. Predetermined shutter speed (1/250
After the elapse of (sec), the magnet MG2 is energized to close the rear curtain of the shutter 4. When the exposure of the film 5 is completed, the motor M2 is energized again to feed the film, and a series of shutter release sequence operations is completed (step 114). After that, the camera turns on the switch SW1 again.
Is turned on (step 102).

During a series of operations other than the shutter release operation (step 114) of the camera shown in FIG. 8, the mode is changed by the mode dial 44, and the signal input circuit 104 indicates that the visual line calibration mode has been set.
Is detected, the CPU 100 temporarily stops the operation of the camera and transmits the result to the line-of-sight detection circuit 101 to set the line of sight to a state in which the line-of-sight calibration (step 115) is possible. The gaze calibration method will be described later.

Next, the "automatic selection of distance measuring point" subroutine performed in step 116 will be described with reference to FIG.

As described above, this subroutine is executed when the line-of-sight prohibition mode, that is, the line-of-sight input mode is not set, and determines the distance measuring point from the information on the defocus amount and the absolute distance of each distance measuring point. Is what you do.

First, it is determined whether there is a distance measuring point among the five distance measuring points that can be measured (step 501). If none of the distance measuring points can be measured, the process returns to the main routine (step 511). . If there is a distance measuring point that can be measured and there is only one (step 502), the one point is set as a distance measuring point (step 507). If there are two or more distance measuring points that can be measured, the process proceeds to the next step.
3) Also, the center ranging point is located at a short distance (for example, 20 focal lengths).
Is determined (step 504).

Here, if the center ranging point can be measured and the distance is short, or if the center ranging point cannot be measured, the process proceeds to step 505. In this step 505, if the number of short-distance ranging points is larger than the number of long-distance ranging points, it is determined that the main subject is considerably on the photographer side, and the nearest ranging point is selected (step 506). ). If the number of short distance measurement points is small, it is determined that the main subject is on the long distance side, and the nearest point among the long distance measurement points is selected in consideration of the depth of field (step 510). ).

If it is determined in step 504 that the center ranging point is at a long distance, the process proceeds to step 508. If the number of long-distance ranging points is larger than the number of short-distance ranging points, it is determined that the main subject is on the long distance side including the central ranging point, and the central ranging point is selected (step 509). ). If the number of long distance measurement points is small, the closest distance measurement point is selected in the same manner as described above (step 506).

As described above, if there are ranging points that can be measured,
One of the distance measuring points is automatically selected from among them, the process returns to the main routine (step 511), and the focus detection operation is performed again at this distance measuring point (step 10).
7).

It should be noted that the in-focus display when a distance measuring point is selected using the above-mentioned line-of-sight information, that is, as in FIG.
Also in this case, at the time of focusing, as shown in FIG.
1 and the focus mark 79 are lit, but the line-of-sight input mark 78
Is, of course, in a non-lighting state.

Next, the "line-of-sight detection" subroutine performed in step 104 will be described with reference to FIGS.

As described above, the line-of-sight detection circuit 101 is a CPU
When a signal is received from 100, the visual axis detection is executed (step 104). The gaze detection circuit 101 determines whether the gaze is detected in the photographing mode or the gaze is detected in the gaze calibration mode (step 20).
1). At the same time, the line-of-sight detection circuit 101 recognizes which calibration data number the camera is set to be described later.

In the case of gaze detection in the photographing mode, the gaze detection circuit 101 first detects the posture of the camera via the signal input circuit 104 (step 202). The signal input circuit 104 processes the output signal of the mercury switch 27 (SW-ANG) to determine whether the camera is in the horizontal position or the vertical position. If the camera is in the vertical position, for example, whether the release button 41 is in the upward direction Judge whether it is in the ground (surface) direction. Subsequently, information on the brightness of the shooting area is obtained from the photometry circuit 102 via the CPU 100 (step 203).

Next, the infrared light emitting diode (hereinafter referred to as IRED) 13a is obtained from the previously detected attitude information of the camera and the eyeglass information of the photographer included in the calibration data.
To 13f are selected (step 204). That is,
If the camera is held in the horizontal position and the photographer does not wear glasses, the IREDs 13a and 13b from the finder optical axis shown in FIG. 2B are selected.

If the camera is in the horizontal position and the photographer wears glasses, 13c and 13c are separated from the finder optical axis.
Select the IRED of d. At this time, a part of the illumination light reflected by the photographer's glasses reaches an area other than a predetermined area on the image sensor 14 on which the eyeball image is projected, so that there is no problem in breaking the eyeball image.

Further, if the camera is held in a vertical position, an IRED that illuminates the photographer's eyeball from below.
, Ie, 13a, 13e or 13
One of the combinations b and 13f is selected.

Next, the image sensor 14 (hereinafter referred to as CCD-
The storage time of EYE) and the illumination power of the IRED are set based on the photometric information, the photographer's spectacle information, and the like (step 205). The accumulation time of the CCD-EYE and the illumination power of the IRED may be set based on values determined from the contrast of the eyeball image obtained at the time of the previous line-of-sight detection.

When the accumulation time of the CCD-EYE and the illumination power of the IRED are set, the CPU 100 turns on the IRED with a predetermined power via the IRED drive circuit 107, and the line-of-sight detection circuit 101 detects the accumulation of the CCD-EYE. Start (step 206).

The CCD-EYE ends the accumulation according to the previously set accumulation time of the CCD-EYE, and at the same time, the IRED is turned off. If not in the line-of-sight calibration mode (step 207),
A CCD-EYE read area is set (step 208).

The CCD-EYE readout area is set based on the CCD-EYE readout area at the time of the previous line-of-sight detection except for the first line-of-sight detection after the power of the camera body is turned on. Is changed, or the presence or absence of glasses is changed, the read area of the CCD-EYE is set to the entire area.

When the CCD-EYE read area is set, the CCD-EYE is read (step 209). At this time, the area other than the read area is subjected to blank reading, and is actually skipped. CCD-EYE
The image output read out from the line-of-sight detection circuit 101 is subjected to A / D conversion.
After being converted, it is stored in the CPU 100 and the CPU 1
At 00, an operation for extracting each feature point of the eyeball image is performed (step 210).

That is, the CPU 100 detects the positions (xd ', yd') and (xe ', ye') of the Purkinje image, which is a set of virtual images of the IRED used for illuminating the eyeball 15. Since a Purkinje image appears as a strong light intensity, it can be detected by setting a predetermined threshold value for the light intensity and using a Purkinje image having a light intensity exceeding the threshold value.

The center position of the pupil 19 (xc ', y
c ′) detects a plurality of boundary points between the pupil 19 and the iris 17,
It is calculated by performing a least square approximation of a circle based on each boundary point. At this time, the pupil diameter rp is also calculated. The interval between the two Purkinje images is calculated.

The CPU 100 analyzes the eyeball image, detects the contrast of the eyeball image, and resets the accumulation time of the CCD-EYE from the degree of the contrast.

The read-out area of the CCD-EYE is set based on the position of the Purkinje image and the position of the pupil 19. At this time, the reading area of the CCD-EYE is set to a range including the detected pupil 19 and detecting the entire pupil even if the position of the pupil 19 changes by a predetermined amount. And, needless to say, its size is smaller than the size of the iris.

The read area of the CCD-EYE is set to a rectangle, and the coordinates of two diagonal points of the rectangle are set to the CCD-EYE.
It is stored in the eye-gaze detection circuit 101 as an E readout area. Further, the reliability of the calculated Purkinje image and the position of the center of the pupil is determined from the contrast of the eyeball image, the size of the pupil 19, and the like.

When the analysis of the eyeball image is completed, the line-of-sight detection circuit 101 serving also as a means for checking the calibration data
Is the calculated distance between the Purkinje images and the lit IRE
It is determined whether or not the eyeglass information in the calibration data is correct based on the combination of D (step 21).
1). This is to cope with a photographer who does not use glasses at any time.

That is, the spectacle information of the photographer in the calibration data is set so as to use, for example, spectacles, and among the IREDs 13c and 13c shown in FIG.
When d is lit, if the interval between the Purkinje images is larger than a predetermined size, the photographer is recognized as a spectacle wearer, and it is determined that the spectacle information is correct.

Conversely, if the interval between the Purkinje images is smaller than a predetermined size, the photographer is recognized as a naked eye or a contact lens wearer, and it is determined that the eyeglasses information is incorrect. If it is determined that the eyeglass information is incorrect (step 2
11) The gaze detection circuit 101 changes the eyeglass information (step 217), selects the IRED again (step 204), and executes the gaze detection. However, when changing the eyeglass information, the eyeglass information stored in the EEPROM 100a of the CPU 100 is not changed.

If it is determined that the eyeglass information is correct (step 211), the distance between the eyepiece 11 of the camera and the eyeball 15 of the photographer is calculated from the distance between the Purkinje images, The imaging magnification β of the eyeball image projected on the CCD-EYE is calculated from the distance from the eyeball 15 of the user (step 212). From the above calculated values, the rotation angle θ of the optical axis of the eyeball 15 is obtained by modifying the above-mentioned equation (3) and θx {ARCSIN} (xc ′ − (xp ′ + δx) / β / L _OC )... (47) θy ≒ ARCSIN ｛(yc ′ − (yp ′ + δy) / β / L _OC } (48) (step 213), where xp ′ ≒ (xd ′ + xe ′) / 2 yp '≒ (yd' + ye ') / 2 δx, δy are correction terms for correcting the center positions of the two Purkinje images.

When the rotation angles θx and θy of the eyeball 15 of the photographer are determined, the position (x, y) of the line of sight on the focus plate 7 is determined by the above-described equations (6) and (14).

In addition, the reliability of the coordinates of the line of sight calculated using the above equations (13) to (17) is changed according to the reliability of the line-of-sight calibration data. When the coordinates of the line of sight on the focus plate 7 are obtained, a flag (n = 1) indicating that the line of sight has been detected is set (step 215), and the process returns to the main routine (step 216 ).

Further, the flow chart of the visual line detection shown in FIGS. 12 and 13 is also effective in the visual line calibration mode. That is, if it is determined in step 201 that the gaze detection is performed in the calibration mode, then it is determined whether the current gaze detection is the first gaze detection in the calibration mode (step 201). 218 ).

If it is determined that the current gaze detection is the first gaze detection in the calibration mode, CC
Ambient brightness is measured to set the D-EYE accumulation time and the IRED illumination power (step 203). The subsequent operation is as described above.

If it is determined that the current gaze detection is the second or more gaze detection in the calibration mode (step 218 ), the CCD-EYE accumulation time and the IRED illumination power are set to the previous values. As soon as it is adopted, lighting of the IRED and accumulation of the CCD-EYE are started (step 206).

In the line-of-sight calibration mode,
If the number of gaze detection times is equal to or more than the second time (step 2
07) The CCD-EYE read area is the same as the previous area, so that the CCD-EYE is read immediately upon completion of the accumulation of the CCD-EYE (step 209). The subsequent operation is as described above.

In the gaze detection flowcharts shown in FIGS. 12 and 13, the variables used when returning to the main routine are the coordinates (x, y) of the gaze on the focus plate in the case of normal gaze detection. In the case of gaze detection in the gaze calibration mode, the rotation angle (θx, θy) of the photographer's eyeball optical axis. In addition, other variables such as reliability of the detection result, CCD-EYE accumulation time, CCD-EYE
The read area and the like are common.

In this embodiment, the CCD-EYE
Although the photometric information detected by the photometric sensor 10 of the camera is used to set the accumulation time and the illumination power of the IRED, a means for detecting the brightness of the front face of the photographer near the eyepiece 11 It is also effective to newly provide and use the value.

Next, the "calibration" subroutine performed in step 115 of FIG. 8 will be described with reference to the display states of the LCD 24 in the finder and the monitor LCD 42 at the time of line-of-sight calibration shown in FIGS. 14, FIG. 15 and FIG.

Conventionally, gaze calibration has been performed by detecting the gaze when the photographer gazes at two or more optotypes, but in the present embodiment, two gazes provided in the viewfinder visual field are used. Optotype (dot mark) 20
5,206 is watched and the line of sight at that time is detected to perform the line of sight calibration. As a result, the calibration data of the line of sight corresponding to the pupil diameter Rpp is calculated. Hereinafter, description will be made with reference to FIG.

When the photographer turns the mode dial 44 to set the "CAL" position 44d to the index 55, the mode is set to the line-of-sight calibration mode, and the signal input circuit 104 is turned on by the CPU 100 via the LCD drive circuit 105.
, And the monitor LCD 42 displays a message indicating that it has entered one of the eye-gaze calibration modes described later.

The CPU 100 is an EEPROM 100
The variables other than the calibration data stored in a are reset (step 301).

FIG. 24 shows the EEPROM 10 of the CPU 100.
It shows the types of calibration data stored in 0a and their initial values. E of CPU 100
The data stored in the EPROM 100a is the data in the portion enclosed by the thick line in FIG. 24, and includes the currently set calibration data number and a plurality of calibration data managed by the number. Here, the calibration data number “0” is a mode for prohibiting gaze detection.

The above-mentioned line-of-sight calibration data is stored in each address of the EEPROM 100a corresponding to the calibration data numbers "1" to "5". For this reason, five data can be stored, but of course, any data can be set depending on the capacity of the EEPROM 100a.)

The initial value of the calibration data is set to a value such that the line of sight is calculated using standard eyeball parameters. In addition, whether the photographer uses glasses,
It also has a flag indicating the degree of reliability of the calibration data. The initial value of the flag indicating the presence or absence of spectacles is set to “1” as if the spectacles are used, and the initial value of the reliability flag of the calibration data is “0” so as not to be reliable. Is set to

Also, the monitor LCD 42 has the structure shown in FIG.
The currently set calibration mode is set as shown in FIG. The calibration mode includes an “ON” mode in which the calibration operation is performed and an “OFF” mode in which the calibration operation is not performed.

First, in the "ON" mode, the calibration numbers "CAL1" to "C1" correspond to the calibration data numbers "1" to "5".
AL5 "is prepared to display the shutter time.
7-segment section 6 displaying segment section 62 and aperture value
3 and the other fixed segment display sections 42a are all turned off (as an example, the state of data number "1" is shown, and only this display section is shown in an enlarged manner).

At this time, if the calibration data of the set calibration number is an initial value,
The calibration number displayed on the monitor LCD 42 flashes (see FIG. 17 (B)), while the calibration, which will be described later, is already performed on the set calibration number, and the address of the EEPROM 100a corresponding to the calibration data number. If a calibration data number different from the initial value is entered above, the calibration number displayed on the motor LCD 42 is fully lit (FIG. 1).
7 (A)).

As a result, the photographer can recognize whether or not the currently set calibration numbers already contain the calibration data. Further, the initial value of the calibration data number is set to “0”, so that the information input by the line of sight is not performed unless the line of sight calibration is executed.

Next, in the "OFF" mode, the seven segments 63 are displayed as "OFF" (see FIG. 17C), and the calibration data number "0" is always selected and the line of sight is displayed. Prohibition mode is set. This can be used effectively, for example, in the following shooting situations.

1) A situation in which gaze detection is impossible, for example, when intense light such as sunlight is illuminating the eyeball, or when looking into an extremely bright scene such as a sunny snowy mountain or a sandy beach. 3) Commemorative photographing when the main subject is around the screen other than the ranging point, or when the background is observed for a while to set the composition, etc. In situations such as when you suddenly have another person take a picture, etc., the calibration data is different, the gaze detection position will be erroneous, and malfunction will occur.In this case, gaze detection is prohibited and gaze It is desirable to select a shooting mode for controlling a shooting function without using information.

Returning to FIG. 14, subsequently, the timer set in the CPU 100 is started, and the calibration of the line of sight is started (step 302). If no operation is performed on the camera within a predetermined time after the timer starts, the gaze detection circuit 101 resets the calibration data number set at that time to “0” and sets the gaze prohibition mode. Change to Also, if a visual target for visual axis calibration or the like is lit in the finder, it is turned off.

When the photographer rotates the electronic dial 45, the signal input circuit 104 which has detected the rotation by the pulse signal as described above transmits a signal to the LCD drive circuit 105 via the CPU 100. As a result, the calibration number displayed on the monitor LCD 42 changes in synchronization with the rotation of the electronic dial 45. This is shown in FIG.

First, when the electronic dial 45 is rotated clockwise, “CAL-1” → “CAL-2” → “CAL-
3 "→" CAL-4 "→" CAL-5 ", and the photographer can store the calibration data in any of the five desired calibration numbers by the calibration operation described later.

The state shown in FIG. 18 is "CAL-
1, CAL-2, CAL-3 "already contains calibration data, and" CAL-4, CAL-5 "
Indicates that it is not entered and remains at the initial value.

Next, when the camera is further rotated clockwise by one click, "OFF" is displayed and the line of sight is prohibited.
When it is further rotated one click, it returns to "CAL-1".
The calibration number is displayed cyclically as described above. When rotated in the counterclockwise direction, the image is displayed in the exact opposite direction of FIG.

When the photographer selects a desired calibration number while looking at the calibration number displayed on the monitor LCD 42 in this way, the visual line detection circuit 101 confirms the corresponding calibration data number by inputting a signal. This is performed via the circuit 104 (step 303). The confirmed calibration data number is stored in the EEPROM 100a of the CPU 100.

However, if the confirmed calibration data number has not been changed, the EEPROM 100
The storage of the calibration data number in a is not executed.

Subsequently, the line-of-sight detection circuit 101 checks the photographing mode via the signal input circuit 104 (step 3).
04). When it is confirmed that the photographer has turned the mode dial 44 to a photographing mode other than the line-of-sight calibration mode (step 304), if the line-of-sight calibration target is blinking in the viewfinder. The light is turned off (step 305), and the process returns to the main routine, which is a photographing operation of the camera (step 336).

Then, the calibration number “C”
If the mode dial 44 is switched to another shooting mode (shutter priority AE) while "AL-1 to CAL-5" is displayed, the line of sight is detected using the data of the calibration number, and the line of sight is detected. A photographing operation using information can be performed.

The state of the monitor LCD 42 at this time is shown in FIG.
As shown in FIG. 9, the gaze input mode display 61 is turned on in addition to the normal shooting mode display to notify the photographer that the gaze input mode is controlling the shooting operation based on the gaze information.

Here, when the mode dial 44 is turned again to set the "CAL" position 44d to the index 55, the above-mentioned calibration number used for the visual line detection is displayed, and the calibration operation is started. If no camera is operated within the predetermined time or the same calibration data is collected, the calibration data of the EEPRPM 100a is not changed.

When it is confirmed that the line-of-sight calibration mode is still set (step 30).
4) The confirmation of the calibration number set by the electronic dial 45 is performed again (step 306).

At this time, if the calibration data number is set to “0” and the gaze prohibition mode is set, the calibration data number is
100 in the EEPROM 100a (step 3
03). If gaze prohibition is selected in the calibration mode, the camera waits until the mode is changed to a shooting mode other than the gaze calibration mode using the mode dial 44.

That is, if the mode dial 44 is switched while “OFF” is displayed, the photographing operation is performed without performing the line-of-sight detection.
The line-of-sight input mode display 61 on the CD 42 is not lit.

If the calibration data number is set to a value other than "0" (step 30)
6) Subsequently, the CPU 100 detects the attitude of the camera via the signal input circuit 104 (step 307). The signal input circuit 104 processes the output signal of the mercury switch 27 to determine whether the camera is in the horizontal position or the vertical position. If the camera is in the vertical position, for example, the release button 41 is in the top direction or the ground (surface) direction. Judge whether it is.

Since the camera is generally used in a horizontal position, a hardware configuration for calibrating the line of sight is set so that the camera can be calibrated when the camera is held in the horizontal position. Therefore, the line-of-sight detection circuit 1
01 indicates that the camera is not in the horizontal position.
When the communication is performed, the gaze calibration is not performed (step 308).

[0181] In order visual axis detection circuit 101 to warn the inability to calibrate the sight line since the orientation of the camera is vertically positioned to the photographer, FIG 23 (A)
As shown in the figure, "CAL" is blinked on the LCD 24 in the viewfinder provided in the viewfinder of the camera. At this time, a warning sound may be emitted by a sounding body (not shown).

On the other hand, when it is detected that the posture of the camera is in the horizontal position (step 308), the gaze detection circuit 10
1 sets the line-of-sight detection frequency n to “0” (step 30).
9). At this time, “C
If "AL" is flashing, stop the flashing. The line-of-sight calibration is set to be started by turning on the switch SW1.

In order to prevent the photographer from starting calibration on the camera side before the photographer is ready to calibrate the line of sight, the line of sight detection circuit 101
The state of W1 is checked, and if the switch SW1 is pressed by the release button 41 and is ON, the process waits until the switch SW1 is turned OFF (step 31).
0).

The line-of-sight detection circuit 101 is a signal input circuit 104
When it is confirmed that the switch SW1 is in the OFF state through (step 310), a signal is transmitted to the LED drive circuit 106 to blink the visual axis calibration target (step 311). The target for eye gaze calibration is guided to the superimposed display of the calibration operation described below, and partially uses the ranging point mark so that the photographer can perform smoothly. The ranging point mark 204 and the dot mark 206 blink (see FIG. 20A).

If the ON signal of the switch SW1, which is the trigger signal for starting the line-of-sight calibration, has not been input, the camera stands by (step 312). When the photographer gazes at the optotype which has started blinking and presses the release button 41 to turn on the switch SW1 (step 314), the optotype 1
Is fully lit (see FIG. 20B) (step 31).
3) Eye gaze detection is performed (step 314). The operation of gaze detection is as described in the flowchart of FIG.

Here, dot marks 205 and 206 are engraved on the rightmost distance measuring point mark 204 and the leftmost distance measuring point mark 200 in FIG. 22A as described above. Indicates that calibration is performed, and both are illuminated by the superimpose LED and can be displayed as lighted, flashed, or not lit. Further, since the ranging point mark indicates a focus detection area, it is necessary to display an area corresponding to the area.

However, in order to perform calibration with high accuracy, it is necessary for the photographer to look at one point as much as possible. The dot marks 205 and 206 are used as distance measuring points so that one point can be easily watched. It is provided smaller than the mark. The line-of-sight detection circuit 101 controls the rotation angles θx, θ of the eyeballs, which are variables from the line-of-sight detection subroutine.
y, the pupil diameter Rpp, and the reliability of each data are stored (step 315).

Further, the number of gaze detection times n is counted up (step 316). Since the photographer's line of sight has some variation, it is effective to execute a plurality of line-of-sight detections on a single target and use the average value in order to obtain accurate line-of-sight calibration data. . In the present embodiment, the number of gaze detections n for one target is 10
It is set to times . If the number of gaze detections n is not 10 (step 317), gaze detection is continued (step 314).

If the number of visual line detections n is 10, the target 1
The line-of-sight detection for (the ranging point mark 204 and the dot mark 206) ends. A line-of-sight detection circuit 10 is provided to make the photographer recognize that the line-of-sight detection for the target 1 has been completed.
1 causes the CPU 100 to emit an electronic sound several times using a sounding body (not shown). At the same time, the line-of-sight detection circuit 101
The optotype 1 is turned off via the ED drive circuit 106 (step 318).

Subsequently, the visual line detection circuit 101 checks via the signal input circuit 104 whether the switch SW1 is in the OFF state (step 319). If the switch SW1 is in the ON state, the process waits until the switch SW1 is turned off. If the switch SW1 is in the OFF state, blinking of the optotype 2 (the ranging point mark 200 and the dot mark 205) at the left end is started (step 320). (See FIG. 21A).

The line-of-sight detection circuit 101 is again in the signal input circuit 1
It is confirmed whether the switch SW1 is in the ON state via the switch 04 (step 321). Switch SW
If the switch 1 is in the OFF state, the control waits until the switch 1 is turned on.
(See (B)) (step 322), and the visual axis detection is executed (step 323).

The gaze detection circuit 101 stores the rotation angles θx and θy of the eyeball, the pupil diameter Rpp, and the reliability of each data, which are variables from the gaze detection subroutine (step 3).
24). Further, the number of gaze detection times n is counted up (step 325). Further, if the number of gaze detections n is not 20 (step 326), gaze detection is continued (step 323). If the number of gaze detection times n is 20, the gaze detection for the target 2 is terminated.

In order for the photographer to recognize that the line-of-sight detection for the target 2 has been completed, the line-of-sight detection circuit 101
The electronic sound is made to sound several times using a sounding body (not shown) via 100. At the same time, the visual line detection circuit 101 turns off the visual target 2 via the LED drive circuit 106 (step 32).
7).

The line-of-sight calibration data is calculated from the eyeball rotation angles θx and θy and the pupil diameter Rpp stored in the line-of-sight detection circuit 101 (step 328) . The method of calculating the line-of-sight calibration data is as described above.

After the calculation of the eye gaze calibration or the end of the eye gaze detection, the timer is reset (step 329).

The gaze detection circuit 101, which also serves as a means for determining the reliability of the calibration data, determines whether the calculated calibration data of the gaze is appropriate (step 332). The determination is made by using the reliability of the eyeball rotation angle and the pupil diameter, which are variables from the line-of-sight detection subroutine, and the calculated line-of-sight calibration data itself.

That is, when there is no reliability in the rotation angle of the eyeball and the pupil diameter detected in the “line-of-sight detection” subroutine,
The calculated line-of-sight calibration data is also determined to be unreliable. Also, if there is reliability of the rotation angle of the eyeball and the pupil diameter detected in the gaze detection subroutine, if the calculated gaze calibration data falls within the range of general individual differences, it is determined to be appropriate, On the other hand, if the calculated line-of-sight calibration data greatly deviates from the range of general individual differences, the calculated line-of-sight calibration data is determined to be inappropriate.

The gaze detection circuit 101 not only determines whether the calculated gaze calibration data is appropriate, but also determines how reliable the calculated gaze calibration data is. It goes without saying that the degree of reliability depends on the reliability of the rotation angle of the eyeball and the pupil diameter detected in the gaze detection subroutine. The reliability of the line-of-sight calibration data is digitized into two bits according to the degree,
It is stored in the EEPROM 100a of the PU 100.

If it is determined that the calculated line-of-sight calibration data is inappropriate (step 330 ), LE is set.
The D drive circuit 106 stops energizing the superimposing LED 21 and turns off the targets 1 and 2 (step 33).
7). Further, the line-of-sight detection circuit 101 uses the sounding body (not shown) to emit an electronic sound different from that at the time of detection for a predetermined time via the CPU 100, and warns that the line-of-sight calibration has failed. At the same time, a signal is transmitted to the LCD drive circuit 105 to cause the LCD 24 in the finder and the
2 warns by flashing the “CAL” display (step 3
40) (see FIGS. 22A and 23A). After a warning sound from an unillustrated sounding body and a warning display on the LCDs 24 and 42 have been performed for a predetermined time, the process proceeds to an initial step (step 301) of the calibration routine, and is set to a state in which the visual line calibration can be executed again.

If the calculated line-of-sight calibration data is appropriate (step 330 ), the line-of-sight detection circuit 101 performs an end display of line-of-sight calibration via the LCD drive circuit 105 and the LED drive circuit 106 (step 330 ). Step 331).

The LED driving circuit 106 energizes the superimposing LED 21 to blink the optotype 1 and the optotype 2 several times.
2 to “End-Calibration N
"o" is displayed for a predetermined time (FIG. 2).
2 (B) and FIG. 23 (B)).

The gaze detection circuit 101 sets the number of gaze detections n to "1" (step 332), and furthermore, the reliability of the calculated gaze calibration data, the photographer's eyeglasses information, and the calculated gaze calibration data. The characteristic is stored on the address of the EEPROM 100a corresponding to the currently set calibration data number (step 333).

After a series of line-of-sight calibration is completed,
The camera waits until the electronic dial 45 or the mode dial 44 is operated by the photographer. If the photographer turns the electronic dial 45 to select another calibration number, the line-of-sight detection circuit 101 detects a change in the calibration number via the signal input circuit 104 (step 335), and performs line-of-sight calibration. The routine proceeds to the initial step (step 301) of the routine.

If the photographer turns the mode dial 44 to select another photographing mode, the line-of-sight detection circuit 101 detects a change in the photographing mode via the signal input circuit 104 (step 335) . The process returns to the routine (step 336 ).

At the time of returning to the main routine, if no calibration data has been input at the calibration number set by the electronic dial 45 and the initial value has been maintained, the line-of-sight detection circuit 101 The number is reset to "0" and the gaze prohibition mode is forcibly set. Actually CPU 100
Of the currently set calibration data number stored in the EEPROM 100a is reset to "0" (gaze prohibited mode).

In the present embodiment, an example has been shown in which the number of gaze detections when one gaze target is gazing is set to 10 times, and the gaze is calibrated. You can go.

According to the present embodiment, each time calibration is executed, individual difference data is acquired once at right and left at a certain brightness, instead of opening and closing the aperture of the photographing lens, and is accumulated. Since the correction data is calculated and the individual difference data is used a plurality of times, the influence of the error can be reduced. If no calibration has been performed in the past, the correction data is calculated from the acquired individual difference data.

Further, since the individual difference data can be inputted a plurality of times, the pupil data in actual use can be obtained.

[0209]

As described above, according to the first aspect of the present invention, in the eye gaze detecting device, the eyeball rotation angle detecting means for detecting the rotation angle of the optical axis of the eyeball and the personal difference data of the eyeball are used. Individual difference data detecting means for detecting, correction data forming means for forming correction data for correcting individual differences of the eyeball from statistical calculation of the individual difference data , and an optical axis of the eyeball detected by the eyeball rotation angle detecting means. A line-of-sight detection unit that detects a line of sight from the rotation angle and the correction data formed by the correction data forming unit; and a case where individual difference data is detected by the individual difference data detection unit after the correction data is formed.
You may use a personal difference data detected in the corrected data formed
Correction data updating means for performing an operation different from the statistical operation to update the correction data, so that the correction data is updated each time individual difference data is detected after the correction data is formed , so that high-precision gaze detection is performed. Becomes possible.

According to the sixth aspect of the present invention, in the gaze detection method, an eyeball rotation angle detection step of detecting a rotation angle of an eyeball optical axis, and an individual difference data detection of detecting individual difference data of an eyeball. Step and the individual difference data
A correction data forming step of forming correction data for correcting individual differences of the eyeballs from the statistical calculation of the rotation angle of the optical axis of the eyeball detected in the eyeball rotation angle detecting step and the correction data forming step. and line-of-sight detection step of detecting a line of sight from the correction data, the corrected data formed when the individual difference data is detected by <br/> the personal difference data detecting step, individuals that are detected after the correction data forming
Performing an operation different from the statistical operation using the difference data
With the correction data updating step of updating the correction data, the correction data is updated every time the individual difference data is detected after the correction data is formed , and highly accurate gaze detection can be performed.

[Brief description of the drawings]

FIG. 1 is a main part configuration diagram of an embodiment in which the present invention is applied to a single-lens reflex camera.

FIG. 2 is a diagram showing an upper surface and a rear surface of the single-lens reflex camera of FIG. 1;

FIG. 3 is a diagram for explaining the inside of a finder visual field of FIG. 1;

FIG. 4 is a diagram for explaining a mode dial of FIG. 2;

FIG. 5 is a diagram for explaining the electronic dial of FIG. 2;

FIG. 6 is a block diagram showing a main configuration of the single-lens reflex camera of FIG. 1;

FIG. 7 is a diagram showing a fully lit state of the monitor LCD and the LCD in the finder according to the embodiment.

FIG. 8 is a flowchart showing a series of operations of the single-lens reflex camera of FIG. 1;

FIG. 9 is a view showing an L in a finder to assist in explaining the operation of FIG. 8;
It is a figure showing a display on CD.

FIG. 10 is a view showing a display on the LCD in the viewfinder to help explain the operation of FIG. 8;

FIG. 11 is a flowchart showing an operation of “automatic selection of distance measuring point” in FIG. 8;

FIG. 12 is a flowchart showing a part of the operation of “line-of-sight detection” in FIG. 8;

FIG. 13 is a flowchart showing a continuation of the operation in FIG. 12;

FIG. 14 is a flowchart showing a part of an operation at the time of calibration of the single-lens reflex camera of FIG. 1;

FIG. 15 is a flowchart showing a continuation of the operation in FIG. 14;

FIG. 16 is a flowchart showing a continuation of the operation in FIG. 15;

FIG. 17 is a diagram showing a display on a monitor LCD when a calibration number is set in the present embodiment.

FIG. 18 is a diagram showing a display on a monitor LCD when a calibration number is set in the embodiment.

FIG. 19 is a diagram showing a display on the LCD in the viewfinder to assist in explaining the operation of FIGS. 14 to 16;

FIG. 20 is a view showing a display on the LCD in the viewfinder to help explain the operation of FIGS. 14 to 16;

FIG. 21 is a view showing a display on the LCD in the finder to help explain the operation of FIGS. 14 to 16;

FIG. 22 is a view showing a display on the LCD in the finder to assist in explaining the operation of FIGS. 14 to 16;

FIG. 23 is a view showing a display on the LCD in the finder to help explain the operation of FIGS. 14 to 16;

FIG. 24 is a diagram for describing types of calibration and initial values in the present embodiment.

FIG. 25 is a diagram for describing a general gaze detection method.

FIG. 26 is a diagram for explaining a general gaze detection method.

[Explanation of symbols]

 6f, 14 Image sensor 13 IRED (infrared light emitting diode) 15 Eyeball 24 LCD in viewfinder 42 LCD for monitoring 44 Mode dial 45 Electronic dial 61 Eye gaze input mode display 78 Eye gaze input mark 100 CPU 101 Eye gaze detection circuit 103 Focus detection device 105 LCD Drive circuit 200 to 204 Distance measuring point mark 205, 206 Dot mark

Claims (10)

(57) [Claims] 1. An eyeball rotation angle detecting means for detecting a rotation angle of an optical axis of an eyeball, an individual difference data detecting means for detecting individual difference data of an eyeball, and correcting an individual difference of an eyeball from a statistical operation of the individual difference data. Correction data forming means for forming correction data to be corrected, and gaze detection means for detecting a line of sight from the rotation angle of the optical axis of the eyeball detected by the eyeball rotation angle detecting means and the correction data formed by the correction data forming means. And the correction
After the data is formed, the individual difference data is detected by the individual difference data detecting means .
If the over data is detected, detected after the correction data forming
Different Starring from the statistical calculation using the individual difference data
A gaze detection device comprising: a correction data updating unit that performs a calculation to update the correction data. 2. The correction data updating means according to claim 1 , wherein
After updating the data, the individual difference data
If the data is detected, it is detected after the correction data is updated.
Operation different from the statistical operation using the obtained individual difference data
The gaze detecting apparatus according to claim 1 , wherein the correction data is updated by performing the following . 3. The correction data updating means, wherein:
Individual difference data used to create or update data
Individual differences detected after making or updating correction data
When updating the correction data according to the difference with the data,
The eye gaze detecting device according to claim 1 or 2 , wherein the calculation is made different . 4. The correction data updating means according to claim 1, wherein:
Individual difference data used to create or update data
Individual differences detected after making or updating correction data
If the difference from the data is greater than the threshold,
Compared to the case where no
Reduced the weight of individual difference data detected after new
The gaze detection device according to claim 3, wherein the gaze detection device performs an operation . 5. The correction data updating means, wherein:
Individual difference data used to create or update data
Individual differences detected after making or updating correction data
Depending on the difference between the data , the simple average method or the least squares method
Either select one, of claims 1, characterized in that updating the correction data by computing method selected 4
Line-of-sight detection apparatus of crab described. 6. An eyeball rotation angle detecting step of detecting a rotation angle of an eyeball optical axis, an individual difference data detecting step of detecting individual difference data of the eyeball, and an eyeball based on a statistical calculation of the individual difference data. A correction data forming step of forming correction data for correcting individual differences, and a line of sight from the rotation angle of the optical axis of the eyeball detected in the eyeball rotation angle detecting step and the correction data formed in the correction data forming step. An eye-gaze detecting step for detecting, and when individual difference data is detected in the individual difference data detecting step after the correction data is formed ,
You may use a personal difference data detected in the corrected data formed
A correction data updating step of performing an operation different from the statistical operation to update the correction data. 7. The correction data updating step includes the step of:
After updating the positive data, the individual
If human error data is detected, after updating the correction data
Using the individual difference data detected in
7. The gaze detection method according to claim 6 , wherein the correction data is updated by performing the following calculation . Wherein said correction data updating step, the complement
Individual difference data used to create or update positive data
Detected after the correction data is formed or updated.
Update the correction data according to the difference with the individual difference data.
6 also claims, characterized in that to vary the operation of the time that
Line-of-sight detection method according to 7. Wherein said correction data updating step, the complement
Individual difference data used to create or update positive data
Detected after the correction data is formed or updated.
If the difference from the individual difference data is greater than the threshold,
Compared with the case where the correction data is not large,
The weight of the individual difference data detected after
The gaze detection method according to claim 8, wherein a calculation is performed . Wherein said correction data updating step, the
Individual difference data used for forming or updating correction data
Detected after the correction data is formed or updated.
10. The method according to claim 6, wherein one of the simple averaging method and the least squares method is selected according to a difference from the individual difference data, and the correction data is updated by the selected calculation method .
The gaze detection method according to any one of the above.