JPH10191132A - Image recording method, device therefor and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To attain a pleasant operation by using an operation means being a single body to conduct both operations for switching to the sight line continuous mode or the sight line momentary movement mode and for a prescribed area shift in the sight line momentary movement mode. SOLUTION: The sight line continuous mode and the sight line momentary movement mode are provided. Then an operation means being a single body is used to conduct operations for the switching between the two modes and for a prescribed area shift in the sight line momentary movement mode. A sight line automatic focus (gaze AF)/automatic exposure(AE) mode switch 1215 that is the operation means being the single body detects a light depression state (half depression) and a strong depression state (deep depression) of a sight line AF/AE mode switch key 401. For example, the sight line AF/AE mode switch key 401 is depressed by a half stroke, a voltage divided by 1st and 2nd resistors R1, R2 is outputted at a switch detection signal output terminal A.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image recording method and apparatus having a line-of-sight detection function, such as a video camera, and a storage medium used in the image recording method and apparatus.

[0002]

2. Description of the Related Art The present applicant displays an index indicating a function such as zoom / fade on a finder screen of a video camera, which is an image recording apparatus, and allows the user to select it with his / her line of sight or to set the position of auto focus. An image recording apparatus having a so-called line-of-sight detection function that allows the user to select a line of sight has already been proposed. The principle of this gaze detection function will be described below.

FIG. 8 is a plan view for explaining the principle of the eye-gaze detecting method, and FIG. 9 is a side view for explaining the principle of the eye-gaze detecting method. In both figures, reference numerals 804a and 804b denote light sources such as light-emitting diodes (IREDs) that emit infrared light insensitive to an observer, and each light source 804a and 804b is in the x direction with respect to the optical axis of the imaging lens 807 ( It is arranged substantially symmetrically (in the horizontal direction) (see FIG. 8), and slightly below (see FIG. 9) in the y-direction (vertical direction).
Divergent lighting. A part of the illumination light reflected by the eyeball 805 is transmitted to the image sensor 808 by the imaging lens 807.
Image. FIG. 10 is a schematic diagram of an eyeball image projected on the image sensor 808, and FIG. 11 is an output intensity diagram of the image sensor 808.

[0004] A gaze detection method will be described below with reference to the drawings.

First, considering a horizontal plane, the infrared light emitted from one light source 804b in FIG. 8 illuminates the cornea 806 of the eyeball 805 of the observer. At this time, the cornea 806
Corneal reflection image d formed by infrared light reflected on the surface
The (virtual image) is condensed by the imaging lens 807 and forms an image at a position d ′ on the image sensor 808. Similarly, the infrared light emitted from the other light source 804a is
Illuminate the 5 cornea 806. At this time, a corneal reflection image e (virtual image) formed by infrared light reflected on the surface of the cornea 806 is condensed by the imaging lens 807 and forms an image at a position e ′ on the image sensor 808.

A light beam from the ends a and b (pupil end 802) of the iris 803 is transferred to positions a 'and b' on the image sensor 808 via an imaging lens 807.
Are formed at the ends a and b. When the rotation angle θ of the optical axis of the eyeball 805 with respect to the optical axis of the imaging lens 807 is small, the x coordinates of the ends a and b of the iris 803 are xa and xb.
A large number of points xa and xb can be obtained on the image sensor 808 (x marks in FIG. 10). Therefore, first, the pupil center xc is calculated by the least square method of the circle.

On the other hand, the center o of the radius of curvature rc of the cornea 806
Let x be the x-coordinate of the eyeball 805, the rotation angle θx of the eyeball 805 with respect to the optical axis can be obtained by the following equation (1).

Oc × sin θx = xc−xo (1) Further, xo can be obtained by the following equation (2) in consideration of a predetermined correction value δx at the midpoint k between the corneal reflection images d and e.

Xk = (xd + xe) / 2 xo = (xd + xe) / 2 + δx (2) where δx is a numerical value geometrically obtained from the installation method of the apparatus / distance of the eyeball 805, and the calculation method thereof. Is omitted.

Therefore, θx can be obtained from the following equation (3) by substituting the above equation (1) into the equation (2).

Θx = arcsin [[xc − ｛(xd + xe) / 2 + δx}] / oc] (3) Further, the coordinates of each feature point projected on the image sensor 808 are represented by “′” (dash). The following equation (4) can be obtained by adding and rewriting.

Θx = arcsin [[xc ′ − {(xd ′ + xe ′) / 2 + δx ′}] / oc / β] (4) where β is determined by the distance sze of the eyeball 805 to the imaging lens 807. The magnification is actually obtained as a function of the interval | xd'-xe '| of the corneal reflection image. Next, when viewed from a vertical plane, the configuration is as shown in FIG. Here, the corneal reflection images generated by the two light sources 804a and 804b are generated at the same position, and this is defined as i. Rotation angle θy of eyeball 805
Is almost the same as that of the horizontal plane described above, except for the equation (2). The y coordinate of the corneal curvature center o is represented by y
Assuming that o, yo can be obtained by the following equation (5).

Yo = yi + δy (5) Here, δy is a numerical value obtained geometrically from the installation method of the apparatus / distance of the eyeball 805, and the calculation method thereof is omitted.

Therefore, the rotation angle θy in the vertical direction can be obtained by the following equation (6). θy = arcsin [[yc ′ − (yi ′ + δy ′)] / oc / β] (6) Further, the position coordinates (x
When a constant m determined by the finder optical system is used, n, yn) are expressed by the following expressions (7) and (8) on the horizontal plane and the vertical plane, respectively.

Xn = m × arcsin [[xc ′ − {(xd ′ + xe ′) / 2 + δx ′}] / oc / β] (7) yn = m × arcsin [[yc ′ − (yi ′ + δy ′) ] / Oc / β] (8) As is clear from FIG. 11, the pupil edge (pupil end 80
The detection of 2) utilizes the rising (xb ') and falling (xa') of the output waveform of the image sensor 808.
Further, the coordinates of the corneal reflection image have a sharp rising portion (x
e ') and (xd') are used.

Next, a video camera which is an image recording device having a visual line detection function will be described. FIG. 12 is a block diagram showing a configuration of a video camera having a visual line detection function. The video camera shown in FIG.
201, aperture 1202, aperture control means 1203 for driving aperture 1202, zoom control and autofocus (A
F) Zoom / AF means 1204 for performing control, a CC for converting an image formed by these optical systems into an electric signal
D, etc., an image sensor 1205, a signal processing circuit 1206 for converting an electric signal output from the image sensor 1205 into a predetermined video signal, and an LC for observing a captured subject image.
A display element 1207 having a liquid crystal display (D) or the like; a first eyepiece (first finder lens) 1208 disposed in front of the display element 1207;
A second eyepiece lens (second finder lens) 1210 disposed immediately before, a display circuit 1211 for driving a display element 1207, a main control circuit 1212 for controlling each part of the camera, and Video recording / reproducing means 1213 for recording and reproducing on a tape, solid-state memory, magnetic / optical disc, etc., operation switch detecting means 1214 for executing the function of a video camera, visual axis AF
A line-of-sight AF / AE mode switch 1215 for changing the / AE mode, an infrared diode 1216 for irradiating the photographer's eyes 1209 with infrared light, a dichroic mirror 1217 for reflecting visible light and transmitting infrared light, and the dichroic mirror Condenser lens 1 for condensing infrared light transmitted through 1217
218, an image sensor 1219 for converting the infrared light condensed by the condenser lens 1218 into an electric signal, and photographing based on the image of the photographer's eye 1209 on the image sensor 1219 according to the algorithm according to the principle described above. A gaze detection circuit 1220 for obtaining the coordinates of the gazing point on the screen of the display element 1207 of the user.

Here, auto-focusing is performed by controlling the zoom / AF means 1204 so that a high-frequency component in an area where the captured image is to be focused has a peak.

Next, the line of sight AF / AE will be described. FIG. 13 is a schematic diagram of a display example of the display element 1207 when this function is used. In the figure, reference numeral 1301 denotes a line-of-sight AF / AE frame representing an outline of a focus area, which is displayed at a coordinate of a gazing point, focuses on a subject in this area, and optimizes brightness of a subject image in the area. The aperture 1202, the gain of the signal processing circuit 1206, and the exposure time of the image sensor 1205 (corresponding to the shutter speed)
Is determined. At this time, the gaze detection circuit 1220 constantly detects the gaze coordinates of the photographer and outputs the coordinates to the main control circuit 1212. For example, when the photographer gazes at the person in FIG. 13, the main control circuit 1212 performs the AF / AE control based on the line-of-sight coordinates, sends a line-of-sight coordinate signal also to the display element 1207, and To display a line of sight AF / AE frame 1301.

The line-of-sight AF / AE is a line-of-sight tracking AF / AE that operates continuously. If the subject does not move, the line-of-sight AF / AE mode switch 1215 is operated to change the current line-of-sight AF / AE. The main control circuit 1212 operates so as to be fixed at the area position. When the line-of-sight AF / AE mode switch 1215 is operated again, the flow returns to the line-of-sight tracking AF / AE.

[0020]

However, the above-described conventional apparatus has the following problems. (1) When the fixed line-of-sight AF / AE area is instantaneously fixed at another position, once the line-of-sight AF / AE mode switch is operated to set the line-of-sight tracking AF / AE mode, the line of sight is directed to a predetermined position. Then, it is necessary to operate the line-of-sight AF / AE mode switch again, so that the line-of-sight AF / AE mode switch is operated twice, which takes a lot of time.

(2) When it is desired to fix the AF / AE area at the center as in a general camera, the AF / AE area must be fixed by the line of sight and cannot be moved to the center accurately.
The operation is troublesome.

The present invention has been made in view of the above-mentioned problems of the prior art, and a first object of the present invention is to instantly replace a fixed AF / AE area with another. An image recording method and apparatus in which the operation for fixing to the position does not take much time, and when it is desired to fix the AF / AE area at the center, the center can be accurately moved by a simple operation. It is intended to provide.

A second object of the present invention is to provide a storage medium capable of smoothly controlling the above-described image recording apparatus.

[0024]

According to a first aspect of the present invention, there is provided an image recording method in which a predetermined area in a photographing screen can be determined by a line of sight. Has a line-of-sight continuous mode in which a predetermined area can be continuously moved, and a line-of-sight instantaneous movement mode in which a predetermined area moves instantaneously only when the line of sight is moved and a predetermined operation is performed. It is characterized in that both an operation for switching to one of the two modes and an operation for moving a predetermined area in the instantaneous line-of-sight movement mode can be performed.

According to a second aspect of the present invention, there is provided an image recording method according to the first aspect, wherein the single operating means is a single push-type operating means. It is characterized by.

According to a third aspect of the present invention, there is provided an image recording method according to the first aspect, wherein the single operating means is a single push-type operating means. One of half-press, deep-press, and double-click.

According to a fourth aspect of the present invention, there is provided an image recording method according to the first aspect, wherein the predetermined area in the photographing screen includes a camera auto-focus (AF). ), Which is an area for performing auto exposure (AE).

According to a fifth aspect of the present invention, there is provided an image recording apparatus capable of determining a predetermined area in a photographing screen based on a line of sight. A line-of-sight continuous mode setting means for setting a predetermined area to a movable line-of-sight continuous mode, and a line-of-sight instantaneous movement mode for setting a line-of-sight instantaneous movement mode in which the predetermined area is instantaneously moved only when the line of sight is moved and a predetermined operation is performed. The apparatus is characterized by comprising a setting means and a single operation means for performing both an operation for switching to any one of the two modes and an operation for moving a predetermined area in the line-of-sight instantaneous movement mode.

According to a sixth aspect of the present invention, there is provided an image recording apparatus according to the fifth aspect, wherein the single operating means is a single push-type operating means. It is characterized by.

In order to achieve the first object, an image recording apparatus according to a seventh aspect of the present invention is the image recording apparatus according to the fifth aspect, wherein the single operating means uses a single push-type operating means. One of half-press, deep-press, and double-click.

According to another aspect of the present invention, there is provided an image recording apparatus according to the present invention, wherein the predetermined area in the photographing screen includes an autofocus (AF) of a camera. ), Which is an area for performing auto exposure (AE).

According to a ninth aspect of the present invention, there is provided an image recording method according to the ninth aspect, wherein a predetermined area in a photographing screen can be determined by a line of sight. There are a line-of-sight continuous mode in which the predetermined area can be moved, a line-of-sight instantaneous movement mode in which the predetermined area moves instantaneously only when the line of sight is moved and a predetermined operation is performed, and a center fixed mode in which the predetermined area is fixed at the center. In addition, it is characterized in that both a switching operation to any one of the three modes and an operation for moving a predetermined area in the line-of-sight instantaneous movement mode can be performed by a single operation unit.

According to a tenth aspect of the present invention, there is provided an image recording method according to the ninth aspect, wherein the single operating means is a single push-type operating means. It is characterized by.

In order to achieve the first object, an image recording method according to claim 11 is the image recording method according to claim 9, wherein the single operating means uses a single push-type operating means. One of half-press, deep-press, and double-click.

According to a twelfth aspect of the present invention, there is provided an image recording method as defined in the ninth aspect, wherein the predetermined area in the photographing screen includes a camera auto-focus (AF). ), Which is an area for performing auto exposure (AE).

In order to achieve the first object, an image recording apparatus according to a thirteenth aspect of the present invention is an image recording apparatus capable of determining a predetermined area in a photographing screen by a line of sight. A line-of-sight continuous mode setting means for setting a predetermined area to a movable line-of-sight continuous mode, and a line-of-sight instantaneous movement mode for setting a line-of-sight instantaneous movement mode in which the predetermined area is instantaneously moved only when the line of sight is moved and a predetermined operation is performed. Setting means, a fixed center mode setting means for setting a fixed center mode for fixing a predetermined area at the center, and a switching operation to any one of the three modes and an operation for moving a predetermined area in the line-of-sight instantaneous movement mode. And a single operating means for performing both.

In order to achieve the first object, an image recording apparatus according to a fourteenth aspect is the image recording apparatus according to the thirteenth aspect, wherein the single operating means is a single push-type operating means. It is characterized by.

In order to achieve the first object, an image recording apparatus according to claim 15 is the image recording apparatus according to claim 13, wherein the single operating means uses a single push-type operating means. One of half-press, deep-press, and double-click.

According to a sixteenth aspect of the present invention, in the image recording apparatus according to the thirteenth aspect, the predetermined area in the photographing screen includes a camera auto-focus (AF). ), Auto exposure (AE)
Is an area for performing

In order to achieve the second object, a storage medium according to a seventeenth aspect is a storage medium for storing a program for controlling an image recording apparatus capable of determining a predetermined area in a photographing screen based on a line of sight. A line-of-sight continuation mode setting module for setting a line-of-sight continuous mode in which a predetermined area can be continuously moved in accordance with the line of sight, and a line of sight in which the predetermined area is instantaneously moved only when the line of sight is moved and a predetermined operation is performed. A line-of-sight instantaneous movement mode setting module for setting an instantaneous movement mode, and operation switching for performing both a switching operation to one of the two modes and an operation for moving a predetermined area in the line-of-sight instantaneous movement mode by a single operation means A program having a module is stored.

In order to achieve the second object, a storage medium according to claim 18 is the storage medium according to claim 17, wherein the single operation means is a single push-type operation means. And

In order to achieve the second object, the storage medium according to the nineteenth aspect is the storage medium according to the seventeenth aspect, wherein the single operation means is a half-push operation using a single push-type operation means. / Deep press / double click.

In order to achieve the second object, the storage medium according to claim 20 is the storage medium according to claim 17, wherein the predetermined area in the photographing screen includes an auto focus (AF) of a camera, It is an area for performing auto exposure (AE).

In order to achieve the second object, a storage medium according to claim 21 is a storage medium for storing a program for controlling an image recording apparatus capable of determining a predetermined area in a photographing screen by a line of sight. A line-of-sight continuation mode setting module for setting a line-of-sight continuous mode in which a predetermined area can be continuously moved in accordance with the line of sight, and a line of sight in which the predetermined area is instantaneously moved only when the line of sight is moved and a predetermined operation is performed. A line-of-sight instantaneous movement mode setting module for setting the instantaneous movement mode, a center fixed mode setting module for setting the center fixed mode for fixing a predetermined area at the center, and a switching operation to any one of the three modes by a single operation means And an operation switching module that performs both an operation for moving a predetermined area in the line-of-sight instantaneous movement mode. Wherein the storing.

In order to achieve the second object, the storage medium according to claim 22 is the storage medium according to claim 21, wherein the single operating means is a single push-type operating means. And

In order to achieve the second object, the storage medium according to the twenty-third aspect is the storage medium according to the twenty-first aspect, wherein the single operation means is a half-push operation using a single push-type operation means. / Deep press / double click. Further, in order to achieve the second object, the storage medium according to claim 24 is the storage medium according to claim 21.
In the storage medium described above, the predetermined area in the photographing screen is an area for performing auto focus (AF) and auto exposure (AE) of a camera.

[0047]

Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) First, the first embodiment of the present invention will be described.
An embodiment will be described with reference to FIGS. Note that the gaze detection principle of the video camera that is the image recording device according to the present embodiment, the configuration of the finder optical system of the video camera having the gaze detection function, and the internal configuration of the video camera are as follows.
Since they are the same as the above-mentioned conventional examples shown in FIGS. 8 to 12, the drawings will be described with reference to these drawings.

In this embodiment, there are three types of AF / AE area operation modes as described below.
The operation will be described using the screen display.

FIG. 1 shows an example of a finder screen display in the eye tracking AF / AE mode, in which the eye is continuously detected and the eye AF / AE frame 1301 always follows the eye.

FIG. 2 shows an example of a finder screen display in the single-movement line-of-sight AF / AE mode.
Reference numeral 301 denotes a fixed unit. When the line of sight AF / AE mode switch 1215 (see FIG. 12) is pressed halfway while gazing at a place to be moved, the AF / AE frame 1301 is instantaneously moved.

FIG. 3 shows an example of a finder screen display in the AF / AE area center fixed mode.
01 is fixed at the center, and AF is applied only to the center subject.
This is a mode similar to that of a general video camera in which the / AE control is performed.

FIG. 4 shows a line-of-sight AF / AE mode switch 12 of a video camera which is an image recording apparatus according to this embodiment.
FIG. 15 is a configuration and operation circuit diagram of No. 15; In the figure, reference numeral 401 denotes a line-of-sight AF / AE mode switch key, which can be moved up and down. Reference numerals 402a, 402b, and 402c denote leaf spring contacts, and fixed ends of the leaf spring contacts 402a to 402c are separated from each other by electrical insulating materials 403a and 403b. The upper leaf spring contact 402a is connected to the switch detection signal output terminal A, and the middle leaf spring contact 402b is a first resistor R interposed between the (+) power supply and the ground (GND).
A lower leaf spring contact 402 between the first resistor R2 and the second resistor R2.
c is connected to the ground (GND).

In the above configuration, when the line-of-sight AF / AE mode switch key 401 is not pressed at all, the switch detection signal output terminal A is open. In this state, when the line-of-sight AF / AE mode switch key 401 is pressed in half a stroke (S1), the upper leaf spring contact 4 is pressed.
02a and the leaf spring contact 402b in the middle part contact each other, and the switch detection signal output terminal A is connected to the first resistor R1.
And the second resistor R2, the divided voltage is output. Further, when the line-of-sight AF / AE mode switch key 401 is pressed in a full stroke (S2), the upper leaf spring contact 402a, the middle leaf spring contact 402b, and the lower leaf spring contact 402c come into contact with each other, and a switch detection signal A ground (GND) voltage is output to the output terminal A.
Therefore, line-of-sight AF / AE mode switch 1215 according to the present embodiment can detect a state in which line-of-sight AF / AE mode switch key 401 is lightly pressed (half-pressed) and strongly pressed (deeply pressed). .

Next, the line-of-sight AF / AE operation of the video camera as the image recording apparatus according to the present embodiment will be described with reference to the flowchart of FIG. The processing operation shown in FIG. 5 is executed by main control circuit 1212 (see FIG. 12).

First, in step S501, the AF / AE frame 1
301 (see FIGS. 1 to 3) is fixed at the center. Next, in step S502, the line-of-sight AF / AE mode switch 1215
It is determined whether or not is half-pressed. If it is not half-pressed, then in the next step S503, the visual axis AF
It is determined whether the / AE mode switch 1215 is pressed deeply. If not, the process returns to step S502.

If the line-of-sight AF / AE mode switch 1215 is half-pressed in step S502, the AF / AE frame 1301 is moved to the line-of-sight position in step S505, and is fixed at that position. In step S506, 0 is written to the memory N of the main control circuit 1212, and then 1 is added to the value of the memory N in step S507. Next, in step S508, it is determined again whether or not the line-of-sight AF / AE mode switch 1215 is half-pressed. If it is not half-pressed, it is determined in the next step S509 whether or not the value of the memory N is larger than a predetermined value NX. When the value of the memory N is smaller than the predetermined value NX, the process returns to the step S507, and when it is larger, the process returns to the step S502. In step S508, the line-of-sight AF / AE mode switch 12
If the button 15 is half-pressed, A is determined in step S510.
After fixing the F / AE frame 1301 at the center, the process returns to step S502. If the line-of-sight AF / AE mode switch 1215 is deeply pressed in step S503, the flow returns to step S502 after setting the line-of-sight tracking AF / AE mode in step S504.

According to the above operation, the AF / AE frame 1301 which was in the center in the initial state is pointed at the place where the user wants to move, and the line-of-sight AF / AE mode switch 1215 is half-pressed. It can be moved to an intended position, and can correspond to a pin feed or a main subject other than the center. When the line-of-sight AF / AE mode switch 1215 is pressed deeply, the AF / AE frame 1 is continuously pressed.
The eye / gaze tracking AF / AE mode in which the moving object 301 moves can be set, and the moving subject can be focused. By half-pressing the line-of-sight AF / AE mode switch 1215 during execution of this line-of-sight tracking AF / AE mode, the AF / AE frame 1301 is fixed at that position, and when used when the subject stops temporarily, Eye fatigue can be reduced. Further, if the line-of-sight AF / AE mode switch 1215 is half-pressed twice consecutively (double-clicked), the AF / AE frame 1301 can be instantaneously fixed at the center, and the line-of-sight AF / AE function is released to be used normally. You can switch back to mode.

The above operations are all performed in one line of sight AF /
Since this is performed by the AE mode switch 1215, no extra key space is required.

(Second Embodiment) Next, a storage medium of the present invention will be described with reference to FIGS.

As shown in FIG. 6, the storage medium for storing the program for controlling the image recording apparatus capable of determining a predetermined area in the photographing screen based on the line of sight includes at least a line of sight continuous mode setting module, a line of sight What is necessary is just to store the program code of each module of "movement mode setting module" and "operation switching module".

Here, the "line-of-sight mode setting module" is a program module for setting a line-of-sight continuous mode in which a predetermined area can be continuously moved following the line of sight. The “line-of-sight instantaneous movement mode setting module” is a program module for setting a line-of-sight instantaneous movement mode in which a predetermined area is instantaneously moved only when a line of sight is moved and a predetermined operation is performed. The “operation switching module” is a program module for performing both an operation of switching to one of the two modes and an operation of moving the predetermined area in the line-of-sight instantaneous movement mode by a single operation unit. The single operation means is a single push-type operation means, and the single operation means is one of half-press, deep-press, and double-click using the single push-type operation means. The predetermined area in the photographing screen is an area where the camera performs auto focus (AF) and auto exposure (AE).

As shown in FIG. 7, a storage medium for storing a program for controlling an image recording apparatus capable of determining a predetermined area in a photographing screen based on a line of sight is different from that shown in FIG.
At least the program codes of the modules of the “line-of-sight continuous mode setting module”, “line-of-sight instantaneous movement mode setting module”, “center fixed mode setting module”, and “operation switching module” may be stored.

Here, the "line-of-sight mode setting module" is a program module for setting the line-of-sight continuous mode in which a predetermined area can be continuously moved following the line of sight. The “line-of-sight instantaneous movement mode setting module” is a program module for setting a line-of-sight instantaneous movement mode in which a predetermined area is instantaneously moved only when a line of sight is moved and a predetermined operation is performed. The “fixed center mode setting module” is a program module for setting a fixed center mode in which a predetermined area is fixed at the center. The “operation switching module” is a program module for performing both an operation of switching to any of the three modes and an operation of moving a predetermined area in the line-of-sight instantaneous movement mode by a single operation unit. . The single operation means is a single push-type operation means, and the single operation means is one of half-press, deep-press, and double-click using the single push-type operation means. The predetermined area in the photographing screen is an area where the camera performs auto focus (AF) and auto exposure (AE).

[0065]

As described in detail above, according to the image recording method and apparatus according to the first and fifth aspects of the present invention, a visual line continuous mode in which a predetermined area can be continuously moved following a visual line, Alternatively, both the switching to one of the gaze instantaneous movement modes in which the predetermined area moves instantaneously only when the gaze is moved and the predetermined operation is performed, and the operation for moving the predetermined area in the gaze instantaneous movement mode are performed as a single unit. Since the operation is made possible by the operation means, it is not necessary to search for another operation means, and it is possible to perform a comfortable operation.

According to the image recording method and apparatus of the ninth and thirteenth aspects of the present invention, a line-of-sight continuous mode in which a predetermined area can be continuously moved following a line of sight, or a predetermined line of sight is moved by moving a line of sight. Both the switching to the gaze instantaneous movement mode in which the predetermined area moves instantaneously only when the operation is performed, or the center fixed mode in which the predetermined area is fixed at the center, and both the operation for moving the predetermined area in the gaze instantaneous movement mode Was made possible by a single operating means,
There is no need to search for other operation means, and it is possible to perform a comfortable operation.

The image recording method and apparatus according to the second and sixth aspects of the present invention, and the tenth and the first aspects of the present invention.
According to the image recording method and apparatus described in Item 4, since a single push-type operating means is employed as a single operating means,
This has the effect of simplifying the operation.

Further, the image recording method and apparatus according to claims 3 and 7 of the present invention and the image recording methods and apparatus according to claims 11 and 1 of the present invention.
According to the image recording method and apparatus described in Item 5, the half-press / single push / pull operation means can be used as the single operation means.
Since either deep-pressing or double-clicking is employed, there is an effect that the operation can be performed with one finger.

The image recording method and apparatus according to claims 4 and 8 of the present invention, and the image recording methods and apparatus according to claims 12 and 1 of the present invention.
According to the image recording method and apparatus described in Item 6, since the predetermined area is an area for performing auto focus (AF) and auto exposure (AE) of the photographing lens, the area for auto focus (AF) and auto exposure (AE) is used. There is an effect that the determination can be made easily.

Further, according to the storage medium of the present invention, there is an effect that the above-described image recording apparatus can be smoothly controlled.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating an example of a viewfinder screen display in a visual line tracking AF / AE mode in an image recording apparatus according to a first embodiment of the present invention.

FIG. 2 is a single moving line-of-sight AF in the image recording apparatus.
FIG. 7 is a diagram illustrating an example of a viewfinder screen display in the / AE mode.

FIG. 3 is a diagram showing an example of a viewfinder screen display in an AF / AE area center fixed mode in the image recording apparatus.

FIG. 4 is a configuration and operation circuit diagram of an AF / AE mode switch in the image recording apparatus.

FIG. 5 is a flowchart illustrating a control procedure of a visual line AF / AE mode operation in the image recording apparatus.

FIG. 6 is a diagram showing each module of a program stored in a storage medium of the present invention.

FIG. 7 is a diagram showing each module of a program stored in a storage medium different from the storage medium shown in FIG. 6 of the present invention.

FIG. 8 is a diagram for explaining the principle of gaze detection in a conventional image recording apparatus having a gaze detection function.

FIG. 9 is a diagram for explaining the principle of gaze detection in a conventional image recording apparatus having a gaze detection function.

FIG. 10 is a schematic diagram of an eyeball image projected on an image sensor in a conventional image recording device having a visual line detection function.

FIG. 11 is a diagram showing the output intensity of an image sensor in a conventional image recording device having a visual line detection function.

FIG. 12 is a diagram showing a configuration of a finder optical system in a conventional image recording apparatus having a visual line detection function.

FIG. 13 is a view showing an example of a viewfinder screen display in a line-of-sight tracking AF / AE mode in a conventional image recording apparatus having a line-of-sight detection function.

[Explanation of symbols]

 401 Line-of-sight AF / AE mode switch key 402a Leaf spring contact 402b Leaf spring contact 402c Leaf spring contact 403a Electrical insulating member 403b Electrical insulating material 801 Pupil 802 Pupil (iris) end 803 Iris 804a Light source 804b Light source 805 Sclera 806 Cornea 807 Image lens 808 Image sensor 1201 Photographing lens 1202 Aperture 1203 Aperture control means 1204 Zoom / AF means 1205 Image sensor 1206 Signal processing circuit 1207 Display element 1208 Finder lens 1209 Eye of observer 1210 Finder lens 1211 Display circuit 1212 Main control circuit 1213 Video Recording / reproducing means 1214 Operation switch detecting means 1215 Eye-gaze AF / AE mode switch 1216 Infrared light emitting diode 1217 Dichroic mirror 1218 Imaging lens 1219 Image sensor 1220 Eye-gaze detection circuit 1301 Eye-gaze AF / AE frame

──────────────────────────────────────────────────の Continued on front page (51) Int.Cl. ⁶ Identification code FI H04N 5/235 G02B 7/11 N

Claims (24)

[Claims] In an image recording method capable of determining a predetermined area in a shooting screen by a line of sight, a line of sight continuous mode in which the predetermined area can be continuously moved following the line of sight, and a predetermined operation is performed by moving the line of sight. A gaze instantaneous movement mode in which the predetermined area moves instantaneously only when the operation is performed, and a single operation unit is used for switching operation to one of the two modes and for moving the predetermined area in the gaze instantaneous movement mode. An image recording method characterized in that both operations can be performed. 2. The image recording method according to claim 1, wherein said single operation means is a single push-type operation means. 3. An image recording method according to claim 1, wherein said single operation means is one of half-press, deep-press, and double-click using a single push-type operation means. 4. The image recording method according to claim 1, wherein the predetermined area in the photographing screen is an area for performing auto focus (AF) and auto exposure (AE) of a camera. 5. An eye-gaze continuation mode setting means for setting a gaze continuous mode in which a predetermined area in a photographing screen can be determined based on a line of sight and in which a predetermined area can be continuously moved following a line of sight. Gaze instantaneous movement mode setting means for setting a gaze instantaneous movement mode in which a predetermined area is instantaneously moved only when a predetermined operation is performed by moving the camera; and a switching operation to one of the two modes and the gaze instantaneous movement An image recording apparatus comprising: a single operation unit that performs both operations for moving a predetermined area in a mode. 6. The image recording apparatus according to claim 5, wherein said single operation means is a single push-type operation means. 7. The image recording apparatus according to claim 5, wherein said single operation means is one of half-press, deep-press, and double-click using a single push-type operation means. 8. The image recording apparatus according to claim 5, wherein the predetermined area in the photographing screen is an area for performing auto focus (AF) and auto exposure (AE) of the camera. 9. An image recording method capable of determining a predetermined area in a shooting screen by a line of sight, wherein a line of sight continuous mode in which the predetermined area is continuously moved following the line of sight, and a predetermined operation is performed by moving the line of sight. It has a line-of-sight instantaneous movement mode in which the predetermined area moves instantaneously only when performed, and a center fixed mode in which the predetermined area is fixed at the center. By a single operation means, switching operation to any of the three modes and An image recording method, wherein both operations for moving a predetermined area in the line-of-sight instantaneous movement mode can be performed. 10. The image recording method according to claim 9, wherein said single operation means is a single push-type operation means. 11. The image recording method according to claim 9, wherein said single operation means is one of half-press, deep-press, and double-click using a single push-type operation means. 12. The image recording method according to claim 9, wherein the predetermined area in the photographing screen is an area for performing auto focus (AF) and auto exposure (AE) of a camera. 13. An image recording apparatus capable of determining a predetermined area in a photographing screen based on a line of sight, a line of sight continuous mode setting means for setting a line of sight continuous mode in which the predetermined area can be continuously moved following the line of sight, A line-of-sight instantaneous movement mode setting means for setting a line-of-sight instantaneous movement mode in which a predetermined area is instantaneously moved only when a predetermined operation is performed by moving
A center fixed mode setting unit for setting a fixed area at the center in a fixed center mode, and a single unit for performing both an operation for switching to any one of the three modes and an operation for moving the predetermined area in the line-of-sight instantaneous movement mode An image recording apparatus comprising: 14. The image recording apparatus according to claim 13, wherein said single operation means is a single push-type operation means. 15. The image recording apparatus according to claim 13, wherein said single operation means is one of half-press, deep-press, and double-click using a single push-type operation means. 16. The image recording apparatus according to claim 13, wherein the predetermined area in the photographing screen is an area for performing auto focus (AF) and auto exposure (AE) of a camera. 17. A storage medium for storing a program for controlling an image recording apparatus capable of determining a predetermined area in a shooting screen based on a line of sight, wherein the line of sight continuous mode is capable of continuously moving the predetermined area following the line of sight. A line-of-sight continuous mode setting module that sets a line-of-sight instantaneous movement mode setting module that sets a line-of-sight instantaneous movement mode in which a predetermined area moves only when a line of sight is moved and a predetermined operation is performed.
A storage storing a program having an operation switching module for performing both an operation for switching to any one of the two modes by a single operation means and an operation for moving a predetermined area in the instantaneous line-of-sight movement mode. Medium. 18. The storage medium according to claim 17, wherein said single operation means is a single push-type operation means. 19. The storage medium according to claim 17, wherein said single operation means is one of half-press, deep-press, and double-click using a single push-type operation means. 20. The storage medium according to claim 15, wherein the predetermined area in the photographing screen is an area for performing auto focus (AF) and auto exposure (AE) of a camera. 21. A storage medium for storing a program for controlling an image recording apparatus capable of determining a predetermined area in a photographing screen based on a line of sight, wherein the line of sight continuous mode is capable of continuously moving the predetermined area following the line of sight. A line-of-sight continuous mode setting module that sets a line-of-sight instantaneous movement mode setting module that sets a line-of-sight instantaneous movement mode in which a predetermined area moves only when a line of sight is moved and a predetermined operation is performed.
A center fixed mode setting module for setting a fixed area at a center fixed mode, a switching operation to any one of the three modes by a single operation means, and an operation for moving a predetermined area in the line-of-sight instantaneous movement mode A storage medium storing a program having an operation switching module that performs both of the above. 22. The storage medium according to claim 21, wherein said single operation means is a single push-type operation means. 23. The storage medium according to claim 21, wherein said single operation means is one of half-press, deep-press, and double-click using a single push-type operation means. 24. The storage medium according to claim 21, wherein the predetermined area in the photographing screen is an area for performing auto focus (AF) and auto exposure (AE) of a camera.