JP2010199728A - Imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the problem that a photographer himself/herself has to perform a release operation even when the camera eye line is judged by the photographer or is electronically determined and photographing with the camera eye line is not easily performed without missing a photo opportunity. <P>SOLUTION: When a photographing mode is determined in S102, an image is fetched in S103, the image of an object is determined, a part determined as the face of the object is focused and exposure is controlled in S104, and a live view image is displayed in S105. In S106, a light emitting pattern indicating the largest change is determined from the inclination of the face. In S107, the camera eye line is determined. When it is determined to be on the camera eye line, processing is advanced to S122, an automatic release operation is performed and recording is performed. When not on the camera eye line, processing is advanced to S121 and the photographer is requested to determine the propriety of photographing. When it is determined that photographing is to be performed even when not on the camera eye line, photographing is performed under the release operation by the photographer in S122 and recording is performed. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus such as a digital camera, a digital video camera, or a mobile phone with a digital camera having a still image and moving image shooting function.

  Imaging devices such as digital cameras, digital video cameras, and mobile phones with digital cameras have become widespread, and photography is becoming a hobby for people other than the core users (eg women, middle-aged and older people). .

  Recently, photographing with a so-called camera line in which the line of sight of the subject is directed to the imaging device is preferred over photographing without making the imaging device conscious. In particular, blogs (abbreviated as Weblogs) that publish information on the Internet that is recorded relatively frequently in time series such as personal experiences and diaries are widespread. On the blog, photos of infants such as babies taken by mothers, cats and dogs taken by people who call pet cats and dogs reflecting the pet boom are posted.

  If the subject is a person of a certain age, the photographer can understand the intention of the photographer and stare at the image pickup apparatus. However, since the infant cannot understand the photographer's intention, it is not easy to photograph the infant as a subject because he is crazy about his play or does not show interest in the photography itself. Also, cats, dogs, and other pets are difficult to shoot from the camera's perspective because they are not interested in shooting.

  In order to direct the eyes of infants, cats, dogs, etc. to the imaging device, an image such as an animation character is displayed on a liquid crystal display directed toward the subject (for example, Japanese Patent Application Laid-Open No. 2003-101842), which is incorporated in the imaging device A speaker that emits a predetermined audio signal such as “here” or a light emitting member such as an LED that is annularly arranged around a photographing lens and blinks at a predetermined interval (for example, Japanese Patent Application Laid-Open No. 2003-078792). Proposed.

  In addition, a device that directs the interest of infants, cats, dogs, and the like in the direction of the imaging device by moving a mouse model, a small animal tail, a spiral rotating panel, and the like has been proposed (for example, Japanese Patent Application Laid-Open No. 2007-128011). Yes.

  In addition, an imaging apparatus has also been proposed in which image data of a subject is digitally analyzed to determine whether the subject's line of sight is directed toward the imaging device. For example, in Japanese Patent Application Laid-Open No. 2008-011457, the nose part and the eye part are extracted from the face part of the subject detected from the image data, and the eye direction of the eye part and the direction of the face part are determined to image the eye of the subject. It is determined whether or not it is directed to the device.

Japanese Patent Laid-Open No. 2003-101842 JP 2003-078792 A JP 2007-128011 A JP 2008-011457 A

  Display means such as a liquid crystal display is provided on the rear surface of the image pickup apparatus, and a photographer usually performs photographing while checking the composition while viewing a live view image on the liquid crystal display (display means). However, in the configuration of Cited Document 1 in which an image such as an animation character is displayed on the liquid crystal display directed toward the subject, the photographer must check the composition by looking through the viewfinder, and is forced to shoot in a narrow field of view. It is easy to miss a photo opportunity.

On the other hand, in References 2 and 3 in which the attention of infants, cats, dogs, and the like is directed to the imaging device by voice, light emission, and movement of objects, photographing can be performed while viewing the liquid crystal display.
However, in any of the cited documents 1 to 3, the photographer determines whether or not the camera is looking at the camera. The photographer has to depend on the sense and experience of the photographer and does not miss the shutter chance. It is not easy to shoot in

In the cited document 4 which digitally analyzes the image data of the subject to determine the direction of the subject's line of sight, it is automatically determined whether or not the subject is looking at the camera without depending on the sense and experience of the photographer. You can judge accurately and take pictures while watching the LCD.
However, it is necessary for the photographer to perform an action that draws the attention of the subject such as calling the photographer to “turn to here” or sounding a toy (for example, rattle), and it is difficult to photograph. In particular, it does not function effectively for a subject that does not show any reaction to the photographer's call, and further requires props such as toys.
Also, although the camera line of sight is determined electronically, the shooting operation of the release switch (release operation) must be performed by the photographer himself, and shooting with the camera line of sight cannot always be performed at the right time. There is a risk of missing an opportunity.

  An object of the present invention is to provide an imaging apparatus that can perform photographing from the viewpoint of a camera with good timing.

  According to the first aspect of the present invention, the imaging device has an imaging means for acquiring an image from the subject, and generates a change signal in a predetermined pattern from the imaging device in the subject direction to alert the subject. Shooting operation by controlling change signal generating means for urging reaction to change signal and signal generation pattern of change signal generating means, detecting the direction of the face of the subject from the image signal from the imaging means, and determining the camera line of the subject And control means for controlling.

  According to the second aspect of the present invention, the imaging apparatus is configured to acquire an image from the subject, and to generate a change signal in a predetermined pattern from a plurality of positions of the imaging device in the subject direction. Change signal generating means for prompting a response to the change signal, and the signal generation pattern of the change signal generating means are controlled, and the orientation of the face of the subject is detected from the image signal from the imaging means, and the direction of the imaging device is detected. Control means for determining whether or not the face is facing, and when determining that the face is facing, control means for controlling the shooting operation by determining the camera line of the subject from the deviation of the center position of the left and right black eyes with respect to the line of the nose of the subject It is equipped with.

  According to the third aspect of the present invention, if the camera line of sight is within a predetermined range, the control unit determines that the camera line of sight is a camera line and performs control so that the photographing operation is automatically performed.

  According to the fourth aspect of the present invention, the change signal generating means has a display provided on the front surface of the imaging device, and generates an optical signal that changes on the screen of the display.

  According to the fifth aspect of the present invention, the change signal generating means generates the change signal from a plurality of positions on the front surface of the imaging apparatus.

  According to the present invention of claim 6, the imaging device generates a plurality of different change signals to alert the subject and prompt a reaction to the change signal, and among the plurality of signal changes, And a control unit that detects a signal change that has the most alerting effect on the subject and controls the change signal generating unit to repeatedly generate the signal change that has the most alerting effect.

  According to the seventh aspect of the present invention, the control means determines the effect of alerting the subject according to the movement of the subject's eyes corresponding to the change signal.

  According to the first aspect of the present invention, the subject's attention is alerted by generating a change signal, and it is not necessary for the photographer himself to perform the action of alerting the subject, and the inclination of the face in response to the change signal. Thus, the camera line of sight is determined under the control of the control means, and the camera line of sight can be accurately determined. Since the photographing operation is controlled by the control means, the photographing operation can be performed in a timely manner by performing the photographing operation when it is determined that the camera is looking at the camera, and a photo opportunity is not missed.

  According to the second aspect of the present invention, the subject's attention is alerted by generating a change signal, and it is not necessary for the photographer himself to perform the action of alerting the subject, and the inclination of the face in response to the change signal. And the camera line of sight is determined under the control of the control means from the deviation of the center position of the black eye based on the inclination of the face, and the camera line of sight can be accurately determined. Since the photographing operation is controlled by the control means, the photographing operation can be performed in a timely manner by performing the photographing operation when it is determined that the camera is looking at the camera, and a photo opportunity is not missed.

  According to the third aspect of the present invention, if it is within an allowable range of a predetermined range, it is determined that the camera is looking at the camera, and the shooting operation is automatically performed. There is no.

  According to the fourth aspect of the present invention, the light emission pattern that generates the light signal that changes on the screen of the display is controlled by the control means, and the light signal is generated under various light emission patterns, so that the attention of the subject is enhanced. Can be aroused.

  According to the fifth aspect of the present invention, change signals are generated from a plurality of positions, and the change signal generation pattern is controlled by the control means to generate an optical signal under various light emission patterns. Can be a powerful reminder.

  In the present invention, the subject's attention is alerted by generating the change signal, and the photographer does not need to perform the action of alerting the subject, and generates a plurality of different change signals. Since the signal change that has the most alerting effect is detected and repeatedly generated, the subject can be surely directed toward the photographer, and shooting can be performed without missing a photo opportunity.

  According to the seventh aspect of the present invention, the effect of alerting the subject is determined according to the eye movement of the subject in response to the change signal, and shooting is performed without missing a photo opportunity at the timing when the subject faces the direction of the photographer. it can.

1 is a schematic block diagram of a main part of an imaging apparatus according to an embodiment of the present invention embodied as a digital camera. A scene of shooting when a subject is a baby is shown. (A) is a schematic perspective view of the digital camera from the front, and (B) and (C) are schematic views of the digital camera from the top. (A) and (B) show a schematic view and an analysis view in a state where the face of the subject (baby) is not facing the photographer (imaging device). (A) and (B) are a schematic view and an analysis view in a state where the face of the subject (baby) faces the photographer (imaging device), respectively. (A) and (B) are schematic diagrams for determining the line of sight of the subject (baby), respectively. A schematic diagram of the subject (baby) faced toward the photographer (imaging device) and his eyes also looking at the photographer (imaging device) is shown. An example of the flowchart of imaging | photography control by the digital camera of this invention is shown. 9 shows a subroutine for the optimum eye line condition (S106 in FIG. 8). The subroutine of the optimal line of sight (S107 in FIG. 8) is shown. (A) and (B) respectively show schematic perspective views of another embodiment (embodiment 2) of the present invention embodied as a digital camera. 6 shows an example of a flowchart of imaging control in Embodiment 2. The schematic perspective view of other Example (Example 4) of this invention actualized as a digital camera which uses not an optical signal but an audio | voice signal as a change signal generation means is shown. The schematic perspective view of Example 4 of this invention embodied as a digital camera is shown. (A)-(C) show the modification which used the liquid crystal display of the digital camera back surface as a touch panel, (A), (B) shows the back view of a digital camera, (C) shows a schematic perspective view, respectively.

  The imaging device includes an imaging unit that acquires an image from a subject, a change signal generation unit that generates a change signal in a predetermined pattern in the subject direction from the imaging device to alert the subject and prompt a reaction to the change signal. And control means for controlling the signal generation pattern of the change signal generating means, detecting the face direction of the subject from the image signal from the imaging means, determining the camera line of the subject, and controlling the photographing operation. .

Hereinafter, an embodiment (Example 1) of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a schematic block diagram of the main part of an imaging apparatus according to an embodiment of the present invention embodied as a digital camera.
As shown in FIG. 1, a digital camera (imaging device) 10 includes an imaging unit 12, a control unit (central control circuit) 14, a display unit 16, a recording unit (memory) 18, a time measuring unit (clock) 20, and a communication unit 22. , Operation determination means 24, change signal generation means 26, switch group 28, and the like.

  The imaging unit 12 includes an imaging element such as a photographing lens 12a (see FIG. 2A), a CCD, and a CMOS sensor. An image from a subject is formed on the imaging element via the photographing lens, and is subjected to photoelectric conversion. It is output to the central control circuit 14. The central control circuit 14 performs necessary image processing such as color and gradation correction and compression processing. For example, the JPEG format is used for still images, and H.264 is used for moving images. It is converted into an image file in the H.264 format and recorded in a recording means (memory) 18 such as a flash memory. The time measuring means (clock) 20 measures the shooting date and time, and the date and time information is recorded in the memory 18 together with the shot image, so that the shot images are recorded in order and can be easily searched.

  In order to confirm the composition and timing of shooting prior to shooting, the image signal from the imaging unit 12 is displayed on the display unit 16 as a live view image (through moving image). Further, not only the live view image before photographing but also the image signal in the memory 18 are displayed on the display means 16 after being processed by the central control circuit 14 for reproduction. The display means 16 is formed from a liquid crystal display (LCD), an organic EL display, or the like, and is provided on the back surface of the digital camera 10.

  A central control circuit (control means) 14 that processes a captured image from the image pickup means 12 includes, for example, a CPU, an MPU, and the like, and includes a face detection unit 14a, a line of sight detection unit 14b, a condition setting unit 14c, and a shooting control unit 14d. The camera line of sight is determined, the operation of the switch group 28 is detected, and the constituent members are controlled according to a predetermined control program.

  The subject image formed on the image sensor, photoelectrically converted and output to the central control circuit 14 is subjected to necessary image processing such as color and gradation correction and compression processing in the central control circuit. The face detection unit 14a analyzes image data of a subject that has been subjected to color correction, image processing, and the like, and determines whether or not there is a subject such as a person or pet (hereinafter referred to as “person or the like” as appropriate). If there is a person or the like, the direction or length of the face is determined, and the eye detection unit 14b detects the eye of the subject from the face direction or length determined by the face detection unit 14a. .

  In the condition setting unit 14c, based on the orientation and length of the face determined by the eye-line detection unit 14b, in what state the orientation and length of the face are, the subject's eyes are facing the imaging device. A condition for determining whether or not the eye of the subject is the camera eye is set. The imaging control unit 14d determines whether the line of sight detected by the line of sight detection unit 14b satisfies the condition set by the condition setting unit 14c, and controls the constituent members according to a predetermined control program.

  The communication unit 22 includes a USB terminal, a wireless transmission / reception unit, and the like. The captured image data recorded in the memory 18 is output to an external display unit such as a TV or another imaging device via the communication unit. Captured image data recorded in another imaging device is input via the communication means.

  The operation determination unit 24 detects a photographer's operation such as operation of a power switch (power switch) for setting a shootable state, operation of a release switch, selection of a shooting / playback mode, and the detection result is output to the central control circuit 14. Then, processing corresponding to the switch operation is performed under the control of the central control circuit.

  The change signal generator 26 generates a change signal for directing the subject's eye toward the imaging device. For example, a change signal such as an optical signal or an audio signal is generated toward the subject by the first release of the release switch. The The clock (timer means) 20 has a timer function, and the time when the change signal of the change signal generator 26 is generated is counted by the clock, and the generation of the change signal is controlled by the central control circuit 14. When a switch for the change signal generating means 26 is provided and the switch is turned on, the change signal may be generated for a predetermined time.

  The switch group 28 includes a power switch (power switch), a release switch, a menu key, an enter key (OK key), a mode key, and the like. When the switch is operated, the operation determination unit 24 detects the switch operation. Processing corresponding to the switch operation is performed under the control of the central control circuit 14.

  The image captured from the camera line of sight and recorded in the memory 18 is reproduced by the central control circuit 14 and displayed on the liquid crystal display (display means) 16 on the back of the digital camera. It is confirmed. The captured image can be reproduced and displayed by connecting the digital camera 10 to an external display means such as a TV via the communication means 22.

  FIG. 2 shows a scene of shooting when the subject is a baby. The subject (baby) is acting without being aware of the photographer (mother) holding the digital camera 10, and the photographer (that is, The face is not directed toward the imaging device), and the eyes are not directed toward the photographer.

3A is a schematic perspective view of the digital camera from the front, and FIGS. 3B and 3C are schematic views of the digital camera from the top.
As shown in FIG. 3A, the change signal generating means 26 is a light emitting member disposed on the front surface of the digital camera 10, and is, for example, nine LEDs (light emitting diodes) juxtaposed horizontally.

  A series of LEDs (change signal generating means) 26, which are light emitting members, send signals (light signals) that change so as to draw the attention of the subject (baby) and point the face and eyes toward the photographer (mother). Is configured to occur. For example, when viewed from the photographer, the leftmost LED 26-1 is first turned on, then the LED is turned off, the right adjacent LED 26-2 is turned on, and the LEDs are sequentially turned on and off from the left end toward the right end. An optical signal that changes due to the change of the LED to be emitted is emitted. When the right end LED 26-9 is turned on after reaching the right end, the LED 26-9 may be turned off, and the LEDs 26-1 to 26-9 may be turned on and off repeatedly toward the left end. The LEDs 26-8 to 26-1 may be sequentially turned on and off from the right to the left.

The above is an example, and various generations of change signals by the LED 26 are conceivable in addition to the above. For example, in the above example, lighting and extinguishing are repeated, but the LEDs 26-1 to 26-26 are not extinguished from the left end to the right end. -9 may be turned on one by one and then turned to the right end toward the left end, or returned to the left end and turned off one by one. Further, instead of lighting one by one, two LEDs may be lit.
Further, LEDs having different emission colors may be used. For example, nine LEDs 26-1 to 26-9 are made of three combinations of three colors such as red, blue, yellow, red, blue, yellow, red, blue, yellow, and red LEDs 26-1, 26-4, 26. -7, blue LED 26-2, 26-5, 26-8, yellow LED 26-3, 26-6, 26-9 may be turned on (turned off) for each set.
In any case, a plurality of signal generation patterns are recorded in the central control circuit 14 in advance, the LED 26 emits light based on each signal generation pattern, and a changing light emission signal is generated toward the subject.

  For example, when a series of LEDs 26 (26-1 to 26-9) are lit so as to run from a predetermined signal generation pattern left to right (or from right to left), the subject (baby) notices this and the photographer Turning the face in the direction, for example, if looking at the leftmost LED 26-1, as shown in FIG. 3B, the eye is shifted to the left (reference), and if looking at the rightmost LED 26-9, FIG. Move to the right as shown in C). However, since the digital camera 10 is not so large and the distance between the mother (photographer) and the baby (subject) is large compared to the size of the digital camera 10, if the subject is looking at one of the LEDs 26 (the baby's If the line of sight is in the LED), it may be considered that it is just a little off and is in the camera's line of sight.

Moreover, even if the baby is looking at the mother (more precisely, the mother's face) without looking at the change signal generation means (LED) 26 of the digital camera, the mother is close to the digital camera 10, that is, the LED. The baby's eyes are only slightly offset, and the eyes of the baby looking at the mother can be considered as the camera.
In any case, it is not necessary to consider whether or not it is a camera line of sight, and it is only necessary to determine the camera line of view with a predetermined range as an allowable range.

  The detection of the face of the subject by the face detection unit of the central control circuit will be described with reference to FIGS. 4 (A) and 4 (B) are schematic views and analysis diagrams in a state where the face of the baby (subject) is not directed toward the digital camera 10, that is, the photographer (mother). B) shows a schematic view and an analysis view of the state facing the photographer.

  As shown in FIG. 4A, assuming that the face of the baby (subject) is not facing the direction of the mother and is tilted, the up and down direction (Y direction) and the left and right direction (X direction) of the tilted face Consider the Y-axis and X-axis passing through the center O on a tilted surface. As shown in FIG. 4B, the Y axis is shifted by θ with respect to the vertical line V passing through the center O, and the nose muscle line Y1 (a line parallel to the Y axis and along the nose muscle) is X with respect to the Y axis. The direction is shifted by ΔX. Regardless of the inclination of the face, the X-axis is at a position F / 2 with respect to the face length F, and the eyes are shifted by ΔY in the face length direction (Y-axis direction).

  On the other hand, as shown in FIG. 5 (A), if the baby is in the exact camera line of sight of the mother without tilting her face, the vertical line V passing through the center O of the face as shown in FIG. 5 (B). The nose muscle line Y1 coincides with the Y axis, and the deviation of the nose muscle line Y1 from the Y axis (ΔX = 0) is eliminated. However, it does not change that the eye position is shifted from the X axis by ΔY.

  4B and 5B, if the baby's face is facing the mother (in the direction), the deviation ΔX of the nose muscle line Y1 with respect to the Y axis, and the inclination θ of the vertical line V Becomes zero, and the orientation of the baby's face can be determined from the deviation ΔX of the nose line Y1 and the inclination θ of the vertical line V. However, since the deviation ΔX of the nose muscle line Y1 depends on the distance of the subject with respect to the mother, similarly, by dividing by the length F of the baby's face that depends on the distance of the baby, normalization is performed by removing the distance dependence and ΔX The direction of the baby's face is determined from / F and the inclination θ of the vertical line V.

  If ΔX / F (shift of nose line Y1 / face length) and inclination θ of vertical line V are zero, the baby's face is pointed at the mother. However, if a certain amount of deviation is allowed and ΔX / F and θ are within predetermined ranges (allowable ranges), the baby's face is handled as being directed toward the mother.

  The face detection unit 14a detects the face outline (the size and position of the face part), and detects the deviation of the nose line Y1 with respect to the Y axis and the inclination θ of the vertical line V from the face outline. Then, whether or not the detected value satisfies a condition set in the condition setting unit 14c (a condition allowing a certain amount of deviation; a condition considering an allowable range) is determined by the imaging control unit 14d, and the baby (subject) It is determined whether or not his / her face is facing the mother's direction (photographer direction).

FIGS. 6A and 6B are schematic diagrams for determining the eye of the subject (baby), respectively.
Since the Y axis and the X axis passing through the center O in the vertical direction (Y direction) and the horizontal direction (X direction) of the face when the face is not inclined are considered, the Y axis is the nose muscle line Y1 and the vertical line V. And the center line of the face in the vertical direction. A deviation ΔX ′ in the center position of the black eye of the left and right eyes with respect to the nose line Y1 (also the Y axis and the vertical line V) is detected, and if the deviation ΔX ′ in the center position of the black eye is zero, the subject is the photographer. You are looking at the (imaging device), and you are at the camera. The deviation ΔX ′ of the center position of the black eye is detected by the eye-line detection unit 14b. As shown in FIG. 6A, a negative value is obtained when the eye is shifted to the right (as viewed from the subject), and as shown in FIG. Since it becomes a positive value if it is to the left, the absolute value is used as a reference.

  Since the deviation ΔX ′ of the center position of the black eye also depends on the distance, it is normalized by dividing by the face length F. That is, (.DELTA.X'.vertline. / F) is calculated, and whether the value of (.vertline..DELTA.X'.vertline. / F) detected by the line-of-sight detection unit 14b satisfies the condition of the condition setting unit 14c is determined. To determine whether or not the camera is at the camera.

  FIG. 7 shows a schematic view of the baby (subject) faced toward the mother (photographer) and the eyes looking at the mother. In this schematic diagram, there is no inclination of the face of the subject (θ = 0), and there is no deviation of the center position of the black eye (ΔX ′ = 0), which is shown as an ideal camera line of sight and can be said to be a complete camera line of sight. . Although shooting with such a perfect camera gaze is preferable, such a perfect camera gaze is not easily obtained, and always taking with a perfect camera gaze is not interesting, so a certain tolerance is required. It is better to consider the camera's gaze.

FIG. 8 shows an example of a flowchart of photographing control by the digital camera of the present invention. FIGS. 9 and 10 show subroutines for the optimum eye condition (S106) and the optimum eye line (S107), respectively.
First, in FIG. 8, the operation state of the power switch (power switch) is determined in S101, and if the power switch is not operated (if it is off), the process is terminated. If the mode is determined and the shooting mode is not selected, the process branches to S111.

  In S111, the playback mode is determined. If the playback mode is not selected, the process returns to S101. If the playback mode is selected, the photographed image recorded in the memory 18 is selected in S112 and displayed (displayed) on the display means 16, for example, a liquid crystal display. Is done. In step S113, it is determined that the reproduction has been completed. If the reproduction is to be continued, the process returns to S112 to reproduce the next image, and if the reproduction is to be completed, the process returns to S101.

  If it is determined in S102 that the shooting mode is selected, an image is formed on the image sensor of the image pickup means 12 and captured in S103. When the release switch is released for the first time, the image of the subject is determined in S104, the portion determined to be the subject's face is focused and exposure is controlled, and the live view image is displayed on the liquid crystal display 16 in S105.

  In S106, the condition (optimal eye line condition) set in the condition setting unit 14c is determined, and the process proceeds to the subroutine of FIG. In FIG. 9, first, in step S201, a series of LEDs 26-1 to 26-9, which are change signal generating means, are lit (emitted) with a predetermined light emission pattern, and a change signal is generated to alert the subject. For example, the change signal generating means 26 is turned on by the first release of the release switch to generate a change signal.

  In step S202, a response (change) of the subject is detected with respect to the change signal. That is, the detection element of the face orientation (1) the deviation ΔX of the nose muscle line Y1 in the X-axis direction, (2) the eye deviation ΔY in the length direction of the face (Y-axis), (3) The inclination (deviation of the Y axis with respect to the vertical line V passing through the center O) θ, (4) the face length F is detected by the face detection unit 14a (see FIGS. 4 and 5).

  Until the predetermined time elapses, the LEDs 26-1 to 26-9 are lit (emitted) with a predetermined light emission pattern (S203). For example, if one LED is lit for 1 sec, the time for detecting ΔX and the like after the LED is lit is set to 9 sec in the light emission pattern for emitting nine LEDs. When a predetermined time (9 sec) elapses, the response of the subject to another light emission pattern is detected. That is, the presence or absence of another light emission pattern is determined in S204, the change signal generating means (LEDs 26-1 to 26-9) are turned on in another light emission pattern in S205 to alert the subject, and the process returns to S202 to be different. A reaction of the subject to the light emission pattern is detected. The LEDs are emitted for all the light emission patterns recorded in the central control circuit 14, and the reaction of the subject is detected each time.

  When the response of the subject to all the light emission patterns is detected, the light emission pattern showing the largest change (response) is determined in S206, and the subroutine is terminated.

  Returning to FIG. 8 from the optimum eye line condition subroutine of FIG. 9, the process proceeds to S107, and the optimum eye line, that is, the camera eye line is determined in S107. Referring to the subroutine of the optimum eye line in FIG. 10, the LEDs 26-1 to 26-9 emit light in S221 with the light emission pattern determined to have the largest reaction (change) of the subject in S206 in FIG. For example, when the lighting of 9 sec) is confirmed, a shift ΔX ′ of the center position of the black eyes of the left and right eyes with respect to the nose muscle line Y1 is detected in S223 (see FIG. 6). If ΔX ′ is within a predetermined range, it is determined that the camera is looking at the camera, and the process branches to Y in S107. If ΔX ′ is not within the predetermined range, the response to the predetermined light emission pattern is switched to the response to the light emission of the specific LED. The specific LED is usually the central LED 26-5, and the central LED 26-5 is lit in S224.

  The number of LEDs 26 is normally an odd number, and is nine in the embodiment as shown in FIG. However, if it is an even number (for example, 8), the LED near the center (the fourth or fifth LED from the left or right end) emits light.

  In S225, the central LED 26-5 emits light (flashes) at a predetermined time, for example, at an interval of 1 sec, and the deviation ΔX ′ of the center position of the black eye with respect to the light emission is detected in S226 to determine whether or not it is within the predetermined range. Is done. If ΔX ′ is within a predetermined range, it is determined that the camera is looking at the camera, and branches to Y in S107 of FIG. 8. If it is not within the predetermined range, it is determined that the subject does not respond to the light emission of the LED (not at the camera). The process branches to N in S107.

  Returning to FIG. 8 from the subroutine of the optimum line of sight in FIG. 10, if it is determined that the line of sight is the camera, the process proceeds from S107 to S122, the release switch is automatically released (2nd release), and the liquid crystal display is displayed in S123. (Display means) The live view image of 16 is recorded in the memory (recording means) 18 together with image data such as the shooting date and time. When the automatic shooting is finished, the process returns to S101.

  If it is determined that the camera is not at the camera, the process proceeds from S107 to S121, and whether or not shooting is possible is determined at S121. If the photographer determines that the camera is not at the camera, the photographer releases the release at S122. The switch is photographed with 2nd release, and the live view image on the liquid crystal display 16 is recorded in the memory 18 together with image data such as the photographing date and time.

As described above, according to the present invention, the attention of the subject is alerted by generating the change signal, and it is not necessary for the photographer himself to perform the action of alerting the subject. The inclination is detected, and the camera line of sight is determined under the control of the control means from the deviation of the center position of the black eye based on the face inclination, and the camera line of sight can be accurately determined. Since the operation of the release switch is controlled by the control means, by operating the release switch when it is determined that the line of sight is the camera, shooting with the line of sight of the camera can be performed with good timing, and a photo opportunity is not missed.
Further, it is possible to take a picture while looking at the display means on which the live view image is displayed, and it is not necessary to check the composition while looking through the viewfinder.

Since the detection of the tilt of the face (face angle) of the subject and the determination of the camera line of sight are performed in consideration of the allowable range, shooting with the camera line of sight can be performed with good timing, and a photo opportunity is not missed.
Further, the present invention is not limited to automatic shooting from the viewpoint of the camera. If the subject does not react to the change signal, shooting can be performed based on the judgment of the photographer, and shooting that does not stick to the camera's line of sight can be performed.

  The camera gaze may be judged from the tilt of the face in response to the change signal without judging the camera gaze from the deviation of the center position of the black eye. In this case, the accuracy of the camera gaze is inferior, but the photo opportunity is missed. This makes it easy to shoot from the camera's point of view.

  If a configuration is adopted in which a change signal is generated from a plurality of positions by providing a plurality of LEDs on the front surface of the digital camera 10, the change signal generation pattern is controlled by the control means, and light is generated under various light emission patterns. Signals can be generated, and the subject's attention can be strongly evoked under various light emission patterns.

11A and 11B are schematic perspective views of another embodiment (embodiment 2) of the present invention embodied as a digital camera. The configuration of the change signal generating means is different between the above-described embodiment (embodiment 1) and this embodiment 2, and the other configurations are common to the embodiments 1 and 2.
That is, the change signal generating means is composed of a plurality of LEDs in the first embodiment, whereas in the second embodiment, a display 26 ′ composed of a liquid crystal display (LCD), an organic EL display or the like is provided on the front surface of the digital camera 10. It is provided as change signal generation means.

  In FIG. 11A, for example, a light spot (bright spot) 26a moves randomly on a plane defined by the X axis and the Y axis on the screen of a display 26 'formed of a liquid crystal display, with the light trace 26b as an afterimage. Produces a changing signal. The light spot 26a randomly moves on the plane defined by the X-axis and the Y-axis on the screen of the liquid crystal display 26 ', thereby attracting the attention of the subject and prompting the reaction of directing the subject's face toward the liquid crystal display 26'. .

  In FIG. 11B, not a light spot (bright spot) but a surface, for example, a rectangular frame surface 26c is randomly selected, for example, in the upper left direction of the liquid crystal display 26 'when viewed from the subject, from a large surface to a small surface. A signal that changes as a result of the change is generated. As the frame surface 26c changes its size, the frame surface 26c randomly moves along the plane defined by the X-axis and Y-axis, thereby attracting the attention of the subject and prompting a reaction to turn the subject's face toward the liquid crystal display 26 '. . Of course, it may change from a large surface to a small surface and then from a small surface to a large surface.

  The movement of the light spot 26 a and the movement of the frame surface 26 c are controlled by the central control circuit 14. In a configuration in which a change signal is generated by randomly moving a light spot on the screen of a display 26 'such as a liquid crystal display or an organic EL display, and a frame surface defined by the X axis and the Y axis, the central control circuit 14 Under control, the light emission pattern of the change signal can be set almost innumerable, and the color can be changed while changing the light trace.

  FIG. 12 shows an example of a flowchart of imaging control in the second embodiment. To describe the light spot of the light spot 26a and the frame surface 26c, first, the light emission position of the light spot is initially set in S301. For example, the center (X = 0, Y = 0) of the change signal light emitting means (liquid crystal display) 26 ′ is set as the initial position of the light spot. Next, the light spot moves while emitting light in either the X-axis direction or the Y-axis direction, for example, the X-axis direction.

In S303, it is determined whether or not a predetermined condition is satisfied. The predetermined condition here refers to the optimum eye line condition and the optimum eye line condition in S106 and S107 of the first embodiment. However, in the second embodiment, these conditions are generally relaxed compared to the first embodiment, and the liquid crystal is used even if the subject does not look at the light spot on the screen of the liquid crystal display 26 ′ (and its surrounding area, which is an allowable range). If you are looking at the screen of the display, it is determined that you are looking at the camera. That is, a larger allowable range is set.
If the predetermined condition is satisfied, the process proceeds to S307, where the shutter is automatically released and the automatic shooting is performed. In S308, the image is recorded in the memory 28 together with the date and other data, and the process ends.

When a predetermined time elapses after the light spot changes its direction (S304), the presence or absence of positions in the X-axis direction that have not yet emitted light is determined in S305, and if all the positions are emitted, the image is taken in S305. If the photographer decides whether or not to take a picture without looking at the camera, the photographer takes a release operation in S307, and in S308, the image is recorded in the memory 28 together with the date and other data. finish.
If the photographer selects shooting from the camera viewpoint in S305, the process returns to S302 to search for shooting from the camera viewpoint.

  If there is an unlighted position in S305, the process branches to S311 to determine whether or not the movement in the X-axis direction is possible. If there is room to move in the X-axis direction without reaching the left and right ends of the liquid crystal display, Return to S302. If the left and right ends have been reached and there is no room to move in the X-axis direction (if there is no non-light emitting position on the X-axis), the shift is made in the Y-axis direction in S312. In step S313, the position in the X-axis direction is initialized, and the process returns to step S302.

As described above, also in the second embodiment, the change signal is generated to alert the subject, the inclination of the face of the subject is detected from the reaction, and the camera line of the subject is determined from the position of the eye. Automatic shooting is possible, and you can shoot from the camera without missing a photo opportunity.
In particular, since various light emission patterns can be obtained, the attention of the subject can be repeatedly aroused by various light emission patterns to promote a reaction.

In the first and second embodiments, the change signal generating means generates a changing optical signal, appeals to the sight of the subject, draws attention of the subject, and prompts the reaction. However, it suffices to raise the attention of the subject by issuing a signal that changes, and to turn the face toward the photographer, that is, the digital camera 10, and the change signal generated by the change signal generating means is not limited to an optical signal. .
FIG. 13 shows a schematic perspective view of another embodiment (embodiment 3) of the present invention embodied as a digital camera using an audio signal instead of an optical signal as a change signal generating means. Needless to say, the configurations of the change signal generating means are different between the first and second embodiments and the third embodiment, and other configurations are common.

As shown in FIG. 13, a speaker 26 ″ as a change signal generating means is built in the digital camera 10. For example, one speaker is arranged on each of the left and right. However, the arrangement and number of speakers (change signal generating means) 26 ″ are not limited to this. For example, one speaker may be arranged in the center of the digital camera in the left-right direction (X-axis direction).
In this way, by generating an audio signal through a speaker, the subject's attention is alerted, and the camera's gaze is determined by detecting the tilt (face angle) of the subject's face from the reaction. Automatic shooting can be performed.
Needless to say, the audio signal corresponds to the change signal.

In order to call attention to the subject by generating a change signal, the change signal generating means is a light emitting member such as LEDs 26-1 to 26-9 that generates a change optical signal in the first and second embodiments, or a liquid crystal display. A display such as an organic EL display is used, and in Example 3, a sound generating member such as a speaker is used. However, a device that generates changing light (optical signal generating means) and a device that generates sound (audio signal generating means) may be used in combination.
FIG. 14 is a schematic perspective view of a fourth embodiment of the present invention embodied as a digital camera. Here, LEDs 26-1 to 26-9 (light signal generating means) are placed on the front surface of the digital camera 10 on the photographing lens 12a. ) Are arranged in the left-right direction, and speakers (audio signal generating means) 26 ″ are arranged one by one on the left and right.

  By combining the optical signal generating means and the audio signal generating means that change in this way into a change signal generating means, it is possible to generate only an optical signal, only an audio signal, both an optical signal and an audio signal. A signal generation pattern is obtained. For this reason, it is possible to select a signal generation pattern that the subject is likely to be interested in, or to execute each signal generation pattern in a medley, so that the subject's attention can be strongly evoked. In addition, a wide range of automatic shooting from the camera perspective.

  In the first to fourth embodiments, the light emission of the LED and the output of the sound are generated by a switch operation such as the first release of the release switch, and are automatically switched and changed in a pattern prerecorded in the central processing circuit. ing. FIGS. 15A to 15C show a modification in which the liquid crystal display on the back of the digital camera is a touch panel, and a change signal is generated when the photographer operates the touch panel. That is, as shown in FIGS. 15A and 15B, if the photographer slides the finger left and right (see FIG. 15A) or up and down (see FIG. 15B) while touching the touch panel, In response to the movement of the finger, for example, as shown in FIG. 15C, LEDs 26 (26-1 to 26-9) on the front surface of the digital camera emit light in a predetermined pattern to generate a change signal.

  Changes in the orientation of the subject's face and changes in the line of sight corresponding to the change signal generated by the photographer's operation on the touch panel are detected by the face detection unit 14a and the line of sight detection unit 14b, causing a signal change that exhibits the greatest response. A signal is repeatedly generated in a pattern.

  Of course, not only the LED, but also the pitch and volume of the sound, or the generation pattern and its frequency may be changed by the operation of the touch panel. In this case, control may be performed such that the volume of the sound is changed by the movement as shown in FIG. 15A and the sound generation pattern is changed by the movement as shown in FIG.

  As described above, according to the present invention, first, the photographer performs the action of calling the attention of the subject according to the situation, and the camera gaze is determined without performing the actual photographing timing determination by the photographer himself. By controlling the shooting when it is determined that the camera is looking at the camera, shooting with the camera looking can be performed without missing a photo opportunity. For this reason, the photographer only has to concentrate on alerting the subject.

The above-described embodiments are for explaining the present invention, and are not intended to limit the present invention. All modifications, alterations, etc. within the technical scope of the present invention are included in the present invention. Needless to say.
For example, in the embodiment, the imaging device is embodied as a digital camera, but the imaging device that is the subject of the present invention is not limited to a digital camera. For example, a digital video camera, a mobile phone having a digital camera function, A mobile tool with a digital camera such as a notebook computer is also included in the imaging apparatus referred to in the present invention.

  The present invention can be widely applied to an imaging apparatus such as a digital camera having display means such as a liquid crystal display.

10 Digital camera (imaging device)
12 imaging means 12a taking lens 14 central control circuit (control means)
14a to 14d Face detection unit, eye detection unit, condition setting unit, photographing control unit 16 Liquid crystal display (display means)
18 Memory (Recording means)
20 clock (clocking means)
22 communication means 24 operation determination means 26 change signal generation means 26-1 to 26-9 LED (change signal generation means)
26 'display (change signal generating means)
26 '' speaker (change signal generating means)
28 switches

Claims (7)

Imaging means for acquiring an image from a subject;
A change signal generating means that generates a change signal in a predetermined pattern from the imaging device in a predetermined direction to alert the subject and prompt a reaction to the change signal;
Control means for controlling the signal generation pattern of the change signal generating means, detecting the face direction of the subject from the image signal from the imaging means, determining the camera line of the subject, and controlling the photographing operation;
An imaging apparatus comprising: Imaging means for acquiring an image from a subject;
Change signal generating means for generating a change signal in a predetermined pattern from a plurality of positions of the imaging device in a predetermined pattern to call attention to the subject and prompt a reaction to the change signal;
Controls the signal generation pattern of the change signal generation means, detects the orientation of the face of the subject from the image signal from the imaging means, determines whether or not the face is directed toward the imaging device, and turns the face Control means for determining the camera line of the subject from the shift of the center position of the left and right black eyes with respect to the line of the nose of the subject, and controlling the shooting operation;
An imaging apparatus comprising: The imaging device according to claim 1 or 2, wherein the control means performs control so that the camera operation is automatically performed by determining that the camera line of sight is within a predetermined range. The imaging apparatus according to claim 1, wherein the change signal generating unit has a display provided in front of the imaging apparatus and generates an optical signal that changes on a screen of the display. The imaging apparatus according to any one of claims 1 to 3, wherein the change signal generating means generates a change signal from a plurality of positions on the front surface of the imaging apparatus. A change signal generating means for generating a plurality of different change signals to alert the subject and to react to the change signals;
A control unit that detects a signal change that has the most alerting effect on the subject among a plurality of signal changes and controls the change signal generating unit to repeatedly generate the signal change that has the most alerting effect When,
An imaging apparatus comprising: The imaging device according to claim 6, wherein the control means determines the effect of alerting the subject according to the eye movement of the subject corresponding to the change signal.

Images