JP2007123953A - Imaging apparatus and imaging method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus and an imaging method that detect moving body information and start a timer until releasing a shutter by motion detection. <P>SOLUTION: A moving body detector 12 detects the motion of an image outputted by a sensor 11 for outputting the moving body information. A shutter determination section 13 determines whether there is motion based on the moving body information, and initializes the timer 14 when there is the motion. The timer 14 counts a preset prescribed time for outputting a completion signal when the count is completed. The shutter determination section 13 receives the completion signal of the timer 14 for outputting a shutter start-up signal, and a shutter 16 receives the shutter start-up signal for releasing the shutter. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an imaging apparatus and an imaging method that automatically release a shutter.

  Conventionally, there has been a method of using a self-timer to release the shutter without pressing the shutter button of the camera body. In this method, for example, the user who is the photographer and the subject must go to the shooting point and pose facing the camera within the time from when the self-timer switch of the camera body is pressed once until the shutter is released. There wasn't.

  However, in this case, it is difficult for the user to know how long the shutter will be released after the self-timer switch is pressed, and the user has to go to the shooting point quickly, or the time until the shutter is released at the shooting point There was a disadvantage that it was necessary to do.

Conventionally, as a method of photographing a moving subject, there is a method in which the user predicts the motion of the subject and releases the shutter at the moment when the subject comes to a desired position on the screen.
However, in this case, when the movement of the subject is fast or when it is difficult to predict the movement, the user has to keep moving the camera following the subject, and there is a disadvantage that it is difficult to grasp the timing to release the shutter. It was.

In order to eliminate the above disadvantages, there is a technique for detecting a moving object from a captured image and automatically releasing a shutter based on this information.
However, when there are a plurality of subjects, a single moving object detection unit that detects a moving object can synchronize the timing with only one moving object. For example, when taking a group photo, all the members are not gathered. There was a disadvantage that the shutter was released.

  Further, as a method of releasing the shutter without pressing the shutter button of the camera body, there is a method of using a remote controller. However, in this case, if the subject himself / herself tries to use the remote control, there is a disadvantage that the shape of the subject's arm or hand becomes unnatural. Further, even if the shutter is released after a certain time from pressing the remote controller, there is a disadvantage that the inconvenience of having the remote controller remains the same.

In order to eliminate the disadvantages described above, for example, there is a technique disclosed in Patent Document 1 that obtains a motion vector from an image and starts a self-timer when the motion stops.
Further, for example, there is a technique disclosed in Patent Document 2 that activates a shutter when matching is obtained in comparison with a motion pattern stored in advance.

Japanese Patent Laid-Open No. 08-279945 JP-A-11-355640

However, since the technique disclosed in Patent Document 1 described above can cope only when the movement stops, there is a disadvantage that the image cannot be taken in the case of an object that continues to move.
Further, in the technique disclosed in Patent Document 2 described above, there is a disadvantage that the shutter is accidentally released when an object other than the subject existing in the screen moves in the same manner as the motion pattern stored by chance. is there.

  An object of the present invention is to provide an imaging apparatus and an imaging method for detecting moving body information and starting a timer until the shutter is released by motion detection based on the moving body information in order to eliminate the disadvantages described above.

  In order to achieve the above-described object, an imaging apparatus according to a first aspect of the present invention includes an imaging unit, a moving body detection unit that detects a moving body and outputs moving body information based on an image obtained by the imaging unit, and the moving body detection. Storage means for storing the moving body information detected by the means, a timer for outputting a timer completion signal after a predetermined time has elapsed since initialization, and the shutter activation signal based on the timer completion signal output by the timer. And a shutter determination means for outputting, and the shutter determination means initializes the timer when there is a movement of a moving object included in the moving object information stored in the storage means.

  Preferably, the moving body information includes at least one of the position, size, presence / absence of movement, and magnitude of movement of the moving body.

  More preferably, the shutter determination means outputs the shutter activation signal regardless of the timer completion signal output from the timer.

  More preferably, the shutter determination unit detects the number of movements of the moving body stored in the storage unit, and initializes the timer when the predetermined number of times is detected.

  More preferably, the shutter determination unit detects the start and end of movement of the moving body based on the moving body information stored in the storage unit, and initializes the timer according to the start or end of movement. To do.

  More preferably, the shutter determination means detects the magnitude of movement of the moving object based on the moving object information detected by the moving object detection means, and the magnitude of movement of the moving object becomes a predetermined magnitude. If the timer is reset, the timer is initialized.

  More preferably, the shutter determination unit initializes the timer when the movement of the moving body having a predetermined size or more is detected a predetermined number of times based on the moving body information stored in the storage unit.

  More preferably, the shutter determination unit is configured to detect the moving object when one point on the moving object is located at a predetermined point in the image captured by the imaging unit based on the moving object information stored in the storage unit. Initialize the timer.

  More preferably, the shutter determination unit detects the size of the moving body based on the moving body information stored in the storage unit, and the timer determines when the size of the moving body reaches a predetermined size. Is initialized.

  More preferably, the moving object detection means detects movements of a plurality of moving objects and outputs a plurality of moving object information, and the storage means stores the plurality of moving object information output by the plurality of moving object detection means. The shutter determination means detects the end of movement of the plurality of moving bodies based on the plurality of moving body information stored in the storage means, and initializes the timer when all of the plurality of moving bodies have finished moving. .

  More preferably, it further comprises a face area detecting means for detecting a face area of a person in the image picked up by the image pickup device, wherein the moving object detecting means detects a plurality of moving objects to detect a plurality of moving objects. Moving body information is output, the storage means stores the plurality of moving body information output by the plurality of moving body detection means, and the shutter determination means is based on the plurality of moving body information stored in the storage means. A moving body having a predetermined size within a certain range is extracted from a plurality of moving bodies with reference to the face area, and the timer is initialized when the moving body moves.

  More preferably, the shutter determination unit detects the number of movements of the plurality of moving objects stored in the storage unit, and initializes the timer when the predetermined number of times is detected.

  The imaging method according to the second aspect of the invention is a first step of photographing an image, and a second step of detecting moving body and outputting moving body information based on the video signal photographed in the first step. And a third step of storing the moving body information detected in the second step, and a timer is initialized when there is a movement of the moving body included in the moving body information stored in the third step. A fourth step of outputting a timer completion signal after a predetermined time has elapsed since the timer was initialized in the fourth step, and the timer outputting the timer in the fifth step. And a sixth step of outputting a shutter activation signal in response to the timer completion signal.

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device and imaging method which detect a moving body information and start the timer until it releases a shutter by motion detection based on this can be provided.

Hereinafter, embodiments of the present invention will be described.
<First Embodiment>
In the present embodiment, an imaging device that releases a shutter according to the presence or absence of motion will be described.
FIG. 1 is a block diagram of an imaging apparatus 1 according to the first embodiment.
As illustrated in FIG. 1, the imaging apparatus 1 includes a sensor 11, a moving object detection unit 12, a shutter determination unit 13, a timer 14, a storage unit 15, and a shutter 16.

The sensor 11 outputs incident light as an image (video signal). For the sensor 11, for example, a semiconductor element such as a CCD or a CMOS is used.
The moving object detection unit 12 performs a moving object detection process on the image output from the sensor 11 and outputs moving object information to the shutter determination unit 13.
The moving body information is information including at least one of the presence / absence of movement of the moving body, the magnitude (speed and direction) of the movement, the position of the moving body, and the size of the moving body.
The moving object detection processing method of the moving object detection unit 12 includes, for example, a background difference method, an inter-frame difference method, and an optical flow method, but the moving object detection processing method is not limited in the present invention.

In the first embodiment, the moving body information output from the moving body detection unit 12 always includes the presence or absence of movement.
Hereinafter, the moving body detection method of the moving body detection unit 12 will be described.

  As illustrated in FIG. 2, the moving object detection unit 12 calculates, for example, the difference between the n−1th frame and the nth frame of the image output from the sensor 11. Note that n is an arbitrary positive integer.

  As illustrated in FIG. 3, the moving object detection unit 12 determines that there is a movement when there is a difference between the (n−1) th frame and the nth frame, and outputs that there is a movement as moving object information. . When there is no difference, it outputs that there was no movement as moving body information.

  Note that the moving object detection unit 12 recognizes the difference as noise when the area where the difference between the (n−1) th frame and the nth frame in the image is less than a predetermined size, It is not determined that there was any movement. The predetermined size may be set in advance when the imaging apparatus 1 is manufactured, or may be arbitrarily set by the user.

The timer 14 is initialized by a shutter determination unit, which will be described later, and outputs a completion signal to the shutter determination unit 13 a predetermined time after the initialization.
The initial value of the timer may be set in advance when the imaging device 1 is manufactured, or may be set by the user.

The shutter determination unit 13 initializes the timer 14 based on the moving object information output from the moving object detection unit 12, receives a completion signal output from the timer 14 after a predetermined time, and outputs a shutter activation signal to the shutter 16.
That is, the shutter determination unit 13 initializes the timer when receiving the moving body information indicating that “there is a movement” output from the moving body detection unit 12. When the moving body information output from the moving body detection unit 12 indicates that “no movement”, the shutter determination unit 13 does nothing.
When the timer 14 is not used, the shutter determination unit 13 outputs a shutter activation signal as soon as the moving object information output from the moving object detection unit 12 is received. Whether or not to use the timer 14 can be set by the user using, for example, an input unit (not shown).

  Further, for example, the shutter determination unit 13 counts the number of times of movement, and initializes the timer 14 (outputs a shutter activation signal) or detects the start or end of movement when the predetermined number of times is reached. In accordance with these, it is possible to initialize the timer 14 (output a shutter activation signal).

The storage unit 15 stores the moving body information of all frames output from the moving body detection unit 12.
That is, the storage unit 15 stores a history of moving object information.
The shutter 16 receives the shutter activation signal output from the shutter determination unit 13 and releases the shutter.

Next, an operation example of the imaging apparatus 1 according to the first embodiment will be described.
FIG. 4 is a flowchart illustrating an operation example of the imaging apparatus 1 according to the first embodiment.

Step ST1:
The sensor 11 outputs an image to the moving object detection unit 12.
Step ST2:
The moving body detection unit 12 detects the movement of the image output from the sensor 11 in step ST1, outputs the moving body information to the shutter determination unit 13, and the storage unit 15 stores this.
Step ST3:
The shutter determination unit 13 determines whether or not there is a movement based on the moving body information. If there is, the process proceeds to step ST4, and if there is no movement, the process returns to step ST1.

Step ST4:
If the timer 14 is used, the process proceeds to step ST5. If the timer 14 is not used immediately, the process proceeds to step ST8.
Step ST5:
The shutter determination unit 13 initializes the timer 14.

Step ST6:
The timer 14 counts until a predetermined time set in advance is reached.
Step ST7:
When the count of the timer 14 ends and a predetermined time is reached, a completion signal is output to the shutter determination unit 13 and the process proceeds to step ST8, and when it has not ended, the process returns to step ST6.

Step ST8:
The shutter determination unit 13 receives the completion signal of the timer 14 in step ST7 and outputs a shutter activation signal.
Step ST9:
The shutter 16 receives the shutter activation signal and releases the shutter.

Next, an operation example when counting the number of times of movement will be described.
FIG. 5 is a flowchart illustrating an operation example of the imaging apparatus 1 when counting the number of times of movement.

Step ST11:
The sensor 11 outputs an image to the moving object detection unit 12.
Step ST12:
The moving body detection unit 12 detects the movement of the image output from the sensor 11 in step ST11 and outputs moving body information to the shutter determination unit 13, and the storage unit 15 stores this.
Step ST13:
The shutter determination unit 13 determines whether or not there is a movement based on the moving body information. If there is, the process proceeds to step ST14. If not, the process returns to step ST11.

Step ST14:
The shutter determination unit 13 counts the number of movements detected by the moving object detection unit 12.
Step ST15:
The shutter determination unit 13 determines whether or not the number of movements counted in step ST14 has reached a predetermined number. If reached, the process proceeds to step ST16, and otherwise returns to step ST11.
The predetermined number of times may be determined by the user using an input unit (not shown) or may be set in advance when the imaging device 1 is manufactured.

Step ST16:
If the timer 14 is used, the process proceeds to step ST17. If the timer 14 is not used immediately, the process proceeds to step ST20.
Step ST17:
The shutter determination unit 13 initializes the timer 14.

Step ST18:
The timer 14 counts until a predetermined time set in advance is reached.
Step ST19:
When the count of the timer 14 is over and a predetermined time is reached, a completion signal is output to the shutter determination unit 13 and the process proceeds to step ST20. When it is not over, the process returns to step ST18.

Step ST20:
The shutter determination unit 13 receives the completion signal of the timer 14 in step ST19 and outputs a shutter activation signal.
Step ST21:
The shutter 16 receives the shutter activation signal and releases the shutter.

Furthermore, an operation example in the case where the movement start and the movement end are detected based on the movement history stored in the storage unit 15 and the shutter is released in accordance with these will be described.
FIG. 6 is a flowchart showing an operation example in the case where the start and end of movement are detected and the shutter is released in accordance with these.

Step ST31:
The sensor 11 outputs an image to the moving object detection unit 12.
Step ST32:
The moving body detection unit 12 detects the movement of the image output from the sensor 11 in step ST31, the storage unit 15 stores the presence / absence of movement for each frame, and the storage unit 15 stores this.

Step ST33:
The shutter determination unit 13 determines whether or not the current frame motion is the same as the previous frame motion, and if so, determines that the current frame continues to move or is stationary, Return to ST31. If they are different, it is determined that the movement has started or ended, and the process proceeds to step ST34.
Step ST34:
If the timer 14 is used, the process proceeds to step ST35, and if the timer 14 is not used immediately, the process proceeds to step ST38.
Step ST35:
The shutter determination unit 13 initializes the timer 14.

Step ST36:
The timer 14 counts until a predetermined time set in advance is reached.
Step ST37:
When the count of the timer 14 ends and a predetermined time is reached, a completion signal is output to the shutter determination unit 13 and the process proceeds to step ST38, and when not completed, the process returns to step ST36.

Step ST38:
The shutter determination unit 13 receives the completion signal of the timer 14 in step ST37 and outputs a shutter activation signal.
Step ST39:
The shutter 16 receives the shutter activation signal and releases the shutter.

As described above, according to the imaging device 1 of the present embodiment, the shutter is released according to the presence or absence of the movement of the image output from the sensor 11, so that even when the user cannot release the shutter himself / herself, Like the self-timer, it is possible to eliminate the disadvantage that the user cannot grasp the timing when the shutter is released and cannot take a picture well.
In addition, since the shutter can be released according to the presence / absence of movement, the number of times of movement, the start of movement, and the like, it is possible to photograph a subject that continues to move.
Also, since the shutter is released according to the movement of the subject, it is necessary to move the camera to capture the moving subject in order to keep the subject within the camera frame, or the timing to release the shutter is difficult. Profit can be eliminated.
Further, according to the imaging apparatus 1 of the present embodiment, the shutter can be released by counting the number of movements, or the shutter can be released by determining the start or end of movement, so that the user can detect the shutter by moving object detection. Convenience when using the function is increased.

Second Embodiment
In the present embodiment, an imaging apparatus that releases a shutter according to the magnitude (speed or direction) of movement will be described.
FIG. 7 is a block diagram of the imaging apparatus 1a of the second embodiment.
As shown in FIG. 7, the imaging device 1a of the second embodiment has the same configuration except for the imaging device 1 of the first embodiment, the moving object detection unit 12a, and the shutter determination unit 13a.

The moving object detection unit 12a performs moving object detection processing on the image output from the sensor 11, and outputs moving object information.
The moving body information is information including the presence / absence of movement of the moving body, the magnitude (speed and direction) of the movement, and the position of the moving body and the size of the moving body as necessary.

In the second embodiment, the moving body information output from the moving body detection unit 12a always includes the magnitude of the movement (speed and direction).
The moving object detection method of the moving object detection unit 12a is performed as follows.
For example, the moving body detection unit 12a calculates a difference between the n−1th frame and the nth frame of the image output from the sensor 11. FIG. 8A is a diagram showing the difference taken.
Note that n is an arbitrary positive integer.

The moving object detection unit 12a first obtains the center of gravity of the difference area between the (n-1) th frame and the nth frame. For example, as shown in FIG. 8B, the intersection of diagonal lines when the difference area is enclosed by a rectangle is used as the center of gravity.
Next, the moving distance of the center of gravity is defined as speed. Alternatively, the speed obtained by dividing the moving distance of the center of gravity by the unit time. The unit time is, for example, the time between frames, but this need not be the case.

As shown in FIG. 8A, when the xy coordinates are set on the image and the moving distance of the center of gravity is (dx, dy), the moving direction of the center of gravity can be obtained from the sign of dx and dy and the inclination dx / dy. it can.
The moving object detection unit 12a outputs the magnitude (speed and direction) of the movement obtained as described above as moving object information.

The shutter determining unit 13a initializes the timer 14 when the moving object information output from the moving object detecting unit 12a, that is, the speed (the speed and direction) of the moving object is greater than or equal to a predetermined value. After a time, a completion signal output from the timer 14 is received and a shutter activation signal is output. The predetermined size may be set in advance when the imaging apparatus 1a is manufactured, or may be arbitrarily set by the user.
When the timer 14 is not used, the shutter determination unit 13a outputs a shutter activation signal immediately after receiving the moving body information output from the moving body detection unit 12a. Whether or not to use the timer 14 can be set by a user through an input unit (not shown).

  In addition to the above-described determination based on the magnitude of the speed, the shutter determination unit 13a can also perform determination based on the direction of movement. For example, the timer 14 is initialized (or a shutter activation signal is output) when the speed is equal to or greater than a predetermined magnitude and the direction of movement is in a predetermined range. The predetermined range may be set in advance when the imaging apparatus 1a is manufactured, or may be arbitrarily set by the user.

  Further, by storing the moving object information in the storage unit 15, the shutter determination unit 13a counts the number of times of movement having a predetermined size (and direction), and when the predetermined number of times is reached, the timer 14 Can be initialized (or a shutter activation signal is output). The predetermined number of times may be set in advance when the imaging apparatus 1a is manufactured, or may be arbitrarily set by the user.

Hereinafter, an operation example of the imaging apparatus 1a of the second embodiment will be described.
FIG. 9 is a flowchart illustrating an operation example of the imaging apparatus 1a according to the second embodiment.

Step ST41:
The sensor 11 outputs an image to the moving object detection unit 12a.
Step ST42:
The moving body detection unit 12a detects the movement of the image output from the sensor 11 in step ST41, and outputs moving body information (the magnitude (speed and direction) of the movement) to the shutter determination unit 13a, and the storage unit 15 stores this. To do.
Step ST43:
Based on the moving object information, the shutter determination unit 13a proceeds to step ST44 when the speed is equal to or greater than the predetermined magnitude, and returns to step ST41 when the speed is equal to or smaller than the predetermined magnitude (including 0). . When the direction of movement is also determined, if the speed is equal to or greater than the predetermined magnitude and the direction is within the predetermined range, the process proceeds to step ST44, and if not, the process returns to step ST41.

Step ST44:
If the number of times that the speed is equal to or greater than the predetermined magnitude is counted, the process proceeds to step ST45, and otherwise, the process proceeds to step ST47.
Step ST45:
The shutter determination unit 13a counts the number of times that the speed is equal to or greater than a predetermined magnitude. When the direction of movement is also determined, the number of times that the speed is equal to or greater than a predetermined magnitude and the direction is within a predetermined range is counted.
Step ST46:
The shutter determination unit 13a determines whether or not the number counted in step ST45 has reached a predetermined number. If it has reached, the process proceeds to step ST47, and if not, the process returns to step ST41.

Step ST47:
If the timer 14 is used, the process proceeds to step ST48. If the timer 14 is not used immediately, the process proceeds to step ST51.
Step ST48:
The shutter determination unit 13a initializes the timer 14.

Step ST49:
The timer 14 counts until a predetermined time set in advance is reached.
Step ST50:
When the count of the timer 14 ends and a predetermined time is reached, a completion signal is output to the shutter determination unit 13a and the process proceeds to step ST51, and when not completed, the process returns to step ST49.

Step ST51:
The shutter determination unit 13a receives the completion signal of the timer 14 in step ST50 and outputs a shutter activation signal.
Step ST52:
The shutter 16 receives the shutter activation signal and releases the shutter.

  As described above, according to the imaging device 1a of the second embodiment, the shutter can be released based on the magnitude (speed and direction) of the movement of the image output from the sensor 11, so that the user can detect the moving object. Convenience when using the shutter function is improved.

<Third Embodiment>
In the present embodiment, an imaging apparatus that cuts a shutter according to the position or size of a moving object will be described.
FIG. 10 is a block diagram of the imaging apparatus 1b of the third embodiment.
As shown in FIG. 10, the imaging apparatus 1b of the third embodiment has the same configuration except for the imaging apparatus 1 of the first embodiment, the moving object detection unit 12b, and the shutter determination unit 13b.

The moving object detection unit 12b performs moving object detection processing on the image output from the sensor 11 and outputs moving object information.
The moving body information is information including at least one of the presence / absence of movement of the moving body, the magnitude (speed and direction) of the movement, the position of the moving body, and the size of the moving body.

In the third embodiment, the moving object information output from the moving object detection unit 12b always includes the position or size of the moving object.
The moving object detection method of the moving object detection unit 12b is performed as follows.

For example, the moving object detection unit 12b calculates the difference between the n−1th frame and the nth frame of the image output from the sensor 11. FIG. 11A is a diagram showing the difference taken.
Note that n is an arbitrary positive integer.

The moving object detection unit 12b first obtains the center of gravity of the difference area between the (n-1) th frame and the nth frame. For example, as shown in FIG. 11B, the intersection of diagonal lines when the difference area is enclosed by a rectangle is used as the center of gravity.
Next, the position of the moving object is obtained. For example, the coordinates of the center of gravity are set as the position of the moving object. Alternatively, it may be any vertex of a rectangle surrounding the difference area, or the center point of a circle surrounding the difference area, and is not limited in this embodiment.

Next, the size of the moving object is obtained. For example, the area h × w of the difference region as shown in FIG. Alternatively, it may be the number of pixels occupied by the moving object or the area of a circle surrounding the moving object. In the present embodiment, the method for obtaining the size of the moving object is not limited.
The moving object detection unit 12b outputs the position or size of the moving object obtained as described above as moving object information.

The shutter determination unit 13b determines whether or not the moving object information output from the moving object detection unit 12b, that is, the position or size of the moving object, has reached a predetermined position. And a completion signal output from the timer 14 after a predetermined time is received and a shutter activation signal is output. The predetermined position may be set in advance when the imaging apparatus 1b is manufactured, or may be arbitrarily set by the user.
When the timer 14 is not used, the shutter determination unit 13b outputs a shutter activation signal immediately after determining that the position of the moving object has reached a predetermined position. Whether or not to use the timer 14 can be set by a user through an input unit (not shown).

  Alternatively, the shutter determination unit 13b performs determination based on the size of the moving object. For example, it is determined whether or not the size of the moving object has become a predetermined size, and when the size has reached the predetermined size, the timer 14 is initialized (or a shutter activation signal is output). The predetermined size may be set in advance when the imaging device 1b is manufactured, or may be arbitrarily set by the user.

  Furthermore, the shutter determination unit 13b determines whether or not both the position and size of the moving object satisfy the condition, and initializes the timer (or outputs a shutter activation signal) only when it is determined that the condition is satisfied. Is possible. In this case, for example, the shutter determination unit 13b initializes a timer (or outputs a shutter activation signal) when the position of the moving object is at a predetermined position and the size of the moving object exceeds a predetermined size. .

Hereinafter, an operation example of the imaging apparatus 1b according to the third embodiment will be described.
FIG. 12 is a flowchart illustrating an operation example of the imaging apparatus 1b according to the third embodiment.

Step ST61:
The sensor 11 outputs an image to the moving object detection unit 12b.
Step ST62:
The moving object detection unit 12b detects the movement of the image output from the sensor 11 in step ST61, and outputs moving object information (position or size of the moving object) to the shutter determination unit 13b. The storage unit 15 stores the information.
Step ST63:
The shutter determination unit 13b proceeds to step ST64 on the condition that the position of the moving object is at the predetermined position based on the moving object information, and returns to step ST61 when the moving object is not at the predetermined position.
Or when determining based on the size of a moving body, the shutter determination part 13b progresses to step ST64, when the size of a moving body becomes a predetermined magnitude | size, and when that is not right, it returns to step ST61.
Further, when the determination is made according to the position and size of the moving object, the process proceeds to step ST64 when the position of the moving object is at a predetermined position and the size of the moving object is equal to or larger than the predetermined size. The process returns to step ST61.

Step ST64:
When counting the number of times the moving body is at the predetermined position, the process proceeds to step ST65, and when not counting, the process proceeds to step ST67.
Step ST65:
The shutter determination unit 13b counts the number of times that the position of the moving object is at a predetermined position or the number of times that the size of the moving object is equal to or greater than a predetermined size.
Step ST66:
The shutter determination unit 13b determines whether or not the number counted in step ST65 has reached a predetermined number. If it has reached, the process proceeds to step ST67, and if not, the process returns to step ST61.

Step ST67:
If the timer 14 is used, the process proceeds to step ST68. If the timer 14 is not used immediately, the process proceeds to step ST71.
Step ST68:
The shutter determination unit 13b initializes the timer 14.

Step ST69:
The timer 14 counts until a predetermined time set in advance is reached.
Step ST70:
When the count of the timer 14 ends and a predetermined time is reached, a completion signal is output to the shutter determination unit 13b and the process proceeds to step ST71, and when not completed, the process returns to step ST69.

Step ST71:
The shutter determination unit 13b receives the completion signal of the timer 14 in step ST70 and outputs a shutter activation signal.
Step ST72:
The shutter 16 receives the shutter activation signal and releases the shutter.

  As described above, according to the imaging device 1b of the third embodiment, since the shutter can be released according to the position or size of the moving object in the image output from the sensor 11, the user has a shutter function based on the moving object detection. Convenience in use increases.

<Fourth embodiment>
In this embodiment, an imaging apparatus capable of handling a plurality of moving objects will be described.
FIG. 13 is a block diagram of an imaging apparatus 1c according to the fourth embodiment.
As illustrated in FIG. 13, the imaging device 1c according to the fourth embodiment has the same configuration except for the imaging device 1 according to the first embodiment, the moving object detection units 12c-1 to 12c-N, and the shutter determination unit 13c.

The imaging device 1c according to the present embodiment includes N moving body detection units 12c-1 to 12c-N. N is an integer of 2 or more.
The moving body detection units 12c-1 to 12c-N detect and output moving body information.
Here, the moving body information is information including at least one of the presence / absence of movement of the moving body, the magnitude (speed and direction) of the movement, the position of the moving body, and the size of the moving body. In the following description, a case where the moving object detection units 12c-1 to 12c-N output the presence or absence of movement as moving object information will be described as an example.

The shutter determination unit 13c determines whether all the N pieces of moving body information output from the moving body detection units 12c-1 to 12c-N satisfy a predetermined condition. If the information is satisfied, the timer 14 is initialized. A completion signal output from the timer 14 is received after a predetermined time, and a shutter activation signal is output. Alternatively, when the timer 14 is not used, the shutter activation signal is output after determining that the condition is satisfied. Whether or not to use the timer 14 can be set by a user through an input unit (not shown).
In the present embodiment, when the moving object information is the presence or absence of movement, the predetermined condition is that all moving objects stop moving, but the present invention does not limit the predetermined condition (according to the contents of the moving object information). change).

Hereinafter, an operation example of the imaging apparatus 1c according to the fourth embodiment will be described.
FIG. 14 is a flowchart illustrating an operation example of the imaging apparatus 1c according to the fourth embodiment.

Step ST81:
The sensor 11 outputs an image to the moving object detection units 12c-1 to 12c-N.
Step ST82:
The moving object detection units 12c-1 to 12c-N detect the movements of the N moving objects in the image output by the sensor 11 in step ST81, and output them as moving object information to the shutter determination unit 13c, which is stored in the storage unit 15. Remember.
Step ST83:
The shutter determination unit 13c refers to the storage unit 15 to determine whether or not all N moving objects have stopped moving. If stopped, the process proceeds to step ST84. If not, the process returns to step ST81.

Step ST84:
If the timer 14 is used, the process proceeds to step ST85. If the timer 14 is not used immediately, the process proceeds to step ST88.
Step ST85:
The shutter determination unit 13 c initializes the timer 14.

Step ST86:
The timer 14 counts until a predetermined time set in advance is reached.
Step ST87:
When the count of the timer 14 ends and a predetermined time is reached, a completion signal is output to the shutter determination unit 13c, and the process proceeds to step ST88. When not completed, the process returns to step ST86.

Step ST88:
The shutter determination unit 13c receives the completion signal of the timer 14 in step ST87 and outputs a shutter activation signal.
Step ST89:
The shutter 16 receives the shutter activation signal and releases the shutter.

  As described above, according to the imaging apparatus 1c of the present embodiment, it is easy to take a picture for a plurality of subjects. This makes it easy to take a group photo or the like without a shutter operator.

  In this embodiment, the case where the presence / absence of motion is detected as moving body information has been described. However, other moving body information, that is, based on one of the size (speed and direction) of the motion, the position of the moving body, and the size of the moving body. Alternatively, the shutter determination unit 13c may perform the determination.

<Fifth Embodiment>
In the present embodiment, for example, an imaging apparatus capable of detecting the movement of the hand and releasing the shutter when the hand is shaken will be described.
FIG. 15 is a block diagram of an imaging apparatus 1d according to the fifth embodiment.
As illustrated in FIG. 15, the imaging apparatus 1d according to the fifth embodiment is different from the imaging apparatus 1 according to the first embodiment in the moving object detection units 12d-1 to 12d-N and the shutter determination unit 13d, and the face area detection unit. 17. Other than these, the configuration is the same as that of the imaging device 1 of the first embodiment.

The face area detection unit 17 detects a face area in the image output from the sensor 11.
As a method for detecting a face area, for example, an area having an approximate skin color is extracted from an image, pattern matching between the area and face area sample data is performed, and it is determined whether or not the face area. If matching is achieved, the area is detected and output as a face area.
Note that the detection method of the face area is known, and a known method other than those described above may be used. This embodiment is not limited.

The imaging apparatus 1d according to the present embodiment includes N moving body detection units 12d-1 to 12d-N. N is an integer of 2 or more.
The moving object detection units 12d-1 to 12d-N detect moving object information and output the detected information to the shutter determination unit 13d.
Here, the moving body information is information such as the presence / absence of movement of the moving body, the magnitude (speed and direction) of the movement, the position of the moving body, and the size of the moving body.

The shutter determination unit 13d estimates the position and size of an area that is considered to have a hand from the position and size of the face area detected by the face area detection unit 17.
For example, the hand size is slightly smaller than the face, and the hand position is estimated to be either right side of the face, slightly upper right, slightly lower right, lower right, left side, slightly upper left, slightly lower left, or lower left To do.

  The shutter determination unit 13d is based on the moving body information of the moving body of the estimated size in the area estimated to have a hand among the N moving bodies output by the moving body detection units 12d-1 to 12d-N. Then, shutter determination is performed.

Hereinafter, an operation example of the imaging apparatus 1d according to the fifth embodiment will be described.
FIG. 16 is a flowchart illustrating an operation example of the imaging apparatus 1d according to the fifth embodiment.

Step ST91:
The sensor 11 outputs an image to the moving object detection units 12d-1 to 12d-N and the face area detection unit 17.
Step ST92:
The moving object detection units 12d-1 to 12d-N detect the movements of the N moving objects in the image output by the sensor 11 in step ST91, and output them as moving object information to the shutter determination unit 13, which is stored in the storage unit 15. Remember.

Step ST93:
The face area detection unit 17 detects a face area in the image output from the sensor 11.
Step ST94:
The shutter determination unit 13d estimates the position of the hand and the size of the hand based on the face area detected by the face area detection unit 17.
Step ST95:
The shutter determination unit 13d refers to the storage unit 15 and performs matching with the estimated size and color of the hand based on the moving object information within the estimated range of the position where the hand is, and identifies the moving object estimated as the hand. .

Step ST96:
The shutter determination unit 13d determines whether or not there is a motion of a moving object that is a candidate for the hand specified in step ST95. If there is, the process proceeds to step ST97, and if there is not, the process returns to step ST91.
Step ST97:
If the timer 14 is used, the process proceeds to step ST98. If the timer 14 is not used immediately, the process proceeds to step ST101.
Step ST98:
The shutter determination unit 13d initializes the timer 14.

Step ST99:
The timer 14 counts until a predetermined time set in advance is reached.
Step ST100:
When the count of the timer 14 ends and a predetermined time is reached, a completion signal is output to the shutter determination unit 13d and the process proceeds to step ST101, and when not completed, the process returns to step ST99.

Step ST101:
The shutter determination unit 13d receives the completion signal of the timer 14 in step ST100 and outputs a shutter activation signal.
Step ST102:
The shutter 16 receives the shutter activation signal and releases the shutter.

  Note that, as described with reference to FIG. 6 of the first embodiment, the imaging device 1d according to the present embodiment stores the presence / absence of hand motion of each frame in the storage unit 15, and starts or moves the hand. By detecting the end, the shutter determination unit 13d may initialize a timer (or output a shutter activation signal).

  In the imaging apparatus 1d of the present embodiment, the region with the hand is estimated based on the face region, but the present invention is not limited to this. For example, the region of the eyelid is estimated, and the shutter determination unit 13d is estimated by blinking. May make a determination. Of course, not only eyelids, but also other moving objects may be used.

As described above, according to the imaging apparatus 1d of the present embodiment, a face area is detected, a range with a hand is estimated based on the detected face area, and moving objects within the range are detected. When the user tries to release the shutter by detecting the moving object by shaking his / her hand, the disadvantage that the other moving object moves in front of the hand and the shutter is accidentally released due to the movement can be eliminated.
Further, for example, since it is not necessary to use a remote controller or the like, it is possible to eliminate the disadvantage that a photograph is taken with an unnatural hand shape and movement.

The present invention is not limited to the embodiment described above.
That is, those skilled in the art may make various modifications, combinations, subcombinations, and alternatives regarding the components of the above-described embodiments within the technical scope of the present invention or an equivalent scope thereof.

  In the embodiment described above, a semiconductor element such as CCS or CMOS is used for the sensor 11, but the present invention is not limited to this.

FIG. 1 is a block diagram of an imaging apparatus 1 according to the first embodiment. FIG. 2 is a diagram showing a basic concept of moving object detection. FIG. 3 is a diagram for explaining the detection of the presence or absence of movement by the moving object detection unit 12. FIG. 4 is a flowchart illustrating an operation example of the imaging apparatus 1 according to the first embodiment. FIG. 5 is a flowchart illustrating an operation example of the imaging apparatus 1 when counting the number of times of movement. FIG. 6 is a flowchart showing an operation example in the case where the start and end of movement are detected and the shutter is released in accordance with these. FIG. 7 is a block diagram of the imaging apparatus 1a of the second embodiment. FIG. 8 is a diagram for explaining the detection of the magnitude (speed and direction) of motion by the moving object detection unit 12a. FIG. 9 is a flowchart illustrating an operation example of the imaging apparatus 1a according to the second embodiment. FIG. 10 is a block diagram of the imaging apparatus 1b of the third embodiment. FIG. 11 is a diagram for explaining detection of the position and size of a moving object by the moving object detection unit 12b. FIG. 12 is a flowchart illustrating an operation example of the imaging apparatus 1b according to the third embodiment. FIG. 13 is a block diagram of an imaging apparatus 1c according to the fourth embodiment. FIG. 14 is a flowchart illustrating an operation example of the imaging apparatus 1c according to the fourth embodiment. FIG. 15 is a block diagram of an imaging apparatus 1d according to the fifth embodiment. FIG. 16 is a flowchart illustrating an operation example of the imaging apparatus 1d according to the fifth embodiment.

Explanation of symbols

1, 1a, 1b, 1c, 1d ... imaging device, 12, 12a, 12b, 12c, 12d ... moving object detection unit, 13, 13a, 13b, 13c, 13d ... shutter determination unit, 14 ... timer, 15 ... storage unit, 16 ... Shutter, 17 ... Face area detection unit

Claims (13)

Imaging means;
A moving object detecting means for detecting a moving object and outputting moving object information based on an image obtained by the imaging means;
Storage means for storing the moving object information detected by the moving object detection means;
A timer that outputs a timer completion signal after a predetermined time has elapsed since initialization;
Shutter determination means for outputting the shutter activation signal based on the timer completion signal output by the timer;
Have
The shutter determination unit initializes the timer when there is a moving body included in the moving body information stored in the storage unit. The imaging apparatus according to claim 1, wherein the moving body information includes at least one of a position, a size, presence / absence of movement, and a magnitude of movement of the moving body. The imaging apparatus according to claim 2, wherein the shutter determination unit outputs the shutter activation signal regardless of the timer completion signal output from the timer. The imaging apparatus according to claim 3, wherein the shutter determination unit detects the number of movements of the moving object stored in the storage unit, and initializes the timer when the predetermined number of times is detected. The shutter determination unit detects the start and end of movement of a moving body based on the moving body information stored in the storage unit, and initializes the timer according to the start or end of movement. The imaging device described. The shutter determination means detects the magnitude of movement of the moving object based on the moving object information detected by the moving object detection means, and the timer determines when the magnitude of movement of the moving object reaches a predetermined magnitude. The imaging apparatus according to claim 3. The imaging according to claim 6, wherein the shutter determination unit initializes the timer when a predetermined number of movements of the moving body having a predetermined size or more are detected based on the moving body information stored in the storage unit. apparatus. The shutter determination unit initializes the timer when one point on the moving body is located at a predetermined point in the image captured by the imaging unit based on the moving body information stored in the storage unit. The imaging device according to claim 3. The shutter determination unit detects the size of the moving body based on the moving body information stored in the storage unit, and initializes the timer when the size of the moving body reaches a predetermined size. Item 4. The imaging device according to Item 3. The moving object detection means detects a plurality of moving objects and outputs a plurality of moving object information,
The storage means stores the plurality of moving body information output by the plurality of moving body detection means,
The shutter determination unit detects the end of movement of the plurality of moving bodies based on the plurality of moving body information stored in the storage unit, and initializes the timer when all of the plurality of moving bodies have finished moving. Item 4. The imaging device according to Item 3. A face area detecting means for detecting a face area of a person in the image captured by the imaging device;
The moving object detection means detects a plurality of moving objects and outputs a plurality of moving object information,
The storage means stores the plurality of moving body information output by the plurality of moving body detection means,
The shutter determination unit extracts a moving body having a predetermined size within a predetermined range from the plurality of moving bodies based on the face area based on the plurality of moving body information stored in the storage unit. The imaging apparatus according to claim 3, wherein the timer is initialized when the moving object moves. The imaging apparatus according to claim 11, wherein the shutter determination unit detects the number of movements of the plurality of moving objects stored in the storage unit, and initializes the timer when the predetermined number of times is detected. A first step of taking an image;
A second step of detecting a moving body and outputting moving body information based on the video signal imaged in the first step;
A third step of storing the moving body information detected in the second step;
A fourth step of initializing a timer when there is a motion of the moving object included in the moving object information stored in the third step;
A fifth step of outputting a timer completion signal after a predetermined time has elapsed since the timer was initialized in the fourth step;
A sixth step of outputting a shutter activation signal in response to the timer completion signal output by the timer in the fifth step;
An imaging method comprising:

Images