JP2000196934A - Method and device for picking up image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method and device for picking up image by which the image of an object is picked up (the picking up of the image is stopped) by using the variation of a specific part of the object as a trigger. SOLUTION: A person to be photographed has a mark 45 (a). A photographer 43 fixes the angle of an image pickup device and, at the same time, brings the mark 45 in the visual field of the device after designating the mark 45 as a section to be detected by operating keys. The image pickup device monitors the luminance of the mark 45 and, when the luminance changes beyond a threshold, picks up the image of the person by operating a shutter. When the photographer 43 conceals the mark 45 after the mark 45 is brought in the visual field of the image pickup device (b), the device picks up the image, because the luminance of the mark 45 changes beyond the threshold.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an imaging technique that replaces a self-timer and a remote control in an imaging apparatus such as a digital camera.

[0002]

2. Description of the Related Art In a case where a photographer himself wants to take an image as a subject in a camera photographing or the like (for example, a case where himself or herself is photographed against a background of a group photograph or a landscape) or a case where there is a risk of camera shake due to manual shutter operation. Conventionally, there is a camera having a self-timer function for performing a shutter operation in conjunction with a timer after fixing the camera, and a camera having a remote control function for performing a shutter operation using a remote control (remote control device).

[0003]

In the case where the photographer himself participates in imaging using the above-mentioned conventional self-timer function, the photographer participates as a subject after setting an imaging angle and then setting a time. , The problem of losing a photo opportunity depending on the setting time of the timer,
That is, if the set time is too short, the shutter operates before the photographer can take a pose as a subject, and if the set time is too long, there is an inconvenience that time is left and a photo opportunity is missed. In the case of photographs, set the timer after paying attention to the camera, but if the timer is set for too long, the attention of the subject will be reduced, and the photograph will be ununiform and look unfocused) was there.

In a camera having a remote control function, it is necessary to carry the remote control device or to attach it to the camera and remove it when using it. It is not widely used except for special applications because it is bulky when it is attached to

The present invention has been made in view of the above problems, and has as its object to provide an imaging method and an imaging apparatus that perform imaging (or stop imaging) by using a change in a specific portion of a subject as a trigger.

[0006]

In order to achieve the above object, according to a first aspect of the present invention, there is provided an imaging method, wherein a desired portion of a displayed subject image is designated, and then the designated desired portion is displayed. It is characterized in that a time when the portion is changed as compared with the state when the portion is designated is used as a trigger for starting or ending the imaging.

[0007] The imaging method according to a second aspect of the invention is characterized in that the start of imaging or the end of imaging is triggered when a designated portion of the displayed subject image matches a registered image pattern. .

[0008] The imaging method according to a third aspect of the present invention is characterized in that, when a designated portion of the displayed subject image and the registered image pattern do not match, the start or end of imaging is triggered. And

In a fourth aspect of the present invention, there is provided an image pickup method, comprising: a designated portion of an image taken at a predetermined angle of view and an image portion corresponding to the designated portion of a subject image displayed as a moving image at a predetermined angle of view. Are different from each other as a trigger for imaging.

The image pickup apparatus according to a fifth aspect of the present invention includes a part designating means for designating a desired image part in a displayed subject image and a state of the image part designated by the part designating means. Comparing the image state of the image part detected by the image state detecting means when specified by the image state detecting means with the image state detecting means, and the image state of the image part detected by the image state detecting means thereafter As a result of the comparison by the image state comparing means and the image state comparing means, when the subsequent image state changes compared to the image state of the partial image specified by the partial specifying means, a trigger to start or end the imaging And an imaging control unit that performs the operation.

According to a sixth aspect of the present invention, in the imaging apparatus of the fifth aspect, the image state detecting means detects a state of the image portion from luminance, hue, or movement of the designated image portion.

An image pickup apparatus according to a seventh aspect of the present invention comprises an image pattern information registering means for registering an image pattern and its pattern data, and an image pattern selecting means for selecting an image pattern registered in the image pattern information registering means. A part designating means for designating a desired image part of the displayed subject image, and cutting out the image part designated by the part designating means from the subject image,
Image recognition means for recognizing the cut out image portion based on the pattern data of the image pattern selected by the image pattern selection means, and as a result of the recognition processing by the image recognition means, the cut out image portion and the image pattern Imaging control means for triggering the start or end of imaging when coincidence occurs.

According to an eighth aspect of the present invention, in the imaging apparatus of the seventh aspect, the imaging control means starts imaging when the cut-out image portion and the image pattern do not match as a result of the recognition processing by the image recognition means. Alternatively, a trigger for ending the imaging is provided.

According to a ninth aspect of the present invention, in the image pickup apparatus of the seventh or eighth aspect, the image pattern is defined by the following (1).
It is characterized by including at least one of the patterns of (4) to (4). (1) geometric figure patterns, (2) pulse patterns, (3) geometric figures taken by human hands, etc.
(4) A series of motion patterns expressed by human hands and the like.

[0015] The imaging apparatus according to a tenth aspect of the present invention provides a comparison image extracting means for extracting a desired image portion from an image captured at a predetermined angle of view, and a subject image displayed as a moving image at a predetermined angle of view. Image extracting means for extracting an image portion for comparison with the comparative image extracted by the comparative image extracting means, image comparing means for comparing the image portion extracted by the image extracting means with the comparative image, An imaging control unit that triggers imaging when a comparison image and an extracted image portion are different as a result of the comparison by the image comparison unit;
It is characterized by having.

[0016]

DESCRIPTION OF THE PREFERRED EMBODIMENTS First Embodiment Imaging by Detecting Change of Specified Part In the imaging method of the present invention, a user changes a certain part (for example, a part including a mark) of a subject by operating a key or the like. It is designated as a detection area, and imaging is performed with a change detection in that part as a trigger. Further, examples of the change detection include a luminance change of the designated portion (= detection area) (Example 1), a color (hue) change of the designated portion (Example 2), and a motion detection of the designated portion (Example 3). But not limited to these.

[Circuit Configuration Example] FIG. 1 is a block diagram showing a circuit configuration example of a digital camera as an embodiment of an imaging apparatus to which the present invention is applied.
0 is a bus 1, an image input system 10, a control unit 20, an operation unit 3.
0, a display unit 40, and a flash memory 50.
Note that the sound output device 60 may be provided to perform imaging notification (described later).

The image input system 10 has an optical system 11, a signal conversion unit 12, a signal processing unit 13, a data compression / decompression unit 14, and a DRAM 15.

The optical system 11 includes an optical system mechanism such as an imaging lens, an aperture mechanism, and a shutter mechanism, and forms light from a subject on the CCD 121 of the signal conversion unit 12 at the subsequent stage.

The signal converter 12 includes a CCD 121, a CCD
Driving timing signal generation circuit (TG) 122, CCD
Driving vertical driver 123, sample hold circuit 12
4 and the A / D converter 125, and the optical system 11
The image formed on the CCD 121 is converted into an electric signal, converted into digital data (hereinafter, image data), and output at a constant period.

The signal processing unit 13 includes a color processing circuit 1
31 and a DMA controller 132. The color process circuit 131 performs a color process on the output from the signal conversion unit 12 and writes the digital output as a digital luminance signal and a color difference multiplex signal (YUV data) in a buffer of the DMA controller 132. The DMA controller 132 converts the YUV data written in the buffer into a DR.
DMA (direct memory access) transfer to the designated area of AM 14 and expansion. DMA controller 1
Numeral 32 reads out the YUV data written in the DRAM 15 at the time of recording and saving, and writes it in the data compression / decompression unit 14. Further, in order to display a through image (moving image), the captured image data is thinned out and sent to the display unit 40. When a shutter operation is performed, the image data at that time is sent to the display unit 40 to display a still image.

The data compression / expansion unit 14 receives the YU from the DRAM 15
JPEG compression processing is performed on the V data. In the reproduction mode, the image data stored in the flash memory 50 is subjected to decompression processing to reproduce the YUV data.

The DRAM 15 is used as a working memory, and an image buffer area or J
A work area for PEG compression / expansion and an area for storing set values and the like are secured.

The control unit 20 has a microprocessor configuration including a CPU, a RAM, a ROM for storing programs, a timer, and the like. The digital camera 100 is controlled by the control program stored in the program storage ROM and connected to each mode stored in the program storage ROM in response to a status signal from the operation unit 30. The processing program is taken out to control the execution of each function of the digital camera 100, for example, to execute an imaging function and a playback function of a recorded image, and to detect a change in a specific portion of an image by the automatic imaging program in the automatic imaging mode. Performs execution control such as output of an imaging trigger.

The operation unit 30 includes a processing mode changeover switch,
Switches and buttons, such as a function selection button, a main switch, an automatic imaging mode setting button 35, a shutter button 36, and a detection portion designation key (frame cursor movement instruction key) 37, are included as components, and these switches or buttons are operated. Then, a state signal is sent to the control unit 20.

When the automatic imaging mode setting button 35 is operated, the automatic imaging program is read from the program ROM, and the automatic imaging mode is started. Further, the user operates the detection portion designation key 37 to designate a specific portion to be a change detection target in the through image (subject image) displayed on the liquid crystal screen of the display section 40.

The display unit 40 is a video encoder, a VRAM
And a liquid crystal screen (LCD). The display control of the control unit 20 enables display of a through image at the time of imaging, a reproduced image at the time of reproduction, a selection menu and a guide (or an icon) at the time of processing selection, and the like. Do.

The flash memory 50 stores and records the image data JPEG-compressed by the image compression / expansion unit 14.
In addition to the area for recording image data, the flash memory 50 can also record an image information registration list for registering an image capturing mode, an image capturing condition, an image capturing time interval, and the like of the image when recording the image data. Also, the program R
Each program may be recorded instead of the OM. Note that a removable IC card may be used instead of the flash memory.

The sound output device 60 is provided to notify the person who has become the subject that the image has been picked up.
When the image is captured, a sound or a sound is output to notify that the image has been captured. Note that a display lamp may be provided instead of the sound output device.

[Color Process Circuit] The color process circuit 131 of the signal processing unit 13 separates and generates a luminance signal, a color component signal, and the like from the image data. FIG. 2 is a block diagram illustrating a configuration example of the color process circuit 131. In FIG. 2, the color process circuit 131 includes an R component integrator 13
11, G component integrator 1312, B component integrator 1313
AE (auto iris) integrator 1314, AF (auto focus) filter 1315, various counters 13
16, AWB circuit 1317, and signal synthesizing circuit 131
Eight.

The image signal photoelectrically converted by the CCD is A / D converted by an A / D converter of the signal converter 12 and input to the color process circuit 131. Color process circuit 13
In step 1, a process for generating an auto iris (AE) signal, an auto white balance (AWB) signal, an auto focus (AF) signal, and Y, Cb, Cr signals is performed on an input signal.

The AE integrator 1314 integrates the input signal and outputs the integrated value, and the AF filter 1315 detects a high frequency for contrast autofocus from the input signal.
F), the integrated value of the output is output, and the AWB circuit 1317 outputs an R component integrator 1311 and a G component integrator 1
An integrated value of each component integrated by 312 and B component integrator 1313 is output. These integrated outputs are output to the control unit 2
0, the control unit 20 outputs a control signal for controlling the gain, the shutter speed, and the lens 11 to be applied to the AGC of the signal processing unit 12 based on these signals. Therefore, the color process circuit 131 can be used as one of the change detection means to detect the state of the designated portion (detection area) on the through image.

FIGS. 3 and 4 are explanatory views of an embodiment of the automatic image pickup method of the present invention. FIG. 3 is an explanatory view of the operation of the photographer at the time of group photographing, and FIG. 4 is a detection area specifying method by mesh division. FIG. FIG. 5 is a flowchart illustrating an operation example of the digital camera according to the automatic imaging method according to the present embodiment. In FIG. 5, (a) illustrates an example in which imaging is performed based on a change in luminance of a designated portion, and (b) illustrates an example. An example in which imaging is performed based on a change in color (hue) of a specified portion, and FIG. 3C is an example in which imaging is performed by detecting movement of a specified portion.

[Example 1] Image pick-up by change in luminance of designated portion FIG. 6 is a diagram showing an example of luminance distribution of a designated portion. Hereinafter, the imaging operation of the digital camera 100 based on the flowchart of FIG.

As a premise, the user selects an imaging mode to perform imaging. On the subject side, as shown in FIG. 3, one of the subject persons 41 and 42 has a different brightness from the background (for example, a person in a black jacket holds a white handkerchief in front of the chest, or a person in a white shirt is black). In this example, the person 42 has a white handkerchief as a mark 45 on his left hand in the example of FIG. 3A. ).

(Example of Operation) Step S1: (Capture of subject image, display of through image) The subject image is captured in the imaging mode, and the persons 41 and 42 are passed through the liquid crystal finder (= the liquid crystal screen of the display unit 40). An image is displayed (FIG. 3A).

Step S2: (Automatic imaging mode setting) When the photographer (and subject) 43 determines the imaging angle of the digital camera 100, the digital camera 100 is fixed to that angle, and when the automatic imaging mode setting button 35 is pressed, the automatic The imaging mode is activated, and the control unit 20 sets a predetermined value (2 seconds in the embodiment) in the time counter. Also, DRA
The image storage area 151 of M15 (FIG. 4A: a through image, a captured image, or a reproduced image is temporarily stored in the embodiment) and the liquid crystal finder 40 are set to a rectangular area (5 × 5 = 20 in the example of FIG. 4). The image is divided, and division lines 51 and 52 are superimposed on the liquid crystal finder (FIG. 4).
(B)). This allows the through image to be displayed on the LCD finder 40.
The above is divided (FIG. 4C). Note that the division line segment may not be displayed). In addition, the liquid crystal finder 40
The cursor 47 is displayed on the screen (FIG. 3A, FIG. 4).
(C)).

Step S3: (Operation of Designating Marks) In FIG. 3, the photographer 43 operates the detection portion designation key 37 to move the cursor 47 to place the mark (white handkerchief) 45 held by the person 42. Point (specify). At this time, as shown in FIG. 4D, the divided area including the position of the cursor 47 (the rectangular portion 45 surrounded by the line segment) is differentially displayed (that is, highlighted, inverted, blinking, etc.). (Displayed so as to be recognizable separately from the image portion) so that the user can easily see which portion is designated by the cursor. Thereafter, the photographer (also a subject) 43 leaves the camera and enters the field of view of the camera to participate as a subject (FIG. 3B).

Step S4: (Specification of Detection Area) The control unit 20 determines the position of the specified portion, that is, the rectangular portion including the position of the cursor 47 on the liquid crystal finder 40, that is, the coordinates of the four corners of the rectangular frame.
Detection area 上 の (x1, y) on the image storage area 151
1), (x2, y1), (x1, y2), (x2, y
2) Specify (calculate)｝.

Step S5: (Determination of Luminance Range) Next, the control unit 20 determines the luminance range of the detection area based on the output of the color process circuit 131. The luminance range is determined, for example, by the distribution of the integrated value of the luminance in the section in the main scanning direction (== the integral output of the AF filter 1315).
This can be performed by examining the color luminance distribution of x2-x1 (FIG. 6A), setting the average value as the reference luminance value K0 of the detection area, and determining the threshold value Kn as shown in FIG. 6B. The threshold value Kn can be a predetermined ratio to the average value, but is not limited thereto.
It may be set to 0 + constant, or may be determined by an empirical value or a known method. The determined value is stored in the RAM (or DRAM 15) of the control unit 20.

Step S6: (Detection area (designated part)
The control unit 20 determines that the average value K1 (or K2) of the luminance distribution in the detection area is K1> K0 + Kn (or K2 <K0−).
In the case of Kn), it is determined that there is a luminance change, and the process transits to S7. That is, in the example of FIG. 3, when the photographer 43 poses next to the subject person 42 and hides the mark (white handkerchief) 45 of the subject person 42 (FIG. 3B), the brightness in the detection area is reduced. Is the reference value K0 obtained in step S6.
And different. That is, the average value K of the detected luminance values at that time
1> K0 + Kn, and a change in luminance occurs in the detection area. The mark 45 is hidden by the photographer 43 or hidden by the subject person 42. FIG.
(B) is an explanatory diagram of the threshold value of the luminance change, and the threshold value Kn is adjusted when the luminance in the detection area is detected and the light amount of the subject person 42 is detected.
Is a value allowed (ignored) as the amount of change in luminance of the image portion in the detection area due to camera shake or the like (change allowable value: automatically set in the remote shooting mode setting).

Step S7: (Countdown of imaging allowance time) The control unit 20 starts counting down the time counter.
When the time counter becomes 0 (zero), the flow goes to S8. Thus, even if the subject person 42 or the photographer 43 holding the mark 45 hides the mark 45, there is still enough time to set a pose, so that the hand movement or the like immediately after hiding the mark 45 is captured. Can be prevented. Although the set time of the time counter is set to 2 seconds (step S2) in the embodiment, the present invention is not limited to this.

Step S8: (Output of Imaging Trigger Signal) When the time counter becomes 0 in step S7, the control section 20 outputs an imaging trigger signal (imaging instruction signal) to control the shutter mechanism (optical system 11). Note that, instead of controlling the shutter mechanism, the sound output device 60 (or a lamp display device for imaging notification) may be controlled by an imaging trigger signal, or the shutter mechanism or the imaging display signal may be controlled. The image recording / storing process may be performed without controlling the apparatus (the next step S9 is omitted and the process proceeds to S10).

Step S9: (Shutter operation (imaging and imaging notification)) The shutter mechanism operates the shutter button 36 in response to the imaging instruction signal, and emits a mechanical sound such as "sharp" to notify the subject person of the end of imaging. . During this time, the control unit 20 transitions to S10 for the imaging process.

As described above (step S9),
A sound or a voice message to the effect that “imaging has been completed” may be output to the sound output device instead of notifying that the imaging has been completed by the shutter operation, or “imaging has been completed” may be notified using a display lamp.

Step S10: (Storing and Recording Process of Captured Image) At the time when the time count value is determined to be 0 in step S7, the image data loaded (= captured) into the DRAM 15 is subjected to JPEG compression processing. Flash memory 50
Save and record.

In the first embodiment, the amount of change in the luminance that is detected when the luminance of the mark 45 and the background color appearing when the mark 45 is hidden is similar to the range of the threshold Kn (that is, K0−K).
n <brightness change amount <K0 + Kn), and it may not be detected that the mark has disappeared.
It is desirable to use a mark 45 of 2 which is clearly different in luminance from the background.

Although the change in luminance is used as the imaging (start) trigger in the first embodiment, the change in luminance may be used as an imaging end trigger. (See Modification Example 2)).
In the first embodiment, one mesh-divided rectangular part is designated and one detection area is set. However, a plurality of rectangular parts may be designated (= a plurality of detection areas are set). A plurality of non-adjacent rectangular portions may be specified.

In the first embodiment, the rectangular portion obtained by dividing the screen into meshes is specified. However, the screen may be divided into arbitrary shapes and the divided areas may be specified. Further, in the first embodiment, the threshold value Kn (the permissible change to be ignored when detecting the luminance) is set to the same value in the light direction and the dark direction with the reference value K0 as the center, but the threshold values in the light direction and the dark direction are set to different values. (Kn1 ≠ Kn2). In the first embodiment, in step S6, the average value K1 (or K2) of the detected luminance values at that time is K1> K0 +
In the case of Kn (or K2 <K0−Kn), it is determined that there is a luminance change in the detection area. Conversely, when the luminance change within a predetermined time becomes equal to or less than Kn, that is, K0−Kn <K1.
<K0 + Kn (or K0−Kn <K2 <K0 + K
At the time of n), the luminance may be changed.

Second Embodiment Imaging by Changing Color (Hue) of Specified Portion In the first embodiment (FIG. 5A), a change in luminance of a specified portion was used as a trigger for imaging (S6). As shown in (1), a change in color (hue) may be used as a trigger for imaging. FIG. 7 is a diagram showing an example of the color distribution of the designated portion. In this example, as a premise, the user selects an imaging mode to perform imaging. On the subject side, as shown in FIG. 3, one of the subject persons 41 and 42 is required to have an object with high saturation (for example, a crimson handkerchief, a blue wallet, or the like whose color is as vivid as possible). 3 (a)
In the example, the person 42 has a mark (in this example, crimson handkerchief 45) in his left hand.

(Example of operation) In FIG.
S3 and steps S7 to S10 are the same as the operations in FIG. 5A, and the operations in steps S5 'and S6' will be described below.

Step S5 ': (Determination of Color Range) After the detection area is specified in step S4, the control unit 20
Determines the color feature (color range) of the designated portion (detection area) based on the output of the color process circuit 131. The color range is, for example, the output of the AWB circuit 1317, that is, R
Among the integral values of the components integrated by the component integrator 1311, the G component integrator 1312, and the B component integrator 1313, the distribution of the integral values in the x2-x1 section in the main scanning direction (= x2-x1 color distribution) ) (FIG. 7 (a)), and xm ± including the maximum value MAX (R, G, B) = f (xm).
The range represented by the color component ratio in the range of k can be determined as the characteristic color range (not limited to this method). The determined value is stored in the RAM (or DAM 15) of the control unit 20. The distribution of the characteristic colors is as shown in FIG. 7B when the saturation of the color of the mark (object) 45 possessed by the subject person is low.
In order to maintain the color sensitivity within a certain limit range (shaded portion), it is necessary to reduce the value of k. Therefore, when the mark is displaced from the cursor frame 320 due to hand shake of the subject person or the like, "k" is set in the next step S6. There is a possibility that it is determined that there is a color change. However, if a mark of one color and high saturation is used as the mark 45, a trapezoidal distribution as shown in FIG. In other words, it is possible to prevent the determination of "color change" even if the subject person's hand shakes.

Step S6 ': (Detection of Color Change in Specified Portion) When the maximum value of the color distribution in the detection area is less than ρ, the control section 20 determines that there is a color change and shifts to step S7. That is, when the photographer 43 or the subject person 42 hides the mark 45 (FIG. 3B), the maximum value MA of the color in the color detection area is obtained.
Since X (R, G, B) is less than ρ and is out of the color range, the process proceeds to step S7 as a color change.

In the second embodiment, when the mark 45 and the background color appearing when the mark 45 is hidden are detected to have similar hues, the degree of hue change detected exceeds the allowable range ρ, and no imaging trigger is output. Therefore, the mark 45 of the subject person 42
It is preferable to use a color having a different hue from the background and a high saturation.

Third Embodiment Imaging by Detecting Motion of a Specified Part The first embodiment (FIG. 5A) and the second embodiment (FIG. 5B)
In the above description, the change in the luminance or the color of the designated portion is used as the trigger for imaging, but the detection of the movement of the designated portion (that is, the change in the designated portion) may be used as the trigger for imaging. In the present embodiment, the motion of the designated portion is detected using the image data of the digital camera 100 (integrated output of the color process circuit 131), but the motion detection method is not limited to this, and a known method may be used.

FIGS. 8A and 8B are diagrams showing an example of the integrated output distribution of the high frequency for AF used for detecting the motion of the designated portion. FIG. 8A is a distribution diagram of the integrated output at the previous sampling time, and FIG.
Is a distribution diagram of the integral output at the time of imaging when there is no motion,
(C) is a distribution diagram of the integral output at the time of imaging when there is a motion, and (d) and (e) are diagrams showing a change in a difference depending on the presence or absence of a motion. In this example, as a premise, the user selects an imaging mode to perform imaging. On the subject side, one of the subject persons 41 and 42 has a mark (for example, a handkerchief) as shown in FIG.

(Example of operation) In FIG.
S3 and steps S7 to S10 are the same as the operation in FIG. 5A, and the operation of steps S4 ″ to S6 ″ will be described below.

Step S4 ″: (Specification of Motion Detection Area) After the operation of designating the mark in step S3 is completed, the control unit 20 sets the position (coordinates) of the designated portion, that is, the rectangular portion including the position of the cursor 320 on the liquid crystal finder. ), That is, from the coordinates of the four corners of the rectangular frame, the image storage area 15
1, the detection area ｛(x1, y1), (x2, y1),
(X1, y2), (x2, y2)} are specified (calculated) as a motion detection area.

Step S5 ″: (Sampling of integrated output of detection area) The control unit 20 determines the specified motion detection area ｛(x1, y
1), (x2, y1), (x1, y2), (x2, y
2) The high-frequency integrated output for AF in (1) is sampled at fixed time intervals t. That is, in the imaging mode, the high frequency signal for AF is output by the color process circuit 131 based on the input image signal and is integrated by the integrator 1314 for AE, so that the detection area section (x2-x1 (FIG. 8)) The integrated value can be stored in the RAM (or the DRAM 15) of the control unit 20, sampled at every time t, and the previous and current sampled values can be held.

The AF at the previous sampling time t0
The output of the filter 1315 is defined as Y0 _{- t} (FIG. 8).
(A)), assuming that the integrated output when there is no movement of the subject (for example, a mark) in the detection area at this time is Y0 (FIG. 8).
(B)), the difference between the integrated output during If there is no motion time _t ΔY = Y0-Y0 _- t is a constant value C (FIG. 8
As shown in (d)), it becomes constant over the entire section (x2-x1). However, this time period when there is motion in the object at t just before the integration output Y0 _- difference integral output Y'0 at _t and the imaging time ΔY '= Y0-Y'0 _{- t} is (FIG. 8
It fluctuates on the section as shown in (e)). Therefore, AF
It is checked whether or not the difference between the integration value one time before the integration value of the high frequency for use and the integration value this time is within a threshold ρ in a section (x2−x2). It shall be assumed.

Step S6 ": (Motion Detection) The control unit 20 determines that the difference between the previous sampling value (integrated value) in step S5" and the current sampling value (integrated value) is in the section (x2-x1). It is checked whether it is within the threshold ρ or not. That is, in the example of FIG.
Alternatively, when the subject person 42 greatly moves the mark 45, the sampling value of the high frequency integration value for AF in the motion detection area is different from the previous sampling value, and if the sampling value exceeds the threshold value ρ, the process proceeds to step S7. In addition,
In the above step S5 ″, ideally, the difference ΔY =
The case of Y0−Y0 _{− t} = C is the case of no motion. However, in practice, the vibration of the ground is transmitted even if the camera is fixed with a tripod or the like. It is desirable to determine the threshold value ρ within a range in which the vibration can be absorbed in view of the performance of the camera in consideration of practical factors such as the fact that the vibration can be ignored.

[Modification 1] Designation of Detection Area by Frame Cursor In the first to third embodiments, the rectangular portion (the rectangular portion containing all or most of the marks) obtained by dividing the liquid crystal finder 40 into n parts is used. Although the user has specified and specified the detection area (S1 to S4), instead of dividing the liquid crystal finder 40 into n and specifying a rectangular portion, a frame cursor is displayed and the mark portion is placed in the frame of the cursor. May be specified.

FIG. 9A is a flowchart showing the operation of a modification of the first to third embodiments, in which a mark is designated by a frame cursor. FIG. 10 is an explanatory diagram of a detection area specifying method using a frame cursor.

(Example of operation) In FIG.
Steps S5 to S10 are the same as the operations of steps S1 and S5 to S10 in FIG. 5 (a), (b), or (c). Hereinafter, the operation in steps T2 to T4 will be described.

Step T2: (Remote shooting mode setting) In step S1 (FIG. 5 (a)), after the subject image is captured and a through image is displayed on the liquid crystal finder 40, the photographer 43 picks up the image using the digital camera 100. After deciding the angle, fix the digital camera 100 at that angle,
When the automatic imaging mode setting button 35 is pressed, the automatic imaging mode is activated and the control unit 20 starts the execution control of the automatic imaging program, and sets a predetermined value (2 seconds in the embodiment) in the time counter.
Set. Further, a frame cursor 49 is displayed on the liquid crystal finder as shown in FIG.

Step T3: (Operation of Designating Marks) The photographer 43 operates the detection portion designating key 37 to move the frame cursor 49 so as to move all or all of the marks (white handkerchiefs) 45 ″ held by the person 42. (FIG. 10B) At this time, the inside of the frame of the frame cursor 49 is discriminated (ie, highlighted, inverted, blinking, etc.). The cursor (displayed so as to be recognizable separately from the part) makes it easy for the user to see which part is designated by the user. It enters the field of view of the camera (FIG. 10 (c)).

Step T4: (Specification of Detection Area) The control section 20 determines the image storage area of the DRAM 15 from the designated portion, that is, the position (coordinate) of the frame of the frame cursor 49 on the liquid crystal finder, ie, the coordinates of the four corners of the rectangular frame. 151 (x1, y1), (x2, y1), (x
(1, y2), (x2, y2)} are specified (calculated) and S5
(S5 ′ or S5 ″).

In step S3 ″ of the first modification,
When the mark 45 "is designated, the size of the frame of the frame cursor 49 may be reduced / enlarged in accordance with the mark 45" by operating a predetermined key. Thus, the entirety of the mark 45 "can be put in the frame, so that the accuracy of specifying the detection area is improved. In the first modification, the shape of the frame cursor 49 is rectangular, but is not limited thereto. A circle, an ellipse, or a rectangular triangle may be used. In step S2 ", a plurality of cursor frame shapes may be displayed so that a frame approximate to a mark can be selected. In the first modification, the frame cursor 49 is displayed and the mark 45 "is designated. However, a point cursor is displayed and moved so as to surround the mark 45" by key operation, or a pointing device such as a touch pen is used. Point around mark 45 "and mark 4
5 "may be specified.

[Modification 2] Automatic imaging in continuous shooting or moving image imaging mode In the first to third embodiments, an example in which imaging is performed by one trigger,
That is, the case of normal shooting in which one shutter operation is performed by one trigger to capture one frame of image has been described. However, in the automatic imaging method of the present invention, the trigger of shooting start and the end of shooting are separately determined by detecting a change in a designated portion of a subject. The present invention can be applied to the case of continuous shooting such as continuous shooting or moving image shooting. FIG. 9B is a flowchart illustrating an operation of a modification of the first embodiment, in which a change in luminance of a designated portion is used as a trigger for starting shooting and ending shooting for continuous shooting or moving image shooting. FIG. 11 is an explanatory diagram of an embodiment of a remote shooting method during continuous shooting or moving image shooting.

(Operation Example) Referring to FIG.
S5 is the step S in FIG. 5 (a), (b) or (c).
1 to S5 (or steps S1 to T5 in FIG. 9A)
The operation is the same as that described above. Hereinafter, the operation in steps T6 ′ to T9 ′ will be described (note that step S9 in FIG. 3A is canceled in this case). As a premise of explanation,
In FIG. 11, the user intends to perform continuous shooting (or moving image shooting) of the train 403 traveling from the right direction to the left direction, and as shown in FIG. It is assumed that it is designated as a landmark (Fig. 3
(S3 in FIG. 9A or T3 in FIG. 9A). When the user designates the sign 401 as a mark, a detection area is specified (S4), and a luminance range is determined (S5).

Step T6 ': (Detection of luminance change in detection area (designated portion)) The control unit 20 checks the change in the luminance distribution in the detection area by the same operation as step S6 in FIG. In some cases, the state transits to T7 '. That is, since the luminance does not change until the train 403 arrives after designating the mark 401 in FIG. 11A, the luminance detecting operation is repeated.
As shown in (b), when the train 403 arrives, the mark 401 is hidden by the train 403 and a change in luminance occurs, so that the transition is made to T7 '(first trigger). In addition, as shown in FIG. 11C, while the train 403 passes in front of the mark 401, the luminance does not change, so that the luminance detecting operation is repeated. Further, FIG.
As shown in (d), when the train 403 finishes passing in front of the mark 401, a transition to T7 'occurs because a luminance change occurs (second trigger).

Step T7 ': (Determination as to whether or not continuous shooting is in progress) If there is a luminance change in T6', the control unit 20
It is determined whether or not shooting is in progress (during continuous shooting or moving image shooting). If not, transition is made to T8 'and continuous shooting (or moving image shooting) is started.
The process transitions to 9 'to perform continuous shooting end processing (or moving image shooting end processing). It is to be noted that whether or not shooting is being performed is set, for example, by setting an imaging state determination flag in step T8 ', and the value thereof (for example, if imaging state determination flag = 1, imaging is in progress, imaging state determination flag = 0 at startup). Can be determined by checking.

Step T8 ': (Start of continuous shooting or moving image shooting) The controller 20 starts continuous shooting (or moving image shooting),
The subject images are fetched and sequentially stored in the DRAM 15 at regular time intervals. In addition, the captured subject image is
The live view is displayed at 0 (and the imaging state determination flag is set to 1 in the embodiment). It should be noted that the imaging operation is performed after the start of imaging until steps T6 ′, T6
The operation is performed by the image data input system 10 independently of the operation of 7 '.

Step T 9 ′: (Shooting end processing) When there is a second luminance change, the control unit 20 stops the image pickup, and sequentially reads the images (plurality) stored in the DRAM 15 by JP.
The EG compression is performed, and the data is stored and recorded in the flash memory 50. When the storage and recording of all the captured images are completed, the process ends.

In the second modification, the luminance reference K0 and the threshold Kn are set to the same value both at the start of photographing and at the end of photographing, but they may be different values. In the second modification, for the sake of explanation, an example in which a change in luminance of a designated portion is used as a trigger to start or end shooting is described. However, in step T6 ′, “hue change detection” or “motion detection” is performed. In this case, a change in hue or a change in movement of the designated portion can be used as a trigger for starting or ending shooting in the same procedure as in FIG. 9B.

In the second modification, step T8 '
In step T9 ', the captured images are sequentially stored in the DRAM 15, and when a second trigger (change) occurs, the DRAM 15
Is stored and recorded in the flash memory 50, but the captured image may be JPEG-compressed and stored and recorded in the flash memory 50 in step T8 '(in this case, step T9). ', The control unit 20 ends the shooting.)

<Embodiment 2> Automatic imaging by change in recognition result of mark In the imaging method of the present invention, when a user designates (or captures) a certain part of the subject as a mark by key operation or the like,
The imaging device performs recognition processing (or recognition processing after imaging) on the shape of the mark, and performs automatic imaging using a change in recognition result (for example, coincidence or non-coincidence) as a trigger.

[Circuit Configuration] FIG. 12 is a block diagram showing an example of a circuit configuration of a digital camera as an embodiment of an imaging apparatus to which the present invention is applied.
0 ′ is a bus 1, an image data input system 10, a control unit 20,
An operation unit 30, a display unit 40, a flash memory 50, an image recognition unit 70, and an image dictionary unit 80 are provided. In addition,
The sound output device 60 may be provided to perform imaging notification. Also, in FIG.
The configuration and functions up to 0 (and the sound output device 60 when performing imaging notification (described later)) are the same as those of the digital camera 100 in FIG.

The image recognizing section 70 recognizes the shape of the designated portion, and judges whether the image registered with the image dictionary section 80 matches or does not match the image obtained by the feature of the image. In addition,
The criterion for matching or non-matching is a known method (matching when the similarity (or distance) by the recognition processing is equal to or greater than a threshold,
The following cases may not be matched).

The image dictionary section 80 is provided in the flash memory 50, and stores an image pattern (normalized pattern) of the image necessary for image recognition and its characteristic data (the direction of the side (line segment), , The ratio between adjacent sides and opposing sides, the number of sides, the number of vertices, etc.) are registered. Further, it is also possible to extract a feature of the captured image and register the normalized pattern and the feature in the image dictionary unit 80.

[Image Pattern] Examples of image patterns include simple geometric figure patterns (square, rectangular,
(Triangles, circles, ellipses, polygons, stars, V-signs, etc.), those with different colors in the above figure patterns, emission of light pulses (white light rays, infrared rays, etc.), geometric figures shaped by human hands, etc. (For example, a V-sign or a circle made with a finger), a series of actions made with a human hand (for example, a block sign), but are not limited thereto.

[Embodiment 4] Specified mark (recognition target)
FIG. 13 is a flowchart illustrating an operation example (imaging based on the recognition result of a landmark) of the digital camera in the automatic imaging mode. FIG. 13A illustrates a state in which a registered image pattern is selected. An example in which a time when an image coincident with the image appears (or disappears) is used as an imaging trigger. FIG. 2B is a modified example in which an image of a specific part in the subject image matches an image pattern registered. When (or when there is a mismatch)
Is an example in which is used as an imaging trigger. For the purpose of description, the recognition target portion is designated by the frame cursor 49 (FIG. 10), and after the imaging preparation is completed and the photographer enters the field of view of the camera, a specific subject person issues a V-sign to trigger the imaging, An example in which automatic imaging is performed will be described.

(Operation Example) Step U1: (Automatic Imaging Mode Setting) In FIG. 13 (a), after the photographer determines the imaging angle of the digital camera 100, the digital camera 100 is fixed at that angle, and the automatic imaging mode setting is performed. Pressing the button 35 activates the automatic imaging mode.

Step U2: (Display of Image Patterns to be Compared) The control section 20 takes out the image patterns registered in the image dictionary section 80 and displays them on the liquid crystal finder 40 to urge the photographer to select. There are at most 1 registered image patterns
If the image cannot be displayed on the screen, the user can scroll to select a desired image pattern.

Step U3: (Selection of Image Pattern) The photographer selects a desired image pattern by operating a cursor moving key or the like. When an image pattern is selected, the control unit 20 stores the feature data of the image pattern in the R
It is stored (held) in the AM or DRAM 15. For example,
When the user selects the V-sign image pattern, the characteristic data (two line segments share one vertex of an angle within 45 ° and the vertex is on the lower side) is stored in the RA of the control unit 20.
M (or the DRAM 15).

Step U4: (Acquisition of subject image, through image display) The subject image is acquired, and the subject image is displayed through the liquid crystal finder 40.

Step U5: (Operation of Specifying Recognition Portion) The photographer 43 operates the detection portion specification key 37 to move the frame cursor 49, and the portion to be recognized of the through-displayed subject image ( For example, a mark is specified so that all or most of the mark is put in the frame (FIG. 10).
(B)). At this time, the inside of the frame cursor 49 is differentially displayed so that the user can easily see which part the frame cursor 49 designates (for example, the photographer recognizes the vicinity of the right breast of a certain subject person). Designated as a target portion, after which the photographer moves away from the camera and enters the field of view of the camera to become a subject). When the recognition target portion is specified, the size of the frame of the frame cursor 49 may be reduced / enlarged in accordance with the mark by a predetermined key operation. As a result, the entire recognition target can be put in the frame, so that the accuracy of specifying the detection area in the next step U6 is improved.

Step U6: (Identification and Extraction of Recognition Area) The control unit 20 determines the position of the designated portion, that is, the position (coordinates) of the frame of the frame cursor 49 on the liquid crystal finder, that is, the coordinates of the four corners of the rectangular frame. Detection area 画像 (x1, y1), (x2, y1), (x
1, y2) and (x2, y2)} are specified (calculated), the portions are cut out, stored in the DRAM 15, and transited to U7 (for example, when the subject person specified in step U5 is a finger in front of the right chest). When a V-sign is created with, a portion including the V-sign is cut out).

Step U7: (Feature Extraction Processing) The control section 20 controls the image recognition section 70 to perform image recognition processing. In the recognition processing, for example, the recognition target portion stored in the DRAM 15 is subjected to background processing to extract and normalize the V-sign image (for example, each side is divided by the maximum side to obtain a ratio to 1). At the same time, the characteristic data is extracted, and a difference between each extracted characteristic data and each characteristic data of the image pattern selected in step U3 is obtained (for example, the subject person specified in step U5 makes a V-sign with a finger). In this case, after extracting the V-sign image from the recognition target portion by the background processing, the characteristic data (two line segments share one vertex with an angle within 45 °, and the vertex Is found) and the difference from each feature is determined).

Step U8: (Match judgment) The control unit 20 calculates the distance X (mean square of the difference) between the recognition target part and the selected image pattern from each feature data obtained in the above step, and calculates the size and the threshold value. When the distance X <Ρ, it is determined that there is a match, and the process transits to U6. Also,
When X ≧ Ρ, it is determined that an image as an imaging trigger has not been output, and the process returns to U6 (for example, step U5
If the specified subject person is making a V-sign with a finger, the process transits to U6 if the square mean of the difference between the characteristic data of the V-sign and the V-sign of the image pattern is within Ρ).

Step U9: (Output of Imaging Trigger Signal) The control section 20 outputs an imaging trigger signal (imaging instruction signal) and activates the shutter mechanism (optical system 11) when the recognition result is "match" in step U8. Control. Note that, instead of controlling the shutter mechanism, the sound output device 60 (or a lamp display device for imaging notification) may be controlled by an imaging trigger signal, or the shutter mechanism or the imaging display signal may be controlled. The image recording / storing process may be performed without controlling the apparatus (transition to U11 omitting the next step U10).

Step U10: (Shutter operation (imaging and imaging notification)) The shutter mechanism operates the shutter button 36 in response to the imaging instruction signal, and emits a mechanical sound such as "sharp" to notify the subject person of the end of imaging. . During this time, the control unit 20 performs an imaging process and makes a transition to U11. In addition,
As described above (step U10), a sound or a voice message to the effect that “imaging has been completed” may be output to the sound output device instead of notifying that the imaging has been completed by the shutter operation, or “imaging is completed” may be performed using the display lamp. May be notified.

Step U11: (Storing and Recording Process of Captured Image) When it is determined in step U8 that they match, the DRAM 1
Image data captured (= imaged) in JP5
EG compression processing is performed, and the data is stored and recorded in the flash memory 50. In the fourth embodiment, the case where the coincidence is determined in step U8 is set as the imaging trigger. However, the coincidence is not determined (X ≧ Ρ).
May be set as the imaging trigger.

In the fourth embodiment, the image pickup is started from the time when the coincidence is determined. However, a plurality of image buffer areas for circulating and storing the picked-up images are set in the DRAM 15, and the fetched images are stored at predetermined time intervals. The image may be sequentially stored in a cyclic manner, and the image may be sequentially taken out from the image several seconds before the point of time when the coincidence is determined, and the imaging of the past image may be started (PAST imaging). Further, in the above-described embodiment, the imaging is started from the time when the coincidence determination is performed. However, the imaging may be terminated when the coincidence determination (or the non-coincidence determination) is performed in the case of continuous shooting or moving image shooting. Also,
In the above-described embodiment, the case where the image pattern is a V-sign is described. However, by registering the above-described image patterns to in the image dictionary 80, the image patterns can be used for various recognition targets. In the fourth embodiment, the shape of the frame cursor 49 is rectangular. However, the shape is not limited to this, and may be a circle, an ellipse, or a rectangular triangle. In step U5, a plurality of cursor frame shapes are displayed to approximate the mark. A frame may be selectable (see Embodiment 5). In the fourth embodiment, the frame cursor is displayed and the mark is specified. However, the point cursor is displayed and moved so as to surround the mark by key operation, or the mark is surrounded by a pointing device such as a touch pen. Pointing may be performed to designate a landmark.

[Third Modification] In the fourth embodiment, when a registered image pattern is selected and an image corresponding to the selected image pattern appears (or disappears), the imaging trigger is set. A time when an image of a specific part in the image matches a registered image pattern (or a time when the image pattern does not match) may be used as an imaging trigger. FIG. 13 (b)
The steps after step U9 are the same as the steps after step U9 in FIG. 13A (step U8 in FIG.
(In the case of (b), cancel).

(Operation Example) Step U1 ': (Capturing of Subject Image, Through Image Display) In FIG. 13B, the subject image is captured and the subject image is displayed through the liquid crystal finder 40.

Step U2 ': (Remote shooting mode setting) When the photographer 43 decides the shooting angle of the digital camera 100, fixes the digital camera 100 to that angle, and presses the remote shooting mode setting button 35, the shooting mode is set. Is activated.

Step U3 ': (Operation for Specifying Recognition Portion) The photographer 43 operates the detection portion specification key 37 to move the frame cursor 49 and to set a portion to be recognized in the through-displayed subject image. Is specified so that all or part of the At this time, the inside of the frame of the frame cursor 49 is differentially displayed so that the user can easily see which part the cursor designates. Also, the photographer designates the area around the right chest of a certain subject as a recognition target part,
Thereafter, the photographer moves away from the camera and enters the field of view of the camera to become a subject.

Step U4 ': (Cut out recognition area) The control unit 20 stores the image of the DRAM 15 from the designated portion, that is, the position (coordinates) of the frame of the frame cursor 49 on the liquid crystal finder, ie, the coordinates of the four corners of the rectangular frame. The detection area on the area 151 is calculated to specify the recognition target portion, which is cut out, stored in the DRAM 15, and transits to U5 '.

Step U5 ': (Image Recognition Processing) The control section 20 controls the image recognition section 70 to perform image recognition processing. In the recognition process, for example, a recognition target portion stored in the DRAM 15 is subjected to background processing to extract a V-sign image, and is also normalized and its characteristic data is extracted.

Step U6 ': (Search of Image Dictionary Unit) The control unit 20 searches the image dictionary unit 80 and determines the difference between each feature data of the image pattern registered and each feature data of the extracted partial image. obtain.

Step U7 ': (Match determination) The controller 20 calculates the distance X (the mean square of the difference) between the recognition target portion and the selected image pattern from the difference between the respective feature data obtained in the above step, and The size is compared with the threshold value Ρ, and when the distance X <Ρ, it is determined that they match, and the process transits to U9. When X ≧ Ρ, it is determined that no image as an imaging trigger has been output, and the process returns to U6 ′ to search for the next image pattern.

[Fifth Embodiment] Example in which imaging is performed by using a change in a captured image as a trigger In this embodiment, imaging is performed using a change in a captured image captured by digital camera 100 (in this example, disappearance due to movement) as a trigger. This is an example, and is a case where a golf swing is continuously photographed.

FIG. 14 is a diagram showing an example of the layout of the DRAM 15 in this embodiment, and FIG. 15 is an explanatory diagram of a trigger image and an imaging timing of continuous photographing in an example of a golf swing. FIG. 16 is a flowchart illustrating an operation example of the digital camera in the automatic imaging mode, and illustrates an example of PAST imaging due to a change in a captured image. In order to photograph before and after the moment of the impact of golf, it is necessary to store an image that is past a predetermined time from the moment of the impact. In this embodiment, as shown in FIG. 14, a plurality of image buffers (G (1) to G (n) in this example) 181 for sequentially and cyclically storing images continuously captured in the DRAM 15 and a trigger image storage 181 are provided. The trigger image buffer 182 is secured.

FIG. 15A shows a golf ball 161 set on a tee 162, and FIG. 15B shows a captured trigger image 160 for comparison (the golf ball 161).
And a partial image comprising a tee 162). Also,
(C) is a diagram showing the movement of the golf club before impact, and corresponds to a PAST image. (D) is a diagram showing the movement of the golf club after the impact, and FIG.
Corresponds to an image. FIG. 4E is a diagram illustrating an imaging timing when a trigger image changes during continuous imaging. Before the impact, as shown in FIG.
Since the image in the designated portion 165 of the through image, which coincides with 0, disappears after the impact as shown in (d), it triggers the imaging. In this example, however, in this example, several seconds ( t) Inconsistency between the trigger image and the image (FASTURE image) during which several seconds (t ') have elapsed since the impact and the image (PAST image) from the point in time to the impact (loss of golf ball and tee)
Is used. Hereinafter, description will be made based on the flowchart of FIG.

Step V1: (Capturing of subject image, through image display) The subject image is captured and the subject image is displayed through the liquid crystal finder 40.

Step V2: (Remote Shooting Mode Setting) When the photographer 43 determines the shooting angle of the digital camera 100, fixes the digital camera 100 to that angle, and presses the automatic shooting mode setting button 35, the automatic shooting mode is set. Is activated.

Step V3: (Trigger image (comparative image)
In the through image, when the photographer has an image (or a part of the through image like the golf ball in FIG. 14) to be used as the trigger image (comparison image), the photographer uses the frame cursor movement designation key 3
The user operates the shutter button 36 to operate the shutter button 36 to specify the image with the frame cursor, and captures the image.

Step V4: (Background processing and storage of trigger image) The control unit 20 stores the position information (in the embodiment, the coordinates of the four corners of the rectangle including the portion) of the image part to be used as the trigger image in the RAM ( Alternatively, the trigger image is stored (held) in the work area 183) of the DRAM 15 and the trigger image within the rectangle is stored in the trigger image buffer 182 of the DRAM 15 (see FIG. 14B).

Step V5: (Continuous Shooting Mode Judgment) The control unit 20 checks the status signal from the operation unit 30, and transitions to V6 when the photographer selects the continuous shooting mode.

Step V6: (Image circulating storage, through image display) The control unit 20 stores the fetched image in the image buffers G (1) to G (1).
G (n) is sequentially stored and a through image is displayed.
The captured images are cyclically displayed at predetermined time intervals (for example, as shown in FIG.
Assuming that data is captured at intervals of 0.2 seconds, the data is cyclically stored every 3.2 seconds (the image stored 3.2 seconds before the current time is replaced with the current image).

Step V7: (Extraction of Comparison Target Part) The control unit 20 extracts a comparison target image part corresponding to the position of the trigger image from the currently acquired image (= through-displayed image).

Step V8: (Comparison with Trigger Image) Next, the control unit 20 compares the extracted partial image with the trigger image, and if they match, returns to V6 without any change, and returns to V6 if they do not match. (For example, before impact in FIG. 15, the golf ball 161 and the tee 16)
Therefore, when the golf ball 161 and the tee 162 disappear due to the impact, the golf ball 161 and the tee 162 disappear.

As a comparison method, for example, the pixels of the extracted partial image are inverted, and if all the logical products of the inverted partial image and the pixels of the trigger image become 1, a match is obtained, otherwise a mismatch is determined. it can. In this case, the logical product of the inverted partial image and the trigger image is set to 1 even if the logical image of the inverted image and the trigger image are not all set to 1 in consideration of the influence of the background and the adjustment of the light beam due to the golfer taking the swing posture. If a pixel falls below a predetermined threshold (for example, 40%), it may be determined that there is no match.

Step V9: (PAST photographing) When there is a change in the image, the control unit 20 uses the image as a trigger to store the image from the point in time retrospectively (for example, 1.6 seconds) from that point to the trigger point in the image buffer. Out of the flash memory 5
0 (for example, when an image is stored in G (16) at the time of triggering, the images stored in G (8) to G (16) are stored and stored as PAST images).

Step V10: (FUTURE photographing) After the PAST photographing, the control unit 20 takes out images from the image buffer until a predetermined time (for example, 1.4 seconds) from the trigger point, sequentially performs JPEG compression processing, and then flash memory. 50 (for example, G (1
When the image is stored in 6), the images stored in G (1) to G (7) are stored and stored as FUTURE images).

In the fifth embodiment, when the trigger image disappears, the shooting start is triggered. However, the shooting end trigger may be used. When the trigger image appears, the shooting start (or shooting end) trigger is used. You may make it.

Although several embodiments and modifications of the present invention have been described above, the present invention is not limited to the above-described embodiments and modifications, and it goes without saying that various modifications can be made. Absent.

[0119]

As described above, according to the imaging method and the imaging apparatus of the present invention, when a change occurs in a designated image portion, it is possible to use the trigger of the imaging as a conventional self-timer. It is possible to perform imaging at a desired timing without being restricted by the set time. Further, since a remote control unit is not required, there is no need to provide an extra structure, and the device does not become bulky.

The first to third imaging methods and the fifth to fifth imaging methods
According to the imaging apparatus of the ninth aspect, in addition to normal imaging in which one image is captured by one shutter operation, continuous shooting in which a plurality of images are captured in one shutter operation, and moving image in which a moving image is captured It is also possible to obtain the start and end timings of shooting at the time of shooting.

Further, according to the fourth imaging method and the imaging apparatus of the tenth aspect of the present invention, since the difference between the captured image and the designated image portion is used as a trigger, the timing at the time of capturing the PAST image can be simplified. Obtainable.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a circuit configuration example of a digital camera as one embodiment of an imaging device of the present invention.

FIG. 2 is a block diagram illustrating a configuration example of a color process circuit.

FIG. 3 is an explanatory diagram of an embodiment of an imaging method according to the present invention.

FIG. 4 is an explanatory diagram of a detection area designating method by screen division.

FIG. 5 is a flowchart illustrating an operation example (imaging by detecting a change in a mark) of the digital camera in a remote shooting mode.

FIG. 6 is a diagram illustrating an example of a luminance distribution of a designated portion.

FIG. 7 is a diagram illustrating an example of a color distribution of a designated portion.

FIG. 8 is a diagram illustrating an example of an integrated output distribution of high frequency for AF used for motion detection of a designated portion.

FIG. 9 is a flowchart showing an operation example (modification) of the digital camera in the remote shooting mode.

FIG. 10 is an explanatory diagram of a detection area designation method using a frame cursor.

FIG. 11 is an explanatory diagram of one embodiment of an automatic imaging method at the time of continuous shooting or moving image shooting.

FIG. 12 is a block diagram illustrating a circuit configuration example of a digital camera as one embodiment of the imaging apparatus of the present invention.

FIG. 13 is a flowchart illustrating an operation example (imaging based on a recognition result of a mark) of the digital camera in the automatic imaging mode.

FIG. 14 is a diagram showing a layout example of a DRAM.

FIG. 15 is an explanatory diagram of an imaging timing of continuous shooting using a golf swing as an example.

FIG. 16 is a flowchart illustrating an operation example of a digital camera in an automatic imaging mode (an example of PAST imaging due to a change in a captured image).

[Explanation of symbols]

20 control unit (image state comparison means, imaging control means, image extraction means, image comparison means) 37 detection part designation key, frame cursor movement instruction key (part designation means, comparison image extraction means) 45 cursor (part designation means, comparison Image extraction means) 49 Frame cursor (part designation means, comparison image extraction means) 50 Through image (subject image displayed as a moving image) 70 Recognition processing unit (image recognition means) 80 Image dictionary unit (image pattern registration means) 131 color Process circuit (image state detection means)

 ────────────────────────────────────────────────── ─── Continued on the front page (72) Inventor Tsuyoshi Matsunaga 3-2-1 Sakaemachi, Hamura-shi, Tokyo Casio Computer Co., Ltd. Hamura Technical Center F-term (reference) 5C022 AA13 AB31 AB64 AB65 AC00 AC03 AC13 AC52 AC69

Claims (10)

[Claims] 1. A trigger for starting or terminating imaging when a desired portion of a displayed subject image is designated and then the designated desired portion changes as compared with a state when the designated portion is designated. An imaging method characterized by the following. 2. An imaging method characterized in that a time when a designated portion of a displayed subject image matches a registered image pattern is used as a trigger to start or end imaging. 3. An imaging method, characterized in that a time when a designated portion of a displayed subject image does not match a registered image pattern is used as a trigger to start or end imaging. 4. When a designated portion of an image captured at a predetermined angle of view is different from an image portion corresponding to the specified portion of a subject image displayed as a moving image at the predetermined angle of view, the image capturing is performed. An imaging method characterized by using as a trigger. 5. A part designating means for designating a desired image part in a displayed subject image; an image state detecting means for detecting a state of the image part designated by the part designating means; An image state of an image portion detected by the image state detecting means when specified by the means,
Then, an image state comparing means for comparing the image state of the image portion detected by the image state detecting means with the image state of the image portion, and an image of the partial image specified by the partial specifying means as a result of the comparison by the image state comparing means An imaging apparatus, comprising: imaging control means for triggering the start or end of imaging when a subsequent image state changes compared to the state. 6. The image pickup apparatus according to claim 5, wherein said image state detecting means detects a state of the image portion from a luminance, a hue, or a movement of a designated image portion. 7. An image pattern information registering means for registering an image pattern and its pattern data; an image pattern selecting means for selecting an image pattern registered in the image pattern information registering means; Part designating means for designating a desired image part, and an image part designated by the part designating means is cut out from the subject image, and the image part is extracted based on the pattern data of the image pattern selected by the image pattern selecting means. Image recognition means for recognizing the cut-out image portion; and, as a result of the recognition processing by the image recognition means, an image-pickup control means for triggering the start or end of image-pickup when the cut-out image portion matches the image pattern; An imaging device comprising: 8. The imaging control means according to claim 1, wherein, as a result of the recognition processing by said image recognizing means, when a cut-out image part and an image pattern do not match, a trigger to start imaging or end imaging is made. Item 8. The imaging device according to Item 7. 9. The image pattern includes the following (1) to
The imaging device according to claim 7, wherein the imaging device includes at least one of the patterns of (4). (1) geometric figure pattern, (2) pulse pattern, (3)
(4) A series of motion patterns expressed by human hands and the like. 10. A comparison image extracting means for extracting a desired image portion from an image captured at a predetermined angle of view, and said comparison image extracting means from a subject image displayed at the predetermined angle of view. An image extracting means for extracting an image part for comparison with the extracted comparative image; an image comparing means for comparing the image part extracted by the image extracting means with the comparative image; An imaging control unit that triggers imaging when the comparison image and the image portion are different, as an imaging trigger.