JP6089634B2 - Imaging apparatus, imaging method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program for processing images that are continuously captured.

  In general, when shooting fireworks that have been launched with a camera, the release operation is performed at the moment when the fireworks open, but it is difficult to capture the fireworks in a timely manner. For this reason, conventionally, for example, a technique has been disclosed in which exposure is performed automatically by controlling the shutter operation when the surroundings are rapidly brightened based on the luminance at the time of shooting (see Patent Document 1).

JP-A-6-202203

  However, in the technique of the above-mentioned patent document, it is possible to obtain an image shot at the timing when the launch fireworks are opened as an instantaneously brightened image, but the fireworks are open. However, depending on the brightness when the fireworks open, such as whether the fireworks are starting to open, fully open, or buds starting, the shooting timing will vary, and in addition to lack of uniformity, It is also difficult to obtain a clear image including the state from when the fireworks are launched to when they are opened.

  An object of the present invention is to appropriately capture a moment when a subject changes and to obtain a single image including a previous state.

In order to solve the above-described problems, an imaging apparatus of the present invention
Imaging means;
Detecting means for detecting a predetermined change by sequentially analyzing each one of the images taken during continuous shooting by the imaging means and not accompanied by synthesis ;
When a predetermined change is detected by the detection means, an acquisition means for acquiring a previous image photographed before that together with an image when the change was detected, and a subsequent image photographed thereafter;
Combining means for combining the images acquired by the acquiring means;
It is an imaging device characterized by comprising.

In order to solve the above-described problem, the imaging method of the present invention includes:
A process for detecting a predetermined change by sequentially analyzing only one image that is captured during continuous shooting by the imaging means and that is not accompanied by synthesis ;
When the predetermined change is detected, a process of obtaining a previous image taken before that together with an image when the change is detected, and a subsequent image taken after that,
A process of combining the acquired images;
It is the imaging method characterized by including.

In order to solve the above-described problems, the program of the present invention
Against the computer,
A function of detecting a predetermined change by sequentially analyzing only one image that is captured during continuous shooting by the imaging means and that is not accompanied by synthesis ;
A function of obtaining a previous image taken before and an image taken after that, together with an image when the change is detected when the predetermined change is detected;
A function of combining the acquired images;
It is a program for realizing.

  According to the present invention, it is possible to appropriately capture the moment when the subject changes and obtain a single image including the previous state, which is suitable for, for example, fireworks photography.

The block diagram which showed the basic component of the digital camera applied as an imaging device. The figure for demonstrating special continuous shooting mode. The flowchart for demonstrating the characteristic operation | movement of this embodiment started execution when it switches to special continuous shooting mode by operation of the mode change key 4a. The flowchart following the operation | movement of FIG. The figure for demonstrating the area | region setting flag F1 and the imaging | photography method flag F2. The figure for demonstrating special continuous shooting mode similarly to FIG. (1)-(3) is a figure for demonstrating the case where the movement of the to-be-photographed object within the detection area of a picked-up image is detected as a predetermined change in 2nd Embodiment. 9 is a flowchart for explaining a characteristic operation that is started when the mode is switched to a special continuous shooting mode in the second embodiment. The figure for demonstrating the special continuous shooting mode in 3rd Embodiment. The flowchart for demonstrating the characteristic operation | movement started when it switches to special continuous shooting mode in 3rd Embodiment. 11 is a flowchart following the operation of FIG.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(Embodiment 1)
First, a first embodiment of the present invention will be described with reference to FIGS.
The present embodiment exemplifies a case where the present invention is applied to a digital camera as an imaging device, and FIG. 1 is a block diagram showing basic components of the digital camera.
The digital camera is a digital compact camera that can shoot moving images in addition to still images. In addition to basic functions such as the imaging function and timekeeping function, the digital camera shoots multiple subjects continuously according to shooting instructions. A continuous shooting function, a self-timer shooting function for starting shooting after a predetermined time from the shutter operation, and the like are provided. The control unit 1 operates by supplying power from the power source unit (secondary battery) 2 and controls the overall operation of the digital camera in accordance with various programs in the storage unit 3. A CPU (Central Processing Unit) and a memory (not shown) are provided.

  The storage unit 3 includes, for example, a ROM, a flash memory, and the like, and stores a program and various applications for realizing the present embodiment in accordance with an operation procedure illustrated in FIGS. 3 and 4 to be described later. A program memory 3a, and a work memory 3b for temporarily storing various information necessary for the operation of the imaging apparatus (for example, a flag, a self-timer measurement time). The storage unit 3 may include a removable portable memory (recording medium) such as an SD card or an IC card, and is connected to a network via a communication function (not shown). The state may include a storage area on a predetermined server device side.

  The operation unit 4 is a push button type key, which is a mode change key 4a for arbitrarily switching between a shooting mode for enabling shooting (for example, a special continuous shooting mode described later) and a playback mode for playing back a captured image. And a shutter key 4b for instructing the start of shooting, and various keys (not shown) for setting shooting conditions such as exposure and shutter speed. The control unit 1 includes the operation unit 4 For example, a mode change process, a shooting process, a shooting condition setting process, and the like are performed in accordance with an input operation signal output corresponding to the operation key. The display unit 5 is, for example, a monitor screen (live view image) that displays a captured image (live view image) on a high-definition liquid crystal display or an organic EL (Electro Luminescence) display having screens with different aspect ratios (width 4: height 3). View screen) or a playback screen for playing back captured images.

  Although not shown, the imaging unit 6 constitutes a camera unit capable of photographing a subject with high definition by forming a subject image from an optical lens on an imaging element (CCD, CMOS, etc.). (For example, a zoom lens), an image sensor, a strobe, various sensors, an analog processing unit, and a digital processing unit. The imaging unit 6 can capture moving images in addition to still images. The photoelectrically converted image signal (analog value signal) is subjected to color separation and gain adjustment for each RGB color component. After being converted, it is converted into digital value data. The digitally converted image data is subjected to color interpolation processing (demosaic processing) and displayed in full color on the display unit 5. Further, in the present embodiment, a continuous shooting function that continuously shoots a plurality of images (for example, 5 images) per second, and a long exposure time by opening the shutter for a predetermined time (for example, 2 seconds). A time exposure control function, an optical zoom function process, a digital zoom function, an auto focus process (AF process), an auto white balance adjustment process (AWB), an image compression process, an image restoration process, and the like can also be executed.

FIG. 2 is a diagram for explaining the special continuous shooting mode.
This special continuous shooting mode is a shooting mode with special effects suitable for shooting fireworks, etc., and the photographer switches to special continuous shooting mode when shooting fireworks as a subject and immediately before the fireworks are launched When the shutter key 4b is operated, the photographing lens is directed in the direction in which the fireworks are opened at the time of launch. When the shutter key 4b is operated in the special continuous shooting mode, the control unit 1 operates the continuous shooting function to start continuous shooting, and continuously capture still images in a predetermined file format (for example, RAW format). Are sequentially stored in the work memory 3b.

  By sequentially storing each still image continuously taken in this way in the work memory 3b, when the capacity becomes full, the oldest image at that time is overwritten with the latest image. . Note that the number of images that can be stored in the work memory 3b is, for example, 10 images depending on the continuous shooting speed. In the figure, P1 indicates a part of images (five in the illustrated example) that have been taken by the continuous shooting function and sequentially stored in the work memory 3b. In this way, the control unit 1 cyclically stores continuously photographed images in the work memory 3b that temporarily stores a predetermined number of photographed images in response to a photographing instruction by operating the shutter key 4b. A predetermined change (change in luminance) is detected by sequentially analyzing each image stored cyclically in the work memory 3b. That is, the control unit 1 measures the luminance of the captured image during continuous shooting using the continuous shooting function, and detects the predetermined change when the measured value reaches a luminance of a predetermined value or more. In the figure, a indicates a detection target area in a preset image, and the luminance is detected only within the detection area a. In the figure, P1a indicates an image in which a predetermined change is detected.

  The control unit 1 performs shooting in a state where the continuous shooting function is stopped and the long-time exposure control function is activated at the timing when the luminance reaches a predetermined value or more. In the figure, P2 is a long-exposure image taken immediately after the luminance reaches a predetermined value or more. In this way, the previous image taken before the detection timing is acquired from the image stored in the work memory 3b at the timing when the luminance reaches a predetermined value or more. That is, the control unit 1 acquires each image P1 (hereinafter, referred to as a previous image) taken before that including the image P1a when the luminance reaches a predetermined value or more, and obtains the last 10 previous images P1. After obtaining the composite image P3, the image P2 (hereinafter referred to as a post-image) taken after the luminance reaches a predetermined value or more, that is, the post-image taken by long exposure An image P4 obtained by combining the composite image P3 of P2 and the previous image is obtained. Hereinafter, an image P3 obtained by synthesizing the previous image P1 by continuous shooting is referred to as a pre-synthesized image, and an image P4 obtained by synthesizing the pre-composited image P3 and the post-image P2 taken by long exposure is referred to as a front-rear synthesized image.

  Next, the operation concept of the digital camera in the first embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. The same applies to other embodiments described later. In addition to the recording medium, an operation peculiar to the present embodiment can be executed using a program / data supplied externally via a transmission medium. 3 and 4 are flowcharts showing an outline of the operation of the characteristic part of the present embodiment in the entire operation of the digital camera. When the flow of FIG. 3 and FIG. Return to the main flow (not shown).

3 and 4 are flowcharts for explaining the characteristic operation of this embodiment that is started when the mode is switched to the special continuous shooting mode by operating the mode change key 4a.
First, the control unit 1 checks whether the shutter key 4b is operated in the special continuous shooting mode (step A1 in FIG. 3) or checks whether an area setting operation for setting the detection area a is performed (step A2). Then, it is checked whether the special continuous shooting mode has been canceled (step A4), or whether other operations have been performed (step A5). Now, when other operations are performed (YES in step A5), for example, processing for arbitrarily specifying a shooting method to be described later, processing for setting shooting conditions, or the like is performed as processing according to the operation. (Step A6). When the operation for setting the detection area a is performed (YES in step A2), the detection area a is set according to the input of the size and position of the detection area a, and the area setting flag shown in FIG. A process of turning on the flag by setting the value of F1 to “1” is performed (step A3). Thereafter, the process returns to the first step A1.

  Now, when the shutter key 4b is operated (YES in Step A1), the continuous shooting function is activated to start continuous shooting (Step A7), and the captured image is acquired from the imaging unit 6 (Step A8). Temporary storage is performed in the work memory 3b (step A9). Then, it is checked whether the detection area a is set based on the area setting flag F1 (step A10). If the value of the area setting flag F1 is “1”, that is, the detection area a is set (step A10). YES), the luminance in the detection area a is measured, and it is checked whether or not it is equal to or higher than a preset first threshold value (step A11). If the value of the area setting flag F1 is “0”, that is, if the detection area a is not set (NO in step A10), the luminance of the entire image is measured, and is equal to or higher than a preset second threshold value. A check is made (step A14).

  Here, if the measured luminance is less than the threshold value (NO in step A11 or A14), it is checked whether a predetermined time (for example, 10 seconds) has elapsed from the start of continuous shooting (step A12). If it is less than the predetermined time (NO in step A12), the process returns to the above step A8 to acquire the next photographed image. If the measured luminance is less than the threshold value even after the predetermined time has elapsed (in step A12). YES) After acquiring each image in the work memory 3b and synthesizing them, and performing a process of recording and saving the synthesized image by performing compression processing (step A13), the first step A1 is performed. Return. Moreover, if the measured brightness | luminance is more than a threshold value (it is YES at step A11 or A14), it will move to the flow of FIG.

  First, it is checked whether the value of the imaging method flag F2 shown in FIG. 5 is “0” (step A15). This shooting method flag F2 is a flag for specifying what kind of shooting should be performed immediately after the luminance reaches a predetermined threshold value or more. When the value is “0”, the long exposure as shown in FIG. However, when the value is “1”, the continuation shooting is continuously specified. If the value of the shooting method flag F2 is “0” (YES in step A15), the continuous shooting function is stopped (step A16), and then long exposure shooting is started (step A17).

  Then, the exposure is continued until a predetermined time for long exposure has passed (NO in step A18) (step A19), but when a predetermined time has elapsed since the start of long exposure (YES in step A18). ), The long exposure shooting is stopped (step A20). Then, an image corresponding to the capacity (predetermined number) is acquired from the work memory 3b as a previous image P1, and a pre-composited image P3 is obtained by synthesizing them (step A21). Next, this long-exposure photographed image is acquired as a rear image P2, and the front and rear composite image P4 is obtained by compositing the rear image P2 with the front composite image P3 (step A22). The front-rear composite image P4 obtained in this way is subjected to compression processing and recorded and saved (step A23). Thereafter, the process returns to the first step A1 in FIG.

  On the other hand, if the value of the shooting method flag F2 shown in FIG. 5 is “1” (NO in step A15), it is designated that continuous shooting should be continued even after the luminance reaches a predetermined threshold value or more. Therefore, the process proceeds to the next step A24, where it is checked whether or not a predetermined number of images (for example, 10 images depending on the continuous shooting speed) has been completed by continuous shooting after the luminance reaches a predetermined threshold value or more. Continuous shooting is continued until the predetermined number is reached (step A25). In this case, the control unit 1 sequentially stores each image taken after the luminance reaches a predetermined threshold value or more in the work memory 3b in the same manner as described above. The image and each subsequent image after reaching the predetermined threshold are sequentially stored in the work memory 3b separately. When the continuous shooting for a predetermined number of images is completed (YES in step A24), the continuous shooting function is stopped (step A26), and then the process proceeds to a process of combining the previous image and the subsequent image (steps A27 to A29). ).

  FIG. 6 is a diagram for explaining the special continuous shooting mode similarly to FIG. 2, in which continuous shooting is continued even after the luminance reaches a predetermined threshold value or more, until the luminance reaches the predetermined threshold value or more. Each image becomes the front image P1, while each image continuously taken after that becomes the back image P2. First, the control unit 1 obtains a predetermined number of previous images P1 from the work memory 3b and synthesizes them to obtain a previous composite image P3 (step A27). Next, a predetermined number of post-images P2 are obtained from the work memory 3b and are combined to obtain a post-composite image P5 (step A28).

  Thereafter, the control unit 1 obtains a front-rear composite image P4 by combining the pre-composite image P3 and the post-composite image P5 (step A29). The front-rear composite image P4 obtained in this way is subjected to compression processing and recorded and saved (step A23). Thereafter, the process returns to the first step A1 in FIG. Thereafter, the above-described operation is repeated until the shutter key 4b is operated in the special continuous shooting mode. When the special continuous shooting mode is canceled (YES in step A4 in FIG. 3), the flow of FIGS. 3 and 4 is exited.

  As described above, in the first embodiment, when the control unit 1 detects a predetermined change by sequentially analyzing a plurality of images continuously captured by the imaging unit 6, the change is detected. Since the previous image taken before that with the time image is acquired and synthesized, it is possible to appropriately capture the moment when the subject changes and obtain a single image including the previous state. .

  In response to a shooting instruction by operating the shutter key 4b, the control unit 1 cyclically temporarily stores continuously shot images in a work memory 3b that temporarily stores a predetermined number of shot images. A predetermined change is detected by sequentially analyzing each image stored cyclically in the work memory 3b at the start of the storage operation, and stored in the work memory 3b at the timing when the predetermined change is detected. Since the previous image taken before the detection timing is acquired from the image being detected, it is possible to acquire the most recent predetermined number of images based on the timing at which the predetermined change is detected.

  When a predetermined change is detected, the control unit 1 acquires a subsequent image taken after that, and combines the previous image and the subsequent image. Fireworks photography can be obtained by appropriately capturing each image from the moment when the fireworks start to open and each image from when the fireworks start to fully open until they completely open. It will be suitable for.

  After detecting a predetermined change, the control unit 1 acquires an image captured by the imaging unit 6 for a predetermined time (photographing for a long time by releasing the shutter for a predetermined time) as a subsequent image, and thereafter Since the image is synthesized with the previous image, for example, an image depicting a flowing trajectory from when the fireworks start to fully open until it finishes opening can be obtained as a subsequent image, and like the fireworks, This is effective for subject shooting that places importance on the subsequent image.

  Since the control unit 1 detects each predetermined change and then acquires each image continuously captured by the imaging unit 6 for a predetermined number of images as a subsequent image, the rear image is continuously shot together with the previous image. Depending on the continuous shooting speed, an image having a uniform flow or an image having a continuous flow can be obtained.

  Since the control unit 1 acquires the most recent predetermined number of images as the previous image captured before detecting the predetermined change and combines the predetermined number of previous images and the rear image, the rear image And the previous image can be obtained.

  Since the control unit 1 detects a predetermined change when the measured luminance value reaches a predetermined value or higher by sequentially analyzing each image photographed in succession, a conventional method is used. Instead of detecting the brightness when the fireworks open, the moment when the brightness changes significantly like when the fireworks start to open can be detected, and the moment when the fireworks start opening can be properly captured, Suitable for shooting fireworks.

  Since the control unit 1 detects a predetermined change in the detection area a set as a detection target in the predetermined area in the image, only by determining the composition so that the subject fits in the detection area a, It is possible to appropriately detect the change of the subject.

Since the front image and the back image are images shot under different shooting conditions (continuous shooting and long exposure shooting), it is possible to obtain an image obtained by combining the front image and the back image with different expressions. As a result, it is possible to expect an interesting image.
In addition, when combining the previous image and the subsequent image, if the background other than the subject to be photographed is bright as in the daytime and the luminance becomes too high when the image is combined, the luminance is decreased at the time of combining. Since the background is dark like fireworks at night, there is almost no change in brightness even after compositing, but if the subject you want to shoot is shot dark, make corrections such as increasing the brightness when compositing. It is desirable.

(Second Embodiment)
A second embodiment of the present invention will be described below with reference to FIGS.
In the first embodiment described above, the luminance change in the detection area a is detected as a predetermined change. In the second embodiment, the subject (for example, fireworks, The movement of an automobile or the like) is detected as a predetermined change. Furthermore, the timing at which a subject (fireworks, a car, etc.) enters the detection area a is detected, or the timing at which the object leaves the detection area a is detected. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

FIG. 7 is a diagram for explaining a case where the movement of the subject in the detection area a of the captured image is detected as a predetermined change.
FIG. 7A is a diagram showing an image taken during the fireworks launch. In the example shown in the figure, a case where fireworks on the way of launch passes through a plurality (two in the illustrated example) of detection areas a arranged vertically. Here, when the plurality of detection areas a are referred to as the detection area a1 and the detection area a2 according to the number, the control unit 1 causes the fireworks to enter the upper detection area a2 through the lower detection area a1. The timing at the moment is detected as a predetermined change. That is, the predetermined change detection timing indicates the timing of entering the last detection area a2 through the first detection area a1 in accordance with a detection order that is arbitrarily set in advance. Hereinafter, such a method of detecting an entry timing and photographing is referred to as “move-in”. When “move-in” is designated as a desired photographing method (photographing timing) in advance by the user, the method shown in FIG. The photographing timing flag F3 is set to “0”.

  FIG. 7 (2) is a diagram showing an image when a car is being photographed in the middle of passing. In the example shown in the figure, a case where the vehicle enters the plurality of (two) detection areas a1 and detection areas a2 arranged on the left and right and then exits from the detection area a2 is shown. The timing at the moment of leaving the detection area a2 on the right side through the detection area a1 is detected as a predetermined change. In other words, the detection timing of the predetermined change indicates the timing of exiting from the last detection region a2 through the first detection region a1 in accordance with a detection order that is arbitrarily set in advance. Hereinafter, such a method for detecting the exit timing and photographing is referred to as “move out”. When “move out” is designated as a desired photographing method (photographing timing) in advance by the user, FIG. The photographing timing flag F3 shown is set to “1”. As a method for detecting the entry timing and the exit timing, a known method is used, and the description thereof is omitted here.

FIG. 8 is a flowchart for explaining a characteristic operation that is started when the special continuous shooting mode is switched in the second embodiment, and shows an operation that replaces the flow of FIG. Since the operation following FIG. 8 is the same as the flow of FIG. 4 described above, description thereof will be omitted.
First, when the control unit 1 is switched to the special continuous shooting mode, it is checked whether or not the shutter key 4b is operated in the special continuous shooting mode (step B1), or an area setting operation for setting the detection area a is performed. (Step B2), whether or not the special continuous shooting mode has been canceled (Step B4), or whether other operations have been performed (Step B5).

  Now, when another operation is performed (YES in step B5), for example, a shooting timing flag F3 or the like is set to specify move-in / move-out, or shooting conditions are set as processing corresponding to the operation. Processing is performed (step B6). When the detection area a setting operation is performed (YES in step B2), the sizes and positions of the plurality of detection areas a are input and set as shown in FIG. 7 (1) or FIG. 7 (2). Or input and setting the detection order (step B3). Thereafter, the process returns to the first step B1.

  Now, when the shutter key 4b is operated (YES in step B1), the continuous shooting function is activated to start continuous shooting (step B7), the captured image is acquired (step B8), and the work memory 3b is stored. While temporarily storing (step B9), the value of an n counter (not shown) for sequentially specifying a plurality of detection areas a is set to an initial value “1” (step B10). Then, referring to the photographing timing flag F3, it is checked whether the value is “0” (step B11). If the value is “0”, that is, when “move-in” is designated (step B11). YES), whether or not it is detected that a moving body has entered the detection area a (n-th area) designated by the n counter is detected (step B12), and if no entry is detected (NO in step B12), Returning to step B8 described above, the next captured image is acquired, and the operation for detecting the entry of the moving body into the nth detection area a is similarly continued.

  When the entry of the moving object into the nth detection area a is detected (YES in step B12), it is checked whether the nth detection area a is the last area (step B13). Since the value is “1” (when the first detection area a1 is designated) and not the last detection area a (NO in step B13), “1” is added to the value of the n counter and the value is obtained. Is updated to “2” (step B14), and then the process returns to step B12 to check whether it is detected that the moving body has entered the detection area a. In the case shown in FIG. 7 (1), since it is detected that fireworks have entered the last detection area a2 (YES in step B12), it is determined that fireworks have entered this last detection area a2. Detect as a predetermined change. As described above, when the control unit 1 detects that the fireworks sequentially enter the plurality of detection areas a according to the detection order, the control unit 1 detects this as a predetermined change and proceeds to the flow of FIG. Similar to the embodiment, a process of combining the previous image and the subsequent image is performed.

  On the other hand, if the value is “1” as a result of referring to the photographing timing flag F3, that is, if “move out” is designated (NO in step B11), the detection area a (specified by the n counter) ( It is checked whether or not it has been detected that the moving object has left the area (step n15) (step B15), and if it is not detected (NO in step B15), the process returns to step B8 to obtain the next photographed image. Thereafter, similarly, the operation for detecting the exit of the moving body into the nth detection area a is continued. Here, when the exit from the nth detection area a is detected (YES in step B15), it is checked whether the nth detection area a is the last area (step B16).

  Here, if it is not the last detection area a (NO in step B16), after performing the process of adding "1" to the value of the n counter and updating the value to "2" (step B17), Return to B15. In the case shown in FIG. 7 (2), since it is detected that the car has left the detection area a2 which is the last area (YES in step B15), it is confirmed that the fireworks have left the last detection area a2. Detect as a predetermined change. As described above, when the control unit 1 detects that the fireworks have sequentially exited the plurality of detection areas a according to the detection order, the control unit 1 detects this as a predetermined change, and proceeds to the flow of FIG. 4. The process which synthesize | combines a front image and a back image like a form is performed.

  As described above, in the second embodiment, the control unit 1 detects a moving state of the subject in the detection area a as a predetermined change with a predetermined area in the image as a detection target. In this case, it is possible to appropriately detect a change in the subject simply by determining the composition so that the subject is within the detection area a.

  Since the control unit 1 detects that the subject has entered the detection area a as a predetermined change, the control unit 1 can detect the predetermined change at an appropriate timing depending on the subject and the shooting environment.

  Since the control unit 1 detects that the subject has left the detection area a as a predetermined change, the control unit 1 can detect the predetermined change at an appropriate timing depending on the subject and the shooting environment.

Since the control unit 1 detects the predetermined change when the fireworks or the automobile sequentially enters or leaves the plurality of detection areas a according to the detection order, for example, other than the desired subject (fireworks or the automobile) Even if another moving body crosses, it is possible to detect a desired change in the subject and prevent erroneous detection.
In the second embodiment described above, two detection areas have been described, but the number is not limited to this.

(Third embodiment)
Hereinafter, a third embodiment of the present invention will be described with reference to FIGS.
In the first and second embodiments described above, the special continuous shooting mode in the case of shooting fireworks as a subject has been shown. However, in this third embodiment, the self performs a golf swing by the self-timer shooting function. This shows a special continuous shooting mode when shooting a scene. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the third embodiment. .

FIG. 9 is a diagram for explaining the special continuous shooting mode in the third embodiment.
This special continuous shooting mode is a shooting mode with a special effect that is suitable for shooting a golf swing by the self-timer shooting function. After switching to the shooting mode, the shooting lens is directed in the shooting direction. As a result, the golf ball previously set in the shooting direction is reflected in the live view screen, and thus the stopped golf ball is designated as a moving subject (moving body). In the figure, P11 indicates a live view image when a moving object is designated. In this case, if the display unit 5 is configured by a touch display unit with a touch panel, the moving body (golf ball) can be easily specified by touching the display position of the golf ball.

  When the shutter key 4b is operated in the special continuous shooting mode, the control unit 1 starts the continuous shooting by operating the continuous shooting function when a predetermined time (self-timer time) has elapsed. Then, similarly to the first embodiment described above, the continuously shot still images are sequentially stored in the work memory 3b in a predetermined file format (for example, RAW format). When the control unit 1 detects a predetermined change of the moving body (the moment when the stopped golf ball starts to move) by analyzing the captured image every time the latest image is acquired from the imaging unit 6, After continuous shooting for a predetermined number of sheets (for example, 5 sheets), the continuous shooting function is stopped. In the figure, P12 indicates each image continuously shot for a predetermined number of sheets, and P12a indicates a predetermined change of the moving body, that is, an image at the moment when the stopped golf ball starts to move among the images P12. Show.

  The control unit 1 acquires the previous image P12 taken before that including the image P12a at the moment (immediately after the impact) when the stopped moving body (golf ball) starts to move, and then a predetermined number of images The images captured for (for example, five) are acquired as the rear image P13 and synthesized. In the figure, P14 indicates a composite image in this case. This composite image P14 is an image obtained by correcting all other images except for the image P12a at the moment when the golf ball starts to move (immediately after impact) into a semi-transparent image (image represented by a broken line in the figure). Yes.

FIGS. 10 and 11 are flowcharts for explaining characteristic operations that are started when the mode is switched to the special continuous shooting mode in the third embodiment.
First, the control unit 1 checks whether the shutter key 4b is operated in the special continuous shooting mode (step C1 in FIG. 10) or checks whether an operation for arbitrarily setting a moving body (for example, a golf ball) is performed. (Step C2), it is checked whether the special continuous shooting mode has been canceled (step C4), or whether other operations have been performed (step C5). When other operations are performed (YES in step C5), processing corresponding to the operations is performed (step C6), and when a moving body setting operation is performed (YES in step C2), FIG. In the preview image P11 shown, the golf ball and its position are set by touching the stopped golf ball (moving body) (step C3).

  When the shutter key 4b is operated (YES in step C1), a self-timer measurement operation is started (step C7) and waits until a time-out occurs (step C8). If a timeout is detected (YES in step C8), the continuous shooting function is activated to start continuous shooting (step C9), and the captured image is acquired (step C10). Then, the photographed image is temporarily stored in the work memory 3b (step C11), and it is examined whether a predetermined change of the moving body, that is, the moment when the stopped golf ball starts to move is detected (step C12).

  When the moment when the stopped golf ball starts to move is detected (YES in step C12), the flow proceeds to the flow of FIG. 11, and a predetermined number of images (for example, five) are shot after the start of the movement is detected. It is checked whether or not the shooting has been completed (step C13), and the continuous shooting operation is continued (step C14) until shooting for the predetermined number of sheets is completed (NO in step C13). YES), the continuous shooting function is stopped (step C15).

  Then, the previous image P12 taken before that including the image P12a at the moment (immediately after the impact) when the stopped moving body (golf ball) starts to move is obtained from the work memory 3b and synthesized. By doing so, a pre-synthesized image is obtained (step C16). Next, after image P13 for a predetermined number (for example, 5 images) is acquired and synthesized, a post-synthesized image is obtained (step C17). Thereafter, the front / rear composite image is obtained by combining the pre-composite image and the post-composite image (step C18). By performing a process of correcting all other front images and rear images to semi-transparent images except for the image P12a at the moment when the golf ball starts to move (immediately after impact) among the front and rear composite images obtained thereby. A front-rear composite image P14 as shown in FIG. 9 is obtained (step C19). Then, after performing a compression process or the like (step C20) for recording and saving, the process returns to the first step C1 in FIG.

  As described above, in the third embodiment, the control unit 1 detects the moment when the stopped subject (moving body) starts moving in the image as a predetermined change. Thus, it is possible to capture an instant that changes from stop to movement and obtain an image including before and after that, and to obtain an image optimal for the user to confirm the entire golf swing.

  The control unit 1 corrects all other front images and rear images to semi-transparent images except for the image P12a at the moment when the moving body starts to move among the front and rear composite images obtained by combining the front image P12 and the rear image P13. As a result, it is possible to obtain an image in which only the image immediately after the impact is clearly raised, but the images before and after the image are also visible, and the entire golf swing is very easy to see.

  In the third embodiment described above, the process of correcting the semi-transparent image after performing the synthesis of the previous image and the subsequent image is performed. However, before the previous image and the subsequent image are combined, the moving body moves. A process of correcting all other images to a semi-transparent image except for the image P12a at the start of the process may be performed.

  In the above-described third embodiment, each image obtained by continuously shooting golf swings using a golf ball as a moving body is synthesized. However, the present invention is not limited to golf swings. You may make it synthesize | combine each image | photographed image. In this case, the moment when the ball is struck with a cue may be detected as a predetermined change. Needless to say, the present invention is not limited to continuous shooting using the self-timer shooting function.

  In each of the above-described embodiments, when obtaining a composite image obtained by combining the previous image or a front-rear composite image obtained by combining the previous image and the subsequent image, the change of the moving object is discontinuous depending on the continuous shooting speed. You may make it perform the process which interpolates so that between moving bodies may continue with respect to such a discontinuous image. This makes it possible to fit a series of flowing motions into one image.

  In each of the embodiments described above, continuous shooting for a predetermined number of images is performed. However, continuous shooting for a predetermined time may be performed.

  In each of the above-described embodiments, a case where the present invention is applied to a digital camera as an imaging device has been shown. -You may make it apply to an electronic game etc.

  Further, the “apparatus” and “unit” shown in each of the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

The embodiment of the present invention has been described above. However, the present invention is not limited to this, and includes the invention described in the claims and the equivalent scope thereof.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
An imaging means for continuously shooting a plurality of images;
Detecting means for detecting a predetermined change by sequentially analyzing each image photographed during continuous photographing by the imaging means;
When a predetermined change is detected by the detection means, an acquisition means for acquiring a previous image taken before that together with an image when the change is detected;
Combining means for combining the images acquired by the acquiring means;
It is an imaging device characterized by comprising.
(Claim 2)
The invention according to claim 2 is the imaging apparatus according to claim 1,
In response to a shooting instruction, shooting control means for starting a cyclic storage operation for cyclically temporarily storing shot images continuously shot in a temporary memory for temporarily storing shot images for a predetermined number or a predetermined time. With
The detection means detects a predetermined change by sequentially analyzing each image stored cyclically by the imaging control means,
The acquisition means acquires a previous image taken before the detection timing from an image stored in the temporary memory at a timing when the predetermined change is detected.
The imaging apparatus is characterized by the above.
(Claim 3)
The invention according to claim 3 is the imaging apparatus according to claim 1 or 2,
The acquisition unit acquires a post-photographed image after the predetermined change is detected by the detection unit;
The synthesizing unit synthesizes the previous image and the rear image acquired by the acquiring unit;
The imaging apparatus is characterized by the above.
(Claim 4)
The invention according to claim 4 is the imaging apparatus according to claim 3,
The photographing means continuously performs photographing for a predetermined number of sheets or for a predetermined time after a predetermined change is detected by the detecting means,
The acquisition unit acquires a predetermined number of images or a predetermined time image captured by the imaging unit as a subsequent image,
The imaging apparatus is characterized by the above.
(Claim 5)
The invention according to claim 5 is the imaging apparatus according to claim 4,
An exposure control means for releasing the shutter over the predetermined time and exposing for a long time;
The photographing means performs photographing for a predetermined time in a state of long exposure by the exposure control means after a predetermined change is detected by the detecting means.
The imaging apparatus is characterized by the above.
(Claim 6)
The invention according to claim 6 is the imaging apparatus according to any one of claims 1 to 5,
The acquisition means acquires an image for the most recent predetermined number of sheets or for a predetermined time as a previous image taken before a predetermined change is detected by the detection means,
The imaging apparatus is characterized by the above.
(Claim 7)
Invention of Claim 7 in the imaging device in any one of Claims 1-6,
The detection means detects a predetermined change when a measured value of luminance reaches a luminance equal to or higher than a predetermined value by sequentially analyzing each of the plurality of images photographed continuously.
The imaging apparatus is characterized by the above.
(Claim 8)
The invention according to claim 8 is the imaging device according to any one of claims 1 to 7,
The detecting means detects a predetermined change in the predetermined area in the image as a detection target;
The imaging apparatus is characterized by the above.
(Claim 9)
The invention according to claim 9 is the imaging apparatus according to any one of claims 1 to 8,
The front image and the rear image acquired by the acquisition means are images captured under different shooting conditions,
This is an imaging apparatus.
(Claim 10)
According to a tenth aspect of the present invention, in the imaging apparatus according to any one of the first to sixth aspects, the eighth aspect, and the ninth aspect,
The detection means detects a predetermined area in the image as a detection target, and detects a moving state of the subject in the area as a predetermined change.
The imaging apparatus is characterized by the above.
(Claim 11)
The invention according to claim 11 is the imaging apparatus according to claim 10,
The detecting means detects that a subject has entered a predetermined area as a predetermined change;
The imaging apparatus is characterized by the above.
(Claim 12)
The invention according to claim 12 is the imaging apparatus according to claim 10,
The detecting means detects that the subject has left the predetermined area as a predetermined change;
The imaging apparatus is characterized by the above.
(Claim 13)
The invention according to claim 13 is the imaging apparatus according to any one of claims 10 to 12,
The detection means sequentially detects the plurality of areas according to the detection order when a plurality of areas are set as detection targets in the image and the detection order is set in association with each area. Is detected as a predetermined change,
The imaging apparatus is characterized by the above.
(Claim 14)
The invention according to claim 14 is the imaging apparatus according to any one of claims 1 to 6,
The detection means detects a moment when a stopped subject starts moving in the image as a predetermined change;
The imaging apparatus is characterized by the above.
(Claim 15)
The invention according to claim 15 is the imaging apparatus according to claim 14,
The combining unit corrects each image other than the image at the moment when the subject starts moving after combining each image acquired by the acquiring unit into a semi-transparent image,
The imaging apparatus is characterized by the above.
(Claim 16)
The invention according to claim 16 is the imaging apparatus according to any one of claims 9 to 15,
Correction means for performing a process of interpolating the moving bodies so as to be continuous by analyzing the image synthesized by the synthesis means when the moving state of the subject is detected as a predetermined change by the detection means; In addition,
The imaging apparatus is characterized by the above.
(Claim 17)
The invention described in claim 17
Detecting a predetermined change by sequentially analyzing each image photographed during continuous photographing by an imaging means that continuously photographs a plurality of images;
When the predetermined change is detected, obtaining a previous image taken before that together with an image when the change is detected;
Combining the acquired images;
It is the imaging method characterized by including.
(Claim 18)
The invention described in claim 18
Against the computer,
A function of detecting a predetermined change by sequentially analyzing each image captured during continuous shooting by an imaging means that continuously captures a plurality of images;
When the predetermined change is detected, a function of acquiring a previous image taken before that together with an image when the change is detected;
A function of combining the acquired images;
It is a program for realizing.

DESCRIPTION OF SYMBOLS 1 Control part 3 Memory | storage part 3a Program memory 4 Operation part 4a Mode change key 4b Shutter key 5 Display part 6 Imaging part a Detection area F1 Area | region setting flag F2 Shooting method flag P1 Previous image P2 Rear image P4 Front-back composite image

Claims (14)

Imaging means;
Detecting means for detecting a predetermined change by sequentially analyzing each one of the images taken during continuous shooting by the imaging means and not accompanied by synthesis;
When a predetermined change is detected by the detection means, an acquisition means for acquiring a previous image photographed before that together with an image when the change was detected, and a subsequent image photographed thereafter;
Combining means for combining the images acquired by the acquiring means;
An imaging apparatus comprising: In response to a shooting instruction, shooting control means for starting a cyclic storage operation for cyclically temporarily storing shot images continuously shot in a temporary memory for temporarily storing shot images for a predetermined number or a predetermined time. With
The detection means detects a predetermined change by sequentially analyzing each one image stored cyclically by the imaging control means,
The acquisition means acquires a previous image taken before the detection timing from an image stored in the temporary memory at a timing when the predetermined change is detected.
The imaging apparatus according to claim 1, which is configured as described above. The imaging means, after a predetermined change is detected by the detection means, further continues to shoot for a predetermined number of sheets or a predetermined time,
The acquisition unit acquires a predetermined number of images or a predetermined time image captured by the imaging unit as a subsequent image.
The imaging apparatus according to claim 1, wherein the imaging apparatus is configured as described above. Further comprising an exposure control means for exposing a long time to release the shutter over Jo Tokoro time,
The image pickup means, after a predetermined change is detected by the detection means, further performs one image of long exposure by the exposure control means,
The acquisition means acquires one image taken by the imaging means with long exposure as a subsequent image,
The imaging apparatus according to claim 1, wherein the imaging apparatus is configured as described above. The acquisition means acquires an image for the most recent predetermined number of sheets or for a predetermined time as a previous image taken before a predetermined change is detected by the detection means,
The imaging apparatus according to claim 1, wherein the imaging apparatus is configured as described above. The detection means detects a predetermined change when a measured value of luminance reaches a luminance of a predetermined value or more by sequentially analyzing each one image photographed in succession.
The imaging apparatus according to claim 1, wherein the imaging apparatus is configured as described above. The detecting means detects a predetermined change in the predetermined area in the image as a detection target;
The imaging apparatus according to claim 1, wherein the imaging apparatus is configured as described above. The detection means detects a predetermined area in the image as a detection target, and detects a moving state of the subject in the area as a predetermined change.
The imaging apparatus according to claim 1, wherein the imaging apparatus is configured as described above. The detecting means detects that a subject has entered or exited the predetermined area as a predetermined change;
The imaging apparatus according to claim 8, which is configured as described above. The detection means detects a moment when a stopped subject starts moving in the image as a predetermined change;
The imaging apparatus according to claim 1, wherein the imaging apparatus is configured as described above. The combining unit corrects each image other than the image at the moment when the subject starts moving after combining each image acquired by the acquiring unit into a semi-transparent image,
The imaging apparatus according to claim 10, which is configured as described above. A correction unit that performs a process of interpolating the subject to be continuous by analyzing the image synthesized by the synthesis unit when the moving state of the subject is detected as a predetermined change by the detection unit; Prepare
The imaging apparatus according to claim 8, wherein the imaging apparatus is configured as described above. A process for detecting a predetermined change by sequentially analyzing only one image that is captured during continuous shooting by the imaging means and that is not accompanied by synthesis;
When the predetermined change is detected, a process of obtaining a previous image taken before that together with an image when the change is detected, and a subsequent image taken after that,
A process of combining the acquired images;
An imaging method comprising: Against the computer,
A function of detecting a predetermined change by sequentially analyzing only one image that is captured during continuous shooting by the imaging means and that is not accompanied by synthesis;
A function of obtaining a previous image taken before and an image taken after that, together with an image when the change is detected when the predetermined change is detected;
A function of combining the acquired images;
A program to realize

Images