JP4742316B2 - Imaging apparatus, imaging method, and imaging control program - Google Patents

Description

  The present invention relates to an imaging apparatus, an imaging method, and an imaging control program that record a series of sequentially output frame images as a moving image.

Conventionally, a digital camera having both a moving image shooting function and a stopwatch function has been proposed. When the first shutter key operation is performed in the moving image shooting mode, the digital camera starts moving image shooting and starts a stopwatch function. If the shutter key is operated again during this action shooting, the movie shooting is stopped and the stopwatch function is stopped. Then, the clock data by the stopwatch function is recorded in association with each frame of the moving image during the first and second shutter key operation. Therefore, for example, when shooting a scene where a child is running during an athletic meet, the first shutter key operation is performed at the start, and the shutter key operation is performed again at the goal, so that from the start to the goal. A scene can be recorded with time (for example, refer to Patent Document 1).
JP 2005-73017 A

  By the way, when shooting a scene in a competition such as an athletic meet, not only the scene from the start of the competition to the goal, but also a series of scenes including the tense movement of the subject before the start and the movement with joy after the goal It is common to shoot. However, in the conventional digital camera described above, the stopwatch function is started in response to the first shutter key operation, so when the shutter key operation is operated to capture the movement of the subject before the start, Will start the stopwatch function. Therefore, a time lag occurs between the start of the stopwatch function and the start of the subject, and the time measurement data by the stopwatch function cannot be matched with the start of the subject. In addition, in order to shoot a movie of the movement of the subject after the goal as a series of scenes, if you continue to shoot without moving the shutter key again at the time of the goal, the stopwatch function will continue to function during that time, and the timing data will be Will continue to be recorded after the goal.

  Therefore, not only unnecessary time data is added before and after the period from the start to the goal of the subject that requires time data recording by the stopwatch function, but also the start of the subject that requires time data recording. From the start to the goal, it is not possible to record the timing data only from the start to the goal.

  The present invention has been made in view of such a problem, and provides an imaging apparatus, an imaging method, and an imaging control program that can record attached data while accurately matching the movement of a subject during moving image shooting. It is the purpose.

In order to solve the above-described problem, in the imaging apparatus according to the first aspect of the present invention, output means for sequentially capturing subject images and outputting temporally continuous frame images; and the output during a predetermined period A moving image recording means for recording a series of frame images sequentially output from the means as a moving image, and during the recording of the moving image by the moving image recording means, a predetermined change occurred in the moving image being recorded . In this case, the start means for starting the function of acquiring the non-image data that sequentially changes as time passes as the attached data, and the attached data sequentially acquired by the function started by the start means so that the time series match. And data recording means for recording in association with the series of moving images.

In the imaging apparatus according to claim 2, an output unit that sequentially captures subject images and outputs a temporally continuous frame image, and a series of sequential outputs from the output unit during a predetermined period When a predetermined change occurs in a moving image recording unit that records a frame image as a moving image and a series of moving images recorded by the moving image recording unit, the moving image recording unit sequentially changes over time. Ending means for ending the function of acquiring non-image data as attached data, and each attached data sequentially acquired by the function until the function is ended by the ending means so that the time series match. , Ru and a data recording means for recording in association with the series of moving images.

Further, in the imaging apparatus according to claim 3, further comprising a note-th image setting means for setting an attention image, to set the attention image by said target image setting means during said frame image, said it determines whether a predetermined change has occurred.

The imaging apparatus according to claim 4, further comprising a deriving unit that derives a focus evaluation value in a predetermined area of each frame image, and using the focus evaluation value derived by the deriving unit. Then, it is determined whether or not the predetermined change has occurred .

Further, in the imaging apparatus according to claim 5, wherein the function is a voice acquiring function, the adjunct data, Ru Oh voice data sequentially acquired by the voice acquisition function.

Further, in the imaging apparatus according to claim 6, wherein the function is a stopwatch function, the adjunct data is timing data that is sequentially acquired by the stopwatch function.

In the imaging method according to claim 7, an output step of sequentially capturing a subject image and outputting a temporally continuous frame image, and a series of outputs sequentially output by the output step during a predetermined period When a predetermined change occurs in a moving image recording step for recording a frame image as a moving image and a series of moving images recorded by the moving image recording step , the moving image is changed sequentially as time elapses. A start step for starting a function for acquiring non-image data as attached data and each attached data sequentially acquired by the function started by the start step are associated with the series of moving images so that the time series match. and a data recording step of recording Te.

In the imaging method according to claim 8, an output step of sequentially capturing a subject image and outputting a temporally continuous frame image, and a series of outputs sequentially output by the output step during a predetermined period When a predetermined change occurs in a moving image recording step for recording a frame image as a moving image and a series of moving images recorded by the moving image recording step, the moving image is changed sequentially as time elapses. An ending step for ending the function of acquiring non-image data as attached data, and until the function is ended by this ending step, each attached data sequentially acquired by the function is matched in time series. And a data recording step of recording in association with the series of moving images .

Further, in the claim 9 Symbol mounting an imaging control program, are sequentially output and an output means for outputting a frame temporally continuous images sequentially capturing a subject image, from said output means during a predetermined time period a computer having an imaging device and a video recording means for recording a sequence of frame images as a moving image, during the recording of a series of moving image by the moving image recording means, a predetermined change in the series of moving images in the recording In such a case, the start means for starting the function of acquiring the non-image data that changes sequentially with the passage of time as the attached data and the respective attached data sequentially acquired by the function started by the starting means match in time series. As described above, it is made to function as data recording means for recording in association with the series of moving images.

Further, in the claim 10 Symbol mounting imaging control program, are sequentially output and an output means for outputting a frame temporally continuous images sequentially capturing a subject image, from said output means during a predetermined time period During recording of a series of moving images by the moving image recording means, a computer having an imaging apparatus including a series of frame images as a moving image has a predetermined change in the series of moving images being recorded. Termination means for ending the function of acquiring the non-image data that changes sequentially as time passes as ancillary data if it occurs, and each accessory that is sequentially acquired by the function until the function is ended by the ending means It is made to function as a data recording means for recording data in association with the series of moving images so that the time series match.

  According to the present invention, a predetermined function is started on the basis of a series of moving images being recorded, and the series of moving images are set so that the time series of the attached data sequentially acquired by the started function is the same. Or a predetermined function is terminated based on a series of moving images being recorded, and the attached data sequentially acquired by the predetermined function is matched in time series until the function is terminated. As described above, since the recording is performed in association with the series of moving images, the attached data can be recorded in accordance with the motion of the subject during moving image shooting with high accuracy.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a schematic configuration of a digital camera 1 according to each embodiment of the present invention. The digital camera 1 can execute moving image shooting and still image shooting, and has a CCD 2 and a DSP / CPU 3. The CCD 2 is disposed on the optical axis of an optical system (not shown) composed of a focus lens, a zoom lens, and the like, and the DSP / CPU 3 performs various processes including image data compression / decompression and audio data processing. It is a one-chip microcomputer that has a digital signal processing function and controls each part of the digital camera 1.

  A TG (Timing Generator) 4 that drives the CCD 2 is connected to the DSP / CPU 3. Connected to the TG 4 is a unit circuit 5 to which an analog imaging signal corresponding to the optical image of the subject output from the CCD 2 is input. The unit circuit 5 includes a CDS that holds an input imaging signal, a gain adjustment amplifier (AGC) that amplifies the imaging signal, and an A / D converter (AD) that converts the amplified imaging signal into a digital imaging signal. The output signal of the CCD 2 is sent to the DSP / CPU 3 as a digital signal through the unit circuit 5.

  The DSP / CPU 3 is connected with a display device 6, a key input unit 7, a clock unit 8, an audio processing unit 9, and a strobe circuit 14, and has a buffer memory (DRAM) 11 built in via an address / data bus 10. A flash memory 12, a storage memory 13, and a target image memory 15 are connected. The buffer memory 11 is a buffer for temporarily storing image data of a subject that has been imaged by the CCD 2 and digitized, and is also used as a working memory for the DSP / CPU 3. The image data temporarily stored in the buffer memory 11 is compressed (encoded) by the DSP / CPU 3 and finally stored as still image data or moving image data having a predetermined format (JPEG method or the like). To be recorded. The built-in flash memory 12 stores an operation program of the DSP / CPU 3 and various data used for controlling each unit, and also stores an AF control program for driving the focus lens to execute autofocus (AF) control. Has been. The attention image memory 15 stores a first attention image and a second attention image described later.

  The display device 6 includes a color LCD and its driving circuit, and displays the subject image captured by the CCD 2 as a through image when in the shooting standby state, and is read from the storage memory 13 and expanded when the recorded image is reproduced. Display a movie or still image. The key input unit 7 includes a plurality of operation keys such as a shutter key, a strobe mode setting key, a playback key, a power key, a MENU key, a cross key, and the like, and a key input signal corresponding to a key operation by the user is sent to the DSP / CPU 3. Output. The clock unit 8 has a calendar function that counts the date and time, a clock function, and a stopwatch function. The date / time data and the time data by the stopwatch function are supplied to the DSP / CPU 3 as necessary during shooting operation. Send to.

  The sound processing unit 9 includes a built-in microphone, an amplifier, an A / D converter, a built-in speaker, a D / A converter, and the like, and converts sound input to the built-in microphone into a digital signal when shooting in the shooting mode with sound. Send to DSP / CPU3. The audio data sent to the DSP / CPU 3 is recorded in the storage memory 13 together with the moving image data in a predetermined format. The audio data is reproduced together with the moving image data, converted into an analog signal, and output from the built-in speaker. The strobe circuit 14 includes a strobe tube as a light emitting means, and causes the strobe tube to emit light based on an instruction signal from the DSP / CPU 3 in response to an operation of a shutter key.

  Next, the operation of the present invention in the digital camera 1 having the above configuration will be described. When the power switch is set to ON, the DSP / CPU 3 executes processing according to the flowchart shown in FIG. 2 based on the program. That is, it is determined whether or not the moving image shooting mode is set (step S101). If the moving image shooting mode is set, it is determined whether or not the attention image setting mode in the moving image shooting mode is set (step S102). If it is set, the attention image setting process is executed (step S102). Step S103).

  FIG. 3 is a subroutine showing details of the attention image setting process. First, a through image is displayed on the display device 6, and a first target image setting frame is displayed on the display device 6 so as to be superimposed on the through image (step S201). It is determined whether or not the shutter key has been operated in this state (step S202). If the shutter key has been operated, the image in the first target image setting frame is stored in the target image memory 15 as the first target image. (Step S203). Accordingly, as shown in FIG. 4A, the through image 61 and the first attention image setting frame 62 are displayed on the display device 6, and “person A” exists in the first attention image setting frame 62. When the shutter key is operated in this state, the image of “person A” is stored in the attention image memory 15 as the first attention image.

  Subsequently, the second attention image setting frame is displayed on the display device 6 while being superimposed on the through image (step S204). It is determined whether or not the shutter key has been operated in this state (step S205). If the shutter key has been operated, the image in the second target image setting frame is stored in the target image memory 15 as the second target image. (Step S206). Accordingly, as shown in FIG. 4B, the through image 61 and the second attention image setting frame 63 are displayed on the display device 6, and the “goal tape T” is displayed in the second attention image setting frame 63. When the shutter key is operated in the existing state, the image of “goal tape T” is stored in the attention image memory 15 as the second attention image.

  It should be noted that the display positions of the first attention image setting frame 62 and the second attention image setting frame 63 on the display device 6 may be substantially the center of the display device 6 (a) or may be a biased position (b). Good. Further, both setting frames 62 and 63 may have different shapes or the same shape as shown in the figure. Furthermore, the size, position, and shape of both setting frames 62 and 63 are set in the key input unit 7. It may be arbitrarily changed by operation.

  In this way, when the user sets the first and second attention images and then releases the attention image setting mode, the determination in step S102 in the flowchart of FIG. 2 becomes YES. Accordingly, the process proceeds from step S102 to step S104, and the first target image setting frame 62 is superimposed on the through image and displayed in the same manner as described above. Next, it is determined whether or not the first target image (“person A”) is present in the first target image setting frame 62 (step S104). During this time, the user adjusts the direction of the digital camera 1 so that the attention image (“person A”) enters the first attention image setting frame 62 while watching the display unit, and prepares for moving image shooting. If the target image (“person A”) enters the first target image setting frame 62, it is determined whether or not the shutter key has been operated (step S106). Shooting is started (step S107).

  By starting the moving image shooting, frame image data output from the CCD at a predetermined frame rate is accumulated in the buffer memory 11. However, at this time, only moving image shooting is started, and the stopwatch function described later is not started. Therefore, a series of frame image data in which time data is not recorded is temporarily stored in the buffer memory 11 as a moving image. Therefore, when a user shoots a scene in a competition such as an athletic meet, a video of the tense movement of “person A” before the start, or “person A until standing on the start line as shown in FIG. Even when the digital camera 1 takes a moving image, the time data of the frame image during this period is not added and recorded. Note that the first attention image setting frame 62 displayed on the display device 6 is deleted with the start of the moving image shooting.

  Next, based on a series of frame images sequentially stored in the buffer memory 11, whether or not the first image of interest ("person A") has changed from static to motion (step S108), that is, for a predetermined time ( For example, about 1 to 3 seconds) whether or not a motion has occurred after being stationary (more specifically, whether or not the same number of frames has changed since the same state has continued), or an image of interest (“person A”) ) Whether or not the focus evaluation value has changed (decreased) (step S109).

  That is, as shown in FIG. 6 (a), the athlete including “person A” arrives at the position on the start line in the student race, and when starting, stops in the “arrived at position” state, pistol sound Along with (Ban), the start operation shown in (b) is performed, so that the movement changes from static to dynamic. Therefore, the start of the stopwatch function and the start of the first attention image (“person A”) are started by starting the stopwatch function according to the change of the first attention image (“person A”) from static to motion. It is possible to match the start accurately.

  In the state where the focus lens is driven and the auto focus (AF) control is performed as described above, as shown in FIG. 6A, “person A” reaches the position on the start line and starts. In this case, it is assumed that the focus frame 64 used for autofocus matches “person A”, and the focus evaluation value used for autofocus in the focus frame 64 is in a peak value state. Then, when the “person A” shifts to the started operation shown in (b) with the pistol sound (van), the image blur and the distance to the subject (“person A”) due to the operation change. The focus evaluation value changes (decreases). Therefore, by starting the stopwatch function according to the change in the focus evaluation value, it is possible to accurately match the start of the stopwatch function and the start of the first image of interest (“person A”).

  Then, when any of these steps S108 and S109 becomes YES, the stopwatch function of the clock unit 8 is started (started), and time data measured by the start of the stopwatch function is sequentially output. It is synthesized and recorded on a part of the frame image (step S110). Further, the second attention image setting frame 63 is displayed superimposed on the through image (step S111), and the second attention image (“goal tape T”) is displayed in the second attention image setting frame 63. It is determined whether or not it exists (step S112). At this time, if the “person A” has not yet reached the vicinity of the goal tape T (the state in the center of FIG. 5), the second attention image (in the second attention image setting frame 63). There is no “goal tape T”). Therefore, during this time, as shown in FIG. 6C, moving images (frame data) in which “person A” or the like is traveling near the center of the track are accumulated in the buffer memory 11 together with time data. It becomes.

  Then, as shown in FIG. 7D, when “person A” reaches the vicinity of the goal line, the lens of the digital camera 1 that is taking a video while tracking the “person A” is also directed to the vicinity of the goal line. In this state, the second target image (“goal tape T”) is present in the second target image setting frame 63. Therefore, the determination in step S112 is YES. Next, based on a series of frame images sequentially stored in the buffer memory 11, whether or not the moving image of the second target image (“goal tape T”) has changed from static to dynamic (step S113), or It is determined whether or not the focus evaluation value of the target image (“goal tape T”) has changed (decreased) (step S114).

  That is, as shown in FIG. 7 (d), the “goal tape T” is in a straight line state until the player finishes the goal in the straight run, and as shown in FIG. When touching, it changes along with this. Therefore, by stopping the stopwatch function according to the change from static to motion of this second attention image ("goal tape T"), the stopwatch function can be accurately matched with the competitor's goal. Can do.

  Further, in the state where the focus lens is driven and the autofocus (AF) control is performed as described above, it is assumed that the focus frame used for autofocus matches the “goal tape T” in the vicinity of the goal. The focus evaluation value used for autofocus within 64 is in a peak value state. Then, as shown in FIG. 7E, when “person A” comes into contact with “goal tape T” along with the goal of “person A”, image blur and subject ( As the distance to “goal tape T”) changes, the focus evaluation value changes (decreases). Therefore, by stopping the stopwatch function in accordance with the change in the focus evaluation value, the stopwatch function stop and the goal of “person A” shown in FIG.

  Therefore, when any of these steps S113 and S114 becomes YES, the stopwatch function of the timepiece unit 8 is stopped (of course) and recording of time data is also stopped (step S115). However, the accumulation of moving images in the buffer memory 11 is continued without being stopped. Therefore, in order to shoot a movie of the movement of “person A” after the goal as a series of scenes, the time data is combined with the image image stored in the buffer memory 11 during this time even if movie shooting is continued after the goal. Absent.

  In this way, when the user who has taken a moving image of the movement of “person A” after the goal operates the shutter key again to stop moving image shooting, the determination in step S116 becomes YES. Therefore, the process proceeds from step S116 to step S117, and the moving image shooting is stopped. Thereafter, a moving image composed of a series of frame images accumulated in the buffer memory 11 between the first shutter key operation and the second shutter key operation is converted into a moving image file and recorded and stored in the storage memory 13 together with the file name ( Step S118). As a result, the storage memory 13 stores a moving image that has been shot between the first shutter key operation and the second shutter key operation, and between the time when “person A” starts and the time when the goal is reached. A moving image file to which time data is attached is stored.

  In the present embodiment, the user registers the first image of interest and the second image of interest in advance. However, the image assumed on the manufacturer side is registered in advance. Also good. Further, in the present embodiment, when the stopwatch function is started and stopped, the change from the static to the dynamic of the second image of interest and the change in the focus evaluation value are detected. Only one may be used. Further, in the present embodiment, the case where the predetermined function is the stopwatch function and the attached data is the timing data acquired sequentially from the stopwatch function is shown, but the predetermined function is the voice acquisition function. The attached data may be audio data acquired sequentially by the audio acquisition function.

  Furthermore, in the embodiment, the case where the present invention is applied to a digital camera has been described. However, the present invention is not limited to this, and other mobile phone terminals with cameras, PDAs with cameras (Personal Digital Assistants). : A portable information terminal), a personal computer with a camera, and the like, and can be easily applied to any apparatus capable of shooting a moving image.

1 is a block diagram of a digital camera according to an embodiment of the present invention. It is a flowchart which shows the process sequence of the embodiment. It is a flowchart which shows the subroutine of an attention image setting process. It is a figure which shows the example of a front screen of an attention image setting. It is a schematic diagram which shows an example at the time of video recording. (A) is the state which arrived at the position in the start line, (b) is the state which started, (c) is a figure which shows the example of a table | surface screen of the state which is drive | working. (D) is a figure which shows the example of a table | surface screen of the state immediately before a goal, and (e) is the state immediately after a goal.

Explanation of symbols

1 Digital camera 2 CCD
3 DSP / CPU
4 TG
5 Unit Circuit 6 Display Device 7 Key Input Unit 8 Clock Unit 11 Buffer Memory 12 Built-in Flash Memory 13 Storage Memory 15 Target Image Memory 61 Through Image 62 First Target Image Setting Frame 63 Second Target Image Setting Frame 64 Focus Frame

Claims (10)

Output means for sequentially capturing subject images and outputting temporally continuous frame images;
Moving image recording means for recording a series of frame images sequentially output from the output means during a predetermined period as a moving image;
During the recording of a series of moving images by the moving image recording means, when a predetermined change occurs in the series of moving images being recorded, a function of acquiring non-image data that sequentially changes as time elapses is started. Starting means;
An image pickup apparatus comprising: data recording means for recording each attached data sequentially acquired by the function started by the start means in association with the series of moving images so that the time series match. Output means for sequentially capturing subject images and outputting temporally continuous frame images;
Moving image recording means for recording a series of frame images sequentially output from the output means during a predetermined period as a moving image;
During the recording of a series of moving images by the moving image recording means, if a predetermined change occurs in the series of moving images being recorded, the function of acquiring non-image data that sequentially changes as time passes is terminated. Termination means;
Data recording means for recording each attached data sequentially acquired by the function in association with the series of moving images so that the time series match until the function is ended by the ending means
Imaging device according to claim Rukoto equipped with. Further comprising a note-th image setting means for setting an attention image,
Wherein the frame image the attention image set by said target image setting means during imaging device according to claim 1, wherein that you determining whether the predetermined change has occurred. Derivation means for deriving a focus evaluation value in a predetermined area of each frame image ,
The imaging apparatus according to claim 1, 2 or 3 , wherein the focus evaluation value derived by the deriving means is used to determine whether or not the predetermined change has occurred . The function is a voice acquisition function,
The adjunct data, the imaging apparatus according to any one of claims 1 to 4, wherein the Oh Rukoto voice data sequentially acquired by the voice acquisition function. The feature is a stopwatch function,
The adjunct data, the imaging apparatus according to any one of claims 1 to 4, characterized in that the time counting data sequentially acquired by the stopwatch function. An output step of sequentially capturing subject images and outputting temporally continuous frame images;
A moving image recording step of recording a series of frame images sequentially output in the output step during a predetermined period as a moving image;
When a predetermined change occurs in the series of moving images during the recording of the series of moving images in the moving image recording step, a function of acquiring non-image data that sequentially changes as time passes as attached data is started . A starting step ;
A data recording method comprising: a data recording step of recording each attached data sequentially acquired by the function started in the start step in association with the series of moving images so that the time series match. An output step of sequentially capturing subject images and outputting temporally continuous frame images;
A moving image recording step of recording a series of frame images sequentially output in the output step during a predetermined period as a moving image;
During the recording of a series of moving images in the moving image recording step, if a predetermined change occurs in the series of moving images being recorded, the function of acquiring non-image data that sequentially changes as time passes is terminated. An end step;
A data recording step of recording each attached data sequentially acquired by the function in association with the series of moving images so that the time series match until the function is ended by the end step.
An imaging method comprising : An output unit that sequentially captures subject images and outputs temporally continuous frame images; and a moving image recording unit that records a series of frame images sequentially output from the output unit during a predetermined period as moving images. A computer included in the imaging apparatus ;
During the recording of a series of moving images by the moving image recording means , if a predetermined change occurs in the series of moving images being recorded, a function of acquiring non-image data that sequentially changes as time elapses is started. Starting means ;
An imaging control program that functions as data recording means for recording each attached data sequentially acquired by the function started by the starting means in association with the series of moving images so that the time series coincide with each other . An output unit that sequentially captures subject images and outputs temporally continuous frame images; and a moving image recording unit that records a series of frame images sequentially output from the output unit during a predetermined period as moving images. A computer included in the imaging apparatus;
During the recording of a series of moving images by the moving image recording means, if a predetermined change occurs in the series of moving images being recorded, the function of acquiring non-image data that sequentially changes as time passes is terminated . Termination means;
Until the function is terminated by the ending means, each attached data sequentially acquired by the function is caused to function as a data recording means for recording in association with the series of moving images so that the time series coincide with each other. An imaging control program characterized by the above.

Images