JP5151454B2 - Imaging device, recording / reproducing method, and program - Google Patents

Description

The present invention relates to an imaging device having a continuous shooting function and a playback function, an imaging device, a recording / playback method, and a program .

Conventionally, some digital cameras have a continuous shooting function. A digital camera having such a function can sequentially display a plurality of images taken continuously at a predetermined time interval or can display a plurality of images. Further, in recent years, as described in Patent Document 1, while increasing the time interval during continuous shooting, in the case of continuous playback display, by considering the frame rate of the display device to be played back, An image having a function for reproducing and displaying a variety of high-speed continuous images has been proposed (see Patent Document 1, FIGS. 4, 2, and 8).
JP 2006-33022 A

  However, in such a conventional technique, since the frame rate at the time of shooting is always constant, continuous shooting at the same frame rate is always forced from the start to the end of shooting. For this reason, even if an important scene occurs during shooting, the photographer cannot increase the number of shots for that scene, resulting in missed shooting. In addition, when it is possible to continuously take an unlimited number of images, there is a problem that it is difficult to search for an image in which a really important scene is recorded if an attempt is made to check while reproducing a large number of continuously shot images.

The present invention has been made in view of such a problem, and can perform continuous shooting at a time interval desired by a photographer even during continuous shooting, and can easily search for a desired image from continuously shot images. It is an object of the present invention to provide an image pickup apparatus, a recording / reproducing method, and a program that can be used.

In order to solve the above-mentioned problem, in the first aspect of the present invention, the imaging means, the image acquisition means for sequentially acquiring a plurality of images by driving the imaging means at a predetermined time interval, and the image acquisition means. By the change means for changing the predetermined time interval during acquisition by the time interval, the time interval storage means for storing the time interval changed by the change means in association with the image acquired at that time, and the change means Detection means for detecting the degree of change between a plurality of images sequentially acquired at changed time intervals, and when the degree of change detected by the detection means is greater than a predetermined degree, the plurality of detection targets an image synthesizing means for synthesizing the image, when sequentially reproducing the plurality of images, if the composite image among the plurality of images are synthesized by the image synthesizing unit, this It is interposed et plurality of images characterized by comprising a reproducing device for reproducing the composite image.

In addition, in the invention according to claim 2, in addition to the invention according to claim 1 , the image to be reproduced is associated with the time interval stored by the time interval storage means during reproduction by the reproduction means. And a notification means for notifying that the time interval has been changed .

In addition, in addition to the invention described in claim 2, the invention described in claim 3 includes a time measuring means for measuring an elapsed time from the start of acquisition by the image acquisition means, and an elapsed time measured by the time measuring means. Recording means for recording in association with a plurality of images sequentially acquired by the image acquisition means, wherein the time interval storage means associates the time interval changed by the change means with the elapsed information at the time of change. And the reproducing means sequentially reproduces the plurality of images recorded by the recording means, and the notifying means records the progress recorded in association with the image to be reproduced at the time of reproduction by the reproducing means. When the time reaches the elapsed time at the time of change stored by the time interval storage means, the fact that the time interval has been changed is notified .

According to a fourth aspect of the present invention, in addition to the third aspect of the present invention, a reproduction that stores reproduction speed information corresponding to the time interval changed by the changing means on the basis of the predetermined time interval. When the elapsed time recorded in association with the image to be reproduced reaches the elapsed time at the time of change stored by the time interval storage unit, the notification unit responds to the elapsed time. Then, based on the time interval stored in the change content storage means, it includes reproduction speed information display means for reading and displaying the corresponding reproduction speed information from the reproduction speed information storage means .

Further, in the invention according to claim 5, in the invention according to any one of claims 1 to 4 , further comprising an operation unit movable to an arbitrary position, the changing means is a position where the operation unit has moved. Based on the above, the time interval is changed.

In the invention according to claim 6, in the invention according to any one of claims 1 to 5, the image synthesizing unit calculates a motion vector of the target image between the plurality of images, and the motion vector is If the image is larger than a predetermined value, the image is larger than the predetermined degree, and a plurality of images to be detected are synthesized.

In order to solve the above-mentioned problem, in the invention according to claim 7, an image acquisition step of sequentially acquiring a plurality of images by driving the imaging unit at predetermined time intervals, and during acquisition by this image acquisition step, A change step for changing the predetermined time interval, a time interval storage step for storing the time interval changed by the change step in association with the image acquired at that time, and the time changed in the change step A detection step for detecting the degree of change between a plurality of images sequentially acquired at intervals, and when the degree of change detected in the detection step is greater than a predetermined degree, the plurality of images to be detected are an image combining step of combining, when sequentially reproducing the plurality of images, the composite image among the plurality of images are synthesized by the image synthesizing step Expediently, characterized in that it comprises a reproduction step of reproducing the composite image is interposed the plurality of images.

In order to solve the above-mentioned problem, in the invention according to claim 8, an image acquisition unit that sequentially acquires a plurality of images by driving the imaging unit at a predetermined time interval, and being acquired by the image acquisition unit Change means for changing the predetermined time interval, time interval storage means for storing the time interval changed by the change means in association with the image acquired at that time, time interval changed by the change means Detecting means for detecting the degree of change between a plurality of images sequentially acquired in step 1, and when the degree of change detected by the detecting means is greater than a predetermined degree, an image for synthesizing the plurality of images as detection targets When the combining means, when the plurality of images are sequentially reproduced, if a composite image between the plurality of images is combined by the image combining means, It is made to function as a reproduction means for reproducing the composite image intervening in the image.

  According to the present invention, the photographer can change the shooting time interval at the time of continuous shooting, and when sequentially reproducing a plurality of images taken continuously, the image of the image at the time of changing the shooting time interval is changed. Since confirmation can be easily performed, continuous shooting can be performed at a time interval desired by the photographer even during continuous shooting, and a desired image can be easily retrieved from continuously shot images.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. 1A and 1B are a front view and a plan view of a digital camera 1 according to the present embodiment. The digital camera 1 is provided with an imaging lens 2 on the front surface thereof as shown in FIG. 1A, and a power ON / OFF key 3 and a shutter on the upper surface as shown in FIG. A button 4 and a lever switch 5 are provided. The lever switch 5 can be rotated in the left-right direction from a predetermined neutral position on the periphery of the shutter button 4. Then, for example, by rotating to the right from the neutral position and stopping at the position, a signal for lowering the continuous shooting frame rate from 30 fps, which is the normal shooting frame rate, is output and turned to the left to By stopping at the position, a signal for increasing the continuous shooting frame rate to 30 fps, which is the normal shooting frame rate, is output. On the back side, a display unit 16 composed of an LCD, a mode setting key for selectively setting a still image shooting mode and a continuous shooting mode in a shooting mode, a playback mode, and a shooting mode are provided.

  FIG. 2A is a block diagram illustrating a schematic configuration of the digital camera 1. The digital camera 1 includes a control unit 7 connected to each unit via a bus line 6. The control unit 7 is a one-chip microcomputer that controls each unit of the digital camera 1, and includes a shooting frame rate control unit 71, a reproduction frame rate control unit 72, a clock unit 73, and a clock 74. The shooting frame rate control unit 71 variably controls the frame rate (time interval) at the time of shooting, and the playback frame rate control unit 72 variably controls the frame rate at the time of playback. The clock unit 73 is used when measuring shooting recording time in the continuous shooting mode, and the clock 74 is a timing generator and controls the CMOS 8.

  The CMOS 8 is disposed on the optical axis of the imaging lens 2 that includes a focus lens, a zoom lens, and the like. The unit circuit 9 is a circuit to which an analog imaging signal corresponding to the optical image of the subject output from the CMOS 8 is input. The unit circuit 9 is a CDS that holds the input imaging signal, and a gain adjustment amplifier that amplifies the imaging signal ( AGC), an A / D converter (AD) for converting the amplified imaging signal into a digital imaging signal, and the like. The output signal of the CMOS 8 is sent to the image processing unit 10 as a digital signal through the unit circuit 9 and subjected to various image processing.

  Further, an input unit 11, a program memory 12, a work memory 13, a storage unit 14, and a display driver 15 are connected to the bus line 6. The display driver 15 drives the display unit 16 disposed on the back surface of the digital camera 1. The input unit 11 includes the shutter button 4, the lever switch 5, and the like, and outputs a key input signal corresponding to a user operation to the control unit 7. The program memory 12 stores an operation program for the control unit 7 and various data used for control of each unit, and also stores an AF control program for driving the focus lens to execute autofocus (AF) control. Yes.

  The work memory 13 is a buffer for temporarily storing image data of a subject digitized after being imaged by the CMOS 8 and also used as a working memory for the control unit 7. The image data temporarily stored in the work memory 13 is compressed (encoded) by the control unit 7 and finally includes still image data of a predetermined format (JPEG format or the like) or a plurality of still image data. A file name (file name using the shooting date / time) is attached as moving image data (Motion JPEG format, MPEG-4 format, MPEG-4 AVC format, etc.), and the file storage area of the storage unit 14 shown in FIG. 143.

  The storage unit 14 is provided with a management area 141 and a change information memory area 142 together with the file storage area 143. The management area 141 is an area for temporarily storing a plurality of still image data acquired in the continuous shooting mode. In the change information memory area 142, as shown in FIG. 2C, an elapsed time and a frame rate are stored corresponding to the file name. The frame rate is a shooting frame rate within a corresponding time.

  In other words, in the illustrated example, the moving image data of the file name “20061006-01.avi” is stored with the elapsed time “02′00 ″ 74-04′30 ″ 30” at the frame rate “50 (fps)”. "20'00" 03 to 22'36 "77" is stored at a frame rate of "50 (fps)", and "22'36" 77 to 24'10 "35" is stored at a frame rate of "100 (fps)". Means that

  Further, in the present embodiment, “30 (fps)” is set as the normal shooting frame rate, and this normal shooting frame rate is not stored in the change information memory area 142 and is a frame rate different from the normal shooting frame rate. The change information memory area 142 is stored only when the image is taken. Therefore, the elapsed time in the illustrated example is the elapsed time when the frame rate is changed, and the frame rate “50 (fps)” of “02′00 ″ 74 to 04′30 ″ 30” is stored. Before "00'00" 00-02'00 "74" or between "02'00" 74-04'30 "30" and "20'00" 03-22'36 "77" "04'30" 30 to 20'00 "03" means that shooting was performed at the normal shooting frame rate of "30 (fps)".

  The program memory 12 stores in advance a reproduction speed table 121 shown in FIG. In this playback speed table 121, the playback speed information at normal playback = 30 fps and the playback speed information at slow playback = 10 fps corresponding to the recording frame rate (fps) “10” “30” “50” “100”, respectively. Playback speed information is stored. In other words, if the recording frame rate is “10”, the playback speed when normal playback = 30 fps is triple speed, so the playback speed information “× 3 times (fast forward)” is stored, and slow playback = 10 fps. Since the playback speed is 1 × speed, playback speed information “× 1 × speed” is stored.

  Next, the operation of the digital camera 1 having the above configuration will be described. When the power ON / OFF key 3 is turned on to set the shooting mode, a through image is displayed on the display unit 16. In this state, the control unit 7 executes processing according to the procedure shown in the flowchart of FIG. 4 according to the program stored in the program memory 12. First, it is detected whether or not the continuous shooting mode is selected (step S102). If the selection of the continuous shooting mode is not detected, the process proceeds to a still image shooting process (step S102).

  When selection of the continuous shooting mode is detected, it is determined whether or not the operation of the shutter button 4 is detected and shooting is started (step S103). If the operation of the shutter button 4 is detected in the continuous shooting mode, the clock unit 73 is activated to start counting the elapsed time in the continuous shooting mode (step S104). Subsequently, frame image data (still image data) is acquired at an imaging frame rate of 30 fps from an imaging unit including the CMOS 8, the unit circuit 9, the image processing unit 10, and the elapsed time is set in these frame image data. In addition, they are sequentially recorded in the work memory 13 (step S105).

  Next, it is determined whether or not a change in the frame rate due to the operation of the lever switch 5 has been detected (step S106). If no change in the frame rate is detected, it is determined whether or not the end of shooting due to the operation of the shutter button 4 is detected again (step S111). If the end of photographing in step S111 is not detected, the process returns to step S105, and acquisition of frame image data at the normal photographing frame rate of 30 fps is continued. Then, the end of shooting due to the operation of the shutter button 4 is detected again, and the process proceeds from step S111 to step S112. A plurality of sequentially recorded frame image data is converted into a file, a file name is given, and the file in the storage unit 14 is stored. Store in the storage area (step S112).

  However, when the user operates the lever switch 5 to change the shooting frame rate, the change in the frame rate is detected, the determination in step S106 becomes YES, and the process proceeds from step S106 to step S107. Then, the elapsed time when the change in the frame rate is detected is acquired by the clock unit 73, the frame image data is acquired at the changed frame rate by driving the imaging unit, and the management area 141 of the storage unit 14 is acquired. Record sequentially.

  Therefore, by the process of acquiring the frame image data at the changed frame rate in step S107, the frame rate is arbitrarily changed for the scene that the user (photographer) determines to be important during continuous shooting, and a desired frame is obtained. Image data can be acquired.

  In addition, since the photographing frame rate can be changed only by operating the lever switch 5, the photographing frame rate can be freely changed by a simple operation.

  Further, in the management area 141, the elapsed time from the start of shooting when the shooting frame rate is changed is recorded corresponding to the recorded moving image data (a plurality of frame image data).

  Subsequently, it is determined whether or not the photographing end due to the operation of the shutter button 4 is detected again (step S108). If the end of photographing in step S108 is not detected, the process returns to step S106. Accordingly, even if the user maintains the state where the lever switch 5 is displaced to the same position as the previous time without operating the lever switch 5 again, the determination in step S106 is YES, and the elapsed time is determined in step S107. Frame image data is acquired at the changed frame rate. Of course, even when the user operates the lever switch 5 to a different position, the determination in step S106 is YES, and frame image data is acquired at the frame rate changed in step S107.

  If the user returns the lever switch 5 to the neutral position, the determination in step S106 is NO, and if the end of shooting is not detected, the process returns to step S105, and the frame image data at the normal shooting frame rate of 30 fps is returned from the imaging unit. Is acquired.

  Then, when the user operates the shutter button 4 again to stop continuous shooting with the lever switch 5 displaced, the determination in step S108 is YES, and the process proceeds from step S108 to step S109. Therefore, the changed frame rate and the elapsed time are associated with each other and stored in the change information memory area 142 of the storage unit 14 as change information.

  At this time, as described above, in the present embodiment, “30 (fps)” is set as the normal shooting frame rate, and this normal shooting frame rate is not stored in the change information memory area 142, and this normal shooting frame rate is stored. The change information is stored as change information in the change information memory area 142 only when the image is shot at a different frame rate.

Therefore, as shown in FIGS. 5 (1) to (5),
(1) Until "00'00" 00 to 02'00 "74", the normal shooting frame rate is set to "30 (fps)" without operating the lever switch 5,
(2) Operate the lever switch 5 to set "50 (fps)" from "02'00" 74 to 04'30 "30"
(3) Until "04'30" 30 to 20'00 "03", the lever switch 5 is returned to the neutral position to set the normal shooting frame rate to "30 (fps)"
(4) Operate the lever switch 5 until "20'00" 03 to 22'36 "77" to set "50 (fps)"
(5) Operate the lever switch 5 from "22'36" 77 to 24'10 "35" to set "100 (fps)"
If continuous shooting is finished,
As shown in FIG.
-Frame rate (fps) "50" corresponding to the elapsed time "02'00"74-04'30"30"
-Frame rate (fps) "50" corresponding to the elapsed time "20'00" 03 to 22'36 "77"
-Frame rate (fps) "100" corresponding to the elapsed time "22'36" 77 to 24'10 "35"
Will be stored.

  Next, a plurality of sequentially recorded frame image data is filed and recorded in the file storage area 143 in association with the change information (step S110). A plurality of sequentially recorded frame image data is converted into a file and given a file name, which is stored in the file storage area 143 of the storage unit 14, and the same file name as the above file name is also given to the change information. Thus, the plurality of frame image data and the change information are associated with each other with the same file name.

  On the other hand, when the playback mode is set, a playback mode standby state is formed, and the control unit 7 executes processing according to the procedure shown in the flowchart of FIG. 6 according to the program stored in the program memory 12. First, it is determined whether or not selection of any file is detected from the file storage area 143 by a user operation (step S201). If a file selection is detected, it is determined whether or not it is a selection of a file including a plurality of still image data (frame image data) recorded in the continuous shooting mode (step S202). If it is not the above-described file selection but the selection of a file consisting of one still image data, the selected file is read from the file storage area 143 and developed in the work memory 13 (step S203). Further, a still image based on the developed file is displayed on the display unit 16 (step S204). Then, it is determined whether or not a cancel operation is detected (step S205), and this display is continued until the cancel operation is detected.

  On the other hand, if the result of determination in step S202 is selection of a file containing a plurality of still image data (frame image data) recorded in the continuous shooting mode, the change information storage unit (change information memory area 142). ) Is searched (step S206), and it is determined whether there is change information recorded in association with the selected file (step S207). That is, as described above, the change information is selected in the change information memory area 142 because it is given the same file name as the file name of a plurality of image data (frame image data) taken continuously. By searching for the file name of the file, it is possible to easily detect whether there is change information.

  If the change information is not recorded as a result of the determination in step S207, that is, if the file has been shot at the normal shooting frame rate, the selected file is read from the file storage area 143. The image is developed in the work memory 13 (step S208), and an image corresponding to the first frame image data is displayed on the display unit 16 (step S209). Further, it is determined whether or not a reproduction instruction has been detected in a state where this image is displayed (step S210), and whether or not cancellation has been detected (step S211). If cancellation has been detected, the process returns. .

  If a playback instruction is detected (step S210; YES), images composed of a plurality of frame image data developed in the work memory 13 are sequentially played back at a playback frame rate of 30 fps which is the same as the shooting frame rate. Is displayed on the display unit 16 (step S212). Further, it is determined whether or not the reproduction end due to the reproduction of the image corresponding to the last frame image data is detected (step S213), and the process of step S212 is repeatedly executed until the reproduction end is detected. As a result, images that sequentially change at a frame rate of 30 fps are reproduced and displayed on the display unit 16. When the end of reproduction is detected by reproducing the last image data, the process returns to step S216 to shift to an image display state based on the first frame image data.

  On the other hand, if the change information is recorded in association with the selected file as a result of the determination in step S207, the change information is read from the change information memory area 142 (step S214). Subsequently, the selected file is read from the file storage area 143 and expanded in the work memory 13 (step S215), and an image corresponding to the first frame image data is displayed on the display unit 16 (step S216). Further, it is determined whether or not a reproduction instruction is detected in a state where this image is displayed (step S217), and whether or not cancellation is detected (step S218). If cancellation is detected, the process returns. .

  If a playback instruction is detected (step S217; YES), playback of images corresponding to a plurality of frame image data developed in the work memory 13 at a frame rate of 30 fps is started, and the display unit 16, and “1 ×” indicating that the shooting frame rate and the playback frame rate are the same (30 fps) are superimposed on the playback image of the display unit 16 and notified (step S219). In other words, in the present embodiment, shooting is performed at the frame rate of 30 fps at the beginning of the continuous shooting mode by the processing of step S105, and playback is started at the frame rate of 30 fps in step S219. At the beginning, the shooting frame rate and the playback frame rate are the same, and “1 ×” indicating this is superimposed and notified. At the same time, the clock unit 73 is activated to start measuring the elapsed playback time (step S219).

  Next, the elapsed time at the time of shooting added to the frame image data to be reproduced is compared with the elapsed time included in the change information, and based on the comparison result, at the reproduction timing of the image based on the frame image data to be reproduced, The elapsed time at the time of shooting added to the frame image data matches the elapsed time stored in the change information, that is, the elapsed time at the time of shooting added to the frame image data and the elapsed time when the frame rate was changed. Is determined (step S220). If it has reached, the reproduction speed information corresponding to the changed frame rate stored at the time of imaging is read out from the reproduction speed table 121 (FIG. 3) (step S221).

  That is, since normal playback is performed at a playback frame rate of 30 fps by the processing in step S219, if the frame rate recorded at the time of imaging is “10 fps”, for example, the corresponding playback speed information in the playback speed table 121 Is “× 3 times speed (fast forward)”. Therefore, “× 3 × speed (fast forward)” is read from the playback speed table 121. Also, when performing slow playback at a playback frame rate of 10 fps, for example, if the changed frame rate recorded at the time of imaging is “100 fps”, the corresponding playback speed information in the playback speed table 121 is “× 1/10 times the speed (slow)”. Therefore, “× 1/10 times speed (slow)” is read from the playback speed table 121.

  Next, it is detected whether or not there is a large change between a plurality of images that are sequentially reproduced and displayed on the display unit 16 (step S222). For example, as shown in FIG. 7, in the case of continuous shooting of an academy race, if it is immediately after the start as in (1) and (2), the runner's movement is small because it is not accelerated, so images that are temporally adjacent The change between (1) and (2) is small. However, as shown in (3) and (4), in a scene in which runner a tries to pass runner b, the motion (motion vector) is large due to acceleration of runner a. Therefore, even if this scene is photographed at 50 fps, for example, the runner a moves greatly in the temporally adjacent images (1) and (2) at intervals of 1/50 seconds, resulting in a frame-by-frame display state. End up.

  In step S222, if the change between images is small as in (1) and (2) that are temporally adjacent, it is determined NO, and the change between images is large as in (3) and (4). In this case, it is determined as YES. More specifically, the feature amount for each predetermined region in the images (3) and (4) is calculated, and the motion vector for each feature amount common to the calculated images (3) and (4) is calculated. At this time, in the feature calculation region (attention image) including the runner a, a large motion vector greater than a predetermined value is calculated between the images (3) and (4). As described above, when a predetermined or more motion vector is detected in the corresponding feature detection regions of the temporally adjacent images (3) and (4), it is determined as YES.

  If the determination in step S222 is YES, the images are combined, and the playback speed information is displayed and superposed on the playback display content (step S223). That is, as described above, a motion vector is calculated in advance, and the composite image (3 ′ ) (4 ') is generated. Further, as shown in FIGS. 7 (3), (3 '), (4') and (4), the composite image (3 ') (4') is inserted into the image (3) between the images (4) for reproduction. Do.

  Accordingly, (3) → (3 ′) → (4 ′) → (4) is sequentially reproduced on the display unit 16 so that the frame-by-frame display state is corrected to a display state with smooth movement. Can do.

  Further, since the image synthesis is performed based on the motion vector as described above, an appropriate image can be synthesized and displayed in accordance with the magnitude of the movement of the subject.

  At this time, the reproduction speed information when an image shot at 50 fpc is reproduced at 30 fps as shown in the figure by the process of “display and notify the reproduction speed information superimposed on the reproduction display contents” in step S223. “× 5/3 speed (slow)” is displayed as 116.

  If the determination in step S222 is NO, the playback speed information is displayed and notified by simply superimposing it on the playback display content without performing image synthesis (step S224).

  Next, based on the elapsed time at the time of shooting added to the frame image data to be reproduced, it is determined whether or not the elapsed time stored in the change information has expired (step S225). That is, if the elapsed time is 02'00 "74-04'30" 30 ", it is determined whether or not the end time" 4'30 "30" has ended (step S225), and until the end. The processing from step S222 is repeated.

  Further, it is determined whether or not the user has performed a reproduction end operation or whether or not the reproduction end of the continuous image has been detected (step S226). If detected, the process returns to step S216. If not detected, the reproduction at the normal reproduction frame rate of 30 fps is continued, and “1 ×” indicating that the shooting frame rate and the reproduction frame rate are the same (30 fps) is superimposed and notified (step S227).

Further, similarly to step S226, it is determined whether or not the end of reproduction is detected (step S222). If not detected, the processing from step S220 is repeated. Therefore, as shown in FIG. 2C, corresponding to the file name “20061006-01.avi”,
Elapsed time "02'00"74-04'30"30"
-Elapsed time "20'00"03-22'36"77"
Elapsed time "22'36" 77 to 24'10 "35"
Is remembered,
-Time of 02'00 "74 from the start of recording (first change)
・ Time of 20'00 "03 from the start of recording (second change)
・ 22'36 "77 from the start of recording (third change)
In each of the above, the determination in step S220 is YES.

  In the first process of step S221, the reproduction speed information “× 3/5 times (slow)” corresponding to “50 fps” which is the shooting frame rate in the first change is read from the reproduction speed table 121. . Furthermore, in the process of step S223 or S224, the reproduction speed information “× 3/5 times speed (slow)” is displayed in a superimposed manner at the elapsed time “02′00 ″ 74 to 04′30 ″ 30”.

  In the second process of step S <b> 221, the reproduction speed information “× 3/5 times (slow)” corresponding to the shooting frame rate “50 fps” in the second change is read from the reproduction speed table 121. . Further, in the process of step S223 or S224, the reproduction speed information “× 3/5 times speed (slow)” is displayed in a superimposed manner during the reproduction time.

  In the third process of step S 221, the reproduction speed information “× 3/10 times (slow)” corresponding to the shooting frame rate “100 fps” in the third change is read from the reproduction speed table 121. . Furthermore, in the process of step S223 or S224, the reproduction speed information “× 3/10 times speed (slow)” is displayed in a superimposed manner during the reproduction time.

  Therefore, according to the present embodiment, desired frame image data can be obtained by arbitrarily changing the frame rate for a scene that the user (photographer) determines to be important during continuous shooting as described above. In addition, at the time of playback, it is easy to search for a desired image from continuously shot images by viewing the displayed playback speed information and visually recognizing the image with attention according to the playback speed information. It can be carried out.

  In this embodiment, only the frame rate at the time of shooting is changed according to the operation of the lever switch 5, but the playback frame rate control unit 72 shown in FIG. Accordingly, the frame rate at the time of reproduction may be changed. That is, in this embodiment, as shown in FIG. 3, not only the playback speed information at normal playback = 30 fps but also the playback speed information at slow playback = 10 fps is stored in the playback speed table 121. Therefore, even when the frame rate at the time of reproduction is changed to 30 fps and 10 fps in accordance with the operation of the lever switch 5, this can be dealt with.

  More specifically, it is determined whether the changed playback frame rate is 30 fps or 10 fps, and if it is 30 fps, the playback speed information corresponding to 30 fps in step S2221 as in the above-described embodiment. Is read from the playback speed table 121 and displayed in step S223 or step S224. If it is 10 fps, the playback speed information corresponding to 10 fps is read from the playback speed table 121 in step S2221, and step S223 or step S224 is read. The display can be done with.

Thereby, even when the playback frame rate is changed, it is possible to inform the user of different playback speeds according to the shooting frame rate.
In the present embodiment, the shooting / playback of a plurality of images (AVI format) taken at a high speed continuously has been described. However, the shooting / playback of a movie shot (MPEG H.264 format). Also good. In this case, the content stored in the change information memory area 142 is stored in the synchronization information of the file header of the moving image file.

  8 and 9 show another embodiment of the present invention. In this embodiment, “frame rate (fps)” of Exif information is read out from a plurality of image files taken continuously at high speed, and the playback speed is controlled according to the read frame rate (fps). is there.

  In FIG. 8A, reference numeral 140 denotes a storage unit in the present embodiment that replaces the storage unit 14 in the first embodiment, and 144, 144, 144,... A plurality of image files stored in the storage unit 140. In FIG. 5B, 1441 is a file header of the image file 144, 1442 is an Exif information storage area, and 1443 is actual image data. The Exif information storage area 1442 stores information indicating fps (frame rate) indicating that the image has been taken continuously at high speed.

  FIG. 9 is a flowchart showing a processing procedure in the present embodiment. When the reproduction mode is set, a reproduction mode standby state is formed, and the control unit 7 executes processing according to the procedure shown in the flowchart of FIG. 9 according to the program stored in the program memory 12. First, it is determined whether or not selection of any file is detected from the file storage area 143 by a user operation (step S301). If the file selection is detected, it is determined whether or not it is a selection of a file including a plurality of still image data (frame image data) recorded in the continuous shooting mode (step S302). If it is not the above-mentioned file selection but a file consisting of one still image data, the selected file is read from the file storage area 143 and developed in the work memory 13 (step S303). Further, a still image based on the developed file is displayed on the display unit 16 (step S304). Then, it is determined whether or not a cancel operation is detected (step S305), and this display is continued until the cancel operation is detected.

  On the other hand, if the result of determination in step S302 is that a file containing a plurality of still image data (frame image data, image file 144) recorded in the continuous shooting mode is selected, the actual image data 1443 is sequentially selected. The data is read and expanded in the work memory 13 (step S306). At this time, the change information fps (frame rate) is read from each Exif information storage area 1442 to the work memory 13. Subsequently, an image corresponding to the first frame image data is displayed on the display unit 16 (step S307). Further, it is determined whether or not a playback instruction has been detected with this image displayed (step S308) and whether or not cancellation has been detected (step S309). If cancellation has been detected, the process returns. .

  If a playback instruction is detected (step S308; YES), playback of images corresponding to a plurality of frame image data developed in the work memory 13 at a frame rate of 30 fps is started, and the display unit 16, and “1 ×” indicating that the shooting frame rate and the playback frame rate are the same (30 fps) are superimposed on the playback image of the display unit 16 and notified (step S310). In other words, in the present embodiment, shooting is performed at the frame rate of 30 fps at the beginning of the continuous shooting mode by the processing in step S105, and playback is started at the frame rate of 30 fps in step S310. At the beginning, the shooting frame rate and the playback frame rate are the same, and “1 ×” indicating this is superimposed and notified.

  Next, it is determined whether or not the frame rate of the image file to be reproduced has been changed (step S311). In other words, since normal playback is performed at a playback frame rate of 30 fps by the processing in step S310, for example, if the frame rate recorded at the time of imaging is “10 fps”, it has been changed and the determination in step S312 is Yes. Further, for example, when the changed frame rate recorded at the time of imaging is “100 fps”, it is changed and the determination in step S311 is YES. Therefore, the process proceeds from step S311 to step S312.

  Then, it is detected whether or not there is a large change between a plurality of images that are sequentially reproduced and displayed on the display unit 16 (step S312). For example, as shown in FIG. 7 described above, in the case of continuous shooting of an academy race, if it is immediately after the start as in (1) and (2), the runner's movement is small because it is not accelerated, so it is adjacent in time. The change between the images (1) and (2) to be performed is small. However, as shown in (3) and (4), in a scene in which runner a tries to pass runner b, the motion (motion vector) is large due to acceleration of runner a. Therefore, even if this scene is photographed at 50 fps, for example, the runner a moves greatly in the temporally adjacent images (1) and (2) at intervals of 1/50 seconds, resulting in a frame-by-frame display state. End up.

  Accordingly, in step S312, when the change between images is small as in (1) and (2) that are temporally adjacent, it is determined NO, and the change between images is large as in (3) and (4). In this case, it is determined as YES. More specifically, the feature amount for each predetermined region in the images (3) and (4) is calculated, and the motion vector for each feature amount common to the calculated images (3) and (4) is calculated. At this time, in the feature calculation region (attention image) including the runner a, a large motion vector greater than a predetermined value is calculated between the images (3) and (4). As described above, when a predetermined or more motion vector is detected in the corresponding feature detection regions of the temporally adjacent images (3) and (4), it is determined as YES.

  If the determination in step S312 is YES, the images are combined, and reproduction speed information is displayed and superposed on the reproduction display content for notification (step S313). That is, as described above, a motion vector is calculated in advance, and the composite image (3 ′ ) (4 ') is generated. Further, as shown in FIGS. 7 (3), (3 '), (4') and (4), the composite image (3 ') (4') is inserted into the image (3) between the images (4) for reproduction. Do.

  Accordingly, (3) → (3 ′) → (4 ′) → (4) is sequentially reproduced on the display unit 16 so that the frame-by-frame display state is corrected to a display state with smooth movement. Can do.

  Further, since the image synthesis is performed based on the motion vector as described above, an appropriate image can be synthesized and displayed in accordance with the magnitude of the movement of the subject.

  At this time, reproduction speed information when an image shot at 50 fpc is reproduced at 30 fps as shown in the figure by the processing of “display reproduction speed information superimposed on reproduction display content and informing” in step S313. “× 5/3 speed (slow)” is displayed as 116.

  If the determination in step S312 is NO, the playback speed information is displayed and notified by simply superimposing it on the playback display content without performing image synthesis (step S314).

  Next, it is determined whether or not the user has performed a playback end operation or the playback end of whether or not playback of the continuous image is completed (step S315). If detected, the process returns to step S307. If not detected, the reproduction at the normal reproduction frame rate of 30 fps is continued, and “1 ×” indicating that the shooting frame rate and the reproduction frame rate are the same (30 fps) is superimposed and notified (step S316).

  Further, similarly to step S315, it is determined whether or not the reproduction end is detected (step S317). If not detected, the process from step S311 is repeated. If detected, the process from step S307 is executed.

  In the embodiment, the case where the present invention is applied to a digital camera has been described. However, the present invention is not limited to this, and other mobile phone terminals with cameras, PDAs with cameras (Personal Digital Assistants), and the like. : Portable information terminal), personal computer with camera, etc., and can be applied to any apparatus capable of continuous shooting.

(A) is a front view of the digital camera which concerns on one embodiment of this invention, (B) is a top view. It is a block diagram of the digital camera. It is a conceptual diagram which shows a reproduction speed table. It is a flowchart which shows the process sequence in imaging | photography mode of this Embodiment. It is explanatory drawing which shows the relationship between an imaging | photography frame rate and the image | photographed image. It is a flowchart which shows the process sequence in the reproduction | regeneration mode of this Embodiment. It is explanatory drawing which shows the processing content of step S223. It is explanatory drawing which shows the structure of the memory | storage part in other embodiment of this invention. It is a flowchart which shows the process sequence of the reproduction | regeneration mode in other embodiment of this invention.

Explanation of symbols

1 Digital Camera 2 Imaging Lens 4 Shutter Button 5 Lever Switch 7 Control Unit 8 CMOS
9 Unit Circuit 10 Image Processing Unit 11 Input Unit 12 Program Memory 13 Work Memory 14 Storage Unit 16 Display Unit 71 Shooting Frame Rate Control Unit 72 Playback Frame Rate Control Unit 73 Clock Unit 116 Playback Speed Information 121 Playback Speed Table 141 Management Area 142 Change Information memory area 143 File storage area

Claims (8)

Imaging means;
Image acquisition means for sequentially acquiring a plurality of images by driving the imaging means at a predetermined time interval;
Changing means for changing the predetermined time interval during acquisition by the image acquisition means;
A time interval storage means for storing the time interval changed by the changing means in association with the image acquired at that time;
Detecting means for detecting a degree of change between a plurality of images sequentially acquired at time intervals changed by the changing means;
If the degree of change detected by the detection means is greater than a predetermined degree, an image synthesis means for synthesizing the plurality of images that are the detection targets ;
When sequentially reproducing the plurality of images, if a combined image between the plurality of images is combined by the image combining unit, a reproducing unit that interposes the plurality of images and reproduces the combined image; ,
An imaging apparatus comprising: In the reproduction by the reproduction means, it further comprises a notification means for notifying that the time interval has been changed when the image to be reproduced is associated with the time interval stored by the time interval storage means. The imaging apparatus according to claim 1, wherein: Clocking means for timing the elapsed time from the start of acquisition by the image acquisition means;
Recording means for recording the elapsed time measured by the time measuring means in association with a plurality of images sequentially acquired by the image acquisition means,
The time interval storage means stores the time interval changed by the changing means in association with the change information at the time of change,
The reproducing means sequentially reproduces a plurality of images recorded by the recording means,
The notification means changes the time interval when the elapsed time recorded in association with the reproduction target image reaches the change elapsed time stored by the time interval storage means during reproduction by the reproduction means. The imaging apparatus according to claim 2, wherein a notification to the effect is made . Reproduction speed information storage means for storing reproduction speed information corresponding to the time interval changed by the changing means with the predetermined time interval as a reference,
When the elapsed time recorded in association with the image to be reproduced reaches the elapsed time at the time of change stored by the time interval storage unit, the notification unit stores the change content in the change content storage unit. 4. The image pickup apparatus according to claim 3, further comprising reproduction speed information display means for reading and displaying the corresponding reproduction speed information from the reproduction speed information storage means based on the stored time interval . It further includes an operation unit that can be moved to an arbitrary position.
The changing means, the operating section imaging apparatus according to any one of claims 1 to 4, characterized in that to change the time interval based on moves position. The image synthesizing unit calculates a motion vector of an image of interest between the plurality of images, and when the motion vector is larger than a predetermined value, it is assumed that the motion vector is larger than the predetermined degree, and the detection target The imaging apparatus according to claim 1, wherein the plurality of formed images are synthesized. An image acquisition step of sequentially acquiring a plurality of images by driving the imaging unit at a predetermined time interval;
A change step of changing the predetermined time interval during acquisition by the image acquisition step;
A time interval storing step for storing the time interval changed by the changing step in association with the image acquired at that time;
A detecting step for detecting a degree of change between a plurality of images sequentially acquired at the time interval changed in the changing step;
When the degree of change detected in this detection step is greater than a predetermined degree, an image synthesis step for synthesizing a plurality of images that are detection targets ;
When sequentially reproducing the plurality of images, if a combined image between the plurality of images is combined in the image combining step, a reproduction step of reproducing the combined image interposed in the plurality of images And a recording / reproducing method comprising: Computer
An image acquisition means for sequentially acquiring a plurality of images by driving the imaging unit at a predetermined time interval;
Changing means for changing the predetermined time interval during acquisition by the image acquiring means;
Time interval storage means for storing the time interval changed by the changing means in association with the image acquired at that time,
Detecting means for detecting a degree of change between a plurality of images sequentially acquired at time intervals changed by the changing means;
An image compositing means for compositing a plurality of images to be detected when the degree of change detected by the detecting means is greater than a predetermined degree ;
When sequentially reproducing the plurality of images, if a composite image between the plurality of images is synthesized by the image synthesizing unit, the reproducing unit is configured to reproduce the synthesized image through the plurality of images. A program characterized by functioning.

Images