JP2017158021A - Information terminal device, imaging device, image information processing system, and image information processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow the workmanship of a time-lapse moving image to be predicted by generating and displaying a time-lapse moving image by using a photographing result until then in the middle of time-lapse photographing, and to simply obtain a photographic image desired by a user by accepting setting change of the time-lapse photographing and reflecting it in the time-lapse photographing thereafter.SOLUTION: An information terminal device comprises: a communication unit for communicating with an imaging device in order to obtain results of repeated photographing at a specific interval; a signal processing unit for generating a confirmation moving image at a particular frame rate by a plurality of photographic images transmitted by the imaging device via the communication unit in the middle of a photographing period by the imaging device; and a display control unit for displaying the confirmation moving image generated by the signal processing unit.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information terminal device, an imaging device, an image information processing system, and an image information processing method capable of controlling time-lapse shooting.

  In recent years, portable devices with a photographing function (photographing devices) such as digital cameras have become widespread. Many of these types of photographing devices can enjoy various image processing. For example, an apparatus capable of time-lapse shooting that continuously captures images at predetermined time intervals and generates a moving image having a playback time shorter than the shooting time has been commercialized. For example, in time-lapse photography, you can shoot a day's scenery with a camera fixed to a tripod and observe changes in the scenery in a short time, or a person wearing a wearable camera can take pictures while walking around the town to shorten the state of the town. Various usages are possible, such as observation over time.

  In such a photographing device, time lapse photographing time interval and the number of photographing are determined (time lapse photographing). In an apparatus that generates a time-lapse moving image, a plurality of time-lapse captured images are arranged on a timeline to generate a moving image having a predetermined frame rate (time-lapse moving image).

  There is also a photographing device having such a time lapse photographing function and a time lapse moving image generation function. For example, Patent Document 1 discloses an apparatus that can independently set a time-lapse shooting parameter and a playback parameter related to playback of a time-lapse moving image shot with the shooting parameter.

Japanese Patent Laying-Open No. 2015-53670

  However, since time-lapse shooting is performed for a long time, various parameters such as time-lapse shooting parameters cannot always be set to optimum setting values at the time of starting shooting.

  In this case, after viewing the time-lapse moving image, the user re-shoots the image and takes a huge amount of time.

  The present invention generates a time-lapse movie by using a result of the previous shooting during the time-lapse shooting, and displays the time-lapse movie so that the desired image can be predicted. An object is to provide an information terminal device, an imaging device, an image information processing system, and an image information processing method that can be easily obtained.

  An information terminal device according to an aspect of the present invention includes a communication unit that communicates with an imaging device in order to acquire repeated imaging results at specific intervals, and the communication unit in the middle of a shooting period of the imaging device. A signal processing unit that generates a confirmation moving image of a specific frame rate based on a plurality of the captured images transmitted from the imaging device via a display, and a display control unit that displays the confirmation moving image generated by the signal processing unit. It has.

  In addition, an imaging device according to one embodiment of the present invention includes an imaging unit capable of time-lapse imaging for repeated imaging, and a specific frame rate based on a plurality of captured images obtained by the imaging unit during the imaging period of the imaging. A signal processing unit that generates a confirmation moving image; and a display control unit that displays the confirmation moving image.

  An image information processing system according to an aspect of the present invention includes an imaging unit capable of time-lapse imaging that repeatedly captures images, a first signal processing unit that generates a moving image based on a plurality of captured images obtained by the imaging unit, 2nd communication which is controlled by 1 control part, communicates between the 1st communication part which transmits the said captured image to an information terminal device, and the said 1st communication part, and receives the said captured image And a second signal processing unit for generating a confirmation moving image of a specific frame rate by the plurality of captured images received via the second communication unit in the middle of a shooting period by the imaging unit, and the second signal processing unit And a display control unit that displays the confirmation moving image generated by the two signal processing units.

  In addition, an image information processing method according to an aspect of the present invention includes a procedure for receiving a captured image obtained by an imaging device capable of time-lapse imaging that repeatedly captures images, and a plurality of the captured images received during a shooting period of the imaging device. A procedure for generating a confirmation moving image having a specific frame rate; and a display procedure for displaying the confirmation moving image.

  According to the present invention, during the time-lapse shooting, the time-lapse moving image is generated and displayed using the previous shooting result, thereby making it possible to predict the performance of the time-lapse moving image and changing the setting of the time-lapse shooting. Is received and reflected in the subsequent time-lapse shooting, the captured image desired by the user can be easily obtained.

1 is a block diagram showing a circuit configuration of an image information processing system including an imaging device and an information terminal device according to a first embodiment of the present invention. 6 is a flowchart showing the operation of the imaging apparatus 10. The flowchart which shows operation | movement of the information terminal device 20. FIG. Explanatory drawing which shows an example of the image displayed on the display screen of the information terminal device. Explanatory drawing which shows an example of the image displayed on the display screen of the information terminal device. Explanatory drawing which shows an example of the image displayed on the display screen of the information terminal device. Explanatory drawing which shows an example of the image displayed on the display screen of the information terminal device. Explanatory drawing which shows an example of the image displayed on the display screen of the information terminal device. Explanatory drawing which shows an example of the image displayed on the display screen of the information terminal device. Explanatory drawing which shows an example of the image displayed on the display screen of the information terminal device. Explanatory drawing for demonstrating a time-lapse moving image. Explanatory drawing for demonstrating a time-lapse moving image. It is explanatory drawing for demonstrating the timing of the process of this Embodiment. The block diagram which shows the 2nd Embodiment of this invention. FIG. 3 is an explanatory diagram illustrating an example of an appearance of an imaging apparatus 50. The flowchart for demonstrating operation | movement of 2nd Embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a circuit configuration of an image information processing system including an imaging device and an information terminal device according to the first embodiment of the present invention.

  The image information processing system according to the present embodiment obtains an image obtained by time-lapse shooting of the imaging unit in the information terminal device, and supports the user so that the effect of the time-lapse movie can be confirmed during the time-lapse shooting, and time-lapse shooting. The shooting parameter setting change can be instructed, and the imaging unit accepts the parameter setting from the information terminal device, so that shooting for obtaining the time-lapse video desired by the user is performed at the end of the time-lapse shooting. It is what makes it possible.

  In FIG. 1, an image information processing system 1 according to the present embodiment includes an imaging device 10 and an information terminal device 20. The imaging device 10 can be configured by a photographing device such as a digital camera. The imaging device 10 includes an imaging unit 12 configured by an imaging element such as a CCD or a CMOS sensor. The imaging unit 12 is provided with a lens (not shown) so that a subject optical image is guided through the lens. This lens may have a zooming and focusing function. The imaging unit 12 obtains an imaging signal by converting the subject optical image into an electrical signal by the imaging element.

  The imaging device 10 is provided with a control unit 11, and the control unit 11 controls each unit of the imaging device 10. The control unit 11 may be configured by a processor such as a CPU (not shown) or may operate according to a program stored in a memory (not shown). The imaging device 10 includes an operation unit 19 including a shutter button (not shown), a function button, various switches for setting a shooting mode, and the like, which are provided in a housing of the imaging device 10. The operation unit 19 receives a user operation and outputs an operation signal based on the user operation to the control unit 11. The control unit 11 can generate a focus signal and a zoom signal based on an operation signal from the operation unit 19 and drive a lens of the imaging unit 12 to perform zooming, focusing, and the like. In addition, the control unit 11 can output a driving signal for the image sensor to the imaging unit 12 to control the shutter speed, the exposure time, and the like.

  The control unit 11 can also control the imaging unit 12 to perform imaging at predetermined time intervals and perform time-lapse imaging in which playback is performed in a time shorter than the imaging time. Note that shooting parameters for time lapse shooting, for example, information related to shooting intervals and shooting times, are stored in the time lapse information storage unit 15, and the control unit 11 reads information in the time lapse information storage unit 15 to control time lapse shooting. It is supposed to be.

  The control unit 11 can read out the captured image from the imaging unit 12 and supply it to the signal processing unit 18. The signal processing unit 18 performs predetermined signal processing, such as color adjustment processing, matrix conversion processing, noise removal processing, and other various signal processing, on the read captured image.

  The imaging device 10 is provided with a recording unit 14 and a temporary recording unit 14a. The control unit 11 can give the captured image signal-processed by the signal processing unit 18 to the recording unit 14 or the temporary recording unit 14a and record it. For example, the control unit 11 can give and record the captured image acquired in the normal shooting mode to the recording unit 14. In addition, the control unit 11 can provisionally record the captured image from the imaging unit 12 acquired in the time lapse shooting mode by giving it to the temporary recording unit 14a.

  The signal processing unit 18 is also controlled by the control unit 11 and can generate a time-lapse moving image by arranging the captured image recorded in the temporary recording unit 14a on the timeline. Note that the frame rate information necessary for generating the time-lapse video is stored in the time-lapse information storage unit 15, and the control unit 11 reads the information in the time-lapse information storage unit 15 to control the generation of the time-lapse video. It has become.

  The signal processing unit 18 can also perform compression processing when recording an image file such as a captured image or a time-lapse movie, and the compressed image is stored in the recording unit 14 and the temporary recording unit 14a. It can be recorded.

  The imaging device 10 is provided with a communication unit 16. The information terminal device 20 is also provided with a communication unit 22. The communication unit 16 is controlled by the communication control unit 17 to transmit / receive information to / from the communication unit 22 of the information terminal device 20 via a predetermined transmission path. The control unit 11 is configured such that commands and parameters are transferred from the information terminal device 20 via the communication unit 16, and each unit can be controlled in accordance with the transferred commands and parameters.

  The communication control unit 17 is controlled by the control unit 11 and can transmit an image captured by the imaging device 10 to the communication unit 22 of the information terminal device 20 via the communication unit 16.

  In addition, the imaging apparatus 10 includes a sound collection unit 13. The sound collection unit 13 is configured by a microphone or the like (not shown), and can convert ambient sounds into audio signals and output them to the signal processing unit 18. The signal processing unit 18 can perform predetermined signal processing on the audio signal from the sound collection unit 13 and then provide the audio signal to the recording unit 14 and the temporary recording unit 14a. The control unit 11 can record the collected sound in correspondence with the captured image acquired at the corresponding timing.

  The information terminal device 20 can be configured by a smartphone, a tablet PC, or the like. The information terminal device 20 has a control unit 21, and the control unit 21 controls each unit of the information terminal device 20. The control unit 21 may be configured by a processor such as a CPU (not shown) or may operate according to a program stored in a memory (not shown). The information terminal device 20 has an operation unit 23 that includes a switch or the like (not shown) provided in the housing of the information terminal device 20. The operation unit 23 can be configured by a software keyboard or the like obtained by a program executed by the control unit 21, or can be configured by a touch panel (not shown) provided on the display unit 27 described later.

  The operation unit 23 receives a user operation and outputs an operation signal based on the user operation to the control unit 21. The control unit 21 controls each unit based on an operation signal from the operation unit 23.

  The information terminal device 20 is provided with a recording unit 24, and the recording unit 24 can record information given from the control unit 21. For example, the image transmitted from the imaging apparatus 10 and various parameters, for example, information related to time-lapse shooting and information related to time-lapse moving image generation (hereinafter referred to as information related to time-lapse) are recorded in the recording unit 24. The recording unit 24 also records information about time lapse based on user operation of the operation unit 23 and information about time lapse initially set by the control unit 21.

  In the present embodiment, the information terminal device 20 is provided with a signal processing unit 25. The signal processor 25 is controlled by the controller 21 and executes various signal processes. For example, the signal processing unit 25 can read a plurality of images and time-lapse information obtained by time-lapse shooting from the recording unit 24 and generate a time-lapse moving image. The signal processing unit 25 gives the generated time lapse moving image to the display control unit 26 as a time lapse confirmation moving image.

  The display control unit 26 executes various processes related to display. The display control unit 26 is controlled by the control unit 21 to control the display on the display unit 27. The display unit 27 has a display screen such as an LCD, and displays an image given from the display control unit 26. For example, the control unit 21 controls the display control unit 26 to display a confirmation display including a time lapse confirmation moving image on the display screen of the display unit 27 and to change the time lapse confirmation moving image to a desired moving image. Various parameters used for time-lapse shooting and time-lapse movie generation of the imaging apparatus 10 can be adjusted, and an adjustment display for designating an image (deleted image) that is not used for time-lapse movie generation can be displayed.

  On the display screen of the display unit 27, a touch panel as the operation unit 23 may be provided. The touch panel can generate an operation signal corresponding to the position on the display screen pointed by the user with a finger. This operation signal is supplied to the control unit 21. Thereby, the control part 21 can detect the operation, when a user touches or slides on a display screen. That is, the control unit 21 can detect various operations such as a user's touch position, an operation for closing and separating a finger (pinch operation), a position reached by a slide operation or a slide operation, a slide direction, and a touch period. It is possible to execute a process corresponding to a user operation.

  The control unit 21 sets, in the signal processing unit 25, parameter setting values and deleted image information by user operation for adjustment display. The signal processing unit 25 can generate a time-lapse moving image using an image that has not been deleted by a user operation according to a parameter based on the user operation. When there is a time margin until the next shooting in the time-lapse shooting, a confirmation display including a time-lapse confirmation moving image based on this time-lapse moving image may be displayed on the display screen of the display unit 27. In this case, the user can change the time lapse confirmation moving image to a desired moving image while viewing the confirmation display. That is, it can be visually matched to the user's preference.

  The control unit 21 can transmit necessary parameters for obtaining a time lapse confirmation video desired by the user and information on the deleted image (information about time lapse) to the imaging device 10 via the communication unit 22. . When information related to time lapse is given via the communication unit 16, the control unit 11 of the imaging apparatus 10 records the information in the time lapse information storage unit 15 and thereafter performs time lapse shooting according to the parameter. In addition, the control unit 11 controls the signal processing unit 18 so as to generate a time-lapse moving image using the updated information regarding the time-lapse moving image generation.

  The control part 11 receives the change of the information regarding the time lapse from the information terminal device 20 until time lapse photography is completed. The control unit 11 causes the signal processing unit 18 to generate a time-lapse moving image based on a series of images recorded in the temporary recording unit 14a when the time-lapse shooting is completed, and records the moving image file in the recording unit 14. It has become.

  Next, the operation of the embodiment configured as described above will be described with reference to FIGS. 2 and 3 are flowcharts showing the operation of the imaging device 10 or the information terminal device 20, respectively. 4A to 4E are explanatory diagrams illustrating examples of images displayed on the display screen of the information terminal device 20. 5A and 5B are explanatory diagrams for explaining a time-lapse moving image. FIG. 6 is an explanatory diagram for explaining the processing timing of the present embodiment.

  In FIG.3 S31, the control part 21 of the information terminal device 20 controls the display control part 26, and displays a function selection display. FIG. 4A shows an example of a function selection display displayed on the display screen 27 a of the display unit 27. In the example of FIG. 4A, a selection button 31a for selecting other functions, an external camera button 31b for selecting an external camera function, a mail button 31c for selecting a mail function, and a telephone function are displayed on the display screen 27a. A telephone button 31d for selecting is displayed.

  Here, it is assumed that the user touches the external camera button 31b to select the external camera function. In step S32, the control unit 21 determines whether or not the external camera function is selected. When the external camera function is not selected, the control unit 21 determines whether or not there is a request from the external camera in step S51. When the request is met, the control unit 21 determines whether or not the request is to activate another function (step S52), and activates the other function if the request is to activate another function (step S52). Step S53). If there is no request from the external camera, the control unit 21 receives an image from the external camera in step S54, displays the received image, and performs temporary recording (step S55). In step S56, the control unit 11 determines whether or not an operation for displaying a confirmation display for confirming the effect of time-lapse shooting has been performed by the user. If the operation has been performed, the process proceeds to step S49. If not, the process returns to step S31.

  When the external camera function is selected, the control unit 21 moves the process from step S32 to step S33, and determines whether or not an external camera has already been designated. If the external camera is not designated, a camera designation operation such as wireless connection setting, ID, and password setting is accepted in step SS34, and the designated information is recorded in the recording unit 24.

  If it is determined in step S33 that the external camera has already been designated, the control unit 21 causes the communication unit 22 to establish communication with the communication unit 16 of the imaging device 10 in step S35 and designate the external camera. The imaging device 10 that is a camera is accessed.

  On the other hand, the control unit 11 of the imaging apparatus 10 is in a communication standby state in step S1 of FIG. In step S2, the control unit 11 determines whether power-off communication has occurred. If there is power-off communication, the control unit 11 turns off the power in step S3 and returns the process to step S1.

  In step S4, the control unit 11 determines whether or not a through image transmission destination has been set. If already set, the through image is transmitted to the communication partner (step S10). In other words, the control unit 11 gives the imaging signal acquired by the imaging unit 12 to the signal processing unit 18 and transmits the captured image after the signal processing from the communication unit 16 to the information terminal device 20 as a through image.

  When the control unit 21 of the information terminal device 20 determines that communication is established in step S36, the communication unit 22 receives the through image. And the control part 21 transfers to step S39 from step S38, and gives the through image received via the communication part 22 to the display control part 26 (step S39). Thus, the through image acquired by the imaging device 10 is displayed on the display screen 27a of the display unit 27. In addition, when it determines with communication not being established in step S36, the control part 21 performs warnings, such as a warning display, after predetermined time progress (step S37).

  In the imaging apparatus 10, when the through image transmission partner has not been set, the control unit 11 determines in step S5 whether or not a through image transmission partner setting operation has been performed. When the setting operation of the through image transmission partner is performed, the control unit 11 performs the setting procedure in step S6, then records the setting information in the recording unit 14 (step S7), and the process proceeds to step S1. return.

  If time-lapse shooting has already been performed in the imaging apparatus 10, the process proceeds from step S5 to step S14 via step S8, and time-lapse shooting is continued.

  In step S <b> 11, the control unit 11 of the imaging device 10 determines whether communication for shooting control has been performed. When a shooting parameter, an image processing parameter, or the like is received from the information terminal device 20, the control unit 11 changes the shooting mode or the parameter in step S12. In step S12, the information terminal device 20 can also set parameters related to time-lapse shooting.

  Here, it is assumed that the user performs a shooting operation for time-lapse shooting. The photographing operation can be performed not only by the operation unit 19 of the imaging device 10 but also by the operation unit 23 of the information terminal device 20. For example, the control unit 21 of the information terminal device 20 can display the mode selection screen shown in FIG. 4B by controlling the display control unit 26. In the example of FIG. 4B, on the display screen 27a, a communication setting button 32a for selecting a communication setting mode, a normal shooting button 32b for selecting a normal shooting mode, and a time-lapse shooting button 32c for selecting a time-lapse shooting mode are displayed. A playback button 32d for selecting a playback mode and a return button 32e for returning to the function selection screen are displayed.

  Here, it is assumed that the user touches the time lapse shooting button 32c to select the time lapse shooting mode. The control unit 21 determines whether or not an operation for imaging control has been performed in step S44, and determines whether or not an imaging operation has been performed in step S46. When an operation for designating the time-lapse shooting mode is performed, the control unit 21 shifts the processing to step S <b> 45 and transmits the operation result to the imaging device 10.

  FIG. 4C shows a setting menu screen for time-lapse shooting displayed on the display screen 27 a of the information terminal device 20. In the example of FIG. 4C, on the display screen 27a, a through image display 33a, a condition setting button 33b for setting shooting conditions such as a shooting interval for time-lapse shooting, and a shooting setting button for specifying setting change of shooting parameters. 33c, a time-lapse shooting start button 33d and a return button 33e for instructing to start shooting of the time-lapse shooting are displayed. When the user performs an operation on the condition setting button 33b, the time-lapse shooting setting can be changed.

  FIG. 4D shows a time-lapse shooting setting screen displayed on the display screen 27a of the information terminal device 20 by operating the condition setting button 33b. In the example of FIG. 4D, on the display screen 27a, a through image display 34a, a display 34b indicating that it is a time-lapse shooting setting screen, an interval setting button 34c for setting the shooting interval, and the number of shots for setting the number of shots A setting button 34d is displayed. While the buttons 34c and 34d are displayed, the current setting is shown. In the example of FIG. 4D, the time-lapse shooting condition is set to capture 100 images at 10-minute intervals. It is shown.

  The user can set the shooting interval for time lapse shooting by touching the interval setting button 34c, and the user can set the number of shots for time lapse shooting by touching the number setting button 34d. Be able to. The control unit 21 records setting information (information about time lapse) based on a user operation in the recording unit 24 and transmits the setting information to the imaging device 10 in step S45. As described above, the control unit 11 of the imaging device 10 receives the setting information in step S12 and stores it in the time lapse information storage unit 15.

  When the user finishes setting the time-lapse shooting, the user touches the return button 34e. Thereby, the display control part 26 returns a display to the state of FIG. 4C. Here, it is assumed that the user instructs time-lapse shooting by touching the time-lapse shooting start button 33d in FIG. 4C. When this photographing operation is performed, the control unit 21 proceeds from step S46 to step S47, and instructs the start or end of photographing. In other words, the control unit 21 transmits a command for shooting instructions for time-lapse shooting to the control unit 11 of the imaging apparatus 10 via the communication units 22 and 16.

  The control unit 11 determines whether or not a time-lapse shooting instruction has been issued in step S13, and the process proceeds to step S14 according to the time-lapse shooting instruction from the information terminal device 20. If there is an instruction for normal shooting instead of time-lapse shooting, normal shooting is performed (not shown).

  In step S14, the controller 11 performs time-lapse shooting under the set conditions. That is, the control unit 11 controls the imaging unit 12 based on information such as the shooting interval and the shooting time stored in the time lapse information storage unit 15 to start time lapse shooting.

  An image obtained by time-lapse imaging of the imaging unit 12 is supplied to the signal processing unit 18 and subjected to predetermined signal processing. The control unit 11 gives the captured image signal-processed by the signal processing unit 18 to the temporary recording unit 14a for recording. In addition, the control unit 11 transmits an image obtained by time-lapse shooting to the information terminal device 20 via the communication units 16 and 22. The information terminal device 20 can generate a time lapse confirmation moving image used for confirmation display using the transferred image.

  Note that the control unit 11 may transmit the obtained captured image to the information terminal device 20 each time a captured image is obtained by each time-lapse photographing, or may be transmitted at a predetermined timing. For example, when a display request for a confirmation display including a time lapse confirmation moving image based on a user operation is generated from the information terminal device 20, the captured image may be transmitted according to a transmission instruction from the information terminal device 20. The control unit 11 may not only transmit the captured image as it is, but also transmit the captured image after converting the captured image into a reduced thumbnail image. The captured image recorded in the temporary recording unit 14 a and the captured image transmitted to the information terminal device 20 may be compressed by the signal processing unit 18.

  In the example of FIG. 2, it is assumed that the captured image is transferred to the information terminal device 20 and the time lapse confirmation moving image is displayed on the display screen 27a of the information terminal device 20, but in the display unit (not illustrated) of the imaging device 10 A time lapse confirmation moving image may be displayed. In this case, it is not necessary to transfer the captured image to the information terminal device 20.

  The controller 11 determines whether or not time-lapse shooting is continued in step S15. When the time-lapse shooting is continued, the control unit 11 obtains a time Tn until the next shooting in the time-lapse shooting in step S16, and sends information on the time to the information terminal device 20 via the communication units 16 and 22. Send.

  The control unit 21 of the information terminal device 20 may receive various types of information from the imaging device 10 in step S54, or may receive the information at any timing after step S36 when communication with the imaging device 10 is established. Good. For example, the control unit 21 provides the recording unit 24 with the information on the remaining time Tn until the next photographing that has been received.

  Here, it is assumed that the user confirms the performance of the time-lapse movie obtained by the time-lapse shooting, and the settings for the time-lapse shooting and the time-lapse movie generation are changed depending on the performance. In the present embodiment, the information terminal device 20 can check the time-lapse moving image and change the setting during the time-lapse shooting. The control unit 21 of the information terminal device 20 displays a confirmation and setting change menu screen (FIG. 4E) for confirmation of a time-lapse moving image obtained by time-lapse shooting of the imaging device 10 and setting change based on a user operation on the display unit 27. It can be displayed on the display screen 27a. Note that the control unit 21 may be configured to always display a confirmation and setting change menu screen during time-lapse shooting.

  5A and 5B are explanatory diagrams for explaining a time-lapse moving image using an image obtained by time-lapse shooting. Now, the user time-lapses the landscape so that it includes a mountain 42 in the center, a relatively dark forest 44 in front of the mountain 42, and a relatively bright sky 43 behind the mountain 42, and changes in the landscape from morning to night. Shall be enjoyed. 5A and 5B show images 41a to 41f and 45a to 45h at predetermined shooting timings, with the reproduction time from time T0 to time TL on the horizontal axis. 5A and 5B show time-lapse moving images obtained at the same frame rate, for example, but have different settings for time-lapse shooting.

  The example of FIG. 5A shows that images 41a to 41f obtained by shooting from morning to night are obtained in a predetermined moving image reproduction time TL. The user can fully feel the change in the scenery over time. On the other hand, the example of FIG. 5B shows that images 45a, 45b,... From the morning to a relatively bright time zone are obtained in the predetermined moving image playback time TL. That is, the changes in the images 45a, 45b,... Are slight, and the user cannot fully feel the change in the landscape over time. That is, FIG. 5B is an example in which the shooting interval is too short compared to FIG. 5A. If the same number of shots is taken in FIGS. 5A and 5B, the shot is taken before the night in FIG. 5B. Indicates that it will end.

  FIG. 4E shows an example of a confirmation and setting change menu screen displayed on the display screen 27a of the information terminal device 20 during time-lapse shooting. In the example of FIG. 4E, on the display screen 27a, a through image display 35a, a setting display 35b of the current shooting number of time lapse shooting, a setting display 35c of the current shooting interval of time lapse shooting, and the time lapse shooting are confirmed. A confirmation button 35d and a return button 35e for shifting to a confirmation mode for displaying a confirmation display are displayed. When the user performs an operation on the confirmation button 35d, a confirmation display of time-lapse photography can be displayed.

  In step S56 or step S48, the control unit 21 of the information terminal device 20 determines whether or not a confirmation mode for displaying the confirmation display based on the time-lapse moving image and confirming the effect is designated. When the user touches the confirmation button 35d to designate the confirmation mode, the control unit 21 moves the process to step S49 and executes the confirmation mode.

  FIG. 4F shows a confirmation display displayed by the display control unit 26. During the confirmation display, the display control unit 26 displays a time lapse confirmation moving image display area for displaying a time lapse confirmation moving image based on a plurality of images of the time lapse shooting result so far or a plurality of thumbnails based on a plurality of images of the time lapse shooting result so far. A thumbnail display area for displaying images (hereinafter, these areas are referred to as confirmation image display areas 36f) can be provided. In the time lapse confirmation moving image display area, a plurality of images obtained by the time lapse shooting so far are displayed at a frame rate that is recorded in the recording unit 24 as an initial frame rate or a frame rate of a time lapse movie. Is done.

  Further, during the confirmation display, the display control unit 26 may display thumbnails of a plurality of images obtained by time-lapse shooting instead of the time-lapse moving image confirmation display. The example of FIG. 4F shows an example in which a thumbnail display area for displaying thumbnail images 36a based on a plurality of captured images obtained by time-lapse shooting so far is provided during confirmation display.

  Below the confirmation image display area 36f, an image switching button 36b for selecting an image not displayed in the thumbnail display area among images obtained by time-lapse shooting up to now is displayed. On the display of the image switching button 36b, a display indicating the number of images from the start of the time-lapse shooting is displayed as the thumbnail image 36a displayed in the thumbnail display area. In the example of FIG. This shows that the first to sixth images are displayed in the thumbnail display area.

  When displaying the time lapse confirmation moving image in the confirmation image display area 36f, the display control unit 26 replaces the image switching button 36b with the entire time lapse confirmation moving image and the start of the reproduction of the moving image under the set conditions. A display showing the reproduction time may be performed.

  During the confirmation display, a setting change button 36c for instructing to change the setting, a remaining time display 36d indicating the time until the next shooting, and a return button 36e are displayed. The control unit 21 reads information on the remaining time Tn recorded in the recording unit 24 and displays a remaining time display 36d. The user can grasp the remaining time for ending the setting operation until the next photographing by the remaining time display 36d.

  Here, it is assumed that the user operates the setting change button 36c. Then, the display control unit 26 displays the time lapse setting change screen shown in FIG. 4G.

The user uses the time lapse setting change screen, which is an adjustment display, to specify and delete unnecessary images as images to be used for time lapse movies, or to set the shooting conditions for subsequent time lapse shooting, that is, the shooting interval and the number of shots. Can be changed. In addition, the image capturing condition may be changed to make a more dramatic image change, or an image change with less change. In other words, the playback result can be immediately reflected in the shooting, and those that do not like can be deleted, so that it is possible to create a favorite moving image between shootings while making various fine adjustments. This is like a movie that has been edited at the same time as the end of shooting, and it can make an extraordinary contribution in terms of effective use of time by the user. For example, a shooting method in which bracket shooting is continuously performed and only a good image in the bracket shooting is adopted as a moving image is included in the range covered by the present application if it can be confirmed appropriately. The range of the moving image to be confirmed does not have to be all frames, and it may be possible to specify that only the part of interest can be reproduced. Such application is possible by selecting the thumbnails or displaying the time bar and specifying the range.
The time lapse setting change screen in FIG. 4G has an area for displaying a thumbnail image 37a based on images obtained by the time lapse shooting so far. Also, on the time lapse setting change screen of FIG. 4G, a delete selection button 37b, a number change button 37c, an interval change button 37d, other setting buttons 37e, and a return button 37f are displayed.

  When the user operates the delete selection button 37b, an image to be deleted can be designated by a touch operation on the thumbnail image 37a. The control unit 21 receives a user's deletion operation and generates an instruction to delete the captured image corresponding to the thumbnail image 37a designated as the image to be deleted from the recording unit 24 and the temporary recording unit 14a of the imaging device 10.

  The control unit 11 of the imaging device 10 determines whether or not a setting change instruction has occurred in step S17 of FIG. 2 and receives an instruction to delete the captured image used for the time-lapse moving image from the information terminal device 20. Then, the instructed captured image is deleted from the temporary recording unit 14a (step S18). If not all images used for the time-lapse moving image are displayed on the time-lapse setting change screen, the remaining thumbnail images can be displayed and selected by operating the delete selection button 37b.

  In addition, when the number change button 37c is touched by the user, the display control unit 26 displays a number change display (not shown). In addition, when the interval change button 37d is touched by the user, the display control unit 26 displays an interval change display (not shown). Note that the time-lapse shooting setting screen in FIG. 4D may be displayed instead of the number change display and the interval change display. The user can change the setting of the number of shots and the shooting interval for time-lapse shooting through operations on these number change display and interval change display.

  For example, when the user feels that the change in the image is poor as a result of confirming the time lapse confirmation video based on the time lapse photographed image at the 10 minute interval setting, for example, the photographing interval is increased to 30 minutes. Settings can be made. On the contrary, as a result of confirming the time lapse confirmation video based on the image taken by the time lapse with the 10 minute interval setting, when the change in the image is felt to be too intense, for example, the photographing interval is reduced to the 3 minute interval, etc. Settings can be made.

  When the user is instructed to change the setting of the time-lapse shooting, the control unit 21 records the setting change information in the recording unit 24 and issues a setting change instruction to the control unit 11 of the imaging apparatus 10. In step S18 of FIG. 2, the control unit 11 of the imaging apparatus 10 stores the number of shots and the shooting interval based on the user operation in the time lapse information storage unit 15 and reflects them in subsequent time lapse shooting. Thereby, it is possible to prevent the subsequent shooting from being wasted. Even if useless shooting is performed, it is also possible in the present application to perform shooting again immediately, discard the failed frame, and replace it with a successful frame.

  FIG. 6 is an explanatory diagram for explaining each shooting timing of time-lapse shooting, time-lapse confirmation moving image confirmation and setting change timing. FIG. 6 shows the photographing timings T1, T2,... Of time lapse photographing by taking time on the horizontal axis and using pulse waveforms. For example, it is assumed that the user displays a confirmation display for time-lapse shooting after shooting at timing T6. The time lapse confirmation moving image P obtained at this timing is generated using the images Pt1 to Pt6 obtained by shooting at the timings T1 to T6. The user can confirm the result of the time lapse moving image by the time lapse confirmation moving image P generated by these images Pt1 to Pt6.

  For example, when the user feels that the change in the moving image is scarce due to the time lapse confirmation moving image at this time, an operation for increasing the shooting interval is performed. Thereby, the control unit 11 of the imaging apparatus 10 controls the imaging unit 12 to widen the shooting interval of time lapse shooting. Accordingly, as shown at timing T7 in FIG. 6, the next shooting is performed at a wider interval than the previous shooting interval. In this way, confirmation and setting change for obtaining a time-lapse moving image satisfying the user can be performed during the time-lapse shooting.

  In the example of FIG. 4G, when the other setting button 37e is touched, the control unit 21 can perform other settings. For example, the display control unit 26 may display a frame rate change display (not shown) when the other setting button 37e is touched. In the initial state, the frame rate used when the time-lapse moving image is generated in the imaging apparatus 10 may be employed for the time-lapse confirmed moving image in the confirmation display. By a user operation using the frame rate change display, the control unit 21 can change the frame rate of the time lapse confirmation moving image displayed in the confirmation display. As a result, the user can view the time lapse confirmation moving image in which the frame rate change operation is reflected while performing the frame rate change operation. When a satisfactory time-lapse confirmation moving image is obtained by a frame rate changing operation, the user may be able to set the frame rate in this case as the frame rate at the time-lapse moving image generation time. . When the control unit 21 receives an operation of changing the frame rate by the user, the control unit 21 records the information on the frame rate in the recording unit 24 and gives the information to the control unit 11 of the imaging apparatus 10. Thereby, the signal processing unit 18 of the imaging apparatus 10 can generate a time-lapse moving image at a frame rate specified by the user.

  In the example of FIG. 4G, an example in which the change of the number of shots is specified is shown. However, for example, a shooting end time may be set. Further, when the other setting button 37e is touch-operated, the setting of the shooting parameter at the time-lapse shooting may be changed.

  In the above description, the time lapse shooting has been described as shooting at a constant time interval. However, when a device that performs time lapse shooting at an interval based on a predetermined condition setting is employed, the time lapse shooting setting screen of FIG. 4G is used. The timing conditions for time-lapse photography may be changed. In addition, time-lapse shooting is not possible only at a predetermined time period and at a predetermined time interval, and the predetermined time period may be changed during or immediately after shooting, and the shooting interval is also fixed by an insulator ruler. Need not be. This is because the present invention is characterized in that the control around this can be switched while appropriately confirming the effect of the moving image.

  As described above, in the present embodiment, during the shooting of the time lapse shooting, a time lapse confirmation moving image is generated using the shooting result of the time lapse shooting so far, and the result of the time lapse shooting can be confirmed. A setting change is accepted, and after that, photographing reflecting the setting change is performed. Thereby, it is possible to easily obtain a time-lapse moving image desired by the user.

  In time-lapse shooting, generally, there is a relatively long time between shooting, and a sufficient set time can be taken between shooting. By checking and changing settings using the idle time, the user can obtain a desired image by one time-lapse shooting.

  Further, since processing for confirming the result of time-lapse shooting and changing the setting is performed in an information terminal device different from the imaging device, there is an advantage that time-lapse shooting is not affected by these processing. In addition, even when processing for checking the result of time-lapse shooting and changing settings in the imaging device, the time until the next shooting is displayed so that the user can perform the setting work so as not to hinder the next shooting. The remaining time is recognized, and the user can work with peace of mind.

  In addition, the signal processing unit may control the playback frame rate so that all of the confirmation time-lapse confirmation moving image ends during the remaining time until the next shooting.

  In the confirmation display, the example in which the shooting interval and the number of shots are directly specified has been described. However, the appropriate shooting interval and the number of shots are automatically set according to the user operation by the display of increasing the movement or reducing the movement. It may be set. For example, when a button for increasing movement is displayed and this button is operated, settings such as shortening the shooting interval and increasing the number of shots so as not to change the total shooting time may be automatically performed. Good. Alternatively, the optimum shooting interval and number of shots may be automatically set by setting the speed of movement to be doubled or 1/3. In other words, time-lapse shooting is not possible only at a predetermined time period and a predetermined time interval, and the predetermined time period can be changed during or immediately after shooting. Also, the shooting interval need not be constant with the lever ruler, and according to the present invention, it is possible to switch the control around this while confirming the effect of the moving image as appropriate.

  Furthermore, the movement of each part of the image may be determined by image analysis, and the image used for generating the time-lapse moving image may be automatically selected based on the determination result. When there is an optimal model for each scene as a time-lapse movie, the scene is analyzed by image analysis, and the model is automatically selected by comparing with the model of the scene according to the analysis result. Good. For example, in the case of the scenes as shown in FIGS. 5A and 5B, it may be determined that an unnecessary image is captured as a time-lapse movie due to a change in the overall luminance average value. An image may be selected and deleted, or it may be automatically controlled to increase the number of shots in order to extend the shooting period.

(Second Embodiment)
FIG. 7 is a block diagram showing a second embodiment of the present invention. The present embodiment shows an example in which the confirmation of the result of time-lapse shooting and the setting change are made possible only by the imaging device. That is, the imaging device 50 in the present embodiment has the same configuration as both the imaging device 10 and the information terminal device 20 of FIG.

  In FIG. 7, the image pickup apparatus 50 includes an image pickup unit 52 configured by an image pickup element such as a CCD or a CMOS sensor. The imaging unit 52 is provided with a lens (not shown) so that a subject optical image is guided through the lens. This lens may have a zooming and focusing function. The imaging unit 52 obtains an imaging signal by converting the subject optical image into an electrical signal by the imaging element. This imaging signal is supplied to the image processing unit 53.

  The imaging device 50 is provided with a control unit 51, and the control unit 51 controls each unit of the imaging device 50. The control unit 51 may be configured by a processor such as a CPU (not shown) or may operate according to a program stored in a memory (not shown). The imaging device 50 includes an operation unit 57 that includes a shutter button, a function button, various switches for setting a shooting mode, and the like provided on a housing of the imaging device 50. The operation unit 57 receives a user operation and outputs an operation signal based on the user operation to the control unit 51. The control unit 51 can control the photographing control unit 53 a in the image processing unit 53 based on the operation signal from the operation unit 57. The imaging control unit 53a is controlled by the control unit 51 to generate a focus signal and a zoom signal, and can drive the lens of the imaging unit 52 to perform zooming, focusing, and the like. In addition, the imaging control unit 53a can output a driving signal for the imaging element to the imaging unit 52 to control the shutter speed, the exposure time, and the like.

  The control unit 51 can also control the shooting control unit 53a to cause the imaging unit 52 to perform shooting at a predetermined time interval, and to execute time-lapse shooting in which playback is performed in a time shorter than the shooting time. Yes. Note that shooting parameters for time lapse shooting, for example, information related to shooting intervals and shooting times, are stored in the time lapse information storage unit 59, and the control unit 51 reads information in the time lapse information storage unit 59 to control time lapse shooting. It is supposed to be.

  The control unit 51 can supply the captured image from the imaging unit 52 to the image processing unit 53. The image processing unit 53 performs predetermined signal processing, for example, color adjustment processing, matrix conversion processing, noise removal processing, and other various signal processing on the read captured image.

  The imaging device 50 is provided with a recording unit 54 and a temporary recording unit 54a. The image processing unit 53 is provided with a recording control unit 53c, and the recording control unit 53c is controlled by the control unit 51 to control recording and reproduction with respect to the recording unit 54 and the temporary recording unit 54a. The control unit 51 can give the captured image signal-processed by the image processing unit 53 to the recording unit 54 or the temporary recording unit 54a for recording. For example, the control unit 51 can give the captured image acquired in the normal shooting mode to the recording unit 54 for recording. In addition, the control unit 51 can provisionally record the captured image from the imaging unit 52 acquired in the time-lapse imaging mode by giving it to the temporary recording unit 54a.

  In addition, the image processing unit 53 can generate a time-lapse moving image by controlling the control unit 51 to place the captured image recorded in the temporary recording unit 54a on the timeline. The frame rate information necessary for generating the time-lapse movie is stored in the time-lapse information storage unit 59, and the control unit 51 reads the information in the time-lapse information storage unit 59 to control the generation of the time-lapse movie. It has become.

  The image processing unit 53 is provided with a compression control unit 53b. The compression control unit 53b is controlled by the control unit 51 so that it can perform compression processing when recording an image file such as a captured image or a time-lapse movie. The recording unit 54 and the temporary recording unit 54a include An image after compression processing can be recorded.

  The image processing unit 53 is provided with a display control unit 53g. The display control unit 53g executes various processes related to display. The display control unit 53g is controlled by the control unit 51 to control the display of the display unit 56. The display unit 56 has a display screen such as an LCD, and displays an image given from the display control unit 53g. For example, the control unit 51 can control the display control unit 53g to display a through image or a reproduced image of a captured image on the display screen of the display unit 56. Further, in the present embodiment, the control unit 51 controls the display control unit 53g to display a confirmation display including the time lapse confirmation moving image on the display screen of the display unit 56, and the time lapse confirmation moving image is desired. In order to change to a moving image, various parameters used for time-lapse shooting and time-lapse movie generation of the imaging device 50 can be adjusted, and an adjustment display for designating an image (deleted image) that is not used for time-lapse movie generation can be displayed. .

  A touch panel as the operation unit 57 may be provided on the display screen of the display unit 56. The touch panel can generate an operation signal corresponding to the position on the display screen pointed by the user with a finger. This operation signal is supplied to the control unit 51. Thereby, the control part 51 can detect the operation, when a user touches or slides on the display screen. That is, the control unit 51 can detect various operations such as a user's touch position, an operation for closing and separating a finger (pinch operation), a position reached by a slide operation or a slide operation, a slide direction, and a touch period. It is possible to execute a process corresponding to a user operation.

  The control unit 51 stores, in the time lapse information storage unit 59, information on parameter setting values by user operations for adjustment display. The image selection unit 53e is provided in the image processing unit 53, and the selection selection unit 53e is an image recorded in the temporary recording unit 54a so as to exclude the image based on the user's deletion operation from the generation of the time-lapse moving image. Is supposed to be deleted. Accordingly, the image processing unit 53 generates a time-lapse moving image using an image that has not been deleted by the user operation according to the parameter based on the user operation. A confirmation display including the time lapse confirmation moving image based on the time lapse moving image is displayed on the display screen of the display unit 56. That is, the user can change the time lapse confirmation moving image to a desired moving image while viewing the confirmation display. That is, it can be visually matched to the user's preference.

  The image processing unit 53 is also provided with a resizing unit 53f. The resizing unit 53f can reduce the time-lapse moving image to obtain a thumbnail image. This thumbnail image can be used as an image for confirmation display and adjustment display. The image processing unit 53 is also provided with an effect processing unit 53d. The effect processing unit 53d can perform predetermined image effect processing on an image obtained by normal photographing and an image obtained by time-lapse photographing.

  The control unit 51 accepts a change in information related to the time lapse by the user until the time lapse shooting is completed, and at the stage when the time lapse shooting is completed, the time lapse movie based on a series of images recorded in the temporary recording unit 54a by the image processing unit 53. Is generated and given to the recording unit 54 to be recorded as a moving image file.

  FIG. 8 is an explanatory diagram illustrating an example of the appearance of the imaging device 50. As shown in FIG. 8, the housing 50 a of the imaging device 50 is provided with a lens barrel (not shown) on the front surface, and the lens portion of the imaging unit 52 is accommodated in the lens barrel. In addition, the imaging device 50 may be provided with a finder unit 61 on the upper surface of the housing 50a. Further, an eye sensor 63 that detects that the user has brought the eye close to the finder unit 61 may be provided in the vicinity of the finder unit 61. The eye sensor 63 detects that the user has brought the eye close to the finder unit 61 and outputs the detection result to the control unit 51. In this case, the display control unit 53g may be able to switch the image output destination between the display unit 56 and the LCD constituting the finder unit 61 based on the detection result of the eye sensor 63.

  Further, as the operation unit 57, a shutter button 64 and two dial operation units 65 and 66 are disposed on the upper surface of the housing 50a, and a PICT button 68 is disposed on the rear surface of the housing 50a. For example, the user can not only press the shutter button 64 with the index finger while looking through the finder unit 61 while holding the imaging device 50, but can also operate the dial operation unit 66 with the thumb of the right hand and the dial operation with the index finger. The unit 65 can be easily operated. By operating the PICT button 68, a predetermined effect process can be instructed. The effect processing unit 53d performs an image effect process corresponding to a user operation on a captured image or the like.

  Next, the operation of the embodiment configured as described above will be described with reference to FIG. FIG. 9 is a flowchart for explaining the operation of the second embodiment. In FIG. 9, the same steps as those in FIG.

  The control unit 51 of the imaging device 50 determines whether or not a power-off operation has been performed in step S51 of FIG. If there is a power-off operation, the controller 51 turns off the power in step S3 and returns the process to step S51.

  The control unit 51 displays a through image in step S52. In other words, the control unit 51 provides the image processing unit 53 with the imaging signal acquired by the imaging unit 52. The display control unit 53g displays the captured image after the signal processing on the display screen of the display unit 56 as a through image. Thus, the through image acquired by the imaging unit 52 is displayed on the display screen 56 a of the display unit 56.

  In step S53, the control unit 51 of the imaging device 50 determines whether a shooting control operation has been performed. When the user performs setting operations such as shooting parameters and image processing parameters, the control unit 51 changes the shooting mode and parameters in step S12. In step S12, parameters related to time-lapse shooting can be set. For example, the control unit 51 allows the display control unit 53g to display a time lapse shooting setting screen similar to the display of FIG. 4D on the display screen of the display unit 56, thereby accepting a parameter setting operation related to time lapse shooting by the user. Can do. Note that setting change information related to time-lapse shooting by the user is stored in the time-lapse information storage unit 59.

  Here, it is assumed that the user performs a shooting operation for time-lapse shooting. When the control unit 51 detects an operation for starting time-lapse shooting in step S13, the control unit 51 shifts the processing to step S14 and starts time-lapse shooting in accordance with a shooting instruction for time-lapse shooting. If there is an instruction for normal shooting instead of time-lapse shooting, normal shooting is performed (not shown).

  The control unit 51 controls the imaging unit 52 based on information such as the shooting interval and the shooting time stored in the time lapse information storage unit 59 to start time lapse shooting. An image obtained by time-lapse shooting of the imaging unit 52 is supplied to the image processing unit 53 and subjected to predetermined signal processing. The control unit 51 gives the captured image signal-processed by the image processing unit 53 to the temporary recording unit 54a for recording.

  The control unit 51 determines whether or not time-lapse shooting is continued in step S15. When the time-lapse shooting is continued, the control unit 51 obtains the remaining time Tn until the next shooting in the time-lapse shooting in step S16.

  Here, it is assumed that the user confirms the performance of the time-lapse movie obtained by the time-lapse shooting, and the settings for the time-lapse shooting and the time-lapse movie generation are changed depending on the performance. In the present embodiment, in step S54, the control unit 51 determines whether or not a confirmation display display operation for confirming the time-lapse moving image and changing the setting during the time-lapse photographing is performed.

  When a confirmation display instruction is issued by the user, the control unit 51 controls the image processing unit 53 to check a time-lapse moving image obtained by time-lapse shooting of the imaging device 50 within the remaining time Tn in step S55. The time lapse confirmation moving image is generated by adjusting the frame rate. The display control unit 53g displays the time lapse confirmation moving image on the display screen 56a of the display unit 56, for example. Also in the present embodiment, the image processing unit 53 generates a time lapse confirmation moving image using an image obtained by time lapse photography performed until a confirmation display display instruction is given. Further, in FIG. 9, it has been described that the frame rate is adjusted so that the playback of the time lapse confirmation video is completed within the remaining time Tn, but the initial frame rate or the time lapse information storage unit 59 that is determined in advance is stored. A time lapse confirmation moving image may be generated by using a certain frame rate.

  FIG. 8 shows an example in which a time lapse confirmation moving image 71 is displayed on the display screen 56a. The user can determine whether or not shooting is performed to obtain an image desired by the time lapse confirmation moving image on the display screen 56a. The display control unit 53g may display the time lapse confirmation moving image by the same display as the confirmation display shown in FIG. 4F.

It is assumed that the user confirms the time lapse confirmation video and desires to change the setting. In this case, the display control unit 53g may receive a setting change by the user by displaying an adjustment display similar to FIG. 4G. Accordingly, the user can select an image that is not used for generating the time-lapse moving image, and can adjust the shooting interval, the number of shots, the frame rate, and the like. The control unit 51 causes the time lapse information storage unit 59 to store setting information obtained by adjustment by the user. Further, the control unit 51 may display a time lapse confirmation moving image reflecting the setting change if there is a time allowance until the next shooting.
If you accept changes in time-lapse shooting settings and reflect them in subsequent time-lapse shooting, for example, depending on settings such as the time interval during time-lapse shooting and the frame rate setting when generating a time-lapse movie, changes in the image of the time-lapse movie may occur. The problem that a time-lapse movie that satisfies the user may not be obtained due to being too early or too late can be taken in advance. In addition, time-lapse shooting is not possible only at a predetermined time period and at a predetermined time interval, and the predetermined time period may be changed during or immediately after shooting, and the shooting interval is also fixed by an insulator ruler. Need not be. This is because according to the present invention, it is possible to obtain a moving image that suits the user's preference by switching the control around this while appropriately checking the effect of the moving image.

  In step S17, the control unit 51 of the imaging device 50 determines whether or not an instruction to change settings or the like has occurred. When an operation for deleting a captured image used for a time-lapse movie occurs, the designated captured image is temporarily stored. It deletes from the recording part 54a (step S18). When the user is instructed to change the setting of the time lapse shooting, the control unit 51 records the setting change information in the time lapse information storage unit 59 and generates an instruction to change the setting in the image processing unit 53. In step S <b> 18, the control unit 51 reads information on the number of shots and the shooting interval based on the user operation from the time lapse information storage unit 59, and reflects them in subsequent time lapse shooting. Thereby, it is possible to prevent the subsequent shooting from being wasted.

  Other configurations and operations are the same as those in the first embodiment. Although repeated explanations are omitted one by one, this example has already been described in the first embodiment.

  Thus, also in this embodiment, the same effect as the first embodiment can be obtained.

  In each of the above embodiments, there is an advantage that the playback time of the generated time-lapse movie can be finely adjusted during the time-lapse shooting. In time-lapse shooting, the recording time and the playback time are different, so that the sound may be synthesized after the time-lapse movie is generated without using the sound collected during the time-lapse shooting. In this case, if the length of the audio signal is known, the time lapse video time and the audio time are matched by changing the time lapse shooting conditions so that the playback time of the time lapse video matches this length. It is also possible to create a video easily. In other words, time-lapse shooting is not possible only at a predetermined time period and at a predetermined time interval, and the predetermined time period may be changed during or immediately after shooting, and the shooting interval is also constant with the insulator ruler. Need not be. According to the present invention, it is possible to switch the control around this while appropriately checking the effect of the moving image, and even if the frame rate at the time of moving image reproduction can be changed as necessary. Good. Since the obtained video can be confirmed during shooting, the frame rate may be adjusted each time, and the specific frame rate may be changed by slowing down or fast-forwarding from the middle. Then, the degree of freedom in devising to obtain the desired photographing result by switching the next photographing is increased, and effective photographing can be continued.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment.

  For example, the system for obtaining an image desired by the user is not limited to a consumer imaging system, but can also be applied to a system for obtaining an image for a user to observe, diagnose, or examine. Is possible. The process for obtaining a user's favorite image may be expressed as an adjustment process for a moving image for report or evidence. For medical use, it can also be applied to endoscopes, etc., and it is necessary to express the necessary treatment process and digest only the necessary affected part, while for scientific use, it is most suitable for cell culture. It can be used to create a movie that shows the features. Observation and photographing control can be performed while confirming the change of the moving image.

  It should be noted that even if the operation flow in the claims, the description, and the drawings is described using “first,” “next,” etc. for convenience, it is essential to carry out in this order. It doesn't mean. In addition, it goes without saying that the steps constituting these operation flows can be omitted as appropriate for portions that do not affect the essence of the invention.

  Of the technologies described here, many of the controls and functions mainly described in the flowcharts can be set by a program, and the above-described controls and functions can be realized by a computer reading and executing the program. it can. As a computer program product, the program may be recorded or stored in whole or in part on a portable medium such as a non-volatile memory such as a flexible disk or a CD-ROM, or a storage medium such as a hard disk or a volatile memory. It can be distributed or provided at the time of product shipment or via a portable medium or communication line. The user can easily download the program via a communication network and install it on the computer, or install it from the recording medium into the computer, so that the information terminal device, imaging device, and image information processing system of the present embodiment can be easily installed. Can be realized.

    DESCRIPTION OF SYMBOLS 1 ... Image information processing system, 10 ... Imaging device, 11, 21 ... Control part, 12 ... Imaging part, 13 ... Sound collection part, 14, 24 ... Recording part, 15 ... Temporary recording part, 16, 22 ... Communication part, DESCRIPTION OF SYMBOLS 17 ... Communication control part, 18, 25 ... Signal processing part, 19, 23 ... Operation part, 26 ... Display control part, 27 ... Display part.

Claims (12)

A communication unit that communicates with the imaging device in order to acquire the results of repeated imaging at specific intervals;
A signal processing unit that generates a confirmation moving image of a specific frame rate based on the plurality of captured images transmitted from the imaging device via the communication unit in the middle of the imaging period of the imaging device;
An information terminal device comprising: a display control unit that displays the confirmation moving image generated by the signal processing unit. The information terminal device according to claim 1, further comprising: a control unit that receives an operation for changing a setting for repeated imaging in the imaging device and instructs the imaging device to perform a setting based on the operation. . The information terminal device according to claim 1, wherein the display control unit displays a remaining time until the next imaging performed in the imaging device. The information terminal device according to claim 3, wherein the signal processing unit adjusts a frame rate of the confirmation moving image so that the display of the confirmation moving image is completed by the remaining time. The information according to any one of claims 1 to 3, wherein the signal processing unit generates the confirmation moving image at a frame rate used when generating a moving image based on a series of captured images obtained by the repeated imaging. Terminal device. An imaging unit capable of time-lapse imaging for repeated imaging;
A signal processing unit that generates a confirmation moving image of a specific frame rate by a plurality of captured images obtained by the imaging unit in the middle of the imaging period by the imaging,
An image pickup apparatus comprising: a display control unit that displays the confirmation moving image. The imaging unit according to claim 6, further comprising: a control unit that receives an operation for changing the setting for obtaining the captured image in the imaging unit and instructs the imaging unit to perform a setting based on the operation. apparatus. The imaging apparatus according to claim 6 or 7, wherein the display control unit displays a remaining time until the next imaging performed in the imaging unit. The imaging apparatus according to claim 8, wherein the signal processing unit adjusts a frame rate of the confirmation moving image so that the display of the confirmation moving image is completed by the remaining time. An imaging unit capable of time-lapse imaging for repeated imaging;
A first signal processing unit that generates a moving image by a plurality of captured images obtained by the imaging unit;
A first communication unit that is controlled by the first control unit and transmits the captured image to the information terminal device;
A second communication unit that communicates with the first communication unit and receives the captured image;
A second signal processing unit that generates a confirmation moving image of a specific frame rate based on the plurality of the captured images received via the second communication unit in the middle of the imaging period of the imaging unit;
An image information processing system comprising: a display control unit that displays the confirmation moving image generated by the second signal processing unit. A second unit configured to receive an operation for changing the setting for obtaining the plurality of captured images in the imaging unit and to transmit setting information based on the operation to the first communication unit via the second communication unit; A control unit,
The image information processing system according to claim 10, wherein the first control unit controls time-lapse shooting of the imaging unit using the setting information received by the first communication unit. A procedure for receiving a captured image obtained by an imaging apparatus capable of time-lapse imaging for repeated imaging;
A procedure for generating a confirmation moving image of a specific frame rate by a plurality of the captured images received in a shooting period by the imaging device;
An image information processing method comprising: a display procedure for displaying the confirmation moving image.