JP6354377B2 - Imaging apparatus and control method and program thereof - Google Patents

Description

  The present invention relates to an imaging apparatus, a control method thereof, and a program.

  An image pickup apparatus that can take a still image while shooting a moving image is used.

  In Patent Document 1, when a still image is shot during moving image recording, a still image is easily created from a plurality of compression-coded frame images that form a moving image file without interrupting the moving image recording. A technique of an imaging apparatus is disclosed.

  In Patent Document 2, an image is taken at a high shutter speed for a unit period, and when a still instruction is received during playback of the taken moving image, a clear still image is taken out of the images taken at a high shutter speed. A technique for searching and reproducing is disclosed.

JP 2013-175978 A JP-A-8-235673

  If still image shooting is performed during moving image recording, the moving image recording is temporarily stopped and shooting is performed with the still image setting. Therefore, the moving image being shot with the still image setting is uncomfortable and smooth moving image reproduction cannot be performed.

  In the technique of Patent Document 1, a still image can be easily created from a plurality of compression-coded frame images forming a moving image file without interrupting moving image recording. You can't record a beautiful video that doesn't shake when you touch it.

With the technology of Patent Document 2, a clear still image can be searched for and reproduced from images taken at a high shutter speed, but it does not shake when the user views it as a still image. You cannot record a movie.
An object of the present invention is to provide a mechanism that can store a beautiful moving image that does not shake even when viewed by a user as a still image in a part of the moving image being shot.

The present invention includes a moving image capturing unit that captures a moving image and stores the captured moving image, a first receiving unit that receives an instruction to start capturing a moving image, and a first receiving unit that receives an instruction to capture a still image while the moving image is being captured. And a storage unit that acquires and stores the currently set shutter speed value and the focal length value of the mounted lens when the second reception unit receives the still image capturing instruction. And determining means for determining whether or not the moving image being shot has reached a camera shake limit value based on the set shutter speed value and the focal length value of the lens, wherein the determination means is the camera shake limit value. If it is determined that does not reach the value for a user to view as a still image, changing the shutter speed value that is the set to be close to the camera shake limit value kinematic The storing said moving image pickup unit to shoot a predetermined time, after a video on the changed storage predetermined time and to store the videos back to shutter speed values the moving image capturing means is the storage Imaging device.

In addition, when the second receiving unit receives a still image capturing instruction during the shooting of the moving image, the moving image capturing unit includes the moving image of the set shutter speed value and the camera shake limit value. The moving image in which the shutter speed value is changed for a predetermined time so as to approach the value and the moving image that has been restored to the stored shutter speed value are stored in succession.
If the determination means determines that the camera shake limit value has been reached, the set shutter speed value is not changed so as to approach the camera shake limit value. The moving image capturing means stores the moving image as it is.
Further, an extraction means for extracting a still image shutter speed value that has been pre-Symbol set from among the videos changed so as to approach the camera shake limit value, a still image storage means for storing the extracted still image, Is further provided.

  In addition, the extracting unit extracts a plurality of different still images from the changed moving images, and the still image storage unit stores the determined moving images after it is determined that the storage of the moving images taken by the moving image capturing unit is completed. And a comparison display control means for displaying the plurality of different still images side by side for comparison.

In addition, an autofocus operation determining unit that determines whether or not the timing at which the second receiving unit receives the imaging instruction is executing an autofocus operation of a lens mounted on the imaging device; When the focus operation determination unit determines that the autofocus operation is being performed, the second reception unit does not receive the imaging instruction.

  According to the present invention, it is possible to provide a mechanism capable of storing a beautiful moving image that is not shaken even when viewed by a user as a still image in a part of the moving image being shot.

It is a figure which shows an example of the hardware block diagram of the imaging device of this invention. It is a figure which shows the flowchart which the imaging device of this invention performs. It is a figure which shows the flowchart which the imaging device of this invention performs. It is a figure which shows an example of the operation screen which the imaging device of this invention displays. It is a figure which shows an example of the operation screen which the imaging device of this invention displays. It is a figure which shows an example of the operation screen which the imaging device of this invention displays. It is a figure which shows an example of the operation screen which the imaging device of this invention displays. It is a figure which shows an example of the operation screen which the imaging device of this invention displays. It is a figure which shows an example of the operation screen which the imaging device of this invention displays. It is a figure which shows an example of the operation screen which the imaging device of this invention displays. It is a structural example of the setting data which the imaging device of this invention memorize | stores. It is an example of a structure of the internal data which the imaging device of this invention memorize | stores. It is an example of a structure of the internal data which the imaging device of this invention memorize | stores.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
Referring to FIG.
FIG. 1 is a block diagram illustrating a main functional configuration of a digital camera as an example of an imaging apparatus according to an embodiment of the present invention.

  The taking lens 10 includes a zoom lens for continuously changing the focal length and a focus lens for adjusting the focus. These lenses are driven by the zoom control unit 44 and the distance measurement control unit 42. The taking lens 10 forms an image of a subject on the image pickup surface of the image pickup device 14. The image pickup device 14 is a photoelectric conversion image pickup device that outputs an electrical signal corresponding to the light intensity of the subject image formed on the image pickup surface, and a CCD type or MOS type individual image pickup device is used.

  The aperture 12 is operated by the exposure control unit 40. An analog video signal from the image sensor 14 is input to the A / D converter 16 and converted from an analog signal to a digital signal. The A / D converted digital signal is subjected to various image processing such as gamma correction and white balance correction by the image processing unit 20. The image display memory 24 is a memory that can store data for a plurality of frames captured by the image sensor 14. The image processed image data is temporarily stored in the image display memory 24.

  The system control unit 112 is connected to the exposure control unit 40, the camera posture detection unit 106, and the like, and performs sequence control when the camera operates. The system control unit 112 displays a power switch 72 for turning on / off the camera, a shutter switch 62 for opening and closing the shutter at a set shutter speed value in conjunction with the release, a full-press switch 64, and a display on the display unit 54. An operation unit 70 is provided for selecting various menu contents when shooting a camera. When the subject brightness is low, the flash 48 is emitted. The image display unit 28 and the display unit 54 may have the same configuration. In addition, the image display unit 28 (display unit 54) in the present embodiment has a touch panel function, and can specify the position touched by the user. The touch detection mechanism necessary for this touch panel function will be described as being provided in the image display unit 28 (display unit 54). Note that the touch panel function itself is a known technique, and detailed description thereof is omitted.

  In addition to the image data converted by the image processing unit 20, the image data stored in the image display memory 24 matches the focus information for determining the feature position of the subject's face or the focus confirmation position arranged at a fixed position. Shadow information such as information on the location and information of the camera posture detection unit 106 is also stored together. Data stored in the image display memory 24 is recorded in storage media 200 and 210 (recording units 200 and 210) such as a memory card. When recording image data in the storage media 200 and 210, data compression is generally performed in a predetermined compression format, for example, the JPEG method. The compression / decompression unit 32 performs data compression when recording image data and photographing information in the storage media 200 and 210, and decompression processing of the image data compressed from the storage media 200 and 210. The storage medium 200 is, for example, a compact flash (registered trademark), a memory card, or an SD memory card.

  The nonvolatile memory 56 is a nonvolatile memory capable of electrically erasing and recording stored data and the like, and for example, an EEPROM or the like is used. The memory 52 is a memory for storing constants, variables, programs and the like for operating the system control circuit 50. The communication unit has a communication function.

An antenna (connector in the case of wired communication) 112 connects the digital camera to other devices via a packet network, a network, and the Internet by a communication unit. The connectors 82 and 84 are connection parts that connect the power supply control unit 80 and the power supply 86. The power source 86 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like.

  The display image data written in the image display memory 24 is displayed by the image display unit 28 via the D / A conversion circuit 26. By sequentially displaying the image data on the image display unit 28, the electronic finder function can be realized. The optical viewfinder 104 can take an image using only the optical viewfinder without using the electronic viewfinder function of the image display unit 28.

  The timing generation circuit 18 is controlled by the memory control unit 22 and the system control unit 112. The memory 30 is a memory for storing captured still images and moving images. The barrier control unit 46 controls the operation of the protection unit 102. The mode dial switch 60 can switch and set various function modes such as power-off, automatic shooting mode, shooting mode, panoramic shooting mode, moving image shooting mode, playback mode, multi-screen playback / erase mode, and PC connection mode. The playback mode switch 66 is a mode switch for executing the image playback processing described in the present embodiment. The attitude mode switch 68 is a switch that automatically determines whether the camera is shooting in the vertical position or in the horizontal position.

  The storage medium 200 includes a recording unit 202 composed of a semiconductor memory, a magnetic disk, and the like, an I / F 204 that is an interface with the digital camera 100, and a connector 206 that connects to the digital camera. The storage medium 210 includes a recording unit 212 composed of a semiconductor memory, a magnetic disk, or the like, an I / F 214 that is an interface with the digital camera, and a connector 216 that connects to the digital camera. The I / Fs 90 and 94 are interfaces for connecting the storage media 200 and 210 such as a memory card and a hard disk and the system bus. The connectors 92 and 96 are connection portions that connect the storage media 200 and 210 such as a memory card and a hard disk and the I / Fs 90 and 94. The storage medium attachment / detachment detection means 98 is a sensor that detects whether or not the storage media 200 and 210 are attached to the connectors 92 and 96.

An original image is stored in the image data area. The image data is compressed in a predetermined compression format, for example, the JPEG method, but is not limited to this. The storage device 56 stores software for compression / decompression, and performs compression of image data including shooting information captured in the RAM 52 and decompression of the compressed image data.
FIG. 2 will be described.

FIG. 2 is a flowchart for accepting a moving image shooting start instruction by a user, which is executed by the system control unit 112 of the imaging apparatus 100 or the CPU of the imaging apparatus 100 (not shown) to represent the embodiment of the present invention.
In step S100, the imaging apparatus 100 refers to the still image setting during moving image shooting that is set in advance by the user as illustrated in FIG.

In step S <b> 101, the imaging apparatus 100 determines whether it is a still image setting during moving image shooting. If it is determined that the still image setting is currently being shot, the process proceeds to step S102.
In step S102, the imaging apparatus 100 starts moving image shooting. The moving image shot in this way is stored (moving image capturing means).
Thereafter, the process proceeds to step S104.

  If the image capturing apparatus 100 determines in step S103 that the current setting is not still image shooting during moving image shooting, the “still image shooting while driving the lens” menu in FIG. 4 is grayed out.

In step S104, the imaging apparatus 100 determines whether or not the release button (Sw) has been pressed by the user during moving image shooting. If it is determined that the user has pressed the release button during moving image shooting, the process proceeds to step S105. That is, a still image capturing instruction is received during moving image shooting (accepting means).
In step S <b> 105, the imaging apparatus 100 refers to the still image setting during execution of autofocus preset by the user as illustrated in FIG. 6.

  In step S <b> 106, the imaging apparatus 100 determines whether or not the still image setting is currently executing autofocus. If it is the still image setting that is currently executing autofocus, the process proceeds to step S107 to perform autofocus operation determination means. If it is not the still image setting that is currently executing autofocus, the autofocus operation determination means in step S107 is skipped.

  In step S107, the imaging apparatus 100 determines whether or not the timing at which the release button (Sw) reception unit receives the shooting instruction in step S104 is executing the autofocus operation of the lens mounted on the imaging apparatus 100. (Auto focus operation determination means).

  When it is determined that the timing at which the shooting instruction is received is during execution of the autofocus operation of the lens mounted on the imaging apparatus 100, the process proceeds to step S109, and the timing at which the shooting instruction is received is mounted on the imaging apparatus 100. If it is determined that the autofocus operation of the lens being performed is not being executed (stopped), the process proceeds to step S108.

In step S108, the imaging apparatus 100 temporarily stores the frame number (for example, 100th) of the moving image at the timing when the release button (Sw) is pressed in step S104 in the storage unit. For example, as shown in FIG. 12A, a frame number that indicates the timing at which Sw is pressed for each moving image may be stored. Thereafter, the process proceeds to step S110.
In step S109, the imaging apparatus 100 displays a warning screen as illustrated in FIG. 8 on the display unit. Thereafter, the process proceeds to step S104.
As described above, when it is determined in step S107 that the autofocus operation is being performed, in step S104, the accepting unit does not accept the photographing instruction.
FIG. 3 will be described.
FIG. 3 is a flowchart executed by the system control unit 112 of the imaging apparatus 100 or the CPU of the imaging apparatus 100 (not shown) to represent the embodiment of the present invention.

  In step S110, the imaging apparatus 100 first acquires the focal length value of the lens (for example, 250 mm) and the currently set Tv value (for example, [1/100] seconds) during acquisition by the moving image imaging unit (acquiring unit). ). At this time, the currently set Tv value (for example, [1/100] second) with respect to the focal length (for example, 250 mm) of the lens mounted on the imaging apparatus is an expression for calculating the limit value of camera shake. It is determined whether [1 / lens focal length] is exceeded (determination means). That is, when [1 / set Tv value] seconds are already shot with a Tv value faster than [1 / lens focal length] seconds, a moving image with subject shake or camera shake is stored. This is because there is a high possibility that it will end up. Here, the Tv value is a shutter opening / closing speed value.

  If it is determined that the camera shake limit value is exceeded (No), it is determined that the camera shake limit value has been reached at this point, and the currently set Tv value is not changed. That is, the processing from step S111 to step S113 is not executed.

If it is determined that the camera shake limit value is not exceeded (yes), it is determined that the camera shake limit value has not been reached at this time, and the current setting is performed by executing steps S111 to S113. It is determined that the Tv value can be further increased to the limit value of the camera shake.
Further, the currently set aperture value (Av) and ISO value are acquired.

  In step S111, the imaging apparatus 100 temporarily stores the currently set Tv value (eg, [1/100] seconds), aperture value (Av), and ISO value acquired in step S110 in the storage unit.

  This is because the imaging apparatus 100 determines in step S112 that the currently set Tv value has not reached the camera shake limit value in step S110, and the currently set Tv value (for example, [1/100 ] Seconds) up to the limit value of camera shake (for example, [1/250] seconds). In other words, when it is determined in step S111 that the camera shake limit value has not been reached, the moving image imaging unit shoots a moving image in which the acquired shutter speed value is changed until it approaches the camera shake limit value for a predetermined time (for example, 1 second). Is to remember.

In step S113, the imaging apparatus 100 changes the Av value and the ISO value acquired in step S110 with respect to the Tv value increased in step S112, and changes the control value so that the same exposure as before step S112 is obtained. At this time, if the Av is greatly changed, the depth of field is greatly changed, and if the ISO is largely changed, the noise is increased. Therefore, the balance needs to be adjusted. For example, in the case of a lens having a focal length of 250 mm, the control value correction (increasing the ISO value instead of increasing the Tv value) in step S113 is as follows.
Tv value: 100 Av value: 11 ISO value: 200 (original setting value)
⇒ Tv value: 250 Av value: 11 ISO value: 400 (after processing in step S112 and step S113)

  In step S114, the image capturing apparatus 100 temporarily stores the frame number (for example, 100th) of the moving image at the timing when the release button (Sw) is pressed in step S108 in the storage unit, and a predetermined time (for example, 1 second) has elapsed. If it is determined that a predetermined time (for example, 1 second) has elapsed, the process proceeds to step S115.

In step S115, the imaging apparatus 100 determines that a moving image of a predetermined time (for example, 1 second) has been shot with the limit value of camera shake in step S114, and thus is the limit value of camera shake (for example, [1/250] seconds) The Tv value that has been made faster is returned to the set Tv value (for example, [1/100] seconds), aperture value (Av), and ISO value that are temporarily stored in the storage unit in step S111.
In step S116, the imaging apparatus 100 receives a moving image shooting end instruction from the user and ends moving image shooting.

  In step S117, the imaging apparatus 100 temporarily outputs all the still images from the frame number stored in step S108 to the frame number after a predetermined time (for example, 1 second). That is, a still image is extracted from the moving image whose setting has been changed until it approaches the camera shake limit value stored for a predetermined time (for example, 1 second) (extraction means).

  In step S118, the imaging apparatus 100 selects the top four images having the highest contrast evaluation value from all the still images output in step S117, and displays a screen as illustrated in FIG. 9 on the display unit. In this way, a plurality of different still images are extracted from the moving images whose settings have been changed.

  Further, after it is determined that the storage of the moving image taken by the moving image capturing unit has been completed, a plurality of different still images stored in the still image storage unit are displayed side by side so as to be comparable (comparison display control unit). .

  In step S119, the imaging apparatus 100 displays a screen as illustrated in FIG. 10 on the display unit. The selection information of the still image selected by the user from the screen displayed in step S119 is received.

In step S120, the imaging apparatus 100 stores the still image selected in step S119. That is, the still image extracted in step S117 is stored (still image storage means).
FIG. 11 will be described.
FIG. 11 shows setting data.
1-1 stores the presence / absence of a still image setting during the current moving image recording. The presence or absence can be switched by FIG.
1-2 stores the presence / absence of the current still image shooting setting during lens driving. The presence or absence can be switched by FIG.
FIG. 12 will be described.
Reference numeral 2-1 denotes the first frame number that is desired to be a still image in the moving image stored in step S108.
2-2 is a control value (Tv value, Av value, ISO value) stored in step S111.
Control value information used when returning to the original control value.
Reference numeral 2-3 denotes a lens driving state, which is information indicating whether the lens is driven when Sw is pressed during recording.
FIG. 13 will be described.

3-1 is the frame number (4 frames) of the image having a high contrast evaluation value among the first frame numbers one second after the first frame number stored in step S 118. 3-2 is stored in step S 120. This is the frame number (one frame) of the image selected by the user.

  Further, the program according to the present invention is a program that can be executed by the imaging apparatus 100 according to the processing method of the flowcharts shown in FIGS. 2 to 3, and the storage medium according to the present invention is the processing method according to FIGS. As an executable program, it is stored in the ROM 112 of the imaging apparatus 100.

  As described above, the recording medium on which the program for realizing the functions of the above-described embodiments is recorded is supplied to the imaging system or the imaging apparatus, and the control computer (or CPU or MPU) of the system or apparatus is stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing the program.

  In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium storing the program constitutes the present invention.

  As a recording medium for supplying the program, for example, a flexible disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD-R, DVD-ROM, magnetic tape, nonvolatile memory card, ROM, EEPROM, silicon A disk or the like can be used.

  Further, by executing the program read by the computer, not only the functions of the above-described embodiments are realized, but an OS (operating system) running on the control computer based on the instructions of the program is actually used. It goes without saying that a case where the function of the above-described embodiment is realized by performing a part or all of the process and the process is included.

  Further, after the program read from the recording medium is written in a memory provided in a function expansion board inserted in the control computer or a function expansion unit connected to the control computer, the function is determined based on the instruction of the program code. It goes without saying that the CPU or the like provided in the expansion board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

  Further, the present invention may be applied to an imaging system including a plurality of devices or an imaging apparatus including a single device. Needless to say, the present invention can also be applied to a case where the present invention is achieved by supplying a program to an imaging system or an imaging apparatus. In this case, by reading the recording medium storing the program for achieving the present invention to the image capturing system or image capturing apparatus, the image capturing system or image capturing apparatus can enjoy the effects of the present invention.

Furthermore, by downloading and reading a program for achieving the present invention from a server, database, etc. on a network using a communication program, the image capturing system or the image capturing apparatus can enjoy the effects of the present invention.
In addition, all the structures which combined each embodiment mentioned above and its modification are also included in this invention.

100 Imaging device (Single-lens reflex digital camera)

Claims (8)

Moving image capturing means for capturing a moving image and storing the captured moving image;
First receiving means for receiving an instruction to start capturing a moving image;
A second accepting means for accepting a still image capturing instruction during shooting of the moving image;
A storage unit that acquires and stores a currently set shutter speed value and a focal length value of a mounted lens when the second reception unit receives an instruction to capture the still image ;
Based on the set shutter speed value and the focal length value of the lens, determination means for determining whether or not the moving image being shot has reached a camera shake limit value;
With
When the determination means determines that the camera shake limit value has not been reached, a moving image in which the set shutter speed value is changed so as to approach the camera shake limit value so that the user can view the image as a still image. The video imaging means captures and stores a predetermined time ,
An image pickup apparatus, wherein after the changed moving image is stored for a predetermined time, the moving image capturing unit stores the moving image returned to the stored shutter speed value . When the second accepting unit accepts an instruction to capture a still image while shooting the moving image,
The moving image capturing means includes a moving image of the set shutter speed value, a moving image in which the shutter speed value is changed for a predetermined time so as to approach the camera shake limit value, and a moving image returned to the stored shutter speed value. The imaging apparatus according to claim 1, wherein the imaging apparatus is continuously stored. When the determination means determines that the camera shake limit value has been reached, the set shutter speed value is not changed so as to approach the camera shake limit value, and the set shutter speed value remains unchanged. The imaging apparatus according to claim 1, wherein the moving image capturing unit stores a moving image. Extracting means for extracting a still image shutter speed value that has been pre-Symbol set from among the videos changed so as to approach the camera shake limit value,
Still image storage means for storing the extracted still image;
The imaging apparatus according to any one of claims 1 to 3 , further comprising: The extraction means extracts a plurality of different still images from the changed video,
A comparison display control means for displaying the plurality of different still images stored in the still image storage means side by side so that they can be compared after it is determined that the storage of the moving images taken by the moving image imaging means has been completed;
The imaging apparatus according to claim 4 , further comprising: An autofocus operation determination unit that determines whether or not the timing at which the second reception unit receives the imaging instruction is executing an autofocus operation of a lens mounted on the imaging device;
Wherein when the autofocus operation determination means determines to be in the autofocus operation performed, any one of claims 1 to 5 wherein the second receiving means is characterized in that it does not accept the image capturing instruction 1 The imaging device according to item . A moving image imaging step in which the moving image capturing means of the imaging apparatus captures a moving image and stores the captured moving image;
A first receiving step in which a first receiving unit of the imaging apparatus receives an instruction to start capturing a moving image;
A second accepting step in which a second accepting unit of the image capturing device accepts an instruction to capture a still image while capturing the moving image;
When the storage unit of the imaging apparatus receives an instruction to capture the still image in the second reception step, the shutter speed value currently set and the focal length value of the mounted lens are acquired and stored . Preservation process;
A determination step in which the determination unit of the imaging apparatus determines whether the moving image being shot has reached a camera shake limit value based on the set shutter speed value and the focal length value of the lens;
Including
If it is determined in the determination step that the camera shake limit value has not been reached, a moving image in which the set shutter speed value is changed so as to approach the camera shake limit value in order to be viewed as a still image by the user. Shoot and store for a predetermined time in the video capture process ,
A method for controlling an imaging apparatus , comprising: storing a moving image that has been restored to the stored shutter speed value in the moving image capturing step after storing the changed moving image for a predetermined time . The imaging device
Moving image capturing means for capturing a moving image and storing the captured moving image;
First receiving means for receiving an instruction to start capturing a moving image;
A second accepting means for accepting a still image capturing instruction during shooting of the moving image;
A storage unit that acquires and stores a currently set shutter speed value and a focal length value of a mounted lens when the second reception unit receives an instruction to capture the still image ;
Based on the set shutter speed value and the focal length value of the lens, determination means for determining whether or not the moving image being shot has reached a camera shake limit value;
To function,
When the determination means determines that the camera shake limit value has not been reached, a moving image in which the set shutter speed value is changed so as to approach the camera shake limit value so that the user can view the image as a still image. The video imaging means captures and stores a predetermined time ,
A program that can be read and executed by an imaging apparatus for storing a moving image in which the moving image capturing unit returns the stored shutter speed value after storing the changed moving image for a predetermined time .

Images