JP2016100848A - Imaging apparatus and imaging method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve a problem in which, when one image is recorded by reproducing in slow motion a plurality of still images during high-speed consecutive photography, the number of photographing frames becomes large, and reproduction is performed in a long period of time, it takes a long time until a desired still image is displayed and a burden is placed on a user.SOLUTION: An imaging apparatus includes: imaging means for acquiring images of a plurality of frames by continuously photographing; display means for displaying the images with a display frame rate lower than a photographing frame rate; first selection means capable of selecting an image of one frame from images displayed on the display means; extraction means for extracting images of a predetermined number of frames from a plurality of frames in accordance with a selection instruction with the first selection means; display control means for controlling to display at a display frame rate on the display means images of the predetermined number of frames extracted with the extraction means; and second selection means capable of selecting an image of one frame as a recording image from the images of the predetermined number of frames displayed on the display means.SELECTED DRAWING: Figure 7

Description

  The present invention provides an image pickup apparatus and an image pickup device that display a plurality of frames of images taken at a high frame rate on a display unit at a frame rate lower than the shooting frame rate, and select a frame image desired by a user as a recorded image. Regarding the method.

  A technique for displaying image data captured at a high frame rate on a display device at a frame rate lower than the frame rate and recording image data of a frame image desired by a user in accordance with a recording instruction operation of the imaging apparatus. Patent Document 1 discloses this.

  According to the technique disclosed in Patent Document 1, only image data corresponding to a user's intended photo opportunity is reliably recorded from a plurality of image data displayed on a display device such as a low frame rate, that is, slow motion, at the time of shooting. be able to.

  This eliminates the troublesome work of deleting image data other than the image corresponding to the photo opportunity after the photographing is completed, and the subject corresponding to the photo opportunity without being forced to perform the troublesome work after the photographing is finished. Images can be recorded.

JP 2008-085689 A

  However, when maintaining the shooting time, the higher the shooting frame rate, the more the number of frames of image data displayed on the display device. Until the image data corresponding to the user's intended photo opportunity is reached. There was a problem that it took time.

  According to one aspect of the present invention, photographing means for acquiring images of a plurality of frames by continuously photographing, display means for displaying an image at a display frame rate lower than the photographing frame rate, and display on the display means A first selection means for selecting an image of one frame from the captured image, an extraction means for extracting an image of a predetermined number of frames from the plurality of frames in response to a selection instruction by the first selection means, and the extraction means Display control means for controlling the extracted image of a predetermined number of frames to be displayed on the display means at the display frame rate, and an image of one frame from the image of the predetermined number of frames displayed on the display means And a second selection means that can be selected as the second selection means.

  Even when the imaging frame rate of the imaging apparatus is increased, it is possible to shorten the time required to select image data corresponding to the shutter chance intended by the user.

It is a figure explaining the case where the image data imaged by 20 FPS is displayed by 5 FPS. It is a figure explaining the case where the image data imaged by 100 FPS is displayed by 5 FPS. It is a figure explaining the frame narrowing-down determination process in a thinning display. It is a figure explaining an example of a frame narrowing-down process. It is a figure explaining another example of a frame narrowing-down process. It is a block diagram which shows the structure of the imaging device concerning 1st Embodiment. It is a flowchart which shows from the image input to the output of a recording image in 1st Embodiment.

(First embodiment)
The imaging apparatus according to the first embodiment of the present invention will be described with reference to FIGS.

  FIG. 6 is a block diagram illustrating a configuration of a characteristic portion in the imaging apparatus.

  A series of processing from image input to image output will be described in order.

  The sensor correction unit 601 performs sensor correction processing on the image data input from the imaging optical system.

  Sensor correction processing includes processing for correcting defective pixels in image data acquired from an image sensor such as a CCD (Charge Coupled Device) sensor and a CMOS (Complementary Metal Oxide Semiconductor) sensor, processing for correcting variations in column amplifier output, and the like. Is mentioned.

  The image data corrected by the sensor correction unit 601 is stored in an image buffer 602 which is a storage unit that temporarily stores the image data.

  The AF / AE / AWB processing unit 603 uses the image data stored in the image buffer 602 to obtain an evaluation value for performing contrast AF, an AE evaluation value for performing automatic exposure control (AE), and a white balance. Generate an evaluation value for automatic adjustment.

  The development processing unit 604 uses the image data stored in the image buffer 602 to apply gamma correction, noise reduction processing, false color processing, white balance coefficient obtained by the AF / AE / AWB processing unit 603, and the like. The developed image is stored, and the developed image is stored in the image buffer 602.

  The developed image data stored in the image buffer 602 is displayed on a display unit 605 serving as a display unit such as an EVF (electronic viewfinder) attached to the imaging apparatus.

  In addition, the display unit 605 displays the image data by performing enlargement / reduction or format conversion in accordance with the resolution or image format of the display device (display panel, television, or the like).

  Although not shown, the imaging apparatus displays on the display unit from display control means for controlling display of an image such as an image display speed (display frame rate) on the display unit 605 and image data stored in the image buffer 602. Control means functioning as extraction means for extracting the image according to the user's selection instruction or the like.

  Further, the display unit 605 includes selection means for the user to select an image of one frame from images sequentially displayed at a predetermined frame rate. As the selection unit, when the display unit 605 accepts a user input operation such as a touch panel, the display unit 605 may also serve as the selection unit, or may be assigned to a switch or button attached to the imaging apparatus. Good.

  Next, with reference to FIG. 7, when image data is captured from the imaging optical system at a high frame rate, a process until the user selects an image of a desired frame from a plurality of captured image data. explain.

  FIG. 7 is a flowchart showing a process from selecting a recorded image from a plurality of frames of image data acquired by continuous imaging processing to outputting a recorded image.

  In FIG. 7, first, it is determined whether or not the frame rate (photographing frame rate) used for imaging is lower than a predetermined frame rate set in advance (S701). In the present embodiment, an imaging frame rate of 20 frames (20 FPS) per second is used as the predetermined frame rate.

  When the frame rate determination processing in S701 determines NO (the frame rate used for shooting is lower than 20 FPS), the display unit 605 displays a display frame rate lower than the shooting frame rate (for example, 5 FPS). To display a frame (S706).

  Note that when imaging is performed for 1 second at a shooting frame rate of 20 FPS, an image of 20 frames is slowly displayed on the display unit 605 in 4 seconds.

  If the user does not press the image selection determination button (second selection means) for selecting a recorded image during the slow display in S706 (NO in S707), the frame display is continued at the same display frame rate (5 FPS) (initial value). j = 0 and the counter is incremented in S708).

  After the image of 20 frames is displayed (when j = 20), the same 4-second frame image is repeatedly played back slowly (j = 0 is returned to the initial value and S706 to S708 are repeated).

  If the user presses the image selection determination button during the slow display in S706 (YES in S707), the low-speed display process is interrupted, and the selected image data is recorded as an image.

  A case will be described with reference to FIG. 1 in which image data of 20 frames captured in one second is slowly displayed on the display unit 605 at 5 FPS.

  Frames 101 to 120 are image data captured in one second.

  When the user presses the image selection determination button in the eleventh frame 111 corresponding to the second second (YES in S707), the low-speed display process is interrupted and the image of the selected frame 111 is recorded. In this case, it takes 2 seconds from the start of image display until the user selects the frame 111.

  Next, a case in which image data captured at a shooting frame rate of 100 FPS is slowly displayed on the display unit 605 at 5 FPS will be described with reference to FIG.

  Frames 2001 to 2100 are image data taken in one second.

  When the user presses the image selection determination button at the 51st frame 2051 corresponding to the 10th second from the start of image display (YES in S707), the low-speed display process is interrupted and the image of the selected frame 2051 is recorded. . In this case, it takes 10 seconds from the start of image display until the user selects the frame 2051.

Next, in order to describe the frame narrowing determination process in the present embodiment, a case where 100 frames are captured in one second is shown.
In this case, since the shooting frame rate is 100 FPS, the frame rate is higher than 20 FPS, and the frame rate determination (S701) is YES.

  Accordingly, in accordance with the flow of FIG. 7, thinning display is performed at a frame rate lower than the shooting frame rate in S702. Here, an image is displayed by thinning out some frames from a plurality of frames of images acquired by the photographing means.

  Specifically, every time NO is determined in the frame narrowing determination process S703, the frame number i is incremented by +5 (initial value i = 0 is set in S704), and the thinning display is performed.

  If NO in frame narrowing determination processing S703, the processing from S702 to S704 is repeated (when i = 100, the initial value i = 0 is reset).

  In FIG. 3, the thinning display S702 and the frame narrowing determination process S703 will be described.

  From the frame 301 (frame number 1) to the frame 320 (frame number 96), 20 frames obtained by thinning 100 frames into equal divisions (one in 5 frames) are displayed over 4 seconds.

  When frame narrowing determination processing S703 (YES) is performed in the frame 311 thinning-out display, the frame 311, that is, the image data group of frame number 51 is selected by the image selection button (second selection means) (first selection). To extract.

  The image data group indicates 10 frames (frames 401 to 420) before and after the frame number 51 as shown in FIG. 4, and 20 frames (frame 501) starting from the frame number 51 as shown in FIG. To 520). The number of frames to be extracted is not limited to 20 frames, but may be a predetermined number of frames set from the display seconds.

  When 10 frames before and after the selected frame number 51 are displayed on the low-speed display 706 as shown in FIG. 4, 20 frames from frame number 41 to frame number 60 (20 frames of image data in an actual shooting time of about 200 ms). Can be displayed repeatedly.

  When 20 frames after frame number 51 selected as shown in FIG. 5 are displayed on low-speed display 706, 20 frames from frame number 51 to frame number 70 (20 frames of image data in an actual shooting time of about 200 ms). Can be displayed repeatedly.

  In FIG. 4, even when there is an image that the user wants to record from frame number 41 to frame number 60, even if the peak of the image to be recorded is shifted before and after frame number 51, the recorded image is displayed in a slow display after narrowing down. Can be selected (second selection).

  For example, the image data group is narrowed down at the moment of impact of a baseball bat and a ball.

  As described above, when the time taken up to the frame group narrowing-down process S705 and the time taken up to the image determination determination process S707 from 0 seconds to 4 seconds are totaled, a desired image can be selected and recorded in 2 seconds to 6 seconds. It becomes possible.

  In FIG. 5, when there is an image that the user wants to record from frame number 51 to frame number 70 and it can be predicted that the peak of the image to be recorded appears after frame number 51, a slow display after narrowing down is performed. The recorded image can be selected (second selection).

  For example, when recording the change of a person's surprised expression with the sound of a broken balloon, if the selection is made immediately after the balloon breaks, the person's facial expression will change after the balloon breaks. If you want to come.

  As described above, when the time taken up to the frame group narrowing-down process S705 and the time taken up to the image determination determination process S707 from 0 seconds to 4 seconds are totaled, a desired image can be selected and recorded in 2 seconds to 6 seconds. It becomes possible.

  Further, in the frame group narrowing-down process, the timing of the narrowed frame is set to 20 frames after the narrowing instruction, but may be 20 frames before the instruction.

  The frame before the narrowing down instruction can be used for a subject that tends to pass the peak of an image to be recorded.

  When the frame rate is further increased, for example, even when a still image is cut out from a moving image like 120 FPS, the frame group narrowing processing 705 and the image determination processing S707 are performed in the same manner, so that the user can obtain the desired shutter chance. It is possible to shorten the time until the corresponding image data is selected.

  In the present embodiment, image display (low-speed thinning display S702 and low-speed display S706) that can be selected in each of the first selection (selection of a frame group to be extracted) and the second selection (selection of a recorded image) is possible. The period is set to the same length. By doing so, the time for which the image is repeatedly displayed becomes the same, and it is possible to prevent the user from feeling uncomfortable due to the change in the time for repeated display.

  Note that each process shown in the flowchart in the embodiment of the present invention can also be realized by reading out a computer program for realizing the function of each process from the memory and executing the CPU in the apparatus.

  The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

  Further, all or some of the functions of the processes shown in the flowchart diagram may be realized by dedicated hardware. In addition, a program for realizing the function of each process shown in the flowchart diagram is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into the computer system and executed. May be performed. Here, the “computer system” includes an OS and hardware such as peripheral devices.

  Here, the “computer-readable recording medium” includes a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage device such as a hard disk built in the computer system. Furthermore, a program that holds a program for a certain period of time, such as a volatile memory (RAM) inside a computer system that becomes a server or client when the program is transmitted via a network such as the Internet or a communication line such as a telephone line Shall also be included.

  The program may be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by a transmission wave in the transmission medium. Here, the “transmission medium” for transmitting the program refers to a medium having a function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line.

  A program product such as a computer-readable recording medium in which the above program is recorded can also be applied as an embodiment of the present invention. The above program, recording medium, transmission medium, and program product are included in the scope of the present invention.

  The above is the description of the embodiments of the present invention. However, the present invention is not limited to the above-described embodiments within the scope of the technical idea of the present invention, and various modifications can be made within the scope shown in the claims. Is possible.

601 Sensor correction unit 602 Image buffer 603 AF / AE / AWB processing unit 604 Development processing unit 605 Display unit

Claims (7)

Photographing means for acquiring images of a plurality of frames by continuously photographing;
Display means for displaying an image at a display frame rate lower than the shooting frame rate;
First selection means for enabling an image of one frame to be selected from images displayed on the display means;
Extraction means for extracting a predetermined number of frames from the plurality of frames in response to a selection instruction by the first selection means;
Display control means for controlling the display means to display an image of a predetermined number of frames extracted by the extraction means at the display frame rate;
An image pickup apparatus comprising: a second selection unit configured to select an image of one frame as a recorded image from images of a predetermined number of frames displayed on the display unit.   The imaging apparatus according to claim 1, wherein the period of image display that can be selected by each of the first selection unit and the second selection unit is the same.   The imaging apparatus according to claim 1, wherein the display unit displays an image by thinning out some frames from an image of a plurality of frames acquired by the photographing unit.   4. The extraction unit according to claim 1, wherein the extraction unit extracts a predetermined number of frames centered on the frame selected by the first selection unit or a predetermined number of frames starting from the frame. The imaging apparatus according to item 1.   2. A storage unit that temporarily stores a plurality of frames of images acquired by the photographing unit until a recording image selected by the second selection unit is recorded on a recording medium. 5. The imaging device according to any one of 4. Determining means for determining whether or not the shooting frame rate is lower than a predetermined frame rate;
When the determination unit determines that the shooting frame rate is lower than a predetermined frame rate, the selection by the second unit is enabled without performing the selection by the first selection unit. Item 6. The imaging device according to any one of Items 1 to 5. An acquisition step of acquiring images of a plurality of frames by continuously shooting;
A first display step for displaying an image at a display frame rate lower than the shooting frame rate;
A first selection step of selecting an image of one frame from the images displayed in the display step;
An extraction step of extracting a predetermined number of images from the plurality of frames in response to a selection instruction in the first selection step;
A second display step of displaying the image of a predetermined number of frames extracted in the extraction step at the display frame rate;
A second selection step of selecting an image of one frame as a recorded image from images of a predetermined number of frames displayed in the second display step;
And a recording step of recording an image in response to a selection instruction in the second selection step.

Images