JP2013179548A - Image pickup device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide means for making it easy to capture a desired image without missing a shutter chance in slow live shooting.SOLUTION: An image pickup device comprises an image sensor, an image acquisition unit, an evaluation value calculation unit, and a display control unit. The image sensor picks up the image of the subject to generate an image. The image acquisition unit acquires a plurality of images generated in a time series at first time intervals by the image sensor. The evaluation value calculation unit analyzes the plurality of images acquired by the image acquisition unit to calculate evaluation values for each image. The display control unit exerts control so that the plurality of images are sequentially displayed on a display unit at second time intervals longer than the first time interval, and that the result of evaluation on the evaluation value of a currently displayed image and/or the result of evaluation on individual evaluation values including images acquired at a later time of day than that image are displayed on the display unit.

Description

  The present invention relates to an imaging apparatus and a program.

  2. Description of the Related Art In recent years, electronic cameras that are a type of imaging device have been known to be equipped with a slow live shooting function (for example, see Patent Document 1). In the above-mentioned slow live shooting, first, from the time when the half-press instruction input by the user is accepted, the temporary recording of the image is started in time series, and then the image temporarily recorded by the slow playback that shows the movement of the subject more slowly than actual. Is displayed on the display monitor. Subsequently, when the user performs a full-press operation while viewing the slow-played image, in slow live shooting, the image displayed on the display monitor at the time of the full-press operation is captured (recorded) as a main image. In this case, the slow live shooting has a feature that the user can operate as if the user presses the shutter in the shooting mode, instead of performing the above processing in the playback mode.

  Therefore, when the user waits for a photo opportunity while watching the movement of the subject by slow reproduction, the user can perform a full press operation at a desired timing according to the movement of the subject in the slow live shooting.

JP 2006-140892 A

  However, when the user waits for a shutter chance while watching the movement of the subject in slow playback, the above-described conventional electronic camera grasps from the display monitor, for example, the blurred state, the exposed state, the open / close state of the person's eyelid, etc. It has the problem of being difficult. In addition, in the above-described conventional electronic camera, when playing back slowly, if the user waits for a photo opportunity that a better image will be displayed, the good image is not displayed in the end, and the photo opportunity is missed. It has the problem that it ends up.

  Accordingly, an object of the present invention is to provide means for easily acquiring a desired image without missing a photo opportunity in slow live shooting.

An imaging apparatus according to a first invention includes an imaging element, an image acquisition unit, an evaluation value calculation unit, and a display control unit. The imaging element captures a subject image and generates an image. The image acquisition unit acquires a plurality of images that the image sensor generates in time series at the first time interval. The evaluation value calculation unit calculates an evaluation value for each image by analyzing a plurality of images acquired by the image acquisition unit. The display control unit sequentially displays a plurality of images on the display device at a second time interval longer than the first time interval, and evaluates the evaluation value of the currently displayed image and / or from the image. The evaluation result of each evaluation value including an image acquired at a later time is displayed on the display device.

  In a first aspect based on the first aspect, the second aspect of the present invention further includes a reception unit and a recording processing unit. The accepting unit accepts an instruction input for recording an image for recording. Based on the time at which the receiving unit receives an instruction input, the recording processing unit records the image that the display control unit displayed on the display device at that time as a recording image.

  According to a third aspect, in the second aspect, when there is an image with a higher evaluation value before or after the image displayed on the display device by the display control unit at that time, a recording process is performed. The unit records an image having a higher evaluation value as a recording image.

  According to a fourth invention, in any one of the first to third inventions, the evaluation value calculation unit selects at least one of a blurred state, an exposed state, and a face state of the subject as the evaluation value. evaluate.

  In a fifth aspect based on the fourth aspect, the evaluation value calculation unit calculates a comprehensive evaluation based on a plurality of types of evaluation values for each image. The display control unit displays the evaluation result of the comprehensive evaluation on the display device.

  In a sixth aspect based on any one of the first to fifth aspects, the display control unit causes the display device to display the evaluation result for each image in a display manner appealing visually.

  In a seventh aspect based on the sixth aspect, the display control unit causes the display device to further display a frame surrounding the currently displayed image, and changes the color display of the frame according to the evaluation result.

  In an eighth aspect based on the first aspect, an operation member is further provided. The operation member receives the setting of the second time interval by user input. The display control unit displays the image on the display device by changing the second time interval according to the user input.

  In a ninth aspect based on the second aspect, the reception unit includes a pressure sensor for detecting finger pressure. The display control unit changes the second time interval according to the detection signal from the pressure sensor, and causes the display device to display an image.

  A program according to a tenth invention causes a computer to execute an imaging process, an image acquisition process, an evaluation value calculation process, and a display control process. The imaging process captures a subject image and generates an image. The image acquisition process acquires a plurality of images that the image sensor generates in time series at the first time interval. The evaluation value calculation process calculates an evaluation value for each image by analyzing a plurality of images. The display control process sequentially displays a plurality of images on the display device at a second time interval longer than the first time interval, and evaluates the evaluation value of the currently displayed image and / or from the image. The evaluation result of each evaluation value including an image acquired at a later time is displayed on the display device.

  The imaging apparatus of the present invention can provide means for easily acquiring a desired image without missing a photo opportunity in slow live shooting.

FIG. 2 is a block diagram illustrating a configuration example of the electronic camera 1 of the present embodiment. Rear view of the electronic camera 1 of the present embodiment Flow chart showing an example of slow playback processing in slow live mode The figure explaining an example of slow reproduction processing of slow live mode Flowchart showing an example of shooting processing in slow live mode The figure which shows an example of the image currently recorded on the buffer for slow displays The figure explaining an example of the display process by the display control part 24d The figure explaining an example of the display process by the display control part 24d The figure explaining an example of the display process by the display control part 24d The figure explaining an example of the display process by the display control part 24d The figure explaining an example of the display process by the display control part 24d The figure explaining an example of slow play in slow live mode Conceptual diagram of slow playback when using the release button

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Here, an electronic camera which is an embodiment of the imaging apparatus of the present invention will be described as an example.

  FIG. 1 is a block diagram illustrating a configuration example of an electronic camera 1 according to the present embodiment. Here, the electronic camera 1 of the present embodiment has the above-described shooting mode of slow live shooting (hereinafter referred to as “slow live mode”). Specific contents of the slow live mode of this embodiment will be described later.

  As shown in FIG. 1, the electronic camera 1 includes a photographing optical system 10, a lens driving unit 11, a diaphragm 12, a diaphragm driving unit 13, an image sensor 14, a signal processing unit 15, and a RAM (Random Access Memory). 16, an image processing unit 17, a flash memory 18, a recording interface unit (hereinafter referred to as "recording I / F unit") 19, a display monitor 20, a touch panel 21, a release button 22, an operation unit 23, A CPU (Central Processing Unit) 24 and a bus 25 are provided.

  Among these, the signal processing unit 15, the RAM 16, the image processing unit 17, the flash memory 18, the recording I / F unit 19, the display monitor 20, and the CPU 24 are connected to each other via a bus 25.

  The photographing optical system 10 includes a plurality of lens groups including a zoom lens and a focus lens. The lens driving unit 11 adjusts the position of the zoom lens and the focus lens in the photographic optical system 10 in the direction of the optical axis L in accordance with an instruction from the CPU 24. For the sake of simplicity, FIG. 1 shows the photographing optical system 10 as a single lens.

  The diaphragm 12 adjusts the amount of light per unit time incident on the image sensor 14. The diaphragm drive unit 13 adjusts the opening amount of the diaphragm 12 in accordance with an instruction from the CPU 24.

  The image sensor 14 captures an image of a subject that has passed through the photographing optical system 10 and the diaphragm 12 and generates an analog image signal (image). The analog image signal output from the image sensor 14 is input to the signal processing unit 15. Note that three types of color filters of R (red), G (green), and B (blue) are arranged on the imaging surface of the imaging device 14 in, for example, a Bayer array. Further, the charge accumulation time of the image sensor 14 and the reading of the image signal are controlled by a timing generator (not shown).

  Here, the image sensor 14 captures an image for recording (main image) in response to the full-pressing operation of the release button 22. In addition, the imaging device 14 continuously captures images for composition confirmation (through images) at predetermined intervals even during shooting standby.

  The image sensor 14 is a CCD (Charge Coupled Device) type or CMOS (Complementary Metal-Oxide Semiconductor) type image sensor.

  The signal processing unit 15 performs analog signal processing on an analog front end circuit (AFE) that performs analog signal processing on the image signal output from the image sensor 14 and digital signal processing on the image signal that has been subjected to analog signal processing by the AFE A digital front-end circuit (DFE). The AFE of the signal processing unit 15 performs correlated double sampling or gain adjustment on the analog image signal, and then performs a process of converting the analog image signal into a digital image signal (A / D conversion). Here, the AFE of the signal processing unit 15 can adjust the imaging sensitivity corresponding to the ISO sensitivity by adjusting the gain of the image signal.

  The DFE of the signal processing unit 15 performs a correction process on the digital image signal after A / D conversion. The image signal output from the signal processing unit 15 is temporarily recorded in the RAM 16 as image data of RGB signals. The RAM 16 is a buffer memory that temporarily records image data as a work area for processing by the CPU 24 and the image processing unit 17. The CPU 24 temporarily records the image data of the through image in the RAM 16 during shooting standby. In addition, a buffer memory (hereinafter referred to as “slow display buffer”) for recording image data of a plurality of images obtained by slow live shooting is allocated to a partial area of the RAM 16. The image acquisition unit 24a described later records these multiple images (image data) in the slow display buffer of the RAM 16. The slow display buffer has a storage capacity equivalent to, for example, 100 images.

  The image processing unit 17 reads the image data recorded in the RAM 16 and performs various types of image processing (for example, color interpolation processing, white balance, etc.) as necessary.

  The flash memory 18 is a non-volatile memory that stores a program for controlling the electronic camera 1 in advance.

  The recording I / F unit 19 is formed with a connector (not shown) for connecting a detachable recording medium 30. Then, the recording I / F unit 19 accesses the recording medium 30 connected to the connector and performs image recording processing and the like. The recording medium 30 is, for example, a non-volatile memory card. FIG. 1 shows the recording medium 30 after being connected to the connector.

  The display monitor 20 is composed of, for example, a liquid crystal display medium. The display monitor 20 displays various images, an operation menu of the electronic camera 1 and the like according to instructions from the CPU 24.

  The touch panel 21 detects the position of a fingertip or the like that has touched the surface of the touch panel provided on the display monitor 20. The touch panel 21 receives the operation from the photographer by outputting the detected position information to the CPU 24. The release button 22 receives an instruction input for a half-press operation (start of imaging preparation operation) and an instruction input for a full-press operation (start of imaging operation). The operation unit 23 includes a plurality of buttons that accept user operations.

  FIG. 2 is a rear view of the electronic camera 1 of the present embodiment. The operation unit 23 of this embodiment includes a wide-angle zoom button 23a, a telephoto zoom button 23b, a mode selection button 23c, a menu button 23d, a selection / determination button 23e, and a power button 26.

  The wide-angle zoom button 23a changes the focal length to the wide-angle side, and the telephoto zoom button 23b changes the focal length to the telephoto side. The mode selection button 23c accepts an operation for switching to the shooting mode or the playback mode from the user. The menu button 23d accepts an operation for starting up the menu screen from the user. The selection / determination button 23e receives item selection or item determination such as setting conditions in the operation menu of the electronic camera 1 from the user. Here, the selection / determination button 23e includes a determination button 23f and a dial 23g. The overall shape of the dial 23g is annular, and a decision button 23f is arranged on the inner peripheral side of the dial 23g. The dial 23g accepts an input of item selection on the menu screen or the like from the user, for example. The decision button 23f accepts an item decision input on the menu screen or the like from the user. For example, an operation for starting the slow live mode is assigned to the decision button 23f. The release button 22 and the power button 26 are provided on the upper surface of the casing of the electronic camera 1 as shown in FIG.

  Returning to the description of FIG. 1 again, the CPU 24 is a processor that performs various operations and controls the electronic camera 1. The CPU 24 controls each part of the electronic camera 1 by executing a sequence program stored in advance in the flash memory 18. Further, the CPU 24 has a clock function, and acquires the time when the release button 22 receives a full-press instruction input (hereinafter referred to as “shooting start time”). Further, the CPU 24 selects an image displayed on the display monitor 20 at the photographing start time.

  The CPU 24 also functions as an image acquisition unit 24a, a face recognition unit 24b, an evaluation value calculation unit 24c, a display control unit 24d, and a recording processing unit 24e.

  The image acquisition unit 24a acquires a plurality of images that the image sensor 14 generates in time series at the first time interval. Specifically, the image acquisition unit 24 a records a plurality of images generated by the image sensor 14 at a frame rate (fps) set in advance as the first time interval in the RAM 16 via the signal processing unit 15. Control a series of processing. Thereby, a plurality of images generated by the image sensor 14 are acquired in the RAM 16.

  As an example, the CPU 24 performs continuous shooting at a first time interval after receiving an operation for starting the slow live mode (for example, an instruction input for half pressing). The image acquisition unit 24 a records a plurality of images generated by the image sensor 14 in the slow display buffer of the RAM 16. Here, the slow display buffer functions as a FIFO (First In First Out) ring buffer. Thereby, the image acquisition unit 24a writes the image data according to the write pointer that is sequentially incremented from the head address of the slow display buffer. Note that when the image acquisition unit 24a has written to the final address of the slow display buffer, the image acquisition unit 24a returns to the top address and overwrites the new image data to sequentially write.

  The face recognition unit 24b analyzes the image and recognizes the face. Specifically, for example, the face recognition unit 24b performs a face detection process of extracting a feature point (feature amount) from a through image and detecting a face area (face image), the size of the face area, and the like. For example, the face recognition unit 24b extracts a face area by a feature point extraction process described in Japanese Patent Laid-Open No. 2001-16573. Examples of the feature points include eyebrow, eye, nose, and lip end points, face contour points, head apexes, and chin lower end points. Then, the face recognition unit 24b specifies the position information of the face area. Alternatively, the face recognition unit 24b may extract an area designated by a user input via the touch panel 21 as a face area. Further, the face recognition unit 24b detects the open / closed state of the eyelid from the face region based on the feature point extraction process. The face recognition unit 24b may recognize facial expressions such as a smile based on the above feature point extraction process.

The evaluation value calculation unit 24c calculates an evaluation value for each image by analyzing the plurality of images acquired by the image acquisition unit 24a. Specifically, the evaluation value calculation unit 24c evaluates at least one of a blurred state, an exposed state, and a face state of the subject as the evaluation value.
(Determination of blur condition)
The evaluation value calculation unit 24c calculates an evaluation value of the blurred state. For example, the evaluation value calculation unit 24c calculates the focus state of the subject as the evaluation value. Specifically, the evaluation value calculation unit 24c reads an image from the slow display buffer of the RAM 16 and analyzes the focus state of the subject for each image. Note that the evaluation value calculation unit 24c may employ any of the known focus state detection methods. As an example, the evaluation value calculation unit 24c analyzes the state of the edge in the eye part of the face recognized by the face recognition unit 24b, and calculates the focus state (focus point) as the evaluation value from the sharpness of the edge. Here, in the present embodiment, the higher the evaluation value, the better the focus state (focusing point).
(Judgment of exposure status)
For example, the evaluation value calculation unit 24c calculates the exposure state of the subject as the evaluation value in order to calculate the evaluation value of the exposure state. Note that the evaluation value calculation unit 24c may employ any of the known exposure state detection methods. As an example, the evaluation value calculation unit 24c reads an image recorded in the slow display buffer of the RAM 16, and detects the brightness of the shooting screen based on the image signal. That is, the evaluation value calculation unit 24c performs multi-division photometry that divides a photographing screen into a plurality of areas and detects a photometric value for each area. For example, the evaluation value calculation unit 24c performs multi-division by converting image data of RGB signals into image data of luminance signals (Y signals) and color difference signals (Cr, Cb signals) (YC conversion) for each divided area. Perform photometry.

Here, the evaluation value calculation unit 24c integrates luminance values (photometric values) for each region (block). Then, the evaluation value calculation unit 24c calculates the brightness of the entire shooting screen (hereinafter referred to as “AE evaluation value”) based on the luminance value. In the present embodiment, the evaluation value calculation unit 24c determines the brightness of the screen according to the AE evaluation value.
(Judgment of face condition)
In order to calculate the evaluation value of the face state, the evaluation value calculation unit 24c calculates, for example, the opening / closing degree of the eyelid on the face of the subject as the evaluation value. Specifically, the evaluation value calculation unit 24c detects an image in a state where the eyelid is opened (hereinafter referred to as “first state”) based on the recognition result of the face recognition unit 24b. Further, the evaluation value calculation unit 24c detects an image in a state in which the eyelid is half closed from the first state (hereinafter referred to as “second state”). Further, the evaluation value calculation unit 24c detects an image in a state where the eyelid is closed (hereinafter referred to as “third state”).

  Here, the evaluation value calculation unit 24c numerically evaluates the degree of opening of the eyelids. As an example, the evaluation value calculation unit 24c sets the value indicating the third state (the state where the eyelids are closed) to zero (0), sets the value indicating the second state (the state where the eyelids are half closed) to 5, The value indicating the state (the state in which the eyelids are open) is digitized as 10. Note that the evaluation value calculation unit 24c may further quantify the opening / closing degree of the bag between 0 and 10.

  The display control unit 24d sequentially displays a plurality of images on the display monitor 20 at a second time interval longer than the first time interval, and displays the evaluation result of the evaluation value in the currently displayed image on the display monitor 20. Let Alternatively, the display control unit 24d sequentially displays a plurality of images on the display monitor 20 at the second time interval, and is acquired at an evaluation result of the evaluation value in the currently displayed image and a time later than the image. The evaluation result of each evaluation value including the image is displayed on the display monitor 20. In this case, the display control unit 24d causes the display monitor 20 to display evaluation results for a preset number of images. As an example, when continuous shooting is performed at 30 frames (frames) / second, the first time interval is 1/30 seconds, but the display control unit 24d has 1 second (second The image is displayed on the display monitor 20 by frame advance at time intervals.

  Based on the shooting start time, the recording processing unit 24e records the image displayed on the display monitor 20 by the display control unit 24d at the shooting start time as a recording image.

  Next, an example of the operation of the electronic camera 1 in the slow live mode will be described. FIG. 3 is a flowchart illustrating an example of slow playback processing in the slow live mode. FIG. 4 is a diagram illustrating an example of slow playback processing in the slow live mode. FIG. 5 is a flowchart illustrating an example of the shooting process in the slow live mode.

  First, after describing the slow playback process in the slow live mode, the shooting process will be described. In the present embodiment, the CPU 24 controls the slow reproduction process and the photographing process independently.

  Note that the CPU 24 reads out the slow reproduction processing and shooting processing programs recorded in the flash memory 18 and performs the processing of the flow shown in FIGS. The CPU 24 can provide means for facilitating acquisition of a desired image without missing a photo opportunity as described below in slow live shooting by executing a program for slow playback processing and shooting processing. In the processing of the following flow, in order to make the explanation easy to understand, a case where the subject is a person's face and the blink of the subject is calculated as an evaluation value is first exemplified.

  After the power of the electronic camera 1 is turned on, the CPU 24 starts acquiring a through image. The display control unit 24d displays a through image on the display monitor 20. In this state, when the operation unit 23 receives an instruction input for the slow live mode and then the release button 22 receives an instruction input for a half-press, the CPU 24 starts a process for the slow live mode.

  Here, first, the CPU 24 performs continuous shooting. Then, the image acquisition unit 24 a of the CPU 24 writes the continuously shot image in the slow display buffer of the RAM 16. Specifically, the CPU 24 causes the image sensor 14 to perform continuous shooting via a timing generator based on shooting parameters obtained by automatic exposure or autofocus when half-pressed. In this case, the image sensor 14 generates images in time series at a preset frame rate. The image acquisition unit 24a refers to the write pointer and sequentially records these images (image data) in the slow display buffer.

  In FIG. 4, as the image writing, the image acquisition unit 24 a writes the first image (t + 0), the second image (t + 1), and the mth image (t + m) into the slow display buffer with reference to time t. The situation is illustrated.

  When the image acquisition unit 24a writes as many images as can be subjected to the slow playback process, the CPU 24 starts the process of the flow shown in FIG.

  Step S101: The CPU 24 performs reading processing of one image. Specifically, first, the first (t + 0) image (n = 1) is read. And CPU24 transfers to the process of step S102.

  Step S102: The evaluation value calculation unit 24c of the CPU 24 performs an evaluation value calculation process of the image using the evaluation values of m images. Here, in order to explain the features of the present embodiment in an easy-to-understand manner, as an example, the CPU 24 has five (m = 5) images (for example, in FIG. 4, the first (t + 0) image to the m-th image ( t + m) image) is read out.

  FIG. 6 is a diagram illustrating an example of an image recorded in the slow display buffer. In this example, an image obtained by continuously shooting a blinking person P1 is shown. The CPU 24 reads five images into the work area of the RAM 16. The evaluation value calculation unit 24c performs an evaluation value calculation process for the read number of images.

  Specifically, first, the face recognition unit 24b extracts a face area. Then, the face recognition unit 24b detects the open / closed state of the eyelid from the face area based on the feature point extraction process. Next, the evaluation value calculation unit 24c evaluates the degree of opening of the eyelid numerically based on the recognition result of the face recognition unit 24b. FIG. 6 shows the evaluation value for each image.

  Step S103: The display control unit 24d of the CPU 24 performs slow reproduction and display processing. Specifically, the display control unit 24d causes the display monitor 20 to display the nth image (starting from n = 1) shown in FIG. In this case, the display control unit 24d causes the display monitor 20 to display images at a time interval longer than the time interval per continuous shooting. As an example, the display control unit 24d causes the display monitor 20 to display an image with frame advance of 1 second per frame.

  The display control unit 24d causes the display monitor 20 to display the evaluation result of the evaluation value of the currently displayed image and the evaluation result of each evaluation value including the image acquired at a later time than the image. As an example, the display control unit 24d causes the display monitor 20 to display the evaluation results of the evaluation values of the five images evaluated by the evaluation value calculation unit 24c. As a result, the evaluation result is visually displayed on the display monitor 20, so that the user can intuitively understand which image has the high evaluation value, and obtains a desired image without missing a photo opportunity. Make it easier.

  FIG. 7 is a diagram illustrating an example of display processing by the display control unit 24d. In FIG. 7, the display control unit 24 d displays the n (= 1) th reduced image in the display frame W on the display monitor 20. The display frame W can appeal the evaluation result visually by color display. For example, the display control unit 24d displays a color of the display frame W in any one of green, yellow, and red according to the evaluation result. For example, green represents the first state, yellow represents the second state, and red represents the third state.

  In addition, the display control unit 24 d displays a graph of the evaluation result on the display monitor 20. This graph is a bar graph, in which the horizontal axis represents the first to fifth images, and the vertical axis represents the evaluation value. An arrow in the figure represents an image currently being displayed. Therefore, the user can visually see the evaluation result of an image (n = 2 to 5) acquired at a later time than the currently displayed image (n = 1). That is, this bar graph can appeal the evaluation result visually.

  Step S104: The CPU 24 determines whether there is a next image for slow playback. When there is a next image for the image read in step S102 (step S104: Yes), the CPU 24 returns to the process of step S101. Then, the display control unit 24d starts the slow playback of the next image as the slow playback time of one image ends. On the other hand, when there is no next image (step S104: No), the CPU 24 ends the processing of the flow shown in FIG.

  Note that when a recording image is recorded by a photographing process described later, the CPU 24 ends the process of the flow shown in FIG. 3, and the display control unit 24 d displays the recording image on the entire screen of the display monitor 20. Let

  Next, an example of shooting processing in the slow live mode will be described. As described above, when the release button 22 receives a half-press instruction input, the processing of the flow shown in FIG. 5 is started.

  Step S201: The CPU 24 determines whether or not a full-press instruction input from the release button 22 has been accepted. If the instruction input for full pressing has not been received (step S201: No), the CPU 24 repeats the process of step S201 and waits for instruction input for full pressing. On the other hand, when the instruction input for full pressing is received (step S201: No), the CPU 24 proceeds to the process of step S202.

  FIG. 8 is a diagram illustrating an example of display processing by the display control unit 24d. For example, when the display control unit 24d displays an image having an evaluation value of 10 on the display monitor 20, the display control unit 24d sets the color of the display frame W to green. Thus, the user can instantaneously select a photo opportunity with the color of the display frame W while concentrating on selecting the pose of the subject. Alternatively, the user can discriminate the evaluation value of the current image by looking at the graph displayed on the display monitor 20, so that the photo opportunity can be selected instantaneously. Note that the display control unit 24d sequentially displays, for example, a bar graph of evaluation values of the currently displayed image and subsequent four images on the display monitor 20. As an example, as shown in FIG. 8, when the currently displayed image is the third image (n = 3), the display control unit 24 d acquires images (n = 4 to 7) acquired at a later time than that image. ), The bar graph of the evaluation values of the third to seventh images (for five images) is displayed on the display monitor 20.

  Step S202: The CPU 24 acquires the shooting start time when fully pressed. Specifically, the CPU 24 acquires the shooting start time by using a clock function inside the CPU 24. And CPU24 transfers to the process of step S203.

  Step S203: The CPU 24 selects an image displayed on the display monitor 20 at the photographing start time as a recording image. That is, the CPU 24 independently controls the slow playback process and the shooting process in the slow live mode. For this reason, since the next image may be displayed on the display monitor 20 due to a so-called release time lag, the CPU 24 selects the image displayed on the display monitor 20 at the shooting start time as the image for recording. After selecting an image for recording, the CPU 24 proceeds to the process of step S204.

  Step S204: The CPU 24 determines whether an image having a higher evaluation value than the image selected in step S203 is present in any one of the preceding and succeeding images. If it does not exist in any of the preceding and succeeding images (step S204: No), the CPU 24 proceeds to the process of step S206. On the other hand, if it exists in any of the previous and subsequent images (step S204: Yes), the CPU 24 proceeds to the process of step S205. In the process of step S204, the previous image or the next image is used as one of the previous and next images, but for example, it may be an image from several images up to several images after manual setting. .

  Step S205: The CPU 24 selects an image having a higher evaluation value by changing it to a recording image. Thus, the CPU 24 can select an image with a higher evaluation value as a recording image. And CPU24 transfers to the process of step S206.

  Step S206: The recording processing unit 24e of the CPU 24 performs a recording process of the main image (recording image). Specifically, the recording processing unit 24e reads the selected recording image data from the slow display buffer, and temporarily records the image data in the work area of the RAM 16. Subsequently, the image processing unit 17 performs various types of image processing (for example, color interpolation processing, white balance, etc.) on the image data. The recording processing unit 24 e records the image after various image processing is performed on the recording medium 30. Therefore, the recording processing unit 24e can record the image displayed on the display monitor 20 at the photographing start time as a recording image while avoiding a so-called release time lag. Then, the CPU 24 ends the process of the flow shown in FIG.

  As described above, in the electronic camera 1 of the present embodiment, in slow live shooting, for example, evaluation results of evaluation values of an image currently being displayed and evaluations of evaluation values of images acquired at a later time than that image. The result can be confirmed on the display monitor 20 by the user. Therefore, since the electronic camera 1 can know in advance a good image during slow reproduction in slow live shooting, it can provide means for easily obtaining a desired image without missing a shutter chance.

(Supplementary items of the embodiment)
Hereinafter, supplementary items of the above embodiment will be described.

  (1) In the above embodiment, the evaluation value calculation unit 24c performs the determination of the face state. However, the evaluation value calculation unit 24c performs the comprehensive evaluation by performing the determination of the blur state, the determination of the exposure state, and the determination of the face state. It may be calculated. This makes it easier for the user to take a good image. For example, if the out-of-focus state is in focus, the evaluation value calculation unit 24c determines OK. The evaluation value calculation unit 24c determines OK when the exposure state is brighter than a preset threshold value. Further, the evaluation value calculation unit 24c makes an OK determination if the face state is determined to be in the first state (a state where the eyelids are open). Then, the evaluation value calculation unit 24c performs comprehensive evaluation based on three parameters to be evaluated (blurred state, exposed state, and facial state). For example, the evaluation value calculation unit 24c ranks the evaluation results of the comprehensive evaluation in three stages of A, B, and C. If all three parameters are OK, the evaluation value calculation unit 24c sets A as an overall evaluation. Alternatively, the evaluation value calculation unit 24c determines that the blurred state and the exposed state are OK, and if the face state is not closed, the evaluation is B as a comprehensive evaluation. Alternatively, the evaluation value calculation unit 24c sets C as an overall evaluation when at least one of the blurred state and the exposed state is not OK.

  FIG. 9 is a diagram illustrating an example of display processing by the display control unit 24d. For example, the display control unit 24d may display the evaluation result of the three parameters and the evaluation result of the comprehensive evaluation on the display monitor 20 for the currently displayed image. Accordingly, the user can refer to the comprehensive evaluation while concentrating on the selection of the pose of the subject and the like, so that the selection of the image with the photo opportunity can be instantaneously determined. Note that the evaluation value calculation unit 24c may digitize the evaluation values of the three evaluation target parameters (blurred state, exposure state, and facial state), and use the total value as the value of the overall evaluation.

  In the above-described embodiment, the evaluation value calculation unit 24c takes the blurred state, the exposed state, and the face state as the parameters to be evaluated. However, the evaluation value calculating unit 24c is not limited to these parameters. These parameters may be added as appropriate.

  (2) In the above embodiment, the display mode of the display control unit 24d is illustrated in FIGS. 7 to 9 in the slow live mode. However, the display mode appealing visually is not limited to the above-described content, and other display modes. An aspect may be sufficient.

  FIG. 10 is a diagram illustrating an example of display processing by the display control unit 24d. In FIG. 10, the evaluation results of the comprehensive evaluation are classified into four levels (A to D). A is the best image, B is a good image, C is a slightly good image, and D is an image unsuitable for photographing. In addition, in FIG. 10, it illustrates with the mark corresponding to each different evaluation result (AD).

  Here, the evaluation value calculation unit 24c, as a determination criterion for the best image, for example, in addition to determining whether all of the three evaluation target parameters (blur state, exposure state, and face state) are OK, When the recognition unit 24b recognizes a smile, the image (A) is determined to be the best when it is a smile. Note that the evaluation criteria of B to D in FIG. 10 correspond to the evaluation criteria of the comprehensive evaluations A to C described above in FIG. That is, B (good image) in FIG. 10 is the same as the evaluation standard for comprehensive evaluation A in FIG. 9, and C (slightly good image) in FIG. 10 is the evaluation standard for comprehensive evaluation B in FIG. In FIG. 10, D (an image unsuitable for photographing) is the same as the evaluation standard of the comprehensive evaluation C in FIG. In FIG. 10, the evaluation results of 10 images are displayed on the display monitor 20. That is, as an example, the display control unit 24d sequentially displays on the display monitor 20 marks (for 10 images) indicating the evaluation results of the currently displayed image and subsequent nine images. In FIG. 10, numbers are displayed on the marks for easy understanding, but the display control unit 24 d may not display these numbers. Alternatively, the display control unit 24d always displays 10 marks, and in FIGS. 10 (b) and 10 (c), the numbers 1 to 10 are used as in FIG. 10 (a). May be displayed. In FIG. 10, for the convenience of explanation, characters indicating the evaluation results of A to D are displayed, but the display control unit 24 d may not display these characters.

  In FIG. 10A, the display control unit 24d causes the display monitor 20 to display the first image. The user visually recognizes that the image is unsuitable for photographing by looking at the display monitor 20. The reason why the display control unit 24d displays an image unsuitable for photographing on the display monitor 20 is to avoid discontinuous movement by thinning out the unsuitable image for photographing.

  In FIG. 10B, the display control unit 24d causes the display monitor 20 to display the third image. Here, the user can visually recognize that the image is favorable for photographing by looking at the mark of the image currently displayed on the display monitor 20. However, since the display control unit 24d displays the mark indicating that the best image is on the seventh image (n = 7) on the display monitor 20, the user fully presses the third image. You can discourage the operation.

  In FIG. 10C, the display control unit 24d causes the display monitor 20 to display the seventh image. Here, the user can visually recognize that the image is favorable for photographing by looking at the mark of the image currently displayed on the display monitor 20 and the color of the display frame W. Therefore, it can be understood that the user only has to perform the full pressing operation when the seventh image is displayed on the display monitor 20. Therefore, the slow live mode of this embodiment avoids the problem that the user waited for a photo opportunity in the hope of having a better image, but did not have a good image after all, unlike the conventional slow playback. can do.

  The display control unit 24d may display the subject image in full screen and display the evaluation result on the display monitor 20 in a superimposed manner.

  FIG. 11 is a diagram illustrating an example of display processing by the display control unit 24d. In FIG. 11, the display control unit 24 d displays the subject of the person P <b> 1 on a full screen and displays the evaluation results A to D shown in FIG. 10 in a superimposed manner. As a result, the subject is displayed on the entire screen, and thus the display control unit 24d can improve the visibility of the subject. Further, as described above, the display control unit 24d causes the display monitor 20 to display the evaluation results of images up to n sheets (n is an arbitrary number suitable for display processing) ahead including the currently displayed image. You may do it.

  (3) In the above embodiment, the slow playback time interval (one frame advance time) is constant in the slow live mode, but this is only an example, and the slow playback time interval is set as a user input. You may change suitably according to it.

  FIG. 12 is a diagram illustrating an example of slow playback in the slow live mode. FIG. 12A schematically shows an image obtained by continuous shooting in the slow live mode. In this example, the CPU 24 performs continuous shooting of 20 images at 20 fps. The image acquisition unit 24 a records the 20 images generated by the image sensor 14 in the slow display buffer of the RAM 16.

  FIG. 12B schematically illustrates slow reproduction in the slow live mode. In the present embodiment, for example, the dial 23g of the selection / determination button 23e shown in FIG. For example, when the user rotates the dial 23g clockwise, the display control unit 24d increases the time interval of the slow playback currently being displayed. On the other hand, when the user rotates the dial 23g counterclockwise, the display control unit 24d further shortens the time interval of the slow playback currently being displayed.

  In FIG. 12B, the display control unit 24d performs slow reproduction at 1 second intervals in the initial setting. Here, when the user rotates the dial 23g clockwise, the display control unit 24d extends the slow playback time interval for each currently displayed sheet from 1 second to 2 seconds.

  FIG. 12C illustrates the subject (person P2) of the ninth to twelfth images. For example, when the evaluation result of the evaluation value calculation unit 24c determines that the 12th image is the best, the display control unit 24d displays, for example, a display frame when displaying the 12th image on the display monitor 20. The color is changed to green to notify the user that the image is the best. At this time, since the slow playback time interval currently being displayed is longer than that at the start of the slow playback, the user can easily perform a full-press operation in a photo opportunity.

  (4) In supplementary matter (3), the dial 23g is used as the operation member for slow playback. However, for example, the time interval for slow playback may be changed using a release button.

  FIG. 13 is a conceptual diagram of slow playback when the release button is used. FIG. 13A is a conceptual diagram of slow playback up to a full press operation, and FIG. 13B is a conceptual diagram at the time of a full press operation. Here, in the configuration of the electronic camera 1 shown in FIG. 1, the release button 22 is replaced with a release button 22a that can be operated for slow playback. The release button 22 a is connected to the CPU 24 via the pressure sensor 27. The pressure sensor 27 is, for example, a sensor that measures the finger pressure with a pressure-sensitive element via the release button 22 a, converts it into a detection (electric) signal, and outputs it to the CPU 24.

  The CPU 24 receives the detection signal, and the display control unit 24d changes the slow playback time interval in accordance with the detection signal and causes the display monitor 20 to display an image.

  Specifically, as the user's finger F pushes the release button 22a, the value of the detection signal of the pressure sensor 27 increases from the current value. When the user's finger F loosens the release button 22a, the value of the detection signal of the pressure sensor 27 becomes smaller than the current value (see FIG. 13A).

  Accordingly, the CPU 24 instructs the display control unit 24d to control the time interval for slow playback in response to the pressing of the release button 22. That is, as the user's finger F pushes the release button 22a, the display control unit 24d increases the time interval for slow reproduction. On the other hand, when the user's finger F loosens the depression of the release button 22a, the slow playback becomes the original time interval as the release button 22a returns to the original position. Further, the CPU 24 receives an instruction input for recording an image for recording as a full pressing operation when the user's finger F fully presses the release button 22 (see FIG. 13B).

  The release button 22a may be a control device that can perform a slow playback operation between a half-press operation and a full-press operation. Alternatively, the release button 22a is a user who has fully pressed the release button 22a from the initial state. It is also possible to use a control device capable of slow playback operation up to the state. By using such a release button 22a that can be operated for slow reproduction, it becomes easier for the user to fully press the shutter chance.

  (5) In the above embodiment, the evaluation value calculation process is performed at the time of reading (displaying) as shown in FIG. 4, but may be performed at the time of writing (at the time of imaging).

  (6) In the above embodiment, the compact type electronic camera is exemplified as the imaging apparatus to which the present invention can be applied. However, the present invention is not limited to this type of electronic camera, for example, a single-lens reflex type electronic camera, a digital video camera. A camera that can take still images and moving images such as digital images in a digital manner is included. In addition, the imaging apparatus to which the present invention can be applied includes a mobile phone, a personal digital assistant (PDA), an electronic apparatus having other imaging functions, and the like.

DESCRIPTION OF SYMBOLS 1 ... Electronic camera, 14 ... Image sensor, 24a ... Image acquisition part, 24c ... Evaluation value calculation part, 24d ... Display control part

Claims (10)

An image sensor that captures a subject image and generates an image;
An image acquisition unit that acquires the plurality of images that the image sensor generates in time series at a first time interval;
An evaluation value calculation unit that calculates an evaluation value for each image by analyzing the plurality of images acquired by the image acquisition unit;
The plurality of images are sequentially displayed on the display device at a second time interval longer than the first time interval, and the evaluation result of the evaluation value of the currently displayed image and / or after the image is displayed. A display control unit that causes the display device to display an evaluation result of each of the evaluation values including the image acquired at the time of
An imaging apparatus comprising: The imaging device according to claim 1,
A receiving unit for receiving an instruction input for recording an image for recording;
And a recording processing unit that records the image displayed on the display device at the time by the display control unit as the recording image based on the time at which the receiving unit receives the instruction input. An imaging apparatus characterized by the above. The imaging device according to claim 2,
If there is an image with a higher evaluation value before or after the image displayed on the display device by the display control unit at the time, the recording processing unit An image pickup apparatus that records a high image as the image for recording. In the imaging device according to any one of claims 1 to 3,
The evaluation value calculation unit evaluates at least one of a blurred state, an exposure state, and a face state of a subject as the evaluation value. The imaging apparatus according to claim 4,
The evaluation value calculation unit calculates a comprehensive evaluation based on the evaluation values of a plurality of types for each image,
The display control unit displays an evaluation result of the comprehensive evaluation on the display device. In the imaging device according to any one of claims 1 to 5,
The said display control part displays the said evaluation result for every said image on the said display apparatus in the display mode which appeals visually. The imaging device characterized by the above-mentioned. The imaging device according to claim 6,
The display control unit causes the display device to further superimpose a frame surrounding the currently displayed image, and changes the color display of the frame according to the evaluation result. The imaging device according to claim 1,
An operation member that receives the setting of the second time interval by a user input;
The display control unit displays the image on a display device by changing the second time interval according to the user input. The imaging device according to claim 2,
A pressure sensor for detecting the pressure of the finger via the reception unit;
The display control unit displays the image on a display device by changing the second time interval according to a detection signal from the pressure sensor. An imaging process for capturing a subject image and generating an image;
An image acquisition process for acquiring a plurality of the images generated in time series by the imaging element at a first time interval;
An evaluation value calculation process for calculating an evaluation value for each image by analyzing a plurality of the images;
The plurality of images are sequentially displayed on the display device at a second time interval longer than the first time interval, and the evaluation result of the evaluation value of the currently displayed image and / or after the image is displayed. Display control processing for causing the display device to display an evaluation result of each of the evaluation values including the image acquired at the time of
A program that causes a computer to execute.

Images