US20160330372A1 - Imaging device - Google Patents

Imaging device Download PDF

Info

Publication number
US20160330372A1
US20160330372A1 US15/212,877 US201615212877A US2016330372A1 US 20160330372 A1 US20160330372 A1 US 20160330372A1 US 201615212877 A US201615212877 A US 201615212877A US 2016330372 A1 US2016330372 A1 US 2016330372A1
Authority
US
United States
Prior art keywords
frame
images
image
movie
slow
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/212,877
Inventor
Takashi Kuriyama
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nikon Corp
Original Assignee
Nikon Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nikon Corp filed Critical Nikon Corp
Priority to US15/212,877 priority Critical patent/US20160330372A1/en
Publication of US20160330372A1 publication Critical patent/US20160330372A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H04N5/23248
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95Computational photography systems, e.g. light-field imaging systems
    • H04N23/951Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/68Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681Motion detection
    • H04N23/6811Motion detection based on the image signal
    • H04N5/23232
    • H04N5/23254

Definitions

  • the present invention relates to an imaging device capable of recording movie images.
  • Patent Document 1 Japanese Unexamined Patent Application Publication No. 2008-85688
  • An object of the present invention is to provide an imaging device whereby a timing intended by a photographer can be used as a reference to record information relating to image stabilization with respect to the preceding and following movie images.
  • An imaging device comprises: a storage unit that sequentially stores a plurality of frame images based on an imaging signal from an imaging sensor for capturing images of a subject light and also stores a still image corresponding to any of the plurality of frame images; a movie image generation unit that generates slow-motion movie images to be played back at a second frame rate lower than a first frame rate indicative of the number of frame images stored in the storage unit in a unit of time, on the basis of the plurality of frame images stored in the storage unit; and an image stabilization amount calculation unit that uses, as a reference, the frame image corresponding to the still image from among the plurality of frame images, to calculate an image stabilization amount for the slow-notion movie images,
  • the imaging device of the present invention it is possible to use a timing intended by a photographer as a reference to record information relating to image stabilization with respect to the preceding and following movie images.
  • FIG 1 is a block diagram illustrating a system configuration of an electronic camera according to an embodiment
  • FIG. 2 is a drawing for describing a frame rate during buffer memory storage and a frame rate during recording medium recording when slow-motion movie images are captured, in an electronic camera according to an embodiment
  • FIG. 3 is a drawing illustrating a frame images acquired by an electronic camera according to an embodiment
  • FIG. 4 is a drawing illustrating a movement vector in a frame image acquired by an electronic camera according to an embodiment
  • FIG. 5 is a drawing illustrating a recording region and a playback region in a frame image acquired by an electronic camera according to an embodiment.
  • FIG. 1 is a block diagram illustrating a system configuration of the electronic camera according to the first embodiment.
  • an electronic camera 2 is provided with a control unit 4 for overall control of each of the parts of the electronic camera 2 , the control unit 4 being constituted of a microprocessor or the like.
  • the control unit 4 has a video signal processing circuit 5 ; the video signal processing circuit 5 has a through-image generation unit 5 a that generates through-image data to be displayed on a display unit 12 (described below), a movie image generation unit 5 b that generates movie image data, and a generated image generation unit 5 c that generates still image data.
  • Connected to the control unit 4 are a buffer memory 8 , a recording medium 10 , the display unit 12 , and an operation unit 14 .
  • the buffer memory 8 temporarily stores image data created on the basis of an imaging signal from an imaging sensor 6 .
  • the imaging sensor 6 is constituted of a CCD, a CMOS, or the like, and captures images of light from a subject via an imaging lens (not shown); the buffer memory 8 temporarily stores image data based on an imaging signal outputted from the imaging sensor 6 and converted from an analog signal to a digital signal by passing through an A/D converter (not shown).
  • the buffer memory 8 sequentially stores a plurality of sets of image data based on the imaging signal outputted synchronously with a movie image cycle (60 fps or the like) from the imaging sensor 6 , i.e., stores a plurality of frame images constituting slow movie images.
  • the buffer memory 8 sequentially stores frame images having the number of pixels specified by QFHD (Quad Full High Definition: 3840 ⁇ 2160 pixels), i.e., high-resolution frame images, in a FIFO (first in first out) scheme.
  • the control unit 4 causes the buffer memory 8 to sequentially store a first acquired frame image F 1 , a second acquired frame image F 2 , . . . and an n-th acquired frame image F n , as illustrated in FIG. 2( a ) .
  • the buffer memory 8 has n storage regions (storage regions for sequentially storing the frame images), and sequentially stores the first frame image F 1 in a storage region having an address number (n ⁇ 1), the second frame image F 2 in a storage region having an address number (n ⁇ 2), . . . and an n-th frame image F n in a storage region having an address number 0.
  • the frame image F 1 of the storage region having the address number (n ⁇ 1) i.e., the oldest frame image
  • each of the frame images F 2 to F n is moved from the storage regions having the address numbers (n ⁇ 2) to 0, to the storage regions having the address numbers (n ⁇ 1) to 1
  • the (n+1)-th frame image F n+1 i.e., the newest frame image
  • the newest frame image is always stored in the storage region having the address number (0)
  • increasingly older frame images are stored in increasingly higher address numbers
  • the newest frame image is always stored in the storage region having the address number 0.
  • the recording medium 10 is a portable recording medium detachably mounted into a card slot (not shown) provided to the electronic camera 2 ; for example, a CF card, an SD card, or smart media is used.
  • the recording medium 10 records movie image data and slow-motion movie image data created by the movie image generation unit 5 b within the control unit 4 , which subjects each of the frame images stored in the buffer memory 8 to a process for resizing to a resolution for movie images (from a high to low resolution), an image process for movie images, and a compression process for movie images.
  • the recording medium 10 also stores still image data created by the still image generation unit 5 c within the control unit 4 , which subjects the frame images stored in the buffer memory 8 to an image process for still images and a compression process for still images; the recording medium further stores information relating to image-capturing, and the like.
  • the display unit 12 is constituted of a monitor or EVF or the like constituted of an LCD or the like disposed on a back surface part of the electronic camera 2 , and displays through-images generated by the through-image generation unit 5 a, movie images based on the movie image data recorded in the recording medium 10 , slow movie images based oh the slow-motion movie image data (hereinafter called “slow movie image data”), still images based on the still image data, information relating to image-capturing, and the like.
  • the operation unit 14 is configured to comprise: a power source switching for turning on or off a power source of the electronic camera 2 ; a command dial for setting an imaging mode, such as a movie image capturing mode for capturing movie images or a slow-motion movie image capturing mode for capturing slow movie images; a release button for issuing an instruction such as to begin capturing movie images or still images; a menu button for causing the display unit 12 to display a menu or the like; a cross key to be operated when menu items or the like are selected or when a variety of settings are being made; an OK button for confirming the selection of a menu item or a variety of different settings; a playback button for causing the display unit 12 to display the movie image data or the still image data recorded in the recording medium 10 ; and the like.
  • slow movie image data output from the imaging sensor 6 , to be played back at a second frame rate lower than a first frame rate indicative of the number of frame images stored in the buffer memory 8 in a unit of time are generated, and image stabilization is also performed; also, still image data based on at least one frame image of the plurality of frame images forming the slow movie image data is generated, and the image-stabilized slow movie image data and still image data are recorded in the recording medium 10 in association with each other.
  • slow movie image data is generated on the basis of the plurality of frame images stored in the buffer memory 8 from when a still image capturing command is inputted until prior to a first predetermined duration, as well as on the basis of the plurality of frame images stored in the buffer memory 8 from after the frame images serving as the still image data were stored in the buffer memory 8 until after a second predetermined duration.
  • slow movie image data is generated on the basis of the plurality of frame images stored in the buffer memory 8 during a predetermined duration (the first predetermined duration plus the second predetermined duration), and still image data is generated on the basis of the frame image (s) stored in the buffer memory 8 upon the termination of the first predetermined duration (upon the initiation of the second predetermined duration).
  • the predetermined duration for example, 1 second
  • the first predetermined duration for example, 0.6 seconds
  • the second predetermined duration for example, 0.4 seconds
  • the control unit 4 moves to the slow-motion movie image capturing mode for capturing the slow-motion movie images and the still images.
  • the control unit 4 determines that a command to generate slow movie image data has been issued, and drives a focus lens or the like (not shown) so as to focus on a primary subject 24 within the through-images illustrated in FIG. 3 (frame images 18 , 20 , and 22 ).
  • the control unit 4 upon ascertaining that the focus is on the primary subject, initiates capturing of slow-motion movie images, i.e., buffering thereof into the buffer memory 8 .
  • the plurality of frame images F 1 . . . F n . . . (see FIG. 2 ) based on the imaging signal outputted synchronously with the movie image cycle from the imaging sensor 6 begin to be stored in predetermined addresses within the buffer memory 8 .
  • the control unit 4 determines that a still image capturing command for commanding that still image data be generated has been inputted, and initiates the second predetermined duration (terminates the first predetermined duration).
  • the control unit 4 determines that the storage of the n frame images needed to generate the slow movie image data into the buffer memory 8 has been terminated, and terminates the buffering into the buffer memory 8 .
  • the buffer memory 8 has stored (n ⁇ p) frame images F 2 to F 5 . . . (where p is a natural number and n>p), from immediately prior to an input time TS of the still image capturing command until prior to the first predetermined duration, as well as p frame images . . . F n , F n+1 from the input time TS of the still image capturing command until after the second predetermined duration; the slow movie image data is generated on the basis of the n frame images F 2 to F n+1 .
  • the control unit 4 determines a movement vector of the subject.
  • the frame image 20 illustrated in FIG. 3( b ) is acquired at the input time TS of the still image capturing command
  • the frame image 18 illustrated in FIG. 3( a ) being a frame image which is one prior to the input time TS of the still image capturing command
  • the frame image 22 illustrated in FIG. 3( c ) being a frame image which is one after the input time TS of the still image capturing command
  • the control unit 4 performs an image process to thereby determine the movement vector, which is indicative of the direction and travel of the angle of view generated by a camera shake.
  • the movement vector is determined as illustrated by the arrows 30 and 32 in the frame images 18 and 22 , respectively.
  • the arrows 30 and 32 schematically illustrate the magnitude and direction of movement of a specific subject within the frame image, where the frame image at the input time TS of the still image capturing command serves as a reference.
  • the in the frame images 18 and 22 illustrates a hypothetical reference position within the screen of the frame image 20 .
  • performing similar image process for each of the n frame images makes it possible to determine the movement vector representative of the fluctuation caused by a camera shake, where the timing TS intended by the user serves as a reference for each of the frame images.
  • the control unit 4 cuts out a recording reference region 36 recorded as slow move image data within the frame image 20 acquired at the input time TS of the still image capturing command illustrated in FIG. 5( b ) , on the basis of the magnitude and direction of the movement vector determined for each of the frame images.
  • the frame image 18 illustrated in FIG. 5( a ) which is one prior to the frame image 20
  • the frame image 22 illustrated in FIG. 5( c ) which is one after the frame image 20
  • a recording region of the same size as the recording reference region 36 having been determined in FIG. 5( b ) on the basis of the movement vector, is also cut out in the other frame images in a similar manner, and the recording region is temporarily stored in the buffer memory 8 .
  • the control unit 4 determines the size of the recording reference region 36 on the basis of the magnitude and direction of the movement vector. For example, the size of the recording reference region 36 is determined per the maximum amplitude of the movement vector in all the frame images stored in the buffer memory 8 .
  • control unit 4 executes a process for generating slow movie image data and a process for generating still image data, on the basis of the plurality of frame images stored in the buffer memory 8 as well as the recording regions cut out from the frame images.
  • the control unit 4 reads out, from the buffer memory 8 , the recording region cut out from a frame image at the second frame rate lower than the first frame rate (for example, 24 frames per second, which is 1/2.5 of the first frame rate).
  • the recording region for the frame image F 2 stored in the buffer memory 8 at a time T 1 (for example, 1/60th of a second) is read out from the buffer memory 8 at a time T 2 (for example, 1/24th of a second), as illustrated in FIG. 2( b ) .
  • the movie image generation unit 5 b within the video signal processing circuit 5 executes a resolution resizing process (resizing to a lower resolution for the number of pixels in full HD or the like) for movie images as well as an image process for movie images (including a compression process for movie images) on the recording regions of the read-out frame images F 2 to F 5 . . . , to thereby generate slow movie image data.
  • the value of the second frame rate is set in advance, stored in a memory or the like (not shown), and configured so as to be changeable.
  • the control unit 4 reads out, from the buffer memory 8 , the frame image stored in the buffer memory 8 at the input time TS of the still image capturing command.
  • the still image generation unit 5 c within the video signal processing circuit, 5 executes an image process for still images (including a compression process for still images) on the read-out frame images to generate still image data.
  • frame images having, for example, a number of pixels specified in QFHD, i.e., high-resolution frame images, are stored in the buffer memory 8 , it is possible to obtain high-resolution still image data.
  • the frame images having the number of pixels specified in QFHD may be recorded, or images made by cutting out (trimming) at the aforedescribed cut-out region (the region matched to the recording region) may be used.
  • the user may also be allowed to change the settings as appropriate for the size of the image data to be recorded (full-sized or trimmed).
  • the control unit 4 records, into the recording medium 10 , the slow movie image data generated by the movie image generation unit 5 b.
  • the still image data generated by the still image generation unit 5 c is also recorded into the recording medium 10 . Further, information indicative of the fact that the slow movie image data and the still image data are related to each other (an image-capturing date and time, or an identification number) is recorded into the recording medium 10 .
  • the control unit 4 causes the display unit 12 to display slow movie images based on the slow movie image data, and thereafter causes the display unit 12 to display still images based on the still image data associated with the slow movie image data.
  • the electronic camera it is possible to use a timing intended by a photographer, as a reference to record slow movie image data in which image stabilization has been performed on preceding and following movie images. It is also possible to play back slow movie images on which image stabilization has been performed, on the basis of the recorded slow movie image data.
  • the slow movie images based on the slow movie image data are played back on the display unit 12 or a PC, television, digital photo frame, or other external device, it is possible to suppress a camera shake and to view stable, more impressive slow movie images.
  • the electronic camera according to the second embodiment has the same configuration as the configuration of the electronic camera 2 according to the first embodiment, and therefore a description thereof has been omitted, and like elements of the configuration have been given like reference numerals in the description.
  • each of the frame images constituting the slow movie image data is recorded into the recording medium 10 , each of the frame images is cut out on the basis of the movement vector during playback of the slow movie images, and the slow movie images are played back.
  • the slow movie images are played back.
  • the control unit 4 performs a focusing operation and thereafter begins buffering the frame images in the buffer memory 8 , and when an input in which the release button has been pressed entirely down is received, the control unit 4 buffers the frame images until the second predetermined duration elapses.
  • a movement vector for each of the frame images is determined.
  • control unit 4 executes a process to generate the slow movie image data and a process to generate the still image data, on the basis of the plurality of frame images stored in the buffer memory 8 .
  • the frame images F 2 to F 5 . . . stored in the buffer memory 8 at a first frame rate (for example, 60 frames/second) similar to the frame rate outputted from the imaging sensor 6 (the imaging frame rate) are read out by the control unit 4 from the buffer memory 8 at a second frame rate (for example, 24 frames/second, which is 1/2.5 the first frame rate) lower than the first frame rate.
  • a frame image F 2 stored in the buffer memory 8 at a time Ti (for example, 1/60th of a second) is read out from the buffer memory 8 at a time T 2 (for example, 1/24 seconds), as illustrated in FIG.
  • the movie image generation unit 5 b within the video signal processing circuit 5 executes an image process for movie images (including a compression process for movie images) on the read-out frame images F 2 to F 5 . . . , to thereby generate the slow movie image data.
  • the value of the second frame rate is set in advance, stored in a memory or the like (not shown), and configured so as to be changeable.
  • the movie image generation unit 5 b may also perform a resolution resizing process for movie images on the frame images F 2 to F 5 . . . prior to performing the image process for movie images.
  • the image stabilization process will be performed by the aforedescribed image process after the resizing thereof, and therefore it becomes necessary to perform a resizing process having an adequate margin to allow for the image stabilization to be achieved (resizing process endowing the movie image size with a margin as wide as the camera shake).
  • the slow movie image data generated by the movie image generation unit 5 b is recorded into the recording medium 10 .
  • the movement vector (see FIG. 4 ) determined as above is also recorded in association with each of the frame images constituting the slow movie image data.
  • the still image data generated by the still image generation unit 5 c is also recorded into the recording medium 10 . Further, information indicative of the fact that the slow movie image data and the still image data are related to each other (an image-capturing date and time, or an identification number) is recorded into the recording medium 10 .
  • the control unit 4 causes the display unit 12 to display a screen for making a selection as to whether or not to perform image stabilization on the slow movie images being played back.
  • control unit 4 reads out and plays back the slow-motion movie image data from the recording medium 10 .
  • the control unit 4 reads out the slow-motion movie image data from the recording medium 10 , and thereafter cuts out and plays back a playback region from each of the frame images.
  • the playback region in each of the frame images is determined using as a reference a playback reference region 42 in the frame image 20 acquired at the input time TS of the still image capturing command.
  • the playback reference region 42 is, for example, a predetermined region including the primary subject 24 within the frame image 20 illustrated in FIG. 5( b ) .
  • the size of the playback reference region 42 is pre-set on the basis of the magnitude and direction of the movement vector determined using as a reference the frame image acquired at the input time TS of the still image capturing command. For example, the size of the playback reference region 42 is determined such that a specific subject is located at the center in the frame image where the magnitude of the movement vector is greatest.
  • the control unit 4 sequentially reads out the frame images constituting the slow-motion movie image data for every predetermined timing, cuts out the playback region from the read-out frame images, and causes the display unit 12 to sequentially display the same.
  • the playback region in each of the frame images is a region of the same size as the playback reference region 42 , where a position of the playback reference region 42 illustrated in FIG. 5( b ) has been moved by a predetermined amount based on the magnitude of the movement vector, in the direction of the movement vector.
  • a position of the playback reference region 42 illustrated in FIG. 5( b ) has been moved by a predetermined amount based on the magnitude of the movement vector, in the direction of the movement vector.
  • the playback regions 40 and 44 of the same size as the playback reference region 42 are cut out, where the playback reference region 42 illustrated in FIG. 5( b ) has been moved by a predetermined amount in the movement vector direction on the basis of the movement vector illustrated by the arrows 30 and 32 in FIG. 4 .
  • control unit 4 After the playback of the slow movie images, the control unit 4 causes the display unit 12 to display still images based on the still image data associated with the slow movie image data.
  • the configuration is such that the display unit 12 displays and plays back the slow movie images, but a configuration may also be adopted in which the slow movie images are outputted to a PC, television, digital photo-frame, or similar external device and are displayed on the external device.
  • the electronic camera of the present embodiment it is possible to use a timing intended by a photographer as a reference for recording information relating to image stabilization for the preceding and following movie images. It is also possible to select, during the playback of slow movie images, whether or not to perform image stabilization and then play back the slow movie images.
  • the configuration is such that the frame image acquired at the input time TS of the still image capturing command is recorded in the recording medium 10 as the still image data, but a configuration may also be adopted in which a single frame image is chosen by a “best shot selection” from the frame images acquired at the first predetermined duration and the second predetermined duration, which are before and after the TS, and the chosen frame image is recorded in the recording medium 10 as the still image data.
  • a “best shot selection” from the frame images acquired at the first predetermined duration and the second predetermined duration, which are before and after the TS
  • the chosen frame image is recorded in the recording medium 10 as the still image data.
  • each of the frame images is assessed on the basis of the degree of camera shake, the degree of smiling, and the like, and the frame image having the highest assessment value(s) is selected as the still image data to be recorded in the recording medium 10 .
  • the configuration is such that a frame image having a number of pixels specified by QFHD (3,840 ⁇ 2,160 pixels) is stored in the buffer memory 8 , but a configuration may also be adopted in which a frame image having a number of pixels specified by full HD (full high definition: 1,920 ⁇ 1,080 pixels) or a similar frame image having a number of pixels at least as high as what is specified by full HD is stored in the buffer memory 8 .
  • full HD full high definition: 1,920 ⁇ 1,080 pixels
  • a similar frame image having a number of pixels at least as high as what is specified by full HD is stored in the buffer memory 8 .
  • only the still image data may be stored in the buffer memory 8 as per the QFHD specifications on the basis of the still image capturing command.
  • the configuration is such that the movement vector is found by performing an image process, but a configuration may also be adopted in which the movement vector is found on the basis of the output from an acceleration sensor or similar camera shake detection sensor.
  • the configuration is such that the frame image at the input time TS of the still image capturing command is used as a reference to find the movement vector for each of the frame images, but a configuration may also be adopted in which a frame image preceding or following by one frame is used as a reference to find the movement vector.
  • the frame image one after the respective frame image may be used as a reference to find the movement vector
  • the frame image one prior to the respective frame image may be used as a reference to find the movement vector.
  • each of the frame images of the movie images may serve as the aforedescribed reference image for each of the frame images continuing prior to (or after) the respective frame image.
  • a frame image other than the one in the aforedescribed embodiments may be used as the reference image.
  • a single frame image selected by applying the aforedescribed best shot selection technique may also serve as the reference image.
  • the range in which the best shot selection is performed may include those frame images acquired at the first predetermined duration and the second predetermined duration, which are the durations before and after the input time TS of the still image capturing command, or may include all frame images stored in the buffer memory 8 .
  • candidate frame images which the user is able to select as desired may be all images within the buffer memory 8 , or may be limited to the plurality of frame images close in terms of image-capturing time to the input time TS (images within several frames before and after the frame image at the input time TS).

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computing Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

This imaging device comprises: a storage unit that sequentially stores a plurality of frame images based on an imaging signal from an imaging sensor for capturing images of a subject light and also stores a still image corresponding to any of the plurality of frame images; a movie image generation unit that generates slow-motion movie images to be played back at a second frame rate lower than a first frame rate indicative of the number of frame images stored in the storage unit in a unit of time, on the basis of the plurality of frame images stored in the storage unit; and an image stabilization amount calculation unit that uses, as a reference, the frame image corresponding to the still image from among the plurality of frame images, to calculate an image stabilization amount for the slow-motion movie images.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This is a Continuation of application Ser. No. 13/684,951 filed Nov. 26, 2012, which claims priority to Japanese Patent Application No. 2011-265440, filed on Dec. 5, 2011; and Japanese Patent Application No. 2012-148560, filed on Jul. 2, 2012. The disclosure of the prior applications are hereby incorporated by reference herein in their entireties.
  • TECHNICAL FIELD
  • The present invention relates to an imaging device capable of recording movie images.
  • BACKGROUND ART
  • There is known an imaging device for performing image stabilization on movie images in a case where a camera shake has been detected while movie images are being captured (for example, see Patent Document 1). In the imaging device of such description, when a camera shake is detected in a case where movie images are being captured at a normal frame rate, the frame rate is set to be higher and image stabilization is performed.
  • CITATION LIST Patent Literature
  • [Patent Document 1] Japanese Unexamined Patent Application Publication No. 2008-85688
  • SUMMARY OF INVENTION Technical Problem
  • In the imaging device recited in Patent Document 1, no disclosure is made of a technique for using a timing intended by a photographer as a reference to perform image stabilization on the preceding and following movie images.
  • An object of the present invention is to provide an imaging device whereby a timing intended by a photographer can be used as a reference to record information relating to image stabilization with respect to the preceding and following movie images.
  • Solution to Problem
  • An imaging device according to the present invention comprises: a storage unit that sequentially stores a plurality of frame images based on an imaging signal from an imaging sensor for capturing images of a subject light and also stores a still image corresponding to any of the plurality of frame images; a movie image generation unit that generates slow-motion movie images to be played back at a second frame rate lower than a first frame rate indicative of the number of frame images stored in the storage unit in a unit of time, on the basis of the plurality of frame images stored in the storage unit; and an image stabilization amount calculation unit that uses, as a reference, the frame image corresponding to the still image from among the plurality of frame images, to calculate an image stabilization amount for the slow-notion movie images,
  • Advantageous Effects of Invention
  • According to the imaging device of the present invention, it is possible to use a timing intended by a photographer as a reference to record information relating to image stabilization with respect to the preceding and following movie images.
  • BRIEF DESCRIPTION OF DRAWINGS
  • FIG 1 is a block diagram illustrating a system configuration of an electronic camera according to an embodiment;
  • FIG. 2 is a drawing for describing a frame rate during buffer memory storage and a frame rate during recording medium recording when slow-motion movie images are captured, in an electronic camera according to an embodiment;
  • FIG. 3 is a drawing illustrating a frame images acquired by an electronic camera according to an embodiment;
  • FIG. 4 is a drawing illustrating a movement vector in a frame image acquired by an electronic camera according to an embodiment; and
  • FIG. 5 is a drawing illustrating a recording region and a playback region in a frame image acquired by an electronic camera according to an embodiment.
  • DESCRIPTION OF EMBODIMENTS
  • Provided below is a description of an electronic camera serving as an imaging device according to a first embodiment of the present invention. FIG. 1 is a block diagram illustrating a system configuration of the electronic camera according to the first embodiment. As illustrated in FIG. 1, an electronic camera 2 is provided with a control unit 4 for overall control of each of the parts of the electronic camera 2, the control unit 4 being constituted of a microprocessor or the like. The control unit 4 has a video signal processing circuit 5; the video signal processing circuit 5 has a through-image generation unit 5 a that generates through-image data to be displayed on a display unit 12 (described below), a movie image generation unit 5 b that generates movie image data, and a generated image generation unit 5 c that generates still image data. Connected to the control unit 4 are a buffer memory 8, a recording medium 10, the display unit 12, and an operation unit 14.
  • The buffer memory 8 temporarily stores image data created on the basis of an imaging signal from an imaging sensor 6. Herein, the imaging sensor 6 is constituted of a CCD, a CMOS, or the like, and captures images of light from a subject via an imaging lens (not shown); the buffer memory 8 temporarily stores image data based on an imaging signal outputted from the imaging sensor 6 and converted from an analog signal to a digital signal by passing through an A/D converter (not shown).
  • In a case where the electronic camera 2 has been set, for example, to a slow-motion movie image capturing mode for capturing slow-motion movie images (described below; hereinafter called “slow movie images”), then the buffer memory 8 sequentially stores a plurality of sets of image data based on the imaging signal outputted synchronously with a movie image cycle (60 fps or the like) from the imaging sensor 6, i.e., stores a plurality of frame images constituting slow movie images. In the present embodiment, the buffer memory 8 sequentially stores frame images having the number of pixels specified by QFHD (Quad Full High Definition: 3840×2160 pixels), i.e., high-resolution frame images, in a FIFO (first in first out) scheme.
  • More specifically, in a case where the buffer memory 8 has a storage region capable of storing, for example, n frame images (n being a natural number), the control unit 4 causes the buffer memory 8 to sequentially store a first acquired frame image F1, a second acquired frame image F2, . . . and an n-th acquired frame image Fn, as illustrated in FIG. 2(a). After the n frame images F1 to Fn have been stored, whenever the subsequent frame image Fn+1 is outputted from the imaging sensor 6, the oldest frame image F1 is deleted from the buffer memory 8 and the newest frame image Fn+1 is stored; the process for deleting the oldest frame image and storing the newest frame image is repeated every time the subsequent frame image is outputted from the imaging sensor 6.
  • In other words, the buffer memory 8 has n storage regions (storage regions for sequentially storing the frame images), and sequentially stores the first frame image F1 in a storage region having an address number (n−1), the second frame image F2 in a storage region having an address number (n−2), . . . and an n-th frame image Fn in a storage region having an address number 0. When the frame images F1 to Fn have been stored in all of the n storage regions and the subsequent frame image Fn+1 is outputted from the imaging sensor 6, the frame image F1 of the storage region having the address number (n−1) (i.e., the oldest frame image) is deleted and each of the frame images F2 to Fn is moved from the storage regions having the address numbers (n−2) to 0, to the storage regions having the address numbers (n−1) to 1; the (n+1)-th frame image Fn+1 (i.e., the newest frame image) is stored in the storage region having the address number (0). Accordingly, the newest frame image is always stored in the storage region having the address number (0), increasingly older frame images are stored in increasingly higher address numbers, and the newest frame image is always stored in the storage region having the address number 0.
  • The recording medium 10 is a portable recording medium detachably mounted into a card slot (not shown) provided to the electronic camera 2; for example, a CF card, an SD card, or smart media is used. The recording medium 10 records movie image data and slow-motion movie image data created by the movie image generation unit 5 b within the control unit 4, which subjects each of the frame images stored in the buffer memory 8 to a process for resizing to a resolution for movie images (from a high to low resolution), an image process for movie images, and a compression process for movie images. The recording medium 10 also stores still image data created by the still image generation unit 5 c within the control unit 4, which subjects the frame images stored in the buffer memory 8 to an image process for still images and a compression process for still images; the recording medium further stores information relating to image-capturing, and the like.
  • The display unit 12 is constituted of a monitor or EVF or the like constituted of an LCD or the like disposed on a back surface part of the electronic camera 2, and displays through-images generated by the through-image generation unit 5 a, movie images based on the movie image data recorded in the recording medium 10, slow movie images based oh the slow-motion movie image data (hereinafter called “slow movie image data”), still images based on the still image data, information relating to image-capturing, and the like.
  • The operation unit 14 is configured to comprise: a power source switching for turning on or off a power source of the electronic camera 2; a command dial for setting an imaging mode, such as a movie image capturing mode for capturing movie images or a slow-motion movie image capturing mode for capturing slow movie images; a release button for issuing an instruction such as to begin capturing movie images or still images; a menu button for causing the display unit 12 to display a menu or the like; a cross key to be operated when menu items or the like are selected or when a variety of settings are being made; an OK button for confirming the selection of a menu item or a variety of different settings; a playback button for causing the display unit 12 to display the movie image data or the still image data recorded in the recording medium 10; and the like.
  • In the electronic camera 2 according to the present embodiment, slow movie image data, output from the imaging sensor 6, to be played back at a second frame rate lower than a first frame rate indicative of the number of frame images stored in the buffer memory 8 in a unit of time are generated, and image stabilization is also performed; also, still image data based on at least one frame image of the plurality of frame images forming the slow movie image data is generated, and the image-stabilized slow movie image data and still image data are recorded in the recording medium 10 in association with each other.
  • Provided below is a description of a process for when slow movie images and still images are captured in the electronic camera 2 according to the present embodiment.
  • In the present embodiment, slow movie image data is generated on the basis of the plurality of frame images stored in the buffer memory 8 from when a still image capturing command is inputted until prior to a first predetermined duration, as well as on the basis of the plurality of frame images stored in the buffer memory 8 from after the frame images serving as the still image data were stored in the buffer memory 8 until after a second predetermined duration. In other words, slow movie image data is generated on the basis of the plurality of frame images stored in the buffer memory 8 during a predetermined duration (the first predetermined duration plus the second predetermined duration), and still image data is generated on the basis of the frame image (s) stored in the buffer memory 8 upon the termination of the first predetermined duration (upon the initiation of the second predetermined duration). The predetermined duration (for example, 1 second), the first predetermined duration (for example, 0.6 seconds), and the second predetermined duration (for example, 0.4 seconds) are set in advance, stored in a memory or the like (not shown), and configured so as to be changeable.
  • When the user operates the command dial to thereby set the slow-motion movie image capturing mode, the control unit 4 moves to the slow-motion movie image capturing mode for capturing the slow-motion movie images and the still images. Next, in a case where the control unit 4 has ascertained that the user has pressed the release button down halfway, the control unit 4 determines that a command to generate slow movie image data has been issued, and drives a focus lens or the like (not shown) so as to focus on a primary subject 24 within the through-images illustrated in FIG. 3 ( frame images 18, 20, and 22). The control unit 4, upon ascertaining that the focus is on the primary subject, initiates capturing of slow-motion movie images, i.e., buffering thereof into the buffer memory 8.
  • More specifically, as described above, the plurality of frame images F1 . . . Fn . . . (see FIG. 2) based on the imaging signal outputted synchronously with the movie image cycle from the imaging sensor 6 begin to be stored in predetermined addresses within the buffer memory 8.
  • Next, in a case where the first predetermined duration has elapsed and it is ascertained that the user has pressed the release button entirely down while the storage of the frame images into the buffer memory 8 is being repeated, then the control unit 4 determines that a still image capturing command for commanding that still image data be generated has been inputted, and initiates the second predetermined duration (terminates the first predetermined duration).
  • Next, when it is ascertained that the second predetermined duration has elapsed, the control unit 4 determines that the storage of the n frame images needed to generate the slow movie image data into the buffer memory 8 has been terminated, and terminates the buffering into the buffer memory 8. At such a time, as illustrated in FIG. 2(a), the buffer memory 8 has stored (n−p) frame images F2 to F5 . . . (where p is a natural number and n>p), from immediately prior to an input time TS of the still image capturing command until prior to the first predetermined duration, as well as p frame images . . . Fn, Fn+1 from the input time TS of the still image capturing command until after the second predetermined duration; the slow movie image data is generated on the basis of the n frame images F2 to Fn+1.
  • Next, the control unit 4 determines a movement vector of the subject. Herein, in a case where the frame image 20 illustrated in FIG. 3(b) is acquired at the input time TS of the still image capturing command, the frame image 18 illustrated in FIG. 3(a) being a frame image which is one prior to the input time TS of the still image capturing command and the frame image 22 illustrated in FIG. 3(c) being a frame image which is one after the input time TS of the still image capturing command, then the control unit 4 performs an image process to thereby determine the movement vector, which is indicative of the direction and travel of the angle of view generated by a camera shake.
  • For example, when a position of the frame image 20 in FIG. 4 serves as a hypothetical reference position for image stabilization, then the movement vector is determined as illustrated by the arrows 30 and 32 in the frame images 18 and 22, respectively. The arrows 30 and 32 schematically illustrate the magnitude and direction of movement of a specific subject within the frame image, where the frame image at the input time TS of the still image capturing command serves as a reference. The in the frame images 18 and 22 illustrates a hypothetical reference position within the screen of the frame image 20.
  • As such, performing similar image process for each of the n frame images makes it possible to determine the movement vector representative of the fluctuation caused by a camera shake, where the timing TS intended by the user serves as a reference for each of the frame images.
  • Next, the control unit 4 cuts out a recording reference region 36 recorded as slow move image data within the frame image 20 acquired at the input time TS of the still image capturing command illustrated in FIG. 5(b), on the basis of the magnitude and direction of the movement vector determined for each of the frame images. In the frame image 18 illustrated in FIG. 5(a), which is one prior to the frame image 20, and in the frame image 22 illustrated in FIG. 5(c), which is one after the frame image 20, recording regions 34 and 38 in which the recording reference region 36 illustrated in FIG. 5(b) has been moved by a predetermined amount based on the magnitude of the movement vector in the direction of the movement vector are cut out on the basis of the movement vector illustrated by the arrows 30 and 32 in FIG. 4, and the recording regions are temporarily stored in the buffer memory 8. A recording region of the same size as the recording reference region 36, having been determined in FIG. 5(b) on the basis of the movement vector, is also cut out in the other frame images in a similar manner, and the recording region is temporarily stored in the buffer memory 8.
  • The control unit 4 determines the size of the recording reference region 36 on the basis of the magnitude and direction of the movement vector. For example, the size of the recording reference region 36 is determined per the maximum amplitude of the movement vector in all the frame images stored in the buffer memory 8.
  • Next, the control unit 4 executes a process for generating slow movie image data and a process for generating still image data, on the basis of the plurality of frame images stored in the buffer memory 8 as well as the recording regions cut out from the frame images.
  • Firstly, the process for generating the slow movie image data shall be described. The control unit 4 reads out, from the buffer memory 8, the recording region cut out from a frame image at the second frame rate lower than the first frame rate (for example, 24 frames per second, which is 1/2.5 of the first frame rate). In other words, as illustrated in FIG. 2(a), the recording region for the frame image F2 stored in the buffer memory 8 at a time T1 (for example, 1/60th of a second) is read out from the buffer memory 8 at a time T2 (for example, 1/24th of a second), as illustrated in FIG. 2(b). The movie image generation unit 5 b within the video signal processing circuit 5 executes a resolution resizing process (resizing to a lower resolution for the number of pixels in full HD or the like) for movie images as well as an image process for movie images (including a compression process for movie images) on the recording regions of the read-out frame images F2 to F5 . . . , to thereby generate slow movie image data. The value of the second frame rate is set in advance, stored in a memory or the like (not shown), and configured so as to be changeable.
  • Next, the process for generating still image data shall be described. The control unit 4 reads out, from the buffer memory 8, the frame image stored in the buffer memory 8 at the input time TS of the still image capturing command. The still image generation unit 5 c within the video signal processing circuit, 5 executes an image process for still images (including a compression process for still images) on the read-out frame images to generate still image data. In the present embodiment, because frame images having, for example, a number of pixels specified in QFHD, i.e., high-resolution frame images, are stored in the buffer memory 8, it is possible to obtain high-resolution still image data. With respect to the still image data that is generated (recorded in the recording medium 10), the frame images having the number of pixels specified in QFHD may be recorded, or images made by cutting out (trimming) at the aforedescribed cut-out region (the region matched to the recording region) may be used. In terms of the still image data to be recorded, the user may also be allowed to change the settings as appropriate for the size of the image data to be recorded (full-sized or trimmed).
  • The control unit 4 records, into the recording medium 10, the slow movie image data generated by the movie image generation unit 5 b. The still image data generated by the still image generation unit 5 c is also recorded into the recording medium 10. Further, information indicative of the fact that the slow movie image data and the still image data are related to each other (an image-capturing date and time, or an identification number) is recorded into the recording medium 10. When playback is to be performed, the control unit 4 causes the display unit 12 to display slow movie images based on the slow movie image data, and thereafter causes the display unit 12 to display still images based on the still image data associated with the slow movie image data.
  • According to the electronic camera according to the present embodiment, it is possible to use a timing intended by a photographer, as a reference to record slow movie image data in which image stabilization has been performed on preceding and following movie images. It is also possible to play back slow movie images on which image stabilization has been performed, on the basis of the recorded slow movie image data.
  • As such, when the slow movie images based on the slow movie image data are played back on the display unit 12 or a PC, television, digital photo frame, or other external device, it is possible to suppress a camera shake and to view stable, more impressive slow movie images.
  • Next, an electronic camera according to a second embodiment of the present invention shall now be described. The electronic camera according to the second embodiment has the same configuration as the configuration of the electronic camera 2 according to the first embodiment, and therefore a description thereof has been omitted, and like elements of the configuration have been given like reference numerals in the description.
  • In the electronic camera 2 according to the second embodiment, each of the frame images constituting the slow movie image data is recorded into the recording medium 10, each of the frame images is cut out on the basis of the movement vector during playback of the slow movie images, and the slow movie images are played back. Provided below is a description of a process for when the slow movie image data is recorded in the electronic camera 2 according to the second embodiment.
  • Similarly with respect to the first embodiment, in the slow-motion movie image capturing mode, when an input in which the user has pressed the release button down halfway is received, the control unit 4 performs a focusing operation and thereafter begins buffering the frame images in the buffer memory 8, and when an input in which the release button has been pressed entirely down is received, the control unit 4 buffers the frame images until the second predetermined duration elapses. Next, similarly with respect to the first embodiment, a movement vector for each of the frame images, using the frame image at the input time TS of the still image capturing command as a reference, is determined.
  • Next, the control unit 4 executes a process to generate the slow movie image data and a process to generate the still image data, on the basis of the plurality of frame images stored in the buffer memory 8.
  • Firstly, the process for generating the slow movie image data shall be described. The frame images F2 to F5 . . . stored in the buffer memory 8 at a first frame rate (for example, 60 frames/second) similar to the frame rate outputted from the imaging sensor 6 (the imaging frame rate) are read out by the control unit 4 from the buffer memory 8 at a second frame rate (for example, 24 frames/second, which is 1/2.5 the first frame rate) lower than the first frame rate. More specifically, as illustrated in FIG. 2(a), a frame image F2 stored in the buffer memory 8 at a time Ti (for example, 1/60th of a second) is read out from the buffer memory 8 at a time T2 (for example, 1/24 seconds), as illustrated in FIG. 2(b). The movie image generation unit 5 b within the video signal processing circuit 5 executes an image process for movie images (including a compression process for movie images) on the read-out frame images F2 to F5 . . . , to thereby generate the slow movie image data. The value of the second frame rate is set in advance, stored in a memory or the like (not shown), and configured so as to be changeable.
  • The movie image generation unit 5 b may also perform a resolution resizing process for movie images on the frame images F2 to F5 . . . prior to performing the image process for movie images. However, in a case where the resizing process is performed prior to the image process for movie images, the image stabilization process will be performed by the aforedescribed image process after the resizing thereof, and therefore it becomes necessary to perform a resizing process having an adequate margin to allow for the image stabilization to be achieved (resizing process endowing the movie image size with a margin as wide as the camera shake).
  • Further, the process to generate the still image data is similar to that of the first embodiment, and therefore a description thereof has been omitted.
  • Next, the slow movie image data generated by the movie image generation unit 5 b is recorded into the recording medium 10. The movement vector (see FIG. 4) determined as above is also recorded in association with each of the frame images constituting the slow movie image data.
  • The still image data generated by the still image generation unit 5 c is also recorded into the recording medium 10. Further, information indicative of the fact that the slow movie image data and the still image data are related to each other (an image-capturing date and time, or an identification number) is recorded into the recording medium 10.
  • Next, the process in a case where the slow movie image data recorded in the recording medium 10 is to be played back shall now be described. When the user operates the playback button to issue a command to play back the slow movie image data, the control unit 4 causes the display unit 12 to display a screen for making a selection as to whether or not to perform image stabilization on the slow movie images being played back.
  • Herein, in a case where the user has issued a playback command in which image stabilization is not to be performed, then the control unit 4 reads out and plays back the slow-motion movie image data from the recording medium 10.
  • On the other hand, in a case where the user has issued a playback command in which image stabilization is to be performed, the control unit 4 reads out the slow-motion movie image data from the recording medium 10, and thereafter cuts out and plays back a playback region from each of the frame images. Herein, the playback region in each of the frame images is determined using as a reference a playback reference region 42 in the frame image 20 acquired at the input time TS of the still image capturing command. Herein, the playback reference region 42 is, for example, a predetermined region including the primary subject 24 within the frame image 20 illustrated in FIG. 5(b).
  • The size of the playback reference region 42 is pre-set on the basis of the magnitude and direction of the movement vector determined using as a reference the frame image acquired at the input time TS of the still image capturing command. For example, the size of the playback reference region 42 is determined such that a specific subject is located at the center in the frame image where the magnitude of the movement vector is greatest.
  • The control unit 4 sequentially reads out the frame images constituting the slow-motion movie image data for every predetermined timing, cuts out the playback region from the read-out frame images, and causes the display unit 12 to sequentially display the same.
  • Herein, the playback region in each of the frame images is a region of the same size as the playback reference region 42, where a position of the playback reference region 42 illustrated in FIG. 5(b) has been moved by a predetermined amount based on the magnitude of the movement vector, in the direction of the movement vector. For example, in the frame image 18, illustrated in FIG. 5(a), which is one prior to the frame image 20, and in the frame image 22, illustrated in FIG. 5(c), which is one after the frame image 20, playback regions 40 and 44 of the same size as the playback reference region 42 are cut out, where the playback reference region 42 illustrated in FIG. 5(b) has been moved by a predetermined amount in the movement vector direction on the basis of the movement vector illustrated by the arrows 30 and 32 in FIG. 4.
  • After the playback of the slow movie images, the control unit 4 causes the display unit 12 to display still images based on the still image data associated with the slow movie image data.
  • In the playback of the slow movie image data, the configuration is such that the display unit 12 displays and plays back the slow movie images, but a configuration may also be adopted in which the slow movie images are outputted to a PC, television, digital photo-frame, or similar external device and are displayed on the external device.
  • According to the electronic camera of the present embodiment, it is possible to use a timing intended by a photographer as a reference for recording information relating to image stabilization for the preceding and following movie images. It is also possible to select, during the playback of slow movie images, whether or not to perform image stabilization and then play back the slow movie images.
  • In each of the embodiments described above, the configuration is such that the frame image acquired at the input time TS of the still image capturing command is recorded in the recording medium 10 as the still image data, but a configuration may also be adopted in which a single frame image is chosen by a “best shot selection” from the frame images acquired at the first predetermined duration and the second predetermined duration, which are before and after the TS, and the chosen frame image is recorded in the recording medium 10 as the still image data. Herein, in the best shot selection, for example, each of the frame images is assessed on the basis of the degree of camera shake, the degree of smiling, and the like, and the frame image having the highest assessment value(s) is selected as the still image data to be recorded in the recording medium 10.
  • In each of the embodiments described above, the configuration is such that a frame image having a number of pixels specified by QFHD (3,840×2,160 pixels) is stored in the buffer memory 8, but a configuration may also be adopted in which a frame image having a number of pixels specified by full HD (full high definition: 1,920×1,080 pixels) or a similar frame image having a number of pixels at least as high as what is specified by full HD is stored in the buffer memory 8. In such a case, only the still image data may be stored in the buffer memory 8 as per the QFHD specifications on the basis of the still image capturing command.
  • In each of the embodiments described above, the configuration is such that the movement vector is found by performing an image process, but a configuration may also be adopted in which the movement vector is found on the basis of the output from an acceleration sensor or similar camera shake detection sensor.
  • In each of the embodiments described above, the configuration is such that the frame image at the input time TS of the still image capturing command is used as a reference to find the movement vector for each of the frame images, but a configuration may also be adopted in which a frame image preceding or following by one frame is used as a reference to find the movement vector. For example, for each of the frame images earlier than the frame image at the input time TS of the still image capturing command, the frame image one after the respective frame image may be used as a reference to find the movement vector, and for each of the frame images after the frame image at the input time TS of the still image capturing command, the frame image one prior to the respective frame image may be used as a reference to find the movement vector. In this manner, each of the frame images of the movie images may serve as the aforedescribed reference image for each of the frame images continuing prior to (or after) the respective frame image.
  • Beyond this even, a frame image other than the one in the aforedescribed embodiments (any single frame image other than the frame image at the input time TS of the still image capturing command) may be used as the reference image. For example, a single frame image selected by applying the aforedescribed best shot selection technique may also serve as the reference image. In such a case, as described by the abovementioned best shot selection, the range in which the best shot selection is performed may include those frame images acquired at the first predetermined duration and the second predetermined duration, which are the durations before and after the input time TS of the still image capturing command, or may include all frame images stored in the buffer memory 8. Alternatively, the user may be allowed to select a single desired frame image to serve as the reference image, from among the plurality of frame images stored in the buffer memory 8. In such a case, candidate frame images which the user is able to select as desired may be all images within the buffer memory 8, or may be limited to the plurality of frame images close in terms of image-capturing time to the input time TS (images within several frames before and after the frame image at the input time TS).
  • The above-described embodiments have been recited in order to facilitate understanding of the present invention, and are not recited in order to limit the present invention. Accordingly, in effect, each element disclosed in the above-described embodiments also includes all design changes and equivalents falling within the technical scope of the present invention.

Claims (1)

1. An imaging device, comprising:
a storage unit that sequentially stores a plurality of frame images based on an imaging signal from an imaging sensor that captures images of a subject light and also stores a still image corresponding to any of the plurality of frame images;
a movie image generation unit that generates slow-motion movie images to be played back at a second frame rate lower than a first frame rate indicative of the number of frame images stored in the storage unit in a unit of time, on the basis of the plurality of frame images stored in the storage unit;
an image stabilization amount calculation unit that uses, as a reference, the frame image corresponding to the still image from among the plurality of frame images, to calculate an image stabilization amount for the slow-motion movie images; and
a still image generation unit that generates still image data by processing any frame image, as the reference, of the plurality of frame images corresponding to the still image based on the calculated stabilization amount.
US15/212,877 2011-12-05 2016-07-18 Imaging device Abandoned US20160330372A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/212,877 US20160330372A1 (en) 2011-12-05 2016-07-18 Imaging device

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
JP2011-265440 2011-12-05
JP2011265440 2011-12-05
JP2012148560A JP5516662B2 (en) 2011-12-05 2012-07-02 Imaging device
JP2012-148560 2012-07-02
US13/684,951 US9426369B2 (en) 2011-12-05 2012-11-26 Imaging device
US15/212,877 US20160330372A1 (en) 2011-12-05 2016-07-18 Imaging device

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/684,951 Continuation US9426369B2 (en) 2011-12-05 2012-11-26 Imaging device

Publications (1)

Publication Number Publication Date
US20160330372A1 true US20160330372A1 (en) 2016-11-10

Family

ID=48498724

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/684,951 Active US9426369B2 (en) 2011-12-05 2012-11-26 Imaging device
US15/212,877 Abandoned US20160330372A1 (en) 2011-12-05 2016-07-18 Imaging device

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US13/684,951 Active US9426369B2 (en) 2011-12-05 2012-11-26 Imaging device

Country Status (3)

Country Link
US (2) US9426369B2 (en)
JP (1) JP5516662B2 (en)
CN (2) CN103139475B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220038631A1 (en) * 2019-04-26 2022-02-03 Fujifilm Corporation Imaging element, imaging apparatus, operation method of imaging element, and program

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5516662B2 (en) * 2011-12-05 2014-06-11 株式会社ニコン Imaging device
US20150195482A1 (en) * 2014-01-08 2015-07-09 Nvidia Corporation Method, system and smartphone that chooses optimal image to reduce shutter shake
US9398196B2 (en) 2014-04-28 2016-07-19 Lynx System Developers, Inc. Methods for processing event timing images
US10375300B2 (en) 2014-04-28 2019-08-06 Lynx System Developers, Inc. Methods for processing event timing data
US9413926B2 (en) 2014-04-28 2016-08-09 Lynx System Developers, Inc. Systems for processing event timing images
US9413963B2 (en) 2014-05-30 2016-08-09 Apple Inc. Video image stabilization
US9674438B2 (en) 2014-07-06 2017-06-06 Apple Inc. Low light video image stabilization strength modulation
US9596411B2 (en) 2014-08-25 2017-03-14 Apple Inc. Combined optical and electronic image stabilization
US9787902B1 (en) 2016-06-10 2017-10-10 Apple Inc. Video image stabilization with enforced stabilization constraints
TW201923776A (en) * 2017-10-27 2019-06-16 美商蝴蝶網路公司 Quality indicators for collection of and automated measurement on ultrasound images
US11522816B2 (en) 2019-09-25 2022-12-06 MIXHalo Corp. Multi-stride packet payload mapping for robust transmission of data
CN116528063B (en) * 2023-07-04 2023-11-03 荣耀终端有限公司 Shooting method, readable storage medium and electronic device

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8525894B2 (en) * 2009-07-30 2013-09-03 Olympus Imaging Corp. Camera and camera control method
US9426369B2 (en) * 2011-12-05 2016-08-23 Niko Corporation Imaging device

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH1042233A (en) * 1996-07-19 1998-02-13 Sony Corp Video camera device and video reproducing device
JP4665737B2 (en) * 2005-11-30 2011-04-06 カシオ計算機株式会社 Image processing apparatus and program
JP4983179B2 (en) * 2006-09-20 2012-07-25 カシオ計算機株式会社 Imaging apparatus, image display control program, and image display control method
JP4872571B2 (en) 2006-09-28 2012-02-08 カシオ計算機株式会社 Imaging apparatus, imaging method, and program
US20090079842A1 (en) * 2007-09-26 2009-03-26 Honeywell International, Inc. System and method for image processing
US8144233B2 (en) * 2007-10-03 2012-03-27 Sony Corporation Display control device, display control method, and display control program for superimposing images to create a composite image
US9165388B2 (en) * 2008-09-22 2015-10-20 International Business Machines Corporation Method of automatic cropping
JP5329311B2 (en) * 2009-06-15 2013-10-30 オリンパスイメージング株式会社 Imaging apparatus, imaging method, playback apparatus, and playback method
JP5436975B2 (en) 2009-08-21 2014-03-05 オリンパスイメージング株式会社 CAMERA, CAMERA DISPLAY CONTROL METHOD, DISPLAY DEVICE, AND DISPLAY METHOD
JP5419647B2 (en) * 2009-11-16 2014-02-19 キヤノン株式会社 Image blur correction device, imaging device including the same, and method for controlling image blur correction device
JP5045785B2 (en) * 2010-05-25 2012-10-10 株式会社ニコン Imaging device
JP4983961B2 (en) * 2010-05-25 2012-07-25 株式会社ニコン Imaging device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8525894B2 (en) * 2009-07-30 2013-09-03 Olympus Imaging Corp. Camera and camera control method
US9426369B2 (en) * 2011-12-05 2016-08-23 Niko Corporation Imaging device

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220038631A1 (en) * 2019-04-26 2022-02-03 Fujifilm Corporation Imaging element, imaging apparatus, operation method of imaging element, and program
US11985423B2 (en) * 2019-04-26 2024-05-14 Fujifilm Corporation Imaging element, imaging apparatus, operation method of imaging element, and program improving real-time output of shake degree information

Also Published As

Publication number Publication date
CN103139475B (en) 2017-11-03
US20130141602A1 (en) 2013-06-06
CN103139475A (en) 2013-06-05
JP5516662B2 (en) 2014-06-11
US9426369B2 (en) 2016-08-23
JP2013141195A (en) 2013-07-18
CN107659773A (en) 2018-02-02

Similar Documents

Publication Publication Date Title
KR102077967B1 (en) Electronic device
US20160330372A1 (en) Imaging device
JP5338373B2 (en) Imaging device
JP6671323B2 (en) Imaging device
JP2014049798A (en) Digital camera
JP2013110562A (en) Imaging apparatus
JP4360395B2 (en) Information processing device
JP6569188B2 (en) Imaging device
JP5682590B2 (en) Imaging device and image display device
JP2014120926A (en) Imaging apparatus
JP2018195892A (en) Imaging apparatus
JP2019176487A (en) Electronic apparatus
JP2013055594A (en) Imaging apparatus
JP2013102385A (en) Imaging apparatus
JP2007104501A (en) Apparatus and method for recording still image, program, and recording medium
JP2015043490A (en) Imaging apparatus
JP2014232987A (en) Imaging apparatus and program
JP2005020786A (en) Information processing apparatus
JP2014086818A (en) Imaging apparatus and program

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION