JP2015043490A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To photograph a moving image with a still image, to which a video effect for paying attention to a main subject is imparted.SOLUTION: An imaging apparatus includes: an imaging element 6 for imaging subject light; a display section 12 for displaying a through image in response to an imaging signal; a storage section 8 for sequentially storing a plurality of frame images and storing a still image corresponding to one of the plurality of frame images; a moving image generation section 5b for generating a slow motion moving image reproduced at a second frame rate smaller than a first frame rate which shows the number of frame images stored in the storage section in unit time in response to the plurality of frame images stored in the storage section; a touch panel 14 for detecting a touch position in the display section; a main subject recognition section for recognizing a main subject in response to detection of touch in the touch panel; and an image processing section 5b for imparting a different video effect to the slow motion moving image in response to a rate of an area of the main subject recognized in the main subject recognition section, which is occupied in a size of a screen of the display section.

Description

  The present invention relates to an imaging apparatus capable of recording a moving image.

  2. Description of the Related Art Conventionally, there is an imaging apparatus that has a moving image-added still image recording function that records a short-time video before and after shooting together with a still image during still image shooting (see, for example, Patent Document 1). Conventionally, there is an image pickup apparatus that has a touch panel overlaid on a rear liquid crystal monitor and can perform shooting by a user's touch operation.

Japanese Patent Application Laid-Open No. 2001-078137

  By the way, according to the conventional imaging device having the function of recording a still image with moving images, the user can easily enjoy the video expression by automatically adding the video effect or adding the BGM.

  However, the recorded video is limited to a video as it is at the time of shooting or a video to which an effect according to a video effect pattern held in advance by the imaging device is given.

  An object of the present invention is to provide an imaging device capable of shooting a moving image with a still image to which a video effect focused on a main subject is given.

  An imaging apparatus according to the present invention sequentially stores an imaging element that captures subject light, a display unit that displays a through image based on an imaging signal from the imaging element, and a plurality of frame images based on the imaging signal from the imaging element. And a storage unit that stores a still image corresponding to one of the plurality of frame images, and the storage unit that stores the still image in unit time based on the plurality of frame images stored in the storage unit. A moving image generating unit that generates a slow motion moving image that is played back at a second frame rate that is less than a first frame rate that indicates the number of frame images; a touch panel that detects a touch position on the display unit; A main subject recognition unit for recognizing a main subject based on the detection; and the main subject recognition unit recognized by the main subject recognition unit. Based on the ratio of the area occupied on the size of the screen of the display portion of the body, characterized in that and an image processing unit for imparting different visual effect in the slow-motion video image.

  According to the imaging apparatus of the present invention, it is possible to shoot a moving image with a still image to which a video effect focused on a main subject is given.

It is a block diagram which shows the system configuration | structure of the electronic camera which concerns on embodiment. It is a figure for demonstrating the frame rate at the time of buffer memory storage at the time of imaging | photography of the slow motion moving image which concerns on embodiment, and the frame rate at the time of recording medium recording. It is a flowchart which shows the imaging | photography process of the slow motion moving image which concerns on embodiment. It is a figure which shows the video effect provided to the slow motion moving image which concerns on embodiment. It is a figure which shows the video effect provided to the slow motion moving image which concerns on embodiment.

  Hereinafter, an electronic camera as an imaging apparatus according to an embodiment of the present invention will be described. FIG. 1 is a block diagram illustrating a system configuration of an electronic camera according to an embodiment. As shown in FIG. 1, the electronic camera 2 is configured by a microprocessor or the like, and includes a control unit 4 that comprehensively controls each unit of the electronic camera 2. The control unit 4 includes a video signal processing circuit 5, and the video signal processing circuit 5 generates a through image generation unit 5 a that generates through image data to be displayed on a display unit 12 described later, and a moving image that generates moving image data. It has a generation unit 5b and a still image generation unit 5c that generates still image data. In addition, an image sensor 6, a buffer memory 8, a recording medium 10, a display unit 12, and a touch panel 14 are connected to the control unit 4.

  The image sensor 6 is constituted by a CCD or CMOS, and images light from a subject through a photographing lens (not shown). The buffer memory 8 is output from the image sensor 6 and passes through an A / D converter (not shown). Thus, the image data based on the imaging signal converted from the analog signal to the digital signal is temporarily stored.

  In addition, the buffer memory 8 starts from the image sensor 6 when the electronic camera 2 is set to a slow motion moving image capturing mode for capturing, for example, a slow motion moving image (hereinafter referred to as a slow moving image) described later. A plurality of image data based on imaging signals output in synchronization with a moving image cycle (60 fps or the like), that is, a plurality of frame images constituting a slow moving image are sequentially stored. In this embodiment, the buffer memory 8 stores a frame image having the number of pixels of the QFHD (Quad Full High Definition: 3840 × 2160 pixels) standard, that is, a high-resolution frame image in a FIFO (first in first out) system. Are sequentially stored.

Specifically, when the buffer memory 8 has a storage area that can store, for example, n (n is a natural number) frame images, the control unit 4 performs the first operation as shown in FIG. The acquired frame image F ₁ , the second acquired frame image F ₂ ... The nth acquired frame image F _n are sequentially stored in the buffer memory 8. After the n frame images F _{1 to} F _n are stored, when the next frame image F _{n + 1} is output from the image sensor 6, the oldest frame image F ₁ is deleted from the buffer memory 8. The latest frame image F _{n + 1} is stored, and each time the next frame image is output from the image sensor 6, the process of deleting the oldest frame image and storing the latest frame image is repeated.

That is, the buffer memory 8 has n storage areas (storage areas for sequentially storing frame images), and the first frame image F ₁ is stored in the storage area of the address number (n−1). The second frame image F ₂ is sequentially stored in the storage area of the address number (n−2),... The nth frame image F _n is sequentially stored in the storage area of the address number 0. Then, when the frame images F _{1 to} F _n are stored in all n storage areas and the next frame image F _{n + 1} is output from the image sensor 6, the frame in the storage area of the address number (n−1) is stored. The image (that is, the oldest frame image) F ₁ is deleted, and each of the frame images F _{2 to} F _n is stored from the storage area of the address number (n−2) to 0 to the address number (n−1) to 1. The (n + 1) th frame image (that is, the latest frame image) F _{n + 1} is stored in the storage area of the address number (0). Therefore, the latest frame image is always stored in the storage area of the address number (0), and the older frame images are sequentially stored as the address number increases, and the latest frame image is always stored in the storage area of the address number 0. Remembered.

  The recording medium 10 is a portable recording medium that is detachably mounted in a card slot (not shown) provided in the electronic camera 2, and for example, a CF card, an SD card, smart media, or the like is used. In the recording medium 10, each frame image stored in the buffer memory 8 is resized to a moving image resolution (from a large resolution to a small resolution) by the moving image generation unit 5 b in the control unit 4. Moving image data and slow motion moving image data created by performing image processing, video effect applying processing, and moving image compression processing are recorded. Further, the recording medium 10 is created by subjecting the frame image stored in the buffer memory 8 to image processing for still images and compression processing for still images by the still image generating unit 5c in the control unit 4. Still image data, information related to shooting, and the like are recorded.

  The display unit 12 is configured by a monitor or EVF configured by an LCD or the like disposed on the back side of the electronic camera 2, and a through image generated by the through image generation unit 5 a and a moving image recorded on the recording medium 10. A moving image based on the image data, a slow moving image based on the slow motion moving image data (hereinafter referred to as slow moving image data), a still image based on the still image data, information related to photographing, and the like are displayed.

  The touch panel 14 is arranged on the display unit 12 with the same size as the display unit 12 and detects that an operator's finger touches the screen of the display unit 12. Using this touch panel 14, setting of shooting modes such as a moving image shooting mode for shooting moving images and a slow motion moving image shooting mode for shooting slow moving images, an instruction to start shooting of moving images and still images, and the recording medium 10 A playback instruction for displaying the moving image data and still image data recorded on the display unit 12 is performed.

  In the electronic camera 2 according to this embodiment, the slow video that is output from the image sensor 6 and reproduced at a second frame rate that is smaller than the first frame rate indicating the number of frame images that are stored in the buffer memory 8 per unit time. The image data is generated, and each frame image data forming the slow moving image data is given a different video effect selected based on the size of the main subject on the display screen, and the slow moving image data is formed. Still image data based on at least one frame image of the plurality of frame images to be generated is generated, and the slow moving image data and the still image data to which the video effect is applied are associated with each other and recorded on the recording medium 10.

  Hereinafter, with reference to the flowchart shown in FIG. 3, processing when the electronic camera 2 according to this embodiment captures a slow moving image with a still image will be described.

  In this embodiment, a plurality of frame images stored in the buffer memory 8 and a frame image serving as still image data between the input of the still image shooting instruction and the first predetermined time before are stored in the buffer memory 8. Slow moving image data is generated on the basis of a plurality of frame images stored in the buffer memory 8 between the stored time and after the second predetermined time. That is, slow moving image data is generated based on a plurality of frame images stored in the buffer memory 8 during a predetermined time (first predetermined time + second predetermined time), and at the end of the first predetermined time (second predetermined time). Still image data is generated based on the frame image stored in the buffer memory 8 at the time start). The predetermined time (for example, 2 seconds), the first predetermined time (for example, 1.2 seconds), and the second predetermined time (for example, 0.8 seconds) are preset and stored in a memory (not shown). It is configured to be changeable.

  When the slow motion moving image shooting mode is set by the user operating the touch panel 14, the control unit 4 shifts to the slow motion moving image shooting mode for shooting the slow moving image and the still image (step S1). . As a result, the display unit 12 starts displaying a through image based on the through image data generated by the through image generation unit 5a.

  When the first touch (1st touch) by the user is detected on the touch panel 14 (step S2), the control unit 4 determines that an instruction to generate slow moving image data has been issued, and detects a main subject in the through image. Then, a focus lens (not shown) or the like is driven so as to focus on the main subject. The main subject is detected by detecting the main subject by performing face recognition processing when the human face image is included in the through image, and the human face image is included in the through image. If not included, the main subject is detected by recognizing the subject existing near the center of the display screen. Then, the control unit 4 starts buffering to the buffer memory 8, that is, capture of a frame image in a state where the main subject is in focus (step S3).

Specifically, as described above, a plurality of frame images F ₁ ... F _n (see FIG. 2) based on the imaging signal output from the imaging device 6 in synchronization with the moving image cycle are predetermined in the buffer memory 8. Start storing to the address.

  Next, when the second touch (2nd touch) by the user is detected on the touch panel 14 after the first predetermined time has elapsed and while the storage of the frame image in the buffer memory 8 is being repeated ( In step S4), the control unit 4 determines that a still image shooting instruction for instructing generation of still image data has been input, and detects a main subject in the through image based on the touch position of the 2nd touch (step S5). Then, a focus lens (not shown) or the like is driven so as to focus on the main subject. That is, when the position of the 2nd touch is the position of a human face included in the through image, the main subject is detected by performing face recognition processing, and when the position of the 2nd touch is a part of the landscape. The main subject is detected by recognizing the subject existing at the touch position. Then, measurement of the second predetermined time is started.

Next, when the second predetermined time elapses, the control unit 4 ends the buffering to the buffer memory 8 (step S6). At this time, as shown in FIG. 2A, the buffer memory 8 has (n−p) sheets (p is a natural number, n> p) from the time TS when the still image capturing instruction is input to the first predetermined time before. ) Frame images F _{2 to} F ₅ ... And p frame images from the time TS when the still image shooting instruction is input to the time after the second predetermined time period... F _n and F _{n + 1} are stored. These n frame images F _{2 to} F _{n + 1} are used for generating slow moving image data, which will be described later.

  Next, the control unit 4 reads out the frame image stored in the buffer memory 8 from the buffer memory 8 when the still image shooting instruction is input TS. Then, it is determined whether or not the area of the main subject included in the read frame image is larger than a predetermined ratio (step S7). When it is determined that the area of the main subject included in the frame image occupies the display screen is larger than a predetermined ratio, a video effect for performing blurring processing on an image excluding the main subject is selected (first video effect) (Step S8). On the other hand, if it is determined that the area occupied by the main subject included in the frame image is not larger than a predetermined ratio, a video effect for performing zoom-in processing on the main subject is selected (second video). Effect selection) (step S9).

  Next, the control unit 4 executes a process for generating slow moving image data and a process for generating still image data to which a video effect is applied based on the plurality of frame images stored in the buffer memory 8 (step S10). .

First, the process of generating slow moving image data will be described. The control unit 4 reads the frame image from the buffer memory 8 at a second frame rate lower than the first frame rate (for example, 24 frames / second which is 1 / 2.5 of the first frame rate). That is, as shown in FIG. 2A, the frame image F ₂ stored in the buffer memory 8 at the time T ₁ (for example, 1/60 seconds) is changed to the time T ₁ as shown in FIG. ₂ (for example, 1/24 second) is read from the buffer memory 8. Then, the read frame images F _{2 to} F _{n + 1} are resized to a moving image resolution by the moving image generation unit 5 b in the video signal processing circuit 5 (to reduce the resolution such as the number of full HD pixels). Sizing), image processing for moving images (including moving image compression processing), and processing for imparting the selected video effect are performed to generate slow moving image data. Further, the selected video effect is imparted to each of the read frame images F _{2 to} F _{n + 1} . Here, the frame image F ₂ to F n + ₁ is given visual effect that the selected direction from the frame image F ₂ to F _{n + 1} so as gradually appears strongly. The value of the second frame rate is preset and stored in a memory (not shown) or the like, and is configured to be changeable.

FIG. 4 is a diagram for explaining the video effect added to the frame image forming the slow movie when the blurring process is selected as the video effect. As shown in this figure, begin to implement blur processing for the image, except for the main subject from the frame image F _2, sequentially increasing the strength of the blurring, the intensity of the blurring process with respect to F n _{+ 1} in the image except the main subject Is in the highest state.

FIG. 5 is a diagram for explaining a video effect added to a frame image forming a slow movie when zoom-in processing is selected as the video effect. As shown in the figure, it begins to applying the treatment to zoom the main subject from the frame image F _2, zoom in sequential main subject is in a state where zoom is completed for the main object in the F n _{+ 1.}

  Next, still image data generation processing will be described. The control unit 4 reads the frame image stored in the buffer memory 8 from the buffer memory 8 when the still image shooting instruction is input TS. Then, still image data is generated by subjecting the read frame image to image processing for still images (including still image compression processing) by the still image generation unit 5 c in the video signal processing circuit 5. In this embodiment, for example, a frame image having the number of pixels of the QFHD standard, that is, a high-resolution frame image is stored in the buffer memory 8, so that high-resolution still image data can be obtained.

  The control unit 4 records the slow moving image data generated by the moving image generation unit 5b on the recording medium 10, and records the still image data generated by the still image generation unit 5c on the recording medium 10 (step S11). Further, information (shooting date and identification number) indicating that the slow moving image data and the still image data are related to each other is recorded on the recording medium 10. In addition, when playing back, the control unit 4 displays a slow motion image based on the slow motion image data on the display unit 12 and then displays a still image based on the still image data related to the slow motion image data. This is displayed on the unit 12.

  Therefore, when a slow moving image based on the slow moving image data is reproduced on the display unit 12 or an external device such as a PC, a television, or a digital photo frame, an impressive slow moving image having a video effect focused on the main subject is viewed. be able to.

  In each of the embodiments described above, the frame image acquired at the time of inputting the still image shooting instruction TS is recorded on the recording medium 10 as still image data. However, the first predetermined time which is the time before and after the TS is used. One frame image may be selected by best shot selection from the frame images acquired at the time and the second predetermined time, and may be recorded on the recording medium 10 as still image data. Here, in the best shot select, for example, each frame image is evaluated based on the hand shake degree, the smile degree, and the like, and the frame image having the highest evaluation value is selected as still image data to be recorded on the recording medium 10.

  In each of the above-described embodiments, the frame image having the number of pixels of the QFHD (3840 × 2160 pixels) standard is stored in the buffer memory 8, but the full HD (Full High Definition: 1920 × 1080 pixels) is used. The buffer memory 8 may be configured to store a frame image having a pixel number equal to or greater than the full HD standard, such as a frame image having a standard pixel number. In this case, only the still image data may be stored in the buffer memory 8 as the QFHD standard based on the still image shooting instruction.

  In the above-described embodiment, the first video effect is a video effect that performs blurring processing on an image excluding the main subject, and the second video effect is a video effect that performs zoom-in processing on the main subject. Selected, but as the first video effect, blur processing, zoom-in processing, select color processing that leaves only the color of the main subject and other parts are monochrome images, and blackouts the other portions leaving only the color of the main subject Other than the process selected as the first video effect, the blackout process selects one of the whiteout processes that leaves only the color of the main subject and whites out the other parts. One process may be selected.

  Further, in the above-described embodiment, the main subject in the through image is focused by the first touch of the touch panel 14 and the capturing of the frame image is started. However, when the first touch of the touch panel 14 is detected In addition, focusing on the touch position may be performed to start capturing the frame image.

  In addition, in the electronic camera according to the above-described embodiment, after the main subject is specified by touching the touch panel 14, frame image capture is started by half-pressing the release button, and still image shooting is performed by fully pressing the release button. After that, the frame image capturing may be terminated after a predetermined time has elapsed. In this case, the frame image may be captured by tracking the main subject. In these cases, different video effects focusing on the main subject are given to the slow motion moving image based on the size of the area occupied by the main subject on the display screen specified by touching the touch panel 14.

DESCRIPTION OF SYMBOLS 2 ... Electronic camera, 4 ... Control part, 5 ... Video signal processing circuit, 5a ... Through image generation part, 5b ... Moving image generation part, 5c ... Still image generation part, 6 ... Imaging device, 8 ... Buffer memory, 10 ... Recording medium, 12 ... display unit, 14 ... operation unit

Claims (6)

An image sensor for imaging subject light;
A display unit that displays a through image based on an imaging signal from the imaging element;
A storage unit that sequentially stores a plurality of frame images based on imaging signals from the imaging element, and stores a still image corresponding to any of the plurality of frame images;
Based on the plurality of frame images stored in the storage unit, a slow motion video that is played back at a second frame rate less than a first frame rate indicating the number of frame images stored in the storage unit per unit time A moving image generation unit for generating an image;
A touch panel for detecting a touch position on the display unit;
A main subject recognition unit for recognizing a main subject based on detection of touch on the touch panel;
An image processing unit that applies different video effects to the slow motion video based on a ratio of an area of the main subject recognized by the main subject recognition unit to a screen size of the display unit;
An imaging apparatus comprising:   The image pickup apparatus according to claim 1, wherein the image effect is any one of zooming of an image, blurring of an image, color selection, blackout, and whiteout.   The imaging apparatus according to claim 1, wherein the main subject recognition unit recognizes the main subject based on a touch position on the touch panel.   The imaging apparatus according to claim 1, wherein the main subject recognition unit performs face recognition processing based on a touch on the touch panel.   The storage unit stores a still image focused on the main subject recognized by the main subject recognition unit when a touch by the touch panel is detected while sequentially storing the plurality of frame images. The imaging apparatus according to any one of claims 1 to 4, wherein   The storage unit stores the plurality of frame images focused on the touch positions detected by the touch panel when sequentially storing the plurality of frame images by touch detection by the touch panel. The imaging device according to any one of claims 1 to 5, wherein the imaging device is characterized.

Images