JP2013172238A - Imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus capable of recording high speed moving image data and normal speed moving image data independently.SOLUTION: An imaging apparatus 2 includes an imager 6 for imaging light of a subject, and a reading control part 4 for reading an image signal composing a frame image from the imager at a first frame rate or at a second frame rate which is greater than the first frame rate. The imaging apparatus 2 captures a high speed moving image by reading an image signal composing a frame image at the second frame rate, if the high speed image capturing is directed while a normal speed moving image is being captured by reading the image signal composing the frame image at the first frame rate from the imager by the reading control part 4. A recording control part 4 is provided for recording moving image data of the normal speed moving image, and moving image data of the high speed moving image, as separate moving image data on a moving image data recording part 10.

Description

  The present invention relates to an imaging apparatus capable of recording a moving image.

  There is known a recording apparatus that generates a normal moving image at a normal frame rate by performing frame thinning out from a high-speed moving image captured at a high frame rate (see, for example, Patent Document 1). This recording device generates moving image data that combines high-speed video and normal video so that high-speed video is displayed on the main screen, which is a normal size screen, and normal video is displayed on the small screen displayed in the main screen. A moving image based on the moving image data is reproduced by a so-called picture-in-picture method.

JP 2010-193063 A

  However, in the conventional imaging device including the recording device described in Patent Document 1 described above, since the moving image data in which the high-speed moving image and the normal moving image are combined is generated, the high-speed moving image data and the normal moving image data are independent. Could not be recorded.

  An object of the present invention is to provide an imaging apparatus capable of recording high-speed moving image data and normal moving image data independently.

  The present invention solves the above problems by the following means. In addition, in order to make an understanding easy, it attaches | subjects and demonstrates the code | symbol corresponding to embodiment of this invention, but this invention is not limited to this.

  An image pickup apparatus according to the present invention includes an image pickup element (6) for picking up light from a subject, and an image pickup signal constituting a frame image from the image pickup element (6) at a first frame rate or higher than the first frame rate. A readout control unit (4) that reads out at two frame rates, and the readout control unit (4) reads out imaging signals constituting the frame image at the first frame rate from the imaging device (6) to shoot a normal moving image. When a high-speed moving image is instructed during reading, the reading control unit (4) reads out an image pickup signal constituting the frame image from the image pickup device (6) at the second frame rate and performs high-speed operation. In the imaging device (2) for shooting a moving image, the moving image data of the normal moving image and the moving image data of the high-speed moving image are used as different moving image data. Characterized in that it comprises over data recording section recording control unit for recording (10) (4).

  According to the imaging apparatus of the present invention, high-speed moving image data and normal moving image data can be recorded independently.

It is a block diagram which shows the system configuration | structure of the electronic camera which concerns on embodiment. It is a flowchart which shows the process at the time of imaging | photography the normal moving image and high-speed moving image of the electronic camera which concerns on embodiment. It is a figure which shows the read-out mode at the time of normal video and high-speed video recording of the electronic camera which concerns on embodiment. It is a figure which shows the file structure of the normal moving image data and high-speed moving image data which are recorded by the electronic camera which concerns on embodiment. It is a figure which shows the display in a display part at the time of reproducing | regenerating a normal moving image in the electronic camera which concerns on embodiment. It is a figure which shows the display in a display part at the time of reproducing a high-speed moving image in the electronic camera which concerns on embodiment.

  Hereinafter, an electronic camera as an imaging apparatus according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a system configuration of an electronic camera 2 according to the embodiment. As illustrated in FIG. 1, the electronic camera 2 includes a microprocessor and the like, and includes a control unit 4 that comprehensively controls each unit of the electronic camera 2. The control unit 4 includes a video signal processing circuit 5. The video signal processing circuit 5 generates a through image generation unit 5a that generates through image data of a through image displayed on the display unit 12 described later, and generates moving image data. And a still image generation unit 5c for generating still image data. The control unit 4 is connected to an image sensor 6, a buffer memory 8, a high-speed moving image buffer memory 9, a recording medium 10, a display unit 12, an operation unit 14, and a memory 16.

  The image sensor 6 is configured by a CCD, a CMOS, or the like, and images light from a subject through a photographing lens (not shown) and outputs an image signal. The buffer memory 8 and the high-speed moving image buffer memory 9 temporarily store image data based on an imaging signal output from the imaging device 6 and converted from an analog signal to a digital signal through an A / D converter (not shown). To do.

  Here, the buffer memory 8 is synchronized with a moving image cycle (30 fps or the like) from the image sensor 6 when the electronic camera 2 is set to a moving image shooting mode for shooting a moving image to be described later, for example. A plurality of image data based on the read image signal, that is, a plurality of frame images constituting a normal moving image with a normal frame rate, are sequentially stored in time series.

  In addition, the high-speed moving image buffer memory 9 receives a moving image from the image sensor 6 when the electronic camera 2 is set to, for example, a moving image shooting mode described below and a high-speed moving image shooting instruction is issued. A plurality of high-speed moving image data based on image signals read out in synchronization with a cycle (60 fps, 300 fps, etc.), that is, a plurality of frame images constituting a high-speed moving image having a higher frame rate than the normal frame rate Are sequentially stored in time series.

  The recording medium 10 is a portable recording medium that is detachably mounted in a card slot (not shown) provided in the electronic camera 2, and for example, a CF card, an SD card, smart media, or the like is used. In the recording medium 10, each of the frame images stored in the buffer memory 8 and the high-speed moving image buffer memory 9 is resized to a moving image resolution by the moving image generation unit 5 b in the control unit 4 (from a large resolution). Small), normal moving image data and high-speed moving image data created by performing image processing for moving images and compression processing for moving images are recorded. Further, the recording medium 10 is created by subjecting the frame image stored in the buffer memory 8 to image processing for still images and compression processing for still images by the still image generating unit 5c in the control unit 4. Still image data, information related to shooting, and the like are recorded.

  The display unit 12 is configured by a monitor configured by an LCD or the like disposed on the back surface of the electronic camera 2, EVF, or the like. The display unit 12 includes a through image generated by the through image generation unit 5a, a normal moving image based on normal moving image data recorded on the recording medium 10, a high speed moving image based on high speed moving image data, and a still image based on still image data. An image, information about photographing, and the like are displayed.

  The operation unit 14 displays a shooting mode such as a power switch for turning on / off the power of the electronic camera 2, a moving image shooting mode for shooting a moving image, a still image shooting mode for shooting a still image, and a moving image or a still image. Command dial for setting the playback mode to be displayed on the screen, a release button for instructing the start of still image shooting, the start of high-speed moving image shooting, the start of normal moving image shooting and the end of normal moving image shooting, etc. Video button, menu button for displaying a menu etc. on the display unit 12, selection of menu items, etc., cross key operated at various settings, selection of menu items, etc. and confirmation operation for various settings OK button, normal moving image based on normal moving image data recorded on the recording medium 10, high-speed moving image based on high-speed moving image data, still image data It is configured to include a play button or the like for displaying a still image based on the display unit 12. The memory 16 temporarily stores information regarding the shooting time of the high-speed moving image, normal moving image data before being recorded on the recording medium 10, still image data, and the like.

  Hereinafter, with reference to the flowchart shown in FIG. 2, a normal moving image and high-speed moving image shooting process executed in the control unit 4 of the electronic camera 2 according to this embodiment will be described.

  First, after the user sets the moving image shooting mode by operating the command dial, when the user presses the moving image shooting button to give an instruction to start shooting a normal moving image, the control unit 4 shoots the normal moving image. Start.

  Here, in normal moving image shooting, the control unit 4 stores the frame images in the buffer memory 8 sequentially in time series with the reading mode of the image sensor 6 set to the normal mode (30 fps or the like). Further, the frame image stored in the buffer memory 8 is sequentially read from the previously stored frame image, and the moving image generation unit 5b performs the moving image generation process to generate normal moving image data. Let me record. In this embodiment, the buffer memory 8 has a frame image having the number of pixels of the QFHD (Quad Full High Definition: 3840 × 2160 pixels) or full high definition (Full High Definition: 1920 × 1080 pixels) standard, that is, a high image quality. Resolution frame images are stored sequentially.

  Next, the control unit 4 determines whether or not the release button has been fully pressed by the user during normal movie shooting (step S11). If it is determined in step S11 that the full-press operation has been performed, the process proceeds to step S12. Otherwise, the process proceeds to step S19. If it is determined in step S11 that the release button has been fully pressed (step S11, Yes), the control unit 4 stores in the memory 16 the time s from the start of normal movie shooting to the start of high-speed movie shooting (step S11). Step S12). Further, the control unit 4 switches the reading mode of the image sensor 6 from the normal mode (30 fps or the like) to the high speed mode (60 fps or 300 fps or the like) (step S13). Here, as the high-speed mode, the first high-speed mode such as 60 fps or the second high-speed mode such as 300 fps can be selected, and the first high-speed mode or the second high-speed mode can be selected by menu operation using the menu button and the cross key. It is good also as a structure which can be preset to.

  In this embodiment, frame images having the number of pixels of the full high-definition standard are sequentially stored in the high-speed moving image buffer memory 9 in the first high-speed mode such as 60 fps, and 1080 × in the second high-speed mode such as 300 fps. Frame images having a pixel number of 720 pixels or VGA (640 × 480 pixels) standard are sequentially stored.

  Then, the control unit 4 starts buffering the frame image in the high-speed moving image buffer memory 9 (step S14). That is, high-speed moving image shooting is started. When buffering to the high-speed moving image buffer memory 9 is being performed, high-speed moving image data creation processing based on the frame image stored in the high-speed moving image buffer memory 9 is not performed. This process is performed after the end of normal movie shooting, as will be described later.

  When the predetermined time n has elapsed since the buffering to the high speed moving image buffer memory 9 is started, the control unit 4 ends the buffering of the frame image to the high speed moving image buffer memory 9 (step S15). That is, the high-speed moving image shooting is finished. The predetermined time n may be a default value (seconds) or may be a value (seconds) set by the user performing a menu operation using a menu button and a cross key. Furthermore, the control unit 4 stores in the memory 16 a time f from the start of normal movie shooting to the end of high-speed movie shooting (step S16).

  When the buffering to the high-speed moving image buffer memory 9 is completed, the control unit 4 switches the reading mode of the image sensor 6 from the high-speed mode to the normal mode (step S17). Then, the control unit 4 resumes the buffering of the frame image to the buffer memory 8 (Step S18). That is, normal movie shooting is resumed. At this time, the frame images stored in the buffer memory 8 are sequentially read out as in the above-described shooting of the normal moving image, the normal moving image data is generated by the moving image generation unit 5b, and is recorded on the recording medium 10.

  Next, the control unit 4 determines whether or not the moving image shooting button has been pressed (step S19). If it is determined in step S19 that the moving image shooting button has been pressed, the process proceeds to step S20. If not, the process returns to step S11 to determine whether or not the release button has been fully pressed.

  If it is determined in step S19 that the moving image shooting button has been pressed (step S19, Yes), the control unit 4 ends the buffering of the frame image in the buffer memory 8 (step S20). That is, the control unit 4 ends the normal moving image shooting.

  FIG. 3 is a diagram showing transition of the reading mode of the image sensor 6 during moving image shooting from the start of this flowchart to the processing in step S20. FIG. 3 shows that during the shooting of a normal movie in the normal mode of 30 fps, when the time s has elapsed since the start of shooting of the normal movie, the release button shown in step S11 of FIG. 2 is fully pressed, and in step S13, the control unit 4 indicates that the readout mode of the image sensor 6 is switched to the second high-speed mode of 300 fps. Further, when the time f has elapsed since the start of normal movie shooting (when the predetermined time n has elapsed since the start of shooting of the high-speed movie), the control unit 4 performs shooting of the high-speed movie by performing the process shown in step S15 of FIG. In step S17, the readout mode of the image sensor 6 is switched to the normal mode of 30 fps. Then, until the time p elapses from the end of shooting of the high-speed moving image (until the end of shooting of the normal moving image shown in step S20 in FIG. 2), the normal moving image is further shot. Note that “1 / 10-times slow motion video” in FIG. 3 indicates the playback speed at the time of playback, and will be described in the playback process described later.

  When shooting of the normal moving image is completed, the control unit 4 sequentially reads out the frame images stored in the high-speed moving image buffer memory 9, and generates moving image data by the moving image generation unit 5b, thereby creating high-speed moving image data. Then, it is recorded on the recording medium 10 (step S21). Here, the high-speed moving image data is recorded in the same file as the file in which the above-described normal moving image data is recorded. For example, as illustrated in FIG. 4, the control unit 4 stores and records the normal moving image data 20 and the high-speed moving image data 22 in one moving image file 18. In the moving image file 18 shown in FIG. 4, when the release button full-press operation (step S11, Yes) in the flowchart shown in FIG. 2 is performed four times, the processing shown in steps S11 to S19 is repeated four times. A state in which two high-speed moving image data 20a to 20d are recorded is shown. In addition, the metadata 24 of the moving image file 18 includes each high-speed moving image shooting start time s (elapsed time s from the start of normal moving image shooting) based on the normal moving image shooting start stored in the memory 16, Shooting information such as the shooting end time f (elapsed time f from the start of normal moving image shooting) is recorded. Instead of the configuration in which normal moving image data and high-speed moving image data are recorded in one moving image file, link information (the above-described shooting start time s and shooting end time f is associated with normal moving image data of a normal moving image). Or the like) may be added to the normal moving image data and the high-speed moving image data, and the normal moving image data and the high-speed moving image data may be recorded on the recording medium 10 as separate files.

  Note that when a shooting end instruction is issued by pressing the moving image shooting button during shooting of a high-speed moving image, such as during the processing of steps S12 to S15 in the flowchart shown in FIG. The high-speed moving image data creation and recording process shown in step S19 is performed.

  Next, a normal moving image based on normal moving image data recorded on the recording medium 10 and a high-speed moving image reproduction process based on high-speed moving image data will be described.

  First, when the user operates the command dial to set a playback mode, the control unit 4 plays back a normal moving image based on normal moving image data recorded on the recording medium 10 and a high-speed moving image based on high-speed moving image data. Switch to playback mode. Then, it is determined whether or not the user has operated the playback button in order to issue a normal moving image playback instruction.

  When an instruction to reproduce a normal moving image is issued, the control unit 4 stores the normal moving image data of the normal moving image instructed to reproduce in the memory 16. Further, the high-speed moving image data associated with the normal moving image data is stored in the memory 16. For example, as shown in FIG. 4, when one normal moving image data 20 and four high-speed moving image data 22 a to 22 d are stored in one moving image file 18, the control unit 4 controls the normal moving image data 20. And four high-speed moving image data 22a to 22d are stored in the memory 16, and further include metadata including shooting information such as shooting start time s and shooting end time f of each high-speed moving image with reference to the start of shooting of the normal moving image. 24 is stored in the memory 16.

  Next, the control unit 4 causes the display unit 12 to display a normal moving image based on the normal moving image data at a normal frame rate (30 fps or the like). The control unit 4 refers to the high-speed moving image recording start time s during the normal moving image reproduction. When the normal moving image reproduction position approaches the position where the high-speed moving image is captured, the high-speed moving image exists as shown in FIG. An icon 30 indicating that the image is to be displayed is displayed. That is, the icon 30 is superimposed and displayed on the normal moving image 32 displayed on the display unit 12 a predetermined time before the shooting start time s, such as immediately before the shooting start time s of the high-speed moving image elapses.

  While the icon 30 is displayed on the display unit 12, the control unit 4 determines whether or not the user has issued a high-speed moving image reproduction instruction by operating the OK button.

  When an instruction to reproduce a high-speed moving image is given, the control unit 4 causes the display unit 12 to display the high-speed moving image 34 based on the high-speed moving image data at a normal frame rate (30 fps or the like) as shown in FIG. Here, as described above, the high-speed moving image is shot in the first high-speed mode such as 60 fps or the second high-speed mode such as 300 fps. Therefore, when playing back at a normal frame rate such as 30 fps, it is played back as a slow motion video. For example, as shown in FIG. 3, when a high-speed moving image shot at 300 fps is reproduced at 30 fps, it is reproduced as a slow motion moving image at 1/10 times speed.

  FIG. 6 shows a case where a high-speed moving image shot in the second high-speed mode such as 300 fps is displayed on the display unit 12. As described above, a normal moving image is composed of a frame image having the number of pixels of QFHD or full high-definition standards, and a high-speed moving image shot in the second high-speed mode such as 300 fps has a number of pixels of 1080 × 720 pixels or VGA standards. Consists of frame images. Therefore, as shown in FIGS. 5 and 6, the size of the moving image displayed on the display unit 12 is a high-speed moving image 34 (see FIG. 6) captured in the second high-speed mode than the normal moving image 32 (see FIG. 5). Is smaller.

  When a high-speed moving image is instructed to be reproduced, when the high-speed moving image based on the high-speed moving image data is reproduced, the control unit 4 reproduces the normal moving image captured after the high-speed moving image is captured. That is, when the normal moving image and the high-speed moving image for which the reproduction instruction has been issued are taken as shown in FIG. 3, the normal moving image is reproduced for the time s from the reproduction start. Next, a slow motion moving image based on the high-speed moving image data is reproduced for a time 10 times the predetermined time n from the time s, that is, 10 × n. When the reproduction of the slow motion moving image based on the high-speed moving image is completed, the normal moving image is reproduced for the time p as shown in FIG.

  On the other hand, when the instruction to reproduce the high-speed moving image is not given, the control unit 4 continues to reproduce the normal moving image. Here, since there is no normal moving image for a predetermined time n from the shooting start time s to the shooting end time f of the high-speed moving image, the control unit 4 displays a complementary image. The control unit 4 may display the normal moving image frame image immediately before the start of high-speed moving image shooting as a complementary image on the display unit 12 for a predetermined time n, or the normal moving image frame image immediately after the high-speed moving image shooting end. You may display on the display part 12 for the predetermined time n.

  Further, the control unit 4 may switch and display a predetermined number of frame images during the predetermined time n as the complementary image. For example, in the first half of the predetermined time n, a normal moving image frame image immediately before the start of high-speed moving image shooting may be displayed, and in the second half of the predetermined time n, a normal moving image frame image immediately after the high-speed moving image shooting may be displayed. . In addition, two to three frame images taken immediately before the start of high-speed moving image shooting may be sequentially switched and displayed in a time-series order during a predetermined time n, or 2 shot immediately after the high-speed moving image shooting ends. Up to three frame images may be switched and displayed in chronological order during a predetermined time n.

  Furthermore, the control unit 4 may display a normal moving image on the display unit 12 for a predetermined time n at a normal frame rate such as 30 fps by creating a normal moving image based on a high-speed moving image in advance as a complementary image. Here, when a normal moving image based on a high-speed moving image is generated in advance, the control unit 4 performs normal moving image data generation processing based on the high-speed moving image data after the processing shown in the flowchart of FIG. 2 is completed. . That is, the control unit 4 reads the high-speed moving image data recorded on the recording medium 10 and creates a moving image with a normal frame rate such as 30 fps by thinning out the frame images based on the high-speed moving image data. The control unit 4 further records the normal moving image data created based on the high-speed moving image data on the recording medium 10.

  Further, as shown in FIG. 4, when a plurality of high-speed moving image data such as high-speed moving image data 22a to 22d is stored in one moving image file 18, the control unit 4 adds each high-speed moving image data to each high-speed moving image data. The icon 30 is displayed about the high-speed moving image based on it. That is, the icon 30 for the high-speed moving image is displayed at the playback position where the high-speed moving image exists. For example, an icon 30 indicating that there is a high-speed moving image based on the high-speed moving image data 22b is displayed at a playback position where a high-speed moving image based on the high-speed moving image data 22b exists, and there exists a high-speed moving image based on the high-speed moving image data 22c. An icon 30 indicating that there is a high-speed moving image based on the high-speed moving image data 22c is displayed at the playback position. When the user operates the OK button while the icon 30 is displayed, high-speed moving image playback based on the corresponding high-speed moving image data is performed in the same manner as described above.

  According to the electronic camera of this embodiment, high-speed moving image data and normal moving image data can be recorded independently. In addition, since recording is performed independently, only one of the high-speed moving image and the normal moving image can be displayed on the display unit during reproduction.

  In the above-described embodiment, the high-speed moving image frame image is stored in the high-speed moving image buffer memory 9 and the normal moving image frame image is stored in the buffer memory 8. However, the buffer memory 8 stores the frame image. The buffer memory 8 is divided, the normal moving image frame image is stored in the first area, and the high speed moving image frame image is stored in the second area. Also good.

  In the above-described embodiment, the moving image generation unit 5b may include two moving image generation units, a normal moving image generation unit and a high-speed moving image generation unit. In this case, at the time of shooting a normal moving image, the control unit 4 sequentially reads frame images stored in the buffer memory 8, creates normal moving image data by the normal moving image generation unit, and records them on the recording medium 10. Further, at the time of shooting a high-speed moving image, the control unit 4 sequentially reads frame images stored in the high-speed moving image buffer memory 9, creates normal moving image data by the high-speed moving image generation unit, and records the normal moving image data on the recording medium 10.

  DESCRIPTION OF SYMBOLS 2 ... Electronic camera, 4 ... Control part, 5 ... Video signal processing circuit, 5b ... Moving image production | generation part, 6 ... Image sensor, 8 ... Buffer memory, 9 ... Buffer memory for high-speed moving images, 10 ... Recording medium, 12 ... Display 14, operation unit

Claims (6)

An image sensor for imaging light from a subject;
A readout control unit that reads out an imaging signal constituting a frame image from the imaging element at a first frame rate or a second frame rate larger than the first frame rate;
The readout control unit reads out an imaging signal constituting the frame image at the first frame rate from the imaging device and performs shooting of a normal moving image. In an imaging apparatus for reading a high-speed moving image by reading out an imaging signal constituting the frame image from the imaging element at the second frame rate by the control unit,
An image pickup apparatus comprising: a recording control unit that causes the moving image data recording unit to record the moving image data of the normal moving image and the moving image data of the high-speed moving image as different moving image data.   The imaging apparatus according to claim 1, further comprising a position information recording control unit that records position information of the high-speed moving image recorded in the position information recording unit during shooting of the normal moving image.   The recording control unit and the position information recording control unit record the moving image data of the normal moving image, the moving image data of the high-speed moving image, and the position information in one moving image file. Imaging device. A playback unit for playing back the moving image data of the normal moving image and the moving image data of the high-speed moving image recorded in the moving image data recording unit;
An instruction unit for instructing reproduction of moving image data of the high-speed moving image during reproduction of moving image data of the normal moving image;
While reproducing the moving image data of the normal moving image by the reproducing unit, a high speed indicating that the position where the moving image data of the high speed moving image is approaching is based on the position information recorded in the position information recording unit A display control unit for displaying video information,
While the display control unit displays the high-speed moving image information, the high-speed moving image data is reproduced based on the position information when the instruction unit instructs to reproduce the moving image data of the high-speed moving image. When the instruction unit does not instruct the reproduction of the moving image data of the high-speed moving image, the complementary image data of the complementary image is reproduced based on the position information, and the moving image data of the high-speed moving image or the complement The imaging apparatus according to any one of claims 1 to 3, wherein the reproduction of the moving image data of the normal moving image is resumed after the reproduction of the complementary image data of the image is completed.   5. The complementary image data is at least one still image data created based on moving image data of the normal moving image that is reproduced either before or after the complementary image. The imaging device described.   5. The imaging apparatus according to claim 4, wherein the complementary image data is moving image data created based on the moving image data of the high-speed moving image.

Images