JP2013162425A - Imaging apparatus, imaging method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus, an imaging method, and a program capable of photographing more variety of moving images using images photographed at different field angles.SOLUTION: An imaging apparatus 1 capable of photographing a first image and a second image different in field angle and/or photographing position comprises a recording controller 274 which performs control to respectively record first moving image data and second moving image data obtained by photographing the first image and the second image consecutively in terms of time. In a case of recording the second image intermittently, the recording controller 274 interpolates each period in which the second image is not recorded, with another image.

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program for imaging a subject and generating image data of the subject.

  In recent years, there has been known a technique capable of combining and recording two image data generated by imaging a subject at two different angles of view in an imaging apparatus such as a digital camera (see, for example, Patent Document 1). ). In this technique, image data for one screen is recorded by generating a composite image by combining an image captured on the telephoto side with an image captured on the wide-angle side.

JP 2010-268019 A

  By the way, the above-described conventional technique only combines images taken at two different angles of view, and does not store them as separate images. For this reason, for example, when shooting a movie, it is not possible to play back images with different angles of view separately or while changing the angle of view in the middle. could not.

  The present invention has been made in view of the above, and provides an imaging apparatus, an imaging method, and a program capable of capturing a more varied moving image using images captured at different angles of view. With the goal.

  In order to solve the above-described problems and achieve the object, an imaging apparatus according to the present invention is an imaging apparatus capable of shooting a first image and a second image having different angles of view and / or shooting positions. A recording control unit that performs control to record the first moving image data and the second moving image data obtained by continuously capturing one image and the second image in time, and the recording control unit includes the first moving image data and the second moving image data. When two images are recorded intermittently, the period during which the second image is not recorded is interpolated with another image.

  The imaging apparatus according to the present invention further includes an imaging unit that images a subject and continuously generates image data of the subject in the above invention, and the second image is the image generated by the imaging unit. The photographed image corresponding to the data is cut out at a different angle of view and / or photographing position from the photographed image.

  In the imaging device according to the present invention as set forth in the invention described above, the other image is the first image.

  The imaging apparatus according to the present invention is the imaging apparatus according to the above invention, wherein the imaging unit generates a first moving image data by sequentially performing image processing on the captured image generated by the imaging unit. A second image processing unit that performs image processing for sequentially cutting out a region having a different angle of view from the captured image, and generating the second moving image data; and recording the first moving image data and the second moving image data And the recording control unit records the first moving image data and the second moving image data in the recording unit so that the first moving image data and the second moving image data can be reproduced in synchronization with each other.

  In the image pickup apparatus according to the present invention, in the above invention, a first moving image shooting operation unit that receives input of a moving image start signal instructing the start of moving image shooting and a moving image end signal instructing the end of moving image shooting; A second moving image photographing operation unit that accepts an input of a start signal for instructing the start of photographing of two images and an end signal for instructing the end of photographing of the second image; and the second image processing unit cuts out from the photographed image An area setting unit for setting an area, and when the start signal is input from the second moving image shooting operation unit, the recording setting unit sets the area setting unit in the second image processing unit. The region to be set is set to a region corresponding to the second image, and when the end signal is input from the second moving image shooting operation unit, the region setting unit sets the second image processing unit. And sets the frequency in a region corresponding to the first image.

  The imaging device according to the present invention is the above-described invention, wherein the imaging unit according to the present invention is provided on the display unit capable of displaying the captured image and the display screen of the display unit, detects the touch of an object from the outside, and detects the touch position A touch panel that outputs a position signal corresponding to the position signal, and the region setting unit is configured to cause the second image processing unit to display a region of the captured image corresponding to the position corresponding to the position signal input from the touch panel. It is set to the area cut out from the photographed image.

  The imaging apparatus according to the present invention may further include a display control unit that causes the display unit to display end information indicating the end of shooting of the second image in a state where the second image is shot. The end signal is the position signal of the area corresponding to the end information from the touch panel, and the start signal is the position signal other than the area corresponding to the end information input from the touch panel. It is characterized by.

  In the imaging device according to the present invention, in the above invention, a feature determination unit that determines a feature of a subject included in an area including a position corresponding to a position signal input from the touch panel, and the feature determination unit determine A tracking setting unit configured to set a subject to be tracked in the adjacent captured image based on the determination result, wherein the region setting unit includes a region including the subject set by the tracking setting unit as the first setting. The two-image processing unit is set to an area cut out from the captured image.

  In the imaging device according to the present invention, in the above invention, the recording control unit may detect a touch position at which the touch panel detects a touch of an object from the outside and / or the second moving image data and / or the second moving image data. Touch information including time information when a touch is detected is associated and recorded in the recording unit.

  In the imaging device according to the present invention, the second image has a smaller angle of view than the first image.

  In the imaging device according to the present invention, in the above invention, when the display control unit displays the first moving image data and the second moving image data recorded in the recording unit on the display unit, The moving image data and the second moving image data are displayed in synchronization on the display unit.

  In the imaging device according to the present invention as set forth in the invention described above, the display control unit superimposes the second image reduced in a predetermined display area on the first image and causes the display unit to display the image. And

  In the imaging device according to the present invention as set forth in the invention described above, the display control unit switches display areas of the first image and the second image with an expression effect based on the touch information. And

  In the imaging device according to the aspect of the invention, in the invention described above, the display control unit may express the effect of gradually switching display areas of the first image and the second image, or the second image may be changed to the first image. An expression effect of gradually switching the composition ratio for synthesizing the images is performed and displayed on the display unit.

  An imaging method according to the present invention is an imaging method executed by an imaging apparatus capable of capturing a first image and a second image having different angles of view and / or imaging positions, wherein the first image and the second image Including a recording control step for controlling the recording of each of the first moving image data and the second moving image data obtained by continuously shooting the image, wherein the recording control step records the second image intermittently. In this case, the period during which the second image is not recorded is interpolated with another image.

  The program according to the present invention is a program for causing an imaging device capable of capturing a first image and a second image having different angles of view and / or photographing positions to execute the first image and the second image over time. Including a recording control step for controlling the recording of the first moving image data and the second moving image data obtained by continuous continuous shooting, wherein the recording control step records the second image intermittently. The period during which the second image is not recorded is interpolated with another image.

  According to the present invention, there is an effect that it is possible to reproduce a moving image with more changes using images taken at different angles of view.

FIG. 1 is a block diagram showing a configuration of an imaging apparatus according to an embodiment of the present invention. FIG. 2 is a diagram for explaining the outline of the multi-recording process executed by the imaging apparatus according to the embodiment of the present invention. FIG. 3 is a flowchart showing an outline of processing executed by the imaging apparatus according to the embodiment of the present invention. FIG. 4 is a flowchart showing an outline of the imaging control process executed by the imaging apparatus according to the embodiment of the present invention. FIG. 5 is a flowchart showing an outline of the second moving image candidate frame display process executed by the imaging apparatus according to the embodiment of the present invention. FIG. 6 is a flowchart showing an outline of the reproduction display process executed by the imaging apparatus according to the embodiment of the present invention. FIG. 7 is a diagram schematically illustrating moving image transition when manually switching multi-frame moving images executed by the imaging apparatus according to the embodiment of the present invention. FIG. 8 is a diagram schematically showing moving image transition when a multi-frame moving image is automatically switched by the imaging apparatus according to the embodiment of the present invention. FIG. 9 is a diagram schematically illustrating moving image transition when the multi-frame moving image is automatically switched by the imaging apparatus according to the embodiment of the present invention. FIG. 10 is a diagram schematically illustrating another moving image transition when the multi-frame moving image is automatically switched by the imaging apparatus according to the embodiment of the present invention. FIG. 11 is a diagram schematically illustrating an outline of another multi-recording process executed by the imaging apparatus according to the embodiment of the present invention. FIG. 12 is a diagram schematically illustrating an outline of another multi-recording process executed by the imaging apparatus according to the embodiment of the present invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, modes for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. Note that the present invention is not limited to the embodiments. In the description of the drawings, the same portions are denoted by the same reference numerals for description.

  FIG. 1 is a block diagram showing a configuration of an imaging apparatus according to an embodiment of the present invention. An imaging apparatus 1 illustrated in FIG. 1 includes a lens unit 2, a lens driving unit 3, a diaphragm 4, a diaphragm driving unit 5, a shutter 6, a shutter driving unit 7, an imaging element 8, and an imaging element driving unit 9. A signal processing unit 10, an A / D conversion unit 11, a first image processing unit 12, a feature determination unit 13, a tracking setting unit 14, a second image processing unit 15, an AE processing unit 16, AF processing unit 17, image compression / decompression unit 18, input unit 19, display unit 20, display drive unit 21, recording medium 22, memory I / F 23, SDRAM 24, flash memory 25, and bus 26 And a control unit 27. Data transfer within the imaging apparatus 1 is performed via the bus 26.

  The lens unit 2 is configured using one or a plurality of lenses. The lens unit 2 collects light from a predetermined visual field region. The lens unit 2 has an optical zoom function that changes the angle of view and a focus function that changes the focus. The lens driving unit 3 is configured using a DC motor, a stepping motor, or the like, and moves the lens of the lens unit 2 on the optical axis L in accordance with an instruction signal input from the control unit 27, thereby Change the focus position and angle of view.

  The diaphragm 4 adjusts the exposure by limiting the amount of incident light collected by the lens unit 2. The aperture driving unit 5 is configured by using a stepping motor or the like, and drives the aperture 4 according to an instruction signal input from the control unit 27.

  The shutter 6 sets the state of the image sensor 8 to an exposure state or a light shielding state. The shutter driving unit 7 is configured using a stepping motor or the like, and drives the shutter 6 in accordance with an instruction signal input from the control unit 27.

  The imaging element 8 is configured using a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) that receives the light collected by the lens unit 2 and converts it into an electrical signal. The image sensor driving unit 9 causes the signal processing unit 10 to continuously output image data (analog signal) from the image sensor 8 at a predetermined timing. In this sense, the image sensor driving unit 9 functions as an electronic shutter. In the present embodiment, the image sensor 8 and the image sensor drive unit 9 function as an image capturing unit.

  The signal processing unit 10 performs analog processing on the analog signal input from the image sensor 8 and outputs the analog signal to the A / D conversion unit 11. Specifically, the signal processing unit 10 performs noise reduction processing, gain increase processing, and the like on the image data. For example, the signal processing unit 10 performs waveform shaping on the analog signal after reducing reset noise and the like, and further increases the gain so that the target brightness is obtained.

  The A / D conversion unit 11 performs A / D conversion on the analog signal input from the signal processing unit 10 to generate digital image data (captured image) and outputs the digital image data to the SDRAM 24 via the bus 26. .

  The first image processing unit 12 is configured using an image engine (image controller). The first image processing unit 12 acquires image data from the SDRAM 24 via the bus 26, performs various image processing on the acquired image data (RAW data), and performs first processing image data (first image data). Is generated. Specifically, the first image processing unit 12 performs at least optical black subtraction processing, white balance (WB) adjustment processing on the image data, and image data synchronization processing when the image sensor is a Bayer array, Image processing including color matrix calculation processing, gamma correction processing, resizing processing, trimming processing, color reproduction processing, edge enhancement processing, and the like is performed. The first processed image data subjected to the image processing by the first image processing unit 12 is output to the SDRAM 24 and the feature determination unit 13 via the bus 26, respectively. The first image processing unit 12 sequentially acquires image data continuously generated by the image sensor 8 from the SDRAM 24 via the bus 26, performs image processing on the captured image corresponding to the acquired image data, and performs first processing. First processing image data constituting the moving image data is sequentially generated.

  Based on the first processed image data input from the first image processing unit 12, the feature determination unit 13 determines the characteristics of the main subject included in the processed image corresponding to the first processed image data. Specifically, the feature determination unit 13 is designated by the processed image corresponding to the first processed image data based on an instruction signal input from the input unit 19 described later or an instruction signal input from the control unit 27. The feature points of the main subject included in the target area are determined, and the determination result is output to the tracking setting unit 14. Here, the feature points are brightness and contrast. Note that the feature determination unit 13 may determine a feature point using a color histogram of the target region.

  The tracking setting unit 14 sets the main subject as a tracking subject to be tracked based on the feature point input from the feature determination unit 13 and the processed image corresponding to the processed image data recorded in the SDRAM 24. Specifically, the tracking setting unit 14 sequentially acquires first processed image data that is temporally continuous from the SDRAM 24, and selects a main subject having a feature point included in the processed image corresponding to the acquired first processed image data. Set as a tracking subject to be tracked between images.

  The second image processing unit 15 is configured using an image engine (image controller). The second image processing unit 15 acquires image data from the SDRAM 24 via the bus 26, and performs the same image processing as the first image processing unit 12 on the acquired image data to generate second processed image data. To do. The second image processing unit 15 sequentially acquires image data continuously generated by the image sensor 8 from the SDRAM 24 via the bus 26, and performs image processing on the captured image corresponding to the acquired image data. Second processed image data (second image) constituting the second moving image having the second angle of view is generated. Further, the second image processing unit 15 performs a process (trimming process) for cutting out a predetermined region from the captured image based on a signal input from the control unit 27 described later or a setting result from the tracking setting unit 14. Second processing image data constituting two moving image data is sequentially generated. Specifically, the second image processing unit 15 cuts out a region corresponding to a second field angle (telephoto side) narrower than the field angle of the first moving image from the captured image, thereby configuring the second moving image data. Processed image data is generated.

  The AE processing unit 16 acquires image data recorded in the SDRAM 24, and sets an exposure condition when performing still image shooting or moving image shooting based on the acquired image data. Specifically, the AE processing unit 16 calculates the brightness from the image data, and based on the calculated brightness, for example, determines the setting value of the aperture value (F value), the shutter speed, etc. Perform exposure.

  The AF processing unit 17 acquires the image data recorded in the SDRAM 24, and adjusts the automatic focus of the imaging device 1 based on the acquired image data. For example, the AF processing unit 17 extracts a high-frequency component signal from the image data, and performs AF (Auto Focus) calculation processing (sometimes referred to as contrast AF processing) on the high-frequency component signal, whereby the imaging apparatus 1. The automatic focus adjustment of the imaging apparatus 1 is performed by determining the in-focus evaluation.

  The image compression / decompression unit 18 acquires the image data recorded in the SDRAM 24, compresses the acquired image data according to a predetermined format, and outputs the compressed image data to the SDRAM 24. The image compression / decompression unit 18 acquires image data (compressed image data) recorded on the recording medium 22 via the bus 26 and the memory I / F 23, and expands (decompresses) the acquired image data. Output to SDRAM 24. The image compression / expansion unit 18 includes a still image compression / expansion unit 181, a first moving image compression / expansion unit 182, and a second moving image compression / expansion unit 183.

  The still image compression / decompression unit 181 compresses or decompresses the image data according to the JPEG (Joint Photographic Experts Group) method and outputs the image data to the SDRAM 24.

  The first moving image compression / decompression unit 182 compresses or expands the moving image data on the first moving image data according to any of the Motion JPEG method, the MP4 (H.264) method, and the AVI method, and outputs the compressed data to the SDRAM 24.

  The second moving image compression / decompression unit 183 compresses or decompresses the moving image data for the second moving image data according to any of the Motion JPEG method, the MP4 (H.264) method, and the AVI method, and outputs the compressed data to the SDRAM 24.

  The input unit 19 includes a still image shooting operation unit 191 that inputs a release signal for giving a still image shooting instruction, a moving image shooting operation unit 192 that inputs a moving image shooting instruction signal, and various shooting modes set in the imaging apparatus 1. A mode switching operation unit 193 for inputting a switching signal for giving a switching instruction, a dial type setting operation unit 194 for inputting setting signals for setting various setting parameters of the imaging apparatus 1, and a display screen of the display unit 20 are overlapped. And a touch panel 195 that receives an input of a signal according to a contact position from the outside. The still image shooting operation unit 191 can advance and retreat by pressing from the outside. When the still image shooting operation unit 191 is half-pressed, a 1st release signal instructing a shooting sequential operation is input. On the other hand, when the still image shooting operation unit 191 is fully pressed, a 2nd release signal instructing still image shooting is input. The input unit 19 includes a menu operation unit (not shown) for inputting an instruction signal to display various settings of the imaging device 1 on the display unit 20 and image data recorded on the recording medium 22 on the display unit 20. A reproduction operation unit (not shown) for inputting a reproduction signal to be displayed is provided.

  The display unit 20 is configured using a display panel made of liquid crystal, organic EL (Electro Luminescence), or the like. The display drive unit 21 acquires image data recorded by the SDRAM 24 or image data recorded by the recording medium 22 and causes the display unit 20 to display an image corresponding to the acquired image data. Here, for image display, a rec view display that displays image data immediately after shooting for a predetermined time (for example, 3 seconds), a reproduction display that reproduces image data recorded on the recording medium 22, and an image sensor 8 are continuously displayed. Live view display that sequentially displays live view images corresponding to image data to be generated in time series. In addition, the display unit 20 appropriately displays operation information of the imaging device 1 and information related to shooting. The display unit 20 displays an image corresponding to the image data. The display unit 20 displays operation information related to the operation of the imaging apparatus 1 and shooting information related to shooting.

  The recording medium 22 is configured using a memory card or the like mounted from the outside of the imaging device 1. The recording medium 22 is detachably attached to the imaging device 1 via the memory I / F 23. In the recording medium 22, image data or moving image data processed by any one of the first image processing unit 12, the second image processing unit 15, and the image compression / decompression unit 18 is written by a read / write device (not shown) according to the type. Alternatively, the image data or moving image data recorded on the recording medium 22 is read by the read / write device. Further, the recording medium 22 may output the imaging program and various types of information to the flash memory 25 via the memory I / F 23 and the bus 26 under the control of the control unit 27.

  The SDRAM 24 is configured using a volatile memory. The SDRAM 24 receives image data input from the A / D converter 11 via the bus 26, processed image data input from the first image processing unit 12, processed image data input from the second image processing unit 15, and imaging. It has a function as a primary recording unit that temporarily records information being processed by the device 1. The SDRAM 24 includes a first moving image temporary recording unit 241, a second moving image temporary recording unit 242, and a still image temporary recording unit 243.

  The first moving image temporary recording unit 241 temporarily records the image data (captured image) that the image sensor 8 sequentially outputs for each frame via the signal processing unit 10, the A / D conversion unit 11, and the bus 26. . Further, the first moving image temporary recording unit 241 is a first moving image that has been subjected to image processing by the first image processing unit 12 when the imaging apparatus 1 is set to a multi-recording shooting mode in which a moving image with two angles of view is shot. First processing image data constituting the data is temporarily recorded.

  The second moving image temporary recording unit 242 temporarily records the second processed image data constituting the second moving image data that has been subjected to image processing by the second image processing unit 15.

  The still image temporary recording unit 243 receives a still image input from the image sensor 8 via the signal processing unit 10, the A / D conversion unit 11, and the bus 26 when a 2st release signal is input from the still image shooting operation unit 191. Temporarily record image data.

  The flash memory 25 is configured using a nonvolatile memory. The flash memory 25 includes a program recording unit 251 and a feature information recording unit 252.

  The program recording unit 251 includes various programs for operating the imaging apparatus 1, imaging programs, various data used during execution of the programs, and image processing operations performed by the first image processing unit 12 and the second image processing unit 15. Record necessary parameters.

  The feature information recording unit 252 records the feature information in the selected candidate area. For example, when the candidate area includes a human face, the feature information is the feature information of the face (the position, size, and the like of the eyes, mouth, nose, and eyebrows). In the case where the candidate area does not include a human face, the information includes characteristic color information, luminance, and the like included in the candidate area.

  The control unit 27 is configured using a CPU (Central Processing Unit) or the like. The control unit 27 performs overall control of the operation of the imaging device 1 by transferring control signals and various data to each unit constituting the imaging device 1 via the bus 26. The control unit 27 performs control to start the shooting operation when a shooting operation start signal is input from the input unit 19. Here, the photographing operation refers to the signal processing unit 10, the A / D conversion unit 11, and the first image processing unit 12 for the image data output from the imaging device 8 by driving the shutter driving unit 7 and the imaging device driving unit 9. Means an operation for performing a predetermined process. The image data thus processed is compressed in accordance with a predetermined format by the image compression / decompression unit 18 under the control of the control unit 27, and recorded on the recording medium 22 via the bus 26 and the memory I / F 23. Is done. Note that a predetermined recording area may be secured inside the imaging apparatus 1 separately from the recording medium 22 and compressed image data may be stored in this recording area.

  A detailed configuration of the control unit 27 will be described. The control unit 27 includes a face detection unit 271, a touch detection unit 272, an area setting unit 273, a recording control unit 274, and a display control unit 275.

  The face detection unit 271 detects a human face included in an image corresponding to the image data by pattern matching or the like. Specifically, the face detection unit 271 detects the position of the face in the image by pattern matching, and then detects the position of the face feature point such as the eyes, nose, and mouth, thereby detecting the position of the face and the size of the face. The size (size), face orientation, face angle (tilt), etc. are detected. Note that the face detection unit 271 may detect not only a person's face but also a face such as a dog or a cat. Furthermore, the face detection unit 271 may detect a human face using a known technique other than pattern matching.

  The touch detection unit 272 detects a touch position on the display unit 20 according to the position signal input from the touch panel 195.

  The area setting unit 273 sets an area (trimming area) that the second image processing unit 15 cuts out from the captured image. Specifically, the region setting unit 273 sets the region of the captured image corresponding to the touch position as a region that the second image processing unit 15 cuts out from the captured image based on the detection result detected by the touch detection unit 272. . Further, the area setting unit 273 sets an area including the main subject set by the tracking setting unit 14 as an area cut out from the captured image by the second image processing unit 15. Furthermore, the face area detected by the face detection unit 271 may be set as an area cut out from the captured image by the second image processing unit 15. In addition, the area setting unit 273 changes the cutout area of the second image when the imaging apparatus 1 touches another part during moving image shooting. Thereby, the different location (area) where the user touches another location is recorded as the second moving image. Furthermore, when the imaging apparatus 1 moves the touch location while touching the screen during moving image shooting, the region setting unit 273 changes the region of the second image cut out from the captured image according to the touch trajectory. Thereby, the cut-out position of the second image is continuously moved accordingly.

  The recording control unit 274 performs control to record the first moving image data and the second moving image data obtained by continuously capturing the first image and the second image in the recording medium 22. Specifically, the recording control unit 274 records the first processed image data group that constitutes the first moving image data recorded in the first moving image temporary recording unit 241 and the second moving image temporary recording unit 242. For example, the time information at the time of shooting is matched to one or a plurality of files on the recording medium 22 so that the time-sequential second processed image data group constituting the second moving image data can be reproduced in synchronization. Control to record. Further, when the second image is intermittently recorded, the recording control unit 274 records the second moving image data by interpolating with the other image during the period in which the second image is not recorded in the second moving image data. Recording on the medium 22. Specifically, the recording control unit 274 sets the second region set by the region setting unit 273 in the second image processing unit 15 when the start signal instructing the start of the second image capturing is input from the touch panel 195. When an end signal for ending the second image capture is input from the touch panel 195 while the region corresponding to the image is set, the region set by the region setting unit 273 in the second image processing unit 15 is set to the first image (wide angle). Side)).

  The display control unit 275 causes the display unit 20 to display an image corresponding to the image data. The display control unit 275 causes the display unit 20 to display various information about the imaging device 1. Further, when the imaging device 1 is shooting the first moving image and the second moving image, the display control unit 275 causes the display unit 20 to display end information that receives an input of the end of moving image shooting at the second angle of view. Furthermore, the display control unit 275 causes the display unit 20 to display information (for example, a rectangular frame) corresponding to the shooting range of the second image corresponding to the area cut out from the shot image by the second image processing unit 15. In the present embodiment, the display control unit 275 and the touch panel 195 function as a second moving image shooting operation unit.

  Bi-directional communication with an external device via the Internet, an electronic viewfinder, an audio input / output unit, an auxiliary light emitting unit that emits auxiliary light (flash) to the subject, and the imaging apparatus 1 having the above configuration You may provide further the communication part etc. which have the function to perform.

FIG. 2 is a diagram for explaining the outline of the multi-recording process executed by the imaging apparatus 1 described above. In FIG. 2, the imaging apparatus 1 synchronizes the visual field area (subject) at the same time by aligning time information at the time of shooting moving images with two angles of view or associating files. Multi-recording shooting mode is set to shoot so that it can be played back. Further, in FIG. 2, the live view image P ₀ is displayed on the display unit 20. In FIG. 2, FIG. 2 (a) shows the user's operation at the time of shooting, FIG. 2 (b) shows the recorded content of the first moving image, and FIG. 2 (c) shows the recorded content of the second moving image. . In FIG. 2, there are a plurality of images between the images.

As shown in FIG. 2, when the user operates the motion shooting operation unit 192 and a moving image shooting start signal is input at time t = t ₁ , the recording control unit 274 is generated by the first image processing unit 12. Recording of the first processed image Q _n (n = 1, 2, 3,... Natural number) and the second processed image R _n generated by the second image processing unit 15 is started. Thereafter, the recording control unit 274, in time sequence, the first processed image Q _{n + 1} sequentially generated by the first image processing unit 12 and the second processed image R _{n + 1} sequentially generated by the second image processing unit 15. Is recorded on the recording medium 22.

Subsequently, when the user touches the subject A shown in the live view image P _{n + 2} via the touch panel 195 at time t = t ₂ , the recording control unit 274 is based on the touch position detected by the touch detection unit 272. Thus, the area setting unit 273 is caused to set the angle of view of the second moving image generated by the second image processing unit 15. Specifically, the area setting unit 273 selects a predetermined area including the touch position (for example, in the image sensor 8) as a region that the second image processing unit 15 cuts out from the captured image corresponding to the image data generated by the image sensor 8. The area (second angle of view) in which the subject A is captured is set by changing to [1/4] of the imaging surface. Thereby, the second image processing unit 15 cuts out an area including the touch position touched by the user and generates a second processed image R _{n + 2} . At this time, the recording control unit 274 stores the first processed image Q _{n + 2} generated by the first image processing unit 12 and the second processed image R _{n + 2} generated by the second image processing unit 15 on the recording medium 22, respectively. Record. In addition, although FIG. 2 demonstrates the case of the method of selecting the predetermined range centering on the point which the user touched, the method of designating the diagonal vertex of the range which a user wants to select may be used.

Thereafter, at time t = t ₃ , the display control unit 275 instructs the MR region K1 (multi-recording region) indicating the second angle of view on the live view image P and the end of moving image shooting of the second angle of view. A close icon Z1 for receiving an input of an end signal is displayed on the display unit 20. Thereby, the user can grasp | ascertain intuitively the area | region (telephoto side) of a 2nd image, image | photographing a wide side (wide angle side). At this time, the recording control unit 274 stores the first processed image Q _{n + 3} generated by the first image processing unit 12 and the second processed image R _{n + 3} generated by the second image processing unit 15 on the recording medium 22, respectively. Record.

Subsequently, when the user touches the close icon Z1 on the live view image P _{n + 4} via the touch panel 195 at time t = t ₄ , the recording control unit 274 generates the second image processing unit 15 to generate The region setting unit 273 is changed from the two images to the region of the first image of the first moving image. Specifically, the region setting unit 273 uses the first image (first image) that is the same as the first image processing unit 12 for the region that the second image processing unit 15 cuts out from the captured image corresponding to the image data generated by the image sensor 8. To the area (wide angle side) corresponding to the angle of view. Thereby, when recording the second image intermittently, the recording control unit 274 interpolates the second moving image data by interpolating the period during which the second image is not recorded in the second moving image data with the first image. Can be recorded. At this time, the recording control unit 274 stores the first processed image Q _{n + 4} generated by the first image processing unit 12 and the second processed image R _{n + 4} generated by the second image processing unit 15 on the recording medium 22, respectively. Record.

Thereafter, at time t = t ₅ , the recording control unit 274 outputs the first processed image Q _{n + 5 of} the first image generated by the first image processing unit 12 and the second image generated by the second image processing unit 15. The second processed image R _{n + 5} is recorded on the recording medium 22.

Subsequently, when the user touches the subject B shown in the live view image P _{n + 6} via the touch panel 195 at time t = t ₆ , the recording control unit 274 is based on the touch position detected by the touch detection unit 272. Thus, the region setting unit 273 sets the region of the second image generated by the second image processing unit 15. Specifically, the region setting unit 273 sets the region of the second image generated by the second image processing unit 15 based on the touch position detected by the touch detection unit 272. For example, the region setting unit 273 sets the region of the second image by changing the region that the second image processing unit 15 cuts out from the captured image corresponding to the image data generated by the image sensor 8 to the region where the subject B is captured. To do. As a result, the second image processing unit 15 cuts out a region including the touch position touched by the user and generates a second processed image R _{n + 6} . At this time, the recording control unit 274 stores the first processed image Q _{n + 6} generated by the first image processing unit 12 and the second processed image R _{n + 6} generated by the second image processing unit 15 on the recording medium 22, respectively. Record.

Thereafter, at time t = t ₇ , the display control unit 275 receives an input of a signal instructing the end of photographing of the MR region K2 indicating the second angle of view and the second image on the live view image P _{n + 7.} The close icon Z1 is displayed on the display unit 20. At this time, the recording control unit 274 stores the first processed image Q _{n + 3} generated by the first image processing unit 12 and the second processed image R _{n + 3} generated by the second image processing unit 15 on the recording medium 22, respectively. Record.

Subsequently, when the user touches the subject A captured in the live view image P _{n + 8} via the touch panel 195 at time t = t ₈ , the recording control unit 274 is based on the touch position detected by the touch detection unit 272. Thus, the region setting unit 273 sets the region of the second image generated by the second image processing unit 15. Specifically, the region setting unit 273 determines, based on the touch position detected by the touch detection unit 272, the region that the second image processing unit 15 cuts out from the captured image corresponding to the image data generated by the image sensor 8. The area of the second image is set by changing to the area where A is shown. Thereby, the second image processing unit 15 cuts out an area including the touch position touched by the user and generates a second processed image R _{n + 8} of the second image. At this time, the recording control unit 274 stores the first processed image Q _{n + 8} generated by the first image processing unit 12 and the second processed image R _{n + 8} generated by the second image processing unit 15 on the recording medium 22, respectively. Record.

  Thereafter, the storage control unit 274 generates the first processed image generated by the first image processing unit 12 and the second image processing unit 15 until an end signal for ending the shooting of the moving image is input from the moving image shooting operation unit 192. The second image processing is continuously recorded on the recording medium 22.

  In this way, the user can simultaneously shoot the entire image while designating a subject and a place to be enlarged and viewed on the screen during moving image shooting. Furthermore, the user can enlarge and photograph a desired subject by touching the touch panel 195 while viewing the live view image displayed on the display unit 20. Furthermore, the user can change the position of the second image (the position on the telephoto side) in the second moving image simply by touching and specifying a different subject or place.

  Next, an outline of processing executed by the imaging apparatus 1 will be described. FIG. 3 is a flowchart illustrating an outline of processing executed by the imaging apparatus 1.

  As shown in FIG. 3, when the imaging device 1 is set to the shooting mode (step S101: Yes), the imaging device 1 performs still image shooting or moving image shooting while controlling various parameters according to the shooting mode. An imaging control process is executed (step S102). The detailed contents of the shooting control process will be described later.

  Subsequently, when the power of the imaging device 1 is turned off (step S103: Yes), the imaging device 1 ends this process. On the other hand, when the power of the imaging device 1 is not turned off (step S103: No), the imaging device 1 returns to step S101.

  In step S101, when the imaging device 1 is not set to the shooting mode (step S101: No) and is set to the reproduction mode (step S104: Yes), the imaging device 1 records an image recorded on the recording medium 22. Reproduction display for reproducing and displaying image data and moving image data in the file is executed (step S105). The detailed contents of the reproduction display process will be described later. After step S105, the imaging apparatus 1 proceeds to step S103.

  Next, the photographing control process described in step S102 of FIG. 3 will be described. FIG. 4 is a flowchart showing an outline of the imaging control process.

  As illustrated in FIG. 4, the display control unit 275 causes the display unit 20 to display a live view image corresponding to the image data generated by the image sensor 8 (Step S <b> 201), and the recording control unit 274 generates the image sensor 8. The recorded image data is temporarily recorded in the first moving image temporary recording unit 241 of the SDRAM 24 (step S202).

  Subsequently, when there is a partial designation for shooting as the second angle of view for the live view image displayed on the display unit 20 via the touch panel 195 (step S203: Yes), the imaging device 1 displays the second moving image. A second moving image candidate frame display process for displaying an MR area indicating the candidate second angle of view is executed (step S204).

  FIG. 5 is a flowchart showing an overview of the second moving image candidate frame display process in step S204.

  As shown in FIG. 5, the feature determination unit 13 determines the feature of the main subject included in the touch position based on the touch position detected by the touch detection unit 272 (step S301).

  Subsequently, the tracking setting unit 14 sets, as a tracking subject, a main subject that tracks a subject having the characteristics determined by the feature determination unit 13 between successive images (step S302). As a result, the main subject desired by the user can be tracked. In the present embodiment, a tracking mode for tracking the main subject can be set in various setting processes of the imaging apparatus 1 before shooting. For this reason, in the setting process of the imaging apparatus 1, when the tracking mode for tracking the main subject is not set, the subject included in the touch position may not be tracked and may be placed on standby at this position.

  Thereafter, when a change signal for changing the position (angle of view) of the second moving image is input from the setting operation unit 194 (step S303: Yes), the region setting unit 273 is configured so that the second image processing unit 15 is moved by the imaging device 8. The area cut out from the captured image corresponding to the generated image data is set to 1/9 (step S304). On the other hand, when the change signal for changing the angle of view of the second moving image is not input from the setting operation unit 194 (step S303: No), the region setting unit 273 is configured such that the second image processing unit 15 uses the image sensor. A region to be cut out from the captured image corresponding to the image data generated by 8 is set to ¼ (step S305).

  Subsequently, the display control unit 275 causes the display unit 20 to display an MR region frame K1 indicating the region of the second image on the live view image (step S306). Thereafter, the imaging apparatus 1 returns to the shooting control process of FIG.

  In step S203, if there is no designation of a part to be captured as the second image for the live view image displayed on the display unit 20 via the touch panel 195 (step S203: No), and after step S204, the imaging apparatus 1 performs step The process proceeds to S205.

  Subsequently, when the partial designation to be captured as the second image is canceled for the live view image displayed on the display unit 20 via the touch panel 195 (step S205: Yes), the region setting unit 273 displays the second image. The area cut out from the captured image corresponding to the image data generated by the image sensor 8 by the processing unit 15 is set as the area corresponding to the first image of the first moving image generated by the first image processing unit 12 (step S206). . Specifically, when the close icon Z1 is touched, the region setting unit 273 performs a first image processing on a region that the second image processing unit 15 cuts out from a captured image corresponding to the image data generated by the image sensor 8. It sets to the area | region of the 1st image of the 1st moving image which the part 12 produces | generates. Thereafter, the imaging apparatus 1 proceeds to step S207. On the other hand, when there is no cancellation of the designation of the part to be captured as the second image for the live view image displayed on the display unit 20 via the touch panel 195 (step S205: No), the imaging apparatus 1 performs step S207. Migrate to

  Thereafter, when a 2st release signal is input from the still image capturing operation unit 191 and there is an instruction for still image capturing (step S207: Yes), the imaging apparatus 1 performs still image capturing (step S208). In this case, when the partial designation of the second image is set, the recording control unit 274 performs the first image still image data subjected to the image processing by the first image processing unit 12 and the second image processing. The still image data of the second image subjected to image processing by the unit 15 is recorded in the still image temporary recording unit 243 of the SDRAM 24.

  Subsequently, the recording control unit 274 records the moving image data recorded by the first moving image temporary recording unit 241 in association with the still image data, for example, moving image data before and after the shooting of the still image data (for example, 3 seconds). Recording is performed on the medium 22 (step S209). Thereafter, the imaging apparatus 1 returns to the main routine of FIG.

  In step S207, when there is no instruction to shoot a still image (step S207: No) and a start signal instructing the start of a moving image is input from the moving image shooting operation unit 192, a moving image shooting instruction is given (step S210). : Yes), the imaging apparatus 1 starts recording the first moving image and the second moving image (step S211). In this case, the recording control unit 274 sets the first processed image data of the first moving image generated by the first image processing unit 12 and the second processed image data of the second moving image generated by the second image processing unit 15 in time series. A moving image file is generated on the recording medium 22 for recording (to prevent file association and time information as described above, and so forth) so as to be synchronized with each other. Recording is started by synchronizing the two image processing data.

  Subsequently, when a 2st release signal is input from the still image capturing operation unit 191 and a still image capturing instruction is received (step S212: Yes), the imaging apparatus 1 performs still image capturing (step S213). . In this case, the recording control unit 274 records the still image data of the first image and the still image data of the second image in the moving image file when the field angles of the first image and the second image are different. The recording control unit 274 may record only the still image data of the first image in the moving image file when the angle of view (trimming area) of the first image and the second image is the same. On the other hand, when there is no instruction for still image shooting (step S212: No), the imaging apparatus 1 proceeds to step S214.

  Thereafter, when the imaging device 1 finishes moving image shooting by inputting an end signal instructing the end of the moving image from the moving image shooting operation unit 192 (step S214: Yes), the recording control unit 274 displays the image compression / expansion unit. 18 compresses the moving image file recorded on the recording medium 22 in accordance with a predetermined format and records it on the recording medium 22 (step S215). Thereafter, the imaging apparatus 1 returns to the main routine of FIG.

  In step S214, when the imaging device 1 does not end moving image shooting (step S214: No), the imaging device 1 proceeds to step S216.

  Subsequently, when the live view image displayed on the display unit 20 via the touch panel 195 is designated as a second angle of view (step S216: Yes), the recording control unit 274 displays the second moving image. Is recorded at an angle of view corresponding to the touch position (step S217). In this case, the region setting unit 273 sets a region to be cut out from the captured image corresponding to the image data generated by the image sensor 8 based on the touch position detected by the detection unit 272. Thereby, the 2nd moving image which is the 2nd angle of view which expanded the field containing a touch position can be recorded. At this time, the recording control unit 274 records touch information including the touch position where the touch panel 195 is touched and time information (touch timing) in the recording medium 22 in association with the first moving image and the second moving image. Of course, there is a case where the position of the second moving image is not changed, and there is a case where the position is changed by other than touch, and only the time information may be used. Since the touch operation is intuitive and can be easily performed, an operation that respects the will of the photographer can be performed intuitively. Also, in this situation, when the tracking mode for tracking the main subject is set in the imaging apparatus 1, the feature determination unit 13 determines the feature included in the touch position, and the tracking setting unit 14 uses the feature determination unit 13. The subject having the determined characteristics is tracked at the second angle of view, and the region setting unit 273 changes the region extracted by the second image processing unit 15 between successive images based on the tracking result of the tracking setting unit 14. You may track while. Such feature determination is not always necessary because there are cases other than tracking. Thereafter, the imaging apparatus 1 proceeds to step S218.

  In step S <b> 216, when there is no designation of a part to be captured as the second image for the live view image displayed on the display unit 20 via the touch panel 195 (step S <b> 216: No), the imaging device 1 proceeds to step S <b> 218.

  After that, when there is cancellation of the designation of a part to be captured as the second image for the live view image displayed on the display unit 20 via the touch panel 195 (step S218: Yes), the region setting unit 273 performs the second image processing. The region cut out from the captured image corresponding to the image data generated by the image sensor 8 by the unit 15 is set as the first angle of view of the first moving image generated by the first image processing unit 12, and the storage control unit 274 Two moving images are recorded at the angle of view of the first moving image (step S219). Specifically, the recording control unit 274 changes the region of the second image of the second moving image generated by the second image processing unit 15 from the region of the first image of the first moving image and causes the region setting unit 273 to set it. . In this case, the region setting unit 273 sets the region extracted from the captured image corresponding to the image data generated by the image sensor 8 by the second image processing unit 15 to the region corresponding to the same first image as the first image processing unit 12. Set. Thereafter, the imaging device 1 returns to step S212.

  In step S218, when the live designation image displayed on the display unit 20 via the touch panel 195 is not canceled as part of the image to be captured as the second image (step S218: No), the imaging apparatus 1 proceeds to step S212. Return.

  In step S210, when there is no instruction for moving image shooting (step S210: No) and the shooting mode is ended (step S220: Yes), the imaging apparatus 1 returns to the main routine of FIG. On the other hand, when there is no instruction for moving image shooting (step S210: No) and the shooting mode has not ended (step S220: No), the imaging apparatus 1 returns to step S201.

  Next, the reproduction display process in step S105 of FIG. 3 will be described. FIG. 6 is a flowchart showing an outline of the reproduction display process.

  As shown in FIG. 6, the display control unit 275 displays a list of files recorded on the recording medium 22 on the display unit 20 (step S401).

  Subsequently, when a file is selected via the setting operation unit 194 or the touch panel 195 (step S402: Yes), the control unit 27 determines whether or not the selected file is a multiframe (step S403). . When the control unit 27 determines that the selected file is multiframe (step S403: Yes), the imaging device 1 proceeds to step S404 described below. On the other hand, when the control unit 27 determines that the selected file is not a multi-frame (step S403: No), the imaging device 1 proceeds to step S413 described later.

  In step S404, the control unit 27 expands the compressed first moving image data and the compressed second moving image data recorded on the recording medium 22 in the first moving image compression / decompression unit 182 and the second moving image compression / decompression unit 183 in the SDRAM 24. Then, the reproduction of the first moving image corresponding to the developed first moving image data and the second moving image corresponding to the second moving image data is started.

  Subsequently, when the second moving image has another angle of view different from the angle of view of the first moving image (step S405: Yes), the display control unit 275 displays the first moving image as a main and subtracts the second moving image. (Step S406), and when the moving image displayed in the sub is touched (step S407: Yes), the display control unit 275 gradually switches the display area between the first moving image and the second moving image and displays the display unit. 20 is displayed (step S408).

FIG. 7 is a diagram schematically illustrating transition of moving images when a multi-frame moving image is manually switched. As illustrated in FIG. 7, when the user selects the second moving image R _n that the display unit 20 displays as a sub via the touch panel 195 (FIG. 7A), the display control unit 275 displays the first moving image Q _n. The display area of ₊₁ and the second video R _{n + 1} is gradually switched and displayed on the display unit 20 (FIG. 7 (b) → FIG. 7 (c) → FIG. 7 (d) → FIG. 7 (e)). . Thereby, since the display area smoothly transitions from the first moving image to the second moving image, the user can appreciate the image without a sense of incongruity. Furthermore, the user can enlarge and confirm the second moving image while enjoying the entire atmosphere photographed at the same time. Note that the display control unit 275 displays the first moving image and the first moving image when the user selects the first moving image via the touch panel 195 when the second moving image is mainly displayed and the first moving image is displayed as a sub. The display area 20 is displayed while gradually switching the display area of the two moving images. At this time, the display control unit 275 may switch between the first moving image and the second moving image instantaneously. After step S408, the imaging apparatus 1 proceeds to step S409.

  In step S409, when the reproduction of the moving image is completed (step S409: Yes), the imaging apparatus 1 returns to the main routine of FIG. On the other hand, when the reproduction of the moving image has not ended (step S409: No), the imaging device 1 returns to step S407.

  In step S407, when the moving image displayed in the sub is not touched (step S407: No), the control unit 27 determines whether or not touch information at the time of shooting is included in the second moving image data (step S407). S410). When the control unit 27 determines that touch information at the time of shooting is included (step S410: Yes), the display control unit 275 gradually displays display areas of the first moving image and the second moving image based on the touch information. To display on the display unit 20 (step S411).

FIG. 8 and FIG. 9 are diagrams schematically illustrating moving image transition when a multi-frame moving image is automatically switched. 8 and 9, the display control unit 275 displays the first moving image as a main and the second moving image as a sub. Further, the display control unit 275 causes the display unit 20 to display a time bar T1 indicating the entire length of the moving image playback time in the multiframe. Furthermore, the display control unit 275 displays the index I ₁ and the index I ₂ that indicate the time information of the touch that the user touched at the time of shooting on the time bar T1 based on the touch information at the time of shooting recorded in the selected file. Is displayed on the time bar T1. The index I ₁ indicates the time when the second moving image is captured at the first angle of view, and the second moving angle is changed to the second angle of view, and the index I ₂ indicates the second moving image at the second angle of view. The timing when the second moving image having the second angle of view is started at a different position in the case of shooting at is shown. The display control unit 275 displays the icon D ₁ indicative of the current imaging time on the time bar T1.

As shown in FIG. 8, the display control unit 275 gradually switches the display area between the first moving image and the second moving image based on the touch information and causes the display unit 20 to display the display area (FIG. 8A → FIG. 8). (B) → FIG. 8 (c) → FIG. 8 (d) → FIG. 8 (e)). At this time, the display control unit 275 enlarges the display area of the second moving image as the shooting time (icon D ₁ ) approaches the index I ₁ on the time bar T1. Thereby, since the display area smoothly transitions from the first moving image to the second moving image, the user can appreciate the image without a sense of incongruity. Furthermore, the user can enlarge and confirm the second moving image while enjoying the entire atmosphere photographed at the same time.

Further, as illustrated in FIG. 9, when the second moving image having a different angle of view is switched and displayed on the display unit 20 based on the touch information, the display control unit 275 is blacked out during the transition of the second moving image. The image O ₁ (blackout) is sandwiched between continuous videos and displayed on the display unit 20 (FIG. 9A → FIG. 9B → FIG. 9C → FIG. 9D → FIG. 9). 9 (e)). At this time, the display control unit 275 displays the black image O ₁ on the display unit 20 when the shooting time (icon D ₁ ) reaches the index I ₂ on the time bar T1. Thereby, even if the second angle of view is switched to another second angle of view, it can be reproduced without a sense of incongruity. After step S411, the imaging apparatus 1 proceeds to step S409.

  In step S410, when there is no touch information at the time of shooting in the selected file (step S410: No), the imaging apparatus 1 proceeds to step S409.

  In step S405, when the second moving image does not have another angle of view (step S405: No), the display control unit 275 hides the second moving image (step S412). In this case, the second moving image is played back in synchronization with the first moving image. Thereafter, the imaging apparatus 1 proceeds to step S409.

  In step S403, when the selected file is not a multiframe (step S403: No), the display control unit 275 reproduces the image data of the selected file (step S413).

  Subsequently, when the image data is completed (step S414: Yes), the imaging apparatus 1 returns to the main routine of FIG. On the other hand, when the image data has not ended (step S414: No), the control unit 27 continues this determination.

  In step S402, when no file is selected (step S402: No) and the reproduction mode is ended (step S415: Yes), the imaging apparatus 1 returns to the main routine of FIG. On the other hand, when the reproduction mode has not ended (step S415: No), the imaging apparatus 1 returns to step S401.

  According to the embodiment of the present invention described above, when the recording control unit 274 intermittently records the second image, the period during which the second image is not recorded in the second moving image data is The second moving image data is recorded by interpolating with the image. As a result, it is possible to shoot more varied moving images using images taken at different angles of view.

  Further, according to the embodiment of the present invention, the recording control unit 274 records the first moving image data and the second moving image data on the recording medium 22, respectively. As a result, the user can reproduce only the second moving image data obtained by enlarging the desired subject, or can reproduce only the first moving image data showing the whole.

  In addition, according to the embodiment of the present invention, the recording control unit 274 stores the first moving image data and the second moving image data in the recording medium 22 so that they can be reproduced in synchronization. As a result, when the user reproduces the first moving image data and the second moving image data at the same time, the display area and display of the first image that forms the first moving image data and the second image that forms the second moving image data are displayed. You can watch while switching manually during playback, and enjoy a variety of videos.

  According to one embodiment of the present invention, when the recording control unit 274 records the first moving image data and the second moving image data on the recording medium 22 so that they can be reproduced in synchronization, the cutout position of the second image is simultaneously recorded. Time information for the end of change or cutout is added. As a result, when the user reproduces the first moving image data and the second moving image data at the same time, the display area and display of the first image that forms the first moving image data and the second image that forms the second moving image data are displayed. You can watch while switching automatically and enjoy a variety of videos.

  Further, according to the embodiment of the present invention, the second image processing unit 15 cuts out the region of the captured image corresponding to the position according to the position signal input from the touch panel 195 by the region setting unit 273 as the second image. Set to area. As a result, the user can set the area of the second moving image data in which the desired area is enlarged by an intuitive operation. Thereby, a user's will can be reflected intuitively.

  In addition, according to the embodiment of the present invention, since the area of the second image constituting the second moving image data can be changed only by the user operating the touch panel 195, the angle of view and the shooting position can be set by the user. It is possible to shoot a second moving image with a change of will. As a result, it is possible to shoot more varied video.

  Further, according to the embodiment of the present invention, since the image compression / decompression unit 18 performs inter-frame compression according to a predetermined method, the recording control unit 274 synchronizes the first moving image data and the second moving image data. Recording is performed on the recording medium 22. Accordingly, when the first moving image data and the second moving image data are reproduced simultaneously, when the user selects one of the moving images displayed in the sub, a frame (frame) is not dropped in the selected moving image. Video transitions can be made. When the first moving image and the second moving image are not recorded in synchronization, the image compression / decompression unit 18 performs inter-frame compression according to a predetermined method, and therefore the user selects one of the moving images displayed in the sub. Since the selected moving image has dropped frames, it is necessary to wait until the next frame, and the moving image transitions intermittently.

  Furthermore, according to the embodiment of the present invention, the second image processing unit 15 cuts out the region corresponding to the tracking subject set by the tracking setting unit 14 by the region setting unit 273 from the captured image as the second angle of view. Since the area is set, a moving image in which the main subject desired by the user is enlarged can be taken as the second moving image. When the tracking subject disappears from the field of view of the imaging device 1, the tracking setting unit 14 may cancel the tracking after waiting for a predetermined time (for example, 3 seconds) at the position where the tracking subject disappears. In addition, the tracking setting unit 14 may continue tracking the tracking subject when the tracking subject appears in the field of view of the imaging apparatus 1 within a predetermined time. At this time, the tracking setting unit 14 may gradually move from the standby position (having a hysteresis number or coefficient) to the tracking subject to prevent the angle of view from changing suddenly. Furthermore, the region setting unit 273 may appropriately adjust the region that the second image processing unit 15 cuts out from the captured image as the second angle of view so that the size of the tracking subject is constant.

  In the present embodiment, the area setting unit 273 sets the area that the second image processing unit 15 cuts out from the captured image according to the touch position, but the second image processing is performed by default (initial setting). The area cut out from the captured image by the unit 15 may be set as an area including the center of the captured image. Furthermore, the region setting unit 273 may set a region that the second image processing unit 15 cuts out from the captured image according to the detection result of the face detection unit 271.

  In the embodiment, the area setting unit 273 sets an area to be cut out from the captured image by the second image processing unit 15 according to the touch position. However, a pinch operation (pinch-in or pinch-out), tap An area to be cut out from the captured image by the second image processing unit 15 may be set according to the operation or the hold operation. Furthermore, the region setting unit 273 may set a region that the second image processing unit 15 cuts out from the captured image in accordance with the touch trajectory.

  In one embodiment of the present invention, the recording control unit 274 interpolates a recording in which the second image is not recorded in the second moving image data with the first moving image, and records the second moving image on the recording medium 22. However, another moving image, for example, a second moving image interpolated with a preset blackout image, whiteout image, or the like may be recorded on the recording medium 22.

  In the present embodiment, the aspect ratio of the moving image has been described as 16: 9. However, the aspect ratio can be appropriately set to 4: 3 or 3: 2, for example.

  In the present embodiment, the first image processing unit 12 performs image processing on the captured image to generate the first processed image data constituting the first moving image data. A predetermined area may be cut out from (area), and image processing may be performed on the image of the cut out area to generate first processed image data constituting the first moving image data.

  In the embodiment, the first image may have a smaller angle of view than the second image.

  In the embodiment, the recording control unit 274 records the first moving image data and the second moving image data on the recording medium 22 so that the first moving image data and the second moving image data can be reproduced in synchronization with each other. As long as the two moving image data can be displayed in synchronization, the first moving image data and the second moving image data may be recorded on the recording medium 22 in a time division manner.

  In the embodiment, when switching from the second video to the first video during playback, the display area is set so that the second video is sucked into the first video based on the touch information at the time of shooting. The transition may be made while gradually decreasing. Specifically, as illustrated in FIG. 10, the display control unit 275 gradually shifts the display area of the second moving image to the position of the first moving image corresponding to the second angle of view based on the touch information at the time of shooting. The display area of the first moving image is enlarged while being returned while being reduced (FIG. 10 (a) → FIG. 10 (b) → FIG. 10 (c) → FIG. 10 (d)). The moving image is displayed in the sub-region (FIG. 10E), so that the user can easily grasp the position touched at the time of shooting.

  In this embodiment, when the user touches the live view image via the touch panel 195 during shooting, the display control unit 275 superimposes the region indicating the position of the second angle of view on the live view image. However, an area including the touch position may be cut out and displayed at a predetermined position on the live view image. Specifically, as illustrated in FIG. 11, when the user touches a live view image displayed on the display unit 20 via the touch panel 195, the display control unit 275 determines according to the detection result of the touch detection unit 272. The area including the touch position may be enlarged and the second moving image A10 having the second angle of view may be superimposed and displayed on the upper left on the live view image. As a result, it is possible to confirm a subject that is hidden by touch, and more intuitively understand the content of the second image.

  Further, in the embodiment of the present embodiment, the display control unit 275 switches the display areas of the first image and the second image with an expression effect based on the touch information. The two images may be combined (multiple exposure), and the display unit 20 may display the expression effect by gradually switching the combination ratio for combining the first image and the second image. Further, as the expression effect, the first image and the second image may be displayed on the display unit 20 using expression effects (video effects) such as fade-out, fade-in, overlap, and cross-fade.

  In the embodiment, the recording control unit 274 records the first moving image and the second moving image on the recording medium 22 respectively. However, as shown in FIG. 12, the first moving image and the second moving image are recorded. You may make it record on the recording medium 22 by synthesize | combining synchronizing (period (a), period (c)). In this case, as shown in FIG. 12, the recording control unit 274 may delete the image having the same angle of view and record it on the recording medium (period (b)).

  In the embodiment, the area setting unit 273 may set an area including the face detected by the face detection unit 271 as an area cut out from the captured image by the second image processing unit 15. In addition, when the face detection unit 271 detects a plurality of faces from the photographed image, the region setting unit 273 is an area where the second image processing unit 15 cuts out the region including the face having the largest face size from the photographed image. It may be set. Furthermore, the region setting unit 273 sets the region including the smiling face as a region to be cut out from the captured image only when the face detected by the face detection unit 271 from the captured image is a smile. Good.

  In the embodiment, only the first moving image and the second moving image are used. However, a third moving image different from the angle of view of the first moving image and the second moving image may be recorded. Furthermore, moving images having a plurality of angles of view may be recorded. Furthermore, the angle of view of the first moving image may be on the telephoto side (second angle of view) instead of on the wide angle side (first angle of view).

  In the embodiment of the present embodiment, the first image or both the first image and the second image may be cut out at a different angle of view and / or shooting position from the shot image.

  In one embodiment of the present invention, the first moving image is a moving image obtained by cutting out a predetermined area with a required aspect ratio, for example, from the original image (captured image) already acquired by the image sensor 8. The second moving image may be cut from the original image instead of the first moving image. Actually, the aspect ratio of a still image taken by a camera is often different from the aspect ratio for a moving image reproduced on a television, for example. Therefore, a specification for extracting the first moving image and the second moving image from the original image can be easily considered, but it goes without saying that the present invention can be applied to such a specification.

  Further, in the embodiment of the present invention, the description is simplified by expressing it as “moving image data”, but strictly speaking, there is a still image resized for a through image (live view). Some are continuous, others are inter-frame compressed for recording. Even moving image data at the time of reproduction is filed in a predetermined format. Furthermore, since the same image is displayed for the user, these differences may not be recognized, and technically, depending on the design, inter-frame compression may not be performed during recording. is there. In view of the above, the expression “moving image data” is comprehensively including the output of the image sensor 8 subjected to image processing.

  In the present invention, a digital camera in which the lens unit 2 and the image sensor 8 are provided in one housing has been described as an example. However, the digital unit is configured by a lens device to which the lens unit 2 is detachable and a main body unit. Even a single-lens reflex camera can be applied.

  In addition to the digital camera, the imaging device according to the present invention is also applicable to electronic devices such as a digital camera that can be equipped with accessories, a digital video camera, and a mobile phone or a tablet-type mobile device having a photographing function. Can do.

  In the description of the flowchart in the present specification, the context of processing between steps is clearly shown using expressions such as “first”, “subsequent”, and “follow”, but this is necessary for carrying out the present invention. The order of processing is not uniquely determined by their expression. That is, the order of processing in the flowcharts described in this specification can be changed within a consistent range.

  As described above, the present invention can include various embodiments not described herein, and various design changes and the like can be made within the scope of the technical idea specified by the claims. Is possible.

(Appendix 1)
An imaging apparatus capable of capturing a first image and a second image having different angles of view and / or shooting positions,
An imaging unit that images a subject and generates image data of the subject;
A display unit capable of displaying a captured image corresponding to the image data generated by the imaging unit;
A touch panel that is provided on the display screen of the display unit, detects a touch of an object from the outside, and outputs a position signal corresponding to the detected touch position;
An area setting unit that sets an area of the captured image corresponding to a position according to a position signal input from the touch panel as an area to be cut out as the second image from the captured image;
An image processing unit that generates second moving image data in which the second image is temporally continuous by sequentially cutting out the region set by the region setting unit from the captured image;
A recording control unit that performs control to record the first moving image data and the second moving image data obtained by continuously capturing the first image in time, and
An imaging apparatus comprising:

DESCRIPTION OF SYMBOLS 1 Imaging device 2 Lens part 3 Lens drive part 4 Aperture 5 Aperture drive part 6 Shutter 7 Shutter drive part 8 Image sensor 9 Image sensor drive part 10 Signal processing part 11 A / D conversion part 12 1st image process part 13 Feature determination part 14 Tracking setting unit 15 Second image processing unit 16 AE processing unit 17 AF processing unit 18 Image compression / decompression unit 19 Input unit 20 Display unit 21 Display drive unit 22 Recording medium 23 Memory I / F
24 SDRAM
25 Flash memory 26 Bus 27 Control unit 181 Still image compression / expansion unit 182 First moving image compression / expansion unit 183 Second moving image compression / expansion unit 191 Still image shooting operation unit 192 Movie shooting operation unit 193 Mode switching operation unit 194 Setting operation unit 195 Touch panel 241 First moving image temporary recording unit 242 Second moving image temporary recording unit 243 Still image temporary recording unit 251 Program recording unit 252 Feature information recording unit 271 Face detection unit 272 Touch detection unit 273 Area setting unit 274 Recording control unit 275 Display control unit

Claims (16)

An imaging apparatus capable of capturing a first image and a second image having different angles of view and / or shooting positions,
A recording control unit that performs control to record the first moving image data and the second moving image data obtained by continuously capturing the first image and the second image in time,
The recording control unit
When the second image is intermittently recorded, an imaging apparatus that interpolates a period during which the second image is not recorded with another image. An imaging unit that captures an image of the subject and continuously generates image data of the subject;
The imaging apparatus according to claim 1, wherein the second image is obtained by cutting a captured image corresponding to the image data generated by the imaging unit at an angle of view and / or a shooting position different from the captured image. .   The imaging apparatus according to claim 1, wherein the other image is the first image. A first image processing unit that sequentially performs image processing on the captured image generated by the imaging unit to generate the first moving image data;
A second image processing unit that performs image processing for sequentially cutting out regions of an angle of view different from the captured image from the captured image generated by the imaging unit, and generates the second moving image data;
A recording unit for recording the first moving image data and the second moving image data;
Further comprising
The imaging apparatus according to claim 3, wherein the recording control unit records the first moving image data and the second moving image data in the recording unit so that the first moving image data and the second moving image data can be reproduced in synchronization. A first moving image shooting operation unit that receives input of a moving image start signal instructing the start of moving image shooting and a moving image end signal instructing the end of moving image shooting;
A second moving image shooting operation unit for receiving input of a start signal for instructing start of shooting of the second image and an end signal for instructing end of shooting of the second image;
An area setting unit for setting an area to be cut out from the captured image by the second image processing unit;
Further comprising
When the start signal is input from the second moving image shooting operation unit, the recording control unit sets the region set by the region setting unit to the second image processing unit as a region corresponding to the second image. On the other hand, when the end signal is input from the second moving image shooting operation unit, the region setting unit sets the region set in the second image processing unit to a region corresponding to the first image. The imaging apparatus according to claim 4. A display unit capable of displaying the captured image;
A touch panel that is provided on the display screen of the display unit, detects a touch of an object from the outside, and outputs a position signal corresponding to the detected touch position;
Further comprising
The area setting unit sets an area of the captured image corresponding to a position corresponding to a position signal input from the touch panel as an area cut out from the captured image by the second image processing unit. Item 6. The imaging device according to Item 5. A display control unit for displaying end information indicating the end of shooting of the second image on the display unit in a state of shooting the second image;
The end signal is the position signal of an area corresponding to the end information from the touch panel,
The imaging apparatus according to claim 6, wherein the start signal is the position signal other than an area corresponding to the end information input from the touch panel. A feature determination unit that determines a feature of a subject included in an area including a position according to a position signal input from the touch panel;
A tracking setting unit that sets a subject to be tracked in the adjacent captured image based on the determination result determined by the feature determination unit;
Further comprising
The imaging device according to claim 6 or 7, wherein the region setting unit sets a region including the subject set by the tracking setting unit as a region cut out from the captured image by the second image processing unit. .   The recording control unit associates the first moving image data and the second moving image data with touch information including a touch position at which the touch panel detects a touch of an object from the outside and / or time information at which the touch is detected. The imaging apparatus according to claim 6, wherein recording is performed in the recording unit.   The imaging apparatus according to claim 6, wherein the second image has a smaller angle of view than the first image.   The display control unit synchronizes the first moving image data and the second moving image data when displaying the first moving image data and the second moving image data recorded in the recording unit on the display unit. The imaging device according to claim 10, wherein the imaging device is displayed on a screen.   The imaging apparatus according to claim 11, wherein the display control unit superimposes the second image reduced in a predetermined display area on the first image and causes the display unit to display the superimposed image.   The imaging device according to claim 11 or 12, wherein the display control unit switches display areas of the first image and the second image with an expression effect based on the touch information.   The display control unit performs an expression effect of gradually switching display areas of the first image and the second image, or an expression effect of gradually switching a composition ratio for synthesizing the second image with the first image. The image pickup apparatus according to claim 13, wherein the image pickup apparatus is displayed on the display unit. An imaging method executed by an imaging apparatus capable of capturing a first image and a second image having different angles of view and / or shooting positions,
A recording control step for performing control to record the first moving image data and the second moving image data obtained by continuously capturing the first image and the second image in time,
The recording control step includes
When the second image is intermittently recorded, a period during which the second image is not recorded is interpolated with another image. A program for causing an imaging device capable of capturing a first image and a second image having different angles of view and / or shooting positions to be executed,
A recording control step for performing control to record the first moving image data and the second moving image data obtained by continuously capturing the first image and the second image in time,
The recording control step includes
When the second image is intermittently recorded, a program in which a period during which the second image is not recorded is interpolated with another image.

Images