JP2016082263A - Image processing device, image processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing device, an image processing method and a program that can perform bracket imaging of photographic scenes, also perform bracket imaging of photographic scenes even in moving picture imaging, and provide a user in a desired shape with high probability.SOLUTION: An image processing device has analyzing means for analyzing photographic scenes on standby for imaging, plural bracket imaging means for changing different parameters, and bracket selecting means for selecting the bracket imaging from the plural bracket imaging means on the basis of the analysis result of the photographic scenes. When plural moving pictures are recordable, the follow range of AF/AE is expanded, and means for changing one of the parameters according to the selection result of the bracket selecting means and performing imaging of plural moving pictures is provided. The reproduction order is determined on the basis of the analysis result, and the recorded moving pictures are sequentially reproduced.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image processing method and program in an imaging apparatus that performs bracket shooting according to a subject.

  Even in the same shooting scene, the expression of the photograph changes variously depending on the shooting condition setting (exposure, focus position, WB, etc.) of the imaging device, and it is not easy for the user to select the shooting condition of the shooting scene. Therefore, when shooting a scene where shooting conditions are difficult, such as a scene with multiple subjects or a scene with high contrast, in order to prevent shooting failure or to enjoy different photographic expressions, Many digital cameras have been developed that have a bracket shooting function that allows shooting under multiple conditions with different focus positions and WB settings.

  Patent Document 1 discloses a digital camera capable of bracket photography. The digital camera of Patent Document 1 captures the same subject based on a plurality of parameters, generates a plurality of images, and displays the plurality of images at different timings for each parameter stage.

  However, in order to make full use of the above functions, users are required to have a knowledge level that can determine at least what kind of shooting conditions are effective for bracketing. It was difficult to carry out effective bracket shooting. Furthermore, it has been difficult to provide a user with an appropriate effect and an appropriate form for moving image shooting.

JP 2006-67464 A

  The present invention has been made in view of the above-described problems, and can perform bracket shooting of a shooting scene and bracket shooting of a shooting scene even in moving image shooting, and can be provided to a user as a desired form with high probability. An imaging device is provided.

  In order to solve the above problems, an imaging apparatus according to the present invention is based on an analysis unit that analyzes a shooting scene during shooting standby, a plurality of bracket shooting units that change different parameters, and an analysis result of the shooting scene, A bracket selection unit that selects bracket shooting from the plurality of bracket shooting units. If a plurality of moving images can be recorded, the tracking range of AF / AE is expanded, and the parameter is selected according to the selection result of the bracket selection unit. Means for taking a plurality of moving images by changing one of them, determining the order of reproduction based on the analysis result, and reproducing the recorded moving images continuously.

  According to the imaging apparatus of the present invention, the user can provide a moving image having a plurality of different expressions by appropriate bracket shooting without requiring complicated settings and advanced knowledge about the camera.

It is a block diagram showing an example of composition of an imaging device concerning an embodiment. It is a bracket imaging | photography process flowchart in embodiment of this invention. It is the flowchart which showed an example of the selection algorithm of a bracket kind. It is an example of the moving image file group produced | generated by this invention. It is an example of the moving image file group produced | generated by this invention.

Hereinafter, preferred embodiments of an image processing apparatus of the present invention will be described in detail with reference to the accompanying drawings.
[Example 1]
FIG. 1 is a block diagram illustrating an example of a configuration of an imaging apparatus according to the present embodiment. In FIG. 1, reference numeral 1 denotes a photographing optical system including a plurality of lens groups and a diaphragm mechanism, and includes a distance measuring lens (FocusLens), a zoom lens (ZoomLens), and a diaphragm mechanism. Reference numeral 2 denotes an image pickup device made of a CCD, a CMOS, or the like, and includes an A / D converter that converts an analog signal into a digital signal. The surface is covered with an RGB color filter such as a Bayer array, for example, so that color photographing is possible. When the subject image is formed on the image sensor 2, image data (image signal) is generated and stored in the memory 3.

  Reference numeral 3 denotes a memory, which can hold an image signal converted by the image sensor 2 and data necessary for processing of the entire image processing apparatus. An image processing circuit 4 performs predetermined pixel interpolation processing, color conversion processing, and the like on the image signal held in the memory 3. The image processing circuit 4 performs predetermined calculation processing using the captured image data, determines shooting conditions based on the obtained calculation result, and notifies the system control unit 5 of the shooting conditions. The image processing circuit 4 has functions such as image analysis, filter processing, and composition processing, and includes a bracket processing selection unit that selects bracket shooting processing of a shooting scene according to an algorithm described later.

  A system control unit 5 controls the entire photographing system. In order to perform shooting under the shooting conditions determined by the image processing circuit 4, the control of the shutter speed, the aperture mechanism, the focus lens and the zoom lens is integrated, and the exposure amount control unit 6, the focus lens control unit 7, and the focal length control, respectively. The unit 8 is instructed. An exposure amount control unit 6 adjusts the aperture mechanism of the optical system 1, the exposure time of the image sensor 2, and the photographing sensitivity, and performs appropriate exposure amount control. A focus lens control unit 7 controls the focus lens of the optical system 1.

  A focal length control unit 8 controls the zoom lens of the optical system 1 and changes the focal length in accordance with an instruction from the system control unit. A compression circuit 9 compresses the image into JPEG or the like, and the generated image is recorded on the recording medium 10. Reference numeral 11 denotes a display unit that reads a captured image generated by the image processing circuit 4 from a memory and displays the image on an LCD or an external monitor on the imaging apparatus.

  Next, the bracket selection processing algorithm according to the embodiment of the present invention will be described below. FIG. 2 is a flowchart of the bracket photographing process in the present invention. First, in step S100, the shooting scene is analyzed during EVF. For the analysis of the photographic scene, subject detection results (step S101) such as person detection and main subject detection by face detection, camera and subject motion detection results (step S102), and hist analysis of the electronic viewfinder (hereinafter EVF) display image The result (step S103) and the focus scan result (step S104) are used. In step S110, the camera automatically determines the type of bracket shooting according to the scene analysis result.

  Here, as the bracket type, various types of brackets such as an exposure bracket for changing the exposure amount, a focus bracket for changing the focus position, and a WB bracket for changing the white balance coefficient can be selected. Has at least two bracket photographing means among the bracket photographing.

  Hereinafter, as an example, a camera having functions of an exposure bracket, a focus bracket, and an image processing filter bracket will be described as an example, and an algorithm related to bracket type selection will be described with reference to FIG.

  FIG. 3 is a flowchart showing an example of the bracket type selection algorithm in step S110. Details will be described below. In S200 of FIG. 3, subject determination is performed according to the subject detection result of S101 of FIG. 2, and the subject branches into three types of scenes where no specific subject exists such as a person, a thing, or a landscape scene.

  Next, in S201, motion determination based on the motion detection result in S102 of FIG. 2 is performed. When it is determined that there is at least one subject within the shooting angle of view and subject motion has occurred, subject enlargement is selected. The purpose of subject enlargement is to emphasize the main subject such as sports and athletic meet and make it easier to confirm facial expressions. As a means for detecting the movement of the subject, a method of tracking the subject in the EVF display image using pattern matching or the like and detecting the amount of movement may be adopted.

  Next, in S202, focus determination based on the focus scan result in S104 of FIG. 2 is performed. Here, for each subject included in the shooting angle of view, the distance from the camera to the subject and the distance from the subject to the background are estimated. When there are multiple subjects and their distances are different, drive the focus lens from the far side or the near side and drive it to the near side or far side to initially blur the subject intentionally. Shoot a video. As a result, the user who is viewing the moving image first imagines what kind of subject is shown, so that the effect of expanding the imagination can be obtained as compared with a moving image in which the subject is always clear.

  Next, in S203, a histogram determination based on the histogram analysis result in S103 of FIG. 2 is performed. Here, a luminance histogram in the EVF display image is generated, and contrast determination is performed from the distribution of the histogram. If it is determined that the scene has a large contrast difference and the exposure setting is difficult, exposure bracket shooting in which the exposure is changed and movie shooting is prioritized. In this case, recording is started from overexposure or underexposure. As a result, the user who is watching the moving image like the focus bracket first imagines what kind of subject is reflected, so that the effect of expanding the imagination can be obtained as compared with the moving image in which the subject is always clear.

  Depending on the determination results of S201 to S203, it may be determined that any bracket shooting is not effective, but in this case, it is determined that the scene does not require bracket shooting and normal movie shooting is performed. Do.

  Next, a description will be given of a case where it is determined that the above-described focus bracket shooting and exposure bracket shooting are both possible scenes. At this time, as shown in FIG. 3, when the subject is a person, priority is given to exposure bracket shooting according to the result of the histogram determination, and when the subject is mono, priority is given to focus bracket shooting.

  According to the algorithm described above, it is possible for the camera to automatically determine an appropriate bracket type according to the shooting scene information obtained during shooting standby. As another embodiment of the present invention, it is possible to change the combination of bracket shooting types and determination conditions to realize a configuration different from the bracket selection algorithm described above.

  Next, in step S120 of FIG. 2, bracket shooting corresponding to the bracket type selected in step S110 is performed. Image data obtained by shooting a plurality of images is stored in the memory 03 of FIG.

  In step S130 of FIG. 2, various image processing using the image processing circuit 04 of FIG. 1 is performed. Here, a special color effect is added by the color conversion process of step S131, gamma conversion is performed by the contrast conversion process of step S133, and image processing such as an enlargement process of the subject is performed by the image cutout process of step S134. It is possible to perform a bracketing process for creating more video variations from a plurality of videos. FIG. 4 shows an example of generating an image to which various effects are added by performing bracket processing by image processing in step S130 on the bracket photographed image.

  In FIG. 4, bracket 1 indicates the bracket shooting type selected by the bracket selection in S110 of FIG. The bracket 1 performs bracket shooting with respect to the selected one type of parameter, and shoots a moving image of N files (in the example, exposure bracket, N = 3). FIG. 4a shows an example of a focus bracket, and FIG. 4b shows an example of an exposed bracket.

  The bracket 2 is a bracket process that is processed by the image processing in S130 of FIG. 2 when the bracket 1 is in the focus position or at the proper exposure. In FIG. 4, a process for converting the color is set. Multiple variations are generated. Therefore, finally, a plurality of moving images with different focus, exposure setting, and color are generated for one shooting. By continuously reproducing these moving images, it is possible to shoot moving images with various effects even without a large scene change, and to present different image expressions to the user. Further, the recording time of moving images having different effects may be fixed for a predetermined time, or a mechanism that allows the user to select may be provided. Furthermore, the time required for the focus to move from the far side to the in-focus position may be set.

  In step S140, when the focus bracket is employed in S120, a moving image that intentionally blurs the subject near the end of the moving image is shot by further driving the focus lens in the same direction as S120 from the in-focus position. As a result, the user who is watching the moving image imagines the final state when the moving image is finished, so that the effect of expanding the imagination can be obtained as compared with the moving image in which the subject is clear to the end.

  If the exposure bracket shooting is adopted in S120, the exposure is gradually set to an over or under state and the recording is finished. As a result, the user who is watching the moving image like the focus bracket imagines the state of the end when the moving image ends, so that the effect of expanding the imagination can be obtained compared to the moving image in which the subject is clear to the end.

  In this embodiment, after changing the focus and exposure settings, the color is changed, and then the focus and exposure settings are changed. As described above, since the moving images in which the plurality of effects are obtained are left as recorded data, means for changing the order may be provided to the user.

  As described above, the invention based on the present embodiment automatically reduces the probability of shooting failure by automatically selecting an appropriate bracket shooting according to the shooting scene analysis result, and is highly desired by the user. Videos can be provided. In addition, by combining a plurality of image processes such as color effects and image cutouts on the captured image, the user can easily obtain a moving image having a plurality of different expressions.

1 optical system, 2 image sensor, 3 memory, 4 image processing circuit, 5 system control unit,
6 exposure amount control unit, 7 focus lens control unit, 8 focal length control unit, 9 compression circuit,
10 recording medium, 11 display section

Claims (5)

Analysis means for analyzing the shooting scene during shooting standby;
A plurality of bracket photographing means for changing different parameters;
Based on the analysis result of the shooting scene, with bracket selection means for selecting bracket shooting from the plurality of bracket shooting means,
If multiple videos can be recorded, the AF / AE tracking range is expanded,
According to the selection result of the bracket selection means, provided with means for changing the one of the parameters to perform a plurality of video shooting,
Determine the playback order based on the analysis results,
A moving image imaging apparatus characterized by continuously playing back a recorded moving image. In the bracket selection means,
If there is a distance difference in the subject included in the shooting scene, focus bracket shooting,
If the shooting scene contrast is high, exposure bracket shooting,
If there are multiple colors in the shooting scene, WB bracket shooting,
If the subject or the imaging device is moving,
The moving image capturing apparatus according to claim 1, wherein the moving image capturing apparatus is selected. According to the shooting scene analysis result,
The moving image capturing apparatus according to claim 1, wherein the shooting order or the playback order of the bracket selection is changed. For the shooting scene analysis,
4. The moving image imaging apparatus according to claim 1, wherein subject distance information obtained from a plurality of AF frames and color and luminance information obtained by a plurality of area divisions are used. 5. .   5. The moving image capturing apparatus according to claim 1, further comprising a unit that can arbitrarily change a reproduction order of a plurality of captured moving images. 6.