JP2016184947A - Imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device in which an imaging unit is rotatable around the axis with respect to a main body and different image processing can be performed according to the imaging direction of the imaging unit.SOLUTION: An imaging device includes a first imaging unit for imaging a subject to generate first image data, a second imaging unit that is secured to the first imaging unit so that the imaging direction is rotatable, and generates second image data, a detector for detecting a first imaging direction and a second imaging direction as the imaging direction of the second imaging unit, a first image processor for performing image processing on the first image data, a second image processor for performing image processing on the second image data, and a controller for setting the operation of the first image processor and the second image processor according to the imaging direction. The controller operates the first image processor and the second image processor interlockingly with each other when the imaging direction is the first imaging direction, and operates the first image processor and the second image processor independently of each other when the imaging direction is the second imaging direction.SELECTED DRAWING: Figure 4

Description

  The present disclosure relates to an imaging apparatus.

  A digital camera as shown in Patent Document 1 can capture a scene viewed by a photographer in the form of a still image or a moving image. In recent years, digital cameras have evolved in various ways, and user satisfaction has increased.

JP 2010-154426 A

  As an example of a camera form that has evolved from a conventional digital camera, a camera form in which a camera unit that is an imaging unit can rotate about an axis with respect to the main body can be considered. As the camera unit rotates about the axis with respect to the main body, the degree of freedom in the shooting direction is wider than that of a conventional digital camera. On the other hand, in photographing, it is desired that an image can be photographed with a suitable image quality according to the scene. Accordingly, it has become necessary to cope with the image quality in accordance with the expansion of the degree of freedom in the photographing direction.

  In order to solve the above problem, an imaging apparatus according to the present disclosure is attached to a first imaging unit that captures an image of a subject and generates first image data, and a shooting direction that is rotatable with respect to the first imaging unit. A second imaging unit that generates second image data; a detection unit that detects a first imaging direction and a second imaging direction as imaging directions of the second imaging unit; and a first image generated by the first imaging unit. A first image processing unit that performs image processing on the data, a second image processing unit that performs image processing on the second image data generated by the second imaging unit, and a first direction according to the shooting direction detected by the detection unit A control unit configured to set operations of the image processing unit and the second image processing unit.

  The first shooting direction is closer to the shooting direction of the first imaging unit, the second shooting direction is closer to the photographer side than the first shooting direction, and the control unit detects that the shooting direction detected by the detection unit is the first shooting direction. When the shooting direction is one, the first image processing unit and the second image processing unit are operated in conjunction with each other, and when the shooting direction detected by the detection unit is the second shooting direction, the first image processing unit And the second image processing unit are operated independently.

  The present disclosure provides an imaging apparatus capable of performing suitable image processing on a subject photographed by a rotatable imaging unit.

(A), (b) The perspective view for showing the outline | summary of the imaging device which concerns on embodiment (A), (b) The figure which shows the usage example of the imaging device which concerns on embodiment (A), (b) The figure which shows the example of an image displayed on the display part of the imaging device which concerns on embodiment The figure which shows the electrical constitution of the imaging device which concerns on embodiment (A), (b) The flowchart which shows imaging | photography operation | movement of the imaging device which concerns on embodiment. (A)-(c) The flowchart which shows the image processing operation | movement of the imaging device which concerns on embodiment. (A), (b) The figure which shows the outline | summary of the white balance correction | amendment of the imaging device which concerns on embodiment. (A), (b) The figure which shows the outline | summary of exposure correction | amendment of the imaging device which concerns on embodiment

  Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.

  In addition, the inventors provide the accompanying drawings and the following description in order for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims. Absent.

[Embodiment 1]
[1. Overview〕
First, an outline of the imaging apparatus 10 will be described with reference to the drawings. 1A and 1B are perspective views for explaining the outline of the imaging apparatus 10. FIGS. 2A and 2B are diagrams illustrating a usage example of the imaging apparatus 10. FIGS. 3A and 3B are diagrams illustrating examples of images displayed on the display unit 220 of the imaging apparatus 10. FIGS. 1A, 2A, and 3A are diagrams corresponding to the state where the sub camera 300 is in the state 1, and FIGS. 1B, 2B, and 3B are illustrated. ) Shows a diagram corresponding to when the sub camera 300 is in the state 2. FIG.

  As illustrated in FIGS. 1A and 1B and FIGS. 2A and 2B, the imaging apparatus 10 includes a main camera 100, a display unit 220, and a sub camera 300. The main camera 100 is disposed in the main body of the imaging device 10. The display unit 220 is joined to the main body of the imaging apparatus 10 so as to be biaxially rotatable at the hinge unit. The sub camera 300 is mounted on the display unit 220 so as to be rotatable about the axis. The main camera 100 images a subject that the photographer mainly wants to shoot. Since the sub camera 300 can rotate with respect to the main camera 100, it can capture a subject in a shooting direction different from that of the main camera 100. As shown in FIGS. 3A and 3B, the display unit 220 displays a PinP (Picture in Picture) image in which an image captured by the sub camera 300 is superimposed on an image captured by the main camera 100. indicate. Hereinafter, for convenience of explanation, an image shot by the main camera 100 is referred to as a main image 222, and an image shot by the sub camera 300 is referred to as a sub image 221. The main camera 100 and the sub camera 300 are an example of an imaging unit.

  Next, a usage example of the imaging device 10 will be described with reference to FIG. As shown in FIG. 2, during normal use, the photographer uses the imaging apparatus 10 such that the photographing direction of the main camera 100 faces the front direction of the photographer. At this time, the photographer rotates the display unit 220 so that the image displayed on the display unit 220 can be confirmed. The sub-camera 300 can realize a state (state 1) in which the photographing direction faces the photographer as shown in FIG. 2A by rotating around the axis. Further, the sub camera 300 can be rotated around the axis to realize a state (state 2) in which the photographing direction is not directed to the photographer as shown in FIG.

  Note that the state of the sub camera 300 when the shooting direction of the sub camera 300 faces the display unit 220 is a state in which the sub camera 300 is housed (hereinafter, housed state).

  In the present embodiment, when the sub camera 300 is in the state 1, the sub camera 300 captures the photographer. In contrast, in this embodiment, when the sub camera 300 is in the state 2, the sub camera 300 captures the same subject as the main camera 100. The imaging apparatus 10 performs different image processing in the state 1 and the state 2 in accordance with the subject being different in the state 1 and the state 2 of the sub camera 300.

[2. Electrical configuration)
Next, the electrical configuration, control system, and image processing of the main camera 100 and the sub camera 300 of the imaging apparatus 10 will be described with reference to FIG.

[2-1. Main camera electrical configuration)
First, the electrical configuration of the main camera 100 will be described with reference to FIG. The main camera 100 captures a subject image formed by the main optical system 110 including one or a plurality of lenses with a CMOS image sensor 140. Image data generated by the CMOS image sensor 140 is converted into a digital signal by an A / D converter (ADC) 150 and then subjected to various processes by the main image processing unit 160 and stored in the memory card 200. Are displayed on the display unit 220.

  The main optical system 110 includes a zoom lens 111, a camera shake correction lens 112, a focus lens 113, a diaphragm 114, and the like. The zoom lens 111 is moved along the optical axis, thereby enabling enlargement and reduction of the subject image. In addition, the focus lens 113 is moved along the optical axis, so that the focus of the subject image can be adjusted. Further, the camera shake correction lens 112 is movable in a plane perpendicular to the optical axis of the main optical system 110. By moving the camera shake correction lens 112 in a direction in which the blur of the imaging device 10 is canceled, it is possible to reduce the influence of the blur of the imaging device 10 on the captured image. The diaphragm 114 adjusts the amount of transmitted light by adjusting the size of the opening in accordance with the setting of the user or automatically.

  The main lens driving unit 120 includes actuators that drive the zoom lens 111, the camera shake correction lens 112, the focus lens 113, and the diaphragm 114, respectively. And the main lens drive part 120 controls each actuator, for example.

  The CMOS image sensor 140 captures a subject image formed by the main optical system 110 and generates image data. The CMOS image sensor 140 performs various operations such as exposure, transfer, and electronic shutter.

  The A / D converter 150 converts analog image data generated by the CMOS image sensor 140 into digital image data.

  The main image processing unit 160 performs various processes on the image data generated by the CMOS image sensor 140 and generates image data to be displayed on the display unit 220. The main image processing unit 160 generates image data to be stored in the memory card 200. For example, the main image processing unit 160 performs various processes such as gamma correction, white balance (WB) correction, sharpness correction, and flaw correction on the image data generated by the CMOS image sensor 140. The main image processing unit 160 converts the image data generated by the CMOS image sensor 140 into H.264. It compresses by the compression format etc. based on H.264 standard or MPEG2 standard.

  In the present embodiment, the main image processing unit 160 includes a PinP processing unit 390. FIGS. 3A and 3B are examples of images that are superimposed by the PinP processing unit 390 and displayed on the display unit 220. The PinP processing unit 390 superimposes the sub image 221 on the main image 222 (PinP processing). The PinP-processed sub-image 221 can be changed in position and size in the through image displayed on the display unit 220. At this time, it is desirable to perform PinP processing so that the main image 222 is larger than the sub image 221.

[2-2. Sub-camera electrical configuration)
Next, the electrical configuration of the sub camera 300 will be described with reference to FIG. The sub camera 300 captures a subject image formed by the sub optical system 310 including one or a plurality of lenses with the CMOS image sensor 340. The image data generated by the CMOS image sensor 340 is converted into a digital signal by an A / D converter (ADC) 350 and then subjected to various processing by the sub image processing unit 360 and stored in the memory card 200, or Are displayed on the display unit 220.

  The sub optical system 310 includes a focus lens 313, a diaphragm 314, and the like. Since the configuration of each element is the same as that of the main camera 100, a detailed description is omitted. Note that the types of elements constituting the sub optical system 310 of the sub camera 300 are not limited to the focus lens 313 and the aperture 314, and may include a zoom lens, a camera shake correction lens, and the like.

  The main configurations of the sub lens driving unit 320, the CMOS image sensor 340, the A / D converter 350, and the sub image processing unit 360 included in the sub camera 300 are the main lens driving unit 120, the CMOS image sensor 140, and A included in the main camera 100. Since it is the same as the main configuration of the / D converter 150 and the main image processing unit 160, the detailed description is omitted. When a fixed-focus optical system is used as the sub optical system 310 of the sub camera 300, the sub lens driving unit 320 may not be present.

[2-3. Control system)
The sub image processing unit 360 sends the image data that has been subjected to various types of processing to the PinP processing unit 390. The PinP-processed image data is stored in the memory card 200. Alternatively, the PinP processed image data is displayed on the display unit 220.

  Image data that has undergone image processing or PinP processing is sent to the controller 180. The controller 180 is a control unit that controls the entire imaging apparatus 10. The controller 180 can be realized by a semiconductor element or the like. The controller 180 may be configured only by hardware, or may be realized by combining hardware and software. The controller 180 can be realized by a microcomputer or the like.

  The direction sensor 380 detects the shooting direction of the sub camera 300. At this time, the orientation sensor 380 detects at least whether the sub camera 300 is in state 1 or state 2. The result detected by the orientation sensor 380 is notified to the controller 180. Thereby, the controller 180 can grasp the shooting direction (state 1 and state 2) when the sub camera 300 rotates about the axis. The direction sensor 380 can be realized using a switching mechanism, a magnet, a variable resistor, or the like.

  The buffers 170 and 370 function as work memories for the main image processing unit 160, the sub image processing unit 360, and the controller 180. The buffers 170 and 370 can be realized by, for example, a DRAM or a ferroelectric memory.

  The card slot 190 is detachable from the memory card 200. The card slot 190 can be mechanically and electrically connected to the memory card 200. The memory card 200 includes a flash memory, a ferroelectric memory, and the like, and can store data such as image files generated by the main image processing unit 160 and the sub image processing unit 360.

  The internal memory 240 is composed of a flash memory or a ferroelectric memory. The internal memory 240 stores a control program for controlling the entire imaging apparatus 10 and the like.

  The operation member 210 is a generic name for a user interface that receives an operation from a user. The operation member 210 includes, for example, a cross key that accepts an operation from a user, a determination button, and the like. The operation member 210 also has a moving image recording button, a moving image reproduction button, and the like. The moving image recording button receives an instruction to start / stop moving image recording by the user. The moving image playback button receives an instruction to start / stop playback of moving image data by the user. The moving image recording button will be described below as a button that uses both a moving image recording start instruction when moving images are not recorded and a moving image recording stop instruction when moving images are recorded, but is not limited thereto. A moving image recording stop button may be provided separately from the moving image recording start button. The moving image recording button or the like may be a hard key provided on the exterior of the imaging apparatus 10. The moving image recording button or the like may be a soft key for operating a button icon displayed on the display unit 220 via a touch panel.

  The display unit 220 can display an image indicated by the image data generated by the CMOS image sensor 140, an image subjected to the superimposition processing by the PinP processing unit 390, and an image indicated by the image data read from the memory card 200. The display unit 220 can also display various menu screens for performing various settings of the imaging device 10.

  In FIG. 4, the PinP processing unit 390 is shown to be built in the main image processing unit 160, but the present disclosure is not limited to this. The PinP processing unit 390 may be built in the sub image processing unit 360 or may exist independently.

  Further, the image data sent from the sub image processing unit 360 to the PinP processing unit 390 may pass through the buffer 370. Accordingly, the image data of the sub image 221 is temporarily stored in the buffer 370, so that the image data of the main image 222 and the image data of the sub image 221 can be sent to the controller 180 at the same timing.

  In addition, the buffer 170 that functions as the work memory of the main camera 100 and the buffer 370 that functions as the work memory of the sub camera 300 exist. However, the present disclosure is not limited to this. There may be one buffer or three or more buffers.

[2-4. Image processing〕
Subsequently, white balance correction, exposure correction, and sharpness correction will be described as examples of image processing performed by the main image processing unit 160 and the sub image processing unit 360.

[2-4-1. (White balance correction)
First, white balance correction performed by the main image processing unit 160 and the sub image processing unit 360 will be described. Each image processing unit of the main camera 100 and the sub camera 300 corrects the white balance of the image data by adjusting the color of the image. The controller 180 estimates the light source from the image data. For example, as shown in FIG. 7A, a plurality of light source estimation ranges are set on the coordinates of R data and B data. In the example shown in FIG. 7A, four light source estimation ranges A1 to A4 are set for the incandescent lamp, the fluorescent lamp, the clear sky, and the shade. The light source estimation unit of the controller 180 can estimate a light source used as a reference for white balance correction based on which light source estimation range the input data of image data is distributed over. The main image processing unit 160 and the sub image processing unit 360 control the tracking range of white balance correction based on the light source estimated by the light source estimation unit. At this time, it is desirable that the tracking range is included in the light source estimation range. Each image processing unit adjusts the color of the image by adjusting the R gain, the B gain, and the G gain within the tracking range of the white balance correction. For example, when the image is reddish, each image processing unit performs correction such as decreasing the R gain and increasing the B gain or the G gain. Details of the WB correction shown in FIGS. 7A and 7B will be described later.

[2-4-2. (Exposure compensation)
Next, exposure correction performed by the main image processing unit 160 and the sub image processing unit 360 will be described. Each image processing unit corrects the exposure of the image data by adjusting the brightness of the image. The controller 180 determines the brightness of the image based on the luminance information of the image data. At this time, a photometer (not shown) may be used, or the obtained image data may be analyzed. In accordance with the luminance information obtained from the image data, each image processing unit corrects the exposure to be negative when the image is too bright (overexposure) than the reference value for proper exposure. Each image processing unit corrects the exposure to plus if the image is too dark (underexposure) than the reference value for proper exposure. By such correction, the image is exposed properly. Examples of a method for correcting exposure include a method of adjusting the diaphragms 114 and 314, a method of adjusting a contrast value using the main image processing unit 160 and the sub image processing unit 360, and the like. Further, as described later, when determining appropriate exposure, a part of an image may be weighted according to a user setting, or the entire image may be handled on an average.

[2-4-3. Sharpness correction)
Finally, the sharpness correction performed by the main image processing unit 160 and the sub image processing unit 360 will be described. Each image processing unit corrects the sharpness of image data by adjusting the contrast of the image. The controller 180 analyzes the luminance difference of each pixel of the image data. Each image processing unit enhances the luminance difference between each pixel of the image data when sharpening the image. Each image processing unit reduces the luminance difference between the pixels of the image data when the image is softened. When capturing a landscape or the like, it is desirable to enhance the luminance difference between each pixel of the image data in order to make the color of the image stand out. When a person is imaged, it is desirable to reduce the luminance difference between the pixels of the image data in order to make the shadows and wrinkles of the face inconspicuous.

[3. Operation)
Subsequently, the operation of the imaging apparatus 10 will be described. FIG. 5A is a flowchart showing the photographing operation of the main camera 100, and FIG. 5B is a flowchart showing the photographing operation of the sub camera 300.

[3-1. (Main camera operation)
First, the operation of the main camera 100 will be described with reference to FIG. For simplicity, it is assumed that the imaging apparatus 10 is set to the shooting mode.

  When the power supply of the imaging apparatus 10 is turned on (step S100), the controller 180 supplies necessary power to each unit constituting the imaging apparatus 10 (step S101). When power is supplied, the main lens driving unit 120 and the CMOS image sensor 140 are initialized to an operable state (step S102). When the initial setting is completed, the CMOS image sensor 140 starts imaging the subject (step S103). Image data captured by the CMOS image sensor 140 is sent to the main image processing unit 160 (step S104).

  Here, the controller 180 detects whether or not the sub image 221 exists (step S105). If there is no sub-image 221 (No in step S105), the display unit 220 starts displaying a through image based on the image data generated by the CMOS image sensor 140 (step S107). At this time, a through image of the main image 222 is displayed on the display unit 220. The user determines the angle of view while viewing the through image displayed on the display unit 220, and presses the moving image recording button of the operation member 210 at a timing suitable for starting moving image recording. When the sub image 221 is present (Yes in step S105), the PinP process is performed (step S106), and then the through image subjected to the PinP process shown in FIGS. 3A and 3B is displayed on the display unit 220. (Step S107). Details will be described later together with the operation of the sub camera 300.

  The controller 180 monitors whether or not the moving image recording button has been pressed (step S108). The controller 180 stands by in the state of S108 until the moving image recording button is pressed. When the moving image recording button is pressed (Yes in step S108), the controller 180 starts recording moving image data based on the image captured by the CMOS image sensor 140 to the memory card 200 (step S109). Before the moving image data is written in the memory card 200, the moving image data may be temporarily stored in the buffer 170. At this time, when the data amount of the moving image data stored in the buffer 170 exceeds a certain amount, the controller 180 writes the moving image data with the data amount exceeding the certain amount to the memory card 200. May be.

  The controller 180 again monitors whether or not the moving image recording button has been pressed (step S110). Until the moving image recording button is pressed, the controller 180 continues recording moving image data in the state of step S110. When the moving image recording button is pressed again (Yes in step S110), the controller 180 ends the recording of the moving image data. Then, returning to step S103, the CMOS image sensor 140 captures the subject image again.

[3-2. Operation of sub camera)
Next, the basic operation of the sub camera 300 and the detailed operation of image processing will be described.

[3-2-1. basic action〕
First, the basic operation of the sub camera 300 will be described with reference to FIG. Here, for the sake of simplicity, description will be made assuming that the imaging apparatus 10 has already been set to the shooting mode.

  When the power of the imaging apparatus 10 is turned on (step S200) and power is supplied to the controller 180, the controller 180 always monitors whether the sub camera 300 is activated (step S201). When the user activates the sub camera 300 (Yes in step S201), necessary power is supplied to each unit constituting the sub camera 300 (step S202). At this time, when the orientation sensor 380 detects the rotation of the sub camera 300 from the housed state, the sub camera 300 is activated. Note that there may be an activation button for activating the sub camera 300, and the sub camera 300 may be activated by turning on the activation button. When power is supplied, the sub-lens driver 320 and the CMOS image sensor 340 perform initial setting to an operable state (step S203). When the initial setting is completed, the CMOS image sensor 340 starts imaging of the subject (step S204). Image data captured by the CMOS image sensor 340 is sent to the sub-image processing unit 360, and image processing is performed (step S205).

  When the above-described operation is performed in the sub camera 300, it is determined in step S105 in FIG. 5A that the sub image 221 exists (Yes in S105). The sub image 221 is subjected to various processes by the sub image processing unit 360 and then subjected to PinP processing by the PinP processing unit 390 (step S106). The PinP processed image is displayed as a through image on the display unit 220 in a state where the main image 222 and the sub image 221 are superimposed as shown in FIGS. 3A and 3B (step S107). Thereafter, a recording operation (step S108 to step S111) is performed.

  In the recording operation, each superimposed image may be individually compressed and recorded as different data. Alternatively, each image may be compressed and recorded as one data.

  As described above, the sub camera 300 can image a subject different from the main camera 100 by rotating. That is, the sub-camera 300 has at least two states, a state 1 where there is a high possibility of capturing a photographer and a state 2 where the possibility of capturing a photographer is low. The imaging apparatus 10 according to the present embodiment uses different image processing parameter setting methods for images captured by the sub camera 300 in accordance with states 1 and 2 respectively.

  Specifically, in state 1, there is a high possibility that the sub camera 300 is photographing the photographer at a short distance. Therefore, the sub image processing unit 360 uses a method for setting image processing parameters different from that of the subject imaged by the main camera 100. On the other hand, in state 2, there is a high possibility that the sub camera 300 is imaging a subject that is close to the main camera 100. Therefore, the sub image processing unit 360 uses the same image processing parameter setting method as that of the main camera 100. Hereinafter, image processing (white balance correction, exposure correction, sharpness correction) in each state will be described.

[3-2-2. (White balance correction)
First, white balance correction will be described. In the imaging apparatus 10, different white balance correction can be performed on the sub image 221 depending on the state of the sub camera 300. Details will be described below with reference to FIG.

  FIG. 6A is a flowchart showing the image processing operation for white balance correction in step S205 shown in FIG. In step S11 of FIG. 6A, the CMOS image sensor 340 captures a subject image as in step S204 of FIG. 5B. At the same time, the sub image processing unit 360 detects the state of the sub camera 300 (step S12). In the present embodiment, regarding the state detection, the detection value of the orientation sensor 380 is configured to be received by the sub image processing unit 360 via the controller 180. However, the sub image processing is directly performed without using the controller 180. The unit 360 may receive it. As a result of detecting the state of the sub camera 300, when the sub camera 300 is in state 1 (Yes in step S12), the sub image processing unit 360 performs WB correction 1 on the image data (step S13). As described above, in the state 1, the sub camera 300 is likely to capture the photographer at a short distance. Therefore, as the WB correction 1, the WB correction suitable for a person's face, that is, the skin color does not fade. I do. When the sub camera 300 is in state 2 (No in step S12), the sub image processing unit 360 performs WB correction on the image data generated by the main camera 100 with respect to the image data generated by the sub camera 300. Corresponding WB correction 2 is performed (step S14). Here, the WB correction 2 corresponding to the WB correction for the image data generated by the main camera 100 may be a correction using the same parameter as the parameter of the WB correction for the image data generated by the main camera 100. Alternatively, correction by a parameter obtained by multiplying a parameter for WB correction for image data generated by the main camera 100 by a predetermined coefficient may be used.

  Here, the WB correction 1 will be described in detail. FIG. 7A is a diagram showing an outline of WB correction, and light source estimation ranges A1, A2, A3, and A4 corresponding to four light sources, which are incandescent lamps, fluorescent lamps, clear sky, and shade, which are main light sources, are shown. Show. FIG. 7B is an enlarged view of the vicinity of the light source estimation range A1 in FIG.

  In the WB correction 1, the sub image processing unit 360 operates independently of the main image processing unit 160. The controller 180 estimates the light source based on the image data obtained from the sub camera 300 and notifies the sub image processing unit 360 of the tracking range of the WB correction. At this time, if the sub camera 300 is capturing a photographer, there is a high possibility that the photographer's skin is detected in large quantities and an incandescent lamp is estimated as a light source. When an incandescent lamp is estimated as the light source, WB correction is performed within the range of the light source estimation range A1 shown in FIG. Then, by the WB correction, the sub-image 221 may be a pale image that cancels the redness of the photographer's skin, a so-called blue fog image. That is, in this case, the sub image 221 is an image in which the skin color of the photographer is faded. However, it is conceivable that such an image cannot adequately express the photographer's skin color and the photographer feels dissatisfied.

  Therefore, in the imaging apparatus 10 according to the present embodiment, when the sub camera 300 is in the state 1, in order to appropriately reproduce the photographer's skin, as shown in FIGS. The range in which the processing unit 360 performs WB correction is limited. That is, by limiting the range of WB correction performed by the sub image processing unit 360 to the tracking range B, the WB correction is limited so as not to follow the lower color temperature side (WB correction 1). Due to this limitation, the imaging apparatus 10 can prevent the photographer's skin from being faded even if the sub-image processing unit 360 estimates a low color temperature range as in the case of an incandescent lamp as a light source. It becomes possible.

  Note that the method of limiting the WB correction is not limited to the method of controlling the tracking range on the low color temperature side. For the captured image, light source estimation may be performed by weighting the image peripheral portion where the photographer's face is unlikely to be captured, and when analyzing the image data generated by the sub image processing unit 360 The light source may be estimated without intentionally referring to the data on the low color temperature side. By doing so, it can suppress that the sub image process part 360 estimates the light source of the low color temperature side. Further, it is possible to limit the following range of the WB correction not only on the low color temperature side but also on the high color temperature side to prevent the occurrence of red fog in the image.

  Next, WB correction 2 will be described. In the WB correction 2, the sub image processing unit 360 operates in conjunction with the main image processing unit 160. The controller 180 estimates the light source based on the image data obtained from the main camera 100, and notifies the sub image processing unit 360 of the range for performing WB correction based on the estimated light source. For example, when an incandescent lamp is estimated as the light source, as shown in FIG. 7B, the controller 180 notifies the sub-image processing unit 360 of the tracking range C1 in which the main image processing unit 160 performs WB correction. To do. When the main image processing unit 160 performs WB correction within the tracking range C1, the sub image processing unit 360 also performs WB correction within the tracking range C2, which is the same range. Due to this limitation, the imaging apparatus 10 according to the present embodiment can perform the same WB correction on the image obtained from the main image processing unit 160 and the image obtained from the sub image processing unit 360. Therefore, when the PinP process is performed, it is possible to suppress the generation of an uncomfortable image in which images having different colors are superimposed and displayed.

[3-2-3. (Exposure compensation)
Next, exposure correction will be described. In the imaging apparatus 10, different automatic exposure (AE) corrections can be performed on the sub image 221 depending on the state of the sub camera 300. FIG. 8 is a diagram in which weighting is set for a photometric portion of an image during AE correction. In FIG. 8, a stronger weight is assigned to a smaller number. Details will be described below with reference to FIGS.

  In FIG. 6B, the process up to step S22 is the same as the process up to step S12 in FIG. When the sub camera 300 is in state 1 as a result of detecting the shooting direction (Yes in step S22), the sub image processing unit 360 is suitable for a human face with respect to the image data, and the photographer's face has an appropriate brightness. An AE correction 1 is performed (step S23). When the sub camera 300 is in the state 2 (No in step S22), the sub image processing unit 360 gives the image data generated by the sub camera 300 to the image data generated by the main camera 100. AE correction 2 corresponding to the image processing parameter is performed (step S24). Here, the AE correction 2 corresponding to the AE correction for the image data generated by the main camera 100 may be correction using the same parameters as the parameters for the AE correction for the image data generated by the main camera 100. Alternatively, correction by a parameter obtained by multiplying a parameter for AE correction for image data generated by the main camera 100 by a predetermined coefficient may be used.

  Here, the AE correction 1 will be described in detail. The controller 180 detects luminance information of the image data and performs AE correction. When the sub camera 300 is in the state 1, it is highly likely that the sub camera 300 is capturing a photographer. Therefore, excessively referring to the luminance information in the periphery of the image where the photographer's face is not imaged may cause the photographer's face to become too bright or too dark depending on the brightness of the background. It is done. However, such an image cannot appropriately express the photographer's face, and the photographer is likely to feel dissatisfied.

  Therefore, in the imaging apparatus 10 according to the present embodiment, when the sub camera 300 is in the state 1, in order to appropriately express the brightness of the photographer's face, as shown in FIG. Gives more weight to the center of By this weighting, the sub-image processing unit 360 focuses light on the center of the image, so that an image with brightness suitable for the photographer's face can be obtained.

  Next, AE correction 2 will be described. In the AE correction 2, the sub image processing unit 360 operates in conjunction with the main image processing unit 160. When the main image 222 is not weighted by the user setting, the main image processing unit 160 and the sub image processing unit 360 both have a specific part of the image as shown in FIG. Measure the light without weighting. Thereby, the imaging apparatus 10 according to the present embodiment can perform the same AE correction corresponding to the image obtained from the main image processing unit 160 and the image obtained from the sub image processing unit 360. Therefore, when the PinP process is performed, it is possible to suppress the generation of an uncomfortable image in which images with different brightness are superimposed and displayed.

  Note that, in the case of AE correction 2, if the main image 222 is weighted for metering, the sub-image 221 may be metered without weighting as shown in FIG. Good. Further, the sub-image 221 may be subjected to photometry in the same manner as the main image 222 or independently.

[3-2-4. Sharpness correction)
Finally, the sharpness correction will be described. The imaging apparatus 10 can perform different sharpness (SP) corrections on the sub image 221 depending on the state of the sub camera 300. Details will be described below with reference to FIG.

  The process up to step S32 in FIG. 6C is the same as that up to step S12 in FIG. When the sub camera 300 is in the state 1 as a result of detecting the shooting direction (Yes in step S32), the sub image processing unit 360 does not overemphasize contours and shadows suitable for a human face on the image data. Such SP correction 1 is performed (step S33). When the sub camera 300 is in state 2 (No in step S32), the sub image processing unit 360 performs SP correction 2 corresponding to the main camera 100 on the image data (step S34).

  The SP correction 1 and SP correction 2 will be described. The controller 180 analyzes the luminance difference of each pixel of the image data. For SP correction 1, the luminance difference between pixels is reduced so that the contour and shadow of the photographer's face are not emphasized too much. Thereby, a photographer's face can be expressed naturally. Regarding the SP correction 2, the sub image processing unit 360 performs SP correction corresponding to the main image processing unit 160 according to the user setting. Here, the SP correction 2 corresponding to the SP correction for the image data generated by the main camera 100 may be correction by the same parameter as the SP correction parameter for the image data generated by the main camera 100. Alternatively, correction by a parameter obtained by multiplying the SP correction parameter for the image data generated by the main camera 100 by a predetermined coefficient may be used. As a result, the imaging apparatus 10 can perform the same SP correction on the image obtained from the main image processing unit 160 and the image obtained from the sub image processing unit 360. Therefore, it is possible to suppress the generation of an uncomfortable image such that images with different clarity are superimposed and displayed when the PinP process is performed.

[4. (Summary)
In the present embodiment, for an image pickup apparatus provided with a sub camera 300 that can rotate with respect to the main camera 100, by performing optimal image processing according to the shooting direction of the sub camera 300, for example, the photographer's It is possible to appropriately express a face and to capture an image with no sense of incompatibility when performing PinP processing.

[5. Other Embodiments]
In the present embodiment, the sub camera 300 is attached to the display unit, but the present disclosure is not limited to this. As long as it can rotate around the axis, the imaging device may be attached to a place other than the display unit.

  In the present embodiment, the sub camera 300 captures the photographer in the state 1 and the sub camera 300 captures the same subject as the main camera 100 in the state 2. However, the present disclosure is not limited to this. Absent. A state in which the sub camera 300 is photographing the photographer in state 2 may be detected, and image processing suitable for a person's face may be performed. Further, in state 1, the sub camera 300 may not shoot the photographer and may not perform image processing suitable for a person's face.

  In the present embodiment, the sub camera 300 has two states, state 1 and state 2, but the present disclosure is not limited to this. For example, the state where the shooting direction of the main camera 100 and the shooting direction of the sub camera 300 are perpendicular to each other may be referred to as state 3 and may have three states. Each image processing unit may use an image processing parameter setting method corresponding to each state from state 1 to state 3.

  In the present embodiment, the sub camera 300 rotates about one axis, but the present disclosure is not limited to this. The sub camera 300 may rotate about two or more axes. Accordingly, the sub camera 300 can capture the same subject as the photographer or the main camera 100 regardless of the rotation state of the display unit.

  In the present embodiment, the captured image data is stored in the memory card 200, but the present disclosure is not limited to this. You may make it preserve | save on different recording media, such as an internal memory.

  Further, although the main image processing unit 160 and the sub image processing unit 360 have been described as separate bodies in the present embodiment, the present disclosure is not limited to this. You may implement | achieve by the integrated image processing part provided with the function of the main image process part 160, and the function of the sub image process part 360. FIG.

  The details of white balance correction, exposure correction, and sharpness correction are not limited to the present embodiment. If different image processing parameter setting methods are changed according to the photographing direction of the sub camera 300, other image processing can be applied.

  As described above, the embodiments have been described as examples of the technology in the present disclosure. For this purpose, the accompanying drawings and detailed description are provided.

  Accordingly, among the components described in the accompanying drawings and the detailed description, not only the components essential for solving the problem, but also the components not essential for solving the problem in order to illustrate the above technique. May also be included. Therefore, it should not be immediately recognized that these non-essential components are essential as those non-essential components are described in the accompanying drawings and detailed description.

  Moreover, since the above-mentioned embodiment is for demonstrating the technique in this indication, a various change, substitution, addition, abbreviation, etc. can be performed in a claim or its equivalent range.

  The present disclosure can be applied to a video camera, a digital camera, a mobile phone, and the like.

DESCRIPTION OF SYMBOLS 10 Imaging device 100 Main camera 110 Main optical system 111 Zoom lens 112 Camera shake correction lens 113 Focus lens 114 Aperture 120 Main lens drive part 140,340 CMOS image sensor 150,350 A / D converter 160 Main image processing part 170,370 Buffer 180 Controller 190 Card slot 200 Memory card 210 Operation member 220 Display unit 221 Sub image 222 Main image 240 Internal memory 300 Sub camera 310 Sub optical system 313 Focus lens 314 Aperture 320 Sub lens driving unit 360 Sub image processing unit 380 Direction sensor 390 PinP processing Part

Claims (3)

A first imaging unit that images a subject and generates first image data;
A second imaging unit that is rotatably attached to the first imaging unit and that generates second image data; and
A detection unit for detecting a first shooting direction and a second shooting direction as a shooting direction of the second imaging unit;
A first image processing unit that performs image processing on the first image data generated by the first imaging unit;
A second image processing unit that performs image processing on the second image data generated by the second imaging unit;
A control unit configured to set operations of the first image processing unit and the second image processing unit according to the photographing direction detected by the detection unit,
The first shooting direction is closer to the shooting direction of the first imaging unit, and the second shooting direction is closer to the photographer side than the first shooting direction,
The controller is
When the shooting direction detected by the detection unit is the first shooting direction, the first image processing unit and the second image processing unit are operated in conjunction with each other,
An imaging apparatus that operates the first image processing unit and the second image processing unit independently when the imaging direction detected by the detection unit is the second imaging direction. The controller is
When the shooting direction detected by the detection unit is the first shooting direction, an image processing parameter for the second image data is set in conjunction with an image processing parameter set for the first image data. And
When the shooting direction detected by the detection unit is the second shooting direction, the image processing parameter for the second image data is set independently of the image processing parameter set for the first image data. The imaging apparatus according to claim 1. Furthermore, a display unit is provided,
The imaging device according to claim 1, wherein the display unit superimposes and displays the first image data and the second image data.

Images