JP2019080109A - Imaging apparatus, control method and control program of imaging apparatus - Google Patents

Abstract

To reduce occurrence of exposure shortage and subject blur in the case of imaging a subject through a display unit.SOLUTION: An imaging apparatus comprises: an imaging unit 12 for capturing an image of a subject; and a display unit 11 for displaying the image captured by the imaging unit. The imaging unit receives light having passed through the display unit, and a CPU 13 executes alternate control of alternately executing displaying by the display unit and image capturing by the imaging unit with predetermined timing.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a photographing apparatus, a control method thereof, and a control program, and more particularly to a photographing apparatus which has a transmissive display unit and photographs a subject through the display unit.

  In general, it is known that in an imaging apparatus including a display unit such as a liquid crystal display, the display unit is a light transmission type and an optical image (object image) transmitted through the display unit is guided to an imaging unit (imaging unit) for imaging. It is done. For example, there is an imaging apparatus in which an imaging unit is disposed on the back side of a display and synchronized control of the imaging unit with the display is performed so that a user gazing at the display unit is photographed in a face-to-face manner (see Patent Document 1).

JP-A-8-195945

  By the way, in the imaging device described in Patent Document 1, in order to prevent the display by the display unit from being damaged, an alternation cycle to be performed at a predetermined timing of imaging and display is predetermined.

  However, in Patent Document 1, since the optical image transmitted through the display unit is photographed, image quality deterioration may occur due to insufficient exposure. In particular, when the luminance of the user is low, etc., the exposure at the time of shooting is insufficient, and the image quality is degraded. In addition, if the user makes intense motions, subject blurring will occur at the time of shooting.

  Therefore, an object of the present invention is to provide a photographing apparatus, a control method thereof, and a control program, which are less likely to cause underexposure and subject blurring when photographing a subject through the display unit.

  In order to achieve the above object, an imaging apparatus according to the present invention is an imaging apparatus having an imaging means for imaging a subject, and a display means for displaying an image obtained by imaging by the imaging unit, the imaging means The display means and the display means are disposed in a predetermined positional relationship, and the display means comprises control means for alternately performing display by the display means and imaging by the imaging means at predetermined timing.

  According to the present invention, it is possible to reduce the occurrence of underexposure and subject blurring when shooting a subject through a display unit or the like.

It is a figure for demonstrating the structure about an example of the imaging device by the 1st Embodiment of this invention. It is a figure for demonstrating the alternation control by the operation control part 13 shown in FIG. It is a figure which shows an example of use of a portable communication apparatus provided with the imaging device shown in FIG. It is a figure for demonstrating an example of the alternation control in the portable communication apparatus shown in FIG. It is a flowchart for demonstrating an example of the alternation control in the imaging device shown in FIG. It is a figure which shows the example which performs self-portrait imaging | photography using the digital camera which is an example of the imaging device shown in FIG. It is a figure which shows the other example of the imaging device by the 1st Embodiment of this invention. It is a block diagram showing the composition about an example of the imaging device by a 2nd embodiment of the present invention. It is a figure for demonstrating an example of the alternation control in the imaging device shown in FIG. It is a flowchart for demonstrating an example of the alternation control in the imaging device shown in FIG. It is a figure for demonstrating the structure about an example of the imaging device by the 3rd Embodiment of this invention. It is a figure for demonstrating the example about the structure of the sub display part shown in FIG. It is a figure which shows the period of relative movement of the sub display part shown in FIG. It is a flowchart for demonstrating an example of the imaging operation in the imaging device shown in FIG. It is a figure for demonstrating the structure about the other example of the imaging device by the 3rd Embodiment of this invention. It is a block diagram which shows the example about the structure of the imaging device by the 4th Embodiment of this invention. 17 is a flowchart for describing an example of an imaging operation in the imaging device shown in FIG. It is sectional drawing which shows another example about the structure of the imaging device by the 4th Embodiment of this invention. It is sectional drawing which shows another example about the structure of the imaging device by the 4th Embodiment of this invention. FIG. 21 is a diagram for describing an example in which an electrostrictive material is used to drive the sub display unit 151 shown in FIG. 19. It is a perspective view for explaining an example of the imaging device by a 5th embodiment of the present invention. It is a figure for demonstrating the structure about an example of the imaging device by the 6th Embodiment of this invention. FIG. 23 is a diagram showing an example of a state in which the orientation of the imaging unit has been changed in the imaging device shown in FIG. 22. It is a flowchart for demonstrating an example of the display control performed with the imaging device shown in FIG. It is a figure for demonstrating the structure about the other example of the imaging device by the 6th Embodiment of this invention. It is a block diagram which shows an example of the control system in the imaging device by the 7th Embodiment of this invention. It is a flowchart for demonstrating the imaging operation in the imaging device by the 7th Embodiment of this invention. FIG. 27 is a diagram showing application timing of an applied voltage when using an electrostrictive member for driving the sub display unit shown in FIG. 26.

  Hereinafter, an example of a photographing apparatus according to an embodiment of the present invention will be described with reference to the drawings.

First Embodiment
FIG. 1 is a diagram for describing the configuration of an example of a photographing apparatus according to a first embodiment of the present invention. FIG. 1A is a perspective view showing a part of the imaging apparatus, and FIG. 1B is a cross-sectional view. FIG. 1C is a block diagram showing a control system.

  The illustrated photographing apparatus is provided with a device case 10, in which a thin, light-transmissive display unit 11 such as an organic EL or liquid crystal display is disposed, and the display unit 11 transmits light. It is possible. The imaging unit (camera unit) 12 is disposed on the back surface of the display unit 11 in a predetermined positional relationship, and the imaging unit 12 can receive light through the display unit 11.

  The imaging unit 12 is mounted on the substrate 161 together with the CPU 13. The CPU 13 has an operation control unit 14 and an alternation control changing unit 15. The operation control unit 14 performs alternating control in which display by the display unit 11 and photographing operation by the imaging unit 12 are alternately performed at predetermined timing.

  In the illustrated example, a display area (transmission area) 11 a is defined in the display unit 11, and the display area 11 a faces the imaging unit 12. Then, the above-described alternation control is performed on the display area 11a, and no alternation control is performed on the other display areas. In addition, you may make it perform an alternation control about another display area.

  The alternation control changing unit 15 changes the alternation control by the operation control unit 14 as described later. The image (subject information) obtained by the imaging unit 12 is input to the CPU 13, and the operation control unit 14 and the alternation control changing unit 15 are driven according to the subject information.

  FIG. 2 is a diagram for explaining the alternation control by the operation control unit 13 shown in FIG.

  In the illustrated example, the display by the display unit 11 and the imaging by the imaging unit 12 are alternately repeated in a 1/30 second cycle. When display is performed in the display unit 11, charge storage is not performed in the imaging unit 12. Then, in the period in which the charge accumulation is not performed, the charge accumulated in the immediately preceding charge accumulation period is read out.

  On the other hand, when charge accumulation is not performed in the imaging unit 12, display is not performed on the display unit 11. As a result, with the display unit 11 (here, the display area 11a) in the transmission state, an optical image (object image) is incident on the imaging unit 12 via the display unit 11.

  As described above, since the display and the imaging are alternately repeated at the frequency at which the user is not aware, the figure of the user gazing at the display unit 11 can be photographed from the gazing direction without a sense of discomfort.

  FIG. 3 is a view showing an example of use of a portable communication device provided with the imaging device shown in FIG.

  In the illustrated example, it is assumed that the portable communication devices 31a and 31b communicate with each other via a network. The user 32a performs a dialogue while gazing at the moving image 33b of the communicator 32b by the display unit 11a. On the other hand, the user 32 a is imaged by the imaging unit 12 (not shown in FIG. 3) provided on the back surface of the display unit 11.

  Since the imaging unit 12 faces the user 32a, the moving image 33a of the user 32a facing the communicator 32b is, for example, every 1/30 seconds on the display 11b of the portable communication device 31b used by the communicator It is updated and displayed. Similarly, the moving image 33b of the communicator facing the user 32a is also updated and displayed on the display unit 11a of the mobile communication device 31a.

  Here, a case where the user 32a or the communicator 32b uses the mobile communication device 31a or 31b indoors at night and outdoor in the daytime will be described.

  When the portable communication device is used indoors at night, the subject is dark and the exposure is insufficient and a high quality image can not be obtained. On the other hand, when the mobile communication device is used outdoors in the daytime, when the subject being the user 32a or the interlocutor 32b is actively moving, the image is degraded in quality due to subject blurring.

  The alternation control changing unit 15 is provided to avoid the problem as described above, and changes the alternation control in the display unit 11 and the imaging unit 12 according to the state of the subject to be photographed (subject condition).

  FIG. 4 is a diagram for explaining an example of an alternation control in the mobile communication device shown in FIG. FIG. 4A shows a first example of the alternation control when the subject is dark, and FIG. 4B shows a first example of the alternation control when the subject is bright. FIG. 4C is a view showing a second example of the alternation control when the subject is dark, and FIG. 4D is a view showing a second example of the alternation control when the subject is bright. Further, FIG. 4E is a diagram showing a third example of the alternation control when the subject is bright.

  In FIG. 4A, in order to ensure sufficient exposure at the time of shooting, for example, the imaging by the imaging unit 12 and the display on the display unit 11 are changed from the 1/30 second cycle to the 1/15 second cycle.

  On the other hand, in FIG. 4B, the imaging by the imaging unit 12 and the display on the display unit 11 are changed from the 1/30 second cycle to the 1/60 second cycle in order to prevent the subject blurring.

  As described above, the image quality can be improved by changing the imaging period and the display period according to the subject condition.

  As described above, in indoor use, the subject is dark and the exposure is insufficient, and a high quality image can not be obtained. Furthermore, since the environment in the room is not so bright, the display on the display portions 11a and 11b often looks dazzling. On the other hand, since the surroundings are bright when used outdoors, the display is difficult to see at normal brightness. Furthermore, when the user 32a or the interlocutor 32b who is the subject is actively moving outdoors, the image quality degradation occurs in the image.

  In the example shown in FIG. 4C, the section 41 is the imaging time, and the section 42 is the display time. Here, in order to ensure sufficient exposure at the time of imaging, imaging in the imaging unit 12 is performed, for example, at a time of 27 ms. On the other hand, in order to lower the brightness of the display unit 11, the display on the display unit 11 is performed for 6 ms. That is, the imaging and display period is 1/30 seconds, and the imaging and display ratio (alternate ratio) is set to 3: 1 in a cycle of 1/30 seconds.

  In the example shown in FIG. 4D, the section 43 is the imaging time, and the section 44 is the display time. Here, since the exposure at the time of imaging is sufficient, the imaging in the imaging unit 12 is performed, for example, at a time of 6 ms. On the other hand, in order to ensure the brightness, the display on the display unit 11 is performed at a time of 27 ms. That is, the period of imaging and display is set to 1/30 seconds, and the alternation ratio of imaging and display is set to 1: 3 in a cycle of 1/30 seconds.

  In the example shown in FIG. 4E, the section 45 is the imaging time, and the section 46 is the display time. The illustrated example is used when the subject is vigorously moving.

  Here, in order to prevent subject blurring, imaging in the imaging unit 12 is performed, for example, for 3 ms. On the other hand, in order to ensure the brightness, the display on the display unit 11 is performed for 30 ms. That is, the period of imaging and display is set to 1/30 seconds, and the alternation ratio of imaging and display is set to 1: 9 in a cycle of 1/30 seconds.

  A subject condition, such as a dark subject, a bright subject, and a strong subject motion, is determined by the CPU 13 based on the charge amount of the continuous image obtained by the imaging unit 12 and the time change thereof.

  FIG. 5 is a flowchart for explaining an example of alternation control in the imaging device shown in FIG.

  The process according to the illustrated flowchart starts when the power of the imaging apparatus is turned on. The CPU 13 performs the alternation control by the operation control unit 14 with the alternation ratio as the initial setting ratio of 1: 1, and alternately repeats imaging and display in a predetermined cycle (for example, in a cycle of 1/30 seconds) (step S501).

  Subsequently, the CPU 13 determines whether the subject is bright based on the image obtained by the imaging unit 12 (step S502). Here, if the brightness of the subject exceeds the preset brightness, the CPU 13 determines that the subject is bright.

  When the subject is dark (lower than a predetermined brightness: NO in step S502), the CPU 13 controls the alternation control unit 15 to change the alternation ratio to 3: 1 to alternately repeat imaging and display (step S503). Then, the CPU 13 returns to the process of step S502.

  If the subject is bright (NO in step S502), the CPU 13 determines whether the operation speed (image plane speed) of the subject in the continuous image is low (step S504). Here, the CPU 13 determines that the moving speed of the subject is slow if the image plane speed is equal to or less than the predetermined speed.

  If the moving speed of the subject is low (YES in step S504), the CPU 13 performs the alternation control with the alternation control unit 15 with the alternation ratio of 1: 3 to repeat imaging and display alternately (step S505). Then, the CPU 13 returns to the process of step S502.

  On the other hand, the moving speed of the subject is fast (NO in step S504), the CPU 13 controls the alternation control to be 1: 9 by the alternation control changing unit 15 to alternately repeat imaging and display (step S506). Then, the CPU 13 returns to the process of step S502.

  In the above-described example, the mobile communication device including the imaging device has been described as an example, but the imaging device may be a digital camera or a video camera.

  FIG. 6 is a diagram showing an example of self-portrait photographing using a digital camera which is an example of the imaging apparatus shown in FIG.

  In the illustrated example, the user holds the selfie stick 62 attached to the digital camera 61 and captures the user's own moving image, and in this case, the user displays the moving image obtained by the imaging unit 12 on the display unit 11 Can be confirmed.

  As described above, in the illustrated digital camera 61, since the imaging unit 12 is provided on the back side of the display unit 11, the subject being the subject is aligned with the line of sight of the subject displayed on the display unit 11 at the time of shooting. (Matching of display and imaging).

  FIG. 7 is a view showing another example of the imaging device according to the first embodiment of the present invention.

  In the illustrated example, a display-imaging integrated device (hereinafter simply referred to as a device) for matching display and imaging is shown. Here, the plurality of imaging units and the plurality of display units are arranged in the same row.

  The illustrated integrated device has a light emitting organic film 71a, and the light emitting organic film 71a is used, for example, as a red light emitting element. A drive circuit and an electrode 71b are provided on the same wafer on the back surface side of the light emitting organic film 71a. The light receiving organic film 72a is provided adjacent to the light emitting organic film 71a and receives the subject light. A drive circuit and an electrode 72b are provided on the back surface side of the light receiving organic film 72a. The light receiving organic film 72a has sensitivity to, for example, blue, and is not easily affected by the red light emission color of the adjacent light emitting organic film 71a.

  A light emitting organic film 73a that emits green light is provided adjacent to the light receiving organic film 72a. A drive circuit and an electrode 73b are provided on the back surface side of the light emitting organic film 73a. Further, a light receiving organic film 74a having sensitivity to red is disposed next to the light receiving organic film 74a, and a driving circuit and an electrode 74b are provided on the back surface side of the light receiving organic film 74a. Further, a light emitting organic film 75a that emits red light is provided adjacent to the light receiving organic film 74a, and a driving circuit and an electrode 75b are provided on the back surface side of the light receiving organic film 75a.

  In this manner, a light emitting organic film (light emitting unit) constituting one pixel and a light receiving organic film (imaging unit) constituting one pixel are alternately arranged to constitute a multi-pixel display combined imaging device as a whole.

  In the illustrated example, microlenses 72c and 74c are disposed on the front surface of the light receiving organic films 72a and 74a, and an optical image is incident on the light receiving organic films 72a and 74a through the objective lens 76. Microlenses are not disposed in the light emitting organic films 71a, 73a, and 75a, and the user can confirm the display by the light emitting organic film through the objective lens 76.

  In the display and imaging device described above, when light emission and light reception are simultaneously performed, the light emission light source affects the light reception even if the light emission color and the light reception color are made different and arranged adjacent to each other. As a result, it is difficult to obtain a good image.

  Therefore, as described above, the display operation and the imaging operation are alternately performed. In particular, in the case of a dark subject condition, if the display luminance is high although the imaging sensitivity needs to be increased, the imaging will be greatly affected. On the other hand, if the alternation control is performed as described above, the quality of the image can be improved without any influence on the imaging.

  As described above, in the first embodiment of the present invention, it is possible to reduce the occurrence of underexposure and blurring of the subject when shooting the subject through the display unit.

Second Embodiment
Subsequently, an example of the imaging device according to the second embodiment of the present invention will be described.

  FIG. 8 is a block diagram showing the configuration of an example of an imaging device according to the second embodiment of the present invention. In FIG. 8, the same components as the components of the imaging apparatus shown in FIG. 1 will be assigned the same reference numerals and descriptions thereof will be omitted.

  In the illustrated imaging device, an operation detection unit 16 that detects a user operation is connected to the CPU 13. Then, the CPU 13 performs the alternation control in accordance with the user operation detected by the operation detection unit 16. Here, while watching the image of the communicator displayed on the display unit 11, the moving image and the voice of the user are transmitted to the communicator and the still image is shared.

  Here, with reference to FIG. 3 described above, a situation in which a still image is captured for the user or the interlocutor will be described.

  For example, a still image of an item held by the user may be sent to the interlocutor side, and the still image may be displayed on the corner of the display portion of the interlocutor side without being updated, and a dialogue regarding the item may be performed. In such a case, it is necessary to obtain a lower still image with minimal influence such as blurring and underexposure.

  However, since the imaging by the imaging unit 12 is performed at a cycle suitable for a moving image, a still image is also taken at a shutter speed (for example, 1/250 seconds) to stop blurring of the subject, and the still image is If it updates in 30 seconds, a moving image will be paraphrased and a moving image quality will fall. Therefore, a moving image can not be obtained under imaging conditions suitable for a still image.

  In addition, when the subject is dark, for example, since the exposure is insufficient in 1/60 second imaging, even if it is an acceptable level as a moving image for dialogue, it does not have an acceptable quality as a still image.

  The alternation control changing unit 15 is for avoiding the problem as described above. Here, when shooting a still image, the alternation control changing unit 15 changes the alternation control of the display unit 11 and the imaging unit 12 in the still image shooting preparation state for shooting a still image or in moving image shooting.

  FIG. 9 is a diagram for explaining an example of alternation control in the imaging device shown in FIG. FIG. 9A is a view showing a first example of the alternation control, and FIG. 9B is a view showing a second example of the alternation control. Moreover, FIG.9 (c) is a figure which shows the 3rd example of alternation control, and FIG.9 (d) is a figure which shows the 4th example of alternation control.

  In FIG. 9A, a section 91 is a section in a moving image shooting or still image shooting preparation state, and a section 92 is a section in a still image shooting. Further, an arrow 93 indicates a timing at which the operation detection unit 16 detects a still image shooting instruction by a user operation.

  The CPU 13 determines the state of the subject according to the captured image up to the point indicated by the arrow 93. Then, the CPU 13 changes the cycle of the alternation control by the alternation control changing unit 15 according to the determination result. Furthermore, as described in step S 504 shown in FIG. 5 described above, when the image plane speed is high, as shown in section 92, the CPU 13 shortens the shooting time for still image shooting compared to the previous video shooting time. Then, the CPU 13 controls the display time as indicated by a section 94 which is the same time as the section 92. That is, the CPU 13 changes the alternation cycle related to the operation of the imaging unit 12 and the operation of the display unit 11.

  The above-mentioned shooting time is set based on, for example, the motion vector of the subject observed in the section 94. When the luminance of the subject in the image is darker than the predetermined luminance, the 0CPU 13 makes the still image shooting time longer than the previous moving image shooting time as shown by a section 92 in FIG. 9B. Then, the CPU 13 controls the display time as indicated by a section 94 which is the same time as the section 92.

  Instead of the alternation period of display and imaging, the alternation ratio may be changed to correspond to the state of the subject.

  As shown in FIG. 9C, the CPU 13 observes the state of the subject in a section 95 of a predetermined time (for example, 30 ms) from the point indicated by the arrow 93. Then, the CPU 13 changes the cycle of the alternation control by the alternation control changing unit 15 in accordance with the observation result. Here, the imaging by the imaging unit 12 in the section 95 is set to be, for example, a 1 / 250-second interval shorter than the imaging interval in the section 91. By this, the CPU 13 compares the images obtained at each imaging interval to obtain the movement of the subject.

  In the section 95, when the movement of the subject is larger than the predetermined speed, the CPU 13 makes the photographing time of the still image photographing shorter than the moving image photographing time immediately before as shown in the section 92. The photographing time is set based on the motion vector of the subject observed in the section 95.

  In the section 95, the CPU 13 detects the brightness of the subject. When the brightness (brightness) of the subject is darker than the predetermined brightness, the CPU 13 makes the still image shooting time longer than the previous moving image shooting time, as shown by a section 92 in FIG.

  As shown in FIGS. 9C and 9D, the alternation ratio between the display operation 91a and the imaging operation 91b adjacent to the moving image shooting time is the alternation ratio between the display operation and the imaging operation adjacent to the still image shooting time. Make it different from When the still image shooting time becomes long, if the display update cycle is lengthened according to the still image shooting time, the user may feel discomfort in the display before and after shooting. In order to prevent such a sense of incongruity, the alternation ratio is made different as described above.

  If there is sufficient time to detect the state of the subject before shooting a still image, the state of the subject is captured before shooting a still image, as in the examples shown in FIGS. 9A and 9B. Section 95 can be omitted.

  FIG. 10 is a flowchart for explaining an example of the alternation control in the imaging device shown in FIG. In FIG. 10, the same steps as the steps in the flowchart shown in FIG.

  After the process of step S501, the CPU 13 determines whether the user operation has been detected by the operation detection unit 16 (step S1002). If the user operation is not detected (NO in step S1002), the CPU 13 stands by.

  When the user operation is detected (YES in step S1002), the CPU 13 performs the process of step S502. When the subject is dark (NO in step S502), the CPU 13 causes the alternation control changing unit 15 to display the still image capturing period, for example, the time indicated by the section 92 in FIG. 9B and FIG. It is extended to 50 ms) (step S1004). Then, the CPU 13 returns to the process of step S1002.

  If the subject is bright (YES in step S502), the CPU 13 performs the process of step S504. If the image plane speed is low (YES in step S504), the CPU 13 shortens the still image capturing period by the alternation control changing unit 15 to, for example, the time (for example, 15 ms) indicated by the section 92 in FIG. (Step S1006). Then, the CPU 13 returns to the process of step S1002.

  If the image plane speed is high (NO in step S504), the CPU 13 shortens the still image capturing period by the alternation control changing unit 15 to, for example, the time (for example, 6 ms) indicated by the section 92 in FIG. (Step S1007). Then, the CPU 13 returns to the process of step S1002.

  As described above, by changing the alternation control between moving image shooting and still image shooting, it is possible to obtain a smooth moving image and a still image without blurring and underexposure.

  As described above, in the second embodiment of the present invention, it is possible to reduce the occurrence of underexposure and subject blurring when shooting a subject through the display unit.

Third Embodiment
Subsequently, an example of the imaging device according to the third embodiment of the present invention will be described.

  FIG. 11 is a diagram for describing the configuration of an example of the imaging apparatus according to the third embodiment of the present invention. 11 (a) is a perspective view showing a part of the imaging apparatus, and FIG. 11 (b) is a cross-sectional view. FIG. 11C is a plan view showing a sub display unit provided in the imaging apparatus, and FIG. 11D is a block diagram showing a control system.

  Note that, in FIG. 11, the same components as those of the imaging device shown in FIG.

  In FIG. 11A, the display unit 11 is referred to as the main display unit 11, and in the main display unit 11, display is not performed in the display area 11a facing the imaging unit 12, and a transparent window is provided. In addition, the transparent member used for this transparent window (transparent area | region or transmission area | region) serves as sealing of an organic material.

  A sub display unit 151 such as an organic EL or liquid crystal display is provided between the imaging unit 12 and the main display unit 11. The main display unit 11 and the sub display unit 151 constitute a display unit 19.

  In FIG. 11B, a protective glass 17 having a polarization function is disposed on the front surface of the main display 11, and the protective glass 17 absorbs the reflected light in the main display 11 and the sub display 151. As a result, the difference in reflection between the main display unit 11 and the sub display unit 151 can not be confirmed by the user, and the display quality does not deteriorate at the boundary between the two display units.

  In the sub display portion 151 shown in FIG. 11C, a sealing member 15b for sealing the organic material 15a seals a thin coil 15c formed by printing or etching. The sealing member 15b is pivotally supported by the housing 10 and the shaft 15d, and the sub display unit 151 is rotatable around the shaft 15d.

  A permanent magnet 10a is disposed on the back surface of the housing 10. When a current is applied to the coil 15c, the sub display unit 151 may rotate around the shaft 15d and move relative to the imaging unit 12 Yes (that is, you can shift the spatial position).

  Thus, one of the sub display unit 151 and the imaging unit 12 is moved relative to the other. The coil 15 c and the permanent magnet 10 a constitute a relative movement unit 18.

  In addition, since the display unit 19 shields light with respect to the imaging unit 12, the display unit 19 becomes a light shielding object with respect to the imaging unit 12.

  In FIG. 11 (d), the CPU 13 is provided with an operation control unit 14. The operation control unit 14 controls the relative moving unit 18 to move the sub display unit 151 relative to the imaging unit 12 by the relative moving unit 18. The main display unit 11 does not move relative to the imaging unit 12.

  In the illustrated example, only the sub display unit 151 is moved relative to the imaging unit 12, but the main display unit 11 may be moved relative to the imaging unit 12.

  FIG. 12 is a diagram for describing an example of the configuration of the sub display unit shown in FIG. FIG. 12 (a) is a diagram showing the configuration of display pixels, and FIG. 12 (b) and FIG. 12 (c) are diagrams showing relative movement.

  For example, as shown in FIG. 12A, it is assumed that the display pixels 21 constituting the sub display unit 151 are arranged in the directions 23x and 23y with the vertical and horizontal sizes 21x and 21y. In this case, as shown in FIGS. 12 (b) and 12 (c), the sub display unit 151 relatively moves in the direction (23z direction) different from the pixel arrangement directions 23x and 23y by the movement amount ± 21z. . Here, the sub display unit 151 'of the movement destination is indicated by a broken line.

  The movement amount 21z is set to the root mean square value (diagonal length) of the vertical and horizontal sizes of the display pixel 21.

  FIG. 13 is a diagram showing a period of relative movement of the sub display unit shown in FIG.

  When the sub display unit 151 is relatively moved, when the shooting time is one cycle, for example, the shooting time 31 is 1/30 seconds, the sub display unit 151 is shown by the waveform 32 during the shooting time 31. The relative movement of one cycle (60 Hz) is performed.

  In the imaging device shown in FIG. 11, the imaging unit 12 captures an optical image transmitted through the sub display unit 151. Therefore, in order to reduce the influence on the image quality by the transparent electrode grid (grid surrounded by the horizontal electrode 24 h and the vertical electrode 24 v) disposed on the side adjacent to the display pixel 21 in the sub display section 151, the sub display section 151 is imaged. It moves relative to the part 12 during photographing.

  As described in FIG. 12 and FIG. 13, when relative movement direction and movement amount are set, it is possible to take an image by appropriately hanging the transparent electrode grids arranged vertically and horizontally, and the grids are clearly seen in the photographed image Can be prevented.

  The relationship between the display pixel 21 and the relative movement amount also changes depending on the imaging magnification, and when the imaging magnification is low, the relative movement amount needs to be set to be equal to or more than the diagonal length of the display pixel 21 described above. is there.

  FIG. 14 is a flowchart for explaining an example of the imaging operation in the imaging device shown in FIG. The illustrated flowchart is started by powering on the imaging apparatus.

  The CPU 13 determines whether the imaging unit 12 is in the imaging start state (step S1401). If the imaging unit 12 does not enter the imaging start state (NO in step S1401), the CPU 13 stands by. On the other hand, when the imaging unit 12 is in the imaging start state (YES in step S1401), the CPU 13 controls the relative movement unit 110 by the operation control unit 14 to send the sub display unit 151 to the imaging unit 12 as described above. It is moved relatively (step S402). Thereafter, the CPU 13 repeats the relative movement of the sub display unit 151 until the end of imaging.

  Subsequently, the CPU 13 determines whether the imaging by the imaging unit 12 is completed (step S1403). If the imaging by the imaging unit 12 is not completed (NO in step S1403), the CPU 13 stands by. On the other hand, when the imaging by the imaging unit 12 ends (YES in step S1403), the CPU 13 ends the relative movement of the sub display unit 151 by the operation control unit 14 (step S1404). Then, the CPU 13 returns to the process of step S1401.

  As described above, the sub display unit 151 is moved relative to the imaging unit 12 while imaging is performed by the imaging unit 12. As a result, it is possible to prevent the material (the organic material and the transparent electrode) constituting the sub display unit 151 from being clearly displayed on the captured image.

  Although the sub display unit 151 vibrates, since the amount of vibration is small, the display viewer does not feel discomfort. If the vibration period and the display period of the sub display unit 151 are performed at appropriate timings, blurring of the display of the sub display unit 151 can be further made inconspicuous. Alternatively, if the display of the sub display unit 151 is controlled to cancel the vibration in response to the vibration of the sub display unit 151, the blurring of the display can be canceled.

  FIG. 15 is a diagram for explaining the configuration of another example of the imaging device according to the third embodiment of the present invention. And Fig.15 (a) is a perspective view which shows a part of imaging device, FIG.15 (b) is an example of sectional drawing. Moreover, FIG.15 (c) is another example of sectional drawing.

  In FIG. 15, the same components as those of the imaging device shown in FIG.

  In FIG. 15A, the main display unit 11 is not provided with a transparent window. In addition, the sub display unit 151 is omitted. Here, the imaging unit 12 is moved relative to the display unit 19 in the direction of the arrow 52 as shown in FIG. 15B by the relative moving unit 51 such as a motor.

  Here, as described in FIG. 14, the imaging unit 12 is driven in the direction of the arrow 52. The drive amount is the same as the example described with reference to FIGS. 12 and 13, and is set by the image magnification of the display unit 19 and the imaging unit 12, and the movement amount of the imaging unit 12 in the direction of the arrow 52 is small.

  Since the display unit 19 is close to the imaging unit 12 and the image magnification is high, the relative movement amount of the display unit 19 with respect to the imaging unit 12 is large even if it is a small movement amount. There is nothing to do. Furthermore, since the subject is far from the imaging unit 12 and the image magnification is sufficiently low, movement of the imaging unit 12 does not blur the subject.

  As described above, by moving the sub display unit 151 or moving the imaging unit 12, it is possible to reduce the reflection of the grid. On the other hand, as shown in FIG. 15C, the imaging unit 12 and the sub display unit 151 may be moved simultaneously. In this case, the imaging unit 12 is moved in the first direction 52, and the sub display unit 151 is moved in a direction different from the first direction 52 (for example, a direction orthogonal to the direction 52). This can further reduce the reflection of the grid described above.

  As described above, in the third embodiment of the present invention, it is possible to reduce the occurrence of underexposure and subject blurring when shooting an object through the display unit.

Fourth Embodiment
Next, an example of an imaging device according to a third embodiment of the present invention will be described.

  Here, it is assumed that the imaging device described in FIG. 1 or 5 described above is provided with the selfie stick 62 described in FIG. 6.

  FIG. 16 is a block diagram showing an example of the configuration of an imaging device according to the fourth embodiment of the present invention.

  Compared with the imaging device according to the third embodiment, in the imaging device illustrated in FIG. 16, the CPU 13 includes an alternation control unit 71, and the operation detection unit 16 is connected to the CPU 13. As described in FIG. 2, the control unit 71 controls the image pickup of the image pickup unit 12 and the display of the display unit 19 in turn at the time of shooting a through image for shooting preparation (shooting preparation state) or at the time of moving image shooting. Do.

  Here, in the shooting preparation state, for example, the display of the display unit 19 and the imaging of the imaging unit 12 are alternately repeated at a cycle of 1/30 seconds. When display by the display unit 19 is performed, charge storage by the imaging unit 12 is not performed, and readout of charge stored immediately before is performed during the period.

  When charge storage by the imaging unit 12 is performed, display by the display unit 19 is not performed. As a result, the display unit 19 is in a transmission state, and an optical image is transmitted to the imaging unit 12 via the display unit 19. Is incident.

  In this manner, if the display operation and the imaging operation are alternately repeated in a cycle in which the user is less likely to be conscious, the user can check the appearance of the user gazing at the display unit 19 without discomfort from the gazing direction. Furthermore, it is possible to perform moving image shooting in which the subject is looking at the display unit 19 with a good eyesight.

  Further, when the operation detection unit 16 detects a still image shooting instruction from the user, the CPU 13 controls the relative movement unit 18 by the operation control unit 14 to move the display unit 19 relative to the imaging unit 12. During preparation for shooting or during moving image shooting, although the grid of the display unit 19 is captured, the position of the grid is known in advance, so that the degree of capturing can be reduced by adjusting the brightness by image processing or the like.

  During still image shooting, the relative movement between the display unit 19 and the imaging unit 12 reduces the possibility that the grid of the display unit 19 will be reflected, and the above-mentioned image processing makes it possible to obtain an even higher quality image.

  FIG. 17 is a flowchart for explaining an example of the imaging operation in the imaging device shown in FIG. The illustrated flowchart is a flowchart for describing an operation at the time of transition from the imaging preparation state to the imaging state, and starts when the imaging preparation state is reached.

  In the imaging preparation state, the CPU 13 alternately repeats the imaging operation and the display operation by the alternation control unit 71 every 1/30 seconds at an alternation ratio of 1: 1 (step S1901). Next, the imaging unit 12 obtains Based on the image, the CPU 13 determines whether the subject is dark or not, and calculates the exposure time (charge storage time) of the imaging unit 12 according to the brightness (step S1902).

  Subsequently, the CPU 13 determines whether or not the user operation has been detected by the operation detection unit 16 (step S1903). If the user operation is not detected by the operation detection unit 16 (NO in step S1903), the CPU 13 returns to the process of step S1901. On the other hand, when the operation detection unit 16 detects a user operation (YES in step S1903), the CPU 13 controls the relative movement unit 110 by the operation control unit 14 to relatively move the display unit 19 and the imaging unit 12 Is started (step S1904).

  Subsequently, the CPU 13 determines whether the relative movement between the imaging unit 12 and the display unit 19 is stable (step S1905). When determining whether or not the relative movement is stable, the CPU 13 may use, for example, a relative movement detection sensor (not shown) to determine whether or not the relative movement has elapsed from the start of the relative movement. It may be determined according to time.

  If the relative movement between the imaging unit 12 and the display unit 19 is not stable (NO in step S1905), the CPU 13 stands by. On the other hand, when the relative movement between the imaging unit 12 and the display unit 19 is stabilized (NO in step S1905), the CPU 13 causes the imaging unit 12 to take a still image.

  At the time of still image shooting, only the imaging operation is performed by stopping the display operation of the display unit 19. In addition, the exposure time obtained in step S1902 is used as the exposure time at the time of shooting a still image.

  Subsequently, the CPU 13 determines whether charge accumulation in the imaging unit 12 is completed (step S1906). That is, the CPU 13 determines whether the exposure time has elapsed. When the charge accumulation in the imaging unit 12 is not completed (NO in step S1906), the CPU 13 stands by. On the other hand, when charge storage in the imaging unit 12 is completed (YES in step S1906), the CPU 13 ends relative movement (step S1907). Then, the CPU 13 returns to the process of step S1901.

  FIG. 18 is a cross-sectional view showing another example of the configuration of the imaging device according to the fourth embodiment of the present invention.

  By the way, in FIG. 11B described above, a thin display such as an organic EL is used as the main display unit 11 and the sub display unit 151. In the example shown in FIG. 18, the sub display unit 1001 includes a backlight 1001a, a liquid crystal display unit 1001b, a base substrate 1001c, and a winding coil 1001d.

  The liquid crystal display portion 1001b is provided on the front side (the user side or the display viewing side) of the base substrate 1001c, and the backlight 1001a is provided between the liquid crystal display portion 1001b and the base substrate 1001c. In addition, the winding coil 1001d is provided on the back side (the imaging unit side) of the base substrate 1001c.

  Since the sub display portion 1001 is formed by superposing a plurality of members in this manner, the thickness of the sub display portion 1001 is increased. However, if an organic EL display is used for the main display portion 11, the step between the two is appreciated It does not stand out from the elderly side.

  The sub display unit 1001 is driven by the relative moving unit 18 (winding coil and permanent magnet) to move relative to the imaging unit 12. In such a configuration, the cost can be reduced by using the liquid crystal as the sub display portion 1001, and the rigidity is high because the thickness is thick, so that the reliability in driving can be improved.

  FIG. 19 is a cross-sectional view showing still another example of the configuration of the imaging device according to the fourth embodiment of the present invention.

  In the example shown in FIG. 19, the main display unit 1101 includes a base substrate 1101c, a liquid crystal display unit 1101b, and a backlight 1101a, and a central hole 1101d is formed. A thin sub display unit 151 of the organic EL is provided closer to the user than the main display unit 1101. Therefore, the level difference between the two is not noticeable from the user side. The periphery of the organic material 151a provided in the sub display unit 151 is sealed by a sealing member 151b, and the reliability is enhanced. The sealing material 151 b is transparent, and the reflection is suppressed by the protective glass 17 having a polarization function provided at the front thereof, and the boundary with the liquid crystal display 1101 a is not noticeable.

  The sub display unit 151 is driven by a motor 151 e which is a relative moving unit 18 connected to the shaft 151 d and moves relative to the imaging unit 12.

  As described above, since there are no steps and reflections, the sub display unit 151 does not feel bothersome. In addition, since the main display unit 1101 is a liquid crystal, the rigidity is high and the cost can be suppressed.

  FIG. 20 is a diagram for explaining an example in which an electrostrictive member is used to drive the sub display unit 151 shown in FIG. FIG. 20A is a cross-sectional view, and FIG. 20B is a plan view of the sub display unit.

  One end of the electrostrictive member 1201 is fixed to the protrusion 10 c formed on the camera housing 10, and the other end is fixed to a fixing portion 151 f formed on the sealing member of the sub display portion 151. When the electrostrictive member 1201 is driven, the electrostrictive member 1201 is driven at a natural frequency determined by the elasticity of the electrostrictive member 1201 and the mass of the sub display unit 151. Thus, the electrostrictive member 1201 can be driven to vibrate efficiently.

  By setting the springiness and the mass appropriately, the natural frequency is set to, for example, 30 Hz. Then, in the still image shooting, the sub display unit 151 is vibrated to move the imaging unit 12 and the sub display unit 151 relative to each other. By this, it is possible to obtain a high quality image with little influence of the organic material layer and the transparent electrode.

  As described above, by relatively moving the display unit 19 and the imaging unit 12 at the time of still image shooting, the quality of the image matching the eyes of the user (appreciator) watching the display screen is high. can do.

  As described above, in the fourth embodiment of the present invention, it is possible to reduce the occurrence of underexposure and blurring of the subject when shooting the subject through the display unit.

Fifth Embodiment
Subsequently, an imaging device according to a fifth embodiment of the present invention will be described.

  FIG. 21 is a perspective view for explaining an example of the imaging device according to the fifth embodiment of the present invention.

  The illustrated imaging device is, for example, an on-vehicle imaging device, and the imaging device is used for a drive recorder or a device intended to prevent a collision, and is installed on a windshield (transmissive surface) of a vehicle. Furthermore, it is used also as a back camera at the time of a vehicle reverse.

  In such an imaging device, there are dust and raindrops adhering to the front of the lens as factors that hinder the reliability, or heat rays provided for antifogging, and such factors reduce the image quality.

  The illustrated imaging device is intended to improve the reliability when it is used as a vehicle-mounted camera, and is an example of a camera for a collision prevention (emergency brake) device provided on a windshield.

  In FIG. 21, imaging units 1301 a and 1301 b are arranged at a predetermined interval on a windshield 1303 of a vehicle. The CPU (not shown) performs predetermined processing on the parallax images obtained by the two imaging units 1301 a and 1301 b to obtain the distance to the object.

  The imaging units 1301a and 1301b are driven by the relative moving unit (not shown) in the approaching direction and the separating direction as indicated by arrows 1302a and 1302b, respectively. The drive (vibration) is repeated, for example, in a cycle of 1/30 seconds.

  In FIG. 21, the base lengths 1304 of the two imaging units 1301 a and 1301 b are changed according to the vibrations of the imaging units 1301 a and 1301 b. The moving speed of the object can be accurately detected using the period of parallax change due to the change of the base line length.

  The moving directions of the imaging units 1301a and 1301b are not limited to the directions of the arrows 1302a and 1302b, as long as they move relative to the windshield 1303.

  In the illustrated example, a heat wire 1305 for preventing fogging is provided on the front surface of the imaging units 1301a and 1301b, and the heat wire 1305 serves as a light shield during imaging. In addition, dust and raindrops adhering to the windshield 1303 serve as a light shield and reduce the imaging performance of the imaging units 1301 a and 1301 b.

  On the other hand, in the illustrated imaging apparatus, the outline of the light shielding object can be blurred by relatively moving the windshield 1303 and the imaging units 1301 a and 1301 b. Therefore, the decrease in imaging performance of the imaging units 1301 a and 1301 b can be reduced.

  As described above, in the fifth embodiment of the present invention, it is possible to reduce the occurrence of underexposure and subject blurring when shooting a subject by transmitting a transparent material such as a windshield.

Sixth Embodiment
Next, an example of an imaging device according to a sixth embodiment of the present invention will be described.

  FIG. 22 is a diagram for describing the configuration of an example of the imaging apparatus according to the sixth embodiment of the present invention. FIG. 22 (a) is a perspective view showing a part of the imaging apparatus, and FIG. 22 (b) is a cross-sectional view. FIG. 22C is a block diagram showing a control system.

  In FIG. 22, the same components as those of the imaging device shown in FIG. 11 are denoted by the same reference numerals.

  In the main display unit 11, display is not performed on the display area 11a facing the imaging unit 12, and a transparent window is provided. The imaging unit 12 is disposed on the back side of the main display unit 11 corresponding to the transparent window (display area 11a), and the imaging unit 12 is pivoted around the shaft 12a by the display retraction unit 12b. A sub display unit 151 such as an organic EL or a liquid crystal display is disposed on the back of the imaging unit 12.

  A substrate 13 a on which the CPU 13 is disposed is provided in the housing 10 of the imaging apparatus, and when the user detection is detected by the operation detection unit 16, the CPU 13 starts imaging by the imaging unit 12. The CPU 13 is provided with an operation control unit 14, and the operation control unit 14 controls the display of the main display unit 11 and the sub display unit 151.

  In the state shown in FIG. 22B, the shooting direction of the imaging unit 12 faces the main display unit 11. In this case, a transparent window is located in front of the imaging unit 12, and the imaging unit 12 can favorably capture an object facing the main display unit 11 through the transparent window.

  As shown in FIG. 22B, in a state where the imaging unit 12 faces the main display unit 11, a display save signal is given to the CPU 13 from the display save unit 12b, whereby the operation control unit 14 displays the sub display The display of part 151 is turned off.

  FIG. 23 is a diagram showing an example of a state in which the orientation of the imaging unit is changed in the imaging device shown in FIG.

  As illustrated, a transparent window 100a is provided on one surface of the housing 10 facing the transparent window (display area 11a). When the orientation of the imaging unit 12 is in the state illustrated in FIG. 23 by the display retraction unit 12 b, the imaging unit 12 faces the subject via the transparent window 100 a. At this time, the operation control unit 14 turns on the display of the sub display unit 151 to complement the display of the display defect portion (that is, the transparent window 11 a) of the main display unit 11.

  The user can confirm the subject in the image obtained as a result of shooting by the display of the main display unit 11 and the sub display unit 151, and as a result, the user can smoothly shift to shooting.

  As described above, the sub display unit 151 is disposed on the back surface of the imaging unit 12 and the sub display unit 151 is in the display retraction state according to the rotation of the imaging unit 12 around the shaft 12 a by the display retraction unit 12 b. Switch selectively between and.

  FIG. 24 is a flowchart for explaining an example of display control performed by the imaging device shown in FIG. The process according to the illustrated flowchart starts when the power of the imaging apparatus is turned on.

  First, the CPU 13 determines whether the main display unit 11 is in the display on state (step S2401). If the main display unit 11 is in the display on state (YES in step S2401), the CPU 13 determines the orientation of the imaging unit 12. Here, the CPU 13 determines whether the imaging unit 12 faces the transparent window 100a (step S2402).

  If the imaging unit 12 faces the transparent window 100a (YES in step S2402), the CPU 13 causes the operation control unit 14 to turn on the sub display unit 151 (step S2403). Then, the CPU 13 returns to the process of step 2401.

  On the other hand, if the imaging unit 12 does not face the transparent window 100a (NO in step S2402), the CPU 13 sets the sub display unit 151 to the display off state (step S2404). Then, the CPU 13 returns to the process of step 2401. If the main display unit 11 is not in the display on state (NO in step S2401), the CPU 13 proceeds to the process of step S2404).

  As described above, when the imaging unit 12 is used, since the display area (sub display unit 151) facing the imaging unit 12 is retracted, it is possible to obtain a high quality image without being affected by the shield. it can.

  FIG. 25 is a diagram for describing the configuration of another example of the imaging device according to the sixth embodiment of the present invention. FIG. 25 (a) is a diagram showing a state in which the subject is confirmed by the main display unit, and FIG. 25 (b) is a diagram showing a state in which the main display unit is moved.

  In the illustrated example, the sub display unit 151 is fixed to the housing 10, and the main display unit 11 is movable relative to the housing 10. An arrow 41 indicates the shooting direction of the imaging unit 12, and in the state shown in FIG. 25A, the user can perform shooting while confirming the subject with the main display unit 11.

  On the other hand, at the time of so-called self-shooting in which the user takes a picture of the user, the user moves the main display unit 11 to the other surface side of the housing 10 as shown in FIG. At this time, the sub display unit 151 is at the original position of the housing 10, and the main display unit 11 is disposed on the front surface of the imaging unit 12 with the center empty (may be filled with a transparent member). It will be

  Thus, since the center of the main display unit 11 is open, the user can be photographed by the imaging unit 12 through the opening. That is, when the self-portrait shooting for shooting the user is performed, the central portion of the main display unit 11 is in a light transmitting state.

  In addition, since a facial expression etc. can be suitably adjusted by oneself at the time of self-portrait photography, the display omission of the central part in the display of the main display part 11 can be disregarded, as long as the photographing composition of a large frame can be grasped.

  Further, since the sub display unit 151 is fixed to the housing 10, here, the mechanism for moving the main display unit 11 is the display retraction unit, and the display retraction unit retracts the sub display unit 151 from the front surface of the imaging unit 12. Do.

  As described above, in the sixth embodiment of the present invention, when the subject is photographed by transmitting the display unit, the underexposure and the blur of the subject hardly occur.

Seventh Embodiment
Subsequently, an example of the imaging device according to the seventh embodiment of the present invention will be described. Although not shown here, it is assumed that the main display unit 11 is provided on the front surface of the casing 10 of the imaging apparatus, and the imaging unit 12 is provided inside the casing 10. Then, the selfie stick 62 described in FIG. 6 is attached to the housing 10, and the user operates the selfie stick 62 to determine a photographing composition and shoot while confirming itself on the main display unit 11. . The imaging apparatus according to the seventh embodiment of the present invention has the same configuration as that shown in FIGS. 11 (b) and 11 (c).

  FIG. 26 is a block diagram showing an example of a control system in an imaging device according to a seventh embodiment of the present invention.

  In the example shown in FIG. 26, the display retraction unit 12b is used instead of the relative moving unit 18 shown in FIG. 16, and the other configuration is the same as the example shown in FIG. Here, the display retraction unit 12b is configured by the coil 15c, the permanent magnet 10a, and the drive circuit (not shown), and the sub display unit 151 is retracted from the front surface of the imaging unit 12 by the display retraction unit 12b when shooting. Do. In the shooting preparation state, the sub display unit 151 is located in front of the imaging unit 12 and displays the image on the main display unit 11 and the sub display unit 151 when shooting the user, as described later.

  For this reason, the user can determine an imaging composition and issue an imaging instruction while confirming the images displayed on the main display unit 11 and the sub display unit 151.

  In the imaging preparation state, for example, display and imaging are alternately repeated at a cycle of 1/30 seconds. When the display by the sub display unit 151 is performed, the charge storage by the imaging unit 12 is not performed, and the charge stored immediately before is read out during the period.

  When the charge storage by the imaging unit 12 is performed, the display by the sub display unit 151 is not performed, and as a result, the light transmission state is achieved and the optical image is incident on the imaging unit 12 via the sub display unit 151. Do.

  In this manner, if the display operation and the imaging operation are alternately repeated in a cycle in which the user is not aware of it, the user confirms the appearance of the user gazing at the main display unit 11 and the sub display unit 151 without discomfort from the gaze direction. be able to. Then, when a photographing instruction is detected by the operation detection unit 16, the CPU 13 causes the operation control unit 14 to control the display retraction unit 12 b to retract the sub display unit 151 from the front of the imaging unit 12. Thereafter, the CPU 13 causes the imaging unit 12 to perform imaging.

  In the shooting preparation state, as described above, the shooting is repeated at a cycle of 1/30 second, and an image obtained by this is displayed on the main display unit 11 and the sub display unit 151. Therefore, the photographing time does not become longer than 1/60 seconds regardless of the brightness of the user who is the subject, and when the subject is dark, a sufficient charge accumulation amount can not be obtained.

  Therefore, in the shooting preparation state, the CPU 13 adjusts the gain of the image to correct the brightness of the subject. Since the gain-adjusted image contains noise, it may not be suitable for a still image, but there is no problem in confirming the shooting composition in the shooting preparation state.

  On the other hand, when shooting a moving image or a still image, the CPU 13 stops the alternation control and performs shooting in a charge accumulation time (exposure time) according to the brightness of the subject. Therefore, a high quality image with little noise can be obtained.

  In the photographing preparation state, the sub display unit 151 is located in front of the imaging unit 12, and the image is deteriorated due to the influence of the layer of the organic material forming the sub display unit 151 and the transparent electrode grid for exciting the layer. Sometimes. On the other hand, at the time of photographing, the sub display unit 151 retracts from the front surface of the imaging unit 12, so that the image deterioration due to the organic material and the transparent electrode grid described above does not occur.

  As described above, in the shooting preparation state, the imaging unit 12 is covered by the sub display unit 151 disposed in the vicinity of the main display unit 11, and when shooting a moving image or a still image, the sub display unit 151 is the imaging unit 12. Evacuate from before.

  FIG. 27 is a flowchart for explaining the photographing operation in the imaging device according to the seventh embodiment of the present invention. In the flowchart shown in the figure, the same steps as the steps in the flowchart shown in FIG.

  In step S1903, when the operation detection unit 16 detects a photographing instruction (YES in step S1903), the CPU 13 causes the operation control unit 14 to turn off the display of the sub display unit 151. Further, the CPU 13 causes the display saving unit 12b to save the sub display unit 151 from the front of the imaging unit 12 (step S2701).

  Subsequently, the CPU 13 determines whether the sub display unit 151 is completely retracted from the front surface of the imaging unit 12 (step S2702). For example, a sub display position detection sensor (not shown) is used to determine whether or not it has completely retracted. It should be noted that the completion of the evacuation may be determined in accordance with the elapsed time since the start of evacuation of the sub display unit 151.

  If sub display unit 151 does not completely save (NO in step S2702), CPU 13 stands by. On the other hand, when the sub display unit 151 is completely retracted (YES in step S2702), the CPU 13 performs charge accumulation in the imaging unit 12 according to the exposure time obtained in step S1902. Then, in step S1906, the CPU 13 determines whether charge accumulation has been completed.

  When the charge accumulation is completed (YES in step S1906), the CPU 13 positions the sub display unit 151 on the front surface of the imaging unit 12 by the display saving unit 12b. Further, the CPU 13 turns on the display of the sub display unit 151 (step S2703). Then, the CPU 13 returns to the process of step S1901.

  The main display unit 11 and the sub display unit 151 may be configured as described with reference to FIGS. 18 to 20.

  FIG. 28 is a diagram showing an application timing of an applied voltage when using an electrostrictive member for driving the sub display unit shown in FIG.

  Here, the CPU 13 drives the electrostrictive member 1201 at a predetermined low voltage in a cycle of 30 Hz in the period 131 of moving image photographing or preparation for photographing, and in the photographing period 132, directs the electrostrictive member 1201 at a predetermined high voltage. Driving is performed to move the sub display unit 151 in the retraction direction.

  As described above, in the seventh embodiment of the present invention, the display unit has the main display unit 11 and the sub display unit 151, and the sub display unit 151 covering the imaging unit 12 is retracted at the time of photographing. As a result, the image of the user looking at the display screen can be made high quality.

  As mentioned above, although this invention was demonstrated based on embodiment, this invention is not limited to these embodiment, The various form of the range which does not deviate from the summary of this invention is also included in this invention .

  For example, the control method may be performed by the imaging apparatus as the control method of the above-described embodiment. In addition, a program having the functions of the above-described embodiments may be used as a control program to cause a computer included in the imaging apparatus to execute the control program. The control program is recorded, for example, on a computer readable recording medium.

Other Embodiments
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

11 Display 12 Imaging Unit 13 CPU
14 operation control unit 15 alternation control changing unit 16 operation detection unit 31 mobile communication device

Claims (26)

An imaging apparatus comprising: an imaging unit configured to capture an object; and a display unit configured to display an image obtained by imaging by the imaging unit.
The imaging means and the display means are arranged in a predetermined positional relationship,
An imaging apparatus comprising: control means for alternately performing display by the display means and imaging by the imaging means at a predetermined timing.   The image pickup apparatus according to claim 1, wherein the image pickup means is disposed at a position capable of receiving light transmitted through the display means and incident thereon. In the display means, a display area capable of transmitting light is defined;
The imaging device according to claim 2, wherein the control unit controls display in the display area. The imaging unit includes a plurality of imaging units, and the display unit includes a plurality of display units.
The imaging device according to claim 1, wherein the imaging unit and the display unit are alternately arranged in a predetermined direction. Having detection means for detecting a user operation;
The image pickup apparatus according to any one of claims 1 to 4, wherein the control unit changes the timing when the user operation detected by the detection unit is a still image photographing instruction.   The imaging apparatus according to any one of claims 1 to 5, wherein the control unit changes the timing in accordance with a state of the subject.   The control means changes the timing to set the time of imaging by the imaging means as a first timing longer than the time of display by the display means when the luminance of the subject is equal to or less than a predetermined luminance. The imaging device according to claim 6, characterized in that   The control means changes the timing when the moving speed of the subject in the image obtained by the imaging means is equal to or less than a predetermined speed when the luminance of the object exceeds a predetermined luminance. 8. The image pickup apparatus according to claim 7, wherein a time of image pickup by the image pickup means is a second timing shorter than a time of display by the display means.   The control means changes the timing when the moving speed of the subject in the image obtained by the imaging means exceeds a predetermined speed when the luminance of the subject exceeds a predetermined luminance. 9. The imaging apparatus according to claim 8, wherein a time of imaging by the imaging means is set to a third timing shorter than a time of display by the display means than the second timing. An imaging apparatus having an imaging unit for imaging a subject, the imaging apparatus comprising:
The image pickup means is disposed at a position to receive light transmitted through a transmission surface provided with a light shield.
An imaging apparatus comprising: control means for shifting a spatial position between the imaging means and the transmission surface when performing imaging by the imaging means.   11. The imaging apparatus according to claim 10, wherein the control unit moves the imaging unit and the transmission surface relative to each other when performing imaging by the imaging unit.   The imaging device according to claim 11, wherein the transmission surface is a display unit on which an image obtained by the imaging unit is displayed.   13. The imaging apparatus according to claim 12, wherein the control unit moves one of the imaging unit and the display unit relative to the other.   The imaging apparatus according to claim 12, wherein the control unit relatively moves the imaging unit and the display unit in a direction different from an arrangement direction of the pixels provided in the display unit.   The photographing according to any one of claims 12 to 14, wherein the control means moves the imaging means and the display unit relative to each other when the still picture is taken by the imaging means. apparatus.   The apparatus according to any one of claims 1 to 15, wherein the control means causes the moving directions of the imaging means and the display unit to differ in relative movement. The display unit includes at least a first display unit and a second display unit which is located in a transmission area of the first display unit and is the shield.
13. The imaging apparatus according to claim 12, wherein the control unit moves the second display unit relative to the imaging unit at the time of imaging by the imaging unit.   13. The apparatus according to claim 12, wherein the control unit controls a moving amount of the imaging unit according to an image magnification from the imaging unit to the subject.   19. The apparatus according to claim 18, wherein the control unit reduces the amount of movement as the image magnification is larger. The transmission surface displays an image obtained by the imaging unit, and includes a first display unit having a transmission region, and a second display unit disposed corresponding to the transmission region and including the shield. ,
11. The imaging apparatus according to claim 10, wherein the control unit retracts the second display unit from the transmission area when imaging by the imaging unit.   21. The apparatus according to claim 20, wherein the control means alternately performs the display by the first display unit and the imaging by the imaging means at a predetermined timing in moving image shooting or in a preparation state for still image shooting. The imaging device of description.   21. The photographing apparatus according to claim 20, wherein when the second display unit is retracted from the transmission area, the control unit turns off the display of the second display unit. A control method of an imaging apparatus, comprising: an imaging unit configured to capture an object; and a display unit configured to display an image obtained by imaging by the imaging unit, wherein the imaging unit and the display unit are arranged in a predetermined positional relationship. And
A control step of alternately performing display by the display unit and imaging by the imaging unit at a predetermined timing. A control method of an image pickup apparatus comprising an image pickup means for picking up an image of an object, wherein the image pickup means is disposed at a position for receiving light transmitted through a transmission surface provided with a light shield,
A control step of shifting a spatial position between the imaging means and the transmission surface when performing imaging by the imaging means. It is used in an imaging apparatus having an imaging unit for imaging a subject and a display unit for displaying an image obtained by imaging by the imaging unit, wherein the imaging unit and the display unit are arranged in a predetermined positional relationship. A control program,
In a computer provided in the imaging device,
A control program characterized by executing a control step of alternately performing display by the display means and imaging by the imaging means at a predetermined timing. A control program for use in an image pickup apparatus comprising an image pickup means for picking up an object, wherein the image pickup means is disposed at a position for receiving light transmitted through a transmission surface provided with a light shield,
In a computer provided in the imaging device,
A control program comprising: executing a control step of shifting a spatial position of the imaging means and the transmission surface when performing imaging by the imaging means.

Images