JP4622882B2 - Digital camera - Google Patents

Description

  The present invention relates to a digital camera, and more particularly to blur correction in a bent optical digital camera.

  2. Description of the Related Art Conventionally, there has been known a digital camera that bends incident light and forms an image on an image sensor (for example, Patent Document 1). In such a bent optical type digital camera, a lens unit or the like can be configured in the main body. For example, unlike a digital camera having a retractable lens, the lens is projected outside the main body of the digital camera. In addition, since the zoom function and the autofocus function can be realized, a compact digital camera with a flat outer surface can be realized.

In such digital cameras, still image shooting (still shooting) is a basic function, but many have a moving image shooting (video shooting) function as an additional function. In the case of movie shooting, unlike still shooting, there are also shooting techniques by moving the camera body.For example, pan shooting that moves or rotates the camera horizontally, tilt shooting that rotates the camera vertically, etc. Are known.
JP 2004-219516 A

  Since the above-described bent optical digital camera is small and light, it tends to cause camera shake. For this reason, when moving image shooting is performed with a bent optical digital camera, camera shake or the like is extremely likely to occur when panning or tilting shooting is performed by moving the camera body.

  On the other hand, many digital cameras have a camera shake correction function, but many of them shift lenses and image sensors. In compact bending optical digital cameras, It is difficult to implement such a mechanism.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to realize image-free imaging with a bending optical digital camera.

In order to achieve the above object, a digital camera according to the first aspect of the present invention provides:
In a digital camera that has a video imaging function and bends incident light by a reflector to form a subject image on an imaging device.
Drive means for rotationally driving the reflector;
A user operation means that is operated by a user and generates an input signal corresponding to the operation;
A motion detection means for detecting the motion of the digital camera which causes blurring of the captured image;
When there is a predetermined input signal from the user operation means, the drive means is controlled, and the reflector is rotated based on the input signal from the user operation means to tilt and / or pan the captured image. And a first control unit that rotates the reflector according to the motion detected by the motion detection unit and corrects blur in the captured image ;
When there is no predetermined input signal from the user operation means, the drive means is controlled, and the reflector is rotated according to the motion detected by the motion detection means to correct blur in the captured image. Control means,
It is characterized by providing.

In the above digital camera,
The driving means includes
A first axis that rotates the reflector around a first axis that is a central axis of the reflector and is parallel to the horizontal direction of the digital camera and orthogonal to the optical axis of incidence on the reflector. Driving means;
It is desirable to further include second driving means for rotating the reflector around a second axis parallel to the vertical direction of the digital camera, in this case,
The first control means controls the first driving means when a tilt operation is instructed based on an input signal from the user operation means, and the second drive when a pan operation is instructed. It is desirable to control the means.

According to such a configuration, it is also image stabilization it is possible to rotate the reflector used in the bending optical digital camera (mirror) in two axial directions by a user operation, a new member it is possible to change the angle of the captured image by performing pan and tilt operation without moving the camera body without adding, Ru can further correct the camera shake. Since it is not necessary to move the camera body, it is possible to prevent camera shake during moving image shooting and to use shooting techniques such as panning and tilting.

In the above digital camera,
It said motion detection means, in the digital camera, it is desirable to detect the first motion and the second motion about the axis around the axis, in this case,
Said first control means, while performing the tilt operation performs only shake correction according to the movement around the second axis, while doing the pan operation to move around the first axis It is desirable to perform only such blur correction.

  According to such a configuration, it is possible to perform blur correction by rotating the reflector (mirror). In this case, if the tilt operation is performed by a user operation, only the horizontal blur correction is performed, and if the pan operation is performed, only the vertical blur correction is performed. Therefore, the pan / tilt operation and the blur correction are performed. It is possible to reduce image shake such as shakeback that can occur when the operations are performed simultaneously.

In the above digital camera,
The first control means preferably controls the drive means so as the reflector rotates at a constant speed.

  According to such a configuration, for example, during blur correction, control is performed so that the rotational speed for blur correction is constant regardless of the position of the reflector (mirror). The movement of the image on the captured image is smooth, and a captured image without image shake can be obtained.

In the above digital camera,
It said first control means, in response to said operating amount based on the input signal from the user operation unit, it is desirable to control the drive means so that turning speed of the reflector is changed.

  According to such a configuration, for example, when a pan / tilt operation is performed by a user operation, the rotation speed of the reflector (mirror) is changed according to the amount of operation, and the captured image has a constant speed. It can be controlled to move. Thereby, the image movement on the captured image accompanying the pan / tilt becomes smooth, and a captured image without image shake can be obtained.

According to the present invention, the reflector used in the bending optical digital camera can be rotated in accordance with the user operation and the camera shake can be corrected. Therefore, the camera body can be mounted without adding a new member. Pan / tilt shooting can be performed without moving , and camera shake can be corrected, and moving image capturing without blurring or image shaking can be realized.

  Embodiments according to the present invention will be described below with reference to the drawings. In the present embodiment, the case where the present invention is applied to a digital camera having a moving image shooting function will be described below. That is, the digital camera according to the present embodiment includes a moving image imaging function as an additional function in a digital camera having a still image imaging function as a basic function.

  An external configuration of the digital camera 100 according to the present embodiment will be described with reference to FIG. FIG. 1 is a view showing an example of the appearance of a digital camera 100 according to the present embodiment (FIG. 1 (a) is a front view and FIG. 1 (b) is a rear view).

  As shown in FIG. 1A, an entrance window 10, a distance measurement / photometry unit 120, and the like are configured on the front surface of the digital camera 100. As shown in FIG. 1B, on the back of the digital camera 100, for example, a zoom button 132, a mode changeover switch 133, a cross key 134, a button group 135, and the like are configured as the operation unit 130. A shutter button 131 is configured on the upper surface of the digital camera 100. A display unit 140 is configured on the back of the digital camera 100.

  The incident window 10 includes an opening provided to allow light indicating an imaging target (subject) to enter the inside of the digital camera 100 and a transparent member that covers the opening when the image is captured by the digital camera 100. .

  The distance measurement / photometry unit 120 includes a distance measurement / photometry device generally used for an ordinary camera having an auto focus (AF) function or an automatic exposure (AE) function, It measures the distance to the subject required during the AF operation, and detects the external light amount and subject light amount required during the AE operation.

  The shutter button 131 is a button for performing an operation related to the imaging operation of the digital camera 100. The shutter button 131 functions as a normal shutter button when capturing a still image, and as a start button for instructing the start of the imaging operation and a stop button for instructing the end of the imaging operation when capturing a moving image. Function.

  The zoom button 132 is a button for operating the zoom function of the digital camera 100.

  The mode changeover switch 133 is constituted by, for example, a slide-type switch, and is used for changing a plurality of operation modes of the digital camera 100. In this embodiment, it is used for switching between the still shooting mode and the moving image shooting mode.

  The cross key 134 is a key for performing various input operations by the user, and includes four direction keys, a left direction key, a right direction key, an up direction key, and a down direction key. In the present embodiment, it is used to perform pan / tilt operations (details will be described later) during moving image shooting. In this case, the left key is used to pan left, the right key is used to pan right, the up key is used to tilt upward, and the down key is used to tilt downward. .

  The button group 135 is a button for operating various functions of the digital camera 100. For example, a menu button for displaying a menu screen on the display unit 140 and display / non-display of the display unit 140 are selected. Used as a display button, etc.

  The display unit 140 is composed of, for example, a liquid crystal display device, and displays a subject image and a captured image at the time of shooting. In addition, various screens used when executing various functions of the digital camera 100 are displayed.

  The digital camera 100 according to the present embodiment is a so-called bending optical digital camera that bends incident light to form an image on an image sensor. The optical unit 200 for realizing such a bending optical system is configured at a position indicated by a broken line in FIG. That is, it is configured at a position corresponding to the entrance window 10 configured in the front part of the digital camera 100.

  The configuration of the optical unit 200 will be described with reference to FIG. 2B is a side view of the digital camera 100 shown in FIG. 2A (the left side is shown from the back side of the digital camera 100), and an optical unit configured inside the digital camera 100. FIG. A configuration of 200 is schematically shown. As shown in the figure, the optical unit 200 mainly includes a mirror 210, a lens unit 220, an image sensor 230, and the like.

  The mirror 210 is a mirror (reflector) for bending incident light that has entered from the incident window 10 and is inclined at a position corresponding to the incident window 10 as shown in FIG. . As a result, the incident light that has entered the incident window 10 is bent downward in the digital camera 100.

  The lens unit 220 includes a plurality of lens groups, and the subject light bent by the mirror 210 passes through the lens unit 220.

  The image pickup device 230 is composed of, for example, a photoelectric conversion device such as a CCD (Charge Coupled Device), receives the subject light bent by the mirror 210 and transmitted through the lens unit 220, and corresponds to the amount of light received. Captured image data is generated by generating an electrical signal. The image sensor 230 includes a predetermined ADC (Analog-Digital Converter), and digital data of the captured image is generated by digitally converting the generated electrical signal. .

  As shown in FIG. 2B, in the present embodiment, the image sensor 230 is disposed in the vicinity of the bottom surface of the digital camera 100 at a position where the light receiving surface faces the upper direction of the digital camera 100 and is parallel to the bottom surface. Is done. In this case, the mirror 210 is tilted at an angle at which the bent incident light is perpendicularly incident on the image sensor 230. In the present embodiment, since the incident light is bent in the vertical direction of the digital camera 100, the narrow angle formed by the optical axis of the subject light perpendicular to the front of the digital camera 100 and the reflecting surface of the mirror 210 is 45 ° or substantially. The mirror 210 is arranged with an inclination of 45 °. This angle is hereinafter referred to as “reference angle”.

  A detailed configuration of the optical unit 200 will be described with reference to FIG. FIG. 3 is a perspective view illustrating a configuration example of the optical unit 200. As shown in the figure, the optical unit 200 includes a mirror 210, a lens unit 220, and an image sensor 230 on a pedestal 201.

  The mirror 210 according to the present embodiment is configured to be rotatable, and is installed on the base 201 in a state of being housed in a mirror unit 300 for rotating the mirror 210. The configuration of the mirror unit 300 will be described later.

  The lens unit 220 includes a focusing lens 220a, a zoom lens 220b, an optical operation unit 221, a lens support 222, a lens driving unit 223, and the like.

  The focus lens 220a and the zoom lens 220b are movable lenses held by the lens support 222, and each move in a direction indicated by a double arrow in the drawing. Here, the lens support 222 includes a support 222a that indicates one end of the focus lens 220a, a support 222b that indicates one end of the zoom lens 220b, and each of the focus lens 220a and the zoom lens 220b. It is comprised from 222c which designates the other end. The support body 222a and the support body 222b include, for example, a rack and pinion mechanism. Each of the support body 222a and the support body 222b is rotationally driven by, for example, a lens driving unit 223 including a motor and a gear. By this operation, the focus lens 220a and the zoom lens 220b move.

  Here, the focus lens 220 a operates by an AF function based on the operation of the distance measurement / photometry unit 120. The zoom lens 220b is operated by operating the zoom button 132.

  The optical operation unit 221 includes, for example, a fixed lens, a diaphragm blade, a shutter mechanism, and the like. The optical operation unit 221 forms an image of subject light transmitted through the focus lens 220a and the zoom lens 220b on the image sensor 230 and has a set exposure. Shutter operation is performed with a diaphragm according to the above.

  Next, the configuration of the mirror unit 300 shown in FIG. 3 will be described with reference to FIG. 4A is a plan view of the mirror unit 300 viewed from the incident window 10 side, and FIG. 4B is a side view corresponding to FIG. 4A illustrates the mirror unit 300 viewed from the front of the digital camera 100, and FIG. 4B illustrates the mirror unit 300 viewed from the left side when viewed from the back side of the digital camera 100. Yes.

  As illustrated, the mirror unit 300 includes a pedestal 301, a first holding body 310, a first actuator 311, a fixed support body 312, a movable support body 313, a second holding body 320, a second actuator 321, and the like. Consists of

  The first holding body 310 covers the back surface of the mirror 210 (the back side of the reflection surface) and holds the mirror 210 so that the reflection surface of the mirror 210 is exposed. The first holding body 310 holding the mirror 210 in this way is held by the second holding body 320.

  In this case, the first holding body 310 is a so-called gimbal that is held by the second holding body 320 so as to be rotatable about the X-X ′ axis shown in FIG. That is, the mirror 210 held by the first holding body 310 is held so as to be rotatable about the X-X ′ axis. Here, the X-X ′ axis (hereinafter referred to as “X rotation axis”) is the central axis of the mirror 210 parallel to the longitudinal direction of the mirror 210. More specifically, as shown in FIG. 5, when the digital camera 100 is horizontally installed so that the shutter button 131 is on the upper surface, the digital camera orthogonal to the optical axis of the incident light perpendicularly incident on the front of the digital camera 100 100 horizontal axes.

  As shown in FIG. 4B, the second holding body 320 has a shape in which the upper portion protrudes toward the incident window 10 side. By being held by the second holding body 320 having such a shape, the first holding body 310 holds the mirror 210 so that the mirror 210 has a reference angle.

  The first actuator 311 and the second actuator 321 are actuators for rotating the mirror 210 held by the first holding body 310 and the second holding body 320, and generate a linear motion, for example. Consists of a voice coil motor. As shown in FIG. 4A, the first actuator 311 is fixed to the pedestal 301 so as to generate a linear motion in a direction parallel to the ZZ ′ axis in the figure, and the second actuator 321 It is fixed to the pedestal 301 so that a linear motion is generated in a direction parallel to the X rotation axis.

  In this case, as indicated by a double arrow ZA-ZA ′, the first actuator 311 generates a linear motion in both directions with respect to the X rotation axis. The second actuator 321 generates linear motion in both directions with reference to the Z-Z ′ axis, as indicated by a double arrow XA-XA ′. Here, as shown in FIG. 5, the Z-Z ′ axis is an axis parallel to the vertical axis of the digital camera 100 when the digital camera 100 is horizontally installed so that the shutter button 131 is on the upper surface.

  Then, as shown in FIG. 4B, the second holding body 320 is held on the base 301 so as to be rotatable around a ZZ ′ axis (hereinafter referred to as “Z rotation axis”). It is a so-called gimbal. More specifically, the second holding body 320 is rotatably held by the upper stay 301a and the lower stay 301b that protrude perpendicularly from the pedestal 301 in the direction of the entrance window 10.

  The linear motion generated by the first actuator 311 acts on the first holding body 310 via the fixed support body 312 and the movable support body 313. Here, as shown in FIG. 4A, the fixed support body 312 is, for example, a substantially prismatic support body, one end of which is fixed to the movable portion of the first actuator 311, and from the first actuator 311. Projecting to the back of the mirror 210. In this case, the position where the longitudinal center line of the fixed support 312 matches the X-X ′ axis is the reference position of the first actuator 311. As the first actuator 311 is driven, the fixed support 312 is also moved in the vertical direction (the direction of the double arrow ZA-ZA ′ shown in FIG. 4A).

  Further, as shown in FIG. 4B, the movable support 313 has a substantially rod shape, one end is fixed to the first holding body 310, and the other end is connected to the fixed support 312 so as to be rotatable. Has been. When the first actuator 311 is in the reference position, the movable support 313 has a longitudinal center line parallel to the horizontal axis of the digital camera 100 orthogonal to the X-X ′ axis. Here, as shown in FIG. 4B, the cross section of the fixed support 312 at the connection portion with the movable support 313 has a substantially U shape with an opening on the mirror 210 side. The end of the movable support 313 having a substantially spherical shape as shown in FIG. 4B is connected to such a U-shaped opening. In other words, such a substantially spherical end is engaged with the opening of the fixed support 312 so as to be pivotally connected. In this case, when the first actuator 311 is at the reference position, the angle between the movable support 313 and the fixed support 312 as viewed from the side is substantially a right angle as shown in FIG. Since the fixed support 312 and the movable support 313 are connected in this way, the movable support 313 and the fixed support 312 as viewed from the side according to the vertical movement of the fixed support 312 by the first actuator 311. The angle with will change.

  The other end of the movable support 313 is fixed to the first holding body 310 at a position corresponding to the center position of the mirror 210. As described above, since the first holding body 310 is held by the second holding body 320 so as to be rotatable around the XX ′ axis, the fixed support body 312 is moved according to the vertical movement of the fixed support body 312. When the angle changes, the first holding body 310 rotates in the direction of the double-headed arrow aa ′ in FIG. That is, the mirror 210 held by the first holding body 310 rotates around the X-X ′ axis by the operation of the first actuator 311.

  On the other hand, the linear motion generated by the second actuator 321 acts on the second holding body 320. In this case, since the second holding body 320 is held so as to be rotatable about the Z rotation axis, the linear movement generated by the second actuator 321 in the X rotation axis direction is held in the second direction. By acting on the body 320, the second holding body 320 rotates about the Z rotation axis. In this case, the first holding body 310 held by the second holding body 320 rotates around the Z rotation axis. Since the mirror 210 is held by the first holding body 310, the mirror 210 is rotated around the Z rotation axis by the operation of the second actuator 321.

  In the present embodiment, when the moving image is captured by the moving image capturing function of the digital camera 100 by the operation of the mirror unit 300 that rotates the mirror 210 as described above, “pan” or “tilt” that is a kind of video capturing technique is used. " Panning in a normal video shooting technique is a technique for moving the screen in the horizontal direction by rotating or moving the camera body in the horizontal direction. Tilt is a technique for moving the screen in the vertical direction by rotating the camera body in the vertical direction.

  As described above, the digital camera 100 according to the present embodiment is a lightweight and compact digital camera that employs a bending optical system. Thus, when the main body is small and lightweight, it is easily affected by the movement of the photographer's hand. Therefore, when such a camera is provided with a moving image shooting function, performing panning or tilting to move the main body causes image blurring.

  The digital camera 100 according to the present embodiment can rotate the mirror 210 in two axial directions around the X rotation axis and the Z rotation axis. If the mirror 210 is rotated about the X rotation axis, the incident light changes in the vertical direction of the captured image. That is, the same effect as the tilt shooting in which the camera body is rotated in the vertical direction can be obtained. Similarly, if the mirror 210 is rotated about the Z rotation axis, the incident light changes in the lateral direction of the captured image. Therefore, the same effect as pan shooting in which the camera body is rotated in the horizontal direction can be obtained. In the present embodiment, hereinafter, the rotation of the mirror 210 around the X rotation axis is referred to as “tilt rotation”, and the rotation of the mirror 210 around the Z rotation axis is referred to as “pan rotation” (see FIG. 4). .

  In addition, it is assumed that the digital camera 100 according to the present embodiment has a blur correction function. In this case, image blur that occurs when the digital camera 100 is rotated about the horizontal axis in the direction parallel to the X rotation axis and the vertical axis in the direction parallel to the Z rotation axis is corrected. Here, as shown in FIG. 5, the movement around the horizontal axis parallel to the X rotation axis is “pitch”, and the movement around the vertical axis parallel to the Z rotation axis is “yaw”.

  As shown in FIG. 5, the digital camera 100 according to the present embodiment includes a pitch detection unit 400a for detecting a pitch generated in the digital camera 100 and a yaw detection unit 400b for detecting yaw. The pitch detection unit 400a and the yaw detection unit 400b are configured by angular velocity sensors using a vibration gyro, a sound piece gyro, or the like, for example. In other words, the pitch detector 400a detects the pitch by detecting the angular velocity of the movement around the horizontal axis parallel to the X rotation axis. Similarly, the yaw detector 400b detects yaw by detecting the angular velocity of the movement around the vertical axis parallel to the Z rotation axis.

  In blur correction, the mirror 210 is controlled to rotate so as to change the incident light in the direction opposite to the generated pitch and / or yaw. In the present embodiment, hereinafter, the rotation of the mirror 210 around the X rotation axis by the blur correction function is referred to as “pitch correction rotation”, and the rotation of the mirror 210 around the Z rotation axis is referred to as “yaw correction rotation”. (See FIG. 4).

  Next, the internal configuration of the digital camera 100 will be described with reference to FIG. FIG. 6 is a block diagram showing an internal configuration of the digital camera 100. As shown in the figure, the digital camera 100 according to the present embodiment includes the distance measurement / photometry unit 120, the operation unit 130, the display unit 140, the optical unit 200, the image sensor 230, the mirror unit 300, the pitch detection unit 400a, the yaw unit, and the like. A control unit 110 that controls the detection unit 400b and a storage unit 150 are provided.

  The control unit 110 includes, for example, a CPU (Central Processing Unit) and a memory (register, RAM (Random Access Memory), etc.) serving as a work area, and controls each unit of the digital camera 100. In addition, each process described later is realized by executing a predetermined operation program.

  The storage unit 150 includes a storage device such as a ROM (Read Only Memory) or a flash memory, for example, and stores various data necessary for executing the operation of the digital camera 100. In this embodiment, as shown in FIG. 6, storage areas such as a captured image storage area 151 and a program storage area 152 are created in the storage unit 150, and predetermined information is stored in each storage area.

  The captured image storage area 151 stores image data indicating an image captured by the digital camera 100. The captured image storage area 151 may be configured as a removable storage device (such as a memory card) that can be attached to and detached from the digital camera 100.

  The program storage area 152 stores an operation program executed by the control unit 110. When the control unit 110 executes the operation program stored in the program storage area 152, the control unit 110 realizes functions as shown in the functional block diagram of FIG. That is, the control unit 110 functions as an imaging processing unit 111, a shake correction processing unit 112, an angle control processing unit 113, an image processing unit 114, and the like by executing the program.

  The imaging processing unit 111 performs an imaging operation by driving and controlling the optical unit 200 and the imaging element 230.

  The shake correction processing unit 112 controls the mirror unit 300 based on the detection values from the pitch detection unit 400a and the yaw detection unit 400b, and rotates the mirror 210 to execute a shake correction operation during shooting.

  The angle control processing unit 113 controls the mirror unit 300 according to the operation of the operation unit 130 (cross key 134) during the moving image capturing operation, and performs image capturing by pan / tilt operation that rotates the mirror 210 in two axes. Change the angle of the image. In this embodiment, framing is performed by this angle change (details will be described later).

  The image processing unit 114 performs predetermined image processing (for example, data compression processing) on the captured image data generated by the image sensor 230 under the control of the imaging processing unit 111, and the processed image data is captured image storage area 151. To store.

  In the present embodiment, the above-described functional configuration is logically realized by the control unit 110 executing a program. These functions are, for example, ASIC (Application Specific Integrated Circuit) or the like. It may be configured by hardware.

  The operation of the digital camera 100 configured as described above will be described below. First, moving image capturing processing executed by the digital camera 100 when a moving image is captured using the digital camera 100 will be described with reference to a flowchart shown in FIG. In the present embodiment, imaging processing when the shake correction mode is valid will be described. This moving image capturing process is started when the digital camera 100 is activated in the moving image shooting mode.

  When the shutter button 131 is operated after the processing is started, the shutter button 131 functions as a start key for moving image shooting. In this case, when an input signal resulting from the operation of the shutter button 131 is input to the control unit 110, the imaging processing unit 111 determines that an instruction to start shooting is given (Step S101: Yes), and starts an imaging operation (Step S101). S102).

  Here, for example, the focusing lens 220a and the lens unit 220c are driven according to the detection of the distance measuring / photometry unit 120 to perform the AF operation, and the zoom lens 220b is driven according to the operation of the zoom button 132. To zoom. Further, by controlling the lens unit 220c and the image sensor 230, incident light is converted into image data, and moving image data is sequentially generated.

  In parallel with such an imaging operation, a shake correction amount calculation process by the shake correction processing unit 112 is executed (step S200). This blur correction amount calculation processing will be described with reference to the flowchart shown in FIG.

When the processing is started, the blur correction processing unit 112 first controls the pitch detection unit 400a and the yaw detection unit 400b to start the respective detection operations, and acquires the angular velocity detection value of the pitch from the pitch detection unit 400a. The yaw angular velocity detection value is acquired from the yaw detection unit 400b (step S201). Here, in order to facilitate understanding, the detected angular velocity value of the pitch and the detected angular velocity value of the yaw are collectively expressed as ω _i .

Next, the shake correction processing unit 112 calculates the angular displacement θ _i using the angular velocity detection value ω _i acquired in step S201 (step S202). This angular displacement θ _i is calculated, for example, by integrating the angular velocity detection value ω _i . The calculated angular displacement θ _i indicates the angle of movement of the digital camera 100 due to the pitch and / or yaw at that time.

The shake correction processing unit 112 sequentially records the angular velocity detection value ω _i and the angular displacement θ _i acquired and calculated in this way in the work area (memory) (step S203). Such recording of detected values and calculated values relating to blur is hereinafter referred to as “blur detection history”.

Next, the blur correction processing unit 112 calculates a correction angle θ ′ _i based on the calculated angular displacement θ _i (step S204). The correction angle θ ′ _i is an operation angle when the mirror 210 is rotated in order to correct the shake of the captured image caused by the shake amount θ _i . Here, for example, it is assumed that the shake is corrected by rotating it by θ in the direction opposite to the generated shake angle. That is, the correction angle θ ′ _i can be calculated by calculating “θ ′ _i = −θ _i ”.

Here, the shake correction processing unit 112 determines whether or not the previous shake detection history is recorded in the work area (step S205). Here, since the recording of step S203 is the first time, there is no previous detection history (step S205: No). In this case, the shake correction processing unit 112 sets a drive angular velocity V that is a rotation speed when the mirror 210 is rotated for shake correction. Here, the pitch and / or yaw angular velocity ω _i acquired in step S201 is set as the driving angular velocity V (step S206).

  When the driving angular velocity V is set and the sampling time Ts preset as the execution interval of the correction operation elapses (step S210: Yes), the flow returns to the moving image capturing processing flow shown in FIG.

  In the moving image capturing process, the moving image data of the moving image captured by the imaging operation started in step S102 is processed by the image processing unit 114 and displayed on the display unit 140, and the image data sequentially captured image storage area 151 (step S103).

  If the pan / tilt operation is not performed by the user operating the cross key 134 during such an imaging operation (step S104: No), the blur correction processing unit 112 performs the blur correction amount calculation process (see FIG. A blur correction process for performing the blur correction according to the blur correction amount obtained in 9) is executed (step S300). This blur correction process will be described with reference to the flowchart shown in FIG.

  When the process is started, the blur correction processing unit 112 first determines whether or not it is the first blur correction operation in the blur correction process (step S301). Here, it is determined whether or not it is the first time based on the presence or absence of the shake detection history. That is, if it is determined that “no previous detection history” is determined in step S205 of the shake correction amount calculation process (FIG. 9) (step S205: No), it is determined that the operation is the initial operation (step S301). : Yes).

In this case, the shake correction processing unit 112 controls the mirror unit 300 and drives the angular velocity V until the angle of the mirror 210 reaches the correction angle θ ′ _i calculated in step S204 of the shake correction amount calculation process (FIG. 9). Thus, the mirror 210 is rotated (step S302, step S303: No). Here, it is assumed that a correspondence relationship between the operation amounts of the first actuator 311 and the second actuator 321 and the rotation angle of the mirror 210 is defined in advance, and the blur correction processing unit 112 is based on this correspondence relationship. By controlling the first actuator 311 and the second actuator 321, the mirror 210 is rotated at the driving angular velocity V until the correction angle θ ′ _i is reached.

  By such an operation, the mirror 210 rotates in the reverse direction at the same speed as the angular velocity according to the pitch and / or yaw generated during moving image shooting, and the image blur caused by the pitch and / or yaw is corrected. .

When the mirror 210 is rotated to the correction angle θ ′ _i and a correction operation according to the detected pitch and / or yaw is performed (step S303: Yes), the flow returns to the flow of the moving image capturing process shown in FIG. In the moving image capturing process, the blur correction amount calculation process (step S200) and the blur correction process (step S300) are repeatedly executed until a shooting end operation is performed (step S105: No). The second and subsequent operations of the blur correction amount calculation process executed a plurality of times will be described with reference to FIG.

In the second and subsequent times, since the shake detection value has already been recorded in the work area, the shake correction processing unit 112 determines that “there is a shake detection history” in step S205 (step S205: Yes). In this case, the shake correction processing unit 112 predicts the shake amount based on the shake detection history. Here, the blur correction processing unit 112 calculates the predicted angular velocity ω Ρ _i and the predicted angular displacement θ Ρ _{i + 1} (step S207). In this case, for example, the angular acceleration a _i is obtained by comparing the current angular velocity detection value ω _i with the previous angular velocity detection value ω _i−1 . Then, the predicted angular velocity ω Ρ _i is obtained by calculating Equation 1 using such angular acceleration a _i .

(Equation 1)
ωP _i = ω _i + a _i · Ts

Also, blur correction processing unit 112, by calculating the number 2 is used this way the predicted angular velocities Omegaro _i and the current angular displacement theta _i found, the predicted angular displacement θΡ _{i + 1} of the next detection time Ask.

(Equation 2)
θΡ _{i + 1} = θ _i + ωΡ _i · Ts

In this way, when the predicted angular velocity ω Ρ _i and the predicted angular displacement θ 求 め る_{i + 1} are obtained, the blur correction processing unit 112 predicts the correction angle at the next detection based on the predicted angular displacement θ Ρ _{i + 1} . Here, a predicted correction angle increment Δθ ′ _{i + 1} that is an increment from the current correction angle θ ′ _i is obtained (step S210).

That is, at the time of executing the first blur correction process, the mirror is rotated to θ ′ _{i in} step S302 of the blur correction process (FIG. 10), so the mirror is rotated by the predicted increment from the angular displacement at that time. Then, correction corresponding to the predicted angular displacement θΡi _{+ 1} can be performed. Therefore, here, the prediction correction angle increment Δθ ′ _{i + 1} is obtained by calculating Equation 3.

(Equation 3)
Δθ ' _{i + 1} = θΡ _{i + 1} −θ' _i

  Here, in order to perform smooth blur correction during moving image capturing, it is desirable to rotate the mirror 210 at a constant speed. In this case, even when the rotation angular velocity of the mirror 210 is fixed to a predetermined value, the moving speed on the image differs depending on the position of the mirror 210 due to the influence of the image size or the change in the angle of view due to the zoom. Will result in an unnatural image. In order to prevent such inconvenience, the blur correction processing unit 112 calculates a driving angular velocity according to the angle of the mirror 210 at that time. Here, a variable driving angular velocity V ′ that is equal to the driving angular velocity V when the mirror 210 is rotated from the reference position is calculated (step S209). Can be made constant speed.

Here, for example, the rotation time of the mirror 210 is set to t, the rotation radius is set to r, and a sine function as shown in Equation 4 is calculated, so that the drive angular velocity V (= angular velocity ω _i ) is constant. The driving angular velocity V ′ can be obtained.

(Equation 4)
V '＝ r ・ sin (ω _i・ t) / t

  In this way, the driving angular velocity of the mirror 210 in the second and subsequent blur correction operations is obtained, and when the sampling time Ts has elapsed (step S210: Yes), the flow returns to the moving image capturing process shown in FIG. The blur correction process executed in this case will be described with reference to FIG. That is, it is an operation of the shake correction process in which the shake correction operation is performed for the second time or later.

In the second and subsequent times (step S301: No), the shake correction processing unit 112 controls the mirror unit 300 to move the mirror 210 at the variable drive angular velocity V ′ calculated in step S209 of the shake correction amount calculation process (FIG. 9). It is rotated (step S304). Here, the mirror 210 is rotated until it reaches the position of the predicted correction angle increment Δθ ′ _{i + 1} calculated in step S208 (step S305: No).

Then, when the mirror 210 rotates to the position of the predicted correction angle increment Δθ ′ _{i + 1} (step S305: Yes), the flow returns to the flow of the moving image capturing process shown in FIG. In the moving image capturing process, the shake correction amount calculation process (step S200) and the shake correction process (step S300) are repeatedly executed until a predetermined end instruction is received (step S105: No). Then, the moving image data of the moving image captured while performing the blur correction by the blur correction process is processed by the image processing unit 114 (step S103), displayed on the display unit 140, and the image data sequentially captured image storage area. 151.

  In such blur correction, in the second and subsequent correction operations, the rotation speed of the mirror 210 is set to the variable drive angular velocity V ′, so that the blur correction processing unit 112 can perform the first operation as the mirror 210 moves away from the reference position. The driving speed of the actuator 311 and / or the second actuator 321 is controlled to gradually decrease. Thereby, the movement of the image by the rotation of the mirror 210 becomes constant speed regardless of the position of the mirror 210.

  In this way, when the cross key 134 is operated during moving image shooting while performing blur correction (step S104: Yes), pan / tilt processing is executed by the angle control processing unit 113 ( Step S400). This pan / tilt processing will be described with reference to the flowchart shown in FIG.

  When the processing is started, the angle control processing unit 113 determines whether the operation is a tilt operation or a pan operation based on an input signal from the cross key 134 (operation unit 130). That is, when tilting, the up / down key is operated, and when panning, the left / right key is operated. Whether the up / down key of the cross key 134 is operated or not, whether the tilt operation or the pan operation is performed. Is determined (step S401).

  When it is a tilt operation (step S401: Yes), the angle control processing unit 113 calculates the vertical field angle θvy of the captured image in cooperation with the imaging processing unit 111 and the image processing unit 114 (step S402). Here, the lens focal length f at that time is acquired from the imaging processing unit 111, the vertical size Y ′ of the captured image is acquired from the image processing unit 114, and the angle of view θvy is calculated by calculating the following equation (5). calculate.

(Equation 5)
θvy = 2 ・ tan ^-1 (Y '/ 2f)

  When a so-called digital zoom function for enlarging an image by image processing is used, the magnification M of the digital zoom is acquired from the image processing unit 114, and the angle θvy is obtained by dividing the result obtained by Equation 5 by M. Can be sought.

Next, the angle control processing unit 113 calculates a predetermined coefficient Ay corresponding to the calculated vertical view angle θ _vy (step S403). This coefficient Ay is a coefficient that becomes smaller as the angle of view becomes smaller. By calculating a ratio between the current angle of view θvy and the angle of view θvy0 at a predetermined focal length f0, that is, “θvy / θvy0”. Desired. The focal length f0 is, for example, the minimum focal length in the zoom performance of the lens unit 220. The angle of view θvy0 in the vertical direction at that time can be obtained by substituting f0 in place of f in Equation 5.

  Next, the angle control processing unit 113 acquires the tilt operation amount By based on the operation time of the up / down direction key of the cross key 134 (operation unit 130) (step S404). That is, since the tilt operation by operating the cross key 134 is performed while pressing one of the up and down keys of the cross key 134, the tilt operation amount By based on the pressing time of the corresponding key is acquired. .

  Next, the angle control processing unit 113 calculates B′y indicating the actual amount of tilt motion (step S405). The tilt operation amount B′y is calculated by multiplying the coefficient Ay and the tilt operation amount By.

  When the tilt operation amount B′y is obtained in this way, the angle control processing unit 113 controls the mirror unit 300 to rotate the mirror 210 by the tilt operation amount B′y. That is, by controlling the first actuator 311, the mirror 210 is rotated about the X rotation axis by B′y (step S 406).

  At this time, the angle control processing unit 113 displays a tilt indicator TI indicating a tilt operation amount on the display unit 140 in cooperation with the image processing unit 114 (step S407). That is, as shown in FIGS. 12A to 12C, the angle of the image displayed on the display unit 140 changes in the vertical direction (tilt) in accordance with the operation of the vertical key of the cross key 134. In addition, a tilt indicator TI indicating the amount of change is displayed.

  In this way, during the tilt operation, the shake correction processing unit 112 performs the yaw shake correction operation (step S408). Here, the blur correction process in step S300 is executed based on the blur correction amount calculated in the blur correction amount calculation process in step S200. However, during the tilt operation, the blur correction is performed only for the yaw blur. .

  Such an operation is repeatedly executed while the up / down direction key of the cross key 134 is operated (step S409: No), and tilt shooting corresponding to the operation amount by the user is realized. In this case, the main body of the digital camera 100 is stationary. That is, tilt shooting is realized without rotating the main body in the vertical direction. In this case, since the blur correction for the yaw is performed, the yaw blur is corrected while the tilt operation is performed, so that a moving image without camera shake can be obtained. Then, when the operation of the cross key 134 is finished (step S409: Yes), the flow returns to the moving image capturing process shown in FIG.

  On the other hand, even when the left / right direction key of the cross key 134 is operated to instruct panning (step S401: No), the panning operation is executed by performing the same process as the tilting operation. In this case, the angle control processing unit 113 calculates the horizontal angle of view θvx of the captured image in cooperation with the shake correction processing unit 112 (step S410). Here, θvx is calculated by obtaining the lateral size X ′ of the captured image from the image processing unit 114 and substituting and calculating X ′ in place of Y ′ in Equation (5).

  In addition, the angle control processing unit 113 calculates a coefficient Ax that changes according to the angle of view in the horizontal direction by the same method as the coefficient Ay calculated during the tilting operation (step S411). Then, the pan operation amount Bx based on the operation time of the left / right direction key of the cross key 134 is acquired (step S412), and the pan operation amount B′x is calculated by multiplying the calculated coefficient Ax (step S413). By controlling the unit 300, the mirror 210 is rotated about the Z rotation axis by B′x to perform a pan operation, and a pan indicator PI indicating the pan operation amount is displayed on the display unit 140 (step S414, Step S415). During such a pan operation, the shake correction processing unit 112 executes a shake correction operation in the pitch direction (step S416). Such an operation is repeatedly executed while the left / right direction key of the cross key 134 is operated (step S417: No).

  By such an operation, as shown in FIGS. 12D to 12F, the angle of the image displayed on the display unit 140 changes in the horizontal direction in accordance with the operation of the horizontal key of the cross key 134. A pan indicator PI indicating the amount of change is displayed along with (Pan). In this case, the main body of the digital camera 100 is stationary. That is, pan shooting is realized without rotating the main body in the left-right direction. In this case, since the blur correction for the pitch is performed, the pitch blur is corrected while performing the pan operation, so that a moving image without camera shake can be obtained.

  Then, when the operation of the cross key 134 is finished (step S417: Yes), the flow returns to the moving image capturing process shown in FIG.

  In the flow of the moving image capturing process, until the operation of the shutter button 131 functioning as a stop button for moving image shooting, the above-described imaging operation, blur correction amount calculating operation, blur correcting operation, and pan / tilt operation are executed. A moving image is picked up (step S105: No). When the shutter button 131 is operated to stop moving image capturing (step S105: Yes), the imaging processing unit 111 stops the imaging operation. In this case, the angle control processing unit 113 controls the mirror unit 300 to return the mirror 210 to the reference position (step S106). In addition, the blur correction processing unit 112 clears the blur detection process recorded in the blur correction process in the current moving image imaging process (step S107), and all the processes are completed.

  As described above, by applying the present invention as in the above embodiment, the bending mirror (reflector) used in the bending optical digital camera can be rotated in two axial directions according to the user operation. Therefore, it is possible to perform tilt shooting and pan shooting without rotating or moving the camera body. In other words, it is possible to change the angle of the captured image by tilting and panning while the camera body is stationary, so camera shake and images during movie shooting with a lightweight, small flex optical camera The occurrence of blurring can be prevented.

  Also, the shake correction operation for the pitch is stopped while the tilt operation is performed, and the shake correction operation for the yaw is stopped while the pan operation is performed. It is possible to avoid the occurrence of deviation from the subject to be imaged, and to reduce the occurrence of so-called shaking that can occur when the pan / tilt operation and blur correction are performed simultaneously. In this case, since it is possible to reliably determine that the tilting operation or the panning operation is being performed by the user's switch operation, a special configuration for reducing the swing back is not required. Therefore, blur correction control can be realized with a simple configuration.

  Further, since the mirror 210 is rotated around the Z rotation axis while maintaining the angle at which the incident light is appropriately bent by the image sensor 230, the captured image can be panned at any position in the pan rotation range. No distortion or tilt occurs in the horizontal direction.

  Furthermore, during pan / tilt operation, the moving speed on the captured image is controlled to be constant by changing the rotation speed of the mirror 210 based on the pan / tilt operation amount and the angle of view at that time. Therefore, the image changes smoothly during moving image shooting, and as a result, it is possible to obtain an easy-to-view moving image without image shaking. Similarly, even during the blur correction operation, the rotation speed (drive angular velocity) is controlled to be constant according to the position of the mirror 210, so that the image shake due to the blur correction can be reduced.

  The said embodiment is an example and the application range of this invention is not restricted to this. That is, various applications are possible, and all embodiments are included in the scope of the present invention.

  For example, in the above embodiment, the actuator that rotates the mirror 210 is configured by a voice coil motor. However, the present invention is not limited to this, and may be configured by a piezoelectric actuator, a bimorph piezoelectric actuator, or the like. Further, the configuration for holding the mirror 210 shown in the above embodiment is an example, and the mirror 210 can be held so as to be rotated by tilt (pitch correction rotation) and / or pan rotation (yaw correction rotation). If so, the configuration for holding the mirror 210 is not limited to that shown in the above embodiment, and any configuration may be adopted.

  In the above embodiment, the mirror 210 is rotated by a rotation amount equal to the angular displacement (blur amount) to correct the blur. However, the rotation amount is not limited to this, and is, for example, 1/2 of the blur amount. You may correct | amend by making it rotate to a reverse direction with rotation amount. In addition, the method for obtaining the rotation amount, the driving angular velocity, and the like of the mirror 210 shown in the above embodiment is an example, and these may be calculated and rotated by any method.

  Further, in the above embodiment, the blur correction is performed while predicting the angular displacement (blur amount) as needed based on the detected angular velocity, but the detection by the pitch detection unit 400a and the yaw detection unit 400b is performed without performing the prediction operation. A correction operation may be performed as needed based on the value.

It is a figure which shows the external appearance structure of the digital camera concerning embodiment of this invention, (a) shows the front of a digital camera, (b) shows the back of a digital camera. It is a figure for demonstrating the optical unit of the digital camera shown in FIG. 1, (a) is a figure for demonstrating the position of an optical unit, (b) is a figure which shows the structure of an optical unit roughly. is there. It is a figure which shows the detailed structural example of the optical unit shown in FIG. 4A and 4B are diagrams illustrating the configuration of the mirror unit illustrated in FIG. 3, in which FIG. 3A illustrates the configuration of the mirror unit viewed from the front side of the digital camera, and FIG. 3B illustrates the configuration of the mirror unit viewed from the side of the digital camera. . It is a figure for demonstrating the X rotation axis | shaft and Z rotation axis | shaft, pitch, yaw, etc. in the digital camera concerning embodiment of this invention. It is a block diagram which shows the internal structure of the digital camera concerning embodiment of this invention. It is a functional block diagram which shows the function structure implement | achieved by the control part shown in FIG. It is a flowchart for demonstrating the moving image imaging process performed in embodiment of this invention. It is a flowchart for demonstrating the blurring amount calculation process performed in the moving image imaging process shown in FIG. It is a flowchart for demonstrating the blurring correction process performed in the moving image imaging process shown in FIG. It is a flowchart for demonstrating the pan / tilt process performed in the moving image imaging process shown in FIG. It is a figure for demonstrating pan / tilt operation | movement concerning embodiment of this invention, (a)-(c) shows the example of a screen display at the time of tilt operation, (d)-(f) is at the time of pan operation An example of the screen display is shown.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Digital camera, 110 ... Control part, 111 ... Image pick-up processing part, 112 ... Blur correction processing part, 113 ... Angle control processing part, 114 ... Image processing part, 120 ... Distance measuring / photometry part, 131 ... Shutter button, 140 DESCRIPTION OF SYMBOLS ... Display part 150 ... Memory | storage part 151 ... Captured image storage area, 152 ... Program storage area, 200 ... Optical unit, 210 ... Mirror, 220 ... Lens unit, 230 ... Imaging element, 300 ... Mirror unit, 310 ... 1st 311 ... first actuator 320 ... second holder 321, second actuator 400a ... pitch detector 400b ... yaw detector

Claims (5)

In a digital camera that has a video imaging function and bends incident light by a reflector to form a subject image on an imaging device.
Drive means for rotationally driving the reflector;
A user operation means that is operated by a user and generates an input signal corresponding to the operation;
A motion detection means for detecting the motion of the digital camera which causes blurring of the captured image;
When there is a predetermined input signal from the user operation means, the drive means is controlled, and the reflector is rotated based on the input signal from the user operation means to tilt and / or pan the captured image. And a first control unit that rotates the reflector according to the motion detected by the motion detection unit and corrects blur in the captured image ;
When there is no predetermined input signal from the user operation means, the drive means is controlled, and the reflector is rotated according to the motion detected by the motion detection means to correct blur in the captured image. Control means,
A digital camera comprising: The driving means includes
A first axis that rotates the reflector around a first axis that is a central axis of the reflector and is parallel to the horizontal direction of the digital camera and orthogonal to the optical axis of incidence on the reflector. Driving means;
Second driving means for rotating the reflector around a second axis parallel to the vertical direction of the digital camera;
The first control means controls the first driving means when a tilt operation is instructed based on an input signal from the user operation means, and the second drive when a pan operation is instructed. Control means,
The digital camera according to claim 1. The movement detecting means detects movement around the first axis and movement around the second axis in the digital camera ;
Said first control means, while performing the tilt operation performs only shake correction according to the movement around the second axis, while doing the pan operation to move around the first axis Do only such blur correction,
The digital camera according to claim 2. The first control means controls the driving means so that the reflector rotates at a constant speed.
The digital camera according to any one of claims 1 to 3, wherein The first control unit controls the driving unit so that a rotation speed of the reflector changes according to an operation amount based on an input signal from the user operation unit.
The digital camera according to claim 1, wherein the digital camera is a digital camera.

Images