JP5270870B2 - Imaging apparatus and control method thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To obtain a photographic image with proper exposure by adjusting the exposure for special effect. <P>SOLUTION: The imaging apparatus 101 is equipped with: an imaging device 106 functioning as an imaging means for photoelectrically converting a subject image formed by an imaging optical system 102; a moving means for moving the subject image relatively to the imaging device 106; an exposure control part 115 functioning as an exposure control means for controlling the exposure of the subject image; an arithmetic calculation means for arithmetically calculating a target moving amount for the special effect of the moving means based on locus data for special effect stored in a memory; and a driving means for driving the moving means at least based on the target moving amount. When the moving means is driven based on the target moving amount for special effect, the exposure control part 115 adjusts the exposure based on the locus data for special effect. <P>COPYRIGHT: (C)2009,JPO&amp;INPIT

Description

  The present invention relates to a technique for acquiring an image having a special effect by capturing a subject image while moving it with respect to an imaging surface in an imaging apparatus such as a digital camera.

  In recent years, digital cameras have been widely used, and many users have taken various pictures in various scenes. Many cameras have been commercialized in which a large number of shooting programs suitable for a scene are prepared in advance so that the user can select a shooting mode so that appropriate shooting can be performed even in such various scenes.

  At the same time, many digital cameras equipped with a camera shake correction mechanism have been commercialized. The camera equipped with this camera shake correction mechanism is controlled so as not to move the subject image relative to the imaging surface so as to reduce camera shake during shooting by the user. A camera equipped with such a camera shake correction mechanism plays a role of further expanding a user's shooting scene.

  As the above-described shooting mode, a camera that has a special effect using a camera shake correction mechanism is introduced.

  Patent Document 1 discloses a technique for obtaining a soft filter effect and a cross filter effect by performing exposure while moving a camera shake correction mechanism.

  Patent Document 2 discloses the relationship between the timing of irradiating a subject using a strobe and the driving of a correction mechanism for obtaining a special effect.

As disclosed in Patent Documents 1 and 2, in the case of two-dimensional shaking regardless of the subject image, the moving mechanism can be driven in a sufficiently short time with respect to the entire exposure time. Further, in the case of swinging so as to draw a cross that is a simple figure, it is sufficient to repeatedly drive the moving mechanism during a predetermined exposure time.
JP-A-2-58034 Japanese Patent Application Laid-Open No. 11-64941

  However, when the subject image includes, for example, a point light source, there are cases where it is desired to move the subject image relative to the imaging surface while exposing and draw a figure on the captured image. In the case of such special effects, the point light source generally has higher brightness than the main subject, so when the exposure amount is adjusted to the point light source, the main subject becomes a dark image, and when the exposure amount is adjusted to the main subject, the point light source There is a problem that an image becomes excessively bright.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to obtain a photographed image with an appropriate exposure amount by adjusting the exposure amount for special effects.

A first aspect of the present invention relates to an imaging apparatus, an imaging unit that photoelectrically converts a subject image formed by an imaging optical system, and a movement for moving the subject image relative to the imaging unit. Means, exposure control means for controlling the exposure amount of the subject image, calculation means for calculating a movement target amount for special effects of the movement means based on trajectory data for special effects stored in a memory, Drive means for driving the movement means based on at least the special effect movement target amount, and the exposure control means is configured to drive the movement means based on the special effect movement target amount. In this case, the exposure amount is adjusted based on the trajectory data for the special effect, and the adjusted exposure is performed when the imaging apparatus drives the moving unit based on the movement target amount for the special effect. Taken by quantity A first captured image, further Ru comprising an image combining means for combining a second captured image taken with an exposure amount corresponding to the luminance of the object image without a movement target amount for the special effects It is characterized by that.

According to a second aspect of the present invention, an imaging unit that photoelectrically converts a subject image formed by an imaging optical system, and a moving unit that moves the subject image relative to the imaging unit are provided. In accordance with a method for controlling an imaging apparatus, the calculation means of the imaging apparatus calculates a movement target amount for special effects of the movement means based on trajectory data for special effects stored in a memory, and the imaging A driving means of the apparatus driving the moving means based on the movement target amount for the special effect, and an exposure control means of the imaging apparatus adjusts the exposure amount based on the trajectory data for the special effect A first photographed image photographed with the adjusted exposure amount when the image synthesizing unit of the imaging apparatus drives the moving unit based on the movement target amount for the special effect; Move for effect Characterized in that it comprises a step of synthesizing a second captured image taken with an exposure amount corresponding to the luminance of the object image without using the target amount, and the.

  According to the present invention, it is possible to adjust the exposure amount for special effects and obtain a photographed image with an appropriate exposure amount.

(First embodiment)
FIG. 1 is a diagram showing an imaging apparatus according to a preferred first embodiment of the present invention. Reference numeral 101 denotes an entire imaging apparatus such as a digital camera. Reference numeral 102 denotes an imaging optical system such as a photographing lens, 103 denotes a camera shake correction lens disposed in the imaging optical system 102, and 104 denotes an optical axis of the imaging optical system. The camera shake correction lens 103 functions as a moving unit for moving the subject image relative to the imaging unit. Reference numeral 105 denotes a lens barrel, reference numeral 106 denotes an imaging element as an imaging means for photoelectrically converting a subject image, and reference numeral 107 denotes a memory for temporarily storing image data and various information. Reference numeral 108 denotes a camera shake detection sensor configured by a gyro sensor that detects camera shake, and 109 denotes a drive unit that drives the camera shake correction lens 103. Reference numeral 110 denotes a power source for supplying power to the imaging apparatus 101, and reference numeral 111 denotes a release button for instructing start of shooting. Specifically, a shooting preparation instruction is issued by pressing about half of the pressing stroke (SW1), and a shooting operation instruction is issued when pressed down to the end (SW2). Reference numeral 112 denotes a strobe for irradiating (illuminating) the subject. An operation unit 113 includes a plurality of buttons and dials for menu display and item selection. A display unit 114 arranged on the back surface of the imaging apparatus 101 is a display unit that functions as an electronic viewfinder by displaying captured images and menu information, and displaying subject images sequentially. Reference numeral 115 denotes an exposure control unit that includes a diaphragm and an ND filter.

  The imaging apparatus 101 forms an object image in the vicinity of the imaging element 106 using the imaging optical system 102 and a focus adjustment unit (not shown). The image sensor 106 photoelectrically converts the subject image formed by the imaging optical system 102. Then, in synchronization with the operation of the release button 111 by the user, an image signal is acquired from the image sensor 106, processed as described later, and recorded in the memory 107. At this time, the strobe 112 is caused to emit light in synchronization with the imaging operation in accordance with an instruction by the user's operation on the operation unit 113 or automatic determination. In the case of the camera shake correction mode, the drive unit 109 drives the camera shake correction lens 103 based on the signal of the camera shake detection sensor 108 during exposure, thereby correcting the relative displacement of the subject image due to camera shake. To do. Note that ON / OFF of a mode for correcting camera shake is set from a menu displayed on the display unit 114 by operating the operation unit 113. Further, whether or not to perform locus drawing, which will be described later, and what kind of locus drawing is performed are also set by menu selection by operation of the operation unit 113.

  FIG. 2 is a block diagram illustrating an electrical configuration of the imaging apparatus 101. The imaging apparatus 101 includes an imaging system, an image processing system, a recording / reproducing system, and a control system. The imaging system includes an imaging optical system 102 and an imaging element 106. The image processing system includes an A / D converter 201 and an image processing circuit 202. The recording / reproducing system includes a recording processing circuit 203, a memory 107, an interface unit 207 with a removable recording medium, and a removable recording medium 208. The control system includes a camera system control unit 204, a camera shake detection sensor 108, a lens system control unit 205, and an exposure control unit 115 as exposure control means. The lens system control unit 205 includes a position detection sensor 206 that detects the position of the camera shake correction lens 103 and a camera shake correction lens driving unit 109.

  The imaging system is an optical processing system that forms an image of light from an object on the imaging surface of the imaging element 106 via the imaging optical system 102, and is based on the control amount of the exposure control unit 115 and the amount of light exposed by the imaging element 106. The exposure control unit 115 is controlled to adjust the exposure amount. Further, the image sensor 106 is exposed to an appropriate amount of object light. The image processing circuit 202 is a signal processing circuit that processes an image signal corresponding to the number of pixels of the image sensor 106 received from the image sensor 106 via the A / D converter 201. The image processing circuit 202 includes a white balance circuit, a gamma correction circuit, an interpolation calculation circuit for increasing resolution by interpolation calculation, an image synthesis circuit for combining images, and the like.

  The recording processing circuit 203 outputs image data to the memory 107 and generates and stores an image to be output to the display unit 114. The recording processing circuit 203 compresses still images and moving images using a known method and records the compressed images on the recording medium 208.

  The camera system control unit 204 detects a user's operation on the operation unit 113 and controls each unit, detects an operation on the release button 111, generates an imaging timing signal, and outputs it. The camera shake detection sensor 108 detects camera shake. The lens system control unit 205 appropriately controls the lens and the like according to the signal from the camera system control unit 204. The exposure control unit 115, which is an aperture or an ND filter, is appropriately controlled according to the signal from the camera system control unit 204. The lens system control unit 205 includes a drive unit 109 and drives the camera shake correction lens 103 using the drive unit 109.

  The control system controls the imaging system, the image processing system, and the recording / reproducing system in response to an external operation. For example, pressing of the release button 111 is detected, and driving of the image sensor 106, operation of the image processing circuit 202, compression processing in the recording processing circuit 203, and the like are controlled.

  A camera shake detection sensor 108 is connected to the camera system control unit 204. When a camera shake correction mode is set from the menu by operating the operation unit 113, a target position signal is sent to the lens system control unit 205 based on the signal from the camera shake sensor 108, and the drive unit 109 moves the camera shake correction lens 103. To drive. When the locus drawing mode for performing locus drawing is set, the driving unit 109 drives the camera shake correction lens 103 in accordance with the locus data for special effects read from the memory 107.

  Next, the camera shake correction system will be described in detail with reference to FIGS.

  The control block of the camera shake correction system is configured as shown in FIG. A camera shake signal detected by the camera shake detection sensor 108 passes through a high-pass filter 302 that passes a signal having a predetermined frequency or higher, and is converted into a shake amount by an integrator 303 to be a first movement target amount 300a for camera shake correction. Is generated. Then, the output signal of the position detection sensor 206 that detects the position of the camera shake correction lens 103 is added to the converted shake amount in the calculation unit 304, and the drive unit 109 drives the camera shake correction lens 103 based on this signal. To do.

  Thus, in the case of normal camera shake correction control, the camera 109 is canceled by controlling the drive unit 109 based on the first movement target amount 300a and driving the camera shake correction lens 103. In the present embodiment, the second movement amount 301 for special effects output from the locus control unit 305 is added to the first movement target amount 300a to generate the third movement target amount 300b. Then, a detection signal of the position detection sensor 206 that detects the position of the camera shake correction lens 103 is added to the third movement target amount 300 b in the calculation unit 304. The drive unit 109 drives the camera shake correction lens 103 based on this signal. As will be described in detail later, the trajectory control unit 305 receives trajectory data stored in the memory 107, converts it into a second movement amount 301, and outputs it at a predetermined timing. Note that both the first movement target amount 300a and the second movement amount 301 are amounts that are changed from moment to moment even while one image is being shot (during exposure to the image sensor 106). This will be specifically described later.

  Further, the high-pass filter 302, the integrator 303, the calculation unit 304, and the trajectory control unit 305 are built in the camera system control unit 204. The outputs of the hand movement sensor 108 and the position detection sensor 206 are input to the high-pass filter 302 and the calculation unit 304 via an A / D converter (not shown), respectively. Further, the drive amount signal output from the arithmetic unit 304 is converted into an analog signal by a D / A converter (not shown).

  In the above description, one system has been described for one axis with respect to the movement direction of the camera shake correction lens 103, but the camera shake correction lens 103 actually moves in a plane perpendicular to the optical axis 104. Therefore, two systems are required to move in two axes in the plane, and the present embodiment also has two systems.

  4, 5 and 6 are diagrams for schematically explaining the operation of the camera shake correction lens 103 by the feedback control system of FIG. The horizontal axis represents the passage of time, and the vertical axis represents the amount of movement from the optical axis center. Since the camera shake correction lens 103 moves in a plane perpendicular to the optical axis 104, the camera shake correction lens 103 has two axial directions of x and y. However, for simplicity, only one of the axial directions will be described here. And

  FIG. 4 is a diagram illustrating a case where the camera shake correction lens 103 is driven in response to camera shake so that the subject image is imaged around the optical axis 104 without shaking on the image sensor 106. That is, the driving is based on the normal camera shake correction control, and the state when the driving unit 109 is controlled based only on the first movement target amount 300a is shown.

FIG. 5 is a diagram illustrating a state when the driving unit 109 is controlled based only on the second movement amount 301 controlled by the trajectory control unit 305. That is, the camera shake correction lens 103 draws a locus based on the locus data stored in the memory 107. Here, for the sake of explanation, it is assumed that the trajectory data stored in the memory 107 gives a single vibration for one cycle. Specific configuration of the trajectory data will be described later. For example, in the x-axis direction, x = αsin (ωt) (1)
in the y-axis direction,
y = αcos (ωt) −α (2)
Time to drive,
0 ≦ t ≦ 2π / ω (3)
Gives the trajectory data. The camera shake correction lens 103 draws one round of a circular locus having a radius α centered at (0, −α), starting from (0, 0). Here, t is time, ω is angular frequency, and α is a constant.

  FIG. 6 is a diagram illustrating a case where the drive unit 109 is controlled based on the movement target amount 300b obtained by adding the drive amounts of the camera shake correction lens 103 illustrated in FIGS. 4 and 5. By performing the camera shake correction lens movement shown in FIG. 6, the camera shake is corrected by the effect of the first movement target amount 300a, and the object image is controlled by the trajectory control unit 305 on the image sensor 106 without being affected by the camera shake. Draw a trajectory. Therefore, the image sensor 106 can obtain an image signal in which the subject moves along the trajectory controlled by the trajectory control unit 305 during exposure.

  Next, a mechanism for driving the camera shake correction lens 103 will be described with reference to FIG. FIG. 7 is a diagram schematically showing a mechanism for moving the camera shake correction lens 103 which is a part of the imaging optical system 102.

  In FIG. 7A, reference numeral 701 denotes a movable frame for holding a lens, 103 denotes a camera shake correction lens, 703 denotes a fixed portion attached to the lens barrel, 704 denotes a support / guide portion on the movable frame, and 705 denotes a support / guide portion. And shows a spring attached coaxially. Reference numerals 706a and 706b denote coils attached to the fixed portion, and reference numerals 707a and 707b denote magnets attached to the movable frame. FIG. 7B is a right side view of the camera shake correction mechanism shown in FIG. In FIG. 7B, reference numerals 710 and 712 denote yokes not shown in FIG. 7A. Reference numeral 711 denotes a movable portion position detection sensor (not shown in FIG. 7A). Specifically, it is composed of a Hall element. FIG.7 (c) is a 702 arrow directional view of Fig.7 (a). The movable frame 701 is guided and supported by the support / guide portion 704 so as to be capable of planar movement with respect to the fixed portion 703. In FIG. 7C, a circular support / guide portion 704 is inserted into an oval guide groove 713. The camera shake correction mechanism has the same structure at all three locations, so that it is restrained in the direction of the optical axis 104 of the imaging optical system 102 and can be moved on a plane orthogonal to the optical axis 104. On the movable frame 701, a camera shake correction lens 103 and driving magnets 707a and 707b are attached. The movable frame 701 is elastically supported by a spring 705 attached coaxially to the support / guide unit 704 so that the center of the camera shake correction lens 103 substantially coincides with the optical axis 104 when no driving force is generated. Is arranged. As shown in FIG. 7B, the drive portion has a configuration in which both sides of the magnet 707a are sandwiched between yokes and a coil 706a is provided on one side. The principle of the driving part will be described with reference to FIG.

  FIGS. 8A and 8B are arrow views of the drive circuit portion taken along the dotted line 708 shown in FIG. 7A. The drive magnet 707a is magnetized in the thickness direction with two poles. Furthermore, yokes 710 and 712 are provided on both sides of the magnet 707a in the magnetizing direction, so that a large amount of magnetic flux does not leak out and generates a magnetic field in the direction of the arrow as shown in FIG. 8A. I am letting. When the coil 706a is energized in this state, currents in opposite directions flow in the regions 801 and 802 on the coil 706a. On the other hand, since the direction of the magnetic field is also opposite, a force in the same direction is generated according to the Fleming left-hand rule. At this time, since the coil is fixed, the magnet 707a attached to the movable part is driven by receiving a force according to the law of action and reaction. The driving force is proportional to the current of the coil 706a, and the driving force received by the magnet 707a can be reversed by changing the direction of the current flowing through the coil 706a to the opposite direction. When the driving force is generated, the movable part is elastically supported by the spring 705, and therefore, it is displaced to a point that balances with the spring force. That is, the position of the movable part can be controlled by appropriately controlling the current of the coil 706a.

  Further, a hall element 711 is attached on the yoke 710. As shown in FIG. 8B, when the magnet 707a is displaced by the driving force generated by applying a current to the coil 706a, the hall element 711 is moved. The magnetic balance also changes. Therefore, the position of the magnet 707a can be detected by obtaining a signal from the Hall element 711.

  7 and 8 exemplify an embodiment using a moving magnet system in which a magnet is arranged in the movable part and a coil is arranged in the fixed part. However, the present embodiment can also be applied to an imaging apparatus including a moving coil in which a coil is disposed in a movable part and a magnet is disposed in a fixed part, and a camera shake correction mechanism using other driving methods.

  Next, trajectory control will be described. The trajectory data referred to by the trajectory control unit 305 is data indicating a movement amount for causing the camera shake correction lens 103 to draw a desired trajectory, and is stored in the memory 107 in advance. The trajectory data is held in several types of memory 107 and can be selected by the user. It is also possible to select a mode for automatically selecting the type of trajectory. The manner in which the locus data is stored in the memory 107 will be described with reference to FIGS.

  FIG. 9 shows a rule for storing trajectory data. The trajectory data indicating a certain “graphic” has an array structure, and the head address stores information corresponding to the length of the trajectory (basic trajectory length), that is, the trajectory data size. Based on the length information of the locus, the time required to draw the “graphic”, that is, the optimum exposure time is determined. A case where the subject has a point light source and the exposure time is different from the time from the start to the end of the locus drawing will be described below. If the trajectory drawing time is shorter than the exposure time, the exposure time in the composition with the image stabilization lens at the end point of the drawing will be longer than during drawing, and a high-intensity part will be created at some point of the drawn figure . On the other hand, if the exposure time is shorter than the trajectory drawing time, the exposure ends in the middle of drawing the “figure” and an incomplete figure is obtained. In order to solve this, in the present embodiment, the exposure time of the “graphic” is made to coincide with the locus drawing time of the “graphic”.

  FIG. 10 shows a part of the data actually stored extracted. Each figure has an array, the head address has trajectory length data (basic trajectory length), and the coordinate information for drawing the desired trajectory from the following address, that is, the target of the biaxial image stabilization lens moving axis orthogonal to the plane The movement amount data is stored. The arrow attached to the star-shaped data array schematically represents a pointer indicating the coordinate data to be read. The pointer sequentially increments the address every predetermined sampling period, and outputs the second movement amount 301 based on the read data, thereby controlling the camera shake correction lens 103 to draw a locus. The pointer increment is started in synchronization with the exposure start timing. The initial value of the pointer is changed according to the “start point” designated by the user.

  The coordinate data shown in FIG. 10 is read as it is, and the size of the figure drawn when the camera shake correction lens 103 is controlled is “medium”. When “Large” is selected by user designation, the coordinate data pointed to by the initial value of the pointer is doubled and read. After one sampling time after the start of exposure, the coordinate data stored in the address incremented by the pointer is doubled and read out, and thereafter the pointer is moved in a half cycle of the sampling cycle. At the timing when the pointer is incremented, the data at the corresponding address is doubled and read, and an intermediate value with the data read last time is output as the second movement amount 301. At the sampling timing when the pointer is not incremented, the data read at the immediately preceding sampling timing is output as the second movement amount 301. By this method, the camera shake correction lens 103 can move a trajectory that is twice as large as the reference with respect to the coordinates (0, 0) over a double time. At this time, the basic trajectory length data is also doubled and read.

  When “small” is selected by the user designation, the coordinate data pointed to by the initial value of the pointer is read by halving it. After the start of exposure, the address pointed to by the pointer is incremented by two, the data stored at that address is multiplied by 1/2, read out, and output as the second movement amount 301. According to this method, the camera shake correction lens 103 can move a trajectory that is ½ times larger than the coordinate (0, 0) in half the time. At this time, the basic trajectory length data is also read by a factor of 1/2.

  In the present embodiment, the data stored as the reference is the size “medium”, and the example of the size control of 2 times and 1/2 times has been shown. However, if this method is implemented by linear interpolation, 2 × It is also possible to control the size other than the magnifications other than ½ and ½ times, except for the integral multiples or the integral magnifications. The coordinate data of the minimum size may be stored as the data stored as the reference, or conversely, the coordinate data of the maximum size may be stored. When the locus drawing mode is OFF, 0 is always output as the second movement amount 301.

  Here, the locus drawing mode will be described with reference to FIGS.

  In the locus drawing mode, when a point light source (bright spot) is present in a subject with a dark background such as dusk or at night, the camera shake correction lens 103 is driven according to the target position while being exposed by the image sensor 106. In this mode, a locus (bright line) planned with the point light source is drawn.

  FIG. 11 is a diagram for comparing images obtained when the locus drawing mode is set to ON / OFF. FIG. 11A illustrates an example of an image obtained when shooting is performed with the setting for not performing locus drawing, that is, the locus drawing mode being OFF. A person who is the main subject is located relatively close to the imaging apparatus 101, and the background is a night view, and there is a point light source such as a street lamp. In this example of the image, a normal camera shake correction is performed at the time of photographing, and a strobe (flashing means) 112 is emitted during the exposure period to illuminate a person. FIG. 11B shows an example of an image obtained when shooting with the same composition as FIG. 11A and the locus drawing mode turned on. During exposure, the background point light source is photographed in a star shape by moving the camera shake correction lens 103 by superimposing a target value for drawing a star shape on a target value for normal camera shake correction. Although FIG. 11B shows an example of a star shape, an arbitrary figure or size can be selected by user selection.

  FIG. 12 is a diagram for explaining selection of a trajectory graphic and a size by the user.

  When a button for instructing menu display on the operation unit 113 is pressed, the menu is displayed on the display unit 114. FIG. 12 shows an example of the menu selection screen displayed on the display unit 114. The selection item of the menu is changed by operating the button indicating the vertical direction of the operation unit 113, and a desired setting can be selected by operating the button indicating the horizontal direction of the operation unit 113 for each item. When the button for instructing menu display on the operation unit 113 is pressed again or the release button 111 is pressed, the menu display disappears and the original display is restored. In the example of FIG. 12, first, whether or not “camera shake correction” is set to ON or OFF is selected in the first line. If you want to apply camera shake correction during shooting, select “On”, otherwise select “Off”.

  Next, in FIG. 12, “graphic drawing” on the second line is “ON”, that is, ON, and it is selected to enter the locus drawing mode. If it is not possible to enter the locus drawing mode, “OFF” may be selected.

  The next line is an item of “graphic selection”. In FIG. 12, this line is highlighted, indicating that the user can currently select this item. Here, it is possible to select a figure to be drawn by driving the camera shake correction lens 103 during photographing. In FIG. 12, “star shape” is selected. Icons are displayed so that "Heart" and "Round" can be selected after "Star", and there is a right triangle symbol next to these icons. This indicates that there is a simple figure. For example, “diamond” or “spade” may be further selected.

  In the next line, "Figure size" can be selected. Here, you can select how large you want to draw the graphic selected in “Select Graphic” in the captured image. In the example of FIG. 12, “small”, “medium”, and “large” can be selected. Here, “medium” is selected.

  Further, in the next line, it is possible to select a “drawing start point” that determines which point of the figure selected in “figure selection” is the drawing start point. The position of the camera shake correction lens 103 when starting the trace drawing is changed by the selection at the “drawing start point”. In the menu, "Up", "Right", "Left", and "Down" can be selected. Since the output image and the subject image formed on the image sensor 106 are in the reverse relationship in the upper, lower, left, and right directions, the “upper”, “right”, “left”, and “lower” in the menu respectively represent the image stabilization lens 103. Corresponds to “down”, “left”, “right”, and “up”.

  Each item of “Select figure”, “Figure size”, and “Draw start point” can be selected only when “Draw figure” is set to “On”, and “Draw figure” is set to “Off”. When it is, it is grayed out and cannot be selected.

  Here, the setting of the drawing start point will be described with reference to FIG. The center point in FIG. 13A indicates a bright spot in the background. A case will be described in which a hand is placed near the imaging apparatus 101 and the composition is determined so that the positional relationship with the bright spots in the background is as shown in FIG. If “heart shape” is selected in the “graphic selection” item and “bottom” is selected as the “drawing start point”, a photographed image as shown in FIG. 13B can be obtained. . In FIG. 13B, since the drawing starts from the lowest point of the heart shape, the bright line is drawn above the position of the bright point in FIG. On the other hand, in “graphic selection”, “heart-shaped” is selected in the same way, and when “top” is selected as “drawing start point”, a captured image as shown in FIG. 13C is obtained. . In FIG. 13C, since drawing starts from one point at the top of the heart shape, the bright line is drawn below the position of the bright point in FIG. 13A. Therefore, an image with a heart shape superimposed on the hand is obtained.

  Further, in selecting the trajectory drawing mode, color conversion of the trajectory may be designated as will be described later. It is possible to allow the user to select the color of the locus using a similar menu.

  It is also possible to allow the user to select a point light source to be used for locus drawing. FIG. 14A shows a finder image displayed on the display unit 114 before photographing. A selection frame can be displayed like 2701 on the viewfinder, and the user can select a point light source used for locus drawing. The selection frame can also be moved by the operation unit 113. Although processing at the time of photographing when the upper right point light source is selected in FIG. 14A will be described later, the photographed image is as shown in FIG.

  Next, referring to FIG. 15, a method for measuring the luminance of the point light source will be described. In normal photometry, subject luminance is measured by the state of the exposure control unit 115 and the imaging optical system 102 and the amount of light received by the image sensor 106 according to a known method. The imaging surface of the imaging device 106 is divided into a plurality of blocks, and the weight for each block is changed as necessary, such as near the center or the face of a person. Then, the luminance of the entire imaging surface, that is, the subject luminance is obtained based on the result of multiplying the average luminance value and integral value of each block by the weight. When the trajectory drawing is ON, the trajectory is drawn by a point light source that is a subject. Therefore, the brightness of the point light source is important for appropriate trajectory drawing. In a scene such as a night view, the size of the point light source is relatively small, and it is estimated that the brightness is remarkably higher than other landscapes. Among the luminance of each block, the block having the highest luminance is selected, and the luminance of only that block is set as the subject luminance. In FIG. 15A, a black dot represents a point light source that is a subject. A ruled line indicates a photometric frame, that is, a block delimiter divided for photometry. Of each block, the block including the brightest point light source is shown in white. By setting the exposure based on the brightness of the brightest point light source, at least one appropriate drawing can be performed. In the method shown in FIG. 15B, a plurality of blocks having high luminance are selected, and subject luminance is set based on the luminance of only those blocks. According to this method, there is an increased possibility that drawing with a plurality of point light sources can be appropriately performed.

  FIG. 16 is a drawing of a star-shaped locus graphic. FIG. 17 is a diagram showing the vicinity of the locus in the round frame indicated by 2501 in FIG. 16 in units of pixels of the image sensor 106. One square indicated by A1, A2, etc. in FIG. 17 corresponds to one pixel.

  The pixels on which the locus is actually drawn are A4, B3, C2, and D1 in FIG. One pixel data that can be acquired from the image sensor 106 has a high luminance value. That is, A4, B3, C2, and D1 in FIG. 17 are higher than other peripheral pixels.

  Image data acquired from the image sensor 106 is stored in the memory 107 in step S2409 of FIG. 18 described later, and the data on the memory 107 can be easily processed. When extracting only the trajectory data, the data on the memory 107 is searched and the data with a predetermined value or more is extracted, so that the data with a predetermined brightness or higher, that is, the trajectory data of the point light source can be obtained. Further, the data written from the image sensor 106 to the memory 107 can easily obtain the drawing position from the address of the memory 107.

  As described above, the pixel data having a high luminance has a high value. In other words, when the pixel data is set to a predetermined value or less, the data becomes dark data, that is, black data. When deleting data other than the trajectory data as the selected image as in step S2415 described later, a place other than the trajectory data described above in the image data stored in the memory 107 is replaced with data having a predetermined value or less. As a result, the data other than the trajectory data can be painted black.

  Further, in order to convert the color of the trajectory data into the color designated by the user as in step S2416 described later, the trajectory data is first extracted from the image data on the memory 107 as described above. The extracted data can reproduce a photographed color by performing color conversion by a known method in accordance with the arrangement of the color filters of the image sensor 106. In the case of conversion to a user-specified color, the color can be changed by rewriting data extracted in accordance with the specified color to a predetermined value.

  Next, the photographing operation will be described with reference to FIG. FIG. 18 is a flowchart of the photographing operation. Each step in FIG. 18 will be described in order to describe the photographing operation. It should be noted that execution / non-execution of various operations is determined in advance by user settings on the menu setting screen described above. In FIG. 18, special effect shooting is performed prior to main subject shooting, but either special effect shooting or main subject shooting may be performed first. In the present embodiment, the special effect graphic and the main subject are separately exposed.

  In S2401, it is determined whether or not the SW1 of the release button 111 is in an ON state. When the release button 111 is pressed halfway and SW1 is turned on (“Yes” in S2401), automatic focus adjustment is performed in accordance with a known method in step S2402. Until the release button 111 is pressed halfway and SW1 is turned on, the input standby state is maintained (“No” in S2401).

  In step S 2403, trajectory distance information of the graphic selected by the user is acquired from the memory 107. As described with reference to FIG. 12, the locus drawn during exposure according to the user's selection varies depending on the shape and size of the figure and the brightness of the point light source. Therefore, using these as parameters, the camera shake correction lens 103 is driven in which range and at what speed to determine how to control the exposure control unit 115 including the aperture and the image sensor 106.

  In step S2404, the brightness of the point light source is measured. Here, an exposure amount suitable for locus drawing with a point light source is set. In general, since the point light source has higher luminance than the main subject, the exposure amount is set lower than that in the case of photographing the main subject.

  Taking into account the control data set in step S2403, exposure setting for drawing a clearer trace figure can be performed. At this time, the light emission of the strobe has no effect on the operation of drawing the locus with the point light source, and the light is reflected and reflected on an object other than the point light source, so that the light emission of the strobe is prohibited.

  Next, the process proceeds to step S2405. In step S2405, it is determined whether or not the SW2 of the release button 111 is in an ON state. When the release button 111 is pressed deeply and the SW2 is turned on, the photographing operation is started and the process proceeds to step S2406. Until the release button 111 is pressed deeply and SW2 is turned on, the input standby state is maintained (“No” in S2405). From step S2406, a special effect photographing operation is started. In step S2406, exposure is started with the exposure (exposure amount) determined in step S2404. Simultaneously with the start of exposure, the camera shake correction lens 103 is driven based on the control data determined in S2403 in S2407. A figure can be drawn with the locus of the point light source by moving the position at which the point light source located mainly in the dark subject is imaged on the image sensor using the camera shake correction lens 103.

  When the exposure is completed (S2408), the image data of the image sensor 106 is transferred from the image sensor 106 to the memory 107 and stored (S2409).

  In general, since the point light source has higher brightness than the main subject, when the exposure is adjusted to the point light source, the main subject becomes a dark image, but depending on the exposure time, the main subject also appears in the image sensor. Even if the main subject is reflected in this way, it is only necessary to delete other than the target trajectory figure after shooting by an image editing process described later.

  In step S2410, the main subject is photographed.

  In step S2410, photometry of the main subject is performed to determine the exposure of the main subject. A known method can be used for determining the exposure. Although the main subject is a subject darker than the point light source, in the present embodiment, appropriate exposure images can be obtained by dividing the shooting of the trajectory image with the point light source and the shooting of the main subject. In general, since the main subject has a lower luminance than the point light source, the exposure amount is set higher than in the case of special effect shooting.

  In step S2410, an exposure suitable for the main subject is determined by a known method. When the main subject is dark and a strobe is required, the strobe may be fired so that the main subject has proper exposure.

  If exposure is determined, it will progress to step S2411 and will start exposure. At this time, the camera shake correction lens 103 performs control to prevent camera shake shooting.

When the exposure is completed (S2412), the captured main subject image is stored in the memory 107 separately from the captured locus image and the region. (S2413)
When shooting of the main subject image ends, the process proceeds to step S2414. In steps S2414 to S2418, various special effect images are edited.

  First, in step S2414, it is determined whether or not the user has selected a special effect image.

  If the user is selecting a special effect image (“Yes” in S2414), the process proceeds to step S2415 to delete other than the selected image. As described above, the special effect image data stored in the memory 107 can be erased by substituting data other than the selected one with a predetermined value or less. Further, the position of the special effect image detected on the image can be stored in another area of the memory 107 and used for editing the main subject image.

  If no image is selected in step S2414 (“No” in S2414), or when the process of step S2415 ends, the process proceeds to step S2416.

  In step S2416, it is determined whether the user has specified color conversion of the special effect image. If the user has specified color conversion of the special effect image (“Yes” in S2416), the process proceeds to step S2417, and color conversion of the specified image is performed. As described above, color conversion can be performed by replacing selected special effect image data stored in the memory 107 with predetermined color data.

  When color conversion is not designated in step S2416 (“No” in S2416) or when the process of step S2417 is completed, the process proceeds to step S2418.

  In step S2418, before combining the main subject image with the special effect image, the point light source at the position of the special effect image is erased so as to be suitable for combining.

  In general, since the point light source is brighter than the main subject, it is also reflected in the main subject image. When the special effect image is superimposed on the position of the point light source, the point light source overlaps the center of the locus. In order to avoid this, the point light source of the main subject image is erased. As the erasing method, the above-described method is used. As the position of the point light source, a position stored in advance when editing the special effect image may be used, or designation data obtained when the user selects an image before photographing may be used. The position of the point light source can be roughly grasped by the above method. Specifically, the brightness of a predetermined range of the position is searched from the main subject image data stored in the memory 107, and the position where the brightness is high is determined as the position of the point light source. To do. When the position of the point light source can be grasped, the point light source data is deleted by the method described later.

  In step S2419, the special effect image and the main subject image are combined.

  In an edited special effect image and an edited main subject image, which will be described later, unnecessary portions are deleted so as to be suitable for composition. Therefore, it can be synthesized as it is. The composition is performed by adding the data at the same position of each image data.

(Second Embodiment)
19 to 22 show an imaging apparatus according to a preferred second embodiment of the present invention. FIG. 19 is a diagram showing an imaging apparatus suitable for this embodiment, and the same reference numerals are given to the same components as those shown in the first embodiment. The difference from the first embodiment is that camera shake correction is performed by moving (shifting) the image sensor 106 itself. Therefore, a drive unit 109 ′ for correcting camera shake is provided in the vicinity of the image sensor 106. The drive unit 109 ′ shift-drives the image sensor 106. In this case, the image sensor 106 functions as an imaging unit that photoelectrically converts the subject image formed by the imaging optical system, and as a moving unit that moves the subject image relative to the shift drive by the drive unit 109 ′. Also works. Other configurations are the same as those of the first embodiment.

  FIG. 20 is a block diagram illustrating an electrical configuration of the imaging apparatus according to the present embodiment. The same components as those shown in the first embodiment are given the same reference numerals. The difference from the first embodiment is that a drive unit for correcting camera shake is not included in the lens system control unit 205 but is provided as a drive unit 109 ′ that shift-drives the image sensor 106. The imaging process and the like are the same as those shown in the first embodiment.

  FIG. 21 and FIG. 22 show examples of mechanisms for driving the image sensor 106 to shift. In FIG. 21, reference numeral 106 denotes an image sensor, 1801 and 1802 denote drive coils, 1803 and 1804 denote Hall elements that detect the position of the movable part, and 1805, 1806, 1807, and 1808 denote magnets. Reference numeral 1809 denotes a first holding portion, 1810 denotes a first guide portion provided on the first holding portion 1809, 1811 denotes a second holding portion, and 1812 denotes a second holding portion 1811. A second guide portion 1813 indicates a third holding portion fixed to the lens barrel. Reference numeral 1814 denotes a first elastic body provided between the first holding portion 1809 and a fixing portion (not shown), and 1815 denotes a second elastic body provided between the second holding portion 1811 and the fixing portion (not shown). The elastic body is shown. The directions guided by the first guide portion 1810 and the second guide portion 1812 are orthogonal to each other. In addition, the first holding unit 1809 including the image sensor 106 is elastically supported by the first elastic body 1814 and the second elastic body 1815.

  FIG. 22 is a diagram showing the configuration of the drive unit. Although there are two magnetic circuits, the configuration is the same except that the angle is different by 90 degrees. Therefore, a description will be given using a drive unit composed of a drive coil 1801 and magnets 1805 and 1806. In FIG. 22, reference numeral 1903 denotes an arrow schematically showing magnetic flux, and reference numerals 1901 and 1902 denote yokes not shown in FIG. Magnets 1905 and 1906 are divided into two regions and magnetized. Therefore, as shown in FIG. 22, most of the magnetic flux constitutes a closed magnetic circuit 1903 that circulates using the yokes 1901 and 1902 on the back surface. When a current flows through the drive coil 1801, a force is generated on the drive coil 1801 according to Fleming's left-hand rule. The first holding portion 1809 and the image sensor 106 are displaced by the balance between the generated force and the first elastic body 1814 and the second elastic body 1815. When the first holding unit 1809 is displaced, the Hall elements 1803 and 1804 provided on the first holding unit 1109 are also displaced. As a result, since it is displaced relative to the magnetic circuit provided in the fixed portion, the position of the first holding portion 1809 can be detected from the signals of the Hall elements 1803 and 1804, and feedback control can be performed. Further, during exposure, a high-quality image with little shake can be obtained by appropriately controlling the currents of the drive coils 1801 and 1802 based on the lens information and the signal from the camera shake detection sensor 108.

  The control block of the camera shake correction system is configured as shown in FIG. 3 as in the first embodiment, except that the target to be driven is not the correction lens 103 but the image sensor 106. The flow relating to imaging is the same as that of the first embodiment, and the difference is that the drive target is not the correction lens 103 but the imaging element 106.

1 is a cross-sectional view of an imaging apparatus according to a preferred first embodiment of the present invention. 1 is a block diagram illustrating an electrical configuration of an imaging apparatus according to a preferred first embodiment of the present invention. It is a block diagram regarding the drive of the correction | amendment lens 103 which concerns on suitable 1st Embodiment of this invention. 6 is a diagram for explaining the operation of a camera shake correction lens 103. FIG. 6 is a diagram for explaining the operation of a camera shake correction lens 103. FIG. 6 is a diagram for explaining the operation of a camera shake correction lens 103. FIG. It is a figure which shows the example of the camera-shake correction mechanism which concerns on suitable 1st Embodiment of this invention. It is a figure which shows the drive force generation | occurrence | production part of the camera-shake correction mechanism which concerns on suitable 1st Embodiment of this invention. It is a schematic diagram which shows the information storage system for locus drawing. It is a schematic diagram which shows the information storage system for locus drawing. It is a drawing example of figure drawing. It is a figure which shows the example of the menu screen which selects figure drawing mode. It is a figure for demonstrating the figure starting point of figure drawing mode. It is a figure which shows the example of selecting the point light source of figure drawing. It is a figure for demonstrating the method to measure a point light source luminance. It is a drawing example of figure drawing. It is a figure which shows the part of the imaging data of figure drawing. It is a flowchart which shows operation | movement of an imaging device. It is sectional drawing of the imaging device which concerns on the suitable 2nd Embodiment of this invention. It is a block diagram which shows the electric constitution of the imaging device which concerns on suitable 2nd Embodiment of this invention. It is a figure which shows the example of the camera-shake correction mechanism which concerns on suitable 2nd Embodiment of this invention. It is a figure which shows the drive force generation part of the camera-shake correction mechanism which concerns on suitable 2nd Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Imaging device 102 Imaging optical system 106 Imaging element 115 Exposure control part

Claims (6)

An imaging device,
An imaging means for photoelectrically converting a subject image formed by the imaging optical system;
Moving means for moving the subject image relative to the imaging means;
Exposure control means for controlling the exposure amount of the subject image;
Based on trajectory data for special effects stored in a memory, calculation means for calculating a movement target amount for special effects of the movement means;
Driving means for driving the moving means based on at least the movement target amount for the special effect;
With
The exposure control means adjusts the exposure amount based on the trajectory data for the special effect when the moving means is driven based on the movement target amount for the special effect ,
The imaging apparatus uses a first photographed image photographed with the adjusted exposure amount when the moving means is driven based on the movement target amount for the special effect, and the movement target amount for the special effect. further comprising an imaging apparatus according to claim Rukoto and second imaged image obtained by imaging with an exposure dose, an image combining means for combining in accordance with the brightness of the object image without.   The imaging apparatus according to claim 1, wherein the image synthesizing unit erases a subject corresponding to a subject having a predetermined luminance or higher in the first photographed image from the second photographed image.   The imaging apparatus according to claim 2, wherein the image synthesizing unit erases an object having a brightness lower than the predetermined luminance from the first photographed image. A camera shake detecting means for detecting camera shake;
The calculation means calculates a movement target amount for shake correction of the movement means based on the output of the shake detection means,
It said drive means on the basis of the movement target amount obtained by adding the movement target amount for special effects movement target amount for the image stabilization, any of claims 1 to 3, characterized in that for driving the moving means The imaging apparatus of Claim 1 . A flash means for illuminating the subject;
The flash unit, an imaging apparatus according to any one of claims 1 to 4, characterized in that it is configured not to operate when driving the moving means based on the movement target amount for the special effects . An imaging apparatus control method comprising: an imaging unit that photoelectrically converts a subject image formed by an imaging optical system; and a moving unit that moves the subject image relative to the imaging unit,
A step of calculating a movement target amount for special effects of the moving means based on trajectory data for special effects stored in a memory by the calculation means of the imaging device;
A step of driving the moving means based on a movement target amount for the special effect by a driving means of the imaging device;
An exposure control means of the imaging apparatus for adjusting an exposure amount of the subject image based on the trajectory data for the special effect;
A first photographed image photographed with the adjusted exposure amount when the image synthesizing unit of the imaging apparatus drives the moving unit based on the movement target amount for the special effect, and the movement for the special effect Combining a second photographed image photographed with an exposure amount corresponding to the luminance of the subject image without using a target amount;
A method for controlling an imaging apparatus, comprising:

Images