US8158918B2 - Imaging apparatus, control method thereof, and computer-readable storage medium storing program - Google Patents

Imaging apparatus, control method thereof, and computer-readable storage medium storing program Download PDF

Info

Publication number
US8158918B2
US8158918B2 US12/495,812 US49581209A US8158918B2 US 8158918 B2 US8158918 B2 US 8158918B2 US 49581209 A US49581209 A US 49581209A US 8158918 B2 US8158918 B2 US 8158918B2
Authority
US
United States
Prior art keywords
foreign substance
image
image sensor
camera
area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US12/495,812
Other languages
English (en)
Other versions
US20100002101A1 (en
Inventor
Yoshiaki Irie
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Assigned to CANON KABUSHIKI KAISHA reassignment CANON KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: IRIE, YOSHIAKI
Publication of US20100002101A1 publication Critical patent/US20100002101A1/en
Application granted granted Critical
Publication of US8158918B2 publication Critical patent/US8158918B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/54—Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/63—Control of cameras or camera modules by using electronic viewfinders

Definitions

  • the present invention relates to a technique for imaging apparatuses, such as digital cameras and digital video cameras, to prevent deterioration in image quality due to a foreign substance that is adhered to an optical element, such as an optical low-pass filter, disposed in front of the image sensor and that is captured in a shot image.
  • an optical element such as an optical low-pass filter
  • the digital single lens reflex cameras do not require film winding operation and film exchange operation. Accordingly, in an operation of exchanging a shooting lens, once a foreign substrate, such as dust, intrudes into the vicinity of the image sensor, the foreign substance continues to appear in captured images. Accordingly, the quality of the series of the shot images is decreased.
  • Japanese Patent Application Laid-Open No. 2002-204379 discusses a method for removing a foreign substance in an imaging apparatus.
  • a dust prevention element disposed in the vicinity of an imaging plane by operating a dust prevention element disposed in the vicinity of an imaging plane, a foreign substance adhered during operation such as lens exchange can be removed. Therefore, the user does not need to perform cleaning operation using a blower. As the result, a high-quality image can be easily obtained.
  • Japanese Patent Application Laid-Open No. 2004-172820 discusses a method for detecting a foreign substance from a plurality of images. In the method discussed in Japanese Patent Application Laid-Open No. 2004-172820, invariant contrast portions across a plurality of images that are preliminarily acquired by a user are detected.
  • the position of a foreign substance is detected.
  • the user appropriately removes the foreign substance using a cleaning mode, and performs shooting. Thus, a high-quality image can be obtained.
  • the user has to perform the foreign substance removal operation using the cleaning mode or the like in advance. Then, in spite of the operation, depending on the type of the foreign substance, the foreign substance may not be removed.
  • the present invention has been made to solve the above-mentioned problems, and is directed to effectively preventing deterioration in image quality due to a foreign substance that exists on an optical element such as an optical low-pass filter disposed in front of an image sensor and that is captured in a shot image.
  • the present invention is directed to an imaging apparatus capable of changing a relative position of a position of a foreign substance adhered to an optical element and a position of a predetermined area of an object based on a comparison result of the positions.
  • an imaging apparatus includes an image sensor configured to photoelectrically convert an image of an object formed by an imaging lens to generate an image signal, a foreign substance information detection unit configured to detect foreign substance information including at least information about a position of a foreign substance adhered to an optical element disposed in front of the image sensor, a determination unit configured to determine whether the position of the foreign substance detected by the foreign substance information detection unit overlaps a predetermined area of the object by analyzing the image signal of the object generated by the image sensor, and a changing unit configured to change a relative position of the image of the object formed on the image sensor and the image sensor when the determination unit determines that the position of the foreign substance overlaps the predetermined area.
  • FIG. 1 illustrates a configuration of an imaging apparatus according to a first exemplary embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating an electric configuration of the imaging apparatus according to the first exemplary embodiment of the present invention.
  • FIG. 3A illustrates an image frame according to the first and a second exemplary embodiments of the present invention.
  • FIG. 3B illustrates an image frame according to the first and second exemplary embodiments of the present invention.
  • FIG. 3C illustrates an image frame according to a third exemplary embodiment of the present invention.
  • FIG. 4 is a flowchart illustrating operation of the imaging apparatus according to the first exemplary embodiment of the present invention.
  • FIG. 5 is a flowchart illustrating operation of frame movement according to the first exemplary embodiment of the present invention.
  • FIG. 6A illustrates calculation of an amount of frame movement according to the first exemplary embodiment of the present invention.
  • FIG. 6B illustrates calculation of an amount of frame movement according to the first exemplary embodiment of the present invention.
  • FIG. 7 is a flowchart illustrating foreign substance detection routine according to the first exemplary embodiment of the present invention.
  • FIG. 8 is a flowchart illustrating foreign substance area acquisition routine according to the first exemplary embodiment of the present invention.
  • FIG. 9 is a block diagram illustrating a drive unit in a camera-shake correction lens according to the first exemplary embodiment of the present invention.
  • FIG. 10 is a graph illustrating operation of the camera-shake correction lens.
  • FIG. 11A illustrates a first example of a camera-shake correction mechanism according to the first exemplary embodiment of the present invention.
  • FIG. 11B illustrates the first example of the camera-shake correction mechanism according to the first exemplary embodiment of the present invention.
  • FIG. 11C illustrates the first example of the camera-shake correction mechanism according to the first exemplary embodiment of the present invention.
  • FIG. 12A illustrates a driving force generation unit in the first example of the camera-shake correction mechanism according to the first exemplary embodiment of the present invention.
  • FIG. 12B illustrates the driving force generation unit in the first example of the camera-shake correction mechanism according to the first exemplary embodiment of the present invention.
  • FIG. 13 is a perspective view illustrating a second example of the camera-shake correction mechanism according to the first exemplary embodiment of the present invention.
  • FIG. 14 illustrates a driving force generation unit in the second example of the camera-shake correction mechanism according to the first exemplary embodiment of the present invention.
  • FIG. 15 is a flowchart illustrating foreign substance correction processing according to the second exemplary embodiment of the present invention.
  • FIG. 16 is a flowchart illustrating interpolation routine according to the second exemplary embodiment of the present invention.
  • FIG. 17 is a schematic view illustrating an imaging apparatus according to a third exemplary embodiment of the present invention.
  • FIG. 1 is a block diagram illustrating a configuration of an imaging apparatus according to a first exemplary embodiment of the present invention.
  • an imaging apparatus (hereinafter, referred to as a camera) 101 such as a digital camera forms an object image in the vicinity of an image sensor 106 using an imaging optical system 102 and a focus adjustment unit (not shown).
  • the imaging optical system 102 includes an optical axis 104 .
  • the imaging optical system 102 is housed in a lens barrel 105 .
  • a filter 112 formed by integrating an infrared absorbing filter for substantially matching a luminosity factor of the image sensor 106 with a human luminosity factor and a low-pass filter for false color prevention is disposed.
  • a foreign substance such as dust adheres on the filter 112
  • the foreign substance is captured as a shadow on an image obtained by the image sensor 106 .
  • the image sensor 106 photoelectrically converts an object image formed by the imaging optical system 102 . Further, the image sensor 106 acquires an image signal from the image sensor 106 in synchronization with an operation of a release button 111 by a user, and records the signal in an external memory 107 , for example, CompactFrash®.
  • a mode for performing a camera-shake correction during exposure, displacement of the image due to camera shake is corrected by driving a camera-shake correction lens 103 by a drive unit 109 a based on a signal output from a camera-shake detection sensor 108 .
  • a display unit 210 e.g., a thin film transistor (TFT) liquid crystal display.
  • TFT thin film transistor
  • ON and OFF of the camera-shake correction operation can be set.
  • the switch 211 can also set valid or invalid of frame movement operation in which an image frame is moved by driving the camera-shake correction lens 103 in order to make the foreign substance adhered on the filter 112 less noticeable. Electric power is supplied to circuits in the camera from a power supply 110 .
  • FIG. 2 is a block diagram illustrating an electric configuration of the camera 101 .
  • the camera 101 includes, for example, an imaging system, an image processing system, a record/reproduction system, and a control system.
  • the imaging system includes the imaging optical system 102 and the image sensor 106 .
  • the image processing system includes an analog-to-digital (A/D) converter 201 and an image processing circuit 202 .
  • the record/reproduction system includes a record processing circuit 203 and the external memory 107 .
  • the control system includes a camera system control circuit 205 , an automatic focus (AF) sensor 206 , an automatic exposure (AE) sensor 207 , the camera-shake detection sensor 108 , an operation detection circuit 208 , and a lens system control circuit 209 .
  • AF automatic focus
  • AE automatic exposure
  • the control system includes a camera system control circuit 205 , an automatic focus (AF) sensor 206 , an automatic exposure (AE) sensor 207 , the camera-shake detection sensor 108 , an operation detection circuit 208 , and a lens system control circuit 209 .
  • the control system further includes a position detection sensor 204 that detects a position of the camera-shake correction lens 103 .
  • the lens system control circuit 209 includes the drive unit 109 a that drives the camera-shake correction lens 103 .
  • the imaging system forms an image of light emitted from an object on an imaging surface of the image sensor 106 via the imaging optical system 102 .
  • the imaging system based on a signal of the AE sensor 207 , using a diaphragm (not shown) or the like, the object light of an appropriate amount is exposed on the image sensor 106 .
  • the image processing circuit 202 processes an image signal corresponding to the pixels of the image sensor 106 received from the image sensor 106 via the A/D converter 201 .
  • the image processing circuit 202 includes a white balance circuit, a gamma correction circuit, and an interpolation calculation circuit that changes a resolution to a high resolution by interpolation calculation.
  • the record processing circuit 203 performs output of an image signal to the external memory 107 , and generates an image to be output to the display unit 210 .
  • the record processing circuit 203 further performs compression of an image or a moving image using a known method.
  • the operation detection circuit 208 detects operation of the release button 111 .
  • the camera system control circuit 205 controls each unit in response to a detection signal of the operation detection circuit 208 . More specifically, for example, the operation detection circuit 208 generates and outputs a timing signal when shooting.
  • the AF sensor 206 detects a focus state of the imaging apparatus 101 .
  • the AE sensor 207 detects luminance of an object.
  • the camera-shake detection sensor 108 detects camera shake.
  • the lens system control circuit 209 controls a lens or the like in response to a signal of the camera system control circuit 205 . Further, the lens system control circuit 209 drives the camera-shake correction lens 103 using the internal drive unit 109 a.
  • the control system controls each of the imaging system, the image processing system, and the record/reproduction system in response to external operation. For example, the control system detects the pressing of the release button 111 to control the drive of the image sensor 106 , the operation of the image processing circuit 202 , the compression processing in the record processing circuit 203 , or the like.
  • control system controls states of each segment in an information display device that performs indication of information on an optical finder, a liquid crystal monitor, or the like using the display unit 210 .
  • the AF sensor 206 and the AE sensor 207 are connected to the camera system control circuit 205 . Based on signals of the AF sensor 206 and the AE sensor 207 , the camera system control circuit 205 controls lenses and a diaphragm. To the camera-system control circuit 205 , the camera-shake detection sensor 108 is connected. When a mode for performing camera-shake correction is set by the switch 211 , based on a signal output from the camera-shake detection sensor 108 and calculation result in the camera system control circuit 205 , the drive unit 109 a drives the camera-shake correction lens 103 .
  • the setting of the switch 211 is notified to the camera system control circuit 205 via the lens system control circuit 209 .
  • the camera system control circuit 205 includes an internal memory 212 that stores various control parameters of the camera or temporarily stores image data.
  • FIGS. 3A to 3C illustrate frame movement operation (composition change operation) in which a shadow of a foreign substance existing in the vicinity of the image sensor is moved so that the shadow captured in an image frame becomes less noticeable in the image frame.
  • a large foreign substance 200 adheres to the filter 112 that is disposed in front of the image sensor 106 .
  • the shadow of the foreign substance appears over a main object, and the state is extremely undesirable in view of the quality of the picture.
  • the camera-shake correction lens 103 in the imaging optical system 102 is moved in X and Y directions by the drive unit 109 a , or the image sensor 106 itself is moved in the X and Y directions.
  • the relative positional relationship between the shooting frame and the image sensor 106 can be changed.
  • movement destination coordinates G 2 As illustrated in FIG. 3A as movement destination coordinates G 2 (x 2 , y 2 ), it is effective to move the image of the shadow to a relatively low luminance area such as hair of a person near the coordinates of the shadow.
  • FIG. 3B illustrates an image frame after the frame movement operation is implemented by operating the camera-shake correction lens 103 .
  • Information about the size and position of the foreign substance in FIG. 3A and darkness of the shadow of the foreign substance captured by the image sensor 106 can be acquired by the photographer at any timing by a foreign substance information detection processing (detection processing of a pixel position where defective image is generated by the foreign substance) that is described below.
  • the foreign substance information is stored in the internal memory 212 before the field is actually shot and the information can be read any time if necessary.
  • FIG. 4 is a flowchart illustrating the imaging operation according to the first exemplary embodiment of the present invention. The imaging operation is described step by step in FIG. 4 .
  • the user can select, using the switch 211 , ON and OFF of the camera-shake correction operation, and ON and OFF of frame movement operation in which a foreign substance, which is captured in an image frame, is moved to an area where the foreign substance is less noticeable in the image frame.
  • the operation is characteristic in the first exemplary embodiment.
  • step S 500 the camera system control circuit 205 receives a shooting preparation operation start signal (SW 1 -ON) that is generated by a half press operation of the release button 111 .
  • SW 1 -ON a shooting preparation operation start signal
  • step S 501 the camera system control circuit 205 determines whether the camera-shake correction mode is set.
  • the camera system control circuit 205 calculates a target value for normal camera shake, that is, a target amount of movement ( 300 a ).
  • step S 503 the camera system control circuit 205 , which can make the foreign substance less noticeable, determines whether the frame movement mode is set.
  • step S 504 the camera system control circuit 205 determines whether the camera-shake correction mode is set again.
  • step S 505 the camera system control circuit 205 drives the camera-shake correction lens 103 based on the target amount of movement ( 300 a ).
  • steps S 509 to S 514 the camera system control circuit 205 executes a live view sequence in a state the camera shake correction is being performed.
  • step S 501 When the camera-shake correction is not performed in step S 501 (NO in step S 501 ), or the frame movement mode is not set in step S 503 (NO in step S 503 ), the camera system control circuit 205 executes the following live view sequence without performing driving of the correction lens in step S 505 .
  • step S 509 the camera system control circuit 205 performs AF/AE operation. More specifically, based on signals acquired from the AF sensor 206 and the AE sensor 207 , the camera system control circuit 205 performs focusing via the lens system control circuit 209 or the like, and performs diaphragm adjustment and exposure time adjustment.
  • step S 510 an object image is exposed on the image sensor 106 . Then, a photoelectrically-converted image signal is read from the image sensor 106 . The signal is A/D-converted in the A/D converter 201 to a digital signal. In step S 511 , the digital signal is image-processed by the image processing circuit 202 .
  • step S 512 the captured image is displayed on the display unit 210 via the internal memory 212 .
  • step S 513 the camera system control circuit 205 checks the SW 1 -ON signal.
  • the processing returns to step S 500 , and the camera system control circuit 205 waits until the SW 1 -ON signal is generated again.
  • the above-described operation is performed to display the image frame on the display unit 210 to provide the frame image for the photographer to determine a shooting composition before a main shooting.
  • the display unit 210 On the image signal of the image sensor 106 , the thinning processing of the read pixels is performed. Therefore, the amount of the image information is smaller than that of an image signal at main shooting described below. Accordingly, on the display unit 210 , it is possible to perform real time display of the field image before the main shooting at a high refresh rate of 60 frames/sec.
  • the above-described display is so-called live view display.
  • step S 506 the camera system control circuit 205 determines whether an amount of movement of image frame for making the foreign substance on the image sensor less noticeable is calculated. The method for the calculation of the amount of frame movement is described below.
  • step S 508 the camera system control circuit 205 calculates an offset amount 301 (i.e., the amount of frame movement). Then, the processing returns to step S 506 .
  • step S 506 when the frame movement amount has been calculated in step S 508 (YES in step S 506 ), the processing proceeds to step S 507 .
  • step S 507 the camera system control circuit 205 adds the offset amount 301 calculated in step S 508 to the target amount of movement ( 300 a ) for camera-shake correction calculated in step S 502 , and a final target amount of movement ( 300 b ) is set.
  • step S 505 To the final target amount of movement ( 300 b ), the camera-shake correction lens drive in step S 505 is performed.
  • step S 501 when the camera-shake correction mode is not set, the target amount of movement ( 300 a ) is not set. Accordingly, when “Camera-shake correction is not set and frame movement is set, the final target amount of movement ( 300 b ) of the camera-shake correction lens 103 corresponds to the amount of frame movement (i.e., offset amount 301 ).
  • the image frame display on the display unit 210 can be repeatedly performed.
  • step S 514 when the photographer views the display unit 210 and further presses the release button 111 to perform shooting of the still image, a trigger signal SW 2 -ON is generated (YES in step S 514 ).
  • steps S 515 and S 516 with respect to exposure output of the all pixels on the image sensor 106 , image processing similar to the above-mentioned image processing such as the gamma correction, the white balance correction, the compression processing and the like is performed, and an image file is generated.
  • step S 517 the record processing circuit 203 records the generated image file in the external memory 107 . Then, in step S 518 , the series of shooting sequence ends.
  • the frame movement operation may be canceled.
  • the method of setting the offset amount 301 i.e., an amount to move a frame
  • the offset amount 301 i.e., an amount to move a frame
  • a main object is specified based on the output of the AF sensor 206 .
  • the AF sensor 206 is configured to obtain ranging information to a plurality of field areas. Accordingly, based on the plurality of pieces of ranging information, using a known closest point algorism, a position of the main object to be shot can be specified.
  • step S 600 it is possible to accurately specify the main point including the size by detecting positions of the eyeballs on the face of the object or detecting the color of skin from output of the image sensor 106 during live view.
  • step S 601 the camera system control circuit 205 reads the information (foreign substance correction data) of the foreign substance adhered in the vicinity of the image sensor of the camera stored in the internal memory 212 by the foreign substance information detection processing performed before the shooting.
  • step S 602 the camera system control circuit 205 determines whether the acquired positional coordinates of the foreign substance are within the area of the main object (especially, the face of the person). When the camera system control circuit 205 determines that the foreign substance is not within the area of the main object, that is, the foreign substance does not affect the shooting (NO in step S 602 ), the camera system control circuit 205 determines that there is no target foreign substance to perform the frame movement. Then, the processing proceeds to step S 608 and the processing ends.
  • step S 602 when the camera system control circuit 205 determines that the foreign substance is within the area of the main object and affects the shooting (YES in step S 602 ), the camera system control circuit 205 specifies the foreign substance as a target foreign substance to perform the frame movement.
  • step S 603 a coordinate system (pixel coordinates) on the image sensor is set. In the example, it is assumed that the coordinates are G 1 (x 1 , y 1 ) in FIG. 6A .
  • step S 604 the pixel coordinates of the foreign substance on the image sensor read from the internal memory 212 are set as a center, for example, the pixels of the image sensor 106 are divided such that a block contains 15 ⁇ 15 small blocks of 9 pixels ⁇ 9 pixels.
  • step S 605 pixel output belonging to the one divided block is averaged. Based on the result, a fine luminance distribution in the vicinity of the foreign substance is measured (field analysis, luminance distribution detection).
  • step S 606 based on the size and the pixel output decrease amount acquired from the internal memory 212 , as illustrated in FIG. 6B , when it is determined that a diameter of the foreign substance is five pixels or less and the output decrease amount is 20 counts or less of the peripheral pixels, within the above-described 15 ⁇ 15 block, in an area of 8 ⁇ 8 block, a block that has a lowest luminance is selected (area A in FIG. 6B ).
  • step S 606 when the diameter of the foreign substance is six pixels or more and the output decrease amount is 21 counts or more of the peripheral pixels (up to 255 counts by 8-bit processing), within all of the 15 ⁇ 15 block (area A and area B in FIG. 6B ), a block that has a lowest luminance is selected.
  • the processing is performed to make a shadow of a greatly noticeable foreign substance less noticeable when shooting is performed.
  • an area for comparing luminance is widened even though a distance to move the shadow in the frame becomes long in order to move the shadow to an area where the field luminance is low as much as possible.
  • the central coordinates of the block selected in the processing are G 2 (x 2 , y 2 ) in FIG. 6A that are to be a destination coordinate point of the frame movement.
  • FIG. 7 is a flowchart illustrating foreign substance detection processing (detection processing of a pixel position where image defective occurs due to a foreign substance) performed in the camera according to the first exemplary embodiment.
  • the processing is performed by executing a foreign substance detection processing program stored in the internal memory 212 by the camera system control circuit 205 .
  • the foreign substance detection processing must be performed before the photographer performs main shooting of a field.
  • the foreign substance detection processing is performed by acquiring a foreign substance detection image.
  • the camera is set such that the optical axis 104 of the imaging optical system 102 faces a surface such as an exit surface of a light source or a surface having a uniform color such as a white wall to prepare for shooting of the foreign substance detection image.
  • a light unit (small light source device) for foreign substance detection may be mounted on a mounting portion (not shown) for filter attachment/detachment at a tip of the imaging optical system (shooting lens) 102 to prepare for shooting of the foreign substance detection image.
  • a light source of the light unit for example, a white light emitting-diode (LED) may be used. It is preferable that a size of the light-emitting face is adjusted to correspond to a predetermined diaphragm value (for example, in the first exemplary embodiment, F 32 ).
  • the camera system control circuit 205 After the preparation is completed, when start of the foreign substance detection processing is instructed, first, the camera system control circuit 205 performs setting of the diaphragm. An image forming state of a foreign substance in the vicinity of the image sensor is varied depending on a diaphragm value of the lens, and the position is varied depending on a position of a pupil of the lens. Accordingly, in addition to positions and sizes of the foreign substance, it is necessary that the foreign substance correction data includes the diaphragm value and the pupil position of the lens at the shooting for the foreign substance detection image.
  • the step of generating the foreign substance correction data if it is determined in advance that the same diaphragm value is always used, it is not always necessary to hold the diaphragm value in the foreign substance correction data.
  • the pupil position by using the light unit, similarly, it is not always necessary to hold the pupil position in the foreign substance correction data.
  • the pupil position means a distance of an exit pupil from an imaging plane (focal plane).
  • step S 701 F 32 is specified.
  • step S 702 the camera system control circuit 205 instructs the lens system control circuit 209 to perform diaphragm blade control of the imaging optical system (shooting lens) 102 and sets the diaphragm to the diaphragm value specified in step S 701 . Further, in step S 703 , the camera system control circuit 205 sets a focus position to infinity.
  • step S 704 the camera system control circuit 205 performs shooting in the foreign substance detection mode.
  • the imaging processing routine performed in step S 704 is similar to the processing described above with reference to FIG. 4 .
  • the shot image data is stored in the internal memory 212 .
  • step S 705 the camera system control circuit 205 acquires the diaphragm value and the lens pupil position at the shooting.
  • step S 706 the image processing circuit 202 reads data stored in the internal memory 212 and corresponding to each pixel of the shot image.
  • step S 707 the image processing circuit 202 performs foreign substance area acquisition routine illustrated in FIG. 8 that is described below, and acquires a position of the pixel where the foreign substance exists, a size, and an amount of output decrease thereof relative to those of peripheral pixels.
  • the image data acquired for the foreign substance detection processing is expanded on the memory, and the processing is performed on each predetermined block unit.
  • Foreign substance area determination in the block is performed according to the flow illustrated in FIG. 8 .
  • step S 804 an average luminance value of each foreign substance area is calculated.
  • a difference between an area adjacent to the foreign substance area, that is, the amount of output decrease can also be calculated.
  • step S 708 the camera system control circuit 205 registers the position, size, output value of the pixel where the foreign substance exists acquired in step S 707 and the diaphragm value and the lens pupil position information acquired in step S 705 in the internal memory 212 as the foreign substance correction data.
  • the actual diaphragm value (F-number) and the lens pupil position at the shooting of the image for detection are stored in the storage area.
  • the number (integer value) of the detected foreign substance areas is stored in a subsequent storage area.
  • parameters of the individual foreign substance areas are repeatedly stored by the number of the foreign substance areas.
  • parameters of the foreign substance area four values, that is, the radius of the foreign substance, the amount of output decrease to the peripheral pixels, the central coordinate x, and the central coordinate y in the valid image area, are registered as a set.
  • step S 708 the camera system control circuit 205 compares a position of a defective pixel at manufacturing recorded in advance as pixel defect positional information in the internal memory 212 with the position of the read pixel data, and determines whether the pixel is a defective pixel.
  • Information of only a foreign substance area determined that the defect is not due to the pixel defect at manufacturing may be stored in the internal memory 212 as the foreign substance correction information.
  • the foreign substance correction information can be used for foreign substance removal processing described below in a second exemplary embodiment of the present invention by attaching to an image together with information at shooting of image data in normal shooting and recording in the external memory 107 .
  • a camera shake correction system is described in detail with reference to FIGS. 9 and 10 .
  • a control block of the camera shake correction system is configured as illustrated in FIG. 9 .
  • a camera-shake signal detected by the camera-shake detection sensor 108 passes through a high-pass filter (HPF) 302 that passes signals higher than a predetermined frequency, and converted into a shake amount by an integrator 303 .
  • HPF high-pass filter
  • a calculation unit 212 adds a detection signal from a position detection sensor 204 that detects a position of the camera-shake correction lens 103 , and generates the first movement target amount 300 a.
  • the drive unit 109 a In normal camera shake correction control, based on the first movement target amount 300 a , the drive unit 109 a is controlled and by driving the camera-shake correction lens 103 , camera shake of the user is cancelled.
  • the offset amount 301 stored in the external memory 107 is read.
  • the offset amount 301 is added to the first movement target amount 300 a, and a second movement target amount 300 b is generated.
  • the drive unit 109 a is controlled and the camera-shake correction lens 103 is driven.
  • the high-pass filter 302 and the integrator 303 are provided in the camera system control circuit 205 .
  • the one system for the one axis for the moving direction of the camera-shake correction lens 103 has been described. However, actually, the camera-shake correction lens 103 can move within the plane perpendicular to the optical axis 104 .
  • FIG. 10 schematically illustrates operation of the camera-shake correction lens 103 by the feedback control system in FIG. 9 .
  • the horizontal axis represents time
  • the vertical axis represents an amount of decentering from the center of an optical axis of the camera-shake correction lens 103 .
  • the solid line shows a case where the camera-shake correction lens 103 is driven according to camera shake caused by the user so that an object image is formed on the image sensor 106 centering the optical axis 104 without the movement of the target object caused by the camera-shake.
  • the operation according to the normal camera shake correction control is illustrated, and the state where the drive unit 109 a is controlled based on the first movement target amount 300 a is illustrated.
  • the camera-shake correction lens 103 is driven as illustrated by the dotted line. More specifically, by adding the offset amount 301 for frame movement to the first movement target amount 300 a , the final movement target amount 300 b can be obtained.
  • the offset amount 301 is set to shift an object image upward by a predetermined amount. However, practically, within the plane, the movements of vertical direction and the horizontal direction are individually controlled.
  • the offset amount 301 is given and the camera-shake correction lens 103 is driven, the object image is formed on the image sensor 106 that is shifted from the optical axis 104 by an amount corresponding to the offset amount without shake.
  • an image signal free from the camera shake and shifted by the amount corresponding to the offset amount 301 can be obtained.
  • FIGS. 11A to 11C schematically illustrate a mechanism for moving the camera-shake correction lens 103 that is an optical system in the imaging optical system 102 .
  • a movable frame 401 holds the camera-shake correction lens 103 .
  • a fixed portion 403 is fixed on a barrel 105 .
  • a supporting/guiding portion 404 is provided on the movable frame 401 .
  • a spring 405 is mounted coaxially with the supporting/guiding portion 404 .
  • Coils 406 a and 406 b are mounted on the fixed portion 403 .
  • Magnets 407 a and 407 b are mounted on the movable frame 401 .
  • FIG. 11B is a right side view illustrating the camera shake correction mechanism illustrated in FIG. 11A .
  • Yokes 410 and 412 in FIG. 11B are not illustrated in FIG. 11A .
  • a position detection sensor 411 is not illustrated in FIG. 11A , the sensor 411 detects a position of the movable portion. More specifically, the position detection sensor 411 is formed with a hall element.
  • FIG. 11C illustrates the camera shake correction mechanism viewed from the direction of the allow 402 in FIG. 11A .
  • the movable frame 401 is guided and supported by the supporting/guiding portion 404 such that the movable frame 401 can perform plane motion to the fixed portion 403 .
  • the circular supporting/guiding portion 404 is inserted into an oval guiding groove 413 .
  • the camera shake correction mechanism can be held in the direction of the optical axis 104 of the imaging optical system 102 and can be moved on the plane perpendicular to the optical axis 104 by configuring the three portions to have the same structure.
  • the camera-shake correction lens 103 and the magnets 407 a and 407 b for driving the lens 103 are mounted on the movable frame 401 .
  • the movable frame 401 is elastically supported by the spring 405 that is mounted coaxially with the supporting/guiding portion 404 .
  • the movable frame 401 is placed such that the center of the camera-shake correction lens 103 is substantially coincident with the optical axis 104 .
  • a drive portion is configured such that the magnet 407 a is sandwiched by the yokes and the coil 406 a is provided on the one side.
  • An operating principle of the drive portion is described with reference to FIGS. 12A and 12B .
  • FIGS. 12A and 12B illustrates a drive circuit portion taken along the dotted line 408 in FIG. 11A as a cross-section.
  • the drive magnet 407 a has two poles, and magnetized in a thickness direction. Further, the yokes 410 and 412 are provided at both sides of the magnet 407 a in the magnetization direction of the magnet 407 a . Accordingly, most of the magnetic flux does not leak to the outside, and a magnetic field in the arrow direction illustrated in FIG. 12A is generated.
  • the driving force is proportional to the electric current of the coil 406 a .
  • the driving force is generated, since the movable frame 401 is elastically supported by the spring 405 , the movable frame 401 is displaced to a point to balance with the spring force.
  • a hall element 411 is mounted on the yoke 410 .
  • FIGS. 11A to 11C , 12 A, and 12 B the exemplary embodiment of the moving magnet method in which the magnet is disposed on the movable portion and the coil is disposed on the fixed portion has been described.
  • the present invention can be applied to an imaging apparatus provided with a moving coil method having a coil on a movable portion and a magnet on a fixed portion, or camera-shake correction mechanisms using the other driving methods.
  • FIG. 13 illustrates a configuration of a periphery of the image sensor according to the exemplary embodiment of the present invention.
  • a drive unit 109 b for camera-shake correction is provided in the vicinity of the image sensor 106 .
  • the drive unit 109 b shift-drives the image sensor 106 .
  • the switch 211 that performs setting of valid or invalid of the mode for implementing the camera-shake correction and valid or invalid of foreign substance correction is provided on the imaging apparatus 101 side.
  • the other configurations are similar to those in the above-described example of the camera-shake correction using the camera-shake correction lens.
  • FIGS. 13 and 14 illustrate the example mechanism that shift-drives the image sensor 106 .
  • drive coils 1101 and 1102 generate driving force between magnets 1105 and 1106 , and between 1107 and 1108 respectively, and drive a movable portion.
  • Hall elements 1103 and 1104 perform position detection of the movable portion.
  • a first guiding portion 1110 is provided on a first supporting portion 1109 .
  • a second guiding portion 1112 is provided on a second supporting portion 1111 .
  • a third supporting portion 1113 is fixed to a barrel.
  • a first elastic member 1114 is provided between the first supporting portion 1109 and a fixed portion (not shown).
  • a second elastic member 1115 is provided on the second supporting portion 1111 and a fixed portion (not shown).
  • the first supporting portion 1109 having the image sensor 106 thereon is elastically supported by the first elastic member 1114 and the second elastic member 1115 .
  • FIG. 14 illustrates a configuration of the drive unit.
  • the drive unit two magnetic circuits are provided.
  • the magnetic circuits have angles different from each other by 90 degrees, but have similar configurations. Accordingly, the description will be made using the drive unit having the drive coil 1101 and the magnets 1105 and 1106 .
  • an arrow 1203 schematically shows magnetic flux (closed magnetic circuit).
  • the magnets 1105 and 1106 are divided into two areas and magnetized respectively. Accordingly, as illustrated in FIG. 14 , most of the magnetic flux forms the closed magnetic circuit 1203 that circulates via rear yokes 1201 and 1202 .
  • the hall elements 1103 and 1104 provided on the first supporting portion 1109 are also displaced.
  • the hall elements 1103 and 1104 are relatively displaced to the magnetic circuits provided on the fixed portion. Accordingly, based on signals from the hall elements 1103 and 1104 , a position of the first supporting portion 1109 can be detected and feedback control can be performed.
  • a control block for the camera-shake correction system by moving the image sensor is similar to the above-described camera-shake correction system by moving the camera-shake correction lens 103 except for a point that the drive target is not the camera-shake correction lens 103 but the image sensor 106 .
  • the offset amount 301 is also appropriately set by the camera system control circuit 205 as described below.
  • an offset amount of the camera-shake correction lens 103 that is to be a movement distance on the image sensor 106 can be calculated from an optical magnification and used.
  • the method to improve quality of an image frame by moving a shadow of a foreign substance existing in the vicinity of the image sensor 106 and captured in a photographed image to a less noticeable area in the field image by the frame movement operation using the camera-shake correction operation has been described.
  • a shadow of a foreign substance is moved to a pixel area where uniform image output is generated to a field image, and shooting is performed.
  • the shadow of the foreign substance on the shot image is corrected by image processing (post-processing).
  • the image frame is moved to a pixel area near the coordinates of the shadow of the foreign substance 200 , the area having a uniform image output, for example, the position of G 3 (x 3 , y 3 ) on the background of FIG. 3A .
  • the result is illustrated in FIG. 3C .
  • the shadow of the foreign substance is noticeable.
  • a method to set the offset amount 301 which is an amount to move a frame, when the shadow of the foreign substance on the image sensor 106 is moved to the pixel area where the uniform image output is generated, is similar to the case described with reference to FIGS. 5 , 6 A, and 6 B.
  • pixels around the coordinates are divided into blocks.
  • the pixels in the block are averaged to obtain luminance of the block.
  • central coordinates of a block nearest to the foreign substance coordinates and having uniform luminance and a predetermined number of blocks are determined.
  • the coordinates are to be coordinates of a movement destination of the foreign substance.
  • an area nearest to the coordinates of the foreign substance where a block having at least a size of 3 ⁇ 3 exists is selected.
  • the coordinates of the destination of the frame movement to be moved by the camera-shake correction system which are the coordinates of the central coordinates of the areas each formed by the plurality of blocks, are G 3 (x 3 , y 3 ). Accordingly, the offset amount 301 ( ⁇ ) for the frame movement operation can be obtained by the following equation using the foreign substance coordinates G 1 (x 1 , y 1 ) and the frame movement destination coordinates G 3 (x 3 , y 3 ).
  • ⁇ ⁇ ( x 3 ⁇ x 1) 2 +( y 3 ⁇ y 1) 2 ⁇
  • ⁇ x x 3 ⁇ x 1
  • the imaging operation of the camera according to the second exemplary embodiment is similar to that described in the first exemplary embodiment with reference to FIG. 4 .
  • the foreign substance removal processing which performs image processing on a shadow of a foreign substance captured in a shot image and recorded in the external memory 107 to reduce the shadow, is specifically described with reference to FIG. 15 .
  • the foreign substance removal processing is performed using an image processing program that operates not in the camera body but on a separately provided personal computer is described.
  • step S 900 normal shot image data to which foreign substance correction data is attached is read from the external memory 107 removed from the camera 101 , and stored in a primary storage unit in the personal computer.
  • step S 901 from the normally shot image data (a target image on which the foreign substance removal processing is to be performed), the foreign substance correction data attached to the shot image is extracted.
  • step S 903 a diaphragm value F 2 and a lens pupil position L 2 at the shooting of the normally shot image are acquired.
  • step S 904 the coordinate D 1 is converted by the following equation. “d” denotes a distance from the image center to the coordinate D 1 , and H denotes a distance between the surface of the image sensor 106 and the foreign substance.
  • step S 905 an interpolation processing counter i is initialized to zero.
  • step S 906 i is counted up.
  • step S 907 interpolation routine described below is performed on an area expressed by an i-th coordinate Di′ and radius Ri′, and the foreign substance in the area is removed.
  • step S 908 whether the foreign substance removal processing is performed on all of the coordinates is determined. When the processing is performed on the all coordinates (YES in step S 908 ), the processing ends in step S 909 . When the processing is not performed on the all coordinates (NO in step S 908 ), the processing returns to step S 906 .
  • the interpolation routine performed using repair processing is described.
  • the repair processing is performed to detect an isolated area that satisfies a condition preliminarily determined within a specified area and interpolate the isolation area by peripheral pixels.
  • FIG. 16 is a flowchart illustrating a flow of the interpolation routine.
  • step S 1001 a foreign substance area is determined.
  • a central coordinate of the area to be repair-processed is P
  • a radius is R.
  • the foreign substance area is an area that satisfies all of the following conditions.
  • T 2 An area having a brightness value smaller than a threshold T 2 obtained by the following equation using an average luminance Yave and a maximum luminance Ymax of a pixel contained in the repair processing target area.
  • T 2 Y ave ⁇ 0.6+ Y max ⁇ 0.4
  • 11 is three pixels, and 12 is 30 pixels. Thereby, it is possible to determine only an isolated small area as the foreign substance area.
  • step S 1002 when a foreign substance area exists (YES in step S 1002 ), the processing proceeds to step S 1003 and the foreign substance area interpolation is performed. When a foreign substance area does not exist (NO in step S 1002 ), the processing ends.
  • the foreign substance area interpolation processing in step S 1003 is performed using a known defective area interpolation method.
  • An example of the known defective area interpolation method is pattern replacement, discussed in Japanese Patent Application Laid-Open No. 2001-223894.
  • a defective area is specified using infrared light.
  • the foreign substance area detected in step S 1001 is specified as the defective area, and the foreign substance area is interpolated by peripheral normal pixels by the pattern replacement.
  • p normal pixels are selected in ascending order of distance from the interpolation target pixel, and q normal pixels are selected in descending order. Then, interpolation is performed using the average color of the pixels on the pattern-replacement processed image data.
  • the example has been described in that once shooting is performed by the camera, and the foreign substance image data is stored, then, for example, using the personal computer, the shot image is acquired.
  • the image processing is performed by the personal computer according to the external program to perform foreign substance processing.
  • the image processing may be performed in the camera. That is, during image processing performed after main exposure of shooting, the interpolation processing may be performed. Alternatively, after the main exposure and the image processing, once the image data is recorded in the external memory 107 , and the photographer may call up the image data again and manually perform the interpolation processing program.
  • the post-processing (image processing) is needed.
  • image processing image processing
  • the processing almost all of the effect of the shadow of the foreign substance can be removed. Further, the probability of existence of a uniform luminance area on a frame where a shadow of a foreign substance is to be moved is substantially high. Accordingly, the amount to move the shadow of the foreign substance can be smaller, and results in smaller possibility of changing the shot composition.
  • frame movement destination coordinates are determined based on luminance distribution of a captured image.
  • DCT discrete cosine transform
  • a periphery of coordinates of a foreign substance is divided into small blocks of 8 ⁇ 8 pixels, and the DCT operation is performed on each small block.
  • the spatial frequency component can be numeric-converted to determine whether the component belongs to a high frequency region or a low frequency region (spatial frequency distribution detection).
  • the shadow of the foreign substance when a shadow of a foreign substance is moved to an area less noticeable in a frame, the shadow of the foreign substance is less noticeable when the shadow is moved to an area having a high spatial frequency. Accordingly, the area (block) having the high spatial frequency is determined as a movement destination of the shadow of the foreign substance.
  • an area (block) having a low spatial frequency is determined as a destination of the foreign substance coordinate. If the coordinate of the movement destination of the shadow of the foreign substance is determined, it is possible to finally obtain the shot scene having the less noticeable foreign substance by using the imaging operation in the first exemplary embodiment illustrated in FIG. 4 or the image processing of the foreign substance interpolation in the second exemplary embodiment.
  • step S 500 to step S 513 is live view shooting for shooting field images continuously.
  • the camera can be used as a video camera.
  • a foreign substance is recorded as a video picture in which the foreign substance is moved and held in an area less noticeable in the image frame.
  • the present invention can be applied to a single-lens reflex camera having a quick-return mirror system, which cannot perform live view shooting.
  • FIG. 17 is a schematic diagram illustrating a single-lens reflex camera to which the present invention is applied.
  • the same reference numerals are designated.
  • a quick-return mirror 217 is in a down state tilted by 45 degrees to the optical axis 104 in the imaging optical system 102 , and a blade type shutter 211 for performing exposure control of the image sensor 106 is shut.
  • the camera-shake correction lens 103 is driven. Accordingly, the photographer can view a field image on which the camera-shake correction is performed and confirm the effect of the correction.
  • the acquisition of the field image is performed by the AE sensor 207 . That is, the primary-formed field image on the focus plate 216 is led to the AE sensor 207 by a projection lens 213 . That is, the AE sensor 207 can detect field luminance except for the time when the quick-return mirror 217 is up for the shooting and thereby the field light does not enter the AE sensor 207 .
  • a light reception portion is divided into areas of 60 ⁇ 90 (vertical ⁇ horizontal). Accordingly, it is possible to similarly divide the field into small areas of 60 ⁇ 90, and detect luminance (luminance distribution detection).
  • luminance data of the small areas is obtained, the calculation of an amount of frame movement (the offset amount 301 ), which is the operation performed in step S 605 and subsequent steps of the flowchart in FIG. 5 , can be executed. Based on the calculated value, the camera-shake correction lens 103 is controlled.
  • the camera with the functions similar to those described in the first and second exemplary embodiments of the present invention can be provided.
  • the moved composition is slightly changed from a shooting composition the photographer originally has intended.
  • FIG. 3A The shooting composition originally intended is illustrated in FIG. 3A .
  • the position of the main object is displaced to the lower portion of the frame.
  • the main object is displaced to the left side.
  • the amount of the change is not accepted by the photographer, it is effective to perform trimming on a shot frame based on the size of the frame movement amount (i.e., the offset amount 301 ).
  • trimming line A when the frame movement is performed to an upper portion of the frame based on the converted pixels of the image sensor 106 , to reproduce the composition center before the frame movement is performed and maintain the aspect ratio of 3:2 (horizontal:vertical) in width and height, trimming for deleting the vertical upper pixels and the right and left pixels is performed (trimming line A).
  • trimming line B when the pixels are moved to the right direction in the frame, trimming for deleting the pixels in the right side in the frame and the upper pixels is performed (trimming line B).
  • the trimming processing may be automatically performed by the camera after the shooting and before the recording of the data in the external memory 107 . Further, after the data is once recorded, the photographer reads the image, and the trimming processing may be performed.
  • a storage medium (or recording medium), which records software program code to implement the functions of the above-described exemplary embodiments, is supplied to a system or apparatus.
  • a computer or a central processing unit (CPU) or a micro processing unit (MPU) of the system or apparatus reads out and executes the program code stored in the storage medium.
  • the program code read out from the storage medium implements the functions of the above-described embodiments, and accordingly, the storage medium storing the program code constitutes the present invention.
  • the functions of the above-described exemplary embodiments are implemented not only by the computer by reading and executing the program code.
  • the present invention can also be embodied in the following arrangement.
  • the operating system (OS) running on the computer executes a part or the whole of the actual processing based on of the instructions of the program code, thereby implementing the functions of the above-described embodiments.
  • an aspect of the present invention can also be achieved by the following arrangement. That is, the program code read out from the storage medium is written in the memory of a function expansion card inserted into the computer or a function expansion unit connected to the computer.
  • the operating system (OS) running on the computer executes a portion or the whole of the actual processing on the basis of the instructions of the program code, thereby implementing the functions of the above-described embodiments.
  • OS operating system

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)
  • Adjustment Of Camera Lenses (AREA)
US12/495,812 2008-07-03 2009-07-01 Imaging apparatus, control method thereof, and computer-readable storage medium storing program Expired - Fee Related US8158918B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2008-174956 2008-07-03
JP2008174956A JP5188293B2 (ja) 2008-07-03 2008-07-03 撮像装置及びその制御方法及びプログラム

Publications (2)

Publication Number Publication Date
US20100002101A1 US20100002101A1 (en) 2010-01-07
US8158918B2 true US8158918B2 (en) 2012-04-17

Family

ID=41464051

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/495,812 Expired - Fee Related US8158918B2 (en) 2008-07-03 2009-07-01 Imaging apparatus, control method thereof, and computer-readable storage medium storing program

Country Status (2)

Country Link
US (1) US8158918B2 (enrdf_load_stackoverflow)
JP (1) JP5188293B2 (enrdf_load_stackoverflow)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120162455A1 (en) * 2010-12-23 2012-06-28 Samsung Electronics Co., Ltd. Digital image processing apparatus including handshake correction module and methods of controlling the digital image processing apparatus
US20220291501A1 (en) * 2021-03-10 2022-09-15 Oak Analytics Inc. System and method for facilitating optical raster scanning

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6448380B2 (ja) * 2015-01-19 2019-01-09 キヤノン株式会社 光学装置、制御方法、プログラム、記憶媒体
JP6558088B2 (ja) * 2015-06-12 2019-08-14 リコーイメージング株式会社 撮影装置、撮影制御装置及び撮影制御方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002204379A (ja) 2000-12-28 2002-07-19 Olympus Optical Co Ltd カメラ
JP2004172820A (ja) 2002-11-19 2004-06-17 Minolta Co Ltd 撮像装置
US7787045B2 (en) * 2005-12-06 2010-08-31 Panasonic Corporation Digital camera having a control portion for light measurement
US7853097B2 (en) * 2002-12-27 2010-12-14 Nikon Corporation Image processing apparatus and image processing program

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4968885B2 (ja) * 2006-06-05 2012-07-04 キヤノン株式会社 撮像装置及びその制御方法、撮像システム、画像処理方法並びにプログラム
KR101078474B1 (ko) * 2006-06-08 2011-10-31 후지쯔 가부시끼가이샤 오염 검출 장치
JP4771539B2 (ja) * 2006-07-26 2011-09-14 キヤノン株式会社 画像処理装置及びその制御方法及びプログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002204379A (ja) 2000-12-28 2002-07-19 Olympus Optical Co Ltd カメラ
US20040012714A1 (en) 2000-12-28 2004-01-22 Olympus Optical Co., Ltd. Camera
JP2004172820A (ja) 2002-11-19 2004-06-17 Minolta Co Ltd 撮像装置
US7853097B2 (en) * 2002-12-27 2010-12-14 Nikon Corporation Image processing apparatus and image processing program
US7787045B2 (en) * 2005-12-06 2010-08-31 Panasonic Corporation Digital camera having a control portion for light measurement

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120162455A1 (en) * 2010-12-23 2012-06-28 Samsung Electronics Co., Ltd. Digital image processing apparatus including handshake correction module and methods of controlling the digital image processing apparatus
US8587676B2 (en) * 2010-12-23 2013-11-19 Samsung Electronics Co., Ltd. Digital image processing apparatus including handshake correction module and methods of controlling the digital image processing apparatus
US20220291501A1 (en) * 2021-03-10 2022-09-15 Oak Analytics Inc. System and method for facilitating optical raster scanning

Also Published As

Publication number Publication date
JP5188293B2 (ja) 2013-04-24
JP2010016650A (ja) 2010-01-21
US20100002101A1 (en) 2010-01-07

Similar Documents

Publication Publication Date Title
US10129479B2 (en) Photographing apparatus and photographing method with optical low-pass filter effect
US7606476B2 (en) Imaging device and imaging method
US20070285522A1 (en) Image capturing apparatus, control method thereof, image processing apparatus, image processing method, image capturing system, and program
JP7305455B2 (ja) 防振制御装置、撮像装置及び防振制御方法
JP2015233248A (ja) 撮像装置及び撮像方法
JP2008262049A (ja) オートフォーカス装置、撮像装置及びオートフォーカス方法
JP2001186401A (ja) デジタルカメラ
WO2008056561A1 (fr) Dispositif d'imagerie
US8158918B2 (en) Imaging apparatus, control method thereof, and computer-readable storage medium storing program
JP2011217311A (ja) 撮像装置および撮像装置の制御方法
US20220400215A1 (en) Image pickup apparatus, image pickup method, and storage medium
JP2005269130A (ja) 手振れ補正機能を有する撮像装置
US10057492B2 (en) Photographing apparatus and photographing control method to generate a low-pass filter effect
JP2009152803A (ja) 撮像装置及びその制御方法及びプログラム
US20210258472A1 (en) Electronic device
CN111741213B (zh) 摄像设备及其控制方法以及计算机可读介质
JP5215818B2 (ja) 撮像装置及びその制御方法及びプログラム
JPH085896A (ja) 撮像装置
JP2016099416A (ja) 撮像装置
JP2021033233A (ja) 像ブレ補正装置及びその制御方法、プログラム、像ブレ補正装置を備える撮像装置
US11665438B2 (en) Electronic device capable of acquiring line-of-sight information
JP2006243609A (ja) オートフォーカス装置
JPH0993481A (ja) 交換レンズ式カメラシステム
JP2018014680A (ja) 撮像装置、制御方法及びプログラム
JP3720499B2 (ja) 撮像装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: CANON KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:IRIE, YOSHIAKI;REEL/FRAME:023359/0853

Effective date: 20090529

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20200417