WO2008100153A1 - A device for providing stabilized images in a hand held camera - Google Patents

A device for providing stabilized images in a hand held camera Download PDF

Info

Publication number
WO2008100153A1
WO2008100153A1 PCT/NO2008/000055 NO2008000055W WO2008100153A1 WO 2008100153 A1 WO2008100153 A1 WO 2008100153A1 NO 2008000055 W NO2008000055 W NO 2008000055W WO 2008100153 A1 WO2008100153 A1 WO 2008100153A1
Authority
WO
WIPO (PCT)
Prior art keywords
providing
camera
piezo electric
lens
electric actuators
Prior art date
Application number
PCT/NO2008/000055
Other languages
French (fr)
Other versions
WO2008100153A8 (en
Inventor
Benny Svardal
Thomas Spatcheck
Vladimir Kartashov
Original Assignee
Polight As
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Polight As filed Critical Polight As
Priority to CN2008800117906A priority Critical patent/CN101688976B/en
Priority to EP08712670A priority patent/EP2122406A4/en
Priority to JP2009549024A priority patent/JP2010518443A/en
Publication of WO2008100153A1 publication Critical patent/WO2008100153A1/en
Publication of WO2008100153A8 publication Critical patent/WO2008100153A8/en
Priority to US12/776,288 priority patent/US20110158617A1/en

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/64—Imaging systems using optical elements for stabilisation of the lateral and angular position of the image
    • G02B27/646—Imaging systems using optical elements for stabilisation of the lateral and angular position of the image compensating for small deviations, e.g. due to vibration or shake
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50—Constructional details
    • H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/004—Optical devices or arrangements for the control of light using movable or deformable optical elements based on a displacement or a deformation of a fluid
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B5/00—Adjustment of optical system relative to image or object surface other than for focusing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/685—Vibration or motion blur correction performed by mechanical compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/75—Circuitry for compensating brightness variation in the scene by influencing optical camera components
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B2205/00—Adjustment of optical system relative to image or object surface other than for focusing
    • G03B2205/0007—Movement of one or more optical elements for control of motion blur
    • G03B2205/0023—Movement of one or more optical elements for control of motion blur by tilting or inclining one or more optical elements with respect to the optical axis
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B2205/00—Adjustment of optical system relative to image or object surface other than for focusing
    • G03B2205/0053—Driving means for the movement of one or more optical element
    • G03B2205/0061—Driving means for the movement of one or more optical element using piezoelectric actuators
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B2217/00—Details of cameras or camera bodies; Accessories therefor
    • G03B2217/005—Blur detection

Definitions

  • the present invention is related to image stabilization of handheld digital cameras, and especially to a device providing image stabilization by applying control signals on actuators attached to a flexible lens body, wherein squeezing of the flexible lens body by the actuators provides a shift in the direction of the optical axis through the lens body in accordance with the control signals that are counteracting the effects of unintended movements or vibrations of the handheld camera.
  • the optical image stabilizer according to the present invention overcomes the complexity of prior art solutions by providing actuators in contact with a flexible lens body providing a shifting of direction of the optical axis through the lens body, and hence the position of a crossing point between the optical axis and a surface of an image sensor, counteracting the movements of the unintended rapid movements.
  • the shift of optical axis direction is obtained by "squeezing" the flexible lens body by activating the actuators according to control signals provided for by motion sensors, for example a gyroscopic sensor system as known in prior art.
  • image stabilizers provided for by flexible lens assemblies are suitable for wafer level manufacturing, which enables a new class of fully automated integrated camera solutions.
  • the example of embodiment enables compact cameras for e.g. cameras for mobile phones to increase the exposure time without increased blurring due to small rapid unintended movements, since the device compensates the movements.
  • Increasing the exposure time for e.g. CMOS digital cameras implies a strongly increased signal to noise level, less background noise for pictures taken under dark conditions and reduces thresholds used for a required brightness. It also implies that a camera can be designed for a higher F-number, while still capturing the same amount of light (over a longer period of time), compared to lower F-number solutions, which will enable reduced size, complexity and cost of the camera lenses compared to the present prior art lenses.
  • a device for providing stabilized images in a hand held camera comprises a flexible lens body arranged in between at least one actuator providing a squeezing of the flexible lens body when applied voltages activates the at least one actuator, wherein the activating voltages alters directions of light passing the lens body proportionally to signals provided by motion sensors sensing yawing and pitching movements, respectively, of the camera.
  • a device comprises side walls bounding a cavity filled with transparent polymer on top of a transparent support, wherein a bendable transparent cover is arranged on top of the side walls and the polymer comprising a centrally attached transparent prism, located in between piezo electric actuators located on top of the transparent cover.
  • a device comprises a centrally attached prism formed as a cylindrical lens, wherein two separate piezo electric actuators, one on each side of the cylindrical lens is providing a one dimensional displacement of light passing the device.
  • a centrally attached prism is a spherical lens
  • four separate piezo electric elements are arranged in a quadratic pattern around the spherical lens, providing a two dimensional displacement of light passing the device.
  • a device comprises the motion detectors that are gyroscopic sensors.
  • a device comprises a motion detector that provides a signal only when the signal level is above a preset threshold level.
  • the signals from the motion detectors are combined with signals from a tracking device providing a projection of an object onto substantially the same location on an image sensor surface when the device is moved for following the movements of a fast moving object viewed through the device.
  • a device for providing stabilized images in a hand held camera comprises a flexible body with a light reflecting coating on an outwardly facing surface arranged in between at least one actuator providing a squeezing of the flexible body when applied voltages activates the at least one actuator, wherein the activating voltages alters directions of incident light being reflected by the body proportionally to signals provided by motion sensors sensing yawing and pitching movements, respectively, of the camera.
  • a device comprises side walls bounding a cavity filled with polymer on top of a support, wherein a bendable cover is arranged on top of the side walls and the polymer is comprising a centrally attached body with a reflecting coating on an outwardly facing side of the body, located in between piezo electric actuators located on top of the cover.
  • two separate piezo electric actuators one on each side of the centrally attached body is providing a one dimensional displacement of incident light being reflected from the device.
  • four separate piezo electric actuators are arranged in a quadratic pattern around the centrally attached body providing a two dimensional displacement of incident light being reflected from the device.
  • Figure 1 depicts an example of prior art image stabilizing arrangements in a camera.
  • Figure 2 depicts another example of prior art image stabilizing arrangements in a camera.
  • Figure 3 a and 3b depicts an example of embodiment of the present invention.
  • Figure 4 depicts another example of embodiment of the present invention.
  • Figure 5 depicts another example of embodiment of the present invention comprising auto focus capabilities.
  • Figure 6 depicts another example of embodiment of the present invention.
  • Figure 7 depicts another example of embodiment of the present invention.
  • FIG 1 illustrates the principle arrangement of an image stabilizer moving a lens element according to signals from motion sensor elements, as known in prior art.
  • a camera house 10 may be moved unintended horizontally around the Y axis denoted yawing, and/or around the X axis which is a movement denoted pitching.
  • An angular velocity sensor 1 located along the Y axis direction senses yawing while another velocity sensor 2 located along the X axis senses pitching.
  • respective actuators 11 and 12 respectively shifts the VR Lens element in the X and Y directions compensating the unintended motions detected by the angular velocity detectors 1 and 2.
  • Figure 2 illustrates the principles of an image stabilizing system moving a CCD image sensor chip according to gyroscopic signal processing.
  • FIG. 3 a and 3b illustrates an example of embodiment of the present invention.
  • correcting movements of an optical axis through a lens assembly may be accomplished by an arrangement as depicted in figure 3a.
  • a transparent flexible polymer is arranged in a cavity 21 bounded by walls 22, a transparent support 23 and a thin bendable transparent cover 26 (for example a thin glass plate) arranged with a centrally located transparent prism 25 in between at least two piezo electric actuators 24.
  • a negative voltage is applied onto one of the two piezo electric actuators
  • a positive voltage is applied onto the other piezo electric actuator
  • the amount of tilting, and hence the displacement of the optical axis through the assembly may be controlled according to motion sensors providing signals that are in accordance with detected unintended movements, thereby providing means for counteracting such unintended movements by shifting the position of the crossing point between the optical axis and a surface of the image sensor.
  • the amount of shifting necessary is proportional to the distance between the device depicted in figure 1 and the surface of the image sensor (not shown).
  • the amount of applied voltages onto the piezo electric actuators can be scaled by programmable voltage sources, programmable or fixed attenuators etc., as known to a person skilled in the art.
  • Figure 4 illustrates another example of embodiment of the present invention, wherein the prism 25 in figure 3 a and 3b is replaced with a body 30 (can be the prism as illustrated in figure 3a and 3b) coated with a light reflecting material on the outwardly facing surface of the body 30.
  • a body 30 can be the prism as illustrated in figure 3a and 3b coated with a light reflecting material on the outwardly facing surface of the body 30.
  • the piezo electric actuators 24 are tilting the body 30, incident light onto the reflecting surface of the body 30 changes its reflected direction.
  • this arrangement can be used to adjust the crossing point between the reflected light from the body 30 and an image sensor surface to counteract effects of unintended movements detected by motion sensors, for example.
  • the amount of voltages applied onto the piezo electric actuators is proportional to the amount of displacement necessary to move the crossing point to counteract the unintended movement.
  • Figure 5 illustrates an example on how an electronic circuitry may be arranged to provide the voltages onto the piezo electric actuators 24.
  • the actual electronic circuitry or configuration of the circuitry can depend on the type of sensor that is used to detect the unintended movements. However, it is within the scope of the present invention that any type of sensors and electronic circuitry, including digital signal processors, micro controllers and microprocessors as well as discrete components, analog as well as digital components, can be used as long as the circuitry applies voltages onto the actuators in a fashion providing a tilting of the prism 25 or the body 30 counteracting the effects of the unintended movement that is detected.
  • Figure 6 illustrates another example of embodiment comprising an image stabilizing arrangement as illustrated in figure 3 together with a lens assembly providing auto focus capabilities.
  • the electronic circuitry is arranged to provide both image stabilizing signals as well as providing a shift of the focus point.
  • the lens arrangement providing auto focus capabilities is disclosed for example in the Norwegian patent application No. 20070803.
  • Figure 7 illustrates different examples of arranging a prism 25 (or a body 30 coated with a light reflecting material), in between different geometries of actuators 24 providing one dimensional tilting or two dimensional tilting of the prism 25 or body 30, respectively.
  • Figure 7a illustrates a one dimensional tilting capability
  • figure 7b and 7c illustrates two dimensional tilting capabilities. If the arrangement depicted in figure 7a is to be used to counteract yawing and pitching, a stack of two embodiments as illustrated in figure 7a could be provided, wherein one of the embodiments controls yawing while the other controls pitching, for example.
  • the different examples of embodiments of the present invention disclosed above provides a control of the crossing point between the light passing through the lens body (or direction of reflected light) and a surface of the image sensor in the camera or video recorder.
  • other movements that are intended may cause the same type of blurriness that unintended movements may provide in images.
  • Such intended rapid movements can stem from fast moving objects that are photographed or video recorded, for example such as a fast running formula 1 racing car.
  • a tracking device may be used to provide regulating voltages onto the piezo electric actuators according to the present invention.
  • a tracking device is used together with an embodiment of the present invention, for example as depicted in figure 3 a or 4a, that will eliminate the problems related to photographing or filming fast moving objects.
  • a tracking device allows an operator of a system comprising a camera or video recorder to lock a marker (cursor) onto an object viewed through the camera or video recorder, thereby enabling the system to "follow" by turning the camera or video recorder as the marked object moves across a scene.
  • the turning of the camera or video recorder is provided for by a camera platform attached to the camera comprising motors controlled by signals related to the detected movements of the locking marker (and thereby the movement of the locked object) across the surface of an image sensor in the came rear.
  • the locking can be obtained by software detecting a contour of the object that the marker is pointing to, and then detecting movements in any direction of the contour by detecting shifting values of pixels in the edge areas of the locked object, as known to a person skilled in the art.
  • signals are generated that moves the camera or video recorder platform such that the object still is inside the surface of the image sensor.
  • the inventors of the present invention have realized that these principles of locking a marker onto an object may be utilized together with embodiments of the present invention to counteract the problems of photographing or filming fast moving objects.
  • the tracking device according to the present invention comprises a selecting and locking mechanism of an object as known in the prior art.
  • a cursor can be used to select an object for locking through the viewfmder of a digital camera.
  • this example of embodiment of the present invention does not comprise a motorized camera platform.
  • signals are generated in the tracking device providing information of the movements of the locked object, such as speed, direction and intensity (acceleration) of the locked object.
  • this information By transforming this information into voltages applied onto the piezo electric actuators according to the present invention, the movement of the fast moving object is counteracted such that the imaged object itself is always projected onto the same area of the surface of the image sensor.
  • the object starts to move, ore moves outside the viewfmder of the camera, the person holding the camera will follow the object by moving the camera.
  • this example of embodiments locks the object to the same area on the surface of the image sensor, this following movement by hand that usually provides a jogging sensation in the images is eliminated.
  • a plurality of devices according to the present invention may be defined by providing a plurality of sidewalls 22, for example in a matrix pattern, on top of a transparent support 23.
  • a polymer can then be filled into the plurality of cavities defined by the matrix pattern.
  • a glass cover 26 may be assembled on top of the polymer and side wall matrix.
  • a glass prism 25 may be an integral part of the glass cover 26, or may be assembled onto the glass cover 26 before the glass cover is arranged on top of the side wall matrix and polymer.
  • a plurality of glass prisms 25 may be arranged in a similar matrix pattern on the glass cover 26, at positions consistent with the cavities bounded by the side walls 26 provided for by the matrix pattern.
  • the piezo electric actuators 24 can likewise be arranged onto the glass cover 26 before or after assembly of the glass cover on top of the side walls 26, as known to a person skilled in the art. After the assembly process is finished, each device in the matrix pattern may be individualized by sawing along the matrix directions in the middle of each respective section of the side walls 22 surrounding each device provided by the matrix pattern.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Studio Devices (AREA)
  • Adjustment Of Camera Lenses (AREA)

Abstract

The present invention provides image stabilization by altering the direction of the optical axis through a flexible lens body by activating actuators attached to the flexible lens body, wherein the amount of applied voltages onto the actuators are proportional to signals provided by motion sensors sensing yawing and pitching movements, respectively.

Description

A device for providing stabilized images in a hand held camera
The present invention is related to image stabilization of handheld digital cameras, and especially to a device providing image stabilization by applying control signals on actuators attached to a flexible lens body, wherein squeezing of the flexible lens body by the actuators provides a shift in the direction of the optical axis through the lens body in accordance with the control signals that are counteracting the effects of unintended movements or vibrations of the handheld camera.
Trembling of the hand, vibrations in the ground or in a floor of a building, or other similar small rapid movements from or through a person or a camera stand, holding a camera, such as a still photography camera or a video camera, are usually unintended movements causing blurring of the pictures since the shutter speed is finite, and the image scene is swept over the image sensor by the unintended movement of the camera. In order to compensate for such unintended movements very high shutter speeds could be used. However, this would affect the low brightness threshold of the camera since less light is captured due to the higher shutter speeds. There are also physical limitations with regard to how fast a shutter can be moved. Digital cameras do also have problems related to the background noise level and read-out speed that affects the maximum possible shutter speed of the camera. In prior art there are known some solutions providing image stabilization by either using a hardware system, or a software program for post processing of captured and stored digital images, or as a combination of hardware and real time software, providing an elimination or compensation of the unintended movements in the captured images.
Currently known methods for image stabilization of digital cameras (still picture and video cameras) typically uses optical lens elements inserted into the light path which are moved laterally by a mechanical mechanism driven by an external motor, for example piezo actuators, voice coils or step motors, and are characterized by a complex arrangement with many parts. For example, a gyro can provide signals providing control signals that counteract unintended movements by moving an optical lens element in an opposite direction than the unintended movement. Other prior art methods uses software algorithms and reduces image blurriness after image capture, but this scheme provides no improved optical quality of the captured image frames, and introduces in stead other image artifacts reducing the quality of the pictures further. Prior art solutions providing a mechanically driven mechanism makes the camera system larger and more complex to build. The large number of parts does also pose a reliability risk. Software solutions providing an image analysis and filtering of captured and stored digital images tends to crop the images, and then often extrapolate lost image parts at the edges of the image to hide the unintended movements. In astronomy it is often used an orthogonal transfer CCD chip that actually shifts the image within the CCD chip itself while the image is captured based on an online analysis of the apparent motion of celestial objects being observed. Solutions provided for by camera manufactures such as Sony, Nikon, Konica Minolta etc. moves mechanically either the image sensor, or have a floating lens element being moved according to control signals provided for by gyroscopic sensors, sensing both the event and direction of small rapid unintended movements, wherein the unintended motion is characterized by providing a sensor signal above a preset threshold level related to speed, direction and intensity (acceleration and duration) of the movement.
Recent developments of flexible lens bodies provide compact lens assemblies with auto focus capabilities. For example, the Norwegian patent applications No. 20070803 and No. 20065238 provides examples of such devices. The present inventors has realized that these types of flexible lens assemblies may be modified and used to provide a simple, compact and easy manufacturability of systems for image stabilization. The optical image stabilizer according to the present invention overcomes the complexity of prior art solutions by providing actuators in contact with a flexible lens body providing a shifting of direction of the optical axis through the lens body, and hence the position of a crossing point between the optical axis and a surface of an image sensor, counteracting the movements of the unintended rapid movements. The shift of optical axis direction is obtained by "squeezing" the flexible lens body by activating the actuators according to control signals provided for by motion sensors, for example a gyroscopic sensor system as known in prior art.
According to an aspect of the present invention, image stabilizers provided for by flexible lens assemblies are suitable for wafer level manufacturing, which enables a new class of fully automated integrated camera solutions.
According to an example of embodiment of a device according to the present invention, the example of embodiment enables compact cameras for e.g. cameras for mobile phones to increase the exposure time without increased blurring due to small rapid unintended movements, since the device compensates the movements. Increasing the exposure time for e.g. CMOS digital cameras implies a strongly increased signal to noise level, less background noise for pictures taken under dark conditions and reduces thresholds used for a required brightness. It also implies that a camera can be designed for a higher F-number, while still capturing the same amount of light (over a longer period of time), compared to lower F-number solutions, which will enable reduced size, complexity and cost of the camera lenses compared to the present prior art lenses.
According to an example of embodiment of the present invention, a device for providing stabilized images in a hand held camera comprises a flexible lens body arranged in between at least one actuator providing a squeezing of the flexible lens body when applied voltages activates the at least one actuator, wherein the activating voltages alters directions of light passing the lens body proportionally to signals provided by motion sensors sensing yawing and pitching movements, respectively, of the camera.
According to an example of embodiment of the present invention, a device comprises side walls bounding a cavity filled with transparent polymer on top of a transparent support, wherein a bendable transparent cover is arranged on top of the side walls and the polymer comprising a centrally attached transparent prism, located in between piezo electric actuators located on top of the transparent cover.
According to an example of embodiment of the present invention, a device comprises a centrally attached prism formed as a cylindrical lens, wherein two separate piezo electric actuators, one on each side of the cylindrical lens is providing a one dimensional displacement of light passing the device.
According to an example of embodiment of the present invention, wherein a centrally attached prism is a spherical lens, wherein four separate piezo electric elements are arranged in a quadratic pattern around the spherical lens, providing a two dimensional displacement of light passing the device.
According to an example of embodiment of the present invention, a device comprises the motion detectors that are gyroscopic sensors.
According to an example of embodiment of the present invention, a device comprises a motion detector that provides a signal only when the signal level is above a preset threshold level. According to an example of embodiment of the present invention, the signals from the motion detectors are combined with signals from a tracking device providing a projection of an object onto substantially the same location on an image sensor surface when the device is moved for following the movements of a fast moving object viewed through the device.
According to an example of embodiment of the present invention, a device for providing stabilized images in a hand held camera comprises a flexible body with a light reflecting coating on an outwardly facing surface arranged in between at least one actuator providing a squeezing of the flexible body when applied voltages activates the at least one actuator, wherein the activating voltages alters directions of incident light being reflected by the body proportionally to signals provided by motion sensors sensing yawing and pitching movements, respectively, of the camera.
According to an example of embodiment of the present invention, a device comprises side walls bounding a cavity filled with polymer on top of a support, wherein a bendable cover is arranged on top of the side walls and the polymer is comprising a centrally attached body with a reflecting coating on an outwardly facing side of the body, located in between piezo electric actuators located on top of the cover.
According to an example of embodiment of the present invention, two separate piezo electric actuators, one on each side of the centrally attached body is providing a one dimensional displacement of incident light being reflected from the device.
According to an example of embodiment of the present invention, four separate piezo electric actuators are arranged in a quadratic pattern around the centrally attached body providing a two dimensional displacement of incident light being reflected from the device.
Figure 1 depicts an example of prior art image stabilizing arrangements in a camera.
Figure 2 depicts another example of prior art image stabilizing arrangements in a camera.
Figure 3 a and 3b depicts an example of embodiment of the present invention.
Figure 4 depicts another example of embodiment of the present invention. Figure 5 depicts another example of embodiment of the present invention comprising auto focus capabilities.
Figure 6 depicts another example of embodiment of the present invention.
Figure 7 depicts another example of embodiment of the present invention.
Figure 1 illustrates the principle arrangement of an image stabilizer moving a lens element according to signals from motion sensor elements, as known in prior art. As depicted in figure 1, a camera house 10 may be moved unintended horizontally around the Y axis denoted yawing, and/or around the X axis which is a movement denoted pitching. An angular velocity sensor 1 located along the Y axis direction senses yawing while another velocity sensor 2 located along the X axis senses pitching. According to signal magnitudes from these sensors, respective actuators 11 and 12 respectively shifts the VR Lens element in the X and Y directions compensating the unintended motions detected by the angular velocity detectors 1 and 2.
Figure 2 illustrates the principles of an image stabilizing system moving a CCD image sensor chip according to gyroscopic signal processing.
An ordinary person skilled in the art understands that such arrangements as illustrated in figure 1 and figure 2, although providing functional solutions to the image stabilizing problem, indeed are complex solutions that are difficult to manufacture. The key problem for providing image stabilization is to arrange movements of the crossing point between light in the optical axis and the surface of the image sensor in a counteracting motion relative to the detected unintended motions, and not the detection of unintended motions as such. For example, modern semi conductor technology and micro electronic mechanical systems (MEMS) systems etc. provides capabilities for providing miniaturized gyroscopic sensors that easily can be integrated into digital cameras for example, as known to a person skilled in the art.
Figure 3 a and 3b illustrates an example of embodiment of the present invention. According to the present invention, correcting movements of an optical axis through a lens assembly may be accomplished by an arrangement as depicted in figure 3a. A transparent flexible polymer is arranged in a cavity 21 bounded by walls 22, a transparent support 23 and a thin bendable transparent cover 26 (for example a thin glass plate) arranged with a centrally located transparent prism 25 in between at least two piezo electric actuators 24. When for example a negative voltage is applied onto one of the two piezo electric actuators, and a positive voltage is applied onto the other piezo electric actuator, the transparent prism 25 is tilted as shown in figure 3b. As readily can be understood by an ordinary person skilled in the art, by adjusting the applied voltages onto the piezo electric actuators, the amount of tilting, and hence the displacement of the optical axis through the assembly, may be controlled according to motion sensors providing signals that are in accordance with detected unintended movements, thereby providing means for counteracting such unintended movements by shifting the position of the crossing point between the optical axis and a surface of the image sensor. The amount of shifting necessary is proportional to the distance between the device depicted in figure 1 and the surface of the image sensor (not shown). In practical embodiments of these principles, the amount of applied voltages onto the piezo electric actuators can be scaled by programmable voltage sources, programmable or fixed attenuators etc., as known to a person skilled in the art.
Figure 4 illustrates another example of embodiment of the present invention, wherein the prism 25 in figure 3 a and 3b is replaced with a body 30 (can be the prism as illustrated in figure 3a and 3b) coated with a light reflecting material on the outwardly facing surface of the body 30. When the piezo electric actuators 24 are tilting the body 30, incident light onto the reflecting surface of the body 30 changes its reflected direction. As can readily be understood by an ordinary person skilled in the art, this arrangement can be used to adjust the crossing point between the reflected light from the body 30 and an image sensor surface to counteract effects of unintended movements detected by motion sensors, for example. The amount of voltages applied onto the piezo electric actuators is proportional to the amount of displacement necessary to move the crossing point to counteract the unintended movement.
Figure 5 illustrates an example on how an electronic circuitry may be arranged to provide the voltages onto the piezo electric actuators 24. The actual electronic circuitry or configuration of the circuitry can depend on the type of sensor that is used to detect the unintended movements. However, it is within the scope of the present invention that any type of sensors and electronic circuitry, including digital signal processors, micro controllers and microprocessors as well as discrete components, analog as well as digital components, can be used as long as the circuitry applies voltages onto the actuators in a fashion providing a tilting of the prism 25 or the body 30 counteracting the effects of the unintended movement that is detected. Figure 6 illustrates another example of embodiment comprising an image stabilizing arrangement as illustrated in figure 3 together with a lens assembly providing auto focus capabilities. The electronic circuitry is arranged to provide both image stabilizing signals as well as providing a shift of the focus point. The lens arrangement providing auto focus capabilities is disclosed for example in the Norwegian patent application No. 20070803.
Figure 7 illustrates different examples of arranging a prism 25 (or a body 30 coated with a light reflecting material), in between different geometries of actuators 24 providing one dimensional tilting or two dimensional tilting of the prism 25 or body 30, respectively. Figure 7a illustrates a one dimensional tilting capability, while figure 7b and 7c illustrates two dimensional tilting capabilities. If the arrangement depicted in figure 7a is to be used to counteract yawing and pitching, a stack of two embodiments as illustrated in figure 7a could be provided, wherein one of the embodiments controls yawing while the other controls pitching, for example.
The different examples of embodiments of the present invention disclosed above provides a control of the crossing point between the light passing through the lens body (or direction of reflected light) and a surface of the image sensor in the camera or video recorder. According to another aspect of the present invention, other movements that are intended may cause the same type of blurriness that unintended movements may provide in images. Such intended rapid movements can stem from fast moving objects that are photographed or video recorded, for example such as a fast running formula 1 racing car. According to another example of embodiment of the present invention, a tracking device may be used to provide regulating voltages onto the piezo electric actuators according to the present invention. When a fast moving object is photographed or filmed by a video camera, the person holding the camera must follow the object as its moves by turning the camera in the direction of the movement. Due to the high speed of the fast moving object this can cause a jogging movement of the camera. This jogging will manifest itself in the images or video streams as blurriness in the images.
According to an example of embodiment of the present invention, a tracking device is used together with an embodiment of the present invention, for example as depicted in figure 3 a or 4a, that will eliminate the problems related to photographing or filming fast moving objects. As known to a person skilled in the art, a tracking device allows an operator of a system comprising a camera or video recorder to lock a marker (cursor) onto an object viewed through the camera or video recorder, thereby enabling the system to "follow" by turning the camera or video recorder as the marked object moves across a scene. The turning of the camera or video recorder is provided for by a camera platform attached to the camera comprising motors controlled by signals related to the detected movements of the locking marker (and thereby the movement of the locked object) across the surface of an image sensor in the came rear. The locking can be obtained by software detecting a contour of the object that the marker is pointing to, and then detecting movements in any direction of the contour by detecting shifting values of pixels in the edge areas of the locked object, as known to a person skilled in the art. When a locked object moves outside the boundaries of the image sensor surface, signals are generated that moves the camera or video recorder platform such that the object still is inside the surface of the image sensor.
The inventors of the present invention have realized that these principles of locking a marker onto an object may be utilized together with embodiments of the present invention to counteract the problems of photographing or filming fast moving objects. The tracking device according to the present invention comprises a selecting and locking mechanism of an object as known in the prior art. For example, a cursor can be used to select an object for locking through the viewfmder of a digital camera. However, this example of embodiment of the present invention does not comprise a motorized camera platform. When the fast moving object starts moving across the image sensor surface of the camera, signals are generated in the tracking device providing information of the movements of the locked object, such as speed, direction and intensity (acceleration) of the locked object. By transforming this information into voltages applied onto the piezo electric actuators according to the present invention, the movement of the fast moving object is counteracted such that the imaged object itself is always projected onto the same area of the surface of the image sensor. When the object starts to move, ore moves outside the viewfmder of the camera, the person holding the camera will follow the object by moving the camera. However, since this example of embodiments locks the object to the same area on the surface of the image sensor, this following movement by hand that usually provides a jogging sensation in the images is eliminated.
According to another aspect of the present invention, embodiments of the present invention may be provided for by wafer level manufacturing. According to an example of manufacturing according to the present invention, a plurality of devices according to the present invention may be defined by providing a plurality of sidewalls 22, for example in a matrix pattern, on top of a transparent support 23. A polymer can then be filled into the plurality of cavities defined by the matrix pattern. Thereafter, a glass cover 26 may be assembled on top of the polymer and side wall matrix. A glass prism 25 may be an integral part of the glass cover 26, or may be assembled onto the glass cover 26 before the glass cover is arranged on top of the side wall matrix and polymer. A plurality of glass prisms 25 may be arranged in a similar matrix pattern on the glass cover 26, at positions consistent with the cavities bounded by the side walls 26 provided for by the matrix pattern. The piezo electric actuators 24 can likewise be arranged onto the glass cover 26 before or after assembly of the glass cover on top of the side walls 26, as known to a person skilled in the art. After the assembly process is finished, each device in the matrix pattern may be individualized by sawing along the matrix directions in the middle of each respective section of the side walls 22 surrounding each device provided by the matrix pattern.

Claims

C l a i m s :
1.
A device for providing stabilized images in a hand held camera, comprising a flexible lens body arranged in between at least one actuator providing a squeezing of the flexible lens body when applied voltages activates the at least one actuator, wherein the activating voltages alters directions of light passing the lens body proportionally to signals provided by motion sensors sensing yawing and pitching movements, respectively, of the camera.
2. The device according to claim 1, wherein the device comprises side walls bounding a cavity filled with transparent polymer on top of a transparent support, wherein a bendable transparent cover is arranged on top of the side walls and the polymer comprising a centrally attached transparent prism, located in between piezo electric actuators located on top of the transparent cover.
3.
The device according to claim 2, wherein the centrally attached prism is a cylindrical lens, wherein two separate piezo electric actuators, one on each side of the cylindrical lens, providing a one dimensional displacement of light passing the device.
4.
The device according to claim 2, wherein the centrally attached prism is a spherical lens, wherein four separate piezo electric elements are arranged in a quadratic pattern around the spherical lens, providing a two dimensional displacement of light passing the device.
5.
The device according to claim 1, wherein the motion detectors are gyroscopic sensors.
6.
The device according to claim 1, wherein a motion detector provides a signal only when the signal level is above a preset threshold level.
7. 5 Device according to claim 1, wherein the signals from the motion detectors are combined with signals from a tracking device providing a projection of an object onto substantially the same location on an image sensor surface, when the device is moved to follow the movements of a fast moving object viewed through the device. o 8.
A device for providing stabilized images in a hand held camera, comprising a flexible body with a light reflecting coating on an outwardly facing surface arranged in between at least one actuator providing a squeezing of the flexible body when applied voltages activates the at least one actuator, wherein the activating voltages alters directions ofs incident light being reflected by the body proportionally to signals provided by motion sensors sensing yawing and pitching movements, respectively, of the camera.
9.
The device according to claim 8, wherein the device comprises side walls bounding a0 cavity filled with polymer on top of a support, wherein a bendable cover is arranged on top of the side walls and the polymer comprising a centrally attached body with a reflecting coating on an outwardly facing side of the body, located in between piezo electric actuators located on top of the cover. S
10.
The device according to claim 9, wherein two separate piezo electric actuators, one on each side of the centrally attached body is providing a one dimensional displacement of incident light being reflected from the device. 0
1 1.
The device according to claim 10, wherein four separate piezo electric actuators are arranged in a quadratic pattern around the centrally attached body providing a two dimensional displacement of incident light being reflected from the device. S
12.
The device according to claim 8, wherein the motion detectors are gyroscopic sensors.
13.
The device according to claim 8, wherein a motion detector provides a signal only when the signal level is above a preset threshold level.
PCT/NO2008/000055 2007-02-12 2008-02-12 A device for providing stabilized images in a hand held camera WO2008100153A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN2008800117906A CN101688976B (en) 2007-02-12 2008-02-12 A device for providing stabilized images in a hand held camera
EP08712670A EP2122406A4 (en) 2007-02-12 2008-02-12 A device for providing stabilized images in a hand held camera
JP2009549024A JP2010518443A (en) 2007-02-12 2008-02-12 A device that provides a stable image with a handheld camera
US12/776,288 US20110158617A1 (en) 2007-02-12 2010-05-07 Device for providing stabilized images in a hand held camera

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
NO20070797 2007-02-12
NO20070797 2007-02-12

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US12526769 A-371-Of-International 2008-02-12
US12/776,288 Continuation US20110158617A1 (en) 2007-02-12 2010-05-07 Device for providing stabilized images in a hand held camera

Publications (2)

Publication Number Publication Date
WO2008100153A1 true WO2008100153A1 (en) 2008-08-21
WO2008100153A8 WO2008100153A8 (en) 2009-07-09

Family

ID=39690301

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/NO2008/000055 WO2008100153A1 (en) 2007-02-12 2008-02-12 A device for providing stabilized images in a hand held camera

Country Status (5)

Country Link
EP (1) EP2122406A4 (en)
JP (1) JP2010518443A (en)
KR (1) KR20100015320A (en)
CN (1) CN101688976B (en)
WO (1) WO2008100153A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8310772B2 (en) 2008-07-11 2012-11-13 Polight As Method and arrangement for reducing thermal effects in compact adjustable optical lenses
NO336140B1 (en) * 2009-09-18 2015-05-26 Sintef Micro optical device actuator
CN105814474A (en) * 2013-12-09 2016-07-27 卡尔蔡司显微镜有限公司 Image capturing device with a moving device for a digital microscope, and digital microscope
EP2783254B1 (en) * 2011-11-23 2017-02-15 Nokia Technologies Oy Optical image stabilization
US9841539B2 (en) 2013-10-08 2017-12-12 Optotune Ag Tunable lens device
WO2019002524A1 (en) 2017-06-30 2019-01-03 Polight As Lens assembly for optical image stabilization and focus adjustment
EA039634B1 (en) * 2017-06-30 2022-02-18 Полайт Аса Lens assembly for optical image stabilization and focus adjustment

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101975893B1 (en) * 2012-03-21 2019-09-10 엘지이노텍 주식회사 Camera Module
CN111033344A (en) 2017-06-30 2020-04-17 珀莱特股份有限公司 Module with multiple cameras for integration in a mobile device
EP3495867A1 (en) * 2017-12-06 2019-06-12 Optotune Consumer AG Tunable prism for optical image stabilization

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4781445A (en) * 1984-02-23 1988-11-01 Canon Kabushiki Kaisha Optical device having positionally changeable optical surfaces and a method of varying an image forming position
US5517238A (en) * 1993-09-22 1996-05-14 Canon Kabushiki Kaisha Camera with image stabilization controlled by focus detection
US6307678B2 (en) * 1998-05-28 2001-10-23 Minolta Co., Ltd. Image shake correction device for optical apparatus and optical apparatus having image shake correction device
US20040017620A1 (en) * 2002-07-24 2004-01-29 Shinji Kaneko Optical unit provided with an actuator
US20040201901A1 (en) * 2003-04-11 2004-10-14 Olympus Optical Co., Ltd. Zoom optical system and imaging apparatus using the same
US20050157409A1 (en) * 1998-06-30 2005-07-21 Olympus Corporation Variable-optical-property element

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3791144B2 (en) * 1997-08-20 2006-06-28 ソニー株式会社 Imaging apparatus and image stabilization method
US6097896A (en) * 1997-08-25 2000-08-01 Nikon Corporation Motion compensation system having motion detection signal correction
JP3466895B2 (en) * 1997-12-12 2003-11-17 キヤノン株式会社 Image stabilizer, imaging device, imaging system, camera unit, and lens unit
JP4041243B2 (en) * 1999-04-12 2008-01-30 花王株式会社 Whitening cosmetics
JP2001359287A (en) * 2000-06-12 2001-12-26 Minolta Co Ltd Surface acoustic wave optical element
US7646544B2 (en) * 2005-05-14 2010-01-12 Batchko Robert G Fluidic optical devices
JP2002214662A (en) * 2001-01-23 2002-07-31 Olympus Optical Co Ltd Shake correcting device for optical device
JP2002228903A (en) * 2001-01-30 2002-08-14 Olympus Optical Co Ltd Optical unit
JP4736399B2 (en) * 2004-10-28 2011-07-27 コニカミノルタオプト株式会社 Drive mechanism and imaging device
JP2006235476A (en) * 2005-02-28 2006-09-07 Fuji Photo Film Co Ltd Optical device, optical unit and imaging apparatus
JP4692027B2 (en) * 2005-03-08 2011-06-01 株式会社ニコン Image blur correction device and camera having the same

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4781445A (en) * 1984-02-23 1988-11-01 Canon Kabushiki Kaisha Optical device having positionally changeable optical surfaces and a method of varying an image forming position
US5517238A (en) * 1993-09-22 1996-05-14 Canon Kabushiki Kaisha Camera with image stabilization controlled by focus detection
US6307678B2 (en) * 1998-05-28 2001-10-23 Minolta Co., Ltd. Image shake correction device for optical apparatus and optical apparatus having image shake correction device
US20050157409A1 (en) * 1998-06-30 2005-07-21 Olympus Corporation Variable-optical-property element
US20040017620A1 (en) * 2002-07-24 2004-01-29 Shinji Kaneko Optical unit provided with an actuator
US20040201901A1 (en) * 2003-04-11 2004-10-14 Olympus Optical Co., Ltd. Zoom optical system and imaging apparatus using the same

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2122406A4 *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8310772B2 (en) 2008-07-11 2012-11-13 Polight As Method and arrangement for reducing thermal effects in compact adjustable optical lenses
NO336140B1 (en) * 2009-09-18 2015-05-26 Sintef Micro optical device actuator
US9250418B2 (en) 2009-09-18 2016-02-02 Sintef Fabry-perot interferometer with piezoelectric actuator contracting in radial direction on membrane
US9329360B2 (en) 2009-09-18 2016-05-03 Sintef Actuator having two piezoelectric elements on a membrane
US9602726B2 (en) 2011-11-23 2017-03-21 Nokia Technologies Oy Optical image stabilization
EP2783254B1 (en) * 2011-11-23 2017-02-15 Nokia Technologies Oy Optical image stabilization
US9841539B2 (en) 2013-10-08 2017-12-12 Optotune Ag Tunable lens device
US10690815B2 (en) 2013-10-08 2020-06-23 Optotune Consumer Ag Tunable lens device
US11500132B2 (en) 2013-10-08 2022-11-15 Optotune Consumer Ag Tunable lens device
CN105814474A (en) * 2013-12-09 2016-07-27 卡尔蔡司显微镜有限公司 Image capturing device with a moving device for a digital microscope, and digital microscope
WO2019002524A1 (en) 2017-06-30 2019-01-03 Polight As Lens assembly for optical image stabilization and focus adjustment
US11231528B2 (en) 2017-06-30 2022-01-25 Polight Asa Lens assembly for optical image stabilization and focus adjustment
EA039634B1 (en) * 2017-06-30 2022-02-18 Полайт Аса Lens assembly for optical image stabilization and focus adjustment
US11693159B2 (en) * 2017-06-30 2023-07-04 Polight Asa Adaptive lens

Also Published As

Publication number Publication date
KR20100015320A (en) 2010-02-12
CN101688976A (en) 2010-03-31
EP2122406A4 (en) 2012-02-08
EP2122406A1 (en) 2009-11-25
WO2008100153A8 (en) 2009-07-09
CN101688976B (en) 2012-07-18
JP2010518443A (en) 2010-05-27

Similar Documents

Publication Publication Date Title
US20110158617A1 (en) Device for providing stabilized images in a hand held camera
WO2008100153A1 (en) A device for providing stabilized images in a hand held camera
US7656428B2 (en) Imaging device employing optical motion sensor as gyroscope
CN110832384B (en) Camera module with automatic focusing and optical image stabilizing functions
US7430366B2 (en) Image capture device
US8289406B2 (en) Image stabilization device using image analysis to control movement of an image recording sensor
CN101782710B (en) Shake correction unit and imaging apparatus
JP2004219930A (en) Camera with camera-shake correction function
JP7516623B2 (en) Celestial body tracking device and celestial body tracking method
JP2005321797A (en) Image-stabilization system and method
TWI483055B (en) Camera module
EP2974271B1 (en) Anti-shake correction system for curved optical sensor
JP2007116679A (en) Imaging device with blur reduction system
CN110933266B (en) Image pickup apparatus, method and adjustment element
JP4973219B2 (en) Optical equipment
JP6250446B2 (en) Image processing system, image processing apparatus, image processing method, and program
US8817127B2 (en) Image correction device for image capture device and integrated circuit for image correction device
JP7242320B2 (en) IMAGING DEVICE, CONTROL METHOD AND PROGRAM
JP2000069353A (en) Camera-shake detector and camera-shake correction device
JP5957796B2 (en) Blur correction device and optical apparatus
KR20200139484A (en) Camera Actuator and Camera module including the same
US20120075487A1 (en) Image apparatus with motion control
JPH03117278A (en) Image pickup device
JP7308696B2 (en) Image blur correction device, its control method, program, and imaging device provided with image blur correction device
US20230168565A1 (en) Camera actuator and camera device including same

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 200880011790.6

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 08712670

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2009549024

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 1020097019082

Country of ref document: KR

Ref document number: 2008712670

Country of ref document: EP