KR20190101104A - Actuator for camera and apparatus for generating depth image using single camera including the same - Google Patents

Abstract

An actuator for camera of the present invention comprises: a main frame provided with a reflectometer reflecting light in a lens direction of a camera module; a base frame in which the main frame is housed; a driving unit moving the main frame with respect to the base frame according to a driving control signal applied from the outside; and a memory unit storing the driving control signal, position information of the reflectometer moved by the driving control signal, and characteristic information in which shift information for a shift size of an image photographed by the camera module at a corresponding moving position of the reflectometer is interrelated with each other.

Description

ACTUATOR FOR CAMERA AND APPARATUS FOR GENERATING DEPTH IMAGE USING SINGLE CAMERA INCLUDING THE SAME}

The present invention relates to an actuator for a camera and an apparatus for generating a depth image using the same, and more particularly, to generate a depth image using only a single camera or a lens using movement characteristics of a memory unit and a reflectometer storing driving specification information of an actuator. It relates to a camera actuator and a depth image generating device that can be.

With the development of hardware technology and changes in user environment, there are various functions such as auto focus (AF) and image stabilization (OIS) in addition to the basic functions for communication in portable terminals (mobile terminals) such as smartphones. And complex functions are being integrated.

In recent years, by adjusting the size of the focused area and the area of the image being captured, it is possible to sharpen the near part from the camera and to blur the other part. The function of generating depth images reflecting effects such as In Focus for sharply adjusting parts and Pan Focus for sharply adjusting both near and other parts is also implemented.

Depth images are typically taken using a plurality of cameras having a fixed separation distance, and the binocular disparity, convergence angle difference, and distance between the plurality of cameras. It is produced by the method using.

However, such a prior art requires the installation of a plurality of cameras in order to generate binocular parallax and a difference in viewing angle, thereby causing a fundamental problem of increased cost and reduced space utilization. Since it must be installed in a specific location, there is a limit that cannot meet the trend of miniaturization or light weight of the portable terminal.

In addition, since a lens and an image sensor provided in each of the plurality of cameras are generally configured to have different specifications, a difference occurs in the image quality or brightness of each camera image, and such a difference is corrected to generate a depth image. Processing must be additionally implemented, which reduces the efficiency of data processing.

Furthermore, in the prior art, since the separation distance between a plurality of cameras, which is an essential parameter for generating a depth image, is fixed, a depth image that is more efficient by reflecting various image environments such as characteristics of a depth image, a characteristic of a subject, and a surrounding environment There is a limit that cannot be generated.

The present invention was devised to solve the above-mentioned problems in the background as described above, and by obtaining a plurality of images using a single camera by changing the position of a reflectometer for introducing light of a subject to the lens side and using the depth image. A camera actuator and a depth image arranging device that can generate a higher quality depth image by organically utilizing the position change of the reflectometer and other parameters according to the position change as well as effectively generating the light. The purpose is to provide.

Other objects and advantages of the present invention can be understood by the following description, and will be more clearly understood by the embodiments of the present invention. In addition, the objects and advantages of the present invention can be realized by the configuration shown in the claims and combinations thereof.

The actuator for the camera of the present invention for achieving the above object comprises a main frame having a reflectometer for reflecting light toward the lens of the camera module; A base frame in which the main frame is accommodated; A driving unit which moves the main frame with respect to the base frame according to a driving control signal applied from the outside; And the shift information on the shift size of the photographed image photographed by the camera module at the driving control signal, the position information of the reflectometer moved by the driving control signal, and the corresponding moving position of the reflecting system. It may be configured to include a memory unit in which information is stored.

In addition, the main frame of the present invention is a groove line is formed, the base frame of the present invention is formed with a guide line corresponding to the groove line, and further comprises one or more balls located between the groove line and the guide line Can be configured.

Furthermore, the groove part line of the present invention has a rounded shape, and the driving part of the present invention rotates the main frame with respect to the base frame along a path corresponding to the groove part line, and in this case, the position of the reflectometer The information may be information about the magnitude and direction of the angle at which the reflectometer is rotated relative to the reference position.

According to an embodiment, the driving unit of the present invention is a drive magnet provided in the main frame; And a driving coil for generating an electromagnetic force on the driving magnet to move the main frame with respect to the base frame.

The actuator for the camera of the present invention may further include a hall sensor sensing the position of the reflectometer, and in this case, the characteristic information may be configured such that a reference sensing value output from the hall sensor at the corresponding position of the reflectometer is further linked. Can be.

The memory unit of the present invention may be mounted on a circuit board in the form of interfacing with the outside.

On the other hand, the depth image generating apparatus using a single camera of the present invention is the main frame having a reflectometer for reflecting light toward the lens of the camera module, the base frame is accommodated, according to the drive control signal applied from the outside A driving unit for moving the main frame with respect to a base frame, the driving control signal, position information of the reflectometer moved by the driving control signal, and a photographed image photographed by the camera module at a corresponding movement position of the reflectometer An actuator including a memory unit in which characteristic information, in which shift information on a shift size of the shift information is interrelated, is stored; A driving control unit for outputting the driving control signal for controlling the reflection system to move to a plurality of positions by using the characteristic information stored in the memory unit; A photographing controller configured to control photographing of the camera module at each point of time when the reflectometer is moved to the plurality of positions; And a data processor configured to perform data processing processing on a plurality of images captured by the camera module.

According to an embodiment, the data processor of the present invention may be configured to generate a depth image using the characteristic information stored in the memory unit.

In addition, the drive control unit of the present invention may be configured to output a drive control signal for controlling the movement of the reflectometer to a reference position and two symmetrical positions symmetrical with respect to the reference position, in this case, the photographing of the present invention The controller may be configured to control the photographing of the camera module to be performed at each time point when the reflectometer is moved to the reference position and the symmetric position.

In other embodiments, the actuator of the present invention may further comprise a Hall sensor for sensing the position of the reflectometer, in which case the characteristic information of the present invention is the Hall sensor at the corresponding position of the reflectometer. The reference sensing value outputted by the controller is further linked, and the photographing controller of the present invention controls the photographing of the camera module to be performed at each time point when the reflectometer is moved to the plurality of positions, but the sensing currently output by the hall sensor. When the value corresponds to the reference sensing value stored in the memory unit, the camera module may control to photograph the camera module.

According to an exemplary embodiment of the present invention, data in which the characteristics information on the movement of the reflectometer and other parameters in association with the characteristics information are organically combined is stored in the memory unit and the data stored in the memory unit is used. By moving the reflectometer and utilizing a plurality of images respectively photographed according to the movement, the depth image can be effectively generated with a single camera or a lens.

As described above, the present invention can generate a depth image using only a single camera, thereby further improving cost efficiency and space utilization of the mobile terminal, and providing an effect more suited to the miniaturization and light weight of the mobile terminal. .

In addition, since the memory unit of the present invention is mounted on the circuit board in the form of interfacing with the outside, processing using the spec information stored in the memory unit can be implemented more easily. The efficiency can be further improved.

Furthermore, since the present invention is configured to store the characteristic information broken down by distance from the subject in the memory unit, the binocular disparity and gaze difference optimized for the distance to the subject may be reflected in the processing for generating the actual depth image by reflecting the information. This allows for higher quality depth images.

The following drawings, which are attached to this specification, illustrate exemplary embodiments of the present invention, and together with the detailed description of the present invention, which serve to more effectively understand the technical spirit of the present invention, the present invention is described in these drawings. It should not be construed as limited to matters.
1 is an exploded coupling view showing a detailed configuration of an actuator for a camera according to an embodiment of the present invention,
2 is a view showing a coupling relationship between a mainframe and a baseframe shown in FIG. 1;
3 is a view illustrating a coupling relationship between a support frame and a middle frame shown in FIG. 1;
4 is a diagram schematically showing a processing for generating characteristic information of the present invention;
5 is a flowchart showing processing for generating characteristic information of the present invention;
6 is a view showing a preferred example of the characteristic information of the present invention,
7 is a block diagram showing a detailed configuration of a depth image generating apparatus according to an embodiment of the present invention;
8 is a flowchart illustrating a process of generating a depth image in the depth image generating apparatus according to the present invention;
FIG. 9 is a diagram illustrating a Y-axis movement of reflected light implemented by moving a reflectometer (middle frame) with respect to a base frame;
FIG. 10 is a diagram illustrating an X-axis movement of reflected light implemented by moving a reflectometer (support frame) with respect to a middle frame.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Prior to this, terms or words used in the present specification and claims should not be construed as being limited to the common or dictionary meanings, and the inventors should properly explain the concept of terms in order to best explain their own invention. Based on the principle that can be defined, it should be interpreted as meaning and concept corresponding to the technical idea of the present invention.

Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiments of the present invention and do not represent all of the technical idea of the present invention, various equivalents that may be substituted for them at the time of the present application It should be understood that there may be water and variations.

1 is an exploded coupling view showing a detailed configuration of a camera actuator (hereinafter referred to as an 'actuator') 100 according to an embodiment of the present invention, Figure 2 is a main frame 125 shown in FIG. ) Is a view showing a coupling relationship between the base frame 140, Figure 3 is a view showing a coupling relationship between the support frame 120 and the middle frame 130 shown in Figure 1, Figure 9 is a base frame ( FIG. 10 is a view illustrating movement of the reflected light in the Y-axis direction by moving the reflectometer 110 with reference to 140. FIG. 10 is a view illustrating the reflected light implemented by moving the reflectometer 110 with respect to the middle frame 130. It is a figure which shows the movement of an X-axis direction.

Hereinafter, with reference to FIGS. 1 to 3, 9 and 10 will be described in detail the detailed configuration of the actuator 100 and the drive relationship of each configuration.

The actuator for a camera (hereinafter referred to as 'actuator') 100 of the present invention stores characteristic information on movement of the reflectometer 110 in the memory unit 260 and utilizes the information to reflect the reflectometer 110. It corresponds to a device for moving a plurality of images having a binocular parallax and a difference in viewing angle to be photographed by the camera module.

As shown in FIG. 1, the actuator 100 of the present invention may include a main frame 125, a base frame 140, a driver 200, a memory unit 260, and the like.

When the light of the subject is introduced into the actuator 100 of the present invention through the opening formed in the case 15 through the Z1 path from the outside, the light introduced into the interior is routed by the reflectometer 110 of the present invention. Changed (refractive to reflective, etc.) (Z path) is introduced into the lens (not shown) or the image pickup device (not shown) of the camera module (not shown) positioned below the driving unit 200 of the present invention (Z-axis reference) .

The reflectometer 110 for changing the path of the light may be one selected from a mirror or a prism or a combination thereof, using various members capable of changing the light flowing from the outside in the direction of the optical axis. It can be implemented in various ways such as injection, cutting. The mirror or prism is preferably implemented with a glass material to improve optical performance.

 Reflector 110 of the present invention is installed in the direction toward the opening direction of the case 15, that is, the Y-axis direction front surface in which light is introduced from the actuator 100 based on the example shown in FIG.

In the following description, an axis corresponding to the vertical axis direction of the lens, that is, a path through which light enters the lens, is defined as an optical axis (Z axis), and two axes on a plane perpendicular to the optical axis (Z axis) are defined as the X axis and the Y axis. .

The reflectometer 110 is provided in the main frame 125 that physically supports the reflectometer 110, as shown in Figure 1, etc., the main frame 125 of the present invention in a state where the reflectometer 110 is installed It is accommodated in the base frame 140 of the present invention.

The main frame 125 of the present invention is accommodated in the base frame 140 of the present invention so as to be moved or rotated, the reflectometer installed in the main frame 125 as the main frame 125 is moved or rotated ( 110, also with the physical movement.

Movement or rotational movement of the reflectometer 110, that is, the main frame 125 may be performed by the coupling relationship between the main frame 125 and the base frame 140 or the groove line lines 160-1 and 160-2 and guides described below. It may be implemented in various directions depending on the shape of the line (170-1, 170-2).

Hereinafter, an embodiment in which the reflectometer 110 of the present invention moves or rotates clockwise or counterclockwise with respect to the YZ plane of FIG. 1 will be described first, and then clockwise or anticlockwise based on the XY plane of FIG. 1. An embodiment of moving or rotating in a clockwise direction will be described later.

When the reflectometer 110 moves or rotates clockwise or counterclockwise with respect to the YZ plane, the light reflected by the reflectometer 110 is reflected in the + Y direction or the -Y direction as shown in FIG. 9. It is moved to enter the image pickup device or the lens.

Therefore, hereinafter, the direction in which the main frame 125 moves or rotates will be replaced with the direction in which the light (reflected light) of the subject moves relative to the image pickup device or the lens in order to increase the convenience of understanding.

That is, the direction in which the main frame 125 moves clockwise or counterclockwise with respect to the YZ plane is referred to as a positive or negative direction in the Y-axis direction (first direction).

The driving unit 200 of the present invention provides a driving force for moving the main frame 125 in the Y-axis direction (first direction) perpendicular to the optical axis based on the base frame 140 according to a driving control signal applied from the outside. Corresponds to the configuration.

Configurations that provide driving force to the mainframe 125 can be used for various applications such as shape memory alloys (SMA), piezoelectric elements, and micro-electromechanical systems (MEMS), but do not include power consumption, low noise, In consideration of space utilization, the first driving coil 150-1 and the first driving magnet 210 that use electromagnetic force as a driving force, as illustrated in the drawing, are preferably implemented.

In order to drive the movement of the main frame 125, a first driving magnet 210 (see FIG. 2) is provided in the main frame 125, and the first driving coil for generating electromagnetic force in the first driving magnet 210. 150-1 is disposed on the circuit board 10 coupled to the base frame 140 as illustrated in FIG. 1.

As such, when the first driving coil 150-1 and the first driving magnet 210 are used as driving sources for moving the main frame 125 in the Y-axis direction, a power source corresponding to the driving control signal is supplied to the circuit board ( When the first driving coil 150-1 is applied to the first driving coil 150-1 through 10), the first driving coil 150-1 generates an electromagnetic force on the first driving magnet 210, and the main frame 125 is driven by the electromagnetic force. The base frame 140 is moved in the Y-axis direction.

As described above, the main frame 125 of the present invention is configured to move or rotate in the Y-axis direction with respect to the base frame 140. For this, the main frame 125 has a main frame as shown in FIG. 2. The first groove part line 160-1 may be formed to guide the movement of the frame 125 in the Y-axis direction.

According to an embodiment, the movement of the reflectometer 110, that is, the mainframe 125 to which the reflectometer 110 is coupled, may be configured to be a rotational movement. For this purpose, a first formed in the mainframe 125 may be used. Groove line (160-1) is a rounded shape as shown in the figure is preferably configured to have an optimized curvature according to the rotational movement, to guide the movement in the Y-axis direction of the main frame (125) For this reason, it is preferable to have a shape extending in the Z-axis longitudinal direction.

In the base frame 140 of the present invention which physically supports the rotation of the main frame 125, the first groove part line is positioned at a position corresponding to the first groove part line 160-1 as shown in FIG. 2. A first guide line 170-1 having a shape corresponding to 160-1, that is, a rounded shape and extending in the Z-axis length direction may be formed.

The main frame 125 of the present invention is rotated along the path corresponding to the first groove line (160-1) having a rounded shape or the first guide line (170-1) having a corresponding shape as described above Done.

According to an embodiment, when the base frame 140 is disposed on the upper portion of the main frame 125 or the frame structure bent vertically, the first groove portion line 160-1 is formed on the upper portion of the main frame 125. It may be provided in.

The first groove line 160-1 and the first guide line 170-1 of the present invention may be arranged in two rows in parallel to each other so that shaking or play of the main frame 125 can be minimized. desirable.

According to an embodiment, as shown in FIG. 2, one or more first balls 240-1 may be located between the first groove line 160-1 and the first guide line 170-1. Through the arrangement of the first ball 240-1, the main frame 125 and the base frame 140 of the present invention can maintain a predetermined spaced apart state, and are point-contacted by balls. The main frame 125 of the present invention can be moved in the Y-axis direction with respect to the base frame 140 with the friction force minimized by).

As illustrated in FIG. 2 to maintain the separation between the main frame 125 and the base frame 140 by an appropriate distance, the first ball 240-1 may be formed in the first groove line line 160-1 or the first groove line 160-1. The guide line 170-1 may be provided in a shape in which a predetermined portion is accommodated.

As shown in FIG. 2, the base frame 140 of the present invention may be provided with a first yoke 180 such as a metal material having magnetic properties at a position facing the first driving magnet 210.

Since the first yoke 180 generates the attraction force with the first driving magnet 210 provided in the main frame 125, the main frame 125 is pulled toward the base frame 140. The 125 may be continuously point-contacted with the first ball 240-1 and the main frame 125 may be effectively prevented from escaping to the outside.

Meanwhile, the actuator 100 of the present invention may be configured to move or rotate the reflectometer 110 not only in the Y-axis direction but also in the X-axis direction perpendicular thereto.

The actuator 100 of the present invention physically dualizes the mainframe 125, moves one of the reflectometers 110 in the X-axis direction by using one of the dualized configurations as a relative moving body and using the other as a relative fixed body. It is configured to.

Specifically, the main frame 125 of the present invention includes a middle frame 130 functioning as a relative stationary body and a support frame 120 functioning as a relative moving body, the actuator 100 of the present invention is a middle frame ( 130, the support frame 120 is moved or rotated in the X-axis direction to implement the movement of the reflectometer 110 with respect to the X-axis direction.

Reflector 110 of the present invention is installed in the support frame 120 for physically supporting the reflectometer 110, as shown in Figure 1, etc., the first drive magnet 210 of the present invention described above is the middle frame 130 is provided.

The support frame 120 of the present invention is installed on the middle frame 130 of the present invention so as to be able to move or rotate in a clockwise or counterclockwise direction based on the XY plane of FIG. 3, and the support frame 120 is moved. As the rotational movement of the reflectometer 110 installed in the support frame 120, the physical movement is also accompanied.

When the reflectometer 110 moves or rotates clockwise or counterclockwise with respect to the XY plane, the light reflected by the reflectometer 110 is reflected in the + X direction or the -X direction as shown in FIG. 10. It is deflected to enter the image pickup device or the lens.

Therefore, hereinafter, the direction in which the support frame 120 moves or rotates will be replaced with the direction in which the light of the subject moves based on the image pickup device or the lens in order to increase the convenience of understanding. That is, the direction in which the support frame 120 moves clockwise or counterclockwise with respect to the XY plane is referred to as a positive or negative direction in the X-axis direction (second direction).

In order to drive the rotational movement of the support frame 120, the second drive magnet 210-2 is provided in the middle frame 130, the second drive coil for generating an electromagnetic force on the second drive magnet (210-2) 150-2 is mounted on the circuit board 10 coupled to the base frame 140 as illustrated in FIG.

Since the support frame 120 of the present invention has a structure capable of independent rotational movement based on the middle frame 130, even if the middle frame 130 is rotated in the Y-axis direction with respect to the base frame 140, When electromagnetic force is generated in the driving coil 150-2, the support frame 120 of the present invention may perform independent rotational movement in the X-axis direction.

As shown in FIG. 3, a second groove part line 160-2 may be formed in the support frame 120 of the present invention to more stably guide the X-axis movement of the support frame 120 itself. The middle frame 130 may be provided with a second guide line 170-2 corresponding to the second groove line 160-2.

The second groove portion line 160-2 and the second guide line 170-2 have a shape corresponding to each other, that is, a shape extending in the X-axis length direction and are rounded to effectively support the rotational movement of the support frame 120. It is preferably configured to have a true shape to an optimized and mutually corresponding curvature.

The second guideline as shown in FIG. 3 and the like in order for the middle frame 130 to support the rotational movement of the support frame 120 and to independently rotate the movement relative to the base frame 140. The 170-2 is preferably provided on a surface different from the surface on which the first driving magnet 210 is provided in the middle frame 130.

In a corresponding aspect, the first groove line 160-1, which guides the middle frame 130 to be rotated relative to the base frame 140, is also provided with the second guide line 170-2. It is preferable to be provided in the surface different from a surface.

That is, as illustrated in the accompanying drawings, the second guide line 170-2 is formed at one side of the middle frame 130, and the first groove part line 160-1 is the second guide line 170. -2) is preferably formed on the other side, which is a region not provided.

In addition, the second groove line line 160-2 and the middle provided in the support frame 120 so that the X-axis movement of the support frame 120 and the Y-axis movement of the middle frame 130 can be implemented independently. The first groove part line 160-1 provided in the frame 130 is preferably formed in a direction perpendicular to each other.

According to the embodiment, the second ball 240-2 is the second groove portion line (160-2) and the second guide line (2) so that the movement in the X-axis direction of the support frame 120 can be implemented more flexibly and precisely 170-2).

In addition, the support frame 120 is always point-contacted with the second ball 240-2 by the attraction force generated between the second driving magnet 210-2 and the support frame 120 The second yoke 190, which is a magnetic material, may be provided in the middle frame 130 to effectively prevent the deviating to the outside.

As described above, an embodiment of the present invention has been described with reference to an example in which the support frame 120 is rotated in the X-axis direction and the middle frame 130 (the main frame 125) is rotated in the Y-axis direction. Therefore, if the movement in the direction perpendicular to each other to rotate the support frame 120 in the Y-axis direction, the middle frame 130 (main frame 125) in the form of the rotational movement in the X-axis direction is of course possible enough.

On the other hand, as described above, the actuator 100 of the present invention stores the characteristic information on the movement of the reflectometer 110 in the memory unit 260, by using the information to move the reflectometer 110 binocular parallax And a plurality of images having a difference in viewing angles from the camera module.

To this end, the memory unit 260 of the present invention stores characteristic information in which the driving control signal, the position information of the reflectometer 110, the shift information, and the reference sensing value are interrelated with each other.

The driving control signal stored in the memory unit 260 is a control signal applied to the driving unit 200 to control the driving force to be generated in the driving unit 200. The driving unit 200 of the present invention includes a driving magnet and a driving coil. In the configured embodiment, the drive control signal may be a signal system that contains information on the direction and magnitude of the current applied to the drive coil to generate an electromagnetic force (drive force).

When the driving unit 200 provides a driving force, the main frame 125 (specifically, the reflectometer 110 installed in the main frame 125) of the present invention moves or rotates in the size and direction corresponding to the driving control signal. do. As such, when the reflectometer 110 moves according to the driving control signal, the position information of the reflectometer 110 according to the driving control signal is generated, and the generated position information is associated with the driving control signal.

In the above-described embodiment of rotating the reflectometer 110, the position information of the reflectometer 110 may be formed of information about the size and direction of the angle at which the reflectometer 110 is rotated relative to the reference position. . The reference position may be an initial position at which the driving control signal is not applied, as well as various positions for checking the magnitude of the angle at which the reflectometer 110 is rotated.

When the reflectometer 110 is moved or rotated, the angle or position at which the light (reflected light) reflected by the reflectometer 110 is incident toward the lens of the camera module (not shown) is changed, so the image photographed by the camera module In addition, it moves (shifts) in response to a change in the position of the reflected light.

As the reflector 110 moves as described above, when the image photographed by the camera module moves, the photographed image shifts based on the image generated when the reflectometer 110 is positioned at the reference position. Generating the shift information, generating the characteristic information by linking the generated shift information with the position information of the corresponding reflectometer 110, and storing the generated characteristic information in the memory unit 260.

According to an embodiment, the circuit board 10 uses a hall effect to determine the position of the first driving magnet 210 or the second driving magnet 210-2 based on the first direction or the second direction. The first hall sensor 250-1 and the second hall sensor 250-2 may be provided to sense the position of the reflectometer 110 by sensing.

As described above, in the case where the hall sensors 250-1 and 250-2 are provided, a reference sensing value that senses the position of the reflectometer 110 to which the hall sensors 250-1 and 250-2 are moved is output. In response, the output reference sensing value is further stored in the memory unit 260 in association with the characteristic information.

The memory unit 260 of the present invention may be implemented in the form of a hardware chip such as a read only memory (ROM) capable of reading the written information, an electrically erasable programmable read only memory (EEPROM), or the like, and the system on Chip) can also be implemented as an integrated form of AF or OIS driver ICs.

In addition, in order to easily access information stored in the memory unit 260 in a process of generating a plurality of images, a depth image, and the like, the memory unit 260 of the present invention uses the interface unit 11 formed on the circuit board 10. It is preferable to be mounted on the circuit board 10 in a form that can interface with the outside through.

The memory unit 260 of the present invention may be provided in a direction facing the first driving magnet 210 as illustrated in FIGS. 1 and 2, as well as the space utilization and the arrangement relationship with other components. In consideration of the present invention, the circuit board 10 may be provided at various positions such as a side portion of the circuit board 10.

4 is a diagram schematically showing processing for generating characteristic information of the present invention, FIG. 5 is a flowchart showing processing for generating characteristic information of the present invention, and FIG. 6 is a preferred embodiment of the characteristic information of the present invention. An example is shown.

Hereinafter, a process of generating characteristic information of the present invention will be described in detail with reference to FIGS. 4 to 6, and an example of characteristic information generated through this processing and stored in the memory unit 260 will be described.

First, set n (n is a natural number of 1 or more) positions where the subject P will be placed for shooting, and position the subject P at k (k is a natural number of 1 or more, default = 1). S510).

After the position setting of the subject P is completed, different driving control signals are applied to the driving unit 200 so that the rotational movement of the reflectometer 110 is implemented at various angles (S520). The reflectometer 110 is rotated so as to correspond to the direction.

For example, when a driving control signal having a specific direction value and a specific magnitude value is applied to the driving unit 200, as shown in FIG. 4, the reflectometer 110 has a direction value of the driving control signal based on a reference position. The counterclockwise rotation is moved by an angle θ1 corresponding to the magnitude value of the driving control signal.

In addition, when a driving control signal having a magnitude value relatively larger in the opposite direction is applied to the driving unit 200, the reflectometer 110 is rotated by a θ2 angle that is relatively larger than θ1 angle in the clockwise direction with respect to the reference position. Done.

According to each driving control signal, the position information of the reflectometer 110, which is an angle (θ1, θ2, etc.) in which the reflectometer 110 is rotated and measured, is measured (S530). In addition, the reference sensing value which is an output value of the Hall sensors 250-1 and 250-2 with respect to the angle (θ1, θ2, etc.) in which the reflectometer 110 rotates is measured (S530).

When the reflectometer 110 is rotated and moved, the light of the subject P flowing into the reflectometer 110 is angled θ1 or θ2 with respect to the direction in which the reflector 110 is incident on the image pickup device 53 at a reference position of the reflectometer 110. As it is reflected at a spaced apart angle, it passes through the lens or the lens module 55 and enters the imaging device 53 such as a CCD.

The light flowing into the image pickup device 53 at an angle of θ1 or θ2 is spaced apart by d1 or d2 based on the position at which the light reflected from the reference position of the reflectometer 110 is incident on the image pickup device 53. It enters the position where it was.

Therefore, as shown in FIG. 4, in each case, the image photographed by the camera module is shifted by d1 or d2. As described above, when the image photographed according to the rotational movement of the reflectometer 110 moves by d1 or d2, image shift information, which is the value of the photographed image, is measured (S530). The image shift information may be generated in units of distance based on the moving distance of the captured image based on the image of the reference position or in units of pixels based on the imaging resolution.

The k-th characteristic information is generated by interworking the applied driving control signal with the position information of the reflectometer 110, the hall sensor output value (reference sensing value), and the image shift information measured through the aforementioned processing (S540).

An example of the characteristic information generated based on the k-th position is illustrated in FIG. 6. The characteristic information includes a drive control signal for driving the reflectometer 110, a physical characteristic value (position information) of the reflectometer 110 that is substantially moved or rotated by the respective drive control signals, and the movement or rotational movement of the reflectometer. This corresponds to information associated with image shift information on how much an image generated by an image pickup device such as a CCD moves based on a reference position.

Therefore, the characteristic information to which such information is linked includes the specification of the camera module 50 such as the focal length or angle of view of the lens, the position or resolution of the Hall sensor, the physical characteristics of the reflectometer 110, and the reflectometer 100. Various examples are possible depending on the configuration of the driving unit and the electrical or mechanical characteristics of the configuration.

As shown in FIG. 6, the applied driving control signal may be expressed based on size and direction, and the position information of the reflectometer 110, which is information about a position at which the reflectometer 110 moves or rotates, may be represented. Rotation direction and angle information) are stored in association with the applied drive control signal.

In addition, the image shift information, which is information about the movement size of the image photographed by the camera module, is stored in association with the position information of the reflectometer 110, and the reference of measuring the position of the moved reflectometer 110 using a hall sensor The sensing value may be stored in association with the position information of the reflectometer 110.

When the generation of the characteristic information based on the k-th position is completed, it is determined whether the generation of the characteristic information for the set n positions is completed (S560). If there is a position where the generation of the characteristic information is required, the object S is moved to the next position and the above-described processing is performed to generate the characteristic information based on the position.

When such processing is repeatedly performed to generate the characteristic information based on all positions (n positions), the characteristic information at each generated position is generated in a predetermined DB structure and stored in the memory unit 260 of the present invention. (S570).

As the size of n increases, the characteristic information can be generated for each of the more detailed positions. Therefore, the characteristic information available in the processing for generating the depth image is more precise, so that the characteristic information can be more accurately reflected in the processing for generating the actual depth image. Since a higher quality depth image can be generated, it is preferable that the divided position n is set to have a sufficiently large size.

However, in consideration of the storage capacity of the memory unit 260 and the simplification of the processing for selecting the optimized characteristic information, the number n of the characteristic information stored in the memory unit 260 is set to an appropriate size and the data interpolation method is performed. Depth image generation processing may be implemented through the estimated data calculated using the < RTI ID = 0.0 >

As described above, the memory unit 260 of the present invention stores characteristic information subdivided according to the position of the subject as well as the rotation angle of the reflectometer 110, and thus is optimized for the distance to the subject for processing to generate an actual depth image. The binocular disparity and the difference in the viewing angle can be reflected, and thus a higher quality depth image can be generated.

FIG. 7 is a block diagram illustrating a detailed configuration of a depth image generating apparatus 300 (hereinafter referred to as a 'generating apparatus') according to an exemplary embodiment of the present invention, and FIG. 8 is a generating apparatus 300 according to the present invention. ) Is a flowchart illustrating a process of generating a depth image.

Hereinafter, a detailed configuration of the generating apparatus 300 and the process of generating a depth image through the generating apparatus 300 according to the present invention will be described in detail with reference to FIGS. 7 and 8.

The generating device 300 of the present invention drives the actuator 100 and the camera module (lens, shutter, CCD, etc.) 50 of the present invention to generate a plurality of images, and processes the data for the plurality of images. Corresponds to an apparatus for generating a panorama image, a depth image, and the like.

As shown in FIG. 7, the generating apparatus 300 according to the present invention includes a camera module 50, an actuator 100, a driving controller 310, a photographing controller 320, and a data processor 330. Can be.

Prior to the detailed description of the present invention, the configuration of the driving control unit 310, the imaging control unit 320 and the data processing unit 330 of the present invention shown in Figure 7 is divided into logically divided components rather than physically divided components It must be understood.

That is, since each configuration corresponds to a logical component for realizing the technical idea of the present invention, even if each component is integrated or separated, if the function performed by the logical configuration of the present invention can be realized, It should be construed that it is within the scope, and that components that perform the same or similar functions are to be interpreted as being within the scope of the present invention regardless of whether their names are consistent.

When the depth image generation signal is received (S810), the driving controller 310 of the present invention outputs a driving control signal (S820, S850) so that the reflector 110 is driven by the driving unit 200 provided in the actuator 100. Control to move to a plurality of positions.

If the reflectometer 110 can be moved to a plurality of positions, the method of outputting the driving control signal by the driving controller 310 of the present invention may be implemented using various methods. Hereinafter, the driving control unit 310 will be described with reference to an embodiment of sequentially outputting a driving control signal.

Processing in which the drive control unit 310 outputs a drive control signal is implemented using the characteristic information stored in the memory unit 260. In detail, the driving controller 310 selects the shift information optimized for generating a depth image of the subject in consideration of the distance from the subject, the specification of the camera module, the focal length of the lens, and the like among the driving control signals included in the characteristic information. The driving control signal associated with this is output (S820).

When the first driving control signal is output (S820), the reflectometer 110 is moved to a position corresponding to the first driving control signal, and the imaging control unit 320 of the present invention has the reflectometer 110 at the first position. The camera module 50 is controlled to take a picture of the camera module 50 at the time point at which it is moved (S840).

According to the exemplary embodiment, the image capturing controller 320 of the present invention corresponds to a reference sensing value stored in the memory unit 260 by the sensing values output by the hall sensors 250-1 and 250-2 provided in the actuator 100. In operation S830, imaging is performed at the first position only when the sensing values output by the hall sensors 250-1 and 250-2 correspond to the reference sensing values stored in the memory unit 260. It may be controlled to lose (S840).

When the image is taken at the first position, the driving controller 310 of the present invention controls the reflectometer 110 to move to the second position using the characteristic information stored in the memory unit 260 as in the above-described processing. The second drive control signal is output (S850).

The photographing controller 320 of the present invention controls the photographing of the camera module 50 to be performed at the time when the reflectometer 110 moves to the second position (S870), or the hall sensors 250-1 and 250-2. It is determined whether the sensed value outputted by the controller corresponds to the reference sensed value stored in the memory unit 260 (S860), and control is performed so that photographing is performed only in this case (S870).

On the other hand, the processing in which the driving controller 310 controls the movement of the reflector 110 and the photographing controller 320 controls the photographing of the camera module 50 to be taken is performed by the first reflector 110 as described above. In addition to the method of moving to the position and the second position and the photographing of the camera module 50 in each position can be implemented in various ways.

For example, the driving controller 310 controls the movement of the reflectometer 110 to move to a reference position corresponding to the initial position of the reflectometer 110 and two symmetric positions that are symmetrical with respect to the reference position. The photographing controller 320 may be implemented by controlling the photographing of the camera module 50 at each time point when the reflectometer 110 moves to the reference position and the symmetric position.

Since the initial position of the reflectometer 110 corresponds to the position at which the reflectometer 110 is not moved because the driving force is not applied to the reflectometer 110, the drive control signal for moving the reflectometer 110 to the reference position is shown in FIG. Means a drive control signal corresponding to 0 된 illustrated in 6.

When a plurality of images are photographed by the camera module 50 by such processing, the data processor 330 of the present invention performs data processing processing on the plurality of photographed images.

The data processing processing performed by the data processor 330 of the present invention may be processing for generating a motion image, a 3D image, a panorama image, a depth image, or the like, and may be a process for measuring a distance from a subject. Hereinafter, the processing of generating the depth image and the processing of generating the panorama image among the various processing performed by the data processor 330 of the present invention will be described.

In order to generate a depth image, the data processor 330 of the present invention first sets a processing area that coordinates a plurality of images and an image area (region of interest) to be clearly processed according to a user's request signal from the plurality of images. Processing is performed (S841, S871)

After the image coordinate processing and the ROI setting processing are completed, the camera module 50 drives the AF function based on the set ROI (S843, S873) to perform image data processing clearly from a plurality of images (interest region). Processing is performed to differentially process an image area to be processed to be blurred and out of focus, and a still image is obtained from a plurality of images in which such processing is completed.

When a still image is acquired, the data processor 330 of the present invention detects a feature point from each of the obtained plurality of still images (S845 and S875), and performs processing to match the feature points of the plurality of still images (S880). .

According to an embodiment, in order to further increase the quality of the acquired still image to generate a more accurate depth image, the data processor 330 of the present invention may perform image distortion improvement processing on the obtained plurality of still images ( S845, S875).

As described above, since the characteristic information of the present invention is stored in association with information about the rotation angle of the reflectometer 110, image shift information for each rotation angle, pixel movement information, and the like, the rotation angle information and the corresponding rotation angle are stored. When the image shift information is used as a function, a parameter corresponding to distance information between a plurality of cameras, which is a parameter required by a conventional method of generating a depth image using a plurality of cameras, may be generated.

Therefore, it is possible to generate a depth image by applying a conventional depth image generation method, which is generated through relative three-dimensional position values such as distance information between a plurality of cameras, a focal length of a lens, an ROI or a feature pixel in an image, and the like. do.

In detail, the data processor 330 of the present invention performs triangular function, inverse trigonometric function, and the like on a plurality of acquired images (matched feature points), position information of the reflectometer 110 included in the characteristic information, image shift information, and the like. Processing to generate a depth image by calculating a distance between the subject and the camera module 50, a distance between the subjects, and the like by applying the same or performing a geometric operation (S890).

According to an embodiment, the data processor 330 of the present invention may perform a process of generating a panorama image by connecting a plurality of images based on regions overlapping in the plurality of images (S890).

As described above, since the generating device 300 of the present invention is configured to generate a panoramara image or a depth image using a single camera module 50, the space utilization is further improved as compared with the conventional technology using a plurality of cameras. Of course, it is possible to provide an effect more suited to the miniaturization and weight reduction that the mobile terminal is directed.

Although the present invention has been described above by means of limited embodiments and drawings, the present invention is not limited thereto and will be described below by the person skilled in the art to which the present invention pertains. Of course, various modifications and variations are possible within the scope of the claims.

In the above description of the present invention, modifiers such as first, second, sub, and the like are merely terms of a tool concept used to relatively distinguish the components from each other, and thus indicate a specific order, priority, and the like. It should not be interpreted to be a term used for the purpose.

The accompanying drawings for the purpose of describing the present invention and the embodiments thereof may be shown in somewhat exaggerated form in order to emphasize or highlight the technical contents of the present invention. It should be understood that various forms of modification application may be possible at the level of ordinary skill in the art in consideration.

100: actuator
110: reflectometer 120: support frame
125: main frame 130: middle frame
140: base frame 150-1: first drive coil
150-2: second drive coil 160-1: first groove line
160-2: second groove line 170-1: first guide line
170-2: second guideline 180: first yoke
190: second yoke 200: drive unit
210: first driving magnet 210-2: second driving magnet
220: first sub magnet 230: second sub magnet
250-1: first hall sensor 250-2: second hall sensor
260: memory unit 300: depth image generating device
310: driving control unit 320: shooting control unit
330: data processing unit

Claims (10)

A main frame having a reflectometer for reflecting light toward the lens of the camera module;
A base frame in which the main frame is accommodated;
A driving unit which moves the main frame with respect to the base frame according to a driving control signal applied from the outside; And
The characteristic information of the driving control signal, the position information of the reflectometer moved by the driving control signal, and the shift information on the shift size of the photographed image photographed by the camera module at the corresponding moving position of the reflectometer Actuator for a camera, characterized in that it comprises a memory unit is stored. The method of claim 1, wherein the mainframe,
Groove line is formed,
The base frame has a guide line corresponding to the groove portion line,
And at least one ball located between the groove line and the guide line. The method of claim 2, wherein the groove portion line,
Has a rounded shape,
The driving unit rotates the main frame with respect to the base frame along a path corresponding to the groove line,
Position information of the reflectometer is an actuator for a camera, characterized in that the information about the size and direction of the angle the rotation of the reflectometer based on the reference position. The method of claim 1, wherein the driving unit,
A driving magnet provided in the main frame; And
And a driving coil for generating an electromagnetic force in the driving magnet to move the main frame with respect to the base frame. The method of claim 1,
Further comprising a Hall sensor for sensing the position of the reflectometer,
The characteristic information,
And a reference sensing value output from the hall sensor at a corresponding position of the reflectometer. The method of claim 1, wherein the memory unit,
Actuator for a camera, characterized in that mounted on the circuit board in the form capable of interfacing with the outside. A main frame including a main frame reflecting light toward a lens of the camera module, a base frame accommodating the main frame, a driving unit moving the main frame with respect to the base frame according to a driving control signal applied from the outside, and Characteristic information in which the driving control signal, the position information of the reflector moved by the driving control signal, and the shift information on the shift size of the photographed image photographed by the camera module at the corresponding moving position of the reflecting system are mutually correlated An actuator including a memory unit to be stored;
A driving control unit for outputting the driving control signal for controlling the reflection system to move to a plurality of positions by using the characteristic information stored in the memory unit;
A photographing controller configured to control photographing of the camera module at each point of time when the reflectometer is moved to the plurality of positions; And
And a data processor configured to perform data processing processing on a plurality of images captured by the camera module. The method of claim 7, wherein the data processing unit,
Depth image generation apparatus using a single camera, characterized in that for generating a depth image using the characteristic information stored in the memory unit. The method of claim 7, wherein the drive control unit,
Outputs a driving control signal for controlling the reflection system to move to a reference position and two symmetric positions symmetrical with respect to the reference position,
The photographing control unit,
Depth image generating apparatus using a single camera, characterized in that for controlling the photographing of the camera module at each point of time when the reflectometer is moved to the reference position and the symmetric position. The method of claim 7, wherein the actuator,
Further comprising a Hall sensor for sensing the position of the reflectometer,
The characteristic information,
The reference sensing value output by the Hall sensor at the corresponding position of the reflectometer is further linked,
The photographing control unit,
The camera module controls the photographing of the camera module to be taken at each time point when the reflectometer is moved to the plurality of positions, when the sensing value currently output by the hall sensor corresponds to the reference sensing value stored in the memory unit. Depth image generating device using a single camera, characterized in that the control to shoot.

Images