KR102341811B1 - Super resolution camara apparatus using one camera module - Google Patents

Abstract

According to one aspect of the present invention, the housing; a camera module provided in the housing unit; a magnet disposed in the housing unit to generate a magnetic force to move the camera module to a plurality of predetermined positions within the housing unit; a spring installed on the camera module to provide an elastic force so that the camera module can move within the housing; an image processing unit configured to process a first resolution image captured at a plurality of locations by the camera module to generate a second resolution image higher than the first resolution; and a controller for moving the camera module to a plurality of preset positions, controlling the camera module to capture the plurality of first resolution images, and controlling the image processing unit to generate the second resolution images A super-resolution camera device using one camera module is provided.

Description

Super-resolution camera device using one camera module {SUPER RESOLUTION CAMARA APPARATUS USING ONE CAMERA MODULE}

The present invention relates to a super-resolution camera device, and more particularly, to a super-resolution camera device using a single camera module capable of generating a super-resolution image from each image acquired at a plurality of locations using a single camera module. it's about

A super-resolution technology is a technology for generating a high-resolution image using several low-resolution images.

For example, a plurality of cameras are arranged in an N×N (where N is a natural number) matrix, and a high-resolution image is estimated and configured by using the relative difference between the low-resolution images photographed from each camera. technology is introduced.

A super-resolution photographing apparatus using a plurality of cameras is advantageous for restoring low-resolution images to high-resolution images, but there is a large spatial limitation because a plurality of cameras must be arranged in a limited area, and there is a problem that a plurality of cameras having a small size must be used. .

The problem to be solved by the present invention is a super-resolution camera device using a single camera module that can acquire each image from a plurality of positions using a single camera module and generate a super-resolution image from each obtained image is to provide

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood by those of ordinary skill in the art to which the embodiments proposed from the description below. will be.

According to one aspect of the present invention, the housing portion; a camera module provided in the housing unit; a magnet disposed in the housing unit to generate a magnetic force to move the camera module to a plurality of predetermined positions within the housing unit; a spring installed on the camera module to provide an elastic force so that the camera module can move within the housing; an image processing unit configured to process a first resolution image captured at a plurality of locations by the camera module to generate a second resolution image higher than the first resolution; and a controller for moving the camera module to a plurality of preset positions, controlling the camera module to capture the plurality of first resolution images, and controlling the image processing unit to generate the second resolution images A super-resolution camera device using one camera module is provided.

The image processing unit may include: a preprocessing unit for estimating and generating a high-resolution image by using a relative difference between the first resolution images captured by the camera module; an image correction unit for correcting the image pre-processed by the pre-processing unit; and a restoration/noise removal unit that restores the first resolution image to a second resolution image higher than the first resolution image and removes noise generated in the restoration process.

The preprocessor may be configured to process a photographing position translation, rotation, and scaling of a first resolution image photographed at each position by the camera module.

The controller may control the photographing position of the camera module to be arranged in an N×N (where N is a natural number equal to or greater than 2) matrix.

The control unit may be set to arrange the photographing positions of the camera module in a 2×2 matrix form.

The camera module may further include a coil for generating a magnetic force for moving the camera module by working with the plurality of magnets under the control of the controller.

The controller may set one position as a reference position for the position of the camera module, and control the power applied to the coil to move the position of the camera module according to a preset order.

The super-resolution camera device using the single camera module may further include a spring fixing part for fixing one side of the spring to the housing part.

According to the present invention, only one camera is required to form a super-resolution image by acquiring each image at a plurality of positions using one camera module and generating a super-resolution image from each acquired image. By doing so, space constraints are reduced and production costs can be greatly reduced by not using multiple cameras.

1 is a view for explaining a super-resolution camera device using one camera module according to an embodiment of the present invention.
2 and 3 are diagrams for explaining a camera module in a super-resolution camera device using one camera module of the present invention.
4 is a view for explaining the movement of the camera module in the super-resolution camera device using one camera module according to an embodiment of the present invention.

Hereinafter, specific embodiments of the present invention will be described in detail with drawings. However, it cannot be said that the spirit of the present invention is limited to the presented embodiment, and other inventions that are degenerate by addition, change, deletion, etc. of other elements or other embodiments included within the scope of the spirit of the present invention can be easily implemented can suggest

As for the terms used in the present invention, general terms that are currently widely used as possible have been selected, but in specific cases, there are also terms arbitrarily selected by the applicant. It is intended to clarify that the present invention should be understood as the meaning of a term other than that of the term.

That is, in the following description, the word 'comprising' does not exclude the presence of elements or steps other than those listed.

1 is a view for explaining a super-resolution camera device using one camera module according to an embodiment of the present invention. 2 and 3 are diagrams for explaining a camera module in a super-resolution camera device using one camera module of the present invention. 4 is a view for explaining the movement of the camera module in the super-resolution camera device using one camera module according to an embodiment of the present invention.

Referring to FIG. 1 , a super-resolution camera device 100 using a single camera module includes a housing 110 , a plurality of magnets 120 , a camera module 130 , an image processing unit 140 , and a control unit 150 ). It may be composed of

The housing 110 may be configured to include a plurality of magnets 120 and a camera module 130 therein.

The plurality of magnets 120 may be installed in the housing 110 and may include a first magnet 121 , a second magnet 122 , a third magnet 123 , and a fourth magnet 124 .

The first magnet 121 and the second magnet 122 may be installed on the first surface of the housing 110 . The third magnet 123 and the fourth magnet 124 may be installed on the second surface of the housing 110 .

The camera module 130 is installed inside the housing unit 110 and is moved to a preset position within the housing unit 110 to generate a low-resolution image by performing photographing at each position.

The camera module 130 is installed in the housing 110 by a spring support, for example, so that the camera module 130 can move within the housing 110 .

2 and 3 , the camera module 130 is installed in the housing 110 by being supported by a spring 160 .

A magnet 120 is installed in the housing unit 110 to generate a magnetic force to move the camera module 130 to a plurality of pre-selected positions within the housing unit 110 .

A coil 133 may be further installed in the camera module 130 . The coil 133 may generate a magnetic force for moving the camera module 130 by working with the plurality of magnets 120 under the control of the controller 150 .

Accordingly, the controller 150 sets one position of the camera module 130 as a reference position, and controls the power applied to the coil 133 to move the position of the camera module 130 according to a preset order. can do.

The spring 160 is installed on the camera module 130 , and provides an elastic force so that the camera module 130 can move within the housing 110 .

A spring fixing part 170 for fixing one side of the spring 160 to the housing 110 is installed on one side of the housing part 110 . The spring fixing unit 170 may be installed to correspond to the number of springs 160 . Here, the spring fixing part 170 is installed on the upper part of the housing part 110 .

As one side of the spring 160 is fixed to the spring fixing unit 170 , the camera module 130 moves within the housing unit 160 and can be restored to a default position by the restoring force of the spring 160 . have.

For example, the camera module 130 may move from the state shown in FIG. 2 to the inside of the housing 160 as shown in FIG. 3 and then be restored to the state shown in FIG. 2 .

The camera module 130 may include a lens unit 131 and a camera sensor 132 . The light focused through the lens unit 131 and the image of the subject taken by the user may be formed on the corresponding camera sensor 132 , and the camera sensor 132 is an external image input through the lens unit 131 . can play a role in converting the image data into image data.

For example, the camera sensor 132 may be a CCD (Charge Coupled Device) sensor or CMOS (Complementary Metal-Oxide Semiconductor) that converts an input image into an electronic signal, but the present invention is not limited thereto.

On the other hand, the camera sensor 132 may have a mode capable of capturing a general video and a mode capable of recording a high-speed or ultra-high speed video. Alternatively, it may be provided with modes capable of shooting by applying an arbitrary frame per second setting. Meanwhile, the lens unit 131 may include a plurality of lenses.

The image processing unit 140 processes the low-resolution images captured at the first position (a), the second position (b), the third position (c), and the fourth position (d) from the camera module 130 to generate a high-resolution image. create

To this end, the image processing unit 140 may include a preprocessor 141 , an image correction unit 142 , and a restoration/noise removal unit 143 .

The preprocessor 141 changes the shooting position of the low-resolution image captured at the first position (a), the second position (b), the third position (c), and the fourth position (d) by the camera module 130 ( It handles translation, rotation and scaling.

Also, the preprocessor 141 estimates and generates a high-resolution image by using a relative difference between the low-resolution images captured by the camera module 130 .

The image correction unit 142 corrects the image processed by the preprocessor 141 , and the restoration/noise removal unit 143 restores a low-resolution image to a high-resolution image and removes noise generated in the restoration process.

The controller 150 moves the camera module 130 to a plurality of preset positions, controls the camera module 130 to capture a plurality of first resolution images, and the image processing unit 140 to generate a second resolution image. ) is configured to control

In one embodiment of the present invention, the controller 150 may control the photographing position of the camera module 130 to be arranged in the form of an N×N (where N is a natural number equal to or greater than 2) matrix. In an embodiment of the present invention, the control unit 150 may set a specific photographing point to be arranged in a 2×2 matrix form.

Specifically, in one embodiment of the present invention, the specific shooting position is the first position (a), the second position (b), the third position (c), the fourth position (d), the camera module 130 is the second A low-resolution image is generated by performing imaging at the first position (a), the second position (b), the third position (c), and the fourth position (d), respectively.

In this case, the shooting order may be set in various ways. For example, the position of the camera module 130 may be set to the fourth position (d) as a reference position. Accordingly, the camera module 130 may be moved from the fourth position (d) to the first position (a), perform the first photographing at the first position (a), and then return to the fourth position (d). Then, the camera module 130 may be moved from the fourth position (d) to the second position (b) to perform a secondary photographing at the second position (b) and return to the fourth position (d). Thereafter, the camera module 130 may be moved from the fourth position (d) to the third position (c) to perform a tertiary photographing at the third position (c) and return to the fourth position (d). Then, the camera module 130 may perform a fourth photographing at the fourth position (d).

In another example, the camera module 130 is moved from the fourth position (d) to the first position (a) as shown in FIG. 4 to perform the first photographing at the first position (a), and the first position ( Moved from a) to the second position (b) to perform the second imaging at the second position (b), moved from the second position (b) to the third position (c), and moved from the third position (c) to 3 The car may be photographed, moved from the third position (c) to the fourth position (d), and then returned to the fourth position (d). Then, the camera module 130 may perform a fourth photographing at the fourth position (d).

In another example, the camera module 130 takes a first shot at a fourth position (d), moves to a first position (a) to take a second shot, and moves to a second position (b) to take a third shot and can be moved to the third position (c) to take the fourth photograph and return to the fourth position (d).

In another example, the camera module 130 may perform a primary photographing at the fourth position (d), move to the first position (a), take a secondary photograph, and return to the fourth position (d). Then, the camera module 130 may be moved from the fourth position (d) to the second position (b) to take a third shot and return to the fourth position (d). Then, the camera module 130 may be moved from the fourth position (d) to the third position (c) to take a fourth photograph and return to the fourth position (d).

Although specific embodiments according to the present invention have been described so far, various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be defined by the following claims as well as the claims and equivalents.

Claims (8)

housing;
a camera module disposed in the housing;
a magnet disposed on the inner surface of the housing;
an elastic member connecting one side of the housing and the camera module;
an image processing unit for processing the image captured by the camera module; and
A control unit for controlling the movement of the camera module,
The camera module moves in a direction perpendicular to the optical axis in the housing to take a first resolution image at a plurality of positions,
The image processing unit generates a second resolution image higher than the first resolution image by processing a plurality of first resolution images,
The controller controls the photographing position of the camera module in an NXN matrix arrangement (where N is a natural number greater than or equal to 2). According to claim 1,
The image processing unit,
a preprocessor for estimating and generating a high-resolution image by using the relative difference between the plurality of first-resolution images captured by the camera module;
an image correction unit for correcting the image pre-processed in the pre-processing unit; and
and a restoration/noise removal unit for restoring the first resolution image to the second resolution image and removing noise. 3. The method of claim 2,
The preprocessor is
A camera apparatus for processing a photographing position change (translation), rotation (rotation), and scaling (scaling) of the plurality of first resolution images. According to claim 1,
At least a portion of the plurality of first resolution images photographed at the plurality of positions overlap each other. According to claim 1,
The plurality of first resolution images photographed at the plurality of positions do not overlap each other. According to claim 1,
The camera module includes a coil disposed to face the magnet. According to claim 1,
and an elastic member fixing part fixing the elastic member to one side of the housing. According to claim 1,
The inner surface of the housing includes a first surface and a second surface perpendicular to each other,
The magnet is disposed on the first surface and the second surface.

Images