KR101862043B1 - Multi camera - Google Patents

Abstract

The multi-camera of the present invention includes a camera unit for photographing an object; And a processing unit for processing image data output from the camera unit. The camera unit is provided with a plurality of camera modules for simultaneously photographing the object, and each camera module can photograph light of different wavelengths.

Description

Multicamera {MULTI CAMERA}

The present invention relates to a multi-camera for photographing an object.

A visible light camera can capture or capture color or black and white images. For example, a visible light camera is used in an environment where light is present around the object.

The infrared camera can capture or capture the thermal radiation of the object as an infrared image. Infrared cameras can be used to improve visibility under low illumination, which limits the camera's exposure to the visible spectrum band.

The visible light camera and the infrared camera can form separate systems that are output through independent displays, respectively.

Korean Patent Registration No. 1123776 discloses a pinhole lens capable of exhibiting a megapixel-class performance. The pinhole lens may be applied to a surveillance camera for visible light or a surveillance camera for near infrared light.

Korean Patent Registration No. 1123776

The present invention is intended to provide a multi-camera capable of improving the photographic sharpness of an object or adding various effects to the image.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not intended to limit the invention to the precise forms disclosed. Other objects, which will be apparent to those skilled in the art, It will be possible.

The multi-camera of the present invention includes a camera unit for photographing an object; And a processing unit for processing image data output from the camera unit. The camera unit is provided with a plurality of camera modules for simultaneously photographing the object, and each camera module can photograph light of different wavelengths.

Image data output from each camera module may be input to the processing unit.

The processing unit may set the image data satisfying the setting condition among the input image data as the main image and use the remaining image data as the additional information of the main image.

The multi-camera of the present invention simultaneously photographs an object using a plurality of camera modules that photograph light of different wavelengths, and uses the image data output from each camera module to select and combine the image data, , Noise, and the like can be improved.

In addition, various additional functions such as displaying an aurora around the object of the photographed image using the synthesis of the respective image data can be added.

1 is a schematic view showing a multi-camera according to the present invention.
2 is a schematic view showing a camera unit installed in a portable terminal.
3 is a schematic view showing the camera unit.
4 is a schematic diagram showing the operation of the processing section of the present invention.
5 is a schematic view showing the operation of the multi-camera of the present invention.
6 is a graph showing the operation of the third camera module.
7 is a graph showing the operation of the fourth camera module.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The sizes and shapes of the components shown in the drawings may be exaggerated for clarity and convenience. In addition, terms defined in consideration of the configuration and operation of the present invention may be changed according to the intention or custom of the user, the operator. Definitions of these terms should be based on the content of this specification.

1 is a schematic view showing a multi-camera according to the present invention.

The multi-camera of the present invention includes a camera unit 100 for photographing an object and a processing unit 200, and can be mounted on various portable terminals 10 such as a smart phone.

The camera unit 100 may be provided with a plurality of camera modules 110, 120, 130, and 140 for simultaneously photographing an object.

Each camera module may include a lens, a lens barrel, a lens barrel, an image sensor disposed facing the lens, and a filter. Accordingly, one camera module can form an independent camera that outputs image data of an object.

According to the camera unit 100 provided with a plurality of camera modules, a plurality of identical image data obtained by photographing the same object at the same time point can be obtained. Even if the same image data is synthesized, the same image data is outputted, so that there is no profit.

Each of the camera modules can take light of different wavelengths so as to improve the sharpness and the like of the final output data by using the plurality of image data output from each camera module. Each camera module may be provided with a filter having a different wavelength band so as to capture light of different wavelengths. At this time, each filter may be disposed between the lens and the image sensor, or may be disposed in the lens barrel together with the lens.

For example, the camera unit 100 includes a first camera module 110 for capturing visible light, a second camera module 120 for capturing infrared rays, a third camera module 130 for capturing microwaves, At least two of the fourth camera modules 140 may be provided.

The processing unit 200 can process image data output from the camera unit 100. [ In order to process image data output from each camera module, the processing unit 200 may be electrically connected to each camera module. The processing unit 200 may synthesize and output the video data output from each camera module, or sequentially output the video data.

The image data output from each camera module may be input to the processing unit 200. [ The processing unit 200 can select and output the image data satisfying the setting condition from among the input image data. If there are a plurality of video data satisfying the setting condition, the processing unit 200 can synthesize and output the selected plurality of video data.

For example, the setting condition may be the satisfaction of the luminance value set for each image data.

The first image data output from the first camera module 110 may be general image data including RGB (Red, Green, Blue), which is obtained by photographing visible light.

The second image data output from the second camera module 120 may be image data of infrared rays.

When the first image data satisfies a first luminance value capable of identifying each object included in the image and the second image data satisfies a second luminance value capable of identifying each object included in the image, The controller 200 may combine the first image data and the second image data.

The infrared image corresponding to the second image data may include a bright portion having a high luminance and a dark portion having a low luminance. When the object to be photographed is a person, a person who emits infrared rays is brightly photographed, and the surrounding background can be photographed black. Accordingly, when the second image data is synthesized with the first image data, the character portion of the synthesized output data can be brightened by combining the character portion of the first image data and the character portion of the second image data. On the other hand, the background portion of the synthesized output data may be darkened or blackened.

If the surrounding background part becomes dark, it may be difficult to improve the sharpness or improve the brightness. The processing unit 200 may set the image data satisfying the setting condition as the main image among the input image data and use the remaining image data as the additional information of the main image.

For example, the processing unit 200 may set the first image data satisfying the first luminance value as the main image. In this case, the processing unit 200 extracts only the portion of the second video data that satisfies the second luminance value, instead of synthesizing the entire second video data satisfying the second luminance value directly into the first video data, . Accordingly, the output data output from the processing unit 200 may include a person whose background is the same as the first image data and is processed brighter than the first image data. As a result, the output data of the processing unit 200 can increase the dynamic range of the person's portion as compared with the main image, and the sharpness can also be improved.

Any one of the image data may be set as the main image, or a plurality of the image data may be set as the main image. For example, the intermediate data corresponding to the first image data whose brightness has been increased by combining the second image data corresponding to the infrared image can be generated by the processing unit 200, and the intermediate data at this time is set as the main image .

The main purpose of the multi-camera of the present invention may be to improve the sharpness of a normal RGB image. In order to satisfy the main purpose, the processing unit 200 first checks the noise level or luminance value of the first image data output from the first camera module 110 among the plurality of image data, and if the corresponding noise level is equal to or higher than the set value, If the value satisfies the first set value, the first image data can be preferentially set as the main image. If the condition is not satisfied, the processing unit 200 can set the second image data output from the second camera module 120 as the main image.

It is preferable that each camera module is disposed as close as possible so that each image data synthesized in the processing unit 200 has the same image.

The camera unit 100 including a plurality of camera modules may be mounted on one portable terminal 10 such that the optical axis of each camera module is disposed substantially coaxially.

2 is a schematic view showing a camera unit 100 installed in the portable terminal 10. As shown in FIG.

The camera unit 100 may be mounted on a front surface or a back surface of a smart phone corresponding to the portable terminal 10. At this time, the processing unit 200 may be embedded in the camera unit 100 or installed in the portable terminal 10.

Each of the camera modules can be disposed in close contact with each other so that the optical axes of the plurality of camera modules included in the camara portion are disposed substantially coaxially.

3 is a schematic view showing the camera unit 100. Fig.

The camera unit 100 installed in the portable terminal 10 may be provided with two or more camera modules. At this time, each camera module may be disposed at an equal angle on an arc centered on a virtual axis.

3 (a), when the first camera module 110 and the second camera module 120 are included in the camera unit 100, the optical axis of the first camera module 110 and the optical axis of the second camera module 120 The first camera module 110 and the second camera module 120 may be disposed at intervals of 180 degrees with respect to a virtual axis provided at the center between the optical axes of the first camera module 110 and the second camera module 120. [ As a result, the first camera module 110 and the second camera module 120 may be arranged in a '1' character.

The first camera module 110, the second camera module 120, and the third camera module 130 may be included in the camera unit 100 as shown in FIG. 3 (b). At this time, the camera modules may be arranged at intervals of 120 degrees with respect to the imaginary axis provided at the center between the camera modules. As a result, the three camera modules can be placed at the vertices of the virtual triangle.

The camera module 100 may include a first camera module, a second camera module 120, a third camera module 130 and a fourth camera module 140 as shown in FIG. 3 (c). At this time, the camera modules may be arranged at intervals of 90 degrees with respect to the imaginary axis provided at the center between the camera modules. As a result, the four camera modules can be placed at the vertices of a virtual rectangle.

The photographing unit may be provided with a processing unit 200 or a lead wire 190 electrically connected to the portable terminal 10. [

4 is a schematic diagram showing the operation of the processing unit 200 of the present invention.

The processing unit 200 may generate the output data K by combining the first image data 1 output from the first camera module 110 and the second image data 2 output from the second camera module 120. If the first image data (1) is set as the main image, the processing unit (200) extracts only a part of the second image data (2) instead of synthesizing the second image data can do.

5 is a schematic view showing the operation of the multi-camera of the present invention.

The camera module 100 may include a first camera module 110 for capturing visible light and a second camera module 120 for capturing infrared light.

The first camera module 110 may include a first filter 111 for passing visible light. The first filter 111 may transmit light having a wavelength of 400 nm to 750 nm and block light of the remaining wavelength band.

The second camera module 120 may be provided with a second filter 121 that transmits infrared light and blocks visible light. The second filter 121 can transmit light in a wavelength band exceeding 750 nm and block light in the remaining wavelength band. When the third camera module 130 for photographing microwaves is additionally provided, the second filter 121 can transmit light in a wavelength range of 750 nm to 1 mm and block light in the remaining wavelength band.

The processing unit 200 includes a visible ray photographing mode for outputting the first image data 1 of the first camera module 110, an infrared photographing mode for outputting the second image data 2 of the second camera module 120, And a visible ray / infrared ray photographing mode for combining the first image data (2) and the second image data (2).

5 shows a visible ray / infrared ray photographing mode.

Green-A, Green-B, and Blue of a wavelength range of 400 nm to 750 nm from the first camera module 110 can be photographed by the first filter 111. The first image data (1) of the first camera module (110) may be similar to the image captured by a general camera.

Infrared rays having a wavelength of more than 750 nm can be taken from the second camera module 120 by the second filter 121. In the case of a person, an infrared ray of 800 nm wavelength is photographed (indicated by a dotted line), and a thermal image can be obtained as in the second image data (2).

The processing unit 200 can synthesize the first image data 1 and the second image data 2. At this time, if the first image data? Is designated as the main image, the processing unit 200 extracts only the portion exceeding the set brightness value in the second image data?, And synthesizes the extracted portion to the first image data?.

The output data K corresponding to the synthesis result may include light (blue) with a wavelength of about 470 nm, light (green) with a wavelength of 540 nm, light (red) with a wavelength of 620 nm, and light with a wavelength of 800 nm (infrared). The portion of the character included in the output data K may have a higher luminance than the portion of the character included in the first image data 1 due to the combination of infrared rays. Therefore, according to the processing section 200, output data K in which a person is displayed brighter and clearer can be generated.

In addition to the first camera module 110 and the second camera module 120, other camera modules may be added to the camera module 100.

For example, the camera unit 100 may include a first camera module 110, a second camera module 120, and a third camera module 130 that captures microwaves.

6 is a graph showing the operation of the third camera module 130. As shown in FIG.

The third camera module 130 may be provided with a third filter 131 for passing microwaves and blocking visible light and infrared rays. The third filter 131 allows the light of the wavelength band exceeding 1 mm to pass therethrough and blocks the light of the remaining wavelength band.

In this case, the processing unit 200 may include a visible light photographing mode, an infrared photographing mode, a visible light / infrared photographing mode, a microwave photographing mode for outputting third image data of the third camera module 130, A visible light / microwave imaging mode for synthesizing three-dimensional image data, and an infrared / microwave imaging mode for synthesizing the second image data 2 and the third image data.

As another example, the camera unit 100 may include a first camera module 110, a second camera module 120, and a fourth camera module 140 that captures ultraviolet rays.

FIG. 7 is a graph illustrating the operation of the fourth camera module 140. FIG.

The fourth camera module 140 may be provided with a fourth filter 141 that passes ultraviolet rays and blocks visible light and infrared rays. The fourth filter 141 can pass light in a wavelength range of less than 400 nm and can block light in other wavelength ranges.

The processing unit 200 may include a visible light photographing mode, an infrared photographing mode, a visible light / infrared photographing mode, an ultraviolet photographing mode for outputting fourth image data of the fourth camera module 140, And an infrared / ultraviolet ray photographing mode for combining the second image data 2 and the fourth image data.

In the above description, the first camera module 110 and the second camera module 120 are basically included in the camera unit 100, and the remaining camera modules are added. In addition, the camera unit 100 may include various types of cameras in various combinations.

For example, the camera unit 100 may include a first camera module 110 and a fourth camera module 140.

At this time, the processing unit 200 may operate in one of a visible light photographing mode, an ultraviolet photographing mode, and a visible light / ultraviolet photographing mode.

In addition, the second camera module 120 and the fourth camera module 140 may be included in the camera unit 100 or the second camera module 120 and the third camera module 130 may be included in the camera unit 100 Or the first camera module 110 and the third camera module 130 are included in the camera unit 100, and the like.

According to the present invention, objects can be simultaneously photographed by using a camera module that photographs light of different wavelengths, and each photographed image data can be appropriately synthesized. Therefore, an object of interest can be clearly photographed regardless of the surrounding environment.

For example, when the first image data is a backlight image, color information extinction phenomenon in which the shadow information disappears and the face of the person is displayed in black may appear. At this time, since the dynamic range is increased when the second image data is synthesized, the color information disappearing phenomenon in which the face of the person is displayed in black can be prevented.

Multicamera may be used for coastal, marine traffic, road surveillance, and park surveillance in fog or smog environments. In addition, the multi-camera of the present invention can be used to grasp the position of a person in a firey smoke scene.

It can be used not only for night vision, but also for identification of the police or the army through the possession of an identification table emitting light of a specific wavelength band.

In addition, since the multi-camera of the present invention can acquire light in various wavelength ranges, it can be used for checking the freshness of food that absorbs, reflects, or emits light different depending on freshness.

In addition, various image effects such as auras can be added through synthesis of respective image data.

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined by the appended claims. Accordingly, the true scope of the present invention should be determined by the following claims.

10 ... portable terminal
100 ... camera unit 110 ... first camera module
111 ... first filter 120 ... second camera module
121 ... second filter 130 ... third camera module
131 ... third filter 140 ... fourth camera module
141 ... fourth filter 190 ... lead wire
200 ... processor

Claims (9)

A camera unit for photographing an object;
And a processing unit for processing image data output from the camera unit,
Wherein the camera unit is provided with a plurality of camera modules for simultaneously photographing the object,
Each camera module captures light of different wavelengths,
The image data output from each camera module is input to the processing unit,
Wherein the processing unit sets the first image data whose noise level is equal to or higher than a set value or whose luminance value satisfies the first set value as a main image among a plurality of image data output from each camera module, 2 image data as additional information of the main image,
The processing unit extracts only the portion of the second image data that satisfies the second luminance value, instead of synthesizing the entire second image data satisfying the second luminance value directly into the first image data, Multi-camera to synthesize data.
The method according to claim 1,
Wherein the first image data is image data output from a first camera module that captures visible light,
Wherein the second image data is image data output from a second camera module for capturing infrared rays,
Wherein the processing unit extracts only a portion of a person that satisfies the second luminance value and adds the extracted portion to the first image data.
delete The method according to claim 1,
Wherein the camera unit is provided with a first camera module for capturing visible light and a second camera module for capturing infrared light,
The first camera module is provided with a first filter for passing visible light,
The second camera module is provided with a second filter for passing infrared light and blocking visible light,
Wherein the processing unit includes a visible light photographing mode for outputting the first image data of the first camera module, an infrared photographing mode for outputting the second image data of the second camera module, A multi-camera that operates in one of the visible light / infrared imaging modes for compositing data.
The method according to claim 1,
The camera unit is provided with a first camera module for photographing a visible ray, a second camera module for photographing infrared rays, and a third camera module for photographing a microwave,
The first camera module is provided with a first filter for passing visible light,
The second camera module is provided with a second filter for passing infrared light and blocking visible light,
The third camera module is provided with a third filter for passing microwaves and blocking visible light and infrared rays,
Wherein the processing unit comprises: a visible light photographing mode for outputting the first image data of the first camera module; an infrared photographing mode for outputting the second image data of the second camera module; A visible ray / infrared ray photographing mode for combining the first image data and the second image data, a visible ray / microwave photographing mode for combining the first image data and the third image data, And an infrared / microwave imaging mode for synthesizing the second image data and the third image data.
The method according to claim 1,
Wherein the camera unit is provided with a first camera module for capturing visible light, a second camera module for capturing infrared rays, and a fourth camera module for capturing ultraviolet light,
The first camera module is provided with a first filter for passing visible light,
The second camera module is provided with a second filter for passing infrared light and blocking visible light,
The fourth camera module is provided with a fourth filter for passing ultraviolet rays and blocking visible rays and infrared rays,
Wherein the processing unit includes a visible ray photographing mode for outputting the first image data of the first camera module, an infrared photographing mode for outputting the second image data of the second camera module, A visible ray / ultraviolet ray photographing mode for combining the first image data and the second image data, a visible ray / ultraviolet ray photographing mode for combining the first image data and the fourth image data, And an infrared / ultraviolet ray photographing mode for combining the second image data and the fourth image data.
The method according to claim 1,
Wherein the camera unit is provided with a first camera module for capturing visible light and a fourth camera module for capturing ultraviolet light,
The first camera module is provided with a first filter for passing visible light,
The fourth camera module is provided with a fourth filter for passing ultraviolet rays and blocking visible light,
The processing unit may include a visible light photographing mode for outputting the first image data of the first camera module, an ultraviolet photographing mode for outputting fourth image data of the fourth camera module, And a visible ray / ultraviolet ray photographing mode for synthesizing the visible ray / ultraviolet ray photographing mode.
The method according to claim 1,
At least two of a first camera module for photographing visible light, a second camera module for photographing infrared rays, a third camera module for photographing microwave, and a fourth camera module for photographing ultraviolet light are provided in the camera part,
The processing unit is electrically connected to each of the camera modules.
9. The method of claim 8,
Wherein the processing unit sequentially outputs image data output from each of the camera modules.

Images