KR20150129548A - Method and apparatus for generating omnidirectional plane image - Google Patents

Abstract

Disclosed are a method and an apparatus for performing an omni-directional photographing operation. An image processing method of an omni-directional plane image generation apparatus comprises the steps of: obtaining an omni-directional image via an omni-directional photographing optical lens unit; processing the obtained omni-directional image based on an image sensor to generate original image data; and transforming the original image data into plane image data and performing an additional image process on the converted plane image data to generate a final output plane image, wherein the omni-directional photographing optical lens unit can have a horizontal angle of view of 360 degrees.

Description

Field of the Invention [0001] The present invention relates to a method and apparatus for generating a full azimuth plane image,

The present invention relates to an image generating method, and more particularly to a method and apparatus for generating a full azimuth plane image.

The number of smartphone users in Korea was only 800,000 at the end of 2009, but it is expected to increase rapidly and reach 30 million by the end of 2013. In addition, the number is steadily increasing, and 90% of Korean phone users will open smartphones. Nowadays, the age of smartphone users is bigger than that of younger users, but the user base is rapidly expanding as smart phones become essential tools to get information and process business.

In addition, every time a new mobile device such as a smart phone or a tablet PC is introduced, the related accessory market is also active. In recent years, mobile device accessories have not only supplemented and strengthened the basic use of the body of the device by employing various uses, functions and designs, but also represent the personality and taste of the user. And the accessories that provide various functions are added to the fun, adding to the use of the device. Smartphone users, for example, can use a variety of smartphone cases and use smartphone-related accessories or peripherals such as earphones, desktop cradles (or car cradles), external battery packs, It is a tendency to use it actively.

The smartphone accessory market itself is expanding as a platform. According to the KT Economic Research Institute, the domestic smartphone accessories market, which was worth 245.5 billion won in 2010, surpassed 500 billion won in 2011 and is expected to grow to 1 trillion won in 2012 this year. The global market is expected to grow from $ 26.5 billion in 2009 to over $ 50 billion by 2015.

Gradually, smartphone accessories are being developed not only as a design change of a smartphone, but also as a module for expanding functions previously implemented in a smartphone to acquire additional functions.

On the other hand, among the smartphone accessories, when the image is combined with the lens portion of the smartphone, there is an accessory for photographing which provides a wider angle of view than the angle of view provided through the photographing module of a general smartphone. However, there has been a problem that an image photographed at a wide angle of view through a photographing accessory is severely distorted as it goes toward the edge of the image.

In order to solve the above problems, Korean Patent Laid-Open No. 10-2010-0031263 relates to a mobile terminal equipped with a panoramic photographing function and a method of operating the same, wherein at least two or more rows of grids And a position guide unit for sensing the movement of the terminal on the preview screen and informing the photographing position.

A mobile terminal providing a panoramic photographed image can provide a wide range of photographed images without distortion. However, in order to photograph a wide range of photographed images and provide the photographed images to a user, the user must rotate the mobile terminal either directly or through a rotating device, There is a problem that it is cumbersome and has a restriction to perform shooting, and it is difficult to immediately obtain the image of the entire defense.

Korean Patent Publication No. 10-2010-0031263

SUMMARY OF THE INVENTION A first object of the present invention is to provide a method and apparatus for acquiring an image of a full azimuth in a single operation and generating a full azimuth plane image that provides a panoramic image without distortion.

It is a second object of the present invention to provide a method and apparatus for generating a full azimuth plane image that provides a segmented image of simultaneously captured full azimuths.

According to still another aspect of the present invention, there is provided a method for generating a full azimuth plane image, comprising: acquiring a full azimuth image through a full azimuth imaging optical lens unit; And converting the circular image data to planar image data and performing further image processing on the converted planar image data to generate a final output plane image, The azimuth photographing optical lens unit can have a horizontal angle of view of 360 degrees. Wherein acquiring a full-deflection image through the full-deflection optical lens unit includes obtaining image information having the horizontal angle of view of 360 degrees through an aspherical optical lens, and acquiring the image information acquired through the aspherical optical lens into a plurality of Wherein the aspherical optical lens and the plurality of associated spherical lenses may be arranged and fixed based on the lens barrel. The circular image data may be data of a bit format generated by transforming the obtained full azimuth image based on an image sensor, and the image sensor may be a CCD or a CMOS. Wherein transforming the circular image data into planar image data and further image processing the transformed planar image data to produce a final output planar image comprises polar transforming the circular image data into planar image data And performing the at least one of pixel addition through interpolation, color correction, and edge transformation processing on the plane image data to generate the final output plane image. The step of polar transforming the circular image data into the plane image data may be performed based on the following equation,

 ≪ Equation &

Where _x is the radius of the circular image data, c _x and c _y are positions on the xy axis of the center pixel of the circular image data, x _i and y _i are the pixel positions of the circular image data, x _f , y _f may be the position of each pixel of the planar image data. The full-orientation photographing optical lens unit is configured to be associated with the photographing unit of the smartphone to obtain the full-direction image, and the circular image data and the final output plane image may be determined based on the processor of the smartphone.

Further, an apparatus for generating a full azimuth plane image of the present invention includes a full-azimuth imaging optical lens unit for acquiring a full-azimuth image through a plurality of optical lenses, And a planar image processing unit for converting the circular image data into plane image data and performing additional image processing on the converted plane image data to generate a final output plane image The omnidirectional imaging optical lens unit may have a horizontal angle of view of 360 degrees. Wherein the full-orientation imaging optical lens unit comprises: an aspherical optical lens for acquiring image information having the horizontal angle of view of 360 degrees; a plurality of ancillary spherical lenses for rearranging and focusing the image information acquired through the aspherical optical lens; A lens and a lens barrel for arranging and securing the plurality of associated spherical lenses. The circular image data may be data in a bit format generated by converting the obtained full-direction image based on an image sensor, and the image sensor may be a CCD or a CMOS. The circular image data is polar transformed into the plane image data, and pixel addition, color correction, and edge transformation processing are performed on the plane image data by interpolation to generate the final output plane image . The plane image processor may be configured to perform the polar transformation based on the equation. The full-orientation imaging optical lens unit may be implemented to obtain the full-direction image in association with the photographing unit of the smartphone, and the circular image data and the final output plane image may be determined based on the processor of the smartphone.

As described above, by using the method and apparatus for performing omnidirectional imaging according to the embodiment of the present invention, it is possible to reduce the response speed without using physical operations such as panning, tilting, and zooming through production of small volume, light weight, It is possible to implement a fast forward azimuth imaging device. By using the full-direction imaging apparatus according to the embodiment of the present invention, the photographer does not have to turn around a wheel as in the conventional panoramic camera, and the camera can be used in a wide range of angles Capturing all the images that can be seen and presenting 360-degree images to the user that were not previously available to the user.

1 is a conceptual diagram showing an apparatus for generating a full azimuth plane image according to an embodiment of the present invention.
2 is a conceptual diagram showing a frontal-orientation photographing optical lens unit according to an embodiment of the present invention.
3 is a conceptual diagram illustrating a method of generating a planar image according to an embodiment of the present invention.
4 is a conceptual diagram illustrating an angle of view according to an embodiment of the present invention.
5 is a conceptual diagram showing a frontal-orientation photographing optical lens unit according to an embodiment of the present invention.
FIG. 6 is a conceptual diagram illustrating a full-azimuth image acquisition image processing unit according to an embodiment of the present invention.
7 is a conceptual diagram illustrating a planar image processing unit according to an embodiment of the present invention.
8 is a conceptual diagram illustrating a specific operation of the plane image processing unit according to the embodiment of the present invention.
9 is a view showing a front plane image that can be divided or edited through PDP (Partial Divide Picture) control according to an embodiment of the present invention.
10 is a flow chart illustrating an image processing operation of an apparatus for generating a full azimuth plane image according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

The terms first, second, etc. may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Hereinafter, the same reference numerals will be used for the same constituent elements in the drawings, and redundant explanations for the same constituent elements will be omitted.

Smartproduct is a convergence product that can provide APP based service through connection with smart devices such as smart phone and smart TV. SmartProducts is emerging as a new growth industrial product that is now forming a global market.

In an embodiment of the present invention, one of a variety of smart products is posted about a device that generates a 360 degree frontal plane image. An apparatus for generating a full azimuth plane image according to an embodiment of the present invention can be installed as an accessory of a smart phone and can be applied to various devices such as a car black box, home care CCTV, .

For example, an apparatus for generating a full azimuth plane image according to an embodiment of the present invention may transmit image data photographed on a smartphone through a wireless communication function such as WiFi, And for Android), it is possible to generate the received image as a panoramic plane image.

By using the device for generating the full azimuth plane image according to the embodiment of the present invention, the photographer does not have to turn around one wheel like a conventional panoramic camera, Capturing all the images that can be seen within the image and providing a 360 degree image that could not previously be provided to the user. In the embodiments of the present invention, an image may be interpreted as an image, a pixel, or the like.

1 is a conceptual diagram showing an apparatus for generating a full azimuth plane image according to an embodiment of the present invention.

1, an apparatus for generating a full azimuth plane image (or an azimuth plane image generating apparatus) includes a full azimuth imaging optical lens unit 100, a full azimuth image processing unit 120, and a plane image processing unit 140 can do.

The omnidirectional imaging optical lens unit 100 may be implemented with an optical structure for receiving image information in all directions. For example, the omnidirectional imaging optical lens unit 100 includes an aspherical optical lens for receiving a peripheral foreground of 360 degrees and a plurality of ancillary spherical lenses for rearranging and focusing the light sources incident through the aspheric optical lens, And a lens barrel for arranging and fixing the optical lens and the plurality of the associated spherical lenses.

The omnidirectional imaging optical lens unit 100 may be implemented in various specifications. For example, the field-of-view angle of the omnidirectional imaging optical lens unit 100 can be selected to be around 45 degrees. The omnidirectional imaging optical lens unit 100 is realized with a viewing angle range of 45 degrees which is slightly smaller than the object viewing visual angle of 50 degrees, which is the human eye, so that a natural image can be obtained. Further, the lens of the omnidirectional imaging optical lens unit 100 may be designed to correspond to a 1 / 3.2 " CMOS. 1 / 3.2 "CMOS is a CMOS sensor of a typical smartphone camera. The specifications of the full-field imaging optical lens unit 100 may be implemented in various other specifications as an example.

The full-deflection image processing unit 120 may be implemented to process the image obtained by the full-deflection optical lens unit 100 into image data.

In the full-azimuth image processing unit 120, the photographed image may be converted into image data having a bit data format. The image data converted by the full-azimuth image processing unit may be compressed based on the codec and transmitted to the planar image processing unit 140.

The planar image processing unit 140 may be implemented to convert the image data processed by the full orientation image acquisition image processing unit 120 into a planar image. For example, the planar image processing unit 140 may generate a flat image by flattening a circular image input from an image signal processor (ISP) of a CMOS sensor included in the frontal image processing unit 120 . The planar image processing unit 140 may perform additional processing on the planar image (for example, a process of up-scaling a distorted portion for improving image quality, a color interpolation process for improving color distortion) The final plane image can be generated.

Hereinafter, in the embodiment of the present invention, specific operations of the omnidirectional imaging optical lens unit 100, the frontal image processing unit 120, and the plane image processing unit 140 are posted.

2 is a conceptual diagram showing a frontal-orientation photographing optical lens unit according to an embodiment of the present invention.

The omnidirectional optical lens unit can be implemented as a 1/3-inch full-spherical aspheric lens for 1.3 million pixels, a full-direction aspheric lens for CCDs for 2 million pixels, and a full-azimuth aspherical lens for CMOS 360-degree shooting. That is, the omnidirectional optical lens unit can be variously implemented according to image sensors such as CCD and CMOS.

Referring to Fig. 2 (a), the omnidirectional imaging optical lens unit can receive light in all directions. As described above, the omnidirectional imaging optical lens unit includes an aspheric optical lens 200 that receives the foreground circumference at all directions, a plurality of auxiliary spherical lenses 210 that rearrange and focus the light source transmitted through the aspheric optical lens 200 And a lens barrel 220 for arranging and fixing the aspherical optical lens 200 and the associated spherical lens 210.

The omnidirectional imaging optical lens unit according to the embodiment of the present invention is designed to have a high response speed without using physical operations such as fan, tilt, and zoom through a small volume, a light weight, You can have fast features. When the omnidirectional imaging optical lens unit according to the embodiment of the present invention is used, it is possible to acquire an image of full azimuth, even if the photographer does not turn around one turn like a conventional panoramic camera. Also, it is possible to capture all images that can be viewed within a range of up and down angles without capturing by using a plurality of cameras, thereby providing a full-direction image to the user.

Table 1 below exemplifies the specifications of the full-field imaging optical lens unit according to the embodiment of the present invention.

<Table 1>

The specifications of the full-directional imaging optical lens disclosed in Table 1 are exemplary specifications, and the full-orientation imaging optical lens unit can be implemented with various specifications different from those shown in Table 1 according to the implementation.

Referring to Table 1, the horizontal angle of the omnidirectional optical lens unit may range from 0 to 360 degrees, and the vertical angle may range from 0 to 45 degrees. The corresponding image sensor can also be assumed to be 1/3/2 "CMOS for operation in conjunction with a smartphone. The specifications of the full-field imaging optical lens, such as the different lens diameters, can be determined in view of the specifications of the smart product in which the device generating the full-field plane image is implemented.

FIG. 2 (b) shows a planar image 260 obtained based on the circular image 250 taken by the full-field imaging optical lens.

3 is a conceptual diagram illustrating a method of generating a planar image according to an embodiment of the present invention.

A CMOS sensor that acquires light incident from the omnidirectional optical lens unit may be a CMOS sensor that is generally included in a smart phone. When using a CMOS sensor, it is necessary to remove unnecessary images except the original image.

Referring to FIG. 3 (a), the original image is acquired through the front optical lens unit, and the original image is obtained by removing the unnecessary image portion.

The circular image 300 may be divided for partial distortion elimination and partial image processing to produce a planar image. A unit (circular divided unit image) 310 of the divided circular image can be divided in consideration of resolution, arcs, pixels, image distortion, and the like.

Referring to FIG. 3 (b), a method for generating a plane image based on the circular split unit image 310 is posted. First, the pixel structure of the circular divided unit image 310 can be grasped. The reference focus pixel 320 for the circular divided unit image 310 in which the pixel structure is grasped can be extracted. The reference focus pixel 320 may be a pixel that does not require expansion or reduction. The pixel structure can be divided into a pixel to be reduced based on the reference focus pixel 320 and a pixel to be expanded.

A per-pixel correction process can be performed to solve partial distortion to generate a plane-divided unit image. For example, the reduced area 330 is determined for the extended area based on the reference focal pixel 320, and the extended area 340 is determined for the reduced area. can do. It is possible to extract plane-divided unit images through additional image processing considering resolution, arcs, pixels, image distortion, and the like.

In this method, a plurality of circular division unit images can be generated as a plurality of plane division unit images. A method of generating a plane-divided unit image will be further described in the following embodiments of the present invention.

4 is a conceptual diagram illustrating an angle of view according to an embodiment of the present invention.

In Fig. 4, the omnidirectional imaging optical lens unit shows an installed viewing range angular range.

The omnidirectional imaging optical lens unit can have a field angle range of 360 degrees in the horizontal angle and 45 degrees in the vertical angle to obtain a visually natural plane image.

5 is a conceptual diagram showing a frontal-orientation photographing optical lens unit according to an embodiment of the present invention.

Referring to Fig. 5A, the front biased optical lens portion is shown in connection with the photographing portion of the smartphone. A device for generating a full azimuth plane image according to an embodiment of the present invention or a portion of an apparatus for generating a full azimuth plane image may be implemented in combination with an existing user device such as a smart phone.

When the omnidirectional imaging optical lens unit is implemented in a smartphone, the image acquired through the imaging unit of the smartphone and the omnidirectional imaging optical lens unit can be received and processed. The planar image processing unit, which is a remainder of the apparatus for generating a full azimuth plane image, may be implemented as a single component in conjunction with the full-azo imaging optical lens unit, but may be implemented as a separate component, Lt; / RTI &gt; processors and applications.

A coupling case may be used to connect the lens barrel of the optical system lens module that implements the omnidirectional imaging optical lens unit to the smartphone.

In FIG. 5 (b), a case for coupling with no clearance is posted between the optical system lens modules implementing the full-deflection optical lens unit.

Referring to FIG. 5 (b), in general, soft plastic can be used as a portion directly contacting with a smartphone for safe connection with a smartphone body. The portion coupled with the lens barrel may be embodied as hard plastic or metal for complete connection.

6 is a conceptual diagram illustrating a full-direction image processing unit according to an embodiment of the present invention.

Referring to Fig. 6, the front-azimuthal image processing unit can process the image transmitted by the front azimuthal optical lens unit. When the light distorted by the omnidirectional optical lens unit is matched to the image sensor (CCD, CMOS) having a planar structure, the charge coupled device acquires the image information, processes it with an image processing circuit, and generates image data based on the codec And can be compressed and transmitted to the planar image processing unit.

The omnidirectional image processing unit may include an image sensor 600, a communication unit 610, an image processing unit 620, a memory 630, a clocking unit 640, and the like.

The image sensor 600 may include an image sensor such as a CCD or a CMOS to generate an electrical signal as an image transmitted by the full-deflection optical lens unit.

The image processing unit 620 may be implemented to process the data transferred by the image sensor 600 based on the image engine. The data transmitted by the image sensor 600 may be compressed based on the codec of the image processing unit and generated as image data.

The memory 630 and the clocking unit 640 can be used for processing the image processing unit and the communication unit 610 can be implemented to transfer the processed image data to the outside or receive information related to image processing from the outside .

7 is a conceptual diagram illustrating a planar image processing unit according to an embodiment of the present invention.

The planar image processing unit can process the circular image input from the ISP of the CMOS sensor into a flat image. A flattened image can be obtained through a process of up-scaling the distorted part and a color interpolation process for improving color distortion to improve image quality.

Referring to the upper part of FIG. 7, the data related to the circular image is received from the full-direction image processing unit (step S700).

The thus obtained full azimuth image can be projected onto a point p (x, y) on a two-dimensional image plane at an arbitrary point in space (step S710).

When the CMOS sensor receives an image of full azimuth through a hyperboloidal mirror, the image of the azimuth becomes a circle on the two dimensional image plane. However, since the pixel array of the CMOS sensor is a lattice-like arrangement, the resulting image includes distortion, and this distorted image can be corrected by image processing such as distortion correction by software (step S720).

7 shows an image processing block of the planar image processing unit.

7, the circular image captured by the smartphone camera equipped with the omnidirectional optical lens module can be converted from a circular image to a plane image through a Round To Rectangle Converter Step S730).

The planar image processing unit receives the circular image input through the full-orientation photographing optical lens unit and the full-direction image processing unit in a YUV format (representing color information by brightness value and color difference signal), and performs conversion to restore the panoramic plane image . The image switching method of the circular-plane switching unit will be specifically described in the following embodiments of the present invention.

And performs additional image processing on the converted plane image (step S740).

Additional image processing (e.g., interpolation and correction, etc.) for the transformed planar image may be performed through various procedures. For example, a step S740-3 of adding pixels based on the interpolation method with an additional image processing method, a step S740-6 of correcting and correcting the color, a step S740-9 of converting the edges, and the like Can be performed. Specifically, when converting a circular image to a planar image, additional pixels may be added to the planar image since pixels corresponding to the planar image may not be present in the circular image. In addition, it is possible to correct and correct the color distortion that occurs in converting to a flat image. In addition, when converting to a flat image, distorted edges can be transformed and the plane image can be divided and controlled.

And outputs the final plane image (step S750).

Through step S740, the final plane image generated based on the additional image processing can be outputted through the display of various user devices such as a display of a smart phone.

8 is a conceptual diagram illustrating a specific operation of the plane image processing unit according to the embodiment of the present invention.

In FIG. 8, the above-described plane image generating method at the bottom of FIG. 7 will be specifically described.

Referring to FIG. 8, a polar transformation may be used to obtain a planar image. The polar transformation can extract an arbitrary radius R in the circular image and extract the coordinates of each pixel in R into each (x _f , y _f ) coordinate to be applied to the equivalent rectangle. The circular image has picture information in the circular area, and the width of the image in which the circular image is converted into a plane is 4R. The entire original image is stored in memory and can be corrected by replacing each pixel with a conversion algorithm.

Around the center of the azimuth circle image (c _x, c _y) in case home, pyeoteul a circular image into a rectangular If as is 4R width of the number of the x _f the horizontal axis is the 4R-1 gae 0, of the longitudinal axis y _f The number of R (circle diameter) -1 and the angle can be from 0 to 2 degrees. The vertical y _f is a point distanced by y _f from (c _x , c _y ) of the center of the circle. The luminance of a rectangular point (x _f , y _f ) can be expressed as r _i and converted to a constant value from the center of the circle (c _x , c _y ).

The following equation represents an exemplary equation for calculating the position of an angle-specific coordinate.

&Lt; Equation &

Based on the equations (1) and (2), we can find the values of x _f and y _f and r _i of the rectangle, and we can find each pixel of the circular image on the basis of equations (3) Pixel. Assuming that the circular image has a radius of 256 and a size of 512x512, the size of the rectangle to be converted is R x 4R = 256 x 1024.

It is possible to check whether there is a bad pixel in the plane image data obtained by the above method, and to correct the defective pixel through correction when a bad pixel occurs. Bad pixel correction, color interpolation, and color correction may be performed simultaneously.

For example, the color interpolation method can use one of nonadaptive algorithms and adaptive algorithms. The non-adaptive algorithm is an algorithm that interpolates in a fixed pattern for all pixels, and is easy to perform and has a small amount of calculation. On the other hand, the adaptive algorithm is an algorithm that estimates the most effective values of the neighboring pixels to find the lost pixel values, but it can obtain a better image than the non-adaptive algorithm.

The non adaptive algorithm has the method of the nearest neighbors pixel interpolation method, bilinear interpolation method, intermediate value interpolation method, incremental color change interpolation method, and the method of adaptive algorithm includes pattern matching interpolation algorithm, interpolation method using the threshold-based variable number of gradient, Interpolation method and the like.

Specifically, the non-adaptive algorithm includes bilinear interpolation of the method of allocating the values of the nearest neighbor pixel and the newly generated pixel to values obtained by multiplying the four closest pixels by a weight, A median interpolation method in which the value of the generated pixel is assigned as an intermediate value to the four closest pixels, and an incremental color change interpolation method using the difference between the luminance channel and the chromaticity channel.

In the adaptive interpolation method, a pattern matching based interpolation algorithm that calculates a difference between a pattern and a neighboring pixel and uses a least difference value, an interpolation using a threshold -based variable number of gradients), and depending on the luminance change and the chromaticity change, edge sensing interpolation is performed in a direction in which the difference is small after comparing with a given threshold value in each direction .

After such a correction and interpolation procedure, the planar image may finally be generated as a final planar image through an edge enhancement block between the values of the different pixels in the image, i. E. The edge. The final plane image can be input to a PDP (Partial Divide Picture) control block. The PDP control makes it possible to divide the planar image finally converted into the external signal into various forms.

9 is a view showing a front plane image that can be divided or edited through PDP (Partial Divide Picture) control according to an embodiment of the present invention.

9, the circular image data 1000 may be generated as a final plane image 1020 according to the plane image acquisition procedure described above, and the final plane image may be split and / or edited Gt; 1040 &lt; / RTI &gt;

10 is a flow chart illustrating an image processing operation of an apparatus for generating a full azimuth plane image according to an embodiment of the present invention.

Referring to FIG. 10, a full-defocus image is acquired through a full-deflection optical lens (step S1100).

A full-deflection image can be obtained based on the omnidirectional optical lens unit. The omnidirectional optical lens unit can have a viewing angle range of 360 degrees in the horizontal angle and 45 degrees in the vertical angle to obtain a visually natural image.

The acquired full-deflection image is processed based on the image processor (step S1120).

The image processor may include an image sensor, and the image acquired through the lens may be transformed through an image sensor and processed as electrical bit data. When an apparatus for generating a full azimuth plane image according to an embodiment of the present invention is implemented on a smartphone, the image processor may be an image processor of a smart phone.

When the distorted image light obtained through the omnidirectional optical lens is matched to a planar image sensor (CCD, CMOS), the charge coupled device can acquire the image and process it into a data format using an image processing circuit. The data processed based on the image processor can be converted into plane image data by the plane image processing unit as circular image data.

The circular image data is converted into the plane image data (step S1140).

The circular image data can be converted from the circular image data to the plane image data through the Round To Rectangle Converter. Additional image processing (interpolation and correction, edge processing, etc.) can be performed on the planar image data. Various methods as described above can be used for conversion to planar image data and interpolation and correction for the converted image. For example, a method such as polar transformation can be used to convert from circular image data to planar image data. In addition, various methods as described above can be used for interpolation and correction of an image converted into a flat image, such as defective pixel correction, color interpolation, correction of corners, and edge transformation.

And outputs the final plane image (step S1160).

The final plane image can be outputted through the image processing based on step S1140.

As described above, an apparatus for generating a full azimuth plane image according to an embodiment of the present invention can operate in association with a smart phone.

As described above, an apparatus for generating a full azimuth plane image may be an image captured by a photographing unit of a smartphone and an apparatus for generating a full azimuth plane image in association with a processor of the smartphone, through a display of the smartphone .

Specifically, the front-facing optical lens unit of the apparatus for generating the front-facing plane image can be combined with the photographing unit of the smartphone. The frontal image processing unit and the planar image processing unit, which are the remaining components, may be implemented as one module with the frontal imaging optical lens unit, but the frontal image processing unit and the planar image processing unit may be implemented in connection with the processor of the smartphone.

That is, a circular distorted image obtained through the omnidirectional imaging optical lens unit can be subjected to image processing and planar image switching operation through the processor of the smartphone based on the application of the smartphone.

Further, the omnidirectional optical lens unit can be changed to a dummy camera by those skilled in the art. That is, the dummy camera includes an aspheric optical lens included in the omnidirectional optical lens unit, a plurality of associated spherical lenses and a lens barrel, and the frontal image processing unit further includes an image sensor, an image processing unit and a communication unit, It can also be used as a dummy camera. Also, it is preferable that the dummy camera does not include a shutter, a finder, a battery, and the like, such as a general camera.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims. It will be possible.

Claims (13)

A method for generating a full azimuth plane image,
Acquiring a full-defocus image through the full-deflection optical lens unit;
Processing the acquired full-deflection image based on an image sensor to generate prototype image data; And
Converting the circular image data to planar image data and performing additional image processing on the converted planar image data to generate a final output plane image,
Wherein the full-direction imaging optical lens unit has a horizontal angle of view of 360 degrees. 2. The method of claim 1, wherein obtaining a full-defocus image through the full-
Acquiring image information having the horizontal angle of view of 360 degrees through an aspherical optical lens; And
Rearranging and focusing the image information obtained through the aspherical optical lens through a plurality of associated spherical lenses,
Wherein the aspherical optical lens and the plurality of associated spherical lenses are arranged and fixed based on the lens barrel. The image processing method according to claim 2,
A bit-format data generated by converting the obtained full-direction image based on the image sensor,
Wherein the image sensor is a CCD or CMOS. 3. The method of claim 2, wherein converting the circular image data to planar image data and further image processing the converted planar image data to generate a final output plane image comprises:
Polar transformation of the circular image data into the plane image data; And
And performing at least one of pixel addition through interpolation, color correction, and edge transformation processing on the plane image data to generate the final output plane image. 5. The method of claim 4, wherein polar transformation of the circular image data into the plane image data comprises:
Is performed based on the following equation,
&Lt; Equation &

Where _x is the radius of the circular image data, c _x and c _y are positions on the xy axis of the center pixel of the circular image data, x _i and y _i are the pixel positions of the circular image data, x _f , y _f is the position of each pixel of the planar image data. 6. The image pickup apparatus according to claim 5, wherein the full-
And is adapted to acquire the full azimuth image in association with a photographing section of the smartphone,
Wherein the circular image data and the final output plane image are determined based on a processor of the smartphone. An apparatus for generating a full azimuth plane image,
A full-direction imaging optical lens unit for acquiring a full-deflection image through a plurality of optical lenses;
A full-direction image processing unit for processing the obtained full-deflection image through the full-deflection optical lens unit to generate circular image data; And
And a planar image processor for converting the circular image data into planar image data and performing additional image processing on the converted planar image data to generate a final output plane image,
Wherein the full-deflection optical lens unit has a horizontal angle of view of 360 degrees. 8. The image pickup apparatus according to claim 7, wherein the full-
An aspherical optical lens for acquiring image information having the horizontal angle of view of 360 degrees;
A plurality of sub-spherical lenses for rearranging and focusing the image information obtained through the aspherical optical lens; And
And a lens barrel arranged and fixing the aspherical optical lens and the plurality of associated spherical lenses. 9. The image processing method according to claim 8,
A bit-format data generated by converting the obtained full-direction image based on the image sensor,
Wherein the image sensor is a CCD or CMOS. The image processing apparatus according to claim 8,
The circular image data is polar transformed into the plane image data, and pixel addition, color correction, and edge transformation processing are performed on the plane image data by interpolation to generate the final output plane image A front azimuth plane image generating device. 11. The image processing apparatus according to claim 10,
And is configured to perform the polar conversion based on the following equation,
&Lt; Equation &

Where _x is the radius of the circular image data, c _x and c _y are positions on the xy axis of the center pixel of the circular image data, x _i and y _i are the pixel positions of the circular image data, x _f , y _f is the position of each pixel of the planar image data. 12. The method of claim 11,
Wherein the full-orientation imaging optical lens unit is implemented to acquire the full-azimuth image in association with a photographing unit of a smartphone,
Wherein the circular image data and the final output plane image are determined based on a processor of the smartphone. 13. The method according to any one of claims 7 to 12,
Wherein the omnidirectional imaging optical lens unit is a dummy camera.

Images