US20120114262A1 - Image correction method and related image correction system thereof - Google Patents

Image correction method and related image correction system thereof Download PDF

Info

Publication number
US20120114262A1
US20120114262A1 US13091137 US201113091137A US20120114262A1 US 20120114262 A1 US20120114262 A1 US 20120114262A1 US 13091137 US13091137 US 13091137 US 201113091137 A US201113091137 A US 201113091137A US 20120114262 A1 US20120114262 A1 US 20120114262A1
Authority
US
Grant status
Application
Patent type
Prior art keywords
corrected
image
pixel
coordinate transformation
processed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US13091137
Other versions
US9153014B2 (en )
Inventor
Chi-Chang Yu
Meng-Chun Lin
Homer H. Chen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
AviSonic Tech Corp
Original Assignee
AviSonic Tech Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration, e.g. from bit-mapped to bit-mapped creating a similar image
    • G06T5/006Geometric correction
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20021Dividing image into blocks, subimages or windows

Abstract

The present invention provides an image correction method and a related image correction system which can correct images captured via a fisheye lens or a ultra-wide angle lens camera so as to alleviate geometrical distortion in the images, and geometrically adjust the images according to user's requirements. Wherein, the present invention further enhances the processing performance of image correction computation by a memory allocation technique.

Description

    BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The present invention relates to image processing, and more particularly, to an image processing method for correcting geometrical distortion caused by fisheye lens or ultra-wide angle lens and related image processing system.
  • 2. Description of the Prior Art
  • Fisheye lens and ultra-wide angle lens are widely used in monitor cameras or general digital cameras. Though this type of camera may capture a scene that is in a quite large angle of view, the captured image is often accompanied with severe geometrical distortion, which will make a user unable to recognize some details in the captured image easily and clearly. In a worst case, the user may fail to recognize the image details due to the geometrical distortion. Therefore, images generated by fisheye lens and ultra-wide angle lens should be restored to images conforming to the original scenes for user's viewing by being processed by proper image processing techniques.
  • SUMMARY OF THE INVENTION
  • Therefore, the present invention provides an image correction method and related correction system that are utilized for correcting an image captured via a camera with fisheye lens or ultra-wide angle lens so as to alleviate the geometrical distortion of the captured images. Moreover, the image processing method and related image processing system of the present invention utilize a memory allocation technique which refers to an arrangement characteristic of reference data to thereby enhance processing speed of interpolation computation employed in the image correction. Besides, as a coordinate transformation method is required for processing the geometrical distortion, the present invention further provides a parameter estimation method for parameters utilized in the coordinate transformation method. The complicated process of obtaining parameters may be simplified according to the parameter estimation method of the present invention.
  • According to a first aspect of the present invention, an image correction method is provided. The image correction method is utilized for outputting a corrected image according to a method to be corrected, wherein the corrected image includes a plurality of corrected pixel blocks. Moreover, the image correction method performs a plurality of pixel value computations, and each pixel value computation is utilized for generating a pixel value of each corrected pixel within the corrected pixel block. The pixel value computation includes: establishing a coordinate transformation relation between the image to be corrected and the corrected image, such that a first coordinate value of each corrected pixel within the corrected pixel block corresponds to a second coordinate value within the image to be corrected; according to the coordinate transformation relation, determining a pixel block to be corrected corresponding to the corrected pixel block, for selecting a pixel block to be processed which at least includes the pixel block to be corrected from the image to be corrected, wherein the pixel block to be processed has a plurality of rows of pixels to be processed; temporarily storing the pixel value of each pixel to be processed into a memory device that has a plurality of memory banks, respectively, wherein the pixel value of different rows of pixels to be processed are temporarily stored into different memory banks of the memory device, respectively; and utilizing the second coordinate value corresponding to the corrected pixel for determining a plurality of specific pixels to be processed corresponding to the corrected pixel, and performing an interpolation computation when the memory device reads a plurality of pixel values of the plurality of specific pixels to be processed, for generating a pixel value of the corrected pixel. The plurality of pixel values of the plurality of specific pixels to be processed are stored into different memory banks, temporarily.
  • According to a second aspect of the present invention, an image correction method is provided. The image correction method is utilized for outputting a corrected image according to an image to be corrected, wherein the corrected image includes a plurality of corrected pixel blocks, and the image to be corrected is captured by a fisheye lens camera. Moreover, the image correction method performs a plurality of pixel value computations, and each pixel value computation is utilized for generating a pixel value of each corrected pixel within a corrected pixel block. The pixel value computation includes: establishing a coordinate transformation relation between the image to be corrected and the corrected image, such that a first coordinate value of each corrected pixel within the corrected pixel block corresponds to a second coordinate value within the image to be corrected, wherein the coordinate transformation relation is at least determined by a perspective distortion correction coordinate transformation, and within the perspective correction coordinate transformation, an angle parameter corresponding to an object plane and an image plane is determined by an incidence angle of an incident beam corresponding to the image to be corrected, and the incident beam transmits through an optical center of the fisheye lens; according to the coordinate transformation relation, determining a pixel block to be corrected corresponding to the corrected pixel block, for selecting a pixel block to be processed which at least includes the pixel block to be corrected from the image to be corrected; and utilizing the second coordinate value corresponding to the corrected pixel for determining a plurality of specific pixels to be processed corresponding to the corrected pixel, and utilizing the plurality of pixel values of the plurality of specific pixels to be processed to perform an interpolation computation, for generating a pixel value of the corrected pixel.
  • According to a third aspect of the present invention, an image correction system is provided. The image correction system is utilized for outputting a corrected image according to an image to be corrected. The corrected image includes a plurality of corrected pixel blocks, the image correction system performs a plurality of pixel value computations, and each pixel value computation is utilized for generating a pixel value of each corrected pixel within a corrected pixel block. The image correction system comprising: a coordinate transformation relation generating circuit, a block selecting circuit, a memory device and an interpolation computation circuit. The coordinate transformation relation generating circuit is utilized for establishing a coordinate transformation relation between the image to be corrected and the corrected image, such that a first coordinate value of each corrected pixel within the corrected pixel block corresponds to a second coordinate value within the image to be corrected. The block selecting circuit is coupled to the coordinate transformation relation generating circuit for according to the coordinate transformation relation, determining a pixel block to be corrected corresponding to the corrected pixel block, for selecting a pixel block to be processed which at least includes the pixel block to be corrected from the image to be corrected, wherein the pixel block to be processed has a plurality of rows of pixels to be processed. The memory device is coupled to the block selecting circuit and has a plurality of memory banks, for temporarily storing a pixel value of each pixel to be processed into the plurality of memory banks. The interpolation computation unit is coupled to the memory device and the coordinate transformation relation generating circuit, and utilizes the second coordinate value corresponding to the corrected pixel for determining the plurality of specific pixels to be processed corresponding to the corrected pixel, and performs an interpolation computation when the memory device reads the plurality of pixel values of the plurality of specific pixels to be processed, for generating a pixel value of the corrected pixel. The pixel values of different rows of the pixels to be processed are stored in different memory banks, temporarily.
  • According to a fourth exemplary embodiment of the present invention, an image correction system is provided. The image correction system is utilized for outputting a corrected image according to an image to be corrected, wherein the corrected image includes a plurality of corrected pixel blocks, and the image to be corrected is captured by a camera with fisheye lens. Moreover, the image correction system is utilized for performing a plurality of pixel value computations, and each pixel value computation is utilized for generating a pixel value of each corrected pixel within the corrected pixel block. The image correction system including: a coordinate transformation relation generating circuit, a block selecting circuit and an interpolation computation circuit. The coordinate transformation relation generating circuit is utilized for establishing a coordinate transformation relation between the image to be corrected and the corrected image, such that a first coordinate value of each corrected pixel within the corrected pixel block corresponds to a second coordinate value within the image to be corrected. The coordinate transformation relation generating circuit includes at least a perspective distortion correction coordinate transformation circuit, and the coordinate transformation relation is at least determined by the perspective distortion correction coordinate transformation circuit. An angle parameter utilized by the perspective correction coordinate transformation circuit corresponding to an object plane and an image plane is determined by an incidence angle of an incident beam corresponding to the image to be corrected, and the incident beam transmits through an optical center of the fisheye lens. The block selecting circuit is coupled to the coordinate transformation relation generating circuit for according to the coordinate transformation relation, determining a pixel block to be corrected corresponding to the corrected pixel block, for selecting a pixel block to be processed which at least includes the pixel block to be corrected from the image to be corrected. The interpolation computation circuit is coupled to the memory device and the coordinate transformation relation generating circuit, and utilizes the second coordinate value corresponding to the corrected pixel for determining the plurality of specific pixels to be processed corresponding to the corrected pixel, and utilizes the plurality of pixel values of the plurality of specific pixels to be processed to perform an interpolation computation for generating a pixel value of the corrected pixel.
  • These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a flowchart illustrating an image correction method according to an exemplary embodiment of the present invention.
  • FIG. 2 is a diagram illustrating the exemplary coordinate transformation relation between the image to be corrected and the corrected image according to the present invention.
  • FIG. 3 is a diagram illustrating the exemplary memory configuration according to the present invention.
  • FIG. 4 is a diagram illustrating the exemplary relation between the image to be corrected and the corrected image according to the present invention.
  • FIG. 5 is a diagram illustrating the determining manner of the coordinate transformation relation according to an exemplary embodiment of the present invention.
  • FIG. 6 is a diagram showing the cause of perspective distortion.
  • FIG. 7 is a diagram illustrating the principle of the parameter estimation according to an exemplary embodiment of the present invention.
  • FIG. 8 is a function block diagram illustrating the image correction system according to an exemplary embodiment of the present invention.
  • DETAILED DESCRIPTION
  • The final objective of the image correction of the present invention is to generate a corrected image by decreasing geometrical distortion of an image to be corrected that is captured by a camera with fisheye lens or ultra-wide angle lens. Before the corrected image is generated, the size of the corrected image has to be determined in advance (but it may be changed according to different requirements). Next, the corrected image is divided into a plurality of corrected pixel blocks that have the same size, and the corrected pixel blocks are processed by interpolation computation to thereby generate a pixel value (i.e., a grey value) of each pixel in each corrected pixel block one by one. Finally, the corrected image is output according to all computed pixel values.
  • For example, the image correction of the present invention may predetermine a size of a corrected image to be 640*480 pixels, and divide the corrected image into 8*8 corrected pixel blocks that have the same size. Therefore, each pixel block to be corrected includes 80*60 pixels (Please note that the numbers listed here are for illustrated purposes only, and are not meant to be limitations of the present invention). In the corrected image, the interpolation computation for generating a pixel value of each corrected pixel requires to find out its related position (i.e., a coordinate value) within the image to be corrected via coordinate transformation. The interpolation computation further finds out a plurality of pixel values of a plurality of pixels adjacent to the related position according to the related position, and utilizes these pixel values to perform interpolation computation to determine the pixel value of the corrected pixel. Therefore, the image correction of the present invention has to perform a plurality of pixel value computations, wherein each pixel value computation will generate a pixel value of each corrected pixel within a corrected pixel block. Taking the numbers listed above for example, each pixel value computation will obtain 80*60 pixel values of the corrected pixels. Please refer to FIG. 1 for the detailed illustration of these operations. FIG. 1 is a flowchart illustrating a pixel value computation of the correction method of the present invention.
  • Please note that the flowchart shown in FIG. 1 only represents one of exemplary embodiments of the pixel value computation of the correction method according to the present invention. In other exemplary embodiments of the present invention, other steps different from the steps shown in FIG. 1 are may be included.
  • First, in step 101, the pixel value computation of the present invention establishes a coordinate transformation relation between the image to be corrected and the corrected image, so that a first coordinate value (Xc, Yc) of each corrected pixel within the corrected pixel block corresponds to a second coordinate value (Xd, Yd) within the image to be corrected. Taking FIG. 2 for example, a plurality of boundary pixels (i.e., the pixels included in dotted-line frame 201) of a corrected pixel block A within the corrected image obtain their related coordinate values (i.e., the pixels included in solid-line frame 202) within the image to be corrected via the coordinate transformation relation. In other words, the first coordinate value (Xc, Yc) of each corrected pixel included in the dotted-line frame 210 within the corrected image will be projected to a second coordinate value (Xd, Yd) within the image to be corrected. On the other hand, the image at the second coordinate value (Xd, Yd) within the image to be corrected will be restored via the coordinate transformation relation, and this image will be established at the position of the first coordinate value (Xc, Yc) within the corrected image. Therefore, the coordinate transformation relation determines the improvement of the geometrical distortion.
  • Next, after the coordinate transformation relation is established, step 103 determines a pixel block to be corrected corresponding to the corrected pixel block according to the coordinate transformation relation, and then selects a pixel block to be processed which includes at least the pixel block to be corrected within the image to be corrected. In detail, the coordinate transformation relation may obtain the related coordinate (i.e., the second coordinate value) of each corrected pixel within the corrected pixel block in the image to be corrected. Therefore, if it is required to find out pixel values of all corrected pixels within the corrected pixel block, the related coordinate is needed for determining which part of the image to be corrected to which the corrected pixel block is related (i.e., which part of a restored image for the image to be corrected that is represented by the corrected pixel block). So, the second coordinate value corresponding to the boundary pixel within the corrected pixel block determines the partial image to be corrected within the image to be corrected. Please refer to FIG. 2 for details of this step. The boundary pixels of the corrected pixel block A (i.e., the pixels included in the dotted-line frame 201) correspond to a plurality of coordinate points in the solid-line frame 202 within the image to be corrected via the coordinate transformation relation established in step 101, and the partial image within the block included in the solid-line frame 202 (i.e., the pixel block A′ to be corrected) is the partial image to be corrected by the corrected pixel block A. Next, after the pixel block A′ to be corrected is determined, in order to facilitate data buffering of the pixel block A′ to be corrected, the present invention further selects a rectangular-shaped pixel block A″ to be processed which includes at least the pixel block A′ to be corrected. The pixel values of the pixels to be processed within the pixel block A″ to be processed provide essential information needed by the interpolation computation used to find out the pixel value of each pixel within the corrected pixel block A.
  • In step 105, after the pixels included in the pixel block A″ to be processed are determined, the present invention further temporarily stores pixel value of each pixel to be processed into a memory device which has a plurality of memory banks (e.g. a static random access memory, SRAM) according to an arrangement relation of a plurality of pixels to be processed within the pixel block A″ to be processed, where the buffered pixel values are waiting to be used by the following interpolation computation. This step utilizes a memory allocation technique provided by the present invention, and the main objective of the proposed memory allocation technique is to accelerate the speed of reading the stored pixel values for interpolation computation. Taking a pixel P within the corrected pixel block A for example, the second coordinate position within the image to be corrected is P′. Therefore, when the interpolation computation is computing the pixel value of the pixel P, the pixel values of a plurality of specific pixels (4*4 pixels) to be processed which are adjacent to the point P′ and are included in the dotted-line frame 203 (i.e., the pixel block A″ to be processed) are used by the interpolation computation. Therefore, the concept of the memory allocation technique of the present invention is to read pixel values of all the specific 4*4 pixels to be processed in one read cycle of the memory device. Thus, the step 105 stores all pixel values into the memory device according to the pixel arrangement relation within the pixel block A″ to be processed, and temporarily stores the pixel values of the specific pixels to be processed into different memory banks.
  • Please further refer to FIG. 2 and FIG. 3 for further description of the memory allocation technique. As shown in FIG. 2, one interpolation computation requires information of pixel values of 4*4 pixels, so the pixel values of the 4*4 pixels to be processed that are included in the dotted-line frame 203 (i.e., the pixel block A″ to be processed) are respectively stored into memory banks A-D of the memory device 300 shown in FIG. 3 according to the row at which the pixels are located. For example, the pixel values of the pixels to be processed that are located at the first row 2031 of the 4*4 pixels to be processed that are included in the dotted-line frame 203 (i.e., the pixel block A″ to be processed) will be stored into the memory bank A, and the pixel values of the pixels to be processed that are located at the second row 2032 will be stored into the memory bank B, and the pixel values of the pixels to be processed that are located at the third row 2033 will be stored into the memory bank C, and the pixel values of the pixels to be processed that are located at the fourth row 2034 will be stored into the memory bank D. Please note that the memory configuration manner mentioned above is for illustrative purposes only, and is not meant to be a limitation of the present invention. In general, the characteristics of the memory allocation technique of the present invention include: (1) In the memory device, among a plurality of pixel values of a plurality of specific pixels to be processed during one interpolation computation, pixel values of pixels to be processed that are respectively located at different rows are temporarily stored into different memory banks of the memory device. In other words, as to one block to be processed (i.e., the pixel block A″ to be processed), pixel values of pixels located at different rows will not be temporarily stored into different row addresses of the same memory bank, and (2) If the number of the specific pixels to be processed for one interpolation computation is m*n, the number of memory banks of the memory device is m, where m and n are both positive integers. So, the pixel values of the specific pixels to be processed which one interpolation computation requires may be read during one read cycle of the memory device, thereby increasing the processing speed of the interpolation computation. Finally, regarding each corrected pixel, the step 107 first utilizes the second coordinate value (e.g., the coordinate value of the point P″) corresponding to the corrected pixel (e.g., pixel P) to determine the specific pixels to be processed (e.g., 4*4 pixels included in the dotted-line frame 203) corresponding to the corrected pixel (e.g., pixel P), and generates a pixel value of the corrected pixel by performing an interpolation computation upon pixel values of the specific pixels to be processed that are read from the memory device. Please note that the some values are mentioned in above paragraph for illustrative purposes; however, in the present invention, the number of pixels utilized by the interpolation computation is not limited. So, under different design consideration, the number of pixels utilized by the interpolation computation of the present invention may be different.
  • The steps 101-107 mentioned above represent the process of one pixel value computation of the present invention. A plurality of interpolation computations may be performed for generating pixel values of all corrected pixels within a corrected pixel block. So, after a plurality of pixel value computations are executed, a corrected image with less geometrical distortion is generated when compared with an original image that is not processed by image correction yet.
  • Since the image to be corrected that is captured by a camera with fisheye lens or ultra-wide angle lens includes image information of a large scope, and all of the image information is projected to a comparatively small image sensing area, resulting in obvious geometrical distortion due to the fact that many lines within the original image to be corrected are squeezed and distorted. So the present invention utilizes fisheye distortion correction technique to restore those distorted lines within the original image to be corrected to non-distorted lines. Moreover, when the fisheye lens or the ultra-wide angle lens camera is capturing an image, as the scope of the scene being captured is too large, the scene is not completely parallel within the plane that the image sensing area is located. As a result, the captured image is often accompanied with perspective distortion. In order to solve the problem of perspective distortion, the present invention also restores the original image to be corrected to a non-distorted image through perspective distortion correction technique. So, the image processing method of the present invention performs at least the fisheye distortion correction and the perspective distortion correction. Therefore, the coordinate transformation relation of the present invention is determined by at least the coordinate transformation of fisheye distortion correction and the coordinate transformation of perspective distortion correction. Generally, the aforementioned first coordinate value (Xc, Yc) of the corrected pixel is transformed to the second coordinate value (Xd, Yd) via coordinate transformation of fisheye distortion correction and coordinate transformation of perspective distortion correction. However, in order to more closely meet user's requirements for adjusting images geometrically, the coordinate transformation relation in other exemplary embodiments of the present invention is further determined by scaling coordinate transformation, zoom coordinate transformation, perspective compensation coordinate transformation, vertical and horizontal line compensation coordinate transformation and rotation coordinate transformation, wherein the parameters thereof may be adjusted by the user according to users' visual feeling. For example, if the user feels that the objects displayed in the corrected image are not large enough, the user may choose to adjust proper parameter values of vertical and horizontal scaling ratios, and these parameters will be utilized for scaling the coordinate transformation to affect the whole coordinate transformation relation. In this way, the size and aspect ratio of the corrected image are changed. Moreover, the user may determine which part within the image to be corrected is to be restored. Taking the image to be corrected and the corrected image shown in FIG. 4 for example, as can be seen from FIG. 4, the image data included in the corrected image is only part of the original image to be corrected. Regarding this operation, the user may select a reference center from the image to be corrected, and the position of the selected reference center is referred to for establishing the coordinate transformation relation. After this reference center is determined, only image of a specific scope which is extended from the reference center is restored. So, when the coordinate transformation relation is being established, the corrected pixels located at the most peripheral part of the corrected image only correspond to the boundary part of the specific scope. Therefore, by selecting a different reference center, the user may select the part within the image to be corrected that is desired to be restored.
  • FIG. 5 shows the relation between different coordinate transformations and coordinate values. As those skilled in the art can readily understand details of these coordinate transformations, further description is omitted here for brevity.
  • Moreover, the present invention particularly provides a simpler estimating method for the parameter utilized in the coordinate transformation of perspective distortion correction, which may improve the efficiency of the image correction process. First, please refer to FIG. 6 which simply shows the cause of perspective distortion. Basically, the cause of perspective distortion is that the object plane OP is not parallel with the image plane IP. Since there is an included angle φ between the two planes, two segments R1 and R2 which have different lengths in the object plane OP will form segments R1′ and R2′ which have the same length when projected to the image plane IP through the lens 600. The image on the image plane IP is different from the actual object on the object plane OP, leading to perspective distortion. So, if the perspective distortion is to be corrected, the actual value of the included angle φ must be known. However, as to the fisheye lens or ultra-wide angle lens, the characteristics of this type of lens are different from that of the general lens. Thus, it is quite difficult to estimate the value of the included angle φ. Therefore, the present invention provides a simpler way for estimating the value of the included angle φ.
  • Please refer to FIG. 7 for details of the aforementioned estimating method. As shown in the figure, there is an included angle φ between the object plane OP and the image plane IP. Theoretically, an incident beam LN originated from a point X of the object plane and passing through the optical center OC of the fisheye lens 600 will form an image at the position X′ on the image plane IP. However, if the incident angle θ of the incident beam LN passing through the optical center OC equals the refraction angle θ of the refraction beam LN′, the refraction beam LN′ will intersect with a virtual curved surface FLR at an intersection point X″. Therefore, as shown in the figure, the included φ′ between a virtual image plane IP' tangent to the point X″ of the virtual curved surface FLR and the original image plane will be equal to the included angle φ and the incident angle θ. In brief, the present invention employs the virtual curved surface FLR to compensate for the assumption that the relation of the incident angle and the refraction angle of the fisheye lens can be simplified. Therefore, the phenomenon φ=θ may be easily utilized for determining the angel parameter φ required by perspective distortion correction. Besides, the user may further adjust the angle parameter φ estimated by the aforementioned estimating method according to his/her visual feeling (e.g., user's visual feeling of the corrected image) to improve the accuracy of the angle parameter φ.
  • The exemplary embodiments of the present invention further provide an image correction system designed according to the aforementioned image correction method. Please refer to FIG. 8, which is a function block diagram of the image correction system 800. As shown in the figure, the image correction system 800 includes a coordinate transformation relation generating circuit 801, a block selecting circuit 802, a memory device 803 and an interpolation computation circuit 804. The image correction system 800 is utilized for outputting a corrected image Pic′ according to an image Pic to be corrected that is derived from an image source 810, wherein the image source 810 may be a real-time image captured by a fisheye lens or an ultra-wide angle lens camera, or a static image stored in a storage device. Moreover, the image correction system 800 is utilized for performing a plurality of pixel value calculations, where each pixel value calculation is utilized for generating pixel value of each corrected pixel within one corrected pixel block of the corrected image Pic′. Moreover, the coordinate transformation relation generating circuit 801 is utilized for establishing a coordinate transformation relation between the image Pic to be corrected and the corrected image Pic′, such that a first coordinate value of each corrected pixel within the corrected pixel block corresponds to a second coordinate value within the image to be corrected. The coordinate transformation relation generating circuit 801 determines the coordinate transformation relation by referring to the image size of the corrected image Pic′ and the coordinate transformation parameters (e.g., the reference center and the angle parameter φ). The block selecting circuit 802 is coupled to the coordinate transformation relation generating circuit 801, and utilized for referring to the coordinate transformation relation to select a pixel block to be processed (which includes at least the pixel block to be corrected) from the image Pic to be corrected. The memory device 803 is coupled to the block selecting circuit 802, and has a plurality of memory banks used for temporarily storing a pixel value of each pixel to be processed, wherein the pixel block to be processed has a plurality of rows of pixels to be processed, and pixel values of pixels to be processed that are located in different rows are temporarily stored in different memory banks of the memory device 803. The memory device 803 may be a static random access memory (SRAM). Moreover, the interpolation computation circuit 804 is coupled to the memory device 803 and the coordinate transformation relation generating circuit 801. The interpolation computation circuit 804 utilizes the second coordinate value corresponding to the corrected pixel for determining a plurality of specific pixels to be processed that correspond to the corrected pixel, reads a plurality of pixel values of the specific pixels to be processed from the memory device 803, and generates a pixel value of the corrected pixel by performing an interpolation computation upon the pixel values of the specific pixels to be processed. Therefore, pixel values of all pixels within the corrected image Pic′ may be derived by the image correction system 800 executing a plurality of pixel value computations, and then the image correction system 800 outputs the corrected image Pic′. Since the image correction system 800 is designed according to the aforementioned image correction method, the detailed function and operation principle of each circuit within the image correction system 800 are similar to the image correction method described above. Please refer to above specification paragraphs directed to the image correction method. Thus, further description is omitted here for brevity.
  • The following only describes features of the coordinate transformation relation generating circuit 801. As the image correction of the present invention requires to perform at least the fisheye correction and the perspective correction, the coordinate transformation relation generating circuit 801 of the present invention includes at least a coordinate transformation circuit of the fisheye correction and a coordinate transformation circuit of the perspective correction (not shown). Generally, the coordinate transformation relation determined by the coordinate transformation relation generating circuit 801 is determined by at least the coordinate transformation circuit of the fisheye correction and the coordinate transformation circuit of the perspective correction. However, in order to more closely meet the user's requirements for adjusting an image geometrically, the coordinate transformation relation generating circuit 801 in other exemplary embodiments of the image correction system of the present invention further includes a scaling coordinate transformation circuit, a zoom coordinate transformation circuit, a perspective compensation coordinate transformation circuit, a vertical and horizontal line compensation coordinate transformation circuit and a rotation coordinate transformation circuit. Please refer to FIG. 5 for the relation between these circuits and the first and second coordinate values. Please note that the present invention does not limit the type and number of the coordinate transformation circuits included in the coordinate transformation relation generating circuit. In other words, under the premise of not departing from the main concept of the present invention, the coordinate transformation relation generating circuit of the present invention may include coordinate transformation types more than or less than that shown in FIG. 5. Besides, the geometrical adjustments available to the user may vary according to the actual design of coordinate transformation relation generating circuit.
  • In summary, regarding the image captured by a fisheye lens or an ultra-wide angle lens camera, the present invention provides an image correction system and an image correction method which have a favorable computation speed and correction effect. In addition, the user may adjust the corrected image according to personal preference to thereby have best visual experience.
  • Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention.

Claims (10)

  1. 1. An image correction method, for outputting a corrected image according to an image to be corrected, the corrected image comprising a plurality of corrected pixel blocks, the image correction method performing a plurality of pixel value computations, each pixel value computation being utilized for generating a pixel value of each corrected pixel within a corrected pixel block, and comprising:
    establishing a coordinate transformation relation between the image to be corrected and the corrected image, such that a first coordinate value of each corrected pixel within the corrected pixel block corresponds to a second coordinate value within the image to be corrected;
    according to the coordinate transformation relation, determining a pixel block to be corrected corresponding to the corrected pixel block, and selecting a pixel block to be processed which comprises at least the pixel block to be corrected from the image to be corrected, wherein the pixel block to be processed has a plurality of rows of pixels to be processed;
    temporarily storing a pixel value of each pixel to be processed into a memory device having a plurality of memory banks, wherein pixel values of pixels to be processed that are located at different rows are temporarily stored into different memory banks of the memory device, respectively; and
    utilizing the second coordinate value corresponding to the corrected pixel for determining a plurality of specific pixels to be processed that correspond to the corrected pixel, reading a plurality of pixels values of the specific pixels to be processed from the memory device, and generating a pixel value of the corrected pixel by performing an interpolation computation upon the pixels values of the specific pixels;
    wherein the pixel values of the specific pixels to be processed are temporarily stored in different memory banks.
  2. 2. The image correction method of claim 1, wherein a number of the specific pixels to be processed is m*n, a number of the memory banks within the memory device is m, and m and n are both positive integers.
  3. 3. The image correction method of claim 1, wherein the image to be corrected is captured via a fisheye lens camera.
  4. 4. The image correction method of claim 3, wherein the coordinate transformation relation is determined by at least a perspective distortion correction coordinate transformation; and in the perspective distortion correction coordinate transformation, an angle parameter corresponding to an object plane and an image plane is determined by an incidence angle of an incident beam corresponding to the image to be corrected, where the incident beam passes through an optical center of the fisheye lens.
  5. 5. An image correction method, for outputting a corrected image according to an image to be corrected, the corrected image comprising a plurality of corrected pixel blocks, the image to be corrected being captured by a fisheye lens camera, the image correction method performing a plurality of pixel value computations, each pixel value computation being utilized for generating a pixel value of each corrected pixel within a corrected pixel block, and comprising:
    establishing a coordinate transformation relation between the image to be corrected and the corrected image, such that a first coordinate value of each corrected pixel within the corrected pixel block corresponds to a second coordinate value within the image to be corrected, wherein the coordinate transformation relation is determined by at least a perspective distortion correction coordinate transformation, and in the perspective correction distortion coordinate transformation, an angle parameter corresponding to an object plane and an image plane is determined by an incidence angle of an incident beam corresponding to the image to be corrected, where the incident beam passes through an optical center of the fisheye lens;
    according to the coordinate transformation relation, determining a pixel block to be corrected that corresponds to the corrected pixel block, and selecting a pixel block to be processed which comprises at least the pixel block to be corrected from the image to be corrected; and
    utilizing the second coordinate value corresponding to the corrected pixel for determining a plurality of specific pixels to be processed that correspond to the corrected pixel, and generating a pixel value of the corrected pixel by performing an interpolation computation upon a plurality of pixel values of the specific pixels to be processed.
  6. 6. An image correction system, for outputting a corrected image according to an image to be corrected, the corrected image comprising a plurality of corrected pixel blocks, the image correction system performing a plurality of pixel value computations, each pixel value computation being utilized for generating a pixel value of each corrected pixel within a corrected pixel block, the image correction system comprising:
    a coordinate transformation relation generating circuit, for establishing a coordinate transformation relation between the image to be corrected and the corrected image, such that a first coordinate value of each corrected pixel within the corrected pixel block corresponds to a second coordinate value within the image to be corrected;
    a block selecting circuit, coupled to the coordinate transformation relation generating circuit, for referring to the coordinate transformation relation for determining a pixel block to be corrected that corresponds to the corrected pixel block, and selecting a pixel block to be processed which comprises at least the pixel block to be corrected from the image to be corrected, wherein the pixel block to be processed has a plurality of rows of pixels to be processed;
    a memory device, coupled to the block selecting circuit, the memory device having a plurality of memory banks for temporarily storing a pixel value of each pixel to be processed; and
    an interpolation computation circuit, coupled to the memory device and the coordinate transformation relation generating circuit, the interpolation computation circuit utilizing the second coordinate value corresponding to the corrected pixel for determining the specific pixels to be processed that correspond to the corrected pixel, reading a plurality of pixel values of the specific pixels to be processed from the memory device, and generating a pixel value of the corrected pixel by performing an interpolation computation upon the pixel values of the specific pixels to be processed;
    wherein the pixel values of the specific pixels to be processed are temporarily stored in different memory banks.
  7. 7. The image correction system of claim 6, wherein a number of the specific pixels to be processed is m*n, a number of the memory banks within the memory device is m, and m and n are both positive integers.
  8. 8. The image correction system of claim 6, wherein the image to be corrected is captured via a fisheye lens camera.
  9. 9. The image correction system of claim 8, wherein the coordinate transformation relation generating circuit comprises at least a perspective distortion correction coordinate transformation circuit, and the coordinate transformation relation is determined by at least the perspective distortion correction coordinate transformation circuit, and an angle parameter utilized in the perspective distortion correction coordinate transformation circuit and corresponding to an object plane and an image plane is determined by an incidence angle of an incident beam corresponding to the image to be corrected, where the incident beam passes through an optical center of the fisheye lens.
  10. 10. An image correction system, for outputting a corrected image according to an image to be corrected, the corrected image comprising a plurality of corrected pixel blocks, the image to be corrected being captured by a fisheye lens camera, the image correction system performing a plurality of pixel value computations, each pixel value computation being utilized for generating a pixel value of each corrected pixel within the corrected pixel block, the image correction system comprising:
    a coordinate transformation relation generating circuit, for establishing a coordinate transformation relation between the image to be corrected and the corrected image, such that a first coordinate value of each corrected pixel within the corrected pixel block corresponds to a second coordinate value within the image to be corrected, wherein the coordinate transformation relation generating circuit comprises at least a perspective distortion correction coordinate transformation circuit, and the coordinate transformation relation is determined by at least the perspective distortion correction coordinate transformation circuit, and an angle parameter utilized by the perspective distortion correction coordinate transformation circuit and corresponding to an object plane and an image plane is determined by an incidence angle of an incident beam corresponding to the image to be corrected, where the incident beam passes through an optical center of the fisheye lens;
    a block selecting circuit, coupled to the coordinate transformation relation generating circuit, for referring to the coordinate transformation relation for determining a pixel block to be corrected that corresponds to the corrected pixel block, and selecting a pixel block to be processed which comprises at least the pixel block to be corrected from the image to be corrected; and
    an interpolation computation circuit, coupled to the coordinate transformation relation generating circuit, the interpolation computation circuit utilizing the second coordinate value corresponding to the corrected pixel for determining a plurality of specific pixels to be processed that correspond to the corrected pixel, and generating a pixel value of the corrected pixel by performing an interpolation computation upon a plurality of pixel values of the specific pixels to be processed.
US13091137 2010-11-09 2011-04-21 Image correction method and related image correction system thereof Active 2033-07-11 US9153014B2 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
TW099138502A 2010-11-09
TW099138502 2010-11-09
TW99138502 2010-11-09

Publications (2)

Publication Number Publication Date
US20120114262A1 true true US20120114262A1 (en) 2012-05-10
US9153014B2 US9153014B2 (en) 2015-10-06

Family

ID=46019691

Family Applications (1)

Application Number Title Priority Date Filing Date
US13091137 Active 2033-07-11 US9153014B2 (en) 2010-11-09 2011-04-21 Image correction method and related image correction system thereof

Country Status (2)

Country Link
US (1) US9153014B2 (en)
JP (1) JP5437311B2 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130016918A1 (en) * 2011-07-13 2013-01-17 Akshayakumar Haribhatt Wide-Angle Lens Image Correction
CN103325109A (en) * 2013-05-29 2013-09-25 山西绿色光电产业科学技术研究院(有限公司) Method used for correcting distortion of fish-eye image and applicable to wall-mounted panoramic video camera
US20140341461A1 (en) * 2012-01-31 2014-11-20 Hitachi, High-Technologies Corporation Image processing apparatus, distortion-corrected map creation apparatus, and semiconductor measurement apparatus
US9153014B2 (en) * 2010-11-09 2015-10-06 Avisonic Technology Corporation Image correction method and related image correction system thereof
CN104994308A (en) * 2015-06-30 2015-10-21 广东欧珀移动通信有限公司 Method and device for shooting fisheye image
US9196022B2 (en) 2014-03-10 2015-11-24 Omnivision Technologies, Inc. Image transformation and multi-view output systems and methods
US20160189350A1 (en) * 2014-12-30 2016-06-30 Texas Instruments Incorporated System and method for remapping of image to correct optical distortions
US9574989B2 (en) 2014-08-08 2017-02-21 Omnivision Technologies, Inc. Lens-free imaging system and method for detecting particles in sample deposited on image sensor
US9959601B2 (en) * 2015-06-30 2018-05-01 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Distortion rectification method and terminal

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101589167B1 (en) * 2015-02-09 2016-01-27 동의대학교 산학협력단 System and Method for Correcting Perspective Distortion Image Using Depth Information
US20160284064A1 (en) * 2015-03-27 2016-09-29 Canon Kabushiki Kaisha Information processing apparatus, information processing method, and medium
KR101714213B1 (en) * 2015-09-09 2017-03-09 현대오트론 주식회사 Apparatus for revising image distortion of lens

Citations (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4790028A (en) * 1986-09-12 1988-12-06 Westinghouse Electric Corp. Method and apparatus for generating variably scaled displays
US5185667A (en) * 1991-05-13 1993-02-09 Telerobotics International, Inc. Omniview motionless camera orientation system
US5313306A (en) * 1991-05-13 1994-05-17 Telerobotics International, Inc. Omniview motionless camera endoscopy system
US5359363A (en) * 1991-05-13 1994-10-25 Telerobotics International, Inc. Omniview motionless camera surveillance system
US5796426A (en) * 1994-05-27 1998-08-18 Warp, Ltd. Wide-angle image dewarping method and apparatus
US5903319A (en) * 1991-05-13 1999-05-11 Interactive Pictures Corporation Method for eliminating temporal and spacial distortion from interlaced video signals
US20010017628A1 (en) * 2000-02-28 2001-08-30 Toshio Sunaga Image memory chip and method for storing data
US20010055427A1 (en) * 1999-01-26 2001-12-27 Smith Freeman Method of memory utilization in a predictive video decoder
US6496192B1 (en) * 1999-08-05 2002-12-17 Matsushita Electric Industrial Co., Ltd. Modular architecture for image transposition memory using synchronous DRAM
US6603502B2 (en) * 1991-05-13 2003-08-05 Internet Pictures Corporation System for omnidirectional image viewing at a remote location without the transmission of control signals to select viewing parameters
US20040076336A1 (en) * 2002-06-12 2004-04-22 Bassi Zorawar S. System and method for electronic correction of optical anomalies
US20040263523A1 (en) * 1993-10-15 2004-12-30 Hitachi, Ltd. Data processing system and image processing system
EP1600890A2 (en) * 2004-05-28 2005-11-30 Kabushiki Kaisha Toshiba Distortion correction of fish-eye image
US20060007235A1 (en) * 2004-07-12 2006-01-12 Hua-Chang Chi Method of accessing frame data and data accessing device thereof
US20060110050A1 (en) * 2002-08-20 2006-05-25 Sony Corporation Image processing device, image processing system, and image processing method
US7061497B2 (en) * 2003-03-19 2006-06-13 Lg Electronics Inc. Memory access control apparatus
US20070171288A1 (en) * 2004-03-25 2007-07-26 Yasuaki Inoue Image correction apparatus and method, image correction database creating method, information data provision apparatus, image processing apparatus, information terminal, and information database apparatus
US20070236595A1 (en) * 2006-04-10 2007-10-11 Sony Taiwan Limited. Method for Improving Image Stitching Accuracy with Lens Distortion Correction and Device for Implementing the Same
US7340558B2 (en) * 2000-11-22 2008-03-04 Silicon Image, Inc. Multisection memory bank system
US20080129723A1 (en) * 2006-11-30 2008-06-05 Comer Robert P System and method for converting a fish-eye image into a rectilinear image
US20080144968A1 (en) * 2006-12-15 2008-06-19 Microsoft Corporation Dynamic viewing of wide angle images
US20080158226A1 (en) * 2006-12-19 2008-07-03 California Institute Of Technology Imaging model and apparatus
US20090058866A1 (en) * 2006-02-28 2009-03-05 Shanghai Magima Digital Information Co., Ltd. Method for mapping picture addresses in memory
US20090087115A1 (en) * 2007-10-02 2009-04-02 Ping Wah Wong Correction for geometric distortion in images in pipelined hardware
US20100111440A1 (en) * 2008-10-31 2010-05-06 Motorola, Inc. Method and apparatus for transforming a non-linear lens-distorted image
US7714936B1 (en) * 1991-05-13 2010-05-11 Sony Corporation Omniview motionless camera orientation system
US20100119172A1 (en) * 2008-11-12 2010-05-13 Chi-Chang Yu Fisheye Correction with Perspective Distortion Reduction Method and Related Image Processor
US20100254602A1 (en) * 2009-04-07 2010-10-07 Dai Nippon Printing Co., Ltd. Image processing apparatus and method and a computer-readable recording medium on which an image processing program is stored
US7852376B2 (en) * 1998-05-27 2010-12-14 Ju-Wei Chen Image-based method and system for building spherical panoramas
US7893972B2 (en) * 2002-06-04 2011-02-22 Aptina Imaging Corporation Method and apparatus for real time identification and correction of pixel defects for image sensor arrays
US20110194606A1 (en) * 2010-02-09 2011-08-11 Cheng-Yu Hsieh Memory management method and related memory apparatus
US20120045100A1 (en) * 2010-08-20 2012-02-23 Tomohide Ishigami Position measuring apparatus, position measuring method, image processing apparatus and image processing method
US20120147023A1 (en) * 2010-12-14 2012-06-14 Electronics And Telecommunications Research Institute Caching apparatus and method for video motion estimation and compensation

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05101221A (en) 1991-10-04 1993-04-23 Mitsubishi Heavy Ind Ltd Image distortion corrector
JPH0636020A (en) 1992-07-17 1994-02-10 Matsushita Electric Ind Co Ltd Image pickup monitoring device
JP3291070B2 (en) 1993-05-25 2002-06-10 株式会社リコー Data transposing apparatus
JPH0915303A (en) 1995-06-28 1997-01-17 Hitachi Electron Eng Co Ltd Ic tester
JP4596986B2 (en) 2005-06-07 2010-12-15 オリンパス株式会社 Imaging apparatus
JP2008061172A (en) 2006-09-04 2008-03-13 Sony Corp Image processing apparatus, image processing method and program therefor and recording medium with the program stored
CN100504909C (en) 2006-11-07 2009-06-24 中国物品编码中心 Method for correcting distortion of two-dimension bar figure
WO2009013845A1 (en) 2007-07-20 2009-01-29 Techwell Japan K.K. Image processing device and camera system
JP5187602B2 (en) 2008-09-19 2013-04-24 コニカミノルタホールディングス株式会社 Image distortion correction method and image processing apparatus
JP5197316B2 (en) 2008-11-19 2013-05-15 オリンパスイメージング株式会社 Camera system
CN101742125B (en) 2008-11-27 2012-07-04 义晶科技股份有限公司 Image processing method and associated device for correcting fisheye image and reducing perspective distortion
US9153014B2 (en) * 2010-11-09 2015-10-06 Avisonic Technology Corporation Image correction method and related image correction system thereof

Patent Citations (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4790028A (en) * 1986-09-12 1988-12-06 Westinghouse Electric Corp. Method and apparatus for generating variably scaled displays
US6603502B2 (en) * 1991-05-13 2003-08-05 Internet Pictures Corporation System for omnidirectional image viewing at a remote location without the transmission of control signals to select viewing parameters
US5185667A (en) * 1991-05-13 1993-02-09 Telerobotics International, Inc. Omniview motionless camera orientation system
US5313306A (en) * 1991-05-13 1994-05-17 Telerobotics International, Inc. Omniview motionless camera endoscopy system
US5359363A (en) * 1991-05-13 1994-10-25 Telerobotics International, Inc. Omniview motionless camera surveillance system
USRE36207E (en) * 1991-05-13 1999-05-04 Omniview, Inc. Omniview motionless camera orientation system
US5903319A (en) * 1991-05-13 1999-05-11 Interactive Pictures Corporation Method for eliminating temporal and spacial distortion from interlaced video signals
US20110007129A1 (en) * 1991-05-13 2011-01-13 Sony Corporation Omniview motionless camera orientation system
US7714936B1 (en) * 1991-05-13 2010-05-11 Sony Corporation Omniview motionless camera orientation system
US20040263523A1 (en) * 1993-10-15 2004-12-30 Hitachi, Ltd. Data processing system and image processing system
US20020063802A1 (en) * 1994-05-27 2002-05-30 Be Here Corporation Wide-angle dewarping method and apparatus
US5796426A (en) * 1994-05-27 1998-08-18 Warp, Ltd. Wide-angle image dewarping method and apparatus
US7852376B2 (en) * 1998-05-27 2010-12-14 Ju-Wei Chen Image-based method and system for building spherical panoramas
US20010055427A1 (en) * 1999-01-26 2001-12-27 Smith Freeman Method of memory utilization in a predictive video decoder
US6496192B1 (en) * 1999-08-05 2002-12-17 Matsushita Electric Industrial Co., Ltd. Modular architecture for image transposition memory using synchronous DRAM
US6819323B2 (en) * 2000-02-28 2004-11-16 International Business Machines Corporation Structure and method for gaining fast access to pixel data to store graphic image data in memory
US20010017628A1 (en) * 2000-02-28 2001-08-30 Toshio Sunaga Image memory chip and method for storing data
US7340558B2 (en) * 2000-11-22 2008-03-04 Silicon Image, Inc. Multisection memory bank system
US7893972B2 (en) * 2002-06-04 2011-02-22 Aptina Imaging Corporation Method and apparatus for real time identification and correction of pixel defects for image sensor arrays
US20040076336A1 (en) * 2002-06-12 2004-04-22 Bassi Zorawar S. System and method for electronic correction of optical anomalies
US7474799B2 (en) * 2002-06-12 2009-01-06 Silicon Optix Inc. System and method for electronic correction of optical anomalies
US20060110050A1 (en) * 2002-08-20 2006-05-25 Sony Corporation Image processing device, image processing system, and image processing method
US7061497B2 (en) * 2003-03-19 2006-06-13 Lg Electronics Inc. Memory access control apparatus
US20070171288A1 (en) * 2004-03-25 2007-07-26 Yasuaki Inoue Image correction apparatus and method, image correction database creating method, information data provision apparatus, image processing apparatus, information terminal, and information database apparatus
EP1600890A2 (en) * 2004-05-28 2005-11-30 Kabushiki Kaisha Toshiba Distortion correction of fish-eye image
US20060007235A1 (en) * 2004-07-12 2006-01-12 Hua-Chang Chi Method of accessing frame data and data accessing device thereof
US20090058866A1 (en) * 2006-02-28 2009-03-05 Shanghai Magima Digital Information Co., Ltd. Method for mapping picture addresses in memory
US20070236595A1 (en) * 2006-04-10 2007-10-11 Sony Taiwan Limited. Method for Improving Image Stitching Accuracy with Lens Distortion Correction and Device for Implementing the Same
US20080129723A1 (en) * 2006-11-30 2008-06-05 Comer Robert P System and method for converting a fish-eye image into a rectilinear image
US20080144968A1 (en) * 2006-12-15 2008-06-19 Microsoft Corporation Dynamic viewing of wide angle images
US20080158226A1 (en) * 2006-12-19 2008-07-03 California Institute Of Technology Imaging model and apparatus
US20090087115A1 (en) * 2007-10-02 2009-04-02 Ping Wah Wong Correction for geometric distortion in images in pipelined hardware
US20100111440A1 (en) * 2008-10-31 2010-05-06 Motorola, Inc. Method and apparatus for transforming a non-linear lens-distorted image
US20100119172A1 (en) * 2008-11-12 2010-05-13 Chi-Chang Yu Fisheye Correction with Perspective Distortion Reduction Method and Related Image Processor
US20100254602A1 (en) * 2009-04-07 2010-10-07 Dai Nippon Printing Co., Ltd. Image processing apparatus and method and a computer-readable recording medium on which an image processing program is stored
US20110194606A1 (en) * 2010-02-09 2011-08-11 Cheng-Yu Hsieh Memory management method and related memory apparatus
US20120045100A1 (en) * 2010-08-20 2012-02-23 Tomohide Ishigami Position measuring apparatus, position measuring method, image processing apparatus and image processing method
US20120147023A1 (en) * 2010-12-14 2012-06-14 Electronics And Telecommunications Research Institute Caching apparatus and method for video motion estimation and compensation

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9153014B2 (en) * 2010-11-09 2015-10-06 Avisonic Technology Corporation Image correction method and related image correction system thereof
US20130016918A1 (en) * 2011-07-13 2013-01-17 Akshayakumar Haribhatt Wide-Angle Lens Image Correction
US9105090B2 (en) * 2011-07-13 2015-08-11 Analog Devices, Inc. Wide-angle lens image correction
US20140341461A1 (en) * 2012-01-31 2014-11-20 Hitachi, High-Technologies Corporation Image processing apparatus, distortion-corrected map creation apparatus, and semiconductor measurement apparatus
US9514528B2 (en) * 2012-01-31 2016-12-06 Hitachi High-Technologies Corporation Image processing apparatus, distortion-corrected map creation apparatus, and semiconductor measurement apparatus
CN103325109A (en) * 2013-05-29 2013-09-25 山西绿色光电产业科学技术研究院(有限公司) Method used for correcting distortion of fish-eye image and applicable to wall-mounted panoramic video camera
US9196022B2 (en) 2014-03-10 2015-11-24 Omnivision Technologies, Inc. Image transformation and multi-view output systems and methods
US9574989B2 (en) 2014-08-08 2017-02-21 Omnivision Technologies, Inc. Lens-free imaging system and method for detecting particles in sample deposited on image sensor
US20160189350A1 (en) * 2014-12-30 2016-06-30 Texas Instruments Incorporated System and method for remapping of image to correct optical distortions
CN104994308A (en) * 2015-06-30 2015-10-21 广东欧珀移动通信有限公司 Method and device for shooting fisheye image
US9959601B2 (en) * 2015-06-30 2018-05-01 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Distortion rectification method and terminal

Also Published As

Publication number Publication date Type
JP2012105246A (en) 2012-05-31 application
JP5437311B2 (en) 2014-03-12 grant
US9153014B2 (en) 2015-10-06 grant

Similar Documents

Publication Publication Date Title
US8643701B2 (en) System for executing 3D propagation for depth image-based rendering
US8665341B2 (en) Methods and apparatus for rendering output images with simulated artistic effects from focused plenoptic camera data
US20150091900A1 (en) Systems and Methods for Depth-Assisted Perspective Distortion Correction
US20100194851A1 (en) Panorama image stitching
US20080180535A1 (en) Motion Vector Calculation Method and Hand-Movement Correction Device, Imaging Device and Moving Picture Generation Device
US20110193978A1 (en) Generic platform video image stabilization
US20040001146A1 (en) Real-time wide-angle image correction system and method for computer image viewing
US20110141226A1 (en) Panorama imaging based on a lo-res map
US20130162629A1 (en) Method for generating depth maps from monocular images and systems using the same
Grundmann et al. Calibration-free rolling shutter removal
Georgiev et al. Lytro camera technology: theory, algorithms, performance analysis
Agrawal et al. Resolving objects at higher resolution from a single motion-blurred image
US20130010073A1 (en) System and method for generating a depth map and fusing images from a camera array
US20120183202A1 (en) Methods and Systems for 2D to 3D Conversion from a Portrait Image
US20110142287A1 (en) Algorithms for estimating precise and relative object distances in a scene
US20110142370A1 (en) Generating a composite image from video frames
US20100119172A1 (en) Fisheye Correction with Perspective Distortion Reduction Method and Related Image Processor
US20110141224A1 (en) Panorama Imaging Using Lo-Res Images
Pickup Machine learning in multi-frame image super-resolution
US20130287304A1 (en) Image processing device, image processing method, and program
US20120249730A1 (en) Stereoscopic panoramic video capture system using surface identification and distance registration technique
US20060291698A1 (en) Image generation device and method for vehicle
US20150262344A1 (en) Method And System For Correcting A Distorted Input Image
US20130063571A1 (en) Image processing apparatus and image processing method
US20080101724A1 (en) Constructing arbitrary-plane and multi-arbitrary-plane mosaic composite images from a multi-imager

Legal Events

Date Code Title Description
AS Assignment

Owner name: AVISONIC TECHNOLOGY CORPORATION, TAIWAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:YU, CHI-CHANG;LIN, MENG-CHUN;CHEN, HOMER H.;SIGNING DATES FROM 20110318 TO 20110324;REEL/FRAME:026160/0066