CN104867113A - Method and system for perspective distortion correction of image - Google Patents
Method and system for perspective distortion correction of image Download PDFInfo
- Publication number
- CN104867113A CN104867113A CN201510149800.4A CN201510149800A CN104867113A CN 104867113 A CN104867113 A CN 104867113A CN 201510149800 A CN201510149800 A CN 201510149800A CN 104867113 A CN104867113 A CN 104867113A
- Authority
- CN
- China
- Prior art keywords
- image
- perspective distortion
- trivector information
- distortion correction
- trivector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000003702 image correction Methods 0.000 claims description 9
- 238000004458 analytical method Methods 0.000 claims description 6
- 208000011580 syndromic disease Diseases 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000007547 defect Effects 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 241001465754 Metazoa Species 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000005755 formation reaction Methods 0.000 description 1
- 238000004321 preservation Methods 0.000 description 1
- 238000004064 recycling Methods 0.000 description 1
- 238000010008 shearing Methods 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
- 238000009966 trimming Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/80—Geometric correction
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
Abstract
The invention, which is suitable for the technical field of the image, provides a method and system for perspective distortion correction of an image. The method and system are applied to a shooting terminal containing two cameras. The method comprises: shooting a shot object simultaneously by using a first camera and a second camera to obtain a corresponding first image and a corresponding second image; generating first three-dimensional vector information corresponding to the first image and second three-dimensional vector information corresponding to the second image respectively; and according to the obtained first three-dimensional vector information and d second three-dimensional vector information, carrying out perspective distortion correction on the first image and the second image by using a predetermined perspective distortion correction algorithm. Therefore, perspective distortion correction of a three-dimensional image can be realized; and the speed of perspective distortion correction can be accelerated substantially.
Description
Technical field
The present invention relates to image taking technical field, particularly relate to a kind of method and system of perspective image distortion correction.
Background technology
Because the camera terminal such as camera, mobile phone optical system is not accurately by the principle work of Utopian pinhole imaging system, have perspective distortion, between the actual imaging of object on the imaging surface of camera terminal and ideal image, have optical distortion error.There is the technology that the correction of camera lens perspective distortion is carried out in physically based deformation distance and direction in prior art, it takes several images by lens focusing, and then analysis chart picture judges focus calculation distance, and recycling distance parameter carries out perspective distortion correction to image.Prior art is owing to can not take countless photos to calculate distance, so the very low calibration result that causes of correction accuracy is bad; And shooting multiple pictures all needs that the required times such as single focusing, exposure are very long thus speed is slow at every turn.In addition, prior art can only correct the perspective distortion of two dimension (Two Dimension, 2D) image, then feels simply helpless to the perspective distortion of three-dimensional (Three Dimension, 3D) image.
In summary, obviously there is inconvenience and defect in actual use in prior art, so be necessary to be improved.
Summary of the invention
For above-mentioned defect, the object of the present invention is to provide a kind of method and system of perspective image distortion correction, it can realize carrying out perspective distortion correction to 3-D view, and greatly can improve the speed of perspective distortion correction.
To achieve these goals, the invention provides a kind of method of perspective image distortion correction, be applied to the camera terminal comprising two cameras, described method includes:
Subject is taken by the first camera and second camera simultaneously, obtain the first corresponding image and the second image;
Generate the first trivector information corresponding to described first image and the second trivector information corresponding to described second image respectively;
According to obtaining described first trivector information and described second trivector information, by predetermined perspective distortion correcting algorithm, perspective distortion correction is carried out to described first image and described second image.
According to method of the present invention, the described step generating the first trivector information corresponding to the first image and the second trivector information corresponding to described second image respectively comprises:
Generate the described first trivector information of each pixel in described first image;
Generate the described second trivector information of each pixel in described second image.
According to method of the present invention, the described step generating the first trivector information corresponding to the first image and the second trivector information corresponding to described second image respectively comprises:
Analyze the overlapping region of described first image and described second image;
Calculate the distance of preimage point corresponding to described first image each described pixel in described overlapping region apart from described first camera, obtain the first distance, and according to the first two-dimensional coordinate of each described pixel and described first distance, generate the described first trivector information of described first image;
Calculate the distance of preimage point corresponding to described second image each described pixel in described overlapping region apart from described second camera, obtain second distance, and according to the second two-dimensional coordinate of each described pixel and described second distance, generate the described second trivector information of described second image.
According to method of the present invention, the described first trivector information that described basis obtains and described second trivector information, by predetermined perspective distortion correcting algorithm, the step that described first image and described second image carry out perspective distortion correction is comprised:
Call the first predetermined perspective distortion correction parameter according to described first trivector information, and carry out perspective distortion correction by the described overlapping region of described perspective distortion correcting algorithm to described first image;
Call the second predetermined perspective distortion correction parameter according to described second trivector information, and carry out perspective distortion correction by the described overlapping region of described perspective distortion correcting algorithm to described second image.
According to method of the present invention, the described first trivector information that described basis obtains and described second trivector information, by predetermined perspective distortion correcting algorithm, comprise after the step of perspective distortion correction is carried out to described first image and described second image:
If receive image shows instruction, judge the type of described image shows instruction;
If described image shows instruction is two dimensional image show instruction, then the described overlapping region intercepted out in described first image after correction or described second image is shown;
If described image shows instruction is 3-D view show instruction, then three-dimensional modulation is carried out to described first image after correction and described second image and show.
The present invention also provides a kind of system of perspective image distortion correction, is applied to the camera terminal comprising two cameras, and described system includes:
Image collection module, for being taken subject by the first camera and second camera simultaneously, obtains the first corresponding image and the second image;
Information generating module, for generating the first trivector information corresponding to described first image and the second trivector information corresponding to described second image respectively;
Image correction module, for according to the described first trivector information obtained and described second trivector information, by predetermined perspective distortion correcting algorithm, carries out perspective distortion correction to described first image and described second image.
According to system of the present invention, described information generating module comprises:
First generates submodule, for generating the described first trivector information of each pixel in described first image;
Second generates submodule, for generating the described second trivector information of each pixel in described second image.
According to system of the present invention, described information generating module comprises:
Regional analysis submodule, for analyzing the overlapping region of described first image and described second image;
Described first generates submodule, for calculating the distance of preimage point corresponding to described first image each described pixel in described overlapping region apart from described first camera, obtain the first distance, and according to the first two-dimensional coordinate of each described pixel and described first distance, generate the described first trivector information of described first image;
Described second generates submodule, for calculating the distance of preimage point corresponding to described second image each described pixel in described overlapping region apart from described second camera, obtain second distance, and according to the second two-dimensional coordinate of each described pixel and described second distance, generate the described second trivector information of described second image.
According to system of the present invention, described image correction module comprises:
First syndrome module, for calling the first predetermined perspective distortion correction parameter according to described first trivector information, and carries out perspective distortion correction by the described overlapping region of described perspective distortion correcting algorithm to described first image;
Second syndrome module, for calling the second predetermined perspective distortion correction parameter according to described second trivector information, and carries out perspective distortion correction by the described overlapping region of described perspective distortion correcting algorithm to described second image.
According to system of the present invention, also comprise:
Command reception module, after carrying out perspective distortion correction to described first image and described second image, if receive image shows instruction, judges the type of described image shows instruction;
First display module, if when being two dimensional image displaying instruction for described image shows instruction, the described overlapping region intercepted out in described first image after correction or described second image is shown;
Second display module, if when being 3-D view displaying instruction for described image shows instruction, carrying out three-dimensional modulation to described first image after correction and described second image and show.
Camera terminal of the present invention is when taking, by two images of two disposable acquisition subjects of camera, and generate the trivector information of two images respectively, greatly can shorten prior art needs different distance to distinguish the time of the repeatedly multiple Image Acquisition depth information of focusing shooting; Then call perspective distortion correcting algorithm and perspective distortion correction is carried out to 3-D view.Whereby, the present invention can realize carrying out perspective distortion correction to 3-D view, and greatly can improve the speed of perspective distortion correction.Preferably, the present invention catches the trivector information of each pixel in image being shot by two cameras, and the perspective distortion correction of 3-D view is carried out according to the trivector information of each pixel, carried out the precision locally corrected on a large scale by several depth values that several photos obtain compared to prior art, the present invention substantially increases the precision that perspective distortion corrects.
Accompanying drawing explanation
Fig. 1 is the structural representation of the system of perspective image distortion correction of the present invention;
Fig. 2 is the structural representation of the system that preferred image perspective distortion of the present invention corrects;
Fig. 3 is the method flow diagram of perspective image distortion correction of the present invention;
Fig. 4 is the method flow diagram of perspective image distortion correction in first embodiment of the invention;
Fig. 5 be in second embodiment of the invention perspective image distortion correction method realize schematic diagram.
Embodiment
In order to make object of the present invention, technical scheme and advantage clearly understand, below in conjunction with drawings and Examples, the present invention is further elaborated.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
Fig. 1 is the structural representation of the system of perspective image distortion correction of the present invention, is applied to the camera terminal comprising two cameras, and described system 100 includes image collection module 10, information generating module 20 and image correction module 30, wherein:
Image collection module 10, for being taken subject by the first camera and second camera simultaneously, obtains the first corresponding image and the second image.Described subject can be personage, animal, plant, buildings, mountain, water, sky etc. any one or multiple.Described first camera and second camera are two cameras of camera terminal at the same face, can be left and right camera or upper and lower camera, described two cameras can take simultaneously and the content of taking is basically identical, namely the picture material of the first image and the second image is basically identical, there is more overlapping region.The widespread use on the camera terminals such as camera, mobile phone, panel computer of order the first two camera.
Information generating module 20, for generating the first trivector information corresponding to the first image and the second trivector information corresponding to the second image respectively.Here, can generate the first trivector information according to the first image, this first trivector information can form the first 3-D view; Can generate the second trivector information according to the second image, this second trivector information can form the second 3-D view.Preferably, the trivector information in the present invention refers to the Vector Message of the spacing of preimage point that in the planar two dimensional coordinate of image and image, each pixel is corresponding and camera.Described distance is preferably the spacing of preimage point and the camera plane of respectively answering pixel corresponding in the planar two dimensional coordinate of image and image, and certain described distance also can be the spacing of the central point of preimage point and the camera of respectively answering pixel corresponding in the planar two dimensional coordinate of image and image.Described preimage point is the point of the actual object that in image, pixel is corresponding.
Image correction module 30, for according to the first trivector information obtained and the second trivector information, by predetermined perspective distortion correcting algorithm, carries out perspective distortion correction to the first image and the second image.At least one perspective distortion correcting algorithm can be prestored in camera terminal, such as, carry out camera lens perspective distortion correcting algorithm based on object distance and direction, because described perspective distortion correcting algorithm is prior art, therefore not repeat them here.Specifically, according to perspective distortion correcting algorithm and the first trivector information, perspective distortion correction is carried out to the first image; And according to perspective distortion correcting algorithm and the second trivector information, perspective distortion correction is carried out to the second image.
Camera terminal of the present invention is when taking, by two images of two disposable acquisition subjects of camera, and generate the trivector information of two images respectively, greatly can shorten prior art needs different distance to distinguish the time of the repeatedly multiple Image Acquisition depth information of focusing shooting; Then call perspective distortion correcting algorithm and perspective distortion correction is carried out to 3-D view, thus realize carrying out perspective distortion correction to 3-D view.
Fig. 2 is the structural representation of the system that preferred image perspective distortion of the present invention corrects, be applied to the camera terminal comprising two cameras, described camera terminal can be camera, mobile phone, panel computer etc., described system 100 at least includes image collection module 10, information generating module 20 and image correction module 30, wherein:
Described image collection module 10, for being taken subject by the first camera and second camera simultaneously, obtains the first corresponding image and the second image.
Described information generating module 20, for generating the first trivector information corresponding to the first image and the second trivector information corresponding to the second image respectively.Preferably, described information generating module 20 comprises:
First generates submodule 21, for generating the first trivector information of each pixel in the first image.
Second generates submodule 22, for generating the second trivector information of each pixel in the second image.
Once taken by two cameras and obtain trivector information, shortening prior art needs different distance repeatedly to focus respectively and takes the time that multiple pictures obtains depth information greatly.Precision based on the trivector information correction of pixel is that prior art carries out the thousands of times of the precision that local corrects on a large scale by several depth values that several photos obtain, and greatly can improve the accuracy and runtime that perspective distortion corrects.
Be more preferably, described information generating module 30 also can comprise:
Regional analysis submodule 23, for analyzing the overlapping region of the first image and the second image.The analysis of described overlapping region relates to image recognition technology, based on RGB (Red, Green, Blue, RGB) value, brightness, the pixel features such as gray scale find similitude and dissimilar points separatrix, can analyze the overlapping region of the first image and the second image.
First generates submodule 21, for calculating the distance of the first image preimage that each pixel is corresponding in overlapping region point apart from the first camera, obtain the first distance, and according to the first two-dimensional coordinate of each pixel and the first distance, generate the first trivector information of the first image, first trivector information can represent with (x, y, z).Namely the first trivector information in the present invention refers to the Vector Message of the spacing of preimage point that in the planar two dimensional coordinate of the first image and the first image, each pixel is corresponding and the first camera.
Second generates submodule 22, for calculating the distance of the second image preimage that each pixel is corresponding in overlapping region point apart from second camera, obtain second distance, and according to the second two-dimensional coordinate of each pixel and second distance, generate the second trivector information of the second image, second trivector information can represent with (x, y, z).Namely the second trivector information in the present invention refers to the Vector Message of the spacing of preimage point that in the planar two dimensional coordinate of the second image and the second image, each pixel is corresponding and second camera.
Described image correction module 30, for according to the first trivector information obtained and the second trivector information, by predetermined perspective distortion correcting algorithm, carries out perspective distortion correction to the first image and the second image.
Preferably, described image correction module 30 comprises:
First syndrome module 31, for calling the first predetermined perspective distortion correction parameter according to the first trivector information, and carries out perspective distortion correction by perspective distortion correcting algorithm to the overlapping region of the first image.
Second syndrome module 32, for calling the second predetermined perspective distortion correction parameter according to the second trivector information, and carries out perspective distortion correction by perspective distortion correcting algorithm to the overlapping region of the second image.Second perspective distortion correction parameter and the first perspective distortion correction parameter can be identical or different.
Be more preferably, the system 100 of described perspective image distortion correction also can comprise:
Command reception module 40, after carrying out perspective distortion correction to the first image and the second image, if receive image shows instruction, judges the type of described image shows instruction.The type of described image shows instruction can be that two dimensional image shows that instruction or 3-D view show instruction.
First display module 50, if when being two dimensional image displaying instruction for image shows instruction, the overlapping region intercepted out in the first image after correction or the second image is shown.
Second display module 60, if when being 3-D view displaying instruction for image shows instruction, carrying out three-dimensional modulation to the first image after correction and the second image and show.Here, the first image after correction and the second image are shown simultaneously and can be formed 3-D view.
The invention describes the trivector information of being caught each pixel in image being shot by two cameras, and call the technology that corresponding camera lens perspective distortion parameter carries out 3-D view distortion correction, greatly improve the accuracy and runtime that perspective distortion corrects, and compensate for prior art can not carry out perspective distortion correction defect to 3-D view.Can also carry out 3-D display with two width images after correction, Consumer's Experience is better.
Fig. 3 is the method flow diagram of perspective image distortion correction of the present invention, is applied to the camera terminal comprising two cameras, and described method realizes by the system 100 as perspective distortion correction as shown in Figure 1 or 2, and described method includes:
Step S301, is taken subject by the first camera and second camera simultaneously, obtains the first corresponding image and the second image.
Described subject can be personage, animal, plant, buildings, mountain, water, sky etc. any one or multiple.Described first camera and second camera are two cameras of camera terminal at the same face, can be left and right camera or upper and lower camera, described two cameras can take simultaneously and the content of taking is basically identical, namely the picture material of the first image and the second image is basically identical, there is more overlapping region.
Step S302, generates the first trivector information corresponding to the first image and the second trivector information corresponding to the second image respectively.
Here, can generate the first trivector information according to the first image, this first trivector information can form the first 3-D view; Can generate the second trivector information according to the second image, this second trivector information can form the second 3-D view.This step preferably, generates the first trivector information of each pixel in the first image, and generates the second trivector information of each pixel in the second image.Precision based on the trivector information correction of pixel is that prior art carries out the thousands of times of the precision that local corrects on a large scale by several depth values that several photos obtain, and greatly can improve the accuracy and runtime that perspective distortion corrects.Namely the trivector information in the present invention refers to the Vector Message of the spacing of preimage point that in the planar two dimensional coordinate of image and image, each pixel is corresponding and camera.Described distance is preferably the spacing of preimage point and the camera plane of respectively answering pixel corresponding in the planar two dimensional coordinate of image and image, and certain described distance also can be the spacing of the central point of preimage point and the camera of respectively answering pixel corresponding in the planar two dimensional coordinate of image and image.Described preimage point is the point of the actual object that in image, pixel is corresponding.
Step S303, according to the first trivector information obtained and the second trivector information, by predetermined perspective distortion correcting algorithm, carries out perspective distortion correction to the first image and the second image.
At least one perspective distortion correcting algorithm can be prestored in camera terminal, such as, carry out camera lens perspective distortion correcting algorithm based on object distance and direction, because described perspective distortion correcting algorithm is prior art, therefore not repeat them here.Specifically, according to perspective distortion correcting algorithm and the first trivector information, perspective distortion correction is carried out to the first image; And according to perspective distortion correcting algorithm and the second trivector information, perspective distortion correction is carried out to the second image.
Fig. 4 is the method flow diagram of perspective image distortion correction in first embodiment of the invention, is applied to the camera terminal comprising two cameras, and described method realizes by the system 100 as perspective distortion correction as shown in Figure 2, and described method includes:
Step S401, is taken subject by the first camera and second camera simultaneously, obtains the first corresponding image and the second image.
Step S402, analyzes the overlapping region of the first image and the second image.The analysis of described overlapping region relates to image recognition technology, and based on rgb value, brightness, the pixel features such as gray scale find similitude and dissimilar points separatrix, can analyze the overlapping region of the first image and the second image.
Step S403, calculate the distance of the first image preimage that each pixel is corresponding in overlapping region point apart from the first camera, obtain the first distance, and according to the first two-dimensional coordinate of each pixel and the first distance, generate the first trivector information of the first image.
Namely the first trivector information in the present invention refers to the Vector Message of the spacing of corresponding pixel points and the first camera in the planar two dimensional coordinate of the first image and the first image, and the first trivector information can represent with (x, y, z).
Step S404, calls the first predetermined perspective distortion correction parameter according to the first trivector information, and carries out perspective distortion correction by perspective distortion correcting algorithm to the overlapping region of the first image.
Step S405, calculate the distance of the second image preimage that each pixel is corresponding in overlapping region point apart from second camera, obtain second distance, and according to the second two-dimensional coordinate of each pixel and second distance, generate the second trivector information of the second image.
Namely the second trivector information in the present invention refers to the Vector Message of the spacing of preimage point that in the planar two dimensional coordinate of the second image and the second image, each pixel is corresponding and second camera, second trivector information can use (x, y, z) represent.
Step S406, calls the second predetermined perspective distortion correction parameter according to the second trivector information, and carries out perspective distortion correction by perspective distortion correcting algorithm to the overlapping region of the second image.
Second perspective distortion correction parameter and the first perspective distortion correction parameter can be identical or different.
Step S407, receives image shows instruction.
The type of described image shows instruction can be that two dimensional image shows that instruction or 3-D view show instruction.
Step S408, judges the type of image shows instruction, if image shows instruction is two dimensional image show instruction, performs step S409, if image shows instruction is 3-D view show instruction, performs step S410.
Step S409, if image shows instruction is two dimensional image show instruction, then the overlapping region intercepted out in the first image after correction or the second image is shown.
Step S410, if image shows instruction is 3-D view show instruction, then carries out three-dimensional modulation to the first image after correction and the second image and shows.
Here, the first image after correction and the second image are shown simultaneously and can be formed 3-D view.
Fig. 5 be in second embodiment of the invention perspective image distortion correction method realize schematic diagram, be applied to the camera terminal comprising left and right camera, mainly comprise:
One, subject is taken by the first camera and second camera simultaneously, obtain the first corresponding image and the second image.Two
1, open two and take the photograph exposal model, by display screen, shooting composition is carried out to subject;
2, specifically, left and right camera is taken pictures to shooting body simultaneously, obtains left and right two width images and preserves, i.e. image L (i.e. the first image), image R (i.e. the second image);
Two, the first trivector information corresponding to the first image and the second trivector information corresponding to the second image is generated respectively.
Analyze the overlapping region of image L and image R, for the overlapping region (the snow region in Fig. 5) of two image L, R, call in camera terminal based on each pixel the algorithm that prestores and carry out geometry teaching calculating, obtain the preimage point distance camera distance z that in image, each pixel is corresponding, the trivector information document of synthetic image is as follows:
(x1，y1，z1)；(x2，y1，z2)………………………(xn，y1，zn)
(x1，y2，zn+1)；(x2，y2，zn+2)…………………(xn，y2，z2n)
. . .
. . .
(x1，ym，z(m-1)n+1)；(x2，ym，z(m-1)n+2)………(xn，ym，zmn)
This document temporary.Here three coordinate systems are had: first coordinate of image L, second coordinate of image R, the three-dimensional of the coincidence pattern picture of two picture registration part formations.Wherein first coordinate of image L, second coordinate of image R are two-dimensional coordinate systems, and the three-dimensional of coincidence pattern picture is three-dimensional system of coordinate.X-axis initial point in three-dimensional (x, y, z) is the horizontal ordinate x1 of first row coincident pixel point in first coordinate of image L, and the Y-axis initial point in three-dimensional (x, y, z) is the ordinate ym of the pixel of most next line in coincidence image.In each coordinate system, true origin refers to last pixel of the lower left corner of each image (image L, image R or coincidence pattern picture).Remember that the critical point of the coincidence part of left and right two width image L and R and not intersection is as transverse axis coordinate x1, x2 data of figure.Because the coordinate disunity of image R, L, needs x1 or x2 to change, if with the coordinate of image L for benchmark will use x1, if with the coordinate of image R for benchmark will use x2, the present embodiment is for benchmark illustrates for the coordinate of image L.The true origin of three-dimensional carries out converting based on the true origin of the first coordinate or the second coordinate, x1 or x2 is used in conversion.
Three, according to the first trivector information obtained and the second trivector information, by predetermined perspective distortion correcting algorithm, perspective distortion correction is carried out to the first image and the second image.
Respectively perspective distortion correction (non-coincidence zone correction values is defaulted as 0) is carried out to overlapping region in two width images (figure bend part) according to the perspective distortion correction factor table that the trivector information generated is called camera lens genuine man and provided by calibration algorithm.The pixel of the distortion factor M that in trimming process, trivector information (x, y, z) is relevant corresponding left camera shooting image L, the pixel of M corresponding right camera shooting image R; Left and right two width image L after last only preservation corrects
j, R
j, delete other ephemeral datas or file.
If the later stage only needs two-dimensional display image, the overlapping region (figure bend part) of shearing in two width images in arbitrary width shows; If need 3-D display be carried out, respectively by existing dimension display technologies to left images L
j, R
jcarry out three-dimensional modulation and play simultaneously.
In sum, camera terminal of the present invention is when taking, by two images of two disposable acquisition subjects of camera, and generate the trivector information of two images respectively, greatly can shorten prior art needs different distance to distinguish the time of the repeatedly multiple Image Acquisition depth information of focusing shooting; Then call perspective distortion correcting algorithm and perspective distortion correction is carried out to 3-D view.Whereby, the present invention can realize carrying out perspective distortion correction to 3-D view, and greatly can improve the speed of perspective distortion correction.Preferably, the present invention catches the trivector information of each pixel in image being shot by two cameras, and the perspective distortion correction of 3-D view is carried out according to the trivector information of each pixel, carried out the precision locally corrected on a large scale by several depth values that several photos obtain compared to prior art, the present invention substantially increases the precision that perspective distortion corrects.
Certainly; the present invention also can have other various embodiments; when not deviating from the present invention's spirit and essence thereof; those of ordinary skill in the art are when making various corresponding change and distortion according to the present invention, but these change accordingly and are out of shape the protection domain that all should belong to the claim appended by the present invention.
Claims (10)
1. a method for perspective image distortion correction, is characterized in that, is applied to the camera terminal comprising two cameras, and described method includes:
Subject is taken by the first camera and second camera simultaneously, obtain the first corresponding image and the second image;
Generate the first trivector information corresponding to described first image and the second trivector information corresponding to described second image respectively;
According to the described first trivector information obtained and described second trivector information by predetermined perspective distortion correcting algorithm, perspective distortion correction is carried out to described first image and described second image.
2. method according to claim 1, is characterized in that, the described step generating the first trivector information corresponding to the first image and the second trivector information corresponding to described second image respectively comprises:
Generate the described first trivector information of each pixel in described first image;
Generate the described second trivector information of each pixel in described second image.
3. method according to claim 2, is characterized in that, the described step generating the first trivector information corresponding to described first image and the second trivector information corresponding to described second image respectively comprises:
Analyze the overlapping region of described first image and described second image;
Calculate the distance of preimage point corresponding to described first image each described pixel in described overlapping region apart from described first camera, obtain the first distance, and according to the first two-dimensional coordinate of each described pixel and described first distance, generate the described first trivector information of described first image;
Calculate the distance of preimage point corresponding to described second image each described pixel in described overlapping region apart from described second camera, obtain second distance, and according to the second two-dimensional coordinate of each described pixel and described second distance, generate the described second trivector information of described second image.
4. method according to claim 3, it is characterized in that, the described first trivector information that described basis obtains and described second trivector information, by predetermined perspective distortion correcting algorithm, comprise the step that described first image and described second image carry out perspective distortion correction:
Call the first predetermined perspective distortion correction parameter according to described first trivector information, and carry out perspective distortion correction by the described overlapping region of described perspective distortion correcting algorithm to described first image;
Call the second predetermined perspective distortion correction parameter according to described second trivector information, and carry out perspective distortion correction by the described overlapping region of described perspective distortion correcting algorithm to described second image.
5. the method according to any one of Claims 1 to 4, it is characterized in that, the described first trivector information that described basis obtains and described second trivector information, by predetermined perspective distortion correcting algorithm, comprise after the step of perspective distortion correction is carried out to described first image and described second image:
If receive image shows instruction, judge the type of described image shows instruction;
If described image shows instruction is two dimensional image show instruction, then the described overlapping region intercepted out in described first image after correction or described second image is shown;
If described image shows instruction is 3-D view show instruction, then three-dimensional modulation is carried out to described first image after correction and described second image and show.
6. a system for perspective image distortion correction, is characterized in that, is applied to the camera terminal comprising two cameras, and described system includes:
Image collection module, for being taken subject by the first camera and second camera simultaneously, obtains the first corresponding image and the second image;
Information generating module, for generating the first trivector information corresponding to described first image and the second trivector information corresponding to described second image respectively;
Image correction module, for according to the described first trivector information obtained and described second trivector information, by predetermined perspective distortion correcting algorithm, carries out perspective distortion correction to described first image and described second image.
7. system according to claim 6, is characterized in that, described information generating module comprises:
First generates submodule, for generating the described first trivector information of each pixel in described first image;
Second generates submodule, for generating the described second trivector information of each pixel in described second image.
8. system according to claim 7, is characterized in that, described information generating module comprises:
Regional analysis submodule, for analyzing the overlapping region of described first image and described second image;
Described first generates submodule, for calculating the distance of preimage point corresponding to described first image each described pixel in described overlapping region apart from described first camera, obtain the first distance, and according to the first two-dimensional coordinate of each described pixel and described first distance, generate the described first trivector information of described first image;
Described second generates submodule, for calculating the distance of preimage point corresponding to described second image each described pixel in described overlapping region apart from described second camera, obtain second distance, and according to the second two-dimensional coordinate of each described pixel and described second distance, generate the described second trivector information of described second image.
9. system according to claim 8, is characterized in that, described image correction module comprises:
First syndrome module, for calling the first predetermined perspective distortion correction parameter according to described first trivector information, and carries out perspective distortion correction by the described overlapping region of described perspective distortion correcting algorithm to described first image;
Second syndrome module, for calling the second predetermined perspective distortion correction parameter according to described second trivector information, and carries out perspective distortion correction by the described overlapping region of described perspective distortion correcting algorithm to described second image.
10. the system according to any one of claim 6 ~ 9, is characterized in that, also comprises:
Command reception module, after carrying out perspective distortion correction to described first image and described second image, if receive image shows instruction, judges the type of described image shows instruction;
First display module, if when being two dimensional image displaying instruction for described image shows instruction, the described overlapping region intercepted out in described first image after correction or described second image is shown;
Second display module, if when being 3-D view displaying instruction for described image shows instruction, carrying out three-dimensional modulation to described first image after correction and described second image and show.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510149800.4A CN104867113B (en) | 2015-03-31 | 2015-03-31 | The method and system of perspective image distortion correction |
| PCT/CN2015/080314 WO2016155110A1 (en) | 2015-03-31 | 2015-05-29 | Method and system for correcting image perspective distortion |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510149800.4A CN104867113B (en) | 2015-03-31 | 2015-03-31 | The method and system of perspective image distortion correction |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104867113A true CN104867113A (en) | 2015-08-26 |
| CN104867113B CN104867113B (en) | 2017-11-17 |
Family
ID=53912930
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510149800.4A Active CN104867113B (en) | 2015-03-31 | 2015-03-31 | The method and system of perspective image distortion correction |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104867113B (en) |
| WO (1) | WO2016155110A1 (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105704374A (en) * | 2016-01-29 | 2016-06-22 | 努比亚技术有限公司 | Image conversion device, method and terminal |
| CN107144241A (en) * | 2017-06-09 | 2017-09-08 | 大连理工大学 | A kind of binocular vision high-precision measuring method compensated based on the depth of field |
| CN107680060A (en) * | 2017-09-30 | 2018-02-09 | 努比亚技术有限公司 | A kind of image distortion correction method, terminal and computer-readable recording medium |
| CN107748887A (en) * | 2017-09-30 | 2018-03-02 | 五邑大学 | It is a kind of based on dominant with recessive Line segment detection planar document perspective image antidote |
| CN108171744A (en) * | 2017-12-26 | 2018-06-15 | 努比亚技术有限公司 | Determining method, mobile terminal and the storage medium of disparity map in a kind of binocular virtualization |
| CN108197624A (en) * | 2018-02-02 | 2018-06-22 | 杭州清本科技有限公司 | The recognition methods of certificate image rectification and device, computer storage media |
| CN109146977A (en) * | 2017-06-16 | 2019-01-04 | 中兴通讯股份有限公司 | Image translation error correcting method, mobile terminal and computer readable storage medium |
| CN110072045A (en) * | 2019-05-30 | 2019-07-30 | Oppo广东移动通信有限公司 | Camera lens, camera and electronic equipment |
| CN113826376A (en) * | 2019-05-24 | 2021-12-21 | Oppo广东移动通信有限公司 | User equipment and strabismus correction method |
| CN118570558A (en) * | 2024-07-31 | 2024-08-30 | 泉州职业技术大学 | Binocular target detection method and system for blind guiding glasses |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117115144B (en) * | 2023-10-18 | 2024-05-24 | 深圳市强达电路股份有限公司 | Online detection system for hole site defects in PCB |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040022451A1 (en) * | 2002-07-02 | 2004-02-05 | Fujitsu Limited | Image distortion correcting method and apparatus, and storage medium |
| CN102005039A (en) * | 2010-08-24 | 2011-04-06 | 浙江大学 | Fish-eye camera stereo vision depth measuring method based on Taylor series model |
| CN103065289A (en) * | 2013-01-22 | 2013-04-24 | 清华大学 | Four-ocular video camera front face reconstruction method based on binocular stereo vision |
| CN103824303A (en) * | 2014-03-14 | 2014-05-28 | 格科微电子（上海）有限公司 | Image perspective distortion adjusting method and device based on position and direction of photographed object |
| CN104259669A (en) * | 2014-09-11 | 2015-01-07 | 苏州菲镭泰克激光技术有限公司 | Precise three-dimensional curved surface laser marking method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5631229B2 (en) * | 2011-01-31 | 2014-11-26 | キヤノン株式会社 | Imaging apparatus, control method thereof, and program |
| CN103077521B (en) * | 2013-01-08 | 2015-08-05 | 天津大学 | A kind of area-of-interest exacting method for video monitoring |
-
2015
- 2015-03-31 CN CN201510149800.4A patent/CN104867113B/en active Active
- 2015-05-29 WO PCT/CN2015/080314 patent/WO2016155110A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040022451A1 (en) * | 2002-07-02 | 2004-02-05 | Fujitsu Limited | Image distortion correcting method and apparatus, and storage medium |
| CN102005039A (en) * | 2010-08-24 | 2011-04-06 | 浙江大学 | Fish-eye camera stereo vision depth measuring method based on Taylor series model |
| CN103065289A (en) * | 2013-01-22 | 2013-04-24 | 清华大学 | Four-ocular video camera front face reconstruction method based on binocular stereo vision |
| CN103824303A (en) * | 2014-03-14 | 2014-05-28 | 格科微电子（上海）有限公司 | Image perspective distortion adjusting method and device based on position and direction of photographed object |
| CN104259669A (en) * | 2014-09-11 | 2015-01-07 | 苏州菲镭泰克激光技术有限公司 | Precise three-dimensional curved surface laser marking method |
Non-Patent Citations (2)
| Title |
|---|
| SOON-KAK KOWN ET AL.: "Correction of Perspective Distortion Image Using Depth Information", 《JOURNAL OF KOREA MULTIMEDIA SOCIETY》 * |
| 崔莉娟 等: "基于畸变校正的双目立体摄像机线性标定", 《电子技术应用》 * |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105704374B (en) * | 2016-01-29 | 2019-04-05 | 努比亚技术有限公司 | A kind of image conversion apparatus, method and terminal |
| CN105704374A (en) * | 2016-01-29 | 2016-06-22 | 努比亚技术有限公司 | Image conversion device, method and terminal |
| CN107144241B (en) * | 2017-06-09 | 2019-01-01 | 大连理工大学 | A kind of binocular vision high-precision measuring method based on depth of field compensation |
| CN107144241A (en) * | 2017-06-09 | 2017-09-08 | 大连理工大学 | A kind of binocular vision high-precision measuring method compensated based on the depth of field |
| CN109146977A (en) * | 2017-06-16 | 2019-01-04 | 中兴通讯股份有限公司 | Image translation error correcting method, mobile terminal and computer readable storage medium |
| CN107748887A (en) * | 2017-09-30 | 2018-03-02 | 五邑大学 | It is a kind of based on dominant with recessive Line segment detection planar document perspective image antidote |
| CN107680060A (en) * | 2017-09-30 | 2018-02-09 | 努比亚技术有限公司 | A kind of image distortion correction method, terminal and computer-readable recording medium |
| CN108171744A (en) * | 2017-12-26 | 2018-06-15 | 努比亚技术有限公司 | Determining method, mobile terminal and the storage medium of disparity map in a kind of binocular virtualization |
| CN108197624A (en) * | 2018-02-02 | 2018-06-22 | 杭州清本科技有限公司 | The recognition methods of certificate image rectification and device, computer storage media |
| CN113826376A (en) * | 2019-05-24 | 2021-12-21 | Oppo广东移动通信有限公司 | User equipment and strabismus correction method |
| CN113826376B (en) * | 2019-05-24 | 2023-08-15 | Oppo广东移动通信有限公司 | User equipment and strabismus correction method |
| CN110072045A (en) * | 2019-05-30 | 2019-07-30 | Oppo广东移动通信有限公司 | Camera lens, camera and electronic equipment |
| CN110072045B (en) * | 2019-05-30 | 2021-11-09 | Oppo广东移动通信有限公司 | Lens, camera and electronic equipment |
| CN118570558A (en) * | 2024-07-31 | 2024-08-30 | 泉州职业技术大学 | Binocular target detection method and system for blind guiding glasses |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104867113B (en) | 2017-11-17 |
| WO2016155110A1 (en) | 2016-10-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104867113A (en) | Method and system for perspective distortion correction of image | |
| CN110300292B (en) | Projection distortion correction method, device, system and storage medium | |
| CN106875339B (en) | Fisheye image splicing method based on strip-shaped calibration plate | |
| EP3163535B1 (en) | Wide-area image acquisition method and device | |
| CN108154058B (en) | Graphic code display and position area determination method and device | |
| US9946955B2 (en) | Image registration method | |
| EP3340170A1 (en) | Multi-depth image fusion method and apparatus | |
| CN111540004B (en) | Single camera polar line correction method and device | |
| JPWO2018235163A1 (en) | Calibration apparatus, calibration chart, chart pattern generation apparatus, and calibration method | |
| CN109474780B (en) | Method and device for image processing | |
| CN109247068A (en) | Method and apparatus for rolling shutter compensation | |
| JP2014112055A (en) | Estimation method for camera attitude and estimation system for camera attitude | |
| CN108340405B (en) | Robot three-dimensional scanning system and method | |
| CN113301320B (en) | Image information processing method and device and electronic equipment | |
| CN105005964A (en) | Video sequence image based method for rapidly generating panorama of geographic scene | |
| CN103824303A (en) | Image perspective distortion adjusting method and device based on position and direction of photographed object | |
| CN105791793A (en) | Image processing method and electronic device | |
| CN106919246A (en) | The display methods and device of a kind of application interface | |
| CN106412421A (en) | System and method for rapidly generating large-size multi-focused image | |
| CN113724391A (en) | Three-dimensional model construction method and device, electronic equipment and computer readable medium | |
| CN108702482A (en) | Information processing equipment, information processing system, information processing method and program | |
| CN115294207A (en) | Fusion scheduling system and method for smart campus monitoring video and three-dimensional GIS model | |
| CN116524022B (en) | Offset data calculation method, image fusion device and electronic equipment | |
| CN116912331A (en) | Calibration data generation method and device, electronic equipment and storage medium | |
| CN117974796A (en) | XR augmented reality camera calibration method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |