CN103179424B - Method and device for synthesising three-dimensional image - Google Patents
Method and device for synthesising three-dimensional image Download PDFInfo
- Publication number
- CN103179424B CN103179424B CN201310100895.1A CN201310100895A CN103179424B CN 103179424 B CN103179424 B CN 103179424B CN 201310100895 A CN201310100895 A CN 201310100895A CN 103179424 B CN103179424 B CN 103179424B
- Authority
- CN
- China
- Prior art keywords
- image
- pixel
- resolution
- points
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The invention relates to a method and a device for synthesising a three-dimensional image. The method comprises the following steps of: S1, acquiring two paths of images obtained by shooting a same object from different angles and having different resolutions; S2, performing interpolation transformation on the image with a low resolution in the two paths of images, and enabling the resolution of the transformed image to be equal to the resolution of the image with a high resolution in the two paths of images; S3, performing synthesis processing on the transformed image and the image with the high resolution in the two paths of images to form the three-dimensional image; and S4, outputting the synthesised three-dimensional image. By implementing the method and the device for synthesising the three-dimensional image disclosed by the invention, the images with two different resolutions can be synthesised into the three-dimensional image, thus overcoming requirements on the resolutions of the two paths of images in the prior art; and lenses with different specifications can be flexibly selected during the process of shooting the three-dimensional image, thus improving shooting flexibility for the three-dimensional image, and reducing the cost of a three-dimensional shooting device.
Description
Technical field
The present invention relates to image display technology, more particularly, relate to a kind of stereo-picture synthetic method and device.
Background technology
Existing stereo-picture is generally take same object from different perspectives by two camera lenses, the image that acquisition two is different respectively, then, when showing to user, the eyes to user provide captured two different images respectively, thus obtain the sensation of stereo-picture.When acquisition image, must ensure that the resolution of two images is consistent, user so just can be made to obtain real third dimension when viewing image.If varying in size of resolution, obtain three-dimensional image by very difficult, require higher to lens parameters in the process of shooting like this, use flexibility lower.
Summary of the invention
The object of the invention is to, require higher in existing stereo-picture acquiring technology to camera lens, the defect that flexibility is lower, provide a kind of technology can using different resolution Images uniting stereo-picture, to overcome above-mentioned defect.
One aspect of the present invention, provides a kind of stereo-picture synthetic method, comprises the following steps:
S1, collection two-way are taken same object from different perspectives respectively and are obtained, and have the image of different resolution;
S2, interpolation conversion is carried out to the image in described two-way image with low resolution, make the resolution of the image after conversion equal with the resolution in described two-way image with the image of high-resolution;
S3, synthesis process is carried out to the image having a high-resolution in the image after conversion and described two-way image, formation stereo-picture;
Stereo-picture after S4, output synthesis.
Stereo-picture synthetic method of the present invention, wherein comprises the step that low-resolution image carries out interpolation conversion:
S21, on the described image with high-resolution, Corresponding matching point is searched to the described each pixel had in the image of low resolution; If the pixel had described in correspondence in the image of low resolution can have in the image of high-resolution described the match point finding correspondence, then described this pixel had in the image of low resolution is recorded as correct match point, otherwise this pixel is recorded as error matching points;
S22, to adjacent two correct match points, search corresponding to described two corresponding pixel points had in the image of high-resolution, when two described adjacent correct match points are positioned at same a line, by the pixel between described two corresponding pixel points by being inserted between described two adjacent correct match points or when two described adjacent correct match points are positioned at same row after column average, be inserted between described two adjacent correct match points after pixel between described two corresponding pixel points is average by row, to obtain the first interpolation image;
S23, above-mentioned steps S22 obtain the first interpolation image neighbor pixel linearly insert pixel, make insert after low-resolution image equal with the pixel of high-definition picture.
Stereo-picture synthetic method of the present invention, wherein step S21 comprises:
S211, there is pixel in the image of low resolution for mid point or summit with described, choose (2m+1) × the pixel region of (2n+1) as matching template, wherein m and n is at the natural number chosen from the scope of 1 to 5;
S212, matching template covered described in there is the region at pixel place corresponding with the described pixel had in the image of low resolution in the image of high-resolution;
S213, calculating error hiding rate, this error hiding rate is:
Wherein, absolute grayscale difference sum for described in have by the region that matching template covers in the image of high-resolution, with the absolute value sum of the difference of corresponding pixel points gray value in matching template;
S214, setting error hiding rate threshold value, if error hiding rate is less than error hiding rate threshold value, then correctly mates, otherwise is erroneous matching.
Stereo-picture synthetic method of the present invention, wherein step S23 comprises:
The first interpolation image obtained in S231, comparison step S22 and the pixel number with higher resolution image, determine that in the first interpolation image, the average insertion of neighbor pixel is counted, and round up;
S232, foundation bilinear interpolation method, insert pixel in the first interpolation image;
If there is the pixel quantity of the image of low resolution more than the described pixel quantity with the image of high-resolution described in after S233 inserts pixel, then calculate the pixel number needing to delete in described each row or column with the image of low resolution; By the pixel of this row or column sum divided by the pixel number needing to delete, and round downwards, be designated as S; From S+1 pixel, delete a pixel every S pixel, until residual pixel point is equal with the described corresponding row or column with the image of high-resolution.
Stereo-picture synthetic method of the present invention, wherein step S3 comprises:
S31, determine Images uniting form;
If S32 synthesize form for when full frame (full side-by-side) or full frame point and point (fulldot-by-dot) shoulder to shoulder by the image described in after the described image with high-resolution and process with low resolution by left and right side by side or mode side by side up and down synthesize a road image; If synthesis form be half screen shoulder to shoulder (half side-by-side) or half screen point and point (half dot-by-dot) time, every row or column, pixel is taken out to two-way image, then by left and right side by side or mode side by side up and down synthesize a road image.
Another aspect of the present invention, provides a kind of stereo-picture synthesizer, comprising:
Signal receiving module, takes same object from different perspectives respectively obtain for gathering two-way, and have the image of different resolution;
Image processing module, for carrying out interpolation conversion to the image in described two-way image with low resolution, makes the resolution of the image after conversion equal with the resolution in described two-way image with higher resolution image;
Image synthesis unit, carrying out synthesis process to having higher resolution image in the image after conversion and described two-way image, forming stereo-picture;
Image output module, for exporting the stereo-picture after synthesis;
Signal receiving module, image processing module, image synthesis unit is connected successively with image output module.
Stereo-picture synthesizer of the present invention, image processing module comprises:
Image matching unit, for searching Corresponding matching point to the described each pixel had in the image of low resolution on the described image with high-resolution; If the pixel had described in correspondence in the image of low resolution can have in the image of high-resolution described the match point finding correspondence, then described this pixel had in the image of low resolution is recorded as correct match point, otherwise this pixel is recorded as error matching points;
First interpolating unit, for to adjacent two correct match points, search corresponding to described two corresponding pixel points had in the image of high-resolution, when two described adjacent correct match points are positioned at same a line, by the pixel between described two corresponding pixel points by being inserted between described two adjacent correct match points or when two described adjacent correct match points are positioned at same row after column average, be inserted between described two adjacent correct match points after pixel between described two corresponding pixel points is average by row, to obtain the first interpolation image;
Second interpolating unit, inserts pixel for the neighbor pixel linearly at the first interpolation image, makes the low-resolution image after inserting equal with the pixel of high-definition picture.
Stereo-picture synthesizer of the present invention, the first interpolating unit
Matching template generator, this matching template generator has pixel in the image of low resolution for mid point or summit with described, choose (2m+1) × the pixel region of (2n+1) as matching template, wherein m and n is at the natural number chosen from the scope of 1 to 5;
Matching template decover, for having the region at pixel place corresponding with the described pixel had in the image of low resolution in the image of high-resolution described in being covered by matching template;
Error hiding rate calculator, for calculating error hiding rate, this error hiding rate is:
Wherein, absolute grayscale difference sum is have the region covered by matching template in the image of high-resolution, with the absolute value sum of the difference of corresponding pixel points gray value in matching template;
Error hiding threshold comparator, for setting error hiding rate threshold value, if error hiding rate is less than error hiding rate threshold value, then correctly mates, otherwise is erroneous matching.
Stereo-picture synthesizer of the present invention, wherein the second interpolating unit comprises:
Insertion is counted calculator, obtains image and the pixel number with higher resolution image for comparing the first interpolating unit, determines that the average insertion that the first interpolating unit obtains neighbor pixel in image is counted, and rounds up;
Bi-linear interpolator, for according to bilinear interpolation method, inserts pixel in the image that the first interpolating unit obtains;
Pixel adjuster, described in after insertion pixel, there is the pixel quantity of the image of low resolution more than the described pixel quantity with the image of high-resolution, then calculate the pixel number needing to delete in described each row or column with the image of low resolution; By the pixel of this row or column sum divided by the pixel number needing to delete, and round downwards, be designated as S; From S+1 pixel, delete a pixel every S pixel, until residual pixel point is equal with the described corresponding row or column with the image of high-resolution.
Stereo-picture synthesizer of the present invention, image synthesis unit comprises:
Format selector, for determining Images uniting form;
Image compressor, for synthesize form be full frame (full side-by-side) shoulder to shoulder or full frame point and point (full dot-by-dot) time, by the image described in after the described image with high-resolution and process with low resolution by left and right side by side or mode side by side up and down synthesize a road image; Synthesize form be half screen shoulder to shoulder (half side-by-side) or half screen point and point (half dot-by-dot) time, every row or column, pixel is taken out to two-way image, then by left and right side by side or mode side by side up and down synthesize a road image.
Implement stereo-picture synthetic method of the present invention and device, image processing and tracking unit different for two resolution can be become stereo-picture, overcome the requirement to two-way image resolution ratio in prior art, make the camera lens can choosing different size in the process of shooting stereo-picture flexibly, improve the convenience of shooting stereo images, also help the cost reducing stereoscopic shooting device.
Accompanying drawing explanation
Below in conjunction with accompanying drawing, the present invention will be described, wherein:
Fig. 1 is the flow chart of stereo-picture synthetic method of the present invention;
Fig. 2 is the low-resolution image schematic diagram that the present invention obtains;
Fig. 3 is the high-definition picture schematic diagram that the present invention obtains;
Fig. 4 is the schematic diagram of bilinear interpolation of the present invention;
Fig. 5 is the functional block diagram of stereo-picture synthesizer of the present invention;
Fig. 6 is the functional block diagram of image processing module;
Fig. 7 is the functional block diagram of image matching unit;
Fig. 8 is the functional block diagram of the second interpolating unit.
Embodiment
Below in conjunction with the drawings and specific embodiments, the present invention is described in detail.
Be illustrated in figure 1 the flow chart of stereo-picture synthetic method of the present invention, stereo-picture synthetic method of the present invention processes for the not identical image to be synthesized of two width resolution, make two width images after processing have identical resolution, the merging of stereo-picture can be carried out.
First in step sl, obtain the image of two-way for merging, this two-way image to be taken same object from different angles and is obtained, and tell the concrete resolution of two-way image, in order to outstanding feature of the present invention, the resolution limiting the image that the present invention obtains here is not identical; In subsequent process, with high-definition picture as a reference, low-resolution image is processed, make process after low-resolution image resolution improve and equal with high-definition picture.
Concrete processing method is S2: carry out interpolation conversion to low-resolution image, and the foundation of interpolation is full resolution pricture, first on high-definition picture, searches Corresponding matching point to the pixel in each low-resolution image; If can correctly mate, remember that the pixel in this low-resolution image is correct match point, otherwise be error matching points; To adjacent two correct match points, search corresponding two corresponding pixel points in high-definition picture, by the pixel between the pixel of two corresponding high-definition pictures by row or between the correct match point being inserted into two low-resolution images after column average.This completes primary interpolation.Such as Fig. 2 is low-resolution image 500, Fig. 3 is high-definition picture 600, and wherein two adjacent points corresponding to correct match point (501,502) are (601,604); In fig. 2, two adjacent correct match points are " row is adjacent ", and namely two points are positioned at same a line; Corresponding second corresponding points 604 of the first correct match point 501 correct match point 502 of corresponding first corresponding points 601, second; Between two corresponding points, there are two row pixels (602,603), column average is pressed to two row pixels, pixel average out to 1 point namely in 602, pixel average out to 1 point in 603; Then the points generated after average by these two, are inserted between two adjacent correct match points (501,502).More than the interpolation operations of two consecutive points in same a line, when two adjacent correct match points at same row time, then after average by row between two corresponding points in high-definition picture, between two the adjacent correct match points being inserted into same row.
Now insert the pixel of a part, compared the image after process and high-definition picture: the image after process is identical with high-resolution, then processed, can carry out the merging of image if just occur; If occur, the high-resolution image of image ratio after process is many, then carry out adaptability deletion, make the resolution of two images equal.
But in most cases, the image for the first time after interpolation, compared with high-definition picture, still needs to insert pixel further.Now carry out secondary interpolation, adopt bilinear interpolation method, specifically comprise the following steps:
Relatively obtain the pixel number of image and high-definition picture after first time interpolation, determine that the average insertion of neighbor pixel in first time interpolation acquisition image is counted, and round up; Such as, in certain a line, the first interpolation image has 400 pixels, and is 1250 at the pixel of high-definition picture corresponding row, then insert between 2 of the first interpolation image:
（1250-400）÷400=2.125
Then rounding up is 3 pixels, and the numerical value such as gray scale, RGB of concrete insertion pixel is realized by method below:
According to bilinear interpolation method, after first time interpolation, image inserts pixel, specifically as shown in Figure 4: XY plane is the plane at image place after first time interpolation, ABCD is after first time interpolation, first interpolation image can form the minimum combination of quadrangle, the quadrangle inside that namely ABCD surrounds no longer includes other pixels.Because we have calculated the number of the average pixel inserted of each row, column adjacent point-to-point transmission needs in a previous step, that is we have known concrete number and the position needing the pixel of insertion in quadrangle ABCD.Assuming that need to insert pixel at inner E point.After this set up Z-direction axle, this axle can the numerical value of gray scale, RGB etc. of represent pixel, for gray scale corresponding to gray scale ABCD on figure for A ' B ' C ' D '.Point adjacent for A ' B ' C ' D ' is coupled together, obtains the linear change between each point.After this E is projected to one group of opposite side (as AD and BC) of ABCD, then on A ' D ' and B ' C ', correspondence finds the gray value of two subpoints respectively, finally the point of these two gray values on figure is coupled together, so just can find gray value from E point to Z-direction.In like manner, also can with AB, CD both sides as projection limit, its result obtained is identical.
If the pixel of low-resolution image is more than high-definition picture after insertion pixel, then calculate the pixel number that each row or column needs to delete; By the pixel of this row or column sum divided by the pixel number needing to delete, and round downwards, be designated as S; From S+1 pixel, a pixel is deleted every S pixel, until residual pixel point row or column corresponding to high-definition picture is equal, such as: after carrying out bilinear interpolation, the pixel of low-resolution image is 1400 points, and pixel corresponding to high-definition picture is 1250, and that now will delete counts as 1400-1250=150, then do business: 1400 ÷ 150=9.33, rounding downwards is 9.Then from the 10th pixel, every 9 point deletions 1 pixel, deletion 150 altogether.It should be noted that, before this delet method is also applicable to first time interpolation after there is the operation that the pixel of low-resolution image is more than high-definition picture pixel.
Like this after twice interpolation, the resolution of low-resolution image is consistent with full resolution pricture, then the synthesis of image can be carried out: first determine Images uniting form, image can be collectively referred to as form (side-by-side) or point and point form (dot-by-dot) shoulder to shoulder in the present invention, and be further divided into full frame (full) and half screen (half), that is:
If synthesis form when being full frame (full side-by-side) or full frame point and point (fulldot-by-dot) shoulder to shoulder by the image after process by left and right side by side or mode side by side up and down synthesize a road image; If synthesis form be half screen shoulder to shoulder (half side-by-side) or half screen point and point (halfdot-by-dot) time, every row or column, pixel is taken out to two-way image, then by left and right side by side or mode side by side up and down synthesize a road image.
It should be noted that, the present invention, when carrying out merging image, can also synthesize according to other form, has more than and is limited to above-mentioned several picture formats.
As Fig. 5, be the system block diagram of stereo-picture synthesizer of the present invention, comprise 4 modules connected successively within the system: signal receiving module 100, image processing module 200, image synthesis unit 300 and image output module 400.Signal receiving module 100, obtains two-way image, and differentiates the resolution of two-way image, such as in two-way stereo camera shooting, obtain the different image of two-way resolution by two camera lenses, compared with prior art, signal receiving module 100 no longer limits the resolution of two-way image; Image processing module 200, carries out interpolation conversion to the low-resolution image in the two-way image obtained, and makes the image resolution ratio after changing equal with high-definition picture; Image synthesis unit 300 pairs of converted images and high-definition picture carry out synthesis process; Finally export the stereo-picture after synthesis by image output module 400.
Specifically as shown in Figure 6, image processing module 200 also specifically comprises: image matching unit 201, first interpolating unit 202 connected successively and the second interpolating unit 203.The function of unit is as follows:
Image matching unit 201, for searching Corresponding matching point to each pixel in low-resolution image on high-definition picture; If can correctly mate, remember that the pixel in this low-resolution image is correct match point, otherwise be error matching points;
First interpolating unit 202, for adjacent two correct match points, searches corresponding two corresponding pixel points in high-definition picture, by the pixel between two corresponding pixel points by row or be inserted into after column average between two correct match points.When two correct match points are same a line time, then between two corresponding pixel points by column average after be inserted between two correct match points; And when two correct match points are same row time, be then inserted between two correct match points after average by row between two corresponding pixel points.
As shown in Figure 7, in order to realize first time interpolation success, image matching unit 201 is configured with matching template generator 2011, this matching template generator 2011 with the pixel in low-resolution image for mid point or summit, choose (2m+1) × the pixel region of (2n+1) is as matching template, wherein 1≤m≤5,1≤n≤5; Preferentially attempt when choosing with the pixel in low-resolution image as mid point sets up matching template, when the pixel region chosen is beyond original low-resolution image time, to change into the pixel in low-resolution image as summit, make the region chosen be arranged in low-resolution image completely.
Matching template is covered high-definition picture corresponding pixel points region by matching template decover 2012;
Calculate error hiding rate by error hiding rate calculator 2013, this error hiding rate is:
Wherein, absolute grayscale difference sum is by the region that matching template covers in high-definition picture, with the absolute value sum of the difference of corresponding pixel points gray value in matching template;
Then error hiding threshold comparator 2014 sets error hiding rate threshold value, if error hiding rate is less than error hiding rate threshold value, then correctly mates, otherwise is erroneous matching.This threshold value is 1% to 5%, and numerical value is less, and the matching degree of the normal match point obtained is higher.
As shown in Figure 8, the second interpolating unit 203, the neighbor pixel linearly for image after the process of the first interpolating unit 202 inserts pixel, makes the low-resolution image after inserting equal with the pixel of high-definition picture.Concrete, the second interpolating unit 203 comprises:
Insert calculator 2031 of counting and compare the pixel number that the first interpolating unit 202 obtains image and high-definition picture, determine that the first interpolating unit 202 processes the average insertion of neighbor pixel in rear image and counts, and round up;
Bi-linear interpolator 2032, for according to bilinear interpolation method, to the image insertion pixel that the first interpolating unit 202 obtains;
Pixel adjuster 2033, for when the pixel inserting low-resolution image after pixel is more than high-definition picture, calculates the pixel number needing each row or column to delete; By the pixel of this row or column sum divided by the pixel number needing to delete, and round downwards, be designated as S; From S+1 pixel, delete a pixel every S pixel, until residual pixel point row or column corresponding to high-definition picture is equal.
After the interpolation of twice, obtain the image that two resolution is identical, image is collectively referred to as form (side-by-side) or point and point form (dot-by-dot) shoulder to shoulder by image output module 400, and is further divided into full frame (full) and half screen (half), that is:
If synthesis form when being full frame (full side-by-side) or full frame point and point (fulldot-by-dot) shoulder to shoulder by the image after process by left and right side by side or mode side by side up and down synthesize a road image; If synthesis form be half screen shoulder to shoulder (half side-by-side) or half screen point and point (halfdot-by-dot) time, every row or column, pixel is taken out to two-way image, then by left and right side by side or mode side by side up and down synthesize a road image.
These are only the specific embodiment of the invention, scope of the present invention can not be limited with this, the equalization change that those skilled in the art in the art do according to this creation, and the change that those skilled in that art know, all still should belong to the scope that the present invention is contained.
Claims (6)
1. a stereo-picture synthetic method, is characterized in that, comprises the following steps:
S1, collection two-way are taken same object from different perspectives respectively and are obtained, and have the image of different resolution;
S2, interpolation conversion is carried out to the image in described two-way image with low resolution, make the resolution of the image after conversion equal with the resolution in described two-way image with the image of high-resolution; Described step S2 comprises:
S21, on the described image with high-resolution, Corresponding matching point is searched to the described each pixel had in the image of low resolution; If the pixel had described in correspondence in the image of low resolution can have in the image of high-resolution described the match point finding correspondence, then described this pixel had in the image of low resolution is recorded as correct match point, otherwise this pixel is recorded as error matching points;
S22, to adjacent two correct match points, search corresponding to described two corresponding pixel points had in the image of high-resolution, when described two adjacent correct match points are positioned at same a line, by the pixel between described two corresponding pixel points by be inserted into after column average between described two adjacent correct match points or when described two adjacent correct match points are positioned at same row, be inserted between described two adjacent correct match points after pixel between described two corresponding pixel points is average by row, to obtain the first interpolation image;
S23, above-mentioned steps S22 obtain the first interpolation image neighbor pixel linearly insert pixel, make insert after low-resolution image equal with the pixel of high-definition picture;
Described step S21 comprises:
S211, there is pixel in the image of low resolution for mid point or summit with described, choose (2m+1) × the pixel region of (2n+1) as matching template, wherein m and n is at the natural number chosen from the scope of 1 to 5;
S212, matching template covered described in there is the region at pixel place corresponding with the described pixel had in the image of low resolution in the image of high-resolution;
S213, calculating error hiding rate, described error hiding rate is:
Wherein, absolute grayscale difference sum for described in have by the region that matching template covers in the image of high-resolution, with the absolute value sum of the difference of corresponding pixel points gray value in matching template;
S214, setting error hiding rate threshold value, if error hiding rate is less than error hiding rate threshold value, then correctly mates, otherwise is erroneous matching
S3, synthesis process is carried out to the image having a high-resolution in the image after conversion and described two-way image, formation stereo-picture;
Stereo-picture after S4, output synthesis.
2. stereo-picture synthetic method according to claim 1, is characterized in that, described step S23 comprises:
The first interpolation image obtained in S231, comparison step S22 and the described pixel number with higher resolution image, determine that the average insertion of neighbor pixel in described first interpolation image is counted, and round up;
S232, foundation bilinear interpolation method, insert pixel in described first interpolation image;
If there is the pixel quantity of the image of low resolution more than the described pixel quantity with the image of high-resolution described in after S233 inserts pixel, then calculate the pixel number needing to delete in described each row or column with the image of low resolution; By the pixel of this row or column sum divided by the pixel number needing to delete, and round downwards, be designated as S; From S+1 pixel, delete a pixel every S pixel, until residual pixel point is equal with the described corresponding row or column with the image of high-resolution.
3. stereo-picture synthetic method according to claim 1, is characterized in that, described step S3 comprises:
S31, determine Images uniting form;
If S32 synthesize form be shoulder to shoulder full frame or full frame point and point time, by the image described in after the described image with high-resolution and process with low resolution by left and right side by side or mode side by side up and down synthesize a road image; If synthesis form be half screen shoulder to shoulder or half screen is point and point time, every row or column, pixel is taken out to two-way image, then by left and right side by side or mode side by side up and down synthesize a road image.
4. a stereo-picture synthesizer, is characterized in that, comprising:
Signal receiving module (100), takes same object from different perspectives respectively obtain for gathering two-way, and have the image of different resolution;
Image processing module (200), for carrying out interpolation conversion to the image in described two-way image with low resolution, makes the resolution of the image after conversion equal with the resolution in described two-way image with higher resolution image; Described image processing module (200) comprising:
Image matching unit (201), for searching Corresponding matching point to the described each pixel had in the image of low resolution on the described image with high-resolution; If the pixel had described in correspondence in the image of low resolution can have in the image of high-resolution described the match point finding correspondence, then described this pixel had in the image of low resolution is recorded as correct match point, otherwise this pixel is recorded as error matching points;
First interpolating unit (202), for to adjacent two correct match points, search corresponding to described two corresponding pixel points had in the image of high-resolution, when described two adjacent correct match points are positioned at same a line, by the pixel between described two corresponding pixel points by be inserted into after column average between described two adjacent correct match points or when described two adjacent correct match points are positioned at same row, be inserted between described two adjacent correct match points after pixel between described two corresponding pixel points is average by row, to obtain the first interpolation image,
Second interpolating unit (203), inserts pixel for the neighbor pixel linearly at the first interpolation image, makes the low-resolution image after inserting equal with the pixel of high-definition picture;
Described image matching unit (201) comprising:
Matching template generator (2011), described matching template generator (2011) has pixel in the image of low resolution for mid point or summit with described, choose (2m+1) × the pixel region of (2n+1) as matching template, wherein m and n is at the natural number chosen from the scope of 1 to 5;
Matching template decover (2012), for having the region at pixel place corresponding with the described pixel had in the image of low resolution in the image of high-resolution described in being covered by matching template;
Error hiding rate calculator (2013), for calculating error hiding rate, this error hiding rate is:
Wherein, absolute grayscale difference sum for described in have by the region that matching template covers in the image of high-resolution, with the absolute value sum of the difference of corresponding pixel points gray value in matching template;
Error hiding threshold comparator (2014), for setting error hiding rate threshold value, if error hiding rate is less than error hiding rate threshold value, then correctly mates, otherwise is erroneous matching;
Image synthesis unit (300), for carrying out synthesis process to having higher resolution image in the image after conversion and described two-way image, forms stereo-picture;
Image output module (400), for exporting the stereo-picture after synthesis;
Described signal receiving module (100), image processing module (200), image synthesis unit (300) is connected successively with image output module (400).
5. stereo-picture synthesizer according to claim 4, is characterized in that, described second interpolating unit (203) comprising:
Insertion is counted calculator (2031), obtains image and the described pixel number with higher resolution image for comparing the first interpolating unit, determines that the average insertion of neighbor pixel in the first interpolating unit acquisition image is counted, and rounds up;
Bi-linear interpolator (2032), for according to bilinear interpolation method, inserts pixel in the image that the first interpolating unit obtains;
Pixel adjuster (2033), described in after insertion pixel, there is the pixel quantity of the image of low resolution more than the described pixel quantity with the image of high-resolution, then calculate the pixel number needing to delete in described each row or column with the image of low resolution; By the pixel of this row or column sum divided by the pixel number needing to delete, and round downwards, be designated as S; From S+1 pixel, delete a pixel every S pixel, until residual pixel point is equal with the described corresponding row or column with the image of high-resolution.
6. stereo-picture synthesizer according to claim 4, is characterized in that, described image synthesis unit (300) comprising:
Format selector (301), for determining Images uniting form;
Image compressor (302), for synthesize form be shoulder to shoulder full frame or full frame point and point time, by the image described in after the described image with high-resolution and process with low resolution by left and right side by side or mode side by side up and down synthesize a road image; If synthesis form be half screen shoulder to shoulder or half screen is point and point time, every row or column, pixel is taken out to two-way image, then by left and right side by side or mode side by side up and down synthesize a road image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310100895.1A CN103179424B (en) | 2013-03-26 | 2013-03-26 | Method and device for synthesising three-dimensional image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310100895.1A CN103179424B (en) | 2013-03-26 | 2013-03-26 | Method and device for synthesising three-dimensional image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103179424A CN103179424A (en) | 2013-06-26 |
| CN103179424B true CN103179424B (en) | 2015-03-11 |
Family
ID=48638995
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310100895.1A Active CN103179424B (en) | 2013-03-26 | 2013-03-26 | Method and device for synthesising three-dimensional image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103179424B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106507088A (en) * | 2016-12-14 | 2017-03-15 | 郑州胜龙信息技术股份有限公司 | Receive the 3 D image display method of upper and lower and left-right format piece source signal |
| CN106803888A (en) * | 2017-03-06 | 2017-06-06 | 联想(北京)有限公司 | The method and electronic equipment of composograph |
| CN108737745A (en) * | 2017-04-21 | 2018-11-02 | 杭州海康威视数字技术股份有限公司 | video fusion method and device |
| CN110191331B (en) * | 2018-02-22 | 2022-01-04 | 深圳市华胜软件技术有限公司 | True three-dimensional naked eye 3D image synthesis method, storage medium and synthesis device |
| CN109302600B (en) * | 2018-12-06 | 2023-03-21 | 成都工业学院 | Three-dimensional scene shooting device |
| CN110809147A (en) * | 2019-09-20 | 2020-02-18 | 北京铂石空间科技有限公司 | Image processing method and device, computer storage medium and electronic equipment |
| CN112954251B (en) * | 2019-12-10 | 2023-03-21 | RealMe重庆移动通信有限公司 | Video processing method, video processing device, storage medium and electronic equipment |
| CN114007057A (en) * | 2020-07-28 | 2022-02-01 | 北京小米移动软件有限公司 | Terminal, photographing method, photographing apparatus, and computer-readable storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100562920C (en) * | 2006-05-22 | 2009-11-25 | 株式会社东芝 | High resolution enabling apparatus and method |
| CN102025959A (en) * | 2009-09-22 | 2011-04-20 | 三星电子株式会社 | System and method for producing high definition video from low definition video |
| CN102110227A (en) * | 2010-11-24 | 2011-06-29 | 清华大学 | Compound method for classifying multiresolution remote sensing images based on context |
| CN102479380A (en) * | 2010-11-25 | 2012-05-30 | 北京大学 | Image interpolation method capable of improving image resolution and device utilizing image interpolation method |
| CN102496158A (en) * | 2011-11-24 | 2012-06-13 | 中兴通讯股份有限公司 | Method and device for image information processing |
| CN102761764A (en) * | 2012-07-16 | 2012-10-31 | 清华大学 | Upper sampling method used for depth picture of three-dimensional stereo video |
| CN102918836A (en) * | 2010-05-13 | 2013-02-06 | 高通股份有限公司 | Frame packing for asymmetric stereo video |
-
2013
- 2013-03-26 CN CN201310100895.1A patent/CN103179424B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100562920C (en) * | 2006-05-22 | 2009-11-25 | 株式会社东芝 | High resolution enabling apparatus and method |
| CN102025959A (en) * | 2009-09-22 | 2011-04-20 | 三星电子株式会社 | System and method for producing high definition video from low definition video |
| CN102918836A (en) * | 2010-05-13 | 2013-02-06 | 高通股份有限公司 | Frame packing for asymmetric stereo video |
| CN102110227A (en) * | 2010-11-24 | 2011-06-29 | 清华大学 | Compound method for classifying multiresolution remote sensing images based on context |
| CN102479380A (en) * | 2010-11-25 | 2012-05-30 | 北京大学 | Image interpolation method capable of improving image resolution and device utilizing image interpolation method |
| CN102496158A (en) * | 2011-11-24 | 2012-06-13 | 中兴通讯股份有限公司 | Method and device for image information processing |
| CN102761764A (en) * | 2012-07-16 | 2012-10-31 | 清华大学 | Upper sampling method used for depth picture of three-dimensional stereo video |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103179424A (en) | 2013-06-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103179424B (en) | Method and device for synthesising three-dimensional image | |
| US9924153B2 (en) | Parallel scaling engine for multi-view 3DTV display and method thereof | |
| US20220358334A1 (en) | Assembly body change detection method, device and medium based on attention mechanism | |
| JP5472328B2 (en) | Stereo camera | |
| US8416284B2 (en) | Stereoscopic image capturing apparatus and stereoscopic image capturing system | |
| CN109447919B (en) | Light field super-resolution reconstruction method combining multi-view angle and semantic texture features | |
| CN102724529B (en) | Method and device for generating video sequence of virtual viewpoints | |
| JP2008276318A (en) | Image processing apparatus and image processing method | |
| CN101689299A (en) | System and method for stereo matching of images | |
| CN103238337B (en) | Three-dimensional image acquisition system and method | |
| JP4737763B2 (en) | Free viewpoint image generation method, apparatus and program using multi-viewpoint images | |
| JP2007336188A (en) | Multi-viewpoint image compression coding method, device, and program | |
| WO2008153313A2 (en) | System and method for generating and regenerating 3d image files based on 2d image media standards | |
| CN102387387A (en) | Image processing apparatus and method | |
| CN105611270B (en) | A kind of binocular vision auto-stereo display system | |
| CN103634519A (en) | Image display method and device based on dual-camera head | |
| CN104574331A (en) | Data processing method, device, computer storage medium and user terminal | |
| CN103220545A (en) | Hardware implementation method of stereoscopic video real-time depth estimation system | |
| CN102905145A (en) | Stereoscopic image system, image generation method, image adjustment device and method thereof | |
| CN103702103A (en) | Optical grating three-dimensional printing image synthetic method based on binocular camera | |
| CN113393382B (en) | Binocular picture super-resolution reconstruction method based on multi-dimensional parallax prior | |
| CN103679739A (en) | Virtual view generating method based on shielding region detection | |
| KR20100112840A (en) | Stereo camera system and parallax detection method using thereof | |
| CN109302600B (en) | Three-dimensional scene shooting device | |
| CN104796624A (en) | Method for editing and propagating light fields |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP03 | Change of name, title or address |
Address after: 518000 Beek science and technology building, room, No. 9 research road, Nanshan District high tech Zone, Guangdong, China, 1501-B Patentee after: INLIFE-HANDNET CO., LTD. Address before: 518054 Guangdong city of Shenzhen province Nanshan District Nanhai Road Guangdong sea (Shenzhen city) 7 Building 3 floor Patentee before: Inlife-handnet Co., Ltd. |
|
| EE01 | Entry into force of recordation of patent licensing contract | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20130626 Assignee: Beijing Yu Technology Co., Ltd. Assignor: INLIFE-HANDNET CO., LTD. Contract record no.: 2017440020014 Denomination of invention: Method and device for synthesizing three-dimensional image Granted publication date: 20150311 License type: Common License Record date: 20170306 |