CN103179424A - Method and device for synthesising three-dimensional image - Google Patents
Method and device for synthesising three-dimensional image Download PDFInfo
- Publication number
- CN103179424A CN103179424A CN2013101008951A CN201310100895A CN103179424A CN 103179424 A CN103179424 A CN 103179424A CN 2013101008951 A CN2013101008951 A CN 2013101008951A CN 201310100895 A CN201310100895 A CN 201310100895A CN 103179424 A CN103179424 A CN 103179424A
- Authority
- CN
- China
- Prior art keywords
- image
- pixel
- resolution
- point
- points
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Image Processing (AREA)
Abstract
The invention relates to a method and a device for synthesising a three-dimensional image. The method comprises the following steps of: S1, acquiring two paths of images obtained by shooting a same object from different angles and having different resolutions; S2, performing interpolation transformation on the image with a low resolution in the two paths of images, and enabling the resolution of the transformed image to be equal to the resolution of the image with a high resolution in the two paths of images; S3, performing synthesis processing on the transformed image and the image with the high resolution in the two paths of images to form the three-dimensional image; and S4, outputting the synthesised three-dimensional image. By implementing the method and the device for synthesising the three-dimensional image disclosed by the invention, the images with two different resolutions can be synthesised into the three-dimensional image, thus overcoming requirements on the resolutions of the two paths of images in the prior art; and lenses with different specifications can be flexibly selected during the process of shooting the three-dimensional image, thus improving shooting flexibility for the three-dimensional image, and reducing the cost of a three-dimensional shooting device.
Description
Technical field
The present invention relates to image display technology, more particularly, relate to a kind of stereo-picture synthetic method and device.
Background technology
Existing stereo-picture is generally to take from different perspectives same object by two camera lenses, obtain respectively two different images, then when showing to the user, provide respectively two captured different images to user's eyes, thereby obtain the sensation of stereo-picture.When obtaining image, must guarantee that the resolution of two images is consistent, so just can make the user obtain real third dimension when watching image.If varying in size of resolution with being difficult to obtain three-dimensional image, had relatively high expectations to lens parameters in the process of taking like this, use flexibility lower.
Summary of the invention
The object of the invention is to, obtain in technology for existing stereo-picture camera lens is had relatively high expectations, the defective that flexibility is lower provides the technology of the enough different resolution images of a kind of energy synthetic stereo image, to overcome defects.
One aspect of the present invention provides a kind of stereo-picture synthetic method, comprises the following steps:
S1, collection two-way are taken same object from different perspectives respectively and are obtained, and have the image of different resolution;
S2, the image that has low resolution in described two-way image is carried out interpolation conversion, the resolution that has the image of high-resolution in the resolution that makes the image after conversion and described two-way image equates;
S3, the image that has a high-resolution in the image after conversion and described two-way image synthesize processing, the formation stereo-picture;
Stereo-picture after S4, output are synthesized.
Stereo-picture synthetic method of the present invention wherein comprises the step that low-resolution image carries out interpolation conversion:
S21, each pixel in described image with low resolution is searched the Corresponding matching point on described image with high-resolution; If a pixel in corresponding described image with low resolution can find corresponding match point in described image with high-resolution, this pixel in described image with low resolution is recorded as correct match point, otherwise this pixel is recorded as error matching points;
S22, to adjacent two correct match points, search corresponding two corresponding pixel points in described image with high-resolution, when two described adjacent correct match points are positioned at delegation, be inserted into described two adjacent correct match points between after by column average the pixel between described two corresponding pixel points or when two described adjacent correct match points are positioned at same row, be inserted between described two adjacent correct match points, to obtain the first interpolation image after pixel between described two corresponding pixel points is average by row;
S23, between the neighbor pixel of the first interpolation image that above-mentioned steps S22 obtains the linear pixel that inserts, make the low-resolution image after insertion equate with the pixel of high-definition picture.
Stereo-picture synthetic method of the present invention, wherein step S21 comprises:
S211, the pixel in the described image with low resolution be as mid point or summit, chooses the pixel zone of (2m+1) * (2n+1) as matching template, and wherein m and n are the natural number of choosing from 1 to 5 scope;
S212, matching template is covered in described image with high-resolution the zone at corresponding with pixel in described image with low resolution pixel place;
S213, calculating mistake matching rate, this mistake matching rate is:
Wherein, the poor sum of absolute grayscale is the zone that is covered by matching template in described image with high-resolution, with the absolute value sum of the difference of corresponding pixel points gray value in matching template;
S214 sets mistake matching rate threshold value, if the mistake matching rate correctly mates, otherwise is erroneous matching less than mistake matching rate threshold value.
Stereo-picture synthetic method of the present invention, wherein step S23 comprises:
The first interpolation image that obtains in S231, comparison step S22 and the pixel number with higher resolution image are determined that in the first interpolation image, the average insertion of neighbor pixel is counted, and are rounded up;
S232, according to bilinear interpolation method, insert pixel in the first interpolation image;
If S233 inserts the pixel quantity of described image with low resolution after pixel more than described pixel quantity with image of high-resolution, calculating need to be in the pixel number of each row or column deletion of described image with low resolution; With the pixel sum of this row or column pixel number divided by the needs deletion, and round downwards, be designated as S; Since S+1 pixel, every pixel of S pixel deletion, until residual pixel point equates with described corresponding row or column with image of high-resolution.
Stereo-picture synthetic method of the present invention, wherein step S3 comprises:
S31, determine that image synthesizes form;
The image that will describedly have high-resolution when if the synthetic form of S32 is full frame (full side-by-side) shoulder to shoulder or full frame point and point (full dot-by-dot) with process after described image with low resolution by the left and right side by side or up and down side by side mode synthesize one road image; If synthetic form is half screen shoulder to shoulder when (half side-by-side) or half screen point and point (half dot-by-dot), the two-way image is taken out pixel every row or column, then by left and right side by side synthetic one road image of mode side by side or up and down.
Another aspect of the present invention provides a kind of stereo-picture synthesizer, comprising:
Signal receiving module is taken same object from different perspectives respectively for the collection two-way and is obtained, and has the image of different resolution;
Image processing module, the image that is used for described two-way image is had low resolution carries out the interpolation conversion, and the resolution that has higher resolution image in the resolution that makes the image after conversion and described two-way image equates;
Image synthesis unit is synthesized processing to having higher resolution image in the image after conversion and described two-way image, forms stereo-picture;
Image output module is used for the stereo-picture after output is synthesized;
Signal receiving module, image processing module, image synthesis unit is connected with image output module and is connected.
Stereo-picture synthesizer of the present invention, image processing module comprises:
The images match unit is used for each pixel of described image with low resolution is searched the Corresponding matching point on described image with high-resolution; If a pixel in corresponding described image with low resolution can find corresponding match point in described image with high-resolution, this pixel in described image with low resolution is recorded as correct match point, otherwise this pixel is recorded as error matching points;
The first interpolating unit, be used for adjacent two correct match points, search corresponding two corresponding pixel points in described image with high-resolution, when two described adjacent correct match points are positioned at delegation, be inserted into described two adjacent correct match points between after by column average the pixel between described two corresponding pixel points or when two described adjacent correct match points are positioned at same row, be inserted between described two adjacent correct match points, to obtain the first interpolation image after pixel between described two corresponding pixel points is average by row;
The second interpolating unit is used for the linear pixel that inserts between the neighbor pixel of the first interpolation image, makes the low-resolution image after insertion equate with the pixel of high-definition picture.
Stereo-picture synthesizer of the present invention, the first interpolating unit
The matching template generator, the pixel of this matching template generator in the described image with low resolution is as mid point or summit, choose the pixel zone of (2m+1) * (2n+1) as matching template, wherein m and n are the natural number of choosing from 1 to 5 scope;
Matching template covers device, is used for matching template is covered the zone at described image with high-resolution pixel place corresponding with pixel in described image with low resolution;
Mistake matching rate calculator is used for calculating the mistake matching rate, and this mistake matching rate is:
Wherein, the poor sum of absolute grayscale is to have a zone that is covered by matching template in the image of high-resolution, with the absolute value sum of the difference of corresponding pixel points gray value in matching template;
Mistake matching threshold comparator is for setting mistake matching rate threshold value, if the mistake matching rate correctly mates, otherwise is erroneous matching less than mistake matching rate threshold value.
Stereo-picture synthesizer of the present invention, wherein the second interpolating unit comprises:
The insertion calculator of counting is used for relatively that the first interpolating unit obtains image and the pixel number with higher resolution image, determines that the average insertion that the first interpolating unit obtains neighbor pixel in image counts, and rounds up;
The bilinear interpolation device is used for according to bilinear interpolation method, inserts pixel in the image of the first interpolating unit acquisition;
The pixel adjuster, be used for the pixel quantity of described image with low resolution after inserting pixel more than described pixel quantity with image of high-resolution, calculating need to be in the pixel number of each row or column deletion of described image with low resolution; With the pixel sum of this row or column pixel number divided by the needs deletion, and round downwards, be designated as S; Since S+1 pixel, every pixel of S pixel deletion, until residual pixel point equates with described corresponding row or column with image of high-resolution.
Stereo-picture synthesizer of the present invention, image synthesis unit comprises:
The form selector is used for determining the synthetic form of image;
Image compressor, be used for when synthetic form is full frame (full side-by-side) shoulder to shoulder or full frame point and point (full dot-by-dot), with described image with high-resolution with process after described image with low resolution by the left and right side by side or up and down side by side mode synthesize one road image; Be half screen shoulder to shoulder when (half side-by-side) or half screen point and point (half dot-by-dot) at synthetic form, the two-way image is taken out pixel every row or column, then by left and right side by side synthetic one road image of mode side by side or up and down.
Implement stereo-picture synthetic method of the present invention and device, two different images of resolution can be merged into stereo-picture, overcome in the prior art requirement to the two-way image resolution ratio, make the camera lens that to choose flexibly different size in the process of taking stereo-picture, improve the convenience of shooting stereo images, also helped the cost that reduces stereoscopic shooting device.
Description of drawings
The present invention will be described below in conjunction with accompanying drawing, wherein:
Fig. 1 is the flow chart of stereo-picture synthetic method of the present invention;
Fig. 2 is the low-resolution image schematic diagram that the present invention obtains;
Fig. 3 is the high-definition picture schematic diagram that the present invention obtains;
Fig. 4 is the schematic diagram of bilinear interpolation of the present invention;
Fig. 5 is the functional block diagram of stereo-picture synthesizer of the present invention;
Fig. 6 is the functional block diagram of image processing module;
Fig. 7 is the functional block diagram of images match unit;
Fig. 8 is the functional block diagram of the second interpolating unit.
Embodiment
The present invention is described in detail below in conjunction with the drawings and specific embodiments.
Be illustrated in figure 1 as the flow chart of stereo-picture synthetic method of the present invention, stereo-picture synthetic method of the present invention is to process for the two not identical images to be synthesized of width resolution, make two width images after processing have identical resolution, can carry out the merging of stereo-picture.
At first in step S1, obtain the image that two-way is used for merging, this two-way image is taken same object from different angles and is obtained, and tell the concrete resolution of two-way image, for outstanding characteristics of the present invention, the resolution that limits the image that the present invention obtains here is not identical; In subsequent process, with high-definition picture as a reference, low-resolution image is processed, make the resolution of the low-resolution image after processing improve and equate with high-definition picture.
Concrete processing method is S2: low-resolution image is carried out the interpolation conversion, and the foundation of interpolation is full resolution pricture, at first the pixel in each low-resolution image is searched the Corresponding matching point on high-definition picture; If can correctly mate the pixel of remembering in this low-resolution image is correct match point, otherwise is error matching points; To adjacent two correct match points, search corresponding two corresponding pixel points in high-definition picture, be inserted between the correct match point of two low-resolution images after the pixel between the pixel of the high-definition picture of two correspondences is average by row or column.So just completed primary interpolation.For example Fig. 2 is low-resolution image 500, and Fig. 3 is high-definition picture 600, and wherein two adjacent corresponding points of correct match point (501,502) are (601,604); In Fig. 2, two adjacent correct match points are " row is adjacent ", and namely two points are positioned at same delegation; Corresponding the first corresponding the second corresponding points 604 of the correct match point 502 of corresponding points 601, the second of the first correct match point 501; Two row pixels (602,603) are arranged between two corresponding points, two row pixels are pressed column average, be i.e. pixel average out to 1 point in 602, pixel average out to 1 point in 603; Then with these two the average rear points that generate, be inserted between two adjacent correct match points (501,502).Be more than two consecutive points at the interpolation operation with delegation, when two adjacent correct match points at same row the time, average by row between two corresponding points in high-definition picture after, be inserted between two adjacent correct match points of same row.
A part of pixel, the image after comparison process and high-definition picture have been inserted this moment: if the image after just occurring processing is identical with high-resolution, finish dealing with, can carry out the merging of image; If the high-resolution image of image ratio after occurring processing is many, carry out the adaptability deletion, make the resolution of two images equate.
Yet in most cases, the image after interpolation is compared with high-definition picture for the first time, or needs further to insert pixel.Carry out secondary interpolation this moment, adopt bilinear interpolation method, specifically comprise the following steps:
Obtain more for the first time the pixel number of image and high-definition picture after interpolation, determine that the average insertion of neighbor pixel in the image of interpolation acquisition is for the first time counted, and round up; For example, in certain delegation, the first interpolation image has 400 pixels, and is 1250 at the pixel of high-definition picture corresponding row, inserts between 2 of the first interpolation image:
（1250-400）÷400=2.125
Then rounding up is 3 pixels, and the numerical value such as the gray scale of concrete insertion pixel, RGB are realized by following method:
According to bilinear interpolation method, image inserts pixel after the interpolation for the first time, specifically as shown in Figure 4: the XY plane is the plane at image place after interpolation for the first time, ABCD is for after interpolation for the first time, can form tetragonal minimum combination on the first interpolation image, namely the quadrangle inside that surrounds of ABCD no longer includes other pixels.Because we have calculated the number that the adjacent point-to-point transmission of each row, column needs the average pixel that inserts in previous step, that is to say that we have known number and the position of the pixel that specifically need to insert in quadrangle ABCD.Suppose at inner E point and need to insert pixel.After this set up the Z axis of orientation, the numerical value of the gray scale that this axle can represent pixel, RGB etc., the gray scale corresponding take gray scale as example ABCD is A ' B ' C ' D ' on figure.The adjacent point of A ' B ' C ' D ' is coupled together, obtain the linear change between each point.After this E is projected to one group of opposite side (as AD and BC) of ABCD, then the corresponding gray value that finds two subpoints respectively on A ' D ' and B ' C ', at last the point of these two gray values on figure coupled together, so just can find gray value to Z-direction from the E point.In like manner, also can use AB, CD both sides as the projection limit, the result of its acquisition is identical.
If after the insertion pixel, the pixel of low-resolution image is more than high-definition picture, calculate the pixel number that each row or column need to be deleted; With the pixel sum of this row or column pixel number divided by the needs deletion, and round downwards, be designated as S; Since S+1 pixel, every pixel of S pixel deletion, until residual pixel point row or column corresponding to high-definition picture equates, for example: after carrying out bilinear interpolation, the pixel of low-resolution image is 1400 points, and pixel corresponding to high-definition picture is 1250, and counting that will delete this moment is 1400-1250=150, then do the business: 1400 ÷ 150=9.33, rounding downwards is 9.Then since the 10th pixel, 1 pixel of every 9 point deletions is deleted altogether 150.Need to prove, this delet method also is applicable to the operation that pixel that low-resolution image appears after interpolation in front is for the first time Duoed than the high-definition picture pixel.
Like this after twice interpolation, the resolution of low-resolution image is consistent with full resolution pricture, then can carry out the synthetic of image: first determine the synthetic form of image, image can be collectively referred to as in the present invention form (side-by-side) or point and point form (dot-by-dot) shoulder to shoulder, and be further divided into full frame (full) and half screen (half), that is:
The image after processing when if synthetic form is full frame (full side-by-side) shoulder to shoulder or full frame point and point (full dot-by-dot) by the left and right side by side or up and down side by side mode synthesize one road image; If synthetic form is half screen shoulder to shoulder when (half side-by-side) or half screen point and point (half dot-by-dot), the two-way image is taken out pixel every row or column, then by left and right side by side synthetic one road image of mode side by side or up and down.
Need to prove, the present invention can also synthesize according to other form when carrying out the combined diagram picture, has more than to be limited to above-mentioned several picture formats.
As Fig. 5, be the system block diagram of stereo-picture synthesizer of the present invention, comprise in this system 4 modules that connect successively: signal receiving module 100, image processing module 200, image synthesis unit 300 and image output module 400.Signal receiving module 100 obtains the two-way image, and differentiates the resolution of two-way image, for example in the two-way stereo camera shooting, obtain the different image of two-way resolution by two camera lenses, compared with prior art, signal receiving module 100 no longer limits the resolution of two-way image; Image processing module 200 carries out interpolation conversion to the low-resolution image in the two-way image that obtains, and makes the image resolution ratio after conversion equate with high-definition picture; After 300 pairs of conversions of image synthesis unit, image and high-definition picture synthesize processing; Stereo-picture after being synthesized by image output module 400 outputs at last.
Concrete as shown in Figure 6, image processing module 200 also specifically comprises: the images match unit 201, the first interpolating unit 202 and the second interpolating unit 203 that connect successively.The function of unit is as follows:
Images match unit 201 is used for each pixel of low-resolution image is searched the Corresponding matching point on high-definition picture; If can correctly mate the pixel of remembering in this low-resolution image is correct match point, otherwise is error matching points;
The first interpolating unit 202 is used for adjacent two correct match points, searches corresponding two corresponding pixel points in high-definition picture, is inserted between two correct match points after the pixel between two corresponding pixel points is average by row or column.When two correct match points are with delegation the time, be inserted between two correct match points after by column average between two corresponding pixel points; And when two correct match points are same row, be inserted between two correct match points after average by row between two corresponding pixel points.
As shown in Figure 7, in order to realize interpolation success for the first time, images match unit 201 disposes matching template generator 2011, the pixel of this matching template generator 2011 in the low-resolution image is as mid point or summit, choose the pixel zone of (2m+1) * (2n+1) as matching template, 1≤m≤5,1≤n≤5 wherein; When choosing, the preferential pixel of attempting in the low-resolution image is set up matching template as mid point, when the pixel zone of choosing has exceeded original low-resolution image, change pixel in the low-resolution image into as the summit, make the zone of choosing be arranged in low-resolution image fully.
It is regional that matching template covering device 2012 covers the high-definition picture corresponding pixel points with matching template;
Calculate the mistake matching rate by mistake matching rate calculator 2013, this mistake matching rate is:
Wherein, the poor sum of absolute grayscale is the zone that is covered by matching template in high-definition picture, with the absolute value sum of the difference of corresponding pixel points gray value in matching template;
Then miss matching threshold comparator 2014 and set mistake matching rate threshold values, if the mistake matching rate correctly mates, otherwise is erroneous matching less than mistake matching rate threshold value.This threshold value is 1% to 5%, and numerical value is less, and the matching degree of resulting normal match point is higher.
As shown in Figure 8, the second interpolating unit 203 is used for the linear pixel that inserts between the neighbor pixel of image after the processing of the first interpolating unit 202, makes the low-resolution image after insertion equate with the pixel of high-definition picture.Concrete, the second interpolating unit 203 comprises:
Insertion count calculator 2031 relatively the first interpolating unit 202 obtain the pixel number of images and high-definition picture, determine that the first interpolating unit 202 processes the average insertion of neighbor pixel in images afterwards and count, and round up;
Bilinear interpolation device 2032 is used for according to bilinear interpolation method, and the image that obtains to the first interpolating unit 202 inserts pixel;
Pixel adjuster 2033, the pixel that is used for low-resolution image after inserting pixel calculate the pixel number that needs each row or column deletion during more than high-definition picture; With the pixel sum of this row or column pixel number divided by the needs deletion, and round downwards, be designated as S; Since S+1 pixel, every pixel of S pixel deletion, until residual pixel point row or column corresponding to high-definition picture equates.
After the interpolation of twice, two images that resolution is identical have been obtained, image output module 400 is collectively referred to as form (side-by-side) or point and point form (dot-by-dot) shoulder to shoulder with image, and is further divided into full frame (full) and half screen (half), that is:
The image after processing when if synthetic form is full frame (full side-by-side) shoulder to shoulder or full frame point and point (full dot-by-dot) by the left and right side by side or up and down side by side mode synthesize one road image; If synthetic form is half screen shoulder to shoulder when (half side-by-side) or half screen point and point (half dot-by-dot), the two-way image is taken out pixel every row or column, then by left and right side by side synthetic one road image of mode side by side or up and down.
These are only the specific embodiment of the invention, can not limit scope of the present invention with this, the equalization that those skilled in the art in the art do according to this creation changes, and the change known of those skilled in that art, all should still belong to the scope that the present invention is contained.
Claims (10)
1. a stereo-picture synthetic method, is characterized in that, comprises the following steps:
S1, collection two-way are taken same object from different perspectives respectively and are obtained, and have the image of different resolution;
S2, the image that has low resolution in described two-way image is carried out interpolation conversion, the resolution that has the image of high-resolution in the resolution that makes the image after conversion and described two-way image equates;
S3, the image that has a high-resolution in the image after conversion and described two-way image synthesize processing, the formation stereo-picture;
Stereo-picture after S4, output are synthesized.
2. stereo-picture synthetic method according to claim 1, is characterized in that, described step S2 comprises:
S21, each pixel in described image with low resolution is searched the Corresponding matching point on described image with high-resolution; If a pixel in corresponding described image with low resolution can find corresponding match point in described image with high-resolution, this pixel in described image with low resolution is recorded as correct match point, otherwise this pixel is recorded as error matching points;
S22, to adjacent two correct match points, search corresponding two corresponding pixel points in described image with high-resolution, when described two adjacent correct match points are positioned at delegation, be inserted into described two adjacent correct match points between after by column average the pixel between described two corresponding pixel points or when described two adjacent correct match points are positioned at same row, be inserted between described two adjacent correct match points, to obtain the first interpolation image after pixel between described two corresponding pixel points is average by row;
S23, between the neighbor pixel of the first interpolation image that above-mentioned steps S22 obtains the linear pixel that inserts, make the low-resolution image after insertion equate with the pixel of high-definition picture.
3. stereo-picture synthetic method according to claim 2, is characterized in that, described step S21 comprises:
S211, the pixel in the described image with low resolution be as mid point or summit, chooses the pixel zone of (2m+1) * (2n+1) as matching template, and wherein m and n are the natural number of choosing from 1 to 5 scope;
S212, matching template is covered in described image with high-resolution the zone at corresponding with pixel in described image with low resolution pixel place;
S213, calculating mistake matching rate, described mistake matching rate is:
Wherein, the poor sum of absolute grayscale is the zone that is covered by matching template in described image with high-resolution, with the absolute value sum of the difference of corresponding pixel points gray value in matching template;
S214 sets mistake matching rate threshold value, if the mistake matching rate correctly mates, otherwise is erroneous matching less than mistake matching rate threshold value.
4. stereo-picture synthetic method according to claim 2, is characterized in that, described step S23 comprises:
The first interpolation image that obtains in S231, comparison step S22 and described pixel number with higher resolution image are determined that the average insertion of neighbor pixel in described the first interpolation image is counted, and are rounded up;
S232, according to bilinear interpolation method, insert pixel in described the first interpolation image;
If S233 inserts the pixel quantity of described image with low resolution after pixel more than described pixel quantity with image of high-resolution, calculating need to be in the pixel number of each row or column deletion of described image with low resolution; With the pixel sum of this row or column pixel number divided by the needs deletion, and round downwards, be designated as S; Since S+1 pixel, every pixel of S pixel deletion, until residual pixel point equates with described corresponding row or column with image of high-resolution.
5. stereo-picture synthetic method according to claim 2, is characterized in that, described step S3 comprises:
S31, determine that image synthesizes form;
If the synthetic form of S32 is shoulder to shoulder full frame or full frame when point and point, with described image with high-resolution with process after described image with low resolution by left and right side by side synthetic one road image of mode side by side or up and down; If synthetic form be half screen shoulder to shoulder or half screen when point and point, the two-way image is taken out pixel every row or column, then by left and right side by side synthetic one road image of mode side by side or up and down.
6. a stereo-picture synthesizer, is characterized in that, comprising:
Signal receiving module (100) is taken same object from different perspectives respectively for the collection two-way and is obtained, and has the image of different resolution;
Image processing module (200), the image that is used for described two-way image is had low resolution carries out the interpolation conversion, and the resolution that has higher resolution image in the resolution that makes the image after conversion and described two-way image equates;
Image synthesis unit (300) is used for that the image after conversion and described two-way image are had higher resolution image and synthesize processing, the formation stereo-picture;
Image output module (400) is used for the stereo-picture after output is synthesized;
Described signal receiving module (100), image processing module (200), image synthesis unit (300) is connected 400 with image output module) connect successively.
7. stereo-picture synthesizer according to claim 6, is characterized in that, described image processing module (200) comprising:
Images match unit (201) is used for each pixel of described image with low resolution is searched the Corresponding matching point on described image with high-resolution; If a pixel in corresponding described image with low resolution can find corresponding match point in described image with high-resolution, this pixel in described image with low resolution is recorded as correct match point, otherwise this pixel is recorded as error matching points;
the first interpolating unit (202), be used for adjacent two correct match points, search corresponding two corresponding pixel points in described image with high-resolution, when described two adjacent correct match points are positioned at delegation, be inserted into described two adjacent correct match points between after by column average the pixel between described two corresponding pixel points or when described two adjacent correct match points are positioned at same row, be inserted between described two adjacent correct match points after pixel between described two corresponding pixel points is average by row, to obtain the first interpolation image,
The second interpolating unit (203) is used for the linear pixel that inserts between the neighbor pixel of the first interpolation image, makes the low-resolution image after insertion equate with the pixel of high-definition picture.
8. stereo-picture synthesizer according to claim 7, is characterized in that, described images match unit (201) comprising:
Matching template generator (2011), the pixel of described matching template generator (2011) in the described image with low resolution is as mid point or summit, choose the pixel zone of (2m+1) * (2n+1) as matching template, wherein m and n are the natural number of choosing from 1 to 5 scope;
Matching template covers device (2012), is used for matching template is covered the zone at described image with high-resolution pixel place corresponding with pixel in described image with low resolution;
Mistake matching rate calculator (2013) is used for calculating the mistake matching rate, and this mistake matching rate is:
Wherein, the poor sum of absolute grayscale is the zone that is covered by matching template in described image with high-resolution, with the absolute value sum of the difference of corresponding pixel points gray value in matching template;
Mistake matching threshold comparator (2014) is for setting mistake matching rate threshold value, if the mistake matching rate correctly mates, otherwise is erroneous matching less than mistake matching rate threshold value.
9. stereo-picture synthesizer according to claim 7, is characterized in that, described the second interpolating unit (203) comprising:
The insertion calculator (2031) of counting is used for relatively that the first interpolating unit obtains image and described pixel number with higher resolution image, determines that the average insertion of neighbor pixel in the first interpolating unit acquisition image is counted, and rounds up;
Bilinear interpolation device (2032) is used for according to bilinear interpolation method, inserts pixel in the image of the first interpolating unit acquisition;
Pixel adjuster (2033), be used for the pixel quantity of described image with low resolution after inserting pixel more than described pixel quantity with image of high-resolution, calculating need to be in the pixel number of each row or column deletion of described image with low resolution; With the pixel sum of this row or column pixel number divided by the needs deletion, and round downwards, be designated as S; Since S+1 pixel, every pixel of S pixel deletion, until residual pixel point equates with described corresponding row or column with image of high-resolution.
10. stereo-picture synthesizer according to claim 7, is characterized in that, described image synthesis unit (300) comprising:
Form selector (301) is used for determining the synthetic form of image;
Image compressor (302), it is shoulder to shoulder full frame or full frame when point and point being used at synthetic form, with described image with high-resolution with process after described image with low resolution by the left and right side by side or up and down side by side mode synthesize one road image; If synthetic form be half screen shoulder to shoulder or half screen when point and point, the two-way image is taken out pixel every row or column, then by left and right side by side synthetic one road image of mode side by side or up and down.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310100895.1A CN103179424B (en) | 2013-03-26 | 2013-03-26 | Method and device for synthesising three-dimensional image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310100895.1A CN103179424B (en) | 2013-03-26 | 2013-03-26 | Method and device for synthesising three-dimensional image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103179424A true CN103179424A (en) | 2013-06-26 |
| CN103179424B CN103179424B (en) | 2015-03-11 |
Family
ID=48638995
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310100895.1A Active CN103179424B (en) | 2013-03-26 | 2013-03-26 | Method and device for synthesising three-dimensional image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103179424B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106507088A (en) * | 2016-12-14 | 2017-03-15 | 郑州胜龙信息技术股份有限公司 | Receive the 3 D image display method of upper and lower and left-right format piece source signal |
| CN106803888A (en) * | 2017-03-06 | 2017-06-06 | 联想(北京)有限公司 | The method and electronic equipment of composograph |
| CN108737745A (en) * | 2017-04-21 | 2018-11-02 | 杭州海康威视数字技术股份有限公司 | video fusion method and device |
| CN109302600A (en) * | 2018-12-06 | 2019-02-01 | 成都工业学院 | A kind of stereo scene filming apparatus |
| CN110191331A (en) * | 2018-02-22 | 2019-08-30 | Tcl新技术（惠州）有限公司 | A kind of very three-dimensional naked eye 3D rendering synthetic method, storage medium and synthesizer |
| CN110809147A (en) * | 2019-09-20 | 2020-02-18 | 北京铂石空间科技有限公司 | Image processing method and device, computer storage medium and electronic equipment |
| CN112954251A (en) * | 2019-12-10 | 2021-06-11 | RealMe重庆移动通信有限公司 | Video processing method, video processing device, storage medium and electronic equipment |
| CN114007057A (en) * | 2020-07-28 | 2022-02-01 | 北京小米移动软件有限公司 | Terminal, photographing method, photographing apparatus, and computer-readable storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100562920C (en) * | 2006-05-22 | 2009-11-25 | 株式会社东芝 | High resolution enabling apparatus and method |
| CN102025959A (en) * | 2009-09-22 | 2011-04-20 | 三星电子株式会社 | System and method for producing high definition video from low definition video |
| CN102110227A (en) * | 2010-11-24 | 2011-06-29 | 清华大学 | Compound method for classifying multiresolution remote sensing images based on context |
| CN102479380A (en) * | 2010-11-25 | 2012-05-30 | 北京大学 | Image interpolation method capable of improving image resolution and device utilizing image interpolation method |
| CN102496158A (en) * | 2011-11-24 | 2012-06-13 | 中兴通讯股份有限公司 | Method and device for image information processing |
| CN102761764A (en) * | 2012-07-16 | 2012-10-31 | 清华大学 | Upper sampling method used for depth picture of three-dimensional stereo video |
| CN102918836A (en) * | 2010-05-13 | 2013-02-06 | 高通股份有限公司 | Frame packing for asymmetric stereo video |
-
2013
- 2013-03-26 CN CN201310100895.1A patent/CN103179424B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100562920C (en) * | 2006-05-22 | 2009-11-25 | 株式会社东芝 | High resolution enabling apparatus and method |
| CN102025959A (en) * | 2009-09-22 | 2011-04-20 | 三星电子株式会社 | System and method for producing high definition video from low definition video |
| CN102918836A (en) * | 2010-05-13 | 2013-02-06 | 高通股份有限公司 | Frame packing for asymmetric stereo video |
| CN102110227A (en) * | 2010-11-24 | 2011-06-29 | 清华大学 | Compound method for classifying multiresolution remote sensing images based on context |
| CN102479380A (en) * | 2010-11-25 | 2012-05-30 | 北京大学 | Image interpolation method capable of improving image resolution and device utilizing image interpolation method |
| CN102496158A (en) * | 2011-11-24 | 2012-06-13 | 中兴通讯股份有限公司 | Method and device for image information processing |
| CN102761764A (en) * | 2012-07-16 | 2012-10-31 | 清华大学 | Upper sampling method used for depth picture of three-dimensional stereo video |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106507088A (en) * | 2016-12-14 | 2017-03-15 | 郑州胜龙信息技术股份有限公司 | Receive the 3 D image display method of upper and lower and left-right format piece source signal |
| CN106803888A (en) * | 2017-03-06 | 2017-06-06 | 联想(北京)有限公司 | The method and electronic equipment of composograph |
| CN108737745A (en) * | 2017-04-21 | 2018-11-02 | 杭州海康威视数字技术股份有限公司 | video fusion method and device |
| CN110191331A (en) * | 2018-02-22 | 2019-08-30 | Tcl新技术（惠州）有限公司 | A kind of very three-dimensional naked eye 3D rendering synthetic method, storage medium and synthesizer |
| CN110191331B (en) * | 2018-02-22 | 2022-01-04 | 深圳市华胜软件技术有限公司 | True three-dimensional naked eye 3D image synthesis method, storage medium and synthesis device |
| CN109302600A (en) * | 2018-12-06 | 2019-02-01 | 成都工业学院 | A kind of stereo scene filming apparatus |
| CN109302600B (en) * | 2018-12-06 | 2023-03-21 | 成都工业学院 | Three-dimensional scene shooting device |
| CN110809147A (en) * | 2019-09-20 | 2020-02-18 | 北京铂石空间科技有限公司 | Image processing method and device, computer storage medium and electronic equipment |
| CN112954251A (en) * | 2019-12-10 | 2021-06-11 | RealMe重庆移动通信有限公司 | Video processing method, video processing device, storage medium and electronic equipment |
| CN112954251B (en) * | 2019-12-10 | 2023-03-21 | RealMe重庆移动通信有限公司 | Video processing method, video processing device, storage medium and electronic equipment |
| CN114007057A (en) * | 2020-07-28 | 2022-02-01 | 北京小米移动软件有限公司 | Terminal, photographing method, photographing apparatus, and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103179424B (en) | 2015-03-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103179424B (en) | Method and device for synthesising three-dimensional image | |
| US9924153B2 (en) | Parallel scaling engine for multi-view 3DTV display and method thereof | |
| CN103238337B (en) | Three-dimensional image acquisition system and method | |
| CN105611270B (en) | A kind of binocular vision auto-stereo display system | |
| WO2009134155A1 (en) | Real-time stereo image matching system | |
| WO2008153313A2 (en) | System and method for generating and regenerating 3d image files based on 2d image media standards | |
| CN103220545A (en) | Hardware implementation method of stereoscopic video real-time depth estimation system | |
| CN102113022A (en) | Image conversion method and apparatus | |
| CN102387387A (en) | Image processing apparatus and method | |
| CN104168487A (en) | Video signal frame synchronization method and device | |
| KR101083824B1 (en) | stereo camera system and parallax detection method using thereof | |
| CN103702103A (en) | Optical grating three-dimensional printing image synthetic method based on binocular camera | |
| CN113393382B (en) | Binocular picture super-resolution reconstruction method based on multi-dimensional parallax prior | |
| CN103379332A (en) | Decoding method, coding method and coding device of three-dimensional video sequence auxiliary information | |
| CN109302600B (en) | Three-dimensional scene shooting device | |
| Park et al. | Real time rectification using differentially encoded lookup table | |
| CN112634127B (en) | Unsupervised stereo image redirection method | |
| CN103813144A (en) | Information processing device, imaging device, and information processing method | |
| CN104661014A (en) | Space-time combined cavity filling method | |
| CN103533327B (en) | DIBR (depth image based rendering) system realized on basis of hardware | |
| CN111508447A (en) | Image time sequence control circuit of grating type naked eye 3D liquid crystal screen based on FPGA | |
| Schaffner et al. | Hybrid ASIC/FPGA system for fully automatic stereo-to-multiview conversion using IDW | |
| Lee et al. | 3D model reconstruction based on multiple view image capture | |
| CN103002194A (en) | Television signal synchronizing circuit and television signal synchronizing method | |
| CN109089100B (en) | Method for synthesizing binocular stereo video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C56 | Change in the name or address of the patentee | ||
| CP03 | Change of name, title or address |
Address after: 518000 Beek science and technology building, room, No. 9 research road, Nanshan District high tech Zone, Guangdong, China, 1501-B Patentee after: INLIFE-HANDNET CO., LTD. Address before: 518054 Guangdong city of Shenzhen province Nanshan District Nanhai Road Guangdong sea (Shenzhen city) 7 Building 3 floor Patentee before: Inlife-handnet Co., Ltd. |
|
| EE01 | Entry into force of recordation of patent licensing contract | ||
| EE01 | Entry into force of recordation of patent licensing contract |
Application publication date: 20130626 Assignee: Beijing Yu Technology Co., Ltd. Assignor: INLIFE-HANDNET CO., LTD. Contract record no.: 2017440020014 Denomination of invention: Method and device for synthesizing three-dimensional image Granted publication date: 20150311 License type: Common License Record date: 20170306 |