CN104902257B - A kind of quickly various visual angles image synthesis method - Google Patents
A kind of quickly various visual angles image synthesis method Download PDFInfo
- Publication number
- CN104902257B CN104902257B CN201510288252.3A CN201510288252A CN104902257B CN 104902257 B CN104902257 B CN 104902257B CN 201510288252 A CN201510288252 A CN 201510288252A CN 104902257 B CN104902257 B CN 104902257B
- Authority
- CN
- China
- Prior art keywords
- image
- coordinate
- data
- visual angle
- referenced
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Abstract
The open a kind of quickly various visual angles image synthesis method of the present invention, parameter according to display screen and input presentation content, the corresponding relation of the image at each visual angle and the coordinate of original 2D image is inversely calculated by the coordinate of the image at the final visual angle that need to produce, the method can reduce useless calculation step, and then memory requirements image operation required for and CPU operand can be greatly reduced；According to experimental result, using the operand of the CPU of computer of the present invention can reduce 30% ~ 35%, memory requirements can reduce by 59 ~ 63%.
Description
Technical field
The present invention relates to a kind of image synthesis method, particularly relate to a kind of quickly various visual angles image synthesis method.
Background technology
Naked-eye stereoscopic display system is, with the tradition main difference of 2D flat panel display system, the part that lens generate with content.For bore hole display screen, it is on the flat-faced screen of general 2D, add one layer of lens or grating；And when content generates, according to lens or grating, the visual angle number when design produces the picture of different visual angles, if the visual angle number of lens is 6, then when content generates, the computing doing depth image-based rendering technology (DIBR) is then needed to generate the picture of 6 width different visual angles, but after having generated 6 width different visual angles pictures, also need the design of the mapping parameters according to lens or grating to synthesize last 1 various visual angles image.
Visible, when traditional naked-eye stereoscopic display system content generates, need to generate N according to visual angle number (N) and open image, finally further according to one image of Data Synthesis of pixel-map, the most each frame image needs to waste the operand of ((N-1)/N), even angle is 6, then the computing having (5/6) is waste, and the consumption for internal memory Yu central processing unit is the most considerable.
Summary of the invention
It is an object of the invention to overcome the deficiencies in the prior art, it is provided that a kind of can the quickly various visual angles image synthesis method of effectively save operand.
The present invention uses the technical scheme to be:
A kind of quickly various visual angles image synthesis method, it comprises the following steps:
1) data acquisition: obtain input picture and display screen parameter；
2) depth map generates: when input picture is the 2D image without depth map, 2D image carries out the collection of depth information, produces the depth map that a width is corresponding with this 2D image；
When input picture is 2D image and corresponding depth map, then it is directly entered step 3)；
3) set up coordinate relation: according to the pixel-map coordinate that image to be generated is corresponding, set up the coordinate relation that image to be generated is corresponding with 2D image:
3.1) resolution adjustment: 2D image and corresponding depth map are done the action amplified/reduce, makes 2D image identical with the resolution ratio of the pixel-map of display screen with the resolution ratio of corresponding depth map；
3.2) determine that benchmark visual angle and benchmark multi-view image obtain the lookup coordinate of data in 2D image: arranging display screen visual angle number is n, setting visual angle on the basis of the visual angle of the n-th/2, the coordinate of the pixel-map that benchmark visual angle need to be inserted image obtains the lookup coordinate of data in 2D image as benchmark multi-view image；
3.3) determine that non-referenced visual angle and non-referenced multi-view image obtain the lookup coordinate of data in 2D image:
3.3.1) set other visual angles as non-referenced visual angle, calculate, according to display screen parameter, the scope that non-referenced multi-view image obtains the lookup coordinate of data in 2D image；
Obtain the tolerable parallax parameter of display screen, including going out screen parallax and entering to shield parallax, and the visual angle that W is acquisition data, the visual angle number that on the basis of X, visual angle is corresponding be set, go out to shield parallax+1 according to Y=W-X, Z1=-Y*(), Z2=-Y*(enters to shield parallax-1)；Calculate Z1 and Z2 respectively,
Setting the resolution ratio of display screen as C*D, the coordinate position of the pixel-map of image inserted by need to be found is (A, B), then non-referenced multi-view image obtains the lookup coordinate of data in the range of (A+Z1, B) ~ (A+Z2, B) in 2D image；
3.3.2) determine that non-referenced visual angle figure obtains the lookup coordinate of data in 2D image:
Set non-referenced multi-view image identical with the lookup coordinate range that non-referenced multi-view image obtains data in 2D image at the lookup coordinate range of depth map acquisition data, from scope (A+Z1, B) ~ (A+Z2, B) find the coordinate that depth value is maximum in, be the lookup coordinate that non-referenced multi-view image obtains data in 2D image by this setting coordinate；When running into identical depth value, then take first maximum coordinate of the depth value run into；
4) stereo-picture is generated: respectively according to benchmark multi-view image and the corresponding data searching the correspondence that coordinate obtains from 2D image of non-referenced multi-view image, the data got are done deformation process and generates a stereo-picture；
5) image shows: transmit the stereo-picture generated to showing screen display.
Further, in described step 3.3.1, non-referenced multi-view image obtains the value of scope searching coordinate of data in 2D image and defers to following condition:
When A+Z1 is less than or equal to 0, then set A+Z1=0；
When A+Z2 is more than or equal to C, then set A+Z2=C.
The present invention uses above technical scheme, parameter according to display screen and input presentation content, the corresponding relation of the image at each visual angle and the coordinate of original 2D image is inversely calculated by the coordinate of the image at the final visual angle that need to produce, the method can reduce useless calculation step, and then memory requirements image operation required for and CPU operand can be greatly reduced；According to experimental result, using the operand of the CPU of computer of the present invention can reduce 30% ~ 35%, memory requirements can reduce by 59 ~ 63%.
Accompanying drawing explanation
Below in conjunction with the drawings and specific embodiments, the present invention is described in further details；
The flow process of a kind of quick various visual angles image synthesis method of Fig. 1 present invention；
The Parameter Map of the depth map of a kind of quick various visual angles image synthesis method of Fig. 2 present invention.
Detailed description of the invention
As it is shown in figure 1, a kind of quickly various visual angles image synthesis method of the present invention, it comprises the following steps:
1) data acquisition: obtain input picture and display screen parameter；
2) depth map generates: when input picture is the 2D image without depth map, 2D image carries out the collection of depth information, produces the depth map that a width is corresponding with this 2D image；
When input picture is 2D image and corresponding depth map, then it is directly entered step 3)；
3) coordinate relation is set up: according to the pixel-map coordinate that image to be generated is corresponding, set up the coordinate relation that image to be generated is corresponding with 2D image；
3.1) resolution adjustment: 2D image and corresponding depth map are done the action amplified/reduce, makes 2D image identical with the resolution ratio of the pixel-map of display screen with the resolution ratio of corresponding depth map；
3.2) determine that benchmark visual angle and benchmark multi-view image obtain the lookup coordinate of data in 2D image: arranging display screen visual angle number is n, setting visual angle on the basis of the visual angle of the n-th/2, the coordinate of the pixel-map that benchmark visual angle need to be inserted image obtains the lookup coordinate of data in 2D image as benchmark multi-view image；
If for 6 view stereo display screens, n=6 in this example, then i.e. visual angle 3, the n-th/2 visual angle, is set as benchmark visual angle；Therefore, it is i.e. the coordinate that the pixel-map of image need to be inserted in visual angle 3 that the image at visual angle 3 obtains the coordinate of searching of data in 2D image, and both are relations one to one；
3.3) determine that non-referenced visual angle and non-referenced multi-view image obtain the lookup coordinate of data in 2D image:
3.3.1) set other visual angles as non-referenced visual angle, calculate, according to display screen parameter, the scope that non-referenced multi-view image obtains the lookup coordinate of data in 2D image；
Obtaining the tolerable parallax parameter of display screen, including going out screen parallax and entering to shield parallax, can go out screen and the scope entering screen in parallax parameter representative picture, its unit is Pixel；And the visual angle that W is acquisition data, the visual angle number that on the basis of X, visual angle is corresponding are set, go out to shield parallax+1 according to Y=W-X, Z1=-Y*(), Z2=-Y*(enters to shield parallax-1), calculate Z1 and Z2 respectively；
Setting the resolution ratio of display screen as C*D, the coordinate position of the pixel-map of image inserted by need to be found is (A, B), then non-referenced multi-view image obtains the lookup coordinate of data in the range of (A+Z1, B) ~ (A+Z2, B) in 2D image；
Holding example, visual angle on the basis of visual angle 3, then X=3, the coordinate position (A, B) of the pixel-map of image inserted by the need that the coordinate at visual angle 3 is i.e. to be found,
The tolerable parallax parameter of stereoscopic display screen described further is :-3 ~ 4 Pixel, when visual angle 2 image to be obtained, X=3, W=2, Y=W-X=2-3=-1, Z1=-Y*(min(parallax)+1)=-(-1) * (-3+1)=-2, Z2=-Y*(max(parallax)-1)=-(-1) * 3=3, be exactly therefore scope to be searched for, then non-referenced multi-view image obtains the lookup coordinate of data in the range of (A-2 in 2D image, B) ~ (A+3, B).
Further, in described step 3.3.1, non-referenced multi-view image obtains the value of scope searching coordinate of data in 2D image and defers to following condition:
When A+Z1 is less than or equal to 0, then set A+Z1=0；
When A+Z2 is more than or equal to C, then set A+Z2=C.
Hold example, if the coordinate position (A of the pixel-map of image inserted by need to be found, B) it is (1,0), owing to its value of A+Z1=1-3=-2 is less than 0, and its value of A+Z2=1+4=5 is less than C, then the value of the scope searching coordinate that final non-referenced multi-view image obtains data in 2D image is (0,0) ~ (5,0).
3.3.2) determine that non-referenced visual angle figure obtains the lookup coordinate of data in 2D image:
Set non-referenced multi-view image identical with the lookup coordinate range that non-referenced multi-view image obtains data in 2D image at the lookup coordinate range of depth map acquisition data, from scope (A+Z1, B) ~ (A+Z2, B) find the coordinate that depth value is maximum in, be the lookup coordinate that non-referenced multi-view image obtains data in 2D image by this setting coordinate；When running into identical depth value, then take first maximum coordinate of the depth value run into；
Holding example, the lookup coordinate range that non-referenced multi-view image obtains data at depth map is also (0,0) ~ (5,0), as in figure 2 it is shown, coordinate range (0,0) in ~ (5,0), coordinate (2,0) with (5,0) depth value is maximum, runs into identical depth value, takes first coordinate run into, therefore non-referenced visual angle figure obtains the lookup coordinate of data in 2D image is (2,0).
4) stereo-picture is generated: respectively according to benchmark multi-view image and the corresponding data searching the correspondence that coordinate obtains from 2D image of non-referenced multi-view image, the data got are done deformation process and generates a stereo-picture；
5) image shows: transmit the stereo-picture generated to showing screen display.
The present invention uses above technical scheme, parameter according to display screen and input presentation content, the corresponding relation of the image at each visual angle and the coordinate of original 2D image is inversely calculated by the coordinate of the image at the final visual angle that need to produce, the method can reduce useless calculation step, and then memory requirements image operation required for and CPU operand can be greatly reduced；According to experimental result, using the operand of the CPU of computer of the present invention can reduce 30% ~ 35%, memory requirements can reduce by 59 ~ 63%.
Claims (2)
1. a quick various visual angles image synthesis method, it is characterised in that: it comprises the following steps:
1) data acquisition: obtain input picture and display screen parameter；
2) depth map generates:
When input picture is the 2D image without depth map, 2D image is carried out the collection of depth information, produce the depth map that a width is corresponding with this 2D image；
When input picture is 2D image and corresponding depth map, then it is directly entered step 3)；
3) coordinate relation is set up: according to the pixel-map coordinate that image to be generated is corresponding, set up the coordinate relation that image to be generated is corresponding with 2D image；
3.1) resolution adjustment: 2D image and corresponding depth map are done the action amplified/reduce, makes 2D image identical with the resolution ratio of the pixel-map of display screen with the resolution ratio of corresponding depth map；
3.2) determine that benchmark visual angle and benchmark multi-view image obtain the lookup coordinate of data in 2D image: arranging display screen visual angle number is n, setting visual angle on the basis of the visual angle of the n-th/2, the coordinate of the pixel-map that benchmark visual angle need to be inserted image obtains the lookup coordinate of data in 2D image as benchmark multi-view image；
3.3) determine that non-referenced visual angle and non-referenced multi-view image obtain the lookup coordinate of data in 2D image:
3.3.1) set other visual angles as non-referenced visual angle, calculate, according to display screen parameter, the scope that non-referenced multi-view image obtains the lookup coordinate of data in 2D image:
Obtaining the tolerable parallax parameter of display screen, including going out screen parallax and enter to shield parallax, and to arrange W be to obtain the visual angle number that the visual angle correspondence of data is corresponding, the visual angle number that on the basis of X, visual angle is corresponding, go out to shield parallax+1 according to Y=W-X, Z1=-Y*(), Z2=-Y*(enters to shield parallax-1)；Calculate Z1 and Z2 respectively,
Set need to be found and insert the coordinate position of pixel-map of image as (A, B), then non-referenced multi-view image obtains the lookup coordinate of data in the range of (A+Z1, B) ~ (A+Z2, B) in 2D image；
3.3.2) determine that non-referenced visual angle figure obtains the lookup coordinate of data in 2D image:
Set non-referenced multi-view image identical with the lookup coordinate range that non-referenced multi-view image obtains data in 2D image at the lookup coordinate range of depth map acquisition data, from scope (A+Z1, B) ~ (A+Z2, B) find the coordinate that depth value is maximum in, be the lookup coordinate that non-referenced multi-view image obtains data in 2D image by this setting coordinate；When running into identical depth value, then take first maximum coordinate of the depth value run into；
4) stereo-picture is generated: respectively according to benchmark multi-view image and the corresponding data searching the correspondence that coordinate obtains from 2D image of non-referenced multi-view image, the data got are done deformation process and generates a stereo-picture；
5) image shows: transmit the stereo-picture generated to showing screen display.
One the most according to claim 1 quickly various visual angles image synthesis method, it is characterized in that: described step 3.3.1) in non-referenced multi-view image in 2D image, obtain the value of scope searching coordinate of data defer to following condition: set the resolution ratio of display screen as C*D then
When A+Z1 is less than or equal to 0, then set A+Z1=0；
When A+Z2 is more than or equal to C, then set A+Z2=C.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510288252.3A CN104902257B (en) | 2015-05-29 | 2015-05-29 | A kind of quickly various visual angles image synthesis method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510288252.3A CN104902257B (en) | 2015-05-29 | 2015-05-29 | A kind of quickly various visual angles image synthesis method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104902257A CN104902257A (en) | 2015-09-09 |
| CN104902257B true CN104902257B (en) | 2016-08-31 |
Family
ID=54034617
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510288252.3A Expired - Fee Related CN104902257B (en) | 2015-05-29 | 2015-05-29 | A kind of quickly various visual angles image synthesis method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104902257B (en) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7113634B2 (en) * | 2001-07-31 | 2006-09-26 | Canon Kabushiki Kaisha | Stereoscopic image forming apparatus, stereoscopic image forming method, stereoscopic image forming system and stereoscopic image forming program |
| CN102625127B (en) * | 2012-03-24 | 2014-07-23 | 山东大学 | Optimization method suitable for virtual viewpoint generation of 3D television |
| CN102724529B (en) * | 2012-05-28 | 2014-08-06 | 清华大学 | Method and device for generating video sequence of virtual viewpoints |
| CN102843571B (en) * | 2012-09-14 | 2015-02-25 | 冠捷显示科技（厦门）有限公司 | Multi-view three-dimensional display image synthesis method |
| CN103647960B (en) * | 2013-12-24 | 2016-01-20 | 北京邮电大学 | A kind of method of compositing 3 d images |
-
2015
- 2015-05-29 CN CN201510288252.3A patent/CN104902257B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN104902257A (en) | 2015-09-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109961406A (en) | A kind of method, apparatus and terminal device of image procossing | |
| EP2774124B1 (en) | Depth-map generation for an input image using an example approximate depth-map associated with an example similar image | |
| JP6883608B2 (en) | Depth data processing system that can optimize depth data by aligning images with respect to depth maps | |
| US9769460B1 (en) | Conversion of monoscopic visual content to stereoscopic 3D | |
| WO2012094076A1 (en) | Morphological anti-aliasing (mlaa) of a re-projection of a two-dimensional image | |
| CN102905145B (en) | Stereoscopic image system, image generation method, image adjustment device and method thereof | |
| CN104574331A (en) | Data processing method, device, computer storage medium and user terminal | |
| US8619094B2 (en) | Morphological anti-aliasing (MLAA) of a re-projection of a two-dimensional image | |
| CN104021555B (en) | Image cutting framing method based on virtual printing technology | |
| US20130321409A1 (en) | Method and system for rendering a stereoscopic view | |
| Winkler | Efficient measurement of stereoscopic 3D video content issues | |
| EP2741503A1 (en) | Method and apparatus for color transfer between images | |
| US20180109775A1 (en) | Method and apparatus for fabricating a stereoscopic image | |
| CN104902257B (en) | A kind of quickly various visual angles image synthesis method | |
| Atapour-Abarghouei et al. | Extended patch prioritization for depth filling within constrained exemplar-based RGB-D image completion | |
| Kao | Stereoscopic image generation with depth image based rendering | |
| TW201909116A (en) | Depth calculation method and device thereof | |
| CN109089100B (en) | Method for synthesizing binocular stereo video | |
| Muddala et al. | Disocclusion handling using depth-based inpainting | |
| Liu et al. | A new stereo matching method for RAW image data based on improved SGBM | |
| KR20160056132A (en) | Image conversion apparatus and image conversion method thereof | |
| Shao et al. | Object-based depth image–based rendering for a three-dimensional video system by color-correction optimization | |
| Liang et al. | An efficient hole-filling method based on depth map in 3D view generation | |
| AU2011314243B2 (en) | Presenting two-dimensional elements in three-dimensional stereo applications | |
| KR102260519B1 (en) | 3D stereoscopic image conversion method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20160831 Termination date: 20170529 |