CN102404598B - Image generation system and method for stereoscopic 3D display - Google Patents
Image generation system and method for stereoscopic 3D display Download PDFInfo
- Publication number
- CN102404598B CN102404598B CN201110372986.1A CN201110372986A CN102404598B CN 102404598 B CN102404598 B CN 102404598B CN 201110372986 A CN201110372986 A CN 201110372986A CN 102404598 B CN102404598 B CN 102404598B
- Authority
- CN
- China
- Prior art keywords
- image
- display
- visual angle
- array
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Image Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses an image generation system and method for stereoscopic 3D display. Image sources of present most stereoscopic 3D display systems are acquired by cooperating display principles of optical field reconstruction and view field splicing. A generation system comprises a 2D display unit array, a lens array, an aperture stop array, a directional scattering screen, a precision guide rail, an image acquisition system and a computer. A generation method comprises the following steps of: cyclically scanning display points; capturing and identifying the image acquisition system; acquiring a map coordinate relation; transforming a perspective image source; moving the image acquisition system and repeatedly carrying out the movement; and overlapping all images to obtain an image source required for final display. According to the invention, an image processing method with flexibility and strong operability can be adopted based on specific 3D display equipment; and the method has the advantages that the image source can be acquired based on panel display or multi-projection stereoscopic 3D display system. The system and the method disclosed by the invention comprehensively consider system imaging aberration and system precision problems, and can obtain corrected images under lower computation complexity.
Description
Technical field
The present invention relates to image and generate and display packing, relate in particular to a kind of for stereoscopic three-dimensional display image generation system and method.
Background technology
The Image Mosaics technology is the study hotspot of computer vision and image processing field always, and, along with the high speed development of three-dimensional panorama Display Technique, become numerous three-dimensional display apparatus image sources with the image generation system of three dimensional constitution design and obtain the Main Means of employing.Image generation system with the three dimensional constitution design is according to the perspective projection method for drafting, and three-dimensional image information is reproduced on two-dimentional display system.Existing stereoscopic three-dimensional display device is mostly according to providing abundant observation visual angle in the laterally or vertical mode by field stitching, allow two eyes of observer across different visual angles to obtain fine and smooth three-dimensional perception.Principle accordingly, the image information of reproducing on two-dimentional display system is relevant with concrete three-dimensional display apparatus visual angle design parameter, often needs through the image processing process corresponding with the required visual angle information presented.Field of Computer Graphics processing thought commonly used is based on the mode that light field is rebuild, pixel scans and obtains corresponding visual angle required image information at present.The method has suitable universality in computer realm, and each visual angle image obtained has very high resolution and authenticity, but the image that this scheme generates is Consideration of Three-dimensional display system actual aberration and system accuracy problem not, the image generated is the required image of imaging under theoretical case often, not fully up to expectations through three-dimensional display system Projection Display effect out.
Generally, all many-sides such as successful three-dimensional display apparatus need to consider image resolution ratio, three-dimensional display effect, assess the cost, the stereoscopic three-dimensional display device of having developed at present is limited to the image that the factor such as system configuration often causes theoretical case to generate and can not perfectly shows, seeks a kind of image generation system and method that easily combines problems such as having considered system imaging aberration and device precision and has more actual application value.Main purpose of the present invention be to build a kind of possess universality, can be used for multiple stereoscopic three-dimensional display image generation system and method, it comprises projection three-dimensional display apparatus and the IMAQ recognition system that possesses higher expansion, its original intention is to combine the angle from the actual Projection Display of picture point under the problem of having considered system imaging aberration and device precision and obtains the required image source of demonstration full-scale condition, can be widely used in the stereoscopic three-dimensional display device based on multi-projector display or timesharing display splicing principle.
Summary of the invention
The objective of the invention is to overcome the deficiency of prior art and image generating method, provide a kind of for stereoscopic three-dimensional display image generation system and method.
Described two-dimentional array of display cells, lens arra, aperture array, directional scattering screen and the precise guide rail set gradually that comprise for stereoscopic three-dimensional display image generation system, wherein, directional scattering screen and precise guide rail are arranged concentric, be provided with image capturing system on precise guide rail, the image that in the two dimension array of display cells, all display units show projects to the imaging of directional scattering screen opposite side by corresponding lens arra, aperture array, and computer is connected with two-dimentional array of display cells with image capturing system respectively.
The N*1 array that the described two-dimentional array of display cells for stereoscopic three-dimensional display image generation system, lens arra and aperture array are transverse parallaxes, or be the N*M array of horizontal and vertical parallax.
The described two-dimentional array of display cells for stereoscopic three-dimensional display image generation system is the array that single two dimensional display or a plurality of two dimensional display form, and wherein, two dimensional display is LCD, LCOS, PDP, LED, CRT, OLED or projector.
The described image capturing system for stereoscopic three-dimensional display image generation system is that CCD or CMOS take device.
The described step for stereoscopic three-dimensional display image generating method is as follows:
1) at first image capturing system is arranged on the symmetry system having symmetry center line, and the alignment system imaging center is taken;
2) display unit in two-dimentional array of display cells shows a coordinate points (X
0, Y
0);
3) if image capturing system captures the corresponding coordinate dot information, be judged to be the image that the point shown on display unit belongs to this required demonstration in visual angle, carry out step 4); If image capturing system does not capture the corresponding coordinate dot information, be judged to be the image that the point shown on display unit does not belong to this required demonstration in visual angle, return to step 2) scan round shows next coordinate points;
4) record respectively the coordinate points information (X of demonstration point in the two dimensional image array of display cells caught
0, Y
0) and the coordinate points information (X in image capturing system
1, Y
1), send into computer and generate corresponding mapping relations; Scan round is recorded the coordinate points map information until all demonstration spot scans of the display unit in two-dimentional array of display cells finish;
5) computer obtains the original image that will present the corresponding visual angle of three-dimensional body, according to mapping relations, carries out from coordinate points (X
1, Y
1) to coordinate points (X
0, Y
0) variation, obtain presenting the image of the corresponding visual angle of three-dimensional body in two-dimentional array of display cells;
6) respectively to the left or to the right the mobile image acquisition system to position, next adjacent visual angle, wherein, the interval, visual angle of the angle intervals that image capturing system moves along precise guide rail and three-dimensional display system is complementary, repeating step 1) to step 5), until computer obtains presenting the image of all visual angles of three-dimensional body in two-dimentional array of display cells;
7) computer by present to some extent image in the two-dimentional array of display cells stack of the corresponding visual angle of three-dimensional body and generate the image that final two-dimentional array of display cells shows and send into respective display unit.
The original visual angle of the described three-dimensional body for stereoscopic three-dimensional display image generating method image is to be taken the image at each visual angle of virtual three-dimensional model by computer simulation, or by camera the image at corresponding visual angle actual photographed three-dimensional body.
Major advantage of the present invention be to propose a kind of possess universality, can be used for multiple stereoscopic three-dimensional display image generation system and method, it comprises projection three-dimensional display apparatus and the IMAQ recognition system that possesses higher expansion, its original intention is to combine the angle from the actual Projection Display of picture point under the problem of having considered system imaging aberration and device precision and obtains the required image source of demonstration full-scale condition, can be widely used in the stereoscopic three-dimensional display device based on multi-projector display or timesharing display splicing principle.
The accompanying drawing explanation
Below in conjunction with drawings and Examples, the present invention is further described.
Fig. 1 is the device basic structure schematic diagram for the method for displaying image of stereoscopic three-dimensional display;
Fig. 2 is image generating method flow process and the schematic diagram for stereoscopic three-dimensional display;
Fig. 3 is horizontal 15 visual angle three-dimensional display apparatus display unit basic structure schematic diagrames;
Fig. 4, Fig. 5 are the image calibration method schematic diagrames that horizontal 15 visual angle three-dimensional display apparatus are corresponding;
In figure, two dimensional image array of display cells 1, lens arra 2, aperture array 3, directional scattering screen 4, precise guide rail 5, image capturing system 6, computer 7.
Embodiment
As shown in Figure 1, comprise two-dimentional array of display cells 1, lens arra 2, aperture array 3, directional scattering screen 4 and the precise guide rail 5 set gradually for stereoscopic three-dimensional display image generation system, wherein, directional scattering screen 4 and precise guide rail 5 are arranged concentric, be provided with image capturing system 6 on precise guide rail 5, the image that in two dimension array of display cells 1, all display units show projects to directional scattering by corresponding lens arra 2, aperture array 3 and shields 4 opposite side imagings, and computer 7 is connected with two-dimentional array of display cells 1 with image capturing system 6 respectively.
The N*1 array that two dimension array of display cells 1, lens arra 2 and aperture array 3 are transverse parallaxes, or be the N*M array of horizontal and vertical parallax.Two dimension array of display cells 1 is the array that single two dimensional display or a plurality of two dimensional display form, and wherein, two dimensional display is LCD, LCOS, PDP, LED, CRT, OLED or projector.Image capturing system 6 is that CCD or CMOS take device.
As shown in Figure 2, the step for stereoscopic three-dimensional display image generating method is as follows:
1) at first image capturing system 6 is arranged on the symmetry system having symmetry center line, and the alignment system imaging center is taken;
2) display unit in two-dimentional array of display cells 1 shows a coordinate points (X
0, Y
0);
3) if image capturing system 6 captures the corresponding coordinate dot information, be judged to be the image that the point shown on display unit belongs to this required demonstration in visual angle, carry out step 4); If image capturing system 6 does not capture the corresponding coordinate dot information, be judged to be the image that the point shown on display unit does not belong to this required demonstration in visual angle, return to step 2) scan round shows next coordinate points;
4) record respectively the coordinate points information (X of demonstration point in two dimensional image array of display cells 1 caught
0, Y
0) and the coordinate points information (X in image capturing system 6
1, Y
1), send into computer 7 and generate corresponding mapping relations; Scan round is recorded the coordinate points map information until all demonstration spot scans of the display unit in two-dimentional array of display cells 1 finish;
5) computer 7 obtains the original image that will present the corresponding visual angle of three-dimensional body, according to mapping relations, carries out from coordinate points (X
1, Y
1) to coordinate points (X
0, Y
0) variation, obtain presenting the image of the corresponding visual angle of three-dimensional body in two-dimentional array of display cells 1;
6) respectively to the left or to the right mobile image acquisition system 6 to position, the adjacent visual angle of the next one, wherein, the interval, visual angle of the angle intervals that image capturing system 6 moves along precise guide rail 5 and three-dimensional display system is complementary, repeating step 1) to step 5), until computer 7 obtains presenting the image of all visual angles of three-dimensional body in two-dimentional array of display cells 1;
7) computer 7 by present to some extent image in two-dimentional array of display cells 1 stack of the corresponding visual angle of three-dimensional body and generate the image that final two-dimentional array of display cells 1 shows and send into respective display unit.
For the original visual angle of the three-dimensional body image of stereoscopic three-dimensional display image generating method, be the image by computer simulation shooting each visual angle of virtual three-dimensional model, or by camera the image at corresponding visual angle actual photographed three-dimensional body.
The image that the field stitching three-dimensional display apparatus that comprises 15 horizontally-spliced images of take generates a visual angle is example, and remaining visual angle all can be analogized and obtain.As shown in Figure 1, image array of display 1 comprises 15 projectors that dislocation is arranged to system configuration, and as shown in Figure 3, so-called projector is comprised of the part of image array of display 1, lens and an aperture, and aperture is close to lens the place ahead; Directional scattering screen 2 is arc, and the system centre O point of take is the center of circle, at vertical scattered beam, and horizontal scattered beam not.15 projectors are the system centre O of alignment settings in the horizontal direction, aims at the sustained height on diffuser screen 2 on vertical direction.The image of 15 projectors all passes through vertical diffuser screen 2 in vertical expansion, thereby sees the strip image at opposite side, and 15 width images just in time are spliced into a view picture complete image.
At first need to carry out one time image calibration before synthetic image.Visual angle position in the middle of first image capturing system 6 being placed in, the acquisition system position meaned as solid line in Fig. 1.Then show a white point on image array of display 1, coordinate is (X
0, Y
0), from the upper left corner of array of display, start white point is lined by line scan, as shown in Figure 4; Whether image capturing system 6 is just caught a width visual angle image in pixel of the every movement of white point, analyze white point in the image obtained and occur; If have, illustrate that the white point of this position belongs to this visual angle, the coordinate (X by it in the visual angle image obtained
1, Y
1) record, as shown in Figure 5, and with the image array of display in the coordinate (X of white point
0, Y
0) set up mapping relations.After on image array of display 1, all pixels all are scanned like this, (the X of the white point occurred in the zone that image capturing system 6 is caught
1, Y
1) coordinate all is mapped on image array of display 1 corresponding (X
0, Y
0), and present distributed areas, as shown in the dotted line frame of Fig. 5, this zone is exactly the image range that system can show.Just has calibrated at such visual angle.
After completing the image calibration at a visual angle, will belong to all (X at this visual angle
0, Y
0) be arranged to white, all the other are arranged to black, and now image capturing system 6 should collect a slice white portion be spliced into by 15 vertical white bands; Image capturing system 6, along precise guide rail 5 toward moving right, until some vertical bar images become black fully, thinks that image capturing system 6 has arrived next visual angle, and the angle turned over is the interval at adjacent visual angle.Repeat image calibration part above at next visual angle, until has all calibrated at all visual angles, finally can obtain (X on all visual angles
1, Y
1) and corresponding (X
0, Y
0) mapping relations.
After having calibrated, can be according to the mapping relations synthetic image obtained and without calibration again in the immovable situation of system parameters.Interval acquiring two dimension visual angle, visual angle image by the threedimensional model that finally will show or scene according to scaling block.The image range size that visual angle image scaling to system can be shown, and by (the X on the pixel of visual angle image and corresponding visual angle
1, Y
1) corresponding one by one, be assigned to (X according to mapping relations
0, Y
0) upper, all pixel (X at this visual angle
0, Y
0) by the visual angle image mapped at this visual angle, obtain.By parity of reasoning in all the other visual angle operations, and finally can obtain whole image array of display 1 needs the image shown.As long as show the final image generated on image array of display 1, at viewing area, just can see threedimensional model or scene.
Although be that the present invention is described further by the mode of illustrating and give an example here; but should be realized that; the present invention is not limited to the above-described embodiment and examples; it is illustrative that description above only is considered to; and it is nonrestrictive; those skilled in the art can make multiple conversion or modification, as long as no leaving the scope and spirit essence of establishing in claims, all are considered as within protection scope of the present invention.
Claims (2)
- One kind use system for stereoscopic three-dimensional display image generating method, it is characterized in that described system comprises the two-dimentional array of display cells (1) set gradually, lens arra (2), aperture array (3), directional scattering screen (4) and precise guide rail (5), wherein, directional scattering screen (4) and precise guide rail (5) are arranged concentric, be provided with image capturing system (6) on precise guide rail (5), the image that in two dimension array of display cells (1), all display units show is by corresponding lens arra (2), aperture array (3) projects to (4) the opposite side imaging of directional scattering screen, computer (7) is connected with two-dimentional array of display cells (1) with image capturing system (6) respectively,Its step is as follows:1) image capturing system (6) at first is arranged on the symmetry system having symmetry center line, and the alignment system imaging center is taken;2) display unit in two-dimentional array of display cells (1) shows a coordinate points (X 0, Y 0);3) if image capturing system (6) captures the corresponding coordinate dot information, be judged to be the image that the point shown on display unit belongs to this required demonstration in visual angle, carry out step 4); If image capturing system (6) does not capture the corresponding coordinate dot information, be judged to be the image that the point shown on display unit does not belong to this required demonstration in visual angle, return to step 2) scan round shows next coordinate points;4) record respectively the coordinate points information (X of demonstration point in two dimensional image array of display cells (1) caught 0, Y 0) and the coordinate points information (X in image capturing system (6) 1, Y 1), send into computer (7) and generate corresponding mapping relations; Scan round is recorded the coordinate points map information until all demonstration spot scans of the display unit in two-dimentional array of display cells (1) finish;5) computer (7) obtains the original image that will present the corresponding visual angle of three-dimensional body, according to mapping relations, carries out from coordinate points (X 1, Y 1) to coordinate points (X 0, Y 0) variation, obtain presenting the image of the corresponding visual angle of three-dimensional body in two-dimentional array of display cells (1);6) respectively to the left or to the right mobile image acquisition system (6) to position, next adjacent visual angle, wherein, the angle intervals that image capturing system (6) is mobile along precise guide rail (5) and the interval, visual angle of three-dimensional display system are complementary, repeating step 1) to step 5), until computer (7) obtains presenting the image of all visual angles of three-dimensional body in two-dimentional array of display cells (1);7) computer (7) by present to some extent image in two-dimentional array of display cells (1) stack of the corresponding visual angle of three-dimensional body and generate the image that final two-dimentional array of display cells (1) shows and send into respective display unit.
- 2. according to claim 1 a kind of for stereoscopic three-dimensional display image generating method, it is characterized in that the original visual angle of described three-dimensional body image is for taken the image at each visual angle of virtual three-dimensional model by computer simulation, or by camera the image at corresponding visual angle actual photographed three-dimensional body.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110372986.1A CN102404598B (en) | 2011-11-22 | 2011-11-22 | Image generation system and method for stereoscopic 3D display |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110372986.1A CN102404598B (en) | 2011-11-22 | 2011-11-22 | Image generation system and method for stereoscopic 3D display |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102404598A CN102404598A (en) | 2012-04-04 |
| CN102404598B true CN102404598B (en) | 2013-12-25 |
Family
ID=45886306
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110372986.1A Expired - Fee Related CN102404598B (en) | 2011-11-22 | 2011-11-22 | Image generation system and method for stereoscopic 3D display |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102404598B (en) |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102692805B (en) * | 2012-05-31 | 2015-01-21 | 浙江大学 | Multilayer liquid crystal-based projection type three-dimensional display device and method |
| TWI507014B (en) * | 2013-12-02 | 2015-11-01 | Nat Taichung University Science & Technology | System for calibrating three dimension perspective image and method thereof |
| CN105739106B (en) * | 2015-06-12 | 2019-07-09 | 南京航空航天大学 | A kind of true three-dimensional display apparatus of body-sensing multiple views large scale light field and method |
| CN105549183B (en) * | 2016-01-05 | 2018-01-16 | 中国航空工业集团公司洛阳电光设备研究所 | Wide-angle image device based on concentric spherical object lens |
| CN106980181B (en) * | 2017-05-16 | 2018-04-03 | 西安科技大学 | A kind of holographic 3D 3 d display devices and method |
| CN107580207A (en) * | 2017-10-31 | 2018-01-12 | 武汉华星光电技术有限公司 | The generation method and generating means of light field 3D display cell picture |
| CN109151447A (en) * | 2018-08-22 | 2019-01-04 | 陈宇拓 | A kind of novel naked eye three-dimensional optical field imaging system |
| CN113421344B (en) * | 2021-05-28 | 2023-03-28 | 互动视创科技(武汉)有限责任公司 | Immersive film watching device and method |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101866482B (en) * | 2010-06-21 | 2012-02-15 | 清华大学 | Panorama splicing method based on camera self-calibration technology, and device thereof |
| CN102238411B (en) * | 2011-06-29 | 2013-01-02 | 浙江大学 | Image display method for reflecting three-dimensional display |
| CN102231044A (en) * | 2011-06-29 | 2011-11-02 | 浙江大学 | Stereoscopic three-dimensional display based on multi-screen splicing |
-
2011
- 2011-11-22 CN CN201110372986.1A patent/CN102404598B/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN102404598A (en) | 2012-04-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102404598B (en) | Image generation system and method for stereoscopic 3D display | |
| JP5238429B2 (en) | Stereoscopic image capturing apparatus and stereoscopic image capturing system | |
| CN102692805B (en) | Multilayer liquid crystal-based projection type three-dimensional display device and method | |
| CN1949166A (en) | Free multi visul point polyprojecting 3D displaying system and method | |
| CN102231044A (en) | Stereoscopic three-dimensional display based on multi-screen splicing | |
| CN102595178B (en) | Field stitching three dimensional rendered images corrective system and bearing calibration | |
| CN102164298A (en) | Method for acquiring element image based on stereo matching in panoramic imaging system | |
| CN1700776A (en) | Method for displaying three-dimensional image, method for capturing three-dimensional image, and three-dimensional display apparatus | |
| JP6598362B2 (en) | Stereoscopic image display device | |
| CN102566251B (en) | Space three-dimensional display device and correction method based on modularization splicing | |
| CN110012286A (en) | A kind of human eye tracking 3 d display device of high viewpoint density | |
| CN107358577A (en) | A kind of quick joining method of cubic panorama | |
| CN102238411B (en) | Image display method for reflecting three-dimensional display | |
| CN115236871A (en) | Desktop type light field display system and method based on human eye tracking and bidirectional backlight | |
| US20080259281A1 (en) | Apparatus and method for displaying three-dimensional image | |
| JP2013238716A (en) | Method for synthesizing multi-visual point image information | |
| CN108061972B (en) | Curved surface light field display system | |
| JP4049738B2 (en) | Stereoscopic video display device and stereoscopic video imaging device | |
| CN202854481U (en) | True three-dimension image displaying system | |
| JP2020060711A (en) | Three-dimensional image display device | |
| CN101594548A (en) | Free stereo display method based on the DLP projection | |
| Kawakita et al. | 3D video capturing for multiprojection type 3D display | |
| CN103809364A (en) | True three-dimensional image display system and true three-dimensional image display method | |
| JP2021002783A (en) | Depth map generation device and program thereof, and stereoscopic image generation device | |
| CN117956133B (en) | Integrated imaging micro-image array generation method based on optimal voxel space distribution |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20131225 Termination date: 20211122 |