CN111432196A - Integrated imaging ring sector micro-image array generation method based on ray tracing - Google Patents
Integrated imaging ring sector micro-image array generation method based on ray tracing Download PDFInfo
- Publication number
- CN111432196A CN111432196A CN202010324656.4A CN202010324656A CN111432196A CN 111432196 A CN111432196 A CN 111432196A CN 202010324656 A CN202010324656 A CN 202010324656A CN 111432196 A CN111432196 A CN 111432196A
- Authority
- CN
- China
- Prior art keywords
- micro
- ring sector
- ring
- image array
- rays
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
Abstract
The invention provides a method for generating an integrated imaging ring sector micro-image array based on ray tracing, which comprises the steps of screening out a ring sector area in each image element by using a ray tracing rendering technology, establishing a coordinate mapping relation between each pixel in a ring sector effective area and a viewing viewpoint, taking the viewing viewpoint as a starting point of rays, taking the connecting line direction of the viewing viewpoint and the corresponding pixel as the emergent direction of the rays, emitting the rays to a virtual 3D scene, and rendering once to generate the ring sector micro-image array. The method can efficiently provide a data source for desktop 360 DEG all-round 3D display or single-side all-round 3D display.
Description
Technical Field
The invention relates to an integrated imaging technology, in particular to a method for generating an integrated imaging ring fan-shaped micro-image array based on ray tracing.
Background
The integrated imaging is a naked eye true 3D display technology, a 3D film source of the integrated imaging is a micro image array, and the integrated imaging can be obtained by shooting a real 3D scene through a camera array and can also be obtained by rendering a virtual 3D scene through a computer. In the process of integrated imaging 3D display, light rays emitted by the micro image array are modulated by the lens array, and a 3D image is reconstructed in space. The viewer can watch full-color and full-parallax 3D images without wearing any vision-aid equipment, and the stereoscopic vision fatigue is avoided. Therefore, the wall surface three-dimensional display can be used in conventional wall surface 3D display, and can also be applied to desktop 360-degree all-round 3D display or single-side all-round 3D display, as shown in figure 1.
The optimal viewing visual area for 360-degree circular viewing 3D display or single-side circular viewing 3D display on the desktop is in an annular or annular sector shape, and viewing viewpoints are also arranged in an annular or annular sector shape and are not consistent with conventional wall surface 3D display. When a computer is used for generating a micro-image array corresponding to the ring sector visual area, a large amount of shooting, correction and pixel mapping work needs to be finished, the whole process is complex, and the calculation time is long. At present, no efficient integrated imaging ring sector micro-image array generation method is available.
Disclosure of Invention
In order to solve the problems, the invention provides a method for generating an integrated imaging ring sector micro-image array based on ray tracing, which comprises the steps of screening out a ring sector area in each image element by using a ray tracing rendering technology, then establishing a coordinate mapping relation between each pixel in an effective area of the ring sector and a viewing viewpoint, taking the viewing viewpoint as a starting point of rays, taking a connecting line direction of the viewing viewpoint and the corresponding pixel as an emergent direction of the rays, emitting the rays to a virtual 3D scene, and rendering once to generate the ring sector micro-image array.
The method comprises the following four steps.
Firstly, a virtual integrated imaging desktop 3D display model is built.
And secondly, establishing a local pixel coordinate system, and screening out a ring sector effective area of each image element.
And thirdly, establishing a coordinate mapping relation between pixels in the ring sector effective area and the viewing viewpoint.
And fourthly, emitting and tracking light rays, and rendering to obtain the ring sector micro-image array.
The method comprises the following steps of establishing a virtual integrated imaging desktop 3D display model, establishing a global space rectangular coordinate system X-Y-Z, and determining the relative position relation of a micro-image array plane, a lens array plane, a virtual 3D object and a viewing viewpoint, wherein the lens array plane is only used as a reference plane and does not exist in the rendering process, the center of the micro-image array plane is coincident with the origin of the global space rectangular coordinate system, the distance from the micro-image array plane to the lens array plane is g, the distance from the lens array plane to the viewing viewpoint plane is l, the distance between adjacent pixels in the micro-image array is p, and the resolution of the micro-image array is M × N, wherein M represents the number of pixels contained in the horizontal direction, N represents the number of pixels contained in the vertical direction, M, N represents the global coordinate of the pixels in the micro-image array, M ∈ {1,2,3, …, M }, N ∈ {1,2,3, …, N }.
Assuming that the pixel offset of the central point corresponding to the ring-sector image element compared with the central point of the conventional square image element is s, the resolution of the square area in which each ring-sector image element is located is A × B, and taking the center of each conventional square image element as the origin of coordinates, establishing a local pixel coordinate system m0-n0. Global (m, n) and local (m) coordinates of pixels in a square region in which the ring-sector image element is located0,n0) Satisfies the following relationship:
where mod (, x) represents the remainder operation. Pixel coordinate (m) in square region within ring sector effective area0,n0) Satisfies the following conditions:
wherein r is1And r2The radii of the inner ring and the outer ring of the ring sector are respectively, and theta is the vertex angle of the ring sector.
And the third step, establishing a coordinate mapping relation between the pixels in the ring sector effective area and the viewing viewpoint. And taking the viewing viewpoint as the starting point of the light, and taking the connecting line direction of the viewing viewpoint and the corresponding pixel as the emergent direction of the light. Local coordinates (m) of pixels within the ring sector effective area0,n0) The relationship with the viewing viewpoint coordinates (X, Y, Z) satisfies:
and fourthly, emitting and tracking light rays, and rendering to obtain the ring sector micro-image array. And (4) according to the coordinate mapping relation between the pixels in the ring-sector-shaped effective area and the viewing viewpoint established in the formula (3), taking the viewing viewpoint as the starting point of the light, taking the connecting line direction between the viewing viewpoint and the corresponding pixels as the emergent direction of the light, and emitting the light to the scene. And (3) the light ray collides with the surface of the 3D object, the color of the pixel is calculated according to the material of the surface of the object and the ambient illumination, and a complete ring-sector micro-image array can be obtained by one-time rendering.
According to the integrated imaging ring sector-shaped micro-image array generation method based on ray tracing, provided by the invention, the mapping relation between effective pixels and a viewing viewpoint is established by screening the ring sector-shaped effective area in each image element, and the micro-image array corresponding to the ring sector-shaped viewing viewpoint can be generated by one-time rendering by using a ray tracing rendering method, and no redundant data exists in the rendering process. The method can efficiently provide a data source for desktop 360 DEG all-round 3D display or single-side all-round 3D display.
Drawings
The foregoing aspects and advantages of the invention will become further apparent and more readily appreciated from the following detailed description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1a is a schematic diagram of a desktop 360 ° panoramic 3D display effect.
Fig. 1b is a schematic diagram of 3D display effect of desktop single-edge surround viewing.
FIG. 2 is a flowchart of a method for generating a fan-shaped micro-image array of an integrated imaging ring based on ray tracing according to an embodiment of the present application.
Fig. 3 is a schematic diagram of building a virtual integrated imaging desktop 3D display model according to an embodiment of the present application.
Fig. 4 is a schematic diagram of a local pixel coordinate system corresponding to an image element according to an embodiment of the present application.
FIG. 5 is a ring sector micro-image array generated according to an embodiment of the present application.
The reference numbers in the figures are:
13D image, 2 viewer, 3 micro image array plane, 4 lens array plane, 5 virtual 3D object, 6 viewing viewpoint plane, 7 ring sector image element, 8 ring sector micro image array
It should be understood that the above-described figures are merely schematic and are not drawn to scale.
Detailed Description
To facilitate an understanding of the present application, the present application will now be described more fully with reference to the accompanying drawings. Alternative embodiments of the present application are shown in the drawings. This application may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terminology used herein in the description of the invention is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.
As used herein, the directional terms "vertical," "horizontal," and the like are used for purposes of illustration only and are not intended to be limiting.
The method for generating an integrated imaging ring sector micro-image array based on ray tracing proposed by the present application will be described in detail below with reference to the embodiments and the accompanying drawings disclosed by the present application.
FIG. 2 shows a flow chart of a ray tracing based integrated imaging ring fan-shaped micro-image array generation method according to an embodiment of the present application, which includes the following steps.
And S100, building a virtual integrated imaging desktop 3D display model.
Step S200, a local pixel coordinate system is established, and a ring sector effective area of each image element is screened out.
Step S300, establishing a coordinate mapping relation between the pixels in the ring sector effective area and the viewing viewpoint.
And step S400, emitting and tracking light rays, and rendering to obtain the ring sector micro-image array.
In an embodiment, in the first step, in the step of constructing a virtual integrated imaging desktop 3D display model, a global spatial rectangular coordinate system X-Y-Z is established, and a relative position relationship between a micro image array plane, a lens array plane, a virtual 3D object, and a viewing viewpoint is determined, where the lens array plane 4 is only used as a reference plane and does not exist in a rendering process, as shown in fig. 3, a center of the micro image array plane 3 coincides with an origin of the global spatial rectangular coordinate system, a distance g between the micro image array plane 3 and the lens array plane 4 may be 13mm, a distance l between the lens array plane 4 and the viewing viewpoint plane 6 may be 600mm, the virtual 3D object 5 may be a sphere on a plane, and is located between the lens array plane 4 and the viewing viewpoint plane 6, a distance p between adjacent pixels in the micro image array may be 0.03mm, a resolution M × N of the micro image array may be 750 ×, (M, N) represents global coordinates of pixels in the micro image array, M, N {1,2, 673, …, ∈, …, 36750, 750, and N } represent global.
In one embodiment, in the second step, establishing a local pixel coordinate system, and screening out the ring-sector effective area of each image element, fig. 4 shows a method for constructing a ring-sector effective area of each image element according to the first embodiment of the present applicationThe pixel offset s of the center point corresponding to the ring-fan-shaped image element 7 compared with the center point of the conventional square image element may be 30, the resolution a × B of the square region where each ring-fan-shaped image element 7 is located may be 50 × 50, and the local pixel coordinate system m is established with the center of each conventional square image element as the origin of coordinates0-n0Global (m, n) and local (m) coordinates of the pixels in the square area of the ring-sector picture element 70,n0) Satisfies the following relationship:
where mod (, x) represents the remainder operation. Pixel coordinate (m) in square region within ring sector effective area0,n0) Satisfies the following conditions:
wherein r is1And r2The radii of the inner and outer rings, which are ring sectors, respectively, may be 20 pixels and 50 pixels, respectively, and θ is the apex angle of the ring sector, which may be 60 °.
In an embodiment, in the third step, in the step of establishing a coordinate mapping relationship between the pixels in the ring-sector-shaped effective area and the viewing viewpoint, the viewing viewpoint is used as a starting point of the light, and a connection direction between the viewing viewpoint and the corresponding pixel is used as an exit direction of the light. Local coordinates (m) of a pixel0,n0) The relation with the viewpoint coordinates (X, Y, Z) satisfies:
in one embodiment, the fourth step is a step of emitting and tracing rays, and rendering to obtain the ring sector micro-image array. And (4) according to the coordinate mapping relation between the pixels in the ring-sector-shaped effective area and the viewing viewpoint established in the formula (3), taking the viewing viewpoint as the starting point of the light, taking the connecting line direction between the viewing viewpoint and the corresponding pixels as the emergent direction of the light, and emitting the light to the scene. And (3) the light rays collide with the surface of the 3D object, the color of the pixel is calculated according to the material of the surface of the object and the ambient illumination, and a complete micro-image array can be obtained by one-time rendering. FIG. 5 illustrates a ring sector micro-image array generated according to an embodiment of the present application.
Claims (5)
1. An integrated imaging ring sector micro-image array generation method based on ray tracing is characterized in that a ray tracing rendering technology is utilized, a ring sector area in each image element is screened out firstly, then a coordinate mapping relation between each pixel in a ring sector effective area and a viewing viewpoint is established, the viewing viewpoint is used as a starting point of rays, a connecting line direction of the viewing viewpoint and the corresponding pixel is used as an emergent direction of the rays, the rays are emitted to a virtual 3D scene, and the ring sector micro-image array can be generated through one-time rendering; the method comprises the following four steps: firstly, building a virtual integrated imaging desktop 3D display model; secondly, establishing a local pixel coordinate system, and screening out a ring sector effective area of each image element; thirdly, establishing a coordinate mapping relation between pixels in the ring sector effective area and the viewing viewpoint; and fourthly, emitting and tracking light rays, and rendering to obtain the ring sector micro-image array.
2. The method for generating the fan-shaped micro image array of the integrated imaging ring based on the ray tracing as claimed in claim 1, wherein in the step of constructing the virtual 3D display model of the integrated imaging desktop, a global rectangular spatial coordinate system X-Y-Z is firstly established, and the relative position relationship between a micro image array plane, a lens array plane, a virtual 3D object and a viewing viewpoint is determined, wherein the lens array plane is only used as a reference plane and does not exist in the rendering process, the center of the micro image array plane coincides with the origin of the global rectangular spatial coordinate system, the distance from the micro image array plane to the lens array plane is g, the distance from the lens array plane to the viewing viewpoint plane is l, the distance between adjacent pixels in the micro image array is p, the resolution of the micro image array is M × N, M represents the number of pixels included in the horizontal direction, N represents the number of pixels included in the vertical direction, and (M, N) represents the global coordinate of the pixels in the micro image array, M ∈ {1,2,3, 3632, M }, N } represents the global coordinate of the pixel included in the vertical direction, ….3.
3. The method as claimed in claim 1, wherein in the step of establishing a local pixel coordinate system and screening out the effective area of the ring sector of each image element, the resolution of the square area in which each image element of the ring sector is located is a × B, and the local pixel coordinate system m is established by using the center point of the normal square image element as the origin of coordinates0-n0Global (m, n) and local (m) coordinates of pixels in a square region in which the ring-sector image element is located0,n0) Satisfies the following relationship:
where mod (, x) represents the remainder operation, the pixel coordinates (m) in the square region that lie within the active area of the ring sector0,n0) Satisfies the following conditions:
and is
Wherein r is1And r2The radii of the inner ring and the outer ring of the ring sector are respectively, and theta is the vertex angle of the ring sector.
4. The method as claimed in claim 1, wherein in the step of establishing the coordinate mapping relationship between the pixels in the ring-sector effective area and the viewing viewpoints, the viewing viewpoints are used as the starting points of the light, the connecting line direction between the viewing viewpoints and the corresponding pixels is used as the emitting direction of the light, and the pixels in the ring-sector effective area are used as the emitting direction of the lightLocal coordinates (m) of the element0,n0) The relation with the viewpoint coordinates (X, Y, Z) satisfies:
5. the method for generating an integrated imaging ring sector micro-image array based on ray tracing as claimed in claim 1, wherein in the fourth step, rays are emitted and traced, and in the step of obtaining the ring sector micro-image array by rendering, according to the coordinate mapping relationship between the established pixel and the viewing viewpoint, the viewing viewpoint is taken as the starting point of the rays, the direction of the connecting line between the viewing viewpoint and the corresponding pixel is taken as the emitting direction of the rays, the rays are emitted into the scene, the rays collide with the surface of the 3D object, the color of the pixel is calculated according to the material of the surface of the object and the ambient illumination, and a complete micro-image array can be obtained by rendering at one time.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010324656.4A CN111432196B (en) | 2020-04-23 | 2020-04-23 | Integrated imaging ring sector micro-image array generation method based on ray tracing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010324656.4A CN111432196B (en) | 2020-04-23 | 2020-04-23 | Integrated imaging ring sector micro-image array generation method based on ray tracing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111432196A true CN111432196A (en) | 2020-07-17 |
| CN111432196B CN111432196B (en) | 2021-05-28 |
Family
ID=71554419
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010324656.4A Active CN111432196B (en) | 2020-04-23 | 2020-04-23 | Integrated imaging ring sector micro-image array generation method based on ray tracing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111432196B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120268566A1 (en) * | 2011-04-21 | 2012-10-25 | Samsung Electronics Co., Ltd. | Three-dimensional color image sensors having spaced-apart multi-pixel color regions therein |
| CN103005498A (en) * | 2013-01-11 | 2013-04-03 | 张鹏 | Bean meatballs and preparation method thereof |
| CN103048866A (en) * | 2012-12-13 | 2013-04-17 | 浙江大学 | Suspended 360-degree optical field three-dimension display device and method based on flat plane display |
| US8964298B2 (en) * | 2010-02-28 | 2015-02-24 | Microsoft Corporation | Video display modification based on sensor input for a see-through near-to-eye display |
| CN104509088A (en) * | 2012-06-01 | 2015-04-08 | 奥斯坦多科技公司 | Spatio-temporal light field cameras |
| CN107608085A (en) * | 2017-09-15 | 2018-01-19 | 四川大学 | Based on 360 ° of integration imaging desktop 3D display devices for combining micro- pattern matrix |
| CN108881881A (en) * | 2018-08-03 | 2018-11-23 | 北京航空航天大学 | A kind of adaptive micro- pattern matrix generation method of integration imaging desktop 3D display |
| CN108919503A (en) * | 2018-08-03 | 2018-11-30 | 北京航空航天大学 | A kind of 360 ° of desktop 3D display systems of integration imaging based on visual angle guide layer |
-
2020
- 2020-04-23 CN CN202010324656.4A patent/CN111432196B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8964298B2 (en) * | 2010-02-28 | 2015-02-24 | Microsoft Corporation | Video display modification based on sensor input for a see-through near-to-eye display |
| US20120268566A1 (en) * | 2011-04-21 | 2012-10-25 | Samsung Electronics Co., Ltd. | Three-dimensional color image sensors having spaced-apart multi-pixel color regions therein |
| CN104509088A (en) * | 2012-06-01 | 2015-04-08 | 奥斯坦多科技公司 | Spatio-temporal light field cameras |
| CN103048866A (en) * | 2012-12-13 | 2013-04-17 | 浙江大学 | Suspended 360-degree optical field three-dimension display device and method based on flat plane display |
| CN103005498A (en) * | 2013-01-11 | 2013-04-03 | 张鹏 | Bean meatballs and preparation method thereof |
| CN107608085A (en) * | 2017-09-15 | 2018-01-19 | 四川大学 | Based on 360 ° of integration imaging desktop 3D display devices for combining micro- pattern matrix |
| CN108881881A (en) * | 2018-08-03 | 2018-11-23 | 北京航空航天大学 | A kind of adaptive micro- pattern matrix generation method of integration imaging desktop 3D display |
| CN108919503A (en) * | 2018-08-03 | 2018-11-30 | 北京航空航天大学 | A kind of 360 ° of desktop 3D display systems of integration imaging based on visual angle guide layer |
Non-Patent Citations (1)
| Title |
|---|
| LIONELJACQUES等: "Direction and surface sampling in ray tracing for spacecraft radiative heat transfer", 《AEROSPACESCIENCEANDTECHNOLOGY》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111432196B (en) | 2021-05-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111062873B (en) | Parallax image splicing and visualization method based on multiple pairs of binocular cameras | |
| US6793350B1 (en) | Projecting warped images onto curved surfaces | |
| TWI397317B (en) | Method for providing output image in either cylindrical mode or perspective mode | |
| CN104778656B (en) | Fisheye image correcting method based on spherical perspective projection | |
| EP1453001A1 (en) | IMAGE PROCESSING APPARATUS, IMAGE PROCESSING METHOD, STORAGE MEDIUM, AND COMPUTER PROGRAM | |
| KR102072639B1 (en) | Image generating device and image display control device | |
| CN111981982B (en) | Multi-directional cooperative target optical measurement method based on weighted SFM algorithm | |
| US20130070094A1 (en) | Automatic registration of multi-projector dome images | |
| KR20140090775A (en) | Correction method of distortion image obtained by using fisheye lens and image display system implementing thereof | |
| Gurrieri et al. | Acquisition of omnidirectional stereoscopic images and videos of dynamic scenes: a review | |
| WO2020151268A1 (en) | Generation method for 3d asteroid dynamic map and portable terminal | |
| TW201921318A (en) | Apparatus and method for generating a tiled three-dimensional image representation of a scene | |
| CN110675482B (en) | Spherical fibonacci pixel lattice panoramic picture rendering and displaying method of virtual three-dimensional scene | |
| CN114511447A (en) | Image processing method, device, equipment and computer storage medium | |
| US10699372B2 (en) | Image generation apparatus and image display control apparatus | |
| CN112002003B (en) | Spherical panoramic stereo picture generation and interactive display method for virtual 3D scene | |
| CN111432196B (en) | Integrated imaging ring sector micro-image array generation method based on ray tracing | |
| CN111583117A (en) | Rapid panoramic stitching method and device suitable for space complex environment | |
| CN109461116B (en) | 720 panorama unfolding monitoring method based on opengl | |
| CN114967170B (en) | Display processing method and device based on flexible naked eye three-dimensional display equipment | |
| JP3387900B2 (en) | Image processing method and apparatus | |
| JPH1118007A (en) | Omnidirectional image display system | |
| CN113674356A (en) | Camera screening method and related device | |
| CN112465693A (en) | 360-degree all-round-looking underwater vision imaging method and system | |
| JP6719240B2 (en) | Image projection apparatus and planetarium apparatus using the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |