CN116708746A - Naked eye 3D-based intelligent display processing method - Google Patents
Naked eye 3D-based intelligent display processing method Download PDFInfo
- Publication number
- CN116708746A CN116708746A CN202310527791.2A CN202310527791A CN116708746A CN 116708746 A CN116708746 A CN 116708746A CN 202310527791 A CN202310527791 A CN 202310527791A CN 116708746 A CN116708746 A CN 116708746A
- Authority
- CN
- China
- Prior art keywords
- image
- images
- parallax
- dimensional
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 17
- 238000012545 processing Methods 0.000 claims abstract description 31
- 230000000694 effects Effects 0.000 claims abstract description 18
- 230000008447 perception Effects 0.000 claims abstract description 8
- 238000004364 calculation method Methods 0.000 claims abstract description 7
- 238000000034 method Methods 0.000 claims description 16
- 238000005516 engineering process Methods 0.000 claims description 11
- 238000005070 sampling Methods 0.000 claims description 9
- 238000013507 mapping Methods 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 6
- 230000000007 visual effect Effects 0.000 claims description 6
- 238000010276 construction Methods 0.000 claims description 5
- 239000013598 vector Substances 0.000 claims description 5
- 230000002146 bilateral effect Effects 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 4
- 238000001914 filtration Methods 0.000 claims description 4
- 230000015572 biosynthetic process Effects 0.000 claims description 3
- 230000004927 fusion Effects 0.000 claims description 3
- 230000010354 integration Effects 0.000 claims description 3
- 239000004973 liquid crystal related substance Substances 0.000 claims description 3
- 238000005457 optimization Methods 0.000 claims description 3
- 238000012887 quadratic function Methods 0.000 claims description 3
- 238000001308 synthesis method Methods 0.000 claims description 3
- 238000003786 synthesis reaction Methods 0.000 claims description 3
- 230000002194 synthesizing effect Effects 0.000 claims description 3
- 238000012360 testing method Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 description 6
- 230000009471 action Effects 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 208000003464 asthenopia Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/305—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/128—Adjusting depth or disparity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
- H04N13/317—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using slanted parallax optics
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02T—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
- Y02T10/00—Road transport of goods or passengers
- Y02T10/10—Internal combustion engine [ICE] based vehicles
- Y02T10/40—Engine management systems
Abstract
The invention discloses an intelligent display processing method based on naked eye 3D, which comprises the following steps: step one: obtaining a parallax image source, deducing an accurate three-dimensional geometric description of a given scene from an image or a series of images of the scene, and quantitatively determining the properties of objects in the scene; step two: obtaining depth information of left and right parallax images through calculation of parallax sizes of corresponding points to form a depth image of the scene, and further forming a certain included angle with pixels by adopting a cylindrical lens grating to reduce vertical resolution; step three: reconstructing a light field around the object by using the constructed screen for three-dimensional display, and optimizing the presence perception of the three-dimensional object; step four: and adjusting related parameters according to the characteristics of the current image scene, optimizing the processing effect of the images in different scenes, and performing three-dimensional display. The invention has the characteristics of stronger stereoscopic impression of image display and better depth perception.
Description
Technical Field
The invention relates to the technical field of intelligent display processing, in particular to an intelligent display processing method based on naked eye 3D.
Background
The naked eye 3D display technology is also called an auto-stereoscopic display technology, is a technology for enabling a viewer to watch stereoscopic images without wearing special vision-aiding equipment, comprises recording, transmitting and displaying processes, and is one of the technologies which are feasible for naked eye 3D in front of a traditional display, but the calculation amount for converting 2D images into 3D images is large, and the requirements on system software and hardware are high, so that the traditional conversion mode has the defects of insufficient image processing speed, high difficulty, high transmission bandwidth requirement, poor instantaneity and the like. Therefore, it is necessary to design an intelligent display processing method based on naked eye 3D with stronger stereoscopic impression and better depth perception of image display.
Disclosure of Invention
The invention aims to provide an intelligent display processing method based on naked eye 3D, which aims to solve the problems in the background technology.
In order to solve the technical problems, the invention provides the following technical scheme: an intelligent display processing method based on naked eye 3D comprises the following steps:
step one: obtaining a parallax image source, deducing an accurate three-dimensional geometric description of a given scene from an image or a series of images of the scene, and quantitatively determining the properties of objects in the scene;
step two: obtaining depth information of left and right parallax images through calculation of parallax sizes of corresponding points to form a depth image of the scene, and further forming a certain included angle with pixels by adopting a cylindrical lens grating to reduce vertical resolution;
step three: reconstructing a light field around the object by using the constructed screen for three-dimensional display, and optimizing the presence perception of the three-dimensional object;
step four: and adjusting related parameters according to the characteristics of the current image scene, optimizing the processing effect of the images in different scenes, and performing three-dimensional display.
According to the above technical solution, the step of obtaining a parallax image source includes:
shooting objects with a plurality of independent mark points from different angles through a plurality of cameras, shooting the same object from different angles, acquiring images, calculating the relative position and the direction of the cameras and the internal parameters of the cameras by utilizing each image, acquiring a plurality of parallax images, processing the object point positions on the images by utilizing a computer technology to obtain the depth of the objects, integrating the stereoscopic images based on the acquired images, and resolving the details of the three-dimensional stereoscopic images of the integrated stereoscopic images by utilizing a display provided with a two-dimensional three-dimensional conversion device.
According to the above technical solution, the step of obtaining depth information of the left and right parallax images by calculating the parallax sizes of the corresponding points includes:
the parallax size of the corresponding point of the image is closely related to the depth information of the scene, a plurality of parallax images are formed by utilizing the depth image and one parallax image, stereo matching is carried out on the image pair acquired by the camera through a binocular stereo matching algorithm, the mapping relation between the pixel point in the image and the scene position is obtained, and the 3D image is synthesized after the parallax value of the pixel is obtained according to the mapping relation.
According to the above technical solution, the step of forming a depth image of the scene includes:
generating a feature vector with a non-deformed scale by simulating multi-scale features of data in a visual image, fitting a three-dimensional quadratic function to position extreme points, detecting the extreme points in the field of the current layer and the extreme points in the layers of the upper and lower different scale factors after acquiring the extreme points, taking the selected maximum point as a feature point, then utilizing the local characteristics of the feature point to distribute directions, taking the extracted feature point as a center, sampling in the field range of the point, counting the sampling point by using a histogram, counting the abscissa of a coordinate axis to represent the directions, wherein the size is 0-360 degrees, one direction represents 10 degrees, the highest peak direction of the histogram represents the main direction, taking the direction point with the peak value higher than 80% of the main peak value in the rest of the histogram as the auxiliary direction of the feature point, testing the direction of the feature point as the coordinate axis direction, selecting a sampling window around the feature point, generating a key seed point, and regarding the discrete matching point as a parallax map by using a SIFT algorithm and a region growth algorithm when a new matching point exists in the neighborhood of the matching point;
after the matching points of the left view and the right view are obtained, parallax is obtained by calculating the difference value of the matching points, bilateral filtering is carried out on the initial left view under the parallax image, a plurality of parallax images are generated by utilizing a projection principle, multi-view synthesis is carried out by a multi-view image synthesis method suitable for all liquid crystal grating displays, and pixels of each view are filled into a three-dimensional image according to a certain rule to form an image with a plurality of view information.
According to the above technical solution, the step of reconstructing a light field around an object by using the constructed screen for three-dimensional display includes:
reconstructing a light field around the object by using the constructed screen for three-dimensional display;
combining and collecting the pre-collected scene images by adopting a light field drawing technology;
after the light field is established, correct light field slices are extracted through searching, interpolation, combination and other modes, and new view angle images at different positions are reconstructed in real time;
obtaining a slice sequence of a plurality of groups of scene light fields by reproducing the sampled three-dimensional light fields, and then preprocessing the three-dimensional light fields to obtain images suitable for projection;
the microstructure on the circular reflective directional scattering screen is utilized to deflect incident light to the region where a viewer is located, scatter the incident light at a larger angle in the vertical direction, keep the light direction unchanged in the horizontal direction, reconstruct a 360-degree visible three-dimensional display light field through screen turning and scattering, and present a 360-degree visible suspended three-dimensional object above the screen.
According to the above technical scheme, the steps of adjusting relevant parameters according to the characteristics of the current image scene, optimizing the processing effects of the images in different scenes, and performing stereoscopic display include:
drawing the multi-view to generate a view, extracting sub-pixels of the view by utilizing image fusion, and then arranging the view according to the sub-pixel arrangement requirement of the lenticular naked eye 3D display screen to fuse the view into a naked eye 3D image;
and outputting the image data to a naked eye 3D drive board through an HDMI interface, acquiring an image video format input in the current naked eye 3D display system by the drive board through calculating image similarity, judging a processing mode currently corresponding to the system, adjusting the processing parameters of the video point synthesizing system according to the technological parameters of the naked eye 3D display device, and performing stereoscopic display.
According to the technical scheme, the intelligent display system comprises
The parallax image module is used for acquiring a plurality of parallax images;
the three-dimensional display construction module is used for constructing a three-dimensional scene for naked eye 3D three-dimensional display;
and the stereoscopic optimization display module is used for optimizing the processing effect of the images in different scenes and performing stereoscopic display.
Compared with the prior art, the invention has the following beneficial effects: according to the invention, the precise three-dimensional geometric description of a given scene is deduced from an image or a series of images of the scene by acquiring a parallax image source, the properties of objects in the scene are quantitatively determined, then the parallax size of corresponding points is calculated, the depth information of left and right parallax images is obtained, the depth image of the scene is formed, a certain included angle is formed by adopting a cylindrical lens grating and pixels, the vertical resolution is reduced, the constructed three-dimensional display screen is utilized to reconstruct the light field around the objects, the presence perception of the three-dimensional objects is optimized, finally the processing effect of the images in different scenes is optimized according to the characteristics of the current image scene, the three-dimensional display is performed, the three-dimensional sense of the displayed images is stronger, and the depth perception of the user aiming at the displayed images is better.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:
fig. 1 is a flowchart of an intelligent display processing method based on naked eye 3D according to a first embodiment of the present invention;
fig. 2 is a schematic diagram of module composition of an intelligent display processing system based on naked eye 3D according to a second embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Embodiment one: fig. 1 is a flowchart of an intelligent display processing method based on naked eye 3D according to an embodiment of the present invention, where the embodiment may apply a scene of naked eye 3D intelligent display, and the method may be executed by an intelligent display processing system based on naked eye 3D according to the embodiment, as shown in fig. 1, and the method specifically includes the following steps:
step one: obtaining a parallax image source, deducing an accurate three-dimensional geometric description of a given scene from an image or a series of images of the scene, and quantitatively determining the properties of objects in the scene;
in the embodiment of the invention, a plurality of cameras shoot objects with a plurality of independent mark points from different angles, shoot the same object from different angles and acquire images, calculate the relative position and direction of the cameras and the internal parameters of the cameras by utilizing each image, acquire a plurality of parallax images, process the positions of the object points on the images by utilizing a computer technology to obtain the depth of the object, integrate the three-dimensional images based on the acquired images, and utilize a display provided with a two-dimensional three-dimensional conversion device to resolve the details of the three-dimensional images after the integration, wherein the vertical resolution is changed to be 1/3 of the original resolution by adjusting the inclination angle of a lens array, and the resolution on the horizontal plane is also adjusted to be 1/3 of the original resolution on the vertical plane, so that the resolution on the horizontal plane is changed to make up for the defect of resolution deficiency on the three-dimensional image distortion, and simultaneously reduce the degree of resolution on the three-dimensional horizontal plane and relatively improve the definition of the three-dimensional images.
Step two: the depth information of the left parallax image and the right parallax image is obtained through calculation of the corresponding parallax size, the depth image of the scene is formed, a certain included angle is formed between the cylindrical lens grating and the pixels, and the vertical resolution is reduced;
in the embodiment of the invention, the parallax size on the corresponding point of the image is closely related to the depth information of the scene, a plurality of parallax images are formed by utilizing the depth image and one parallax image, stereo matching is carried out on the image pair acquired by the camera through a binocular stereo matching algorithm, the mapping relation between the pixel point in the image and the scene position is obtained, and the 3D image is synthesized after the parallax value of the pixel is obtained according to the mapping relation;
by means of example, a multi-scale feature of data in a visual image is simulated, a feature vector with a non-deformed scale is generated, a three-dimensional quadratic function is fitted to locate extreme points, after the extreme points are obtained, the extreme points in the field of the current layer and the extreme points in the layers with different scale factors are detected, the selected extreme points are used as feature points, the local characteristics of the feature points are utilized to conduct direction distribution, the extracted feature points are used as centers, sampling is conducted in the field range of the points, a histogram is used for statistics of the sampling points, the abscissa of the statistical coordinate axis represents the direction, the size is 0-360 degrees, one direction represents 10 degrees, the highest peak direction of the histogram represents the main direction, the direction points with peaks higher than 80% of the main peak value in the rest of the histogram are used as auxiliary directions of the feature points, in order that the feature point characteristics are not changed along with the changes of visual angles, illumination and the like, the feature point directions are tested to be the coordinate axis directions, a sampling window is selected around the feature points, a dense seed point is generated, the discrete matching point is obtained through a SIFT algorithm, and the new matching point exists when the matching point is found in the neighborhood;
the method comprises the steps of obtaining a matching point of a left view and a right view, obtaining parallax by calculating a difference value of the matching point, carrying out bilateral filtering on an initial left view under a parallax image, carrying out joint bilateral filtering on a depth image according to the initial left view, ensuring that the interior transition of the image is more natural and smooth, generating a plurality of parallax images by utilizing a projection principle, carrying out multi-view synthesis by a multi-view image synthesis method suitable for all liquid crystal grating displays, filling pixels of each view into a stereoscopic image according to a certain rule, forming an image with a plurality of view information, adopting a cylindrical grating and pixels to form a certain included angle, reducing vertical resolution, determining the number of views according to grating pitch and sub-pixel spacing, and because the resolution of an original image is the same as that of a synthesized image, the resolution of each view in the stereoscopic image is 1/n (n is the total number of the number of views), if the cylindrical grating and the pixels are horizontally placed, only reducing the horizontal resolution, causing visual fatigue, and leading the vertical resolution to be unchanged, and leading to a black space to be better seen between two stereoscopic views.
Step three: reconstructing a light field around the object by using the constructed screen for three-dimensional display, and optimizing the presence perception of the three-dimensional object;
in the embodiment of the invention, the 3D display of the lenticular lens grating utilizes the refraction effect of the lenticular lens grating to enable the light rays of left and right eye images to propagate along different directions, so that the eyes of a viewer can respectively receive images with parallax, the 3D display of the lenticular lens grating adds a layer of lenticular lens between an originally adopted 2D display panel and the viewer, the 2D display panel is positioned in the focal plane, each lenticular lens unit refracts pixels positioned at different positions on the focal plane to different directions in the arrangement direction of the lenticular lens units, in the 3D display of double view points, odd-even column pixels of the display screen respectively display two parallax images of the left and right eyes, the refraction effect of the lenticular lens grating enables the left and right eye images to be separated in space, the light rays from different parallax images on the 2D display screen propagate towards different directions, the light rays of the left and right view pixels are converged again in front of the display screen, a region capable of viewing different parallax images is formed in space, and the viewer can be positioned at a proper position for viewing the stereoscopic images;
by way of example, the constructed screen for three-dimensional display is utilized to reconstruct the light field around the object, the light field drawing technology is adopted to carry out combined collection on the pre-collected scene images, the pre-collected scene images comprise the position, the direction and the angle of the object, the distribution of each ray emitted in the light field is the same as that of the surrounding light field of the previous object, the image of a new arbitrary viewpoint position is obtained, the correct light field slice is extracted through the image reconstruction light field in a mode of searching, interpolation, combination and the like after the light field is established, the view angle images of the new different positions are reconstructed in real time, the observer naturally obtains the images of the correct 360-degree view angle through reproducing the sampled three-dimensional light field, the slice sequence of a plurality of groups of scene light fields is obtained, then the three-dimensional light field is preprocessed, the image suitable for projection is obtained, the radiance of the point is searched from the three-dimensional light field after the viewpoint position is determined, namely searching corresponding pixel values from the image shot at the viewpoint position, when the number of the acquired light field slices is enough, accurately obtaining each viewpoint view from the acquired slices or approximately obtaining the view of the adjacent viewpoints, the human eyes can spontaneously and reversely track light, and the reconstructed object light field and the light field cannot be distinguished by eyes, so that the microstructure on the circular reflective directional scattering screen is utilized to deflect the incident light to the region where the viewer is positioned, scatter the incident light at a larger angle in the vertical direction, keep the light direction unchanged in the horizontal direction, reconstruct a 360-degree visible three-dimensional display light field through screen turning and scattering, present a 360-degree visible suspended three-dimensional object above the screen, and the viewer can still feel the existence of the three-dimensional object based on the 360-degree detectable suspended three-dimensional display reconstructed by the light field, the stereoscopic depth sense can be more accurately perceived.
Step four: and adjusting related parameters according to the characteristics of the current image scene, optimizing the processing effect of the images in different scenes, and performing three-dimensional display.
In the embodiment of the invention, the views generated by drawing the multi-view views are extracted by utilizing image fusion, then the views are arranged according to the arrangement requirement of the sub-pixels of the naked eye 3D display screen of the cylindrical lens, the mixed naked eye 3D images are fused into a naked eye 3D image, the fused naked eye 3D images are sent to a video output end, the video output end caches the data and generates line field signals meeting the requirement of an HDMI (high-definition multimedia interface), the image data are output to a naked eye 3D drive board through the HDMI interface, the drive board acquires an image video format input in a current naked eye 3D display system by calculating the image similarity, the current corresponding processing mode of the system is judged, the processing parameters of the point synthesizing system are finely adjusted according to the process parameters of the naked eye 3D display device, the processing parameters of the related parameters are adjusted according to the characteristics of the current image scene in the display image processing process, the on-screen display is realized, the images are presented to a plurality of viewers, the viewers move within a certain range, the viewers can sense the stereoscopic effect as long as the two adjacent viewers see the parallax images at the same time, the parallax images can be seen, the parallax effect can be provided when the viewers move horizontally, the parallax effect is acquired according to the arranged, and the parallax effect of the position of the parallax can be saved, and the cost is achieved.
Embodiment two: an embodiment II of the present invention provides an intelligent display processing system based on naked eye 3D, and FIG. 2 is a schematic diagram of module composition of the intelligent display processing system based on naked eye 3D provided in the embodiment II of the present invention, as shown in FIG. 2, the system includes:
the parallax image module is used for acquiring a plurality of parallax images;
the three-dimensional display construction module is used for constructing a three-dimensional scene for naked eye 3D three-dimensional display;
and the stereoscopic optimization display module is used for optimizing the processing effect of the images in different scenes and performing stereoscopic display.
In some embodiments of the present invention, the parallax image module includes:
the parallax image source module is used for shooting the same object from different angles and acquiring a parallax image source;
the stereoscopic image integration module is used for integrating stereoscopic images based on the acquired images;
and the image detail resolution module is used for resolving three-dimensional image details of the integrated three-dimensional image.
In some embodiments of the present invention, a three-dimensional display construction module includes:
the parallax size calculation module is used for calculating the parallax size of the corresponding feature points and acquiring depth information of the parallax image;
a depth image module for forming a plurality of parallax images using the depth image and the parallax images;
the multi-scale feature module is used for generating feature vectors with non-deformation scales by simulating multi-scale features of data in the visual image;
the included angle forming module is used for forming a certain included angle between the cylindrical lens grating and the pixel to reduce the vertical resolution;
and the light field reconstruction module is used for reconstructing a light field around the object by using the constructed screen for three-dimensional display.
In some embodiments of the present invention, a stereoscopic optimized display module includes:
the three-dimensional light field preprocessing module is used for preprocessing the three-dimensional light field to obtain an image suitable for projection;
the characteristic parameter adjusting module is used for adjusting related parameters according to the characteristics of the current image scene;
and the stereoscopic display module is used for optimizing the processing effect of the images in different scenes and realizing the stereoscopic display of the upper screen.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Finally, it should be noted that: the foregoing description is only a preferred embodiment of the present invention, and the present invention is not limited thereto, but it is to be understood that modifications and equivalents of some of the technical features described in the foregoing embodiments may be made by those skilled in the art, although the present invention has been described in detail with reference to the foregoing embodiments. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. An intelligent display processing method based on naked eye 3D is characterized by comprising the following steps: the method comprises the following steps:
step one: obtaining a parallax image source, deducing an accurate three-dimensional geometric description of a given scene from an image or a series of images of the scene, and quantitatively determining the properties of objects in the scene;
step two: obtaining depth information of left and right parallax images through calculation of parallax sizes of corresponding points to form a depth image of the scene, and further forming a certain included angle with pixels by adopting a cylindrical lens grating to reduce vertical resolution;
step three: reconstructing a light field around the object by using the constructed screen for three-dimensional display, and optimizing the presence perception of the three-dimensional object;
step four: and adjusting related parameters according to the characteristics of the current image scene, optimizing the processing effect of the images in different scenes, and performing three-dimensional display.
2. The naked eye 3D-based intelligent display processing method according to claim 1, wherein the method comprises the following steps of: the step of acquiring the parallax image source includes:
shooting objects with a plurality of independent mark points from different angles through a plurality of cameras, shooting the same object from different angles, acquiring images, calculating the relative position and the direction of the cameras and the internal parameters of the cameras by utilizing each image, acquiring a plurality of parallax images, processing the object point positions on the images by utilizing a computer technology to obtain the depth of the objects, integrating the stereoscopic images based on the acquired images, and resolving the details of the three-dimensional stereoscopic images of the integrated stereoscopic images by utilizing a display provided with a two-dimensional three-dimensional conversion device.
3. The naked eye 3D-based intelligent display processing method according to claim 1, wherein the method comprises the following steps of: the step of obtaining depth information of the left and right parallax images by calculating the parallax sizes of the corresponding points comprises the following steps:
the parallax size of the corresponding point of the image is closely related to the depth information of the scene, a plurality of parallax images are formed by utilizing the depth image and one parallax image, stereo matching is carried out on the image pair acquired by the camera through a binocular stereo matching algorithm, the mapping relation between the pixel point in the image and the scene position is obtained, and the 3D image is synthesized after the parallax value of the pixel is obtained according to the mapping relation.
4. The intelligent display processing method based on naked eye 3D according to claim 3, wherein the intelligent display processing method based on naked eye 3D is characterized by comprising the following steps of: the step of forming a depth image of the scene includes:
generating a feature vector with a non-deformed scale by simulating multi-scale features of data in a visual image, fitting a three-dimensional quadratic function to position extreme points, detecting the extreme points in the field of the current layer and the extreme points in the layers of the upper and lower different scale factors after acquiring the extreme points, taking the selected maximum point as a feature point, then utilizing the local characteristics of the feature point to distribute directions, taking the extracted feature point as a center, sampling in the field range of the point, counting the sampling point by using a histogram, counting the abscissa of a coordinate axis to represent the directions, wherein the size is 0-360 degrees, one direction represents 10 degrees, the highest peak direction of the histogram represents the main direction, taking the direction point with the peak value higher than 80% of the main peak value in the rest of the histogram as the auxiliary direction of the feature point, testing the direction of the feature point as the coordinate axis direction, selecting a sampling window around the feature point, generating a key seed point, and regarding the discrete matching point as a parallax map by using a SIFT algorithm and a region growth algorithm when a new matching point exists in the neighborhood of the matching point;
after the matching points of the left view and the right view are obtained, parallax is obtained by calculating the difference value of the matching points, bilateral filtering is carried out on the initial left view under the parallax image, a plurality of parallax images are generated by utilizing a projection principle, multi-view synthesis is carried out by a multi-view image synthesis method suitable for all liquid crystal grating displays, and pixels of each view are filled into a three-dimensional image according to a certain rule to form an image with a plurality of view information.
5. The naked eye 3D-based intelligent display processing method according to claim 4, wherein the method comprises the following steps of: the step of reconstructing a light field around an object using the constructed screen for three-dimensional display includes:
reconstructing a light field around the object by using the constructed screen for three-dimensional display;
combining and collecting the pre-collected scene images by adopting a light field drawing technology;
after the light field is established, correct light field slices are extracted through searching, interpolation, combination and other modes, and new view angle images at different positions are reconstructed in real time;
obtaining a slice sequence of a plurality of groups of scene light fields by reproducing the sampled three-dimensional light fields, and then preprocessing the three-dimensional light fields to obtain images suitable for projection;
the microstructure on the circular reflective directional scattering screen is utilized to deflect incident light to the region where a viewer is located, scatter the incident light at a larger angle in the vertical direction, keep the light direction unchanged in the horizontal direction, reconstruct a 360-degree visible three-dimensional display light field through screen turning and scattering, and present a 360-degree visible suspended three-dimensional object above the screen.
6. The naked eye 3D-based intelligent display processing method according to claim 1, wherein the method comprises the following steps of: the step of adjusting relevant parameters according to the characteristics of the current image scene, optimizing the processing effect of the images in different scenes, and performing three-dimensional display comprises the following steps:
drawing the multi-view to generate a view, extracting sub-pixels of the view by utilizing image fusion, and then arranging the view according to the sub-pixel arrangement requirement of the lenticular naked eye 3D display screen to fuse the view into a naked eye 3D image;
and outputting the image data to a naked eye 3D drive board through an HDMI interface, acquiring an image video format input in the current naked eye 3D display system by the drive board through calculating image similarity, judging a processing mode currently corresponding to the system, adjusting the processing parameters of the video point synthesizing system according to the technological parameters of the naked eye 3D display device, and performing stereoscopic display.
7. An intelligent display system for executing the intelligent display processing method based on naked eye 3D according to claim 1, wherein: the system comprises
The parallax image module is used for acquiring a plurality of parallax images;
the three-dimensional display construction module is used for constructing a three-dimensional scene for naked eye 3D three-dimensional display;
and the stereoscopic optimization display module is used for optimizing the processing effect of the images in different scenes and performing stereoscopic display.
8. The intelligent display processing system according to claim 7, wherein: the parallax image module includes:
the parallax image source module is used for shooting the same object from different angles and acquiring a parallax image source;
the stereoscopic image integration module is used for integrating stereoscopic images based on the acquired images;
and the image detail resolution module is used for resolving three-dimensional image details of the integrated three-dimensional image.
9. The intelligent display processing system according to claim 8, wherein: the three-dimensional display construction module includes:
the parallax size calculation module is used for calculating the parallax size of the corresponding feature points and acquiring depth information of the parallax image;
a depth image module for forming a plurality of parallax images using the depth image and the parallax images;
the multi-scale feature module is used for generating feature vectors with non-deformation scales by simulating multi-scale features of data in the visual image;
the included angle forming module is used for forming a certain included angle between the cylindrical lens grating and the pixel to reduce the vertical resolution;
and the light field reconstruction module is used for reconstructing a light field around the object by using the constructed screen for three-dimensional display.
10. The smart display processing system of claim 9 wherein: the stereoscopic optimized display module includes:
the three-dimensional light field preprocessing module is used for preprocessing the three-dimensional light field to obtain an image suitable for projection;
the characteristic parameter adjusting module is used for adjusting related parameters according to the characteristics of the current image scene;
and the stereoscopic display module is used for optimizing the processing effect of the images in different scenes and realizing the stereoscopic display of the upper screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310527791.2A CN116708746A (en) | 2023-05-11 | 2023-05-11 | Naked eye 3D-based intelligent display processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310527791.2A CN116708746A (en) | 2023-05-11 | 2023-05-11 | Naked eye 3D-based intelligent display processing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116708746A true CN116708746A (en) | 2023-09-05 |
Family
ID=87828385
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310527791.2A Pending CN116708746A (en) | 2023-05-11 | 2023-05-11 | Naked eye 3D-based intelligent display processing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116708746A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116939186A (en) * | 2023-09-18 | 2023-10-24 | 北京天图万境科技有限公司 | Processing method and device for automatic associative covering parallax naked eye space calculation |
-
2023
- 2023-05-11 CN CN202310527791.2A patent/CN116708746A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116939186A (en) * | 2023-09-18 | 2023-10-24 | 北京天图万境科技有限公司 | Processing method and device for automatic associative covering parallax naked eye space calculation |
| CN116939186B (en) * | 2023-09-18 | 2023-12-05 | 北京天图万境科技有限公司 | Processing method and device for automatic associative covering parallax naked eye space calculation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10560687B2 (en) | LED-based integral imaging display system as well as its control method and device | |
| US6496598B1 (en) | Image processing method and apparatus | |
| EP1143747B1 (en) | Processing of images for autostereoscopic display | |
| US6205241B1 (en) | Compression of stereoscopic images | |
| JP5036132B2 (en) | Critical alignment of parallax images for autostereoscopic display | |
| CN105704479B (en) | The method and system and display equipment of the measurement human eye interpupillary distance of 3D display system | |
| US9031356B2 (en) | Applying perceptually correct 3D film noise | |
| CN100565589C (en) | The apparatus and method that are used for depth perception | |
| EP3350989B1 (en) | 3d display apparatus and control method thereof | |
| CN101411207A (en) | Method and system for acquiring and displaying 3d light fields | |
| US20060171028A1 (en) | Device and method for display capable of stereoscopic vision | |
| US8094148B2 (en) | Texture processing apparatus, method and program | |
| RU2453922C2 (en) | Method of displaying original three-dimensional scene based on results of capturing images in two-dimensional projection | |
| CN101180658A (en) | Depth perception | |
| CN102932662B (en) | Single-view-to-multi-view stereoscopic video generation method and method for solving depth information graph and generating disparity map | |
| CN107105216B (en) | A kind of 3 d light fields display device of continuous parallax based on pinhole array, wide viewing angle | |
| CN113238472B (en) | High-resolution light field display method and device based on frequency domain displacement | |
| JPWO2012117706A1 (en) | Video processing apparatus, video processing method, and program | |
| CN103679739A (en) | Virtual view generating method based on shielding region detection | |
| CN116708746A (en) | Naked eye 3D-based intelligent display processing method | |
| CN113253845A (en) | View display method, device, medium and electronic equipment based on eye tracking | |
| US20070122029A1 (en) | System and method for capturing visual data and non-visual data for multi-dimensional image display | |
| Wu et al. | Depth mapping of integral images through viewpoint image extraction with a hybrid disparity analysis algorithm | |
| Sawahata et al. | Estimating depth range required for 3-D displays to show depth-compressed scenes without inducing sense of unnaturalness | |
| CN111447431A (en) | Naked eye 3D display method and system applied to vehicle-mounted all-around camera shooting |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |