CN104253989B - Full multi-view image display device - Google Patents
Full multi-view image display device Download PDFInfo
- Publication number
- CN104253989B CN104253989B CN201410251969.6A CN201410251969A CN104253989B CN 104253989 B CN104253989 B CN 104253989B CN 201410251969 A CN201410251969 A CN 201410251969A CN 104253989 B CN104253989 B CN 104253989B
- Authority
- CN
- China
- Prior art keywords
- point
- concave mirror
- data
- convex lens
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Lenses (AREA)
Abstract
Full multi-view image display device disclosed by the invention, image display includes the interpupillary adjustment mechanism for being arranged on image display one side, further include the concave mirror, convex lens and transparent connector of opposite side, concave mirror is set close to display device, and convex lens is fixed on concave mirror by transparent connector；Image procossing is divided into two steps of segmentation and conversion by image processing software：Original image is divided into central area and outer edge area；The image of central area is after convex lens reflects into pupil, the corresponding comfortable ken in the visual field；After the image of peripheral edge portion is carried out polar coordinates reversion via computer, then pupil entered by concave mirror.The present invention's generates full field-of-view image with concave mirror and convex lens combination, expands visual range, it can be achieved that very big visual angle including 230 degree, the telepresenc of virtual reality is substantially increased, after the completion of design, simple in structure, assembling and manufacture difficulty are low, convenient for producing in enormous quantities, cost is reduced.
Description
Technical field
The present invention relates to a kind of image display device more particularly to a kind of display devices for watching full multi-view image.
Background technology
In recent years, with CG technologies (Computer Graphic, computer graphic image technology) and computer performance
It is continuously improved, the extensive concern of people is increasingly subject to for the display device of virtual reality.Wherein, HMD (Head-Mounted
Display, wear-type display system) compared with CAVE (Computer-Aid Virtual-reality Environment, meter
Calculation machine aids in reality environment) and the large scale equipments such as Full-Dome Projection (ball-screen projection) for, it is cheap
And it is easy to implement, it is more suitable for small unit and personal use.In addition the hair increasingly of the interactive medias such as virtual roaming, computer game
Exhibition, possesses posture sensing, the wear-type display system development prospect of 3D three-dimensional display functions is very wide.
Since structure limits, existing wear-type display system can not restore all images of mankind's scope of sight, visual angle compared with
To be narrow.Such as the HMZ-T1 displays of Sony corporation of Japan, horizontal viewable angle is only 30 degree or so；U.S. Silicon
The ST1080 displays of Micro Display companies, horizontal viewable angle are about 45 degree；And the Oculus of Oculus companies of the U.S.
Rift displays, horizontal viewable angle are about 90 degree.According to measuring and calculating, about 230 degree after the horizontal view angle superposition of mankind's eyes, to reach
Virtual immersion to full visual angle is experienced, it is necessary to be increased to more than 180 degree the visible angle of head-mounted display, be formed virtual
Hemisphere image.
And existing similar devices are mostly using single convex lens or lens group as eyepiece, as shown in Figure 1, by LED, LCD
The original image that display devices generate is waited to be amplified to larger size, and is remedied to the distance of distinct vision, the structure constraint is in the straight of eyepiece
Footpath can not show the image at the full visual angle of 180 degree.
Therefore, the prior art is defective, to be further improved and developed.
The content of the invention
It is an object of the invention to provide a kind of image display device, the cooperation based on convex lens and concave mirror passes through light
Conversion and respective algorithms are learned, the panorama sketch that panorama camera or computer generate is divided into two parts, and is directed to its figure respectively
As feature is converted, the natural image at full visual angle is finally restored to.
Technical scheme is as follows：
Full multi-view image display device, the calculating being connected including image display device and with described image display device
Machine, wherein：Described image display device includes image display, and the interpupillary distance for being arranged on described image display device one side is adjusted
Mechanism；Further include the concave mirror for being arranged on described image display device opposite side, convex lens and transparent connector, the concave surface
Mirror is set close to the display device, and the convex lens is fixed on the concave mirror by the transparent connector；
The computer includes image processing software and raw image data；The computer connection described image is shown
Equipment；The raw image data is sent to described image display device after image processing software cutting transformation；
The 2 Zhang Quanjing figures with parallax that right and left eyes observable image display device is shown, generate in full angular field of view
Three-dimensional sense；The corresponding ken of the convex lens is the comfortable ken, and the corresponding ken of the concave mirror is the induction ken；
The image of described image processing software assurance outer edge area and the curvature of concave mirror strictly match；
The curvature of the concave mirror and convex lens is specified for the feature of original image and is customized, and is existed with correcting panorama sketch
Distortion on the concave mirror and convex lens；
Described image handles software and image procossing is divided into two steps of segmentation and conversion：The first step, by original image point
It is segmented into central area and outer edge area；The image of central area comfortably regards after convex lens reflects into pupil, the corresponding visual field
Domain；Second step after the image of peripheral edge portion is carried out polar coordinates reversion via computer, then by concave mirror enters pupil, right
The visual field is answered to induce the ken.
Compared with prior art, the present invention provides full multi-view image display device, in existing wear-type display system
On the basis of, one group of free-form surface mirror, i.e. concave mirror are added, the fade chart picture of central eyepiece is used, utilization is convex
The blind area of lens generates full field-of-view image with concave mirror and convex lens combination, expands visual range, it can be achieved that 230 degree
Very big visual angle inside substantially increases the telepresenc of virtual reality.The present invention is by optical transform and respective algorithms, by panorama
The panorama sketch that camera or computer generate is divided into two parts, and is converted respectively for its characteristics of image, final to restore
For the natural image at full visual angle.After the completion of full multi-view image display device design provided by the invention, simple in structure, assembling and system
It is low to make difficulty, convenient for producing in enormous quantities, reduces cost.
Description of the drawings
Fig. 1 is the display device structure schematic diagram of prior art wear-type display system；
Fig. 2 is the decomposition texture schematic diagram of image display device of the present invention；
Fig. 3 is the assembly structure diagram of image display device of the present invention；
Fig. 4 is the comfortable ken that right and left eyes observable image display device of the present invention generates and induction ken schematic diagram；
The illustrative view of functional configuration of Fig. 5 computers of the present invention and image display device；
Fig. 6 is the schematic diagram that original image is divided into central area and outer edge area by image processing software of the present invention；
Fig. 7 is the schematic diagram that concave mirror of the present invention inverts outer edge area；
Fig. 8 is the principle schematic of the general curvature estimation method of concave mirror of the present invention；
Fig. 9 is K in the general curvature estimation method of concave mirror of the present inventioniComputing Principle schematic diagram；
Figure 10 is spherical reflector panorama sketch Computing Principle schematic diagram of the present invention；
Figure 11 is parabolic mirror panorama sketch Computing Principle schematic diagram of the present invention；
Figure 12 is the general curvature estimation schematic diagram of convex lens of the present invention；
Figure 13 is L in the general curvature calculating process of convex lens of the present inventioniSchematic diagram calculation.
Specific embodiment
Below in conjunction with the accompanying drawings, presently preferred embodiments of the present invention is described in further detail.
The full multi-view image display device of the present invention, first preferred embodiment, including image display device, Yi Jiyu
The computer 8 of described image display device connection；Described image display device mainly includes image display 1, is arranged on institute
State the interpupillary adjustment mechanism 5 of 1 one side of image display；Further include the concave surface for being arranged on 1 opposite side of described image display device
Mirror 2, convex lens 3 and transparent connector 4, as shown in Figures 2 and 3, the concave mirror 2 are set close to the display device 1, institute
It states transparent connector 4 convex lens 3 is fixed on the concave mirror 2.
Image display device of the present invention is suitable for the display of 3-D view, as shown in figure 4, right and left eyes observable image is shown
The 2 Zhang Quanjing figures with parallax that equipment 1 is shown, three-dimensional sense is generated in full angular field of view.The 3 corresponding ken of convex lens is easypro
The suitable ken；The 2 corresponding ken of concave mirror is the induction ken.
When the image display 1 of described image display device is display, described image display device is shown by image
Show that equipment 1 connects computer 8, as shown in Figure 5.The computer includes image processing software and raw image data, the original
Beginning image refers to single panoramic picture, panoramic video or the virtual reality scenario by camera or Software Create.The computer 8 includes
The described image display device 1 of image rendering unit, image processing software and its connection.Described image rendering unit is generally swum
Play engine or virtual reality software, after described image rendering unit is via image conversion process, by video signal transmission to described
Image display 1.Original image may include frozen frame picture, video image or interaction figure picture, such as photo, video, game.Institute
The original image of image rendering unit is stated generally by panorama camera, panoramic camera or by game engine, virtual reality software
It renders and is sent to described image display device 1 by image processing software after generating.
The computer 8 further includes the image processing software being connected with described image rendering unit, and described image processing is soft
Part connection described image display device 1.Described image handles software and image procossing is divided into two steps of segmentation and conversion：First
Step, is divided into 7 two parts in central area 6 and outer edge area, as shown in Figure 6 by original image；The image of central area 6 will be logical
It crosses after convex lens 3 reflects into pupil, the corresponding comfortable ken in the visual field.Second step, since concave mirror 2 has inverted outer edge area 7
Image, therefore 7 parts of images of outer edge area need to carry out polar coordinates as shown in Figure 7 via computer and invert.Computer of the present invention
Image processing software can ensure that the curvature of concave mirror 2 and the image of outer edge area 7 strictly match.In this way, eventually enter into view
The image of film will be spliced into without invert, distort full visual angle scene small, that parallax is small.
The concave mirror 2 is the smooth speculum in surface, and shape is similar to parabola, and material plates for alloy or surface
The high molecular material of metal.According to the feature of original image, the reflecting curved surface of concave mirror 2 must for customized in this feature,
Curvature is according to characteristics of image and otherwise varied.Such as spherical reflector, hyperboloidal mirror, parabolic mirror generated it is complete
Scape pattern distortion coefficient is different, the curvature of corresponding concave mirror 2 also respective change, also can root if image is generated by computer
According to its characteristic customization curvature.The present invention proposes the universal method for calculating 2 curvature of concave mirror.
According to the feature that original image obtains, convex lens 3 is saturating for the glass customized in this feature or high molecular material
Mirror, curvature are otherwise varied according to the feature of original image.The present invention proposes the general side for calculating 3 curvature of convex lens simultaneously
Method.
When described image display device is assembled, as shown in figure 3, the outer edge area 7 of image is needed just by the blind area of convex lens 3
It is blocked, while can be reflected again by concave mirror 2.Distort in order to prevent, the imaging of concave mirror 2 need to be connected convex lens 3 into
Picture.As shown in figure 3, positioned at the A points of picture centre region 6, the virtual image is located at A' points；Positioned at the D points of outer edge area 7, the virtual image
Positioned at D' points；And the B points in outside and C points in the boundary line of region, the virtual image are located at respectively for B' points and C' points.Concave mirror 2
Inward flange and convex lens 3 outer edge overlap, on the connecting line of B' points and human eye or slightly overlap, to ensure to be imaged
Seamless connection.
The connector 4 is the uniform element of the thin and thick being made of clear material, for connecting concave mirror 2 and convex lens 3.
Second preferred embodiment of the full multi-view image display device is changing on first preferred embodiment
Into the identical part with first preferred embodiment, which is not described herein again.
Sensor 9 can be connected in the image display 1 of described image display device, as shown in figure 5, making this hair
When bright full multi-view image display device is suitable for interactive virtual reality.Sensing data is sent to described by the sensor 9
Computer 8, computer 8 can set the virtual camera in software, with synchronous with head pose according to sensing data.It is described
Sensor may include gyroscope, accelerometer, magnetometer etc., and obtaining information includes angle, acceleration, posture and the position of user's head
Put data etc..
Concave mirror 2 under the general distortion correction method for the concave mirror 2 that multi-view image display device of the invention complete provides
Curvature estimation method：Arbitrary convex mirror panorama sketch is in the method for the distortion correction of concave mirror 2, and at this moment, concave mirror 2 is anti-
Penetrate mirror, distortion caused by no color differnece phenomenon, predominantly camber reflection.This method is applicable to the song of arbitrary convex curve rotation generation
The reflected image of face speculum, the distortion correction of the panoramic picture including the similar fashion generation in software, as convex surface reflects
Mirror non-360 degree rotary body, the distortion correction method also can be generalized to three-dimensional by two dimension.
As shown in figure 8, the reflector space of concave mirror 2 only includes outer edge area 7, the general curvature of concave mirror 2 is described below
Computational methods：
By taking right eye as an example, if pupil is coordinate origin O, right and left eyes line is x-axis, is y-axis immediately ahead of the visual field.It will be described recessed
The section curve of face mirror is divided into n parts, and each cut-point is denoted as K0, K1, K2, K3……Kn-1, KnSo that each curved section K0K1,
K1K2, K2K3……Kn-1KnThe subtended angle of respective coordinates origin O is equal；K0To induce the outermost points of the ken, KnFor induction the ken and
The separation of the comfortable ken；Assuming that the image profile of image display is OO' from interpupillary distance parallel to x-axis, then center
The separation of domain and outer edge area is K0Reflection point, be denoted as K'0；Outer rim image rightmost side point is KnReflection point, be denoted as K
'n；Similarly, by K1, K2, K3……KnThe picture point that each point is reflected is denoted as K'1, K'2, K'3……K'n；By K0, K1, K2,
K3……Kn-1, KnThe angle of each point tangent line is denoted as a0, a1, a2, a3……an-1, an。
K0O human eye right maximum visual angles corresponding with the angle of y-axis, are denoted as β；K0The distance of point and pupil is man-machine size m；
KnO and the angle of y-axis need to be more than the comfortable visual angle of human eye and take appropriate value, be denoted as ε；The original image radius of image display
For r.(according to man-machine size, β radians are about 2.007；M is about 21 millimeters；1.047) ε radians need to be more than.
Assuming that original panoramic figure is obtained by convex mirror rectangular projection in the environment, then appointing in original panoramic figure
Meaning is a little all from the projection of certain light ray in space, and the angle of this ray and convex surface mirror central shaft is denoted as γi, with
The central point of original panoramic figure is polar origin, arbitrary point K on concave mirroriCorresponding point is (ρ on original panoramic figurei,
θi), if γiWith ρiFunctional relation be f：
ρi=f (γi) (1)
By KiCoordinate be denoted as (xi,yi), cross KiThe angle of tangent line is denoted as ai, KiThe picture point of reflection is denoted as K'i, K'iSeat
Labeled as (x'i,y'i), OKiγ is denoted as with the angle of y-axisi。
Such as Fig. 9, when n is sufficiently large, KiIt can be seen as being located at straight line OKiWith Ki-1The intersection point of tangent line, by reflection law, cosine
Theorem, triangle K'iOKiProperty solve equation, the concave mirror each point related data x can be obtainedi、yi、x'i、aiGeneral public affairs
Formula is
As i=0, have：
x0=msin β
y0=mcos β
x'0=f (ε)
y'0=rcot ε
When panorama picture formation function f is determined, by gained x0、y0、x'0Formula (2) is substituted into, a can be obtained0：
Again by x0, y0, x'0And a0Formula (4), (5), (3), (2), x when i=1 can be obtained are substituted into successively1、y1、x'1、a1's
Data；Then the data for i=2 being obtained ... when i=n；When n is sufficiently large, the n point datas on the concave mirror can provide
Enough precision are produced and processed.
It, also can be according to K during data when obtaining i=nnThe value of point, with KnPoint carries out secondary correction for starting point and calculates, according to
It is secondary that K is obtainedn-1、Kn-2... until K0The data of point, the seam for so enabling to concave mirror and convex lens are more accurate.Formula phase
Together, method is similar, and this will not be repeated here.
To sum up, K0Data only rely upon the image size of image display 1, the aperture of concave mirror 2, image display is set
Standby 1 distance and the acquisition methods (such as spheric reflection, parabolic reflector) of original image, therefore, K0Data easily ask
.And K1Data can be in K0On the basis of acquire, K2Data can be in K1On the basis of acquire, and so on, finally may be used
Calculate K0To KnThe data of each point.
Multistage process is converted into a series of single phase problems by the above method, using the relation between each stage, one by one
It solves, it is easy to accomplish CAD, precision is controllable, wide adaptation range.
The above are based on arbitrary rotation convex surface mirror image, reflection distortion is eliminated on concave mirror 2, reduces original panoramic figure
General algorithmic method.
The different acquisition modes of original panoramic figure are directed to individually below, by taking the f of spherical mirror and paraboloidal mirror (γ) as an example, into
Row calculates：
1st, spherical reflector panorama sketch is in the distortion correction of concave mirror 2, the curvature estimation method of concave mirror 2
Such as Figure 10, when the convex mirror for obtaining panorama sketch is partial sphere, can be obtained according to the geometric properties of spherical surface
The system generation panorama sketch function f be：
The image due to concave mirror, can obtain according to formula (3)
As i=0, have
y'0=rcot ε
x0=msin β
y0=mcos β
Substitute into formula (2), K0The angle a of tangent line0Have
By x0, y0, x'0And a0Formula (4), (5), (2), x when i=1 can be obtained are substituted into successively1、y1、a1Data；By public affairs
Formula (7), can be obtained x'1Data；Then data of the i=2 ... when i=n can be obtained.Data when obtaining i=n
When, it also can be according to KnThe value of point, with KnK is obtained for starting point in point successivelyn-1、Kn-2... until K0The correction data of point so that concave mirror
More accurate with the seam of convex lens, this will not be repeated here.
2nd, parabolic mirror panorama sketch is in the distortion correction of concave mirror 2, the curvature estimation method of concave mirror 2.
Such as Figure 11, when it is a paraboloidal part to obtain the convex mirror used in panorama sketch, by reflection law and
Parabolical focal property, the function that can obtain parabolic reflector generation panorama sketch are
The image due to concave mirror substitutes into formula (3), can obtain
As i=0, γ0=β, K'0Coordinate (x'0, y'0) have
y'0=rcot ε
x0=msin β
y0=mcos β
By formula (2), K0The angle a of tangent line0Have
By x0, y0, x'0And a0Formula (4), (5), (2), x when i=1 can be obtained are substituted into successively1、y1、a1Data；By public affairs
Formula (9), can be obtained x'1Data；Then data of the i=2 ... when i=n can be obtained.Data when obtaining i=n
When, it also can be according to KnThe value of point, with KnK is obtained for starting point in point successivelyn-1、Kn-2... until K0The correction data of point so that concave mirror
More accurate with the seam of convex lens, this will not be repeated here.
The specific method of 3 distortion correction of convex lens of the present invention, is described in detail as follows：
Arbitrary convex mirror panorama sketch is in the distortion correction of convex lens 3, and the general curvature estimation method of convex lens is such as
Under：
Convex lens 3 is made of the larger transparent material of refractive index, such as glass, makrolon, it is necessary to common with concave mirror 2
Axis, and the distortion by reflecting to correct original panoramic figure.For by curve rotation generation convex surface mirror reflective panorama figure,
This patent proposes the section curve computational methods of single convex lens of correction distortion.
As shown in figure 12, the index ellipsoid of convex lens 3 only includes central area 6, it is contemplated that eye position error, it can be appropriate
Increase the radius of convex lens 3, avoid the occurrence of seam, but visible area need to be strictly limited to central area 6.
If convex lens refractive index is nr, radius r2, the convex surface hatching line of convex lens is divided into n parts, each cut-point is denoted as
L0, L1……Ln-1, LnSo that each curved section L0L1, L1L2……Ln-1LnThe subtended angle of respective coordinates origin O is equal；Due to convex lens
Closely it is connected with concave mirror edge, so L0O and the angle of y-axis are equal to ε.When n is sufficiently large, can determine by the data of each point
The section curve of convex lens.
Appoint above lens and take a point Li, by point LiThe point reflected is denoted as L'i, the angle of tangent line is denoted as bi, by lens
The corresponding points of lower, planar are denoted as L "i；If the angle of the light and y-axis after refraction into pupil is γi, before it is not refracted
λ is denoted as with the angle of y-axisi。
When n is sufficiently large, such as Figure 13, LiIt can be seen as being located at Li-1Tangent line on, according to the law of refraction, solving equation can
Know, convex surface L on convex lensiThe corresponding γ of pointi, bi, xi, yi, λiHave
If the panoramic picture function f in formula (14) is determined, as i=0, L0Corresponding data have：
γ0=ε
x0=r2
y0=r2·cotε
By γ0, x0, y0, λ0, b0Formula (10), (12), (13), (14), (11) are substituted into successively, can be acquired as i=1, institute
State convex lens convex surface L1The data γ of point1, x1, y1, λ1, b1... and so on, L2, L3……Ln-1, LnEach point can be by L0Point
Successive ignition acquires.
The above are based on arbitrary rotation convex surface mirror image, convex lens 3 is made to eliminate distortion, reduces the general of original panoramic figure
Computational methods.
The different acquisition modes of original panoramic figure are directed to individually below, by taking the f of spherical mirror and paraboloidal mirror (γ) as an example, into
Row calculates：
1st, for spherical reflector panorama sketch in 3 distortion correction of convex lens, the curvature estimation method of convex lens 3 is as follows：
Such as Figure 10, the function of spherical reflector generation panoramic picture is
As i=0, have
γ0=ε
x0=r2
y0=r2·cotε
Data result γ during by i=00, x0, y0, λ0, b0Formula (10), (12), (13), (14), (11) are substituted into successively,
It can acquire as i=1, L1The data γ of point1, x1, y1, λ1, b1... and so on, L can be acquired2, L3……Ln-1, LnEach point
The data of convex lens based on correction spherical mirror panorama sketch distortion.
2nd, for parabolic mirror panorama sketch in 3 distortion correction of convex lens, the curvature estimation method of convex lens 3 is as follows：
Such as Figure 11, the function of parabolic mirror generation panoramic picture is
As i=0, have
γ0=ε
x0=r2
y0=r2·cotε
Data result γ during by i=00, x0, y0, λ0, b0Formula (10), (12), (13), (14), (11) are substituted into successively,
It can acquire as i=1, L1The data γ of point1, x1, y1, λ1, b1... and so on, L can be acquired2, L3……Ln-1, LnEach point
The data of convex lens based on correction spherical mirror panorama sketch distortion.
To sum up, full multi-view image display device provided by the invention on the basis of existing wear-type display system, increases
One group of free-form surface mirror and concave mirror 3, the fade chart picture of central eyepiece is used, using the blind area of convex lens,
Full field-of-view image is generated with concave mirror and convex lens combination, expands visual range, it can be achieved that greatly regarding including 230 degree
Angle substantially increases the telepresenc of virtual reality.The present invention is by optical transform and respective algorithms, by panorama camera or computer
The panorama sketch of generation is divided into two parts, and is converted respectively for its characteristics of image, is finally restored to full visual angle oneself
Right image.The present apparatus can be directed to different panoramic pictures and obtain feature progress distortion correction, pass through different curved designs and correct
Different panoramic pictures proposes the specific formula of a set of correction distortion, is applicable to design associated op-tics, corrects by various
The panorama sketch distortion of free convex mirror.After the completion of design, simple in structure, assembling and manufacture difficulty are low, convenient for high-volume
Production, reduces cost.
The present invention proposes the curve design method for arbitrary convex mirror panorama sketch, requires nothing more than convex surface and is
360 degree of rotationally symmetric bodies, surface can continuously be led, the panorama sketch distortion factor of generation can flexible customization as needed, accommodation
Very extensive, the reflective panorama figure as spherical mirror, paraboloidal mirror, hyperbolic mirror generate is applicable.
Full multi-view image display device provided by the invention, in the cooperation of convex lens and concave mirror, full visual angle of the invention
Image display device, available for the panorama sketch of Effective Pictures By A Computer and the reflection based on convex mirror (Convex Mirror) generation is complete
Jing Tu can eliminate aberration by algorithm and distort, and sensors and the computer such as cooperation gyroscope, accelerometer, magnetometer can answer
For facilities such as wear-type three dimensional display, the virtual immersion helmets, ken broadness the advantage is that, it is simple in structure, it solves existing
There is the defects of equipment visual angle is narrow, improve Flow experience.
It should be appreciated that the above-mentioned statement for present pre-ferred embodiments is more detailed, can not therefore think
It is the limitation to scope of patent protection of the present invention, scope of patent protection of the invention should be determined by the appended claims.
Claims (6)
1. full multi-view image display device, the computer being connected including image display device and with described image display device,
It is characterized in that：
Described image display device includes image display, and the interpupillary distance for being arranged on described image display device one side adjusts machine
Structure；Further include the concave mirror for being arranged on described image display device opposite side, convex lens and transparent connector, the concave mirror
It is set close to the display device, the convex lens is fixed on the concave mirror by the transparent connector；
The computer includes image processing software and raw image data；The computer connection described image, which is shown, to be set
It is standby；The raw image data is sent to described image display device after image processing software cutting transformation；
The 2 Zhang Quanjing figures with parallax that right and left eyes observable image display device is shown generate three-dimensional in full angular field of view
Sense；The corresponding ken of the convex lens is the comfortable ken, and the corresponding ken of the concave mirror is the induction ken；
The image of described image processing software assurance outer edge area and the curvature of concave mirror strictly match；
The curvature of the concave mirror and convex lens is specified for the feature of original image and is customized, to correct panorama sketch described
Distortion on concave mirror and convex lens；
Described image handles software and image procossing is divided into two steps of segmentation and conversion：Original image is divided by the first step
Central area and outer edge area；The image of central area is after convex lens reflects into pupil, the corresponding comfortable ken in the visual field；The
Two steps after the image of peripheral edge portion is carried out polar coordinates reversion via computer, then by concave mirror enter pupil, the corresponding visual field
Induce the ken；
For convex mirror panorama sketch in concave mirror distortion correction, the curvature general calculation method of the concave mirror is as follows：
By taking right eye as an example, if pupil is coordinate origin O, right and left eyes line is x-axis, is y-axis immediately ahead of the visual field；By the concave mirror
Section curve be divided into n parts, and each cut-point is denoted as K0, K1, K2, K3……Kn-1, KnSo that each curved section K0K1, K1K2,
K2K3……Kn-1KnThe subtended angle of respective coordinates origin O is equal；K0To induce the outermost points of the ken, KnFor the induction ken and comfortably
The separation of the ken；Assuming that the image profile of image display is OO' from interpupillary distance parallel to x-axis, then central area with
The separation of outer edge area is K0Reflection point, be denoted as K'0；Outer rim image rightmost side point is KnReflection point, be denoted as K'n；It is similar
Ground, by K1, K2, K3……KnThe picture point that each point is reflected is denoted as K'1, K'2, K'3……K'n；By K0, K1, K2, K3……Kn-1,
KnThe angle of each point tangent line is denoted as a0, a1, a2, a3……an-1, an；
K0O human eye right maximum visual angles corresponding with the angle of y-axis, are denoted as β；K0The distance of point and pupil is man-machine size m；KnO with
The angle of y-axis need to be more than the comfortable visual angle of human eye and take appropriate value, be denoted as ε；The original image radius of image display is r；
Assuming that original panoramic figure is obtained by the rectangular projection of convex mirror in the environment, then it is any one in original panoramic figure
Point is all from certain light ray OK in spaceiProjection, by this ray and convex surface mirror central shaft, i.e. the angle of y-axis is denoted as
γi, using the central point of original panoramic figure as polar origin, arbitrary point K on concave mirroriThe corresponding point on original panoramic figure
For (ρi,θi), if γiWith ρiFunctional relation be f：
ρi=f (γi) (1)
By KiCoordinate be denoted as (xi,yi), cross KiThe angle of tangent line is denoted as ai, KiThe picture point of reflection is denoted as K'i, K'iCoordinate note
For (x'i,y'i), OKiγ is denoted as with the angle of y-axisi；
When n is sufficiently large, KiIt can be seen as being located at straight line OKiWith Ki-1The intersection point of tangent line, by reflection law, the cosine law, triangle
Shape K'iOKiProperty solve equation, the concave mirror each point related data x can be obtainedi、yi、x'i、aiGeneral formula be
As i=0, have：
x0=msin β
y0=mcos β
x'0=f (ε)
y'0=rcot ε
When panorama picture formation function f is determined, by gained x0、y0、x'0Formula (2) is substituted into, a can be obtained0：
Again by x0, y0, x'0And
a0Formula (4), (5), (3), (2), x when i=1 can be obtained are substituted into successively1、y1、x'1、a1Data；Then it is straight i=2 to be obtained ...
Data during to i=n；
During data when obtaining i=n, according to KnThe value of point, with KnPoint carries out secondary correction for starting point and calculates, and is obtained successively
Kn-1、Kn-2... until K0The data of point；
Arbitrary convex mirror panorama sketch is in convex lens distortion correction, the curvature general-purpose computations side of convex lower flat pattern convex lens
Method is as follows：
If convex lens refractive index is nr, radius r2, the convex surface hatching line of convex lens is divided into n parts, each cut-point is denoted as L0,
L1……Ln-1, LnSo that each curved section L0L1, L1L2……Ln-1LnThe subtended angle of respective coordinates origin O is equal；Due to convex lens with
Concave mirror edge is closely connected, so L0O and the angle of y-axis are equal to ε；When n is sufficiently large, can determine by the data of each point convex
The section curve of lens；
Appoint above lens and take a point Li, by point LiThe point reflected is denoted as L'i, the angle of tangent line is denoted as bi, will be below lens
The corresponding points of plane are denoted as L "i；If the angle of the light and y-axis after refraction into pupil is γi, it is not refracted to preceding and y-axis
Angle be denoted as λi；
When n is sufficiently large, LiIt can be seen as being located at Li-1Tangent line on, according to the law of refraction, solve equation and understand that convex lens is convex
Face LiThe corresponding γ of pointi, bi, xi, yi, λiHave
If the panoramic picture function f in formula (14) is determined, as i=0, L0Corresponding data have：
γ0=ε
x0=r2
y0=r2·cotε
By γ0, x0, y0, λ0, b0Formula (10), (12), (13), (14), (11) are substituted into successively, can be acquired as i=1, it is described convex
Convex lens surface L1The data γ of point1, x1, y1, λ1, b1... and so on, L2, L3……Ln-1, LnEach point can be by L0Point is multiple
Iteration acquires.
2. full multi-view image display device according to claim 1, which is characterized in that described image display device is assembled
When, the outer edge area of image is blocked by the blind area of convex lens, while can be reflected again by concave mirror；The imaging of concave mirror needs
It is connected the imaging of convex lens.
3. full multi-view image display device according to claim 2, which is characterized in that when spherical reflector panorama sketch exists
During concave mirror distortion correction, the curvature estimation method of concave mirror is as follows：
When the convex mirror for obtaining panorama sketch is partial sphere, the full multi-view image can be obtained according to the geometric properties of spherical surface
Display device generation panorama sketch function f be：
The image due to concave mirror, can obtain according to formula (3)
As i=0, have
y'0=rcot ε
x0=msin β
y0=mcos β
Substitute into formula (2), K0The angle a of tangent line0Have
By x0, y0, x'0And a0Formula (4), (5), (2), x when i=1 can be obtained are substituted into successively1、y1、a1Data；By formula (7),
X' can be obtained1Data；Then data of the i=2 ... when i=n can be obtained；During data when obtaining i=n, also may be used
According to KnThe value of point, with KnK is obtained for starting point in point successivelyn-1、Kn-2... until K0The correction data of point.
4. full multi-view image display device according to claim 2, which is characterized in that when parabolic mirror panorama sketch exists
During concave mirror distortion correction, the curvature estimation method of concave mirror is as follows：
When it is a paraboloidal part to obtain the convex mirror used in panorama sketch, by reflection law and parabolical focus
Property, the function that can obtain parabolic reflector generation panorama sketch are
The image due to concave mirror substitutes into formula (3), can obtain
As i=0, γ0=β, K'0Coordinate (x'0, y'0) have
y'0=rcot ε
x0=msin β
y0=mcos β
By formula (2), K0The angle a of tangent line0Have
By x0, y0, x'0And a0Formula (4), (5), (2), x when i=1 can be obtained are substituted into successively1、y1、a1Data；By formula (9),
X' can be obtained1Data；Then data of the i=2 ... when i=n can be obtained；During data when obtaining i=n, also may be used
According to KnThe value of point, with KnK is obtained for starting point in point successivelyn-1、Kn-2... until K0The correction data of point.
5. full multi-view image display device according to claim 2, which is characterized in that spherical reflector panorama sketch is in convex lens
During mirror distortion correction, the curvature estimation formula of convex lens is as follows：
Spherical reflector generation panoramic picture function be
As i=0, have
γ0=ε
x0=r2
y0=r2·cotε
Data result γ during by i=00, x0, y0, λ0, b0Formula (10), (12), (13), (14), (11) are substituted into successively, can be asked
During proper i=1, L1The data γ of point1, x1, y1, λ1, b1... and so on, L can be acquired2, L3……Ln-1, LnEach point is based on rectifying
The data of the convex lens of positive spherical mirror panorama sketch distortion.
6. full multi-view image display device according to claim 5, which is characterized in that parabolic mirror panorama sketch is convex
During the distortion correction of lens, the curvature estimation method of convex lens is as follows：
Parabolic mirror generation panoramic picture function be
As i=0, have
γ0=ε
x0=r2
y0=r2·cotε
Data result γ during by i=00, x0, y0, λ0, b0Formula (10), (12), (13), (14), (11) are substituted into successively, can be asked
During proper i=1, L1The data γ of point1, x1, y1, λ1, b1... and so on, L can be acquired2, L3……Ln-1, LnEach point is based on rectifying
The data of the convex lens of positive spherical mirror panorama sketch distortion.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410251969.6A CN104253989B (en) | 2014-06-09 | 2014-06-09 | Full multi-view image display device |
| PCT/CN2015/080988 WO2015188731A1 (en) | 2014-06-09 | 2015-06-08 | Full-view image display apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410251969.6A CN104253989B (en) | 2014-06-09 | 2014-06-09 | Full multi-view image display device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104253989A CN104253989A (en) | 2014-12-31 |
| CN104253989B true CN104253989B (en) | 2018-05-18 |
Family
ID=52188469
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410251969.6A Active CN104253989B (en) | 2014-06-09 | 2014-06-09 | Full multi-view image display device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN104253989B (en) |
| WO (1) | WO2015188731A1 (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104253989B (en) * | 2014-06-09 | 2018-05-18 | 黄石 | Full multi-view image display device |
| CN104902139B (en) | 2015-04-30 | 2018-10-26 | 北京小鸟看看科技有限公司 | A kind of video data handling procedure of head-mounted display and head-mounted display |
| US10365490B2 (en) * | 2015-05-19 | 2019-07-30 | Maxell, Ltd. | Head-mounted display, head-up display and picture displaying method |
| CN105898285A (en) * | 2015-12-21 | 2016-08-24 | 乐视致新电子科技（天津）有限公司 | Image play method and device of virtual display device |
| CN106097245B (en) * | 2016-07-26 | 2019-04-30 | 北京小鸟看看科技有限公司 | A kind for the treatment of method and apparatus of panorama 3D video image |
| CN113296268B (en) * | 2016-10-04 | 2023-06-23 | 麦克赛尔株式会社 | Head-up display device |
| CN106780317B (en) * | 2017-01-25 | 2020-08-11 | 北京数码视讯科技股份有限公司 | Panoramic projection method and device |
| CN106821696B (en) * | 2017-02-08 | 2021-07-27 | 王三铭 | Far-distance reading and writing device for preventing and treating myopia of students and using method |
| CN107589837A (en) * | 2017-08-22 | 2018-01-16 | 努比亚技术有限公司 | A kind of AR terminals picture adjusting method, equipment and computer-readable recording medium |
| CN111522193B (en) * | 2020-04-15 | 2021-04-23 | 中国农业大学 | Method for collecting all surface images of spherical material by using concave mirror |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201060318Y (en) * | 2007-01-29 | 2008-05-14 | 王小光 | Video amplification composite shot |
| CN101589328A (en) * | 2007-11-20 | 2009-11-25 | 松下电器产业株式会社 | Image display device and display packing thereof, program, integrated circuit, glasses type head mounted display, automobile, binoculars and console display |
| CN102782562A (en) * | 2010-04-30 | 2012-11-14 | 北京理工大学 | Wide angle and high resolution tiled head-mounted display device |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1161087A (en) * | 1994-08-10 | 1997-10-01 | 实质(Ip)有限公司 | Head mounted display optics |
| JP4550184B2 (en) * | 1999-07-02 | 2010-09-22 | オリンパス株式会社 | Observation optical system |
| CN101589329B (en) * | 2007-11-21 | 2011-10-12 | 松下电器产业株式会社 | Display |
| CA2821401C (en) * | 2010-12-16 | 2019-04-30 | Lockheed Martin Corporation | Collimating display with pixel lenses |
| CN102692709A (en) * | 2012-06-15 | 2012-09-26 | 中航华东光电有限公司 | Spherical-prism-based optical system of head display |
| CN103018907A (en) * | 2012-12-19 | 2013-04-03 | 虢登科 | Display method and head-mounted display |
| CN104253989B (en) * | 2014-06-09 | 2018-05-18 | 黄石 | Full multi-view image display device |
-
2014
- 2014-06-09 CN CN201410251969.6A patent/CN104253989B/en active Active
-
2015
- 2015-06-08 WO PCT/CN2015/080988 patent/WO2015188731A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201060318Y (en) * | 2007-01-29 | 2008-05-14 | 王小光 | Video amplification composite shot |
| CN101589328A (en) * | 2007-11-20 | 2009-11-25 | 松下电器产业株式会社 | Image display device and display packing thereof, program, integrated circuit, glasses type head mounted display, automobile, binoculars and console display |
| CN102782562A (en) * | 2010-04-30 | 2012-11-14 | 北京理工大学 | Wide angle and high resolution tiled head-mounted display device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104253989A (en) | 2014-12-31 |
| WO2015188731A1 (en) | 2015-12-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104253989B (en) | Full multi-view image display device | |
| US11284993B2 (en) | Variable resolution eye mounted displays | |
| US11221494B2 (en) | Adaptive viewport optical display systems and methods | |
| US20190246095A1 (en) | Image creation device, method for image creation, image creation program, method for designing eyeglass lens and method for manufacturing eyeglass lens | |
| Nitschke et al. | Corneal imaging revisited: An overview of corneal reflection analysis and applications | |
| CN105844584B (en) | The method for correcting fisheye image distortion | |
| JP2017182078A (en) | Compact eye sight tracked head-mounted display | |
| US20220276490A1 (en) | Near eye display apparatus | |
| US11587254B2 (en) | Raycast calibration for artificial reality head-mounted displays | |
| US20200326543A1 (en) | Prescription augmented reality display | |
| KR20190122258A (en) | How to control the virtual image on the display | |
| US20230274455A1 (en) | Systems and methods for low compute high-resolution depth map generation using low-resolution cameras | |
| US9638836B1 (en) | Lenses having astigmatism correcting inside reflective surface | |
| US10088692B1 (en) | Free-space lens design method | |
| US8134786B2 (en) | Method and system for determining projections in non-central catadioptric optical systems | |
| CN109084679B (en) | A kind of 3D measurement and acquisition device based on spatial light modulator | |
| CN108931850A (en) | A kind of wearable optical system, device and method | |
| CN105589208A (en) | Internal focusing virtual reality optical system | |
| WO2021230941A1 (en) | Upsampling low temporal resolution depth maps | |
| TWI745000B (en) | Light field near-eye display device and method of light field near-eye display | |
| CN213276127U (en) | Augmented reality and glasses combined projection optical device | |
| JP2012215855A (en) | Method and system for determining projections in non-central catadioptric optical systems | |
| JP6379474B2 (en) | Spectacle lens evaluation method, spectacle lens manufacturing method, and display method | |
| CN218886314U (en) | AR glasses light path reflection projection arrangement | |
| Zhou et al. | Optical-path-difference analysis and compensation for asymmetric binocular catadioptric vision measurement |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |