CN108012139B - The image generating method and device shown applied to the nearly eye of the sense of reality - Google Patents
The image generating method and device shown applied to the nearly eye of the sense of reality Download PDFInfo
- Publication number
- CN108012139B CN108012139B CN201711250300.5A CN201711250300A CN108012139B CN 108012139 B CN108012139 B CN 108012139B CN 201711250300 A CN201711250300 A CN 201711250300A CN 108012139 B CN108012139 B CN 108012139B
- Authority
- CN
- China
- Prior art keywords
- coordinate system
- eyepiece
- light field
- field image
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the present invention provides a kind of image generating method and device shown applied to the nearly eye of the sense of reality, and method includes: that the aerial image information of three-dimension object to be shown is converted into eyepiece coordinate system from world coordinate system, to remove effect of the eyepiece to imaging.A plurality of light is triggered at exit pupil position, by obtaining the actual grey value of corresponding pixel in the image-forming information of a plurality of light after conversion, obtains the first light field image of true picture display effect of the reflection three-dimension object in human eye.By obtaining the initial gray value of a plurality of light corresponding pixel on multilayer video screen, the second light field image is obtained.It is modified according to gray value of first light field image to pixel in the second light field image, to obtain third light field image, to ensure that third light field image is more life-like in the first light field image for embodying the sense of reality, ensure that image displaying quality.
Description
Technical field
The present invention relates to technical field of image processing more particularly to a kind of image generations shown applied to the nearly eye of the sense of reality
Method and apparatus.
Background technique
Show that Three-dimensional Display can provide more intuitive visual experience, richer details, in virtual reality compared to two dimension
It is widely used in the fields such as augmented reality.Recently, multi-layer three-dimension display has obtained in Three-dimensional Display field more next
More concerns.Generally, multi-layer three-dimension display is by multiple parallel two-dimentional display layer shapes for stacking along thickness direction
At to generate 3D visual effect.
In some practical application scenes, when people wear the three dimensional display of three dimensional display such as helmet-type, often
Dizzy sense of discomfort can be generated, why generates sense of discomfort, one of them is main reasons is that image-quality problems.Therefore, base
In multi-layer three-dimension display, more true, high quality display image how is efficiently generated, is a problem to be solved.
Summary of the invention
In view of this, the embodiment of the present invention provides a kind of image generating method and dress shown applied to the nearly eye of the sense of reality
It sets, to generate the 3-D image of high quality.
The embodiment of the present invention provides a kind of image generating method shown applied to the nearly eye of the sense of reality, comprising:
According to the mapping relations of default world coordinate system and eyepiece coordinate system, the aerial image of three-dimension object to be shown is believed
Breath from the world coordinate system is converted into the eyepiece coordinate system, with the image-forming information after being converted；
A plurality of light is triggered at exit pupil position, by obtaining image-forming information of a plurality of light after the conversion
In corresponding pixel actual grey value, obtain the first light field image；
By obtaining the initial gray value of a plurality of light corresponding pixel on multilayer video screen, second is obtained
Light field image；
It is modified according to gray value of first light field image to pixel in second light field image, to obtain
Three light field images；
The third light field image described in the Multi-level display screen display.
The embodiment of the present invention provides a kind of video generation device, comprising:
Conversion module, for the mapping relations according to default world coordinate system and eyepiece coordinate system, by three-dimensional article to be shown
The aerial image information of body is converted into the eyepiece coordinate system from the world coordinate system, with the image-forming information after being converted；
First obtains module, for triggering a plurality of light at exit pupil position, by obtaining a plurality of light in institute
The actual grey value of corresponding pixel in image-forming information after stating conversion, obtains the first light field image；
Second obtains module, for by obtain a plurality of light on multilayer video screen corresponding pixel just
Beginning gray value obtains the second light field image；
Correcting process module, for the gray value according to first light field image to pixel in second light field image
It is modified, to obtain third light field image；
Display module is used for the third light field image described in the Multi-level display screen display.
The embodiment of the invention provides a kind of electronic equipment, comprising: the eyepiece that is made of uniform thickness lens, multilayer video screen,
Memory and processor, the eyepiece include the second table for being coated with the first surface of anti-reflection film and being coated with semi-transflective reflective film
Face, the first surface are located at close to human eye side, and the second surface is located remotely from human eye side；
The memory is for storing one or more computer instruction, wherein one or more computer instruction
The image generating method provided such as previous embodiment is provided when being executed by the processor.
The image generating method and device provided in an embodiment of the present invention shown applied to the nearly eye of the sense of reality is being obtained to aobvious
After showing the aerial image information of three-dimension object, by the way that the aerial image information of the three-dimension object to be shown is become from world coordinate system
Eyepiece coordinate system is shifted to, the effects of to remove amplification of the eyepiece to the aerial image information.Later, by the image-forming information after conversion
It is projected at the exit pupil position of eyepiece, a plurality of light is triggered at exit pupil position, by obtaining a plurality of light after conversion
The actual grey value of corresponding pixel obtains the first light field image in image-forming information, first light field image reflect to
Show true picture effect of the three-dimension object in human eye.In addition, aobvious in multilayer by obtaining every light in a plurality of light
The initial gray value of the upper corresponding pixel of every layer of display screen, obtains corresponding second light field image on multilayer video screen, i.e.,
The initial gray information of the light field image of display is actually needed.Since the gray value of each pixel in second light field image is also just
Initial value, not gray value corresponding when actual imaging is corresponded to using the initial gray value as variable in conjunction in the first light field image
The actual grey value of pixel is modified the gray value of each pixel in the second light field image, obtains third light field to be shown
Image ensure that figure to ensure that the third light field image of generation is more life-like in the first light field image for embodying the sense of reality
As display quality.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair
Bright some embodiments for those of ordinary skill in the art without creative efforts, can be with root
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is the flow chart of the image generating method provided in an embodiment of the present invention shown applied to the nearly eye of the sense of reality；
Fig. 2 a- Fig. 2 c is the structural schematic diagram of three dimensional display provided in an embodiment of the present invention；
Fig. 3 is the schematic diagram of world coordinate system provided in an embodiment of the present invention, eyepiece coordinate system；
Fig. 4 is the acquisition process schematic diagram of the first light field image provided in an embodiment of the present invention；
Fig. 5 is the acquisition process schematic diagram of the second light field image provided in an embodiment of the present invention；
Fig. 6 is the structural schematic diagram of video generation device provided in an embodiment of the present invention；
Fig. 7 is the structural schematic diagram of a kind of electronic equipment provided in an embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
It will be appreciated that though XXX may be described in embodiments of the present invention using term first, second, third, etc., but
These XXX should not necessarily be limited by these terms.These terms are only used to for XXX being distinguished from each other out.For example, not departing from implementation of the present invention
In the case where example range, the first XXX can also be referred to as the 2nd XXX, and similarly, the 2nd XXX can also be referred to as the first XXX.
Fig. 1 is the flow chart of the image generating method provided in an embodiment of the present invention shown applied to the nearly eye of the sense of reality, this
The image generating method that embodiment provides can be executed by a video generation device, which can be implemented as
Software, or it is embodied as the combination of software and hardware, which, which can integrate, is arranged in a three dimensional display.
As shown in Figure 1, this method comprises the following steps:
Step 101, basis preset the mapping relations of world coordinate system and eyepiece coordinate system, by the sky of three-dimension object to be shown
Between image-forming information from world coordinate system be converted into eyepiece coordinate system, with the image-forming information after being converted.
In the present embodiment, the aerial image information of the three-dimension object to be shown in above-mentioned world coordinate system, which can be, to be calculated
After establishing three-dimension object to be shown in machine software, place it in world coordinate system.Wherein, the acquisition of the three-dimension object can be with
It is Computerized three-dimensional modeling software, such as Unity 3D, Pro-E, Solidworks modeling are formed, and are also possible to pass through computer
Bottom modeling language or script are also possible to if OpenGL is constructed by rebuilding after light field shooting or multiple-camera shooting
It obtains.
As shown in Figure 2 a, the image generating method can be adapted for using display knot shown in Fig. 2 a in the present embodiment
It include images of left and right eyes eyepiece, images of left and right eyes multilayer video screen in the display in simple terms in the scene that structure performs image display.
General image display process is briefly described are as follows: the spatial light field image that multilayer video screen is formed is incident upon respectively by eyepiece
In images of left and right eyes, the light field that left eye and right eye pass through rendering respectively obtains the focus information of three-dimension object.The light field of left eye and right eye
Image provides the parallax information of three-dimension object, so that user obtains the experience of sense of reality Three-dimensional Display.
In addition, display device structure as shown in Figure 2 a provided in an embodiment of the present invention is in addition to being displayed for virtual sky
Between outside light field image, can be also used for the image for showing real world simultaneously.For ease of understanding, in simple terms, it is assumed that need aobvious
The spatial light field image shown is the picture of a television set, which is placed on wall in real world, then aobvious based on this
Show device, can not only show the TV set image, while can also show that television set hangs over the true effect of wall.
In the following, the specific design parameter of the display device structure in conjunction with shown in Fig. 2 b and Fig. 2 c explanatory diagram 2a.
Eyepiece in the embodiment of the present invention can be Light Transmission eyepiece, be also possible to immersion eyepiece.With optical lens
It penetrates for formula eyepiece, which can be made of a piece of uniform thickness lens, and as shown in Figure 2 b, which is leaning on
The first surface of person of modern times's eye is coated with anti-reflection film, is coated with semi-transflective reflective film in the second surface far from human eye.In multilayer video screen
Every layer of display screen have certain radius of curvature.In this configuration, as shown in Figure 2 b, light is from pupil of human position to imaging
Multilayer video screen successively pass through diaphragm, first surface, second surface, first surface and multilayer video screen.
Specifically, in imaging process, the TV set image of the light field image that multilayer video screen is shown such as the example above
By the human eye that is reflected into of first surface transmitted twice with second surface, virtual optical path is formed；Meanwhile real world is such as
The wall of the example above forms true optical path through the human eye that is transmitted into of second surface.To which human eye can see void simultaneously
Quasi- light field image and real world images.In virtual optical path, in three beams light as shown in Figure 2 b, optical axis passes through optics
Transmission-type eyepiece reflects, and optical axis reflects front and back angle by Light Transmission eyepiece and is greater than 30 degree less than 90 degree, i.e., successively
The angle after first surface is greater than 30 degree less than 90 degree twice.
The design process of the display device structure are as follows: establish that optical axis direction is Z axis, meridian direction is Y-axis in stop position
Rectangular coordinate system.Optical surface, that is, position of the Light Transmission eyepiece relative to diaphragm center, can be by X-direction bias, Y-direction
Eccentric and Z-direction bias indicates, wherein optical surface is inclined by the Alpha around X-direction relative to the rotation angle at diaphragm center
The heart, around the Beta bias and the Gamma bias expression in direction about the z axis of Y direction.Multilayer video screen is parallel to image planes, is placed on
Close to the position of Light Transmission eyepiece.Optional design parameter can be as shown in table 1, corresponding optical property figure such as Fig. 2 c institute
Show.
Table 1:
Based on the display device structure, the image generating method that embodiment provides to realize the present invention, it is necessary first to establish generation
Boundary's coordinate system and eyepiece coordinate system, wherein eyepiece coordinate system includes left eye eyepiece coordinate system and right eye eyepiece coordinate system.
It is alternatively possible to world coordinate system, left eye eyepiece coordinate system and right eye eyepiece coordinate system are established according to following rule,
It is as shown in Figure 3:
Using the optical center position of left eye eyepiece as coordinate origin, left eye eyepiece coordinate system O is establishedleftXleftYleftZleft；With the right side
The optical center position of eyes mirror is coordinate origin, establishes right eye eyepiece coordinate system OrightXrightYrightZright；With the light of left eye eyepiece
Any is coordinate origin on the perpendicular bisector of line between heart position and the optical center position of right eye eyepiece, establishes world coordinate system
OwXwYwZw, wherein the reference axis of world coordinate system and the corresponding axis in left eye eyepiece coordinate system and right eye eyepiece coordinate system
In parallel, i.e. OwXwIt is respectively parallel to and OleftXleft、OrightXright, OwYwIt is respectively parallel to and OleftYleft、OrightYright, OwZw
It is respectively parallel to and OleftZleft、OrightZright.Wherein, D is interpupillary distance.
Based on the coordinate system that this is established, according to the focal length f of the eyepiece based on the display, interpupillary distance D, by three-dimensional article to be shown
The aerial image information of body transforms in eyepiece coordinate system from world coordinate system.
Specifically, (1) the aerial image information of three-dimension object to be shown can be converted into left eye mesh according to the following formula
Mirror coordinate system:
The aerial image information of three-dimension object to be shown is converted into right eye eyepiece coordinate system by (2) according to the following formula:
Wherein, (xw,yw,zw) be the world coordinate system in any point imaging position information, (xleft,yleft,zleft)
For corresponding imaging position information in left eye eyepiece coordinate system, (xright,ylright,zright) it is corresponding in right eye eyepiece coordinate system
Imaging position information, f is eyepiece focal length, and D is interpupillary distance, and L is the coordinate origin O of world coordinate systemwTo OleftWith OrightLine
Distance.
The amplification pair of eyepiece can be removed in the case where not considering that the distortion of eyepiece acts on based on above-mentioned transformation
The influence of the imaging of three-dimension object.
Step 102 triggers a plurality of light at exit pupil position, by obtaining the imaging of a plurality of light after conversion
The actual grey value of corresponding pixel in information obtains the first light field image.
In the present embodiment, in order to obtain the image-forming information of the three-dimension object in eyepiece coordinate system, i.e., transformed imaging letter
The image imaging effect at human eye is ceased, it is alternatively possible to multiple viewpoints be selected at eyepiece exit pupil position, by eyepiece coordinate system
In three-dimension object project to multiple viewpoints, to obtain the two dimensional image formed in multiple viewpoints, i.e. the first light field image.
Fig. 4 shows the acquisition process of the first light field image, and each pixel in the first light field image, which corresponds to, to be triggered from a viewpoint
Light, as shown in Figure 4, certain pixel in the first light field image correspond to a light of V2 viewpoint triggering, the light and mesh
Three-dimension object to be shown intersection in mirror coordinate system on the pixel in image-forming information after corresponding to above-mentioned conversion, obtains
Obtain gray value corresponding to the pixel.To, multiple viewpoints based on setting, a plurality of light of each viewpoint triggering can be with
Acquisition includes the first light field image of the i.e. true gray value of actual grey value of multiple pixels, which reflects
The imaging effect that should be actually presented in human eye.
The acquisition process of above-mentioned first light field image is optional other than the mode for generating image based on above-mentioned viewpoint obtains
Ground, can also be by pursuing and attacking light from eyepiece exit pupil position, and three-dimension object pair in light and eyepiece coordinate system is pursued and attacked in calculating
The gray value answered obtains first light field image.
Optionally, after obtaining first light field image, gray scale normalization can also be carried out to first light field image
Processing.
Step 103, the initial gray value by obtaining a plurality of light corresponding pixel on multilayer video screen, obtain
Second light field image.
It is under initial situation, i.e., aobvious there are no multilayer before Multi-level display screen display image, can be set in the present embodiment
The initial gray value of each pixel in every layer of display screen of display screen.By using the initial gray value as variable, by multilayer video screen
Multiple viewpoints for being arranged at above-mentioned eyepiece exit pupil position of image projection on, form two dimensional image, i.e. the second light field image.
As shown in fig. 5, it is assumed that display median ocellus has used N layers of display screen, the pixel grey scale on display screen is usedIt indicates,
Wherein, t indicates the number of display screen, and i, j indicate the number of pixel in the display screen.The transmission of the gray scale chart display screen curtain of pixel
Rate.Fig. 5 shows the acquisition process of the second light field image, and similarly, each pixel in the second light field image corresponds to from one
The light of viewpoint triggering, as shown in Figure 5, certain pixel in the second light field image correspond to a light of V2 viewpoint triggering,
Only at this point, the light can intersect at respectively different pixels point, the corresponding gray value of each pixel of intersection with multilayer video screen
It is respectivelyTherefore, the gray value of pixel corresponding to V2 viewpoint can indicate in second light field image are as follows:
That is the initial gray for the pixel that light with N layers of display screen of V2 viewpoint triggering intersect respectively
The product of value.
Optionally as well, the acquisition process of second light field image can be not based on the image of viewpoint generation, can also be from
Set out Geometrical Optics for eyepiece exit pupil position, determines Geometrical Optics corresponding initial gray value on multilayer video screen.
Optionally, after obtaining second light field image, gray scale normalization can also be carried out to second light field image
Processing.
Step 104 is modified according to gray value of first light field image to pixel in the second light field image, to obtain
Three light field images.
Specifically, which may be implemented are as follows:
It is constructed according to the actual grey value of respective pixel in the first light field image and the second light field image and initial gray value
Error function；Error function is solved, determines the final gray value of a plurality of light corresponding pixel on multilayer video screen, with
Obtain third light field image, wherein final gray value keeps error function minimum.
Optionally, which can be the actual grey of respective pixel in the first light field image and the second light field image
The sum of the difference of value and initial gray value or the weighted sum of difference.For example, with the first light field image and the second light field image
The quadratic sum of the weighted difference of the actual grey value and initial gray value of middle respective pixel constructs error function.
Wherein, weight coefficient can such as be determined according to corresponding viewpoint position, such as closer to the viewpoint institute of ocular axis
Corresponding weight coefficient is bigger, i.e. the weight system of the difference of the actual grey value and initial gray value of pixel corresponding to the viewpoint
Number is bigger.
In the present embodiment, using the corresponding initial gray value of each pixel as variable, with the minimum optimization aim of error function, ask
The error function is solved, obtains the corresponding final value of each variable to get to the corresponding final gray value of each pixel, with obtain can be with
In the third light field image of Multi-level display screen display.
Step 105, with preset eyepiece distortion factor, third light field image is corrected.
When optionally, due to aforementioned coordinate transform processing, the distortion effect of eyepiece is not accounted for often, therefore, this
When the distortion effect of eyepiece can be considered, the third light field image obtained will be calculated and carry out distortion correction processing, it is final to obtain
The light field image that need to be shown.The acquisition of the distortion factor of eyepiece can be the design value in eyepiece design process, be also possible to mesh
Measured value is actually demarcated after mirror actual processing, the distortion factor of the screen of different location depth is not identical herein, need to
Fixed different distortion factor.
Step 106, the third light field image after the correction of Multi-level display screen display.
In the embodiment of the present invention, after the aerial image information for obtaining three-dimension object to be shown, by by this to be shown three
The aerial image information of dimension object is converted into eyepiece coordinate system from world coordinate system, to remove eyepiece to the aerial image information
The effects of amplification.Later, the image-forming information after conversion is projected at the exit pupil position of eyepiece, is triggered at exit pupil position a plurality of
Light obtains by obtaining the actual grey value of corresponding pixel in the image-forming information of a plurality of light after conversion
One light field image, first light field image reflect true picture effect of the three-dimension object to be shown in human eye.In addition, passing through
Every light in a plurality of light is obtained to obtain more in the initial gray value of every layer of upper corresponding pixel of multilayer video screen
Corresponding second light field image on layer display screen, that is, be actually needed the initial gray information of the light field image of display.Due to this
The gray value of each pixel is also initial value in two light field images, not gray value corresponding when actual imaging, with the initial ash
Angle value is variable, constructs error function in conjunction with the actual grey value of respective pixel in the first light field image, passes through optimization algorithm
The gray value so that the smallest each pixel of the error function is sought, as the final gray value of each pixel in the second light field image,
Third light field image to be shown is obtained, to ensure that the third light field image of generation is more life-like in embodying the of the sense of reality
One light field image, ensure that image displaying quality.
Fig. 6 is the structural schematic diagram of video generation device provided in an embodiment of the present invention, as shown in fig. 6, the device includes:
Conversion module 11, first obtains module 12, second and obtains module 13, correcting process module 14, display module 15.
Conversion module 11, for the mapping relations according to default world coordinate system and eyepiece coordinate system, by three-dimensional to be shown
The aerial image information of object is converted into the eyepiece coordinate system from the world coordinate system, is believed with the imaging after being converted
Breath.
First obtains module 12, for triggering a plurality of light at exit pupil position, to be existed by obtaining a plurality of light
The actual grey value of corresponding pixel in image-forming information after the conversion obtains the first light field image.
Second obtains module 13, for by obtaining a plurality of light corresponding pixel on multilayer video screen
Initial gray value obtains the second light field image.
Correcting process module 14, for the gray scale according to first light field image to pixel in second light field image
Value is modified, to obtain third light field image.
Display module 15 is used for the third light field image described in the Multi-level display screen display.
Wherein, the eyepiece coordinate system includes left eye eyepiece coordinate system and right eye eyepiece coordinate system, optionally, described device
Further include: establish module 21.
Module 21 is established, for establishing the world coordinate system, the left eye eyepiece coordinate system and institute according to following rule
State right eye eyepiece coordinate system:
Using the optical center position of left eye eyepiece as coordinate origin, the left eye eyepiece coordinate system is established；With the light of right eye eyepiece
Heart position is coordinate origin, establishes the right eye eyepiece coordinate system；With the optical center position of the left eye eyepiece and the right eye mesh
Any is coordinate origin on the perpendicular bisector of line between the optical center position of mirror, establishes the world coordinate system；The world
The reference axis of coordinate system is parallel with the corresponding axis in the left eye eyepiece coordinate system and the right eye eyepiece coordinate system.
Correspondingly, the conversion module 11 is specifically used for:
The aerial image information of the three-dimension object to be shown is converted into the left eye eyepiece and sat by (1) according to the following formula
Mark system:
The aerial image information of the three-dimension object to be shown is converted into the right eye eyepiece and sat by (2) according to the following formula
Mark system:
Wherein, (xw,yw,zw) be the world coordinate system in any point imaging position information, (xleft,yleft,zleft)
For corresponding imaging position information in the left eye eyepiece coordinate system, (xright,ylright,zright) it is the right eye eyepiece coordinate
Corresponding imaging position information in system, f are eyepiece focal length, and D is interpupillary distance, and L is the coordinate origin of the world coordinate system described in
The distance of line.
Optionally, the correcting process module 14 is specifically used for:
According to the actual grey value of respective pixel in first light field image and second light field image and initial ash
Angle value constructs error function；The error function is solved, determines that a plurality of light respectively corresponds on the multilayer video screen
Pixel final gray value, to obtain third light field image, the final gray value keeps the error function minimum.
Optionally, the correcting process module 14 is specifically used for: with first light field image and the second light field figure
The quadratic sum of the weighted difference of the actual grey value and initial gray value of respective pixel, constructs the error function as in.
Optionally, device further include: distortion correction module 22.
Distortion correction module 22, for being corrected to the third light field image to preset eyepiece distortion factor.
The method that Fig. 6 shown device can execute embodiment illustrated in fig. 1, the part that the present embodiment is not described in detail can join
Examine the related description to embodiment illustrated in fig. 1.In implementation procedure and the technical effect embodiment shown in Figure 1 of the technical solution
Description, details are not described herein.
In addition, as shown in fig. 7, the embodiment of the present invention also provides a kind of electronic equipment, comprising: the mesh being made of uniform thickness lens
Mirror 31, multilayer video screen 32, memory 33 and processor 34.As shown in Figure 2 b, the eyepiece 31 includes be coated with anti-reflection film the
One surface and the second surface for being coated with semi-transflective reflective film, the first surface are located at close to human eye side, second table
Face is located remotely from human eye side.The memory 33 is for storing one or more computer instruction, wherein described one or more
The image generating method provided such as previous embodiment is provided when computer instruction is executed by the processor 34.
In a kind of optional embodiment, electronic equipment provided in an embodiment of the present invention can also include communication interface 35,
For the communication between the electronic equipment and other equipment or external network.
The embodiment of the present invention also provides a kind of computer readable storage medium for being stored with computer program, the computer
Image generating method provided in an embodiment of the present invention is realized when program executes computer.
The apparatus embodiments described above are merely exemplary, wherein described, unit can as illustrated by the separation member
It is physically separated with being or may not be, component shown as a unit may or may not be physics list
Member, it can it is in one place, or may be distributed over multiple network units.It can be selected according to the actual needs
In some or all of the modules achieve the purpose of the solution of this embodiment.Those of ordinary skill in the art are not paying creativeness
Labour in the case where, it can understand and implement.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although
Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be used
To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features；
And these are modified or replaceed, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution spirit and
Range.
Claims (13)
1. a kind of image generating method shown applied to the nearly eye of the sense of reality characterized by comprising
According to the mapping relations of default world coordinate system and eyepiece coordinate system, by the aerial image information of three-dimension object to be shown from
The world coordinate system is converted into the eyepiece coordinate system, with the image-forming information after being converted；
A plurality of light is triggered, at exit pupil position to divide in the image-forming information after the conversion by obtaining a plurality of light
The actual grey value of not corresponding pixel obtains the first light field image；
By obtaining the initial gray value of a plurality of light corresponding pixel on multilayer video screen, the second light field is obtained
Image；
It is modified according to gray value of first light field image to pixel in second light field image, to obtain third light
Field picture；
The third light field image described in the Multi-level display screen display.
2. the method according to claim 1, wherein the eyepiece coordinate system includes left eye eyepiece coordinate system and the right side
Eyes mirror coordinate system, the method also includes:
The world coordinate system, the left eye eyepiece coordinate system and the right eye eyepiece coordinate system are established according to following rule:
Using the optical center position of left eye eyepiece as coordinate origin, the left eye eyepiece coordinate system is established；With the optical center position of right eye eyepiece
It is set to coordinate origin, establishes the right eye eyepiece coordinate system；With the optical center position of the left eye eyepiece and the right eye eyepiece
Any is coordinate origin on the perpendicular bisector of line between optical center position, establishes the world coordinate system；The world coordinates
The reference axis of system is parallel with the corresponding axis in the left eye eyepiece coordinate system and the right eye eyepiece coordinate system.
3. according to the method described in claim 2, it is characterized in that, the aerial image information by three-dimension object to be shown from
The world coordinate system is converted into the eyepiece coordinate system, comprising:
The aerial image information of the three-dimension object to be shown is converted into the left eye eyepiece coordinate by (1) according to the following formula
System:
The aerial image information of the three-dimension object to be shown is converted into the right eye eyepiece coordinate by (2) according to the following formula
System:
Wherein, (xw,yw,zw) be the world coordinate system in any point imaging position information, (xleft,yleft,zleft) for institute
State corresponding imaging position information in left eye eyepiece coordinate system, (xright,yright,zright) it is in the right eye eyepiece coordinate system
Corresponding imaging position information, f are eyepiece focal length, and D is interpupillary distance, and L is the coordinate origin of the world coordinate system to the line
Distance.
4. the method according to claim 1, wherein it is described according to first light field image to second light
The gray value of pixel is modified in field picture, to obtain third light field image, comprising:
According to the actual grey value and initial gray value of respective pixel in first light field image and second light field image
Construct error function；
The error function is solved, determines the final ash of a plurality of light corresponding pixel on the multilayer video screen
Angle value, to obtain third light field image, the final gray value keeps the error function minimum.
5. according to the method described in claim 4, it is characterized in that, described according to first light field image and second light
The actual grey value of respective pixel and initial gray value construct error function in field picture, comprising:
With the actual grey value of respective pixel in first light field image and second light field image and initial gray value
The quadratic sum of weighted difference constructs the error function.
6. the method according to claim 1, wherein after the acquisition third light field image, further includes:
To preset eyepiece distortion factor, the third light field image is corrected.
7. a kind of video generation device characterized by comprising
Conversion module, for the mapping relations according to default world coordinate system and eyepiece coordinate system, by three-dimension object to be shown
Aerial image information is converted into the eyepiece coordinate system from the world coordinate system, with the image-forming information after being converted；
First obtains module, for triggering a plurality of light at exit pupil position, by obtaining a plurality of light at described turn
The actual grey value of corresponding pixel in image-forming information after changing obtains the first light field image；
Second obtains module, for the initial ash by obtaining a plurality of light corresponding pixel on multilayer video screen
Angle value obtains the second light field image；
Correcting process module, for being carried out according to gray value of first light field image to pixel in second light field image
Amendment, to obtain third light field image；
Display module is used for the third light field image described in the Multi-level display screen display.
8. device according to claim 7, which is characterized in that the eyepiece coordinate system includes left eye eyepiece coordinate system and the right side
Eyes mirror coordinate system, described device further include:
Module is established, for establishing the world coordinate system, the left eye eyepiece coordinate system and the right eye according to following rule
Eyepiece coordinate system:
Using the optical center position of left eye eyepiece as coordinate origin, the left eye eyepiece coordinate system is established；With the optical center position of right eye eyepiece
It is set to coordinate origin, establishes the right eye eyepiece coordinate system；With the optical center position of the left eye eyepiece and the right eye eyepiece
Any is coordinate origin on the perpendicular bisector of line between optical center position, establishes the world coordinate system；The world coordinates
The reference axis of system is parallel with the corresponding axis in the left eye eyepiece coordinate system and the right eye eyepiece coordinate system.
9. device according to claim 8, which is characterized in that the conversion module is specifically used for:
The aerial image information of the three-dimension object to be shown is converted into the left eye eyepiece coordinate by (1) according to the following formula
System:
The aerial image information of the three-dimension object to be shown is converted into the right eye eyepiece coordinate by (2) according to the following formula
System:
Wherein, (xw,yw,zw) be the world coordinate system in any point imaging position information, (xleft,yleft,zleft) for institute
State corresponding imaging position information in left eye eyepiece coordinate system, (xright,yright,zright) it is in the right eye eyepiece coordinate system
Corresponding imaging position information, f are eyepiece focal length, and D is interpupillary distance, and L is the coordinate origin of the world coordinate system to the line
Distance.
10. device according to claim 7, which is characterized in that the correcting process module is specifically used for: according to described
The actual grey value of respective pixel and initial gray value construct error function in one light field image and second light field image；
The error function is solved, determines the final ash of a plurality of light corresponding pixel on the multilayer video screen
Angle value, to obtain third light field image, the final gray value keeps the error function minimum.
11. device according to claim 9, which is characterized in that the correcting process module is specifically used for: with described first
Square of the weighted difference of the actual grey value and initial gray value of respective pixel in light field image and second light field image
With building error function.
12. device according to claim 7, which is characterized in that further include:
Distortion correction module, for being corrected to the third light field image to preset eyepiece distortion factor.
13. a kind of electronic equipment characterized by comprising
Eyepiece, multilayer video screen, memory and the processor being made of uniform thickness lens, the eyepiece include be coated with anti-reflection film
One surface and the second surface for being coated with semi-transflective reflective film, the first surface are located at close to human eye side, second table
Face is located remotely from human eye side；
The memory is for storing one or more computer instruction, wherein one or more computer instruction is by institute
It states when processor executes and realizes such as image generating method described in any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711250300.5A CN108012139B (en) | 2017-12-01 | 2017-12-01 | The image generating method and device shown applied to the nearly eye of the sense of reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711250300.5A CN108012139B (en) | 2017-12-01 | 2017-12-01 | The image generating method and device shown applied to the nearly eye of the sense of reality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108012139A CN108012139A (en) | 2018-05-08 |
| CN108012139B true CN108012139B (en) | 2019-11-29 |
Family
ID=62056033
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711250300.5A Active CN108012139B (en) | 2017-12-01 | 2017-12-01 | The image generating method and device shown applied to the nearly eye of the sense of reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108012139B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109633906A (en) * | 2019-01-02 | 2019-04-16 | 京东方科技集团股份有限公司 | Virtual reality device and its method for correcting image |
| CN111147760B (en) * | 2019-12-23 | 2021-08-24 | 兴科迪智能科技(北京)有限公司 | Light field camera, luminosity adjusting method and device thereof and electronic equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101387760A (en) * | 2008-08-26 | 2009-03-18 | 东南大学 | All phase modulation method three-dimensional complex light field |
| CN102109677A (en) * | 2011-03-10 | 2011-06-29 | 北京理工大学 | Head-mounted stereoscopic visual slide viewer |
| CN104007552A (en) * | 2014-05-30 | 2014-08-27 | 北京理工大学 | Display system of light field helmet with true stereo feeling |
| CN106251323A (en) * | 2015-12-22 | 2016-12-21 | 深圳超多维光电子有限公司 | Method, device and the electronic equipment of a kind of bore hole three-dimensional tracking |
| CN107016704A (en) * | 2017-03-09 | 2017-08-04 | 杭州电子科技大学 | A kind of virtual reality implementation method based on augmented reality |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2931776A1 (en) * | 2013-11-27 | 2015-06-04 | Magic Leap, Inc. | Virtual and augmented reality systems and methods |
| TWI527434B (en) * | 2014-03-21 | 2016-03-21 | 國立臺灣大學 | Method for using a light field camera to generate a three-dimensional image and the light field camera |
-
2017
- 2017-12-01 CN CN201711250300.5A patent/CN108012139B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101387760A (en) * | 2008-08-26 | 2009-03-18 | 东南大学 | All phase modulation method three-dimensional complex light field |
| CN102109677A (en) * | 2011-03-10 | 2011-06-29 | 北京理工大学 | Head-mounted stereoscopic visual slide viewer |
| CN104007552A (en) * | 2014-05-30 | 2014-08-27 | 北京理工大学 | Display system of light field helmet with true stereo feeling |
| CN106251323A (en) * | 2015-12-22 | 2016-12-21 | 深圳超多维光电子有限公司 | Method, device and the electronic equipment of a kind of bore hole three-dimensional tracking |
| CN107016704A (en) * | 2017-03-09 | 2017-08-04 | 杭州电子科技大学 | A kind of virtual reality implementation method based on augmented reality |
Non-Patent Citations (1)
| Title |
|---|
| 基于深度相机的空间增强现实动态投影标定;许维鹏等;《系统仿真学报》;20130908;第25卷(第9期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108012139A (en) | 2018-05-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11632537B2 (en) | Method and apparatus for obtaining binocular panoramic image, and storage medium | |
| JP7443602B2 (en) | Mixed reality system with virtual content warping and how to use it to generate virtual content | |
| CN108475327A (en) | three-dimensional acquisition and rendering | |
| US20100110069A1 (en) | System for rendering virtual see-through scenes | |
| US10852821B2 (en) | Virtual ray tracing method and dynamic light field refocusing display system | |
| US20090244267A1 (en) | Method and apparatus for rendering virtual see-through scenes on single or tiled displays | |
| CN110310373B (en) | Image processing method of augmented reality equipment and augmented reality equipment | |
| US10553014B2 (en) | Image generating method, device and computer executable non-volatile storage medium | |
| CN110447224A (en) | The method of the virtual image is controlled in the display | |
| JP2009175866A (en) | Stereoscopic image generation device, its method, and its program | |
| CN107908278A (en) | A kind of method and apparatus of Virtual Reality interface generation | |
| CN109803133B (en) | Image processing method and device and display device | |
| CN104581119A (en) | Display method of 3D images and head-wearing equipment | |
| KR20200144097A (en) | Light field image generation system, image display system, shape information acquisition server, image generation server, display device, light field image generation method and image display method | |
| JP2024019662A (en) | Method and device for angle detection | |
| CN108012139B (en) | The image generating method and device shown applied to the nearly eye of the sense of reality | |
| JP2012084105A (en) | Stereoscopic image generation device and program therefor | |
| US11212502B2 (en) | Method of modifying an image on a computational device | |
| US20180213215A1 (en) | Method and device for displaying a three-dimensional scene on display surface having an arbitrary non-planar shape | |
| JP4042356B2 (en) | Image display system and image correction service method for image display system | |
| CN110060349B (en) | Method for expanding field angle of augmented reality head-mounted display equipment | |
| CN115841539A (en) | Three-dimensional light field generation method and device based on visual shell | |
| WO2022116194A1 (en) | Panoramic presentation method and device therefor | |
| JP2016532147A (en) | How to identify the visual effects of ophthalmic lenses | |
| JP2024504012A (en) | Reverse pass-through glasses for augmented reality and virtual reality devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |