CN108012139A - The image generating method and device shown applied to the nearly eye of the sense of reality - Google Patents
The image generating method and device shown applied to the nearly eye of the sense of reality Download PDFInfo
- Publication number
- CN108012139A CN108012139A CN201711250300.5A CN201711250300A CN108012139A CN 108012139 A CN108012139 A CN 108012139A CN 201711250300 A CN201711250300 A CN 201711250300A CN 108012139 A CN108012139 A CN 108012139A
- Authority
- CN
- China
- Prior art keywords
- coordinate system
- eyepiece
- light field
- field image
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The embodiment of the present invention provides a kind of image generating method and device shown applied to the nearly eye of the sense of reality, and method includes：The aerial image information of three-dimensional body to be shown is converted into eyepiece coordinate system from world coordinate system, to remove effect of the eyepiece to imaging.A plurality of light is triggered at exit pupil position, by obtaining the actual grey value of corresponding pixel in the image-forming information of a plurality of light after conversion, obtains the first light field image of true picture display effect of the reflection three-dimensional body in human eye.By obtaining the initial gray value of a plurality of light corresponding pixel on multilayer video screen, the second light field image is obtained.The gray value of pixel in the second light field image is modified according to the first light field image, to obtain the 3rd light field image, so as to ensure that the 3rd light field image is more life-like in the first light field image for embodying the sense of reality, ensure that image displaying quality.
Description
Technical field
The present invention relates to technical field of image processing, more particularly to a kind of image life shown applied to the nearly eye of the sense of reality
Into method and apparatus.
Background technology
Shown compared to two dimension, Three-dimensional Display can provide more intuitive visual experience, more rich details, virtually existing
It is widely used in the fields such as real and augmented reality.Recently, multi-layer three-dimension display obtains more in Three-dimensional Display field
Carry out more concerns.Generally, multi-layer three-dimension display is by multiple parallel two-dimentional display layers for being stacked along thickness direction
Formed, to produce 3D visual effect.
In some practical application scenes, when people wear the three dimensional display of three dimensional display such as helmet-type, often
Dizzy sense of discomfort can be produced, why produces sense of discomfort, one of them is main reasons is that image-quality problems.Therefore, base
In multi-layer three-dimension display, more true, the display image of high quality how is efficiently generated, is a problem to be solved.
The content of the invention
In view of this, the embodiment of the present invention provides a kind of image generating method and dress shown applied to the nearly eye of the sense of reality
Put, to generate the 3-D view of high quality.
The embodiment of the present invention provides a kind of image generating method shown applied to the nearly eye of the sense of reality, including：
According to the mapping relations of default world coordinate system and eyepiece coordinate system, by the aerial image of three-dimensional body to be shown
Information is converted into the eyepiece coordinate system from the world coordinate system, to obtain transformed image-forming information；
A plurality of light is triggered at exit pupil position, to believe by obtaining a plurality of light in the transformed imaging
The actual grey value of corresponding pixel in breath, obtains the first light field image；
By obtaining the initial gray value of a plurality of light corresponding pixel on multilayer video screen, the is obtained
Two light field images；
The gray value of pixel in second light field image is modified according to first light field image, to obtain
3rd light field image；
In the 3rd light field image described in the Multi-level display screen display.
The embodiment of the present invention provides a kind of video generation device, including：
Modular converter, for the mapping relations according to default world coordinate system and eyepiece coordinate system, by three-dimensional article to be shown
The aerial image information of body is converted into the eyepiece coordinate system from the world coordinate system, to obtain transformed image-forming information；
First acquisition module, for triggering a plurality of light at exit pupil position, with by obtaining a plurality of light in institute
The actual grey value of corresponding pixel in transformed image-forming information is stated, obtains the first light field image；
Second acquisition module, for by obtaining a plurality of light corresponding pixel on multilayer video screen
Initial gray value, obtains the second light field image；
Correcting process module, for the gray scale according to first light field image to pixel in second light field image
Value is modified, to obtain the 3rd light field image；
Display module, in the 3rd light field image described in the Multi-level display screen display.
An embodiment of the present invention provides a kind of electronic equipment, including：The eyepiece that is made of uniform thickness lens, multilayer video screen,
Memory and processor, the eyepiece include being coated with the first surface of anti-reflection film and are coated with the second table of semi-transflective reflective film
Face, the first surface is located at is located remotely from human eye side close to human eye side, the second surface；
The memory is used to store one or more computer instruction, wherein, one or more computer instruction
The image generating method provided such as previous embodiment is provided when being performed by the processor.
The image generating method and device provided in an embodiment of the present invention shown applied to the nearly eye of the sense of reality, is being treated
After the aerial image information for showing three-dimensional body, by by the aerial image information of the three-dimensional body to be shown from world coordinates
System is converted into eyepiece coordinate system, to remove the effect such as the amplification of eyepiece to the aerial image information.Afterwards, by it is transformed into
As information is projected at the exit pupil position of eyepiece, a plurality of light is triggered at exit pupil position, is being turned by obtaining a plurality of light
The actual grey value of corresponding pixel obtains the first light field image in image-forming information after changing, first light field image
Reflect true picture effect of the three-dimensional body to be shown in human eye.In addition, by obtaining every light in a plurality of light
The initial gray value of corresponding pixel on every layer of multilayer video screen, obtains corresponding second light on multilayer video screen
Field picture, that is, be actually needed the initial gray information of the light field image of display.Due to the ash of each pixel in second light field image
Angle value is also initial value, not gray value corresponding during actual imaging, using the initial gray value as variable, with reference to the first light
The actual grey value of respective pixel is modified the gray value of each pixel in the second light field image in field picture, is treated
3rd light field image of display, so as to ensure that the 3rd light field image of generation is more life-like in the first light for embodying the sense of reality
Field picture, ensure that image displaying quality.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will to embodiment or
Attached drawing needed to be used in the description of the prior art is briefly described, it should be apparent that, drawings in the following description are these
Some embodiments of invention, for those of ordinary skill in the art, without creative efforts, may be used also
To obtain other attached drawings according to these attached drawings.
Fig. 1 is the flow chart of the image generating method provided in an embodiment of the present invention shown applied to the nearly eye of the sense of reality；
Fig. 2 a- Fig. 2 c are the structure diagram of three dimensional display provided in an embodiment of the present invention；
Fig. 3 is world coordinate system provided in an embodiment of the present invention, the schematic diagram of eyepiece coordinate system；
Fig. 4 is the acquisition process schematic diagram of the first light field image provided in an embodiment of the present invention；
Fig. 5 is the acquisition process schematic diagram of the second light field image provided in an embodiment of the present invention；
Fig. 6 is the structure diagram of video generation device provided in an embodiment of the present invention；
Fig. 7 is the structure diagram of a kind of electronic equipment provided in an embodiment of the present invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, the technical solution in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
Part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill people
Member's all other embodiments obtained without creative efforts, belong to the scope of protection of the invention.
It will be appreciated that though XXX may be described using term first, second, third, etc. in embodiments of the present invention,
But these XXX should not necessarily be limited by these terms.These terms are only used for XXX being distinguished from each other out.For example, the present invention is not being departed from
In the case of scope of embodiments, the first XXX can also be referred to as the 2nd XXX, and similarly, the 2nd XXX can also be referred to as first
XXX。
Fig. 1 is the flow chart of the image generating method provided in an embodiment of the present invention shown applied to the nearly eye of the sense of reality, this
The image generating method that embodiment provides can be performed by a video generation device, which can realize
For software, or it is embodied as the combination of software and hardware, which can be integrally disposed in a three dimensional display
In.As shown in Figure 1, this method comprises the following steps：
Step 101, the mapping relations according to default world coordinate system and eyepiece coordinate system, by three-dimensional body to be shown
Aerial image information is converted into eyepiece coordinate system from world coordinate system, to obtain transformed image-forming information.
In the present embodiment, the aerial image information of the three-dimensional body to be shown in above-mentioned world coordinate system can counted
After establishing three-dimensional body to be shown in calculation machine software, place it in world coordinate system.Wherein, the acquisition of the three-dimensional body
Can be Computerized three-dimensional modeling software, such as Unity 3D, Pro-E, Solidworks modeling are formed or passed through
Computer bottom modeling language either script such as OpenGL structure or pass through light field shooting or multiple-camera shoot
Rebuild what is obtained afterwards.
As shown in Figure 2 a, the image generating method can be adapted for using the display shown in Fig. 2 a in the present embodiment
In the scene that structure performs image display, in simple terms, which includes images of left and right eyes eyepiece, images of left and right eyes Multi-level display
Screen.General image display process be briefly described for：The spatial light field image that multilayer video screen is formed is projected respectively by eyepiece
In images of left and right eyes, left eye and right eye are respectively by the focus information of the light field acquisition three-dimensional body rendered.Left eye and right eye
Light field image provides the parallax information of three-dimensional body, so that user obtains the experience of sense of reality Three-dimensional Display.
In addition, display device structure as shown in Figure 2 a provided in an embodiment of the present invention is virtual except being displayed for
Outside spatial light field image, it can be also used for showing the image of real world at the same time.For ease of understanding, in simple terms, it is assumed that need
The spatial light field image of display is the picture of a television set, which is placed on wall in real world, then being based on should
Display, can not only show the TV set image, while can also show that television set hangs over the true effect of wall.
In the following, with reference to shown in Fig. 2 b and Fig. 2 c explanatory drawins 2a display device structure specific design parameter.
Eyepiece in the embodiment of the present invention can be Light Transmission eyepiece or immersion eyepiece.With optical lens
Penetrate exemplified by formula eyepiece, which can be made of a piece of uniform thickness lens, and as shown in Figure 2 b, such thick lens exists
First surface close to human eye is coated with anti-reflection film, and semi-transflective reflective film is coated with the second surface away from human eye.Multilayer video screen
In every layer of display screen there is certain radius of curvature.In the structure shown here, as shown in Figure 2 b, light from pupil of human position to
The multilayer video screen of imaging passes through diaphragm, first surface, second surface, first surface and multilayer video screen successively.
Specifically, in imaging process, the TV set image for the light field image such as the example above that multilayer video screen is shown
Transmission twice and the human eye that is reflected into of second surface by first surface, form virtual optical path；Meanwhile real world ratio
Wall such as the example above forms true light path through the human eye that is transmitted into of second surface.So as to which human eye can be seen at the same time
Virtual light field image and real world images.In virtual optical path, in three beams light as shown in Figure 2 b, optical axis passes through
Light Transmission eyepiece reflects, and optical axis is more than 30 degree by angle before and after the reflection of Light Transmission eyepiece and is less than 90 degree, i.e.,
Successively the angle after first surface is more than 30 degree and is less than 90 degree twice.
The design process of the display device structure is：Established in stop position optical axis direction be Z axis, meridian direction be Y-axis
Rectangular coordinate system.Optical surface, that is, Light Transmission eyepiece, can be by X-direction bias, Y side relative to the position at diaphragm center
Represented to eccentric and Z-direction is eccentric, wherein, optical surface is relative to the rotation angle at diaphragm center by around X-direction
Alpha is eccentric, around the eccentric expressions of eccentric and direction about the z axis the Gamma of the Beta of Y direction.Multilayer video screen is parallel to picture
Face, is disposed close to the position of Light Transmission eyepiece.Optional design parameter can be as shown in table 1, corresponding optical property
Figure is as shown in Figure 2 c.
Table 1：
| Radius of curvature (mm) | Y-direction bias (mm) | Z-direction bias (mm) | Alpha bias (°) | |
| Diaphragm | It is infinite | |||
| -206.68 | 3.83 | 101.3 | -18.23 | |
| -206.68 | 3.83 | 109.3 | -18.23 | |
| -206.68 | 3.83 | 101.3 | -18.23 | |
| Image planes | It is infinite | 60.85 | 26.86 | -12.55 |
Based on the display device structure, to realize image generating method provided in an embodiment of the present invention, it is necessary first to establish generation
Boundary's coordinate system and eyepiece coordinate system, wherein, eyepiece coordinate system includes left eye eyepiece coordinate system and right eye eyepiece coordinate system.
It is alternatively possible to world coordinate system, left eye eyepiece coordinate system and right eye eyepiece coordinate are established according to following rule
System, as shown in Figure 3：
Using the optical center position of left eye eyepiece as coordinate origin, left eye eyepiece coordinate system O is establishedleftXleftYleftZleft；With
The optical center position of right eye eyepiece is coordinate origin, establishes right eye eyepiece coordinate system OrightXrightYrightZright；With left eye eyepiece
Optical center position and right eye eyepiece optical center position between line perpendicular bisector on a little be coordinate origin, establish the world
Coordinate system OwXwYwZw, wherein, reference axis and the phase in left eye eyepiece coordinate system and right eye eyepiece coordinate system of world coordinate system
Answer reference axis parallel, i.e. OwXwIt is respectively parallel to and OleftXleft、 OrightXright, OwYwIt is respectively parallel to and OleftYleft、
OrightYright, OwZwIt is respectively parallel to and OleftZleft、OrightZright.Wherein, D is interpupillary distance.
Based on the coordinate system of this foundation, according to the focal length f of the eyepiece based on the display, interpupillary distance D, by three-dimensional to be shown
The aerial image information of object is transformed in eyepiece coordinate system from world coordinate system.
Specifically, the aerial image information of three-dimensional body to be shown can be converted into by left eye mesh according to equation below (1)
Mirror coordinate system：
The aerial image information of three-dimensional body to be shown is converted into by right eye eyepiece coordinate system according to equation below (2)：
Wherein, (xw,yw,zw) be the world coordinate system in any point imaging position information, (xleft,yleft,zleft)
For corresponding imaging position information in left eye eyepiece coordinate system, (xright,ylright,zright) it is right in right eye eyepiece coordinate system
The imaging position information answered, f are eyepiece focal length, and D is interpupillary distance, and L is the coordinate origin O of world coordinate systemwTo OleftWith OrightEven
The distance of line.
Based on above-mentioned conversion, in the case where being acted on without considering the distortion of eyepiece, the amplification pair of eyepiece can be removed
The influence of the imaging of three-dimensional body.
Step 102, trigger a plurality of light at exit pupil position, with by obtain a plurality of light after conversion into
As the actual grey value of corresponding pixel in information, the first light field image is obtained.
In the present embodiment, in order to obtain the image-forming information of the three-dimensional body in eyepiece coordinate system, that is, the imaging letter after converting
The image imaging effect at human eye is ceased, it is alternatively possible to multiple viewpoints be selected at eyepiece exit pupil position, by eyepiece coordinate
Three-dimensional body in system projects to multiple viewpoints, so that obtain the two dimensional image formed in multiple viewpoints, i.e. the first light field figure
Picture.Fig. 4 shows the acquisition process of the first light field image, and each pixel in the first light field image corresponds to be touched from a viewpoint
The light of hair, as shown in Figure 4, certain pixel in the first light field image correspond to a light of V2 viewpoints triggering, the light
Intersect with three-dimensional body to be shown in eyepiece coordinate system, i.e., can correspond to the pixel in above-mentioned transformed image-forming information
On, obtain the gray value corresponding to the pixel.So as to, multiple viewpoints based on setting, a plurality of light of each viewpoint triggering
Line, can obtain the first light field image of the i.e. true gray value of actual grey value for including multiple pixels, first light field
Image reflects the imaging effect that should be actually presented in human eye.
The acquisition process of above-mentioned first light field image is optional in addition to the mode of image is produced based on above-mentioned viewpoint and is obtained
Ground, can also be by pursuing and attacking light from eyepiece exit pupil position, and light and three-dimensional body pair in eyepiece coordinate system are pursued and attacked in calculating
The gray value answered obtains first light field image.
Alternatively, after first light field image is obtained, gray scale normalization can also be carried out to first light field image
Processing.
Step 103, the initial gray value by obtaining a plurality of light corresponding pixel on multilayer video screen, are obtained
Obtain the second light field image.
In the present embodiment, under initial situation, i.e., multilayer can be also set not before Multi-level display screen display image
The initial gray value of each pixel in every layer of display screen of display screen.By using the initial gray value as variable, by Multi-level display
In multiple viewpoints that the image projection of screen is set at above-mentioned eyepiece exit pupil position, two dimensional image, i.e. the second light field figure are formed
Picture.
As shown in fig. 5, it is assumed that display median ocellus has used N layers of display screen, the pixel grey scale on display screen is usedTable
Show, wherein, t represents the numbering of display screen, and i, j represent the numbering of pixel in the display screen.The gray scale chart display screen curtain of pixel it is saturating
Cross rate.Fig. 5 shows the acquisition process of the second light field image, similarly, each pixel in the second light field image correspond to from
The light of one viewpoint triggering, as shown in Figure 5, certain pixel in the second light field image correspond to a light of V2 viewpoints triggering
Line, simply at this time, the light can intersect at different pixels point, the intersecting corresponding ash of each pixel respectively with multilayer video screen
Angle value is respectivelyTherefore, the gray value of the pixel in second light field image corresponding to V2 viewpoints can be with table
It is shown as：
That is the initial gray for the pixel that the light of V2 viewpoints triggering intersects respectively with N layers of display screen
The product of value.
Optionally as well, the acquisition process of second light field image can be not based on the image of viewpoint generation, can also be from
Set out Geometrical Optics for eyepiece exit pupil position, determines Geometrical Optics corresponding initial gray value on multilayer video screen.
Alternatively, after second light field image is obtained, gray scale normalization can also be carried out to second light field image
Processing.
Step 104, according to the first light field image be modified the gray value of pixel in the second light field image, to obtain
3rd light field image.
Specifically, which can be implemented as：
Built according to the actual grey value of respective pixel in the first light field image and the second light field image and initial gray value
Error function；Error function is solved, determines the final gray value of a plurality of light corresponding pixel on multilayer video screen,
To obtain the 3rd light field image, wherein, final gray value makes error function minimum.
Alternatively, which can be the actual ash of respective pixel in the first light field image and the second light field image
The sum of the difference of angle value and initial gray value, or the weighted sum of difference.Such as with the first light field image and the second light field
The quadratic sum of the weighted difference of the actual grey value of respective pixel and initial gray value in image, builds error function.
Wherein, weight coefficient can such as be determined according to corresponding viewpoint position, such as the viewpoint institute closer to ocular axis
Corresponding weight coefficient is bigger, i.e. the weight of the difference of the actual grey value of pixel corresponding to the viewpoint and initial gray value
Coefficient is bigger.
In the present embodiment, using the corresponding initial gray value of each pixel as variable, with the minimum optimization aim of error function,
The error function is solved, obtains the corresponding final value of each variable, that is, obtains the corresponding final gray value of each pixel, to obtain
Can be in the 3rd light field image of Multi-level display screen display.
Step 105, with default eyepiece distortion factor, the 3rd light field image is corrected.
When alternatively, due to foregoing coordinate transform processing, the distortion effect of eyepiece is not accounted for often, therefore, this
When the distortion effect of eyepiece can be contemplated, the 3rd light field image obtained will be calculated and carry out distortion correction processing, it is final to obtain
The light field image that need to be shown.The acquisition of the distortion factor of eyepiece can be design load or mesh in eyepiece design process
Measured value is actually demarcated after mirror actual processing, herein the distortion factor of the screen of diverse location depth and differ, it is necessary to
Fixed different distortion factor.
Step 106, the 3rd light field image after the correction of Multi-level display screen display.
In the embodiment of the present invention, after the aerial image information of three-dimensional body to be shown is obtained, by by this to be shown three
The aerial image information of dimension object is converted into eyepiece coordinate system from world coordinate system, to remove eyepiece to the aerial image information
The effect such as amplification.Afterwards, transformed image-forming information is projected at the exit pupil position of eyepiece, is triggered at exit pupil position
A plurality of light, by obtain the actual grey value of corresponding pixel in the image-forming information of a plurality of light after conversion come
The first light field image is obtained, which reflects true picture effect of the three-dimensional body to be shown in human eye.Separately
Outside, by obtaining the initial gray of every light corresponding pixel on every layer of multilayer video screen in a plurality of light
Value, obtains corresponding second light field image on multilayer video screen, that is, is actually needed the initial gray letter of the light field image of display
Breath.Since the gray value of each pixel in second light field image is also initial value, corresponding gray scale when being not actual imaging
Value, using the initial gray value as variable, error letter is built with reference to the actual grey value of respective pixel in the first light field image
Number, the gray value for asking for each pixel of error function minimum by optimizing algorithm, as each picture in the second light field image
The final gray value of element, obtains the 3rd light field image to be shown, so as to ensure that the 3rd light field image of generation is more life-like
In the first light field image for embodying the sense of reality, image displaying quality ensure that.
Fig. 6 is the structure diagram of video generation device provided in an embodiment of the present invention, as shown in fig. 6, the device bag
Include：Modular converter 11, the first acquisition module 12, the second acquisition module 13, correcting process module 14, display module 15.
Modular converter 11, for the mapping relations according to default world coordinate system and eyepiece coordinate system, by three-dimensional to be shown
The aerial image information of object is converted into the eyepiece coordinate system from the world coordinate system, is believed with obtaining transformed imaging
Breath.
First acquisition module 12, for triggering a plurality of light at exit pupil position, to be existed by obtaining a plurality of light
The actual grey value of corresponding pixel in the transformed image-forming information, obtains the first light field image.
Second acquisition module 13, for by obtaining a plurality of light corresponding pixel on multilayer video screen
Initial gray value, obtain the second light field image.
Correcting process module 14, for the ash according to first light field image to pixel in second light field image
Angle value is modified, to obtain the 3rd light field image.
Display module 15, in the 3rd light field image described in the Multi-level display screen display.
Wherein, the eyepiece coordinate system includes left eye eyepiece coordinate system and right eye eyepiece coordinate system, alternatively, the dress
Put and further include：Establish module 21.
Module 21 is established, for establishing the world coordinate system, the left eye eyepiece coordinate system and institute according to following rule
State right eye eyepiece coordinate system：
Using the optical center position of left eye eyepiece as coordinate origin, the left eye eyepiece coordinate system is established；With the light of right eye eyepiece
Heart position is coordinate origin, establishes the right eye eyepiece coordinate system；With the optical center position of the left eye eyepiece and the right eye mesh
Any is coordinate origin on the perpendicular bisector of line between the optical center position of mirror, establishes the world coordinate system；The world
The reference axis of coordinate system is parallel with the corresponding axis in the left eye eyepiece coordinate system and the right eye eyepiece coordinate system.
Correspondingly, the modular converter 11 is specifically used for：
The aerial image information of the three-dimensional body to be shown is converted into by the left eye eyepiece according to equation below (1)
Coordinate system：
The aerial image information of the three-dimensional body to be shown is converted into by the right eye eyepiece according to equation below (2)
Coordinate system：
Wherein, (xw,yw,zw) be the world coordinate system in any point imaging position information, (xleft,yleft,zleft)
For corresponding imaging position information in the left eye eyepiece coordinate system, (xright,ylright,zright) sat for the right eye eyepiece
Corresponding imaging position information in mark system, f is eyepiece focal length, and D is interpupillary distance, L for the world coordinate system coordinate origin to institute
State the distance of line.
Alternatively, the correcting process module 14 is specifically used for：
According to the actual grey value of respective pixel in first light field image and second light field image and initial ash
Angle value builds error function；The error function is solved, determines that a plurality of light corresponds to respectively on the multilayer video screen
Pixel final gray value, to obtain the 3rd light field image, the final gray value makes the error function minimum.
Alternatively, the correcting process module 14 is specifically used for：With first light field image and the second light field figure
The quadratic sum of the weighted difference of the actual grey value of respective pixel and initial gray value, builds the error function as in.
Alternatively, which further includes：Distortion correction module 22.
Distortion correction module 22, for default eyepiece distortion factor, being corrected to the 3rd light field image.
Fig. 6 shown devices can perform the method for embodiment illustrated in fig. 1, and the part that the present embodiment is not described in detail, can join
Examine the related description to embodiment illustrated in fig. 1.Implementation procedure and the technique effect embodiment shown in Figure 1 of the technical solution
In description, it is no longer superfluous herein.
In addition, as shown in fig. 7, the embodiment of the present invention also provides a kind of electronic equipment, including：It is made of uniform thickness lens
Eyepiece 31, multilayer video screen 32, memory 33 and processor 34.As shown in Figure 2 b, the eyepiece 31 includes being coated with anti-reflection film
First surface and the second surface for being coated with semi-transflective reflective film, the first surface are located at close to human eye side, and described second
Surface is located remotely from human eye side.The memory 33 is used to store one or more computer instruction, wherein, described one
Or a plurality of computer instruction realizes the image generating method provided such as previous embodiment when being performed by the processor 34.
In a kind of optional embodiment, electronic equipment provided in an embodiment of the present invention can also include communication interface 35,
For the communication between the electronic equipment and other equipment or external network.
The embodiment of the present invention also provides a kind of computer-readable recording medium for being stored with computer program, the calculating
Machine program makes computer realize image generating method provided in an embodiment of the present invention when performing.
Device embodiment described above is only schematical, wherein the unit illustrated as separating component
It may or may not be physically separate, physics may or may not be as the component that unit is shown
Unit, you can with positioned at a place, or can also be distributed in multiple network unit.It can select according to the actual needs
Some or all of module therein is selected to realize the purpose of this embodiment scheme.Those of ordinary skill in the art are not paying
In the case of performing creative labour, you can to understand and implement.
Finally it should be noted that：The above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；To the greatest extent
Pipe is with reference to the foregoing embodiments described in detail the present invention, it will be understood by those of ordinary skill in the art that：It is still
It can modify to the technical solution described in foregoing embodiments, or which part technical characteristic is equally replaced
Change；And these modifications or replacement, the essence of appropriate technical solution is departed from the essence of various embodiments of the present invention technical solution
God and scope.
Claims (13)
- A kind of 1. image generating method shown applied to the nearly eye of the sense of reality, it is characterised in that including：According to the mapping relations of default world coordinate system and eyepiece coordinate system, by the aerial image information of three-dimensional body to be shown from The world coordinate system is converted into the eyepiece coordinate system, to obtain transformed image-forming information；A plurality of light is triggered at exit pupil position, to divide by obtaining a plurality of light in the transformed image-forming information The actual grey value of not corresponding pixel, obtains the first light field image；By obtaining the initial gray value of a plurality of light corresponding pixel on multilayer video screen, the second light field is obtained Image；The gray value of pixel in second light field image is modified according to first light field image, to obtain the 3rd light Field picture；In the 3rd light field image described in the Multi-level display screen display.
- 2. according to the method described in claim 1, it is characterized in that, the eyepiece coordinate system includes left eye eyepiece coordinate system and the right side Eyes mirror coordinate system, the method further include：The world coordinate system, the left eye eyepiece coordinate system and the right eye eyepiece coordinate system are established according to following rule：Using the optical center position of left eye eyepiece as coordinate origin, the left eye eyepiece coordinate system is established；With the optical center position of right eye eyepiece Coordinate origin is set to, establishes the right eye eyepiece coordinate system；With the optical center position of the left eye eyepiece and the right eye eyepiece Any is coordinate origin on the perpendicular bisector of line between optical center position, establishes the world coordinate system；The world coordinates The reference axis of system is parallel with the corresponding axis in the left eye eyepiece coordinate system and the right eye eyepiece coordinate system.
- 3. according to the method described in claim 2, it is characterized in that, the aerial image information by three-dimensional body to be shown from The world coordinate system is converted into the eyepiece coordinate system, including：The aerial image information of the three-dimensional body to be shown is converted into by the left eye eyepiece coordinate according to equation below (1) System：The aerial image information of the three-dimensional body to be shown is converted into by the right eye eyepiece coordinate according to equation below (2) System：Wherein, (xw,yw,zw) be the world coordinate system in any point imaging position information, (xleft,yleft,zleft) for institute State corresponding imaging position information in left eye eyepiece coordinate system, (xright,ylright,zright) it is in the right eye eyepiece coordinate system Corresponding imaging position information, f are eyepiece focal length, and D is interpupillary distance, and L is the coordinate origin of the world coordinate system to the line Distance.
- 4. according to the method described in claim 1, it is characterized in that, it is described according to first light field image to second light The gray value of pixel is modified in field picture, to obtain the 3rd light field image, including：According to the actual grey value and initial gray value of respective pixel in first light field image and second light field image Build error function；The error function is solved, determines the final ash of a plurality of light corresponding pixel on the multilayer video screen Angle value, to obtain the 3rd light field image, the final gray value makes the error function minimum.
- It is 5. according to the method described in claim 4, it is characterized in that, described according to first light field image and second light The actual grey value of respective pixel and initial gray value structure error function in field picture, including：With the actual grey value of respective pixel in first light field image and second light field image and initial gray value The quadratic sum of weighted difference, builds the error function.
- 6. according to the method described in claim 1, it is characterized in that, after the 3rd light field image of the acquisition, further include：With default eyepiece distortion factor, the 3rd light field image is corrected.
- A kind of 7. video generation device, it is characterised in that including：Modular converter, for the mapping relations according to default world coordinate system and eyepiece coordinate system, by three-dimensional body to be shown Aerial image information is converted into the eyepiece coordinate system from the world coordinate system, to obtain transformed image-forming information；First acquisition module, for triggering a plurality of light at exit pupil position, with by obtaining a plurality of light at described turn The actual grey value of corresponding pixel in image-forming information after changing, obtains the first light field image；Second acquisition module, for the initial ash by obtaining a plurality of light corresponding pixel on multilayer video screen Angle value, obtains the second light field image；Correcting process module, for being carried out according to first light field image to the gray value of pixel in second light field image Correct, to obtain the 3rd light field image；Display module, in the 3rd light field image described in the Multi-level display screen display.
- 8. device according to claim 7, it is characterised in that the eyepiece coordinate system includes left eye eyepiece coordinate system and the right side Eyes mirror coordinate system, described device further include：Module is established, for establishing the world coordinate system, the left eye eyepiece coordinate system and the right eye according to following rule Eyepiece coordinate system：Using the optical center position of left eye eyepiece as coordinate origin, the left eye eyepiece coordinate system is established；With the optical center position of right eye eyepiece Coordinate origin is set to, establishes the right eye eyepiece coordinate system；With the optical center position of the left eye eyepiece and the right eye eyepiece Any is coordinate origin on the perpendicular bisector of line between optical center position, establishes the world coordinate system；The world coordinates The reference axis of system is parallel with the corresponding axis in the left eye eyepiece coordinate system and the right eye eyepiece coordinate system.
- 9. device according to claim 8, it is characterised in that the modular converter is specifically used for：The aerial image information of the three-dimensional body to be shown is converted into by the left eye eyepiece coordinate according to equation below (1) System：The aerial image information of the three-dimensional body to be shown is converted into by the right eye eyepiece coordinate according to equation below (2) System：Wherein, (xw,yw,zw) be the world coordinate system in any point imaging position information, (xleft,yleft,zleft) for institute State corresponding imaging position information in left eye eyepiece coordinate system, (xright,ylright,zright) it is in the right eye eyepiece coordinate system Corresponding imaging position information, f are eyepiece focal length, and D is interpupillary distance, and L is the coordinate origin of the world coordinate system to the line Distance.
- 10. device according to claim 7, it is characterised in that the correcting process module is specifically used for：According to the actual grey value and initial gray value of respective pixel in first light field image and second light field image Build error function；The error function is solved, determines the final ash of a plurality of light corresponding pixel on the multilayer video screen Angle value, to obtain the 3rd light field image, the final gray value makes the error function minimum.
- 11. device according to claim 10, it is characterised in that the correcting process module is specifically used for：With the actual grey value of respective pixel in first light field image and second light field image and initial gray value The quadratic sum of weighted difference, builds the error function.
- 12. device according to claim 7, it is characterised in that further include：Distortion correction module, for default eyepiece distortion factor, being corrected to the 3rd light field image.
- 13. a kind of electronic equipment, it is characterised in that including：Eyepiece, multilayer video screen, memory and the processor being made of uniform thickness lens, the eyepiece include being coated with the of anti-reflection film One surface and the second surface for being coated with semi-transflective reflective film, the first surface are located at close to human eye side, second table Face is located remotely from human eye side；The memory is used to store one or more computer instruction, wherein, one or more computer instruction is by institute State the image generating method realized when processor performs as any one of claim 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711250300.5A CN108012139B (en) | 2017-12-01 | 2017-12-01 | The image generating method and device shown applied to the nearly eye of the sense of reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711250300.5A CN108012139B (en) | 2017-12-01 | 2017-12-01 | The image generating method and device shown applied to the nearly eye of the sense of reality |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108012139A true CN108012139A (en) | 2018-05-08 |
| CN108012139B CN108012139B (en) | 2019-11-29 |
Family
ID=62056033
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711250300.5A Active CN108012139B (en) | 2017-12-01 | 2017-12-01 | The image generating method and device shown applied to the nearly eye of the sense of reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108012139B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109633906A (en) * | 2019-01-02 | 2019-04-16 | 京东方科技集团股份有限公司 | Virtual reality device and its method for correcting image |
| CN111147760A (en) * | 2019-12-23 | 2020-05-12 | 兴科迪智能科技(北京)有限公司 | Light field camera, luminosity adjusting method and device thereof and electronic equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101387760A (en) * | 2008-08-26 | 2009-03-18 | 东南大学 | All phase modulation method three-dimensional complex light field |
| CN102109677A (en) * | 2011-03-10 | 2011-06-29 | 北京理工大学 | Head-mounted stereoscopic visual slide viewer |
| CN104007552A (en) * | 2014-05-30 | 2014-08-27 | 北京理工大学 | Display system of light field helmet with true stereo feeling |
| US20150243096A1 (en) * | 2013-11-27 | 2015-08-27 | Magic Leap, Inc. | Using a fiber scanning display to present a lightfield to a user |
| US20150268451A1 (en) * | 2014-03-21 | 2015-09-24 | National Taiwan University | Method of using a light-field camera to generate a three-dimensional image, and light field camera implementing the method |
| CN106251323A (en) * | 2015-12-22 | 2016-12-21 | 深圳超多维光电子有限公司 | Method, device and the electronic equipment of a kind of bore hole three-dimensional tracking |
| CN107016704A (en) * | 2017-03-09 | 2017-08-04 | 杭州电子科技大学 | A kind of virtual reality implementation method based on augmented reality |
-
2017
- 2017-12-01 CN CN201711250300.5A patent/CN108012139B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101387760A (en) * | 2008-08-26 | 2009-03-18 | 东南大学 | All phase modulation method three-dimensional complex light field |
| CN102109677A (en) * | 2011-03-10 | 2011-06-29 | 北京理工大学 | Head-mounted stereoscopic visual slide viewer |
| US20150243096A1 (en) * | 2013-11-27 | 2015-08-27 | Magic Leap, Inc. | Using a fiber scanning display to present a lightfield to a user |
| US20150268451A1 (en) * | 2014-03-21 | 2015-09-24 | National Taiwan University | Method of using a light-field camera to generate a three-dimensional image, and light field camera implementing the method |
| CN104007552A (en) * | 2014-05-30 | 2014-08-27 | 北京理工大学 | Display system of light field helmet with true stereo feeling |
| CN106251323A (en) * | 2015-12-22 | 2016-12-21 | 深圳超多维光电子有限公司 | Method, device and the electronic equipment of a kind of bore hole three-dimensional tracking |
| CN107016704A (en) * | 2017-03-09 | 2017-08-04 | 杭州电子科技大学 | A kind of virtual reality implementation method based on augmented reality |
Non-Patent Citations (1)
| Title |
|---|
| 许维鹏等: "基于深度相机的空间增强现实动态投影标定", 《系统仿真学报》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109633906A (en) * | 2019-01-02 | 2019-04-16 | 京东方科技集团股份有限公司 | Virtual reality device and its method for correcting image |
| CN111147760A (en) * | 2019-12-23 | 2020-05-12 | 兴科迪智能科技(北京)有限公司 | Light field camera, luminosity adjusting method and device thereof and electronic equipment |
| CN111147760B (en) * | 2019-12-23 | 2021-08-24 | 兴科迪智能科技(北京)有限公司 | Light field camera, luminosity adjusting method and device thereof and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108012139B (en) | 2019-11-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10855909B2 (en) | Method and apparatus for obtaining binocular panoramic image, and storage medium | |
| EP3163535B1 (en) | Wide-area image acquisition method and device | |
| CN108475327A (en) | three-dimensional acquisition and rendering | |
| JP4928476B2 (en) | Stereoscopic image generating apparatus, method thereof and program thereof | |
| US9443338B2 (en) | Techniques for producing baseline stereo parameters for stereoscopic computer animation | |
| EP2715669A1 (en) | Systems and methods for alignment, calibration and rendering for an angular slice true-3d display | |
| KR100897542B1 (en) | Method and Device for Rectifying Image in Synthesizing Arbitary View Image | |
| CN108090880A (en) | The anti-distortion processing method and device of a kind of image | |
| CN110447224A (en) | The method of the virtual image is controlled in the display | |
| JP5522794B2 (en) | Stereoscopic image generating apparatus and program thereof | |
| WO2010085549A1 (en) | System and method for three-dimensional visualization of geographical data | |
| KR20200144097A (en) | Light field image generation system, image display system, shape information acquisition server, image generation server, display device, light field image generation method and image display method | |
| US20180213215A1 (en) | Method and device for displaying a three-dimensional scene on display surface having an arbitrary non-planar shape | |
| CN108012139A (en) | The image generating method and device shown applied to the nearly eye of the sense of reality | |
| JPH1074269A (en) | Stereoscopic cg moving image generator | |
| CN107659772B (en) | 3D image generation method and device and electronic equipment | |
| CN110060349B (en) | Method for expanding field angle of augmented reality head-mounted display equipment | |
| CN111164542A (en) | Method of modifying an image on a computing device | |
| CN116095294B (en) | Three-dimensional light field image coding method and system based on depth value rendering resolution | |
| JP2019149777A (en) | Image processing apparatus and image processing program | |
| CN111915739A (en) | Real-time three-dimensional panoramic information interactive information system | |
| Thumuluri et al. | A unified deep learning approach for foveated rendering & novel view synthesis from sparse rgb-d light fields | |
| CN114967170B (en) | Display processing method and device based on flexible naked eye three-dimensional display equipment | |
| Smith et al. | Perception of size and shape in stereoscopic 3d imagery | |
| WO2022180630A1 (en) | Camera capture and communications system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |