Summary of the invention
The technical problem that the present invention mainly solves is to provide the holographic display packing of a kind of self adaptation based on viewing angle and holographic display, and beholder can be made can to watch 3D image clearly in any position.
For solving the problems of the technologies described above, the technical scheme that the present invention adopts is: provide a kind of self adaptation based on viewing angle holographic display packing, comprising:
The eye image of real-time tracing beholder, and according to the center between described eye image determination eyes;
Analyze described eye image to determine beholder's viewpoint particular location on the display screen;
The line judging center between described eyes and described particular location whether with the plane orthogonal of described display screen; And
When the plane out of plumb of described line and described display screen, reduce the conversion depth of field of the 3D rendering of display.
Wherein, during the described plane out of plumb when described line and described display screen, the step reducing the conversion depth of field of the 3D rendering of display comprises:
By 3D interleaving algorithm determination depth of field parameter, and the 3D that the skew showing the left and right view of image according to described depth of field parameter change reduces described display image changes the depth of field.
Wherein, during the described plane out of plumb when described line and described display screen, also comprise the steps: after reducing the step of the conversion depth of field of the 3D rendering of display
Eject information, to remind described beholder, viewing location is adjusted.
Wherein, during the described plane out of plumb when described line and described display screen, also comprise the steps after reducing the step of the conversion depth of field of the 3D rendering of display,
When the plane orthogonal of described line and described display screen, increase the conversion depth of field of the 3D rendering of display.
Wherein, the eye image of described real-time tracing beholder, and specifically comprise according to the step of the center between described eye image determination eyes:
According to the described eye image determination eyes tracked relative to the first coordinate information of screen and the second coordinate information;
The three-dimensional information of the center between described eyes is determined according to described first coordinate information and described second coordinate information.
Wherein, describedly judge whether the line of the center between described eyes and described particular location specifically comprises with the step of the plane orthogonal of described display screen:
Determine that the line of center between described eyes and described particular location is relative to the angle of described display screen plane, judges whether described angle is 90 degree according to the coordinate information of described three-dimensional information and described particular location.
For solving the problems of the technologies described above, another technical solution used in the present invention is: provide a kind of holographic display, comprising: tracing module, control module and depth of field adjustment module,
Described tracing module is used for the eye image of real-time tracing beholder, and according to the center between described eye image determination eyes;
Described control module is for analyzing described eye image to determine beholder's viewpoint particular location on the display screen;
Described control module also for judge center between described eyes and described particular location line whether with the plane orthogonal of described display screen;
Described depth of field adjustment module, for when the plane out of plumb of described line and described display screen, reduces the conversion depth of field of the 3D rendering of display.
Wherein, described depth of field adjustment module specifically for passing through 3D interleaving algorithm determination depth of field parameter, and reduces the conversion depth of field of the 3D rendering of described display according to described depth of field parameter.
Wherein, described holographic display also comprises display module, and described display module, for when the plane out of plumb of described line and described display screen, ejects information, adjusts to remind described beholder to viewing location.
Wherein, described depth of field adjustment module, also for when the plane orthogonal of described line and described display screen, increases the conversion depth of field of the 3D rendering of display.
The invention has the beneficial effects as follows: the situation being different from prior art, the eye image of the holographic display packing real-time tracing of the self adaptation based on the viewing angle beholder of present embodiment, and according to the center between eye image determination eyes; Analyze described eye image to determine beholder's viewpoint particular location on the display screen, the line judging center between eyes and beholder's viewpoint particular location on the display screen whether with the plane orthogonal of display screen; When the plane out of plumb of line and display screen, reduce the conversion depth of field of the 3D rendering of display, change the depth of field by the 3D reducing holographic display, make beholder can watch 3D image clearly in any position, adding users is experienced.
Embodiment
Consult Fig. 1, Fig. 1 is the schematic flow sheet of depth of field adaptive display method one execution mode that the present invention is based on human eye viewing angle, and the adaptive display method of present embodiment comprises:
101: the eye image of real-time tracing beholder, and according to the center between described eye image determination eyes.
Holographic display, in order to the holography display image corresponding according to the position adjustment of human eye, generally obtains eye image by camera.As shown in Figure 2, the holographic display system of present embodiment comprises holographic display 201 and camera 202, and wherein, camera 202, as the front end of described holographic display 301, is electrically connected with holographic display 301, for obtaining eye image 203.Wherein, camera in Fig. 2 202 and holographic display 201 position be relative position, and non-limiting.
Wherein, holographic display 201 generally comprises conventional large-scale holographic display, as 3D projector, also 3D intelligent mobile terminal is comprised, as 3D smart mobile phone, as long as the device of 3D rendering can be shown, do not limit at this, the type of camera does not also limit, as the camera as 3D projector front end, and the front-facing camera etc. of smart mobile phone for another example.
Particularly, holographic display according to eye image determination eyes relative to the first coordinate information of screen and the second coordinate information, wherein, the first coordinate information and the second coordinate information are the spatial coordinated information relative to screen, in one preferred embodiment, using screen centre position as the origin of coordinates, to facilitate subsequent calculations, in other embodiments, can other places be also the origin of coordinates, as any position of screen, do not limit at this.And the three-dimensional information of the center between beholder's eyes is determined according to the first coordinate information and the second coordinate information.
102: analyze described eye image to determine beholder's viewpoint particular location on the display screen.
Generally speaking, when the eyes of people are seen to different directions, eye has trickle change, these changes can produce the feature that can extract, holographic display can by catching eye image or these features of scanning extraction, thus the change of real-time tracing eyes, the particular location on the display screen of beholder's viewpoint is determined in the change further by eye.Above-mentioned technology is commonly referred to as eyeball tracking, and holographic display is exactly by just analyzing the eye image tracked, and determines beholder's viewpoint particular location on the display screen by eyeball tracking technology.
In another embodiment, also can determine beholder's viewpoint particular location on the display screen by the method for infrared test, not limit at this.
103: the line judging center between described eyes and described particular location whether with the plane orthogonal of described display screen.
Generally, if the line of the center between beholder's eyes and beholder's viewpoint particular location on the display screen and the plane being perpendicular of display screen, as shown in Figure 3A, when angle theta between the line of the central point A between eyes 303 and beholder's viewpoint particular location B on the display screen and display screen 301 is 90 degree, for best viewing angle, beholder can watch 3D rendering comparatively clearly, and now holographic display does not make any adjustments.
Particularly, after the three-dimensional information of the center A in the present embodiment between holographic display determination eyes, determine the coordinate information of beholder's viewpoint particular location B on the display screen further, the linear equation of the straight line AB at the two line place is determined again according to the coordinate information of A and B, concrete, directly can pass through point coordinates the Representation Equation, then determine the angle with display screen plane according to the linear equation of straight line AB, and judge whether above-mentioned angle is 90 degree.
In another embodiment, the angle of line relative to described display screen plane of center between eyes and beholder's viewpoint particular location on the display screen can also be determined by other means, as judged by distance.
Center between holographic display detecting eyes is relative to the first distance of screen centre position, preferably, holographic display detects the first distance by infrared distance measurement instrument, in other embodiments, also can detect by other means, not limit at this.
104: when the plane out of plumb of described line and described display screen, reduce the conversion depth of field of the 3D rendering of display.
If the line of the center A between beholder's eyes and beholder's viewpoint particular location B on the display screen and the plane of display screen 301 not perpendicular, as shown in Figure 3 B, angle theta between the line of the central point A between eyes 303 and beholder's viewpoint particular location B on the display screen and display screen 301 is not 90 degree, during as being less than 90 degree, in order to enable beholder watch effect preferably holographic display effect, holographic display reduces the conversion depth of field of the 3D rendering of display.
During due to, human eye viewing object, object is imaged on eyeball by light principle, and imaging is transferred to brain, feels the picture of object.But when object is removed, optic nerve can not disappear immediately to the impression of object, and will continue the time of about 0.1 second, this phenomenon of human eye is called as the visual persistence phenomenon of eyes.
Concrete, 3D rendering is generally in units of frame, because the 3D rendering of each frame all includes a left side, the picture of right two width different angles shootings, when playing 3D rendering, that broadcasting is alternately left, right image, accordingly, a people's left side, right eye receives a left side corresponding with it respectively, right image, when above-mentioned left eye data image and right eye data image switch in the given time, because left eye exists persistence of vision effect, the impression of left eye data image does not also disappear, occur again with the slightly differentiated right eye data image of left eye data image, then the 3D visual effect by brain, two width Images uniting integrally realized.
Therefore, the conversion depth of field of described 3D rendering can be reduced by the skew of left and right view reducing display image, beholder is seen more clear.
Particularly, holographic display by 3D interleaving algorithm determination depth of field parameter, and shows the skew of the left and right view of image according to described depth of field parameter change, reduces the conversion depth of field of described 3D rendering.
Be different from the situation of prior art, the eye image of the holographic display packing real-time tracing of the self adaptation based on the viewing angle beholder of present embodiment, and according to the center between eye image determination eyes; Analyze described eye image to determine beholder's viewpoint particular location on the display screen, the line judging center between eyes and beholder's viewpoint particular location on the display screen whether with the plane orthogonal of display screen; When the plane out of plumb of line and display screen, reduce the conversion depth of field of the 3D rendering of display, change the depth of field by the 3D reducing holographic display, make beholder can watch 3D image clearly in any position, adding users is experienced.
In another embodiment, as shown in Figure 4, Fig. 4 is the structural representation of holographic another execution mode of display packing of self adaptation that the present invention is based on viewing angle.
Present embodiment and a upper difference implemented are, the line of the center between eyes and beholder's viewpoint particular location on the display screen and the plane out of plumb of display screen, after reducing the step 404 of the conversion depth of field of the 3D rendering of display, comprise step 405 further
Step 405: eject information, to remind described beholder, viewing location is adjusted.
Particularly, informations such as " please position be adjust " that holographic display ejects on its screen, the 3D clearly reducing to show image to make user changes the reason of the depth of field, to enable user carry out correspondence adjustment according to above-mentioned information to its viewing location, thus beholder can be made to watch clear effective 3D rendering.In other embodiments, holographic display also can eject other informations, as " current viewing position is improper " or other informations, does not limit at this.
In addition, the adaptive display packing of the depth of field based on human eye viewing angle of present embodiment also comprises step 401 ~ 404, because step 401 ~ 404 are identical with step 101 ~ 104 of a upper execution mode, specifically refer to the description of Fig. 1 and related text, do not repeat them here.
Be different from the situation of prior art, the eye image of the adaptive display packing of the depth of field based on the human eye viewing angle real-time tracing beholder of present embodiment, and according to the center between eye image determination eyes; Analyze described eye image to determine beholder's viewpoint particular location on the display screen, the line judging center between eyes and beholder's viewpoint particular location on the display screen whether with the plane orthogonal of display screen; When the plane out of plumb of line and display screen, reduce the conversion depth of field of the 3D rendering of display, change the depth of field by the 3D reducing holographic display, make beholder can watch 3D image clearly in any position, adding users is experienced.
Difference and a upper execution mode, the holographic display packing of present embodiment is after the conversion depth of field of 3D rendering reducing display, further display is for showing the information of above-mentioned reason, suggesting effect is played to beholder, corresponding adjustment is made according to prompting message to enable beholder, thus can watch and more have clear effective 3D rendering, adding users is experienced.
In another embodiment, as shown in Figure 5, Fig. 5 is the schematic flow sheet of the another execution mode of the adaptive display packing of the depth of field that the present invention is based on human eye viewing angle.
The difference of the adaptive display method of the adaptive display method of present embodiment and first execution mode is, to reduce to show the conversion depth of field of 3D rendering due to the plane out of plumb of described line and described display screen at holographic display after, comprise step 505 further.
505: when the plane orthogonal of described line and described display screen, increase the conversion depth of field of the 3D rendering of display.
Holographic display is after the conversion depth of field reducing display 3D rendering, do not stop the acquisition to eye image, and obtain eye image by camera still in real time, and perform further judge center between eyes and beholder's viewpoint particular location on the display screen line whether with the step of the plane orthogonal of display screen.
When the plane orthogonal of described line and described display screen, holographic display increases the conversion depth of field of the 3D rendering of display, makes it to return to original image display.
Particularly, holographic display utilizes 3D interleaving algorithm determination depth of field parameter, and increases the skew of the left and right view of described display image according to described depth of field parameter, and then increases the conversion depth of field of described 3D rendering.
The holographic display packing of self adaptation based on viewing angle of present embodiment also comprises step 501 ~ 504, and step 501 ~ 504 are identical with step 101 ~ 104 of first execution mode, specifically refer to the description of Fig. 1 and related text thereof, do not repeat them here.
Be different from the situation of prior art, the eye image of the holographic display packing real-time tracing of the self adaptation based on the viewing angle beholder of present embodiment, and according to the center between eye image determination eyes; Analyze described eye image to determine beholder's viewpoint particular location on the display screen, the line judging center between eyes and beholder's viewpoint particular location on the display screen whether with the plane orthogonal of display screen; When the plane out of plumb of line and display screen, reduce the conversion depth of field of the 3D rendering of display, change the depth of field by the 3D reducing holographic display, make beholder can watch 3D image clearly in any position, adding users is experienced.
Be different from first execution mode, the holographic display packing of present embodiment is after the conversion depth of field of 3D rendering reducing display, continue to follow the trail of eye image, and when the plane orthogonal of the line in the center determined between eyes and beholder's viewpoint particular location on the display screen and display screen, increase the conversion depth of field of the 3D rendering of display, with the display effect making the 3D rendering of display recover original, thus beholder is watched more have clear effective 3D rendering, adding users is experienced.
In another embodiment, as shown in Figure 6, Fig. 6 is the schematic flow sheet of the holographic display packing of the self adaptation execution mode again that the present invention is based on viewing angle.
The difference of present embodiment and a upper execution mode is, in execution step 606 according to the described eye image determination eyes coordinate tracked, and before increasing the step of the conversion depth of field of the 3D rendering of display, also comprise step 605: eject information, to remind described beholder, viewing location is adjusted.
Particularly, informations such as " please position be adjust " that holographic display ejects on its screen, the 3D clearly reducing to show image to make user changes the reason of the depth of field, to enable user carry out correspondence adjustment according to above-mentioned information to its viewing location, thus can watch according to clear effective 3D rendering.In other embodiments, holographic display also can eject other informations, as " current viewing position is improper " or other informations, does not limit at this.
Be different from prior art, the holographic display packing of the self adaptation based on viewing angle of present embodiment is when the plane out of plumb of the line of the center determined between eyes and beholder's viewpoint particular location on the display screen and display screen, reduce the conversion depth of field of the 3D rendering of display, make beholder can watch 3D image clearly in any position.After the conversion depth of field of 3D rendering reducing display, continue to follow the trail of eye image, and after tracking eye image, according to the eye image determination eyes coordinate tracked, and increase the conversion depth of field of the 3D rendering of display, with the display effect making the 3D rendering of display recover original, thus beholder is watched more have clear effective 3D rendering, adding users is experienced.
Be different from an execution mode, the depth of field adaptive display method based on human eye viewing angle of present embodiment is after the conversion depth of field of 3D rendering reducing display, further display is for showing the information of above-mentioned reason, suggesting effect is played to beholder, corresponding adjustment is made according to prompting message to enable beholder, thus can watch and more have clear effective 3D rendering, adding users is experienced.
Consult Fig. 7, Fig. 7 is the structural representation of holographic display one execution mode of the present invention.The holographic display of present embodiment comprises tracing module 701, control module 702 and depth of field adjustment module 703.
Tracing module 701 for the eye image of real-time tracing beholder, and according to the center between described eye image determination eyes.In order to the holography display image corresponding according to the position adjustment of human eye, general tracing module 701 obtains eye image by camera.Generally, camera as the front end of described holographic display, with holographic display electrical wiring, for obtaining eye image.But, camera and holographic display be not limited to lifting position.
Wherein, holographic display comprises conventional large-scale holographic display, as 3D projector, also 3D intelligent mobile terminal is comprised, as 3D smart mobile phone, as long as the device of 3D rendering can be shown, do not limit at this, the type of camera does not also limit, as the camera as 3D projector front end, and the front-facing camera etc. of smart mobile phone for another example.
Particularly, tracing module 701 according to eye image determination eyes relative to the first coordinate information of screen and the second coordinate information, wherein, the first coordinate information and the second coordinate information are the spatial coordinated information relative to display screen, in one preferred embodiment, tracing module 701 using screen centre position as the origin of coordinates, to facilitate subsequent calculations, in other embodiments, can other places be also the origin of coordinates, as any position of display screen, do not limit at this.And the three-dimensional information of the center between beholder's eyes is determined according to the first coordinate information and the second coordinate information.
Control module 702 is for analyzing described eye image to determine beholder's viewpoint particular location on the display screen.
Generally speaking, when the eyes of people are seen to different directions, eye has trickle change, these changes can produce the feature that can extract, holographic display can by catching eye image or these features of scanning extraction, thus the change of real-time tracing eyes, the particular location on the display screen of beholder's viewpoint is determined in the change further by eye.Above-mentioned technology is commonly referred to as eyeball tracking, and control module 702 is exactly by just analyzing the eye image tracked, and determines beholder's viewpoint particular location on the display screen by eyeball tracking technology.
In another embodiment, also can determine beholder's viewpoint particular location on the display screen by the method for infrared test, not limit at this.
Control module 702 also for judge center between described eyes and beholder's viewpoint particular location on the display screen line whether with the plane orthogonal of described display screen.
Generally, if the line of the center between beholder's eyes and beholder's viewpoint particular location on the display screen and the plane being perpendicular of display screen, when angle between the line of the central point namely between eyes and beholder's viewpoint particular location on the display screen and display screen is 90 degree, for best viewing angle, beholder can see the 3D rendering of best results, and now holographic display does not make any adjustments.
Particularly, after tracing module 701 determines the three-dimensional information of the center between eyes, control module 702 determines the coordinate information of beholder's viewpoint particular location on the display screen further, the linear equation of the two line place straight line is determined again according to above-mentioned two coordinate informations, concrete, directly can pass through point coordinates the Representation Equation, then determine the angle with display screen plane according to the linear equation of straight line, and judge whether above-mentioned angle is 90 degree.
In another embodiment, control module 702 also can determine that the line of center between eyes and beholder's viewpoint particular location is on the display screen relative to the angle of described display screen plane, does not limit at this by other means.
Depth of field adjustment module 703, for when the plane out of plumb of described line and described display screen, reduces the conversion depth of field of the 3D rendering of display.
If control module 702 determines that center between beholder's eyes and the line of beholder's viewpoint particular location on the display screen and the plane of display screen are not perpendicular, angle theta between the line of the central point namely between eyes and beholder's viewpoint particular location on the display screen and display screen is not 90 degree, during as being less than 90 degree, in order to enable beholder watch effect preferably holographic display effect, depth of field adjustment module 703 reduces the conversion depth of field of the 3D rendering of display.
During due to, human eye viewing object, object is imaged on eyeball by light principle, and imaging is transferred to brain, feels the picture of object.But when object is removed, optic nerve can not disappear immediately to the impression of object, and will continue the time of about 0.1 second, this phenomenon of human eye is called as the visual persistence phenomenon of eyes.
Concrete, 3D rendering is generally in units of frame, because the 3D rendering of each frame all includes a left side, the picture of right two width different angles shootings, when playing 3D rendering, that broadcasting is alternately left, right image, accordingly, a people's left side, right eye receives a left side corresponding with it respectively, right image, when above-mentioned left eye data image and right eye data image switch in the given time, because left eye exists persistence of vision effect, the impression of left eye data image does not also disappear, occur again with the slightly differentiated right eye data image of left eye data image, then the 3D visual effect by brain, two width Images uniting integrally realized.
Therefore, depth of field adjustment module 703 can reduce the conversion depth of field of described 3D rendering by the skew of left and right view reducing display image, beholder is seen more clear.
Particularly, depth of field adjustment module 703 by 3D interleaving algorithm determination depth of field parameter, and shows the skew of the left and right view of image according to described depth of field parameter change, reduces the conversion depth of field of described 3D rendering.
Be different from the situation of prior art, the eye image of the tracing module real-time tracing beholder of present embodiment, and according to the center between eye image determination eyes; Control module analyzes described eye image to determine beholder's viewpoint particular location on the display screen, and the line judging center between eyes and beholder's viewpoint particular location on the display screen whether with the plane orthogonal of display screen; Depth of field adjustment module is when the plane out of plumb of above-mentioned line and display screen, reduce the conversion depth of field of the 3D rendering of display, change the depth of field by the 3D reducing holographic display, make beholder can watch 3D image clearly in any position, adding users is experienced.
In another embodiment, tracing module is also for after reducing the depth of field of the 3D rendering shown, continuing to follow the trail of eye image due to the center between eyes and the line of beholder's viewpoint particular location on the display screen and the plane out of plumb of display screen in depth of field adjustment module.When the eye image determination eyes coordinate that judge module can track according to tracing module, depth of field adjustment module is further used for the conversion depth of field of the 3D rendering increasing display, makes it to return to original image display.
Particularly, holographic display utilizes 3D interleaving algorithm determination depth of field parameter, and increases the skew of the left and right view of described display image according to described depth of field parameter, and then increases the conversion depth of field of described 3D rendering.
Be different from prior art, the judge module of present embodiment is when the plane out of plumb of the line of the center determined between eyes and beholder's viewpoint particular location on the display screen and display screen, depth of field adjustment module reduces the conversion depth of field of the 3D rendering of display, the depth of field is changed by the 3D reducing holographic display, make beholder can watch 3D image clearly in any position, adding users is experienced.
Be different from first execution mode, the tracing module of present embodiment is after the conversion depth of field of the 3D rendering of depth of field adjustment module minimizing display, continue to follow the trail of eye image, judge module further according to the center between eye image determination eyes and the line of beholder's viewpoint particular location on the display screen and the plane of display screen whether vertical, and when determining vertical, depth of field adjustment module increases the conversion depth of field of the 3D rendering of display, with the display effect making the 3D rendering of display recover original, thus beholder is watched more have clear effective 3D rendering, adding users is experienced.
In another embodiment, refer to Fig. 8, Fig. 8 is the structural representation of another execution mode of holographic display of the present invention.The holographic display of present embodiment, except comprising tracing module 801 in a upper execution mode, judge module 802, depth of field adjustment module 803, also comprises display module 804.
Display module 804, for ejecting information, adjusts viewing location to remind described beholder.
Particularly, informations such as " please position be adjust " that display module ejects on its screen, the 3D clearly reducing to show image to make user changes the reason of the depth of field, to enable user carry out correspondence adjustment according to above-mentioned information to its viewing location, thus can watch according to clear effective 3D rendering.In other embodiments, display module also can eject other informations, as " current viewing position is improper " or other informations, does not limit at this.
Be different from prior art, the eye image of the tracing module real-time tracing beholder of present embodiment, and according to the center between eye image determination eyes; The line that control module judges center between eyes and beholder's viewpoint particular location on the display screen whether with the plane orthogonal of display screen; Depth of field adjustment module is when the plane out of plumb of above-mentioned line and display screen, reduce the conversion depth of field of the 3D rendering of display, change the depth of field by the 3D reducing holographic display, make beholder can watch 3D image clearly in any position, adding users is experienced.
Be different from an execution mode, the display module of present embodiment is after the conversion depth of field of the 3D rendering of depth of field adjustment module minimizing display, further display is for showing the information of above-mentioned reason, suggesting effect is played to beholder, corresponding adjustment is made according to prompting message to enable beholder, thus can watch and more have clear effective 3D rendering, adding users is experienced.
The foregoing is only embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize specification of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.