CN104317120A - Free-viewpoint true three-dimensional display method and free-viewpoint true three-dimensional display system allowing many people to watch - Google Patents
Free-viewpoint true three-dimensional display method and free-viewpoint true three-dimensional display system allowing many people to watch Download PDFInfo
- Publication number
- CN104317120A CN104317120A CN201410584974.9A CN201410584974A CN104317120A CN 104317120 A CN104317120 A CN 104317120A CN 201410584974 A CN201410584974 A CN 201410584974A CN 104317120 A CN104317120 A CN 104317120A
- Authority
- CN
- China
- Prior art keywords
- liquid crystal
- crystal panel
- layer
- beholder
- human eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 20
- 239000004973 liquid crystal related substance Substances 0.000 claims abstract description 169
- 238000000576 coating method Methods 0.000 claims abstract description 37
- 239000011248 coating agent Substances 0.000 claims abstract description 34
- 230000010287 polarization Effects 0.000 claims description 8
- 230000000694 effects Effects 0.000 claims description 7
- 238000000354 decomposition reaction Methods 0.000 claims description 5
- 238000009877 rendering Methods 0.000 claims description 5
- 239000000835 fiber Substances 0.000 claims description 4
- 210000000887 face Anatomy 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 12
- 238000005516 engineering process Methods 0.000 description 10
- 230000008447 perception Effects 0.000 description 7
- 230000001886 ciliary effect Effects 0.000 description 6
- 210000003205 muscle Anatomy 0.000 description 5
- 239000011159 matrix material Substances 0.000 description 4
- 230000007547 defect Effects 0.000 description 3
- 208000002173 dizziness Diseases 0.000 description 3
- 238000005286 illumination Methods 0.000 description 3
- 238000003384 imaging method Methods 0.000 description 3
- 230000003447 ipsilateral effect Effects 0.000 description 3
- 239000007787 solid Substances 0.000 description 3
- 238000012856 packing Methods 0.000 description 2
- 206010021118 Hypotonia Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000036640 muscle relaxation Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000010415 tropism Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/22—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type
- G02B30/25—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type using polarisation techniques
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
- G02F1/1333—Constructional arrangements; Manufacturing methods
- G02F1/1335—Structural association of cells with optical devices, e.g. polarisers or reflectors
- G02F1/133528—Polarisers
Landscapes
- Physics & Mathematics (AREA)
- Nonlinear Science (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Mathematical Physics (AREA)
- Chemical & Material Sciences (AREA)
- Crystallography & Structural Chemistry (AREA)
- Liquid Crystal (AREA)
- Devices For Indicating Variable Information By Combining Individual Elements (AREA)
Abstract
The invention discloses a free-viewpoint true three-dimensional display method and a free-viewpoint true three-dimensional display system allowing many people to watch. The system comprises a backlight plate, an N-layer liquid crystal panel, a human eye tracking module, first and second polarizing coatings, a computer and a multi-output-port display card. A first layer of the N-layer liquid crystal panel is close to the backlight plate, the Nth layer of the N-layer liquid crystal panel is close to viewers, each layer of the N-layer liquid crystal panel is parallel to the backlight plate, and the front face of each layer of the N-layer liquid crystal panel faces the viewers; polarizing polarity directions of the first and second polarizing coatings are perpendicular mutually; the first polarizing coating is attached to the back face of the first layer of the N-layer liquid crystal panel; the second polarizing coating is attached to the front face of the Nth layer of the N-layer liquid crystal panel; the first and second polarizing coatings and the N-layer liquid crystal panel form a spatial light modulator; the human eye tracking module is positioned above the Nth layer of the N-layer liquid crystal panel and fixedly connected with the same; the computer is connected with the human eye tracking module; the multi-output-port display card is connected with the computer.
Description
Technical field
The invention belongs to true 3-D display field, particularly relate to a kind of naked eye three-dimensional display system of simultaneously watching for many people and method.
Background technology
Real world is a three-dimensional space, and the mankind can three-dimensional information in perception real world by eyes.As shown in Figure 1, these three-dimensional informations mainly comprise: 1) binocular parallax, 2) mobile parallax, 3) human eye active adjustment.Binocular parallax is because human eye position is in the horizontal direction different, thus the image that right and left eyes is seen is also different; Perception can go out the distance of object after the different images of right and left eyes synthesizes in the brain, object parallax far away is less, and nearer object parallax is larger.Mobile parallax is because the relative position of human eye and object changes the not ipsilateral can seeing object later, thus can perception three-dimensional body.The active adjustment of human eye is different based on human eye readability when watching far and near different object, human eye can active adjustment ciliary muscle thus change curvature of lens and makes object imaging clearly as far as possible on the retina, and the difference of ciliary muscle relaxation degree can the far and near distance of indirect suggestion object.But traditional flat-panel screens can not provide any one in above-mentioned three kinds of three-dimensional informations; Traditional flat-panel display devices by the method for the psychological hints such as illumination, texture, shade for beholder provides three-dimensional sensation, and can only can not provide the three-dimensional information in physical significance.
True three-dimension display technlolgies is a kind of with the diverse display packing of conventional planar display technique, it can enable in the above-mentioned three kinds of three-dimensional informations of human eye perception when not wearing any specific installation one or more.True 3-D technology achieves significant progress at last decade, and progressively moves towards the marketization.True three display techniques mainly comprise three major types at present: 1) body 3-D display, 2) hologram three-dimensional display, 3) integrated grating display.Body 3-D display is progressively eliminated due to the shortcoming such as bulky, system complex, imaging be of low quality; Hologram three-dimensional display also cannot reach Real time dynamic display at present, and requires higher to viewing environment, thus is not also universally accepted; Integrated grating display is with low cost, can be improved realization on traditional liquid crystal panel display; Naked eye three-dimensional display device in current market is mainly based on this technology.But integrated grating display also has its serious defect: 1) image resolution ratio loss serious, 2) viewpoint fixes, 3) dizzy degree obviously, 4) lack vertical parallax, 5) cannot meet many people watch simultaneously, 6) three-dimensional information that provides is limited.
Along with the development of true three-dimension display technlolgies, need a kind of dimension display technologies that whole three kinds of three-dimensional informations can be provided not lose again resolution and the viewing of many people viewpoint bore hole can be met badly.But current existing display packing all can not meet above-mentioned requirements simultaneously.
Summary of the invention
In order to overcome above-mentioned defect, the object of the invention is to propose a kind of cheap and naked eye three-dimensional display system that is that easily realize and method, avoiding the loss of image resolution ratio, allow many people to obtain best view simultaneously, and above-mentioned whole three kinds of three-dimensional informations are provided.
To achieve these goals, according to a first aspect of the invention, a kind of free view-point real three-dimensional display system of many people's viewings is provided, comprises directivity backlight, multilayer liquid crystal panel, tracing of human eye module, the first polarizing coating, the second polarizing coating, computing machine and multi output port video card, wherein:
The 1st layer of liquid crystal panel in multilayer liquid crystal panel is near backlight, n-th layer liquid crystal panel near beholder, and wherein n=1,2,3...N are the sequence number of the n-th layer liquid crystal panel number of plies, n≤N; Every layer of all parallel with backlight placement of liquid crystal panel, and the front of every layer of liquid crystal panel is all towards beholder; First polarizing coating is mutually vertical with the polarization polarity direction of the second polarizing coating; The first polarizing coating is closely posted, for changing backlight into polarity polarized light at the back side of the 1st layer of liquid crystal panel; The second polarizing coating is closely posted, for hindering partially by the 1st layer of polarized light that liquid crystal panel transmits in the front of n-th layer liquid crystal panel; First polarizing coating, the second polarizing coating and N layer liquid crystal panel form spatial light modulator jointly, light for sending backlight is modulated, after modulation, multilayer liquid crystal panel combination produces light, and the light of this light and human eye line defines the rectangular pyramid fibre bundle that take human eye as summit; Every eyes receive different rectangular pyramid light shafts, for ensureing that everyone eyes receive different images, thus make human eye experience three-dimensional picture;
Tracing of human eye module is positioned over the top of n-th layer liquid crystal panel, and keeps tracing of human eye module to be fixedly connected with n-th layer liquid crystal; Tracing of human eye module real-time follow-up is positioned at all beholder faces before multilayer liquid crystal panel, and calculates the 3 d space coordinate of each beholder's right and left eyes in real time;
Computing machine and tracing of human eye model calling, receive the 3 d space coordinate of all beholder's right and left eyes, and be the binocular image under each beholder renders corresponding viewpoint; By the binocular image back projection of playing up to every layer of liquid crystal panel, decompose and obtain every tomographic image;
Multi output port video card is connected with computing machine, and every tomographic image that reception decomposition obtains also is transferred on every layer of liquid crystal panel.
To achieve these goals, according to a second aspect of the invention, provide the true 3 D displaying method of free view-point that the many people of a kind of confession watch, the method comprises the following steps:
Step S1: determine the liquid crystal panel number of plies, build the free view-point real three-dimensional display system of many people viewing, the viewing area before the multilayer liquid crystal panel of described system is divided into multiple viewing area, and the number of viewing area is decided by the maximum refresh rate of liquid crystal;
Step S2: start tracing of human eye module, obtains the right and left eyes 3 d space coordinate of all beholders before being positioned at multilayer liquid crystal panel, and with the relative position of multilayer liquid crystal panel, all beholders is divided into corresponding viewing area according to beholder's human eye;
Step S3: according to the right and left eyes 3 d space coordinate of beholder is the binocular image that each beholder renders corresponding viewpoint by computing machine;
Step S4: binocular image back projection will be played up on every layer of liquid crystal panel, and the subscript of back projection's line of each pixel on binocular image and the crossing pixel of every layer of liquid crystal panel played up in record;
Step S5: for the some viewing areas in step S1, by the subscript of crossing pixel, all binocular images of playing up in this viewing area are decomposed on every layer of liquid crystal panel, be that every layer of liquid crystal panel calculates piece image by computing machine, and complete the decomposition of binocular image in each viewing area successively;
Step S6: drive every layer of liquid crystal panel by having multiport output video card, the image after being decomposed some viewing areas is shown on corresponding liquid crystal panel simultaneously simultaneously; Judge whether the display of all viewing areas binocular image, if do not complete the display of all viewing areas binocular image, then shown the binocular image of next viewing area, if completed the display of all viewing areas binocular image, then enter step S7;
Step S7: judge whether system exits, if system does not exit, repeat step S2 to step S6 according to the eye space three-dimensional coordinate after upgrading, the 3-D view of display new viewpoint, if system exits, then shows end.
Beneficial effect of the present invention: the right and left eyes that real three-dimensional display system of the present invention is respectively each beholder according to the position of human eye modulates different images, thus the beholder being positioned at diverse location can see the not ipsilateral of object, which ensure that beholder can obtain correct mobile parallax.Simultaneously the image that obtains of beholder's left eye and right eye is also different, and this provides binocular solid parallax for beholder.When beholder and display system far and near distance change, light can enter human eye with different angles, makes the relax level of human eye ciliary muscle be in correct active adjustment state.Therefore the design provides binocular solid parallax, mobile parallax and the perception of human eye active adjustment for beholder simultaneously, and can meet multiple beholder bore hole viewing simultaneously 3-D view.
Directivity backlight can send the light beam of different directions within the scope of certain angle; In the system cloud gray model of reality, multilayer liquid crystal panel front is divided into multiple viewing area; Directivity backlight can successively to each viewing area sender tropism's light beam, and when the backlight of this viewing area lights, N floor liquid crystal panel can project the binocular image in this district.The quantity of viewing area is more, requires that the refresh rate of liquid crystal panel is also higher; Consider that liquid crystal panel generally can reach 144Hz on the market at present, be generally divided into 4 viewing areas, this can ensure that 3-D view shows in real time with the refresh rate being greater than 30fps; The method of this multi-section display proposed in the present invention is watched most important for the multiple beholders meeting diverse location simultaneously, because the locus of multiple beholder may be apart from each other, and such as, beholder 061 shown in Fig. 6 and beholder 069; If decomposed by binocular image corresponding for multiple beholders apart from each other for locus simultaneously simultaneously, can cause decomposing picture quality and reduce, the three-dimensional image quality finally making all beholders see all reduces.
The number of plies of liquid crystal panel needs to consider 3-D display quality, and viewing number and system power are determined.The number of plies of liquid crystal panel is more, and the three-dimensional image quality that modulation generates is better, but due to light therethrough multilayer liquid crystal panel luminance loss increase, at this moment needs more powerful backlight.The loss of the liquid crystal panel number of plies fewer light luminance is fewer, and display brightness is higher, but modulation degree of freedom reduces, and three-dimensional image quality reduces.The number of plies of required liquid crystal panel can be determined according to the quantity of beholder, needs more liquid crystal surface flaggy when being applied in a fairly large number of occasion of beholder, and the liquid crystal panel number of plies needed when the occasion being applied in beholder's negligible amounts is less.When being applied to mobile phone, flat board and PC etc. and only watching for 1-2 people, only namely needs 2 layers of liquid crystal panel can be the naked eye three-dimensional viewing effect that each beholder provides good.When being applied to the occasion that home videos, advertisement machine etc. have more than 3 people to watch, need 3-4 layer liquid crystal panel, the power of backlight needs suitably to improve simultaneously.
Tracing of human eye module not only will follow the tracks of the face of beholder, and will calculate the 3 d space coordinate of each beholder's right and left eyes.Can adopt stereoscopic camera technology at present, or the Kinect etc. of Microsoft can realize position of human eye location.Tracing of human eye module Real-time Obtaining eye space three-dimensional coordinate (being greater than 24fps), and position of human eye data are delivered in real time three-dimensional display system and be used for for each beholder plays up the binocular image of corresponding viewpoint.
The invention solves traditional integrated cylinder lens type or the display of slit grating formula naked eye three-dimensional can only provide limited several fixed view, beholder can only obtain the limitation of best 3-D view in fixed view; In described viewing area, the binocular image of the corresponding viewpoint of all beholders decomposes, and this effectively avoids the three dimensional rendered images Quality Down caused because multiple beholder's viewpoint distribution span is excessive; Multilayer liquid crystal panel front allows multiple beholder to watch 3-D view in bore hole mode simultaneously, also allows multiple beholder to watch 3-D view in bore hole mode in each independent viewing area simultaneously simultaneously; The three-dimensional picture that beholder's eyes receive not is the image that one deck liquid crystal panel directly shows, but is carried out modulating the picture later cast out to light by multilayer liquid crystal panel (at least 2 layers); Any one pixel on certain layer of liquid crystal panel can with any one the pixel line on other layer of liquid crystal panel, and total amount of light that therefore can produce is with liquid crystal panel resolution for radix, the geometric growth being power with the liquid crystal panel number of plies; Adopt 3 layers of liquid crystal panel in one embodiment of the invention, liquid crystal panel resolution is 1920*1080, and total amount of light that therefore can produce is (1920*1080)
3.
Accompanying drawing explanation
Fig. 1 is three kinds of major ways of Human Perception three-dimensional world;
Fig. 2 is the free view-point real three-dimensional display system design diagram of the many people's viewings of confession of the present invention;
Fig. 3 is that in the present invention, modules is interconnected schematic diagram;
Fig. 4 is present system operational flow diagram;
Fig. 5 is the schematic diagram that the present invention watches for many people simultaneously;
Fig. 6 is that all beholders are divided into the schematic diagram of corresponding viewing area by the present invention;
Fig. 7 is the present invention by the binocular image back projection the played up schematic diagram to each layer liquid crystal panel;
Fig. 8 is that the binocular image after modulation is projected the schematic diagram of corresponding beholder's right and left eyes by the present invention;
Embodiment
For making the object, technical solutions and advantages of the present invention clearly understand, below in conjunction with specific embodiment, and with reference to accompanying drawing, the present invention is described in more detail.
As Fig. 2 and Fig. 3 illustrates the free view-point real three-dimensional display system of the present invention for many people's viewings, primarily of directivity backlight 001, a N layer liquid crystal panel 021-02N, first polarizing coating 031, second polarizing coating 032, tracing of human eye module 004, computing machine 008 and multiport export video card 009 and form; The observer in multilayer liquid crystal panel 021-02N front is numbered 06x, is numbered 061-063 respectively as having 3 beholders in Fig. 3; The rendering image of the corresponding viewpoint of each beholder is numbered 07x, and rendering image as corresponding in beholder 061-063 in Fig. 3 is numbered 071-073, wherein:
The 1st layer of liquid crystal panel 021 in multilayer liquid crystal panel 021-02N is near backlight 001, and n-th layer liquid crystal panel 02N is near beholder, and wherein n=1,2,3...N are the sequence number of the n-th layer liquid crystal panel number of plies, n≤N; Every layer of all parallel with backlight 001 placement of liquid crystal panel 021-02N, and the front of every layer of liquid crystal panel 021-02N is all towards beholder; First polarizing coating 031 must have contrary polarization polarity with the second polarizing coating 032, and also namely the polar orientation of polarization is mutually vertical; The first polarizing coating 031 is closely posted, for changing backlight into polarity polarized light at the back side of the 1st layer of liquid crystal panel 021; The second polarizing coating 032 is closely posted, for hindering partially by the 1st layer of polarized light that liquid crystal panel 021 transmits in the front of n-th layer liquid crystal panel 02N; First polarizing coating 031, second polarizing coating 032 forms spatial light modulator jointly with N layer liquid crystal panel 021-02N, light for sending backlight 001 is modulated, after modulation, multilayer liquid crystal panel 021-02N combines and produces light, and the light of this light and human eye line defines the rectangular pyramid fibre bundle that take human eye as summit; Every eyes receive different rectangular pyramid light shafts, for ensureing that everyone eyes receive different images, thus make human eye experience three-dimensional picture;
Tracing of human eye module 004 is positioned over the top of n-th layer liquid crystal panel 02N, and keeps tracing of human eye module 004 to be fixedly connected with n-th layer liquid crystal 02N; Tracing of human eye module 004 real-time follow-up is positioned at all beholder faces before multilayer liquid crystal panel 021-02N, and calculates the 3 d space coordinate of each beholder's right and left eyes in real time;
Computing machine 008 is connected with tracing of human eye module 004, receives the 3 d space coordinate of all beholder's right and left eyes, and renders the binocular image under corresponding viewpoint, and by the binocular image back projection of playing up to every layer of liquid crystal panel 021-02N, decomposes and obtain every tomographic image;
The video card 009 of multi output port is connected with computing machine 008, and every tomographic image that reception decomposition obtains also is transferred on every layer of liquid crystal panel 021-02N.
Wherein, described backlight 001 is the directive backlight of tool, and within the scope of set angle, produce directivity light beam; As shown in Figure 6, the viewing area in multilayer liquid crystal panel 021-02N front is divided into multiple viewing area 051-054, backlight 001 is successively in turn for different viewing area provides backlight.
Wherein, described spatial light modulator, can modulate the light that backlight 001 sends, for multiple beholder provides correct light shafts, make multiple beholder can perceive binocular parallax and mobile parallax simultaneously, and make the eyes of beholder be in correct active adjustment state.Light sends from backlight 001 often will be subject to primary modulation through one deck liquid crystal panel 021-02N afterwards, finally arrives human eye.
Wherein, described tracing of human eye module 004, for real-time follow-up face, and calculate left eye and the right eye 3 d space coordinate in space of people, when position of human eye changes, real-time rendering goes out the binocular image under the corresponding viewpoint of each beholder, guarantees that all beholders can obtain best naked eye three-dimensional viewing effect simultaneously.
As Fig. 5 illustrates the schematic diagram that the invention provides many people and watch simultaneously, according to the eyes of people relative to the deviation post of multilayer liquid crystal panel 021-023 and far and near distance, multilayer liquid crystal panel is that each beholder modulates the binocular image under corresponding viewpoint and correct light shafts is mapped to the right and left eyes of all beholders, make human eye can simultaneously perception binocular parallax and mobile parallax, and the relax level of active adjustment ciliary muscle, thus make multiple beholder can receive correct naked eye three-dimensional image.
As Fig. 4 illustrates operational flow diagram of the present invention, true 3-D display production method of the present invention comprises the following steps:
Step S1: determine the liquid crystal number of plies according to application scenario, describe according to system schematic as shown in Figure 2 and design, build the true 3-D display hardware system of free view-point of many people viewing, viewing area before the multilayer liquid crystal panel 021-02N of real three-dimensional display system is divided into multiple viewing area, and the number of viewing area is decided by the maximum refresh rate of liquid crystal;
The number of plies of required multilayer liquid crystal panel 021-02N is determined by application scenario, and determines according to beholder's quantity.For the display application occasion such as mobile phone, flat board, PC for 1-2 people's viewing, all beholders can obtain best naked eye three-dimensional viewing effect to use 2 layers of liquid crystal panel to ensure; Have the application scenario of 3 people and above viewing in home videos, advertisement machine etc., need 3-4 layer liquid crystal panel, the power of backlight illumination needs corresponding raising simultaneously.
In an embodiment of the present invention, the liquid crystal panel number of plies is 3 layers, and liquid crystal panel model is Asus VG278,27 inches, and resolution is 1920*1080, and the highest refresh rate is 144Hz; The polarization angle of the first polarizing coating 031 is that the polarization angle of 45 ° and the second polarizing coating 032 is-45 °, first polarizing coating 031 is close to the back side of the 1st layer of liquid crystal panel, namely near the side of backlight 001, second polarizing coating 032 is close to before the 3rd layer of liquid crystal panel, namely supplies the side of beholder's direct viewing.First polarizing coating 031 is mutually vertical with the polarization direction of the second polarizing coating 032, does not require according to arranging at 45 ° and-45 ° shown in Fig. 2, as long as ensure that the first polarizing coating 031 is mutually vertical with the polarization direction of the second polarizing coating 032;
Step S2: startup tracing of human eye module 004 real-time tracing is positioned at the face of all beholders before multilayer liquid crystal panel 021-02N, and calculates the 3 d space coordinate of each beholder's right and left eyes in real time by analyzing face characteristic; And according to the distribution of position of human eye, beholder is divided into multiple viewing area;
Human eye location technology can adopt the kinect of Microsoft, also can adopt binocular solid camera technique, in an embodiment of the present invention, adopts kinect to carry out real-time human eye location; Directivity backlight is effective within the scope of certain angle, maximum effective angle is determined by the curvature of the cylindrical prism in backlight 001, in an embodiment of the present invention, as Fig. 6 is depicted as the schematic diagram that all beholders to be divided into corresponding viewing area by the present invention, the maximum effective angle of directivity backlight is 120 °, and being divided into 4 viewing area 051-054, each viewing area is 30 °; According to the position at human eye place, beholder is divided into corresponding viewing area; In order to clearly show how viewing area divides, in Fig. 6, between 4 viewing area 051-054, there is gap, and very close to each other between the viewing area of reality.
Step S3: according to the locus of each beholder's eyes, be the binocular image that each beholder renders under corresponding viewpoint by computing machine, the computing machine 008 used in one embodiment of the invention is Dell Optiplex 960, and installs OpenGL software library on computers.
Consider the difference of position of human eye, the not ipsilateral of object can be seen; Simultaneously different from object far and near distance, see that the size of object is also different; And right and left eyes also should receive different images; In an embodiment of the present invention, the binocular image 07x of corresponding viewpoint under rendering diverse location by OpenGL, as there being three beholder 061-063 in Fig. 3, the image that correspondence renders is 071-073; Often couple of binocular image 071-073 comprises left and right two width images, the right and left eyes of corresponding people respectively; The binocular image resolution rendered should not higher than the liquid crystal panel resolution selected in step S1.In an embodiment of the present invention, the binocular image resolution rendered by OpenGL is identical with liquid crystal panel resolution, is 1920*1080.
Step S4: by binocular image back projection on each layer liquid crystal panel, and record the Mei Tiao back projection line and the subscript of the crossing pixel of each layer liquid crystal panel of playing up each pixel on binocular image.
In an embodiment of the present invention, the 3 d space coordinate at often pair of binocular image 07x center is consistent with the 3 d space coordinate of the corresponding beholder 06x right and left eyes calculated in step 2; As Fig. 7 is depicted as the present invention, corresponding for 3 beholder 061-063 is played up the schematic diagram of binocular image 071-073 back projection to each layer liquid crystal panel 021-023, by each the pixel back projection in binocular image in the 1st layer of liquid crystal panel respective pixel, its back projection's line can be crossing with other liquid crystal surface flaggies; According to this binocular image of each beholder is carried out by pixel back projection, and record the subscript with the crossing pixel of each layer liquid crystal panel; Until each pixel in the binocular image of each beholder completes above-mentioned back projection process.
Step S5: for some viewing area 051-054, by the subscript of crossing pixel, all binocular images of playing up in this viewing area are decomposed on every layer of liquid crystal panel 021-023, transformation matrix wherein for exploded view picture is determined by the subscript of the crossing pixel recorded in step S4, calculate piece image by computing machine 008 for every layer of liquid crystal panel, and successively all binocular images are resolved into N layer liquid crystal panel image according to following formula.
According in step S2, subregion is carried out to viewing area, be divided into into M viewing area; Wherein, L
iit is the set being positioned at i-th all binocular image in viewing area; B
iit is the backlight illumination of i-th viewing area; W is weight matrix, is determined by the subscript of back projection's line in step S4 with the crossing pixel of each layer liquid crystal panel, if back projection's line is crossing with certain pixel on liquid crystal panel, then corresponding in weight matrix W element is 1, otherwise is 0; F
ig
ih
ibe respectively the image that rear three layers of liquid crystal panel are decomposed in i-th viewing area; W, b
i, f
i, g
i, h
ibe respectively matrix W, B
i, F
i, G
i, H
iin element; "." be vectorial apposition operational symbol; In an embodiment of the present invention, decompose respectively in each viewing area to all binocular images in this district, each viewing area can calculate three width liquid crystal panel images.
Step S6: simultaneously drive every layer of liquid crystal panel 021-023 by having multiport output video card 009, viewing areas some in step S5 being decomposed the liquid crystal panel image obtained is simultaneously displayed on corresponding liquid crystal panel, judge whether the display of all viewing areas binocular image, if do not complete the display of all viewing areas binocular image, then show the binocular image of each viewing area next, if completed the display of all viewing areas binocular image, then enter step S7.
In an embodiment of the present invention, the model that multiport exports video card 009 is Nvidia Gerforce690, and video card 009 can be 4 liquid crystal panel transmitting images simultaneously; The three width liquid crystal panel images obtained simultaneously can be decomposed in step display 5 in each viewing area; 4 viewing areas show successively in turn, and the refresh rate of each viewing area is 30fps, therefore needs the highest refresh rate of liquid crystal panel to be 120Hz; According to the liquid crystal panel selected in step 1, its highest refresh rate is 144Hz, and therefore the refresh rate of liquid crystal panel meets the demands.
Step S7: above-mentioned steps S2 to step S6 completes a frame can for the display of the true 3-D view of many people bore hole viewing simultaneously.Judge whether system exits, if system does not exit, if need to continue the lower frame 3-D view of display, repeat step S2 to step S6 according to the eye space three-dimensional coordinate after upgrading; If display terminates, then log off.
Wherein, before described beholder is positioned at multilayer liquid crystal panel, any viewpoint of set and display district scope can obtain best naked eye three-dimensional effect; The binocular image of the corresponding viewpoint of beholders all in each viewing area is decomposed, for effectively avoiding three dimensional rendered images Quality Down; Multilayer liquid crystal panel front allows multiple beholder 061-069 to watch 3-D view in bore hole mode simultaneously, also allows multiple beholder to watch 3-D view in bore hole mode in each independent viewing area 051-054 simultaneously simultaneously.
Wherein, the same time only has the 3-D view in a viewing area to project all beholders in this viewing area, projects the 3-D view in each viewing area successively, until the beholder in all viewing areas have received the 3-D view of corresponding viewpoint.
Wherein, the three-dimensional picture that beholder's eyes receive is undertaken modulating the picture later cast out by 3 layers of liquid crystal panel, 021,022,023 pair of light.
Wherein, any one pixel on certain layer of liquid crystal panel can with any one the pixel line on other layer of liquid crystal panel, and the total amount of light therefore produced is with liquid crystal panel resolution for radix, the geometric growth being power with the liquid crystal panel number of plies.
Fig. 8 illustrates that the binocular image after modulation is projected the schematic diagram of corresponding beholder's right and left eyes by the present invention, 3 layers of liquid crystal panel 021-023 can combine and produce a large amount of light, wherein define the rectangular pyramid fibre bundle that take human eye as summit with the light of human eye line; Every eyes receive different rectangular pyramid light shafts, which ensure that everyone eyes have received different images, thus make human eye experience three-dimensional picture.
There are some business-like naked eye three-dimensional display products at present, mainly realized based on microtrabeculae lens imaging technology, micro-cylindrical lens array is covered in one deck liquid crystal display, make liquid crystal display send different pictures to different directions; But there is following obvious defect in this technology at present: 1) image resolution ratio loss serious, 2) viewpoint fixes, 3) dizzy degree obviously, 4) lack vertical parallax, 5) cannot meet many people watch at free view-point simultaneously, 6) the whole three kinds of three-dimensional informations shown in Fig. 1 can not be provided.Relative to technology before, the present invention well compensate for above-mentioned deficiency; The present invention adopts multilayer liquid crystal panel repeatedly to modulate the light that backlight sends, and image resolution ratio can not be caused to lose; Real-time follow-up position of human eye of the present invention, allows to watch in any viewpoint; The present invention can play up correct visual point image according to the distance of beholder and multilayer liquid crystal panel, makes the ciliary muscle of human eye be in correct adjustment state, and what avoid in viewing process is dizzy; When human eye moves left and right relative to multilayer liquid crystal panel and moves up and down, the present invention can provide different images, provides horizontal parallax and vertical parallax for beholder; The present invention is that the right and left eyes of multiple beholder all projects corresponding cone of rays bundle, therefore allows many people to watch from any viewpoint simultaneously; The present invention provides binocular parallax, mobile parallax for beholder simultaneously, and makes the ciliary muscle of human eye be in correct adjustment state.
The above; be only the embodiment in the present invention, but protection scope of the present invention is not limited thereto, any people being familiar with this technology is in the technical scope disclosed by the present invention; the conversion or replacement expected can be understood, all should be encompassed in of the present invention comprising within scope.
Claims (10)
1. a free view-point real three-dimensional display system for the many people's viewings of confession, is characterized in that, comprise backlight, multilayer liquid crystal panel, tracing of human eye module, the first polarizing coating, the second polarizing coating, computing machine and multi output port video card, wherein:
The 1st layer of liquid crystal panel in multilayer liquid crystal panel is near backlight, n-th layer liquid crystal panel near beholder, and wherein n=1,2,3...N are the sequence number of the n-th layer liquid crystal panel number of plies, n≤N; Every layer of all parallel with backlight placement of liquid crystal panel, and the front of every layer of liquid crystal panel is all towards beholder; First polarizing coating is mutually vertical with the polarization polarity direction of the second polarizing coating; The first polarizing coating is closely posted, for changing backlight into polarity polarized light at the back side of the 1st layer of liquid crystal panel; The second polarizing coating is closely posted, for hindering partially by the 1st layer of polarized light that liquid crystal panel transmits in the front of n-th layer liquid crystal panel; First polarizing coating, the second polarizing coating and N layer liquid crystal panel form spatial light modulator jointly, light for sending backlight is modulated, after modulation, multilayer liquid crystal panel combination produces light, and the light of this light and human eye line defines the rectangular pyramid fibre bundle that take human eye as summit; Every eyes receive different rectangular pyramid light shafts, for ensureing that everyone eyes receive different images, thus make human eye experience three-dimensional picture;
Tracing of human eye module is positioned over the top of n-th layer liquid crystal panel, and keeps tracing of human eye module to be fixedly connected with n-th layer liquid crystal; Tracing of human eye module real-time follow-up is positioned at all beholder faces before multilayer liquid crystal panel, and calculates the 3 d space coordinate of each beholder's right and left eyes in real time;
Computing machine and tracing of human eye model calling, receive the 3 d space coordinate of all beholder's right and left eyes, and be the binocular image under each beholder renders corresponding viewpoint; By the binocular image back projection of playing up to every layer of liquid crystal panel, decompose and obtain every tomographic image;
Multi output port video card is connected with computing machine, and every tomographic image that reception decomposition obtains also is transferred on every layer of liquid crystal panel.
2. according to the real three-dimensional display system described in claim 1, it is characterized in that, described backlight is the directive backlight of tool, and within the scope of set angle, produce directivity light beam; The viewing area in multilayer liquid crystal panel front is divided into multiple viewing area, and backlight is successively in turn for different viewing area provides backlight.
3. according to the real three-dimensional display system described in claim 1, it is characterized in that, described spatial light modulator, the light that backlight sends can be modulated, for multiple beholder provides correct light shafts, make multiple beholder can perceive binocular parallax and mobile parallax simultaneously, and make the eyes of beholder be in correct active adjustment state.
4. according to the real three-dimensional display system described in claim 1, it is characterized in that, the number of plies of described liquid crystal panel is determined by application scenario; Described application scenario is: in the application scenario of the mobile phone watched for 1 people-2 people, flat board and PC, and 2 layers of liquid crystal panel can ensure that all beholders can obtain best naked eye three-dimensional viewing effect; There iing the application scenario of 3 people and above viewing, needing 3-4 layer liquid crystal panel.
5. according to the real three-dimensional display system described in claim 1, it is characterized in that, described tracing of human eye module, for real-time follow-up face, and calculate left eye and the right eye 3 d space coordinate in space of people; When position of human eye changes, go out the binocular image under the corresponding viewpoint of each beholder by computing machine real-time rendering, guarantee that all beholders can obtain best naked eye three-dimensional viewing effect simultaneously.
6. use the true 3 D displaying method of free view-point of the confession of system many people viewing described in claim 1-5, it is characterized in that, the method comprises the following steps:
Step S1: determine the liquid crystal panel number of plies, build the free view-point real three-dimensional display system of many people viewing, the viewing area before the multilayer liquid crystal panel of described system is divided into multiple viewing area, and the number of viewing area is decided by the maximum refresh rate of liquid crystal;
Step S2: start tracing of human eye module, obtains the right and left eyes 3 d space coordinate of all beholders before being positioned at multilayer liquid crystal panel, and with the relative position of multilayer liquid crystal panel, all beholders is divided into corresponding viewing area according to beholder's human eye;
Step S3: according to the right and left eyes 3 d space coordinate of beholder is the binocular image that each beholder renders corresponding viewpoint by computing machine;
Step S4: binocular image back projection will be played up on every layer of liquid crystal panel, and the subscript of back projection's line of each pixel on binocular image and the crossing pixel of every layer of liquid crystal panel played up in record;
Step S5: for the some viewing areas in step S1, by the subscript of crossing pixel, all binocular images of playing up in this viewing area are decomposed on every layer of liquid crystal panel, be that every layer of liquid crystal panel calculates piece image by computing machine, and complete the decomposition of binocular image in each viewing area successively;
Step S6: drive every layer of liquid crystal panel by having multiport output video card, the image after being decomposed some viewing areas is shown on corresponding liquid crystal panel simultaneously simultaneously; Judge whether the display of all viewing areas binocular image, if do not complete the display of all viewing areas binocular image, then shown the binocular image of next viewing area, if completed the display of all viewing areas binocular image, then enter step S7;
Step S7: judge whether system exits, if system does not exit, repeat step S2 to step S6 according to the eye space three-dimensional coordinate after upgrading, the 3-D view of display new viewpoint, if system exits, then shows end.
7. true 3 D displaying method according to claim 6, is characterized in that, before beholder is positioned at multilayer liquid crystal panel, any viewpoint of set and display district scope can obtain best free view-point naked eye three-dimensional effect; In turn the binocular image of the corresponding viewpoint of beholders all in each viewing area is decomposed, for effectively avoiding three dimensional rendered images Quality Down successively; Multilayer liquid crystal panel front allows multiple beholder to watch 3-D view in bore hole mode simultaneously, also allows multiple beholder to watch 3-D view in bore hole mode in each independent viewing area simultaneously simultaneously.
8. true 3 D displaying method according to claim 6, it is characterized in that, the same time only has the 3-D view in a viewing area to project all beholders in this viewing area, the beholder in all viewing areas projects the 3-D view in each viewing area successively, until have received the 3-D view of corresponding viewpoint.
9. true 3 D displaying method according to claim 6, is characterized in that, the three-dimensional picture that beholder's eyes receive is carried out modulating the picture later cast out to light by N layer liquid crystal panel.
10. true 3 D displaying method according to claim 6, it is characterized in that, any one pixel on certain layer of liquid crystal panel can with any one the pixel line on other layer of liquid crystal panel, therefore the total amount of light produced is with liquid crystal panel resolution for radix, the geometric growth being power with the liquid crystal panel number of plies.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410584974.9A CN104317120A (en) | 2014-10-27 | 2014-10-27 | Free-viewpoint true three-dimensional display method and free-viewpoint true three-dimensional display system allowing many people to watch |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410584974.9A CN104317120A (en) | 2014-10-27 | 2014-10-27 | Free-viewpoint true three-dimensional display method and free-viewpoint true three-dimensional display system allowing many people to watch |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104317120A true CN104317120A (en) | 2015-01-28 |
Family
ID=52372371
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410584974.9A Pending CN104317120A (en) | 2014-10-27 | 2014-10-27 | Free-viewpoint true three-dimensional display method and free-viewpoint true three-dimensional display system allowing many people to watch |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104317120A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104751765A (en) * | 2015-03-09 | 2015-07-01 | 联想(北京)有限公司 | Display control method and electronic device |
| CN105954886A (en) * | 2016-07-15 | 2016-09-21 | 成都工业学院 | A double-vision 2D display device based on polaroids |
| CN106454307A (en) * | 2015-08-07 | 2017-02-22 | 三星电子株式会社 | Method and apparatus of light field rendering for plurality of users |
| CN106507097A (en) * | 2016-11-29 | 2017-03-15 | 广州弥德科技有限公司 | Bore hole stereoscopic display live broadcast system and method based on directing backlight |
| CN107492334A (en) * | 2016-06-10 | 2017-12-19 | 苹果公司 | The interdependent image of saturation degree for high dynamic range displays is split |
| CN108304071A (en) * | 2018-02-02 | 2018-07-20 | 惠州学院 | A method of interactive mode 2.5D is realized based on eye tracking |
| CN108833891A (en) * | 2018-07-26 | 2018-11-16 | 宁波视睿迪光电有限公司 | 3d shows equipment and 3d display methods |
| WO2021147756A1 (en) * | 2020-01-20 | 2021-07-29 | 北京芯海视界三维科技有限公司 | Method, apparatus, and product for display |
| WO2022185871A1 (en) * | 2021-03-01 | 2022-09-09 | 株式会社テイデック | Three-dimensional display |
| WO2023092545A1 (en) * | 2021-11-29 | 2023-06-01 | 京东方科技集团股份有限公司 | Display method and display apparatus |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1790421A (en) * | 2001-11-27 | 2006-06-21 | 三星电子株式会社 | Apparatus and method for depth image-based representation of3-dimensional object |
| CN101061415A (en) * | 2004-09-21 | 2007-10-24 | 纽鲁克公司 | Composite dual LCD panel display suitable for three dimensional imaging |
| CN102692805A (en) * | 2012-05-31 | 2012-09-26 | 浙江大学 | Multilayer liquid crystal-based projection type three-dimensional display device and method |
| CN103179416A (en) * | 2011-12-26 | 2013-06-26 | 三星电子株式会社 | Image processing method and apparatus using multi-layer representation |
| CN103364961A (en) * | 2013-08-02 | 2013-10-23 | 浙江大学 | Three-dimensional display device and method based on multi-projection array and multilayered liquid crystal composite modulation |
| CN104049451A (en) * | 2013-03-12 | 2014-09-17 | 耿征 | True three-dimensional display device and system, true three-dimensional display control method and apparatus |
-
2014
- 2014-10-27 CN CN201410584974.9A patent/CN104317120A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1790421A (en) * | 2001-11-27 | 2006-06-21 | 三星电子株式会社 | Apparatus and method for depth image-based representation of3-dimensional object |
| CN101061415A (en) * | 2004-09-21 | 2007-10-24 | 纽鲁克公司 | Composite dual LCD panel display suitable for three dimensional imaging |
| CN103179416A (en) * | 2011-12-26 | 2013-06-26 | 三星电子株式会社 | Image processing method and apparatus using multi-layer representation |
| CN102692805A (en) * | 2012-05-31 | 2012-09-26 | 浙江大学 | Multilayer liquid crystal-based projection type three-dimensional display device and method |
| CN104049451A (en) * | 2013-03-12 | 2014-09-17 | 耿征 | True three-dimensional display device and system, true three-dimensional display control method and apparatus |
| CN103364961A (en) * | 2013-08-02 | 2013-10-23 | 浙江大学 | Three-dimensional display device and method based on multi-projection array and multilayered liquid crystal composite modulation |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104751765A (en) * | 2015-03-09 | 2015-07-01 | 联想(北京)有限公司 | Display control method and electronic device |
| CN106454307A (en) * | 2015-08-07 | 2017-02-22 | 三星电子株式会社 | Method and apparatus of light field rendering for plurality of users |
| CN106454307B (en) * | 2015-08-07 | 2020-12-08 | 三星电子株式会社 | Method and apparatus for light field rendering for multiple users |
| CN107492334A (en) * | 2016-06-10 | 2017-12-19 | 苹果公司 | The interdependent image of saturation degree for high dynamic range displays is split |
| CN107492334B (en) * | 2016-06-10 | 2020-08-18 | 苹果公司 | Electronic display method, system and non-transitory program storage device |
| CN105954886A (en) * | 2016-07-15 | 2016-09-21 | 成都工业学院 | A double-vision 2D display device based on polaroids |
| CN106507097A (en) * | 2016-11-29 | 2017-03-15 | 广州弥德科技有限公司 | Bore hole stereoscopic display live broadcast system and method based on directing backlight |
| CN108304071A (en) * | 2018-02-02 | 2018-07-20 | 惠州学院 | A method of interactive mode 2.5D is realized based on eye tracking |
| CN108833891A (en) * | 2018-07-26 | 2018-11-16 | 宁波视睿迪光电有限公司 | 3d shows equipment and 3d display methods |
| WO2021147756A1 (en) * | 2020-01-20 | 2021-07-29 | 北京芯海视界三维科技有限公司 | Method, apparatus, and product for display |
| WO2022185871A1 (en) * | 2021-03-01 | 2022-09-09 | 株式会社テイデック | Three-dimensional display |
| WO2023092545A1 (en) * | 2021-11-29 | 2023-06-01 | 京东方科技集团股份有限公司 | Display method and display apparatus |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104317120A (en) | Free-viewpoint true three-dimensional display method and free-viewpoint true three-dimensional display system allowing many people to watch | |
| Balogh et al. | Holovizio 3D display system | |
| CN103513438B (en) | A kind of various visual angles naked-eye stereoscopic display system and display packing thereof | |
| CN102801999B (en) | Synthetizing algorithm based on naked eye three-dimensional displaying technology | |
| CN106464854B (en) | Image encodes and display | |
| CN102520787B (en) | Real-time spatial three-dimensional presentation system and real-time spatial three-dimensional presentation method | |
| WO2020237927A1 (en) | Optical field display system | |
| US9140912B2 (en) | Holography 3D display | |
| CN202168171U (en) | Three-dimensional image display system | |
| CN102591124A (en) | Transverse wide-visual field tridimensional display method and system based on spliced light field | |
| CN102169283B (en) | Suspension type 360-degree view field three-dimensional display device based on projector array | |
| JP2006195018A (en) | Three dimensional display method, image generation side apparatus and image display side apparatus | |
| CN103124362B (en) | Multi-view three-dimensional display | |
| Klug et al. | 32.4: A scalable, collaborative, interactive light‐field display system | |
| CN104104939A (en) | Wide viewing angle integrated imaging three-dimensional display system | |
| CN110082960B (en) | Highlight partition backlight-based light field display device and light field optimization algorithm thereof | |
| CN109782452B (en) | Stereoscopic image generation method, imaging method and system | |
| CN104155840A (en) | Device and method for 360-degree full-parallax three dimensional display based on high-speed projector | |
| WO2023056865A1 (en) | Naked-eye 3d display method and related device | |
| CN104394394A (en) | Three-dimensional display method, device and system for realizing holographic image display | |
| US10817055B2 (en) | Auto-stereoscopic display device | |
| CN102244732B (en) | A kind of parameter setting method of stereo camera, device and this stereo camera | |
| CN202565397U (en) | 3D video monitoring system allowing videos to be watched with naked eyes | |
| CN102638690A (en) | Wide-view-angle intelligent 3D (Three-Dimensional) display and wide-view-angle intelligent 3D display method | |
| CN102917176B (en) | A kind of production method of three-dimensional stereoscopic parallax subtitle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150128 |
|
| WD01 | Invention patent application deemed withdrawn after publication |