CN102908783A - Entertainment display system and interactive stereoscopic display method thereof - Google Patents

Entertainment display system and interactive stereoscopic display method thereof Download PDF

Info

Publication number
CN102908783A
CN102908783A CN201210387863XA CN201210387863A CN102908783A CN 102908783 A CN102908783 A CN 102908783A CN 201210387863X A CN201210387863X A CN 201210387863XA CN 201210387863 A CN201210387863 A CN 201210387863A CN 102908783 A CN102908783 A CN 102908783A
Authority
CN
China
Prior art keywords
display
virtual object
entity article
transparent display
viewing area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201210387863XA
Other languages
Chinese (zh)
Other versions
CN102908783B (en
Inventor
孙宜嶙
赖世伦
蔡永生
董人郎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
AU Optronics Corp
Original Assignee
AU Optronics Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by AU Optronics Corp filed Critical AU Optronics Corp
Publication of CN102908783A publication Critical patent/CN102908783A/en
Application granted granted Critical
Publication of CN102908783B publication Critical patent/CN102908783B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/275Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • H04N13/279Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals the virtual viewpoint locations being selected by the viewers or determined by tracking

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The invention relates to an entertainment display system which is used for generating an interactive display effect to an observation area by matching with a physical object. The tracking module is used for tracking the relative position relationship between the observation area and the physical object. The operation module generates a three-dimensional virtual object according to the relative position relation. The stereoscopic display module is arranged between the solid object and the observation area, and comprises a transparent display device and a shading structure, wherein the transparent display device is used for displaying a stereoscopic virtual object. The shading structure is arranged adjacent to the transparent display device and is positioned between the transparent display device and the solid object, and the shading structure switches the shading switching state according to the virtual depth of field sequence between the three-dimensional virtual object and the solid object.

Description

Entertainment display system and interactive stereo display method thereof
Technical field
The invention relates to a kind of entertainment display system and display packing, and particularly relevant for a kind of entertainment display system and display packing with interaction effect.
Background technology
Recently, the numerical digit display unit that has an interactive display effect is in the extensive use in the middle of the various fields.For instance, can change according to user's appreciative perspective the numerical digit advertisement plate of ad content, or, can be according to user's action and the table of game player of visual angle change game display effect etc.
Take present existing interactive display system as example, see also Fig. 1, it illustrates a kind of schematic diagram of existing interactive display system 100.As shown in Figure 1, interactive display system 100 comprises the entity article (such as the rotaring wheel structure 120 in this example) of displaying contents and the transparent display 140 that is used for showing extra information.Basically, rotaring wheel structure 120 and is mainly used to show the game content information as a setting.
On the other hand, transparent display 140 is made in display foreground, is arranged between rotaring wheel structure 120 and the user's viewing area 200.Transparent display 140 can be used to show extra dynamically information.
By this, cooperate entity article (being rotaring wheel structure 120) to show with the transparent display 140 of prospect, can form two figure of prospect and background layers, so that the picture of interactive display system 100 is more diversified.In the above-mentioned example, user's viewing area 200 must with rotaring wheel structure 120 on object and transparent display 140 on corresponding display effect (for example numeral 122 and pattern 142) in line, can contraposition correctly reach best effect.See also Fig. 2, under the actual conditions, user's observation visual angle is not unalterable, and for example different according to user's height or institute's station location, the position of optimal viewing zone 200a not necessarily can be dropped in user's visual angle.
On the other hand, in the present prior art, the display effect of bringing such as the rotaring wheel structure 120 among Fig. 1 and transparent display 140 only limits to the combination of two-dimensional content.In addition, the technology of in recent years stereoscopic display breaks through gradually, begins that three-dimensional film is arranged, the application such as stereotelevision asks the city.Three-dimensional display can be by simultaneously with left-eye images and the right-eye image of different visual angles, the eyes of independently presenting to respectively the audience, and then the Deep Canvas that when eyes are watched, brings owing to the eyes spacing of imitation.Therefore, how stereo display technique can be integrated on the aforesaid transparent display, and then to bring more diversified interactive display effect be the important subject of development of present industry.
Summary of the invention
For addressing the above problem, the present invention proposes a kind of entertainment display system and interactive stereo display method, wherein having comprised transparent display in the entertainment display system is arranged between entity article and the user observation place, relative position relation calculating angle correction between tracking entity article and the user observation place is used generation tridimensional virtual object and is shown on the transparent display, by this, can avoid the user observation place to change the contraposition misalignment problem that causes.In addition, other has light-shielding structure setting adjacent with transparent display, light-shielding structure selectively switch its shading on off state by this depth of field orbution between simulating stereo virtual article and the entity article (as the tridimensional virtual object in prospect and entity article in background, or entity article in prospect and three-dimensional virtual article in background), by this, the virtual location of tridimensional virtual object can be set in before or after the entity article, is not subject to the precedence relationship of actual setting.
One aspect of this disclosure is that a kind of entertainment display system is being provided, and produces interactive display effect to a viewing area in order to the entity article of arranging in pairs or groups, and this entertainment display system comprises tracing module, computing module and stereo display module.Tracing module is in order to follow the trail of a relative position relation of this viewing area and this entity article.Computing module produces at least one tridimensional virtual object according to this relative position relation.Stereo display module is arranged between this entity article and this viewing area, and this stereo display module comprises transparent display and light-shielding structure, and transparent display is in order to show this tridimensional virtual object.Light-shielding structure setting adjacent with this transparent display and between this transparent display and this entity article, this light-shielding structure switches its shading on off state according to the virtual depth of field order between this tridimensional virtual object and this entity article.
Description of drawings
Fig. 1 illustrates a kind of schematic diagram of existing interactive display system;
Fig. 2 illustrates the image content schematic diagram of interactive display system among Fig. 1;
Fig. 3 illustrates the functional block diagram according to a kind of entertainment display system in one embodiment of the invention;
Fig. 4 A illustrates according to the wherein schematic diagram of an embodiment Stereo display module, viewing area and entity article of the present invention;
Fig. 4 B illustrates the schematic diagram of the tridimensional virtual object that shows on the entity article and stereo display module among the embodiment of Fig. 4 A;
Fig. 4 C illustrates according to the wherein schematic diagram of an embodiment Stereo display module, viewing area and entity article of the present invention;
Fig. 4 D illustrates the schematic diagram of the tridimensional virtual object that shows on the entity article and stereo display module among the embodiment of Fig. 4 C;
Fig. 4 E illustrates according to the wherein schematic diagram of an embodiment Stereo display module, viewing area and entity article of the present invention;
Fig. 4 F illustrates the schematic diagram of the tridimensional virtual object that shows on the entity article and stereo display module among the embodiment of Fig. 4 E;
Fig. 4 G illustrates according to the wherein schematic diagram of an embodiment Stereo display module, viewing area and entity article of the present invention;
Fig. 4 H illustrates the schematic diagram of the tridimensional virtual object that shows on the entity article and stereo display module among the embodiment of Fig. 4 G;
Fig. 5 A illustrates according among the wherein embodiment of the present invention three-dimensional virtual article being carried out the schematic diagram that two group images of corresponding user's left eye and right eye were calculated and produced to binocular parallax;
Fig. 5 B illustrates the schematic diagram of the left-eye images among Fig. 5 A;
Fig. 5 C illustrates the schematic diagram of the right-eye image among Fig. 5 A;
Fig. 6 A to Fig. 6 C is illustrated in respectively among the embodiment when tridimensional virtual object and entity article and is the schematic diagram of part when overlapping;
Fig. 7 A to Fig. 7 C is illustrated in respectively among another embodiment when tridimensional virtual object and entity article and is the schematic diagram of part when overlapping;
Fig. 8 A and Fig. 8 B illustrate according to a kind of luminance compensation mechanism in one embodiment of the invention;
Fig. 9 A and Fig. 9 B illustrate according to the another kind of luminance compensation mechanism in one embodiment of the invention; And
A kind of method flow diagram of interactive stereo display method during Figure 10 illustrates according to another embodiment of the present invention.
Wherein, Reference numeral:
100: interactive display system
120: rotaring wheel structure
140: transparent display
142: pattern
122: numeral
S100 ~ S106: step
200,200a, 200b, 200c: viewing area
300: entertainment display system
320: tracing module
340: computing module
360: stereo display module
362: transparent display
364: light-shielding structure
366: the tridimensional virtual object
380: driver module
400: viewing area
420: entity article
The specific embodiment
Describe the present invention below in conjunction with the drawings and specific embodiments, but not as a limitation of the invention.
See also Fig. 3, it illustrates the functional block diagram according to a kind of entertainment display system 300 in one embodiment of the invention.Among the embodiment as shown in Figure 3, entertainment display system 300 comprises tracing module 320, computing module 340 and stereo display module 360, and wherein, computing module 340 is coupled to tracing module 320 and stereo display module 360.Entertainment display system 300 produces interactive display effect to one of corresponding user's eyes viewing area in order to the entity article of arranging in pairs or groups (such as commodity, advertising items or game item etc.), and entertainment display system 300 for example is a kind of table of game player with stereo display module.
See also Fig. 4 A and Fig. 4 B, Fig. 4 A illustrates according to the wherein schematic diagram of an embodiment Stereo display module 360, viewing area 400 and entity article 420 of the present invention.Fig. 4 B illustrates the schematic diagram of the tridimensional virtual object 366 that shows on the entity article 420 and stereo display module 360 among the embodiment of Fig. 4 A.
Tracing module 320 is in order to tracing study zone 400 and the actual coordinate of entity article 420 and the relative position relation between the described viewing area 400 of computing and the entity article 420, and viewing area 400 for example is user's eyes.For instance, tracing module 320 is configurable not to affect the position that the user watches display frame in entertainment display system 300, the corner of entertainment display system 300 for example, at least one groove of upper bottom surface or side, in order to comprise at least one sensing unit (such as phtographic lens, the infrared ray follow-up mechanism) respectively toward the direction pick-up image picture of viewing area 400 and entity article 420, with (as going background by image processing, object is distinguished and is looked etc.) learn the position coordinate of viewing area 400 and entity article 420, and then calculate the relative position relation between viewing area 400 and the entity article 420.Computing module 340 produces tridimensional virtual object 366 (shown in Fig. 4 B) according to relative position relation, and the relevant tridimensional virtual object 366 that produces is specified in subsequent paragraph.
Stereo display module 360 is arranged between entity article 420 and the viewing area 400, and stereo display module 360 comprises transparent display 362 and light-shielding structure 364, and the transparent display 362 in the stereo display module 360 is in order to show tridimensional virtual object 366.
Alleged tridimensional virtual object 366 is in order to the vision imaging of the entity article 420 of arranging in pairs or groups herein, and the transparent display 362 that sees through on the stereo display module 360 is shown.In the practical application, tridimensional virtual object 366 can be the additional game information of collocation entity article 420 in the game image, or animation effect etc.For conveniently illustrating, entity article 420 is a spheroid in this embodiment, and tridimensional virtual object 366 is for visually being positioned at the Cubic object of spheroid (entity article 420) below, but the present invention is not limited with above-mentioned 3D shape of giving an example.
It is noted that, shape, outward appearance and the display order of the tridimensional virtual object 366 among the present invention according to the observation the zone 400 and entity article 420 between the relative position relation dynamic change.That is to say, the displaying contents of tridimensional virtual object 366 (shape, outward appearance and display order) changes according to user's viewing area 400 positions or the movement of entity article 420 and changing to some extent, reaches by this interaction effect.Following paragraph further specifies the generation mechanism of interaction effect.
See also Fig. 4 C, Fig. 4 D, Fig. 4 E, Fig. 4 F, Fig. 4 G and Fig. 4 H, the schematic diagram of the relative position relation of viewing area 400 and entity article 420 during Fig. 4 C, Fig. 4 E and Fig. 4 G illustrate respectively according to other embodiments of the invention.Fig. 4 D illustrates the schematic diagram of the tridimensional virtual object 366 that shows on the entity article 420 and stereo display module 360 under the relative position relation of Fig. 4 C.Fig. 4 F illustrates the schematic diagram of the tridimensional virtual object 366 that shows on the entity article 420 and stereo display module 360 under the relative position relation of Fig. 4 E.Fig. 4 H illustrates the schematic diagram of the tridimensional virtual object 366 that shows on the entity article 420 and stereo display module 360 under the relative position relation of Fig. 4 G.
Shown in Fig. 4 A to Fig. 4 H, the display plane of transparent display 362 has transverse axis Ax (along continuous straight runs extension) and longitudinal axis Ay (vertically extending), and in addition, viewing area 400 forms vertical normal Az with the projection join line of display plane.
Among the present invention, viewing area 400 and relative position relation between the entity article 420 comprise viewing area and the line of entity article and compare vertical normal Az toward the first relative angle θ a (shown in Fig. 4 A) of transverse axis Ax deflection, toward the second relative angle θ b (shown in Fig. 4 C) and the viewing area 400 and the relative level distance D s (shown in Fig. 4 E) on vertical normal Az between the entity article 420 of longitudinal axis Ay deflection.
Computing module 340 is according to the perspective view effect of the first relative angle θ a and this second relative angle θ b corrected object prototype, the object prototype is take a Cubic object as example in this embodiment, and revise the stereo object size of this object prototype (Cubic object) according to relative level distance D s, and then produce tridimensional virtual object 366 (such as the tridimensional virtual objects 366 among Fig. 4 B, Fig. 4 D, Fig. 4 F and Fig. 4 H).
Fig. 4 A and Fig. 4 B are in order to explanation, and viewing area 400 closes with the relative position of entity article 420 compares vertical normal Az along to the left deflection of transverse axis Ax for entity article 420 with the line of viewing area 400.Therefore, computing module 340 is according to the perspective view effect of the first relative angle θ a corrected object prototype, produce the tridimensional virtual object 366 among Fig. 4 B, because the deflection of the first relative angle θ a, the tridimensional virtual object 366 that the user is seen by viewing area 400 in this example visual angle of turning left in the right side of serving as reasons, to make user in the example of Fig. 4 B see the larger zone of tridimensional virtual object 366 right half side surfaces, and a rarely seen left side half side surface than the zonule.
The example of Fig. 4 C and Fig. 4 D is in order to explanation, and viewing area 400 is that entity article 420 is compared vertical normal Az along upward deflection of longitudinal axis Ay with the line of viewing area 400 with the relative position relation of entity article 420.Therefore, computing module 340 is according to the perspective view effect of the second relative angle θ b corrected object prototype, produce the tridimensional virtual object 366 among Fig. 4 D, because the deflection of the second relative angle θ b, the tridimensional virtual object 366 that the user is seen by viewing area 400 in this example visual angle up of serving as reasons down will stretch the tridimensional virtual object 366 in the example of Fig. 4 D upward.
The example of Fig. 4 E and Fig. 4 F is in order to illustrate viewing area 400 and entity article 420 relative level distance D s between the two.Computing module 340 is revised the stereo object size of this object prototype (Cubic object) according to relative level distance D s, produce the tridimensional virtual object 366 among Fig. 4 F, when relative level distance D s is healed when far away, user in the example of Fig. 4 F sees that the object of tridimensional virtual object 366 is less, otherwise heal when near as relative level distance D s, 366 of the tridimensional virtual objects that the user sees are corresponding larger.
Among above-mentioned Fig. 4 A to Fig. 4 F, only illustrate the first relative angle θ a, the second relative angle θ b or relative level distance D s one of them when changing, the corrected object prototype also produces the schematic diagram of tridimensional virtual object 366.In the practical application, relative position relation between viewing area 400 and the entity article 420 comprises the first relative angle θ a, both may change simultaneously at least in three factors such as the second relative angle θ b and relative level distance D s, computing module 340 must calculate respectively its variable quantity to produce corresponding tridimensional virtual object 366, comprise the direction that virtual article 366 presents, angle and coordinate position etc. all can be revised, ask for an interview the example of Fig. 4 G and Fig. 4 H, in the example of Fig. 4 G, entity article 420 is positioned at partially upper left distant place, and computing module 340 is considered the first relative angle θ a simultaneously, the second relative angle θ b and relative level distance D s produce corresponding tridimensional virtual object 366 then for the visual angle observed toward the upper left side by the lower right and have less object size.Above Fig. 4 A to Fig. 4 G is way of example explanation this case viewing area 400 and the relative position relation of entity article 420, but in the practical application relative position relation have various possibilities can be by that analogy, and state each example not only and be limited.
In the above-mentioned example, the actual displayed position of tridimensional virtual object 366 is all on the display plane of transparent display 362, changed visual angle far and near with size up and down of tridimensional virtual object 366 according to relative position relation by computing module 340, tridimensional virtual object 366 is visually cooperated with entity article 420, and then reach interaction effect, when the position of entity article 420 changed, the shape size that tridimensional virtual object 366 presents just can change thereupon.
In addition, entertainment display system 300 can further comprise driver module 380, driver module 380 is coupled between computing module 340 and the stereo display module 360, and driver module 380 mainly drives the image effect of each display unit generation stereoscopic vision on the stereo display module 360 in order to the tridimensional virtual object 366 that calculates according to computing module 340.In the example that Fig. 4 A to Fig. 4 G illustrates, shape with single viewpoint illustrative tridimensional virtual object 366, but because user's eyes have certain parallax, corresponding user's left eye and right eye provide respectively two group images with parallax respectively when showing tridimensional virtual object 366 on the stereo display module 360 in the practical application.
See also Fig. 5 A, Fig. 5 B and Fig. 5 C, it is in order to illustrate according among the wherein embodiment of the present invention three-dimensional virtual article being carried out the schematic diagram that two group images of corresponding user's left eye and right eye were calculated and produced to binocular parallax.In Fig. 5 A, illustrated in this embodiment the user in viewing area 400 two respectively the position in different positions, the angle of its observation entity article 420 and tridimensional virtual object 366 is difference (being so-called binocular parallax) to some extent, therefore, after computing module 340 produces the coordinate position of tridimensional virtual object 366 according to relative position relation, driver module 380 can be further according to the left-eye images 366L among binocular parallax generation Fig. 5 B and the right-eye image 366R among Fig. 5 C, to be presented on the transparent display 362.Do the signal explanation with larger parallax among Fig. 5 A to Fig. 5 C, the present invention is not as limit, and formed two group images of binocular parallax only have less gap mostly in the practical application.
As for the stereoscopic display mode can utilize that sequential is separated, light polarization is separated or other various stereo display techniques be passed to the user about two, this people by existing skill is known, and does not give unnecessary details in addition at this.In this embodiment, driver module 380 transmits respectively a plurality of image frames to transparent display 362 according to sequential, and these image frames can be distinguished corresponding left-eye images and right-eye image, reach by this three-dimensional image effect, but the present invention is not as limit.
What must further specify is, on the shown picture of stereo display module 360 (shown in Fig. 4 B, Fig. 4 D, Fig. 4 F and Fig. 4 H), may there be the orbution of certain prospect background in tridimensional virtual object 366 and entity article 420, when tridimensional virtual object 366 and entity article 420 both overlapping parts, must be according to both first back depth of field order, make the one near viewing area 400 can hide another one, can form stereoscopic depth effect true to nature.
Therefore, be provided with light-shielding structure 364 in the stereo display module 360 of this entertainment display system 300.Light-shielding structure 364 and transparent display 362 adjacent settings and between transparent display 362 and entity article 420, light-shielding structure 364 switches its shading on off state according to the virtual depth of field order between tridimensional virtual object 366 and the entity article 420.
See also Fig. 6 A to Fig. 6 C, it is illustrated in respectively among the embodiment when tridimensional virtual object 366 and entity article 420 and is the schematic diagram of part when overlapping.Fig. 6 A and Fig. 6 B are illustrated in respectively the shading on off state schematic diagram of the lower light-shielding structure 364 of two sub-picture frames (the first subgraph frame and the second subgraph frame) among this embodiment.Fig. 6 C then illustrates above-mentioned two subgraph frames because of the schematic diagram of the merging image of persistence of vision generation.
In the embodiment of Fig. 6 A to Fig. 6 C, tridimensional virtual object 366 and entity article 420 are part when overlapping to the visual angle of viewing area 400, and entity article 420 is near viewing area 400 (prospect) in virtual depth of field order for both overlapping OLP, and three-dimensional virtual article 366 is away from viewing area 400 (distant view).
In a subgraph frame (such as the first subgraph frame among Fig. 6 A) wherein, light-shielding structure 364 starts shading comprehensively and shows the part (showing that namely tridimensional virtual object 366 deducts overlapping OLP) of these tridimensional virtual object 366 underlapped these entity article 420 at transparent display 362, thus, light-shielding structure 364 has completely cut off from the light of background and image, the part that is only shown these tridimensional virtual object 366 underlapped these entity article 420 by transparent display 362, get rid of tridimensional virtual object 366 at overlapping OLP, reach 366 effects at distant view of tridimensional virtual object.In this embodiment, the light transmittance that transparent display 362 can be the display floaters such as active illuminating display unit is in fact greater than 80% display unit, or transparent display 362 comprises side direction type backlight (not shown), therefore, transparent display 362 can be in the situation that must not show tridimensional virtual object 366 by background light source, and light-shielding structure 364 can such as be the display floater light transmittances such as active illuminating display unit that can partly activate in fact greater than 80% display unit, and light-shielding structure 364 utilize the part actuation function on display floater partial display lightproof part printing opacity so that the light of entity article 420 can see through this light-shielding structure 364.
In another subgraph frame (such as the second subgraph frame among Fig. 6 B), this light-shielding structure 364 does not start shading and transparent display 362 switches to pellucidity, allow the user can observe directly entity article 420, therefore got rid of tridimensional virtual object 366 and entity article 420 covered thereon at overlapping OLP, reach 366 of tridimensional virtual objects at distant view and entity article 420 in the effect of prospect.By this, the merging image effect that produces because of the persistence of vision of two subgraph frames is shown in Fig. 6 C.
See also Fig. 7 A to Fig. 7 C, it is illustrated in respectively among another embodiment when tridimensional virtual object 366 and entity article 420 and is the schematic diagram of part when overlapping.Fig. 7 A and Fig. 7 B are illustrated in respectively the shading on off state schematic diagram of the lower light-shielding structure 364 of two sub-picture frames (the first subgraph frame and the second subgraph frame) among this embodiment.Fig. 7 C then illustrates above-mentioned two subgraph frames because of the schematic diagram of the merging image of persistence of vision generation.
In the embodiment of Fig. 7 A to Fig. 7 C, tridimensional virtual object 366 and entity article 420 are part when overlapping to the visual angle of viewing area 400, and for both overlapping OLP in virtual depth of field order neutral body virtual article 366 near viewing area 400 (prospect), and entity article 420 is away from viewing area 400 (distant view).
In a subgraph frame (such as the first subgraph frame among Fig. 7 A) wherein, light-shielding structure 364 starts shading comprehensively and shows tridimensional virtual object 366 at transparent display 362, thus, light-shielding structure 364 has completely cut off from the light of background and image, only show this tridimensional virtual object 366 by transparent display 362, can show tridimensional virtual object 366 and get rid of entity article 420 at overlapping OLP, reach 366 effects in prospect of tridimensional virtual object.In this embodiment, transparent display 362 can be the active illuminating display unit, or transparent display 362 comprises side direction type backlight (not shown), and therefore, transparent display 362 can be in the situation that must not show tridimensional virtual object 366 by background light source.
In another subgraph frame (such as the second subgraph frame among Fig. 7 B), light-shielding structure 364 only partly starts shading and transparent display 362 switches to pellucidity in the overlapping OLP of tridimensional virtual object 366 and entity article 420, allows the user can observe directly entity article 420.By this, the merging image effect that produces because of the persistence of vision of two subgraph frames is shown in Fig. 7 C.
In addition, in the embodiment of Fig. 7 A to Fig. 7 C, because of when the first subgraph frame, light-shielding structure 364 starts shading comprehensively, and when the second subgraph frame, tridimensional virtual object 366 also carries out shading with the overlapping OLP of entity article 420, and possibility is so that the display brightness of overlapping OLP is low especially, and is inharmonious with tridimensional virtual object 366 other underlapped parts.Therefore, the entertainment display system among the present invention 300 can be further carries out luminance compensation to the overlapping OLP of three-dimensional virtual article 366 and entity article 420.
For example, adjust transparent display 362 brightness to carry out the luminance compensation of overlapping OLP for subgraph frame out of the ordinary.See also Fig. 8 A and Fig. 8 B, it illustrates according to a kind of luminance compensation mechanism in one embodiment of the invention.Shown in Fig. 8 A, in the opening time of the first subgraph frame, light-shielding structure 364 starts shading comprehensively and shows tridimensional virtual object 366 at transparent display 362.Wherein, tridimensional virtual object 366 is 100% display brightness with underlapped place's setting transparent display 362 of entity article 420, and overlapping OLP setting transparent display 362 is 50% display brightness.Shown in Fig. 8 B, in the second subgraph frame, overlapping OLP does not carry out shading, and transparent display 362 is set in overlapping OLP continues to show tridimensional virtual object 366 with 50% display brightness overlapped part.Thus, show respectively the overlapped part of tridimensional virtual objects 366 at transparent display 362 with impartial brightness (50% display brightness) in the first subgraph frame and the second subgraph frame, by this to the luminance compensation of overlapping OLP.Thus, the first subgraph frame starts shading, and the second subgraph frame does not start shading.And, the underlapped time that is in the first subgraph frame of tridimensional virtual object 366 has 100% display brightness, the overlapping OLP of tridimensional virtual object 366 has 50% display brightness in the time of an image frame (i.e. the first subgraph frame and the second subgraph frame), finish by this luminance compensation, can avoid the phenomenon of brightness disproportionation.In addition, more can comprise between each image frame between a clear area, transparent display 362 shows black picture between the clear area, and in order to avoid the interference between the picture frame, right the present embodiment is not limited to.
See also Fig. 9 A and Fig. 9 B, it illustrates according to the another kind of luminance compensation mechanism in one embodiment of the invention.Shown in Fig. 9 A, in the first subgraph frame, light-shielding structure 364 starts shading comprehensively and shows tridimensional virtual object 366 at transparent display 362.Wherein, tridimensional virtual object 366 is 100% display brightness with underlapped place's setting transparent display 362 of entity article 420, and overlapping OLP setting transparent display 362 is 200% display brightness.Shown in Fig. 9 B, in the second subgraph frame, overlapping OLP carries out shading.That is to say, in the first subgraph frame, start the comprehensive shading of this light-shielding structure, and show the overlapped part of tridimensional virtual object 362 at transparent display 362 with highlight (such as 200% display brightness).By this, also luminance compensation can be finished, the phenomenon of brightness disproportionation can be avoided.
On the other hand, see also Figure 10, a kind of method flow diagram of interactive stereo display method during it illustrates according to another embodiment of the present invention.Interactive stereo display method correspondent entity object produces interactive display effect to viewing area, between this entity article and this viewing area, be provided with a transparent display and a light-shielding structure, above-mentioned object and structure can with reference to previous embodiment and graphic explanation, not given unnecessary details at this in addition.
As shown in figure 10, interactive stereoscopic display mode is execution in step S100 at first, follows the trail of the coordinate position of this viewing area and this entity article and produces viewing area and this entity article relative position relation.This relative position relation comprises take viewing area as datum mark, with respect to the entity article of viewing area in one first folded relative angle of first direction axle, in perpendicular to folded one second relative angle of the second direction axle of first direction axle and with respect to the relative level distance of the entity article of viewing area (can with reference to shown in Fig. 4 A to Fig. 4 F).
Then, execution in step S102 produces at least one tridimensional virtual object according to relative position relation.Wherein, produce the step S102 of at least one tridimensional virtual object can be further according to the perspective view effect of this first relative angle and this second relative angle correction one object prototype, stereo object size according to this this object prototype of relative level distance correction, and, according to the correction result of this object prototype, produce this tridimensional virtual object (can with reference to shown in Fig. 4 A to Fig. 4 F).
Then, execution in step S104 shows that the tridimensional virtual object is in transparent display.In this step, can produce respectively a plurality of image frames to transparent display according to sequential, these image frames are corresponding left-eye images and right-eye image respectively, forms by this its stereoscopic visual effect of tridimensional virtual object.
And execution in step S106 switches the shading on off state (can with reference to shown in Fig. 6 A to Fig. 6 C and Fig. 7 A to Fig. 7 C) of light-shielding structure according to the virtual depth of field order between tridimensional virtual object and the entity article.
In addition, after step S102 finished and produce the tridimensional virtual object, interactive stereoscopic display mode is execution in step S103 further, three-dimensional virtual article is carried out binocular parallax calculate, and produced respectively the image (shown in Fig. 5 A to Fig. 5 C) of corresponding right and left eyes.
Each shown image frame comprises two sub-picture frames at least on the transparent display, if this virtual depth of field order is this entity article during near this viewing area, in a subgraph frame wherein, start the comprehensive shading of this light-shielding structure, and show the part of underlapped this entity article of this tridimensional virtual object at this transparent display.In another subgraph frame, close this light-shielding structure, and this transparent display is switched to pellucidity (can with reference to Fig. 6 A to Fig. 6 C).
If this virtual depth of field order is this tridimensional virtual object during near this viewing area, in a subgraph frame wherein, starts the comprehensive shading of this light-shielding structure, and show this tridimensional virtual object at this transparent display.In another subgraph frame, start this light-shielding structure in the shading of the overlapping of this tridimensional virtual object and this entity article part, and switch this transparent display to pellucidity (can with reference to Fig. 7 A to Fig. 7 C).
So that the display brightness of overlapping is on the low side, inharmonious with other underlapped parts for avoiding.Therefore, interactive stereo display method among the present invention can be further carries out luminance compensation to the overlapping of three-dimensional virtual article and entity article, for example, overlapping for this tridimensional virtual object and this entity article, the overlapped part (can with reference to Fig. 8 A to Fig. 8 B and aforementioned corresponding embodiment) that shows respectively this tridimensional virtual object in the first subgraph frame and the second subgraph frame with an impartial brightness at this transparent display, or, in the first subgraph frame, start the comprehensive shading of this light-shielding structure, and at this transparent display with the overlapped part that shows this tridimensional virtual object (can with reference to Fig. 9 A to Fig. 9 B and aforementioned corresponding embodiment) that highlights, the details of luminance compensation has seen previous embodiment and has not given unnecessary details in addition at this.
In sum, the present invention proposes a kind of entertainment display system and interactive stereo display method, wherein having comprised transparent display in the entertainment display system is arranged between entity article and the viewing area, relative position relation between tracking entity article and the viewing area produces the tridimensional virtual object and is shown on the transparent display, by this, can avoid the user position to change the contraposition misalignment problem that causes.In addition, other is provided with light-shielding structure and transparent display is adjacent, light-shielding structure selectively switch its shading on off state by this depth of field orbution between simulating stereo virtual article and the entity article (as the tridimensional virtual object in prospect and entity article at distant view, or entity article in prospect and three-dimensional virtual article at distant view), by this, the virtual location of tridimensional virtual object can be set in before or after the entity article, is not subject to the precedence relationship of actual setting.
Although this disclosure discloses as above with embodiment; so it is not to limit this disclosure; anyly have the knack of this skill person; in the spirit and scope that do not break away from this disclosure; when can being used for a variety of modifications and variations, so the protection domain of this disclosure is as the criterion when looking accompanying the claim person of defining.

Claims (17)

1. an entertainment display system produces interactive display effect to a viewing area in order to the entity article of arranging in pairs or groups, and it is characterized in that, this entertainment display system comprises:
One tracing module is arranged between this entity article and this viewing area, in order to follow the trail of a relative position relation of this viewing area and this entity article;
One computing module calculates the display parameters of at least one tridimensional virtual object according to this relative position relation; And
One stereo display module is arranged between this entity article and this viewing area, and this stereo display module comprises:
One transparent display is in order to show this at least one tridimensional virtual object; And
One light-shielding structure, setting adjacent with this transparent display also is positioned at this transparent display and is somebody's turn to do
Between the entity article, this light-shielding structure is according to the void between this tridimensional virtual object and this entity article
Intend depth of field order and switch its shading on off state.
2. entertainment display system according to claim 1, it is characterized in that, the display plane of this transparent display has a transverse axis and a longitudinal axis, the projection join line of this viewing area and the display plane of this transparent display forms a vertical normal, and this relative position relation comprises this viewing area and the line of this entity article and compares this vertical normal toward one first relative angle of this transverse axis deflection, toward the relative level distance on this vertical normal between one second relative angle of this longitudinal axis deflection and this viewing area and this entity article.
3. entertainment display system according to claim 2, it is characterized in that, this computing module calculates the tridimensional virtual object visual angle of an object prototype according to this first relative angle and this second relative angle, and big or small apart from the tridimensional virtual object that calculates this object prototype according to this relative level.
4. entertainment display system according to claim 1 is characterized in that, more comprises a driver module, and this driver module transmits respectively a plurality of image frames to this transparent display according to sequential, and described image frame is corresponding left-eye images and right-eye image respectively.
5. entertainment display system according to claim 4, it is characterized in that, each shown on this transparent display described image frame comprises two sub-picture frames at least, this light-shielding structure starts shading comprehensively when the first subgraph frame, and this light-shielding structure optionally partly starts shading in the overlapping of this tridimensional virtual object and this entity article according to this virtual depth of field order when the second subgraph frame.
6. entertainment display system according to claim 5, it is characterized in that, when this tridimensional virtual object and this entity article overlapping, and when this entity article is near this viewing area in this virtual depth of field order, in the first subgraph frame, this light-shielding structure starts shading comprehensively and shows the part of underlapped this entity article of this tridimensional virtual object at this transparent display, and in the second subgraph frame, this light-shielding structure does not start shading and this transparent display switches to pellucidity.
7. entertainment display system according to claim 5, it is characterized in that, when this tridimensional virtual object and this entity article overlapping, and when this tridimensional virtual object is near this viewing area in this virtual depth of field order, in the first subgraph frame, this light-shielding structure starts shading comprehensively and shows this tridimensional virtual object at this transparent display, in the second subgraph frame, this light-shielding structure only partly starts shading and this transparent display switches to pellucidity in the overlapping of this tridimensional virtual object and this entity article.
8. entertainment display system according to claim 1 is characterized in that, this transparent display is an active illuminating display unit, or this transparent display comprises a light source.
9. interactive stereo display method, a corresponding entity article produces interactive display effect to a viewing area, be provided with a transparent display and a light-shielding structure between this entity article and this viewing area, it is characterized in that, this interaction stereoscopic display mode comprises:
Follow the trail of a relative position relation of this viewing area and this entity article;
Calculate at least one tridimensional virtual object display parameters according to this relative position relation;
Show that this tridimensional virtual object is in this transparent display; And
Switch the shading on off state of this light-shielding structure according to the virtual depth of field order between this tridimensional virtual object and this entity article.
10. interactive stereo display method according to claim 9, it is characterized in that, the display plane of this transparent display has a transverse axis and a longitudinal axis, this viewing area forms a vertical normal with the projection join line of the display plane of this transparent display, this relative position relation comprises this viewing area and compares this vertical normal toward one first relative angle of this transverse axis deflection with the line of this entity article, toward the relative level distance on this vertical normal between one second relative angle of this longitudinal axis deflection and this viewing area and this entity article, the step of wherein calculating at least one tridimensional virtual object display parameters comprises:
Calculate the perspective view of an object prototype according to this first relative angle and this second relative angle;
Big or small apart from the stereo object that calculates this object prototype according to this relative level; And
According to the result of calculation of this object prototype, obtain this at least one tridimensional virtual object.
11. interactive stereo display method according to claim 9 is characterized in that, more comprises:
Produce respectively a plurality of image frames to this transparent display according to sequential, described image frame is corresponding left-eye images and right-eye image respectively.
12. interactive stereo display method according to claim 11, it is characterized in that, each shown image frame comprises two sub-picture frames at least on this transparent display, if this virtual depth of field order is this entity article during near this viewing area, this interaction stereo display method comprises:
In the first subgraph frame, start the comprehensive shading of this light-shielding structure, and show the part of underlapped this entity article of this tridimensional virtual object at this transparent display; And
In the second subgraph frame, close this light-shielding structure, and this transparent display is switched to pellucidity.
13. interactive stereo display method according to claim 11, it is characterized in that, each shown image frame comprises two sub-picture frames at least on this transparent display, if this virtual depth of field order is this tridimensional virtual object during near this viewing area, this interaction stereo display method comprises:
In the first subgraph frame, start the comprehensive shading of this light-shielding structure, and show this tridimensional virtual object at this transparent display; And
In the second subgraph frame, start this light-shielding structure in the overlapping part shading of this tridimensional virtual object and this entity article, and switch this transparent display to pellucidity.
14. according to claim 12 or 13 described interactive stereo display methods, it is characterized in that, overlapping when this tridimensional virtual object and this entity article, the overlapping of this tridimensional virtual object and this entity article is carried out luminance compensation.
15. interactive stereo display method according to claim 14 is characterized in that, further comprises:
For the overlapping of this tridimensional virtual object and this entity article, show respectively the overlapped part of this tridimensional virtual object at this transparent display with an impartial brightness in the first subgraph frame and the second subgraph frame.
16. interactive stereo display method according to claim 14 is characterized in that, further comprises:
In the first subgraph frame, highlighting with one at this transparent display shows the overlapped part of this tridimensional virtual object.
17. interactive stereo display method according to claim 16 is characterized in that, further comprises:
More comprise between a clear area between each described image frame, this transparent display shows a black picture between this clear area.
CN201210387863.XA 2012-08-20 2012-10-12 Entertainment display system and interactive stereoscopic display method thereof Active CN102908783B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TW101130137A TWI458530B (en) 2012-08-20 2012-08-20 Entertainment display system and interactive stereoscopic displaying method of same
TW101130137 2012-08-20

Publications (2)

Publication Number Publication Date
CN102908783A true CN102908783A (en) 2013-02-06
CN102908783B CN102908783B (en) 2015-04-08

Family

ID=47607501

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210387863.XA Active CN102908783B (en) 2012-08-20 2012-10-12 Entertainment display system and interactive stereoscopic display method thereof

Country Status (4)

Country Link
US (1) US9300950B2 (en)
JP (1) JP5555750B2 (en)
CN (1) CN102908783B (en)
TW (1) TWI458530B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105719586A (en) * 2016-03-18 2016-06-29 京东方科技集团股份有限公司 Transparent display method and device
CN113973199A (en) * 2020-07-22 2022-01-25 财团法人工业技术研究院 Light-transmitting display system and image output method and processing device thereof

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016103871A1 (en) * 2014-12-25 2016-06-30 シャープ株式会社 Display device and control method therefor
JP2017191378A (en) * 2016-04-11 2017-10-19 富士通テン株式会社 Augmented reality information display device and augmented reality information display method
JP2020017773A (en) * 2016-10-31 2020-01-30 株式会社エイビック Display device
US10146300B2 (en) 2017-01-25 2018-12-04 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Emitting a visual indicator from the position of an object in a simulated reality emulation
TWI767232B (en) * 2020-05-20 2022-06-11 財團法人工業技術研究院 Transparent display system, parallax correction method and image outputting method

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101414425A (en) * 2007-10-16 2009-04-22 宋学锋 Display device and display method
CN101518096A (en) * 2006-09-20 2009-08-26 苹果公司 Three-dimensional display system
JP2010015075A (en) * 2008-07-07 2010-01-21 Seiko Epson Corp Display device
US20100164910A1 (en) * 2005-08-05 2010-07-01 Pioneer Corporation Image display apparatus

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5574836A (en) * 1996-01-22 1996-11-12 Broemmelsiek; Raymond M. Interactive display apparatus and method with viewer position compensation
TW476001B (en) * 2000-09-29 2002-02-11 Artificial Parallax Electronic 3D image display device
JP2005141102A (en) * 2003-11-07 2005-06-02 Pioneer Electronic Corp Stereoscopic two-dimensional image display device and its method
JP4707368B2 (en) * 2004-06-25 2011-06-22 雅貴 ▲吉▼良 Stereoscopic image creation method and apparatus
US8786675B2 (en) * 2008-01-23 2014-07-22 Michael F. Deering Systems using eye mounted displays
US20110084983A1 (en) * 2009-09-29 2011-04-14 Wavelength & Resonance LLC Systems and Methods for Interaction With a Virtual Environment
CN102483530B (en) * 2009-10-09 2015-02-11 夏普株式会社 Display panel, display system, portable terminal and electronic device
TW201205174A (en) 2010-07-22 2012-02-01 J Touch Corp An electrochromic unit and display device using the unit
TWM399335U (en) 2010-09-02 2011-03-01 Innovision Flextech Corp Changes with multiple visual effect of grating device
CN101986243B (en) 2010-11-05 2012-07-11 友达光电股份有限公司 Stereoscopic image interactive system and position offset compensation method
WO2012088285A2 (en) * 2010-12-22 2012-06-28 Infinite Z, Inc. Three-dimensional tracking of a user control device in a volume
JP2012141502A (en) * 2011-01-05 2012-07-26 Nippon Seiki Co Ltd Viewpoint position detecting device, method for detecting viewpoint position, and stereographic display device
TWM409872U (en) 2011-02-25 2011-08-21 Laio Li Shi Care interacting instrument
US8847988B2 (en) * 2011-09-30 2014-09-30 Microsoft Corporation Exercising applications for personal audio/visual system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100164910A1 (en) * 2005-08-05 2010-07-01 Pioneer Corporation Image display apparatus
CN101518096A (en) * 2006-09-20 2009-08-26 苹果公司 Three-dimensional display system
CN101414425A (en) * 2007-10-16 2009-04-22 宋学锋 Display device and display method
JP2010015075A (en) * 2008-07-07 2010-01-21 Seiko Epson Corp Display device

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105719586A (en) * 2016-03-18 2016-06-29 京东方科技集团股份有限公司 Transparent display method and device
WO2017156949A1 (en) * 2016-03-18 2017-09-21 京东方科技集团股份有限公司 Transparent display method and transparent display apparatus
CN113973199A (en) * 2020-07-22 2022-01-25 财团法人工业技术研究院 Light-transmitting display system and image output method and processing device thereof
CN113973199B (en) * 2020-07-22 2024-03-26 财团法人工业技术研究院 Light-permeable display system and image output method and processing device thereof

Also Published As

Publication number Publication date
US9300950B2 (en) 2016-03-29
TW201408352A (en) 2014-03-01
TWI458530B (en) 2014-11-01
US20140049620A1 (en) 2014-02-20
CN102908783B (en) 2015-04-08
JP2014039234A (en) 2014-02-27
JP5555750B2 (en) 2014-07-23

Similar Documents

Publication Publication Date Title
CN102908783B (en) Entertainment display system and interactive stereoscopic display method thereof
CN103595987B (en) Stereoscopic display device, image processing apparatus and image processing method
US10672311B2 (en) Head tracking based depth fusion
US20140306954A1 (en) Image display apparatus and method for displaying image
US10366642B2 (en) Interactive multiplane display system with transparent transmissive layers
US9106906B2 (en) Image generation system, image generation method, and information storage medium
US9754379B2 (en) Method and system for determining parameters of an off-axis virtual camera
CN107810463A (en) Mixed display system
AU2018249563B2 (en) System, method and software for producing virtual three dimensional images that appear to project forward of or above an electronic display
WO2002003124A1 (en) Multiple sharing type display device
TW201126203A (en) Stereoscopic display device
CN107728244A (en) A kind of slit grating preparation method for bore hole 3D printings
JP2010259017A (en) Display device, display method and display program
KR20130070304A (en) Autostereoscopic display apparatus and method thereof
CN108983963B (en) Vehicle virtual reality system model establishing method and system
JP2014150402A (en) Display apparatus and program
CN102970498A (en) Display method and display device for three-dimensional menu display
CN110750000A (en) Three-dimensional display screen
CN202258161U (en) Three-dimensional (3D) light emitting diode (LED) advertisement device
KR100538471B1 (en) System and method for marking stereoscopy using selective re-rendering and extrapolation
CN102981283B (en) Active polarized light three-dimensional display device
NZ757902B2 (en) System, method and software for producing virtual three dimensional images that appear to project forward of or above an electronic display
KR20120139875A (en) A system for an interactive advertising
JP2018186319A (en) Stereoscopic image display control device, stereoscopic image display control method and stereoscopic image display control program
Chen et al. A View-Dependent Stereoscopic System Using Tiled Projection

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant