CN1926497A

CN1926497A - Interactive video display system

Info

Publication number: CN1926497A
Application number: CNA2004800345514A
Authority: CN
Inventors: 马修·贝尔; 菲利普·格莱克曼; 乔舒亚·齐德; 海伦·肖内西
Original assignee: Reactrix Systems Inc
Current assignee: Reactrix Systems Inc
Priority date: 2003-12-09
Filing date: 2004-12-09
Publication date: 2007-03-07
Also published as: CN1918532A

Abstract

A self-contained interactive video display system. A flat-panel display screen displays a visual image for presentation to a user on a front side of the flat-panel display screen. A first illuminator illuminates the flat-panel display screen with viisible light. A second illuminator illuminates an object. A camera detects interaction of an illuminated object with the visual image, wherein the camera is operable to view the object through the flat-panel display screen. A computer system directs the projector to change the visual image in response to the interaction.

Description

Interactive video display system

Cross reference with related application

The application is the patented claim of part continuity, it requires the common unsettled U.S. Patent application No.10/160 in " the INTERACTIVE VIDEO DISPLAY SYSTEM " by name of submission on May 28th, 2002 by Bell, 217 right of priority, wherein this application is transferred to the application's assignee, and this application is incorporated into this with as a reference.The application also requires the common unsettled U.S. Provisional Patent Application No.60/504 in " the SELF-CONTAINEDINTERACTIVE VIDEO DISPLAY SYSTEM " by name of submission on September 18th, 2003 by Bell, 375 right of priority, wherein this application is transferred to the application's assignee; The common unsettled U.S. Provisional Patent Application No.60/514 that is called " METHODANDSYSTEM FOR PROCESSING CAPTURED IMAGE INFORMATIONIN AN INTERACTIVE VIDEO SYSTEM " that requirement is submitted on October 24th, 2003 by Bell, 024 right of priority, wherein this application is transferred to the application's assignee; The common unsettled U.S. Provisional Patent Application No.60/528 that is called " SELF-CONTAINEDINTERACTIVE VIDEO DISPLAY SYSTEM AND FEATURESRELATING THERETO " that requirement is submitted on Dec 9th, 2003 by Bell, 439 right of priority, wherein this application is transferred to the application's assignee; And the common unsettled U.S. Provisional Patent Application No.60/554 that requires to equal " the METHOD AND SYSTEMFOR ALLOWING A CAMERA TO VIEW AN AREA IN FRONT OF ADISPLAY BY IMAGING IT THROUGH THE DISPLAY " by name of submission on March 18th, 2004 by Bell, 520 right of priority, wherein this application is transferred to the application's assignee, and above-mentioned all these applications are incorporated into this with as a reference.

Technical field

The present invention relates to visible electronic and show the field.Especially, embodiment described herein relates to a kind of interactive video display system.

Background technology

For many years, use static the demonstration that information is passed to spectators usually.For example, product advertising presents by print advertisements and placard.Along with the appearance of TV and film, can utilize dynamic demonstration (for example, television advertising) to come presentation information.Though with static state show compare more attractive, dynamically demonstration the user can not be provided usually and show between alternately.

Recently, use interactive touch-screen presentation information on planar surface.For example, image can show on touch-screen that the user can be mutual with image by touching touch-screen, makes image modification.But, for touch-screen on the image that shows mutual, the user must really contact with touch-screen.In addition, typical touch-screen once can only receive an input, and can not distinguish the shape of input.In fact, existing touch-screen can only receive a finger contact as input.

In some applications, for example point of sale, retail advertising, sales promotion, amusement website etc., expectation provides interactive interface with to user's display message.This more attracting interface that is used for presentation information (for example medium, advertisement etc.) that provides alternately.By obtaining people's attention, even a moment, the user may note more showing the information that presents with interactive mode than original demonstration.

As mentioned above, existing interactive the demonstration needs user's body contact touch screen surface usually.Provide mutual owing to contacting with touch-screen, thus a large amount of potential users interactively show or lose interest in for existing, perhaps be forced to use.In addition, owing to can only have a user and touch-screen to carry out alternately at every turn, more user is left out.In addition, because existing touch-screen can not be distinguished the shape of input, they are limited in response to the type of the information that presents alternately.

Summary of the invention

At this present invention is described, i.e. interactive video display system, various embodiment.Panel display screen is to user's display of visually image in its place ahead.In one embodiment, panel display screen is LCD (LCD) panel.First luminaire uses the illuminated with visible light panel display screen.In one embodiment, interactive video display system also comprises the diffusing screen that is used to reduce the dazzle of first luminaire and illuminates panel display screen more equably.Second luminaire illuminates object.In one embodiment, to liking user's body part.In one embodiment, second luminaire projects illumination on the object by panel display screen.In one embodiment, place second luminaire to reduce potential dazzle influence to camera.In one embodiment, second luminaire is positioned at the panel display screen next door so that second luminaire does not pass through the panel display screen projection illumination.In one embodiment, interactive video display system comprises a plurality of second luminaires, and wherein said second luminaire is positioned at panel display screen next door and screen back.In one embodiment, second luminaire when camera exposure by gating.

Camera detects mutual between the object be illuminated and visual image, and wherein camera is used for watching object by panel display screen.In one embodiment, second luminaire is to utilize infrared illumination to illuminate the infrared illuminator of object, and wherein camera is the infrared camera that is used to detect infrared illumination.In one embodiment, camera is positioned at the back of panel display screen and points to screen, makes camera can watch on the screen and the zone in screen the place ahead.In one embodiment, the image of camera is calibrated to visual image, so that conforming to physical location with the nearest object of screen alternately of causing of object.In one embodiment, the camera and second luminaire comprise transit time camera (time-of-flight camera).In one embodiment, a plurality of transit time cameras are placed so that the covering fully to the zone before the described display to be provided, and by angled placement to prevent arriving described transit time camera owing to described screen causes direct reflection.

Computer system instructs projector in response to changing visual image alternately.In one embodiment, camera, first luminaire, second luminaire and computer system are included in the shell, and wherein a side of shell comprises panel display screen.

In one embodiment, interactive video display system also comprises a series of mirror bars, and itself and screen have a segment distance to place to proofread and correct the observation distortion of camera.In another embodiment, interactive video display system also comprises Fresnel lens, and its adjacent screen is placed to proofread and correct the observation distortion of camera.In one embodiment, interactive video display system also comprises the diffusing globe based on wavelength that contiguous panel display screen is placed.In one embodiment, diffusing globe is for the infrared light substantially transparent, and is translucent substantially for visible light.In another embodiment, diffusing globe is the material with Rayleigh scattering.In one embodiment, interactive video display system also comprises the diffusing globe with physical texture that contiguous panel display screen is placed, wherein diffusing globe is for translucent substantially by the light of diffusing globe with the oblique angle, and to pass through the light substantially transparent of diffusing globe with basic vertical angle, wherein first luminaire becomes an oblique angle to place with diffusing globe.

In one embodiment, interactive video display system also comprises the scattering polarizer, and its contiguous panel display screen is placed and is used for the light of scattering from first luminaire, and wherein camera is to the scattering polarizer photaesthesia of the polarization of scattering not.In one embodiment, flat-panel monitor is a display panels, the directional scattering polarizer is so that the light that is polarized along scattering polarizer scattering direction of light passes through display panels, and the light that is polarized along not scattering of scattering polarizer direction of light is absorbed by display panels.In another embodiment, interactive video display system also comprises linear polarizer, is used for that polaroid camera receives and its wavelength is the light of camera sensitivity, so that camera is ignored the light of scattering polarizer scattering.In one embodiment, interactive video display system also comprises diffuse material, it can be from the translucent substantially substantially transparent that changes to, substantially it is translucent when first luminaire illuminates display, substantially transparent during object before camera detects panel display screen, wherein diffuse material is placed on the panel display screen back.

In one embodiment, interactive video display system is used for determining the information about the distance of object and screen.In one embodiment, camera is a stereo camera.In another embodiment, camera is the transit time camera.In one embodiment, place the transit time camera so that transit time camera reflected back oneself not.

In one embodiment, interactive video display system provides touch screen function when the object touch screen.In one embodiment, interactive video display system also comprises the transparent touch-sensitive panel of adjacent screen front.In another embodiment, interactive video display system also comprises the slide of the edge-lit of adjacent screen front, and wherein camera can be used to distinguish the light of generation when object contacts with the slide of edge-lit.

In another embodiment, the invention provides a kind of method of using interactive video display system to present interactive visual image.Visual image is presented on the panel display screen, to present to the user of panel display screen front.The back side of panel display screen is by illuminated with visible light.The object nearest from the panel display screen front illuminated by second light source.Mutual between Equipment Inspection object by its existence of perception and visual image via panel display screen.Visual image is in response to changing alternately.

Description of drawings

Accompanying drawing combined and that constitute this instructions part shows specific embodiments of the invention, and in conjunction with describing to be used to illustrate principle of the present invention.

Fig. 1 shows a kind of physical configuration of the parts of interactive video according to an embodiment of the invention system;

Fig. 2 shows a kind of arrangement that use linear polarizer sheet according to an embodiment of the invention is used to eliminate or reduce the screen of dazzle;

Fig. 3 shows the cross section according to several other configurations of the interactive video system of various embodiments of the invention;

Fig. 4 A and 4B are the synoptic diagram that the interactive video system embodiment is described respectively according to embodiments of the invention;

Fig. 5 A and 5B are the synoptic diagram that the interactive video system embodiment is described respectively according to embodiments of the invention;

Fig. 6 A and 6B illustrate two synoptic diagram from the configuration of axial projection respectively according to embodiments of the invention;

Fig. 7 A and 7B are the synoptic diagram that interactive flat panel display systems is described according to embodiments of the invention;

Fig. 8 A shows according to embodiments of the invention to use the synoptic diagram of Fresnel lens with the technology of minimizing image fault;

Fig. 8 B shows according to embodiments of the invention to use the synoptic diagram of a series of mirror bars with the technology of minimizing image fault;

Fig. 9 A and 9B are the diagrammatic layout figure that shows the interactive video display system that has scattering polarizer screen according to embodiments of the invention;

Figure 10 A is the xsect that shows the screen that has micro-scattering spine or projection according to embodiments of the invention;

Figure 10 B is the xsect that shows the screen that has micro-scattering depression or groove according to embodiments of the invention;

Figure 11 is the structure that shows the example that is used for edge light according to embodiments of the invention;

Figure 12 A is the xsect that shows flat pannel display according to embodiments of the invention;

Figure 12 B is the xsect that shows flat pannel display according to another embodiment of the present invention;

Figure 13 shows camera and illumination subsystems according to embodiments of the invention;

Figure 14 is the illumination subsystems that shows the camera that uses inclination scattering polarizer according to embodiments of the invention;

Figure 15 shows a camera and the illumination subsystems that is used for the transit time camera according to embodiments of the invention;

Figure 16 shows first structure that is used to catch the 3D data according to embodiments of the invention;

Figure 17 shows second structure that is used to catch the 3D data according to embodiments of the invention;

Figure 18 A shows two additional structures that are used to catch the 3D data according to embodiments of the invention;

Figure 18 B shows another structure that is used to catch the 3D data according to embodiments of the invention;

Figure 19 A and 19B are the synoptic diagram that shows light scattering according to embodiments of the invention;

Figure 20 A shows high distortion according to embodiments of the invention;

Figure 20 B shows the distortion that reduces by telephoto camera from display screen according to embodiments of the invention;

Figure 21 A shows according to embodiments of the invention to use Fresnel lens to reduce distortion;

Figure 21 B shows according to embodiments of the invention to use Fresnel lens to eliminate distortion;

Figure 21 C shows according to embodiments of the invention to use Fresnel lens to eliminate distortion in two camera arrangements;

Figure 22 shows the synoptic diagram that window shows according to embodiments of the invention;

Figure 23 A, 23B and 23C are the synoptic diagram that shows the various technology that are used to reduce dazzle according to embodiments of the invention respectively;

Figure 24 A and 24B show use according to embodiments of the invention can show that the control film reduces the synoptic diagram of the technology of dazzle;

Figure 25 is the xsect that shows a structure of the window demonstration of using the scattering polarizer according to embodiments of the invention;

Figure 26 is the xsect that shows a structure of the window demonstration of using scattering polarizer and microprism material according to embodiments of the invention;

Figure 27 is the xsect that shows a structure of the window demonstration of using a mirror that is used to compress according to embodiments of the invention;

Figure 28 is the side view that shows the interactive mode demonstration that comprises a plurality of transit time cameras according to embodiments of the invention;

Figure 29 is the top view that shows the mutual demonstration that comprises a plurality of transit time cameras according to embodiments of the invention.

Embodiment

To at length monitor the electronic equipment whether second electronic equipment object on every side exists with reference to various embodiment of the present invention, a kind of being used to now, their example will be illustrated in conjunction with the accompanying drawings.Though the present invention will be described in conjunction with the embodiments, be understandable that the present invention is not limited to these embodiment.On the contrary, the present invention is used for covering replacement, modification and the equivalent that is included in the defined the spirit and scope of the present invention of claims.In addition, in below of the present invention, describing in detail, illustrated a large amount of specific details to provide to comprehensive understanding of the present invention.Yet one of ordinary skill in the art will appreciate that does not have these specific details can realize the present invention yet.In other example, well-known method, process, parts and circuit are not described in detail, in order to avoid unnecessarily fuzzy aspect of the present invention.

The some parts of ensuing detailed description is represented the symbolic representation of the operation of the data bit that can carry out on computer memory with process, step, logical block, processing and other.These descriptions and expression are the employed means of data processing field technician so that most effectively their essence of work is passed to others skilled in the art.It is a kind of step of expected results or self-compatibility sequence of instruction of obtaining that the step that program, computing machine are carried out, logical block, process or the like are envisioned for usually at this.Step needs physical quantity to carry out physical operations.Usually, though not necessary, this tittle adopts the form of electrical or magnetic signal, can be stored, transmits, merges, compare and other operation in computer system.Mainly, proved that it is easily sometimes that these signals are called bit, numerical value, element, symbol, character, term, numeral etc. for the reason of public use.

Yet what need remember is, all these and similarly term do not interrelate with suitable physical entity, and only be the mark easily that is applied to this tittle.Unless especially the statement the picture following discussion shown, be understood that and run through the present invention, use the discussion of for example " projection " or " detection " or " change " or " illumination " or " correction " or terms such as " eliminations " to refer to electronic system (as the interactive video system 100 among Fig. 1) or the similarly action and the processing of electronic computing device, wherein said electronic system is handled and the data that are expressed as physics (electronics) amount in the RS of described electronic equipment is converted to other data, is expressed as the such information stores of described electronic device memory or register or other like these other data class, physical quantity in transmission or the display device.

The present invention is described here, promptly autonomous interactive video display system, various embodiment.In one embodiment, panel display screen shows the user's that will present to the panel display screen front visual image.First luminaire uses the illuminated with visible light panel display screen.Second luminaire illuminates an object.Camera detect the object illuminate and visual image alternately, wherein camera can be used for observing this object by panel display screen.Computer system indication projector is in response to changing visual image alternately.

The interactive video projection system

The present invention of one or more exemplary embodiment forms will be described now.According to an exemplary embodiment, provide interactive video system 100 as shown in fig. 1.Interactive video system 100 uses: installed optical filter that can block visible light camera 115, illuminate the luminaire 125 of the screen 130 that camera 115 observing, with the projector 120 of image projection on the interactive space of screen 130, and with the image of camera 115 as input and to the computing machine 110 of projector 120 output video images.In one embodiment, luminaire 125 is infrared illuminator, and camera 115 is the infrared cameras that can be used for writing down the image that infrared light illuminated of luminaire 125.Camera 115 and luminaire 125 can be configured to use any type of invisible light to operate, and are not limited to infrared light.

Computing machine 110 is handled cameras 115 inputs, has occupied what part of screen 130 front volume to distinguish people's (or moving object) one by one pixel, and what of screen 130 partly is background.Which type of evolution model computing machine 110 looks like by developing several imaginary backgrounds, and comparing of then its background notion and camera 115 just being watched realizes this function.Perhaps, the parts of computing machine 110 processing cameras 115 inputs are known as vision system.The various embodiment of this vision system are described in following patented claim: by the common unsettled U.S. Patent application No.10/160 of Bell in " the INTERACTIVE VIDEODISPLAY SYSTEM " by name of submission on May 28th, 2002,217, wherein this application is transferred to the application's assignee; By the common unsettled U.S. Provisional Patent Application No.60/504 of Bell in " the SELF-CONTAINED INTERACTIVE VIDEO DISPLAYSYSTEM " by name of submission on September 18th, 2003,375, wherein this application is transferred to the application's assignee; And by the common unsettled U.S. Provisional Patent Application No.60/514 of Bell in " the METHOD AND SYSTEM FOR PROCESSING CAPTUREDIMAGE INFORMATION IN AN INTERACTIVE VIDEO SYSTEM " by name of submission on October 24th, 2003,024, wherein this application is transferred to the application's assignee, and it all is incorporated in this for your guidance.

The background of evolution is the pith of vision, because its system that makes is recovered in the change of light, screen scratch and other disturb.The output of vision system is black and white shade image, and it is passed to the effects engine that also operates on the computing machine 110.Produce the application program of interactive graphics on the effects engine operation screen 130.The technician can use a large amount of various types of effect parts and script to come design effect, allows these effects to produce various widely interactive experience.At last, the image of effects engine generation is output to projector 120.

All electronic units of expectation interactive video system 100 (for example camera 115, projector 120, computing machine 110, and luminaire 125) are in a side of screen 130, and user interactions occurs in the opposite side of screen 130.In one embodiment, screen 130 is that part is translucent for the light of projector 120, so that at the image forming surface of screen 130.Yet screen 130 also is a partially transparent for camera 115, so that camera 115 can be seen the object of screen 130 opposite sides.Be preferably in the term of indication in the whole existing instructions transparent with translucent be defined as respectively that refer to partially transparent at least and/or translucent.The term " scattering " and " unscattered " that are preferably in indication in the whole existing instructions equally are defined as finger " basic scattering " and " unscattered substantially " respectively.At last, be preferably in the term " diffusion " of indication in the whole existing instructions and " not diffusion " and be defined as finger " basic diffusion " and " not diffusion substantially " respectively.

Fig. 1 shows the physical arrangement of the parts of an illustrative embodiment of the invention.Comprise camera 115, luminaire 125, computing machine 110, and all perception of projector 120 and display unit are in the inside of box 140.In one embodiment, box 140 all faces except a face all are opaque.This face of non-opacity is the screen 130 that is used to show image projected.

In one embodiment, screen 130 uses smooth, the plate material with strong Rayleigh scattering and few relatively other form scatterings.If light is by screen 130 (translucent screen) scattering, then this light as piece image on screen 130 as seen.If light is not by screen 130 (transparent screen) scattering or absorption, then light image like that directly passes through screen 130 by block length side's glass.

(wavelength ^4) is proportional for Rayleigh scattering and 1/, this means short wavelength's light ratio long wavelength's the severity of light scattering.Therefore, wavelength is the visible light scattering much less of 400nm-700nm than wavelength greater than the infrared light of 800 nanometers (nm).In the present embodiment, projector 120 uses visible lights, and camera 115 uses infrared lights, so that camera 115 can be observed and light that projector 120 sends is dispersed on the screen 130 by screen 130.In one embodiment, the material of screen 130 is the scope down to about the best 40nm of smooth homogeneity, with the Rayleigh scattering that obtains but the scattering of other minimum kinds.

In one embodiment, screen material has the fine scale structure, and it makes most of visible light scattering.Yet, can not be too close or thick; Otherwise most of infrared light is also with scattering.In addition, the visible or infrared light that material can not hyperabsorption; Otherwise, thereby can make that the opaque screen of material is bad.A kind of example that satisfies the material of strong Rayleigh scattering character is common white plastic garbage bag.In one embodiment, screen 130 is made by sandwiching this sack between two sheet glass.The examples of material that another kind satisfies this character is a polythene strip.

Because the wavelength that (use selected suitable screen material and thickness) increased makes the scattered quantum maximization (it has minimized dazzle) of visible light, and make the scattered quantum of infrared light minimize (it has improved the observation of the object of 115 pairs of screen tops of camera), so improve the feasible performance that has improved interactive video system 100 of wavelength of the optical filter of luminaire 125 and camera 115.In one embodiment, use the LED bunch of luminaire of 950nm and before camera lens, have monochromatic charge-coupled device (CCD) (CCD) camera of the wide 950nm of 40nm center bandpass filter.

Can increase several characteristic with its performance of further enhancing to interactive video system 100.

Reduce the dazzle of camera

May exist from luminaire 125 and reflex to dazzle on the camera 115.This dazzle can disturb camera 115 to watch the ability of screen 130 other ends.In one embodiment, in the bottom of screen 130 and/or the top place the near infrared antireflecting coating eliminating this interferences, and the performance of raising camera 115.In addition, luminaire 125 and screen 130 bevel ground can be placed, to prevent direct reflection.

In addition, in another embodiment, (polarization direction of luminaire 125 is perpendicular to the polarization of camera 115) increases infrared linear polarizing filter with further minimizing dazzle before luminaire 125 and camera 115.The generation of dazzle be since directly the frame out light of 130 bottoms of reflection still be polarized, lost its polarization and beat light on the object of screen 130 outsides.

Directed environment infrared ray

The ambient infrared light source can throw into question to the vision system of interactive video system 100.For example, if bright outside infrared radiation source impinges upon on the display from a direction, then any object between this infrared radiation source and screen will throw infrared shade on screen 130.This vision system may be obscured the practical object on this and the screen 130, causes application and trouble.Can use several technology to reduce the problem of infrared shade.

In one embodiment, select the wavelength of luminaire 125 to make it balanced as far as possible.Can before camera 115, increase narrow-band pass filter, the light of the strongest wavelength that this narrow-band pass filter only sends by luminaire 125.

In another embodiment, use the pattern luminaire system that makes to distinguish infrared shade on the screen 130 and real object.Other details, referring to the U.S. Patent application No.10/160 of " the INTERACTIVE VIDEO DISPLAY SYSTEM " by name that submit on May 28th, 2002 by Bell, 217, this application is incorporated into this with as a reference.

In another embodiment, luminaire 125 and camera 115 can be by gatings.Some light sources, light emitting diode (LED) for example, short brightness ratio was opened continuously and was wanted much bright the opening time.If 125 of luminaires are opened between camera 115 exposure periods, and camera exposure is enough short, and then the brightness of luminaire 125 and surround lighting are relatively just very strong.This be because and luminaire 125 open the image that still brightness is lower, obtain in the time shutter of the length of continuous operation continuously and compare, the image of the camera 115 during the short exposure that luminaire 125 is opened very brightly will comprise the surround lighting of much less but most light from luminaire 125.

Camera 115 and luminaire 125 can be by synchronously.For example, it is synchronous that microcontroller or other electronic circuits can read or be provided with the exposure of camera, and in the pulse power of suitable Time Triggered luminaire 125.

By only opening the performance that luminaire 125 can further improve gating during the camera exposure in per second time.Thereby camera 115 can open exposure and luminaire 125 at luminaire 125 and cut out between exposure alternately.Because purpose is to eliminate ambient infrared light, so computing machine 110 can produce the image that does not have surround lighting continuously by the difference that obtains present image and previous image.Because 125 of luminaires are luminous when each second frame, then piece image will have only ambient infrared light, and another image will have the light that ambient infrared light adds luminaire 125.By obtaining the pixel difference of current and previous image, the environment infrared ray can be eliminated, the light of only remaining luminaire 125.

Under the situation of staggered CCD camera, flash illumination device 125 is opened between the exposure period that replaces and will be produced 125 unlatchings of even lines luminaire and camera output image that odd lines luminaire 125 cuts out.Thereby, replacing relatively two width of cloth images, computing machine 110 can obtain the difference between odd lines and the even lines and deduct surround lighting.Two cameras 115 that can use timing are carried out gating so that first and second cameras obtain their exposure in the different slightly time, and 125 of luminaires are opened one of in double exposure.Perhaps, two cameras will be to the fine difference sensitivity of wavelength, and the light of 125 emissions of luminaire, second wavelength.

In another embodiment, in not having the environment of ambient infrared light, only when each second exposure strobe illumination device 125 to reduce the reaction time of system.Any moving when luminaire 125 cuts out between second exposure period can not be noted.Yet this can be improved by the part of only turning off luminaire 125 between each second exposure period or the power that just reduces luminaire 125 simply.So, luminaire 125 replaces between " always opening " and " part is opened ".When computing machine 110 obtains when the difference between prior exposure and the first prior exposure, then the result will not comprise the part light of environment infrared ray and luminaire 125.This configuration will be for providing the most possible reaction time the user who does not have the environment infrared ray and have in some environment infrared rays.

The projector dazzle

Because screen material is not translucent fully, some light from projector 120 will directly pass through screen 130.The result is that projector 120 can cause dazzle to user's eyes.In one embodiment, longer by the wavelength that makes luminaire 125, and use and to cause the more screen 130 of multiple scattering, camera 115 still can be watched by screen 130, and the quantity of visible light dazzle reduces simultaneously.

In another embodiment, can use the linear polarizer sheet to eliminate or the minimizing dazzle.Fig. 2 shows a kind of arrangement, and wherein the linear polarizer sheet is used to eliminate or reduce dazzle.Vertical polaroid 230 and horizontal polaroid 220 directly are placed on the below and the top of screen 210 respectively.When projection light during by vertical polaroid 230, its vertical polarisation that becomes.Because scattering can depolarize light, then a large amount of scattered light on the screen 210 is still visible for the observer.Yet, almost all not absorbed by horizontal polaroid 220 by the light of screen 210 scatterings (it causes dazzle), this is owing to only vertical polarization.Thereby, eliminated dazzle and screen 210 is still bright.Note, if camera, then can be selected the not linear polarisation material of polarized ir light to the infrared light sensitivity

In another embodiment, if projector is LCDs (LCD) projector, then light is polarized.For some LCD projector, red, green, blue all is polarized along identical direction.In this case, under screen, just do not need light polarizing film.In some LCD projector, red, blue light is polarized along a direction, and green glow is to become the direction of an angle of 90 degrees to be polarized with this direction.In this case, in one embodiment, use polaroid and become 45 degree and 135 degree angles to be polarized with red-blue direction.In another embodiment, on projector or inner place the colored polarisation rotor of selecting, to obtain red, green, blue along the equidirectional polarization.In this case, before screen, only need a linear polarizer.The colored polarisation rotor of selecting as retardation plate superimposed " ColorSelect " technology that ColorLink Corporation proposes, is used for polarization with green glow and revolves and turn 90 degrees.Perhaps, red revolving with polarization blue light can be turn 90 degrees, to reach identical effect.

Physique

The physique that has multiple possible interactive video display system.A kind of structure is a tabletop display, as shown in Figure 1.Interactive video display system is positioned on the surface and all electron devices are included in a box, has several feet high and the screen of a level is arranged at the top of box.Yet interactive video display system also can be used for producing oblique, vertical or crooked demonstration.

The part of the physical space that interactive video display system takies is simple dead space---on screen, to obtain sizable image, there is one section suitable distance between projector needs and screen.By using mirror can reduce this segment distance; This allows the light beam of projector to be redirected and is fit to compacter space.In one embodiment, as long as can clearly observe screen, then camera can be installed on the difference place in the box, and can pass through the mirror view screen.In one embodiment, as long as infrared illuminator illuminates the object of box top, then infrared illuminator can be installed in the box Anywhere, even on the surface of box.

Fig. 3 shows the xsect of several other possible structures of system.Because all parts all can be protected simply, so shown design can turn to any direction.The interactive video display of describing in display 310 presentation graphs 1.Display 320 and 330 expressions use mirror to be redirected the compacter interactive video display of projector

light beam.Display

340 and 350 expressions are used angled camera (display 340) and are used mirror to be redirected the angled interactive video display of projector light beam (display 350).The interactive video display of a plurality of mirrors with the light beam of redirected projector used in display 360 expressions.

The additional structure of interactive video display

According to an aspect of the present invention, provide many exemplary being used to illuminate the method for screen forefoot area.In interactive video shows, infrared camera, infrared illuminator, and the visible light projector is all in a side of screen, and the user is at opposite side.For the function of wanting is provided, employed screen material is for visible light normally translucent (but also can be transparent a little), and is transparent (being called " the transparent VIS-translucent screen of IR-" or " main screen " hereinafter) for infrared light preferably usually.The light that infrared illuminator is sent scatters to certain angle during by screen.Camera obtains these light, and these light can to make the image of camera be low contrast and fade.The result is, can stop camera observes to the object that exceeds screen, and this causes Performance Characteristics to reduce.

The present invention solves foregoing problems in many ways.In one embodiment, infrared illuminator can be placed ground as far as possible near screen.For example, luminaire can directly be positioned over the reverse side of screen along the border.This structure is shown in Fig. 4 A.The material in luminaire the place ahead (being called " lid of luminaire 402 " in Fig. 4 A) can comprise any somewhat translucent or material transparent to infrared ray at least.Can comprise main screen material, transparent material clearly for the selection of the material of luminaire 402 lids, or for the transparent black opaque material of infrared ray.The luminaire lid of indication has identical implication in the subsequent figures.Use physical block to be mapped to main screen to prevent infrared light.

Yet above embodiment is for close screen and bad near the object illumination of screen center.This is that for example, the transparency of material is functionally reduced because penetrating light on most of materials with the oblique angle tends to reflection and leave material surface but not pass through.A mode that solves is simply screen to be moved backward from display surface, so just makes infrared illuminator pass through screen with a littler oblique angle.This structure is shown in Fig. 4 B.

In another embodiment, luminaire can be positioned over screen the place ahead according to following mode: make luminaire be easy to illuminate all preceding positions of screen.Fig. 5 A shows a kind of wherein luminaire structure outstanding from screen the place ahead; It is the structure that falls in that Fig. 5 B shows another kind of wherein display surface.In Fig. 4 A, 4B, the described embodiment of 5A, 5B, luminaire can be placed along a continuous line or at the key position place around screen at regular intervals.These illumination strategies shown in Fig. 4 A, 4B, 5A and the 5B also can be positioned at screen after and luminaire by illuminated screen combine.

Off-axis projector

According to another aspect of the present invention, use from axial projection to improve the performance of interactive video display system.Can the rectangle video image be projected on the planar surface with the oblique angle from axle video projector.These off-axis projectors show very important for interactive mode, because they can make the size of total system acutely dwindle and can reduce dazzle.

Fig. 6 A and 6B show two kinds of structures of the interactive video display that uses off-axis projector.The IR-that has off-axis projector when use is transparent, can reduce dazzle during the VIS-translucent screen.Because screen is not translucent fully (is not transparent fully for infrared light) for visible light, so some visible lights will directly pass through screen.If the screen thickening, then more remaining visible light will be scattered, thereby reduce dazzle.Because screen is not fully transparent for infrared ray, then makes the screen thickening make that screen is opaquer for infrared ray yet.Yet if visible light passes through screen with oblique angle rather than vertical angle, light must pass through screen with bigger distance, thereby reduces the dazzle amount.For example, must pass with the screen material of vertical angle by the screen material twice that light was passed of screen from the light of the 30 degree angles parallel by screen with screen.Therefore, if infrared camera direct viewing screen and visible light projector, then can obtain the translucence of the maximum of the transparency of maximum of infrared camera and visible light projector from oblique angle irradiates light on screen.

The transparent plate display

Except video projector, the interactive video display also can use display technology to realize.At least for any flat-panel monitor of the visible only partially transparent of camera,, then can be implemented if it also is used to replace main screen.For example, a kind of LCD panel that transparent image matrix, Provision are sold can use as display in the specific embodiment of a use near-infrared camera.The LCD panel of this form is clear and transparent when shown color is white.Also be transparent near infrared ray, and no matter show what color.The LCD panel of many types comprises that the LCD panel that can transmit that is used for laptop monitor, dull and stereotyped LCD computer monitor and dull and stereotyped LCD TV screen also has in the transparent character of near infrared ray.

At least be that the flat-panel monitor of partially transparent is referred to herein as " transparent plate display " for the camera visible light.Though example described herein comprises for complete transparent transparent plate display and the infrared camera of infrared ray, this realizations also can similarly be applied to operate on the interior camera of different wavelength range and for camera can the complete transparent transparent plate display of detected light on.

Use can use infrared camera to construct interactive flat-panel monitor for infrared ray transparent LCD panel or other flat panel displays of partially transparent at least.Transparent LCD does not have the illumination of oneself usually, so they must throw light on by external source.In one embodiment, this external source is included in the white visible illumination device behind the LCD panel.In one embodiment, will be but that the screen of transparent scatter visible light luminaire directly is placed on after the LCD panel for camera, make the light that is easier to diffuser.

Fig. 7 A shows exemplary transparent interaction formula flat panel display systems 700 according to embodiments of the invention.In one embodiment, by placing the outward appearance that transparent VIS-translucent screen 720 materials of IR-have improved display 700 in transparent plate display 710 backs.Therefore, any light of irradiation will illuminate display 710 in the mode of more diffusions on screen 720.In order to make the illumination of screen 720 that maximum diffusion be arranged, system 700 use with the oblique angle be mapped on the screen light 730 or before it light 730 of separative diffusing globe 740.Notice that diffusing globe 740 does not hinder the observation of camera 760.Fig. 7 B shows identical structure with sectional top view, and wherein transparent plate display 710 and screen 720 are removed.Visible illumination device 730 can comprise any lighting that produces visible light, comprises LED, fluorescence, neon bulb, electro luminescence line or sheet, halogen light and incandescent lamp bulb.Infrared illuminator 750 can comprise any lighting that can produce for the visible infrared light of camera, comprises LED, heating lamp, Halogen lamp LED or incandescent lamp.Infrared and visible light can produce by identical light source.Perhaps, for better control infrared light, can to place for visible light on visible luminaire 730 be transparent but be opaque film for infrared light.

Be used for all can be applicable to the system that this part is described based on the transparent plate display based on the improvement of the system of projector, described improvement is included in the gating technique that is entitled as " directed environment infrared ray " part, be entitled as the physical arrangement of " physique " part, and the luminaire arrangement that is entitled as " the additional structure that interactive video shows " part.

Use the transparent plate display but not projector can significantly reduce the size of interactive video display.Yet this has caused the problem of the computer vision system that must watch by screen.If distance is very little between the screen and the display box back side, camera 760 just must have big wide angle to see the preceding whole zone of screen 720, the system position with detected object (for example user's hand).So since the difficulty of watching by screen with the oblique angle this also produced problem.

Solution is to use the polarisation material around camera 760 with one of method of oblique lighting problem, eliminating frame out 720 infrared light of reflection, and to the not influence of light by screen 720.The frame out light on surface of reflection trends towards along the direction that is parallel to screen surface by polarization consumingly, so will eliminate diffusing of most of or all infrared illuminator 750 from screen 720 back around camera 760 and its polarization orthogonal in the polarizer of screen surface in the mode on normal to screen surface.

The processing of distortion

All there is the camera observes problem of dtmf distortion DTMF in (for example, optical projection system and based on the system of transparent plate display) in all interactive video displays described herein.In many cases, the two-dimentional viewing area of the camera of screen top has very strong distortion.For example, among Fig. 7 A,, seem that by camera 760 they but are in identical position even object 712 is positioned at screen 720 preceding different positions with object 714.In order to make the more accurate alternately of screen 720 tops, need correcting distortion.

In undistorted environment, with virtual location on the corresponding screen 720 of physical object be the vertical projection of this contours of objects on screen 720.Can on the screen 720 or near placement plate correction optical devices Fresnel lens for example so that to being redirected perpendicular to light towards the screen of camera 760.Thereby camera 760 observed objects are in their trams with respect to the surface of screen 720.Fig. 8 A shows the exemplary embodiment that is used for based on the structure of the interactive video display system 800 of projector with xsect.Camera 810 is put in the focal length place of Fresnel lens 820, makes the light ray that is mapped on the screen 830 from vertical direction be redirected at camera 810.The result is, if object 802 moves to position 804 from the position, its apparent position to camera 810 may be constant.Thereby, the effect that can obtain to want, the i.e. virtual location of the vertical projection of object contours of objects on screen 820 of screen 820 tops.Notice that the optical devices of camera lens need special consideration; Apeture lens can provide the desirable depth of field and image definition, is that cost can have brighter image and have the wide-angle lens that focuses on the past infinite distance with the part depth of field and sharpness.The Fresnel lens method of eliminating distortion can be used for based on interactive system projection and transparent flat-panel monitor.

Have under the situation of the Fresnel lens of main projection engine display in use, because the IR-before Fresnel lens is transparent, the light of VIS-translucent screen scatter projection instrument, and the distance between this screen and the Fresnel lens is almost nil, so Fresnel lens does not influence the image of projection, thereby the image of projection does not have distortion.

Have in use under the situation of Fresnel lens of transparent plate display, transparent at IR-, locate to place transparent flat-panel monitor near the observer before VIS-translucent screen and the Fresnel lens.Owing to the white light backlight or by diffusion or by the material diffusion between Fresnel lens and the transparent plate display, so Fresnel lens can not influence the illumination of display.

Perhaps, can eliminate distortion by a series of mirror bars that use the display back side, shown in Fig. 8 B.These mirror bars 910 are designed to will be perpendicular to the light-redirecting of display irradiation with towards camera 920.Camera is put in the side of display in order to avoid stray light.The actual quantity of mirror bar 910 may be very big, and mirror bar itself may be very thin.In one embodiment, between mirror bar 910, provide enough spaces, so that the light that comes from screen 930 back sides is luminous by screen.Yet camera 920 be cannot see these light; Because its perspective, camera 920 depends on mirror bar 910 fully to the observation in this zone.When the direction of normal to screen 930 is observed, mirror bar 910 forms circular curves, and center of circle of each circle is in the position of camera 920.

Because projector can not be luminous by mirror bar 910 easily, so present embodiment is more useful for transparent plate display or off-axis projector display, projector passes space projection between mirror bar and the screen to screen in transparent plate display or off-axis projector display.Yet it is luminous by the mirror bar that this does not get rid of the use projector; Though can lose some light, the light of projector is out-of-focus at this point, and therefore final projected image may be unaffected.

Perhaps, if the degree of depth of the sight that can obtain watching (the distance in each pixel) from camera to the object of watching, then can rebuild each object that camera watches each pixel position occupied on screen x-y-z coordinate (by simple coordinate conversion) thus and the observation distortion of recoverable camera.Can make ins all sorts of ways obtains such depth information, including, but not limited to stereocamera, transit time camera and figure pattern illumination.

The ability of utilizing the x-y-z coordinate of each pixel of camera images to rebuild undistorted three-dimensional (3D) view also will allow will merge into the single unified view of the object before the screen from the data of a plurality of cameras by simple data stack.The use of a plurality of cameras (if perhaps use 3D stereoscopic vision, can be many to camera) makes it possible to make displays De Gengping, and camera view is narrower.In this case, camera or camera to placing in one way ideally so that the zone more equably behind the cover screen.For example, camera can be positioned in the grid behind the screen.

Use the image projection of scattering polarizer screen and catch

Another kind of screen material is described now.This screen material can be used as a kind of replacement based on employed in system projector and based on the transparent plate display " the transparent VIS-translucent screen of IR-" above-mentioned among the application.Because screen is positioned between object and the interactive display system, so screen transmission projected image allows light source and camera clearly to watch by screen simultaneously.In one embodiment, screen is used as the transmission diffusing globe of display image passage, catches the window of passage simultaneously as camera.Another requirement to screen is the dazzle that prevents the observer, promptly from uncomfortable visual stimulus of the projector light of direct or insufficient scattering.

In specific examples, though little particle scattering and single particle scattering have λ ^-4The correlativity of wavelength, but most of diffusing globe uses multiple scattering to realize enough diffusions.In multiple scattering, the wavelength dependence of scattered light is just more uncertain, just as the color of milk represented.With by the density of the light of little particle coherent scattering with (n-1) ²Proportional, wherein n is the relative index of refraction between particle and the principal matrix.In the present invention, adopt the feasible passage of catching of this scattering nature transparent, display channel is fuzzy.Herein the method for Shi Yonging with catch passage in use IR compatible mutually but be not limited thereto.The chromatic dispersion of normal polymeric material is not enough to produce contrast between visible light and nearly IR.Instead, we use polarization state mark capturing passage, quadrature mark display channel.Also can provide the screen of following character: its refractive index match (index matching) that is used for polarization state between matrix and chromatic dispersion particle (n=1) and the refractive index that is used for quadrature do not match (n ≠ 1).In this way, screen is enough fuzzy for display channel, and is enough transparent for catching passage.Adjust material to realize near desirable refractive index match at the passage place that catches with very narrow frequency spectrum (about 20nm).Can use two basic measuring (metrics) to define the performance of this type screen: monolithic transmission (single piecetransmission, T _Sp) and polarizer efficient (polarizer efficiency, PE).This tittle is as shown in the formula 1 and 2 definition:

T _sp＝(T _II+T _⊥)/2 (1)

PE＝|(T _II-T _⊥)/(T _II+T _⊥)| (2)

T wherein _IIAnd T _⊥It is direct (for example, non-scattering or the small angle scattering) transmittance in two states.

For desirable polarizer, T _Sp=0.5, PE=1.For the polarizer of reality, because increasing, screen thickness and particle concentration surpass a certain usable range, thus since multiple scattering, T _SpTo reduce and PE will increase.For certain given application, can pass through to adjust the material of given scattering system and handle parameter and these two performance metrics of optimization.High T _SpMainly cause the bigger resolution of camera, and high PE mainly causes lower dazzle.

In one embodiment, the light of projector is at the translucent state polarization of screen.For the LCD projector, this can be arranged with low consumption.The part light of projected image will be reversed scattering, and part will be preferentially in the scattering of forward direction hemisphere.The illumination that is used for camera preferentially polarization to avoid parasitic light.This can obtain easily by the absorption polarizer that uses film-type.The object that is illuminated is reflected light diffusely, and will produce about equally part (for example, not preserving polarization) at the polarization state corresponding to transparency and scattering.Camera is equipped with absorptive-type polarizing filter so that have only direct light in the light from object by imaging.Camera also can be equipped with the narrow band pass filter of the spectrum of coupling lamp, to avoid the interference of video feed and surround lighting.If the scattering polarizer has scattered light to keep this further character of polarization of incident light, then will reduce the environment reflection of light, thereby produce higher contrast.Fig. 9 A and 9B show the schematic layout figure of the interactive video display system that has scattering polarizer screen according to embodiments of the invention.Intersection and four-headed arrow are represented the state of polarization.

Typical LCD projector sends polarized light from its projecting lens.Yet under the situation of three the most general panel LCD projector, the polarized orthogonal of green primary is in red and blue primary.(this is the result of the design of X-cube combiner).Therefore, for all these three primary colours of identical polarization projection, green primary must with other two be consistent.This can realize that with low-down loss this retardation plate is superimposed to have increased half-wave retardation to green passage for red and blue channel by using retardation plate superimposed (can obtain from Japanese Polatechno company).

These superimposed parts can be arranged between combiner cube and projecting lens or between lens and screen.In order to keep high light intensity and to avoid image artificial, it is necessary using the projecting lens assembly of preserving polarization.

The optional structure of the interactive projection display

Can be in the interactive display so that following screen material is used for the dark fully mode of user in the inside of display container: described screen material partially transparent but be translucent when light shines with special angle above the time, such as HoloClear (a kind of hologram screen) by DaiNippon Printing manufacturing.This can be black by all inside face that make container, and has before infrared camera and luminaire the transparent black window of infrared ray is realized.Because screen material is a partially transparent, so camera can be seen object by it.Yet, because projector from the next light quilt diffusion fully of projector, thereby has been eliminated dazzle in suitable angle (for example, being 35 degree) skew under the situation of HoloClear.Because display interior deceives fully, so the user can not see behind the screen of partially transparent anything.

In another embodiment, can use a kind of like this screen material, this screen material can be instantaneously when applying electric current from clear switch to translucent, such as at present only to inner deviser's product sold " Privacy Glass ".Here this material is called time-based material (for example rely on the time and transparent or semitransparent).This material can be used for substituting wavelength or polarization selectivity screen.The camera exposure time is lacked (for example near 100 microseconds, 1 second 30 times) very much.When camera exposure, it is clear that screen material becomes, and makes camera to watch by screen.In a projecting apparatus system, the shutter of (for example high speed liquid crystal shutter) of electronics or machinery can hinder the light output of projector, guarantees that projector does not during this period of time dodge user's eyes.When camera did not expose, screen material became translucent, made light projector or backlight be scattered.Be appreciated that the term backlight refers to the light source that uses the illuminated with visible light flat-panel monitor.

The general description of interface

Though carried out implicit description by text herein, this system description to interface from Primary Display System.This interface allows position, profile and the latent distance of the object (comprising the user) before the perception display, and shows real-time results based on this perception.These real-time results comprise with the action mapping in the physical space before the display being the result of these actions of relevant position in the Virtual Space of display.In other words, system can be calibrated so that work as physical object, user's hand for example, when being positioned on the position of the virtual objects on the display, carry out with display on virtual objects mutual.This display has the physical characteristics without any the witness marking of awareness apparatus; It is visible having only indicator screen self.In the window display system that the application describes after a while, interface with in basic display unit, describe the same, only display adopts the form of window display, wherein window one side at user place does not have equipment.

In many embodiment of the present invention, use video camera as awareness apparatus.The image of camera is as the input to computer vision system, and this system separates the foreground object in the camera images (for example people) in real time from static background.This prospect-background is distinguished as the input to the interactive video display application, and this is used and produces shown image on the display screen.These images can be calibrated, so that the result of the object on the shown image of interactive application and object are at identical physical location.This has produced the illusion for augmented reality, and wherein the user can be by the body action of nature, for example pick up, push away or draw with screen on image or object carry out alternately, realize the illusion of operation real object or image.

Transparent display screen

In an embodiment of system, lcd screen or other such transparent screens are used as display device.The camera that is used for perception user's action is placed on after the screen.Thereby camera is watched zone before the screen by screen.Can be called as interactive areas by this zone that camera detects before the screen of user and object.Therefore, the screen light wavelength of watching for camera is partially transparent at least.

In order to prevent the camera images of the object behind the content influence screen shown on the screen, the light wavelength of camera operation makes and is showing that what content (comprising black) screen all is a partially transparent.Ideally, the light wavelength of watching at camera of the content on the screen is to the not influence of optical property of screen.When the LCD monitor was used for kneetop computer and dull and stereotyped graphoscope, when the camera of watching by the LCD monitor only was 920nm or longer photaesthesia to wavelength, the LCD monitor can be realized this characteristic usually.But the minority LCD flat panel is near wavelength of visible light, and for example the 800nm place also can realize this special permission.In addition, the polarizer in the lcd screen does not carry out polarization to the light at these wavelength places.

LCD or other transparent display screens are illuminated, so that the observer watches the content on it.Ideally, light should become clear and be dispersed on the screen equably.Typical LCD display is used any of multiple backlight and edge light solution.Yet, place scattering, reflection or opaque material layer because these solutions generally comprise in the screen back, so do not allow the camera behind the screen to watch the preceding zone of screen.Yet, the several optional scattering material of the present invention's description, it allows camera to watch the preceding zone of screen still to provide bright, uniform illumination to the zone before the screen simultaneously.

In following solution, be used for the preferably long-life effective white visible light emitter of light source of backlight or edge light, for example fluorescent light or white LEDs, but also can be any visible light source.

1. Rayleigh scattering material

A kind of solution is included in the back side of screen and places the material that a slice has strong Rayleigh scattering, uses white backlight or the bright display screen of edge illumination, and uses the responsive camera of near infrared to watch by screen.Because Rayleigh scattering is with to be scattered the negative bipyramid of light wavelength proportional, thus nearly all white light all by the Rayleigh material scattering, thereby provide uniform illumination to screen.Yet, because infrared ray is longer than wavelength of visible light, so the infrared light that quite few camera is watched is scattered.

2. texture materials

Another solution comprises that generation has the physical texture of the projection, ridge, pit or the groove shape that are dispersed between the flat area.This material can be positioned over the back side of display screen then.This material has all is carried out the influence of scattering with glancing angle by its light, but to a vertical light scattering sub-fraction by it.Some such materials are shown in Figure 10 A and 10B.

Figure 10 A shows the simplification xsect of the material 1000 with the microspike that is used for scattered light or ridge 1010.Can make ridge or projection or superficial makings be changed into projection or ridge 1010 is realized this scattering by the material that utilizes scattered light by additive method.Figure 10 B shows the simplification xsect of the material 1050 with the minute recesses that is used for scattered light or pit 1060.Material by in groove or pit 1060, filling scattered light or superficial makings is changed into groove or pit 1060 is realized this scattering by other modes.In all cases, can not be scattered, and nearly allly will be scattered with the light of glancing angle by the surface with suitable major part near the light that passes through perpendicular to material surface.

Therefore, if use edge illumination bright screen curtain, then display screen can evenly and brightly be illuminated and allow camera to watch by screen simultaneously.Figure 11 shows the rough schematic view of the xsect of an autonomous edge light interactive display according to an embodiment of the invention.Edge light equipment 1110 is provided for illuminating display screen 1140 (for example, visible illumination LCD).Screen 1150 contiguous display screens 1140 are placed, and are used for the light that scattering comes with glancing angle (for example angle of edge light equipment 1110).Luminaire 1120 illuminates the object in camera 1130 visual fields.Be mapped on the display screen 1140 with vertical or subvertical angle from the light of luminaire 1120, and be not scattered.

3. scattering polarizer

In another embodiment, be positioned over the back side of display screen as " use the image projection of scattering polarizer screen and catch " described scattering polarizer of part.The light of a polarization of this scattering polarizer scattering, and the light of inverted polarized is not scattered.By linearly with the backlight polarization for the scattering polarizer on scattering direction equidirectional use backlight to illuminate display screen equably.Thereby all backlight all were scattered before by display screen.

Perhaps, backlight can be unpolarized and can place linear polarizer between scattering polarizer and display screen that the polarization direction of this polarizer is consistent with the direction of scattering scattering of light polarizer.Thereby the scattering polarizer not any light that comes from backlight of scattering is opposite with the polarization direction of linear polarizer, makes it be absorbed.This makes illumination on the display screen be uniformly and eliminate dazzle to eyes of user.

If display screen is a lcd screen, owing in the LCD rear surface built-in linear polarizer is arranged, then backlight does not need polarization.In this case, simply then can from unpolarized backlight, obtain illumination uniformly, and the directed direction of scattering polarizer maximum scattering that makes is parallel to the polarization direction of lcd screen linear polarizer behind by placing the scattering polarizer in the back of lcd screen.Therefore, have only the light of scattering polarizer scattering can pass through lcd screen.

Panel display screen

Figure 12 A shows the simplification cross-sectional view from the exemplary embodiment of basic display unit 1200 that uses display screen.Use lcd screen 1210 to make display, this lcd screen 1210 is illuminated from behind by white visible light 1220.The light that 1215 scatterings of scattering polarizer are all is for the observer provides uniform illumination.Mirror 1225 on the independent unit side will return display screen 1210 from the spuious white light reflection of light 1220, increase its brightness.Only the light activated video camera 1230 of the near infrared from 920nm to 960nm is watched zone before the lcd screen 1210, be called " visual field of camera ".Object in this visual field is visible for camera 1230.The illumination of the visual field of this camera is come from one group in the infrared LEDs at the box back side bunches 1240, and this infrared LEDs bunches 1240 produces the light of the visual wavelength of camera 1230.The light that comes from these LED1240 by the slight scattering of diffusion screen 1245, is emerging on the camera images to stop the minute surface bright spot that becomes clear from LED1240 before arriving lcd screen 1210.Fresnel lens 1250 is used to reduce the camera observes distortion in the zone before lcd screen 1210.

Now the path of visible and infrared light will be described by the exemplary embodiment among Figure 12 A.We are called polarization A and polarization B with these two vertical polarizations of light.

Begin not polarization from the visible light of white light luminaire 1220,, be redirected, perhaps leave mirror 1225 in its reflection on the path of screen 1210 by Fresnel lens 1250 by diffusion material 1245 scatterings.Then, light is by scattering polarizer 1215, the light of all polarization A of these scattering polarizer 1215 scatterings and the light of scattering polarization B (A refers to two vertical polarizations with B here) not.The light of scattering is being scattered the polarization that the back keeps it.Light then passes through lcd screen 1210, the light that this lcd screen 1210 absorbs the light of all polarization B and transmits all polarization A.Thereby, only use scattered light just to illuminate lcd screen 1210, and the observer has seen the screen that evenly illuminates.

The infrared light of launching from infrared illumination device 1240 begins not polarization.Arbitrarily, for promoting clearness, this light can be at first by infrared linear polarizer 1260 with along polarization B polarization, so that this light still less is by 1215 scatterings of scattering polarizer.Then, use diffusion material 1245 scattered infrared light, be redirected, perhaps leave mirror 1225 in its reflection on the path of screen 1210 by Fresnel lens 1250.If light is not polarized, then it during by scattering polarizer 1215 wherein a part will be scattered, the light of polarization B will not be scattered by scattering polarizer 1215.Because infrared light wavelength long enough, it can be insusceptibly by lcd screen 1210 and the object before illuminating screen, for example staff.

Be not subjected to the influence of lcd screen 1210 from the infrared light that before the display screen of camera 1230, returns.Yet when light during by scattering polarizer 1215, the light of polarization A will be scattered, and the light of polarization B still is not scattered.Then, light is by Fresnel lens 1250, but its not obvious ground polarisation-affecting.Infrared linear polarizer 1260 is arranged in the place ahead that is close to camera 1230; The light of this polarizer 1260 absorbing polarization A also transmits the light of polarization B.Therefore, camera 1230 can only be seen the light of the polarization B that is not scattered polarizer 1260 scatterings.This has provided the image of the clear high-contrast of camera 1230 screen forefoot area.

Figure 12 B shows the cross-sectional view based on another exemplary embodiment of the interactive display of LCD.Total system is a wedge shape.The design of system is with similar with the design of describing shown in relevant Figure 12 A.Yet, place infrared illuminator to minimize the dazzle that enters camera 1262.Illuminated by inner infrared illuminator 1264 on the screen and near the object of screen, this inside infrared illuminator 1264 is luminous by scattering polarizer 1266 and LCD panel 1268.Yet in order to reduce the dazzle influence for camera 1262, they are not luminous by Fresnel lens 1276.Fresnel lens 1276 is put in back to the surface of LCD panel 1268 and scattering polarizer 1266, so that provide the space for inner infrared illuminator 1264.Outside infrared illuminator 1270 illuminates the object away from screen.Infrared illuminator 1270 is luminous around (but not passing through) LCD panel 1268 or scattering polarizer 1266, thereby further reduces dazzle.

White visible illumination device 1272 is arranged along the side of system's base, and is covered by backlight lid 1274.Backlight lid 1274 by absorption near infrared ray but the material of transmission visible light forms, reducing ultrared existence of environment on the screen, and so improve the contrast of the image that camera 1262 catches.

Use the projection display screen of scattering polarizer

In another embodiment of interactive video display system, use projector and projection screen with as display device.After the camera that is used for perception people's action is put in screen.Therefore, camera is by the zone before the screen viewing screen.Therefore, screen is a partially transparent for the light wavelength of camera observes at least.The scattering polarizer can be used as the projection screen in this system.

Will be understood that the running that the scattering polarizer can not be desirable.A spot of light that should be polarized is not polarized in polarization.Because projector light is very bright, even along the light of the suitable direction polarized projector of maximum scattering, the bright light source by scattering polarizer projection lenses inside is still directly visible when direct viewing.By before the scattering polarizer, using linear polarizer can eliminate the bright spot of dazzle, be absorbed with the projector light that guarantees not scattering.In addition, if the light of projector similar problem will occur not by complete polarization.This problem can reduce by use linear polarizer behind the scattering polarizer.In both cases, the parallel light of these polarizers and projector towards.If camera is near infrared or other non-visible light wavelengths, can select the visible light polarizer so that camera is not influenced by it.Therefore, camera can be watched by screen.

Eliminate direct reflection

In addition, can influence the image of camera unfriendly from the next direct reflection of the luminaire of camera.These influences can by on one or two surface of display screen and any surface behind the screen apply antireflecting coating and eliminate, comprise Rayleigh scattering material, veined material, scattering material or Fresnel lens.These influences also can be eliminated from the next light of luminaire so that do not get back to camera from the next direct reflection of the luminaire of camera by tilting.

Gou Zao a example as shown in figure 13 like this.This structure uses the some luminaire 1310 away from camera 1320 and normal to screen 1330 irradiations, prevents that any direct reflection is to camera 1320.The regional illuminated device 1340 that is covered by these luminaires does not illuminate, and luminaire 1340 is luminous to screen 1330 with glancing angle, prevents to launch illumination and gets back to camera 1320.

In another embodiment, the scattering material of scattering polarizer 1410 or other selections can be by slight bending, so that the direct reflection of the luminaire of camera 1440 is left camera 1430, as shown in figure 14.As shown in the figure, the direct reflection from luminaire 1440 is redirected to towards the box side.In another embodiment, can before the luminaire of camera, place diffusion material to be attenuated to any direct reflection of camera.The light that comes from these luminaires also can be by their light of rebounding to be spread away from the display back side.

Figure 15 shows the exemplary configurations of the interactive video display system 1500 that uses transit time camera 1530 according to one embodiment of present invention.Because in common design, the luminaire of camera and camera must be close to each other and place, and can not be scattered from the next light of luminaire, so direct reflection has proposed a special problem for the transit time camera.Thereby, because the luminaire of camera will cause that violent dazzle frames out backside reflection to camera from it, so aforesaid solution can not be used in the embodiment that uses the transit time camera.Yet,,, and can be merged from the data of a plurality of cameras so camera does not need to be positioned over the back of screen center because computer vision system can use the coordinate conversion of 3D camera information with the coordinate system of carrying out hope.Thereby, for example, can use two transit time cameras 1530 to come zone before the view screen 1510, to avoid any direct reflection, as long as two cameras 1530 are in different time exposures from luminaire with an angle.

Increase touch screen interface

Though the system of describing can the decipherment distance screen several inches far away object and attitude, also can provide the touch-screen behavior, wherein the user truly touch screen so that the action generation.The system interface of the extra kind of this permission system support.For example, this interface can allow the user by the hand cup-shaped being placed on together screen top the virtual objects on " gatherings " screen, also can be by the image of touch virtual objects " picking up " this virtual objects and " putting down " this object by another point on the touch screen then.

This touch-screen behavior can be by a kind of realization the in several modes.The touch-screen example of describing in this part and the further part with based on projector and compatible mutually based on the interactive video system of transparent plate display.As long as covering the part of display screen is transparent for camera, then existing touch screen technology just can be integrated with the screen of system.This comprises electric resistance touch screen, capacitance touch screen, infrared ray grid touch-screen, and surface acoustic wave touch screen.Yet all these screens all have a shortcoming: they can only detect a finger touch screen at every turn; Some in addition can not detect continuous touch, as refuse brief knocking.Have several modes can solve aforesaid drawbacks, information about distance between object and screen can be collected by many systems that also allow.These 3D data are useful for higher levels of visual processes, for example gesture recognition.

Multi-user touch screen and 3D data: stereocamera

By this system is carried out small transformation, can make the multi-user touch screen that allows a plurality of users to use this screen simultaneously.In one embodiment, can use stereocamera to replace single camera.Stereocamera has identical wavelength sensitivity and optical filter equipment with the single camera system.Yet computing machine can obtain two images from stereocamera, and uses in several well-known stereopsis algorithms any one, and Marr-Poggio algorithm is for example extrapolated the range information of any object of seeing on the screen.Because known, so computing machine can be judged whether touch screen of object by the comparison other range information with to the distance of screen to the distance of screen.

Many families touch-screen and 3D data: single camera stero

Figure 16 shows the structure 1600 that uses mirror to obtain the 3D data according to embodiments of the invention.Only use a camera 1610 just can obtain stereo data by the inboard that mirror 1620 is placed on box.Thereby camera 1610 will be seen screen 1630 from both direction directly and at an angle.Just in the master image of camera and reflected image, present identical distance with mirror 1620 edges at the object of touch screen 1630.Yet the object of screen 1630 tops is different with the distance at mirror 1620 edges in master image and reflected image.By comparing these images, whether computing machine can extrapolate each object in touch screen 1630.

Multi-user touch screen and 3D data: figure pattern illumination (patterned illumination)

Figure 17 shows the another kind structure 1700 that use figure pattern illumination obtains 3D information according to embodiments of the invention.The pattern infrared illuminator 1710 of projected light pattern can be used for replacing conventional infrared illuminator.The object on the distinguishable screen 1720 of this system and the object of screen 1720 tops.Yet the raising of the degree of accuracy of this system can be luminous on screen 1720 at an angle by making pattern infrared illuminator 1710, may pass through the mirror 1730 of its bullet on the box inboard.The position of the pattern light on the object along with it away from or move even very short distance and changing tempestuously towards screen 1720, make the distance of 1720 of easier definite object of computing machine 1740 and screens.

Multi-user touch screen and 3D data transit time system

Camera can be the transit time infrared camera, for example from the available model of Canesta and 3DV system.This camera has the built-in performance that detects range information for each pixel of its image.If use such camera, all infrared dazzles of eliminating so from screen will become most important; Otherwise camera can be thought real object to the reflection mistake of luminaire on the screen.The method of eliminating infrared dazzle has been described in the front.

Multi-user touch screen: multi-wavelength

By using two cameras and two luminaires also can obtain the performance of touch-screen, wherein each camera-luminaire is to there being different infrared frequencies.For example, camera-luminaire is to using the light of 800nm, and another camera-luminaire is to using the light of 1100nm.Because the negative bipyramid of the scattering of screen and wavelength is proportional, so that the camera of 800nm is crossed the ability that screen watches than the camera of 1100nm is very different.The result is, the object that has only those touches or almost touch screen to the camera of 800nm as seen, and the camera of 1100nm can be seen the object from several inches far away of screens.Two cameras are all with their data input computing machine and by independent vision system operation.The data of 800nm will be input to touch screen interface, and the camera of 1100nm will be used to the attitude input, and this is because it can detect the object of screen top.

Multi-user touch screen: the arrow beam of light on the display surface

Figure 18 A shows according to embodiments of the invention and is used to use the fill light device to obtain the

structure

1800 and 1850 of 3D information.Second luminaire 1810 can be used for only illuminating on the display surface or very near the object of display surface.For example, if narrow angle luminaire such as LED or laser, just in time is arranged at the inside or the outside of screen 1820, almost point to abreast with screen 1820, then the object near screen 1820 will very be illustrated in the image of camera brightly.Can use cylindrical lens or additive method flatly but not vertically propagate the light of luminaire, make the whole zone before its cover screen.Vision system can extrapolate very bright object very near or touch screen 1820.

In another embodiment, light beam can be luminous in display surface.Figure 18 B shows the embodiment of such illuminator.Before main display 1855, place transparent pane 1860.Luminaire 1870 shines arrow beam of light at the edge of into transparent pane 1860.Because the big cone angle of incident, light 1870 be reflection fully in the boundary of transparent pane 1860.Yet if object 1875 touch screen, light 1870 can scattering, makes it can break away from the boundary of transparent pane 1860.Camera 1885 can detect light 1880 then.This makes that camera 1885 can detected object 1875 or user's touch screen when.

For these or use the method for the second cover luminaire near screen surface, several designs are arranged, these designs make system distinguishable from master luminaire light and from the light of second luminaire.This resolution is crucial, because its system that makes can detect the object of touch screen discretely from the object before screen just.

At first, two cover luminaires are opened during the camera exposure that replaces, and the zone before the screen that is illuminated by each luminaire can be seen by the system that makes.Optionally, system can use two cameras, and each camera-luminaire is to operating in different wave length.In addition, system can use two cameras, but makes each camera-luminaire to different time gated.

Multi-user touch screen and 3D data: brightness ratio

By different luminaires being placed on the characteristic that on the different distance of screen, can realize touch-screen.Suppose that two feet of luminaire A and screens are far away, and one foot of luminaire B and screen are far away.The brightness of light source is with proportional from negative square of the distance of light source.Thereby, change along with the change of distance from A and the next ratio of light on object of B.This ratio allows computing machine to determine that object is whether on screen.Even table 1 shows from the ratio between the light of A and B how to distinguish the example that object on the screen and screen top have only one inch object.

Table 1

Object's position	Light (far away) from luminaire A with respect to 1 foot	Light (far away) from luminaire B with respect to 1 foot	From the light of B with from the ratio of the light of A
Object's position	Light (far away) from luminaire A with respect to 1 foot	Light (far away) from luminaire B with respect to 1 foot	From the light of B with from the ratio of the light of A	Touch screen	0.25	1	4 to 1
1 inch of screen top	0.23	0.85	3.7 than 1	Touch screen	0.25	1	4 to 1
1 inch of screen top	0.23	0.85	3.7 than 1	1 foot of screen top	0.11	0.25	2.3 than 1

As long as object be not black fully to as if this ratio of what color all be right.In addition, because LED is only unbalanced, be what part of screen and changing so the ratio of the object of touch screen depends on that the user touches.Yet, can determine this ratio by each nearest observed maximum rate in some place on the record screen in calibration process with in the whole time of heavily determining.

Distinguishable luminaire A and luminaire B.In one embodiment, as described in the title " multi-user touch screen: multi-wavelength ", can use two cameras also can be adjusted to different wavelength with luminaire.Therefore, luminaire A is visible to camera A only, and luminaire B is visible to camera B only.

In another embodiment, but the wavelength of luminaire A and B is identical to be opened in different time.If have only a camera, luminaire A and B can replace unlatching during camera exposure, so that obtain all even numbers time camera exposure when A unlatching B closes, and obtain all odd numbers time camera exposure when A closes the B unlatching.This has reduced factor 2 with effective frame per second, but makes a camera can catch the image that is thrown light on respectively by A and B.Computing machine can each point relatively two width of cloth images calculate brightness ratio, and definite object touch screen when.Can be very simply that luminaire and camera is synchronous by making a circuit that reads or produce the camera synchronizing signal.

In another embodiment, as long as only when corresponding camera exposure the strobe illumination device to open, and the exposure of two cameras be interlock so that their crossovers not, then two independently camera can be connected to luminaire A and B (two at identical wavelength).

In all cases, camera can compare the image of the screen that A illuminates and the image of the screen that B illuminates, determining the brightness ratio at each some place, and the distance of any object and screen.A is apart from two feet of screens, and B only is an embodiment apart from one foot of screen; Other distance rates or arrangement also can.

Tiling

Because system is in an autonomous box, and screen can take the whole side of box, thus screen can storehouse in a grid, all screens are in the same side, to generate a much bigger screen.If each intrasystem computing machine connects by network, then system can share about their the real-time vision signal and the information of content, allows screen as a big seamless screen work.For reason attractive in appearance, the screen of each unit that tiles separately can replace with a very large screen.

Obtain range information from fuzzy quantity

Some screen materials and structure can cause the incident scattering of light, so that the typical angular of scattering is less.Thereby the major part of the light by screen changes direction slightly.Figure 19 A shows the notion example of slight scattering; The length of each scattered beam arrow is represented the part of light in its place direction scattering; Though show a limited number of arrow, the distribution of scattering angle is continuous.

The scattering of this form can obtain by several modes.Material with strong Mie scattering shows this character.In addition, there is the material of grain surface also to be redirected light in the way you want slightly.Desirable, texture only causes sharing and possible smoothly departing from seldom on light path.Figure 19 B shows the example of such texture.The size of texture is enough little, not shift the observation to projected image.Have strong Mie scattering or grain surface by the main screen material is changed into, can obtain this dispersion effect.Optionally, these character can be in addition on second screen material, and this second screen material and main screen material interlayer are together.

Use such material will influence the mode that camera is watched scene as the part of screen.Because the scattering nature of material is so all objects that camera is seen are all with smudgy.Yet fuzzy quantity will depend on distance.The object of touch screen remains non-fuzzy, but will little by little blur away from the object of screen.This is that it is proportional with the distance from the screen to light because change the physical distance of scattering into given scattered through angles light in the surface of screen.For example, 1 foot of distance screen sentence miter angle flatly scattered beam make it depart from 1 foot along horizontal level, and be 2 feet in departing from of 2 feet places of distance screen.

This vision system can use this blurred picture to rebuild this distance by many methods then, comprises the use edge detecting technology, and it can detect sharp edge and fuzzy limit, and estimates the fuzzy quantity at each edge.The Elder-Zucker algorithm is a kind of such edge detecting technology.In case fuzzy quantity is known, then can determine the distance of target edges and screen, provide vision system 3D information, because fuzzy quantity and distance are proportional about this object.

The task of vision system can be simplified by the infrared illuminator of using the pattern light source to replace or to be additional to standard, wherein the visible infrared patterns of this pattern light source projection camera.This pattern can comprise that point, line or other have the texture of sharp edge.This pattern can be projected from several directions, comprises and passes through screen.If pattern is by screen prjection, the quantity of scattering can be doubled, but the effect that depends on the scattering of distance can not change.

By utilizing pattern to illuminate all objects on the screen, the performance of vision system improves.If figure pattern illumination not then is difficult to distinguish the 3D information of any position that does not have the edge in the image, for example the centre of the object under the equilibrium brightness.Yet, utilize all objects that cover in this projection pattern, be easy to obtain the fuzzy message of any point in the image.

Utilize the texture of projection, can use diverse ways to come the ambiguous estimation amount.For example Sobel wave filter or pyramid decomposition obtain information about the gradient of signal intensity and different scale can to use image convolution.If texture is a dot pattern, then can be by seeking local maximum in the positioning image with the corresponding position of luminous point.So, by the intensity of inspection in the gradient in the zone of each local maximum ambient, it is fuzzy what can determine to have taken place.The gradient and the fuzzy quantity at luminous point edge roughly are inversely proportional to.Therefore, the gradient at each luminous point place can with the distance dependent from screen.

Camera architecture

In an embodiment of system, camera is to the sightless light wavelength sensitivity of human eye.The luminaire of the light by increasing that nonvisible wavelength of emission, not under the situation of user's research irradiates light, camera can obtain the image of the good illumination of display screen forefoot area in a black chamber.In addition, depend on selected light wavelength, the content of display screen can be invisible to camera.For example, it is transparent only wavelength to be that the light activated camera of 920nm-960nm can be regarded lcd screen as, shows what image above no matter.

In another embodiment of system, camera is only to the wavelength sensitive of near infrared very close limit, and wherein the shortest wavelength is 920nm at least in this scope.Utilize the zone before infrared LED bunch illuminates screen, the light of wherein said infrared LED bunch this wavelength coverage of emission.Camera is the monochromatic CCD that the near infrared sensitivity of bandpass filter is installed, and wherein this bandpass filter only transmits the light of the wavelength of LED generation.In order further to improve picture quality and reflection of ambient light, camera and LED can be together by gatings.

In another embodiment of system, the observation in the zone of camera before to screen is undistorted relatively.In order to reduce distortion, camera can be placed to such an extent that significant distance is arranged with screen.Optionally, camera can be placed near screen, and is placing Fresnel lens on the screen or behind the screen.Figure 20 A shows a kind of high distortion structure, and camera is very near screen.Notice that in Figure 20 A, from the skeleton view of camera, object 2010 seems in identical position with object 2020, but is very different parts above screen.Figure 20 B, 21A and 21B show the several structures that reduce distortion.Figure 20 B shows the low distortion structure of a kind of camera away from screen; By the compressible whole display system in the visual field of reflex camera.Notice that in Figure 20 B, from the skeleton view of camera, object 2030 seems in identical position with object 2040, and occupy similar position above screen.Figure 21 A and 21B show respectively and use Fresnel lens to reduce or eliminate distortion.

Use Fresnel lens can make a plurality of cameras be used for a system.Figure 21 C shows and uses Fresnel lens to eliminate distortion in the system of two cameras.Each camera all has a Fresnel lens, and it eliminates the observation distortion of camera.Do not have to intersect owing to the visual field of two cameras just contacts, object will be seamlessly from the observation of observing another camera of a camera.This technology may extend into uses a large amount of cameras, after permission camera grid is put in screen.This technology makes interactive display very shallow, gives its formative factor identical with flat-panel monitor.By similar mode, use Fresnel lens to eliminate distortion and make a plurality of modes that can seamlessly be tiled in together with the camera that allows from all displays be tiled in together from basic display unit.

If use a technology to obtain the 3D data from camera since can be by carrying out coordinate conversion software ground correcting distortion, so that the position of camera just becomes is inessential.For example, for the degree of depth of the camera of each pixel reads can be switched to (x, y, z) coordinate, wherein x and y corresponding on the display screen near the position of this point, and z (x is y) to the distance of this point corresponding to the position from screen.Other based on software and hardware based method in, but by using transit time camera hardware ground acquisition 3D rendering.The manufacturer of 3D transit time camera comprises Canesta and 3DV system.Because most of transit time cameras use infrared illuminator, then preceding method is in full accord with placement transit time camera behind screen.

The luminaire of camera

Can be placed on behind screen periphery, the screen or all put with the luminaire of the interaction area before the illumination bright screen curtain of camera wavelength.

If these luminaires are put in screen periphery, they shine directly on the interaction area, make their brightness maximum utilize.Yet such structure is insecure; The user may stop the light path of luminaire, hinders some objects in the interaction area to be illuminated.This structure just also is difficult to illuminate the object in touch screen.

The aforementioned problem that luminaire is put in screen periphery can solve after luminaire is placed on screen; Luminaire is near camera, and the visible object of then any camera all is illuminated.Yet, can be by the Rayleigh scattering material behind the screen, texture materials or the back scattering of scattering polarizer from the light that these luminaires come.The scattering of this back has reduced the contrast of camera images significantly, makes vision system more be difficult to explain the image of camera.

If use the scattering polarizer to come scattered light, camera is to the near infrared light sensitivity, and luminaire sends near infrared light, and the then aforementioned loss of contrast can reduce by using infrared linear polarizer, this polarizer linear polarization infrared light.Before camera, place infrared linear polarizer, and to be parallel to the scattering polarizer be transparent direction in the polarization direction, will reduce the back scattering significantly and improve contrast.Before infrared illuminator, place infrared linear polarizer, and to be parallel to the scattering polarizer be transparent direction in the polarization direction, also will reduce back scattering and raising contrast.

Window display

According to a further aspect in the invention, the interactive video display uses with window display.Can use multiple physical arrangement configuration interactive video display, for example, level, vertically or orthogonally place screen.Yet, when on a window, disposing such display, several additional possible physical arrangements can be arranged.

Figure 22 shows the representative configuration of interactive window display 2200 according to embodiments of the invention.In one embodiment, parts can physically rather than independently be separated.Screen 2210 can be directly fixed on the surface of window 2220 or be arranged separately in the back of window 2220.Camera 2230, projector 2240 and luminaire 2250 can be positioned over position contiguous or that disperse, and can apart from window 2220 various distances be installed between base plate, top board or the two Anywhere.Optionally, infrared illuminator 2250 can be positioned over the side of screen 2210, makes them can shine directly on the object and need not pass through screen 2210.Also be optionally, the communication between camera 2230 and the computing machine 2260, or the communication between computing machine 2260 and the projector 2240 is wireless.

The common level of camera in the window display is pointed to.Therefore, camera is seen the people that any distance is arranged with screen usually.Yet can use vision software, screen material or other system to discern and remove the object at additional distance place, also camera can be inclined upwardly, so that farther object needs a certain minimum constructive height so that camera can be seen them.Therefore, having only can be mutual with it apart from the people in several feet of the screens.User near such display can find that their virtual image at first appears at the bottom of screen, then along with they rise gradually near screen.Figure 22 shows acclivitous by this way camera 2230.

Dazzle is a problem in window display.Yet the user of window display is limited to the angle that they watch screen usually.In general, they are unlikely to watch screen from the oblique angle, because they keep the distance of several at least (for example two) foot, the object so that their arm and hand have living space on the display possibly with screen.

For or be lower than the display of the surface level of eyes, people especially unlikely watch display with the oblique angle.If projector very near but on the top of screen, place, its light beam is with the downward projection in oblique angle, then this low dazzle situation will realize.Perhaps, if display place ground or be higher than the surface level of eyes, be lower than or near the position of screen by projector is put in so, can realize then that with the oblique angle projection that makes progress similar dazzle reduces.Notice that off-axis projector is particularly useful for such structure.

Windows units: replace structure

In the windows units than more wishing screen transparent to visible light in the independent unit.Therefore, can use the screen structure window display of partially transparent, the screen of described partially transparent is to translucent with special angle irradiation light thereon.A kind of material that can be used for constructing the partially transparent screen is that the commodity of selling on the market " HoloClear " by name are made by Dai Nippon Printing; Such material is for 35 degree angles only translucent according to thereon.This screen replaces transparent VIS-translucent screen of IR-or scattering polarizer screen.If projector then can not bring dazzle from projector from this angle irradiates light on screen.The angle that (arrives screen) as long as that camera and projector have is very different, system just can move normally.

The interface of windows units

The interface of windows units can use the method the same with independent unit to make to depend on distance, and described method comprises uses stereocamera, transit time camera, and the technology of describing in " touch-screen " of the present invention part.In one embodiment, and more accurate attitude alternately whole with comprising alternately of windows units for example indicated mixing of (pointing).

Use the vision system that extracts depth information, might isolate indication attitude and other hand motions by certain methods.At first, camera images can be divided into distance range, a distance range is used for whole mutual another (general nearer) distance range and is used to indicate attitude.Object in one distance range of back is followed the trail of by indicator, and their position is as the input of the application program of moving to display.Perhaps, analysis is less than all objects of a certain distance to find wherein nearest with screen point with screen.If this point is compared with other point of object more near at least one certain threshold level of screen, then this point is as the input of indication attitude.To on screen, provide visible feedback so that the position of any detected hand motion to be shown.

Reduce the technology of dazzle

Always watch the projector dazzle if can guarantee the observer, then when having the scene of adverse influence camera observes, can further not reduce dazzle from the special angle scope.Figure 23 A, 23B and 23C different embodiment according to the subject invention show the rough schematic view of the various technology that are used to reduce dazzle respectively.Figure 23 A shows the accordion screen material.Suppose that screen is an accordion, the feasible light that comes with the oblique angle must only pass through one deck and approach directly next light usually by several layers of screen.If the light of projector is the oblique angle, and camera is near view screen abreast, and then the quantity of projector scattering of light will increase considerably and do not have an observation of adverse influence camera.In Figure 23 A, the major part of the observation of camera is only by one deck screen layer, and all projection lights are by a plurality of layers.

There are several modes can obtain desired effects.Shown in Figure 23 B, replace the screen of accordion, can use ultra tiny shuttering (microlouver material) to replace panel display screen to produce the result identical with the accordion screen.Perhaps, shown in Figure 23 C, can add screen material little, the flat sheet-like particle (all are all towards level) to transparent substrates.In all cases, run into more scattering material near the typical light of screen than the typical light vertical with the oblique angle with material.

The texture of all situations sub-screen should be enough little so that the observer can not notice it.This technology is very useful when using off-axis projector; Yet projector and camera from different perspectives view screen this all is useful in any case.

Prevent that infrared light supply from illuminating screen and reducing contrast is crucial.Thereby if infrared illuminator is put in the back of screen, it is favourable then having the angle of minimum scattering to place with screen infrared illuminator.

Perhaps, be translucent during for close limit and be that transparent observation control film product (for example Lumisty) can reduce the dazzle under some situation in viewing angle in every other angle.

By making projector become specific angle with screen, can guarantee directly to see that the people of projector light beam is being that translucent angle is watched screen to observe the control film just.Figure 24 A and 24B show the method that the control film can reduce dazzle of observing.Figure 24 A shows people's (or camera) and controls the experience that film is watched light by a kind of the observation.The light that comes from translucent area is reduced or eliminated any dazzle from light source by diffusion in this zone.Light source from two transparent regions will be by diffusion, makes people or camera can observe the object in these zones.The area boundary of observing the control film is defined by the scope of the angle value between the surface of controlling film along the light and the observation of a dimension usually.Figure 24 B shows the composition of sample of the observation control film that is used to reduce the dazzle on the interactive window display.Observing the control film uses with the transparent VIS-translucent screen of IR-.Because the angle of projector, the light beam of direct viewing projector is not impossible with the angle of observing control film diffused light.Yet because the directed observation control of camera film is transparent angle, camera can be watched object by observing the control film.Thereby, reduce dazzle and do not influenced the ability of camera observes scene.

Exemplary configurations

As shown in figure 25, use the scattering polarizer as screen based on an exemplary embodiment of the display 2500 of window.This embodiment is an interactive window display 2500, and wherein necessary all sensings of display work and display unit are positioned over after the window 2505.Window display 2500 makes that video image displayed is carried out alternately on body action that the user before the window 2505 can be by nature and the window 2505.

In one embodiment, LCD projector 2510 produces display image.In most of LCD projector, along a red and blue light of direction polarization, and along vertical direction polarized green light.The colored polarisation rotor 2515 of selecting, ColorLink Corporation retardation plate superimposed " ColorSelect " technology of producing for example is used for polarization with green glow and revolves and turn 90 degrees.Perhaps, red revolving with polarization blue light can be turn 90 degrees to obtain same effect.By place the colored polarisation rotor 2515 of selecting before projector 2510, the light of all projector all is identical polarization.Directional scattering polarizer 2525 is so that the maximum scattering direction is parallel to the projector polarisation of light.Thereby, when the light of projector arrives scattering polarizer 2525, all be scattered, for the user of screen opposite side provides image.

Only, be called " visual field of camera " to the zone before light activated camera 2530 view screens of near infrared.This visual field that object to camera 2530 as seen.The illumination of the visual field of camera is come from the cover infrared LED bunches 2535 at the screen back side, and this infrared LED bunches 2535 produces the light of cameras 2530 visible wavelengths.Notice that the visual field of camera is inclined upwardly, so that have only the people near screen to drop in the visual field.This prevents object influences use camera 2530 the interactive application as input far away with screen distance.

Figure 25 has described the exemplary embodiment in visible and the path that infrared light passes through.Two vertical polarizations of light are called polarization A and polarization B.

Visible light occurs from LCD projector 2510, red and blue light is along polarization A, and green glow is along polarization B.At first by the colored polarisation rotor 2515 of selecting, it makes red unaffected with blue light light, but rotates the polarization of green glow so that it is along polarization A.Then, light is by linear polarizer 2520, and it transmits the light of polarization A and the light of absorbing polarization B.This linear polarizer 2520 " removing " light---absorbing still is the light of any projector of B polarization.Then, light is by scattering polarizer 2525, and it is directed with the light of scattering polarization A but the light of transmission polarization B.Thereby the light of nearly all projector all is scattered.Notice that scattered light keeps its polarization A.Alternatively, light is then by linear polarizer 2540, and it transmits the light of polarization A and the light of absorbing polarization B.This polarizer trends towards improving picture quality.

The infrared light that sends from infrared illuminator 2535 begins not polarization.Alternatively, in order to promote clearness, light can be at first by infrared linear polarizer with it along polarization B polarization, so that light still less is scattered polarizer 2525 scatterings.If light is polarization not, wherein a part will be scattered by scattering polarizer 2525 time, will not be scattered by scattering polarizer 2525 but polarization is the light of A.Because infrared light wavelength long enough, thus it can be insusceptibly by the linear polarizer 2540 of any visible light and the object before illuminating screen, for example people.

Not influenced by linear polarizer 2540 from the infrared light that before the window 2505 of camera 2530, returns.Yet when light during by scattering polarizer 2525, the light of polarization A will be scattered and the light of polarization B will not be scattered.Camera 2530 has the infrared linear polarizer 2545 that is close to before it; The light of this polarizer 2545 absorbing polarization A also transmits the light of polarization B.Thereby camera 2530 is observed the light of polarization B only, and the light of this polarization B is not scattered polarizer 2545 scatterings.This has given the image of clear, the high-contrast of 2530 screen forefoot area of camera.

Use prismatic film

In common interactive projection window display, usually wish that the zone under the window display is empty, but settle camera so that the zone that it is observed is inclined upwardly.This situation can realize that described prismatic film will be by the special angle of their light-redirecting by using prismatic film.For example, the Vikuiti IDF film of 3M manufacturing is with light-redirecting 20 degree that enter.As shown in figure 26, by put one or more these films whenever being sidelong of projection screen direction of light is become upwards, camera can be put highlyer relatively than screen.

Compression

The size of total system can be compressed by using mirror.Figure 27 shows camera and the projector adjacent windows is placed, and point to away from window, and mirror returns their beam reflection the structure of window.

The improvement of camera

For the further raising of picture quality and surround lighting suppress, can be to the luminaire of camera and camera gating together.This method is to be consistent with using the various software and hardware modes that are used for 3D rendering.Especially, camera and the luminaire in this design can be replaced by the transit time camera.

The visible light system

If linear polarizer is not joined scattering polarizer next door (as shown in figure 25), then this design does not need to use infrared camera.Before as long as the linear polarizer of visible light directly is placed on camera, and polarization direction to be parallel to the scattering polarizer be transparent direction, then colour or black and white visible light camera can both be to the regional imagings before the screen.Thereby camera be cannot see the image of projection, makes the uncrossed zone of watching before the screen of camera.This camera can be worked with placing near display to illuminate the user before the screen and the existing surround lighting of object or extra visible lamp.If increased extra visible lamp, then camera and lamp be together by gating, just as of the present invention being entitled as " direction environment infrared ray " the described raising camera images of part quality and limit environment and projector light to the influence of image.

For the further raising of picture quality, can before projector lens, place the high speed aperture.This aperture can be machinery or electronics; A kind of available electric aperture is the Velocity Shutter based on liquid crystal that Meadowlark Optics produces.In one embodiment, this shutter is almost all opened in all time, makes the light of projector pass through.This shutter is only closed when camera is taken pictures to stop the light of projector.If the camera exposure time is very short, then the brightness of projector is influenced hardly.Notice that the operating speed shutter also makes it possible to use visible light camera before the interactive floor of projection or wall display at the light that stops projector during the camera exposure.

Note, in the interactive video optical projection system, use visible light camera, can obtain the preceding people's's (system user) of screen real-time photo, and the visual signal that is used for each pixel of camera images is categorized as prospect or background.This makes vision system isolate to remove the picture of the system user of static background.User's coloured image is placed by this information system that makes in the image of its demonstration, with the image insertion of manually generation with around the user.If this system is perfectly collimated, the then tangible screen of user, and shown user images will be in the same position on the identical time touch screen.These features can significantly improve the interactive application that runs on this display, for example, comprise allowing the user to see intuitively to be in the interactive content themselves.

The visible images that comes from camera can be used to generate virtual mirror, and this virtual mirror seems and takes action just as real mirror, but this mirror image can be handled electronically.For example, image can be by flip horizontal to generate the non-anti-mirror that resembles, and the user can see that as other people they see the image of oneself therein.Perhaps, image can be delayed time so that the people can turn round the back of seeing themselves.This system thereby can be used for using in the environment of mirror comprises, for example, and dressing cubicle.

Transit time camera interactive display

Embodiments of the invention can use the transit time camera to realize.The transit time camera has the built-in ability that detects range information for each pixel of its image.Use the transit time camera not need the display of revising.In other words, the transit time camera can be worked and need not revise with any display (comprising LCD panel, cathode-ray tube display etc.).Can use single transit time camera.Yet single transit time camera can not detect by the object that more stops near the object of camera.Therefore, embodiments of the invention use a plurality of transit time cameras, as shown in figure 28.

Utilize the redundancy of camera, needn't worry that a camera can not detect all objects owing to an object stops another object.For example, as shown in figure 29, four transit time cameras are positioned over several angles of display, guarantee that the whole zone of display all can be mutual.In order to use the transit time embodiment of this a plurality of cameras, each pixel of each transit time camera is carried out coordinate transform to put it into common coordinate space.Such definition space is: (x, y)-be vertically projected to the position of the point of display surface, (z)-with the distance of display.Can determine the coordinate space conversion by watching each camera with respect to the angle (and position) of screen.Perhaps, can determine conversion by calibration process, before the object of known dimensions, shape and position is positioned over screen in this calibration process.By making each camera give the object imaging, can determine to be transformed into the corresponding transfer function of the point of common coordinate space from the point that each camera is watched.If the camera coordinate conversion is finished in real time, then can obtain the 3D rendering of real-time camera forefoot area.

Purposes

This interactive video display system can be used in many different application.System has like the touch-screen performance and the mutual performance of whole or local human body contour outline has increased the requirement of system for information interface, and this need be to button and more accurate selection of object and operation.

Comprise based on transparent display screen and based on the purposes of the interactive display system of projector, but be not limited to, the user moves with the interactive video games of playing games therein, interactive menu, catalogue, and allow the user to use attitude to pass through the browing system of information content page browsing, the system that allows the user to use the image of oneself " to try " clothes on, the pure entertainment applications that user's image or profile is input to the video effect system, carry out mutual interactive personage with the action of user before the screen, and the user by move can be mutual with it virtual game field and story-book.

Other purposes of the present invention comprise, but be not limited to: allow the user in the useful selection that customizes or watch the product that is used on the custom display, the product of permission on display place predetermined display, use display interface device, keyboard, credit card swiper or three's combination, the characteristic that compares a plurality of products on the display, show combination or compatibility between a plurality of products on the display, and product is positioned in different virtual settings the on the screen to infer feature (for example water, forest, pitch etc.).

Peripherals

Based on transparent display screen and can be in conjunction with other input and output based on the interactive display system of projector, comprise, but be not limited to microphone, touch-screen, keyboard, mouse, radio-frequency (RF) identification (RFID) label, pressure pad, mobile telephone signal, PDA(Personal Digital Assistant) and loudspeaker.

Can be tiled in together to generate single bigger screen or interaction area based on transparent display screen with based on the interactive display system of projector.Screen tiling or physical separation can use network to connect, and the action of permission on a screen influences the image on another screen.

In an exemplary enforcement, the present invention uses the combination of software and hardware to realize with the form of steering logic by the mode of integrated or module.Based on open and instruction provided herein, those of ordinary skill in the art knows other approach of the present invention and/or the method for realizing.

A wide summary is that the application discloses a kind of interactive video display system.Panel display screen is to user's display of visually image in panel display screen the place ahead.First luminaire uses the illuminated with visible light panel display screen.Second luminaire illuminates object.Camera detects and to illuminate mutual between object and visual image, and wherein camera is used for watching object by panel display screen.Computer system instructs the projector response to change visual image alternately.

An illustrative aspects, aforesaid the present invention has provided the system that allows the preceding zone of camera observes display.In related invention, provide the system that before display, generates reaction compartment.The present invention can be used for capturing information from reaction compartment.

Be appreciated that, example described herein and embodiment only are used for illustrative purpose, advised various modifications or change to one skilled in the art, and all should be included in the spirit and scope of the present invention and in the scope of claims about it.All open texts cited herein, patent and patented claim are incorporated in this for your guidance with its integral body.

The present invention has been described, interactive video display system, various embodiment.Though the present invention has used specific embodiment to be described, will be understood that the present invention should not be limited to described embodiment, and can further be explained according to following claim.

Claims

1, a kind of interactive video display system comprises:

Display screen is used for the display of visually image to present to the user in described panel display screen the place ahead;

First luminaire is used to use the described display screen of illuminated with visible light;

Second luminaire is used to illuminate object;

Camera is used to detect the mutual of the object that illuminated and described visual image, and wherein said camera is used for by the described object of described screen viewing;

Computer system is used to instruct described display screen to respond the described described visual image that changes alternately.

2, the system as claimed in claim 1, wherein said display screen is a panel display screen.

3, interactive video display system as claimed in claim 2, wherein said panel display screen are LCD (LCD) panels.

4, interactive video display system as claimed in claim 1 or 2, wherein said second luminaire is an infrared illuminator, is used to use infrared illumination to illuminate described object, and wherein said camera is the infrared camera that is used to detect infrared illumination.

5, interactive video display system as claimed in claim 1 or 2 also comprises the diffusion of light screen that is used for described first luminaire of diffusion.

6, interactive video display system as claimed in claim 1 or 2, wherein said camera, described first luminaire, described second luminaire, and described computer system is included in the shell, and a side of wherein said shell comprises described panel display screen.

7, interactive video display system as claimed in claim 1 or 2, wherein said second luminaire to described object projection illumination, and wherein settles described second luminaire to reduce the potential dazzle influence to described camera by described panel display screen.

8, interactive video display system as claimed in claim 1 or 2, wherein said second luminaire place on described panel display screen next door so that described second luminaire not by described panel display screen projection illumination.

9, interactive video display system as claimed in claim 1 or 2, comprise a plurality of described second luminaires, wherein said second luminaire is placed on described panel display screen next door, and not by described panel display screen projection illumination, and be positioned at after the described screen.

10, interactive video display system as claimed in claim 1 or 2, wherein said camera is positioned over after the described panel display screen, and points to described screen, make described camera watch on the described screen and described screen before the zone.

11, interactive video display system as claimed in claim 1 or 2 also comprises a series of mirror bars, and it is having a segment distance place to place to proofread and correct the observation distortion of described camera with described screen.

12, interactive video display system as claimed in claim 1 or 2 also comprises Fresnel lens, and it is adjacent to described screen and places to proofread and correct the observation distortion of described camera.

13, interactive video display system as claimed in claim 1 or 2 also comprises the diffusing globe based on wavelength that contiguous described panel display screen is placed.

14, interactive video display system as claimed in claim 13, wherein said diffusing globe based on wavelength is for the infrared light substantially transparent, and is translucent substantially for visible light.

15, interactive video display system as claimed in claim 13, wherein said diffusing globe based on wavelength are the materials that produces Rayleigh scattering.

16, interactive video display system as claimed in claim 1 or 2, also comprise the diffusing globe that contiguous described panel display screen is placed, wherein said diffusing globe is for translucent substantially by the light of described diffusing globe with the oblique angle, and to pass through the light substantially transparent of described diffusing globe with basic vertical angle, wherein to place described first luminaire with described diffusing globe bevel.

17, interactive video display system as claimed in claim 1 or 2, also comprise the scattering polarizer, it is placed by contiguous described panel display screen and is used for the light of scattering from described first luminaire, and wherein said camera is not to by the photaesthesia of the polarization of described scattering polarizer scattering.

18, interactive video display system as claimed in claim 17, wherein said panel display screen is a panel of LCD, and wherein said scattering polarizer is directed so that the light that is polarized along described scattering polarizer scattering direction of light passes through described panel of LCD, and the light that is polarized along described not scattering of scattering polarizer direction of light is absorbed by described panel of LCD.

19, interactive video display system as claimed in claim 17 also comprises linear polarizer, is used for that the described camera of polarization receives and its wavelength is the light of described camera sensitivity, so that described camera is ignored the light of described scattering polarizer scattering.

20, interactive video display system as claimed in claim 1 or 2, also comprise diffuse material, it can be from the translucent substantially substantially transparent that changes to, wherein when described first luminaire when being visible to the people in described the place ahead of described panel display screen described diffuse material translucent substantially, and described diffuse material substantially transparent during the object before described camera detects described panel display screen, wherein said diffuse material is placed on after the described panel display screen.

21, interactive video display system as claimed in claim 1 or 2, wherein said second luminaire when described camera exposure by gating.

22, interactive video display system as claimed in claim 1 or 2, the image of wherein said camera is calibrated to described visual image, so that the physical location of the described object of the described mutual and approaching described screen that described object causes conforms to.

23, interactive video display system as claimed in claim 1 or 2, wherein said interactive video display system are used for determining the information about the distance of described object and described screen.

24, interactive video display system as claimed in claim 23, wherein said camera is a stereo camera.

25, interactive video display system as claimed in claim 23, wherein said camera are the transit time cameras.

26, interactive video display system as claimed in claim 25 is wherein placed described transit time camera so that described transit time camera reflected back oneself not.

27, interactive video display system as claimed in claim 1 or 2, wherein said interactive video display system provide touch screen function when the described screen when described object.

28, interactive video display system as claimed in claim 27 also comprises the transparent touch-sensitive panel in described the place ahead of contiguous described screen.

29, interactive video display system as claimed in claim 27, the slide that also comprises the edge-lit in the described the place ahead that is close to described screen, wherein when described object contacted with the slide of described edge-lit, described camera was used to distinguish the light of generation.

30, interactive video display system as claimed in claim 1 or 2, wherein said to liking the body part of human user.

31, interactive video display system as claimed in claim 1 or 2, wherein said camera and described luminaire comprise the transit time camera.

32, interactive video display system as claimed in claim 1 or 2, wherein a plurality of transit time cameras are placed so that the covering fully to the zone before the described display to be provided, and by angled placement to prevent arriving described transit time camera owing to described screen causes direct reflection.

33, a kind of method of using interactive video display system to present interactive visual image, described method comprises:

Display of visually image on panel display screen, wherein said visual image is used to present to the user in described panel display screen the place ahead;

Use the back side of the described panel display screen of illuminated with visible light;

Illuminate object in described the place ahead of described panel display screen;

Detect the mutual of described object and described visual image by described panel display screen; And

Respond the described described visual image that changes alternately.

34, method as claimed in claim 33 wherein illuminates described object and comprises with infrared illumination and illuminate described object, and wherein said detection detects the infrared illumination that projects on the described object described comprising alternately.

35, method as claimed in claim 33, wherein said interactive video display system is included in the shell, and a side of wherein said shell comprises described panel display screen.

36, method as claimed in claim 33 wherein saidly illuminates described object and comprises by described panel display screen described illumination is projected on the described object.

37, method as claimed in claim 33 comprises that also the Fresnel lens that uses contiguous described screen to place comes correcting distortion.

38, method as claimed in claim 33 also comprises infrared-transparent visible light-translucent screen that contiguous described panel display screen is placed.

39, method as claimed in claim 33 also comprises the transparent display screen with physical texture, and its contiguous described panel display screen is placed and is used for the light from the described back side of the described panel display screen of described use illuminated with visible light is carried out scattering.

40, method as claimed in claim 33 also comprises the transparent screen of Rayleigh scattering material, and its contiguous described panel display screen is placed and is used for the light from the described back side of the described panel display screen of described use illuminated with visible light is carried out scattering.

41, method as claimed in claim 33 also comprises the scattering polarizer, and its contiguous described panel display screen is placed and is used for the light from the described back side of the described panel display screen of described use illuminated with visible light is carried out scattering.

42, method as claimed in claim 33, wherein said interactive video display system also comprise the diffusing globe based on wavelength that contiguous described panel display screen is placed.

43, method as claimed in claim 33, wherein said interactive video display system also comprises can be from the translucent substantially diffuse material that changes to substantially transparent, wherein said diffuse material is translucent substantially during the described back side of the described panel display screen of described use illuminated with visible light, and described detect described object and described visual image mutual by described panel display screen during substantially transparent, wherein said diffuse material is placed on after the described panel display screen.

44, method as claimed in claim 33, wherein said illuminate described object when described detection by gating.

45, method as claimed in claim 33, the image calibration of catching when also comprising described the detection are to described visual image, so that the physical location of the described object of the described mutual and approaching described screen that described object causes conforms to.

46, method as claimed in claim 33 also comprises and determining about the information of described object to the distance of described screen.

47, method as claimed in claim 46 wherein utilizes stereo camera to carry out described detection.

48, method as claimed in claim 46 is wherein utilized the transit time camera to carry out and is detected.

49, method as claimed in claim 48 also comprises and places described transit time camera so that described transit time camera reflected back oneself not.

50, method as claimed in claim 33 wherein also comprises when described object touch screen function is provided when the described screen.

51, method as claimed in claim 50 comprises that also described the place ahead of contiguous described screen provides transparent touch-sensitive panel.

52, method as claimed in claim 50, the described the place ahead that also comprises contiguous described screen provides the slide of edge-lit, and wherein when described object contacts with the slide of described edge-lit, described detection is used to distinguish the light of generation.

53, method as claimed in claim 33, wherein said to liking the body part of human user.

54, the system as claimed in claim 1, wherein said display screen is:

LCDs, described first luminaire is the visible illumination device, described second luminaire is an infrared illuminator, and described second camera is an infrared camera;

Wherein said infrared camera, described visible illumination device, described infrared illuminator, and described computer system is included in the shell, and a side of wherein said shell comprises described LCDs.

55, interactive video display system as claimed in claim 54 also comprises the diffusion of light screen that is used for the described visible illumination device of diffusion.

56, interactive video display system as claimed in claim 54, wherein said infrared illuminator is by described LCDs projection illumination on described object.

57, interactive video display system as claimed in claim 56 is wherein placed described infrared illuminator, to reduce the potential dazzle influence to described infrared camera.

58, interactive video display system as claimed in claim 54, wherein said infrared illuminator are positioned at described LCDs next door, so that described infrared illuminator is not by described LCDs projection illumination.

59, interactive video display system as claimed in claim 54, comprise a plurality of described infrared illuminator, wherein said infrared illuminator is positioned at described panel display screen next door, and not by described panel display screen projection illumination and be positioned at after the described screen.

60, interactive video display system as claimed in claim 54, wherein said infrared camera are positioned at after the described LCDs and point to described screen, make on the described infrared camera view screen and the zone before the screen.

61, interactive video display system as claimed in claim 54 also comprises a series of mirror bars, and itself and described screen are placed to proofread and correct the observation distortion of described infrared camera at a distance of a segment distance.

62, interactive video display system as claimed in claim 54 also comprises Fresnel lens, and its contiguous described screen is placed to proofread and correct the observation distortion of described infrared camera.

63, interactive video display system as claimed in claim 54 also comprises the diffusing globe based on wavelength that contiguous described LCDs is placed.

64, as the described interactive video display system of claim 63, wherein said diffusing globe based on wavelength is to the infrared light substantially transparent, and is translucent substantially to visible light.

65, as the described interactive video display system of claim 63, wherein said diffusing globe based on wavelength is the material that causes Rayleigh scattering.

66, interactive video display system as claimed in claim 54, also comprise the diffusing globe that contiguous described LCDs is placed, wherein said diffusing globe is to translucent substantially by the light of described diffusing globe with the oblique angle, for with the light substantially transparent of vertical substantially angle, wherein place described visible illumination device and described diffusing globe bevel by described diffusing globe.

67, interactive video display system as claimed in claim 54, also comprise the scattering polarizer, its contiguous described LCDs is placed and is used for the light of scattering from described visible illumination device, and wherein said infrared camera is not to by the photaesthesia of the polarization of described scattering polarizer scattering.

68, as the described interactive video display system of claim 67, wherein said LCD is a panel of LCD, and wherein directed described scattering polarizer is so that the light that is polarized along described scattering polarizer scattering direction of light passes through described panel of LCD, and the light that is polarized along described not scattering of scattering polarizer direction of light is absorbed by described scattering polarizer.

69, as the described interactive video display system of claim 67, also comprise linear polarizer, be used for described infrared camera the light that the described infrared camera of polarization place receives on the responsive wavelength so that described infrared camera is ignored the light by the scattering of described scattering polarizer.

70, interactive video display system as claimed in claim 54, also comprise diffuse material, it can be from the translucent substantially substantially transparent that changes to, wherein described diffuse material is translucent substantially when described first luminaire is visible to the people in described the place ahead of described panel display screen, and when the object in the described LCDs of described infrared photography machine testing the place ahead described diffuse material substantially transparent, wherein said diffuse material is placed on after the described LCDs.

71, interactive video display system as claimed in claim 54, wherein said infrared illuminator when the exposure of described infrared camera by gating.

72, interactive video display system as claimed in claim 54, the image of wherein said infrared camera is calibrated to described visual image, so that the physical location of the described object of the described mutual and approaching described screen that described object causes conforms to.

73, interactive video display system as claimed in claim 54, wherein said interactive video display system are used for determining the information about the distance of described object and described screen.

74, as the described interactive video display system of claim 73, wherein said infrared camera is three-dimensional thermal camera.

75, as the described interactive video display system of claim 73, wherein said infrared camera is the transit time infrared camera.

76,, wherein place described transit time infrared camera so that described transit time infrared camera reflected back oneself not as the described interactive video display system of claim 75.

77, interactive video display system as claimed in claim 54, wherein said interactive video display system provides the touch-screen behavioral function when the described screen at described object.

78,, also comprise the transparent touch-sensitive panel in described the place ahead of contiguous described screen as the described interactive video display system of claim 77.

79, as the described interactive video display system of claim 77, the slide that also comprises the edge-lit in the described the place ahead that is close to described screen, and wherein when described object contacted with the slide of described edge-lit, described infrared camera was used to distinguish the light of generation.

80, interactive video display system as claimed in claim 54, wherein said to liking the body part of human user.

81, interactive video display system as claimed in claim 54, wherein said infrared camera and described infrared illuminator comprise the transit time infrared camera.

82, as the described interactive video display system of claim 81, wherein a plurality of transit time cameras are placed so that the covering fully to the zone before the described display to be provided, and by angled placement to prevent arriving described transit time camera owing to described screen causes direct reflection.