WO2017046423A1 - Afficheur 3d et procédé de fonctionnement associé - Google Patents

Afficheur 3d et procédé de fonctionnement associé Download PDF

Info

Publication number
WO2017046423A1
WO2017046423A1 PCT/EP2016/072208 EP2016072208W WO2017046423A1 WO 2017046423 A1 WO2017046423 A1 WO 2017046423A1 EP 2016072208 W EP2016072208 W EP 2016072208W WO 2017046423 A1 WO2017046423 A1 WO 2017046423A1
Authority
WO
WIPO (PCT)
Prior art keywords
viewer
eye
images
display
sequence
Prior art date
Application number
PCT/EP2016/072208
Other languages
English (en)
Inventor
Olivier Charlier
Original Assignee
Barco N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from GB1516604.4A external-priority patent/GB2542416A/en
Application filed by Barco N.V. filed Critical Barco N.V.
Publication of WO2017046423A1 publication Critical patent/WO2017046423A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/334—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using spectral multiplexing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays

Definitions

  • the present invention relates to a 3D display arrangement and a method of operation thereof, an optical device and a method of operating thereof, as well as software for carrying out such methods.
  • the present invention also relates to moving pictures adapted for 3D image production. The images may be viewed in a cinema or at home for example.
  • Motion pictures have traditionally been images in 2-dimensions. However, several methods have been developed for providing the illusion of depth in motion pictures. These include the Anaglyph, IMAX (Polaroid), autostereoscopy and Pulfrich 3- dimensional illusions.
  • Autostereoscopy refers to the representation of stereoscopic images without the use of glasses, also referred to as glassless or glass free 3D, for rendering the three-dimensional effect, using a combination of both stereo parallax and movement parallax.
  • parallax barriers or lenticular lenses are used in combination with the flat panel.
  • Autosteroscopy is mainly used for scientific and medical 3D visualisation, and computer games or advertising.
  • auto stereo scopy has no application in cinema due to the required positions by the viewer.
  • An immersive theater is described in US 5,963,247 "Visual display systems and a system for producing recordings for visualization thereon and methods therefor".
  • a central screen is flanked by a first screen on its left and a second screen on its right thereby immersing the viewers in the theatrical experience as illustrated in Figures 15a and 24.
  • the glasses used for 3D performances can obstruct at least part of the lateral field of view or create a discontinuity that can reduce the comfort of the experience of the viewers.
  • Viewers on opposite sides of the projection room also see the lateral screens from largely different angles. If two viewers seated at opposite sides of the projection room look at the same 3D images projected on a lateral screen, at least one of them will see a wrong perspective thereby ruining the immersive experience that the immersive theater is supposed to enable.
  • Some viewers have a poor 3D sight and/or get headaches while watching 3D movies for more than a few minutes at a time. Those viewers do not enjoy motion pictures in stereoscopic projection. Going to the movie often being a social activity, viewers averse to 3D movies can be a disincentive for an entire group to see movies in 3D thereby affecting the return on investment expected from the 3D movie producers.
  • the Pulfrich effect is generally induced by placing a dark filter over one eye.
  • the phenomenon is named after the German physicist Carl Pulfrich, who first described it in 1922.
  • the effect has been exploited as the basis for some television, film, and game 3D presentations.
  • Barco EscapeTM makes use of three large screens at the front and to the left and right in a cinema. Such screens produce not a narrow beam of light and it can be expected that a distributed light is generated that can be seen by the eye closest to the screen not only in peripheral vision but perhaps also in the central visual area. Also the image projected is a video image and not a static light. One can expect that some light can even enter the eye furthest away from the side screen.
  • the art also remain silent on (c) how to make it possible for viewers in the same projection room, at the same time and watching to the same screen to choose whether or not they want to experience the motion picture in 2D or 3D version of a film without impact on e.g. the brightness of images being projected with (d) a minimum of modification to the existing projection hardware.
  • the art remain silent on how to avoid perspective mismatch, in particular for stereoscopic images projected on the lateral screens for which there are not only sweet spots where the 3D effect will be most convincing but also spots where the 3D effect will be incorrect and will ruin the cinematic experience. What is needed is a solution that solves all of the issues listed above. There is room for improvement in the art. Summary of the invention.
  • An object of embodiments of the present invention is to provide systems and devices for moving pictures with some 3D effect, and an arrangement for producing moving pictures with some level of three dimensional effects when viewed by at least some viewers.
  • An advantage of some embodiments of the present invention is that such images can be seen in 3D without wearing filter or shutter glasses.
  • Embodiments of the present invention solve the problem caused by generating 3D images with the viewer wearing glasses, and therefore embodiments of the present invention can provide 3D images without discontinuities in the field of view of the viewer.
  • a display system comprising at least a first display for displaying images like e.g. a motion picture in front of a viewer, a first means to illuminate the left eye of the viewer and a second means to illuminate the right eye of a viewer wherein the first and second means are controlled by a control unit for inducing inter-eye luminance disparity coupled to the lateral movement of an object on the first display without the use of light absorbing filter in front of either eye of the viewer coupled to the lateral movement of an object on a projection surface.
  • Inter-eye illumination disparity is induced according to embodiments of the present invention by e.g. activating a light source on the left or on the right of the head of a viewer.
  • the illumination disparity is coupled to the movement of the image of an object on screen, moving with a lateral velocity component (i.e. from left to right or from right to left for a viewer under normal circumstances) so as so as to create 3D images according to the Pulfrich effect.
  • a lateral velocity component i.e. from left to right or from right to left for a viewer under normal circumstances
  • no filter has to be positioned in front of the viewer to create a 3D effect.
  • viewers have to wear glasses which create a boundary between the screen and the viewer (not unlike a mask creates a boundary between a diver and the surrounding underwater environment in which the diver is) and can ruin the immersive experience.
  • the amount of light reaching an eye of the viewer is at least twice the amount of light reaching the other eye of the viewer to induce inter-eye luminance disparity sufficient to let the viewer perceive 3D effects.
  • More pronounced 3D effects can be achieved when the amount of light reaching an eye of the viewer is 5 times or more the amount of light reaching the other eye of the viewer.
  • the images projected on screen must be watched from a frontal position (i.e. the images are not meant to be seen at an angle). If the images are seen at an angle, the perspective will be wrong, thereby ruining the cinematic experience of the viewer.
  • the amplitude of the Pulfrich effect being proportional to the lateral velocity of the images being projected, the amplitude of the 3D effect will be reduced when a viewer looks at a screen at an angle. Wrong perspectives are thus mitigated if not entirely eliminated.
  • a control unit for activating the light source. It is preferred if the activating is done with a ramp up of the signal so that the change is not sudden in preparation of a 3D scene.
  • Embodiments of the present invention does not exclude the possibility that some viewers are unable to see the 3D effect. Such viewers, who are not sensitive to three dimensional effects, will experience the motion picture as usual. This is a significant improvement over conventional stereoscopic three dimensional moving pictures which are viewed with glasses which stereoscopic three dimensional movies superpose two images, and which therefore cannot be viewed without wearing the correct glasses. When viewed without filter glasses, the images appear blurred which does not allow viewing the film in optimal conditions without wearing filter glasses.
  • the first and second means for activating a light source on the right or on the left of the head of a viewer are controlled by a control unit which receives command signals correlated to the displayed images of the at least one motion picture according to the horizontal moving direction of the at least one object.
  • This provides the advantage that the illumination of the eyes is automatically controlled and can react fast to any movement occurring in the motion picture.
  • command signals are not detectable by the viewer, i.e. are invisible to the viewer.
  • Such command signals can be transmitted by at least one of infrared light, or radio frequency wavelengths of light, ultrasound, etc. (including Bluetooth, wifi, ... 3G, 4G, ...)
  • Such signals provide wireless solutions although the present invention includes in embodiments wired solutions as well, or a combination of both.
  • said command signals are transmitted with at least one of ultrasonic sound, or infrasonic sound.
  • the signals can be therefore provided to the first and second means for activating a light source through the soundtrack of the motion picture, without disturbing the viewer as these are not audible.
  • the light source is positioned in a monocular field of view of each of, respectively, the left and right eye.
  • the light source When the light source is positioned in a monocular field of view, it provides the advantage that the first means for increasing the illumination does not disturb the left eye and the second means for increasing the illumination does not disturb the right eye.
  • At least one light source is an incandescent source, or a solid state light source.
  • the at least one light source is one or more LEDs.
  • said light source e.g. comprising at least one LED, emits at least one of white, red, green, blue light or any combination thereof.
  • LEDs e.g. LEDs of different colors can be light up according to the content and color content of the displayed motion picture thereby making them less conspicuous.
  • the at least one light source is positioned in a proximity of respectively the left and right eye.
  • the at least one light source is positioned adjacent to the lateral cantus, at the level of or below the lateral hooding area of the eye, or at the level of or below the lower eyelid or close to the medial canthus.
  • At least one of the display surfaces is a front projection screen.
  • the display surfaces for displaying moving pictures comprise at least one of an LCD, an LED, a projection screen, an LED wall, a CRT or a plasma fixed format display.
  • the arrangement is installed within a cinema, a theatre, an opera, a conference room, a concert hall, in a room or an outdoor cinema at night.
  • a second object of embodiments of the present invention is to provide a device for assisting the visualization of some three dimensional effects in moving pictures without disturbing the field of view and without dazzling the viewer.
  • Embodiments of the present invention also provide a device for viewing three- dimensional effects in at least one motion picture displayed on at least one display surface, the device comprising first means for increasing the amount of light entering the right eye of a viewer compared to the amount of light entering the left eye dependent upon a horizontal movement of an object on the at least one display surface, second means for increasing for increasing the amount of light entering the left eye of a viewer compared to the amount of light entering the right eye (optionally, without reducing the illumination entering the right eye) dependent upon horizontal movement of an object on the display , (optionally when at least one object in images displayed on the third display surface is moving generally in a horizontal direction from left to right from the viewer' s point of view, or vice versa), and a control unit for for controlling the amount of light emitted by the first and means so as to create 3D images according to the Pulfrich effect by inducing inter-eye luminance disparity.
  • the switching is done with a ramp up of the signal so that the change is not sudden in preparation of a 3D scene.
  • Which of the first and second means for increasing the amount of light entering the eye of the viewer are employed depends on whether the object with the horizontal movement is to be pushed back and should appear further away from the viewer or whether the object should appear closer to the viewer.
  • the first and second means for increasing the amount of light entering the left eye and the right eye of the viewer comprise at least one light source.
  • An advantage associated with the device according to these embodiments of the present invention is that the user may move his head without influencing the three dimensional effects created.
  • the command signals are invisible light signals such as infrared signals, and the control unit comprises therefore an infrared detector.
  • the command signals are signals at radio frequency wavelengths such as provided by Wifi, Bluetooth, 3G, 4G, etc.
  • the command signals are sonic signals that cannot be detected by humans such as ultrasonic or infrasonic sound and can be emitted in parallel to the audio soundtrack of the moving pictures. However, the viewer doesn't hear the command signals.
  • the control unit comprises an ultrasound or infrasound detector accordingly.
  • the first and second means for increasing the amount of light entering the right eye and the left eye of the viewer are to be positioned in a monocular field of view of the left and/or right eye such that the means for increasing the illumination of the left eye do not disturb the right eye and inversely.
  • the device does not interfere with the field of view of the binocular vision, which increases strongly the comfort and the image quality provided by the device.
  • an apparatus to induce the Pulfrich effect comprises at least one source of light with a light exit and a support structure to maintain the source of light in a position relative to the head of a viewer; wherein the light exit of the source of light is positioned close to one eye of the viewer so as to illuminate said one eye.
  • the control unit is configured to be attached by fixing means or is mounted to said support structure.
  • the light exit is positioned adjacent to the lateral cantus of the at least one eye and at the level of or below the lateral hooding area of that eye.
  • the light exit is positioned at the level of or below the lower eyelid.
  • the light exit is positioned close to the medial canthus.
  • the support structure also maintains a louver close to the root and/or dorsum of the nose to shield each eye of the viewer from stray light.
  • the louver shields thus the left eye from light coming from the right of the viewer and the louver shields the right eye from light coming from the left side of the viewer.
  • the support structure may take the form of a tiara, hard headband, cloth headband, plastic headband, wherein the headband goes over or behind the head, headphones, earphones, glasses, goggles, security glasses, hat, helmet, head accessory, or any type of hair accessory.
  • the apparatus comprises a receiver to receive command signals and control electronics to activate the source of light and illuminate the corresponding eye of the viewer at a well determined moment e.g. in order the induce the Pulfrich effect at one or more time during a motion picture.
  • a mobile phone is used to receive the command signals and control the activation of the at least one source of light.
  • the apparatus has a source of light with a light exit for each eye of the viewer.
  • the apparatus is used in conjunction with a Barco EscapeTM projection system comprising a first and second lateral screens and a third main screen .
  • the light source When used with a Barco EscapeTM projection system, the light source collects light emitted by one of the lateral screens.
  • the light can be collected by a light funnel, whether hollow or full.
  • the advantage of that aspect of the invention is that the apparatus does not have to be powered. Furthermore, no electronics is required to activate the light source at the opportune moment when the viewer looks at a motion picture.
  • a reflecting surface fastened to the support structure of the apparatus can be positioned adjacent to the root and dorsum of the nose to reflect light into the eye.
  • the reflecting surface can be used alone or in conjunction with a light funnel.
  • the reflecting surface can be an integral part of a louver on the dorsum of the nose of the viewer.
  • the apparatus is powered and command signals are transmitted by light projected on the lateral screens. (For instance: right left light imbalance + photosensor).
  • the light projected can be infra-red light projected by one of the projectors or by a dedicated infra-red projector.
  • the apparatus is used in conjunction with an emissive display.
  • the present invention also includes a sensor to evaluate dark adaptation / light adaptation locally.
  • a light source on a head mounted device collects light emitted by one of the lateral screens.
  • the light can be collected by a light funnel, whether hollow or full.
  • a reflecting surface fastened to the support structure of the apparatus can be positioned adjacent to the root and dorsum of the nose to reflect light into the eye.
  • the reflecting surface can be used alone or in conjunction with a light funnel.
  • the reflecting surface can be an integral part of a louver on the dorsum of the nose of the viewer.
  • the head mounted device is powered and command signals are transmitted by light projected on the lateral screens.
  • the light projected can be infra-red light projected by one of the projectors or by a dedicated infra-red projector.
  • the device is used in conjunction with an emissive display.
  • the color of the at least one light source is selected to match a color of the images projected on the first and/or second lateral screens.
  • the control unit further comprises means to control the intensity of the illumination provided by the means for increasing the light entering an eye as a function of the ambient light provided by the sensor.
  • the arrangement is further adapted to display the first and second sequence of images such that the intensity of at least a portion of at least some images of the first or second sequence emitted from the first or second part respectively is such that a ratio of illumination leaving the display surface for entering the second eye of the viewer compared to the first eye is at least of two.
  • Advantages of embodiments of the present invention are to solve the problem of generating three dimensional images without complex glasses which include filters.
  • it is the content of the displayed images which matters to generate the three dimensional effect and no special hardware is required.
  • only one image is displayed, unlike 3D as known in the art which requires the superposition of 2 images, one for the left eye and one for the right eye.
  • Further advantages of the present invention are that the impression of 3D can be generated in a natural way to the viewer, by adapting the content of the images to generate a ratio of illumination between the first and second part of the display surface.
  • a louver configured to be positioned on the dorsum of a viewer's nose is provided so as to increase the monocular field of view of each eye of the viewer. This can be provided in a simple and economic way.
  • a louver positioned on a viewer's nose increases the 3D effects generated by the Pulfrich effect as it increases the monocular field of view.
  • the ratio of illumination between the second and first eye is preferably at least 5, more preferably at least 9 or at least 10. Increasing the ratio of illumination increases even more the impression of 3D generated by the Pulfrich effect.
  • the arrangement does not comprise viewer glasses, i.e. glasses with polarization filters or with color filters.
  • the means for adjusting the brightness of at least a portion of each image of the second sequence comprises a controller configured to read calibration data. Adjusting brightness is easy to control.
  • the calibration data is provided by test-subjects or a photo sensor device configured to measure inter-eye luminance disparity, said photo sensor device comprising at least two photodiodes separated by a distance which is substantially the average human inter eye distance.
  • the photo sensor device provided in the display zone which is configured to measure the illumination ratio between a left and right photodiode so as to calibrate the system and adapt the first and/or second sequence of images so as to achieve the desired Pulfrich effect.
  • Test subjects in the display zone may also advantageously provide a quantitative parameter to further calibrate the intensity of the images of the first and/or second sequence to generate an optimal 3D illusion with the Pulfrich effect.
  • the calibration data comprises at least one of a look-up table storing a parameter related to the brightness setting of a projector and the inter eye luminance disparity, meta-data stored within the image data.
  • the storing of the calibration data in the form of a look up table allows to adapt the settings of the projector or the display as a function of various conditions, such as the inter eye luminance disparity, and thus the ratio of illumination 11/12.
  • the calibration data depends on at least one of a parameter characterizing a sequence of images, a qualitative parameter determined by a test-subject identifying a brightness level, a quantitative parameter computed with a photo sensor device, the surroundings of the arrangement such as the theater, the test subject, the brightness of the first sequence of images and/or the brightness of the second sequence of images, the horizontal speed of the moving object, the distance between the first part of the display surface and a viewer, the distance between the second part of the display surface and a viewer.
  • said quantitative parameter comprises at least one of the lowest of the two output signals of a photo- sensor device, the maximum value measured by the least illuminated photodiode for the first sequence of images (227), an average or median value of the signal measured by the least illuminated photodiode for the first sequence of images (227), a weighted luminance measured as the product of the maximum luminance achieved on the first part of the display surface when a white field is projected and the average pixel value for that image sequence, a weighted luminance of a sequence of images for a given display system acquired by computing the average pixel value or capturing the readings of a photo-sensor device.
  • the adaptation of the intensity of at least a portion of at least some images of the first or second sequence emitted from the first or second part respectively such that a ratio of illumination leaving the display surface for entering the second eye of the viewer compared to the first eye is at least of two is performed during the acquisition of the first and second sequence of images, during film editing, color grading, film production or in real time while displaying the first and second sequence of images.
  • intereye illumination disparity can be provided at various stages, such as during shooting of the images, during film editing, or even while displaying.
  • existing films or films with no intent of 3D can be easily adapted to be displayed with the illusion of 3D thanks to the Pulfrich effect, as long as there is a moving object in a scene, with the movement having one component parallel to the pupil plane.
  • No special camera is required to acquire images for generating the Pulfrich effect.
  • the adaptation of the intensity of at least a portion of at least some images of the first or second sequence of images in real time is performed by controlling at least one of the brightness setting of the projector, the intensity of at least a portion of the image data of the first and/or second sequence of images, the image data such as the pixel values and/or the color point and/or any other image characteristics which affect inter eye illumination disparity, the image content of the second sequence of images such that most or all bright pixels which are in the monocular field of view of the first eye of the viewer are dimmed.
  • the inter eye illumination disparity is monitored in real time with at least one of a photo-sensor device such that the displaying of the first and second sequence of images such that the intensity of at least a portion of at least some images of the first or second sequence emitted from the first or second part respectively is such that a ratio of illumination leaving the display surface for entering the second eye of the viewer compared to the first eye is at least of two.
  • a visual cue and/or audio cue configured to draw the attention of a viewer during the first sequence of images. It has been found that continuous 3D images can be tiring and that occasional 3D sequences for dramatic effect are preferred. Advantages of a visual or audio cue are to direct the attention of the viewer in the right direction so as to make him see the images with an optimized Pulfrich effect.
  • the audio cue is generated by a directional sound system.
  • the display surfaces further comprise a third part, said third part being configured to be in the monocular field of view of the first eye of the viewer.
  • the louver is incorporated in opera binoculars, in a mask, in glasses.
  • the display surface is at least one of an LCD, an LED, a projection screen, a back projection screen, an LED wall, a CRT or a plasma fixed format display.
  • the present invention also pertains to a method for displaying on a display surface having a first part and a second part, wherein said first part is configured to be in the binocular field of view of a viewer and at least a portion of said second part is configured to be in the monocular field of view the second eye of the viewer, said second eye being the left or the right eye, said first eye being the right or left eye, the method comprising the steps of displaying a first sequence of images in the first part of the display surface, said first sequence of images showing at least one picture element of the first sequence of images at some time in movement wherein the movement has at least a nonzero horizontal component comprised in the visual plane and parallel to the pupil line of the viewer,
  • the step of adapting to display the first and second sequence of images is performed during the acquisition of the first and second sequence of images, during film editing, color grading, film production or in real time while displaying the first and second sequence of images
  • Embodiments of the present invention also pertain to a photo- sensor device configured to measure a ratio of illumination, said photo sensor device comprising at least two photodiodes separated by a distance which is substantially the average human inter eye distance.
  • the photo- sensor is configured to be worn by a viewer.
  • the photo- sensor is configured to be placed in a display zone of a display system
  • the photo- sensor device is further configured to communicate with a controller for controlling in real time a first and second sequence of images emitted by a first and second part of a display surface.
  • the photo- sensor comprises means to communicate with a controller for adapting the displaying of the first and second sequence of images such that the intensity of at least a portion of at least some images of the first or second sequence emitted from the first or second part respectively is such that a ratio of illumination leaving the display surface for entering the second eye of the viewer compared to the first eye is at least of two.
  • the present invention also pertains to a method for calibrating an arrangement as described above with a photo- sensor device described above and comprising means for measuring a ratio of illumination between a left and right eye with a left and right photodiode, the method comprising the steps of measuring with a photosensor device a ratio of illumination between a left and right photodiode,
  • the method further comprises the step of storing in a look-up- table measurements obtained with a photo- sensor device for various locations in a display zone.
  • Figure 1 shows the binocular and monocular field of view for an average human being.
  • Figure 2 is a perspective view of an arrangement of a display for use with embodiments of the present invention, indicating the relative positions of a viewer; the light sources use to induce inter-eye luminance disparity and the display.
  • Figure 3 is a top view of an arrangement of a display for use with embodiments of the present invention, indicating the relative positions of a viewer; the light sources use to induce inter-eye luminance disparity and the display.
  • Figure 4a and 4b illustrate a principle of the invention in a first example.
  • Figure 5a and 5b illustrate a principle of the invention in a second example.
  • Figure 6a and 6b illustrate a principle of the invention in a third example.
  • Figure 7a and 7b illustrate a principle of the invention in a fourth example.
  • Figure 8a, 8b and 8c illustrate the concept of velocity for an image moving across a display.
  • Figure 9a and 9b illustrate the geometric construction to evaluate the perceived position of an object when the Pulfrich effect is induced.
  • Figure 10 shows the preferred positions for light sources according to embodiments of the present invention.
  • Figure 11 is a headset for viewing three dimensional effects according to an embodiment of the present invention
  • Figure 12 shows a perspective view of a headset according to embodiments of the present invention worn by a viewer.
  • Figure 13 illustrates one snapshot of a video sequence used to evaluate devices for viewing three dimensional effects according to embodiments of the present invention.
  • Figure 14 shows the geometrical construction illustrating what happens when the velocity of objects moving on the screen exceeds a critical limit.
  • Figure 15a, b, c and d show how the proposed embodiments of the present invention addresses the problems of 3D in an EscapeTM display system.
  • Figure 16 is a device for viewing three dimensional effects according to an embodiment of the present invention.
  • Figure 17 is an arrangement of a main projection screen and a lateral projection screen for use with embodiments of the present invention, wherein the main projection screen is in a binocular field of view of a viewer, and the lateral projection screen is in a monocular field of view.
  • Figure 18 is schematic top view of an arrangement of two screens for use with embodiments of the present invention, indicating the orientation and the distances of the screens and a main viewer.
  • Figure 19 is a main screen displaying a motion picture of a merry go round
  • Figure 20 shows a device for measuring inter-eye illumination disparity with two photodiodes according to an embodiment of the present invention.
  • Figure 20b is a side view of the device shown in Figure 20, further comprising a louver.
  • Figure 21 shows a schematic representation of an operational amplifier for use in the device according to embodiments of the present invention.
  • Figure 22a is a schematic top view representation of an arrangement of a front screen and lateral screen, wherein the front screen is in a binocular field of view of a viewer and displays a first sequence of images, and the lateral projection screen is in a monocular field of view of the viewer and displays a second sequence of images.
  • Figure 22b is a schematic representation of two projector projecting images on two walls meeting at a corner of a room, the projector projecting respectively a first and a second sequence of images simultaneously.
  • Figure 22c is a perspective view of Figure 22b.
  • Figure 22d is a representation of a curved display surface used and three projectors projecting images on the curved display surface in rear projection.
  • Figure 22e shows three front projection screens, comprising a left, central and right screen positioned next to each other as in an Escape display system, a viewer facing the central screen, and a schematic representation of the binocular field of view of the viewer and the left and right monocular field of view, with and without a louver.
  • Figure 22f shows three front projection screens, comprising a left, central and right screen positioned next to each other as in an Escape display system, a viewer facing the left screen, and a schematic representation of the right monocular field of view, with and without a louver.
  • Figure 22g shows three front projection screens, comprising a left, central and right screen positioned next to each other as in an Escape display system, a viewer facing the right screen, and a schematic representation of the left monocular field of view, with and without a louver.
  • Figure 22h shows a single planar projection screen used to induce Pulfrich effect, a viewer and a schematic representation of the left monocular field of view of the viewer.
  • Figure 23 shows a louver according to an embodiment of the present invention worn by a viewer.
  • Figure 24 is a schematic representation of a front projection display comprising three front projection screens and three projectors for use with embodiments of the present invention.
  • Figure 25 is a schematic representation of the display system of Figure 18 and 19 wherein measurements of the ratio 11/12 at the locations of the crosses performed with a device for measuring inter eye luminance disparity are provided.
  • Figure 26 is a schematic representation of a display system wherein the lateral screen is a front projection screen and measurements of the ratio 11/12 measured with the device for measuring inter eye luminance disparity is indicated next to the positions marked by a cross "x".
  • Figure 27 represents a black image displayed over the entire display area of a screen, shown in landscape mode.
  • Figure 28 represents a white image, the negative of Figure 27, displayed over the entire display area of a screen, shown in landscape mode.
  • Figure 29 is an image which is half black and half white, to be displayed over the entire display area of a screen, shown in landscape mode.
  • Figure 30 is the negative image of figure 29.
  • Figure 31 is an image of alternating narrow black and white stripes, to be displayed over the entire display area of a screen, shown in landscape mode.
  • Figure 32 is the negative image of figure 31.
  • Figure 33 is an image of alternating wide black and white stripes, to be displayed over the entire display area of a screen, shown in landscape mode.
  • Figure 34 is the negative image of figure 33.
  • Figure 35 is a checkerboard pattern image wherein the pads are black and white, to be displayed over the entire display area of a screen, shown in landscape mode.
  • Figure 36 is the negative of the checkerboard pattern image of figure 35.
  • Figure 37 illustrates the velocity vector V of picture element Px in a display surface represented in a Cartesian coordinate system having as horizontal coordinate axis the pupil line of the viewer and as vertical coordinate axis the vertical visual axis
  • Figure 38 is a schematic representation of a viewer V, the Cartesian coordinate system represented by axis VH, VRT attached to the viewer, the pupil line PL, the visual axis right (VAR), the visual axis left (VAL) and the visual plane (VP) of the viewer.
  • Figure 39 is a side view of the schematic representation of the viewer V shown in Figure 38, and the vertical axis VRT, and the visual axis VAR, VAL and the visual plane.
  • Barco EscapeTM is an arrangement of three display surfaces one immediately in front of a viewer and one on each side. Projectors are provided for projecting motion pictures onto the three display surfaces.
  • the display surfaces may also be emitting screens such as LED walls.
  • Binocular field of view The region of space seen by both eyes of a viewer at the same time. On figure 1, the binocular field of view covers the region I in front of the viewer.
  • Component of a vector: "component” will have the same meaning as in mathematics and physics. In particular, we will consider the components of a vector along the horizontal and vertical. In specific cases, we will consider the components of a vector along the bottom edge and the lateral edge of a screen. More generally will also consider the components of a vector in a reference system attached to the head of a viewer: a first component along the visual horizontal or pupil line and a second component along an axes perpendicular to the pupil line and the viewing plane. An example is given on figure 8c where the velocity V with which an object or picture elementis moving across a display surface.
  • the velocity V has a component Vx along an horizontal axis (parallel to the top and bottom edges of the rectangular display surface) and a component Vy along a vertical axis (parallel to the lateral edges of the rectangular display surface).
  • a picture element Px moves across a display surface DS with a velocity V.
  • the viewer's head is slightly tilted: the pupil line PL is not parallel with the top or bottom edges of the rectangular display surface (in most applications like cinema, home cinema etc... the display surface is rectangular with the right and left edges parallel to the local vertical and the top and bottom edges parallel to the local horizontal).
  • the pupil line PL and visual vertical VRT form a local system of reference attached to the face of the viewer.
  • the component V PL of the velocity V along the pupil line PL is obtained as usual in an orthogonal system of reference.
  • Display Throughout the description, the following terms relate to display surfaces: display, front projector display, display surface, display screen, lateral display, display surface, front projection screen.
  • lateral refers to screens positioned laterally with respect to a viewer and front or main refers to a screen positioned in front of a viewer when the viewer is seating in a regular theatre: .
  • a "display screen” can be a projection screen, an LCD screen, a LED display, a plasma screen, or any other fixed format display.
  • Horizontal In a typical display setting like e.g. a theatre or a home cinema, the left - right median of the display is in the horizontal plane, i.e. perpendicular to the local acceleration of gravity or the UP - DOWN direction indicated on Figure 2 and 3. In those cases, when the viewer is facing a screen, the horizontal direction is parallel to the top and bottom side of that screen. More generally, the horizontal direction for a viewer V is parallel to the pupil line. This can for instance be the case in a flight simulator, 4D cinema and amusement parks wherein the seats in which the viewers are positioned can be tilted.
  • Monocular field of view a region of space seen by one eye of a viewer and not the other eye of said viewer.
  • the monocular field of view II is a region of space seen by the right eye only.
  • the monocular field of view III is a region of space seen by the left eye only. This definition of the monocular field of view does not necessarily correspond to the generally adopted definition.
  • Motion picture A sequence of filmed images viewed in rapid succession so that the illusion of continuity and motion is created.
  • Projection Screen is a surface and a support structure used for displaying a projected image for the view of an audience.
  • Projection screens may be pieces of fabric typically coated to behave as closely as possible as a Lambertian emitter, as in a movie theater; the can be painted on the wall; they can be permanently installed and they can be portable with tripod or floor rising modes as in a conference room or other non-dedicated viewing space. Uniformly white or grey screens are used almost exclusively as to avoid any discoloration to the image, Screens can be further designed for front or back projection In a front projection system, the image source (e.g. a projector) is situated on the same side of the screen as the audience. In this description, a projection screen will be any surface (planar or otherwise) on which images can be projected.
  • Pupil Line Line drawn through the pupils of both eyes. See line PL on figure 38.
  • Pulfrich Effect is a psychophysical perception wherein lateral motion (i.e. from the right to the left or from the left to the right of an object in the field of view is interpreted by the visual cortex as having a depth component, due to a relative difference in signal timings between the two eyes.
  • Vertical a direction perpendicular to the horizontal. In a typical display setting, the vertical is parallel to the local acceleration of the gravity vector or in other words the direction of a plumb line. More generally, vertical means "visual vertical i.e. a line that is perpendicular to the viewing plane VP and the pupil line PL. See line VRT on figure 38 and 39.
  • Visual axis the straight line extending from the object seen, through the center of the pupil, to the ma cula lutea of the retina. Synonym: line of vision. See VAR (Visual Axis Right) and VAL (Visual Axis Left) on figure 38. Viewing Plane: a plane passing through the point of sight; specifically : the plane in which the visual axis of the two eyes lie in binocular vision. See VP on figure 38 and 39.
  • Picture element is part of an image or object displayed on or emitted from a display surface.
  • Inter eye distance (IED) or Interpupillary distance is the distance between the center of the pupils of the two eyes.
  • the average inter eye distance is 64.7 mm for male and 62.3 mm for female. It is usually in the range of 5 to 8 cm.
  • Intereve luminance disparity or intereve illumination disparity corresponds to the difference between the illumination entering one eye with respect to the illumination entering the other eye.
  • the ratio of illumination between the luminance entering one eye with respect to the other eye, 11/12 is also a measure of intereve luminance disparity.
  • An aspect of the current invention is to provide a device for viewing three-dimensional effects in at least one motion picture displayed on at least one display surface, according to the Pulfrich effect.
  • Such a device comprises means to cause inter-eye luminance disparity at the basis of the Pulfrich effect.
  • the device comprises at least one means for increasing the amount of light entering an eye of a viewer compared to the amount of light entering the other eye.
  • the means to cause inter-eye luminance disparity are preferably positioned in the monocular field of view of the viewer.
  • the binocular and monocular field of view of an average human being are represented on Figure 1 : the binocular field of view I spans an angle of approximately 100 degrees of angle in front of the viewer.
  • the right monocular field of view II of the viewer spans an angle of approximately 60 degrees of angle on the right side of the viewer and the left monocular field of view III of the viewer spans an angle of approximately 60 degrees of angle on the left side of the viewer.
  • At least one object in images displayed on the display surface is moving in a horizontal direction.
  • the principles of the invention will now be explained in more detail based on Figures 2 and 3.
  • the only source of light in the setting of Figures 2 and 3 are the display 1 and the light sources 3 and 4.
  • the viewer is facing towards the display 1, that the head of the viewer is straight-up and that the line joining the left eye and the right eye is parallel to LEFT - RIGHT median of the display 1.
  • the left - right median of the display is in the horizontal plane, i.e. perpendicular to the local acceleration of gravity or the UP - DOWN direction indicated on Figure 2 and 3.
  • the display shown on Figure 2 is for instance an LCD display or a plasma display but the invention also applies to LED displays, fixed format displays, rear and front projection systems etc...
  • the viewer 2 can see with both eyes.
  • the viewer 2 has the ad-hoc optical correction in the form of contact lenses or prescription glasses if needed.
  • both lens of the glasses or both contact lenses have the same transmittance or substantially the same transmittance (i.e. their transmittance vary by no more than 5% or preferably no more than 10% or preferably no more than 25%).
  • the viewer 2 is immobile with respect to display 1.
  • means for increasing the illumination on the right eye of the viewer and on the left eye of the viewer are provided by light sources 3 and 4 respectively.
  • the light sources are positioned in a monocular field of view of each of, respectively, the left and right eye.
  • light source 3 is in the monocular field of view of the right eye
  • light source 4 is in the monocular field of view of the left eye.
  • the Pulfrich effect can be induced by activating the light sources 3 and 4 differentially. This means that inter-eye luminance disparity is induced by having one of the light sources emitting more light than the other.
  • Light source 3 turned ON, light source 4 turned OFF
  • Light source 3 turned OFF, light source 4 turned ON
  • the amount of light reaching an eye of the viewer is at least twice the amount of light reaching the other eye of the viewer so as to induce inter-eye luminance disparity sufficient to let the viewer perceive 3D effects
  • 3D effects can be achieved when the amount of light reaching an eye of the viewer is 5 times or more the amount of light reaching the other eye of the viewer.
  • Viewing in 3D means that the viewer 3 will perceive (at least) part of the images displayed on display 1 as if they were in FRONT of display 1 and/or (at least) part of the images displayed on display 1 as if they were at the back of / behind display 1.
  • the amount of light reaching the eyes is:
  • LR light emitted by display 1 and reaching the right eye of viewer 2 + L3, the light emitted by light source 3 and reaching the right eye of viewer 2.
  • LE light emitted by display 1 and reaching the left eye of viewer 2.
  • inter-eye luminance disparity can be further amplified by the distribution of light emitted by the display. For instance, if the left side of the image on display 1 is black while the right side of the image on display 1 is white, the right eye can be more illuminated than the left eye by the display 1 itself. In some cases, it may be useful or needed to tailor the images being projected to optimize the inter-eye luminance disparity and the induced Pulfrich effect. The perception of the image of the house 5 being immobile with respect to the display and the viewer will not be affected by the Pulfrich effect.
  • the image of the aeroplane 6 moving with a velocity VP in the right to left direction the aeroplane will be perceived by viewer 2 as if it were in FRONT of display 1, i.e. closer to the viewer 2 than display 1.
  • FIGS 5a and 5b images of a house 5, not moving with respect to e.g. the sides of display 1, and a flying plane 6 moving from the right to the left of display 1 are displayed.
  • the light source 4 is turned off and does not emit light.
  • the light source 3 is turned ON and illuminates the left eye of viewer 2.
  • the amount of light reaching the eyes is:
  • LR light emitted by display 1 and reaching the right eye of viewer 2 + L3, the light emitted by light source 3 and reaching the right eye of viewer 2.
  • the perception of the image of the house 5 will not be affected by the Pulfrich effect because it is immobile with respect to the display and the viewer.
  • the house will appear to be in the plane of display 1.
  • the image of the plane 6 moving with a velocity VP in the left to right direction the plane will be perceived by viewer 2 as if it were at the BACK of / BEHIND display 1, i.e. further away from viewer 2 than display 1.
  • the amplitude d of the distance at which a moving object (the plane 6 in these examples) will be perceived behind or in front of the display 1 is function of (a) the amplitude of the inter-eye luminance disparity (i.e. LE-LR) as well as of (b) LE and LR, (c) the velocity VP of the moving object (and in particular the component of the velocity along the horizontal direction (dashed line H on e.g. Figure 4a), (d) the distance DO between the display 1 and the viewer 2 and very probably (e ) the visual system of the viewer 2 (by this we mean that while the biology of the visual system is the same for all human beings, different viewers in the same conditions may perceive the moving object at different distances dO).
  • the Pulfrich effect will occur even if the object moves diagonally across the screen. In other words, the effect will be present whenever (a) there is inter-eye luminance disparity and (b) the velocity of at least one object displayed on display 1 has a horizontal component i.e. a component along a direction parallel to the line joining the left eye and the right eye of the viewer 2.
  • Ax and Ay can be measured in meters or centimeters or even in number of pixels, whichever is more convenient in function of the display and the settings in which the display is used.
  • the image of a plane is displayed on display 1.
  • the image 6a of the plane is located in the lower left corner of display 1.
  • the image 6b of the plane is located in the upper right corner of display 1.
  • the displacement Ax and Ay are given for the tip of the nose cone of the plane for the sake of illustration.
  • the plane of the display is parallel with the local acceleration of gravity and the words horizontal and vertical have the usual meaning.
  • the Pulfrich effect is caused by a difference in response time between the right eye and the left eye .
  • the delay varies typically from a few ms when in a bright environment to tens of ms in a dark environment.
  • the delay can also vary in function of time (for instance with dark adaptation of the eyes).
  • the sequence of images being displayed on display 1 represents a point P moving from the left to the right of the screen. This time, the point P is perceived as if it were behind the display 1.
  • the means for inducing inter-eye luminance disparity are preferably provided for both eyes in the form of light sources and the light is increased on one side or the other of the viewer according to the movement of objects in the motion picture.
  • a control unit for increasing the illumination of the first and/or second light source according to command signals correlated to the displayed images of the displayed motion picture dependent upon horizontal movement of an object in the displayed images (optionally when at least one object is moving horizontally from left to right or right to left).
  • Real time motion detection algorithms may automatically detect a movement in the motion picture, and trigger the emission of command signals to the control unit, or the command signals can be pre-calibrated and emitted during the viewing of the motion picture.
  • This embodiment is preferable as the light emitted by the first and/or second light source may then be increased progressively before the movement starts so as to be clearly seen by the viewer while viewing the motion pictures.
  • metadata can be included in the files encoding the motion picture. Said metadata determines when to activate light source 3 or 4, with which intensity, when to deactivate the light sources etc.
  • Tests were carried out with solid state, e.g. LED light sources and incandescent light sources to illuminate preferentially one of the eyes of a viewer V looking at moving images on a screen.
  • the purpose of the tests was to determine whether or not it would be possible to induce the Pulfrich effect in a theater without using an absorbing filter in front of one of the eye of the viewers but instead to manipulate the light entering the eyes of the viewer directly and induce inter-eye luminance disparity.
  • This problem involved solutions depending on antagonistic parameters.
  • the solution had to be selective enough to allow illumination of one eye only (in order to induce a substantially different illumination of the retina of the left eye and the right eye) and applicable to a large audience of tens or hundreds of viewers.
  • the solution had also to be as unobtrusive as possible, which excluded the use of filters and the associated glasses.
  • the sought after solution had to keep the field of view of the viewer free. No discontinuity (caused by e.g. the rims of 3D glasses) was allowed in order not to spoil the immersive experience of the viewer.
  • a headset 91 seen on Figure 11 can be positioned on the head as seen on Figure 12.
  • the headset has two lateral arms 91a and 91b extending from the back of the head.
  • the extremities of the arms 91a and 91b are close to the eye of the viewer wearing the headset 91.
  • the extremity of each of the arms 91a and 91b supports a light source such as a solid state lamp of which an LED (Light emitting diode) is one example.
  • a light source such as LED 92 is fastened to the arm 91b and a light source such as LED 93 is fastened to the arm 91a.
  • Each light source such as an LED is connected to control electronics, e.g. on a Printed Circuit Board 95 by means of a cable such as a twisted cable pair 94 (shown only for light source, e.g. LED 92 on Figure 11).
  • the electronics can include a switch to activate either the light source such as LED 92 or the light source such as LED 93 which is controlled depending upon the horizontal motion on the screen to be viewed.
  • a connector 96 at the other end of the twisted cable pair 94 made it easier to connect and disconnect the light source such as the LED from the electronics, i.e. the PCB.
  • the electronics i.e.
  • the PCB may accommodate a battery support 97 (to accommodate e.g. 3 AAA or AA batteries 97b) or it may itself be provided with a cable such as a twisted cable pair to connect to a power supply.
  • the purpose of upper arm 91c is to help maintain the position of the lateral arms 91a and 91b.
  • the electronics i.e. PCB 95 accommodated two potentiometers 98 and 99, one for each of the light sources e.g. LED's on arms 91a and 91b.
  • the potentiometer was used to vary the amount of light emitted by the light source, e.g. LED 92 and 93.
  • Test subjects were requested to change the potentiometer settings to adjust the light level illuminating their eyes so that the Pulfrich effect would be visible without causing them discomfort. The tests were carried out with video sequences where images of objects moving in different directions are displayed.
  • the images displayed in the example of video sequence comprise three groups of objects A, B and C.
  • the objects in group A move from the right side of the screen towards the left side of the screen with velocities vl, y_2, v3.
  • the objects in group B move from the left of the screen to the right of the screen with velocities y_4, y_5, y_6 ....
  • the objects in group C either remain immobile or move in the vertical direction (i.e. from "DOWN” to "UP” or from "UP” to "DOWN") with velocities y7, v8, y9 ....
  • the velocities of the objects in the group A and B varied from zero at the beginning of the video sequence up to more than one thousand pixels per second (i.e.
  • the objects of group A appeared to move outside the plane of the display surface (i.e. the screen of the LCD display or the wall on which images were projected) and in front of the display surface while the objects of group B appeared to move behind the plane of the display surface.
  • Objects in the group C appeared to stay in the plane of the display surface and between the objects in group A and B.
  • the objects of group B appeared to move outside the plane of the display surface (i.e. the screen of the LCD display or the wall on which images were projected) and in front of the display surface while the objects of group A appeared to move behind the plane of the display surface.
  • objects in the group C appeared to stay in the plane of the display surface and between the objects in group A and B.
  • the amplitude of the effect increased with the velocity (the higher the velocity, the more pronounced the effect) and with the intensity of the light illuminating the eye.
  • the direction within which the collapse can occur depends on which eye is more illuminated than the other.
  • the critical velocity can be used to estimate the delay At induced by inter-eye luminance disparity. This allows us to establish Look-Up-Tables. For a set of display luminance (i.e. the amount of light emitted by the display and reaching the eyes of viewer 2), the delay At is evaluated for a set of luminance emitted by a light source (3, 4). The horizontal speed of objects moving through the screen can be measured directly. The intensity of the light emitted by the display 1 and reaching each of the eyes of viewer 2 can be measured with e.g. a photometer. In McGraw-Hill, Dictionary of scientific and technical terms, 6 th Edition, a photometer is defined as "Aw instrument used for making measurements of light or electromagnetic radiation, in the visible range. " When the viewer 2 experiences the collapse of the effect (as described earlier), it means the delay At induced by inter-eye luminance disparity is approximately equal to the ratio of IED, the distance between the left and right pupil, and the critical velocity VP critical:
  • the look-up table can be used to generate the metadata that will yield best results for a given video sequence on a given display and with given light sources 3 and 4.
  • the look-up table can be evaluated for different population groups, to take variations of the visual system from one group of individual to another.
  • the look-up table can for instance be established for e.g. viewers aged 10 to 20, viewers aged 20 to 30 ... and viewers aged 90 to 100. The results obtained for a test group are averaged and the lookup table then gives the necessary data to optimize the 3D effect. If a movie is made for "All Audiences", the look-up table can be established based on a group of test subject representative of the general population.
  • the display 1 used is a front projection display in a theater
  • the brightness of images projected on the screen will have a maximum brightness of 50 or 100 cd/m 2 .
  • the look-up table can be established e.g. for brightness varying from 0 to the maximum brightness by steps of 10 cd/ m 2 .
  • the delay At is evaluated in function of the light they emit or more easily the current with which they are driven or the duty cycle at which they are driven if Pulse Width modulation is used to control the output power of the light sources
  • the metadata is generated for the video scenes that are to be seen in 3D.
  • the metadata comprises for instance a start signal; information about which light source must be lit up and the PWM duty cycle at which the light source 3 and/or 4 will be driven.
  • the metadata comprises e.g. a stop signal.
  • the metadata can also contain information about the rate at which the duty cycle must increase or decrease (if the sources of light are controlled with Pulse Width Modulation).
  • the light sources 3 and 4 can generate white light or colored light.
  • the metadata can also contain information on the color that must be emitted by the light sources at a given time.
  • LCD displays with a refresh rate of 48 frame per seconds or more and with dimensions 60 mm X 35 mm; 310 mm X 17,5 mm and 890 mm X 500 mm.
  • Tests were also carried out with projection displays: a digital cinema projector DP2K-20C from Barco as well as a variety of smaller projectors used in meeting rooms.
  • the position of the light sources LED 92 and LED 93 is adjustable.
  • the test subject can move the light source, i.e. LED 92 forward and backward.
  • the light source e.g. the LED was soldered on a small PCB and the PCB fastened to the arm 91a by a ring that could slide along the arm 91a. This is not shown on Figures 11 and 12.
  • An alternative to a sliding mechanism to adjust the position of the light sources, e.g. LED 92 and 93 is to increase the area of the light source as shown on Figure 11.
  • the result is not as sensitive to the exact position of the headset.
  • the bottom of the cavity can be coated with a reflective layer (e.g.
  • the positions for the light sources, LED 92 and 93 that seem to be the best trade-off between the perceived amplitude of the Pulfrich effect and viewer experience (no or little negative sensation on nose etc ., no or little disturbance in the viewer's field of view) is close to the lateral cantus and at the level of or below the lateral hooding area of the eye (the light will reach the retina from the side) or below the lower eyelid (the light emitted by the LED will reach the retina from below the eye).
  • Tests were carried out with green, red, blue and white light sources, e.g. LEDs.
  • the test subject preferred the white and blue light source e.g. LED with a marked preference for the white light source, e.g. LED.
  • the light source e.g. LED is for instance a "cold white” LED with a maximum light output of less than 10 Cd.
  • Figure 24 gives a schematic representation of a front projection display comprising three front projection screens (2408, 2409 and 2410) and three projectors (2411, 2412 and 2413), each projector projecting an image on one of the three projection screens.
  • This display system corresponds to the Barco EscapeTM Display system. Generating any color in the visible part of the spectrum is included within the scope of the present invention. If used in conjunction with a Barco EscapeTM Display System (as illustrated on Figures 15a, 15b, 15c, 15d and Figure 24) it may be advantageous to match the color of the light emitted by one of the light sources, e.g.
  • LED 92 and 93 with a color of the images projected on the lateral screens. For instance, if a dominant color on the left side of a viewer is blue (e.g. a landscape with a blue sky is projected on the screen on the left of the viewer), the light source close to the left eye will be driven to emit a blue or bluish light).
  • the light source can be for instance a set of red and green light sources, such as Red Green and Blue LEDS with which different colors can be generated.
  • Those light sources, e.g. LEDs can be discrete LEDs associated to a diffuser or a multicolor LED.
  • the light emitted by a lateral screen and the light source e.g.
  • the intensity of the light illuminating the retina of e.g. the right eye results from light emitted by the light source, e.g. LED on the right side of the viewer, the light from the lateral screen on the right of the viewer, the front screen and any ambient light.
  • the total intensity being larger than the intensity caused by either source of light on its own, the perceived amplitude of the Pulfrich effect is greater.
  • the headset allows the positioning of other light sources below at the level of or below the lower eyelid and/or close to the medial canthus.
  • An extension of the arms 91a and 91b extends along the face of the viewer below the lower eyelid until the vicinity of the medial canthus. Additional sources of light can be positioned below the eyelid and/or close to the medial canthus on those extensions.
  • the light sources e.g. LED 92 and 93 are replaced by light funnels or light concentrators that collect the light emitted by one of the lateral screens in a Barco EscapeTM display system as on figure 17 and 18 (the angle between a lateral screen 8 or 10 and the central screen 9 is 102.5 degrees).
  • the light is collected and by refraction and/or reflection, it is directed towards the corresponding eye of the viewer (i.e. light of the lateral screen on the left of the viewer is redirected towards the left eye of the viewer and light of the lateral screen on the right of the viewer is redirected towards the right eye of the viewer).
  • the light funnel can be a hollow and flexible light guide. It can also be an optical fiber or a bundle of optical fibers (a full light guide).
  • the light guide can be a molded PMMA structure with a reflective coating on the outer surface.
  • Figure 15a illustrates how a viewer perceives an Escape display system when wearing filter glasses as they exist for 3D cinema.
  • the glasses introduce discontinuities 1520 and 1530 in the field of view.
  • Figure 15b illustrates how a viewer perceives an Escape display system when wearing a device according to the invention.
  • the light sources will be perceived as fuzzy blobs 1503 and 1504 at the limit of the visual field on the left and on the right.
  • Figure 15c illustrates the problem of wrong perspective that would occur in an Escape display system if anaglyphic images are projected for a viewer in a sweet spot.
  • a first viewer VI looks at the screen 1511 on which the anaglyphic image of a football 1540 under a table 1550. The perspective is correct.
  • Figure 15d is a top view of an Escape display system.
  • a point P is moving on the lateral screen.
  • the viewer VI sees the point P moving with a velocity VP1 in the plane of the screen.
  • FIG. 16 illustrates another embodiment of a device 1400 according to the invention.
  • the device comprises a support structure, which in this embodiment has the shape of a headband 1420 which goes behind the head of the viewer.
  • the headband has preferably two curved parts 1422 such that the headband goes around the ears, which increases the support.
  • the headband may further comprise in-ears loud speakers 1430 designed to penetrate partially inside the ears. This feature further increases the support of the support structure when carried by a viewer. It also allows the viewer to hear the soundtrack of the moving picture via the headset device.
  • the invention is not limited to in-ears loudspeakers and may comprise any type of loudspeaker used for headsets.
  • a compartment 1410, 1415 is foreseen, for example on each side of the device, for carrying a control unit, a receiver, and a power supply.
  • the power supply could also be on one side and the control unit with the receiver on the other side.
  • Light sources e.g. LEDs 92 and 93 are attached to the device 1400 by two plates 1440, 1450 respectively extending from compartments 1410, 1415. At an extremity of each plate 1440, 1450, two movable parts 1445, 1455 are attached to the plates preferably by a sliding mechanism.
  • the light sources, e.g. LEDs 92 and 93 are fixed to the movable parts 1445 and 1455 respectively, on the inner side such that when the device is carried, light emitted by the light sources, e.g. LEDs is going towards the viewer's eyes.
  • the movable parts 1445, 1450 are preferably capable of sliding on plates 1440, 1450 in horizontal direction such as to adapt to distance of the light sources, e.g. LEDs to the eyes when the device 1400 is carried by the viewer, and in a vertical direction such as to adapt the height of the light sources, e.g. LEDs 92, 93 with respect to the viewer's eyes.
  • the device of Figure 16 may be plugged directly in a viewer's seat, wherein two cables are provided: one for transmitting the audio signals, and one for transmitting the command signals.
  • the device 1400 comprises a wireless connection such as a WiFi connection or Bluetooth for 3D sound.
  • the command signals are transmitted to the device by an invisible radiation such as infra-red or other undetectable means such as a wireless connection , e.g. Bluetooth wavelengths, or ultrasound to change the light sources e.g. LEDs from one side to the other in dependence upon the horizontal motion of objects on the observed screen.
  • Metadata corresponding to the sequence of images displayed can be sent to device 1400 or 91 wirelessly.
  • the loud speakers are configured to provide soundtrack synchronized with the motion picture.
  • the sound transmitted provides three dimensional audio effects.
  • the techniques to render three-dimensional audio effects comprise binaural recording, and most preferably holophonicTM recording.
  • the means for increasing the illumination in a viewer's eye is incorporated directly in a viewer's seat, or in a "U-shaped head support pillow" attached to the seat.
  • the light source can be attached to a brass coil neck, incorporated in the seat, which is flexible and whose position can therefore be manually set by the viewer.
  • a head support could be included in the seat in order to provide additional comfort to the viewer but also to remove the disturbance generated by the light sources of neighbouring viewers. When a pillow is used, the latter could be fixed by quick fixing means, such as VelcroTM.
  • Directional lights suspended to the ceiling of the projection room might be activated selectively to illuminate both eyes of a viewer differently. If the lights are too directional, several lights are required to avoid a sweet spot. Those light adding to the ambient light, they will be responsible for a decrease of the contrast ratio which is undesirable. Furthermore, additional electronics is still required to activate the lights in synchronization with the images being projected.
  • a first example of how different areas of a display system can be used to induce the Pulfrich effect is illustrated on figure 17 and 18.
  • the 3D display according to the invention comprises at least two display surfaces, in the current example LCD displays.
  • a third display surface (given the reference number 176), or LCD display can be positioned on the left side as well but has been omitted for the sake of simplifying the description.
  • a viewer 173 faces the first display 171 at a distance Dl as seen on figure 18.
  • a second display 172 makes an angle (a) with the first display 171.
  • the second display 172 is on the right side of the viewer 173 as indicated on figure 18.
  • the second display 172 is at a distance D2 from the first display 171, the distance D2 is measured as indicated on figure 18.
  • the second display can also be shifted closer to the viewer; this shift is characterized by the distance D3 as indicated on figure 18.
  • the angle ⁇ is the angle beyond which objects on the right side will disappear from the field of view of the left eye.
  • the angle ⁇ is the angle beyond which objects on the right side will disappear from the field of view of the left eye.
  • the angle ⁇ may vary from individual to individual. For the test subjects who evaluated the display, ⁇ was in the interval 15 to 30 degrees.
  • the angle ⁇ may vary from individual to individual and from the position of the viewer. While not necessary, it may be advantageous to position the viewer with respect to the second display 172 so that it will be outside of the field of view of the left eye of viewer 173 in order not to illuminate the left eye directly (i.e. ray of lights emitted by the second display 172 do not reach the left eye in a straight line).
  • Means for increasing the amount of light entering one eye of the viewer is, in the current example, provided by display 172 itself.
  • the average luminance of display 171 was modified in three ways:
  • the image content e.g. an entirely black image is less bright than an entirely white image
  • the brightness can be increased or decreased by using keyboard shortcut like e.g. Fn J, or Fn ⁇ on a DELL Latitude E6420 laptop computer).
  • display 171 was the screen of a DELL LATITUDE E6420 laptop computer with a diagonal of 14 inches (the active display area being 310 mm X 175 mm), a 16:9 aspect ratio and a maximum average luminance of +/- 277 cd/m 2 .
  • Display 172 was an Acer AL718 with a diagonal of 17 inches (the active display area being 340 mm X 270 mm) and a maximum average luminance of +/- 200 cd/ m 2 .
  • the moving pictures used on display 171 to evaluate the Pulfrich effect were those of a merry-go-round (also known as carousel): the merry-go-round is seen from a lateral view (as seen on figure 19) and rotates at an apparent angular speed ⁇ of ⁇ /2 s "1 (or 90 degrees of angle per second) which amounts to say that the moving pictures have a period T of 4 s.
  • a merry-go-round also known as carousel
  • the direction of the movement in the plane of display 190 is from the right to the left from the viewer's perspective, the maximum amplitude A of the apparent movement in the plane of display 171 being 200 mm (that is, the position of given point of the image of the merry-go-round will vary between two extremes El and E2 on the screen of display 171, the maximum difference A between these two extremes for an outermost point of the merry-go-round being 200 mm or 2/3 of the width of the active display area).
  • El and E2 correspond to the tip of the left wing of an airplane- shaped nacelle 194.
  • the tests were carried-out in a closed room approximately 7 m X 5 m and 2.5 meter high.
  • the only light sources during the test were the screens of display 1 and display 2 to emulate the situation in a cinema.
  • the closest wall on the left side of the viewer was at approximately 2 meters from the viewer.
  • the closest wall behind the viewer was at approximately 1.5 meters from the viewer.
  • the table on which display 171 and 172 stood was covered by a dark, matte tablecloth to limit reflection of light originating from display 2 onto the left eye of the viewer.
  • Tests were carried out with different configurations.
  • Dl 1 m
  • D2 0 m
  • D3 0 m
  • a 155 degrees of angle.
  • Dl 0.8 m
  • D2 0.1
  • D3 0.3 m
  • a 120 degrees of angle.
  • Dl 0.6 m
  • D2 0.2
  • the contrast setting of display 171 was left at factory settings.
  • the image displayed on display 172 during the tests were a white field (i.e. entire image is white), a black field (i.e. entire image is black), a light gray field and a dark gray field.
  • the luminance of display 172 for these 4 images was evaluated: a white field
  • a black field corresponded to an average luminance of less than 5 cd/m 2
  • a light gray field corresponded to an average luminance of approximately 75 cd/m 2
  • a dark gray field corresponded to an average luminance of approximately 50 cd/m 2 .
  • the luminance of display 171 was evaluated on randomly selected still images in the moving pictures used to evaluate the Pulfrich effect. With a first filter positioned on the entire screen, the average luminance of the screen of display 1 appeared to be
  • the Pulfrich effect was perceived when the luminance of the light from display 172 entering one eye was 10 times higher or lower than the luminance of the light entering the other eye from display 171 and this for all configurations (in the first configuration, part of display 172 was still in the field of view of the left eye and a louver positioned on the dorsum of the viewer's nose was used to prevent light emitted by display 172 from reaching the left eye in a straight line.
  • the right eye being illuminated and the apparent motion of the nacelles on the screen of display 171 being directed from the right to the left, the nacelles (see figure 19) appeared in 3D, i.e.
  • the ratio of illuminations that enter one eye includes the ratio of the light from images on a first display surface 171 directly in front of the viewer combined with light from a lateral display surface 172 and any ambient light compared with the light entering the other eye from the first display surface 171 combined with light from the other lateral display surface 172 and any ambient light entering the other eye.
  • This ratio should preferably be greater than 2, more preferably greater than 5 and even more preferably greater than 9 for a more pronounced effect in particular when images displayed on display 1 are bright and/or when the amount of ambient or stray light that reaches the eyes of viewer 173 is of the same order of magnitude than the amount of light from display 171 that reaches the eyes of viewer 173.
  • the director of the film can select scenes that achieve this ratio or shoot scenes specifically to achieve this ratio in combination with one or more objects moving in a given directions so as to be perceived either closer to the viewer or farther away from the viewer than the display surface.
  • the test subject reported that the Pulfrich effect was perceptible at a ratio as low as 2.
  • the images can be projected on front projection screens, or back-projection screens.
  • the images can be displayed on Cathode Ray Tube displays, plasma displays, OLED and LED displays.
  • the displays do not necessarily need to be of the same type. For instance, tests were carried out with a liquid crystal display 171 and a rear projection display instead of the liquid crystal display 172. In other tests, a front projection display was used instead of the liquid crystal display 172.
  • the inter-eye illumination disparity can be generated in different fashions: a small display screen closer to a viewer may have the same effect on inter-eye illumination disparity as a large display screen farther away from the viewer.
  • Two photodiodes 201 and 202 are used to measure the amount of lights that reach two points distant of +/- 6 cm, or more preferably to the average Inter Eye Distance or distance between the left eye and right eye of a human being.
  • the photodiodes 201 and 202 are mounted on a (planar) printed circuit board 204.
  • a profile 203 (e.g. in cardboard) is positioned between the photodiode 201 and 202 and fastened to the printed circuit board 204.
  • the profile 203 mimics the effect that the nose and forehead in a human face have on the light distribution on the face and the eyes in particular.
  • the photosensitive plane 205 of the photodiode is parallel to the plane of the printed circuit board 204.
  • the cardboard profile 203 may be limited to a rectangle or be a profile of a viewer as illustrated on figure 20B.
  • the profile can be modified to include a louver as is the case with the profile 203B on figure 20B.
  • the photodiodes were BPW34 manufactured by Osram Opto Semiconductor and Vishay.
  • the photodiodes can be adapted for human eye sensitivity and be (even) more representative of what a human being will perceive.
  • "Adapted to the human eye sensitivity" means that the photodiode is equipped with optical correction filters that offer the sensor a spectral responsivity function that corresponds to the rods and cones of the human eye.
  • Their signal was amplified with an operational amplifier 206, 207 having resistors 208, 209 respectively (e.g. LM324 from Texas Instruments) as illustrated on figure 21 for the left and right photodiodes respectively.
  • the resistance of each of the feedback resistors R204 and R205 is 1.2 ⁇ with a 5% tolerance.
  • the sensitive part of both photodiodes is oriented identically.
  • the photosensitive part is parallel to the plane of the printed circuit board.
  • the device 200 is held with the photosensitive parts (the face 205A and 205B of the photodiodes in the example of figure 20) facing in the same direction as the viewer, so as to capture light in the same way as the eyes of a viewer.
  • the photosensitive parts the face 205A and 205B of the photodiodes in the example of figure 20
  • a more complex version of the device 200 allows modifying the position of the photodiodes independently of the profile 203 and the PCB 204.
  • the photodiodes can be rotated with respect to the printed circuit board 204 to evaluate inter eye illumination disparity when the fixation point varies while the position of the viewer's head remains fixed with respect to the display surface(s).
  • the output signal varied from a few mV to several hundreds.
  • the contribution of stray light to the output signal of the operational amplifier amounted to up to lOmV.
  • the images used were either black and white or color. As would be expected, images where most of the pixels were "black" (like a black background with a handful of bright pixels representing asteroids moving across the display surface) yielded good results.
  • the output signals can be used to determine the photocurrent and, using the quantum yield, the number of photons reaching each eye. This can in turn be used by the technicians, engineers, artists involved in postproduction or computer graphics animation to determine a desired brightness for the images to be projected on the front screen and the lateral screen,
  • inter-eye illumination disparity can be evaluated by e.g. a camera (still or video) to take images of a viewer's face looking at a first display like 171 while a second display like 172 illuminates the right side of the viewer's face.
  • a camera still or video
  • An analysis of the pixel values at and/or around the position of the pupils on the (still of video) image(s) of the viewer' s face will yield information on the amount of light that reaches the left and right eyes of the viewer.
  • a device 200 was used to evaluate inter-eye illumination disparity with different types of display.
  • Figure 25 gives the result for a display system comparable to the display system of figure 17 and 18.
  • the first display is an LCD display 251 (e.g. a DELL Latitude E5570) and the second display is a rear projection system.
  • the dimensions of the rear projection screen 252 are 100 cm by 70 cm.
  • the projector 253 is a B1M from ASUS.
  • the LCD display was positioned in the middle and against a diffusing surface 254 having the same dimension as the rear projection screen 252.
  • the diffusing surface 254 was adjacent to the rear projection screen forming an angle between 90 and 100 degrees with the rear projection screen. The measurements were done at various positions indicated by a cross on figure 25.
  • the value of the ratio 11/12 corresponding to a position is indicated next to that position on the figure. II is the output signal of the photodiode most illuminated and 12 the output signal of the photodiode least illuminated (i.e. the photodiode shielded by the cardboard profile 203).
  • the device 200 is represented in the position it is to take measurements: the line joining both photodiodes 201 and 202 being horizontal and perpendicular to the rear projection screen 252.
  • a white field was projected on the rear projection screen while a test sequence was displayed on the LCD display.
  • Figure 26 gives results for a system where the lateral screen is a front projection screen.
  • the dimensions of the screens are 350 cm by 200 cm.
  • the gain of the screen was estimated to be approximately 0.7.
  • the device 200 is represented with the line joining the two photodiodes being horizontal and perpendicular to the projection screen.
  • the screen to which the viewer would be facing would be at an angle (e.g. perpendicular) to the display surface 261 (either on the lfet or on the right).
  • the " front" screen was an LCD screen placed either to the left or to othe right of 261 and perpendicular with it or with an angle > 90 degrees.
  • the ratio 11/12 is indicated next to the positions marked by a cross "x".
  • the test sequence used to evaluate the perception of depth caused by the Pulfrich effect was similar to that of figure 13: colored squares moving in different directions (from right to left, from left to right and from top to bottom) on a black background.
  • the side of a colored square is less than one 20 th of the side of the LCD display.
  • the speed was varied from zero to more than 1000 pixels per second.
  • the amplitude of the effect depended on the position of the viewer (the higher the ratio 11/12, the more pronounced the effect).
  • a first sequence of images is projected in a first part of a display surface, the first part of the display surface being visible by both eyes of a viewer;
  • a second image or sequence of images is projected simultanesouly to the first sequence of images in a second part of the display surface, the second part of the display surface being in a monocular field of view of the viewer;
  • thhe first sequence of images comprises at least one picture element moving across the first part of the display surface, the movement having a non zero component parallel to the pupil line of the viewer, and if the ratio (ill+il2)/ill is high enough to induce the Pulfrich effect, the viewer will perceive the at least one picture element as if it were closer or further away from the viewer than the display surface.
  • a louver positioned on the nose of the viewer to increase inter-eye illumination disparity by limiting the field of view of each eye to the opposite side: the louver limits the field of view of the left eye to the right and the louver limits the field of view of the right eye to the left.
  • two liquid crystal displays 221 and 222 are used.
  • a viewer 223 is facing the first display 221 and images displayed on the first display 221 are visible to both eyes 224 and 225 of viewer 223.
  • a first sequence of images is displayed on the first display 221.
  • a second image or sequence of images is displayed simultaneously or concurrently to the first sequence of images on the second display 222.
  • the second display screen is in the right monocular field of view 226 of viewer 223.
  • LL light emitted by display 221 and reaching the left eye of viewer 223.
  • LR the light emitted by display 221 and reaching the right eye of viewer 223 + light emitted by display 222 and reaching the right eye of viewer 2.
  • LR - LL the amount of light emitted by display 223 and reaching the right eye, which is different from zero when images are displayed on the display screen 223.
  • the amount of light reaching the left eye and the right eye can be evaluated with a device 200. As the amplitude of the inter-eye luminance disparity increases, the amplitude of the Pulfrich effect will increase.
  • a projector 230 projects images on walls 229a and 229b meeting at a corner 229 of a room.
  • the projector 230 projects a first sequence of images 227 on wall 229a and at the same time an image or sequence of images 228 on wall 229b.
  • the image of an asteroid 232 is moving from left to right on wall 229a within the binocular field of view of viewer 223.
  • an image 228 of a brighter object e.g. a sun 233 is projected on wall 229b.
  • the image 228 can be static or dynamic.
  • the image 228 is in the right monocular field of view 226 of viewer 223.
  • FIG. 22c A perspective view of the walls and the projected images is shown on figure 22c.
  • the leftmost boundary of the right monocular field of view 226 is indicated by the dashed line 231 on wall 229b.
  • a curved display surface is used (as e.g. a cylindrical screen or an hemispherical "dome" rear projection screen).
  • the display surface 240 is a rear projection screen.
  • Two or more projectors 241, 242, 243 project images on the back projection screen 240.
  • inter-eye illumination disparity is obtained by projecting a first sequence of images in the binocular field of view of the viewer 223 and a second image or sequence of images in a monocular field of view 226b of the viewer 223.
  • figure 22d shows the wider monocular field of view 226b that can be obtained by positioning a louver 250 on the nose of the viewer as illustrated on figure 23.
  • test subjects #1, #2, #3... each look at the images of an asteroid 232 moving across the surface of the rear projection screen 240. Keeping their gaze on the central part of the screen
  • Each test subject can control the light sources of projectors 241, 242 and 243 with e.g. control knobs.
  • control knobs e.g. a few dim pinpoint-like stars are projected by projector 241.
  • a test subject is requested to keep looking in direction A to make sure that the images projected by projector 243 remain in the right monocular field of view of the test subject.
  • the brightness of the images 227 projected by projector 242 can be controlled with a first control knob.
  • the brightness of the images 228 projected by projector 243 can be controlled with a second control knob.
  • the control knobs are either graduated in known units (e.g. the maximum luminance that can be expected at that setting when a white field is projected), relative units (e.g. a scale from 1 to 10 as is for instance the case with a projector B1M from ASUS) or even Fuzzy terms like VERY DARK, DARK, MEDIUM, BRIGHT, VERY BRIGHT and known from Fuzzy Logic.
  • Each test subject in turn can modify the settings of projectors 142 and 143 to optimize the Pulfrich effect.
  • a look-up table is preferably generated for each test subject (as e.g. can be the case for an arcade game where a player can personalize the game by saving settings of the game and/or the display system. The settings are advantageously retrieved every time the player uses the arcade game).
  • test subjects can adjust the brightness settings of projector 143 only.
  • the setting of projector 143 is recorded in a look-up table.
  • Each sequence of images 227 is characterized by at least one quantitative parameter or a qualitative parameter.
  • the parameter can be e.g. the maximum value measured by the least illuminated photodiode during the image sequence 227 (in other words, the contribution of image 227 only to the photo- sensor outputs).
  • the parameter can also be an average or median value of the signal measured by the least illuminated photodiode during the image sequence 227.
  • a "weighted luminance” i.e. the product of the maximum luminance achieved on screen by projector 142 when a white filed is projected (e.g. 50 or 100 cd/m 2 ) and the average pixel value for that image sequence.
  • the value of the parameter is either determined by a controller or by the test subject.
  • a controller can be a human operator that e.g. keep records of the parameter that characterizes a scene or a data processing unit like a computer that can e.g. compute the weighted luminance of a sequence of images 227 for a given display system by computing the average pixel value or capturing the readings of a photo-sensor device like the device 200.
  • the controller can also adjust the images projected (e.g. the brightness setting of a projector or even the image data) in function of a look-up-table in order to optimize the Pulfrich effect or as a function of the readings of the photo sensor device.
  • the photosensor device is configured to communicate with the controller.
  • the adjustment can be done in real time or can be done in post-production. If done in post-production, the adjustment required can be stored as meta-data together with the image data. If necessary, the meta-data can be made theater dependent (since different wall covers and screens can impact the light distribution and as a result the inter-eye illumination disparity).
  • test subject can enter a quantitative parameter when prompted by the controller.
  • the test subject can modify the settings, e.g. the brightness of the image projected by projector 143. Once the test subject deems the result satisfactory, the brightness setting B0 of the projector is saved. Next to the brightness settings, the image data can be modified (modify the pixel value and/or the color point and/or any other image characteristics that will affect inter eye illumination disparity.
  • the results obtained for a group of test subjects can be processed to generate a look-up table like the one of Table 1
  • the parameter P is qualitative and the brightness setting ranges from 1 to 10 as is the case for projectors like e.g. the B1M from ASUS.
  • the controller can adjust the brightness setting of the projector 143 in function of the measured inter eye illumination disparity.
  • the attention of a viewer 223 is drawn to the sequence of images 227 by use of a visual and/or audio cue.
  • the audio cue is preferably generated by a directional sound system like e.g. Auro-3D or IOSONO's wave field synthesis. Sounds generated by these technologies can be made to appear as if originating from a given point of the display surface and in particular the moving object in the sequence of images 227.
  • the controller has a good estimate of which part of the display surface is in the binocular field of view and which part of the display surface is in the (right) monocular field of view of viewer 223. If the images projected by projector 143 can be modified on the fly by the controller, the image content of images 228 can be modified to exclude most or all bright pixels that would not be in the (right) monocular field of view 226 (or 226b when a louver 250 is used).
  • images projected on the lateral screen 263 are in the right field of view 226 (or 226b when a louver 250 is used) of the viewer 223.
  • Images 228 projected on the right lateral screen 263 can be used to generate inter eye illumination disparity when an image sequence 227 is projected on the central screen.
  • images 228 projected on the left lateral screen 261 can be used to generate inter eye illumination disparity when an image sequence 227 is projected on the central screen.
  • the viewer 223 looks at the left screen 261.
  • images projected on the central screen are in the right field of view 226 (or 226b when a louver 250 is used) of the viewer 223.
  • Images 228 projected on the central screen 262 can be used to generate inter eye illumination disparity when an image sequence 227 is projected on the left lateral screen 261.
  • the viewer 223 looks at the right lateral screen 263.
  • images projected on the central screen are in the left field of view 256 (or 256b when a louver 250 is used) of the viewer 223.
  • Images 228 projected on the central screen 262 can be used to generate inter eye illumination disparity when an image sequence 227 is projected on the right lateral screen 262.
  • a single planar projection screen can be used.
  • directional screens can be used to further improve the system. Examples of such screens are described in e.g. WO2015036501 "Multiscreen projector settings" which is incorporated herewith in its entirety.
  • the lateral display surfaces 261 and 263 are each at an angle to the front display surface 262 and can be configured so to reflect light projected onto them predominantly or exclusively in one or more angular ranges that do not intersect with the first display surface 262.
  • the lateral screens can for instance be lenticular screens.
  • Such directional screens decrease the cross talk between the lateral screens and the central screen as well as better direct the light of a lateral screen towards the corresponding eye of the viewer 223 (i.e. light from the lateral screen on the right of the viewer towards the right eye of the viewer and light from the lateral screen on the left of the viewer towards the left eye of the viewer).
  • directional screens there will be less reflections (that can be considered as stray light) which will help increasing the inter-eye illumination disparity.
  • the difference in light intensity illuminating the right eye and the left eye is preferably a factor 5 and preferably a factor 10 to induce the Pulfrich effect significantly.
  • a lower difference in light intensity may still induce a Pulfrich effect albeit not as pronounced.
  • At least one test subject reported a difference in how he perceived the images and that the moving pictures appeared more lifelike with lateral illumination than without lateral illumination. This indicates that a positive impact on the viewer's experience may be expected as long as light emitted by one of the lateral screens will illuminate preferentially one of the eyes of the viewer as described earlier.
  • viewers located at different positions with respect to the screens may experience the Pulfrich effect (for images like the first sequence of images projected on e.g. the central screen) differently but they are expected to perceive it at various degree as long as the lateral screen on their left is in the monocular field of view of their left eye and/or as long as the lateral screen on their right is in the monocular field of view of their right eye.
  • a higher difference between the light intensity illuminating the (retinas of the) left eye and the right eye by a factor 10 or more will induce a more pronounced effect.
  • Such differences in light intensity are for example achievable either for very dark central images and / or for displays with high and very high dynamic ranges (for example with minimum luminance lower than 5 and preferably 1 cd/m2 and maximum luminance higher than 50 cd/ m2 and preferably higher than 100 cd/m2). This is expected to be the case for large LED displays used in lieu of projection screens, tiled LCD displays and new generations of HDR (High Dynamic Range) projection displays for which the maximum luminance is at least 100 cd/m2.
  • high and very high dynamic ranges for example with minimum luminance lower than 5 and preferably 1 cd/m2 and maximum luminance higher than 50 cd/ m2 and preferably higher than 100 cd/m2.
  • the central display 1 can be a projection screen and the lateral screens can be LCD displays or LED displays.
  • the Pulfrich effect was seriously affected for Tl > Is, moving objects being alternatively perceived in front of the screen (when the image on the lateral display surface was bright) or within the plane of the screen (when the image on the lateral screen was dark).
  • the Pulfrich effect was somewhat affected for Tl between 0.5 s and Is and the Pulfrich effect being less and less affected as Tl further decreased below 0.5 s.
  • Tests were also carried out where the average luminance of the image displayed on screen was more or less constant even though the image varied with time. In the tests, a first image was displayed for a time Tl and was followed by a second image for a time T2 and the sequence was repeated for up to 30 seconds. In those tests, Tl was always equal to T2.
  • the test subject reported that the sequence of images displayed on the lateral screen affected the perception of the Pulfrich effect less and less as the distance between the lateral screen and the test subject (e.g. the viewer 223 on figure 22e) increased. In particular, this was true for the images seen on Figures 29 and 30 (where the left half of the screen is white and right half of the screen black for a time T and the left half of the screen turns black and the right half of the screen turns white for a time T).
  • the distance between lateral display and test subject had less and less impact on how the Pulfrich effect was perceived when the "patches" of images for which the luminance varied were small when compared to the area of the lateral display surface within the monocular field of view of the viewer on the same side as lateral display surface. For instance, cycling through images seen on figure 31 and 32 had less impact than cycling through images seen on 33 and 34. A test subject reported that cycling through images seen on figure 35 and 36 had hardly any effect.
  • the impact of the distance between the lateral display and the corresponding eye of the viewer is linked to the monocular field of view of that eye. Indeed, in an extreme case, with images like those on figure 29 and 30, depending on the precise position of the viewer facing the central display, the eye will see the white (bright) part of the image (and not the other half) for T second and will see the black (dark) part of the image for the next T seconds.
  • the entire image displayed on the lateral display was within the monocular field of view of the eye on the same side of the viewer as the lateral screen.
  • the luminance over the entire screen of display 172 being constant, so is more or less the intensity of the light reaching the retina of the eye.
  • the lateral screen in the field of view of at least one viewer close to the lateral screen would be predominantly filled in by a part of the screen where large variations of luminance will occur (hence the inter-eye illumination disparity would fluctuate between values that are enough to induce the Pulfrich effect and values that are not enough to induce the Pulfrich effect and this during a scene for which an uninterrupted Pulfrich effect is desired for a given time interval).
  • a display system comprising a first display for displaying images for a viewer looking at the display; a first light source positioned on the left side of the viewer and a second light source positioned on the right side of the viewer, wherein the first and second light sources are controlled by a control unit for controlling the amount of light emitted by the first and second light source so as to create 3D images according to the Pulfrich effect by inducing inter-eye luminance disparity.
  • a display system according to item 1 further characterized in that the amount of light reaching an eye of the viewer is at least twice the amount of light reaching the other eye of the viewer.
  • a display system according to item 1 or 2, wherein the amount of light reaching an eye of the viewer is at least 5 times the amount of light reaching the other eye of the viewer.
  • a display system further characterized in that the first light source is in the right monocular field of view of the viewer and the second light source is in the left monocular field of view of the viewer.
  • the display surfaces comprise at least one of an LCD, an LED, a projection screen, a back projection screen, an LED wall, a CRT or a plasma fixed format display.
  • the first and second light sources emit at least one of white, red, green, blue light or any combination thereof.
  • the at least one of the first and second light sources is positioned in a proximity of respectively the left and right eye.
  • a display system wherein the at least one light source is positioned adjacent to the lateral cantus, at the level of or below the lateral hooding area of the eye, or at the level of or below the lower eyelid or close to the medial canthus.
  • An arrangement comprising a display system according to any of the items 1 to 8, wherein the control unit is adapted to receive command signals correlated to the displayed images according to the horizontal moving direction of the at least one object.
  • said command signals are transmitted by at least one of infrared light, or radio wavelengths or ultrasonic or infrasonic sound.
  • Arrangement according to item 9 or 10 wherein at least one of the first and second light sources for inducing inter-eye luminance disparity is positioned in a monocular field of view of respectively the left and right eye.
  • a device for viewing three-dimensional effects in at least one motion picture displayed on at least one display surface comprising :
  • first and second means for increasing the illumination are controlled by a control unit for controlling the amount of light entering the left and right eye so as to create 3D images according to the Pulfrich effect by inducing inter-eye luminance disparity.
  • Device 14
  • the first and second means for increasing the amount of light comprise at least one light source positioned in a proximity of respectively the left and right eye.
  • control unit is adapted to receive command signals correlated to the displayed images of the at least one motion picture according to the horizontal moving direction of the at least one object.
  • command signals are transmitted by at least one of ultrasonic sound, or infrasonic sound.
  • At least one of the first and second light sources is positioned in a monocular field of view of respectively the right and left eye.
  • the at least one light source is a solid state light source or is an incandescent source.
  • said at least one light source emits at least one of white, red, green, blue light or any combination thereof.
  • said at least one light source is a set of discrete LEDs associated to a diffuser or a multicolor LED.
  • the at least one light source is positioned in a proximity of respectively the left and right eye.
  • the at least one light source is for positioning adjacent to the lateral cantus, at the level of or below the lateral hooding area of the eye, at the level of or below the lower eyelid or close to the medial canthus.
  • the first and second light sources are mounted or attached by fixing means to a support structure adapted to maintain the first and second light sources in a constant position relative to the head of the viewer.
  • the support structure is one of a tiara, hard headband, cloth headband, plastic headband, wherein the headband goes over or behind the head, headphones, earphones, glasses, goggles, security glasses, hat, helmet, head accessory, or any type of hair accessory.
  • the support structure is configured to maintain a louver, which, when the support structure is placed on a viewer's head, the louver is positioned close to the root and/or dorsum of the nose.
  • the control unit is configured to be attached by fixing means or is mounted to said support structure.
  • Device Device according to item 29 or 30, wherein the first and second light sources comprise means for collecting light emitted by the first and second lateral screens of the Barco EscapeTM projection system.
  • a reflecting surface fastened to the support structure of a device positioned adjacent to the root and dorsum of the nose to reflect light into the eye.
  • Device Device according to any of items 13 to 33, wherein the device further comprises a light sensor for measuring the ambient light.
  • control unit further comprises means to control the intensity of the illumination provided by the means for increasing the light entering an eye as a function of the ambient light provided by the sensor.
  • control unit is further configured to establish a look-up-table in which the delay At induced by inter-eye luminance disparity is evaluated for a set of luminance vales emitted by a light source.
  • the brightness varying from 0 to a maximum brightness by steps of 10 cd m 2 , the maximum brightness being comprised in the range of 50 to 100 cd m 2 .
  • the third display surface being positioned in front of the viewer
  • the first display surface being positioned so that the viewer has the first display surface on a right side
  • the second display surface being positioned so that the viewer has the second display surface on a left side;
  • first and second means for increasing the illumination are controlled by a control unit for automatically switching between the first and second ratios, so as to create 3D images according to the Pulfrich effect.
  • the first and/or second ratio is 5 or more or at least 9 or at least 10.
  • the control unit is adapted to receive command signals correlated to the displayed images according to the horizontal moving direction of the at least one object.
  • said command signals are transmitted by fat least one of infrared light, or radio wavelengths or ultrasonic or infrasonic sound
  • the first and second means for increasing the illumination further comprise at least one light source positioned in a monocular field of view of respectively the left and right eye.
  • the at least one light source is any of the first to third display surface.
  • the display surfaces comprise at least one of an LCD, an LED, a projection screen, a back projection screen, an LED wall, a CRT or a plasma fixed format display.
  • a louver is provided for positioning on the dorsum of the viewer's nose
  • the at least one light source is an incandescent source.
  • the first means for increasing the first ratio and/or the second means for increasing the second ratio comprises at least one light source.
  • said at least one light source emits at least one of white, red, green, blue light or any combination thereof.
  • the first means for increasing the first ratio and/or the second means for increasing the second ratio comprises at least one light source positioned in a proximity of respectively the left and right eye.
  • the at least one light source is positioned adjacent to the lateral cantus, at the level of or below the lateral hooding area of the eye, or at the level of or below the lower eyelid or close to the medial canthus.
  • a device for viewing three-dimensional effects in at least one motion picture displayed on at least one display surface comprising:
  • first and/or second ratio is five or more or at least nine and the first and second means for increasing the illumination are controlled by a control unit for automatically switching between the first and second ratios, so as to create 3D images according to the Pulfrich effect.
  • control unit is adapted to receive
  • command signals correlated to the displayed images of the at least one motion picture according to the horizontal moving direction of the at least one object.
  • said command signals are transmitted with an invisible light, radiofrequency waves.
  • said command signals are transmitted by at least one of ultrasonic sound, or infrasonic sound.
  • the first and second means for increasing the first and second ratio further comprise at least one light source for being positioned in a monocular field of view of respectively the right and left eye.
  • the first and second means for increasing the first and second ratio comprise at least one light source.
  • the at least one light source is a solid state light source or is an incandescent source.
  • said at least one light source emits at least one of white, red, green, blue light or any combination thereof.
  • said at least one light source is a set of discrete LEDs associated to a diffuser or a multicolor LED.
  • the at least one light source is positioned in a proximity of respectively the left and right eye.
  • the at least one light source is for positioning adjacent to the lateral cantus, at the level of or below the lateral hooding area of the eye, at the level of or below the lower eyelid or close to the medial canthus.
  • the first and second means for increasing the first and second ratio are mounted or attached by fixing means to a support structure adapted to maintain the first and second means for increasing the first and second ratio comprise in a position relative to the head of the viewer.
  • the support structure is one of a tiara, hard headband, cloth headband, plastic headband, wherein the headband goes over or behind the head, headphones, earphones, glasses, goggles, security glasses, hat, helmet, head accessory, or any type of hair accessory.
  • Device configured to maintain a louver, which, when the support structure is placed on a viewer's head, the louver is positioned close to the root and/or dorsum of the nose.
  • the control unit is configured to be attached by fixing means or is mounted to said support structure.
  • the fixing means can be at least one of glue, magnets, clipping mechanism, VelcroTM.
  • a mobile phone is used to receive command signals and control the first and second means for increasing the first and second ratio.
  • Device according to any of the items 59 to75, wherein said device is used in conjunction with a Barco EscapeTM projection system comprising a first and second lateral screens and a third main screen .
  • a Barco EscapeTM projection system comprising a first and second lateral screens and a third main screen .
  • the color of the at least one light source is selected to match a color of the images projected on the first and/or second lateral screens.
  • the first and second means for increasing the first and second ratio comprise means for collecting light emitted by the first and second lateral screens of the Barco Escape projection system.
  • Device according to item78, wherein the means for collecting light emitted by the first and second lateral screens comprise a hollow or full light funnel.
  • first and second means for increasing the first and second ratio further comprise a reflecting surface fastened to the support structure of a device positioned adjacent to the root and dorsum of the nose to reflect light into the eye.
  • the reflecting surface is an integral part of a louver for positioning on the dorsum of the nose of the viewer.
  • the apparatus is powered and command signals are transmitted by light projected on the lateral screens.
  • the device further comprises a light sensor for measuring the ambient light.
  • control unit further comprises means to control the intensity of the illumination provided by the means for increasing the light entering an eye as a function of the ambient light provided by the sensor.
  • control unit further comprises means to control the intensity of the illumination provided by the means for increasing the light entering an eye as a function of the ambient light provided by the sensor.
  • light projected can be infra-red light projected by one of the projectors or by a dedicated infra-red projector.
  • Device according to any of the items 59 to 85 used in conjunction with an emissive display. A method of using the device according to any of the items 59 to 86, for viewing three dimensional images according to the Pulfrich effect.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

La présente invention concerne des systèmes et des dispositifs destinés à des images animées ayant un certain effet 3D, ainsi qu'un procédé et un agencement permettant de produire des images animées ayant un certain niveau d'effet tridimensionnel lorsqu'elles sont visionnées par au moins certains observateurs. Selon certains modes de réalisation, la présente invention a pour avantage de permettre de voir ces images en 3D sans porter ni lunettes ni autre dispositif. Des modes de réalisation de la présente invention résolvent le problème provoqué par la génération d'images 3D alors que l'observateur porte des lunettes. Des modes de réalisation de la présente invention peuvent produire des images 3D sans interruptions.
PCT/EP2016/072208 2015-09-18 2016-09-19 Afficheur 3d et procédé de fonctionnement associé WO2017046423A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
GB1516604.4A GB2542416A (en) 2015-09-18 2015-09-18 A 3D display and method of operation thereof
GB1516604.4 2015-09-18
CN201621070487.1U CN206674125U (zh) 2015-09-18 2016-07-28 一种显示系统、包括该显示系统的设备以及观看装置
CN201621070487.1 2016-07-28

Publications (1)

Publication Number Publication Date
WO2017046423A1 true WO2017046423A1 (fr) 2017-03-23

Family

ID=58288175

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2016/072208 WO2017046423A1 (fr) 2015-09-18 2016-09-19 Afficheur 3d et procédé de fonctionnement associé

Country Status (1)

Country Link
WO (1) WO2017046423A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5365370A (en) * 1993-06-10 1994-11-15 Hudgins J Stephen Three dimensional viewing illusion with 2D display
US5963247A (en) * 1994-05-31 1999-10-05 Banitt; Shmuel Visual display systems and a system for producing recordings for visualization thereon and methods therefor
US20090073558A1 (en) * 2001-01-23 2009-03-19 Kenneth Martin Jacobs Continuous adjustable 3deeps filter spectacles for optimized 3deeps stereoscopic viewing and its control method and means

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5365370A (en) * 1993-06-10 1994-11-15 Hudgins J Stephen Three dimensional viewing illusion with 2D display
US5963247A (en) * 1994-05-31 1999-10-05 Banitt; Shmuel Visual display systems and a system for producing recordings for visualization thereon and methods therefor
US20090073558A1 (en) * 2001-01-23 2009-03-19 Kenneth Martin Jacobs Continuous adjustable 3deeps filter spectacles for optimized 3deeps stereoscopic viewing and its control method and means

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
CHIEN-YUE CHEN ET AL: "Pulfrich autostereo display with micro-prism array", OPTICS EXPRESS, vol. 21, no. 18, 9 September 2013 (2013-09-09), pages 21264 - 21272, XP055328690, ISSN: 2161-2072, DOI: 10.1364/OE.21.021264 *
JACOBS KEN ET AL: "Continuously adjustable Pulfrich spectacles", STEREOSCOPIC DISPLAYS AND APPLICATIONS XXII, SPIE, 1000 20TH ST. BELLINGHAM WA 98225-6705 USA, vol. 7863, no. 1, 10 February 2011 (2011-02-10), pages 1 - 14, XP060006176, DOI: 10.1117/12.870750 *

Similar Documents

Publication Publication Date Title
US11393435B2 (en) Eye mounted displays and eye tracking systems
US10621785B2 (en) Blended reality systems and methods
EP2685313B1 (fr) Système à plusieurs projections
JP4606420B2 (ja) 補助ビジュアル表示システム
US8786675B2 (en) Systems using eye mounted displays
EP0640859B1 (fr) Unité d'affichage d'images
JP2005515487A (ja) 再帰反射スクリーンを使用した３次元画像投影
EP2920646B1 (fr) Système et procédé de multiprojection comprenant des sièges pour spectateurs à orientation variable
Riecke et al. Selected technical and perceptual aspects of virtual reality displays
JP2017083551A (ja) 映像投影装置、舞台装置および映像投影方法
KR20110080290A (ko) 3ｄ 정보 획득장치 및 이의 광원 구동방법, 그리고, 3ｄ 정보 획득 시스템
RU2698919C2 (ru) Стереодисплей (варианты), видеокамера для стереосъёмки и способ компьютерного формирования стереоизображений для этого стереодисплея
KR20150026436A (ko) 다면 상영 시스템의 시뮬레이션을 위한 시뮬레이션 시스템
CN206674125U (zh) 一种显示系统、包括该显示系统的设备以及观看装置
CN111338175A (zh) 透射式几何全息显示系统
Tanaka et al. Twister: an immersive autostereoscopic display
WO2017046423A1 (fr) Afficheur 3d et procédé de fonctionnement associé
Rupkalvis Human considerations in stereoscopic displays
CN215494384U (zh) 一种裸眼三维显示装置
WO2014005605A1 (fr) Procédé et système de visualisation partagée basée sur la localisation d'emplacement de téléspectateurs
KR20140064738A (ko) 방향 전환이 가능한 관람용 의자를 포함하는 다면 상영 시스템 및 방법
JPS6114711B2 (fr)

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16775517

Country of ref document: EP

Kind code of ref document: A1

DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16775517

Country of ref document: EP

Kind code of ref document: A1