EP2842331A1 - Auto-stereoscopic display device and driving method - Google Patents

Auto-stereoscopic display device and driving method

Info

Publication number
EP2842331A1
EP2842331A1 EP13727368.6A EP13727368A EP2842331A1 EP 2842331 A1 EP2842331 A1 EP 2842331A1 EP 13727368 A EP13727368 A EP 13727368A EP 2842331 A1 EP2842331 A1 EP 2842331A1
Authority
EP
European Patent Office
Prior art keywords
light
backlight
arrangement
light tubes
array
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP13727368.6A
Other languages
German (de)
French (fr)
Other versions
EP2842331B1 (en
Inventor
Christiaan Varekamp
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of EP2842331A1 publication Critical patent/EP2842331A1/en
Application granted granted Critical
Publication of EP2842331B1 publication Critical patent/EP2842331B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/32—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using arrays of controllable light sources; using moving apertures or moving light sources
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G02B30/27—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving lenticular arrays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
    • G02B30/33—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving directional light or back-light sources
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/305—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using lenticular lenses, e.g. arrangements of cylindrical lenses
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
    • H04N13/351—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying simultaneously
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/376—Image reproducers using viewer tracking for tracking left-right translational head movements, i.e. lateral movements

Definitions

  • This invention relates to auto-stereoscopic display devices.
  • Such displays include an optical arrangement which directs different views into different directions at which the eyes of a user may be located, so that the user does not need to wear special glasses for this purpose.
  • the different directions of the views to different locations can for example be achieved with a lens arrangement, with individual lenses covering groups of pixels.
  • the lenses then direct light from different pixels in different directions, and in this way different images (e.g. left and right) can be sent to different directions.
  • Another approach is to use a barrier arrangement. This again has the function of limiting the direction in which light from individual pixels can be sent.
  • a problem with this arrangement is that the resolution of the individual views is reduced. By operating in time-multiplex as well as spatial-multiplex manner increased resolution can be obtained.
  • This invention is particularly concerned with a known type of auto- stereoscopic display in which a light-steering backlight is used to direct light into the eyes of one or multiple viewers that are detected using cameras.
  • the left- and right-images are displayed sequentially on an LCD.
  • a light-steering backlight can for example comprise a pixellated backlight and a lens arrangement. By controlling backlight elements, the resulting light output direction is determined by the lens. Electro wetting prism arrays can also be provided for directing a backlight output in different directions.
  • a lens array is used to achieve the required light-steering.
  • these lens arrays suffer from aberrations off-axis. As a consequence, loss of angular resolution occurs at larger incidence angles. This is a problem with backlight-steering approaches generally.
  • a backlight arrangement for an auto-stereoscopic display device comprising:
  • a lens arrangement comprising an array of lens units, wherein a respective sub- array of -backlight segments is associated with each lens unit of the lens arrangement, such that the lens unit directs light output from different backlight segments in different directions, wherein each backlight sub-array provides illumination to a light tube with the respective lens unit at the end of the light tube, and wherein the light tubes comprise at least two sets, with the light tubes of a first set all parallel to each other and facing a first direction and the light tubes of a second set all parallel to each other and facing a second direction.
  • This arrangement provides a backlight arrangement in which different parts of the backlight arrangement point in different directions. This means that different parts of the backlight arrangement will be suitable for directing images in different directions, while reducing the effect of optical aberrations resulting from large exit angles. It would in theory be beneficial to provide rotation of the lenses to have their optical axis directly towards the viewer. However, this is practically not feasible.
  • the invention instead provides sets of lenses with different static orientations. Each tube of the light tube array directs light efficiently in its own limited angular range.
  • the invention enables an increased viewing angle for a flat auto-stereoscopic display.
  • the invention also provides an auto-stereoscopic display device comprising: the backlight arrangement and a light modulating display panel illuminated by the backlight arrangement.
  • the invention provides the rotation of the optical axes in a flat matrix structure.
  • the lens optical axes are in particular rotated in the horizontal (column) direction.
  • the light tubes can comprise three sets, wherein the light tubes of the first set are directed normally to the display panel, the light tubes of the second set are directed laterally to one side of the normal and the light tubes of the third set are directed laterally to the other side of the normal.
  • the light tubes of the second and third sets can be directed laterally to the side of the normal by an amount between 10 and 30 degrees.
  • Each light tube can for example have an exit area of between 0.25 square centimers (cm 2 ) and 4 square centimeters (cm 2 ).
  • Each set of light tubes can comprise a plurality of (horizontal) rows of light tubes, with light tubes of one set alternated with the light tubes of the other sets.
  • a vertical diffuser at the output of the backlight arrangement can then be used so that the rows of light tubes which are providing illumination have their light output expanded in the column (vertical) direction.
  • a camera arrangement is preferably provided for tracking the location of one or more viewers, and the display further comprises a controller adapted to select which set of light tubes to use for each image to be presented in dependence on the viewer location, and to control the backlight arrangement to control the direction of illumination to the display panel for each image.
  • the best light tubes to be used are selected, and then the sub-array of backlight segments is controlled to provide the required illumination direction.
  • the invention also provides a method of controlling an auto-stereoscopic display device which comprises a backlight arrangement comprising a segmented backlight and a lens arrangement comprising an array of lens units, wherein a respective sub-array of backlight segments is associated with each lens unit of the lens arrangement, such that the lens unit directs light output from different backlight segments in different directions, wherein the method comprises: aligning each backlight sub-array with a light tube having the respective lens unit at the end of the light tube, and wherein the light tubes comprise at least two sets, with the light tubes of a first set all parallel to each other and facing a first direction and the light tubes of a second set all parallel to each other and facing a second direction;
  • Figure 1 is used to explain the basic operation of a known backlight steering auto-stereoscopic display device
  • Figure 2 shows a backlight arrangement of an auto-stereoscopic display device of the invention
  • FIG 3 shows the different orientations of the light tubes of Figure 2 in more detail
  • Figure 4 shows the angular relationship between light tubes
  • Figure 5 shows the optical parts of an auto-stereoscopic display device of the invention
  • Figure 6 shows the electronic components in addition to the optical components of Figure 5;
  • Figure 7 is used to explain how the light tubes are selected and how the associated backlight sub-arrays are controlled.
  • the invention provides a directional backlight arrangement for an auto- stereoscopic display in which different parts of the backlight arrangement point in different directions. This means that different parts of the backlight arrangement will be suitable for directing images in different directions, while reducing the effect of optical aberrations resulting from large exit angles.
  • Figure 1 is used to explain generally the type of display device to which the invention relates.
  • the display comprises a backlight arrangement 10 and a light modulating display panel 12, such as an LC panel.
  • the backlight arrangement comprises a set of segmented backlight sub-arrays 14, each of which is associated with an output lens 16.
  • a greater number of backlight segments implies a more complicated structure as well as higher cost as a result of the greater number of light sources.
  • the size of the backlight sub-array is sufficient to enable a desired number of individually addressable backlight segments (e.g. individual LEDs) to be provided so as to give the desired controllability of the illumination direction.
  • a compromise is found between the complexity of the lens structure, the size of the individual lighting segments, the number of lighting segments per sub-array and the required backlight intensity per segment.
  • the limiting factor is typically the size of a single controllable light segment in the backlight sub-array. For a given viewing distance, a given angular resolution of view directions will be required, and this in turn specifies the spatial resolution of the light source array, which relates to the size and spatial resolution of the light sources and lenses..
  • Each sub-array has a grid of light sources, such as LEDs.
  • the light output direction from the lenses can be controlled.
  • the light output direction from each lens is the same, as shown by envelopes 18.
  • the envelopes 18 can converge so that they meet at a single eye position for a designed viewing distance.
  • the light output can be directed to specific lateral (i.e. left-right) position in space at a given viewing distance.
  • optical aberrations affect the light output for large non-normal exit angles.
  • the invention also uses backlight sub-arrays, but provides the light to a light tube with the respective lens unit at the end of the light tube.
  • the light tubes comprise at least two sets, with the light tubes of a first set all parallel to each other and facing a first direction and the light tubes of a second set all parallel to each other and facing a different second direction.
  • Figure 2 shows an example of the light tube arrangement in which there are three sets of light tubes. The light tubes of the first set are directed normally to the display panel, the light tubes of the second set are directed laterally to one side of the normal and the light tubes of the third set are directed laterally to the other side of the normal.
  • the set of light tubes are in rows.
  • Figure 2 shows three rows of light tubes.
  • Figure 2(a) shows a front view of three rows of three light tubes.
  • the top row has tubes directed normally.
  • the next row has light tubes directed to the right (as seen when facing the backlight arrangement) and the bottom row has light tubes directed to the left.
  • a view from above the backlight arrangement top edge is shown in Figure 2(b) for each of the three rows.
  • each backlight sub-array 14 is provided at the entrance end of a light tube 20 having light absorbing walls. In this way, only direct light from the backlight sub-array reaches the light lens, and high contrast is achieved. Reflective vertical walls can be used to increase the light output efficiency but this will reduce the contrast.
  • the exit end of each light tube 20 is provided with a lens, or set of lenses (this lens or set of lenses is generally termed a "lens unit").
  • Figure 2(b) shows how the light tubes are arranged in different direction in the different rows. All light tubes of one set are parallel to each other. All light tubes are horizontal (i.e. face outwardly) and the angular difference is in the lateral (i.e. left-right) direction. By defining the sets of light tubes as rows, it is possible to combine the light tubes to define a continuous output surface as shown in Figure 2(a).
  • Figure 2(c) shows the plan view of all three rows superimposed on each other.
  • the backlight sub-array illuminates an entire lens, so that no aperture is used.
  • the backlight sub-array 14 is placed at the focal plane of the lens unit. To improve performance, the backlight sub-array may be placed closer to or further from the lens.
  • the backlight sub-array is oriented such that the optical axis of the lens 16 lies normal to the plane that contains the backlight sub-array. This is shown more clearly in Figure 3 in which Figure 3(a) shows the front view of a single light tube and Figure 3(b) shows a side view. The non-transparent boundary is shown as 22.
  • Figure 3(c) shows the three different orientations side by side, and shows the plane of the backlight sub-array parallel to the lens, i.e. perpendicular to the lens optical axis.
  • An alternative arrangement is to place all the backlight sub-arrays 14 for all tubes on one common plane surface.
  • an additional correcting lens can be placed at the exit end of each tube, as part of the lens unit, to provide the required focusing of rays.
  • Each backlight sub-array can comprise closely packed LEDs or OLED strips.
  • the light source matrix may consist of a miniature LED or OLED display.
  • each tube of the lens tube array can be 1 cm wide, 1 cm high and 2 cm deep.
  • a 3D backlight of 1 m wide and 0.5 m high this means that the tube array has 5000 tubes where each tube has a lens and a separate miniature LED or OLED display at the back.
  • Each light tube can have a backlight sub-array with approximately 30 lighting segments in the row direction. More generally there may be between 10 and 50. The more segments, the greater the directional control, but the lower the intensity. There can be only one segment in the column direction since resolution is not needed in the column direction. However, a 2D array of backlight segments in the backlight sub-array can be used. The size of the backlight sub-array thus is large enough to have the required number of backlight segments, but small enough that the overall size (in particular thickness) of the backlight can be made small. A smaller tube entrance and exit face results in a smaller tube length, and thereby a reduced overall backlight thickness. With an approximate length to width ratio of the tubes of around 2: 1, the light tubes preferably have a width dimension at most a few centimetres.
  • the fixed direction of the three sets of light tubes can for example be 0 degrees, minus 20 degrees and plus 20 degrees.
  • This 20 degree offset can more generally be any angle, for example in the range 10 to 30 degrees.
  • Figure 4 shows light ray paths that correspond to the most left and most right position on a lens such that each lens is fully lit horizontally.
  • Switching on one single LED of the backlight sub-array, or a small group of LEDs results in a more or less collimated beam of light in a direction that depends both on the orientation of the lens tube and on the position of the LED or LEDs relative to the optical axis of the lens.
  • Figure 4 shows how the oriented lens tube configuration doubles the opening angle from ⁇ to 2 ⁇ , where ⁇ is the output angle range for one light tube.
  • Figure 4 shows the left directed tubes in Figure 4(a), the normally directed tubes in Figure 4(b) and the right directed tubes in Figure 4(c). This factor of two (instead of three) results from overlap between the light output directions.
  • Figure 4(a) the right-half of the opening angle ⁇ cannot be used since then the tube matrix becomes visible.
  • Figure 4(c) shows how the oriented lens tube configuration doubles the opening angle from ⁇ to 2 ⁇ , where ⁇ is the output angle range for one light tube.
  • Figure 4 shows the left directed tubes in Figure 4(a), the normally directed tubes in Figure 4(b) and the right directed tubes in Figure 4(c). This factor of two (instead of three) results from overlap between the light output directions.
  • Figure 4(a) the right-half of the opening angle ⁇ cannot be used since then the tube matrix becomes visible.
  • Figure 4(c) the left-half of the
  • Figure 5 shows how the lens tube array can be used within an auto- stereoscopic display.
  • Figure 5 shows a side view of the device. Rows in the lens tube array correspond to different orientations.
  • two vertical diffuser sheets 50 are placed between the lens tube array and the LCD display panel 12.
  • the horizontally oriented tube matrix material can be made reflective and one vertical diffuser can then be removed.
  • Light-steering is only done in the horizontal direction via the light tube configuration and the selection of light sources.
  • the light is not collimated in the vertical direction.
  • a reflective horizontal matrix material increases the amount of light that leaves the tubes under a large vertical angle, thereby making vertical diffusion more effective.
  • the light tubes are separate by mechanical separators 52 to provide
  • the display panel can be completely standard, for example a standard HD panel. Each light tube thus illuminates a sub-array of the pixels of the panel.
  • the decision of which set of backlight sub-arrays and associated light tubes to select for the left and right eyes of the viewer depends on the 2D location of the eyes relative to the display.
  • the backlight arrangement of light tubes and lenses is shown as 10 for illuminating the display panel 12.
  • a controller 60 receives an input from a head-tracking arrangement 62 which tracks the pupils of one or more viewers.
  • the controller 60 controls the display panel 12 to provide an output image for presentation to one pupil of one viewer. Each displayed image is thus a full resolution display at the native resolution of the display panel.
  • the controller also selects which set of backlight sub-arrays to use, as well as controlling the backlight sub-arrays to generate the desired light output direction from the light tubes.
  • the different images required (two per viewer) are provides in a time sequential manner.
  • the display panel has a high refresh rate, for example 240Hz or more. There will be a maximum number of users for which separate images can be provided, for example 2, 3 or 4.
  • the head-tracking arrangement can comprise one or multiple cameras mounted on the display.
  • the decision on which set of backlight sub-arrays to be used can be carried out using the following steps:
  • the angle a is calculated as shown in Figure 7 which is the angle between the line that connects the eye and the centre of each column of tubes in the matrix and the normal to the display surface. This angle varies slightly across the display, with the variation being greater for closer viewing distances. The angle can be determined for each column, so that the illumination direction for each column of the display can be selected independently.
  • the angle between the line that connects the eye and the centre of the tube lens and the optical-axis of the selected tube lens is then used to calculate which light source (or light sources) of the backlight sub-array to use to steer light towards the eye. Since refraction occurs at the lens air/interface, and multiple lenses may be present in each lens unit, this calculation takes into account all of the air/lens material ray-direction changes.
  • the viewing direction required for each column of the backlight arrangement can be determined independently for each image, i.e. the left and right images can result in a different set of light tube selections.
  • different parts of the image can be provided by different light tube directions, or else single light tube directions may be selected for the whole of each image.
  • the invention has been described above in connection with three sets of light tubes. However two can be used, both laterally offset from the normal direction. It is however, preferred to have a normally directed set of light tubes, since the normal direction is likely to represent the ideal viewing position, and the most likely position for a single viewer. This implies that there is preferably an odd number of sets of light tubes, for example 3 or 5.
  • the controller has not been described in detail. Essentially, it combines the function of a standard display driver with logic to select with light tubes to use, and to derive the backlight segments which need to be oriented. This involves basic trigonometric functions once a viewer position has been determined.
  • the head-tracking system can be totally conventional, and such systems are already used in head-tracking auto-stereoscopic displays.
  • the display panel can be an LCD panel or any other light modulating display technology.

Abstract

The invention provides a directional backlight arrangement for an auto- stereoscopic display in which different parts of the backlight arrangement point in different directions. This means that different parts of the backlight arrangement will be suitable for directing images in different directions, while reducing the effect of optical aberrations resulting from large exit angles.

Description

AUTO-STEREOSCOPIC DISPLAY DEVICE AND DRIVING METHOD
FIELD OF THE INVENTION
This invention relates to auto-stereoscopic display devices.
BACKGROUND OF THE INVENTION
Various types of auto-stereoscopic display device are known. Essentially, such displays include an optical arrangement which directs different views into different directions at which the eyes of a user may be located, so that the user does not need to wear special glasses for this purpose.
The different directions of the views to different locations can for example be achieved with a lens arrangement, with individual lenses covering groups of pixels. The lenses then direct light from different pixels in different directions, and in this way different images (e.g. left and right) can be sent to different directions.
Another approach is to use a barrier arrangement. This again has the function of limiting the direction in which light from individual pixels can be sent.
A problem with this arrangement is that the resolution of the individual views is reduced. By operating in time-multiplex as well as spatial-multiplex manner increased resolution can be obtained.
The designs outlined above provide the different views in fixed different directions. However, other designs provide tracking of the position the eyes of one or more viewers. This means that for each viewer only two views need to be generated, instead of a full set of views (typically 9 or 15) filling the field of view.
This invention is particularly concerned with a known type of auto- stereoscopic display in which a light-steering backlight is used to direct light into the eyes of one or multiple viewers that are detected using cameras. The left- and right-images are displayed sequentially on an LCD.
For each viewer, two direction light source configurations of the backlight are switched on and off in phase with the LCD such that at a given moment in time each eye sees either the correct image or a black screen. A light-steering backlight can for example comprise a pixellated backlight and a lens arrangement. By controlling backlight elements, the resulting light output direction is determined by the lens. Electro wetting prism arrays can also be provided for directing a backlight output in different directions.
Typically, a lens array is used to achieve the required light-steering. However, these lens arrays suffer from aberrations off-axis. As a consequence, loss of angular resolution occurs at larger incidence angles. This is a problem with backlight-steering approaches generally.
To address this problem, it has for example been proposed to place the illumination sources on a curved surface and to limit the aperture of each optical element. Multiple optical elements are then stacked and shifted a distance horizontally equal to the width of the aperture opening. A vertical diffuser can be used to achieve a homogeneously lit display. This however results in a more complicated optical structure. SUMMARY OF THE INVENTION
According to the invention there is provided a device and method as claimed in the independent claims.
According to one aspect of the invention, there is provided a backlight arrangement for an auto-stereoscopic display device, comprising:
- a segmented backlight; and
a lens arrangement comprising an array of lens units, wherein a respective sub- array of -backlight segments is associated with each lens unit of the lens arrangement, such that the lens unit directs light output from different backlight segments in different directions, wherein each backlight sub-array provides illumination to a light tube with the respective lens unit at the end of the light tube, and wherein the light tubes comprise at least two sets, with the light tubes of a first set all parallel to each other and facing a first direction and the light tubes of a second set all parallel to each other and facing a second direction.
This arrangement provides a backlight arrangement in which different parts of the backlight arrangement point in different directions. This means that different parts of the backlight arrangement will be suitable for directing images in different directions, while reducing the effect of optical aberrations resulting from large exit angles. It would in theory be beneficial to provide rotation of the lenses to have their optical axis directly towards the viewer. However, this is practically not feasible. The invention instead provides sets of lenses with different static orientations. Each tube of the light tube array directs light efficiently in its own limited angular range.
The invention enables an increased viewing angle for a flat auto-stereoscopic display. Thus, the invention also provides an auto-stereoscopic display device comprising: the backlight arrangement and a light modulating display panel illuminated by the backlight arrangement.
To address the problem of off-axis lens aberrations, the invention provides the rotation of the optical axes in a flat matrix structure. The lens optical axes are in particular rotated in the horizontal (column) direction.
The light tubes can comprise three sets, wherein the light tubes of the first set are directed normally to the display panel, the light tubes of the second set are directed laterally to one side of the normal and the light tubes of the third set are directed laterally to the other side of the normal.
The light tubes of the second and third sets can be directed laterally to the side of the normal by an amount between 10 and 30 degrees. Each light tube can for example have an exit area of between 0.25 square centimers (cm2) and 4 square centimeters (cm2).
Each set of light tubes can comprise a plurality of (horizontal) rows of light tubes, with light tubes of one set alternated with the light tubes of the other sets. A vertical diffuser at the output of the backlight arrangement can then be used so that the rows of light tubes which are providing illumination have their light output expanded in the column (vertical) direction.
A camera arrangement is preferably provided for tracking the location of one or more viewers, and the display further comprises a controller adapted to select which set of light tubes to use for each image to be presented in dependence on the viewer location, and to control the backlight arrangement to control the direction of illumination to the display panel for each image.
In this way, the best light tubes to be used are selected, and then the sub-array of backlight segments is controlled to provide the required illumination direction.
The invention also provides a method of controlling an auto-stereoscopic display device which comprises a backlight arrangement comprising a segmented backlight and a lens arrangement comprising an array of lens units, wherein a respective sub-array of backlight segments is associated with each lens unit of the lens arrangement, such that the lens unit directs light output from different backlight segments in different directions, wherein the method comprises: aligning each backlight sub-array with a light tube having the respective lens unit at the end of the light tube, and wherein the light tubes comprise at least two sets, with the light tubes of a first set all parallel to each other and facing a first direction and the light tubes of a second set all parallel to each other and facing a second direction;
- detecting the position of a viewer;
based on the viewer position, determining which set of light tubes to use to display an image to each eye of the viewer; and
for the selected light tubes, controlling the associated sub-array of backlight segments to provide illumination in a direction through a light modulating display panel to each eye of the viewer.
BRIEF DESCRIPTION OF THE DRAWINGS
Examples of the invention will now be described in detail, with reference to the accompanying drawings, in which:
Figure 1 is used to explain the basic operation of a known backlight steering auto-stereoscopic display device;
Figure 2 shows a backlight arrangement of an auto-stereoscopic display device of the invention;
Figure 3 shows the different orientations of the light tubes of Figure 2 in more detail;
Figure 4 shows the angular relationship between light tubes;
Figure 5 shows the optical parts of an auto-stereoscopic display device of the invention;
Figure 6 shows the electronic components in addition to the optical components of Figure 5; and
Figure 7 is used to explain how the light tubes are selected and how the associated backlight sub-arrays are controlled.
DETAILED DESCRIPTION OF THE EMBODIMENTS
The invention provides a directional backlight arrangement for an auto- stereoscopic display in which different parts of the backlight arrangement point in different directions. This means that different parts of the backlight arrangement will be suitable for directing images in different directions, while reducing the effect of optical aberrations resulting from large exit angles. Figure 1 is used to explain generally the type of display device to which the invention relates.
The display comprises a backlight arrangement 10 and a light modulating display panel 12, such as an LC panel. The backlight arrangement comprises a set of segmented backlight sub-arrays 14, each of which is associated with an output lens 16.
The more backlight sub-arrays there are, the greater the number of backlight segments that can be turned on to provide illumination of the display panel, so that the intensity of the individual backlight segments can be reduced. Of course, a greater number of backlight segments implies a more complicated structure as well as higher cost as a result of the greater number of light sources. The size of the backlight sub-array is sufficient to enable a desired number of individually addressable backlight segments (e.g. individual LEDs) to be provided so as to give the desired controllability of the illumination direction. Thus, a compromise is found between the complexity of the lens structure, the size of the individual lighting segments, the number of lighting segments per sub-array and the required backlight intensity per segment.
The limiting factor is typically the size of a single controllable light segment in the backlight sub-array. For a given viewing distance, a given angular resolution of view directions will be required, and this in turn specifies the spatial resolution of the light source array, which relates to the size and spatial resolution of the light sources and lenses..
Each sub-array has a grid of light sources, such as LEDs. By selecting which
LEDs are illuminated, the light output direction from the lenses can be controlled. As shown in Figure 1 , by using a selected LED within each sub-array, the light output direction from each lens is the same, as shown by envelopes 18. By suitable selection of one or more light sources in each sub-array 14 for each lens 16, the envelopes 18 can converge so that they meet at a single eye position for a designed viewing distance. Thus, by controlling the sub- arrays, the light output can be directed to specific lateral (i.e. left-right) position in space at a given viewing distance. A problem with this type of arrangement is that optical aberrations affect the light output for large non-normal exit angles.
The invention also uses backlight sub-arrays, but provides the light to a light tube with the respective lens unit at the end of the light tube. The light tubes comprise at least two sets, with the light tubes of a first set all parallel to each other and facing a first direction and the light tubes of a second set all parallel to each other and facing a different second direction. Figure 2 shows an example of the light tube arrangement in which there are three sets of light tubes. The light tubes of the first set are directed normally to the display panel, the light tubes of the second set are directed laterally to one side of the normal and the light tubes of the third set are directed laterally to the other side of the normal.
In the example of Figure 2, the set of light tubes are in rows. Figure 2 shows three rows of light tubes. Figure 2(a) shows a front view of three rows of three light tubes.
The top row has tubes directed normally. The next row has light tubes directed to the right (as seen when facing the backlight arrangement) and the bottom row has light tubes directed to the left. A view from above the backlight arrangement top edge is shown in Figure 2(b) for each of the three rows.
As shown, each backlight sub-array 14 is provided at the entrance end of a light tube 20 having light absorbing walls. In this way, only direct light from the backlight sub-array reaches the light lens, and high contrast is achieved. Reflective vertical walls can be used to increase the light output efficiency but this will reduce the contrast. The exit end of each light tube 20 is provided with a lens, or set of lenses (this lens or set of lenses is generally termed a "lens unit"). Figure 2(b) shows how the light tubes are arranged in different direction in the different rows. All light tubes of one set are parallel to each other. All light tubes are horizontal (i.e. face outwardly) and the angular difference is in the lateral (i.e. left-right) direction. By defining the sets of light tubes as rows, it is possible to combine the light tubes to define a continuous output surface as shown in Figure 2(a).
Figure 2(c) shows the plan view of all three rows superimposed on each other. The backlight sub-array illuminates an entire lens, so that no aperture is used. The backlight sub-array 14 is placed at the focal plane of the lens unit. To improve performance, the backlight sub-array may be placed closer to or further from the lens. The backlight sub-array is oriented such that the optical axis of the lens 16 lies normal to the plane that contains the backlight sub-array. This is shown more clearly in Figure 3 in which Figure 3(a) shows the front view of a single light tube and Figure 3(b) shows a side view. The non-transparent boundary is shown as 22. Figure 3(c) shows the three different orientations side by side, and shows the plane of the backlight sub-array parallel to the lens, i.e. perpendicular to the lens optical axis.
An alternative arrangement is to place all the backlight sub-arrays 14 for all tubes on one common plane surface. In this case, an additional correcting lens can be placed at the exit end of each tube, as part of the lens unit, to provide the required focusing of rays. Each backlight sub-array can comprise closely packed LEDs or OLED strips. Alternatively, the light source matrix may consist of a miniature LED or OLED display.
By way of example, each tube of the lens tube array can be 1 cm wide, 1 cm high and 2 cm deep. For a 3D backlight of 1 m wide and 0.5 m high this means that the tube array has 5000 tubes where each tube has a lens and a separate miniature LED or OLED display at the back.
Each light tube can have a backlight sub-array with approximately 30 lighting segments in the row direction. More generally there may be between 10 and 50. The more segments, the greater the directional control, but the lower the intensity. There can be only one segment in the column direction since resolution is not needed in the column direction. However, a 2D array of backlight segments in the backlight sub-array can be used. The size of the backlight sub-array thus is large enough to have the required number of backlight segments, but small enough that the overall size (in particular thickness) of the backlight can be made small. A smaller tube entrance and exit face results in a smaller tube length, and thereby a reduced overall backlight thickness. With an approximate length to width ratio of the tubes of around 2: 1, the light tubes preferably have a width dimension at most a few centimetres.
The fixed direction of the three sets of light tubes can for example be 0 degrees, minus 20 degrees and plus 20 degrees. This 20 degree offset can more generally be any angle, for example in the range 10 to 30 degrees.
Figure 4 shows light ray paths that correspond to the most left and most right position on a lens such that each lens is fully lit horizontally.
Switching on one single LED of the backlight sub-array, or a small group of LEDs, results in a more or less collimated beam of light in a direction that depends both on the orientation of the lens tube and on the position of the LED or LEDs relative to the optical axis of the lens.
Figure 4 shows how the oriented lens tube configuration doubles the opening angle from Θ to 2Θ, where Θ is the output angle range for one light tube. Figure 4 shows the left directed tubes in Figure 4(a), the normally directed tubes in Figure 4(b) and the right directed tubes in Figure 4(c). This factor of two (instead of three) results from overlap between the light output directions. For the left-oriented lenses (Figure 4(a)) the right-half of the opening angle Θ cannot be used since then the tube matrix becomes visible. The same applies for the left-half of the opening angle of the right-oriented lenses (Figure 4(c)). This problem of the tube matrix being visible is caused by the requirement that all rotated lenses should be generally arranged on the same surface, which implies that each tube in the tube array is shifted with respect to its neighbours as shown in Figure 4. The effect is that for some viewing angles the absorbing boundary becomes visible, for example region 24 shown in Figure 4(a). These angles are thus excluded and are instead provided by the normally directed tubes.
Figure 5 shows how the lens tube array can be used within an auto- stereoscopic display. Figure 5 shows a side view of the device. Rows in the lens tube array correspond to different orientations.
To spread light vertically, two vertical diffuser sheets 50 are placed between the lens tube array and the LCD display panel 12. Alternatively, the horizontally oriented tube matrix material can be made reflective and one vertical diffuser can then be removed.
Light-steering is only done in the horizontal direction via the light tube configuration and the selection of light sources. The light is not collimated in the vertical direction.
A reflective horizontal matrix material increases the amount of light that leaves the tubes under a large vertical angle, thereby making vertical diffusion more effective.
The light tubes are separate by mechanical separators 52 to provide
mechanical strength.
The display panel can be completely standard, for example a standard HD panel. Each light tube thus illuminates a sub-array of the pixels of the panel.
The decision of which set of backlight sub-arrays and associated light tubes to select for the left and right eyes of the viewer depends on the 2D location of the eyes relative to the display.
The complete system is shown in Figure 6.
The backlight arrangement of light tubes and lenses is shown as 10 for illuminating the display panel 12. A controller 60 receives an input from a head-tracking arrangement 62 which tracks the pupils of one or more viewers.
The controller 60 controls the display panel 12 to provide an output image for presentation to one pupil of one viewer. Each displayed image is thus a full resolution display at the native resolution of the display panel. The controller also selects which set of backlight sub-arrays to use, as well as controlling the backlight sub-arrays to generate the desired light output direction from the light tubes. The different images required (two per viewer) are provides in a time sequential manner. For this purpose, the display panel has a high refresh rate, for example 240Hz or more. There will be a maximum number of users for which separate images can be provided, for example 2, 3 or 4.
The head-tracking arrangement can comprise one or multiple cameras mounted on the display.
The decision on which set of backlight sub-arrays to be used can be carried out using the following steps:
1. For a detected eye- location, the angle a is calculated as shown in Figure 7 which is the angle between the line that connects the eye and the centre of each column of tubes in the matrix and the normal to the display surface. This angle varies slightly across the display, with the variation being greater for closer viewing distances. The angle can be determined for each column, so that the illumination direction for each column of the display can be selected independently.
2. The magnitude of a is compared with the magnitude of the lens opening angle
Θ. A decision is then made about which tube orientation to use. The decision rule is shown in Figure 7. Essentially, if the required orientation is outside the range of the normally directed light tubes, one of the sets of laterally directed light tubes is used.
3. The angle between the line that connects the eye and the centre of the tube lens and the optical-axis of the selected tube lens is then used to calculate which light source (or light sources) of the backlight sub-array to use to steer light towards the eye. Since refraction occurs at the lens air/interface, and multiple lenses may be present in each lens unit, this calculation takes into account all of the air/lens material ray-direction changes.
The viewing direction required for each column of the backlight arrangement can be determined independently for each image, i.e. the left and right images can result in a different set of light tube selections. As also mentioned above, within an image, different parts of the image can be provided by different light tube directions, or else single light tube directions may be selected for the whole of each image.
The invention has been described above in connection with three sets of light tubes. However two can be used, both laterally offset from the normal direction. It is however, preferred to have a normally directed set of light tubes, since the normal direction is likely to represent the ideal viewing position, and the most likely position for a single viewer. This implies that there is preferably an odd number of sets of light tubes, for example 3 or 5. The controller has not been described in detail. Essentially, it combines the function of a standard display driver with logic to select with light tubes to use, and to derive the backlight segments which need to be oriented. This involves basic trigonometric functions once a viewer position has been determined. The head-tracking system can be totally conventional, and such systems are already used in head-tracking auto-stereoscopic displays.
The display panel can be an LCD panel or any other light modulating display technology.
Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measured cannot be used to advantage. Any reference signs in the claims should not be construed as limiting the scope.

Claims

CLAIMS:
1. A backlight arrangement for an auto-stereoscopic display device, comprising:
a segmented backlight; and
a lens arrangement comprising an array of lens units,
wherein a respective sub-array (14) of backlight segments is associated with each lens unit (16) of the lens arrangement, such that the lens unit (16) directs light output from different backlight segments in different directions,
wherein each backlight sub-array (14) provides illumination to a light tube (20) with the respective lens unit at the end of the light tube, and
wherein the light tubes comprise at least two sets, with the light tubes of a first set all parallel to each other and facing a first direction and the light tubes of a second set all parallel to each other and facing a second direction.
2. An arrangement as claimed in claim 1, wherein the light tubes (20) comprise three sets, wherein the light tubes of the first set are directed normally to the display panel, the light tubes of the second set are directed laterally to one side of the normal and the light tubes of the third set are directed laterally to the other side of the normal.
3. An arrangement as claimed in claim 2, wherein the light tubes (20) of the second and third sets are directed laterally to the side of the normal by an amount between 10 and 30 degrees.
4. An arrangement as claimed in claim 1, wherein each light tube (20) has an exit area of between 0.25 square centimeters and 4 square centimeters.
5. An arrangement as claimed in claim 1, wherein each sub-array (14) comprises an array of individually addressable light segments, wherein there are at least 10 columns of light segments in each sub-array.
6. An arrangement as claimed in claim 1, wherein each set of light tubes (20) comprises a plurality of rows of light tubes, with light tubes of one set alternated with the light tubes of the other sets.
7. An arrangement as claimed in claim 1, further comprising a vertical diffuser
(50) at the output of the backlight arrangement.
8. An auto-stereoscopic display device comprising a backlight arrangement as claimed in claim 1; and a light modulating display panel (12) illuminated by the backlight arrangement.
9. A display device as claimed in claim 8, further comprising a camera arrangement (62) for tracking the location of one or more viewers, and wherein the display further comprises a controller (60) adapted to select which set of light tubes to use for each image to be presented in dependence on the viewer location, and to control the backlight arrangement to control the direction of illumination to the display panel for each image.
10. A method of controlling an auto-stereoscopic display device which comprises a backlight arrangement comprising a segmented backlight and a lens arrangement comprising an array of lens units (16), wherein a respective sub-array (14) of backlight segments is associated with each lens unit (16) of the lens arrangement, such that the lens unit directs light output from different backlight segments in different directions, wherein the method comprises the steps of:
aligning each backlight sub-array (14) with a light tube (20) having the respective lens unit (16) at the end of the light tube, and wherein the light tubes comprise at least two sets, with the light tubes of a first set all parallel to each other and facing a first direction and the light tubes of a second set all parallel to each other and facing a second direction;
detecting the position of a viewer;
- based on the viewer position, determining which set of light tubes to use to display an image to each eye of the viewer; and
for the selected light tubes, controlling the associated sub-array (14) of backlight segments to provide illumination in a direction through a light modulating display panel to each eye of the viewer.
11. A method as claimed in claim 10, wherein the light tubes (20) comprise three sets, wherein the light tubes of the first set are directed normally to the display panel, the light tubes of the second set are directed laterally to one side of the normal and the light tubes of the third set are directed laterally to the other side of the normal.
EP13727368.6A 2012-04-24 2013-04-22 Auto-stereoscopic display device and driving method Not-in-force EP2842331B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261637335P 2012-04-24 2012-04-24
PCT/IB2013/053163 WO2013160815A1 (en) 2012-04-24 2013-04-22 Auto-stereoscopic display device and driving method

Publications (2)

Publication Number Publication Date
EP2842331A1 true EP2842331A1 (en) 2015-03-04
EP2842331B1 EP2842331B1 (en) 2017-03-29

Family

ID=48577174

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13727368.6A Not-in-force EP2842331B1 (en) 2012-04-24 2013-04-22 Auto-stereoscopic display device and driving method

Country Status (11)

Country Link
US (1) US9258551B2 (en)
EP (1) EP2842331B1 (en)
JP (1) JP5895098B2 (en)
KR (1) KR101507756B1 (en)
CN (1) CN104247414B (en)
BR (1) BR112014026207A2 (en)
MX (1) MX2014012615A (en)
RU (1) RU2014147055A (en)
TW (1) TWI595267B (en)
WO (1) WO2013160815A1 (en)
ZA (1) ZA201408588B (en)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150228226A1 (en) * 2014-02-13 2015-08-13 Nvidia Corporation Power-efficient steerable displays
US11099798B2 (en) 2015-01-20 2021-08-24 Misapplied Sciences, Inc. Differentiated content delivery system and method therefor
US10701349B2 (en) 2015-01-20 2020-06-30 Misapplied Sciences, Inc. Method for calibrating a multi-view display
US10928914B2 (en) 2015-01-29 2021-02-23 Misapplied Sciences, Inc. Individually interactive multi-view display system for non-stationary viewing locations and methods therefor
US10955924B2 (en) 2015-01-29 2021-03-23 Misapplied Sciences, Inc. Individually interactive multi-view display system and methods therefor
US10264247B2 (en) * 2015-02-03 2019-04-16 Misapplied Sciences, Inc. Multi-view displays
US10356397B2 (en) 2015-02-13 2019-07-16 Samsung Electronics Co., Ltd. Three-dimensional (3D) display apparatus and method
CN107925756B (en) 2015-03-03 2019-09-10 米斯应用科学有限公司 For showing the system and method for relying on the content in place
US10362301B2 (en) 2015-03-05 2019-07-23 Misapplied Sciences, Inc. Designing content for multi-view display
JP2016206637A (en) * 2015-09-17 2016-12-08 政信 工藤 Naked eye stereoscopic display
CN105807438B (en) * 2016-04-25 2018-11-20 中山大学 A kind of time division multiplexing mould group and method for increasing viewpoint and number being presented
US10602131B2 (en) 2016-10-20 2020-03-24 Misapplied Sciences, Inc. System and methods for wayfinding and navigation via multi-view displays, signage, and lights
US10269279B2 (en) 2017-03-24 2019-04-23 Misapplied Sciences, Inc. Display system and method for delivering multi-view content
US10427045B2 (en) 2017-07-12 2019-10-01 Misapplied Sciences, Inc. Multi-view (MV) display systems and methods for quest experiences, challenges, scavenger hunts, treasure hunts and alternate reality games
US10565616B2 (en) 2017-07-13 2020-02-18 Misapplied Sciences, Inc. Multi-view advertising system and method
US10404974B2 (en) 2017-07-21 2019-09-03 Misapplied Sciences, Inc. Personalized audio-visual systems
US10778962B2 (en) 2017-11-10 2020-09-15 Misapplied Sciences, Inc. Precision multi-view display
WO2024030274A1 (en) * 2022-08-02 2024-02-08 Reald Spark, Llc Pupil tracking near-eye display

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2294350A (en) 1994-10-21 1996-04-24 Sharp Kk Light source and display
KR100258836B1 (en) 1998-06-18 2000-06-15 박호군 Stereo and multi-view three-dimensional image display device
US6101008A (en) * 1998-10-16 2000-08-08 Digilens, Inc. Autostereoscopic display based on electrically switchable holograms
GB0318892D0 (en) * 2003-08-12 2003-09-17 Dawe Christopher M Stereoscopic imaging device and machine for fabrication thereof
US7250611B2 (en) 2003-12-02 2007-07-31 3M Innovative Properties Company LED curing apparatus and method
WO2005057669A2 (en) * 2003-12-02 2005-06-23 3M Innovative Properties Company Irradiation apparatus
TW200720703A (en) * 2005-09-09 2007-06-01 Koninkl Philips Electronics Nv Lenticular device for an autostereoscopic display apparatus and method of producing the same
JP2009530661A (en) 2006-03-15 2009-08-27 ゼブラ・イメージング・インコーポレイテッド Dynamic autostereoscopic display
KR101411697B1 (en) * 2006-10-06 2014-06-25 쓰리엠 이노베이티브 프로퍼티즈 컴파니 Scanning backlight for stereoscopic 3d liquid crystal display apparatus
JP2010224129A (en) 2009-03-23 2010-10-07 Sharp Corp Stereoscopic image display device
US8659830B2 (en) * 2009-12-21 2014-02-25 3M Innovative Properties Company Optical films enabling autostereoscopy
KR20110109565A (en) * 2010-03-31 2011-10-06 삼성전자주식회사 Backlight unit, 3d display having the same and method of making 3d image
JP5549444B2 (en) 2010-07-14 2014-07-16 株式会社ニコン Display device
KR101652401B1 (en) 2010-09-07 2016-08-31 삼성전자주식회사 3D image display apparatus and 3D image display method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
None *
See also references of WO2013160815A1 *

Also Published As

Publication number Publication date
JP2015524074A (en) 2015-08-20
JP5895098B2 (en) 2016-03-30
CN104247414A (en) 2014-12-24
US9258551B2 (en) 2016-02-09
KR20140114908A (en) 2014-09-29
TW201400873A (en) 2014-01-01
ZA201408588B (en) 2016-09-28
BR112014026207A2 (en) 2017-06-27
WO2013160815A1 (en) 2013-10-31
MX2014012615A (en) 2015-01-15
CN104247414B (en) 2017-03-01
US20150085091A1 (en) 2015-03-26
RU2014147055A (en) 2016-06-10
TWI595267B (en) 2017-08-11
EP2842331B1 (en) 2017-03-29
KR101507756B1 (en) 2015-04-07

Similar Documents

Publication Publication Date Title
EP2842331B1 (en) Auto-stereoscopic display device and driving method
JP6782703B2 (en) Time division multiplex visual display
US8514272B2 (en) Directional illumination unit for autostereoscopic displays
US8310524B2 (en) Stereoscopic image display apparatus
US7954967B2 (en) Directional backlight, display apparatus, and stereoscopic display apparatus
US7450188B2 (en) Multi-user autostereoscopic display with position tracking
JP4367775B2 (en) Dual view display
CN101750746B (en) Three-dimensional image displayer
CN106104372A (en) directional backlight source
CN110809884B (en) Visual display utilizing temporal multiplexing for stereoscopic views
KR20110109565A (en) Backlight unit, 3d display having the same and method of making 3d image
EP2802148A1 (en) Display device for time-sequential multi-view content
US20150077321A1 (en) Auto-stereoscopic display device and drive method
KR20160027166A (en) Auto-stereoscopic display device with a striped backlight and two lenticular lens arrays
KR20160062312A (en) Three dimensional image display device
KR102070800B1 (en) Stereoscopic display apparatus, and display method thereof
EP3004967B1 (en) Multi-view display device
CN102081239B (en) Wide-angle naked eye stereo display system
JP2013015711A (en) Display device
Li et al. Autostereoscopic display with bicylindrical lens based on temporal-spatial multiplexing
CN116909018A (en) Head-up display device, head-up display system, vehicle and image display method

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140910

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20151014

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20161020

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 880754

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170415

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 5

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602013019163

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170629

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170630

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20170329

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 880754

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170329

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170629

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602013019163

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: H04N0013040000

Ipc: H04N0013300000

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170729

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170731

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602013019163

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170430

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170430

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170422

26N No opposition filed

Effective date: 20180103

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20170430

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170422

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170430

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20180426

Year of fee payment: 6

Ref country code: TR

Payment date: 20180417

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170422

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20180427

Year of fee payment: 6

Ref country code: DE

Payment date: 20180629

Year of fee payment: 6

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20130422

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602013019163

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20190422

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191101

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190422

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170329

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190422