EP3877824A2 - Display presentation across plural display surfaces - Google Patents
Display presentation across plural display surfacesInfo
- Publication number
- EP3877824A2 EP3877824A2 EP19806075.8A EP19806075A EP3877824A2 EP 3877824 A2 EP3877824 A2 EP 3877824A2 EP 19806075 A EP19806075 A EP 19806075A EP 3877824 A2 EP3877824 A2 EP 3877824A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- display
- display surface
- image
- edge portion
- display system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
- G02F1/1333—Constructional arrangements; Manufacturing methods
- G02F1/13336—Combining plural substrates to produce large-area displays, e.g. tiled displays
-
- G—PHYSICS
- G02—OPTICS
- G02F—OPTICAL DEVICES OR ARRANGEMENTS FOR THE CONTROL OF LIGHT BY MODIFICATION OF THE OPTICAL PROPERTIES OF THE MEDIA OF THE ELEMENTS INVOLVED THEREIN; NON-LINEAR OPTICS; FREQUENCY-CHANGING OF LIGHT; OPTICAL LOGIC ELEMENTS; OPTICAL ANALOGUE/DIGITAL CONVERTERS
- G02F1/00—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics
- G02F1/01—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour
- G02F1/13—Devices or arrangements for the control of the intensity, colour, phase, polarisation or direction of light arriving from an independent light source, e.g. switching, gating or modulating; Non-linear optics for the control of the intensity, phase, polarisation or colour based on liquid crystals, e.g. single liquid crystal display cells
- G02F1/133—Constructional arrangements; Operation of liquid crystal cells; Circuit arrangements
- G02F1/1333—Constructional arrangements; Manufacturing methods
- G02F1/1335—Structural association of cells with optical devices, e.g. polarisers or reflectors
- G02F1/133526—Lenses, e.g. microlenses or Fresnel lenses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1615—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function
- G06F1/1616—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
- G06F1/1641—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being formed by a plurality of foldable display components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
- G06F1/1652—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being flexible, e.g. mimicking a sheet of paper, or rollable
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1675—Miscellaneous details related to the relative movement between the different enclosures or enclosure parts
- G06F1/1677—Miscellaneous details related to the relative movement between the different enclosures or enclosure parts for detecting open or closed state or particular intermediate positions assumed by movable parts of the enclosure, e.g. detection of display lid position with respect to main body in a laptop, detection of opening of the cover of battery compartment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
- G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
- G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1431—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using a single graphics controller
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/14—Display of multiple viewports
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/0206—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings
- H04M1/0208—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings characterized by the relative motions of the body parts
- H04M1/0214—Foldable telephones, i.e. with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/026—Details of the structure or mounting of specific components
- H04M1/0266—Details of the structure or mounting of specific components for a display module assembly
- H04M1/0268—Details of the structure or mounting of specific components for a display module assembly including a flexible display panel
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2300/00—Aspects of the constitution of display devices
- G09G2300/02—Composition of display devices
- G09G2300/026—Video wall, i.e. juxtaposition of a plurality of screens to create a display screen of bigger dimensions
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0233—Improving the luminance or brightness uniformity across the screen
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/045—Zooming at least part of an image, i.e. enlarging it or shrinking it
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2380/00—Specific applications
- G09G2380/02—Flexible displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/0202—Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
- H04M1/0206—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings
- H04M1/0241—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings using relative motion of the body parts to change the operational status of the telephone set, e.g. switching on/off, answering incoming call
- H04M1/0243—Portable telephones comprising a plurality of mechanically joined movable body parts, e.g. hinged housings using relative motion of the body parts to change the operational status of the telephone set, e.g. switching on/off, answering incoming call using the relative angle between housings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/02—Constructional features of telephone sets
- H04M1/22—Illumination; Arrangements for improving the visibility of characters on dials
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/16—Details of telephonic subscriber devices including more than one display unit
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
-
- H—ELECTRICITY
- H10—SEMICONDUCTOR DEVICES; ELECTRIC SOLID-STATE DEVICES NOT OTHERWISE PROVIDED FOR
- H10K—ORGANIC ELECTRIC SOLID-STATE DEVICES
- H10K2102/00—Constructional details relating to the organic devices covered by this subclass
- H10K2102/301—Details of OLEDs
- H10K2102/311—Flexible OLED
Definitions
- One aspect of this disclosure is directed to an electronic display system comprising first and second display surfaces and a computer.
- Each of the first and second display surfaces is configured to receive and transmit display light from an emissive element.
- Each of the first and second display surfaces includes both a flat portion and an edge portion non- coplanar to the flat portion.
- the computer is configured to control the emissive elements of the first and second display surfaces so as to present a first section of a display image on the first display surface and a second section of the display image on the second display surface.
- one or more horizontal or vertical rows of the display image rendered on the flat portion of a display surface are rendered duplicatively on an edge portion.
- FIGS. 1 and 2 show aspects of example electronic display systems.
- FIGS. 3A, 3B, and 3C show aspects of an example electronic display system featuring hinged display surfaces arranged over curved organic light-emitting diode (OLED) matrices.
- OLED organic light-emitting diode
- FIG. 4 shows aspects of an example electronic display system featuring hinged display surfaces arranged over liquid-crystal display (LCD) matrices.
- LCD liquid-crystal display
- FIG. 5 shows aspects of estimation of a user’s ocular position in an example electronic display system.
- FIG. 6 illustrates an example method to present a display image on an electronic display system.
- FIGS. 7, 8 A, and 8B shows aspects of an example implementation of the method of FIG. 6.
- FIG. 1 shows aspects of an example electronic display system 10.
- the electronic display system as illustrated takes the form of a foldable tablet computer.
- the electronic display system may take the form of a laptop computer or dual-screen smart phone.
- Electronic display systems of numerous other types, sizes, and form factors are equally envisaged.
- electronic display system 10 is shown presenting a display image 12.
- the nature of the display image is not particularly limited.
- the display image may include a user interface of an application executing on the electronic display system.
- the display image may include text.
- the display image may be one of a sequence of video frames.
- display image 12 is comprised of a set of discrete loci ⁇ ; ⁇ arranged in three-dimensional (3D) space.
- each locus Pi may correspond to a pixel of a display matrix used to form the display image.
- each locus Pi may be associated with corresponding digital color values Ri, Gi , and Bi, which define the relative brightness of that locus in each of three different color channels. All of the loci of display image 12 may be coplanar in some examples, but that condition is not strictly necessary.
- electronic display system 10 is a hinged device, and display image 12 is bent along the axis of hinge 14 to an angle a.
- electronic display system 10 includes a first display surface 16A and a second display surface 16B.
- Each display surface 16 e.g ., 16A and 16B in FIG. 1 is configured to receive and transmit display light from one or more light-emissive elements arranged beneath that display surface. In this manner, each display surface is configured to present at least a section of display image 12.
- the first and second display surfaces are separated by an adjustable angle a, via hinge 14.
- Some example electronic display systems may include only one display surface, or more than two.
- the plural display surfaces may be the same or different from each other with respect to dimensions and/or technology.
- the plural display surfaces need not be joined by a hinge, but may simply abut each other in a tiled arrangement, and thereby present a unitary display image.
- FIG. 2 shows an example display system 10’ configured in this manner.
- a single display surface 16 may be configured to present a display image 12 in its entirety.
- a display image may be partitioned into a plurality of sections 18 (e.g ., sections 18A and 18B), and each display surface 16 may be configured to present a different, corresponding section.
- sections 18A and 18B e.g ., sections 18A and 18B
- seamless, gapless presentation across the sections may be desired.
- FIG. 3 A shows an example display surface 16 and associated display componentry of electronic display system 10.
- FIG. 3 A shows an organic light-emitting diode (OLED) matrix 20, in which a plurality of individually addressable, emissive OLED elements 22 are arranged beneath the display surface.
- OLED organic light-emitting diode
- the elements 22 of OLED matrix 20 are bordered by a nonemissive area 24, which may be configured to seal or secure the OLED matrix, or provide electrical connections for addressing the elements.
- the nonemissive area of the OLED matrix may be bent or curved away from the primary viewing plane, which is defined by flat portion 28 A of display surface 16.
- the display surface is similarly bent or curved to follow substantially the contour of the OLED matrix.
- display surface 16 includes, in addition to flat portion 28, an edge portion 30, which is non-coplanar (i.e., nonparallel in an areal sense) to the flat portion.
- the edge portion follows the smooth curve of the OLED matrix.
- the edge portion may comprise any number of curved and/or plane-bevel facets non-coplanar to the flat portion.
- two hinged or otherwise abutting display surfaces 16, configured in this manner may be used to present a continuous, essentially unbroken display image 12, where a different section 18 of the display image (e.g., 18A and 18B in FIG. 3B) is presented on each display surface.
- hinge 14 is situated between adjacent edge portions 30 and is configured to pivotally couple display surface 16A to display surface [0017]
- each display surface 16 is the outer surface of a glass or transparent-polymer cover layer 32 of substantially constant thickness.
- the thickness and/or structure of the cover layer may be varied in order to impart desired ray-guiding properties.
- the cover layer may be configured so as to collect the emission from the OLED elements 22 below edge portion 30 and to release the emission in a direction normal to the primary viewing plane. Used in conjunction with curved OLED matrix 20, this approach may be used to provide substantially distortion-free image display all the way to visible edge of each display surface 16.
- FIG. 4. shows aspects of an electronic display system 10” based on liquid-crystal display (LCD) matrices 34.
- LCD liquid-crystal display
- a suitably engineered cover layer 32” may be used to re-image the pixel elements 22” of the LCD display so that the pixel elements appear very close to the shared edge of each display surface 16.
- image distortion resulting from the re imaging may be corrected preemptively during rendering of the display-image ( vide infra).
- electronic display system 10 includes a computer 36. Operatively coupled to the display componentry of the electronic display system, the computer may execute the rendering of display image 12 in addition to any other process described herein.
- the computer may include at least one processor 38 and associated computer memory 40.
- the computer may be configured to individually address and control the emission from each OLED element 22.
- the same computer 36 may address and control plural associated display matrices. This tactic enables plural sections 18 of the display image to be rendered conceitedly.
- the computer may be configured to render a plurality of sections of a display image for presentation on a corresponding plurality of display surfaces of the electronic display system.
- display-image rendering is responsive to one or more geometric inputs to computer 36 of electronic display system 10.
- the geometric inputs may reflect (1) the configuration of the electronic display system, including the layout and conformation among the various display surfaces; (2) the orientation of the electronic display system as configured; and (3) one or more ocular positions O of the user in a frame of reference of the electronic display system.
- each geometric input may be furnished by a sensor arranged in the electronic display system and coupled operatively to the computer.
- each geometric input may be estimated heuristically by the computer based on the current usage scenario of the electronic display system.
- each geometric input may be evaluated and re-evaluated in real time as the electronic display system is used, so that the computer is able to dynamically adjust the display-image presentation in response to changing geometry. Example geometric inputs are described below.
- electronic display system 10 includes a hinge-angle sensor 42 and at least one abutment sensor 44.
- the hinge-angle sensor is configured to furnish an output responsive to the angle of separation a between flat portion 28A and flat portion 28B of respective display surfaces 16A and 16B.
- Each abutment sensor 44 is configured to furnish an output responsive to abutment of display surface 16A to any other display surface 16.
- the hinge-angle sensor may be potentiometer-based, and the abutment sensor may be an electrostatic or Hall-effect sensor; in other examples, various other sensor technologies may be used.
- Electronic display system 10 includes an inertial measurement unit (EMU) 46, magnetometer 48, and palm sensor 50.
- the IMU may comprise either or both of a multi- axis accelerometer and a multi-axis gyroscope configured to sense, respectively, translational and rotational movement of the electronic display system.
- the magnetometer may be configured to sense the absolute orientation of the electronic display system based on a geomagnetic measurement. Alone or in combination with the output from hinge-angle sensor 42, output from the IMU and magnetometer are responsive to the orientation of each display surface 16 of the electronic display system. Accordingly, such output may be furnished to computer 36.
- palm sensor 50 may be configured to sense the location of the user’s palm in scenarios in which the electronic display system is being held in the user’s hand.
- the computer may be configured to estimate the orientation of each display surface heuristically, based on output from the palm sensor.
- feature imaging based on a world-facing camera may be used to determine the orientation of the electronic display system.
- Electronic display system 10 includes an optional user-facing camera 52 configured to acquire an ocular image of the user. More particularly, the user-facing camera is configured to image the user’s pupils, eyes, face, or head in real time. As shown in FIG. 5, user-facing camera 52 includes an on-axis lamp 54 and an off-axis lamp 56, these terms referring to the direction of illumination with respect to the optical axis Z of the user-facing camera. Each lamp may comprise a light-emitting diode (LED) or diode laser, for example, which emits infrared (IR) or near-IR illumination in a high-sensitivity band of the user facing camera.
- LED light-emitting diode
- IR infrared
- Off-axis illumination may create a specular glint 58 that reflects from the cornea 60 of the user’s eye. Off-axis illumination may also be used to illuminate the eye for a‘ dark pupil’ effect, where pupil 62 appears darker than the surrounding iri s 64. By contrast, on-axis illumination may be used to create a‘bright pupil’ effect, where the pupil appears brighter than the surrounding iris. More specifically, illumination of the retror effective tissue of retina 66 may reflect back through the pupil, forming a bright image 68.
- Ocular image data from user-facing camera 52 may be conveyed to computer 36. There, the data may be processed to resolve such features as the pupil center, pupil outline, and/or one or more specular glints 58. The locations of such features in the image data may be used as input parameters in a model— e.g ., a polynomial model— that relates feature position to an estimate of the right or left ocular position O of the user.
- the ocular position O may correspond to a pupil position itself.
- the ocular position may correspond to a position of the dominant eye of the user, or to a position that bisects a line segment joining the right and left eyes, for instance.
- the user-facing camera may be configured to recognize the user’s face, or head, and ocular positions may be estimated based on a suitable anatomical model. In examples in which two or more users are detected in the ocular image, additional ocular positions may be computed.
- user-facing camera 52 may be omitted in some implementations.
- computer 36 may be configured to estimate the ocular positions based on a series of heuristics.
- the user may be expected to view electronic display system 10 from a side opposite to the side that the operating system recognizes as the‘top’.
- the palm location may be sensed by palm sensor 50 and used to predict the likely vantage point of the user.
- the user may be expected to view the display screen from the side which is opposite to the side where the palm is located.
- FIG. 6 illustrates aspects of an example method 70 to present on an electronic display system 10 a display image 12 viewable from an ocular position O.
- the display image may be presented on one or more display surfaces 16 of the electronic display system.
- the configuration among two or more display surfaces 16 of electronic display system 10 is sensed by computer 36.
- the configuration may include layout information defining the relative arrangement of the display surfaces.
- the configuration may include conformational information defining the relative orientation of the display surfaces as determined by the hinge angle a.
- the configuration may be sensed via output from hinge-angle sensor 42 and/or abutment sensors 44, in view of stored data reflecting the dimensions and static configuration of the various display surfaces.
- the hinge angle a in some implementations, affects not only the orientation of a hinged display surface, but also the viewable size of that surface as viewed from a given ocular position ( vide infra).
- the overall orientation of the one or more display surfaces 16 of electronic display system 10 is sensed.
- the orientation may be sensed by computer 36 based on the output of IMU 46, magnetometer 48, and/or palm sensor 50, for example.
- one or more ocular positions O of one or more users of electronic display system 10 are estimated in the frame of reference of the display image 12.
- the ocular positions may be estimated by acquisition of an ocular image of the one or more users and subsequent analysis of the ocular image.
- ocular positions may be estimated heuristically— e.g., based on palm positioning on the electronic display system.
- control loop in which computer 36 iterates through each locus P of display image 12 and renders that locus at appropriate coordinates (U, V) of any display surface 16 on which the locus would be visible from ocular position O.
- the control loop at 78 may be executed for each display surface 16 of electronic display system 10, in sequence or in parallel.
- a locus P is mapped to coordinates (II, V) of display surface 16 where a straight line OP passing through O and P intersects the display surface. If the point of intersection of OP is within the boundaries of the display surface, then locus P will be presented on that display surface. Otherwise, P will not be presented on that display surface, but may be presented on another display surface.
- method 70 effectively partitions display image 12 into one or more sections 18 based on the position of that locus in the display image, and further based on the geometric inputs specifying configuration, orientation, and ocular position.
- the angle Q of the straight line OP is computed relative to the direction E of emergence of light from display surface 16.
- the direction of emergence may be normal to the display surface at coordinates (U, V). More generally, the direction of emergence may be computed based on the orientation of the emissive element 22 and the ray-directing properties (e.g ., refractive index and thickness) of cover layer 32.
- each OLED element 22 emits a Lambertian distribution centered normal (i.e., orthogonal) to the matrix.
- the energy emitted at non-orthogonal angles ( Q > 0) may be computed in terms of the cosine of Q.
- the projected off-orthogonal energy may be increased by the inverse of this value in order to compensate the observed brightness for the angle of observation.
- the angle may also be useful, inter alia , for mapping display surface coordinates ( U , V) to a corresponding pixel position (X, Y).
- the straight line OP is extrapolated in order to determine which pixel position (X, Y ) of display matrix 20 correspond to mapped coordinates (//, V) of display surface 16.
- the extrapolation may be computed according to Snell’s Law applied at the display surface, in view of the refractive index of cover layer 32. Such extrapolation is appropriate in examples in which light from an emissive element 22 refracts through cover layer 32 en route to coordinates (//, V).
- the corresponding pixel position (X, Y) is illuminated to a brightness which is based on the angle Q computed relative to the direction of emergence of light from display surface 16. Illumination of the pixel position may include actively increasing the level of illumination for coordinates ( U , V) with increasing angle Q , for a given desired brightness of locus P. In some examples, the active illumination at pixel position (X, Y) varies as 1 / cos Q.
- Steps 80 through 86 are now repeated, in sequence or in parallel, for all remaining loci P of display image 12.
- method 70 may return to 72 for re-evaluation of the configuration, orientation, and ocular position, prior to presentation of the next display image. Accordingly, any change in the geometric inputs—the hinge angle or ocular position, for example— may be reflected in the subsequent presentation of the display image.
- FIG. 7 demonstrates the implementation of method 70 under conditions of changing geometric inputs.
- FIG. 7 shows the rendering of the same locus P of display image 12 in different usage scenarios.
- hinge 14 When hinge 14 is set at an oblique angle and the display image is observed from ocular position O i, P is rendered on flat portion 28B of display surface 16B. As the hinge angle is opened further, more of the edge portions of both display surfaces become visible, thereby extending further into the edge portions the area to which the display image is rendered.
- OiP is rotated relative to its initial position, and P is now rendered on edge portion 30B of display surface 16B, even though the ocular position Oi has not changed.
- the display image when viewed from 0 ⁇ of a user, flows continuously from flat portion 28B of display surface 16B to the edge portion 30B of the same display surface.
- one or more rows of the display image rendered on flat portion 28B may be rendered duplicatively on ( e.g ., shifted over to) edge portion 30B.
- the‘rows’ of the display image may run horizontally or vertically with respect to the frame of reference of the electronic display system.
- Duplicative rendering of display content from flat portion 28B onto edge portion 30B is also shown in FIG. 8A.
- the row of pixel positions 88 from the flat portion are duplicated on the edge portion of the same display surface.
- FIG. 7 also demonstrates the effect of method 70 for a case in which the user’s ocular position shifts relative to electronic display system 10.
- P is rendered on edge portion 30B for observation from () ⁇ .
- the display image flows continuously to edge portion 30A of adjacent display surface 16A.
- one or more rows of the display image originally rendered on flat portion 28B may be rendered duplicatively on edge portion 30 A.
- Duplicative rendering of display content from flat portion 28B onto edge portion 30A is also shown in FIG. 8B.
- the row of pixel positions 88 from the flat portion are duplicated on the edge portion of the adjacent display surface.
- duplication of pixel rows may be concurrent, such that the duplicated rows are displayed at the same time.
- duplication of pixel rows may be from frame to frame, such that a portion of a frame is displayed using one row of pixels at an earlier time (e.g, Frameo), and then a corresponding portion of a subsequent frame is displayed using another row of pixels at a later time (e.g, Framei).
- One aspect of this disclosure is directed to an electronic display system comprising: a first display surface configured to receive and transmit display light from a first emissive element, the first display surface having a first flat portion and a first edge portion non-coplanar to the first flat portion; a second display surface configured to receive and transmit display light from a second emissive element, the second display surface having a second flat portion and a second edge portion non-coplanar to the second flat portion; and a computer configured to control the first and second emissive elements so as to present a first section of a display image on the first display surface and a second section of the display image on the second display surface, such that one or more rows of the display image rendered on the first flat portion are rendered duplicatively on the first or second edge portion.
- the one or more rows of the display image rendered on the first flat portion are rendered duplicatively on the first edge portion. In some implementations, the one or more rows of the display image rendered on the first flat portion are rendered duplicatively on the second edge portion. In some implementations, the display image, when viewed from a first ocular position of a user, flows continuously from the first flat portion to the first or second edge portion. In some implementations, the first and second sections are rendered so that the display image, when viewed from a second ocular position of the user, flows continuously from the second flat portion to the first or second edge portion. In some implementations, the computer is further configured to partition the display image into the first and second sections based on an estimate of the first ocular position.
- the electronic display system further comprises a hinge situated between the first and second edge portions and configured to pivotally couple the first display surface to the second display surface, and a sensor furnishing an output responsive to an angle of separation between the first and second flat portions; here the computer is further configured to partition the display image into the first and second sections based on the output.
- the electronic display system further comprises a camera configured to acquire an ocular image of the user, and the computer is further configured to estimate the ocular position by analysis of the ocular image.
- the electronic display system further comprises a sensor furnishing an output responsive to one or more of an orientation of the first display surface and an abutment of the first display surface to another display surface, and the computer is further configured to partition the display image into the first and second sections based on the output.
- Another aspect of this disclosure is directed to a method to present on a display surface of an electronic display system a display image viewable from an ocular position O, the method comprising: rendering a locus P of the display image by illuminating coordinates (U, V) of an edge portion of the display surface where a straight line OP passing through O and P intersects the edge portion, including increasing active illumination of the coordinates (U, V) with increasing angle of the straight line OP relative to a direction of emergence of light from the coordinates (U, V).
- the direction of emergence is normal to a surface of the edge portion at the coordinates (U, V), and the active illumination is increased with increasing angle of OP relative to the normal of the display surface.
- increasing the active illumination includes increasing by a factor 1 / cos Q, where Q is the angle of OP relative to the direction of emergence of light from the coordinates (U, V).
- illuminating the coordinates ⁇ II, V) includes refracting light from an emissive element associated with the coordinates.
- the ocular position O is a position of a dominant eye of a user of the electronic display system, or a position that bisects a line segment joining right and left eyes of a user of the electronic display system.
- the method further comprises estimating the ocular position O heuristically.
- the method further comprises acquiring an ocular image of a user of the electronic display system, and the ocular position O is estimated by analysis of the ocular image.
- the ocular position O is a pupil position.
- Another aspect of this disclosure is directed to a method to present on first and second display surfaces of an electronic display system a display image viewable from an ocular position O, the method comprising: sensing a configuration of the first and second display surfaces; estimating the ocular position 0 rendering a locus P of the display image by illuminating coordinates (U, V) of the first display surface where a straight line OP passing through O and P intersects the first display surface; and re-rendering the locus P of the display image by illuminating different coordinates ⁇ O’, V’) of the first or second display surface where a straight line OP passing through O and P intersects the first or second display surface, responsive to a change in OP.
- the change in OP is responsive to a change in O.
- the first and second display surfaces are held apart by an adjustable angle via a hinge situated between the first and second display surfaces, and the change in OP is responsive to a change in the angle.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Nonlinear Science (AREA)
- Signal Processing (AREA)
- Mathematical Physics (AREA)
- Crystallography & Structural Chemistry (AREA)
- Chemical & Material Sciences (AREA)
- Optics & Photonics (AREA)
- Multimedia (AREA)
- Computer Graphics (AREA)
- Devices For Indicating Variable Information By Combining Individual Elements (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/181,214 US11272045B2 (en) | 2018-11-05 | 2018-11-05 | Display presentation across plural display surfaces |
PCT/US2019/058421 WO2020096801A2 (en) | 2018-11-05 | 2019-10-29 | Display presentation across plural display surfaces |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3877824A2 true EP3877824A2 (en) | 2021-09-15 |
Family
ID=68618200
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19806075.8A Pending EP3877824A2 (en) | 2018-11-05 | 2019-10-29 | Display presentation across plural display surfaces |
Country Status (4)
Country | Link |
---|---|
US (1) | US11272045B2 (en) |
EP (1) | EP3877824A2 (en) |
CN (1) | CN112955812A (en) |
WO (1) | WO2020096801A2 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102692813B1 (en) * | 2019-08-20 | 2024-08-08 | 삼성전자 주식회사 | Electronic device and method for controlling operation mode based on status of electronic device thereof |
NL2025203B1 (en) | 2020-03-24 | 2021-10-20 | Microsoft Technology Licensing Llc | Alignment of modification regions with pixel registration |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB0028890D0 (en) | 2000-11-27 | 2001-01-10 | Isis Innovation | Visual display screen arrangement |
GB0223883D0 (en) | 2002-10-15 | 2002-11-20 | Seamless Display Ltd | Visual display screen arrangement |
US7570227B2 (en) * | 2003-10-17 | 2009-08-04 | Palo Alto Research Center Incorporated | Systems and methods for managing seams |
US7623105B2 (en) | 2003-11-21 | 2009-11-24 | Sharp Laboratories Of America, Inc. | Liquid crystal display with adaptive color |
US8368729B2 (en) | 2007-11-22 | 2013-02-05 | Sharp Kabushiki Kaisha | Display device |
WO2011067996A1 (en) | 2009-12-02 | 2011-06-09 | シャープ株式会社 | Display device and display method |
JP5561769B2 (en) * | 2010-04-08 | 2014-07-30 | Necカシオモバイルコミュニケーションズ株式会社 | Terminal device and program |
JP2012185797A (en) | 2011-02-15 | 2012-09-27 | Toshiba Corp | Electronic equipment |
US20130181892A1 (en) * | 2012-01-13 | 2013-07-18 | Nokia Corporation | Image Adjusting |
CN105324605B (en) | 2013-02-22 | 2020-04-28 | 瑞尔D斯帕克有限责任公司 | Directional backlight |
JP5922639B2 (en) | 2013-12-07 | 2016-05-24 | レノボ・シンガポール・プライベート・リミテッド | Foldable electronic device, display system, and display method |
KR102172980B1 (en) * | 2014-04-07 | 2020-11-02 | 삼성전자주식회사 | Tiled display system and method for processing images thereof |
EP3172621A4 (en) * | 2014-07-22 | 2018-05-23 | Barco Inc. | Display systems and methods employing polarizing reflective screens |
WO2016017948A1 (en) * | 2014-07-31 | 2016-02-04 | Samsung Electronics Co., Ltd. | Flexible device and interfacing method thereof |
KR102243106B1 (en) * | 2014-08-20 | 2021-04-22 | 삼성전자 주식회사 | Display apparatus and control method thereof |
US10520782B2 (en) | 2017-02-02 | 2019-12-31 | James David Busch | Display devices, systems and methods capable of single-sided, dual-sided, and transparent mixed reality applications |
KR102390984B1 (en) * | 2017-08-10 | 2022-04-26 | 엘지디스플레이 주식회사 | Display Device and Driving Method thereof |
-
2018
- 2018-11-05 US US16/181,214 patent/US11272045B2/en active Active
-
2019
- 2019-10-29 CN CN201980072604.8A patent/CN112955812A/en active Pending
- 2019-10-29 EP EP19806075.8A patent/EP3877824A2/en active Pending
- 2019-10-29 WO PCT/US2019/058421 patent/WO2020096801A2/en unknown
Also Published As
Publication number | Publication date |
---|---|
US20200142662A1 (en) | 2020-05-07 |
WO2020096801A3 (en) | 2020-10-01 |
US11272045B2 (en) | 2022-03-08 |
WO2020096801A2 (en) | 2020-05-14 |
CN112955812A (en) | 2021-06-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3571673B1 (en) | Method for displaying virtual image, storage medium and electronic device therefor | |
EP3227760B1 (en) | Pointer projection for natural user input | |
CN108700934B (en) | Wearable device capable of eye tracking | |
US9874932B2 (en) | Avoidance of color breakup in late-stage re-projection | |
US9779512B2 (en) | Automatic generation of virtual materials from real-world materials | |
US9480397B2 (en) | Gaze tracking variations using visible lights or dots | |
CN105992965B (en) | In response to the stereoscopic display of focus shift | |
TWI704501B (en) | Electronic apparatus operated by head movement and operation method thereof | |
US20170256095A1 (en) | Blocking screen in Augmented Reality | |
CN107209386A (en) | Augmented reality visual field object follower | |
JP2017539108A (en) | Display visibility based on eye convergence | |
JP2017534957A (en) | Display that reduces eye discomfort | |
US11250541B2 (en) | Camera-based transparent display | |
US11272045B2 (en) | Display presentation across plural display surfaces | |
CN109643152A (en) | Use face and the eyes tracking of the face sensor in head-mounted display and FA Facial Animation | |
US20180158390A1 (en) | Digital image modification | |
CN107148591A (en) | Display device and display control method | |
US20240036699A1 (en) | Devices, Methods, and Graphical User Interfaces for Processing Inputs to a Three-Dimensional Environment | |
US10706600B1 (en) | Head-mounted display devices with transparent display panels for color deficient user | |
US20240104843A1 (en) | Methods for depth conflict mitigation in a three-dimensional environment | |
WO2024026024A1 (en) | Devices and methods for processing inputs to a three-dimensional environment | |
WO2024054433A2 (en) | Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments | |
WO2024020061A1 (en) | Devices, methods, and graphical user interfaces for providing inputs in three-dimensional environments | |
CN118694912A (en) | Gaze-aware tone mapping with adaptive glints |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20210429 |
|
AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
RAP3 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20230206 |