EP2500898A1 - System and method for foldable display - Google Patents
System and method for foldable display Download PDFInfo
- Publication number
- EP2500898A1 EP2500898A1 EP11158915A EP11158915A EP2500898A1 EP 2500898 A1 EP2500898 A1 EP 2500898A1 EP 11158915 A EP11158915 A EP 11158915A EP 11158915 A EP11158915 A EP 11158915A EP 2500898 A1 EP2500898 A1 EP 2500898A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- display
- fold
- display unit
- visual information
- format
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 230000000007 visual effect Effects 0.000 claims abstract description 60
- 238000004590 computer program Methods 0.000 claims abstract description 18
- 230000006735 deficit Effects 0.000 claims abstract description 15
- 230000004044 response Effects 0.000 claims abstract description 15
- 238000001514 detection method Methods 0.000 claims description 34
- 230000008859 change Effects 0.000 claims description 6
- 239000004973 liquid crystal related substance Substances 0.000 claims description 2
- 238000012544 monitoring process Methods 0.000 claims 1
- 230000004075 alteration Effects 0.000 abstract 1
- 238000012986 modification Methods 0.000 abstract 1
- 230000004048 modification Effects 0.000 abstract 1
- 238000005516 engineering process Methods 0.000 description 19
- 238000012545 processing Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 2
- 230000009977 dual effect Effects 0.000 description 2
- 230000005055 memory storage Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000001010 compromised effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000000875 corresponding effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000003362 replicative effect Effects 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/2092—Details of a display terminals using a flat panel, the details relating to the control arrangement of the display terminal and to the interfaces thereto
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/03—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes specially adapted for displays having non-planar surfaces, e.g. curved displays
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/03—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes specially adapted for displays having non-planar surfaces, e.g. curved displays
- G09G3/035—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes specially adapted for displays having non-planar surfaces, e.g. curved displays for flexible display surfaces
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/36—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0606—Manual adjustment
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/06—Adjustment of display parameters
- G09G2320/0613—The adjustment depending on the type of the information to be displayed
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/14—Solving problems related to the presentation of information to be displayed
Definitions
- This technology relates generally to display devices, and more particularly to foldable display devices used for display of visual information.
- Foldable displays are now becoming available for use in displaying visual information such as text, video or graphics.
- the availability of these foldable displays is providing opportunities for innovative new display systems that can offer many advantages over conventional rigid displays.
- FIGS. 1A and 1B are schematic illustrations of a display system according one embodiment of the present technology.
- FIG. 2 illustrates a foldable display device with fold detection devices according to one example embodiment of the present technology.
- FIG. 3 is a flowchart illustrating an example method and computer program suitable for determining the folding of a display device, according to one example embodiment of the present technology.
- FIG. 4 is a flowchart illustrating an example method and computer program to control the format of the display according to one example embodiment of the present technology.
- FIGS. 5A and 5B illustrate the changing of the display format from one format to another format, according to one example embodiment of the present technology.
- FIGS. 6A , 6B and 6C illustrate several example embodiments of devices incorporating a display system according to the present technology.
- FIG. 7 illustrates in schematic form a computing platform suitable for use in certain example embodiments of the present technology.
- FIG. 8 illustrates the integration of a display system into a further computing environment.
- a display unit of the display device has at least some flexible portions that allow it to be folded in one or more locations.
- the fold may be any substantial deformation.
- the fold may be along one or more substantially fixed lines in the display unit, such as may be the case where a display unit is capable of folding at some places but not others.
- the fold may be, but need not be, a substantially sharp crease.
- the display unit in one example embodiment, is deformed along a line of the fold, compromising the display of visual information in the deformed area.
- the display format of displayed visual information such as but not limited to the configuration, characteristics, size, form, position, brightness, layout, shading, spacing, perspective, coloration or design, are altered, modified or changed in order to adapt the visual information to the deformed area caused by the folding or unfolding of the display unit.
- the display format is changed in order to avoid distortion, illegibility, imperceptibility or sub-optimal presentation of the visual information in such deformed areas or locations of the display unit.
- display system 10 including a display device 12 having a display element, which may also be referred to as unit 11 or display unit 11 or foldable display unit 11, capable of displaying visual information.
- display unit 11 is a component of display device 12, which may include additional components to provide physical support to the display unit 11 or complementary electronic functionality such as connectors or circuits to drive the display unit 11.
- display unit 11 is contained in a housing of display device 12, or is self-supporting or contained in a separate housing from other components of display device 12.
- Display unit 11, or optionally the entire display device 12, is flexible or foldable to provide for folding 13 of the display unit 11 along at least one axis 15.
- the display unit 11 displays visual information using, for example but not by way of limitation, liquid crystal display elements, organic or inorganic light emitting diode elements, and/or plasma display technology, through, for example, a display surface or screen of the unit 11.
- display unit 11 When folded, as illustrated in FIG. 1B , display unit 11 has at least one fold, along an axis 15, that creates a deformation 17 in the display, along the axis 15.
- the deformation 17, in some cases, takes the form of a fold line, crease or an elbow turn, and results in impairment or compromising of the ability of display unit 11 to display visual information, or impairment of the ability of a viewer to clearly see visual information displayed on or near the deformation 17.
- Such impairment may be caused, for example, by distortion, blocking, compression, pinching, overlap, compromised viewing angles, and/or obfuscation of visual information displayed on or near the deformation 17.
- references to "folding" of the display unit 11 shall mean folding the display unit 11 from a substantially planar (or default) configuration to a folded configuration, or from a folded configuration to a planar configuration, or between different degrees of folded states of the display unit 11.
- the deformation 17 of the display includes that area of the display unit 11 that is curved, compressed, pinched and/or has a discontinuity where the plane of the display changes from one orientation to another partially or fully transverse orientation on the other side of the deformation 17.
- the foldable display unit 11 and/or device 12 may be foldable along any line or location or orientation of the display unit 11 and/or device 12, or only along predetermined lines or axes.
- deformation of visual information in an area of the display is avoided by automatically dividing the display area into display sub-areas, for example areas 11A and 11B (which may be thought of as display areas on opposite sides of the fold along axis 15), that do not contain the deformation 17, and moving the display of visual information from the original display area into the sub-areas.
- a display control unit 14 receives display data 16 from a data source 18 and produces one or more display control signals 20 for application to one or more display control inputs 24 of display device 12, in order to produce visual information on the display unit 11 of display device 12.
- Display unit 11 is operative to display (i.e., is capable of displaying) the visual information, based at least in part on display data 16.
- display data 16 conveys or holds or encodes the visual information to be displayed.
- display control unit 14 includes at least one additional input 26 to receive a fold signal 30, from fold detection system 54, that is indicative of the folding or unfolding of at least some portion of display unit 11, and optionally the location(s) of fold deformations.
- Display control unit 14 receives display data 16 and at least one fold signal 30, indicative of a fold in display unit 11, and generates as output one or more display control signals 20 that cause display 11 unit to display the visual information.
- Signal 30 may take the form of one or more analog signals, or digital signals or data.
- Fold detection system 54 receives one or more load signals 51 from load cells 50, shown and described with respect to FIG. 2 , used to detect a fold in the display unit 11.
- display control unit 14 takes the form of an integrated circuit responsible for generating the timing of display control signals 20, such as, for example, horizontal and vertical synchronization signals, and a blanking interval signal.
- the data source 18 is a video random access memory (RAM), or other storage device, such as but not limited to a magnetic or optical storage device, or a processing device.
- display control unit 14 is a video display processor (VDP).
- the display control unit 14 is a video display controller that may take the form of a video shifter, a cathode ray tube controller (CRTC), a video interface controller, or a video code processor.
- the display control unit 14 may be mounted on a central processing unit (CPU) motherboard, or integrated into a microprocessor chip.
- the display control signals 20 may be analog or digital, for example but not limited to component video, digital visual interface (DVI), video graphics array (VGA) or high-definition multimedia interface (HDMI) video control signals.
- the display system of the present technology includes data source 18, display control unit 14, display device 12 (including any fold detection devices associated therewith) and fold detection system 54, as illustrated for example in FIGS. 1A , 1B and 2 .
- the display system may include fewer than all of these components, such as, in one embodiment, the system may only include display control unit 14, or, in another example embodiment, the system may only include fold detection system 54 or, in yet another example embodiment, the system may only include fold detection system 54 and display control unit 14.
- the methods and computer program products described herein may also, in alternative embodiments, include or encompass only the operations or functionality of the alternate system embodiments described herein,
- the fold signal 30 may be obtained or derived from one or more fold detection devices, which in one example embodiment comprise load cell(s) 50, mounted or integrated with display unit 11 and/or display device 12, that produce fold detection signals, for example in one embodiment, load cell signal(s) 51 (also shown in FIG. 1A ).
- the load cell(s) 50 are bonded onto display unit 11 and/or display device 12 such that folding of the display unit 11 and/or display device 12 produces corresponding analog (or, in an alternate embodiment, digital) load cell signal(s) 51 in one or more of the load cell(s) 50.
- the load cell signal(s) 51 from load cell(s) 50 are conveyed on signal paths 52 to the fold detection system 54 ( FIG. 1A ) taking, for example, the form of a computing platform having a programmable computer or other electronic device capable of interpreting the signal(s) 51 to generate fold signal 30.
- signal(s) 51 are analog signals, and are converted to digital signals or data and processed in fold detection system 54 to determine the location of folds in the display device 12.
- separate analog to digital circuits may be employed to digitize the signal(s) 51, if in analog form, prior to delivery to fold detection system 54.
- load cell(s) 50 are oriented fully or partially transversely to one another in order that folds in display unit 11 and/or device 12 can be ascertained in both directions or diagonally using the signal(s) 51.
- fold detection system 54 determines the approximate or exact degree of folding of display unit 11, or alternatively only whether the display unit 11 is folded or not, and if more than one fold axis is possible, the location of the fold axis.
- fold detection system 54 may determine the location of each axis, as well as the degree of folding at each axis.) In one example embodiment, the determination of the foregoing is made using the relative magnitude of the signals from load cell(s) 50.
- the signal(s) 51 generated from load cell(s) 50 are proportional to or at least can be correlated to the amount of or degree of fold in the display unit 11 and/or device 12. Such correlations may be established, for example, by storing predetermined or known signal characteristics of the load cell(s) 50, for example in the form of coefficients or other parameters stored in a memory or storage device, that are used to translate load cell signals 51 into the degree of fold in the display unit.
- the fold detection system 54 records fold data representing the degree of folds and location of the fold axis, or axes if more than one fold is present, in a storage device or memory, on or off-board, the fold detection system 54. According to one example embodiment, if the folding of the display unit 11 and/or device 12 is restricted to folding along one or a limited number of fold lines, a single load cell 50 may be appropriately positioned along the preset fold line in order to detect the fold along that particular line.
- the folding or unfolding of display unit 11 or display device 12 may be determined using other means such as from images of the display device 12 captured from one or more cameras, wherein the images are processed in order to determine the folding of the display unit 11 or device 12.
- a signal source such as an infra-red source on one side of the display device 12 may be detected by a detector, such as an infra-red detector, on the opposite side of the display device 12, wherein the detection or magnitude of the signal detected may indicate folding or the degree of folding.
- the fold detection devices may be integrated with the display unit 11, or fastened or integrated with the back (non-display) side of the display unit 11 or display device 12.
- the fold detection signal may be generated from user input without the use of a fold detection device.
- load cell signal(s) 51 serving as fold detection signals
- the method 100 determines the relative degree of strain or load on the load cell(s) 50 and the location of the fold, from signal(s) 51 (114).
- method 100 determines the fold, degree of fold and/or location of the fold in display unit 11 and/or device 12 (116), and generates or produces, in one example embodiment, the fold signal 30 that is conveyed to the display control unit 14. In another example embodiment, method 100 continuously monitors the signal(s) 51 and continuously re-determines the fold signal 30.
- the determination of fold signal 30 from signal(s) 51 is on-demand from a viewer, in response to a change in the load cell signal(s) 51, and/or made from time-to-time but not continuously.
- the method 100 operates on a central processing unit and is stored in a memory device or storage device on-board or off-board fold detection system 54.
- Fold detection system 54 may include, in one embodiment, the computing system 700 of FIG. 7 , wherein the computer program implementing method 100 may be stored and executed, for example, as described with respect to program 725.
- method 170 operates to control the display format of visual information on display unit 11 in response to display data 16 and the fold signal 30.
- Method 170 in one example embodiment, continuously monitors for folding of the display, either from an unfolded state to a folded state, from one degree of folding to another degree of folding, or from a folded state to an unfolded state (172).
- method 170 operates only in response to detection of a folding action of the display by the fold detection devices, and/or in response to a user input that is conveyed to display control unit 14.
- Method 170 is responsive to fold signal 30, received from the fold detection system 54, to input and receive the fold and/or the degree of fold of the display unit 11 and/or device 12 (174). Using the fold signal 30 and the display data 16, method 170 determines the display format to be used for displaying visual information on display unit 11 (176). Based on the determined format, the visual information presented on display unit 11 are altered or modified, for example by adapting (e.g., altering or modifying) the display data 16 and/or the one or more display control signals 20, or an intermediate form of the signals and/or data, to change the format or use of the display area in which visual information is presented (178).
- adapting e.g., altering or modifying
- the display format may be a default format to display visual information on a substantially planar display area that is substantially the full displayable area of the display unit 11, while in a second mode of operation, the planar display area may be divided into two or more sub-areas that avoid a deformed area of the display caused by folding of the display unit 11, and the format of the visual information is adapted for this sub-divided configuration of the display unit 11.
- the visual information presented is text, and the format is changed from or between a first format in which substantially the entire display area of display unit 11 is used, and another format in which the display is divided into display sub-areas, such as illustrated in FIGS. 5A and 5B , wherein the display area in or near the deformation 17 (shown in FIGS. 1A and 1B ) is not used for display, to avoid impairment in the display of information in or near the deformation 17.
- visual information continues to be displayed along and in the area of the deformation 17 in the display, but is altered or changed in order to improve the perceptibility or display characteristics of the visual information, for example by performing any of the operations to alter the display as otherwise described herein, such as increasing the size of visual information, such as fonts, in the area of the deformation, or changing the color or brightness of visual information.
- the portion of the video image coinciding with the deformed area of the display may be altered to diminish any actual or perceived distortion in the image, while still enabling the video image to be displayed entirely or substantially across the deformed area, or in sub-portions of the deformed area that provide the appearance of continuous image display across the deformed area.
- the display images are shifted or moved from a first display area that is separated by a fold, to an area of the display that is smaller and on only one side of the fold, and the scale of the images is reduced to fit into the reduced display area.
- a computer program implementing method 170 ( FIG. 4 ) operates on a central processing unit and is stored in a memory device or storage device on-board or off-board display control unit 14.
- Display control unit 14 may include, in one embodiment, the computing system 700 of FIG. 7 , wherein the computer program may be stored and executed, for example, as described with respect to program 725.
- compensation for impairment or distortion in the fold deformations may include, for example, avoiding the display of visual information in the deformed area, changes in format including stretching, narrowing, enlarging, shrinking, tilting, rotating, obliterating, replicating, interpolating or changing the color of an image or part of an image.
- Such compensation may be performed, for example, by substituting alternative display data or modifying the display data, by transforming the display data, and/or by adapting or modifying the generation of display control signals independently of the display data.
- compensation for impairment or distortion may include, for example, substituting or modifying fonts for text, such as fonts specifically adapted to reduce distortion experienced from proximity to a deformation 17.
- compensation or correction for impairment or distortion may reduce or eliminate one or more undesirable effects associated with the impairment or distortion. Any technique for compensation or correction may be applied.
- the method 170 may, in one example embodiment, mathematically determine the kinds and degrees of distortion that may be experienced by a viewer, for example assuming the display device 12 is viewed from a particular, typical, viewing angle.
- FIG. 5A and FIG. 5B A change of display format from a single display area format 190 to a dual display area format 192 is illustrated in FIG. 5A and FIG. 5B .
- visual information displayed in the single display area format 190 of FIG. 5A is automatically reformatted to the dual area 192 of FIG. 5B upon detection of a fold along axis 194.
- the display area formats 190 and 192 delineated by the dashed lines, do not overlap or coincide with the fold axis 194 or any deformation resulting therefrom.
- the reformatting may take place in response to a viewer-initiated input that is conveyed to display control unit 14.
- multiple predetermined display formatting options or display templates may be stored in the memory or storage device for display control unit 14, and used, respectively, for different fold states or configurations.
- folding of the display device 12 along the center of the display unit 11 would invoke a format providing two display sub-areas in which information is displayed, while folding the display along two fold axes may invoke a format providing for display of visual information in three display sub-areas, each within a separate plane or substantially planar area of the display.
- the display templates are based on the type of visual information to be displayed, such as text, pictures, images or video, such that method 170 (or any computer program implementing the method) changes the display format based on the type of information as well as in response to the folding state or configuration of the display.
- visual information such as text, pictures, images or video
- method 170 or any computer program implementing the method
- video such as a movie might not be split between two different sides of the display, but for example be shifted to display only in the display area on one side of a fold.
- the display format or template provides a privacy mode of display in which only one, or certain ones, of the sub-areas of the folded display are used to display visual information, such that a viewer of the display device 12 can shield visual information displayed on the display device 12 from the view of others located near the display device 12.
- the privacy mode of display is initiated by a user input to system 10.
- any unused portion of the display may be automatically, semi-automatically or manually (by user input), under control of method 170 (or any computer program implementing the method), deactivated and power to that area of the display reduced or eliminated, for example by directly reducing power or by altering the display data to substitute display data that causes the deactivated display area to be dimmed or darkened.
- display system 10 may be incorporated in a reading device 200, such as an e-reader, that may be held in a user's hands and have a form factor such as that illustrated.
- a reading device 200 such as an e-reader
- display system 10 may be incorporated in a handheld mobile device such as a mobile telephone and/or smart phone 210.
- system 10 may be used in a personal computing system 220 with a foldable display 222 allowing the user to fold the display, for example to increase privacy in viewing the display in a crowded setting.
- Other devices that may incorporate the display system 10 include laptop computers, notebook computers, tablet computers, and display systems.
- System 700 includes a central processing unit 710 including a processing unit 702 and memory 704, removable memory storage 712, and non-removable storage 714.
- Memory 704, which stores computer instructions or a computer program 725, may include volatile memory 706 and non-volatile memory 708.
- System 700 may include or have access to a computer environment that includes a variety of computer-readable (or machine-readable) media, such as volatile memory 706 and non-volatile memory 708, removable memory storage 712 and non-removable storage 714.
- Computer storage includes random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) and electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile discs (DVD) or other optical disc storage, magnetic cassettes, magnetic tape, magnetic disc storage or other magnetic storage devices, or any other tangible and physical medium capable of storing computer-readable instructions.
- System 700 may include or have access to a computing environment that includes input 716, output 718, and a communications connection 720. The system 700 may operate in a networked environment using communications connection 720 to connect to one or more remote computers.
- the remote computers may include a personal computer (PC), server, router, network PC, a peer device or other common network node, or the like.
- the communications connection 720 may include a local area network (LAN), a wide area network (WAN) and other networks.
- Computer-readable instructions or program 725 is stored on a tangible and physical computer-readable medium in non-transitory form and executable by the processing unit 702 of the system 700. Instructions or program 725 may be stored in one or more different tangible, physical and non-transitory articles including computer-readable mediums such as memory 704 and storage 712 or 714.
- display system 10 is further integrated in a computer environment 800, wherein environment 800 uses system 10 in order to display visual information requested by environment 800 for display, for example in response to a user selection of information or in response to a computer program executing in environment 800.
- computer environment 800 includes a computing platform such as that described with respect to FIG. 7 .
- the display device 12 may be a foldable, wrappable, moldable plastic display, for example, available from the Hewlett-Packard (HP) corporation.
- display device 12 might be a folding display, for example as available from Philips Corporation.
- the foldable display may be obtained from Plastic Logic, Inc., for example as used in their Plastic Reader device.
- the display control unit 14 is a graphics processing unit (GPU) that is a specialized microprocessor system that offloads and accelerates 3D or 2D graphics rendering from a general purpose microprocessor system in which the display control unit 14 is used.
- the display control unit 14 is integrated on the central processing unit of a general processing computer, or is deployed on a separate dedicated video card that may be installed in a slot of a personal computer or server system.
- the display control unit 14 is a hybrid of the above described solutions.
- the display control unit 14 may use stream processing and general purpose GPUs.
- the functionality of display control unit 14 and fold detection system 54 may be combined or rearranged so that all of the functions may be in a single unit or accomplished by a single computer program or method, or so that functions of one may be substituted or added to functions of the other. Further, such functionality of unit 14 and system 54 may, in one example embodiment, be combined in whole or in part with display device 12, or another component of the system, such as a software utility or application operating on a processing system separate and apart from the display unit 14, fold detection system 54 or display device 12. In addition, according to other example embodiments, the various functionalities described herein may be implemented in hardware, software or combinations thereof.
- a display system, method and computer program product for a foldable display wherein the format of the display is adjusted to avoid or compensate for impairment or distortion in the display of visual information on or near a deformation in the display resulting from folding the display. Also described, among other things, is a system, method and computer program product for detection of folds in a display unit.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Crystallography & Structural Chemistry (AREA)
- Controls And Circuits For Display Device (AREA)
- Devices For Indicating Variable Information By Combining Individual Elements (AREA)
- User Interface Of Digital Computer (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
Description
- This technology relates generally to display devices, and more particularly to foldable display devices used for display of visual information.
- Foldable displays are now becoming available for use in displaying visual information such as text, video or graphics. The availability of these foldable displays is providing opportunities for innovative new display systems that can offer many advantages over conventional rigid displays.
- The accompanying figures, in which like reference numerals refer to identical or functionally-similar elements throughout the separate views and which are incorporated in and form part of the specification, further illustrate the present technology that is the subject of this disclosure and, together with the detailed description of the technology, serve to explain the principles of the present technology.
-
FIGS. 1A and1B are schematic illustrations of a display system according one embodiment of the present technology. -
FIG. 2 illustrates a foldable display device with fold detection devices according to one example embodiment of the present technology. -
FIG. 3 is a flowchart illustrating an example method and computer program suitable for determining the folding of a display device, according to one example embodiment of the present technology. -
FIG. 4 is a flowchart illustrating an example method and computer program to control the format of the display according to one example embodiment of the present technology. -
FIGS. 5A and 5B illustrate the changing of the display format from one format to another format, according to one example embodiment of the present technology. -
FIGS. 6A ,6B and 6C illustrate several example embodiments of devices incorporating a display system according to the present technology. -
FIG. 7 illustrates in schematic form a computing platform suitable for use in certain example embodiments of the present technology. -
FIG. 8 illustrates the integration of a display system into a further computing environment. - Described herein are various embodiments of display technologies used to display any kind of visual information, such as (but not limited to) text, video, pictures, two- or three-dimensional images, icons, cursors or graphics, on foldable display devices. In some embodiments, a display unit of the display device has at least some flexible portions that allow it to be folded in one or more locations. The fold may be any substantial deformation. The fold may be along one or more substantially fixed lines in the display unit, such as may be the case where a display unit is capable of folding at some places but not others. The fold may be, but need not be, a substantially sharp crease. When folded, the display unit, in one example embodiment, is deformed along a line of the fold, compromising the display of visual information in the deformed area. The display format of displayed visual information, such as but not limited to the configuration, characteristics, size, form, position, brightness, layout, shading, spacing, perspective, coloration or design, are altered, modified or changed in order to adapt the visual information to the deformed area caused by the folding or unfolding of the display unit. In one example embodiment, as described in more detail below, the display format is changed in order to avoid distortion, illegibility, imperceptibility or sub-optimal presentation of the visual information in such deformed areas or locations of the display unit. These and other embodiments, described in more detail below, enable advantageous use of foldable display devices in various applications and on various machines, such as but not limited to mobile devices, smart phones, e-readers, laptop computers, notebook computers, tablet computers, personal computers and display systems.
- The following description should be read with reference to the drawings, in which like elements in different drawings are numbered in like fashion. The drawings, which are not necessarily to scale, depict illustrative embodiments and are not intended to limit the scope of the claims appended hereto. Although examples of various steps are illustrated in the various views, many of the examples provided have suitable alternatives that can be utilized. Moreover, while several illustrative applications are described throughout the disclosure it should be understood that the present technology could be employed in other applications where foldable display technology is of value.
- Referring now to
FIGS. 1A and1B , there is schematically illustrated adisplay system 10 including adisplay device 12 having a display element, which may also be referred to asunit 11 ordisplay unit 11 orfoldable display unit 11, capable of displaying visual information. In one example embodiment,display unit 11 is a component ofdisplay device 12, which may include additional components to provide physical support to thedisplay unit 11 or complementary electronic functionality such as connectors or circuits to drive thedisplay unit 11. In another example embodiment,display unit 11 is contained in a housing ofdisplay device 12, or is self-supporting or contained in a separate housing from other components ofdisplay device 12.Display unit 11, or optionally theentire display device 12, is flexible or foldable to provide for folding 13 of thedisplay unit 11 along at least oneaxis 15. According to various example embodiments, thedisplay unit 11 displays visual information using, for example but not by way of limitation, liquid crystal display elements, organic or inorganic light emitting diode elements, and/or plasma display technology, through, for example, a display surface or screen of theunit 11. - When folded, as illustrated in
FIG. 1B ,display unit 11 has at least one fold, along anaxis 15, that creates adeformation 17 in the display, along theaxis 15. Thedeformation 17, in some cases, takes the form of a fold line, crease or an elbow turn, and results in impairment or compromising of the ability ofdisplay unit 11 to display visual information, or impairment of the ability of a viewer to clearly see visual information displayed on or near thedeformation 17. Such impairment may be caused, for example, by distortion, blocking, compression, pinching, overlap, compromised viewing angles, and/or obfuscation of visual information displayed on or near thedeformation 17. When such impairment results from folding of thedisplay unit 11 it is accordingly desirable to adjust for such impairments in order to restore unimpaired display of visual information. Conversely, when the deformation (or deformations) 17 is (are) eliminated by unfolding of thedisplay unit 11, adjustments made to accommodate such deformation(s) 17 may be discontinued. As used herein, references to "folding" of thedisplay unit 11 shall mean folding thedisplay unit 11 from a substantially planar (or default) configuration to a folded configuration, or from a folded configuration to a planar configuration, or between different degrees of folded states of thedisplay unit 11. - According to one example embodiment, the
deformation 17 of the display includes that area of thedisplay unit 11 that is curved, compressed, pinched and/or has a discontinuity where the plane of the display changes from one orientation to another partially or fully transverse orientation on the other side of thedeformation 17. According to various other example embodiments, thefoldable display unit 11 and/ordevice 12 may be foldable along any line or location or orientation of thedisplay unit 11 and/ordevice 12, or only along predetermined lines or axes. In one embodiment, described in more detail below, deformation of visual information in an area of the display is avoided by automatically dividing the display area into display sub-areas, forexample areas 11A and 11B (which may be thought of as display areas on opposite sides of the fold along axis 15), that do not contain thedeformation 17, and moving the display of visual information from the original display area into the sub-areas. - Referring again to
FIG. 1A , adisplay control unit 14 receivesdisplay data 16 from adata source 18 and produces one or moredisplay control signals 20 for application to one or moredisplay control inputs 24 ofdisplay device 12, in order to produce visual information on thedisplay unit 11 ofdisplay device 12.Display unit 11 is operative to display (i.e., is capable of displaying) the visual information, based at least in part ondisplay data 16. In general, displaydata 16 conveys or holds or encodes the visual information to be displayed. As further illustrated inFIG. 1A ,display control unit 14 includes at least oneadditional input 26 to receive afold signal 30, fromfold detection system 54, that is indicative of the folding or unfolding of at least some portion ofdisplay unit 11, and optionally the location(s) of fold deformations.Display control unit 14 receivesdisplay data 16 and at least onefold signal 30, indicative of a fold indisplay unit 11, and generates as output one or moredisplay control signals 20 that causedisplay 11 unit to display the visual information.Signal 30 may take the form of one or more analog signals, or digital signals or data.Fold detection system 54 receives one ormore load signals 51 fromload cells 50, shown and described with respect toFIG. 2 , used to detect a fold in thedisplay unit 11. - According to one embodiment,
display control unit 14 takes the form of an integrated circuit responsible for generating the timing ofdisplay control signals 20, such as, for example, horizontal and vertical synchronization signals, and a blanking interval signal. According to another example embodiment, thedata source 18 is a video random access memory (RAM), or other storage device, such as but not limited to a magnetic or optical storage device, or a processing device. According to still another example embodiment,display control unit 14 is a video display processor (VDP). According to another example embodiment, thedisplay control unit 14 is a video display controller that may take the form of a video shifter, a cathode ray tube controller (CRTC), a video interface controller, or a video code processor. According to still other example embodiments, thedisplay control unit 14 may be mounted on a central processing unit (CPU) motherboard, or integrated into a microprocessor chip. According to other example embodiments, thedisplay control signals 20 may be analog or digital, for example but not limited to component video, digital visual interface (DVI), video graphics array (VGA) or high-definition multimedia interface (HDMI) video control signals. - According to one example embodiment, the display system of the present technology includes
data source 18,display control unit 14, display device 12 (including any fold detection devices associated therewith) andfold detection system 54, as illustrated for example inFIGS. 1A ,1B and 2 . In another example embodiment, the display system may include fewer than all of these components, such as, in one embodiment, the system may only includedisplay control unit 14, or, in another example embodiment, the system may only includefold detection system 54 or, in yet another example embodiment, the system may only includefold detection system 54 anddisplay control unit 14. Further, the methods and computer program products described herein may also, in alternative embodiments, include or encompass only the operations or functionality of the alternate system embodiments described herein, - As illustrated schematically in
FIG. 2 , according to one example embodiment, the fold signal 30 (shown inFIG. 1A ) may be obtained or derived from one or more fold detection devices, which in one example embodiment comprise load cell(s) 50, mounted or integrated withdisplay unit 11 and/ordisplay device 12, that produce fold detection signals, for example in one embodiment, load cell signal(s) 51 (also shown inFIG. 1A ). According to another example embodiment, the load cell(s) 50 are bonded ontodisplay unit 11 and/ordisplay device 12 such that folding of thedisplay unit 11 and/ordisplay device 12 produces corresponding analog (or, in an alternate embodiment, digital) load cell signal(s) 51 in one or more of the load cell(s) 50. The load cell signal(s) 51 from load cell(s) 50 are conveyed onsignal paths 52 to the fold detection system 54 (FIG. 1A ) taking, for example, the form of a computing platform having a programmable computer or other electronic device capable of interpreting the signal(s) 51 to generatefold signal 30. According to one embodiment, signal(s) 51 are analog signals, and are converted to digital signals or data and processed infold detection system 54 to determine the location of folds in thedisplay device 12. Alternatively, separate analog to digital circuits may be employed to digitize the signal(s) 51, if in analog form, prior to delivery to folddetection system 54. - According to another example embodiment, at least some of load cell(s) 50 are oriented fully or partially transversely to one another in order that folds in
display unit 11 and/ordevice 12 can be ascertained in both directions or diagonally using the signal(s) 51. In still one more embodiment, described further below with respect tomethod 100, folddetection system 54 determines the approximate or exact degree of folding ofdisplay unit 11, or alternatively only whether thedisplay unit 11 is folded or not, and if more than one fold axis is possible, the location of the fold axis. (In the event more than one fold axis is possible, folddetection system 54 may determine the location of each axis, as well as the degree of folding at each axis.) In one example embodiment, the determination of the foregoing is made using the relative magnitude of the signals from load cell(s) 50. In one embodiment, the signal(s) 51 generated from load cell(s) 50 are proportional to or at least can be correlated to the amount of or degree of fold in thedisplay unit 11 and/ordevice 12. Such correlations may be established, for example, by storing predetermined or known signal characteristics of the load cell(s) 50, for example in the form of coefficients or other parameters stored in a memory or storage device, that are used to translate load cell signals 51 into the degree of fold in the display unit. Thefold detection system 54 records fold data representing the degree of folds and location of the fold axis, or axes if more than one fold is present, in a storage device or memory, on or off-board, thefold detection system 54. According to one example embodiment, if the folding of thedisplay unit 11 and/ordevice 12 is restricted to folding along one or a limited number of fold lines, asingle load cell 50 may be appropriately positioned along the preset fold line in order to detect the fold along that particular line. - According to still other example embodiments, not shown, the folding or unfolding of
display unit 11 ordisplay device 12 may be determined using other means such as from images of thedisplay device 12 captured from one or more cameras, wherein the images are processed in order to determine the folding of thedisplay unit 11 ordevice 12. In another example embodiment, a signal source such as an infra-red source on one side of thedisplay device 12 may be detected by a detector, such as an infra-red detector, on the opposite side of thedisplay device 12, wherein the detection or magnitude of the signal detected may indicate folding or the degree of folding. In still other example embodiments, the fold detection devices may be integrated with thedisplay unit 11, or fastened or integrated with the back (non-display) side of thedisplay unit 11 ordisplay device 12. In other example embodiments, the fold detection signal may be generated from user input without the use of a fold detection device. - Referring now to
FIG. 3 , there is illustrated a flowchart showing anexample method 100, implemented in one example embodiment using a computer program executing on a computer system or platform, suitable for determining the folding, or degree of folding, and optionally the location of folding, if more than one location is possible, of thedisplay unit 11 and/ordevice 12. According tomethod 100, load cell signal(s) 51 (serving as fold detection signals) are received from the fold detection devices, such as load cell(s) 50 (112). Themethod 100 determines the relative degree of strain or load on the load cell(s) 50 and the location of the fold, from signal(s) 51 (114). This determination may be made, for example, using the set of predetermined or known coefficients or parameters described above that are indicative of a correlation between load cell signals 51 and respective physical folding behavior or characteristics of thedisplay unit 11 and/ordevice 12. In one embodiment,method 100 determines the fold, degree of fold and/or location of the fold indisplay unit 11 and/or device 12 (116), and generates or produces, in one example embodiment, thefold signal 30 that is conveyed to thedisplay control unit 14. In another example embodiment,method 100 continuously monitors the signal(s) 51 and continuously re-determines thefold signal 30. Alternatively, for example, the determination offold signal 30 from signal(s) 51 is on-demand from a viewer, in response to a change in the load cell signal(s) 51, and/or made from time-to-time but not continuously. According to one other example embodiment, themethod 100 operates on a central processing unit and is stored in a memory device or storage device on-board or off-boardfold detection system 54.Fold detection system 54 may include, in one embodiment, thecomputing system 700 ofFIG. 7 , wherein the computerprogram implementing method 100 may be stored and executed, for example, as described with respect toprogram 725. - Referring now to
FIG. 4 there is illustrated a flowchart of amethod 170, implemented, in one example embodiment, using a computer program executing on a computer system or platform indisplay control unit 14. According to this example embodiment,method 170 operates to control the display format of visual information ondisplay unit 11 in response to displaydata 16 and thefold signal 30.Method 170, in one example embodiment, continuously monitors for folding of the display, either from an unfolded state to a folded state, from one degree of folding to another degree of folding, or from a folded state to an unfolded state (172). In other example embodiments,method 170 operates only in response to detection of a folding action of the display by the fold detection devices, and/or in response to a user input that is conveyed to displaycontrol unit 14.Method 170 is responsive to foldsignal 30, received from thefold detection system 54, to input and receive the fold and/or the degree of fold of thedisplay unit 11 and/or device 12 (174). Using thefold signal 30 and thedisplay data 16,method 170 determines the display format to be used for displaying visual information on display unit 11 (176). Based on the determined format, the visual information presented ondisplay unit 11 are altered or modified, for example by adapting (e.g., altering or modifying) thedisplay data 16 and/or the one or more display control signals 20, or an intermediate form of the signals and/or data, to change the format or use of the display area in which visual information is presented (178). In one mode of operation, for example, the display format may be a default format to display visual information on a substantially planar display area that is substantially the full displayable area of thedisplay unit 11, while in a second mode of operation, the planar display area may be divided into two or more sub-areas that avoid a deformed area of the display caused by folding of thedisplay unit 11, and the format of the visual information is adapted for this sub-divided configuration of thedisplay unit 11. - According to still another example embodiment, the visual information presented is text, and the format is changed from or between a first format in which substantially the entire display area of
display unit 11 is used, and another format in which the display is divided into display sub-areas, such as illustrated inFIGS. 5A and 5B , wherein the display area in or near the deformation 17 (shown inFIGS. 1A and1B ) is not used for display, to avoid impairment in the display of information in or near thedeformation 17. According to another example embodiment, visual information continues to be displayed along and in the area of thedeformation 17 in the display, but is altered or changed in order to improve the perceptibility or display characteristics of the visual information, for example by performing any of the operations to alter the display as otherwise described herein, such as increasing the size of visual information, such as fonts, in the area of the deformation, or changing the color or brightness of visual information. Alternatively, for example in the case of graphical images such as in video, the portion of the video image coinciding with the deformed area of the display may be altered to diminish any actual or perceived distortion in the image, while still enabling the video image to be displayed entirely or substantially across the deformed area, or in sub-portions of the deformed area that provide the appearance of continuous image display across the deformed area. In other example embodiments, the display images are shifted or moved from a first display area that is separated by a fold, to an area of the display that is smaller and on only one side of the fold, and the scale of the images is reduced to fit into the reduced display area. According to one example embodiment, a computer program implementing method 170 (FIG. 4 ) operates on a central processing unit and is stored in a memory device or storage device on-board or off-boarddisplay control unit 14.Display control unit 14 may include, in one embodiment, thecomputing system 700 ofFIG. 7 , wherein the computer program may be stored and executed, for example, as described with respect toprogram 725. - In alternative embodiments, compensation for impairment or distortion in the fold deformations may include, for example, avoiding the display of visual information in the deformed area, changes in format including stretching, narrowing, enlarging, shrinking, tilting, rotating, obliterating, replicating, interpolating or changing the color of an image or part of an image. Such compensation may be performed, for example, by substituting alternative display data or modifying the display data, by transforming the display data, and/or by adapting or modifying the generation of display control signals independently of the display data. Alternatively, compensation for impairment or distortion may include, for example, substituting or modifying fonts for text, such as fonts specifically adapted to reduce distortion experienced from proximity to a
deformation 17. In general, compensation or correction for impairment or distortion may reduce or eliminate one or more undesirable effects associated with the impairment or distortion. Any technique for compensation or correction may be applied. For example, themethod 170 may, in one example embodiment, mathematically determine the kinds and degrees of distortion that may be experienced by a viewer, for example assuming thedisplay device 12 is viewed from a particular, typical, viewing angle. - A change of display format from a single
display area format 190 to a dualdisplay area format 192 is illustrated inFIG. 5A and FIG. 5B . In this example embodiment, visual information displayed in the singledisplay area format 190 ofFIG. 5A is automatically reformatted to thedual area 192 ofFIG. 5B upon detection of a fold alongaxis 194. As illustrated inFIG. 5A and 5B , the display area formats 190 and 192, delineated by the dashed lines, do not overlap or coincide with thefold axis 194 or any deformation resulting therefrom. In another embodiment, the reformatting may take place in response to a viewer-initiated input that is conveyed to displaycontrol unit 14. According to still another example embodiment, multiple predetermined display formatting options or display templates may be stored in the memory or storage device fordisplay control unit 14, and used, respectively, for different fold states or configurations. For example but not by way of limitation, folding of thedisplay device 12 along the center of thedisplay unit 11 would invoke a format providing two display sub-areas in which information is displayed, while folding the display along two fold axes may invoke a format providing for display of visual information in three display sub-areas, each within a separate plane or substantially planar area of the display. In still another example embodiment, the display templates are based on the type of visual information to be displayed, such as text, pictures, images or video, such that method 170 (or any computer program implementing the method) changes the display format based on the type of information as well as in response to the folding state or configuration of the display. For example, video such as a movie might not be split between two different sides of the display, but for example be shifted to display only in the display area on one side of a fold. - In still another example mode of operation, the display format or template provides a privacy mode of display in which only one, or certain ones, of the sub-areas of the folded display are used to display visual information, such that a viewer of the
display device 12 can shield visual information displayed on thedisplay device 12 from the view of others located near thedisplay device 12. According to one such embodiment, the privacy mode of display is initiated by a user input tosystem 10. According to still other example embodiments, any unused portion of the display, for example a deformed portion in or near a fold, or a larger area not used for display due to the folding of thedisplay unit 11, may be automatically, semi-automatically or manually (by user input), under control of method 170 (or any computer program implementing the method), deactivated and power to that area of the display reduced or eliminated, for example by directly reducing power or by altering the display data to substitute display data that causes the deactivated display area to be dimmed or darkened. - Referring now to
FIG. 6A ,6B and 6C , several example embodiments of devices incorporatingdisplay system 10 are illustrated. As illustrated inFIG. 6A ,display system 10 may be incorporated in areading device 200, such as an e-reader, that may be held in a user's hands and have a form factor such as that illustrated. As illustrated inFIG. 6B ,display system 10 may be incorporated in a handheld mobile device such as a mobile telephone and/orsmart phone 210. As illustrated inFIG. 6C ,system 10 may be used in apersonal computing system 220 with afoldable display 222 allowing the user to fold the display, for example to increase privacy in viewing the display in a crowded setting. Other devices that may incorporate thedisplay system 10 include laptop computers, notebook computers, tablet computers, and display systems. - Referring now to
FIG. 7 , there is illustrated in schematic form anexample computing system 700 suitable for use indisplay control unit 14 and/or folddetection system 54.System 700, according to one example embodiment, includes acentral processing unit 710 including aprocessing unit 702 andmemory 704,removable memory storage 712, andnon-removable storage 714.Memory 704, which stores computer instructions or acomputer program 725, may include volatile memory 706 andnon-volatile memory 708.System 700 may include or have access to a computer environment that includes a variety of computer-readable (or machine-readable) media, such as volatile memory 706 andnon-volatile memory 708,removable memory storage 712 andnon-removable storage 714. Computer storage includes random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) and electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile discs (DVD) or other optical disc storage, magnetic cassettes, magnetic tape, magnetic disc storage or other magnetic storage devices, or any other tangible and physical medium capable of storing computer-readable instructions.System 700 may include or have access to a computing environment that includesinput 716,output 718, and acommunications connection 720. Thesystem 700 may operate in a networked environment usingcommunications connection 720 to connect to one or more remote computers. The remote computers may include a personal computer (PC), server, router, network PC, a peer device or other common network node, or the like. Thecommunications connection 720 may include a local area network (LAN), a wide area network (WAN) and other networks. Computer-readable instructions orprogram 725 is stored on a tangible and physical computer-readable medium in non-transitory form and executable by theprocessing unit 702 of thesystem 700. Instructions orprogram 725 may be stored in one or more different tangible, physical and non-transitory articles including computer-readable mediums such asmemory 704 andstorage - As illustrated in
FIG. 8 , and as described above,display system 10 is further integrated in acomputer environment 800, whereinenvironment 800 usessystem 10 in order to display visual information requested byenvironment 800 for display, for example in response to a user selection of information or in response to a computer program executing inenvironment 800. In one example embodiment,computer environment 800 includes a computing platform such as that described with respect toFIG. 7 . - According to one example embodiment, the
display device 12 may be a foldable, wrappable, moldable plastic display, for example, available from the Hewlett-Packard (HP) corporation. According to another example embodiment,display device 12 might be a folding display, for example as available from Philips Corporation. According to another example embodiment, the foldable display may be obtained from Plastic Logic, Inc., for example as used in their Plastic Reader device. - According to still other example embodiments, the
display control unit 14 is a graphics processing unit (GPU) that is a specialized microprocessor system that offloads and accelerates 3D or 2D graphics rendering from a general purpose microprocessor system in which thedisplay control unit 14 is used. According to still another example embodiment, thedisplay control unit 14 is integrated on the central processing unit of a general processing computer, or is deployed on a separate dedicated video card that may be installed in a slot of a personal computer or server system. According to still another example embodiment, thedisplay control unit 14 is a hybrid of the above described solutions. In still other example embodiments, thedisplay control unit 14 may use stream processing and general purpose GPUs. In still further embodiments, the functionality ofdisplay control unit 14 and folddetection system 54 may be combined or rearranged so that all of the functions may be in a single unit or accomplished by a single computer program or method, or so that functions of one may be substituted or added to functions of the other. Further, such functionality ofunit 14 andsystem 54 may, in one example embodiment, be combined in whole or in part withdisplay device 12, or another component of the system, such as a software utility or application operating on a processing system separate and apart from thedisplay unit 14, folddetection system 54 ordisplay device 12. In addition, according to other example embodiments, the various functionalities described herein may be implemented in hardware, software or combinations thereof. - Thus, as described above, there is provided a display system, method and computer program product for a foldable display wherein the format of the display is adjusted to avoid or compensate for impairment or distortion in the display of visual information on or near a deformation in the display resulting from folding the display. Also described, among other things, is a system, method and computer program product for detection of folds in a display unit.
- Having thus described the several embodiments of the present technology, it will be readily appreciated that other embodiments may be made and used which fall within the scope of the claims attached hereto. Numerous advantages of the technology covered by this document have been set forth in the foregoing description. It will be understood that this disclosure is, in many respects, only illustrative. Changes can be made with respect to various elements described herein without exceeding the scope of the claims appended hereto.
Claims (14)
- A display system, comprising:a foldable display unit to display visual information, the visual information based at least in part on display data; anda display control unit receiving the display data and at least one fold signal indicative of a fold in at least a portion of the display unit, and outputting one or more display control signals operative to cause the display unit to display the visual information, the display control signals being output at least in part in response to the at least one fold signal to adapt the one or more display control signals to change a format of the visual information.
- A system according to claim 1, wherein the format divides a display area into at least two display sub-areas.
- A system according to claim 1, wherein the fold in the display unit creates a deformation area along a fold axis of the display unit.
- A system according to claim 3, wherein the format avoids the display of the visual information on or near a fold axis in the folded display unit.
- A system according to claim 3, wherein the format compensates for impairment of visual information displayed in or near the deformation area.
- A system according to claim 1, further wherein the display unit includes at least one device to detect the fold in the display unit.
- A system according to claim 1, wherein the fold signal indicative of the fold in the display unit is generated automatically or is generated in response to a user input.
- A system according to claim 1, wherein the visual information comprises text, and wherein the text is adapted to appear in display areas on opposite sides of a fold deformation in the display unit.
- A system according to claim 1, wherein the display unit includes display elements selected from the group: liquid crystal display, plasma display, light emitting diode display, or organic light emitting diode.
- A display system, comprising:a foldable display unit to display visual information, the visual information based at least in part on display data;a fold detection system receiving at least one fold detection signal and outputting at least one fold signal indicative of a fold in the display unit and a location of the fold in the display unit; anda display control unit receiving the display data and the at least one fold signal and outputting one or more display control signals operative to cause the display unit to display the visual information, the display control signals being output at least in part in response to the least one fold signal to adapt a format of the visual information from a format adapted to a first folded state of the display unit to a format adapted to a second folded state of the display unit when folded.
- A system according to claim 10, wherein a display template is associated with types of visual information and the fold state of the display unit, wherein the display control unit receives the display template and generates the display control signals at least in part based on the display template.
- A system according to claim 10, further wherein the display unit and display control unit are part of a machine selected from the group: personal computer, smart phone, mobile phone, laptop computer, notebook computer, reading device, or tablet computer, and wherein the display unit provides for display of information in the machine.
- A method comprising:generating one or more display control signals, at least in part in response to display data, to cause a foldable display unit to display visual information, the visual information displayed according to a first display format;monitoring a signal indicative of a fold in the display unit; andin response to the signal indicative of a fold in the display unit, generating the one or more display control signals to change the display of visual information in the visual information to at least one second display format, wherein the second display format compensates for impairment in the display of visual information in the first format that is introduced by the fold in the display unit.
- A computer program product comprising computer program instructions recorded in non-transitory form on a machine-readable media, the instructions adapted to execute on a computing system to:monitor a signal indicative of a fold in a display unit; andin response to the signal indicative of a fold in the display unit, generate one or more display control signals to change the display of visual information to at least one second display format, wherein the second display format compensates for impairment in the display of visual information in a first format that is introduced by folding the display unit.
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP11158915.6A EP2500898B1 (en) | 2011-03-18 | 2011-03-18 | System and method for foldable display |
CA2771508A CA2771508C (en) | 2011-03-18 | 2012-03-15 | System and method for foldable display |
KR1020120027948A KR20120106662A (en) | 2011-03-18 | 2012-03-19 | System and method for foldable display |
CN201210072754.9A CN102723058B (en) | 2011-03-18 | 2012-03-19 | For the system and method for collapsible display |
JP2012062080A JP2012198541A (en) | 2011-03-18 | 2012-03-19 | System and method for foldable display |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP11158915.6A EP2500898B1 (en) | 2011-03-18 | 2011-03-18 | System and method for foldable display |
Publications (2)
Publication Number | Publication Date |
---|---|
EP2500898A1 true EP2500898A1 (en) | 2012-09-19 |
EP2500898B1 EP2500898B1 (en) | 2023-01-18 |
Family
ID=44343061
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP11158915.6A Active EP2500898B1 (en) | 2011-03-18 | 2011-03-18 | System and method for foldable display |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP2500898B1 (en) |
JP (1) | JP2012198541A (en) |
KR (1) | KR20120106662A (en) |
CN (1) | CN102723058B (en) |
CA (1) | CA2771508C (en) |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8654095B1 (en) | 2013-03-20 | 2014-02-18 | Lg Electronics Inc. | Foldable display device providing adaptive touch sensitive area and method for controlling the same |
WO2015016160A1 (en) * | 2013-08-02 | 2015-02-05 | Semiconductor Energy Laboratory Co., Ltd. | Display device |
US9117384B2 (en) | 2011-03-18 | 2015-08-25 | Blackberry Limited | System and method for bendable display |
EP2902870A3 (en) * | 2014-02-04 | 2015-11-04 | Samsung Display Co., Ltd. | Display device and method of driving the same |
WO2016028068A3 (en) * | 2014-08-20 | 2016-05-06 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
US9484001B2 (en) | 2013-12-23 | 2016-11-01 | Google Technology Holdings LLC | Portable electronic device controlling diffuse light source to emit light approximating color of object of user interest |
US9622365B2 (en) | 2013-02-25 | 2017-04-11 | Google Technology Holdings LLC | Apparatus and methods for accommodating a display in an electronic device |
US9674922B2 (en) | 2013-03-14 | 2017-06-06 | Google Technology Holdings LLC | Display side edge assembly and mobile device including same |
US9812074B2 (en) | 2011-03-18 | 2017-11-07 | Blackberry Limited | System and method for foldable display |
US9875008B2 (en) | 2011-11-16 | 2018-01-23 | Google Llc | Display device, corresponding systems, and methods therefor |
US10452104B2 (en) | 2013-07-02 | 2019-10-22 | Semiconductor Energy Laboratory Co., Ltd. | Data processing device |
CN110488970A (en) * | 2019-07-03 | 2019-11-22 | 努比亚技术有限公司 | Graphic display method, terminal and the computer readable storage medium of arc-shaped display screen |
US10628103B2 (en) | 2013-06-07 | 2020-04-21 | Semiconductor Energy Laboratory Co., Ltd. | Information processor and program |
GB2554142B (en) * | 2016-07-13 | 2020-09-02 | Motorola Mobility Llc | Deformable electronic device and methods and systems for display remediation to compensate performance degradation |
US10839059B2 (en) | 2016-07-13 | 2020-11-17 | Motorola Mobility Llc | Electronic device with gesture actuation of companion devices, and corresponding systems and methods |
US11243567B2 (en) | 2016-07-13 | 2022-02-08 | Motorola Mobility Llc | Deformable electronic device and methods and systems for reconfiguring presentation data and actuation elements |
CN114264456A (en) * | 2021-12-28 | 2022-04-01 | 武汉华星光电半导体显示技术有限公司 | Clamping device |
CN114778339A (en) * | 2022-04-11 | 2022-07-22 | 江苏鼎盛检测中心有限公司 | Big data-based high-low temperature endurance test analysis method capable of reducing errors |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI679624B (en) * | 2014-05-02 | 2019-12-11 | 日商半導體能源研究所股份有限公司 | Semiconductor device |
KR102174323B1 (en) | 2014-05-27 | 2020-11-05 | 삼성디스플레이 주식회사 | Gate driving circuit and display device having the same |
TWI493517B (en) * | 2014-06-18 | 2015-07-21 | Au Optronics Corp | Foldable display device |
KR102172388B1 (en) | 2014-09-11 | 2020-10-30 | 엘지디스플레이 주식회사 | Curved Display and Method for Processing Image thereof |
KR102283369B1 (en) * | 2014-12-29 | 2021-07-30 | 엘지디스플레이 주식회사 | Foldable display array panel and display device |
KR102293839B1 (en) * | 2014-12-30 | 2021-08-26 | 엘지디스플레이 주식회사 | Display Device and Driving Method thereof |
KR102378601B1 (en) | 2015-01-13 | 2022-03-25 | 삼성디스플레이 주식회사 | Display module |
CN104766545A (en) * | 2015-04-30 | 2015-07-08 | 京东方科技集团股份有限公司 | Display device and driving method thereof |
KR102475589B1 (en) * | 2016-04-29 | 2022-12-07 | 엘지디스플레이 주식회사 | Flexible organic light emitting display apparatus |
CN107331304B (en) * | 2017-08-18 | 2019-11-22 | 深圳市华星光电半导体显示技术有限公司 | The ameliorative way and improvement device of flexible display and its bending display exception |
US20200402434A1 (en) * | 2017-12-06 | 2020-12-24 | Sony Corporation | Display Unit |
CN108319390B (en) * | 2018-01-25 | 2021-01-08 | 维沃移动通信有限公司 | Control method of flexible screen and mobile terminal |
CN108536411A (en) * | 2018-04-12 | 2018-09-14 | 维沃移动通信有限公司 | A kind of method for controlling mobile terminal and mobile terminal |
CN110251941B (en) * | 2019-07-22 | 2023-02-03 | 网易(杭州)网络有限公司 | Game picture self-adaption method and device, electronic equipment and storage medium |
KR20210050906A (en) | 2019-10-29 | 2021-05-10 | 삼성전자주식회사 | Method for performing wireless communications and electronic device thereof |
CN111783664B (en) * | 2020-06-30 | 2024-05-07 | 珠海格力电器股份有限公司 | Fold compensation method and device for folding screen, electronic equipment and storage medium |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100056223A1 (en) * | 2008-09-02 | 2010-03-04 | Choi Kil Soo | Mobile terminal equipped with flexible display and controlling method thereof |
US20100141605A1 (en) * | 2008-12-08 | 2010-06-10 | Samsung Electronics Co., Ltd. | Flexible display device and data displaying method thereof |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2006243621A (en) * | 2005-03-07 | 2006-09-14 | Canon Inc | Display device |
US8406562B2 (en) * | 2006-08-11 | 2013-03-26 | Geo Semiconductor Inc. | System and method for automated calibration and correction of display geometry and color |
CN101910966B (en) * | 2007-11-29 | 2013-01-23 | 创造者科技有限公司 | An electronic apparatus comprising collapsible display with non-deformable active areas |
JP5099158B2 (en) * | 2010-03-24 | 2012-12-12 | コニカミノルタビジネステクノロジーズ株式会社 | Image display device |
-
2011
- 2011-03-18 EP EP11158915.6A patent/EP2500898B1/en active Active
-
2012
- 2012-03-15 CA CA2771508A patent/CA2771508C/en active Active
- 2012-03-19 KR KR1020120027948A patent/KR20120106662A/en not_active Application Discontinuation
- 2012-03-19 JP JP2012062080A patent/JP2012198541A/en active Pending
- 2012-03-19 CN CN201210072754.9A patent/CN102723058B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100056223A1 (en) * | 2008-09-02 | 2010-03-04 | Choi Kil Soo | Mobile terminal equipped with flexible display and controlling method thereof |
US20100141605A1 (en) * | 2008-12-08 | 2010-06-10 | Samsung Electronics Co., Ltd. | Flexible display device and data displaying method thereof |
Cited By (36)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9117384B2 (en) | 2011-03-18 | 2015-08-25 | Blackberry Limited | System and method for bendable display |
US9812074B2 (en) | 2011-03-18 | 2017-11-07 | Blackberry Limited | System and method for foldable display |
US10387020B2 (en) | 2011-11-16 | 2019-08-20 | Google Technology Holdings LLC | Display device, corresponding systems, and methods therefor |
US9875008B2 (en) | 2011-11-16 | 2018-01-23 | Google Llc | Display device, corresponding systems, and methods therefor |
US9622365B2 (en) | 2013-02-25 | 2017-04-11 | Google Technology Holdings LLC | Apparatus and methods for accommodating a display in an electronic device |
US9674922B2 (en) | 2013-03-14 | 2017-06-06 | Google Technology Holdings LLC | Display side edge assembly and mobile device including same |
US8654095B1 (en) | 2013-03-20 | 2014-02-18 | Lg Electronics Inc. | Foldable display device providing adaptive touch sensitive area and method for controlling the same |
US9170678B2 (en) | 2013-03-20 | 2015-10-27 | Lg Electronics Inc. | Foldable display device providing adaptive touch sensitive area and method for controlling the same |
US8854332B1 (en) | 2013-03-20 | 2014-10-07 | Lg Electronics Inc. | Foldable display device providing adaptive touch sensitive area and method for controlling the same |
WO2014148688A1 (en) * | 2013-03-20 | 2014-09-25 | Lg Electronics Inc. | Foldable display device providing adaptive touch sensitive area and method for controlling the same |
US8842090B1 (en) | 2013-03-20 | 2014-09-23 | Lg Electronics Inc. | Foldable display device providing adaptive touch sensitive area and method for controlling the same |
US8786570B1 (en) | 2013-03-20 | 2014-07-22 | Lg Electronics Inc. | Foldable display device providing adaptive touch sensitive area and method for controlling the same |
US11321039B2 (en) | 2013-06-07 | 2022-05-03 | Semiconductor Energy Laboratory Co., Ltd. | Information processor and program |
US10628103B2 (en) | 2013-06-07 | 2020-04-21 | Semiconductor Energy Laboratory Co., Ltd. | Information processor and program |
US11720218B2 (en) | 2013-07-02 | 2023-08-08 | Semiconductor Energy Laboratory Co., Ltd. | Data processing device |
US11221720B2 (en) | 2013-07-02 | 2022-01-11 | Semiconductor Energy Laboratory Co., Ltd. | Data processing device |
US10452104B2 (en) | 2013-07-02 | 2019-10-22 | Semiconductor Energy Laboratory Co., Ltd. | Data processing device |
US11836007B2 (en) | 2013-08-02 | 2023-12-05 | Semiconductor Energy Laboratory Co., Ltd. | Display device |
US11340657B2 (en) | 2013-08-02 | 2022-05-24 | Semiconductor Energy Laboratory Co., Ltd. | Display device |
US11009913B2 (en) | 2013-08-02 | 2021-05-18 | Semiconductor Energy Laboratory Co., Ltd. | Display device |
WO2015016160A1 (en) * | 2013-08-02 | 2015-02-05 | Semiconductor Energy Laboratory Co., Ltd. | Display device |
US9484001B2 (en) | 2013-12-23 | 2016-11-01 | Google Technology Holdings LLC | Portable electronic device controlling diffuse light source to emit light approximating color of object of user interest |
US9633413B2 (en) | 2014-02-04 | 2017-04-25 | Samsung Display Co., Ltd. | Shape-changeable display device and method of driving the same |
EP2902870A3 (en) * | 2014-02-04 | 2015-11-04 | Samsung Display Co., Ltd. | Display device and method of driving the same |
US10698478B2 (en) | 2014-08-20 | 2020-06-30 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
WO2016028068A3 (en) * | 2014-08-20 | 2016-05-06 | Samsung Electronics Co., Ltd. | Display apparatus and control method thereof |
US11282476B2 (en) | 2016-07-13 | 2022-03-22 | Motorola Mobility Llc | Deformable electronic device and methods and systems for display remediation to compensate performance degradation |
US11243567B2 (en) | 2016-07-13 | 2022-02-08 | Motorola Mobility Llc | Deformable electronic device and methods and systems for reconfiguring presentation data and actuation elements |
US10878771B2 (en) | 2016-07-13 | 2020-12-29 | Motorola Mobility Llc | Deformable electronic device and methods and systems for display remediation to compensate performance degradation |
US10839059B2 (en) | 2016-07-13 | 2020-11-17 | Motorola Mobility Llc | Electronic device with gesture actuation of companion devices, and corresponding systems and methods |
GB2554142B (en) * | 2016-07-13 | 2020-09-02 | Motorola Mobility Llc | Deformable electronic device and methods and systems for display remediation to compensate performance degradation |
CN110488970A (en) * | 2019-07-03 | 2019-11-22 | 努比亚技术有限公司 | Graphic display method, terminal and the computer readable storage medium of arc-shaped display screen |
CN114264456A (en) * | 2021-12-28 | 2022-04-01 | 武汉华星光电半导体显示技术有限公司 | Clamping device |
CN114264456B (en) * | 2021-12-28 | 2023-10-31 | 武汉华星光电半导体显示技术有限公司 | clamping device |
CN114778339A (en) * | 2022-04-11 | 2022-07-22 | 江苏鼎盛检测中心有限公司 | Big data-based high-low temperature endurance test analysis method capable of reducing errors |
CN114778339B (en) * | 2022-04-11 | 2022-11-25 | 江苏鼎盛检测中心有限公司 | High-low temperature endurance test analysis method capable of reducing errors based on big data |
Also Published As
Publication number | Publication date |
---|---|
CA2771508A1 (en) | 2012-09-18 |
JP2012198541A (en) | 2012-10-18 |
EP2500898B1 (en) | 2023-01-18 |
KR20120106662A (en) | 2012-09-26 |
CN102723058A (en) | 2012-10-10 |
CA2771508C (en) | 2015-06-30 |
CN102723058B (en) | 2015-11-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2771508C (en) | System and method for foldable display | |
US9812074B2 (en) | System and method for foldable display | |
US10031712B2 (en) | System and method for display mirroring | |
US9117384B2 (en) | System and method for bendable display | |
US9826225B2 (en) | 3D image display method and handheld terminal | |
CA2917196C (en) | Display control apparatus and computer-readable recording medium | |
EP2500894A1 (en) | System and method for bendable display | |
CN101499253A (en) | Output picture regulation method and apparatus | |
WO2008022439A1 (en) | System and method for displaying computer data in a multi-screen display system | |
TW200928860A (en) | Method and device for adjusting output frame | |
US10705781B1 (en) | System and method for adaptive automated bezel tiling correction for multiple display solution | |
US9117382B2 (en) | Device and method for automatic viewing perspective correction | |
KR102061869B1 (en) | Electronic apparatus and method for image displaying | |
CN107079198B (en) | Display device, system and control method thereof | |
US9305333B1 (en) | Display with square root of two aspect ratio | |
US20220101495A1 (en) | Display method and device | |
US11645960B2 (en) | Distortion correction for non-flat display surface | |
JP6534243B2 (en) | Video processing device | |
US11978381B2 (en) | Orientation-agnostic full-screen user interface displays for electronic devices | |
US20140118394A1 (en) | Image processing method and associated apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20110318 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: BLACKBERRY LIMITED |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: BLACKBERRY LIMITED |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20170307 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
APBK | Appeal reference recorded |
Free format text: ORIGINAL CODE: EPIDOSNREFNE |
|
APBN | Date of receipt of notice of appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNNOA2E |
|
APBR | Date of receipt of statement of grounds of appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNNOA3E |
|
APAF | Appeal reference modified |
Free format text: ORIGINAL CODE: EPIDOSCREFNE |
|
APBX | Invitation to file observations in appeal sent |
Free format text: ORIGINAL CODE: EPIDOSNOBA2E |
|
APBZ | Receipt of observations in appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNOBA4E |
|
APAQ | Information on invitation to file observation in appeal modified |
Free format text: ORIGINAL CODE: EPIDOSCOBA2E |
|
APBH | Information on receipt of observation in appeal deleted |
Free format text: ORIGINAL CODE: EPIDOSDOBA4E |
|
APBZ | Receipt of observations in appeal recorded |
Free format text: ORIGINAL CODE: EPIDOSNOBA4E |
|
APBT | Appeal procedure closed |
Free format text: ORIGINAL CODE: EPIDOSNNOA9E |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20220818 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602011073611 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1545123 Country of ref document: AT Kind code of ref document: T Effective date: 20230215 Ref country code: IE Ref legal event code: FG4D |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230327 Year of fee payment: 13 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20230118 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1545123 Country of ref document: AT Kind code of ref document: T Effective date: 20230118 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230518 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230418 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230518 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230419 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602011073611 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20230331 |
|
26N | No opposition filed |
Effective date: 20231019 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230318 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20230118 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230318 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20230331 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20240328 Year of fee payment: 14 Ref country code: GB Payment date: 20240319 Year of fee payment: 14 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R081 Ref document number: 602011073611 Country of ref document: DE Owner name: MALIKIE INNOVATIONS LTD., IE Free format text: FORMER OWNER: BLACKBERRY LIMITED, WATERLOO, ON, CA |