EP2500898A1 - System and method for foldable display - Google Patents

System and method for foldable display Download PDF

Info

Publication number
EP2500898A1
EP2500898A1 EP11158915A EP11158915A EP2500898A1 EP 2500898 A1 EP2500898 A1 EP 2500898A1 EP 11158915 A EP11158915 A EP 11158915A EP 11158915 A EP11158915 A EP 11158915A EP 2500898 A1 EP2500898 A1 EP 2500898A1
Authority
EP
European Patent Office
Prior art keywords
display
fold
display unit
visual information
format
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP11158915A
Other languages
German (de)
French (fr)
Other versions
EP2500898B1 (en
Inventor
W. Garland Phillips
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BlackBerry Ltd
Original Assignee
Research in Motion Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Research in Motion Ltd filed Critical Research in Motion Ltd
Priority to EP11158915.6A priority Critical patent/EP2500898B1/en
Priority to CA2771508A priority patent/CA2771508C/en
Priority to KR1020120027948A priority patent/KR20120106662A/en
Priority to CN201210072754.9A priority patent/CN102723058B/en
Priority to JP2012062080A priority patent/JP2012198541A/en
Publication of EP2500898A1 publication Critical patent/EP2500898A1/en
Application granted granted Critical
Publication of EP2500898B1 publication Critical patent/EP2500898B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/2092Details of a display terminals using a flat panel, the details relating to the control arrangement of the display terminal and to the interfaces thereto
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/03Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes specially adapted for displays having non-planar surfaces, e.g. curved displays
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/03Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes specially adapted for displays having non-planar surfaces, e.g. curved displays
    • G09G3/035Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes specially adapted for displays having non-planar surfaces, e.g. curved displays for flexible display surfaces
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/34Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
    • G09G3/36Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source using liquid crystals
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/06Adjustment of display parameters
    • G09G2320/0606Manual adjustment
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2320/00Control of display operating conditions
    • G09G2320/06Adjustment of display parameters
    • G09G2320/0613The adjustment depending on the type of the information to be displayed
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/14Solving problems related to the presentation of information to be displayed

Definitions

  • This technology relates generally to display devices, and more particularly to foldable display devices used for display of visual information.
  • Foldable displays are now becoming available for use in displaying visual information such as text, video or graphics.
  • the availability of these foldable displays is providing opportunities for innovative new display systems that can offer many advantages over conventional rigid displays.
  • FIGS. 1A and 1B are schematic illustrations of a display system according one embodiment of the present technology.
  • FIG. 2 illustrates a foldable display device with fold detection devices according to one example embodiment of the present technology.
  • FIG. 3 is a flowchart illustrating an example method and computer program suitable for determining the folding of a display device, according to one example embodiment of the present technology.
  • FIG. 4 is a flowchart illustrating an example method and computer program to control the format of the display according to one example embodiment of the present technology.
  • FIGS. 5A and 5B illustrate the changing of the display format from one format to another format, according to one example embodiment of the present technology.
  • FIGS. 6A , 6B and 6C illustrate several example embodiments of devices incorporating a display system according to the present technology.
  • FIG. 7 illustrates in schematic form a computing platform suitable for use in certain example embodiments of the present technology.
  • FIG. 8 illustrates the integration of a display system into a further computing environment.
  • a display unit of the display device has at least some flexible portions that allow it to be folded in one or more locations.
  • the fold may be any substantial deformation.
  • the fold may be along one or more substantially fixed lines in the display unit, such as may be the case where a display unit is capable of folding at some places but not others.
  • the fold may be, but need not be, a substantially sharp crease.
  • the display unit in one example embodiment, is deformed along a line of the fold, compromising the display of visual information in the deformed area.
  • the display format of displayed visual information such as but not limited to the configuration, characteristics, size, form, position, brightness, layout, shading, spacing, perspective, coloration or design, are altered, modified or changed in order to adapt the visual information to the deformed area caused by the folding or unfolding of the display unit.
  • the display format is changed in order to avoid distortion, illegibility, imperceptibility or sub-optimal presentation of the visual information in such deformed areas or locations of the display unit.
  • display system 10 including a display device 12 having a display element, which may also be referred to as unit 11 or display unit 11 or foldable display unit 11, capable of displaying visual information.
  • display unit 11 is a component of display device 12, which may include additional components to provide physical support to the display unit 11 or complementary electronic functionality such as connectors or circuits to drive the display unit 11.
  • display unit 11 is contained in a housing of display device 12, or is self-supporting or contained in a separate housing from other components of display device 12.
  • Display unit 11, or optionally the entire display device 12, is flexible or foldable to provide for folding 13 of the display unit 11 along at least one axis 15.
  • the display unit 11 displays visual information using, for example but not by way of limitation, liquid crystal display elements, organic or inorganic light emitting diode elements, and/or plasma display technology, through, for example, a display surface or screen of the unit 11.
  • display unit 11 When folded, as illustrated in FIG. 1B , display unit 11 has at least one fold, along an axis 15, that creates a deformation 17 in the display, along the axis 15.
  • the deformation 17, in some cases, takes the form of a fold line, crease or an elbow turn, and results in impairment or compromising of the ability of display unit 11 to display visual information, or impairment of the ability of a viewer to clearly see visual information displayed on or near the deformation 17.
  • Such impairment may be caused, for example, by distortion, blocking, compression, pinching, overlap, compromised viewing angles, and/or obfuscation of visual information displayed on or near the deformation 17.
  • references to "folding" of the display unit 11 shall mean folding the display unit 11 from a substantially planar (or default) configuration to a folded configuration, or from a folded configuration to a planar configuration, or between different degrees of folded states of the display unit 11.
  • the deformation 17 of the display includes that area of the display unit 11 that is curved, compressed, pinched and/or has a discontinuity where the plane of the display changes from one orientation to another partially or fully transverse orientation on the other side of the deformation 17.
  • the foldable display unit 11 and/or device 12 may be foldable along any line or location or orientation of the display unit 11 and/or device 12, or only along predetermined lines or axes.
  • deformation of visual information in an area of the display is avoided by automatically dividing the display area into display sub-areas, for example areas 11A and 11B (which may be thought of as display areas on opposite sides of the fold along axis 15), that do not contain the deformation 17, and moving the display of visual information from the original display area into the sub-areas.
  • a display control unit 14 receives display data 16 from a data source 18 and produces one or more display control signals 20 for application to one or more display control inputs 24 of display device 12, in order to produce visual information on the display unit 11 of display device 12.
  • Display unit 11 is operative to display (i.e., is capable of displaying) the visual information, based at least in part on display data 16.
  • display data 16 conveys or holds or encodes the visual information to be displayed.
  • display control unit 14 includes at least one additional input 26 to receive a fold signal 30, from fold detection system 54, that is indicative of the folding or unfolding of at least some portion of display unit 11, and optionally the location(s) of fold deformations.
  • Display control unit 14 receives display data 16 and at least one fold signal 30, indicative of a fold in display unit 11, and generates as output one or more display control signals 20 that cause display 11 unit to display the visual information.
  • Signal 30 may take the form of one or more analog signals, or digital signals or data.
  • Fold detection system 54 receives one or more load signals 51 from load cells 50, shown and described with respect to FIG. 2 , used to detect a fold in the display unit 11.
  • display control unit 14 takes the form of an integrated circuit responsible for generating the timing of display control signals 20, such as, for example, horizontal and vertical synchronization signals, and a blanking interval signal.
  • the data source 18 is a video random access memory (RAM), or other storage device, such as but not limited to a magnetic or optical storage device, or a processing device.
  • display control unit 14 is a video display processor (VDP).
  • the display control unit 14 is a video display controller that may take the form of a video shifter, a cathode ray tube controller (CRTC), a video interface controller, or a video code processor.
  • the display control unit 14 may be mounted on a central processing unit (CPU) motherboard, or integrated into a microprocessor chip.
  • the display control signals 20 may be analog or digital, for example but not limited to component video, digital visual interface (DVI), video graphics array (VGA) or high-definition multimedia interface (HDMI) video control signals.
  • the display system of the present technology includes data source 18, display control unit 14, display device 12 (including any fold detection devices associated therewith) and fold detection system 54, as illustrated for example in FIGS. 1A , 1B and 2 .
  • the display system may include fewer than all of these components, such as, in one embodiment, the system may only include display control unit 14, or, in another example embodiment, the system may only include fold detection system 54 or, in yet another example embodiment, the system may only include fold detection system 54 and display control unit 14.
  • the methods and computer program products described herein may also, in alternative embodiments, include or encompass only the operations or functionality of the alternate system embodiments described herein,
  • the fold signal 30 may be obtained or derived from one or more fold detection devices, which in one example embodiment comprise load cell(s) 50, mounted or integrated with display unit 11 and/or display device 12, that produce fold detection signals, for example in one embodiment, load cell signal(s) 51 (also shown in FIG. 1A ).
  • the load cell(s) 50 are bonded onto display unit 11 and/or display device 12 such that folding of the display unit 11 and/or display device 12 produces corresponding analog (or, in an alternate embodiment, digital) load cell signal(s) 51 in one or more of the load cell(s) 50.
  • the load cell signal(s) 51 from load cell(s) 50 are conveyed on signal paths 52 to the fold detection system 54 ( FIG. 1A ) taking, for example, the form of a computing platform having a programmable computer or other electronic device capable of interpreting the signal(s) 51 to generate fold signal 30.
  • signal(s) 51 are analog signals, and are converted to digital signals or data and processed in fold detection system 54 to determine the location of folds in the display device 12.
  • separate analog to digital circuits may be employed to digitize the signal(s) 51, if in analog form, prior to delivery to fold detection system 54.
  • load cell(s) 50 are oriented fully or partially transversely to one another in order that folds in display unit 11 and/or device 12 can be ascertained in both directions or diagonally using the signal(s) 51.
  • fold detection system 54 determines the approximate or exact degree of folding of display unit 11, or alternatively only whether the display unit 11 is folded or not, and if more than one fold axis is possible, the location of the fold axis.
  • fold detection system 54 may determine the location of each axis, as well as the degree of folding at each axis.) In one example embodiment, the determination of the foregoing is made using the relative magnitude of the signals from load cell(s) 50.
  • the signal(s) 51 generated from load cell(s) 50 are proportional to or at least can be correlated to the amount of or degree of fold in the display unit 11 and/or device 12. Such correlations may be established, for example, by storing predetermined or known signal characteristics of the load cell(s) 50, for example in the form of coefficients or other parameters stored in a memory or storage device, that are used to translate load cell signals 51 into the degree of fold in the display unit.
  • the fold detection system 54 records fold data representing the degree of folds and location of the fold axis, or axes if more than one fold is present, in a storage device or memory, on or off-board, the fold detection system 54. According to one example embodiment, if the folding of the display unit 11 and/or device 12 is restricted to folding along one or a limited number of fold lines, a single load cell 50 may be appropriately positioned along the preset fold line in order to detect the fold along that particular line.
  • the folding or unfolding of display unit 11 or display device 12 may be determined using other means such as from images of the display device 12 captured from one or more cameras, wherein the images are processed in order to determine the folding of the display unit 11 or device 12.
  • a signal source such as an infra-red source on one side of the display device 12 may be detected by a detector, such as an infra-red detector, on the opposite side of the display device 12, wherein the detection or magnitude of the signal detected may indicate folding or the degree of folding.
  • the fold detection devices may be integrated with the display unit 11, or fastened or integrated with the back (non-display) side of the display unit 11 or display device 12.
  • the fold detection signal may be generated from user input without the use of a fold detection device.
  • load cell signal(s) 51 serving as fold detection signals
  • the method 100 determines the relative degree of strain or load on the load cell(s) 50 and the location of the fold, from signal(s) 51 (114).
  • method 100 determines the fold, degree of fold and/or location of the fold in display unit 11 and/or device 12 (116), and generates or produces, in one example embodiment, the fold signal 30 that is conveyed to the display control unit 14. In another example embodiment, method 100 continuously monitors the signal(s) 51 and continuously re-determines the fold signal 30.
  • the determination of fold signal 30 from signal(s) 51 is on-demand from a viewer, in response to a change in the load cell signal(s) 51, and/or made from time-to-time but not continuously.
  • the method 100 operates on a central processing unit and is stored in a memory device or storage device on-board or off-board fold detection system 54.
  • Fold detection system 54 may include, in one embodiment, the computing system 700 of FIG. 7 , wherein the computer program implementing method 100 may be stored and executed, for example, as described with respect to program 725.
  • method 170 operates to control the display format of visual information on display unit 11 in response to display data 16 and the fold signal 30.
  • Method 170 in one example embodiment, continuously monitors for folding of the display, either from an unfolded state to a folded state, from one degree of folding to another degree of folding, or from a folded state to an unfolded state (172).
  • method 170 operates only in response to detection of a folding action of the display by the fold detection devices, and/or in response to a user input that is conveyed to display control unit 14.
  • Method 170 is responsive to fold signal 30, received from the fold detection system 54, to input and receive the fold and/or the degree of fold of the display unit 11 and/or device 12 (174). Using the fold signal 30 and the display data 16, method 170 determines the display format to be used for displaying visual information on display unit 11 (176). Based on the determined format, the visual information presented on display unit 11 are altered or modified, for example by adapting (e.g., altering or modifying) the display data 16 and/or the one or more display control signals 20, or an intermediate form of the signals and/or data, to change the format or use of the display area in which visual information is presented (178).
  • adapting e.g., altering or modifying
  • the display format may be a default format to display visual information on a substantially planar display area that is substantially the full displayable area of the display unit 11, while in a second mode of operation, the planar display area may be divided into two or more sub-areas that avoid a deformed area of the display caused by folding of the display unit 11, and the format of the visual information is adapted for this sub-divided configuration of the display unit 11.
  • the visual information presented is text, and the format is changed from or between a first format in which substantially the entire display area of display unit 11 is used, and another format in which the display is divided into display sub-areas, such as illustrated in FIGS. 5A and 5B , wherein the display area in or near the deformation 17 (shown in FIGS. 1A and 1B ) is not used for display, to avoid impairment in the display of information in or near the deformation 17.
  • visual information continues to be displayed along and in the area of the deformation 17 in the display, but is altered or changed in order to improve the perceptibility or display characteristics of the visual information, for example by performing any of the operations to alter the display as otherwise described herein, such as increasing the size of visual information, such as fonts, in the area of the deformation, or changing the color or brightness of visual information.
  • the portion of the video image coinciding with the deformed area of the display may be altered to diminish any actual or perceived distortion in the image, while still enabling the video image to be displayed entirely or substantially across the deformed area, or in sub-portions of the deformed area that provide the appearance of continuous image display across the deformed area.
  • the display images are shifted or moved from a first display area that is separated by a fold, to an area of the display that is smaller and on only one side of the fold, and the scale of the images is reduced to fit into the reduced display area.
  • a computer program implementing method 170 ( FIG. 4 ) operates on a central processing unit and is stored in a memory device or storage device on-board or off-board display control unit 14.
  • Display control unit 14 may include, in one embodiment, the computing system 700 of FIG. 7 , wherein the computer program may be stored and executed, for example, as described with respect to program 725.
  • compensation for impairment or distortion in the fold deformations may include, for example, avoiding the display of visual information in the deformed area, changes in format including stretching, narrowing, enlarging, shrinking, tilting, rotating, obliterating, replicating, interpolating or changing the color of an image or part of an image.
  • Such compensation may be performed, for example, by substituting alternative display data or modifying the display data, by transforming the display data, and/or by adapting or modifying the generation of display control signals independently of the display data.
  • compensation for impairment or distortion may include, for example, substituting or modifying fonts for text, such as fonts specifically adapted to reduce distortion experienced from proximity to a deformation 17.
  • compensation or correction for impairment or distortion may reduce or eliminate one or more undesirable effects associated with the impairment or distortion. Any technique for compensation or correction may be applied.
  • the method 170 may, in one example embodiment, mathematically determine the kinds and degrees of distortion that may be experienced by a viewer, for example assuming the display device 12 is viewed from a particular, typical, viewing angle.
  • FIG. 5A and FIG. 5B A change of display format from a single display area format 190 to a dual display area format 192 is illustrated in FIG. 5A and FIG. 5B .
  • visual information displayed in the single display area format 190 of FIG. 5A is automatically reformatted to the dual area 192 of FIG. 5B upon detection of a fold along axis 194.
  • the display area formats 190 and 192 delineated by the dashed lines, do not overlap or coincide with the fold axis 194 or any deformation resulting therefrom.
  • the reformatting may take place in response to a viewer-initiated input that is conveyed to display control unit 14.
  • multiple predetermined display formatting options or display templates may be stored in the memory or storage device for display control unit 14, and used, respectively, for different fold states or configurations.
  • folding of the display device 12 along the center of the display unit 11 would invoke a format providing two display sub-areas in which information is displayed, while folding the display along two fold axes may invoke a format providing for display of visual information in three display sub-areas, each within a separate plane or substantially planar area of the display.
  • the display templates are based on the type of visual information to be displayed, such as text, pictures, images or video, such that method 170 (or any computer program implementing the method) changes the display format based on the type of information as well as in response to the folding state or configuration of the display.
  • visual information such as text, pictures, images or video
  • method 170 or any computer program implementing the method
  • video such as a movie might not be split between two different sides of the display, but for example be shifted to display only in the display area on one side of a fold.
  • the display format or template provides a privacy mode of display in which only one, or certain ones, of the sub-areas of the folded display are used to display visual information, such that a viewer of the display device 12 can shield visual information displayed on the display device 12 from the view of others located near the display device 12.
  • the privacy mode of display is initiated by a user input to system 10.
  • any unused portion of the display may be automatically, semi-automatically or manually (by user input), under control of method 170 (or any computer program implementing the method), deactivated and power to that area of the display reduced or eliminated, for example by directly reducing power or by altering the display data to substitute display data that causes the deactivated display area to be dimmed or darkened.
  • display system 10 may be incorporated in a reading device 200, such as an e-reader, that may be held in a user's hands and have a form factor such as that illustrated.
  • a reading device 200 such as an e-reader
  • display system 10 may be incorporated in a handheld mobile device such as a mobile telephone and/or smart phone 210.
  • system 10 may be used in a personal computing system 220 with a foldable display 222 allowing the user to fold the display, for example to increase privacy in viewing the display in a crowded setting.
  • Other devices that may incorporate the display system 10 include laptop computers, notebook computers, tablet computers, and display systems.
  • System 700 includes a central processing unit 710 including a processing unit 702 and memory 704, removable memory storage 712, and non-removable storage 714.
  • Memory 704, which stores computer instructions or a computer program 725, may include volatile memory 706 and non-volatile memory 708.
  • System 700 may include or have access to a computer environment that includes a variety of computer-readable (or machine-readable) media, such as volatile memory 706 and non-volatile memory 708, removable memory storage 712 and non-removable storage 714.
  • Computer storage includes random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) and electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile discs (DVD) or other optical disc storage, magnetic cassettes, magnetic tape, magnetic disc storage or other magnetic storage devices, or any other tangible and physical medium capable of storing computer-readable instructions.
  • System 700 may include or have access to a computing environment that includes input 716, output 718, and a communications connection 720. The system 700 may operate in a networked environment using communications connection 720 to connect to one or more remote computers.
  • the remote computers may include a personal computer (PC), server, router, network PC, a peer device or other common network node, or the like.
  • the communications connection 720 may include a local area network (LAN), a wide area network (WAN) and other networks.
  • Computer-readable instructions or program 725 is stored on a tangible and physical computer-readable medium in non-transitory form and executable by the processing unit 702 of the system 700. Instructions or program 725 may be stored in one or more different tangible, physical and non-transitory articles including computer-readable mediums such as memory 704 and storage 712 or 714.
  • display system 10 is further integrated in a computer environment 800, wherein environment 800 uses system 10 in order to display visual information requested by environment 800 for display, for example in response to a user selection of information or in response to a computer program executing in environment 800.
  • computer environment 800 includes a computing platform such as that described with respect to FIG. 7 .
  • the display device 12 may be a foldable, wrappable, moldable plastic display, for example, available from the Hewlett-Packard (HP) corporation.
  • display device 12 might be a folding display, for example as available from Philips Corporation.
  • the foldable display may be obtained from Plastic Logic, Inc., for example as used in their Plastic Reader device.
  • the display control unit 14 is a graphics processing unit (GPU) that is a specialized microprocessor system that offloads and accelerates 3D or 2D graphics rendering from a general purpose microprocessor system in which the display control unit 14 is used.
  • the display control unit 14 is integrated on the central processing unit of a general processing computer, or is deployed on a separate dedicated video card that may be installed in a slot of a personal computer or server system.
  • the display control unit 14 is a hybrid of the above described solutions.
  • the display control unit 14 may use stream processing and general purpose GPUs.
  • the functionality of display control unit 14 and fold detection system 54 may be combined or rearranged so that all of the functions may be in a single unit or accomplished by a single computer program or method, or so that functions of one may be substituted or added to functions of the other. Further, such functionality of unit 14 and system 54 may, in one example embodiment, be combined in whole or in part with display device 12, or another component of the system, such as a software utility or application operating on a processing system separate and apart from the display unit 14, fold detection system 54 or display device 12. In addition, according to other example embodiments, the various functionalities described herein may be implemented in hardware, software or combinations thereof.
  • a display system, method and computer program product for a foldable display wherein the format of the display is adjusted to avoid or compensate for impairment or distortion in the display of visual information on or near a deformation in the display resulting from folding the display. Also described, among other things, is a system, method and computer program product for detection of folds in a display unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Devices For Indicating Variable Information By Combining Individual Elements (AREA)
  • User Interface Of Digital Computer (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

As described herein, there is provided methods, apparatus and computer program products to display visual information on a foldable display device. Display control signals are altered or modified to avoid display of or compensate for impairment in the display of visual information on fold deformations introduced in a display unit of the display device in response to folding of the display unit, or to reverse any alterations or modifications in the event that the fold deformations are eliminated by unfolding of the display unit.

Description

    Technical Field
  • This technology relates generally to display devices, and more particularly to foldable display devices used for display of visual information.
  • Background
  • Foldable displays are now becoming available for use in displaying visual information such as text, video or graphics. The availability of these foldable displays is providing opportunities for innovative new display systems that can offer many advantages over conventional rigid displays.
  • Brief Description of the Drawing
  • The accompanying figures, in which like reference numerals refer to identical or functionally-similar elements throughout the separate views and which are incorporated in and form part of the specification, further illustrate the present technology that is the subject of this disclosure and, together with the detailed description of the technology, serve to explain the principles of the present technology.
  • FIGS. 1A and 1B are schematic illustrations of a display system according one embodiment of the present technology.
  • FIG. 2 illustrates a foldable display device with fold detection devices according to one example embodiment of the present technology.
  • FIG. 3 is a flowchart illustrating an example method and computer program suitable for determining the folding of a display device, according to one example embodiment of the present technology.
  • FIG. 4 is a flowchart illustrating an example method and computer program to control the format of the display according to one example embodiment of the present technology.
  • FIGS. 5A and 5B illustrate the changing of the display format from one format to another format, according to one example embodiment of the present technology.
  • FIGS. 6A, 6B and 6C illustrate several example embodiments of devices incorporating a display system according to the present technology.
  • FIG. 7 illustrates in schematic form a computing platform suitable for use in certain example embodiments of the present technology.
  • FIG. 8 illustrates the integration of a display system into a further computing environment.
  • Detailed Description
  • Described herein are various embodiments of display technologies used to display any kind of visual information, such as (but not limited to) text, video, pictures, two- or three-dimensional images, icons, cursors or graphics, on foldable display devices. In some embodiments, a display unit of the display device has at least some flexible portions that allow it to be folded in one or more locations. The fold may be any substantial deformation. The fold may be along one or more substantially fixed lines in the display unit, such as may be the case where a display unit is capable of folding at some places but not others. The fold may be, but need not be, a substantially sharp crease. When folded, the display unit, in one example embodiment, is deformed along a line of the fold, compromising the display of visual information in the deformed area. The display format of displayed visual information, such as but not limited to the configuration, characteristics, size, form, position, brightness, layout, shading, spacing, perspective, coloration or design, are altered, modified or changed in order to adapt the visual information to the deformed area caused by the folding or unfolding of the display unit. In one example embodiment, as described in more detail below, the display format is changed in order to avoid distortion, illegibility, imperceptibility or sub-optimal presentation of the visual information in such deformed areas or locations of the display unit. These and other embodiments, described in more detail below, enable advantageous use of foldable display devices in various applications and on various machines, such as but not limited to mobile devices, smart phones, e-readers, laptop computers, notebook computers, tablet computers, personal computers and display systems.
  • The following description should be read with reference to the drawings, in which like elements in different drawings are numbered in like fashion. The drawings, which are not necessarily to scale, depict illustrative embodiments and are not intended to limit the scope of the claims appended hereto. Although examples of various steps are illustrated in the various views, many of the examples provided have suitable alternatives that can be utilized. Moreover, while several illustrative applications are described throughout the disclosure it should be understood that the present technology could be employed in other applications where foldable display technology is of value.
  • Referring now to FIGS. 1A and 1B, there is schematically illustrated a display system 10 including a display device 12 having a display element, which may also be referred to as unit 11 or display unit 11 or foldable display unit 11, capable of displaying visual information. In one example embodiment, display unit 11 is a component of display device 12, which may include additional components to provide physical support to the display unit 11 or complementary electronic functionality such as connectors or circuits to drive the display unit 11. In another example embodiment, display unit 11 is contained in a housing of display device 12, or is self-supporting or contained in a separate housing from other components of display device 12. Display unit 11, or optionally the entire display device 12, is flexible or foldable to provide for folding 13 of the display unit 11 along at least one axis 15. According to various example embodiments, the display unit 11 displays visual information using, for example but not by way of limitation, liquid crystal display elements, organic or inorganic light emitting diode elements, and/or plasma display technology, through, for example, a display surface or screen of the unit 11.
  • When folded, as illustrated in FIG. 1B, display unit 11 has at least one fold, along an axis 15, that creates a deformation 17 in the display, along the axis 15. The deformation 17, in some cases, takes the form of a fold line, crease or an elbow turn, and results in impairment or compromising of the ability of display unit 11 to display visual information, or impairment of the ability of a viewer to clearly see visual information displayed on or near the deformation 17. Such impairment may be caused, for example, by distortion, blocking, compression, pinching, overlap, compromised viewing angles, and/or obfuscation of visual information displayed on or near the deformation 17. When such impairment results from folding of the display unit 11 it is accordingly desirable to adjust for such impairments in order to restore unimpaired display of visual information. Conversely, when the deformation (or deformations) 17 is (are) eliminated by unfolding of the display unit 11, adjustments made to accommodate such deformation(s) 17 may be discontinued. As used herein, references to "folding" of the display unit 11 shall mean folding the display unit 11 from a substantially planar (or default) configuration to a folded configuration, or from a folded configuration to a planar configuration, or between different degrees of folded states of the display unit 11.
  • According to one example embodiment, the deformation 17 of the display includes that area of the display unit 11 that is curved, compressed, pinched and/or has a discontinuity where the plane of the display changes from one orientation to another partially or fully transverse orientation on the other side of the deformation 17. According to various other example embodiments, the foldable display unit 11 and/or device 12 may be foldable along any line or location or orientation of the display unit 11 and/or device 12, or only along predetermined lines or axes. In one embodiment, described in more detail below, deformation of visual information in an area of the display is avoided by automatically dividing the display area into display sub-areas, for example areas 11A and 11B (which may be thought of as display areas on opposite sides of the fold along axis 15), that do not contain the deformation 17, and moving the display of visual information from the original display area into the sub-areas.
  • Referring again to FIG. 1A, a display control unit 14 receives display data 16 from a data source 18 and produces one or more display control signals 20 for application to one or more display control inputs 24 of display device 12, in order to produce visual information on the display unit 11 of display device 12. Display unit 11 is operative to display (i.e., is capable of displaying) the visual information, based at least in part on display data 16. In general, display data 16 conveys or holds or encodes the visual information to be displayed. As further illustrated in FIG. 1A, display control unit 14 includes at least one additional input 26 to receive a fold signal 30, from fold detection system 54, that is indicative of the folding or unfolding of at least some portion of display unit 11, and optionally the location(s) of fold deformations. Display control unit 14 receives display data 16 and at least one fold signal 30, indicative of a fold in display unit 11, and generates as output one or more display control signals 20 that cause display 11 unit to display the visual information. Signal 30 may take the form of one or more analog signals, or digital signals or data. Fold detection system 54 receives one or more load signals 51 from load cells 50, shown and described with respect to FIG. 2, used to detect a fold in the display unit 11.
  • According to one embodiment, display control unit 14 takes the form of an integrated circuit responsible for generating the timing of display control signals 20, such as, for example, horizontal and vertical synchronization signals, and a blanking interval signal. According to another example embodiment, the data source 18 is a video random access memory (RAM), or other storage device, such as but not limited to a magnetic or optical storage device, or a processing device. According to still another example embodiment, display control unit 14 is a video display processor (VDP). According to another example embodiment, the display control unit 14 is a video display controller that may take the form of a video shifter, a cathode ray tube controller (CRTC), a video interface controller, or a video code processor. According to still other example embodiments, the display control unit 14 may be mounted on a central processing unit (CPU) motherboard, or integrated into a microprocessor chip. According to other example embodiments, the display control signals 20 may be analog or digital, for example but not limited to component video, digital visual interface (DVI), video graphics array (VGA) or high-definition multimedia interface (HDMI) video control signals.
  • According to one example embodiment, the display system of the present technology includes data source 18, display control unit 14, display device 12 (including any fold detection devices associated therewith) and fold detection system 54, as illustrated for example in FIGS. 1A, 1B and 2. In another example embodiment, the display system may include fewer than all of these components, such as, in one embodiment, the system may only include display control unit 14, or, in another example embodiment, the system may only include fold detection system 54 or, in yet another example embodiment, the system may only include fold detection system 54 and display control unit 14. Further, the methods and computer program products described herein may also, in alternative embodiments, include or encompass only the operations or functionality of the alternate system embodiments described herein,
  • As illustrated schematically in FIG. 2, according to one example embodiment, the fold signal 30 (shown in FIG. 1A) may be obtained or derived from one or more fold detection devices, which in one example embodiment comprise load cell(s) 50, mounted or integrated with display unit 11 and/or display device 12, that produce fold detection signals, for example in one embodiment, load cell signal(s) 51 (also shown in FIG. 1A). According to another example embodiment, the load cell(s) 50 are bonded onto display unit 11 and/or display device 12 such that folding of the display unit 11 and/or display device 12 produces corresponding analog (or, in an alternate embodiment, digital) load cell signal(s) 51 in one or more of the load cell(s) 50. The load cell signal(s) 51 from load cell(s) 50 are conveyed on signal paths 52 to the fold detection system 54 (FIG. 1A) taking, for example, the form of a computing platform having a programmable computer or other electronic device capable of interpreting the signal(s) 51 to generate fold signal 30. According to one embodiment, signal(s) 51 are analog signals, and are converted to digital signals or data and processed in fold detection system 54 to determine the location of folds in the display device 12. Alternatively, separate analog to digital circuits may be employed to digitize the signal(s) 51, if in analog form, prior to delivery to fold detection system 54.
  • According to another example embodiment, at least some of load cell(s) 50 are oriented fully or partially transversely to one another in order that folds in display unit 11 and/or device 12 can be ascertained in both directions or diagonally using the signal(s) 51. In still one more embodiment, described further below with respect to method 100, fold detection system 54 determines the approximate or exact degree of folding of display unit 11, or alternatively only whether the display unit 11 is folded or not, and if more than one fold axis is possible, the location of the fold axis. (In the event more than one fold axis is possible, fold detection system 54 may determine the location of each axis, as well as the degree of folding at each axis.) In one example embodiment, the determination of the foregoing is made using the relative magnitude of the signals from load cell(s) 50. In one embodiment, the signal(s) 51 generated from load cell(s) 50 are proportional to or at least can be correlated to the amount of or degree of fold in the display unit 11 and/or device 12. Such correlations may be established, for example, by storing predetermined or known signal characteristics of the load cell(s) 50, for example in the form of coefficients or other parameters stored in a memory or storage device, that are used to translate load cell signals 51 into the degree of fold in the display unit. The fold detection system 54 records fold data representing the degree of folds and location of the fold axis, or axes if more than one fold is present, in a storage device or memory, on or off-board, the fold detection system 54. According to one example embodiment, if the folding of the display unit 11 and/or device 12 is restricted to folding along one or a limited number of fold lines, a single load cell 50 may be appropriately positioned along the preset fold line in order to detect the fold along that particular line.
  • According to still other example embodiments, not shown, the folding or unfolding of display unit 11 or display device 12 may be determined using other means such as from images of the display device 12 captured from one or more cameras, wherein the images are processed in order to determine the folding of the display unit 11 or device 12. In another example embodiment, a signal source such as an infra-red source on one side of the display device 12 may be detected by a detector, such as an infra-red detector, on the opposite side of the display device 12, wherein the detection or magnitude of the signal detected may indicate folding or the degree of folding. In still other example embodiments, the fold detection devices may be integrated with the display unit 11, or fastened or integrated with the back (non-display) side of the display unit 11 or display device 12. In other example embodiments, the fold detection signal may be generated from user input without the use of a fold detection device.
  • Referring now to FIG. 3, there is illustrated a flowchart showing an example method 100, implemented in one example embodiment using a computer program executing on a computer system or platform, suitable for determining the folding, or degree of folding, and optionally the location of folding, if more than one location is possible, of the display unit 11 and/or device 12. According to method 100, load cell signal(s) 51 (serving as fold detection signals) are received from the fold detection devices, such as load cell(s) 50 (112). The method 100 determines the relative degree of strain or load on the load cell(s) 50 and the location of the fold, from signal(s) 51 (114). This determination may be made, for example, using the set of predetermined or known coefficients or parameters described above that are indicative of a correlation between load cell signals 51 and respective physical folding behavior or characteristics of the display unit 11 and/or device 12. In one embodiment, method 100 determines the fold, degree of fold and/or location of the fold in display unit 11 and/or device 12 (116), and generates or produces, in one example embodiment, the fold signal 30 that is conveyed to the display control unit 14. In another example embodiment, method 100 continuously monitors the signal(s) 51 and continuously re-determines the fold signal 30. Alternatively, for example, the determination of fold signal 30 from signal(s) 51 is on-demand from a viewer, in response to a change in the load cell signal(s) 51, and/or made from time-to-time but not continuously. According to one other example embodiment, the method 100 operates on a central processing unit and is stored in a memory device or storage device on-board or off-board fold detection system 54. Fold detection system 54 may include, in one embodiment, the computing system 700 of FIG. 7, wherein the computer program implementing method 100 may be stored and executed, for example, as described with respect to program 725.
  • Referring now to FIG. 4 there is illustrated a flowchart of a method 170, implemented, in one example embodiment, using a computer program executing on a computer system or platform in display control unit 14. According to this example embodiment, method 170 operates to control the display format of visual information on display unit 11 in response to display data 16 and the fold signal 30. Method 170, in one example embodiment, continuously monitors for folding of the display, either from an unfolded state to a folded state, from one degree of folding to another degree of folding, or from a folded state to an unfolded state (172). In other example embodiments, method 170 operates only in response to detection of a folding action of the display by the fold detection devices, and/or in response to a user input that is conveyed to display control unit 14. Method 170 is responsive to fold signal 30, received from the fold detection system 54, to input and receive the fold and/or the degree of fold of the display unit 11 and/or device 12 (174). Using the fold signal 30 and the display data 16, method 170 determines the display format to be used for displaying visual information on display unit 11 (176). Based on the determined format, the visual information presented on display unit 11 are altered or modified, for example by adapting (e.g., altering or modifying) the display data 16 and/or the one or more display control signals 20, or an intermediate form of the signals and/or data, to change the format or use of the display area in which visual information is presented (178). In one mode of operation, for example, the display format may be a default format to display visual information on a substantially planar display area that is substantially the full displayable area of the display unit 11, while in a second mode of operation, the planar display area may be divided into two or more sub-areas that avoid a deformed area of the display caused by folding of the display unit 11, and the format of the visual information is adapted for this sub-divided configuration of the display unit 11.
  • According to still another example embodiment, the visual information presented is text, and the format is changed from or between a first format in which substantially the entire display area of display unit 11 is used, and another format in which the display is divided into display sub-areas, such as illustrated in FIGS. 5A and 5B, wherein the display area in or near the deformation 17 (shown in FIGS. 1A and 1B) is not used for display, to avoid impairment in the display of information in or near the deformation 17. According to another example embodiment, visual information continues to be displayed along and in the area of the deformation 17 in the display, but is altered or changed in order to improve the perceptibility or display characteristics of the visual information, for example by performing any of the operations to alter the display as otherwise described herein, such as increasing the size of visual information, such as fonts, in the area of the deformation, or changing the color or brightness of visual information. Alternatively, for example in the case of graphical images such as in video, the portion of the video image coinciding with the deformed area of the display may be altered to diminish any actual or perceived distortion in the image, while still enabling the video image to be displayed entirely or substantially across the deformed area, or in sub-portions of the deformed area that provide the appearance of continuous image display across the deformed area. In other example embodiments, the display images are shifted or moved from a first display area that is separated by a fold, to an area of the display that is smaller and on only one side of the fold, and the scale of the images is reduced to fit into the reduced display area. According to one example embodiment, a computer program implementing method 170 (FIG. 4) operates on a central processing unit and is stored in a memory device or storage device on-board or off-board display control unit 14. Display control unit 14 may include, in one embodiment, the computing system 700 of FIG. 7, wherein the computer program may be stored and executed, for example, as described with respect to program 725.
  • In alternative embodiments, compensation for impairment or distortion in the fold deformations may include, for example, avoiding the display of visual information in the deformed area, changes in format including stretching, narrowing, enlarging, shrinking, tilting, rotating, obliterating, replicating, interpolating or changing the color of an image or part of an image. Such compensation may be performed, for example, by substituting alternative display data or modifying the display data, by transforming the display data, and/or by adapting or modifying the generation of display control signals independently of the display data. Alternatively, compensation for impairment or distortion may include, for example, substituting or modifying fonts for text, such as fonts specifically adapted to reduce distortion experienced from proximity to a deformation 17. In general, compensation or correction for impairment or distortion may reduce or eliminate one or more undesirable effects associated with the impairment or distortion. Any technique for compensation or correction may be applied. For example, the method 170 may, in one example embodiment, mathematically determine the kinds and degrees of distortion that may be experienced by a viewer, for example assuming the display device 12 is viewed from a particular, typical, viewing angle.
  • A change of display format from a single display area format 190 to a dual display area format 192 is illustrated in FIG. 5A and FIG. 5B. In this example embodiment, visual information displayed in the single display area format 190 of FIG. 5A is automatically reformatted to the dual area 192 of FIG. 5B upon detection of a fold along axis 194. As illustrated in FIG. 5A and 5B, the display area formats 190 and 192, delineated by the dashed lines, do not overlap or coincide with the fold axis 194 or any deformation resulting therefrom. In another embodiment, the reformatting may take place in response to a viewer-initiated input that is conveyed to display control unit 14. According to still another example embodiment, multiple predetermined display formatting options or display templates may be stored in the memory or storage device for display control unit 14, and used, respectively, for different fold states or configurations. For example but not by way of limitation, folding of the display device 12 along the center of the display unit 11 would invoke a format providing two display sub-areas in which information is displayed, while folding the display along two fold axes may invoke a format providing for display of visual information in three display sub-areas, each within a separate plane or substantially planar area of the display. In still another example embodiment, the display templates are based on the type of visual information to be displayed, such as text, pictures, images or video, such that method 170 (or any computer program implementing the method) changes the display format based on the type of information as well as in response to the folding state or configuration of the display. For example, video such as a movie might not be split between two different sides of the display, but for example be shifted to display only in the display area on one side of a fold.
  • In still another example mode of operation, the display format or template provides a privacy mode of display in which only one, or certain ones, of the sub-areas of the folded display are used to display visual information, such that a viewer of the display device 12 can shield visual information displayed on the display device 12 from the view of others located near the display device 12. According to one such embodiment, the privacy mode of display is initiated by a user input to system 10. According to still other example embodiments, any unused portion of the display, for example a deformed portion in or near a fold, or a larger area not used for display due to the folding of the display unit 11, may be automatically, semi-automatically or manually (by user input), under control of method 170 (or any computer program implementing the method), deactivated and power to that area of the display reduced or eliminated, for example by directly reducing power or by altering the display data to substitute display data that causes the deactivated display area to be dimmed or darkened.
  • Referring now to FIG. 6A, 6B and 6C, several example embodiments of devices incorporating display system 10 are illustrated. As illustrated in FIG. 6A, display system 10 may be incorporated in a reading device 200, such as an e-reader, that may be held in a user's hands and have a form factor such as that illustrated. As illustrated in FIG. 6B, display system 10 may be incorporated in a handheld mobile device such as a mobile telephone and/or smart phone 210. As illustrated in FIG. 6C, system 10 may be used in a personal computing system 220 with a foldable display 222 allowing the user to fold the display, for example to increase privacy in viewing the display in a crowded setting. Other devices that may incorporate the display system 10 include laptop computers, notebook computers, tablet computers, and display systems.
  • Referring now to FIG. 7, there is illustrated in schematic form an example computing system 700 suitable for use in display control unit 14 and/or fold detection system 54. System 700, according to one example embodiment, includes a central processing unit 710 including a processing unit 702 and memory 704, removable memory storage 712, and non-removable storage 714. Memory 704, which stores computer instructions or a computer program 725, may include volatile memory 706 and non-volatile memory 708. System 700 may include or have access to a computer environment that includes a variety of computer-readable (or machine-readable) media, such as volatile memory 706 and non-volatile memory 708, removable memory storage 712 and non-removable storage 714. Computer storage includes random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) and electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile discs (DVD) or other optical disc storage, magnetic cassettes, magnetic tape, magnetic disc storage or other magnetic storage devices, or any other tangible and physical medium capable of storing computer-readable instructions. System 700 may include or have access to a computing environment that includes input 716, output 718, and a communications connection 720. The system 700 may operate in a networked environment using communications connection 720 to connect to one or more remote computers. The remote computers may include a personal computer (PC), server, router, network PC, a peer device or other common network node, or the like. The communications connection 720 may include a local area network (LAN), a wide area network (WAN) and other networks. Computer-readable instructions or program 725 is stored on a tangible and physical computer-readable medium in non-transitory form and executable by the processing unit 702 of the system 700. Instructions or program 725 may be stored in one or more different tangible, physical and non-transitory articles including computer-readable mediums such as memory 704 and storage 712 or 714.
  • As illustrated in FIG. 8, and as described above, display system 10 is further integrated in a computer environment 800, wherein environment 800 uses system 10 in order to display visual information requested by environment 800 for display, for example in response to a user selection of information or in response to a computer program executing in environment 800. In one example embodiment, computer environment 800 includes a computing platform such as that described with respect to FIG. 7.
  • According to one example embodiment, the display device 12 may be a foldable, wrappable, moldable plastic display, for example, available from the Hewlett-Packard (HP) corporation. According to another example embodiment, display device 12 might be a folding display, for example as available from Philips Corporation. According to another example embodiment, the foldable display may be obtained from Plastic Logic, Inc., for example as used in their Plastic Reader device.
  • According to still other example embodiments, the display control unit 14 is a graphics processing unit (GPU) that is a specialized microprocessor system that offloads and accelerates 3D or 2D graphics rendering from a general purpose microprocessor system in which the display control unit 14 is used. According to still another example embodiment, the display control unit 14 is integrated on the central processing unit of a general processing computer, or is deployed on a separate dedicated video card that may be installed in a slot of a personal computer or server system. According to still another example embodiment, the display control unit 14 is a hybrid of the above described solutions. In still other example embodiments, the display control unit 14 may use stream processing and general purpose GPUs. In still further embodiments, the functionality of display control unit 14 and fold detection system 54 may be combined or rearranged so that all of the functions may be in a single unit or accomplished by a single computer program or method, or so that functions of one may be substituted or added to functions of the other. Further, such functionality of unit 14 and system 54 may, in one example embodiment, be combined in whole or in part with display device 12, or another component of the system, such as a software utility or application operating on a processing system separate and apart from the display unit 14, fold detection system 54 or display device 12. In addition, according to other example embodiments, the various functionalities described herein may be implemented in hardware, software or combinations thereof.
  • Thus, as described above, there is provided a display system, method and computer program product for a foldable display wherein the format of the display is adjusted to avoid or compensate for impairment or distortion in the display of visual information on or near a deformation in the display resulting from folding the display. Also described, among other things, is a system, method and computer program product for detection of folds in a display unit.
  • Having thus described the several embodiments of the present technology, it will be readily appreciated that other embodiments may be made and used which fall within the scope of the claims attached hereto. Numerous advantages of the technology covered by this document have been set forth in the foregoing description. It will be understood that this disclosure is, in many respects, only illustrative. Changes can be made with respect to various elements described herein without exceeding the scope of the claims appended hereto.

Claims (14)

  1. A display system, comprising:
    a foldable display unit to display visual information, the visual information based at least in part on display data; and
    a display control unit receiving the display data and at least one fold signal indicative of a fold in at least a portion of the display unit, and outputting one or more display control signals operative to cause the display unit to display the visual information, the display control signals being output at least in part in response to the at least one fold signal to adapt the one or more display control signals to change a format of the visual information.
  2. A system according to claim 1, wherein the format divides a display area into at least two display sub-areas.
  3. A system according to claim 1, wherein the fold in the display unit creates a deformation area along a fold axis of the display unit.
  4. A system according to claim 3, wherein the format avoids the display of the visual information on or near a fold axis in the folded display unit.
  5. A system according to claim 3, wherein the format compensates for impairment of visual information displayed in or near the deformation area.
  6. A system according to claim 1, further wherein the display unit includes at least one device to detect the fold in the display unit.
  7. A system according to claim 1, wherein the fold signal indicative of the fold in the display unit is generated automatically or is generated in response to a user input.
  8. A system according to claim 1, wherein the visual information comprises text, and wherein the text is adapted to appear in display areas on opposite sides of a fold deformation in the display unit.
  9. A system according to claim 1, wherein the display unit includes display elements selected from the group: liquid crystal display, plasma display, light emitting diode display, or organic light emitting diode.
  10. A display system, comprising:
    a foldable display unit to display visual information, the visual information based at least in part on display data;
    a fold detection system receiving at least one fold detection signal and outputting at least one fold signal indicative of a fold in the display unit and a location of the fold in the display unit; and
    a display control unit receiving the display data and the at least one fold signal and outputting one or more display control signals operative to cause the display unit to display the visual information, the display control signals being output at least in part in response to the least one fold signal to adapt a format of the visual information from a format adapted to a first folded state of the display unit to a format adapted to a second folded state of the display unit when folded.
  11. A system according to claim 10, wherein a display template is associated with types of visual information and the fold state of the display unit, wherein the display control unit receives the display template and generates the display control signals at least in part based on the display template.
  12. A system according to claim 10, further wherein the display unit and display control unit are part of a machine selected from the group: personal computer, smart phone, mobile phone, laptop computer, notebook computer, reading device, or tablet computer, and wherein the display unit provides for display of information in the machine.
  13. A method comprising:
    generating one or more display control signals, at least in part in response to display data, to cause a foldable display unit to display visual information, the visual information displayed according to a first display format;
    monitoring a signal indicative of a fold in the display unit; and
    in response to the signal indicative of a fold in the display unit, generating the one or more display control signals to change the display of visual information in the visual information to at least one second display format, wherein the second display format compensates for impairment in the display of visual information in the first format that is introduced by the fold in the display unit.
  14. A computer program product comprising computer program instructions recorded in non-transitory form on a machine-readable media, the instructions adapted to execute on a computing system to:
    monitor a signal indicative of a fold in a display unit; and
    in response to the signal indicative of a fold in the display unit, generate one or more display control signals to change the display of visual information to at least one second display format, wherein the second display format compensates for impairment in the display of visual information in a first format that is introduced by folding the display unit.
EP11158915.6A 2011-03-18 2011-03-18 System and method for foldable display Active EP2500898B1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
EP11158915.6A EP2500898B1 (en) 2011-03-18 2011-03-18 System and method for foldable display
CA2771508A CA2771508C (en) 2011-03-18 2012-03-15 System and method for foldable display
KR1020120027948A KR20120106662A (en) 2011-03-18 2012-03-19 System and method for foldable display
CN201210072754.9A CN102723058B (en) 2011-03-18 2012-03-19 For the system and method for collapsible display
JP2012062080A JP2012198541A (en) 2011-03-18 2012-03-19 System and method for foldable display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP11158915.6A EP2500898B1 (en) 2011-03-18 2011-03-18 System and method for foldable display

Publications (2)

Publication Number Publication Date
EP2500898A1 true EP2500898A1 (en) 2012-09-19
EP2500898B1 EP2500898B1 (en) 2023-01-18

Family

ID=44343061

Family Applications (1)

Application Number Title Priority Date Filing Date
EP11158915.6A Active EP2500898B1 (en) 2011-03-18 2011-03-18 System and method for foldable display

Country Status (5)

Country Link
EP (1) EP2500898B1 (en)
JP (1) JP2012198541A (en)
KR (1) KR20120106662A (en)
CN (1) CN102723058B (en)
CA (1) CA2771508C (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8654095B1 (en) 2013-03-20 2014-02-18 Lg Electronics Inc. Foldable display device providing adaptive touch sensitive area and method for controlling the same
WO2015016160A1 (en) * 2013-08-02 2015-02-05 Semiconductor Energy Laboratory Co., Ltd. Display device
US9117384B2 (en) 2011-03-18 2015-08-25 Blackberry Limited System and method for bendable display
EP2902870A3 (en) * 2014-02-04 2015-11-04 Samsung Display Co., Ltd. Display device and method of driving the same
WO2016028068A3 (en) * 2014-08-20 2016-05-06 Samsung Electronics Co., Ltd. Display apparatus and control method thereof
US9484001B2 (en) 2013-12-23 2016-11-01 Google Technology Holdings LLC Portable electronic device controlling diffuse light source to emit light approximating color of object of user interest
US9622365B2 (en) 2013-02-25 2017-04-11 Google Technology Holdings LLC Apparatus and methods for accommodating a display in an electronic device
US9674922B2 (en) 2013-03-14 2017-06-06 Google Technology Holdings LLC Display side edge assembly and mobile device including same
US9812074B2 (en) 2011-03-18 2017-11-07 Blackberry Limited System and method for foldable display
US9875008B2 (en) 2011-11-16 2018-01-23 Google Llc Display device, corresponding systems, and methods therefor
US10452104B2 (en) 2013-07-02 2019-10-22 Semiconductor Energy Laboratory Co., Ltd. Data processing device
CN110488970A (en) * 2019-07-03 2019-11-22 努比亚技术有限公司 Graphic display method, terminal and the computer readable storage medium of arc-shaped display screen
US10628103B2 (en) 2013-06-07 2020-04-21 Semiconductor Energy Laboratory Co., Ltd. Information processor and program
GB2554142B (en) * 2016-07-13 2020-09-02 Motorola Mobility Llc Deformable electronic device and methods and systems for display remediation to compensate performance degradation
US10839059B2 (en) 2016-07-13 2020-11-17 Motorola Mobility Llc Electronic device with gesture actuation of companion devices, and corresponding systems and methods
US11243567B2 (en) 2016-07-13 2022-02-08 Motorola Mobility Llc Deformable electronic device and methods and systems for reconfiguring presentation data and actuation elements
CN114264456A (en) * 2021-12-28 2022-04-01 武汉华星光电半导体显示技术有限公司 Clamping device
CN114778339A (en) * 2022-04-11 2022-07-22 江苏鼎盛检测中心有限公司 Big data-based high-low temperature endurance test analysis method capable of reducing errors

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI679624B (en) * 2014-05-02 2019-12-11 日商半導體能源研究所股份有限公司 Semiconductor device
KR102174323B1 (en) 2014-05-27 2020-11-05 삼성디스플레이 주식회사 Gate driving circuit and display device having the same
TWI493517B (en) * 2014-06-18 2015-07-21 Au Optronics Corp Foldable display device
KR102172388B1 (en) 2014-09-11 2020-10-30 엘지디스플레이 주식회사 Curved Display and Method for Processing Image thereof
KR102283369B1 (en) * 2014-12-29 2021-07-30 엘지디스플레이 주식회사 Foldable display array panel and display device
KR102293839B1 (en) * 2014-12-30 2021-08-26 엘지디스플레이 주식회사 Display Device and Driving Method thereof
KR102378601B1 (en) 2015-01-13 2022-03-25 삼성디스플레이 주식회사 Display module
CN104766545A (en) * 2015-04-30 2015-07-08 京东方科技集团股份有限公司 Display device and driving method thereof
KR102475589B1 (en) * 2016-04-29 2022-12-07 엘지디스플레이 주식회사 Flexible organic light emitting display apparatus
CN107331304B (en) * 2017-08-18 2019-11-22 深圳市华星光电半导体显示技术有限公司 The ameliorative way and improvement device of flexible display and its bending display exception
US20200402434A1 (en) * 2017-12-06 2020-12-24 Sony Corporation Display Unit
CN108319390B (en) * 2018-01-25 2021-01-08 维沃移动通信有限公司 Control method of flexible screen and mobile terminal
CN108536411A (en) * 2018-04-12 2018-09-14 维沃移动通信有限公司 A kind of method for controlling mobile terminal and mobile terminal
CN110251941B (en) * 2019-07-22 2023-02-03 网易(杭州)网络有限公司 Game picture self-adaption method and device, electronic equipment and storage medium
KR20210050906A (en) 2019-10-29 2021-05-10 삼성전자주식회사 Method for performing wireless communications and electronic device thereof
CN111783664B (en) * 2020-06-30 2024-05-07 珠海格力电器股份有限公司 Fold compensation method and device for folding screen, electronic equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100056223A1 (en) * 2008-09-02 2010-03-04 Choi Kil Soo Mobile terminal equipped with flexible display and controlling method thereof
US20100141605A1 (en) * 2008-12-08 2010-06-10 Samsung Electronics Co., Ltd. Flexible display device and data displaying method thereof

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006243621A (en) * 2005-03-07 2006-09-14 Canon Inc Display device
US8406562B2 (en) * 2006-08-11 2013-03-26 Geo Semiconductor Inc. System and method for automated calibration and correction of display geometry and color
CN101910966B (en) * 2007-11-29 2013-01-23 创造者科技有限公司 An electronic apparatus comprising collapsible display with non-deformable active areas
JP5099158B2 (en) * 2010-03-24 2012-12-12 コニカミノルタビジネステクノロジーズ株式会社 Image display device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100056223A1 (en) * 2008-09-02 2010-03-04 Choi Kil Soo Mobile terminal equipped with flexible display and controlling method thereof
US20100141605A1 (en) * 2008-12-08 2010-06-10 Samsung Electronics Co., Ltd. Flexible display device and data displaying method thereof

Cited By (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9117384B2 (en) 2011-03-18 2015-08-25 Blackberry Limited System and method for bendable display
US9812074B2 (en) 2011-03-18 2017-11-07 Blackberry Limited System and method for foldable display
US10387020B2 (en) 2011-11-16 2019-08-20 Google Technology Holdings LLC Display device, corresponding systems, and methods therefor
US9875008B2 (en) 2011-11-16 2018-01-23 Google Llc Display device, corresponding systems, and methods therefor
US9622365B2 (en) 2013-02-25 2017-04-11 Google Technology Holdings LLC Apparatus and methods for accommodating a display in an electronic device
US9674922B2 (en) 2013-03-14 2017-06-06 Google Technology Holdings LLC Display side edge assembly and mobile device including same
US8654095B1 (en) 2013-03-20 2014-02-18 Lg Electronics Inc. Foldable display device providing adaptive touch sensitive area and method for controlling the same
US9170678B2 (en) 2013-03-20 2015-10-27 Lg Electronics Inc. Foldable display device providing adaptive touch sensitive area and method for controlling the same
US8854332B1 (en) 2013-03-20 2014-10-07 Lg Electronics Inc. Foldable display device providing adaptive touch sensitive area and method for controlling the same
WO2014148688A1 (en) * 2013-03-20 2014-09-25 Lg Electronics Inc. Foldable display device providing adaptive touch sensitive area and method for controlling the same
US8842090B1 (en) 2013-03-20 2014-09-23 Lg Electronics Inc. Foldable display device providing adaptive touch sensitive area and method for controlling the same
US8786570B1 (en) 2013-03-20 2014-07-22 Lg Electronics Inc. Foldable display device providing adaptive touch sensitive area and method for controlling the same
US11321039B2 (en) 2013-06-07 2022-05-03 Semiconductor Energy Laboratory Co., Ltd. Information processor and program
US10628103B2 (en) 2013-06-07 2020-04-21 Semiconductor Energy Laboratory Co., Ltd. Information processor and program
US11720218B2 (en) 2013-07-02 2023-08-08 Semiconductor Energy Laboratory Co., Ltd. Data processing device
US11221720B2 (en) 2013-07-02 2022-01-11 Semiconductor Energy Laboratory Co., Ltd. Data processing device
US10452104B2 (en) 2013-07-02 2019-10-22 Semiconductor Energy Laboratory Co., Ltd. Data processing device
US11836007B2 (en) 2013-08-02 2023-12-05 Semiconductor Energy Laboratory Co., Ltd. Display device
US11340657B2 (en) 2013-08-02 2022-05-24 Semiconductor Energy Laboratory Co., Ltd. Display device
US11009913B2 (en) 2013-08-02 2021-05-18 Semiconductor Energy Laboratory Co., Ltd. Display device
WO2015016160A1 (en) * 2013-08-02 2015-02-05 Semiconductor Energy Laboratory Co., Ltd. Display device
US9484001B2 (en) 2013-12-23 2016-11-01 Google Technology Holdings LLC Portable electronic device controlling diffuse light source to emit light approximating color of object of user interest
US9633413B2 (en) 2014-02-04 2017-04-25 Samsung Display Co., Ltd. Shape-changeable display device and method of driving the same
EP2902870A3 (en) * 2014-02-04 2015-11-04 Samsung Display Co., Ltd. Display device and method of driving the same
US10698478B2 (en) 2014-08-20 2020-06-30 Samsung Electronics Co., Ltd. Display apparatus and control method thereof
WO2016028068A3 (en) * 2014-08-20 2016-05-06 Samsung Electronics Co., Ltd. Display apparatus and control method thereof
US11282476B2 (en) 2016-07-13 2022-03-22 Motorola Mobility Llc Deformable electronic device and methods and systems for display remediation to compensate performance degradation
US11243567B2 (en) 2016-07-13 2022-02-08 Motorola Mobility Llc Deformable electronic device and methods and systems for reconfiguring presentation data and actuation elements
US10878771B2 (en) 2016-07-13 2020-12-29 Motorola Mobility Llc Deformable electronic device and methods and systems for display remediation to compensate performance degradation
US10839059B2 (en) 2016-07-13 2020-11-17 Motorola Mobility Llc Electronic device with gesture actuation of companion devices, and corresponding systems and methods
GB2554142B (en) * 2016-07-13 2020-09-02 Motorola Mobility Llc Deformable electronic device and methods and systems for display remediation to compensate performance degradation
CN110488970A (en) * 2019-07-03 2019-11-22 努比亚技术有限公司 Graphic display method, terminal and the computer readable storage medium of arc-shaped display screen
CN114264456A (en) * 2021-12-28 2022-04-01 武汉华星光电半导体显示技术有限公司 Clamping device
CN114264456B (en) * 2021-12-28 2023-10-31 武汉华星光电半导体显示技术有限公司 clamping device
CN114778339A (en) * 2022-04-11 2022-07-22 江苏鼎盛检测中心有限公司 Big data-based high-low temperature endurance test analysis method capable of reducing errors
CN114778339B (en) * 2022-04-11 2022-11-25 江苏鼎盛检测中心有限公司 High-low temperature endurance test analysis method capable of reducing errors based on big data

Also Published As

Publication number Publication date
CA2771508A1 (en) 2012-09-18
JP2012198541A (en) 2012-10-18
EP2500898B1 (en) 2023-01-18
KR20120106662A (en) 2012-09-26
CN102723058A (en) 2012-10-10
CA2771508C (en) 2015-06-30
CN102723058B (en) 2015-11-18

Similar Documents

Publication Publication Date Title
CA2771508C (en) System and method for foldable display
US9812074B2 (en) System and method for foldable display
US10031712B2 (en) System and method for display mirroring
US9117384B2 (en) System and method for bendable display
US9826225B2 (en) 3D image display method and handheld terminal
CA2917196C (en) Display control apparatus and computer-readable recording medium
EP2500894A1 (en) System and method for bendable display
CN101499253A (en) Output picture regulation method and apparatus
WO2008022439A1 (en) System and method for displaying computer data in a multi-screen display system
TW200928860A (en) Method and device for adjusting output frame
US10705781B1 (en) System and method for adaptive automated bezel tiling correction for multiple display solution
US9117382B2 (en) Device and method for automatic viewing perspective correction
KR102061869B1 (en) Electronic apparatus and method for image displaying
CN107079198B (en) Display device, system and control method thereof
US9305333B1 (en) Display with square root of two aspect ratio
US20220101495A1 (en) Display method and device
US11645960B2 (en) Distortion correction for non-flat display surface
JP6534243B2 (en) Video processing device
US11978381B2 (en) Orientation-agnostic full-screen user interface displays for electronic devices
US20140118394A1 (en) Image processing method and associated apparatus

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110318

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: BLACKBERRY LIMITED

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: BLACKBERRY LIMITED

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20170307

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

APBK Appeal reference recorded

Free format text: ORIGINAL CODE: EPIDOSNREFNE

APBN Date of receipt of notice of appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNNOA2E

APBR Date of receipt of statement of grounds of appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNNOA3E

APAF Appeal reference modified

Free format text: ORIGINAL CODE: EPIDOSCREFNE

APBX Invitation to file observations in appeal sent

Free format text: ORIGINAL CODE: EPIDOSNOBA2E

APBZ Receipt of observations in appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNOBA4E

APAQ Information on invitation to file observation in appeal modified

Free format text: ORIGINAL CODE: EPIDOSCOBA2E

APBH Information on receipt of observation in appeal deleted

Free format text: ORIGINAL CODE: EPIDOSDOBA4E

APBZ Receipt of observations in appeal recorded

Free format text: ORIGINAL CODE: EPIDOSNOBA4E

APBT Appeal procedure closed

Free format text: ORIGINAL CODE: EPIDOSNNOA9E

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20220818

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602011073611

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1545123

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230215

Ref country code: IE

Ref legal event code: FG4D

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230327

Year of fee payment: 13

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20230118

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1545123

Country of ref document: AT

Kind code of ref document: T

Effective date: 20230118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230518

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230418

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230518

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230419

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602011073611

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20230331

26N No opposition filed

Effective date: 20231019

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230318

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20230118

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230318

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20230331

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20240328

Year of fee payment: 14

Ref country code: GB

Payment date: 20240319

Year of fee payment: 14

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 602011073611

Country of ref document: DE

Owner name: MALIKIE INNOVATIONS LTD., IE

Free format text: FORMER OWNER: BLACKBERRY LIMITED, WATERLOO, ON, CA