CN104641320B

CN104641320B - Flexible display device and display method thereof

Info

Publication number: CN104641320B
Application number: CN201380048239.XA
Authority: CN
Inventors: 徐俊奎; 金贤真; 尼庞.库玛; 孙廷周; 李根镐
Original assignee: Samsung Electronics Co Ltd
Current assignee: Samsung Electronics Co Ltd
Priority date: 2012-09-17
Filing date: 2013-09-17
Publication date: 2022-04-05
Anticipated expiration: 2033-09-17
Also published as: RU2656977C2; CN104641320A; KR20140036499A; US20190196685A1; BR112015004043A2; AU2013316225A1; HK1210290A1; EP2709091B1; EP2709091A2; WO2014042495A1; AU2013316225B2; JP2015535974A; US10983687B2; RU2015114172A; US10261682B2; ES2724823T3; IN2015DN02881A; US20140078047A1; SG11201500332RA; TW201413498A

Abstract

There is provided a flexible display device configured to sense deformation of the flexible display device, control display of an object displayed on the flexible display device based on the deformation, and execute an operation based on the displayed object.

Description

Flexible display device and display method thereof

Technical Field

Apparatuses and methods consistent with exemplary embodiments relate to a flexible display apparatus and a display method thereof, and more particularly, to a flexible display apparatus including a display capable of changing a shape thereof, and a display method thereof.

Background

With the development of electronic technology, various kinds of display devices have been developed. In particular, display devices such as a Television (TV), a Personal Computer (PC), a laptop computer, a tablet PC, a mobile phone, and an MP3 player are widely used to the extent that they can be found in most homes.

In order to satisfy new functions for displays and new forms of consumer demand, efforts are being made to develop new forms of displays. One result of such efforts is the next generation of display devices in the form of flexible display devices.

A flexible display device is a display device that can be deformed into different shapes and configurations.

The flexible display device may be deformed by a force applied by a user, and thus the flexible display device may be used for various purposes. For example, the flexible display device may be used as a mobile phone, a tablet PC, an electronic photo album, a Personal Digital Assistant (PDA), and an MP3 player.

The flexible display device has flexibility different from that of the existing display device. In view of this characteristic, a method of applying a bending gesture is required as an input method for the flexible display device.

Disclosure of Invention

Technical problem

One or more exemplary embodiments may overcome the above disadvantages and other disadvantages not described above. However, it should be understood that the exemplary embodiments are not required to overcome the disadvantages described above, and may not overcome any of the problems described above.

One or more exemplary embodiments provide a flexible display device capable of using a bending gesture as an input method and a display method thereof.

Technical scheme

According to an aspect of an exemplary embodiment, there is provided a flexible display device including: a flexible display; a sensor configured to sense deformation of the flexible display device; and a controller configured to control the flexible display to display an object at a first location on the flexible display; determining a second position of the object on the flexible display based on the deformation; and operating a function of the flexible display device associated with the second position.

The controller may be configured to control the flexible display to display the lock screen, and the controller may be configured to determine whether the second position is associated with unlocking of the lock screen, and to unlock the lock screen in response to determining that the second position is associated with unlocking of the lock screen.

The controller may be configured to unlock and run an application associated with the second position in response to determining that the second position is associated with unlocking of the lock screen.

The controller may be configured to display a home screen in response to unlocking the lock screen.

The controller may be configured to determine the second position in dependence on the degree of deformation.

According to an aspect of another exemplary embodiment, there is provided a display method of a flexible display device, the method including: displaying an object at a first location on a flexible display of a flexible display device; sensing deformation of the flexible display device; determining a second position of the object on the flexible display based on the deformation; and operating a function of the flexible display device associated with the second position.

The function may be unlocking a lock screen of the flexible display device.

The function may be unlocking the lock screen and displaying a main screen of the flexible display device.

Advantageous effects of the invention

According to various exemplary embodiments described above, the curvature of the display may be used as an input method for performing various functions. Thus, user convenience is improved.

Drawings

The above and other aspects will be more apparent by describing in detail exemplary embodiments with reference to the attached drawings, in which:

fig. 1 is a block diagram illustrating a flexible display device according to an exemplary embodiment;

fig. 2 is a view showing a basic configuration of a display of a flexible display device according to an exemplary embodiment;

fig. 3 to 5 are views illustrating an example of a method for sensing bending of a flexible display device according to an exemplary embodiment;

FIG. 6 is a diagram illustrating a method for sensing a bending direction using a bending sensor according to an exemplary embodiment;

FIG. 7 is a diagram illustrating a method for sensing a bending direction according to another exemplary embodiment;

fig. 8 to 10 are views illustrating an example of a method for moving an object on a screen based on bending of a flexible display device according to an exemplary embodiment;

fig. 11 and 12 are views illustrating an example of a method for changing a moving direction of an object according to a bending state of a flexible display device according to an exemplary embodiment;

fig. 13 is a view illustrating object movement based on a deformation duration according to an exemplary embodiment;

FIG. 14 is a diagram illustrating a range of object movement based on curvature according to an exemplary embodiment;

fig. 15 is a view illustrating an example of a method for unlocking a lock screen according to an exemplary embodiment;

fig. 16 and 17 are views illustrating an example of a method for performing an operation mapped to a location of an object according to an exemplary embodiment;

fig. 18 is a view illustrating an example of a method for performing an operation of mapping to a location of an object according to an exemplary embodiment;

fig. 19 to 21 are views illustrating a method for displaying an object on various screens according to an exemplary embodiment;

fig. 22 and 23 are views illustrating a method for setting parameters of an object according to an exemplary embodiment;

fig. 24 to 27 are views illustrating various methods for performing an operation of a flexible display device according to an exemplary embodiment;

fig. 28 and 29 are views illustrating a display method of a flexible display device according to an exemplary embodiment;

fig. 30 is a view illustrating an example of a method for changing a display state of an object based on a bending direction of a flexible display device according to an exemplary embodiment;

fig. 31 is a block diagram illustrating a detailed configuration of a flexible display device according to an exemplary embodiment;

fig. 32 is a view showing a detailed configuration of a controller according to an exemplary embodiment;

fig. 33 is a view showing a software structure of an application supporting an operation of a controller according to various exemplary embodiments;

fig. 34 is a view illustrating an example of a flexible display device according to an exemplary embodiment;

fig. 35 is a view illustrating a flexible display device according to an exemplary embodiment; and

fig. 36 is a flowchart illustrating a display method of a flexible display device according to an exemplary embodiment.

Detailed Description

Hereinafter, exemplary embodiments will be described in more detail with reference to the accompanying drawings.

In the following description, the same reference numerals are used for the same elements when they are depicted in different drawings. The matters defined in the description such as a detailed construction and elements are provided to assist in a comprehensive understanding of the exemplary embodiments. It is therefore evident that the illustrative embodiments may be practiced without those specifically defined matters. Also, functions or elements well known in the art are not described in detail since they would obscure the exemplary embodiments in unnecessary detail.

Fig. 1 is a block diagram illustrating a flexible display device according to an exemplary embodiment. Referring to fig. 1, the flexible display device 100 includes a display 110, a sensor 120, and a controller 130.

The flexible display device 100 of fig. 1 may be implemented using various types of portable devices having a display function, such as a mobile phone, a smart phone, a Portable Multimedia Player (PMP), a Personal Digital Assistant (PDA), a tablet PC, and a navigation system. Also, the flexible display device 100 may be implemented in stationary devices other than portable devices, such as monitors, Televisions (TVs), and kiosks.

The display 110 displays various screens. Specifically, the display 110 may display a playback screen or a running screen of content, such as images, moving images, text, and music, and may display various User Interface (UI) screens. For example, when various contents are played back through an application installed in the flexible display device 100, the display 110 may display a content playback screen provided by the corresponding application.

The flexible display device 100, including the display 110, may be bent (deformed). Therefore, the flexible display device 100 and the display 110 should have a flexible structure and be made of a flexible material. Hereinafter, a detailed configuration of the display 110 will be explained with reference to fig. 2.

Fig. 2 is a view showing a basic configuration of a display constituting a flexible display device according to an exemplary embodiment. Referring to fig. 2, the display 110 includes a substrate 111, a driver 112, a display panel 113, and a protective layer 114.

The flexible display device may be a device that can be bent, deformed, bent, folded, or rolled like paper while maintaining the display characteristics of the flat panel display device. Therefore, the flexible display device should be manufactured on a flexible substrate.

Specifically, the substrate 111 may be implemented by using a plastic substrate (e.g., a polymer film) that can be deformed by external pressure.

The plastic substrate has a structure formed by opposite surfaces of the barrier coating layer of the base film. The base film may be implemented by using various resins such as Polyimide (PI), Polycarbonate (PC), polyethylene terephthalate (PET), Polyethersulfone (PES), polyethylene naphthalate (PEN), and Fiber Reinforced Plastic (FRP). Barrier coating is performed on the opposite surface of the base film. An organic film or an inorganic film may be used for the purpose of maintaining flexibility.

The substrate 111 may also be formed of a flexible material such as thin glass or metal foil.

The driver 112 drives the display panel 113. Specifically, the driver 112 applies a driving voltage to a plurality of pixels constituting the display panel 113, and may be implemented by using a silicon TFT, a Low Temperature Polysilicon (LTPS) TFT, or an organic TFT (otft), or the like. The driver 112 may also be implemented in various forms according to the form of the display panel 113. For example, the display panel 113 may be composed of an organic light emitting substance including a plurality of pixel units and an electrode layer covering opposite surfaces of the organic light emitting substance. In this case, the driver 112 may include a plurality of transistors corresponding to a plurality of pixel units of the display panel 113. The controller 130 applies an electric signal to the gate of each transistor and controls the pixel unit connected to the transistor to emit light. Thus, an image is displayed.

The display panel 113 may be implemented by using an electroluminescent display (EL), an electrophoretic display (EPD), an electrochromic display (ECD), a Liquid Crystal Display (LCD), an active matrix LCD (amlcd), and a Plasma Display Panel (PDP) in addition to an Organic Light Emitting Diode (OLED). When the display panel 113 is embodied by an LCD, the display panel cannot independently emit light, and thus a separate backlight unit may be required. When the LCD does not use the backlight, the LCD may use ambient light. In order to use the LCD display panel 113 without a backlight unit, an environment such as a bright outdoor environment may be used to operate the LCD.

The protective layer 114 protects the display panel 113. For example, the protective layer 114 may be made of ZrO, CeO2, or Th O2. The protective layer 114 may be manufactured as a transparent film, and may cover the entire surface of the display panel 113.

The display 110 may also be implemented by electronic paper (e-paper). Electronic paper is a display that applies ink to general characteristics of paper, and is different from a general flat panel display in that: electronic paper uses reflected light. Electronic paper may use electrophoresis to change pictures or text, using twist balls or capsules.

When the display 110 is composed of elements made of a transparent material, the display 110 may be implemented as a bendable and transparent display device. For example, when the substrate 111 is made of a polymer material such as plastic having transparency, when the driver 112 is implemented by using a transparent transistor, and when the display panel 113 is implemented by using a transparent organic light emitting layer and a transparent electrode, the display 110 may have transparency.

The transparent transistor refers to a transistor manufactured by replacing opaque silicon of an existing thin film transistor with a transparent material such as zinc oxide or titanium dioxide. The transparent electrode may be made of an advanced material such as Indium Tin Oxide (ITO) or graphene. Graphene refers to a material having a plane structure of a honeycomb shape in which carbon atoms are connected to each other and having transparency. The transparent organic light emitting layer may be implemented by using various materials.

As described above, the display 110 may be deformed by an external force and thus have its shape changed. Hereinafter, a method for sensing deformation of the flexible display device 100 will be described with reference to fig. 3 to 5.

Fig. 3 to 5 are views for illustrating an example of a method for sensing deformation of a flexible display device according to an exemplary embodiment.

The sensor 120 senses bending of the display 110. The "bending" referred to herein refers to a state in which the display 110 is bent. Although bending is described herein, bending is merely an exemplary deformation, and other deformations (e.g., curls, folds, twists, etc.) may be detected by the sensor 120.

To sense the deformation, the sensor 120 includes a bending sensor disposed on one surface (such as a front surface or a rear surface) of the display 110, or a bending sensor disposed on an opposite surface of the display 110.

The bending sensor refers to a sensor that can be bent and has a resistance value that varies according to the degree of bending. The bend sensor may be implemented in various forms such as a fiber optic bend sensor, a pressure sensor, and a strain gauge (strain gauge).

Fig. 3 is a view illustrating an arrangement of bending sensors according to an exemplary embodiment.

View (a) of fig. 3 shows an example of this: a plurality of bar-shaped bending sensors are arranged in a grid pattern in the vertical direction and the horizontal direction in the display 110. Specifically, the bending sensors include bending sensors 11-1 to 11-5 arranged in a first direction and bending sensors 12-1 to 12-5 arranged in a second direction perpendicular to the first direction. The bending sensors are arranged at a predetermined distance from each other.

In view (a) of fig. 3, five bending sensors (11-1 to 11-5, 12-1 to 12-5) are arranged in each of the horizontal direction and the vertical direction in a grid formation. However, this is merely an example, and the arrangement configuration and the number of the bending sensors may be changed according to the size of the display 110. The bending sensors are arranged in the horizontal direction and the vertical direction so as to sense bending from the entire area of the display 110. Thus, when only a portion of the flexible display device is flexible, or when the flexible display device needs to sense bending from only a portion of the device, the bending sensors may be arranged only in the corresponding portion of the device.

The bending sensor may be embedded in the front surface of the display 110 as shown in view (a) of fig. 3. However, this is merely an example, and the bending sensor may be embedded in the rear surface of the display 110 or may be embedded in both surfaces.

Also, the shape, number, and position of the bending sensors may be variously changed. For example, a single bend sensor or multiple bend sensors may be coupled to the display 110. The single bend sensor may sense single bend data and may have multiple sensing channels for sensing multiple bend data.

View (b) of fig. 3 shows an example of a single bending sensor disposed on one surface of the display 110. As shown in view (b) of fig. 3, the bending sensors 21 may be arranged in a circle on the front surface of the display 110. However, this is only one example, and the bending sensor may be arranged on the rear surface of the display 110, and may be implemented in the form of a circular curve forming various polygons, such as a quadrangle.

View (c) of fig. 3 shows two crossed bending sensors. Referring to view (c) of fig. 3, the first bending sensor 22 is disposed on the first surface of the display 110 in a first diagonal direction, and the second bending sensor 23 is disposed on the second surface of the display 110 in a second diagonal direction.

Although a linear bending sensor is used in the various exemplary embodiments described above, the sensor 120 may use multiple strain gauges to sense bending.

View (d) of fig. 3 shows a plurality of strain gauges arranged in the display 110. The strain gauge uses a metal or semiconductor whose impedance greatly changes according to an applied force, and senses deformation of a surface of an object to be measured according to a change in an impedance value. It is common for a material such as metal to increase the resistance value if its length is stretched by an external force and to decrease the resistance value if the length is shortened. Thus, the bending is sensed by sensing a change in the impedance value.

Referring to view (d) of fig. 3, a plurality of strain gauges 30-1, 30-2, 30-n, 30-m, are arranged along an edge of display 110. The number of strain gauges may vary depending on the size or shape of the display 110, the sensing of predetermined bending, and resolution, among other things.

Hereinafter, a method of sensing the bending of the display 110 by the sensor 120 using bending sensors or strain gauges arranged in a grid formation will be described.

The bending sensor may be implemented by using a resistance sensor using resistance or a micro optical fiber sensor using strain of an optical fiber. Hereinafter, for convenience of explanation, the bending sensor will be explained assuming that the bending sensor is a resistance sensor.

Fig. 4 is a view illustrating a method for sensing bending of a flexible display device according to an exemplary embodiment.

When the display 110 is bent, the bending sensor arranged on one surface or the opposite surface of the display 110 is also bent, and outputs a resistance value corresponding to the magnitude of the applied tension.

That is, the sensor 120 may sense an impedance value of the bending sensor using a level of a voltage applied to the bending sensor or a strength of a current flowing through the bending sensor, and may sense bending of the display 110 using the sensed impedance value.

For example, when the display 110 is bent in a horizontal direction, as shown in view (a) of fig. 4, the bending sensors 41-1 to 41-5 embedded in the front surface of the display 110 are also bent, and output impedance values according to the magnitude of the applied tension.

In this case, the magnitude of the tension increases in proportion to the degree of bending. For example, when the display 110 is bent, as shown in view (a) of fig. 4, the largest bending occurs in the central region. Therefore, the maximum tension is applied at the point a3 of the bending sensor 41-1, the point b3 of the bending sensor 41-2, the point c3 of the bending sensor 41-3, the point d3 of the bending sensor 41-4, and the point e3 of the bending sensor 41-5, which are the central regions, and thus, the bending sensors 41-1 to 41-5 have the maximum resistance values at the points a3, b3, c3, d3, and e 3.

On the other hand, the degree of curvature gradually decreases toward the edge of the curved sensor. Therefore, the bending sensor 41-1 has a smaller resistance value at points farther to the left and right from the point a3, and has the same resistance value as that before bending occurs at the left region of the point a1 where bending does not occur and at the right region of the point a 5. The same impedance may be applied to the other bending sensors 41-2 to 41-5.

The controller 140 may determine the bending of the display 110 based on the result of the sensing by the sensor 120. Specifically, the controller 130 may determine the position of the bending region, the size of the bending region, the number of bending regions, the size of the bending line, the position of the bending line, the number of bending lines, the direction of the bending line, and the number of times bending occurs, based on the relationship between the points at which changes in the impedance value of the bending sensor are sensed.

The bending region is a region where the display 110 is bent. Since the bending sensor is also bent by bending the flexible display device 100, all points at which the bending sensor outputs a resistance value different from an original value may delineate a bending region. On the other hand, a region where the resistance value does not change may delineate a flat region where no bending is performed.

Therefore, when the distance between the points at which the change of the impedance value is sensed is within the predetermined distance, the points are sensed as one bending region. On the other hand, when the distance between the points at which the change in the impedance value is sensed exceeds a predetermined distance, different bending regions are delineated with reference to the points.

As described above, in view (a) of fig. 4, the impedance value from point a1 to a5 of the bend sensor 41-1, the impedance value from point b1 to b5 of the bend sensor 41-2, the impedance value from point c1 to c5 of the bend sensor 41-3, the impedance value from point d1 to d5 of the bend sensor 41-4, and the impedance value from points e1 to e5 of the bend sensor 41-5 are different from the impedance values in the initial state. In this case, the points in each of the bending sensors 41-1 to 41-5, at which the change in the impedance value is sensed, are located within a predetermined distance and are arranged continuously.

Thus, the controller 130 determines the region 42 including all points from the points a1 to a5 of the bend sensor 41-1, from the points b1 to b5 of the bend sensor 41-2, from the points c1 to c5 of the bend sensor 41-3, from the points d1 to d5 of the bend sensor 41-4, and from the points e1 to e5 of the bend sensor 41-5 as one bending region.

The bending region may comprise a bending line. The bent lines indicate lines connecting points in each of the bent sensors at which the maximum impedance value is sensed. Accordingly, the controller 130 may determine a line connecting points at which the maximum impedance value is sensed in the bending region as the bending line.

For example, in the case of view (a) of fig. 4, a line 43 connecting the following points may delineate a curved line: a point a3 at which the maximum impedance value is output in the bending sensor 41-1, a point b3 at which the maximum impedance value is output in the bending sensor 41-2, a point c3 at which the maximum impedance value is output in the bending sensor 41-3, a point d3 at which the maximum impedance value is output in the bending sensor 41-4, and a point e3 at which the maximum impedance value is output in the bending sensor 41-5. View (a) of fig. 4 shows a bending line formed in a central region of the display surface in the vertical direction.

View (a) of fig. 4 shows only the bending sensors arranged in the horizontal direction among the bending sensors arranged in the grid formation to explain a case where the display 110 is bent in the horizontal direction. That is, the sensor 120 may sense the bending of the display 110 in the vertical direction by the bending sensors arranged in the vertical direction in the same method as that for sensing the bending in the horizontal direction. Also, when the display 110 is bent in a diagonal direction, tension is applied to all the bending sensors arranged in the horizontal and vertical directions. Accordingly, the sensor 120 may sense bending of the display 110 in a diagonal direction based on output values of bending sensors arranged in a horizontal direction and a vertical direction.

Also, the sensor 120 may sense bending of the display 110 using a strain gauge.

Specifically, when the display 110 is bent, a force is applied to strain gauges arranged along an edge of the display 110, and the strain gauges output different resistance values according to the applied force. Accordingly, the controller 130 may determine the position of the bending region, the size of the bending region, the number of bending regions, the size of the bending line, the position of the bending line, the number of bending lines, the direction of the bending line, and the number of times bending occurs based on the output values of the strain gauges.

For example, when the display 110 is bent in a horizontal direction, as shown in view (b) of fig. 4, a force is applied to the strain gauges 51-p, ·, 51-p +5, 51-r,. and 51-r +5 arranged around a bending region among a plurality of strain gauges embedded in the front surface of the display 110, and the strain gauges 51-p,. and 51-p +5, 51-r,. and 51-r +5 output resistance values corresponding to the applied force. Therefore, the controller 130 may determine the region 51 including all points at which the strain gauge outputs a resistance value different from that in the initial state as one bending region.

Also, the controller 130 may determine a line connecting at least two strain gauges outputting an impedance value very different from that in the initial state in the bending region as the bending line. That is, the controller 130 may determine a line connecting at least two strain gauges to which the greatest force is applied or at least two strain gauges to which the greatest force and the second greatest force are applied as the bending line according to the bending of the display 110.

For example, when the display 110 is bent in the horizontal direction, as shown in view (b) of fig. 4, the display 110 may determine a line connecting the first and second strain gauges 51-p +2 and 51-r +3 outputting impedance values that are very different from those of the initial state as a bent line.

In the above exemplary embodiment, the strain gauges 51-1, 51-2 are embedded in the front surface of the flexible display device 100. Strain gauges 51-1, 51-2 are embedded in the front surface of the flexible display device 100 to sense bending when the flexible display device 100 is bent in the Z + direction.

The bending direction of the flexible display device 100 may be defined according to a direction in which the convex region of the flexible display device 100 to be bent points. That is, when it is assumed that the front surface of the flexible display device 100 is a two-dimensional X-Y plane, when the convex region of the flexible display device 100 being bent is directed to a Z-direction of a Z-axis perpendicular to the X-Y plane, the bending direction of the flexible display device 100 is a Z + direction, and when the convex region of the flexible display device 100 being bent is directed to the Z + direction of the Z-axis, the bending direction of the flexible display device 100 is a Z-direction.

Accordingly, a strain gauge may be embedded in the rear surface of the flexible display device 100 to sense bending of the flexible display device 100 in the Z-direction. However, this is merely an example, and strain gauges may be disposed in one surface of the flexible display device 100 to sense bending in the Z + direction and the Z-direction.

The sensor 120 may sense the bending degree, i.e., the bending angle, of the display 110. The bending angle mentioned herein may refer to an angle formed when the display 110 is bent compared to a flat state of the display 110.

Fig. 5 is a view illustrating a method for determining a bending angle of a display of a flexible display device according to an exemplary embodiment.

The controller 130 may determine the bending angle of the display 110 based on the sensing result by the sensor 120. In order to determine the bending angle, the flexible display device 100 may previously store impedance values output from the bending line according to the bending angle of the display 110. Accordingly, the controller 130 may compare the impedance value output from the bending sensor or the strain gauge disposed in the bending line when the display 110 is bent with the pre-stored impedance value, and may determine a bending angle matching the sensed impedance value.

For example, when the display 110 is bent, as shown in fig. 5, the bending sensor point a4 located in the bent line outputs the largest impedance value. At this time, the flexible display device 100 determines the bending angle (θ) matching the impedance value output from the point a4 using the impedance value previously stored according to the bending angle.

As described above, the bending direction of the flexible display device 100 is divided into the Z + direction and the Z-direction, and the sensor 120 may sense the bending direction of the flexible display device 100 in various ways. A detailed description thereof will be provided with reference to fig. 6 and 7.

Fig. 6 is a view illustrating a method for sensing a bending direction using a bending sensor according to an exemplary embodiment.

The controller 130 may determine a bending direction of the display 110 based on the sensing result by the sensor 120. To determine the direction of bending, the sensor 120 may include one or more bending sensors arranged in various arrangements.

For example, the sensor 120 may include two bending

sensors

71 and 72 arranged to overlap each other at one side of the display 110, as shown in view (a) of fig. 6. In this case, when bending is performed in one direction, different resistance values are output from the upper bending sensor 71 and the lower bending sensor 72 at the point where bending is performed. Thus, the controller 130 can determine the bending direction by comparing the resistance values of the two bending

sensors

71 and 72 at the same point.

Specifically, when the display 110 is bent in the Z + direction, as shown in view (b) of fig. 6, at a point "a" corresponding to the bending line, the tension applied to the lower bending sensor 72 is greater than the tension applied to the upper bending sensor 71. On the other hand, when the display 110 is bent in the Z-direction, the tension applied to the upper bending sensor 71 is greater than the tension applied to the lower bending sensor 72.

Thus, the controller 130 can determine the bending direction by comparing the resistance values of the two bending

sensors

71 and 72 at point a. That is, when the impedance value output from the lower bending sensor of the two overlapped bending sensors is greater than the impedance value output from the upper bending sensor at the same point, the controller 130 may determine that the display 110 is bent in the Z + direction. When the impedance value output from the upper bending sensor of the two overlapped bending sensors is greater than the impedance value output from the lower bending sensor at the same point, the controller 130 may determine that the display 110 is bent in the Z-direction.

Although in views (a) and (b) of fig. 6, the two bending sensors are disposed to overlap each other at one side of the display 110, the sensor 120 may include bending sensors disposed on opposite surfaces of the display 110, as shown in view (c) of fig. 6.

View (c) of fig. 6 shows two bending sensors 73 and 74 arranged on opposite surfaces of the display 110.

Therefore, when the display 110 is bent in the Z + direction, the bending sensor disposed on a first surface of the opposite surfaces of the display 110 is subjected to a pressing force, and the bending sensor disposed on a second surface is subjected to a tensile force. On the other hand, when the display 110 is bent in the Z-direction, the bending sensor disposed on the second surface receives a pressing force, and the bending sensor disposed on the first surface receives a tensile force. As described above, different values are detected from the two bending sensors according to the bending direction, and the controller 130 determines the bending direction according to the detection characteristics of the values.

Although two bending sensors are used to sense the bending direction in views (a) to (c) of fig. 6, the bending direction may be determined only by means of strain gauges disposed on one surface or the opposite surface of the display 110.

Fig. 7 is a view illustrating a method for sensing a bending direction according to another exemplary embodiment. Specifically, views (a) and (b) of fig. 7 are views showing a method for sensing a bending direction using, for example, an acceleration sensor.

The sensor 120 may include a plurality of acceleration sensors disposed on an edge area of the display 110. The controller 130 may determine a bending direction of the display 110 based on the sensing result by the sensor 120.

An acceleration sensor is a sensor that measures the acceleration of a movement and the direction of said acceleration. Specifically, the acceleration sensor outputs a sensing value corresponding to the gravitational acceleration that changes in accordance with the inclination of the device to which the sensor is attached.

Accordingly, when the acceleration sensors 81-1 and 81-2 are disposed on opposite edges of the display 110, as shown in view (a) of FIG. 7, when the display 110 is bent, the output values sensed by the acceleration sensors 81-1 and 81-2 are changed. The controller 130 calculates a pitch angle and a roll angle using output values sensed by the acceleration sensors 81-1 and 81-2. Accordingly, the controller 130 may determine the bending direction based on changes in the pitch angle and the roll angle sensed by the acceleration sensors 81-1 and 81-2.

In view (a) of fig. 7, the acceleration sensors 81-1 and 81-2 are arranged on opposite edges in the horizontal direction with reference to the front surface of the display 110. However, the acceleration sensor may be arranged in the vertical direction as shown in view (b) of fig. 7. In this case, when the display 110 is bent in the vertical direction, the controller 130 may determine the bending direction according to the measurement values sensed by the acceleration sensors 81-3 and 81-4 in the vertical direction.

In views (a) and (b) of fig. 7, the acceleration sensors are disposed on the left and right edges or the upper and lower edges of the display 110. However, the acceleration sensors may be disposed on all of the left edge, the right edge, the upper edge, and the lower edge, or may be disposed on the corners.

In addition to the acceleration sensor as described above, the bending direction may be sensed using a gyro sensor or a geomagnetic sensor. The gyro sensor is a sensor that detects an angular velocity by measuring Coriolis force (Coriolis' force) applied to a velocity direction of a motion when a rotational motion occurs. Based on the measurement values of the gyro sensor, the direction of the rotational movement can be sensed, and the bending direction can also be sensed. The geomagnetic sensor refers to a sensor that senses an azimuth angle using a 2-axis or 3-axis fluxgate. When such a geomagnetic sensor is applied, when each edge of the flexible display apparatus 100 is bent, the geomagnetic sensor disposed on each edge is subjected to position shift, and outputs an electric signal corresponding to a geomagnetic change caused by the position shift. The controller 130 may calculate a yaw angle using a value output from the geomagnetic sensor. From the calculated change in yaw angle, various bending characteristics, such as bending area and bending direction, can be determined.

As described above, the controller 130 may determine the bending of the display 110 based on the sensing result by the sensor 120. The sensor configuration and sensing method as described above may be individually applied to the flexible display device 100 or may be applied in combination.

In the above exemplary embodiment, the display 110 is bent. However, since the display 110 is bent together with the flexible display device 100, sensing the bending of the display 110 may be considered as sensing the bending of the flexible display device 100. That is, a configuration for sensing bending may be provided in the flexible display device 100, and the controller 130 may determine bending of the flexible display device 100 based on the sensing result.

The sensor 120 may sense a user touch manipulation on the screen of the display 110. In this case, the sensor 120 may include a resistive or capacitive touch sensor, and the controller 130 may determine coordinates of a point of the display 110 touched by the user based on an electrical signal transmitted from the sensor 120.

The controller 130 controls the overall operation of the flexible display device 100. In particular, the controller 130 may determine the bending of the display 110 based on the sensing result by the sensor 120. Specifically, the controller 130 may determine the bending/non-bending of the display 110, the position of the bending region, the size of the bending region, the number of bending regions, the size of the bending line, the position of the bending line, the number of bending lines, the bending direction, the bending angle, and the number of times of bending occurred, using the impedance value output from the bending sensor or the strain gauge. This has already been described above with reference to fig. 3 to 7, and thus a repetitive description thereof is omitted.

The display 110 may display an object at a predetermined position of the screen. The predetermined position of the display object may be set when the flexible display device 100 is manufactured, and may be set and changed by a user. For example, the user may set and change the position of the object displayed on the screen through a separate button (e.g., an object position adjustment button) or a separate menu displayed on the flexible display device 100.

Accordingly, the display 110 may display the object on the first position of the screen. The object mentioned here is a graphic element composed of various shapes such as a circle or a polygon, and the shape, size, and display position of the object can be set and changed by the user.

The controller 130 may move the position of the object based on the position on the screen where the bending is sensed while maintaining the bending.

Specifically, the controller 130 may move the object to a relatively lower position with reference to the Z-axis by considering an area on the screen where the bending is performed and a bending direction. The region where bending is performed may be a region of a predetermined size including a bent line.

At this time, the controller 130 may determine the moving direction of the object by considering the curved line. That is, the controller 130 may move the object to a relatively lower position with reference to the Z-axis along a line perpendicular to the bending line.

A detailed description will be provided with reference to fig. 8 to 12.

Fig. 8 to 10 are views illustrating an example of a method for moving an object on a screen based on bending of a flexible display device according to an exemplary embodiment.

As shown in fig. 8, it is assumed that the left side of the display 110 is bent in the Z + direction, and the object 220 is displayed on the left side of the bent area on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a bending region with reference to the object. Thus, the object 220 may be moved to the right of the display 110. At this time, the object 220 may be moved to the right of the display 110 along a line perpendicular to the bent line 230.

Although not shown in fig. 8, it is assumed that the left side of the display 110 is bent in the Z + direction and the object 220 is displayed on the right side of the bent area on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a region opposite to the bending region with reference to the object. Thus, the object 220 may be moved to the right of the display 110. At this time, the object 220 may be moved to the right of the display 110 along a line perpendicular to the bent line 230.

Also, assume that the right side of the display 110 is curved in the Z + direction, and the object 220 is displayed on the right side of the curved area on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a bending region with reference to the object. Thus, the object 220 may be moved to the left of the display 110. At this time, the object 220 may be moved to the left of the display 110 along a line perpendicular to the bent line 230.

Also, assume that the right side of the display 110 is bent in the Z + direction, and the object 220 is displayed on the left side of the bent area on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a region opposite to the bending region with reference to the object. Thus, the object 220 may be moved to the left of the display 110. At this time, the object 220 may be moved to the left of the display 110 along a line perpendicular to the bent line 230.

On the other hand, as shown in FIG. 9, assume that the left side of the display 110 is curved in the Z-direction, and the object 220 is displayed on the left side of the curved region on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a region opposite to the bending region with reference to the object. Thus, the object 220 may be moved to the left of the display 110. At this time, the object 220 may be moved to the left of the display 110 along a line perpendicular to the bent line 230.

Although not shown in fig. 9, it is assumed that the left side of the display 110 is curved in the Z-direction and the object 220 is displayed on the right side of the curved area on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a bending region with reference to the object. Thus, the object 220 may be moved to the left of the display 110. At this time, the object 220 may be moved to the left of the display 110 along a line perpendicular to the bent line 230.

Also, assume that the right side of the display 110 is curved in the Z-direction, and the object 220 is displayed on the right side of the curved area on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a region opposite to the bending region with reference to the object. Thus, the object 220 may be moved to the right of the display 110. At this time, the object 220 may be moved to the right of the display 110 along a line perpendicular to the bent line 230.

Also, assume that the right side of the display 110 is curved in the Z-direction and the object 220 is displayed on the left side of the curved region on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a bending region with reference to the object. Thus, the object 220 may be moved to the right of the display 110. At this time, the object 220 may be moved to the right of the display 110 along a line perpendicular to the bent line 230.

On the other hand, as shown in fig. 10, it is assumed that the center of the display 110 is bent in the Z + direction, and the object 220 is displayed on the left side of the bent area on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a region opposite to the bending region with reference to the object. Thus, the object 220 may be moved to the left of the display 110. At this time, the object 220 may be moved to the left of the display 110 along a line perpendicular to the bent line 230.

Although not shown in fig. 10, it is assumed that the center of the display 110 is bent in the Z + direction, and the object 220 is displayed on the right side of the bent area on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a region opposite to the bending region with reference to the object. Thus, the object 220 may be moved to the right of the display 110. At this time, the object 220 may be moved to the right of the display 110 along a line perpendicular to the bent line 230.

Also, assume that the center of the display 110 is curved in the Z-direction, and the object 220 is displayed on the left side of the curved area on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a bending region with reference to the object. Thus, the object 220 may be moved to the right of the display 110. At this time, the object 220 may be moved to the right of the display 110 along a line perpendicular to the bent line 230.

Also, assume that the center of the display 110 is curved in the Z-direction and the object 220 is displayed on the right side of the curved area on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a bending region with reference to the object. Thus, the object 220 may be moved to the left of the display 110. At this time, the object 220 may be moved to the left of the display 110 along a line perpendicular to the bent line 230.

In the above exemplary embodiment, the object is moved to the right or left of the display 110. However, this is because the left or right side of the display 110 is bent. The object may move in various directions according to the bending region and the bending direction.

For example, assume that the lower left end of the display 110 is bent in the Z + direction, and the object 220 is displayed on the left side of the bent area on the screen 210. In this case, the controller 130 may move the object to a relatively lower position with reference to the Z-axis, that is, to a bending region with reference to the object. Thus, the object 220 may be moved to the upper right end of the display 110. At this time, the object 220 may be moved to the upper right end of the display 110 along a line perpendicular to the bent line 230.

In addition, the object may move in various directions of the display 110, such as a lower right direction, an upper left direction, or a lower left direction, according to the bending region and the bending direction.

When the curved state of the display 110 is changed while the object moves according to the curved state of the display 110, the controller 130 may change the moving direction of the object to correspond to the changed curved state. The bending state may include a position of the bending region and a bending direction.

That is, the controller 130 may determine a direction in which the moving object is located with reference to the changed position of the bending region, and may determine the moving direction of the object by considering the relative position and the bending direction of the moving object. A detailed description will be provided with reference to fig. 11 and 12.

Fig. 11 and 12 are views illustrating an example of a method for changing a moving direction of an object according to a curved state of a display according to an exemplary embodiment.

As shown in fig. 11, assuming that the left side of the display 110 is bent in the Z + direction and the object 220 is displayed on the left side of the bent area on the screen 210, the object 220 is moved to the right side of the display 110 along a line perpendicular to the bent line 230.

At this time, when the lower left end of the display 110 is bent in the Z + direction and the position of the bent region is changed, the controller 130 may change the moving direction of the object 220 according to the changed position of the bent region. That is, since the moving object 220 is located at the right of the changed bending region, the controller 130 may move the object 220 in the opposite direction of the bending region. Accordingly, the object 220 may be moved to the upper right end of the display 110 along a line perpendicular to the changed bent line 240.

Also, when the upper left end of the display 110 is bent in the Z + direction and the position of the bent region is changed as shown in fig. 12, the controller 130 may move the moving object 220 in the opposite direction of the bent region because the object 220 is located at the right of the changed bent region. Accordingly, the object 220 may be moved to the lower right end of the display 110 along a line perpendicular to the changed bent line 240.

In the above-described exemplary embodiment, the lower left end or the upper left end of the display 110 is bent after the left side of the display 110 is bent. However, this is merely an example for explaining changing the moving direction of the object. That is, the controller 130 may change the moving direction of the object based on the position of the most recently bent region of the display 110.

For example, assuming that the right side of the display 110 is bent in the Z + direction and the object 220 is displayed on the left side of the bent area on the screen 210, the object 220 is moved to the left side of the display 110 along a line perpendicular to the bent line 230. At this time, when the right lower end of the display 110 is bent in the Z + direction and the position of the bent region is changed, the controller 130 may move the object 220 to the left upper end of the display 110 along a line perpendicular to the changed bent line 240. Meanwhile, when the upper right end of the display 110 is bent in the Z + direction and the position of the bent region is changed, the controller 130 may move the object 220 to the lower left end of the display 110 along a line perpendicular to the changed bent line 240.

Meanwhile, although not shown, the controller 130 may change the moving direction of the object even when the bending direction is changed while the object is being moved.

For example, assuming that the left side of the display 110 is bent in the Z + direction and the object 220 is displayed on the left side of the bent area on the screen 210, the object 220 is moved to the right of the display 110 along a line perpendicular to the bent line 230.

At this time, when the left side of the display 110 is bent in the Z-direction, the controller 130 may change the moving direction of the object based on the changed bending direction. Specifically, when the moving object is located at the right side of the bending region, the controller 130 may move the object to the bending region with reference to the object. That is, the controller 130 may move the object to the left of the display 110 along a direction perpendicular to the changed bent line 240.

Although the object is moved along a line perpendicular to the bent line in the above-described exemplary embodiments, this is merely an example. The direction of the moving object may be variously set. For example, the controller 130 may move the object along a line that forms an angle of 80 °, 70 °, 60 °, and.

On the other hand, the controller 130 may move the object while the bend is maintained on the display 110 and may stop moving the object while the display 110 is in a flat state. In this case, the controller 130 may adjust the moving distance of the object to be proportional to the bending holding time. A detailed description thereof will be provided with reference to fig. 13.

Fig. 13 is a view illustrating object movement based on a deformation duration according to an exemplary embodiment.

As shown in fig. 13, assuming that the left side of the display 110 is bent in the Z + direction and the object 220 is displayed on the left side of the bent area on the screen 210, the object 220 is moved to the right side of the display 110 along a line perpendicular to the bent line 230.

At this time, the controller 130 further moves the object 220 as the bending holding time increases. That is, when the bending hold time t1 is longer than the bending hold time t2, the object 221 moved at the bending held time t1 is moved farther than the object 222 moved at the bending held time t 2. Thus, as the duration of the deformation increases, the object movement distance increases accordingly.

On the other hand, the controller 130 may adjust the subject moving distance according to the curvature of the display 110. Specifically, the controller 130 may adjust the object moving distance to be proportional to the curvature. A detailed description thereof will be provided with reference to fig. 14.

Fig. 14 is a view illustrating a moving distance of an object based on a curvature according to an exemplary embodiment.

As shown in fig. 14, assuming that the left side of the display 110 is bent in the Z + direction and the object 220 is displayed on the left side of the bent area on the screen 210, the object 220 is moved to the right side of the display 110 along a line perpendicular to the bent line 230.

At this time, the controller 130 may further move the object 220 as the degree of curvature increases. That is, object 222 is moved more according to a relatively higher degree of curvature, while object 221 is moved less according to a relatively lower degree of curvature, assuming that the curvature is maintained for the same time.

In the above exemplary embodiment, the moving distance of the object is changed according to the duration of the bending and the degree of bending. However, this is merely an example.

For example, the controller 130 may control the moving speed of the object according to the bending duration. Specifically, the controller 130 may control the moving speed of the object to be proportional to the bending duration. That is, as the bending duration increases, the controller 130 may accelerate the object.

For another example, the controller 130 may control the moving speed of the object according to the degree of curvature. Specifically, the controller 130 may adjust the moving speed of the object to be proportional to the curvature. That is, as the degree of curvature increases, the controller 130 may accelerate the subject.

On the other hand, the controller 130 may control the moving speed of the object according to the length of the bent line. Specifically, the controller 130 may control the moving speed of the object to be proportional to the length of the bent line. For example, when the bent line crosses two adjacent sides of the display 110, the controller 130 may increase the object speed as the length of the bent line increases.

Also, the controller 130 may determine the bending region and the bending direction based on the sensing result by the sensor 120.

For example, the controller 130 may determine a region including a point of the bending sensor outputting an impedance value different from that of the initial state as the bending region, and may determine a line connecting the points of the bending region outputting the maximum impedance value as the bending line. The controller 130 may determine the bending direction of the display 110 based on impedance values of bending sensors disposed in opposite surfaces of the display 110.

Also, the controller 130 may determine the bending degree and the bending retention time based on the sensing result by the sensor 120.

For example, when the display 110 is bent, the controller 130 may determine the degree of bending using impedance values output from bending sensors arranged along the bent line. The controller 130 may determine the bend retention time using a time during which the bend sensor outputs an impedance value different from the impedance value of the initial state.

However, this is merely an example, and the controller 130 may determine the bending area, the bending direction, the bending degree, and the bending duration using various methods described with reference to fig. 3 to 7.

The controller 130 may control the movement of the object by combining sensing results by a bending sensor, a gravity sensor, or an acceleration sensor.

Specifically, when it is determined that the direction of gravity sensed by the gravity sensor disposed along the edge of the display 110 is changed, the controller 130 may determine the bending direction of the display 110 based on the changed direction of gravity. Also, the controller 130 may determine the bending direction of the display 110 based on a change in acceleration sensed by an acceleration sensor disposed along an edge of the display 110. The controller 130 may determine a bending region based on the impedance value sensed by the bending sensor, and may move the object according to a result of the determination.

When the movement of the display 110 is not sensed, the controller 130 may determine the bent state of the display 110 with reference to the sensing result by the gravity sensor or the acceleration sensor, and when the movement of the display 110 is sensed, the controller 130 may determine the bent state of the display 110 using only the sensing result by the bending sensor. By doing so, a value sensed by the gravity sensor or the acceleration sensor when the flexible display device 100 is rotated or tilted is prevented from being mistaken for a value sensed when the display 110 is bent.

The controller 130 may control the operation of a function corresponding to the movement of the object. That is, the controller 130 may determine a moving direction, a moving distance, and a moving speed of the object displayed on the screen based on at least one of a position of the object on the screen, a curved region on the screen, a curved direction, a curvature, and a curved duration, and may move the object and display the object according to a result of the determination.

Accordingly, when the object is moved to a predetermined second position, the controller 130 may execute a function mapped to the second position.

For example, when the screen displayed on the display 110 is a lock screen and an object on the lock screen is moved to a predetermined second position corresponding to an unlock function in response to bending, the controller 130 may unlock the lock screen.

Specifically, when there is no user input to the flexible display device 100 for a predetermined time, the controller 130 may enter a screen-off mode and turn off the screen of the display 110. The controller 130 determines whether a user manipulation is input, and when it is determined that the user manipulation is input, the controller 130 enters a screen lock mode and displays a lock screen on the display 110. The user manipulation referred to herein may include a touch manipulation of pressing a specific button provided on the flexible display device 100 or the display 110.

An object may be displayed on the lock screen, and when the object is moved to the unlock menu according to the bending of the display 110, the controller 130 unlocks the lock screen and enters a screen activation mode. That is, when the lock screen is unlocked, the controller 130 may display a main screen on the display 110, and when one menu is selected on the main screen, the controller 130 may execute a function corresponding to the selected menu and may display an execution result screen on the display 110. The home screen may be a screen including at least one of icons, widgets, and images of applications installed in the flexible display apparatus 100.

Fig. 15 is a view illustrating an example of a method for unlocking a lock screen according to an exemplary embodiment.

As shown in fig. 15, an object 320 that can move according to the bending of the display 110 is displayed on the lock screen 310. And, the current time and the current date are displayed on the lock screen 310 of fig. 15 together with the object 320. However, this is merely an example. That is, widgets and images may be displayed along with the object 320 according to user settings. And, only an object that can move according to a bending direction can be displayed on the lock screen.

When the left side of the display 110 on which the object 320 is displayed is bent, the object 320 is moved to the right side of the display 110. However, the unlock menu 330 does not move even when the display 110 is bent.

Accordingly, when the object 320 is moved to the position of the unlock menu 330, the lock screen is unlocked and the home screen 340 including the plurality of icons 341 through 345 is displayed on the display 110. When the object 320 overlaps fully or partially with the position of the unlock menu 330, the home screen 340 may be displayed. The location of the unlock menu 330 may be indicated by an icon, an object, or an image displayed on the display.

When one icon 344 is selected from among the plurality of icons 341 to 345, an application corresponding to the selected icon 344 may be executed, and an application execution screen may be displayed on the display 110. For example, when the icon 344 for the photo application is selected, the photo application may be executed, and thus the image 350 stored in the flexible display device 100 may be displayed on the display 110.

Also, when the object on the lock screen is moved to a predetermined second position, the controller 130 may unlock the lock screen and may automatically perform an additional operation also mapped to the second position. The operation performed when the object is moved to the second position may be a function of: the application installed in the flexible display device 100 is executed and the execution result screen is displayed on the display 110. This can be set and changed by the user.

Fig. 16 and 17 are views illustrating an example of a method for performing an operation of mapping to a location of an object according to an exemplary embodiment.

For example, as shown in fig. 16, the

objects

420 and 440 may be displayed on different positions of the lock screen 410, and the

objects

420 and 440 may move according to the bending of the display 110.

Specifically, when the left side of the display 110 is bent in the Z + direction and the object 420 displayed on the left side of the lock screen is moved to the unlock menu 430, the lock screen may be unlocked and the main screen may be displayed on the display 110. This has already been described above with reference to fig. 15, and therefore a duplicate description thereof is omitted.

The object 440 displayed on the lower side of the lock screen 410 is a menu for automatically executing a predetermined operation while unlocking the lock screen. That is, when the lower side of the display 110 is bent in the Z + direction, the object 440 is moved to the upper side of the display 110. At this time, the function execution menu 450 does not move even when the display 110 is bent.

Accordingly, when the object 440 is moved to the position of the function execution menu 450, the lock screen may be unlocked and a predetermined function mapped to the function execution menu 450 may be performed. That is, a predetermined function mapped to the function execution menu 450 may be automatically performed without displaying a main screen, and a screen performing the predetermined function may be displayed on the display 110. For example, when the object 440 is moved to the position of the function execution menu 450 as shown in fig. 16, the lock screen may be unlocked, the calendar application may be automatically executed, and the calendar 460 may be displayed on the display 110.

In the above-described exemplary embodiment, the object for unlocking the lock screen and performing the specific function is displayed separately from the object for unlocking only the lock screen. However, this is merely an example.

That is, only one object may be displayed on the lock screen, and a specific function may be automatically performed when the object is moved to a position of the function execution menu according to the bending of the display 110. Also, by moving one object, an operation of unlocking the lock screen and simultaneously automatically executing a specific function can be performed.

That is, as shown in fig. 17, one object may be displayed on the lock screen, and the home screen may be displayed or a specific operation may be automatically performed according to an area to which the object moves according to the bent state of the display 110.

Referring to fig. 17, an object 520 that can move according to the bending of the display 110 is displayed on the lock screen 510. An unlock menu 530 and a function execution menu 540 are displayed on the lock screen 510 along with the object 520, and an operation may be performed according to a position to which the object 520 moves.

That is, when the object 520 is moved to the unlock menu 530 according to the curved state of the display 110, the home screen 550 including the plurality of icons 551 to 555 may be displayed on the display 110. On the other hand, when the object 520 is moved to the function execution menu 540 according to the bent state of the display 110, the e-book application mapped to the function execution menu 540 may be executed, and the e-book screen 560 may be displayed on the display 110.

Fig. 18 is a view illustrating an example of a method for performing an operation of mapping to a location of an object according to an exemplary embodiment.

When receiving the call request, the controller 130 may control the display 110 to display a call connection screen. The controller 130 may perform a call connection operation of accepting an incoming call request when an object on the call connection screen is moved to a position where a call connection menu is displayed according to the bending, and the controller 130 may perform a call rejection operation of rejecting the incoming call request when the object is moved to a position where a call rejection menu is displayed. The call connection screen may include the object, the call connection menu, and the call rejection menu.

That is, when a call request is received from an external device, a call connection screen 610 including an object 620, a call connection menu 630, and a call rejection menu 640 may be displayed on the display 110 as shown in fig. 18. The object 620 may move according to the bent state of the display 110, but the call connection menu 630 and the call rejection menu 640 are not moved when the display 110 is bent.

When the object 620 is moved to the call connection menu 630 according to the bent state of the display 110, a call screen 650 is displayed on the display 110, and a call connection operation of exchanging voice with an external device is performed.

On the other hand, when the object 620 is moved to the call reject menu 640 according to the bent state of the display 110, the controller 130 rejects the call request of the external device and displays the previous screen before the call connection screen is displayed on the display 110. For example, when a call request is received in a locked state, a lock screen 660 including an object 670 and an unlock menu 680 may be displayed on the display 110 as shown in fig. 18.

The flexible display device 100 may further include a communicator (not shown) connected to an external device through a mobile communication network or the internet. Also, when a voice acquiring device (not shown), such as a microphone, provided in the flexible display device 100 collects voice or external sound and transmits the voice or sound to the controller 130, the controller 130 may perform signal processing on the collected voice or external sound and may transmit the voice or external sound to an external device through a communicator (not shown). When receiving a voice signal from an external device, the controller 130 may perform signal processing on the received voice signal and may output the voice signal through a voice output device such as a speaker.

In the above-described exemplary embodiments, various operations may be performed according to the movement of the object. That is, various operations that can be executed by various applications installed in the flexible display device 100, such as a call connection operation, a call rejection operation, a message display operation, and a web browser connection operation, can be performed, and these operations can be set and changed by a user. The operation may be an operation associated with an application run by the flexible display device 100 or a function of the flexible display device, such as an unlocking operation.

For example, assume that a message is received from an external device. Then, when a lock screen including an object and a function execution menu is displayed and the object is moved to the function execution menu by bending the display 110, the controller 130 may execute a message application and may display a message received from an external device on the display 110.

Also, in the above-described exemplary embodiment, the object, the unlock menu, and the function execution menu are displayed on the lock screen. However, this is merely an example. That is, the controller 130 may display an object on the currently displayed screen according to the user manipulation. A detailed description thereof will be provided with reference to fig. 19 to 21.

Fig. 19 to 21 are views illustrating a method for displaying an object on various screens according to an exemplary embodiment.

When a predetermined user manipulation is input, the controller 130 may display an object on a first position of the screen. The user manipulation referred to herein may include a touch manipulation of pressing a specific button provided on the flexible display device 100 and the display 110. When a specific button provided on the flexible display device 100 is pressed or a touch manipulation on the display 110 is input, the controller 130 may directly display an object on the screen. However, the controller 130 may display a User Interface (UI) on the screen to inquire of the user whether the user wants to display the object, and may receive a separate user command through the UI to display the object.

When the object is displayed, the controller 130 may display an unlock menu or a function execution menu at a predetermined second position. At this time, the controller 130 may display an unlock menu or a function execution menu according to a screen currently displayed on the display 110.

For example, when the lock screen is displayed on the display 110, the controller 130 may display an unlock menu or a function execution menu. Also, when the main screen or the application execution screen is displayed, the controller 130 may display a function execution menu.

Also, when the object is moved to the unlock menu by bending the display 110, the controller 130 may unlock the lock screen and may display the home screen. When the object is moved to the function execution menu by bending the display 110, the controller 130 may execute a predetermined application and may display an application execution screen.

For example, when the lock screen 710 is displayed on the display 110 and a predetermined user manipulation is input, as shown in fig. 19, an object 720 and an unlock menu 730 are displayed on the lock screen 710. Then, when the left side of the display 110 is bent in the Z + direction and the object 720 is moved to the position of the unlock menu 730, the lock screen may be unlocked and the main screen 740 may be displayed.

Also, when the home screen 810 is displayed on the display 110 and a predetermined user manipulation is input, as shown in fig. 20, an object 820 and a function execution menu 830 may be displayed. Then, when the left side of the display 110 is bent in the Z + direction and the object 820 is moved to the function execution menu 830, a function mapped to the function execution menu 830 may be performed and the message application execution screen 840 may be displayed.

Also, when the electronic book application execution screen 910 is displayed on the display 110 and a predetermined user manipulation is input as shown in fig. 21, an object 920 and a function execution menu 930 may be displayed. Then, when the left side of the display 110 is bent in the Z + direction and the object 920 is moved to the function execution menu 930, a function mapped to the function execution menu 930 may be performed. That is, a photo application may be executed, and an image 940 of the photo application may be displayed.

In the above-described exemplary embodiment, when an object is moved to a position of an unlock menu or a function execution menu by bending the display 110, the object disappears from the screen. However, this is merely an example.

That is, when a user manipulation for bending the display 110 is not input for a predetermined time while an object is being displayed, the controller 130 may remove the object, the unlock menu, and the function execution menu from the screen.

Also, when a specific button provided on the flexible display device 100 is pressed or a touch manipulation on the display 110 is input in addition to a user manipulation for bending the display 110, the controller 130 may remove the object, the unlock menu, and the function execution menu from the screen. Also, when a specific button provided on the flexible display device 100 is pressed or a touch manipulation on the display 110 is input, the controller 130 may display a UI on the screen to inquire whether the user wants to remove the object, and may receive a separate user command to remove the object through the UI.

The object may be displayed in a predetermined size at a predetermined position on the screen. However, the display position and size of the object may be set and changed by the user. A detailed description thereof will be provided with reference to fig. 22 and 23.

Fig. 22 and 23 are views illustrating a method for setting parameters of an object according to an exemplary embodiment.

When a user manipulation for setting a parameter of an object is input, the controller 130 may display a UI screen for setting a display position or size of the object on the display 110. The controller 130 may set a display position or size of the object based on user manipulation of the input UI screen.

For example, when a menu for setting a display position of an object is selected through the displayed UI screen 1010 according to a user manipulation, as shown in fig. 22, the controller 130 may display an object 1030 for unlocking a locked state and a setting screen 1020 for setting a position of an unlock menu 1040.

When the user changes the position of the object 1030 through an input on the setting screen 1020, the controller 130 may set the position of the display object 1030 to the changed position. Thus, when lock screen 1060 is displayed, object 1050 can be displayed in the changed position on lock screen 1060.

In the above exemplary embodiment, the position of the object is changed. However, the controller 130 may change the display position of the unlock menu according to the user manipulation. Also, the controller 130 may change the display positions of the object and the unlock menu in a method other than the drag-and-drop method. For example, the position of the object or the unlock menu may be changed by touching the object and then touching the position where the user wants to place the object.

On the other hand, when a menu for changing the size of the object is selected through the displayed UI screen 1010 according to the user manipulation, as shown in fig. 23, the controller 130 may display an object 1030 for unlocking the locked state and a setting screen 1020 for setting the size of the unlock menu 1040.

When the user changes the size of the unlock menu 1040 by inputting a pinch-in manipulation and a pinch-out manipulation on the setting screen 1020, the controller 130 may set the size of the displayed unlock menu 1040 to the changed size. In this case, the size of the unlock menu 1040 may be enlarged by the outward-pinching manipulation, and the size of the unlock menu 1040 may be reduced by the inward-pinching manipulation.

Thus, when the lock screen 1080 is displayed, the unlock menu 1040 may be enlarged and displayed on the lock screen 1060.

Although the size of the unlock menu is changed in the above exemplary embodiment, the size of the object may be changed. Also, the sizes of the object and the unlock menu may be changed in a method other than the inward-pinch manipulation or the outward-pinch manipulation. For example, when the user touches the unlock menu and bends the display in the Z + direction at the center, the controller 130 may enlarge the size of the unlock menu. Conversely, when the user touches the unlock menu and bends the display in the Z-direction at the center, the controller 130 may reduce the size of the unlock menu.

Also, in the above-described exemplary embodiment, the display positions and sizes of the object and the unlock menu are changed. However, this is merely an example. That is, the controller 130 may display a setting screen for setting the position and size of the object and the unlock menu when the user operation is input while the lock screen is being displayed, and the controller 130 may display a setting screen for setting the position and size of the object and the function execution menu when the user operation is input while the main screen is being displayed. Accordingly, the position and size of the object and function execution menu may be changed in the same method as described in fig. 22 and 23.

In the above-described exemplary embodiments, when an object displayed on a screen is moved, a locked state is unlocked or a specific function is performed. However, this is merely an example. That is, the user may use various methods other than moving the object, and detailed description thereof will be provided with reference to fig. 24 to 27.

Fig. 24 to 27 are views illustrating various methods for performing an operation of a flexible display device according to an exemplary embodiment.

The controller 130 may display an animation effect on the lock screen when the display 110 is bent, and the controller 130 may unlock the lock screen or may perform a specific function when a specific condition is satisfied by the animation effect.

For example, as shown in fig. 24, the controller 130 may display a lock screen including the sea image 1110, and may display an animation effect showing the wave 1120 moving from left to right on the sea image 1110 when the left side of the display 110 is bent in the Z + direction. Thus, when the wave 1120 reaches the right edge of the lock screen, the controller 130 may unlock the lock screen and may display the home screen 1130 on the display 110.

Also, as shown in fig. 25, the controller 130 may display a lock screen including a baseball image 1210, and may display an animation effect showing that the baseball 1220 moves from left to right on the baseball image 1210 when the left side of the display 110 is bent in the Z + direction. Thus, when baseball 1220 reaches the right edge of the lock screen, controller 130 may unlock the lock screen and may display main screen 1230 on display 110.

On the other hand, it is assumed that an image having a size larger than the display 110 is displayed on the lock screen. Thus, a part of the image is displayed on the lock screen.

In this case, when the display 110 is bent, the controller 130 may display other portions of the image. At this time, the controller 130 may determine other portions of the image to be displayed based on the bent state of the display 110.

For example, when the left side of the display 110 is bent in the Z + direction, the controller 130 may gradually display a currently undisplayed left portion of the image, and when the right side of the display 110 is bent in the Z + direction, the controller 130 may gradually display a currently undisplayed right portion of the image. Also, when the upper side of the display 110 is bent in the Z + direction, the controller 130 may gradually display an upper portion of the image, which is not currently displayed, and, when the lower side of the display 110 is bent in the Z + direction, the controller 130 may gradually display a lower portion of the image, which is not currently displayed.

Also, when a predetermined region of the image is displayed, the controller 130 may unlock the lock screen and display a main menu screen or perform a specific function. For example, when the leftmost area, the rightmost area, the uppermost area, or the lowermost area of the image is displayed, the controller 130 may unlock the lock screen and display a main menu screen or perform a specific function.

That is, when the image 1310 having a size larger than the display 110 is displayed on the lock screen as shown in fig. 26, and when the display 110 is left-hand bent in the Z + direction, the left area of the image is gradually displayed. Thus, when the leftmost area of the image 1310 is displayed, the lock screen may be unlocked and the main menu screen 1320 may be displayed.

In the above-described exemplary embodiment, only an image having a size larger than the display 110 is displayed on the lock screen. However, this is merely an example. That is, the controller 130 may display an object on the lock screen together with an image having a size larger than the display 110, and may unlock the lock screen and display a main menu screen or perform a specific function according to the bent state of the display 110.

Specifically, the controller 130 may move the object according to the bending of the display 110, and may control the display 110 to gradually display other regions of the image according to the moving direction of the object. That is, when the controller 130 moves the object according to the curvature of the display 110, the controller 130 may gradually display an area of the entire image existing in the moving direction of the object with reference to the currently displayed area.

For example, when the left edge of the display 110 is bent in the Z + direction, the object is moved to the right of the display 110, the controller 130 may gradually display a left region of the image that is not currently displayed, and, when the right edge of the display 110 is bent in the Z + direction and the object is moved to the left of the display 110, the controller 130 may gradually display a right region of the image that is not currently displayed. Also, when the upper side of the display 110 is bent in the Z + direction and the object is moved to the lower side of the display 110, the controller 130 may gradually display an upper area of the image that is not currently displayed, and, when the lower side of the display 110 is bent in the Z + direction and the object is moved to the upper side of the display 110, the controller 130 may gradually display a lower area of the image that is not currently displayed.

Also, when the object reaches a predetermined position, the controller 130 may unlock the lock screen and may display a main screen or perform a specific function.

For example, it is assumed that a lock screen including an image 1410 having a size larger than the display 110, an object 1420, and an unlock menu 1430 is displayed on the display 110, as shown in fig. 27. In this case, when the left side of the display 110 is bent in the Z + direction, the object 1420 is moved to the right of the display 110 and the left area of the image 1410 is gradually displayed. Thus, when the object 1420 reaches the unlock menu 1430, the lock screen may be unlocked and the home screen 1440 may be displayed on the display 110.

Fig. 28 and 29 are views illustrating a display method of a flexible display device according to an exemplary embodiment.

When some areas constituting a content screen having a size larger than the display 110 are displayed on the display 110 and the display 110 is bent, the controller 130 may display another area according to the bending. The content screen referred to herein may be a screen on which various contents (such as images, texts, and web pages) are displayed, and may include, for example, an execution screen on which an application is executed.

That is, when only some regions of the content screen are displayed on the display 110, the controller 130 may display regions that are not currently displayed on the display 110 according to the curvature of the display 110. Specifically, when the display 110 is bent, the controller 130 may display an area of the content screen corresponding to the bent area among all areas of the content screen.

For example, when the left side of the display 110 is bent in the Z + direction, the controller 130 may gradually display a left area of the image that is not currently displayed, and, when the right side of the display 110 is bent in the Z + direction, the controller 130 may gradually display a right area of the image that is not currently displayed. Also, when the upper side of the display 110 is bent in the Z + direction, the controller 130 may gradually display an upper area of the image, which is not currently displayed, and, when the lower side of the display 110 is bent in the Z + direction, the controller 130 may gradually display a lower area of the image, which is not currently displayed.

For example, assume that some regions 1510 of the image are displayed on the display 110, as shown in FIG. 28. In this case, when the right side of the display 110 is bent in the Z + direction, a right area 1520 of the image, which is not currently displayed, may be gradually displayed.

Also, it is assumed that some areas 1620 of the entire web page screen 1610 are displayed on the display 110 as shown in fig. 29. In this case, when the lower side of the display 110 is bent in the Z + direction, the lower area 1630 of the entire web page screen 1610 may be gradually displayed, and when the upper side of the display 110 is bent in the Z + direction, the upper area 1640 of the entire web page screen 1610 may be gradually displayed. That is, an operation such as a scroll manipulation of the mouse may be performed.

In the above exemplary embodiment, the display 110 is bent in the Z + direction. However, when the display 110 is bent in the Z-direction instead of the Z + direction, a region that is not currently displayed may be displayed.

The controller 130 may map the curvature of the display 110 to the arrow key manipulation, and may move an object or may display a content area that is not currently displayed. The arrow keys may include four direction keys (up/down/left/right) or eight direction keys (up/left down/right up/right).

For example, when the left side of the display 110 is bent with reference to the center of the display 110, the controller 130 may move an object displayed on the screen to the left, and when the right side of the display 110 is bent with reference to the center of the display 110, the controller 130 may move an object displayed on the screen to the right. Also, the controller 130 may move an object displayed on the screen to an upper side when an upper side of the display 110 is bent with reference to the center of the display 110, and the controller 130 may move an object displayed on the screen to a lower side when a lower side of the display 110 is bent with reference to the center of the display 110.

Accordingly, when the object reaches a position associated with the unlock menu or the function execution menu, the controller 130 may unlock the lock screen or may perform a specific function associated with the position.

Also, when the left side of the display 110 is bent with reference to the center of the display 110, the controller 130 may gradually display a left area of the content screen that is not currently displayed, and when the right side of the display 110 is bent with reference to the center of the display 110, the controller 130 may gradually display a right area of the content screen that is not currently displayed. Also, when the upper side of the display 110 is bent with reference to the center of the display 110, the controller 130 may gradually display an upper area of the content screen that is not currently displayed, and, when the lower side of the display 110 is bent with reference to the center of the display 110, the controller 130 may gradually display a lower area of the content screen that is not currently displayed.

As described above, the controller 130 may map a bending manipulation of the display 110 to an arrow key manipulation, and may control an object or a content screen according to a position of a bending region of the display 110.

Also, the controller 130 may execute a function corresponding to the menu selected on the main screen, and may display an execution result screen. For example, when a web browser launch menu displayed on the main screen is selected, the controller 130 may access a web server through a communicator (not shown), receive a web page screen from the web server, and display the web page screen on the display 110. Also, when the photo application execution menu displayed on the main screen is selected, the controller 130 may display an image pre-stored in the flexible display device 100 on the display 110.

When the display 110 is bent in the first direction while the running result screen is being displayed, the controller 130 may align at least one object included in the running result screen on an edge region of the running result screen and display the aligned object. The object referred to herein may include an image, text, and an application execution screen.

In this case, the controller 130 may adjust at least one of a size and a shape of the at least one object, and may align the object on the edge region. When the flexible display device 100 is bent in a second direction opposite to the first direction while at least one object is aligned on the edge region and displayed, the controller 130 may restore the at least one object to its original state and display it. A detailed description thereof will be provided with reference to fig. 31.

Fig. 30 is a view illustrating an example of a method for changing a display state of an object based on a bending direction of a flexible display device according to an exemplary embodiment.

When a specific button provided on the flexible display device 100 is pressed or a specific icon displayed on the display 110 is touched, an information display screen of a currently running application may be displayed on the display 110. The application information display screen referred to herein may include the icon corresponding to the currently running application or an execution screen of the currently running application.

When a plurality of applications are simultaneously run according to the multitasking function, an icon or a running screen corresponding to each application may be displayed on the display 110. That is, an application information display screen including a plurality of

application execution screens

1711, 1712, and 1713 may be displayed on the display 110, as shown in fig. 30.

When the right side of the display 110 is bent in the Z + direction while the application information display screen 1710 is being displayed, the plurality of

application execution screens

1711, 1712, and 1713 displayed on the display 110 may be reduced in size, moved to the left edge area of the display 110, aligned in the vertical direction, and displayed. A home screen 1720 including a plurality of icons 1721-1725 may be displayed on the display 110. However, this is merely an example, and a screen including at least one of an icon, a widget, and an image may be displayed.

When the left side of the display 110 is bent in the Z + direction, the main screen 1720 may disappear and the application information display screen 1710 may be displayed on the display 110.

In the above-described exemplary embodiment, when the right side of the display is bent, the object displayed on the screen is moved to the left edge area of the display and displayed. However, this is merely an example, and an object displayed on a screen may be moved and displayed according to a curved region of the display 110. That is, when the left side of the display is bent, an object displayed on the screen may be moved to a left edge area of the display and displayed. Also, when the display is bent in the Z-direction instead of the Z + direction, the object may be moved to the edge region and restored to its original state.

The controller 130 may control a mode of the flexible display device 100. The modes mentioned herein may include a power off mode, a screen off mode, a lock screen mode, a security screen mode, and a screen activation mode.

Specifically, when a power off command is input, the controller 130 cuts off power supplied to each element of the flexible display device 100 and turns off the screen of the display 110. In such a power-off mode, an operation corresponding to another user manipulation is not performed until a power-on command is input.

When there is no user input to the flexible display device 100 for a predetermined time (or based on a user command) in the power-on state, the controller 130 turns off the screen of the display 110 and enters a screen-off mode. In this case, when a specific button provided on the flexible display device 100 is pressed or a touch manipulation is input on the display 110, the controller 130 may display a lock screen on the display 110.

The lock screen mode is a state in which a lock screen is displayed. In this case, the controller 130 does not perform an operation corresponding to a user manipulation other than the user manipulation for unlocking the lock screen.

When a user manipulation for unlocking the lock screen is input while the lock screen is being displayed, the controller 130 unlocks the lock screen and enters a screen activation mode. In the screen activation mode, operations corresponding to various user manipulations may be performed. For example, when the lock screen is unlocked, the controller 130 may display a home screen on the display 110 and may run an application corresponding to an icon selected from among icons displayed on the home screen.

The secure screen mode is a mode requiring a predetermined password or a specific touch manipulation in order to enter the screen activation mode. When a specific button provided on the flexible display device 100 is pressed or a touch manipulation on the display 110 is input in the secure screen mode, the controller 130 may display a UI screen for receiving a password or a touch manipulation on the display 110. Also, the controller 130 may enter a screen activation mode when a predetermined password or a specific touch manipulation is input through the UI screen.

In the above-described exemplary embodiment, the controller 130 displays the lock screen when a specific button is pressed or a touch manipulation is input. However, this is merely an example. That is, the controller 130 may display the lock screen based on a bending manipulation or other user input.

For example, the controller 130 may display the lock screen and may enter the lock screen mode when a predetermined position of the display 110 is bent, the predetermined position of the display 110 is bent by a predetermined angle, the predetermined position of the display 110 is bent a predetermined number of times, the predetermined position of the display 110 is bent in a specific direction, the predetermined position of the display 110 is bent for a predetermined time, or the predetermined position of the display 110 is bent at a predetermined speed.

Fig. 31 is a block diagram illustrating a detailed configuration of a flexible display device according to an exemplary embodiment. Referring to fig. 31, the flexible display device 100 includes a display 110, a sensor 120, a controller 130, a storage 140, a communicator 150, a voice recognizer 160, a motion recognizer 170, a speaker 180, external input ports 190-1 to 190-n, and a power supply 1800. In explaining the process of fig. 32, explanations of the elements discussed above with reference to fig. 1 are omitted.

The storage device 140 may store various programs or data associated with the operation of the flexible display device 100, setting information set by a user, system operating software, various application programs, and information on operations corresponding to user manipulations.

The sensor 120 senses bending manipulation on the flexible display device 100 and touch manipulation input through the display 110. Referring to fig. 26, the sensors 120 may include various sensors such as a touch sensor 121, a geomagnetic sensor 122, a gyro sensor 123, an acceleration sensor 124, a bending sensor 125, a pressure sensor 126, a proximity sensor 127, and the like.

The touch sensor 121 may be implemented by using a capacitive or resistive sensor. The capacitive type calculates touch coordinates by sensing minute electric power excited in a user's body when a portion of the user's body touches the surface of the display 110 using a dielectric substance coated on the surface of the display 110. The resistive type includes two electrode plates, and when a user touches the screen, the resistive type calculates a touch coordinate by sensing a current flow due to a contact between an upper electrode plate and a lower electrode plate at a touch point. As described above, the touch sensor 121 may be embodied in various forms.

The geomagnetic sensor 122 and the gyro sensor 123 sense a rotation state and a moving direction of the flexible display apparatus 100. The acceleration sensor 124 senses the inclination of the flexible display device 100. As described above, the geomagnetic sensor 122, the gyro sensor 123, and the acceleration sensor 124 may be used to sense a bending characteristic of the flexible display apparatus 100, such as a bending direction or a bending area. However, the geomagnetic sensor 122, the gyro sensor 123, and the acceleration sensor 124 may be used to sense a rotation state or a tilt state of the flexible display apparatus 100.

The bending sensor 125 may be embodied in various shapes and numbers, as described above with reference to fig. 3 to 6, and may sense a bending state of the flexible display device 100. The configuration and operation of the bending sensor 125 have been described above, and thus redundant explanations are omitted.

The pressure sensor 126 senses the magnitude of pressure applied to the flexible display device 100 when the user performs a touch or bending manipulation, and provides the magnitude of pressure to the controller 130. The pressure sensor 126 may include a piezoelectric film embedded in the display 110 and output an electrical signal corresponding to the magnitude of the pressure. Although the pressure sensor 126 is an element separate from the touch sensor 121 in fig. 31, if the touch sensor 121 is implemented by using a resistive touch sensor, the resistive touch sensor may also perform the function of the pressure sensor 126.

The proximity sensor 127 senses motion that is close to, but not directly touching, the display surface. The proximity sensor 127 may be implemented by using various types of sensors, such as a high-frequency oscillation type proximity sensor that forms a high-frequency magnetic field and detects a current induced by a magnetic property that changes when an object approaches, a magnetic type proximity sensor using a magnet, a capacitive type proximity sensor that detects a capacitance that changes when an object approaches, and the like.

The controller 130 analyzes the sensing result by the sensor 120, determines a deformed state of the display 110, and performs an operation corresponding to the deformed state. The operations performed by the controller 130 when the display 110 is deformed have been described above, and thus redundant explanations are omitted.

The communicator 150 may communicate with various types of external devices according to various communication methods. The communicator 150 may include various communication modules such as a broadcast receiving module 151, a short-range wireless communication module 152, a GPS module 153, and a wireless communication module 154. The broadcast receiving module 151 may include: a terrestrial broadcast receiving module (not shown) including an antenna for receiving a terrestrial broadcast signal, a demodulator, and an equalizer; and a Digital Multimedia Broadcasting (DMB) module for receiving and processing a DMB broadcasting signal. The short range wireless communication module 152 is a module that communicates with an external device located nearby according to a short range wireless communication method, such as Near Field Communication (NFC), bluetooth, or Zigbee, etc. The GPS module 153 is a module that receives GPS signals from GPS satellites and detects the current position of the flexible display device 100. The wireless communication module 154 is a module that is connected to an external network according to a wireless communication protocol (such as Wi-Fi or IEEE, etc.) and communicates with the external network. The wireless communication module 154 may also include a mobile communication module that accesses a mobile communication network and performs communication according to various mobile communication standards, such as third generation (3G), third generation partnership project (3GPP), and Long Term Evolution (LTE).

The controller 130 may selectively activate the communicator 150 and may perform an operation corresponding to a user command. For example, the controller 130 may access a web server through the wireless communication module 154 and may receive web page data from the web server. The controller 130 may configure a web page screen using the web page data and may display the web page screen on the display 110.

The controller 130 may recognize a sound input or a motion input other than the bending or touch manipulation, and may perform an operation corresponding to the input. In this case, the controller 130 may activate the speech recognizer 160 or the motion recognizer 170.

The voice recognizer 160 collects the user's voice or external sound using a voice acquiring device such as a microphone (not shown) and transmits the user's voice or external sound to the controller 130. When the user's voice coincides with a preset voice command in the voice control mode, the controller 130 may perform a task corresponding to the user's voice. The tasks that can be controlled using speech may include various tasks such as adjusting volume, selecting a channel, switching (e.g., changing) a channel, adjusting display properties, reproducing, pausing, rewinding, fast forwarding, running an application, selecting a menu, turning on a device, and turning off a device.

The motion recognizer 170 acquires an image of the user using an image pickup device (not shown) such as a camera, and provides the image of the user to the controller 130. When the controller 130 analyzes the user's image in the motion control mode and determines that the user makes a motion gesture corresponding to a preset motion command, the controller 130 performs an operation corresponding to the motion gesture. For example, various tasks, such as switching channels, turning devices on, turning off, pausing, reproducing, stopping, rewinding, fast forwarding, muting, and the like, may be controlled according to the motion. The above-described tasks that can be controlled according to voice and the tasks that can be controlled according to motion are merely examples and are not limited.

The

external input ports

1, 2, n 190-1 to 190-n may be connected to various types of external devices, and may receive various data or programs or control commands. Specifically, the external input port may include a USB port, a headset port, a mouse port, a LAN port, and the like.

The power supply 1800 supplies power to the elements of the flexible display device 100. Power supply 1800 may be implemented by including a positive collector, a positive electrode, an electrolyte, a negative electrode, a negative collector, and a casing (casing) enclosing the above components. The power supply 1800 may be implemented using a rechargeable and dischargeable battery. The power supply 1800 may be implemented in a flexible form so that it can be bent along with the flexible display device 100. In this case, the collector, the electrode, the electrolyte, and the case may be made of a flexible material. The detailed configuration and materials of the power supply 1800 will be separately described below.

Although fig. 31 shows various elements that may be included in the flexible display device 100, the flexible display device 100 may not necessarily include all of the elements, and may include not only the above elements. Accordingly, some elements may be omitted or added according to the product type of the flexible display device 100, or may be replaced with other elements.

The controller 130 may control the elements according to user manipulations recognized through the sensor 120, the voice recognizer 160, and the motion recognizer 170 as described above, and may perform various operations.

Fig. 32 is a view illustrating a detailed configuration of the controller 130 according to an exemplary embodiment.

Referring to fig. 32, the controller 130 may include a system memory 131, a main CPU132, an image processor 133, a network interface 134, a storage interface 135, first to nth interfaces 136-1 to 136-n, an audio processor 137, and a system bus 138.

The system memory 131, the main CPU132, the image processor 133, the network interface 134, the storage interface 135, the first to nth interfaces 136-1 to 136-n, and the audio processor 137 may be connected through a system bus 138, and may exchange various data or signals through the system bus 138.

The first through nth interfaces 136-1 through 136-n support interfacing between elements including the sensor 120 and elements of the controller 130. In FIG. 32, the sensor 120 is connected only to the first interface 136-1. However, when the sensors 120 include various types of sensors as shown in fig. 32, each of the sensors may be connected through each interface. Also, at least one of the first to nth interfaces 136-1 to 136-n may be implemented by using: a button provided on the main body of the flexible display device 100; or an input interface that receives various signals from external devices connected through the external input ports 1 to n.

The system memory 131 includes Read Only Memory (ROM)131-1 and Random Access Memory (RAM) 131-2. The ROM 131-1 stores a set of commands for system startup. If a power-on command is input and power is supplied, the main CPU132 copies the OS stored in the storage device 140 into the RAM 131-2 according to the command stored in the ROM 131-1, runs the OS, and starts the system. If the startup is completed, the main CPU132 copies various applications stored in the storage device 140 into the RAM 131-2, runs the applications copied into the RAM 131-2, and performs various operations.

As described above, the main CPU132 may perform various operations according to the execution of applications stored in the storage device 140.

The storage interface 135 is connected to the storage device 140 and exchanges various programs, contents, data, and the like with the storage device 140.

For example, when a user performs a touch manipulation corresponding to a reproduction command for reproducing and displaying content stored in the storage device 140, the main CPU132 accesses the storage device 140 through the storage interface 135, generates a list of the stored content, and displays the list on the display 110. In this state, when the user performs a touch manipulation for selecting one content, the main CPU132 runs a content reproduction program stored in the storage device 140. The main CPU132 controls the image processor 133 to form a content reproduction screen according to a command included in the content reproduction program.

The image processor 133 may include a decoder, a renderer, a scaler, and the like. Accordingly, the image processor 133 decodes the stored contents, renders the decoded contents data and forms a frame to scale the size of the frame according to the screen size of the display 110. The image processor 133 supplies the processed frame to the display 110 and displays it.

The audio processor 137 refers to an element that processes audio data and provides the audio data to a sound output device such as a speaker 180. The audio processor 137 performs audio signal processing by decoding audio data stored in the storage device 140 or audio data received through the communicator 150, filtering noise, and amplifying the audio data to an appropriate decibel. In the above-described example, when the content to be reproduced is moving image content, the audio processor 137 may process audio data demultiplexed from the moving image content, and may supply the audio data to the speaker 180 so that the audio data is synchronized with the image processor 133 and output.

The network interface 134 is connected to an external device through the communicator 150. For example, when a web browser program is executed, the main CPU132 accesses a web server through the network interface 134. When web page data is received from the web server, the main CPU132 controls the image processor 133 to form a web page screen and displays the web page screen on the display 110.

Fig. 33 is a view showing a software structure of an application supporting the operation of the controller 130 according to the above-described exemplary embodiment. Referring to fig. 33, the storage 140 includes a base module 1910, a device management module 1920, a communication module 1930, a presentation module 1940, a web browser module 1950, and a service module 1960.

The base module 1910 is a module that processes a signal transmitted from each hardware element included in the flexible display apparatus 100 and transmits the signal to an upper module.

The base module 1910 includes a storage module 1911, a location-based module 1912, a security module 1913, and a network module 1914.

The storage module 1911 is a program module that manages a Database (DB) or a registry (registry). The location-based module 1912 is a program module that interlocks with hardware, such as a GPS chip, and supports location-based services. The security module 1913 is a program module supporting hardware certification, request permission, and secure storage, and the network module 1914 includes a Distributed.net (DNET) module and a universal plug and play (UPnP) module as modules for supporting network connection.

The device management module 1920 is a module that manages and uses external input and information about external devices. The device management module 1920 may include a sensing module 1921, a device information management module 1922, and a remote control module 1923, among others.

Sensing module 1921 is a module that analyzes sensor data provided from various ones of sensors 120. In particular, sensing module 1921 is a program module that detects the location, color, shape, size, and other profiles, etc. of a user or object. Sensing module 1921 may include a face recognition module, a voice recognition module, a motion recognition module, and an NFC recognition module. The device information management module 1922 is a module that provides information about various types of devices, and the remote control module 1928 is a program module that remotely controls peripheral devices such as a telephone, a Television (TV), a printer, a camera, an air conditioner, and the like.

The communication module 1930 is a module that communicates with an external device. The communication module 1930 includes: a messaging module 1931, such as a messenger program, Short Message Service (SMS) and Multimedia Message Service (MMS) programs, and an email program, among others; and a phone module 1932 that includes a call information aggregator program module and a voice over internet protocol (VoIP) module.

The rendering module 1940 is a module that generates a display screen. The presentation module 1940 includes: a multimedia module 1941 for reproducing and outputting multimedia contents; and a User Interface (UI) and graphic module 1942 for processing UI and graphic. The multimedia module 1941 may include a player module, a camcorder module, and a sound processing module. Accordingly, the multimedia module 1941 generates a screen and sound by reproducing various multimedia contents, and reproduces the screen and sound. The UI and graphics module 1942 may include an image compositor module 1942-1 for combining images, a coordinate combination module 1942-2 for combining coordinates on a screen to display images and generate coordinates, an X11 module 1942-3 for receiving various events from hardware, and a 2D/3D UI toolkit 1942-4 for providing tools for configuring a UI in a 2D or 3D format.

The web browser module 1950 is a module that performs web browsing and accesses a web server. The web browser module 1950 may include a web viewing module for rendering and viewing web pages, a download agent module for downloading, a bookmark module, and a web suite module, among others.

The service module 1960 is an application module that provides various services. In particular, the service module 1960 may include various modules such as: a navigation service module for providing map, current location, landmark, and route information; a game module; and an advertisement application module.

The main CPU132 of the controller 130 accesses the storage device 140 through the storage interface 135, copies various modules stored in the storage device 140 into the RAM 131-2, and performs operations according to the operations of the copied modules.

Specifically, the main CPU132 analyzes the output values of the sensors of the sensor 120 using the sensing module 1921, checks a bending region, a bending line, a bending direction, the number of times bending is performed, a bending angle, a bending speed, a touch area, the number of times touch is performed, a touch intensity, a magnitude of pressure, and a proximity, and determines user manipulation of an input based on the result of the checking. When it is determined that the user manipulation is intentional, the main CPU132 detects information on an operation corresponding to the user manipulation from the database of the storage module 1910. The main CPU132 drives a module corresponding to the detected information and performs an operation.

For example, when the operation is displaying a Graphical User Interface (GUI), the main CPU132 configures a GUI screen using the image synthesizer module 1942-1 of the presentation module 1940. Also, the main CPU132 determines a display position of the GUI screen using the coordinate combination module 1942-2, and controls the display 110 to display the GUI screen at the position.

When a user manipulation corresponding to a message reception operation is performed, the main CPU132 runs a message module, accesses the message management server, and receives a message stored in a user account. Also, the main CPU132 configures a screen corresponding to the received message using the presentation module 1940 and displays the screen on the display 110.

If a phone call is performed, the main CPU132 may drive the phone module 1932.

As described above, programs of various structures may be stored in the storage device 140, and the controller 130 may perform various operations using the various programs stored in the storage device 140.

Fig. 34 is a view showing an example of a flexible display device embedded in a main body. Referring to fig. 34, the flexible display device 100 includes a main body 2000, a display 110, and a grip portion 2010.

The body 2000 may serve as a housing containing the display 110. When the flexible display device 100 includes various elements as shown in fig. 31, elements other than the display 110 and some sensors may be mounted on the main body 2000. The main body 2000 includes a rotating roller for rolling the display 110. Thus, when not in use, the display 110 is rolled around a rotating reel and embedded in the body 2000.

When the user holds the grip portion 2010 and pulls the display 110, the rotation reel rotates in a direction opposite to the direction of the curling, and the curling is released, so that the display 110 comes outside the main body 2000. The brake may be provided on the rotating spool. Accordingly, when the user pulls the grip portion 2010 more than a predetermined distance, the rotation of the rotation reel is stopped by the brake, and the display 110 may be fixed. Accordingly, the user can operate various functions using the display 110 outside the main body 2000. When the user presses a button for releasing the brake, the brake is released and the rotating reel rotates in a reverse direction. As a result, the display 110 is rolled into the body 2000. The brake may have a switch for stopping the operation of the gear for rotating the rotating spool. Since the rotating reel and the brake can actually adopt a general winding structure, detailed illustration and description thereof are omitted.

The body 2000 includes a power source 1800. The power supply 1800 may be implemented by using a battery connector on which a disposable battery is mounted, a secondary battery that can be charged by a user and used multiple times, and a solar cell that generates electricity using solar heat. When the power supply is implemented by using a secondary battery, the user may connect the main body 2000 to an external power supply through a wire and may charge the power supply 1800.

In fig. 34, the body 2000 has a cylindrical shape. However, the shape of the body 2000 may be a quadrangle or other polygonal shape. Also, the display 110 may be implemented in various forms, such as encasing the body 2000, instead of being embedded in the body 2000 and exposed to the outside by being pulled.

Fig. 35 is a view illustrating a flexible display device according to an exemplary embodiment. Referring to fig. 35, a power supply 1800 is provided on one edge of the flexible display device and may be attached and detached.

The power supply 1800 is made of a flexible material and can flex with the display 110. Specifically, the power supply 1800 includes a negative collector, a negative electrode, an electrolyte, a positive electrode, a positive collector, and a case covering the above-described components.

For example, the collector may be implemented using: alloys such as TiNi having good elasticity; metals such as copper and aluminum, and the like; conductive materials such as carbon-coated metals, carbon, and carbon fibers, or conductive polymers (such as polypyrrole), and the like.

The negative electrode may be fabricated from a negative electrode material such as: metals such as lithium, sodium, zinc, magnesium, cadmium, hydrogen storage alloys, and lead, and the like; non-metals, such as carbon; and high polymer electrode materials such as organic sulfur.

The positive electrode may be fabricated from anode materials such as: sulfur and metal sulfides; lithium transition metal oxides such as LiCoO 2; and polymer electrode materials such as SOCl2, MnO2, Ag2O, Cl2, NiCl2, and NiOOH, among others. The electrolyte may be implemented in a gel form using PEO, PVdF, PMMA, and PVAC.

The shell may use a common polymer resin. For example, PVC, HDPE, or epoxy, etc. may be used. In addition to these, any material that can prevent the screw-type battery from being damaged and can be freely molded and bent may be used for the case.

Each of the positive and negative electrodes in the power supply 1800 may include a connector to be electrically connected to an external source.

Referring to fig. 35, a connector protrudes from the power source 1800 and a groove corresponding to the position, size, and shape of the connector is formed on the display 110. Accordingly, the power source 1800 is connected with the display 110 as the connector and the recess are connected with each other. The connector of the power supply 1800 is connected to a power connection pad (not shown) of the flexible display device 100 in order to supply power to the flexible display device 100.

Although the power supply 1800 is attached to or separated from one edge of the flexible display device 100 in fig. 35, this is only an example. The position and shape of the power source 1800 may vary depending on product characteristics. For example, when the flexible display device 100 has a predetermined thickness, the power supply 1800 may be mounted on the rear surface of the flexible display device 100.

First, an object is displayed at a first position on a screen of a display (S2110). That is, an object may be displayed at a predetermined position on the screen, and the predetermined position may be set at the time of manufacturing the flexible display device 100 or may be set and changed by a user.

The bending of the display is sensed (S2120).

Moving the object based on the position of the sensed bend. When the object is moved to a predetermined second position on the screen, a function mapped to the second position is performed (S2130).

Specifically, a moving direction, a moving distance, and a moving speed of an object displayed on a screen are determined based on at least one of a position of the object displayed on the screen, a curved region on the screen, a curved direction, a curvature, and a curved duration, and the object is moved and displayed according to a result of the determination. A function corresponding to the movement of the object may be performed.

The screen mentioned here is a lock screen, and when the object is moved to a predetermined second position on the lock screen by bending, an unlocking operation for unlocking the lock screen may be performed.

When the lock screen is unlocked, a main screen is displayed, and when one menu is selected on the main screen, a function corresponding to the selected menu is executed and an execution result screen is displayed.

When the display is bent in the first direction while the running result screen is being displayed, at least one object included in the running result screen is aligned and displayed on an edge area of the running result screen. In this case, at least one of the size and the shape of the at least one object aligned on the edge region may be adjusted.

When the display is bent in a second direction opposite to the first direction while the at least one object is aligned and displayed on the edge region, the at least one object is restored to an original state and displayed.

On the other hand, when the object on the lock screen is moved to a predetermined second position, the lock screen may be unlocked and an operation matching the second position may be automatically performed. For example, the operation matched with the second position may be an operation of running an application installed in the flexible display device.

The screen may be a call connection screen further including a call connection menu and a call rejection menu. The call connection operation may be performed when the object on the call connection screen is moved to a position of the call connection menu by bending, and the call rejection operation may be performed when the object is moved to a position of the call rejection menu.

On the other hand, the distance the object moves may be adjusted differently according to the degree of curvature of the display. That is, the moving distance of the object may be adjusted to be proportional to the degree of curvature. Thus, as the degree of bending increases during the same bending hold time, the distance the object moves increases. However, this is merely an example, and the moving speed of the object may increase as the degree of curvature increases.

The above exemplary embodiments have been described with reference to the accompanying drawings, and thus redundant explanations are omitted.

A non-transitory computer readable medium storing a program for sequentially performing a display method according to an exemplary embodiment may be provided.

Non-transitory computer-readable media refer to media that store data semi-permanently, rather than for a short period of time, such as registers, caches, and memory, and can be read by a device. In particular, the various applications or programs described above may be stored in a non-transitory computer readable medium such as a Compact Disc (CD), a Digital Versatile Disc (DVD), a hard disk, a blu-ray disc, a Universal Serial Bus (USB), a memory stick, and a Read Only Memory (ROM), and may be provided.

In the block diagram of the flexible display device, the bus is not shown. However, the elements of the flexible display device may communicate with each other over a bus. Also, the flexible display device may further include a processor such as a CPU and a microprocessor to perform the above-described various operations.

The foregoing exemplary embodiments and advantages are merely exemplary and are not to be construed as limiting the present inventive concept. The exemplary embodiments can be readily applied to other types of apparatuses. Also, the description of the exemplary embodiments is intended to be illustrative, and not to limit the scope of the claims, and many alternatives, modifications, and variations will be apparent to those skilled in the art.

Claims

1. A method of displaying information on a flexible display device, the method comprising:

receiving a user input of a lock screen setting of at least one of a size of an object or a position of the object to be provided on a lock screen of the flexible display device,

setting a display object according to a lock screen at a first position on a flexible display when the lock screen is displayed on the flexible display of the flexible display device;

sensing deformation of the flexible display device in a locked state;

moving the object to a predetermined second position of a lock screen on the flexible display based on the deformation, the object moving to be displayed with an animation effect on the lock screen; and

functions of unlocking the lock screen and displaying the main screen are performed on the flexible display.

2. The method of claim 1, wherein the function unlocks a lock screen of the flexible display device.

3. The method of claim 2, wherein the functions include unlocking a lock screen and running an application mapped to the predetermined second location.

4. The method of claim 2, wherein the function comprises unlocking a lock screen and a home screen of the display flexible display device.

5. The method of claim 1, wherein executing the function comprises adjusting a distance of movement of the object differently according to a degree of curvature of the display.

6. A flexible display device comprising:

a flexible display;

a sensor configured to sense deformation of the flexible display device in the locked state; and

a controller configured to control the flexible display to display an object according to a lock screen setting of at least one of a size of the object or a position of the object when the lock screen is displayed on the flexible display based on a user input of the lock screen setting of at least one of the size of the object or the position of the object to be provided on the lock screen of the flexible display device, and to control the flexible display to move the object to a predetermined position of the lock screen of the flexible display based on the deformation, the object moving being displayed with an animation effect on the lock screen, and to execute a function of unlocking the lock screen and displaying the main screen on the flexible display.

7. The flexible display device of claim 6, wherein the function comprises an unlock function for unlocking a lock screen of the flexible display device.

8. The flexible display device of claim 6, wherein the function comprises an application execution function for executing an application of the flexible display device.

9. The flexible display device of claim 6, wherein the controller is configured to determine the changed position of the object based on a duration of the deformation.

10. The flexible display device of claim 6, wherein the controller is configured to determine the changed position of the object based on the position of the deformation.

11. The flexible display device of claim 10, wherein the controller is configured to determine the changed position of the object based on a position of the object relative to the deformed position.

12. The flexible display device of claim 11, wherein the deformation comprises bending of the flexible display device, and

wherein the controller is configured to determine the changed position of the object based on a direction perpendicular to the position of the bend.

13. The flexible display device of claim 6, wherein the object comprises an image.