KR20200058377A - Flexible display apparatus and display method thereof - Google Patents

Abstract

Disclosed is a flexible display device. The flexible display device of the present invention comprises: a display part displaying an object in a first position on a screen; a sensing part sensing bending of the display part; and a control part moving the position of the object based on the position on the screen where the bending is detected while the bending is maintained, wherein the control part controls a function mapped to a predetermined second position to be performed when the object moves to the second position.

Description

Flexible display device and its display method {FLEXIBLE DISPLAY APPARATUS AND DISPLAY METHOD THEREOF}

The present invention relates to a flexible display device and a display method thereof, and more particularly, to a flexible display device and a display method having a display unit that can be modified in shape.

With the development of electronic technology, various types of display devices have been developed. In particular, display devices such as TVs, PCs, laptop computers, tablet PCs, mobile phones, and MP3 players have a high penetration rate to be used in most homes.

Recently, efforts have been made to develop a display device in a newer form in order to meet the needs of users who desire new and diverse functions. That is what is called the next-generation display.

An example of a next-generation display device is a flexible display device. The flexible display device means a display device having characteristics that can be deformed like paper.

The flexible display device can be used for various purposes because the user can deform the shape by bending by applying a force. For example, it may be implemented as a portable device such as a mobile phone or a tablet PC, an electronic picture frame, a PDA, or an MP3 player.

On the other hand, the flexible display device has a characteristic that it is flexible, unlike the conventional display device. In view of this, a search for a method for applying a bending gesture as an input means of a flexible display device is required.

The present invention is in accordance with the above-described needs, and an object of the present invention is to provide a flexible display device and a display method thereof that can utilize a bending gesture as an input means.

Flexible display device according to an embodiment of the present invention for achieving the above object, while the display unit for displaying an object in a first position on the screen, the sensing unit for sensing the bending of the display unit and the bending is maintained, And a control unit for moving the location of the object based on the location on the screen where the bending is detected, and the control unit performs a function mapped to the second location when the object is moved to a preset second location on the screen. Control it as much as possible.

In this case, the screen is a lock screen, and when the object on the lock screen moves to a second position preset by the bending, the controller may perform a lock release operation to release the lock state.

In addition, when the object on the lock screen moves to a preset second position, the controller may perform the unlocking operation and automatically perform an operation mapped to the second position.

The controller may display a main screen when the lock state is released, and execute a function corresponding to the menu when one menu is selected on the main screen to display an execution result screen.

In this case, when the display unit is bent in the first direction while the execution result screen is being displayed, the controller aligns and displays at least one object included in the execution result screen in an edge area of the execution result screen. can do.

In addition, the control unit may adjust the size and shape of the at least one object to align the edge region.

In addition, when the display unit is bent in a second direction opposite to the first direction while the at least one object is aligned and displayed in the edge area, the controller returns the at least one object to its original state. Can be displayed.

Meanwhile, the screen is a phone connection screen that further includes a call connection menu and a call rejection menu, and the control unit controls the display unit to display the phone connection screen when a call request is received, and When an object moves to a location where the call connection menu is displayed by the bending, a call connection operation may be performed, and when the object moves to a location where the call rejection menu is displayed, a call rejection operation may be performed.

In addition, the control unit may adjust the moving distance of the object differently according to the bending degree of the display unit.

Meanwhile, a display method of a flexible display device according to an embodiment of the present invention includes displaying an object at a first position on a screen of a display unit, sensing a bending of the display unit, and while the bending is maintained, the bending And moving the location of the object based on the detected location on the screen, and performing a function mapped to the second location when the object is moved to a preset second location on the screen.

In this case, the screen is a lock screen, and the step of performing the function is performed when the object on the lock screen moves to a preset second position by the bending, and performs an unlock operation to release the lock state. can do.

In addition, in the step of performing the function, when an object on the lock screen moves to a preset second location, the unlocking operation may be performed, and an operation mapped to the second location may be automatically performed.

Then, in the display method according to the present embodiment, when the locked state is released, displaying a main screen, and when a menu is selected on the main screen, executing a function corresponding to the menu to display an execution result screen It may further include.

In this case, in the display method according to the present exemplary embodiment, when the display unit is bent in a first direction while the execution result screen is being displayed, at least one object included in the execution result screen is displayed at the edge of the execution result screen. The method may further include arranging and displaying the area.

Also, the display method according to the present embodiment may further include adjusting at least one of the size and shape of the at least one object to be aligned with the edge area.

In addition, in the display method according to the present exemplary embodiment, when the display unit is bent in a second direction opposite to the first direction while the at least one object is aligned and displayed in the edge region, the at least one object is displayed. It may further include the step of returning to the original state to display.

On the other hand, the screen is a call connection screen further comprising a call connection menu and a call rejection menu, and in the step of performing the function, the object on the phone connection screen is displayed by the bending to the location where the call connection menu is displayed. When moving, a call connection operation may be performed, and when the object moves to a location where the call rejection menu is displayed, a call rejection operation may be performed.

In addition, in the step of performing the function, the moving distance of the object may be adjusted differently according to the bending degree of the display unit.

On the other hand, the flexible display device according to an embodiment of the present invention, a display unit for displaying an object at a predetermined position on the screen, a sensing unit for sensing the bending of the display unit; And a control unit for moving the position of the object based on the position at which the bending is detected while the bending is maintained, and the control unit controls to perform a function corresponding to the movement of the object.

According to various embodiments of the present invention as described above, bending of the display unit may be used as an input means for executing various functions. Accordingly, user convenience may be increased.

1 is a block diagram showing the configuration of a flexible display device according to an embodiment of the present invention;
2 is a view for explaining the basic structure of a display unit constituting a flexible display device according to an embodiment of the present invention;
3 to 5 are diagrams for explaining an example of a method for a flexible display device to detect bending according to an embodiment of the present invention,
6 is a view for explaining a method for detecting a bending direction using a bend sensor according to an embodiment of the present invention,
7 is a view for explaining a bending direction detection method according to another embodiment of the present invention,
8 to 12 are diagrams for explaining an example of moving an object on the screen according to bending according to an embodiment of the present invention,
11 and 12 are views for explaining an example in which the moving direction of the object is changed according to the bending state of the display unit in one embodiment of the present invention,
13 is a view for explaining a distance that an object moves according to a bending holding time in an embodiment of the present invention;
14 is a view for explaining the distance the object is moved according to the bending degree in an embodiment of the present invention,
15 is a view for explaining an example in which the lock screen is released by moving the object according to an embodiment of the present invention;
16 and 17 are diagrams for explaining an example of performing an operation mapped to a moved position by moving an object according to an embodiment of the present invention;
18 is a diagram for explaining an example of performing an operation mapped to a moved position by moving an object according to an embodiment of the present invention;
19 to 21 are diagrams for explaining a method of displaying an object on various screens according to an embodiment of the present invention,
22 and 23 are views for explaining a method for changing an object in an embodiment of the present invention,
24 to 27 are diagrams for explaining an example of various ways that a flexible display device may be applied to perform an operation according to an embodiment of the present invention,
28 and 29 are diagrams for explaining a method of displaying a screen using bending of a display unit according to an embodiment of the present invention,
30 is a view for explaining an example of changing the display state of an object according to a bending direction according to an embodiment of the present invention;
31 is a block diagram illustrating a detailed configuration of a flexible display device according to an embodiment of the present invention,
32 is a view for explaining the detailed configuration of the control unit according to an embodiment of the present invention,
33 is a diagram showing a software structure of a storage unit for supporting an operation of a control unit according to various embodiments of the present invention;
34 is a view showing an example of a form of a flexible display device embedded in a main body according to an embodiment of the present invention;
35 is a view showing a flexible display device in a form in which a power supply unit can be detached according to an embodiment of the present invention; and
36 is a flowchart illustrating a display method of a flexible display device according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings.

1 is a block diagram showing the configuration of a flexible display device according to an embodiment of the present invention. According to FIG. 1, the flexible display device 100 includes a display unit 110, a sensing unit 120, and a control unit 130.

The flexible display device 100 of FIG. 1 is portable such as a mobile phone such as a smart phone, a PMP, a PDA, a tablet PC, and navigation, and may be implemented as various types of devices having a display function. In addition, the display device 100 may be implemented as a portable device, as well as a stationary device such as a monitor, TV, or kiosk.

The display unit 110 displays various screens. Specifically, the display 110 may display a playback screen or an execution screen of content such as an image, video, text, music, etc., and display various UI (User Interface) screens. For example, when various contents are played through various applications installed on the flexible display apparatus 100, the display 110 may display a content playback screen provided by the corresponding application.

Meanwhile, the flexible display device 100 including the display unit 110 has a bendable characteristic. Accordingly, the flexible display device 100 and the display unit 110 have a flexible structure and must be made of a flexible material. Hereinafter, a detailed configuration of the display 110 will be described with reference to FIG. 2.

2 is a view for explaining the basic structure of a display unit constituting a flexible display device according to an embodiment of the present invention. According to FIG. 2, the display 110 includes a substrate 111, a driver 112, a display panel 113, and a protective layer 114.

The flexible display device refers to a device that can be bent, bent, folded, or rolled like paper while maintaining the display characteristics of an existing flat panel display device. Therefore, the flexible display device must be manufactured on a flexible substrate.

Specifically, the substrate 111 may be embodied as a plastic substrate (eg, a polymer film) that can be deformed by external pressure.

The plastic substrate has a structure in which a barrier coating is treated on both sides of a base film. In the case of the base material, it may be implemented with various resins such as polyimide (PI), polycarbonite (PC), polyethyleneterephtalate (PET), polyethersulfone (PES), polythylenenaphthalate (PEN), and fiber reinforced plastic (FRP). In addition, the barrier coating is performed on surfaces facing each other in the base material, and an organic film or an inorganic film may be used to maintain flexibility.

Meanwhile, in addition to the plastic substrate, the substrate 111 may be made of a material having flexible characteristics such as a thin glass or a metal foil.

The driving unit 112 functions to drive the display panel 113. Specifically, the driving unit 112 applies a driving voltage to a plurality of pixels constituting the display panel 113, and may be implemented by an a-si TFT, a low temperature poly silicon (LTPS) TFT, an organic TFT (OTFT), or the like. have. The driving unit 112 may be implemented in various forms according to the implementation form of the display panel 113. For example, the display panel 113 may be formed of an organic light emitting body made of a plurality of pixel cells and an electrode layer covering both surfaces of the organic light emitting body. In this case, the driver 112 may include a plurality of transistors corresponding to each pixel cell of the display panel 113. The controller 130 applies an electric signal to the gate of each transistor to emit pixel cells connected to the transistor. Accordingly, an image may be displayed.

Alternatively, the display panel 113 may be embodied as an EL, an electrophoretic display (EPD), an electrochromic display (ECD), a liquid crystal disply (LCD), an AMLCD, or a plasma display panel (PDP) in addition to the organic light emitting diode. However, in the case of LCD, a separate backlight is required in that it cannot emit light by itself. In the case of an LCD in which no backlight is used, ambient light is used. Therefore, in order to use the LCD display panel 113 without backlight, conditions such as an outdoor environment with a large amount of light must be satisfied.

The protective layer 114 functions to protect the display panel 113. For example, materials such as ZrO, CeO2, and Th O2 may be used for the protective layer 114. The protective layer 114 may be made of a transparent film to cover the entire surface of the display panel 113.

Meanwhile, as illustrated in FIG. 2, the display 110 may be implemented with electronic paper. Electronic paper is a display that applies the characteristics of general ink to paper, and the point of using reflected light is different from a general flat panel display. On the other hand, the electronic paper can use a twist ball or electrophoresis using a capsule to change the picture or text.

On the other hand, when the display 110 is made of a component made of a transparent material, it can be bent and can also be implemented as a display device having transparent properties. For example, when the substrate 111 is made of a polymer material such as plastic having a transparent property, and the driving unit 112 is made of a transparent transistor, and the display panel 113 is made of a transparent organic light emitting layer and a transparent electrode, transparency is achieved. Can have

The transparent transistor refers to a transistor manufactured by replacing the opaque silicon of a conventional thin film transistor with a transparent material such as transparent zinc oxide or titanium oxide. In addition, new materials such as indium tin oxide (ITO) or graphene may be used as the transparent electrode. Graphene refers to a material having transparent properties with a carbon atom connected to each other to form a honeycomb plane. In addition, the transparent organic light emitting layer can also be implemented with various materials.

As described above, the display 110 may be bent by a force acting from the outside to change its shape. Hereinafter, a method of sensing the bending by the flexible display apparatus 100 will be described with reference to FIGS. 3 to 5.

3 to 5 are diagrams for explaining an example of a method for a flexible display device to detect bending according to an embodiment of the present invention.

The sensing unit 120 detects bending of the display unit 110. Here, bending means a state in which the display 110 is bent.

To this end, the sensing unit 120 may include a bend sensor disposed on one surface, such as a front surface or a rear surface of the display unit 110, or a bend sensor disposed on both surfaces.

Here, the bend sensor means a sensor that can be bent by itself and has a characteristic in which a resistance value varies depending on the degree of bending. The bend sensor may be implemented in various forms such as an optical fiber bend sensor, a pressure sensor, and a strain gauge.

3 is a view for explaining an arrangement form of a bend sensor according to an embodiment of the present invention.

3 (a) shows an example in which a plurality of bar-shaped bend sensors are arranged on the display unit 110 in the horizontal and vertical directions to form a grid. Specifically, the bend sensor includes bend sensors 11-1 to 11-5 arranged in the first direction and bend sensors 12-1 to 12-5 arranged in the second direction perpendicular to the first direction. Each bend sensor may be spaced apart from each other at regular intervals.

On the other hand, in FIG. 3 (a), although five bend sensors 11-1 to 11-5 and 12-1 to 12-5 are arranged in each of the horizontal and vertical directions, this is only an example, and the bend sensor Of course, the number of the display unit 110 may be changed according to the size or the like. In this way, since the bend sensor is disposed in the horizontal and vertical directions to detect bending made in the entire area of the display unit 110, a device having a flexible characteristic partly or only need to detect bending for a part In the case of, the bend sensor may be disposed only in the corresponding part.

In addition, as shown in FIG. 3 (a), a bend sensor may be built in the front of the display 110, but this is only an example, and the bend sensor may be built in the back of the display 110, or on both sides. It may be embedded.

In addition, the shape, number, and placement of the bend sensor may be variously changed. For example, one bend sensor or a plurality of bend sensors may be coupled to the display 110. Here, one bend sensor may be to sense one bending data, but one bend sensor may have a plurality of sensing channels to sense a plurality of bending data.

FIG. 3 (b) shows an example in which one bend sensor is disposed on one surface of the display unit 110. 3 (b), the bend sensor 21 may be disposed in a circular shape on the front surface of the display 110. However, this is only an example, and may be disposed on the rear surface of the display unit 110, and may be implemented in the form of a closed curve forming various polygons such as a square.

3 (c) shows an embodiment in which two bend sensors are arranged to cross each other. According to FIG. 3 (c), the first bend sensor 22 is disposed in a first diagonal direction on the first surface of the display 110, and the second bend sensor 23 is in a second diagonal direction on the second surface. Is placed as

Meanwhile, in the various embodiments described above, a case in which line-type bend sensors are used is illustrated, but the sensing unit 120 may also detect bending using a plurality of strain gauges.

3 (d) shows a diagram in which a plurality of strain gauges are disposed on the display unit 110. The strain gauge is a metal or semiconductor whose resistance is greatly changed according to the magnitude of the applied force, and senses the deformation of the surface of the measurement object according to the change in the resistance value. In general, a material such as metal has a characteristic in that the resistance value increases when the length increases according to the force from the outside, and the resistance value decreases when the length decreases. Accordingly, when the resistance value change is sensed, bending of the display 110 may be sensed.

On the other hand, according to Figure 3 (d), a plurality of strain gauges (30-1,30-2, ..., 30-n, ..., 30-m) in the edge area of the display unit 110, ...) is deployed. The number of strain gauges may vary depending on the size, shape, preset bending detection, and resolution of the display 110.

Hereinafter, a method of sensing the bending of the display unit 110 using the bend sensor or strain gauge in which the sensing unit 120 is disposed in a grid shape will be described.

The bend sensor may be implemented in the form of an electric resistance type sensor using electrical resistance or a micro fiber optic sensor using a strain rate of an optical fiber. Hereinafter, for convenience of description, it is assumed that the bend sensor is implemented as an electrical resistance type sensor. do.

4 is a diagram for describing a method of sensing bending in a flexible display device in an embodiment of the present invention.

When the display 110 is bent, the bend sensors disposed on one or both surfaces of the display 110 are also bent, and the bend sensor outputs a resistance value corresponding to the strength of the applied tension.

That is, the sensing unit 120 detects the resistance value of the bend sensor using the magnitude of the voltage applied to the bend sensor or the magnitude of the current flowing through the bend sensor, and displays the 110 using the magnitude of the sensed resistance value. Can detect bending.

For example, when the display 110 is bent in the horizontal direction as shown in FIG. 4 (a), the bend sensors 41-1 to 41-5 embedded in the front of the display 110 are also bent and applied. The resistance value according to the magnitude of the tension is output.

In this case, the strength of the tension increases in proportion to the degree of bending. For example, when the display 110 is bent in the form as shown in FIG. 4 (a), the bending degree of the central region is greatest. Accordingly, the a3 point of the bend sensor 41-1, the b3 point of the bend sensor 41-2, the c3 point of the bend sensor 41-3, the d3 point of the bend sensor 41-4, and the bend are the central regions. The greatest tension acts on the e3 point of the sensor 41-5, and accordingly, each bend sensor 41-1 to 41-5 is the most at the a3 point, b3 point, c3 point, d3 point and e3 point. It has a large resistance value.

On the other hand, the degree of bending becomes weaker toward the outside. Accordingly, the bend sensor 41-1 has a resistance value smaller than the a3 point toward the left and right directions based on the a3 point, and the a1 point that is not bent and its left area, the a5 point and its right area Silver has the same resistance value as before bending. The same applies to other bend sensors 41-2 to 41-5.

Meanwhile, the controller 130 may determine the bending of the display 110 based on the detection result of the detector 120. Specifically, the controller 130 based on the relationship between the points where the change in the resistance value of the bend sensor is detected, the location of the bending region, the size of the bending region, the number of bending regions, the size of the bending line, the location of the bending line, The number of bending lines, the direction of the bending lines, and the number of bendings may be determined.

The bending area refers to an area in which the display unit 110 is bent. Since the bend sensor is bent together by bending, the bending area may be defined as any point where a bend sensor that outputs a resistance value different from the original state is disposed. Meanwhile, a region in which the resistance value is not changed may be defined as a flat region in which bending is not performed.

Accordingly, if the distance between the points where the resistance value change is detected is within a preset distance, the control unit 130 determines the points outputting the resistance value as one bending area. On the other hand, the control unit 130 may be divided into different bending regions based on these points, if a point in which a distance between the resistance value change is detected is spaced over a predetermined distance.

As described above, in Fig. 4 (a), from point a1 to point a5 of the bend sensor 41-1, from point b1 to point b5 of the bend sensor 41-2, of the bend sensor 41-3 From the point c1 to the point c5, from the point d1 to the point d5 of the bend sensor 41-4, from the point e1 to the point e5 of the bend sensor 41-5, it has a different resistance value from the original state. In this case, the points where the resistance value change is detected in each bend sensor 41-1 to 41-5 are positioned within a predetermined distance from each other and are continuously arranged.

Accordingly, the control unit 130 is a point from a1 to a5 in the bend sensor 41-1, a point from b1 to b5 in the bend sensor 41-2, and a point from c1 to c5 in the bend sensor 41-3. Up to, the area 42 including all the points e1 to e5 in the bend sensor 41-4 from the point d1 to the point d5 and the point e1 to e5 in the bend sensor 41-5 is determined as one bending area.

Meanwhile, the bending area may include a bending line. The bending line may be defined as a line connecting points where the largest resistance value is detected in each bending area. Accordingly, the controller 130 may determine a line connecting the points where the largest resistance value is detected in the bending area as a bending line.

For example, in FIG. 4 (a), the a3 point outputting the largest resistance value from the bending sensor 41-1, the b3 point outputting the largest resistance value from the bend sensor 41-2, and the bend sensor 41 The c3 point outputting the largest resistance value at -3), the d3 point outputting the largest resistance value at the bend sensor 41-4, and the e3 point outputting the largest resistance value at the bend sensor 41-5. The connecting line 43 may be defined as a bending line. 4 (a) shows a state in which a bending line is formed in a vertical direction in a central region of the display surface.

Meanwhile, FIG. 4 (a) shows only a bend sensor disposed in a horizontal direction among grid-shaped bend sensors in that the display 110 is for explaining a case in which the display part is bent in the horizontal direction. That is, the sensing unit 120 may detect that the display 110 is bent in the vertical direction using the same method as when bending in the horizontal direction through the bend sensor disposed in the vertical direction. In addition, when the display 110 is bent in a diagonal direction, tension is applied to all of the bend sensors arranged in the horizontal and vertical directions, so the sensing unit 120 is applied to the output values of the bend sensors arranged in the horizontal and vertical directions. Based on this, it is possible to detect that the display 110 is bent in a diagonal direction.

On the other hand, the sensing unit 120 may sense bending of the display unit 110 using a strain gauge.

Specifically, when the display unit 110 is bent, a force acts on the strain gauge disposed in the edge region of the display unit 110, and the strain gauge outputs different resistance values according to the magnitude of the applied force. . Accordingly, the controller 130 based on the output value of the strain gauge, the position of the bending area, the size of the bending area, the number of bending areas, the size of the bending lines, the position of the bending lines, the number of bending lines, the direction of the bending lines, The number of bendings, etc. can be determined.

For example, as shown in FIG. 4 (b), when the display 110 is bent in the horizontal direction, the strain gauge 51 disposed in the bent region among the plurality of strain gauges built in the front of the display 110 Force is applied to -p, ..., 51-p + 5,51-r, ..., 51-r + 5), and a resistance value corresponding to the magnitude of the applied force is output. Accordingly, the controller 130 may determine the region 52 including all the points where the strain gauges outputting a resistance value different from the original state are located as one bending region.

In addition, the controller 130 may determine a line connecting at least two strain gauges that output a resistance value having a large difference from the original state in the bending area as a bending line. That is, according to the bending of the display 110, the control unit 130 connects at least two strain gauges to which the greatest force is applied, or a line connecting the at least two strain gauges to which the greatest force is applied and the next greatest force. Judging by the bending line.

For example, as shown in FIG. 4 (b), the display unit 110 is bent in the horizontal direction, so that the first strain gauge 51-p + 2 and the second outputting a resistance value having a large difference from the original state. The line connecting the strain gauges 51-r + 3 may be determined as a bending line.

Meanwhile, in the above-described embodiment, it is illustrated that the strain gauges 51-1, 51-2, ... are built in the front surface of the flexible device 100. As described above, the strain gauges 51-1, 51-2, ... are disposed on the front surface of the flexible device 100 to detect bending when the flexible device 100 is bent in the Z + direction. .

Here, the bending direction of the flexible device 100 may be defined as a direction in which the convex region of the flexible device 100 is directed. That is, assuming that the front surface of the flexible device 100 is an xy plane in two dimensions, when the convex area of the bent flexible device 100 faces the z-direction of the z axis perpendicular to the xy plane, the flexible device 100 may The bending direction becomes the Z + direction, and when the convex area of the bent flexible device 100 faces the z + direction of the z-axis, the bending direction of the flexible device 100 may be the Z- direction.

Therefore, in order to sense that the flexible device 100 is bent in the Z-direction, a strain gauge may be built into the rear surface of the flexible device 100. However, this is only an example, and the strain gauge may be implemented to sense bending in the Z + direction and the Z- direction by being disposed on one surface of the flexible device 100.

Meanwhile, the sensing unit 120 may sense a degree of bending of the display unit 110, that is, a bending angle. Here, the bending angle may mean an angle formed when the display 110 is in a flat state and a bent state by bending.

5 is a diagram for explaining a method of determining a bending angle of a display unit by a flexible display device according to an embodiment of the present invention.

The controller 130 may determine the bending angle of the display 110 based on the detection result of the detector 120. To this end, the flexible display apparatus 100 may pre-store resistance values output from the bending line for each bending angle of the display 110. Accordingly, when the display 110 is bent, the controller 130 compares the magnitude of the resistance value output from the bend sensor or strain gauge located on the bending line with a previously stored resistance value, and the bending value matches the detected resistance value. You can judge the angle.

For example, as shown in FIG. 5, when the display 110 is bent, the largest resistance value is output at the bend sensor point a4 located in the bending line. At this time, the flexible display apparatus 100 determines the bending angle θ that matches the resistance value output at the point a4 by using pre-stored resistors for each bending angle.

Meanwhile, as described above, the bending direction of the flexible device 100 may be divided into a Z + direction or a Z- direction, and the sensing unit 120 may sense a bending direction of the flexible device 100 in various ways. . 6 and 7 for more detailed description.

6 is a view for explaining a method for detecting a bending direction using a bend sensor according to an embodiment of the present invention.

The controller 130 may determine a bending direction of the display 110 based on the detection result of the detector 120. To this end, the sensing unit 120 may include bend sensors arranged in various ways.

For example, as shown in FIG. 6 (a), the sensing unit 120 may include two bend sensors 71 and 72 superimposed on one side of the display unit 110. In this case, when bending is performed in one direction, resistance values of the upper bend sensor 71 and the lower bend sensor 72 are differently detected at a point where bending is performed. Accordingly, the control unit 130 may compare the resistance values of the two bend sensors 71 and 72 at the same point to determine the bending direction.

Specifically, when the display 110 is bent in the Z + direction, as shown in FIG. 6 (b), at a point A corresponding to the bending line, a tension of greater intensity is applied to the lower bend sensor 72 than the upper bend sensor 71. This is applied. Conversely, when the display 110 is bent in the Z- direction, a tension of greater intensity is applied from the upper bend sensor 71 to the lower bend sensor 72.

Therefore, the control unit 130 may determine the bending direction by comparing the resistance values corresponding to point A in the two bend sensors 71 and 72. That is, when the resistance value output from the lower bend sensor is greater than the resistance value output from the upper bend sensor at the same point among the two overlapped bend sensors, the controller 130 may determine that the bending is performed in the Z + direction. Then, the control unit 130 may determine that the resistance value output from the upper bend sensor is greater than the resistance value output from the lower bend sensor at the same point among the two overlapped bend sensors, so that bending is performed in the Z- direction.

Meanwhile, in FIGS. 6 (a) and 6 (b), the two bend sensors are shown overlapping each other on one side of the display 110, but as shown in FIG. 9 (c), the sensing unit 120 displays It may also include a bend sensor disposed on both sides of the unit 110.

6 (c) shows a state in which two bend sensors 73 and 74 are disposed on both sides of the display 110.

Accordingly, when the display unit 110 is bent in the Z + direction, the bend sensor disposed on the first surface among the two sides of the display unit 110 receives a compressive force, while the bend sensor disposed on the second surface receives tension. Will receive. On the other hand, when bending in the Z-direction, the bend sensor disposed on the second surface receives a compressive force, while the bend sensor disposed on the first surface receives a tension. As described above, values sensed by the two bend sensors are detected differently according to the bending direction, and the controller 130 can distinguish the bending direction according to the detection characteristic of the value.

Meanwhile, in FIGS. 6 (a) to 6 (c), it has been described that the bending direction is sensed using two bend sensors, but the bending direction can be distinguished only by the strain gauges disposed on one or both sides of the display 110. Of course it can.

7 is a view for explaining a bending direction detection method according to another embodiment of the present invention. Specifically, FIGS. 7 (a) and 7 (b) are diagrams for explaining a method of sensing a bending direction using an acceleration sensor as an example.

The sensing unit 120 may include a plurality of acceleration sensors disposed in an edge region of the display unit 110. Then, the control unit 130 may determine the bending direction of the display unit 110 based on the detection result of the detection unit 120.

The acceleration sensor is a sensor that can measure acceleration and the direction of acceleration when motion occurs. Specifically, the acceleration sensor outputs a sensing value corresponding to the gravitational acceleration that changes according to the slope of the device to which the sensor is attached.

Therefore, as shown in FIG. 7 (a), when the acceleration sensors 81-1 and 81-2 are disposed on both edge regions of the display unit 110, the acceleration sensors 81 when the display unit 110 is bent, respectively. -1, 81-2) The output value sensed at each is changed. The control unit 130 calculates a pitch angle and a roll angle using output values sensed by the acceleration sensors 81-1 and 81-2, respectively. Accordingly, the controller 130 may determine the bending direction based on the degree of change in the pitch angle and the roll angle detected by each of the acceleration sensors 81-1 and 81-2.

On the other hand, in FIG. 7 (a), the display unit 110 shows the state in which the acceleration sensors 71-1 and 71-2 are arranged at both edges in the horizontal direction with respect to the front surface. It can also be arranged in the vertical direction. In this case, when the display 110 is bent in the vertical direction, the control unit 130 may detect the bending direction according to the measured values of each of the vertical acceleration sensors 81-3 and 81-4.

Meanwhile, FIGS. 7 (a) and 7 (b) show the state in which the acceleration sensors are disposed on the left and right edges or the upper and lower edges of the display 110, but the acceleration sensors may be disposed on both the upper, lower, left, and right edges, It can also be arranged in the corner area.

Meanwhile, in addition to the above-described acceleration sensor, a bending direction may be detected using a gyro sensor or a geomagnetic sensor. The gyro sensor is a sensor that detects an angular velocity by measuring the force of Coriolis acting in the direction of the velocity when a rotational movement occurs. According to the measurement value of the gyro sensor, it is possible to detect in which direction it is rotated, so it is possible to detect the bending direction. The geomagnetic sensor is a sensor that senses azimuth using a 2-axis or 3-axis fluxgate. When implemented as a geomagnetic sensor, the geomagnetic sensor disposed at each edge portion of the flexible display apparatus 100 is moved when the edge portion is bent, and outputs an electrical signal corresponding to the resulting geomagnetic change. The control unit 130 may calculate a yaw angle using a value output from the geomagnetic sensor. Accordingly, various bending characteristics such as a bending area and a bending direction may be determined according to the calculated yaw angle change.

As described above, the controller 130 may determine the bending of the display 110 based on the detection result of the detector 120. The above-described configuration and sensing method of the sensor may be individually applied to the flexible display device 100 or may be applied in combination with each other.

In addition, in the above-described embodiment, the display 110 is described as being bent, but since the display 110 is bent together with the flexible display apparatus 100, detecting the bending of the display 110 is not possible. Of course, it can be seen as detecting the bending of 100). That is, a configuration for sensing bending may be provided in the flexible display apparatus 100, and the controller 130 may determine bending of the flexible display apparatus 100 based on the detection result.

Meanwhile, the sensing unit 120 may also detect an operation in which the user touches the screen of the display unit 110. In this case, the sensing unit 120 may include a pressure-sensitive or capacitive touch sensor, and the control unit 130 is a point where a user touches the display unit 110 based on an electric signal transmitted from the sensing unit 120 Can determine the coordinates of

The controller 130 controls the overall operation of the flexible display device 100. In particular, the controller 130 may determine the bending of the display 110 based on the detection result of the detector 120. Specifically, the controller 130 uses the resistance value output from the bend sensor or the strain gauge to determine whether the display 110 is bent, the location of the bending region, the location of the bending region, the size of the bending region, the number of bending regions, The size of the bending line, the location of the bending line, the number of bending lines, the bending direction, the bending angle, the number of bending, and the like can be determined. In this regard, in the fact that it has been described with reference to FIGS. 3 to 7, detailed overlapping descriptions will be omitted.

Meanwhile, the display 110 may display the object at a predetermined location on the screen. Here, a predetermined position at which the object is displayed may be set at the time of manufacture, and may be set and changed by a user. For example, the user may set and change the position of the object displayed on the screen through a separate button (eg, an object position adjustment button) or a separate menu displayed on the flexible display device 100.

Accordingly, the display 110 may display the object at the first location on the screen. Here, the object is a graphic element having various shapes such as a circle or a polygon, and the shape, size, and displayed position of the object may be set and changed by the user.

The controller 130 moves the position of the object based on the position on the screen where bending is sensed while bending is maintained.

Specifically, the controller 130 may move the object to an area positioned at a relatively low point relative to the Z axis, considering the bending area and the bending direction on the screen. Here, the area where the bending is performed may be an area having a predetermined size including a bending line.

At this time, the controller 130 may determine the moving direction of the object in consideration of the bending line. That is, the controller 130 may move the object along the vertical line of the bending line, to an area located at a relatively low point relative to the Z axis.

For more specific description, reference is made to FIGS. 8 to 12.

8 to 12 are diagrams for explaining an example of moving an object on a screen according to bending according to an embodiment of the present invention.

8, it is assumed that the left side of the display 110 is bent in the Z + direction, and the object 220 is displayed on the left side of the bending area on the screen 210. In this case, the controller 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction in which bending is performed based on the object. Accordingly, the object 220 may be moved in the right direction of the display 110. At this time, the object 220 may be moved in the right direction of the display 110 along the line perpendicular to the bending line 230.

On the other hand, although not shown in FIG. 8, it is assumed that the left side of the display 110 is bent in the Z + direction, and the object 220 is displayed on the right side of the bending area on the screen 210. In this case, the controller 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction opposite to a bending area based on the object. Accordingly, the object 220 may be moved in the right direction of the display 110. At this time, the object 220 may be moved in the right direction of the display 110 along the line perpendicular to the bending line 230.

In addition, it is assumed that the right side of the display 110 is bent in the Z + direction, and the object 220 is displayed on the right side of the bending area on the screen 210. In this case, the controller 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction in which bending is performed based on the object. Accordingly, the object 220 may be moved in the left direction of the display 110. At this time, the object 220 may be moved in the left direction of the display 110 along the line perpendicular to the bending line 230.

Also, it is assumed that the right side of the display 110 is bent in the Z + direction, and the object 220 is displayed on the left side of the bending area on the screen 210. In this case, the controller 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction opposite to a bending area based on the object. Accordingly, the object 220 may be moved in the left direction of the display 110. At this time, the object 220 may be moved in the left direction of the display 110 along the line perpendicular to the bending line 230.

Meanwhile, as shown in FIG. 9, it is assumed that the left side of the display 110 is bent in the Z-direction, and the object 220 is displayed on the left side of the bending area on the screen 210. In this case, the control unit 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction opposite to a bending area based on the object. Accordingly, the object 220 may be moved in the left direction of the display 110. At this time, the object 220 may be moved in the left direction of the display 110 along a line perpendicular to the bending 230.

On the other hand, although not shown in FIG. 9, it is assumed that the left side of the display 110 is bent in the Z-direction, and the object 220 is displayed on the right side of the bending area on the screen 210. In this case, the controller 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction in which bending is performed based on the object. Accordingly, the object 220 may be moved in the left direction of the display 110. At this time, the object 220 may be moved in the left direction of the display 110 along a line perpendicular to the bending 230.

Also, it is assumed that the right side of the display 110 is bent in the Z-direction, and the object 220 is displayed on the right side of the bending area on the screen 210. In this case, the control unit 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction opposite to a bending area based on the object. Accordingly, the object 220 may be moved in the right direction of the display 110. At this time, the object 220 may be moved in the right direction of the display 110 along a line perpendicular to the bending 230.

In addition, it is assumed that the right side of the display 110 is bent in the Z-direction, and the object 220 is displayed on the left side of the bending area on the screen 210. In this case, the control unit 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction in which bending is performed based on the object. Accordingly, the object 220 may be moved in the right direction of the display 110. At this time, the object 220 may be moved in the right direction of the display 110 along a line perpendicular to the bending 230.

Meanwhile, as illustrated in FIG. 10, it is assumed that the central portion of the display 110 is bent in the Z + direction, and the object 220 is displayed on the left side of the bending area on the screen 210. In this case, the control unit 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction opposite to a bending area based on the object. Accordingly, the object 220 may be moved in the left direction of the display 110. At this time, the object 220 may be moved in the left direction of the display 110 along the line perpendicular to the bending line 230.

Meanwhile, although not illustrated in FIG. 9, it is assumed that the central portion of the display 110 is bent in the Z + direction, and the object 220 is displayed on the right side of the bending area on the screen 210. In this case, the control unit 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction opposite to a bending area based on the object. Accordingly, the object 220 may be moved in the right direction of the display 110. At this time, the object 220 may be moved in the right direction of the display 110 along the line perpendicular to the bending line 230.

Also, it is assumed that the central portion of the display 110 is bent in the Z-direction, and the object 220 is displayed on the left side of the bending area on the screen 210. In this case, the control unit 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction in which bending is performed based on the object. Accordingly, the object 220 may be moved in the right direction of the display 110. At this time, the object 220 may be moved in the right direction of the display 110 along the line perpendicular to the bending line 230.

Also, it is assumed that the central portion of the display 110 is bent in the Z-direction, and the object 220 is displayed on the right side of the bending area on the screen 210. In this case, the control unit 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction in which bending is performed based on the object. Accordingly, the object 220 may be moved in the left direction of the display 110. At this time, the object 220 may be moved in the left direction of the display 110 along the line perpendicular to the bending line 230.

On the other hand, in the above-described embodiment, it has been described that the object is moved in the left or right direction of the display 110, which is because the left or right of the display 110 is bent, and the object is a bending area and a bending direction. Of course, it can be moved in various directions.

For example, it is assumed that the bottom left of the display 110 is bent in the Z + direction, and the object 220 is displayed on the left side of the bending area on the screen 210. In this case, the controller 130 may move the object to an area existing at a relatively low position with respect to the Z axis, that is, an area existing in a direction in which bending is performed based on the object. Accordingly, the object 220 may be moved in the upper right direction of the display 110. At this time, the object 220 may be moved along the line perpendicular to the bending line 230 in the upper right direction of the display 110.

In addition, the object may be moved in various directions, such as a bottom right direction, a top left direction, or a bottom left direction of the display 110 according to the bending area and the bending direction.

Meanwhile, the control unit 130 may change the moving direction of the object to correspond to the changed bending state when the bending state of the display 110 is changed while the object is moving according to the bending state of the display 110. Here, the bending state may include a location of a bending area and a bending direction.

That is, the controller 130 may determine the direction in which the moving object is located based on the changed position of the bending area, and may determine the moving direction of the object in consideration of the relative position and bending direction of the moving object. For more detailed description, reference is made to FIGS. 11 and 12.

11 and 12 are views for explaining an example in which the moving direction of the object is changed according to the bending state of the display unit in one embodiment of the present invention.

As shown in FIG. 11, the left side of the display 110 is bent in the Z + direction and the object 220 is displayed on the screen 210 on the left side of the bending area, so that the object 220 is perpendicular to the bending line 230. It is assumed that the display 110 moves to the right along a line.

At this time, when the position of the area where the bending is made is changed by bending the lower left corner of the display unit 110 in the Z + direction, the controller 130 may change the moving direction of the object 220 according to the changed position of the area where the bending is made. have. That is, the control unit 130 may move the object 220 in the opposite direction to the bending area because the moving object 220 is located on the right side of the changed bending area. Accordingly, the object 220 may be moved in the upper right direction of the display unit 110 along the vertical line of the changed bending line 240.

In addition, as illustrated in FIG. 12, when the position of the area where the bending area is changed by bending the lower left corner of the display unit 110 in the Z + direction, the control unit 130 is the right side of the area where the moving object 220 is changed. Because it is located at, it is possible to move the object 220 in the opposite direction to the bending area. Accordingly, the object 220 may be moved along the vertical line of the changed bending line 240 in the lower right direction of the display 110.

On the other hand, in the above-described example, after the left side of the display 110 is bent, the lower left or upper left of the display 110 is bent, but this is for explaining that the moving direction of the object is changed. Yes. That is, the controller 130 may change the moving direction of the object based on the location of the newly bent area in the display 110.

For example, the right side of the display 110 is bent in the Z + direction and the object 220 is displayed on the screen 210 on the left side of the bending area, so that the object 220 is perpendicular to the bending line 230. It is assumed that the display 110 moves to the left along the line. At this time, the control unit 130, the right bottom of the display unit 110 is bent in the Z + direction to change the position of the bending area, the right side of the display unit 110 along the vertical line of the changed bending line 240 It can be moved upward. In addition, the control unit 130, the upper right of the display 110 is bent in the Z + direction, when the position of the bending area is changed, the right side of the display 110 along the vertical line of the changed bending line 240 It can be moved in the lower direction.

In addition, although not shown, the controller 130 may change the moving direction of the object even when the bending direction is changed while the object is moving.

For example, the left side of the display 110 is bent in the Z + direction and the object 220 is displayed on the screen 210 on the left side of the bending area, so that the object 220 is perpendicular to the bending line 230. It is assumed that the display 110 moves to the right along the line.

At this time, when the left side of the display 110 is bent in the Z-direction, the controller 130 may change the moving direction of the object based on the changed bending direction. Specifically, when the moving object is located on the right side of the bending area, the controller 130 may move the object in the direction of the bending area based on the object. That is, the controller 130 may move the object in the left direction of the display 110 along the line perpendicular to the changed bending line 240.

Meanwhile, in the above-described embodiment, the object is described as being moved in a direction perpendicular to the bending line, but this is only an example, and the direction in which the object is moved may be variously set. For example, the controller 130 may move the object along a line having an angle formed by the bending line of 80 °, 70 °, 60 °, ..., and the like.

Meanwhile, the control unit 130 may move the object while bending is performed on the display unit 110 and may stop moving the object when the display unit 110 is flat. In this case, the control unit 130 may adjust the moving distance of the object in proportion to the bending holding time. See FIG. 13 for a more detailed description.

13 is a diagram for explaining a distance that an object moves according to a bending holding time in an embodiment of the present invention.

As shown in FIG. 13, the left side of the display 110 is bent in the Z + direction and the object 220 is displayed on the screen 210 on the left side of the bending area, so that the object 220 is perpendicular to the bending line 230. It is assumed that the display 110 moves to the right along a line.

At this time, the control unit 130 may move the object 220 as the bending holding time increases. That is, when the bending holding time t ₁ is longer than the bending holding time t ₂ , the object 221 when bending for t ₁ may be moved more than the object 222 when bending for t ₂ .

Meanwhile, the control unit 130 may adjust the moving distance of the object according to the bending degree of the display unit 110. Specifically, the control unit 130 may adjust the moving distance of the object in proportion to the bending degree. See FIG. 14 for a more detailed description.

14 is a view for explaining a distance that an object moves according to a bending degree in an embodiment of the present invention.

As illustrated in FIG. 14, the left side of the display 110 is bent in the Z + direction and the object 220 is displayed on the screen 210 on the left side of the bending area, so that the object 220 is perpendicular to the bending line 230. It is assumed that the display 110 moves to the right along a line.

At this time, the control unit 130 may move the object 220 more as the bending degree is larger. That is, assuming that the bending retention time is the same, the object 222 when the bending degree is relatively large may be moved more than the object 221 when the bending degree is small.

On the other hand, in the above-described embodiment, it has been described that the moving distance of the object varies according to the bending holding time and the bending degree, but this is only an example.

For example, the controller 130 may control the moving speed of the object according to the bending holding time. Specifically, the controller 130 may control the moving speed of the object in proportion to the bending holding time. That is, the larger the bending holding time, the faster the object can be moved.

As another example, the controller 130 may control the moving speed of the object according to the bending degree. Specifically, the control unit 130 may adjust the moving speed of the object in proportion to the bending degree. That is, the larger the bending degree, the faster the object can be moved.

Meanwhile, the controller 130 may control the moving speed of the object according to the length of the bending line. Specifically, the controller 130 may control the moving speed of the object to be proportional to the length of the bending line. For example, when the bending line intersects two adjacent sides of the display 110, the controller 130 may move the object quickly as the length of the bending line increases.

Meanwhile, the controller 130 may determine a bending area and a bending direction based on the detection result of the sensing unit 120.

For example, the controller 130 determines an area including a point where a bend sensor that outputs a resistance value different from the original state is located as a bending area, and loads the largest resistance value in the bending area. The line connecting me can be judged as a bending line. In addition, the controller 130 may determine a bending direction of the display 110 based on the resistance value of the bend sensor disposed on both sides of the display 110.

In addition, the controller 130 may determine a bending degree and a bending holding time based on the detection result of the sensing unit 120.

For example, when bending the display 110, the controller 130 may determine the degree of bending by using the magnitude of the resistance value output from the bend sensor located on the bending line. In addition, the controller 130 may determine a bending holding time using a time for the bend sensor to output a resistance value different from that of the original state.

However, this is only an example, and the control unit 130 may determine a bending area, a bending direction, a bending degree, and a bending holding time in the display unit 110 through various methods illustrated in FIGS. 3 to 7. Of course.

On the other hand, the controller 130 may control the movement of the object by combining the detection result of the bend sensor and the gravity sensor or the acceleration sensor.

Specifically, if it is determined that the gravity direction detected by the gravity sensor disposed in the edge area of the display unit 110 is changed, the controller 130 may determine the bending direction of the display unit 110 based on the changed gravity direction. have. In addition, the controller 130 may determine the bending direction of the display 110 based on the change in acceleration detected by the acceleration sensor disposed in the edge region of the display 110. Then, the controller 130 may determine an area where bending is performed based on the resistance value detected by the bend sensor, and move the object according to the determination result.

Meanwhile, when the movement of the display 110 is not detected, the controller 130 determines the bending state of the display 110 by referring to the detection result of the gravity sensor or the acceleration sensor, and the movement of the display 110 When detected, the bending state of the display 110 may be determined using only the detection result of the bend sensor. This is to prevent the value sensed by the gravity sensor or the acceleration sensor from being mistaken as being generated according to bending of the display unit 110 as the flexible display device 100 is rotated or tilted.

Meanwhile, the controller 130 may control to perform a function corresponding to the movement of the object. That is, the controller 130 may move or move the object displayed on the screen based on at least one of the location of the object displayed on the screen, the area in which the bending is performed on the screen, the bending direction, the bending degree, and the bending retention time. The distance and the moving speed may be determined and displayed while moving the object according to the determination result.

Accordingly, when the object is moved to a preset second position, the controller 130 may control the function mapped to the second position to be performed.

For example, when the screen displayed on the display 110 is a lock screen, the controller 130 performs an unlock operation to release the lock state when an object on the lock screen moves to a preset second position by bending. can do.

Specifically, if there is no user input for a preset time in the flexible display device 100, the controller 130 switches to a screen off mode to turn off the screen of the display 110. Then, the control unit 130 determines whether a user operation is input, and when a user operation is input, switches to a screen lock mode and displays a lock screen on the display unit 110. Here, the user manipulation may include pressing a specific button provided on the flexible display device 100 or touching the display 110.

Meanwhile, an object is displayed on the lock screen, and the controller 130 may release the lock state and enter the screen activation mode when the object is moved to the unlock menu according to the bending of the display 110. That is, the control unit 130 displays the main screen on the display unit 110 when the lock state is released, and when a menu is selected on the main screen, executes a function corresponding to the menu to display the execution result screen 110 Can be displayed on. Here, the main screen may be a screen including at least one of icons, widgets, and images for an application installed on the flexible display device 100.

15 is a diagram illustrating an example in which an object is moved and a lock screen is released according to an embodiment of the present invention.

15, a movable object 320 is displayed on the lock screen 310 according to bending of the display 110. In addition, although the current time and date are displayed together with the object 320 on the lock screen 310 of FIG. 15, this is only an example. That is, a widget, an image, and the like may be displayed together according to a user setting, or, of course, only a movable object may be displayed on a lock screen according to a bending direction.

When the left side of the display unit 110 displaying the object 320 is bent in the Z + direction, the object 320 moves in the right direction of the display unit 110. However, the unlock menu 330 does not move even when the display 110 is bent.

Accordingly, when the object 320 moves to the unlock menu 330, the locked state is released, and the main screen 340 including a plurality of icons 341 to 345 is displayed on the display 110. do. Here, the main screen 340 may be displayed when the object 320 is completely overlapped with the unlock menu 330 or if some of the objects are overlapped.

Meanwhile, when one of the icons 341 to 345 is selected, an application corresponding to the selected icon 344 is executed, and an application execution screen may be displayed on the display 110. For example, when the icon 344 for a photo application is selected, an image 350 stored in the flexible display device 100 may be displayed on the display 110 according to driving of the photo application.

Meanwhile, when the object on the lock screen moves to a preset second position, the controller 130 may perform an unlock operation and automatically perform an operation mapped to the second position. Here, the operation performed by moving the object to the second position may be a function of executing an application installed on the flexible display device 100 and displaying an execution result screen on the display unit 110, which is set by a user And changeable.

16 and 17 are diagrams for explaining an example in which an object is moved and performs an operation mapped to a moved location according to an embodiment of the present invention.

For example, as illustrated in FIG. 16, objects 420 and 440 may be displayed at different locations on the lock screen 410, and objects 420 and 440 may be moved according to bending of the display 110. .

Specifically, when the left side of the display 110 is bent in the Z + direction and the object 420 displayed on the left side of the lock screen 410 moves to the unlock menu 430, the lock state is released and the main screen is displayed. It may be displayed on the unit 110. Since this was described above with reference to FIG. 15, redundant description will be omitted.

Meanwhile, the object 440 displayed on the lower side of the lock screen 410 is a menu for automatically executing a preset operation with unlocking. That is, when the lower side of the display unit 110 is bent in the Z + direction, the object 440 moves in the upper direction of the display unit 400. At this time, the function execution menu 450 does not move even when the display 400 is bent.

Accordingly, when the object 440 moves to the function execution menu 450, the lock state is released, and a preset function mapped to the function execution menu 450 may be executed. That is, without the main screen being displayed, a preset function mapped to the function execution menu 450 is automatically performed and a screen on which the preset function is performed may be displayed on the display 110. For example, as illustrated in FIG. 16, when the object 440 moves to the function execution menu 450, the locked state is released and the calendar application is automatically executed, so that the calendar 460 is displayed on the display 110. Can be.

Meanwhile, in the above-described embodiment, the object for releasing the lock state and performing a specific function is illustrated as being displayed separately from the object for releasing only the lock state, but this is only an example.

That is, only one object is displayed on the lock screen, and it is a matter of course that a specific function may be automatically executed when the function execution menu is moved according to the bending of the display 110. In addition, both the operation of releasing the lock screen only with one object and the operation of releasing the lock screen and simultaneously executing a specific function may be implemented.

That is, as shown in FIG. 17, one object is displayed on the lock screen, and the main screen is displayed according to an area in which the moved object is positioned according to a bending state of the display 110 or a specific operation is automatically performed. Of course it can.

According to FIG. 17, a movable object 520 is displayed on the lock screen 510 according to bending of the display 110. In addition, an unlock menu 530 and a function execution menu 540 are displayed together on the lock screen 510, so that an operation according to a location where the object 520 moves may be performed.

That is, when the object 520 moves to the unlock menu 530 according to the bending state of the display 110, the main screen 550 including a plurality of icons 551 to 555 is displayed on the display 500. Is displayed. Meanwhile, when the object 520 moves to the function execution menu 540 according to the bending state of the display 110, the e-book application mapped to the function execution menu 540 is driven to display the e-book screen 560. It may be displayed on the unit 500.

18 is a diagram for explaining an example of performing an operation mapped to a moved position by moving an object according to an embodiment of the present invention.

The control unit 130 controls the display unit 110 to display a call connection screen when a call request is received, and performs a call connection operation when an object on the call connection screen moves to a location where a call connection menu is displayed by bending, When the object is moved to a location where the call rejection menu is displayed, a call rejection operation may be performed. Here, the phone connection screen may include an object, a call connection menu, and a call rejection menu.

That is, as shown in FIG. 18, when a call request is received from an external device, the display 110 includes a phone connection screen 610 including an object 620, a call connection menu 630, and a call rejection menu 640. Is displayed. Here, the object 620 is movable according to the bending state of the display 110, but the call connection menu 630 and the call rejection menu 640 are not moved even when the display 110 is bent.

When the object 620 moves to the call connection menu 630 according to the bending state of the display 110, the call screen 650 is displayed on the display 110 and a call connection operation for transmitting and receiving voice to and from an external device is performed. Is performed.

On the other hand, if the object 620 moves to the call rejection menu 640 according to the bending state of the display 110, the screen before the call request screen of the external device is rejected and the phone connection screen is displayed is displayed 110 Is displayed on. For example, when a call request is received in a locked state, a lock screen 660 including an object 670 and a unlock menu 680 may be displayed on the display 110 as shown in FIG. 18.

Meanwhile, the flexible display device 100 may include a communication unit (not shown) for performing a telephone connection with an external device through a mobile communication network or an Internet network. In addition, when a voice acquiring means such as a microphone (not shown) provided in the flexible display apparatus 100 collects voice or external sound and transmits it to the control unit 130, the control unit 130 signals the collected voice or external sound. It can be processed and transmitted to an external device through a communication unit (not shown). Then, when a voice signal is received from an external device, the controller 130 may process the received voice signal and output it through a voice output means such as a speaker (not shown).

Meanwhile, in the above-described embodiment, the operation performed as the object is moved may vary. That is, it may be a variety of operations that can be performed in various applications installed on the flexible display device 100, such as a call connection operation, a call rejection operation, a message display operation, and a web browser connection operation, which can be set and changed by a user.

For example, it is assumed that a message is received from an external device. Thereafter, a lock screen including an object and a function execution menu is displayed, and when the object is moved to the function execution menu according to the bending of the display 110, the controller 130 drives a message application to receive a message from an external device. The message can be displayed on the display 110.

Further, in the above-described embodiment, the object, the unlock menu and the function execution menu are described as being displayed on the lock screen, but this is only an example. That is, the controller 130 may display an object on the screen currently displayed according to a user manipulation. For more detailed description, refer to FIGS. 19 to 21.

19 to 21 are diagrams illustrating a method of displaying an object on various screens according to an embodiment of the present invention.

The controller 130 may display an object at a first location on the screen when a preset user manipulation is input. Meanwhile, the user manipulation may include pressing a specific button provided on the flexible display device 100 or touching the display 110. On the other hand, when a specific button provided on the flexible display device 100 is pressed or a touch operation on the display 110 is input, the controller 130 may display the object directly on the screen, but inquires to display the object. The UI may be displayed on the screen, and a separate user command for displaying an object may be input through the UI.

Meanwhile, when displaying the object, the controller 130 may display the unlocking menu or the function execution menu at a preset second location. At this time, the controller 130 may display a lock release menu or a function execution menu according to the screen currently displayed on the display 110.

For example, when the lock screen is displayed on the display 110, the controller 130 may display the unlock menu or the function execution menu. In addition, when the main screen or the application execution screen is displayed, the controller 130 may display a function execution menu.

In addition, when the object is moved to the unlocking menu according to the bending of the display 110, the controller 130 may release the lock state and display the main screen, and the object is executed according to the bending of the display 110 When the menu is moved, a preset application may be executed to display an application execution screen.

For example, as illustrated in FIG. 19, when a lock screen 710 is displayed on the display 110, when a preset user operation is input, an object 720 and a unlock menu 730 on the lock screen 710. ) May be displayed. Thereafter, when the left side of the display 110 is bent in the Z + direction and the object 720 is moved to the unlock menu 730, the locked state is released and the main screen 740 can be displayed.

In addition, as illustrated in FIG. 20, when the main screen 810 is displayed on the display 110, when a preset user manipulation is input, the object 820 and the function execution menu 830 may be displayed. Thereafter, when the left side of the display 110 is bent in the Z + direction and the object 820 is moved to the function execution menu 830, the function mapped to the function execution menu 830 is performed to execute the message application execution screen 840. Can be displayed.

In addition, as illustrated in FIG. 21, when an e-book application execution screen 910 is displayed on the display 110, when a preset user manipulation is input, an object 920 and a function execution menu 930 may be displayed. . Thereafter, when the left side of the display 110 is bent in the Z + direction and the object 920 is moved to the function execution menu 930, a function mapped to the function execution menu 930 may be performed. That is, the photo application may be driven to display the image 940.

On the other hand, in the above-described embodiments, when the object is moved to the unlock menu or the function execution menu by bending the display 110, it is described as disappearing on the screen, but this is only an example.

That is, the control unit 130 may remove the object, the unlock menu, and the function execution menu on the screen when a user operation for bending the display unit 110 for a preset time is not input while the object is displayed.

In addition, the control unit 130, in addition to the user operation of bending the display unit 110, when pressing a specific button provided on the flexible display device 100, or when a touch operation is input to the display unit 110, the object, unlock menu And the function execution menu may be removed from the screen. In addition, when a specific button provided on the flexible display apparatus 100 is pressed or a touch operation on the display 110 is input, the controller 130 displays a UI inquiring to remove the object on the screen, and the UI A separate user command for removing an object may be received through.

Meanwhile, the object may be displayed at a preset position on the screen with a preset size. However, the display position and size of the object may be set and changed by the user. 22 and 23 for a more detailed description.

22 and 23 are diagrams for describing a method of changing an object in an embodiment of the present invention.

When a user manipulation to change an object is input, the controller 130 displays a UI screen for changing the display position or size of the object on the display 110. Then, the controller 130 may change the display position or size of the object based on the user manipulation input on the UI screen.

For example, as illustrated in FIG. 22, when a menu for changing the display position of an object is selected on the UI screen 1010 displayed according to a user manipulation, the control unit 130 includes an object 1030 for releasing the locked state and The setting screen 1020 for setting the position of the unlocking menu 1040 may be displayed.

Thereafter, when the user changes the position of the object 1010 by dragging and dropping on the setting screen 1020, the controller 130 may set the position where the object 1010 is displayed to the changed position. Accordingly, when the lock screen 1060 is displayed, the object 1050 may be displayed at a changed location on the lock screen 1060.

On the other hand, in the above-described embodiment, it has been described that the position of the object is changed, but the control unit 130 can change the position where the unlock menu is displayed according to a user manipulation. In addition, the controller 130 may change the location in which the object and the unlock menu are displayed according to a method other than the drag and drop method. For example, after touching an object, the location of the object and the unlock menu can be changed by touching the point where the object is to be positioned.

On the other hand, as shown in FIG. 23, when a menu for changing the size of an object is selected on the UI screen 1010 displayed according to a user manipulation, the controller 130 controls the object 1010 and the lock release menu to release the lock state. A setting screen 1020 for setting the size of 1040 may be displayed. From here,

Thereafter, when the user changes the size of the unlock menu 1040 by a pinch zoom-in operation / pinch zoom-out operation on the setting screen 1020, the control unit 130 changes the size at which the unlock menu 1040 is displayed. Can be set to size. In this case, the size of the unlocking menu 1040 may be enlarged by a pinch zoom-in operation, and the size of the unlocking menu 1040 may be reduced by a pinch zoom-out operation.

Accordingly, when the lock screen 1080 is displayed, the lock release menu 1040 may be displayed on the lock screen 1060 in an enlarged size.

On the other hand, in the above-described embodiment, it has been described as changing the size of the unlock menu, but it is needless to say that the size of the object can be changed. Also, the size of the object and the unlock menu may be changed according to a method other than the pinch zoom-in operation or the pinch zoom-out operation. For example, if the user touches the unlocking menu and then bending the central area of the display unit in the Z + direction, the controller 130 may enlarge the size of the unlocking menu. On the contrary, if the user touches the unlocking menu and then bending the central area of the display unit in the Z-direction, the controller 130 can reduce the size of the unlocking menu.

Also, in the above-described embodiments, it has been described that the position and size of the object and the unlock menu are displayed, but this is only an example. That is, the controller 130 displays a setting screen for setting the position and size of the object and the unlock menu when a user operation is input while the lock screen is displayed, and when a user operation is input while the main screen is displayed. The setting screen for setting the position and size of the object and function execution menu can be displayed. Accordingly, the position and size of the object and function execution menu may also be changed in the same way as in FIGS. 22 and 23.

Meanwhile, in the above-described embodiment, when the object displayed on the screen is moved, the lock state is released or a specific function is performed, but this is only an example. That is, the controller 130 may use various methods, not the movement of the object, and refer to FIGS. 24 to 27 for more detailed description.

24 to 27 are diagrams for explaining an example of various methods that a flexible display device may be applied to perform an operation according to an embodiment of the present invention.

First, the control unit 130 may display an animation effect on the lock screen when the display 110 is bent, and release a lock state or perform a specific function when a specific condition is satisfied by the animation effect.

For example, as shown in FIG. 24, the controller 130 displays a lock screen including the sea image 1110, and while the left side of the display 110 is bent in the Z + direction, waves on the sea image 1110 ( 1120) may display animation effects moving from left to right. Accordingly, when the wave 1120 moves near the right edge of the lock screen, the controller 130 may release the lock state and display the main screen 1130 on the display 110.

In addition, as shown in FIG. 25, the controller 130 displays a lock screen including the baseball image 1210, and the baseball ball 1220 on the baseball image 1210 while the left side of the display 110 is bent in the Z + direction. ) Can display animation effects that are moved from left to right. Accordingly, when the baseball 1220 moves to the vicinity of the right edge of the lock screen, the controller 130 may release the lock state and display the main screen 1230 on the display 110.

Meanwhile, it is assumed that an image having a size larger than that of the display 110 is displayed on the lock screen. Accordingly, a portion of the image is displayed on the lock screen.

In this case, when the display 110 is bent, the controller 130 may display another area of the image. At this time, the controller 130 may determine another area of the displayed image based on the bending state of the display 110.

For example, when the left side of the display 110 is bent in the Z + direction, the control unit 130 gradually displays the left area of the image that is not currently displayed, and when the right side of the display 110 is bent in the Z + direction, the current The right area of the image that is not displayed can be gradually displayed. Then, when the upper side of the display 110 is bent in the Z + direction, the controller 130 gradually displays an upper region of the image that is not currently displayed, and when the lower side of the display 110 is bent in the Z + direction, it is not currently displayed. The lower region of the image may be gradually displayed.

Then, when the predetermined area of the image is displayed, the controller 130 may release the lock state and display the main menu screen or perform a specific function. For example, when the leftmost region, the rightmost region, the topmost region, or the bottommost region of the image is displayed, the controller 130 may release the lock state and display the main menu screen or perform a specific function.

That is, as shown in FIG. 26, when an image 1310 having a size larger than the display 110 is displayed on the lock screen, when the left side of the display 110 is bent in the Z + direction, the left area of the image is gradually displayed. . Accordingly, when the leftmost area of the image 1310 is displayed, the locked state is released and the main menu screen 1320 can be displayed.

Meanwhile, in the above-described embodiment, only an image having a size larger than that of the display 110 is described as being displayed on the lock screen, but this is only an example. That is, the control unit 130 displays an image and an object having a size larger than that of the display unit 110 together on the lock screen, releases the lock status according to the bending state of the display unit 110, and displays or selects a main menu screen. Can perform a function.

Specifically, the controller 130 may control the display 110 to move the object according to the bending of the display 110 and to gradually display other areas of the image according to the moving direction of the object. That is, when the object is moved according to bending of the display 110, the controller 130 may gradually display an area existing in the moving direction of the object based on the currently displayed area of the entire image of the image.

For example, when the left side of the display 110 is bent in the Z + direction and the object moves in the right direction of the display 110, the controller 130 gradually displays the left area of the image that is not currently displayed, When the right side of the display 110 is bent in the Z + direction and the object moves in the left direction of the display 110, the right region of the image that is not currently displayed may be gradually displayed. Then, when the upper side of the display 110 is bent in the Z + direction and the object moves in the lower direction of the display 110, the controller 130 gradually displays an upper region of the image that is not currently displayed, and the display unit When the lower side of the 110 is bent in the Z + direction and the object moves in the upper direction of the display 110, the lower region of the image that is not currently displayed may be gradually displayed.

Then, when the object moves to a predetermined position, the controller 130 may release the lock state to display the main screen or perform a specific function.

For example, as shown in FIG. 27, when a lock screen including an image 2010, an object 1420, and a lock screen menu 1430 having a larger size than the display 110 is displayed on the display 110. Suppose In this case, when the left side of the display 110 is bent in the Z + direction, the object 1420 moves in the right direction of the display 110 and the left area of the image 2010 is gradually displayed. Accordingly, when the object 1420 reaches the lock screen menu 1430, the lock state is released, and the main screen 1440 is displayed on the display 110.

28 and 29 are diagrams for explaining a method of displaying a screen using bending of a display unit according to an embodiment of the present invention.

When the display unit 110 is bent while some areas constituting a content screen having a size larger than the display unit 110 are displayed on the display unit 110, the controller 130 is mapped to the area where the bending is detected. It can be controlled to display other areas. Here, the content screen is a screen in which various contents such as images, text, and web pages are displayed, and may include, for example, an execution screen according to an application configuration.

That is, when only a partial area of the content screen is displayed on the display 110, the controller 130 may control to display an area not currently displayed on the display 110 according to bending of the display 110. have. Specifically, when bending is performed in the display 110, the controller 130 may display a content screen corresponding to the bending area among the entire areas of the content screen on the display 110.

For example, when the left side of the display 110 is bent in the Z + direction, the control unit 130 gradually displays the left area of the content screen, and when the right side of the display 110 is bent in the Z + direction, the control unit 130 is right side of the content screen. The area can be displayed gradually. Then, when the upper side of the display 110 is bent in the Z + direction, the controller 130 gradually displays the upper region of the content screen, and when the lower side of the display 110 is bent in the Z + direction, the controller 130 displays the lower region of the content screen. It can be displayed gradually.

For example, as illustrated in FIG. 28, it is assumed that a partial area 1510 of the image is displayed on the display 110. In this case, when the right side of the display 110 is bent in the Z + direction, the right area 1520 of the image that is not currently displayed may be gradually displayed.

In addition, as illustrated in FIG. 29, it is assumed that a partial area 1620 of the entire web page screen 1610 is displayed on the display 110. In this case, when the lower side of the display 110 is bent in the Z + direction, the lower area 1630 of the entire web page screen 1610 may be gradually displayed, and the upper side of the display 110 may be moved in the Z + direction. When bending, the upper region 1640 of the entire web page screen 1610 may be gradually displayed. That is, an operation such as a scroll operation of the mouse may be performed.

On the other hand, in the above-described embodiments, although the display 110 is described as bending in the Z + direction, an area not currently displayed may be displayed even when the display 110 is bent in the Z- direction rather than the Z + direction. Yes, of course.

On the other hand, the controller 130 may map the bending of the display 110 to the operation of the arrow keys to move the object or display an area of the content screen that is not currently displayed. Here, the direction key may include a 4-way key (up / down / left / right), an 8-way key (up / left / left / left / down / down / right / right), and the like.

For example, when the left side is bent relative to the center portion of the display unit 110, the control unit 130 may move the object displayed on the screen in the left direction, and the right side based on the center portion of the display unit 110 may be moved. When bending, the object displayed on the screen may be moved to the right. In addition, when the upper side is bent relative to the center of the display 110, the controller 130 may move the object displayed on the screen in the upper direction, and when the lower side is bent relative to the center of the display 110 The object displayed on the screen can be moved downward.

Accordingly, when the object reaches a lock release menu or a function execution menu, the controller 130 may release the lock state or perform a specific function.

In addition, when the left side is bent relative to the center portion of the display unit 110, the control unit 130 may gradually display the left region of the content screen that is not currently displayed, and the right side based on the center portion of the display unit 110. When the bending is performed, the right area of the content screen that is not currently displayed can be gradually displayed. In addition, when the upper side is bent relative to the central portion of the display unit 110, the control unit 130 may gradually display an upper region of the content screen that is not currently displayed, and the lower side based on the central portion of the display unit 110. When bending, the lower area of the content screen that is not currently displayed can be gradually displayed.

As such, the controller 130 may map the bending operation of the display 110 to the direction key operation, and control the object or content screen according to the location of the area where the bending is performed in the display 110.

Meanwhile, the controller 130 may execute a function corresponding to the selected menu on the main screen, and display an execution result screen. For example, when the web browser execution menu displayed on the main screen is selected, the controller 130 accesses the web server through a communication unit (not shown), receives a web page screen from the web server, and displays the web page screen on the display unit 110 can do. Also, when the photo application driving menu displayed on the main screen is selected, the controller 130 may display an image pre-stored in the flexible display device 100 on the display 110.

On the other hand, when the display 110 is bent in the first direction while the execution result screen is being displayed, the controller 130 arranges and displays at least one object included in the execution result screen in the edge area of the execution result screen. can do. Here, the object may include an image, text, an application execution screen, and the like.

In this case, the control unit 130 may adjust at least one of the size and shape of at least one object to align the edge area. In addition, when the flexible display apparatus 100 is bent in a second direction opposite to the first direction while the at least one object is aligned and displayed in the edge area, the controller 130 returns the at least one object to its original state. Can be displayed. See FIG. 31 for a more detailed description.

30 is a view for explaining an example in which the display state of an object is changed according to a bending direction according to an embodiment of the present invention.

When a specific button provided on the flexible display device 100 is pressed or a specific icon displayed on the display 110 is touched, the currently running application information display screen may be displayed on the display 110. Here, the application information display screen may include an icon corresponding to the currently running application or an execution screen for the currently running application.

When a plurality of applications are being driven simultaneously according to the multitasking function, an icon or an execution screen corresponding to each application may be displayed on the display 110. That is, as shown in FIG. 30, the application information display screen 1710 including a plurality of application execution screens 1711, 1712, and 1713 may be displayed on the display unit 1000.

On the other hand, when the right side of the display 110 is bent in the Z + direction while the application information display screen 1710 is displayed, the plurality of application execution screens 1711, 1712, and 1713 displayed on the display 110 are sized. May be reduced and moved to the left edge of the display 110 to be displayed in alignment in the vertical direction. In addition, the main screen 1720 including a plurality of icons 1721 to 1725 may be displayed on the display 110. However, this is only an example, and of course, a screen including at least one of an icon, a widget, and an image may be displayed.

Thereafter, when the left side of the display 110 is bent in the Z + direction, the main screen 1720 disappears and the application information display screen 1710 may be displayed on the display 110.

On the other hand, in the above-described embodiment, when the right side of the display unit is bent, the object displayed on the screen is moved to the left edge of the display unit and displayed, but this is only an example, and the display unit 110 is bent in an area to bend. Of course, the object displayed on the screen may be moved and displayed. That is, when the left side of the display unit is bent, the object displayed on the screen may be displayed by being moved to the leftmost edge of the display unit. In addition, even when the display unit is bent in the Z- direction rather than the Z + direction, the object may be moved to the edge region and returned to the original state.

Meanwhile, the controller 130 may control the mode of the flexible display device 100. Here, the mode may include a power off mode, a screen off mode, a lock screen mode, a security screen mode, a screen activation mode, and the like.

Specifically, when a power-off command is input, the controller 130 cuts power supplied to each component of the flexible display device 100 and turns off the screen of the display 110. In this power off mode, an operation corresponding to another user operation is not performed until a power on command is input.

On the other hand, if there is no user input for a preset time in the flexible display device 100 in the power-on state, the control unit 130 turns off the screen of the display unit 110 to switch to the screen off mode. In this case, when a specific button provided on the flexible display device 100 is pressed in the mode or a touch operation on the display 110 is input, the controller 130 may display a lock screen on the display 110.

The lock screen mode means that the lock screen is displayed. In this case, the controller 130 does not perform an operation corresponding to a user operation other than a user operation for releasing the locked state.

Meanwhile, when a user operation for releasing the lock state is input while the lock screen is displayed, the controller 130 performs a lock release operation to switch to the screen activation mode. In the screen activation mode, operations according to various user manipulations may be performed. For example, when the lock state is released, the controller 130 may display the main screen on the display 110 and drive an application corresponding to an icon input by a touch operation among icons displayed on the main screen.

In addition, the secure screen mode means a mode in which a preset password or a specific touch operation must be input to enter the screen activation mode. The controller 130 displays the UI screen for receiving a password or a touch operation when a specific button provided on the flexible display device 100 is pressed or a touch operation is input to the display 110 in the secure screen mode. ). Then, when a preset password or a specific touch operation is input on the UI screen, the controller 130 may switch to the screen activation mode.

Meanwhile, in the above-described embodiment, when a specific button is pressed or a touch operation is input, the controller 130 is described as displaying a lock screen, but this is only an example. That is, the controller 130 may display a lock screen based on the bending operation.

For example, the control unit 130 may bend a preset position of the display 110, a preset position of the display 110 may be bent by a preset angle, or a preset position of the display 110 may be determined. Bending the set number of times, the preset position of the display 110 is bent in a specific direction, the preset position of the display 110 is bent for a preset time, or the preset position of the display 110 is set When bending at a set speed, a lock screen can be displayed to switch to the lock screen mode.

31 is a block diagram illustrating a detailed configuration of a flexible display device according to an embodiment of the present invention. According to FIG. 31, the flexible display device 100 includes a display unit 110, a sensing unit 120, a control unit 130, a storage unit 140, a communication unit 150, a voice recognition unit 160, and a motion recognition unit 170, a speaker 180, an external input port (190-1 ~ 190-n), and includes a power supply (1800). Meanwhile, in describing FIG. 32, descriptions overlapping with FIG. 1 will be omitted.

The storage unit 140 includes various programs or data related to the operation of the flexible display device 100, user-configured setting information, system operating software, various application programs, and information about operations corresponding to user operation contents. Etc. can be stored.

The sensing unit 120 senses bending of the flexible display device 100 and touch manipulation input through the display unit 110. According to FIG. 31, the sensing unit 120 includes a touch sensor 121, a geomagnetic sensor 122, a gyro sensor 123, an acceleration sensor 124, a bend sensor 125, a pressure sensor 126, and a proximity sensor ( 127) and the like.

The touch sensor 121 may be implemented in a capacitive type or a pressure-sensitive type. The capacitive type is a method of calculating touch coordinates by sensing micro electricity excited by the user's body when a part of the user's body touches the surface of the display unit 110 using a dielectric coated on the surface of the display unit 110. The decompression type includes two electrode plates, and when a user touches the screen, the touch coordinates are calculated by sensing that the upper and lower plates of the touched point are in contact and current flows. As described above, the touch sensor 121 may be implemented in various forms.

The geomagnetic sensor 122 and the gyro sensor 123 are sensors for detecting a rotation state and a moving direction of the flexible display device 100, and the acceleration sensor 124 detects an inclination degree of the flexible display device 100. It is a sensor to do. As described above, the geomagnetic sensor 122, the gyro sensor 123, and the acceleration sensor 124 may be used for detecting bending characteristics such as a bending direction or a bending area of the flexible display device 100, respectively. Separately, the flexible display device 100 may also be used for detecting a rotation state or a tilt state.

The bend sensor 125 may be implemented in various shapes and numbers as shown in FIGS. 3 to 6 to detect a bending state of the flexible display device 100. Since various examples of the configuration and operation of the bend sensor 125 have been described above, a duplicate description is omitted.

The pressure sensor 126 detects the amount of pressure applied to the flexible display device 100 when a user touches or performs a bending operation, and provides it to the controller 130. The pressure sensor 126 may include a piezo film embedded in the display 110 and outputting an electrical signal corresponding to the pressure. In FIG. 31, although the pressure sensor 126 is shown as separate from the touch sensor 121, when the touch sensor 121 is implemented as a pressure-sensitive touch sensor, the pressure-sensitive touch sensor also plays a role as the pressure sensor 126. It might be.

The proximity sensor 127 is a sensor for detecting motion approaching without directly contacting the display surface. The proximity sensor 127 forms a high frequency magnetic field to detect a current induced by a magnetic field characteristic that changes when an object is approached, a high frequency oscillation type, a magnetic type using a magnet, and a capacitance that changes due to the approach of an object. It can be implemented with various types of sensors, such as capacitive type.

The controller 130 analyzes the detection result of the sensing unit 120 to determine a bending state of the display unit 110 and performs an operation corresponding to the bending state. When the display unit 110 is bent, the operation performed by the control unit 130 has been described above, so a duplicate description will be omitted.

The communication unit 150 is a component that performs communication with various types of external devices according to various types of communication methods. The communication unit 150 may include various communication modules such as a broadcast reception module 151, a short-range wireless communication module 152, a GPS module 153, and a wireless communication module 154. Here, the broadcast receiving module 151 includes a terrestrial broadcast receiving module (not shown) including an antenna, a demodulator, and an equalizer for receiving terrestrial broadcast signals, a DMB module for receiving and processing DMB broadcast signals, and the like. Can be. The short-range wireless communication module 152 is a module for performing communication with an external device located at a short distance according to a short-range wireless communication method such as NFC (Near Field Communication), Bluetooth, or Zigbee. The GPS module 153 is a module for receiving a GPS signal from a GPS satellite and detecting the current position of the flexible display device 100. The wireless communication module 154 is a module that is connected to an external network and performs communication according to wireless communication protocols such as WiFi and IEEE. In addition, the wireless communication module 154 is a mobile communication module that performs communication by connecting to a mobile communication network according to various mobile communication standards such as 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), and LTE (Long Term Evoloution). It may further include.

The control unit 130 may selectively activate the above-described communication unit 150 to perform an operation corresponding to a user command. For example, the controller 130 may access the web server through the wireless communication module 154 and receive web page data from the web server. The control unit 130 may configure the web page screen using the web page data, and display the configured web page screen on the display unit 110.

Meanwhile, the controller 130 may recognize a voice input or a motion input in addition to a bending operation or a touch operation, and perform an operation corresponding to the input. In this case, the voice recognition unit 160 or the motion recognition unit 170 may be activated.

The voice recognition unit 160 collects the user's voice or external sound by using a voice acquisition means such as a microphone (not shown), and then transmits it to the control unit 130. When operating in the voice control mode, the control unit 130 may perform a task corresponding to the user's voice when the user's voice matches a preset voice command. Tasks that can be controlled using voice include various tasks such as volume adjustment, channel selection, channel zapping, display attribute adjustment, playback, pause, rewind, fast forward, application execution, menu selection, device turn on, and turn off. Can be.

Meanwhile, the motion recognition unit 170 acquires an image of the user using an image capturing means (not shown) such as a camera, and then provides it to the controller 130. When operating in the motion control mode, the controller 130 analyzes the image of the user and determines that the user has taken a motion gesture corresponding to a preset motion command, and performs an operation corresponding to the motion gesture. For example, various tasks such as channel zapping, device turn-on, turn-off, pause, play, stop, rewind, fast forward, mute, etc. can be controlled by motion. The above-described examples of a task controllable by voice, a task controllable by motion, etc. are only examples, and are not limited thereto.

In addition, the external input ports 1, 2 to n (190-1 to 190-n) may be connected to various types of external devices to receive various data, programs, and control commands. Specifically, it may include a USB port, a headset port, a mouse port, a LAN port, and the like.

The power supply unit 1800 is a component that supplies power to each component of the flexible display device 100. The power supply 1800 may be implemented in a form including a positive electrode current collector, a positive electrode electrode, an electrolyte portion, a negative electrode electrode, a negative electrode current collector, and a covering portion surrounding the positive electrode current collector. The power supply unit 1800 is implemented with a secondary battery capable of charging and discharging. The power supply unit 1800 may be implemented in a flexible form to be bent together with the flexible display device 100. In this case, the current collector, the electrode, the electrolyte, and the coating may be made of a material having flexible properties. The specific shape and material of the power supply unit 1800 will be separately described in a later section.

Although various components that may be included in the flexible display apparatus 100 are illustrated in FIG. 31, the flexible display apparatus 100 does not necessarily include all components, and is not limited to having only these components. That is, some of the components may be omitted or added depending on the product type of the flexible display device 100, or, of course, may be replaced with other components.

The control unit 130 controls each component according to a user manipulation recognized through the above-described detection unit 120, the voice recognition unit 160, the motion recognition unit 170, and performs various operations.

32 is a view for explaining a detailed configuration of a control unit according to an embodiment of the present invention.

According to FIG. 32, the control unit 130 includes a system memory 131, a main CPU 132, an image processor 133, a network interface 134, a storage unit interface 135, and first to n interfaces 136-1. ~ 136-n), an audio processing unit 137, and a system bus 138.

System memory 131, main CPU 132, image processor 133, network interface 134, storage interface 135, first to n interfaces 136-1 to 136-n, audio processing unit 137 ) Are connected to each other through the system bus 138 to transmit and receive various data or signals.

The first to n-interfaces 136-1 to 136-n support interfacing between various components including the detector 120 and each component in the controller 130. In FIG. 32, although the sensing unit 120 is illustrated as being connected only to the first interface 136-1, when the sensing unit 120 includes a plurality of sensors of various types, as illustrated in FIG. 32, for each sensor It can be connected via an interface. In addition, at least one of the first to n interfaces 136-1 to 136-n is a button provided on a body portion of the display device 100, or receives various signals from external devices connected through external input ports 1 to n. It can also be implemented as an input interface.

The system memory 131 includes a ROM 131-1 and a RAM 131-2. In the ROM 131-1, a set of instructions for booting the system and the like are stored. When a turn-on command is input and power is supplied, the main CPU 132 copies the O / S stored in the storage 140 to the RAM 131-2 according to the command stored in the ROM 131-1, and the O / Run S to boot the system. When the booting is completed, the main CPU 132 copies various application programs stored in the storage 140 to the RAM 131-2 and executes the application programs copied to the RAM 131-2 to perform various operations. do.

As described above, the main CPU 132 may perform various operations according to the execution of the application program stored in the storage 140.

The storage interface 135 is connected to the storage 140 to transmit and receive various programs, contents, data, and the like.

For example, when a user performs a touch operation corresponding to a play command for playing and displaying content stored in the storage 140, the main CPU 132 may access the storage 140 through the storage interface 135. After accessing and generating a list of stored contents, the list is displayed on the display 110. In this state, when the user performs a touch operation for selecting one content, the main CPU 132 executes the content playback program stored in the storage 140. The main CPU 132 controls the image processing unit 133 according to an instruction included in the content playback program to configure a content playback screen.

The image processing unit 133 may include a decoder, a renderer, and a scaler. Accordingly, the stored content is decoded, the decoded content data is rendered to constitute a frame, and the size of the configured frame is scaled to fit the screen size of the display 110. The image processing unit 133 provides the processed frame to the display unit 110 for display.

In addition, the audio processing unit 137 means a component that processes audio data and provides it as sound output means such as a speaker 180. The audio processing unit 137 may perform audio signal processing such as decoding audio data stored in the storage unit 140 or audio data received through the communication unit 150, filtering the noise, and amplifying to an appropriate decibel. . In the above-described example, when the content to be played is video content, the audio processing unit 137 processes the audio data demuxed from the video content and provides it to the speaker 180 so that it can be output in synchronization with the image processing unit 133. Can be.

The network interface 134 is a part connected to external devices through the communication unit 150. For example, when the web browser program is executed, the main CPU 132 accesses the web server through the network interface 134. When web page data is received from the web server, the main CPU 132 controls the image processing unit 133 to configure a web page screen, and displays the configured web page screen on the display 110.

33 is a diagram illustrating a software structure of the storage unit 140 to support the operation of the control unit 130 according to various embodiments described above. According to FIG. 33, the storage unit 140 includes a base module 1910, a device management module 1920, a communication module 1930, a presentation module 1940, a web browser module 1950, and a service module 1960. Includes.

The base module 1910 refers to a basic module that processes signals transmitted from respective hardware included in the flexible display apparatus 100 and delivers them to an upper layer module.

The base module 1910 includes a storage module 1911, a location-based module 1912, a security module 1913, a network module 1914, and the like.

The storage module 1911 is a program module that manages a database (DB) or registry. The location-based module 1912 is a program module that supports location-based services in conjunction with hardware such as a GPS chip. The security module 1913 is a program module that supports hardware certification, request permission, and secure storage, and the network module 1914 is a module for supporting network connection, and is a DNET module. , UPnP module.

The device management module 1920 is a module for managing and using external input and external device information. The device management module 1920 may include a sensing module 1921, a device information management module 1922, a remote control module 1923, and the like.

The sensing module 1921 is a module that analyzes sensor data provided from various sensors in the sensing unit 120. Specifically, it is a program module that performs an operation of detecting an object's location or a user's location, color, shape, size, and other profiles. The sensing module 1921 may include a face recognition module, a voice recognition module, a motion recognition module, an NFC recognition module, and the like. The device information management module 1922 is a module that provides information about various devices, and the remote control module 1923 is a program that performs operations to remotely control peripheral devices such as a telephone, TV, printer, camera, and air conditioner. It is a module.

The communication module 1930 is a module for performing communication with the outside. The communication module 1930 includes a messaging module 1931 such as a messenger program, a short message service (SMS) & multimedia message service (MMS) program, an email program, a call information aggregator program module, and a VoIP module. Can include a telephone module 1932.

The presentation module 1940 is a module for configuring a display screen. The presentation module 1940 includes a multimedia module 1941 for reproducing and outputting multimedia content, and a UI & graphics module 1942 performing UI and graphic processing. The multimedia module 1941 may include a player module, a camcorder module, and a sound processing module. Accordingly, various multimedia contents are reproduced to generate screens and sounds to be reproduced. The UI & graphics module 1942 is an image compositor module that combines images (1942-1), a coordinate combination module that generates and combines coordinates on the screen to display an image (1942-2), and various events from hardware. It may include an X11 module (1942-3) for receiving, a 2D / 3D UI toolkit (1942-4) providing a tool for configuring a 2D or 3D UI.

The web browser module 1950 refers to a module that performs web browsing to access a web server. The web browser module 1950 may include various modules such as a web view module that composes a web page, a download agent module that performs download, a bookmark module, and a webkit module.

In addition, the service module 1960 means an application module for providing various services. For example, the service module 1960 may include various modules such as a navigation service module, game module, advertisement application module, and the like, which provides maps, current locations, landmarks, route information, and the like.

The main CPU 132 in the control unit 130 accesses the storage unit 140 through the storage unit interface 135 to copy various modules stored in the storage unit 140 to the RAM 131-2, The operation is performed according to the operation of the module.

Specifically, the main CPU 132 analyzes the output values of various sensors in the sensing unit 120 using the sensing module 1921, bending area, bending line, bending direction, bending number, bending angle, bending speed, touch After checking the area, number of touches, touch intensity, pressure magnitude, proximity, and the like, the inputted user operation is determined based on the result of the check. When it is determined that the user operation is intended, the main CPU 132 detects information about the operation corresponding to the user operation from the database DB of the storage module 1910. Then, the module corresponding to the detected information is driven to perform an operation.

For example, in the case of a GUI (Graphic User Interface) display operation, the main CPU 132 configures the GUI screen by using the image combination module 1942-1 in the presentation module 1940. Then, by using the coordinate combination module 1942-2, the display location of the GUI screen is determined, and the display unit 110 is controlled to display the GUI screen at the location.

Alternatively, when a user operation corresponding to the message reception operation is performed, the main CPU 132 executes the messaging module 1941, accesses the message management server, and then receives the message stored in the user account. Then, the main CPU 132 configures a screen corresponding to the received message using the presentation module 1940, and then displays it on the display unit 140.

In addition, when performing a phone call operation, the main CPU 132 may drive the phone module 1932.

As described above, programs having various structures may be stored in the storage 140, and the controller 130 may perform operations according to the various embodiments described above using various programs stored in the storage 140. .

34 is a diagram illustrating an example of a shape of a flexible display device embedded in the main body. According to FIG. 35, the flexible display device 100 may include a main body 2000, a display unit 110, and a grip unit 2010.

The main body 2000 serves as a kind of case containing the display 110. When the flexible display apparatus 100 includes various components as shown in FIG. 31, other components except the display unit 110 and some sensors may be mounted on the main body 2000. The main body 2000 includes a rotating roller that rolls the display 110. Accordingly, when not in use, the display 110 may be rolled around a rotating roller to be embedded in the main body 2000.

When the user grips and pulls the grip portion 2010, the rotating roller rotates in the opposite direction of rolling to release the rolling, and the display 110 comes out of the main body 2000. A stopper may be provided on the rotating roller. Accordingly, when the user pulls the grip unit 2010 over a predetermined distance, the rotation of the rotating roller is stopped by the stopper, and the display unit 110 can be fixed. Accordingly, the user can execute various functions using the display unit 110 exposed to the outside. Meanwhile, when the user presses a button for releasing the stopper, the stopper is released and the rotating roller rotates in the reverse direction, and as a result, the display 110 may be rolled back into the main body 2000. The stopper may be a switch shape that stops the operation of the gear for rotating the rotating roller. As for the rotating roller and the stopper, a structure used in a conventional rolling structure may be used as it is, so a detailed illustration and description thereof will be omitted.

Meanwhile, the main body 2000 includes a power source 1800. The power supply unit 1800 may be implemented in various forms, such as a battery connection unit on which a disposable battery is mounted, a secondary battery that a user can charge and use multiple times, or a solar cell that performs power generation using solar heat. When implemented as a secondary battery, the user can charge the power unit 1800 by connecting the main body 2000 and an external power source by wire.

In FIG. 34, the body 2000 having a cylindrical structure is illustrated, but the shape of the body 2000 may be implemented as a rectangle or other polygons. In addition, of course, the display 110 may be implemented in a form surrounding the outside of the main body or in various other forms, rather than being exposed to the outside by pulling while being embedded from the main body 2000.

35 is a view showing a flexible display device in a form in which the power supply unit 1800 can be attached or detached according to an embodiment of the present invention. According to FIG. 36, the power supply unit 1800 may be provided at one edge of the flexible display device and detachable.

The power supply unit 1800 is made of a flexible material, and may be bent together with the display unit 110. Specifically, the power supply unit 1800 may include a negative electrode current collector, a negative electrode electrode, an electrolyte portion, a positive electrode electrode, a positive electrode current collector, and a covering portion covering them.

For example, the current collector may be implemented with alloys such as TiNi based on good elastic properties, pure metals such as copper aluminum, conductive metals such as carbon-coated pure metals, carbon, and carbon fibers, and conductive polymers such as polypyrrole. .

The negative electrode may be made of metals such as lithium, sodium, zinc, magnesium, cadmium, hydrogen storage alloys, lead, non-metals such as carbon, and negative electrode materials such as polymer electrode materials such as organic sulfur.

The positive electrode may be made of a positive electrode material such as sulfur and metal sulfide, lithium transition metal oxide such as LiCoO2, SOCl2, MnO2, Ag2O, Cl2, NiCl2, NiOOH, polymer electrode. The electrolyte part may be embodied in a gel form using PEO, PVdF, PMMA, PVAC, and the like.

A normal polymer resin can be used for the coating portion. For example, PVC, HDPE or epoxy resin can be used. In addition, any material that can be freely bent or bent while preventing damage to the seal-type battery can be used as a covering.

The positive electrode and the negative electrode in the power supply unit 1800 may each include a connector to be electrically connected to the outside.

According to FIG. 35, a connector is formed in a form protruding from the power supply unit 1800, and a groove corresponding to the position, size, and shape of the connector is formed in the display unit 110. Accordingly, the power supply unit 1800 may be combined with the display unit 110 by the combination of the connector and the groove. The connector of the power supply unit 1800 may be connected to a power connection pad (not shown) inside the display device 100 to supply power.

In FIG. 35, the power supply unit 1800 is illustrated as being detachable from one edge of the display device 100, but this is only an example, and the position and shape of the power supply unit 1800 varies depending on product characteristics. Can be. For example, when the display device 100 is a product having a certain thickness, the power supply unit 1800 may be mounted on the rear surface of the flexible display device 100.

36 is a flowchart illustrating a display method of a flexible display device according to an embodiment of the present invention.

First, an object is displayed at a first position on the screen of the display unit (S2110). That is, an object can be displayed at a predetermined position on the screen, where the predetermined position is set at the time of manufacture or can be set and changed by the user.

Thereafter, bending of the display unit is sensed (S2120).

Then, while the bending is maintained, the position of the object is moved based on the position on the screen where bending is detected, and when the object is moved to a preset second position on the screen, a function mapped to the second position is performed (S2130). .

Specifically, the moving direction, moving distance and moving speed of the object displayed on the screen, based on at least one of the location of the object displayed on the screen, the area where the bending is made on the screen, the bending direction, the bending degree, and the bending holding time. The back may be determined and displayed while moving the object according to the determination result. And, it can be controlled to perform a function corresponding to the movement of the object.

Here, the screen is a lock screen, and when an object on the lock screen moves to a preset second position by bending, a lock release operation for releasing the lock state may be performed.

On the other hand, when the lock state is released, the main screen is displayed, and when one menu is selected on the main screen, a function corresponding to the menu is executed to display the execution result screen.

Then, when the display unit is bent in the first direction while the execution result screen is being displayed, at least one object included in the execution result screen may be aligned and displayed on the edge area of the execution result screen. In this case, at least one of the size and shape of at least one object to be aligned with the edge area may be adjusted.

Meanwhile, when the display unit is bent in a second direction opposite to the first direction in a state in which at least one object is aligned and displayed in the edge area, the at least one object may be returned to the original state for display.

Meanwhile, when an object on the lock screen moves to a preset second position, an unlocking operation may be performed, and an operation matched to the second location may be automatically performed. For example, the operation matched to the second location may be an operation of executing an application installed on the display device.

In addition, the screen is a call connection screen that further includes a call connection menu and a call rejection menu, and when an object on the call connection screen is moved to a location where the call connection menu is displayed by bending, a call connection operation is performed, and the object is rejected. When the menu is moved to the displayed location, a call rejection operation may be performed.

Meanwhile, the moving distance of the object may be adjusted differently according to the bending degree of the display unit. That is, the moving distance of the object can be adjusted to be proportional to the bending degree. Accordingly, the larger the bending degree during the same bending holding time, the larger the moving distance of the object. However, this is only an example, and the larger the bending degree, the faster the movement speed of the object.

With respect to the above-described embodiment, the duplicate description will be omitted in that it has been described above with the accompanying drawings.

In addition, a non-transitory computer readable medium in which a program for sequentially performing a display method according to the present invention is stored may be provided.

A non-transitory readable medium means a medium that stores data semi-permanently and that can be read by a device, rather than a medium that stores data for a short time, such as registers, caches, and memory. Specifically, the various applications or programs described above may be stored and provided in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, although a bus is not illustrated in the block diagram of the display device, communication between components in the display device may be performed through a bus. Further, the display device may further include a processor, such as a CPU or a microprocessor, which performs the various steps described above.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be implemented by those skilled in the art, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

100: flexible display device 110: display unit
120: detection unit 130: control unit

Claims (18)

In the flexible display device,
Flexible display;
A sensor for sensing bending of the flexible display;
The flexible display is controlled to display an object at a first position of the flexible display, and when the flexible display is bent, a second position at which the object is displayed on the flexible display is determined, and the object is determined based on the bending. And a processor configured to control the flexible display to be displayed at a second location, and to perform a function of the flexible display apparatus related to the second location. According to claim 1,
The processor,
When the flexible display is controlled to display a lock screen, the flexible display is controlled so that the object is displayed at the first location on the lock screen, and when the flexible display is bent so that the object is displayed at the second location, The flexible display device determines whether the second position is related to a function of unlocking a lock screen and unlocks the lock screen when the second position is related to unlocking. According to claim 2,
The processor,
When the second position is associated with the release of the lock screen and execution of an application, the flexible display device unlocks the lock screen and performs an operation related to the second position. According to claim 2,
The processor,
When the lock screen is unlocked, the flexible display is controlled to display a main screen,
When one menu is selected on the main screen, the flexible display device controls the flexible display to display an execution result screen by executing a function corresponding to the menu. The method of claim 4,
The processor,
When the flexible display is bent in a first direction while the execution result screen is displayed, controlling the flexible display to display at least one object included in the execution result screen aligned with an edge area of the execution result screen, Flexible display device. The method of claim 5,
The processor,
The at least one of the size and shape of the at least one object is adjusted to align with the edge area. The method of claim 5,
The processor,
When the flexible display is bent in a second direction opposite to the first direction while the at least one object is aligned and displayed in the edge area, the flexible display is displayed by returning the at least one object to its original state. Device. According to claim 1,
The processor,
The flexible display device determines the second position based on at least one of the bending angle and direction. According to claim 1,
The processor,
A flexible display device for determining a second position where the object is displayed based on the duration of the bending. In the display method of the flexible display device
Displaying an object at a first position on the flexible display;
Determining a second position at which the object is displayed on the flexible display when the flexible display is bent;
Displaying the object at the second location based on the bending; And
And performing a function of the flexible display device related to the second position. The method of claim 10,
Further comprising; displaying a lock screen;
The step of displaying the object in the first position,
And displaying the object at the first location on the lock screen.
Step of performing the function,
When the flexible display is bent and the object is displayed at the second position, it is determined whether the second position is related to a function of unlocking the lock screen, and when the second position is related to unlocking, the lock screen is displayed. And unlocking. The method of claim 11,
Step of performing the function,
And when the second location is associated with the release of the lock screen and execution of the application, unlocking the lock screen and performing an operation related to the second location. The method of claim 11,
When the lock screen is unlocked, displaying a main screen; And
And when a menu is selected on the main screen, executing a function corresponding to the menu to display an execution result screen. The method of claim 13,
Further comprising, if the flexible display is bent in a first direction while the execution result screen is displayed, aligning and displaying at least one object included in the execution result screen in an edge area of the execution result screen; Display method. The method of claim 14,
The step of sorting and displaying,
And adjusting at least one of the size and shape of the at least one object to align with the edge area. The method of claim 14,
Returning and displaying the at least one object in an original state when the flexible display is bent in a second direction opposite to the first direction while the at least one object is aligned and displayed in the edge region; Further comprising, a display method. The method of claim 10,
Determining the second position,
And determining the second position based on at least one of the angle and direction of the bending. The method of claim 10,
Determining the second position,
And determining the second position based on the duration of the bending.

Images