KR20160139647A - Display device having splitable display, controlling method thereof and recording medium for performing the method - Google Patents

Display device having splitable display, controlling method thereof and recording medium for performing the method Download PDF

Info

Publication number
KR20160139647A
KR20160139647A KR1020150074898A KR20150074898A KR20160139647A KR 20160139647 A KR20160139647 A KR 20160139647A KR 1020150074898 A KR1020150074898 A KR 1020150074898A KR 20150074898 A KR20150074898 A KR 20150074898A KR 20160139647 A KR20160139647 A KR 20160139647A
Authority
KR
South Korea
Prior art keywords
input
screen
display device
user
gesture
Prior art date
Application number
KR1020150074898A
Other languages
Korean (ko)
Other versions
KR101726576B1 (en
Inventor
박지형
허보경
김효영
김희선
권규현
Original Assignee
한국과학기술연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국과학기술연구원 filed Critical 한국과학기술연구원
Priority to KR1020150074898A priority Critical patent/KR101726576B1/en
Publication of KR20160139647A publication Critical patent/KR20160139647A/en
Application granted granted Critical
Publication of KR101726576B1 publication Critical patent/KR101726576B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1615—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function
    • G06F1/1616—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
    • G06F1/1618—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position the display being foldable up to the back of the other housing with a single degree of freedom, e.g. by 360° rotation over the axis defined by the rear edge of the base enclosure
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Mathematical Physics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

According to one embodiment of the present invention, a display device includes: a flexible display of which a screen is able to be split; a sensor unit for detecting a user input including a gesture input; and a control unit for determining a split axis based on a first gesture input, determining a split number based on at least one second gesture input detected after the first gesture input, and splitting the screen of the flexible display according to the split axis and the split number. Accordingly, the control unit is capable of determining the split axis based on an input trajectory direction of the first gesture input. In addition, the control unit is capable of obtaining the number of intersecting points between an input trajectory of the first gesture input and respective input trajectories of the at least one second gesture input, and determining the split number based on the number of the intersecting points.

Description

TECHNICAL FIELD [0001] The present invention relates to a display device having a display capable of dividing a screen, a control method thereof, and a recording medium for performing the method. BACKGROUND OF THE INVENTION [0001]

The present invention relates to a display device, and more particularly, to a display device having a flexible display capable of screen division.

Various types of display devices have been developed according to the development of electronic technology, and in particular, portable display devices such as TVs, PCs, laptop computers, tablet computers, mobile phones, MP3 players, and the like are widely spread. In recent years, efforts have been made to develop display devices in a more new form in order to meet the needs of users who want more and more various functions. This is what is called the next generation display.

One example of a next generation display is a flexible display. Flexible display is a display with characteristics that can be deformed like paper, and is consumer-oriented future display technology that can retrieve and obtain desired information anytime and anywhere.

Such a flexible display can be bent in the nature of a flexible display panel and fixed in a bent state to provide visual information at various angles (e.g., 360 degrees). If the flexible display provides visual information at various angles There is a need to provide a new user interface (UI) or a user experience (UX) in order to provide a display optimized for the angle the user views the flexible display and provide various information according to the angle.

Application Publication No. KR 10-2012-0093148

Accordingly, the present specification aims to determine a division axis and a division number of a flexible display based on a user's gesture input, and to divide the screen of the flexible display according to the determined division axis and the division number, and a control method thereof .

A display device according to an embodiment of the present invention includes a flexible display capable of screen division; A sensor unit for sensing a user input including a gesture input; And determining a division axis based on the first gesture input and determining a division number based on the at least one second gesture input sensed after the first gesture input and determining the number of divisions based on the division axis and the number of divisions, And a control unit for dividing the screen.

As an example, the control unit may determine the split axis based on the direction of the input trajectory of the first gesture input.

As an embodiment, the control unit may obtain the number of intersections between the input trajectory of the first gesture input and the input trajectory of each of the one or more second gesture inputs, and determine the number of divisions based on the number of intersection points .

According to another aspect of the present invention, there is provided a method of controlling a display device, including: determining a split axis based on a first gesture input sensed by a sensor unit; Determining a number of divisions based on at least one second gesture input sensed by the sensor unit after the first gesture input is sensed; And dividing the screen of the flexible display according to the division axis and the division number.

As an example, the step of determining the dividing axis may determine the dividing axis based on the direction of the input trajectory of the first gesture input.

As an embodiment, the step of determining the number of divisions may comprise obtaining the number of intersections between the input trajectory of the first gesture input and the input trajectory of each of the one or more second gesture inputs, The number can be determined.

According to the present disclosure, the display device can provide an intuitive user interface by determining the division axis and the number of divisions of the flexible display based on the trajectory and the intersection point of the user's gesture input.

In addition, the display device can detect the gesture input inputted by the user at a position where the user views the flexible display, irrespective of the input position, thereby providing user convenience.

In addition, the display device can separately provide the display area and the control area of the flexible display, thereby increasing the visibility of the flexible display having various sizes and reducing the error rate of the control.

1 is a configuration diagram of a display device according to an embodiment of the present invention.
2 is a conceptual diagram showing an appearance of a display device according to an embodiment of the present invention.
3 is an exemplary diagram illustrating a method of horizontally dividing a screen according to an embodiment of the present invention.
4 is an exemplary diagram illustrating a method of vertically dividing a screen according to an embodiment of the present invention.
5 is a diagram illustrating a method of selecting and controlling a horizontally divided screen according to an embodiment of the present invention.
6 is an exemplary diagram illustrating a method of selecting and controlling a vertically divided screen according to an exemplary embodiment of the present invention.
FIG. 7 is an exemplary diagram illustrating a method of selecting and controlling a horizontally divided screen according to another embodiment of the present invention. FIG.
8 is an exemplary diagram illustrating a method of selecting and controlling a vertically divided screen according to another embodiment of the present invention.
9 is an exemplary diagram showing a method of merging a divided screen of a display device according to an embodiment of the present invention.
10 is a flowchart showing a control method of a display device according to an embodiment of the present invention.
11 is a flowchart showing a control method of a display device according to another embodiment of the present invention.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings and the accompanying drawings, but the scope of the claims is not limited or limited by the embodiments.

As used herein, terms used in the present specification are selected from the general terms that are currently widely used, while taking into consideration the functions, but these may vary depending on the intention or custom of the artisan or the emergence of new techniques. Also, in certain cases, there may be a term selected by the applicant at will, in which case the meaning will be described in the description part of the corresponding specification. Therefore, it is intended that the terminology used herein should be interpreted based on the meaning of the term rather than on the name of the term, and on the entire contents of the specification.

1 is a configuration diagram of a display device according to an embodiment of the present invention.

The display device 100 may be various types of display devices including the flexible display 110 in this specification. For example, the display device 100 may be a mobile device, a portable device, a digital device, a personal computer, a laptop computer, a tablet computer, or other similar type of display device, including the flexible display 110. The display device 100 includes a flexible display 110 that can be physically deformed so that when the display function is not needed, the flexible display 110 can be housed inside the device to increase the mobility of the display device 100 Respectively.

Referring to FIG. 1, a display device 100 includes a flexible display 110, a sensor unit 120, and a control unit 140. In one embodiment, the display apparatus 100 may further include the user interface unit 130 as an optional configuration.

The flexible display 110 refers to a display that can be bent by external pressure to change its shape. Here, bending is a concept including general bending, folding, and rolling. In this case, normal bending means that the flexible display 110 is bent. This general bending differs from folding and rolling in that the bent surfaces do not touch each other. The folding means a state in which the flexible display 110 is folded, and the rolling means a state in which the flexible display 110 is rolled. Rolling may also be defined such that the front and back surfaces of the flexible display 110 are in contact with each other due to bending. In the present specification, these various types of rolling are collectively referred to as rolling.

In one embodiment, the flexible display 110 may be embodied as a plastic substrate (e.g., a polymeric film) that may be deformed by external pressure. Here, the plastic substrate has a structure in which a base film is treated with a barrier coating on both sides. In this case, the base material can be embodied by various resins such as polyimide (PI), polycarbonate (PC), polyethyleneterephtalate (PET), polyethersulfone (PES), polystyrene naphthalate (PEN), and fiber reinforced plastic have. And, the barrier coating is performed on the surfaces facing each other in the base material, and an organic film or an inorganic film can be used to maintain flexibility.

In another embodiment, the flexible display 110 may be embodied as a material having a flexible nature other than a plastic substrate. For example, the flexible display 110 may be embodied as a flexible material such as a thin glass or a metal foil. The flexible display 110 may be embodied as an organic light emitting diode (EL), an electrophoretic display (EPD), an electrochromic display (ECD), a liquid crystal display (LCD), an AMLCD, a plasma display panel It is possible.

In this specification, the flexible display 110 includes a flexible display 110 (e.g., a fixed bendable display, a foldable display, a rollable display, etc.) that can be fixed in a bend state And can preferably be a cylindrical display that can be fixed in a rolled state. This flexible display 110 may be fixed in a bend state to provide the user with visual information at various angles (e.g., 360 degrees in the case of a cylindrical display).

The screen of the flexible display 110 can be divided. For example, the screen of the flexible display 110 may be divided into various numbers (e.g., two, three, etc.) in various angles (e.g., horizontal or vertical). In one embodiment, the screen of the flexible display 110 may be split when the flexible display 110 is fixed in the bend state. For example, the screen of the flexible display 110 may be divided when the flexible display 110 is fixed in a rolled state (e.g., in the form of a cylindrical display).

In addition, the flexible display 110 may be a touch sensitive display including a touch sensor. In this case, the display device 100 can detect the touch input of the user touching the surface of the flexible display 110. [

The sensor unit 120 senses a user input to the flexible display 110 and transmits the sensed result to the control unit 140. Here, the user input is a control input for controlling the display device 100, for example, a single touch input, a double touch input, a multi-touch input, various types of gesture input (e.g., a touch gesture input, a motion gesture input, ) Or other similar type of input.

In one embodiment, the sensor portion 120 may use one or more sensors to sense user input. For example, the sensor unit 120 may detect a user input using a touch sensor that senses a touch input of a user, a motion sensor that senses a motion input, and the like.

In one embodiment, the sensor portion 120 may sense user input to the display area of the flexible display 110. [ In another embodiment, the sensor unit 120 may sense user input to the user interface unit 130 of the flexible display 110.

The user interface unit 130 may provide an interface for interaction between the display device 100 and a user. In one embodiment, the user interface portion 130 may be located at the top or bottom of the flexible display 110. In this way, the user can control the display device 100 through user input to the user interface unit 130 while holding the interruption of the display device 100 in hand. The user interface unit 130 will be described in detail below with reference to FIG.

The control unit 140 may control at least one configuration of the display device 100. For example, More specifically, the control unit 140 controls each of the above-described configurations and can control data transmission and / or reception between the respective configurations.

Herein, the control unit 140 determines the division axis based on the first gesture input of the user, determines the division number based on the one or more gesture inputs sensed after the first gesture input, The screen of the flexible display 110 can be divided.

In one embodiment, the controller 140 may determine a split axis (e.g., a horizontal axis, a vertical axis, etc.) based on the direction of the input trajectory of the first gesture input. The controller 140 also obtains the number of intersections between the input trajectory of each of the one or more gesture inputs sensed after the first gesture input and the input trajectory of the first gesture input, and determines the number of divisions based on the number of intersections . In this case, the control unit 140 can determine one more number of division points than the number of the obtained intersection points. As described above, the display device 100 can provide a more intuitive user interface to the user by determining the axis and the number of the screen division of the flexible display 110 using the input trajectory of the user's gesture input.

The operations of the controller 140 will be described in detail below with reference to the drawings. Hereinafter, the control unit 140 may be described as controlling at least one unit included in the display device 100 or the display device 100, and the control unit 140 and the display device 100 may be equated . Further, although not shown in detail in FIG. 1, the configurations of the display device 100 can communicate with each other through one or more buses or signal lines. Further, the configurations of the display device 100 may be implemented by a combination of hardware and software, such as hardware, software, or middleware.

FIG. 1 is a configuration diagram of a display device 100 according to an exemplary embodiment. Components separated from each other are logically distinguished from each other. Thus, the components of the apparatus described above may be mounted as a single chip or as a plurality of chips, depending on the design of the apparatus. In addition, the display device 100 of FIG. 1 corresponds to an embodiment, and not all elements included in FIG. 1 are required to perform the embodiments of the present invention. Hereinafter, components necessary for the embodiments of the present invention and their operation will be described in detail.

Embodiments of the display device 100 will now be described, focusing on the case where the flexible display 110 is a cylindrical display, but this description is not intended to limit the scope of the present invention, It will be apparent to one of ordinary skill in the art that the present invention can be applied to the display device 100 including various types of flexible displays 110 that can be applied to the device 100 as well as bending.

2 is a conceptual diagram showing an appearance of a display device according to an embodiment of the present invention.

The display device 100 of FIG. 2 is an apparatus including a cylindrical display, for example, a device including a cylindrical display (small cylindrical display) with a size that can be held by the user, (E.g., a medium or large cylindrical display) having a size that can not be achieved. In this case, the shape of the cylindrical display may have various shapes. For example, the cylindrical display may be a shape having a constant cross-sectional size, a shape in which the size of the cross-section decreases or a shape in which the cross-sectional size increases as the cross-sectional direction moves from the upper portion to the lower portion.

When the display device 100 has a small cylindrical display, the display device 100 may be utilized as a multipurpose display having functions such as, for example, a tumbler, a light, a clock, etc., and may be in a portable form . When the display device 100 has a medium or large cylindrical display, the display device 100 can be used as a public display for advertising or publicity purposes, for example, Lt; / RTI >

2, the display apparatus 100 may include a flexible display 110 having a display area for displaying time information, and a user interface unit 130 for interaction between the display apparatus 100 and the user . In one embodiment, the user interface may be located on a display area of the flexible display 110. In another embodiment, the user interface portion 130 may be located on a separate region that is distinct from the display region of the flexible display 110. In this case, the flexible display 110 and the user interface unit 130 may be positioned on one flexible panel.

The user interface unit 130 may include one or more input areas where user input is sensed. For example, the user interface unit 130 includes an icon input area 131 in which control icons are provided, a first input area 132 located at one side of the icon input area 131, And a second input area 133 located in the second input area. In this case, the display device 100 can sense a user input to the input area of the user interface unit 130 using the sensor unit.

Here, the icon input area 131 indicates an area where a user input (e.g., a touch input) for a control icon for controlling the display device 100 is sensed. The first input area 132 includes a display area for displaying a state of a screen division, which is a region where a user input (e.g., a gesture input) for performing functions related to screen division, screen selection or screen merging is detected can do. According to one embodiment, the first input region 132 may be enlarged or reduced in size. For example, the display device 100 may enlarge the size of the first input area 132 when a user input for activating the first input area 132 is detected. In addition, the second input area 133 refers to an area where a user input (e.g., gesture input) for performing a function associated with the control of the selected screen area is sensed.

In one embodiment, the user interface unit 130 may be rotated clockwise or counterclockwise with respect to the central axis of the display device 100. [ Accordingly, the user positioned at various angles can easily control the display device 100 without moving the user's position by rotating the position of the user's interface in the field of view.

3 is an exemplary diagram illustrating a method of horizontally dividing a screen according to an embodiment of the present invention. 4 is an exemplary diagram illustrating a method of vertically dividing a screen according to an embodiment of the present invention.

First, the display device 100 can activate the screen division function of the flexible display 110. [ In one embodiment, the display device 100 can be set to activate the screen division function when the flexible display 110 is activated (e.g., the display is turned on). In another embodiment, when a user input for activating the screen division function is sensed, the display apparatus 100 may activate the screen division function. For example, when a first user input (e.g., a touch input) to the first input area 132 of the user interface is sensed, as shown on the left side of FIGS. 3 and 4, Can be activated.

When the screen division function is activated, the display apparatus 100 detects a first gesture input for determining a screen division axis, and, after the first gesture input is sensed, outputs one or more second gesture inputs for determining a screen division number Can be detected. Here, the first gesture input and the second gesture input may be a predetermined type of touch gesture input or a motion gesture input (e.g., air motion gesture input). If the gesture input is a touch gesture input, the display device 100 may use the touch sensor to obtain information about the input trajectory of the gesture input. If the gesture input is a motion gesture input, the display device 100 may use the motion sensor to obtain information about the input trajectory of the gesture input.

In one embodiment, the display device 100 may sense the first gesture input and the second gesture input for a predetermined period of time (e.g., five seconds after the screen segmentation function is activated). 3 and 4, the display device 100 enlarges the size of the first input area 132 and enlarges the size of the enlarged first input area 232, for example, The first gesture input and the second gesture input may be sensed. When the first gesture input and the second gesture input are sensed, the display device 100 can determine the division axis based on the first gesture input and determine the number of divisions based on the second gesture input.

In one embodiment, the display device 100 obtains the direction of the input trajectory of the first gesture input and, based thereon, can determine whether the split axis is a horizontal axis or a vertical axis. For example, when the input trajectory of the first gesture input a is in the horizontal direction, as in the middle of Fig. 3, the display device 100 can determine the horizontal axis as a dividing axis. As another example, when the input trajectory of the first gesture input (a) is vertical, as in the middle of Fig. 4, the display device 100 can determine the vertical axis as the dividing axis.

In one embodiment, the display device 100 may obtain the number of intersections between the input trajectory of each of the second gesture inputs and the input trajectory of the first gesture input, and may determine the number of divisions based on the number of intersections. 3, when the number of intersections between the input trajectory of the first gesture input (a) and the input trajectory of the second gesture input (b, c) is two, the display device 100 It is possible to determine three, which is one more than the number of intersections, as the number of divisions. 4, when the number of intersections between the input trajectory of the first gesture input a and the input trajectory of the second gesture input b is one, the display device 100 displays the intersection point < RTI ID = 0.0 > 2 " can be determined as the number of divisions.

If the split axis and the number of divisions are determined, the display device 100 may divide the screen of the flexible display 110 according to the determined split axis and the number of divisions. For example, if the split axis is a horizontal axis and the number of divisions is three as shown on the right side of FIG. 3, the display apparatus 100 can divide the screen of the flexible display 110 into three horizontally. As another example, if the division axis is a vertical axis and the number of divisions is two, as shown in the right side of FIG. 4, the display device 100 can vertically divide the screen of the flexible display 110 into two.

In one embodiment, when the screen of the flexible display 110 is divided, the display device 100 can display the same execution screen as the execution screen displayed on the screen prior to being divided into the divided screens. In another embodiment, when the screen of the flexible display 110 is divided, the display device 100 may display an execution screen different from the execution screen displayed on the screen before the partial screen is divided. For example, the display apparatus 100 can display different execution screens of currently executed applications on divided screens, respectively.

When the screen of the flexible display 110 is divided, the display device 100 can display the state of the screen division. In one embodiment, the display device 100 may display the status of the screen division in the first input area 132. [ For example, when the screen of the flexible display 110 is horizontally divided into three as shown on the right side of FIG. 3, the display device 100 can horizontally divide the first input area 132 into three horizontally. As another example, when the screen of the flexible display 110 is vertically divided into two, as shown on the right side of FIG. 4, the display device 100 can vertically divide the first input area 132 into two.

5 is a diagram illustrating a method of selecting and controlling a horizontally divided screen according to an embodiment of the present invention. 6 is an exemplary diagram illustrating a method of selecting and controlling a vertically divided screen according to an exemplary embodiment of the present invention.

First, the display device 100 in a screen-divided state can activate a screen selection function of the flexible display 110. [ In one embodiment, the display device 100 may be configured to activate the screen selection function when the flexible display 110 is screen-divided. In another embodiment, when a user input for activating the screen selection function is sensed, the display device 100 may activate the screen division function. For example, as shown on the left side of FIGS. 5 and 6, a first user input (e.g., a single touch input or a short touch input) for the first input area 132 of the user interface Is detected, the display apparatus 100 can activate the screen selection function.

When the screen selection function is activated, the display apparatus 100 can sense a second user input (e.g., a touch input) for screen selection. In one embodiment, the display device 100 may sense a second user input for a predetermined period of time (e.g., 5 seconds after the screen selection function is activated). 5 and 6, the display device 100 enlarges the size of the first input area 132 and enlarges the size of the enlarged first input area 232, for example, when the screen selection function is activated Lt; RTI ID = 0.0 > user input. ≪ / RTI >

When the second user input is detected, the display apparatus 100 can select at least one of the divided screens based on the second user input. For example, when a second user input for the second horizontal area of the enlarged first entry area 242 is sensed, as shown in the middle of FIG. 5, the display device 100 displays a screen corresponding to the second horizontal area The second horizontal screen can be selected. 6, when the second user input for the second vertical area of the enlarged first entry area 242 is sensed, the display device 100 displays the second vertical area corresponding to the second vertical area A second vertical screen which is a screen can be selected. As an example, when a screen is selected, the display device 100 can display a highlight (indicated by a dotted line in the figure) for identifying the selected screen.

When a screen is selected, the display apparatus 100 may sense a third user input for controlling the selected screen. In one embodiment, the display device 100 may sense a third user input for a predetermined period of time (e.g., three seconds after the screen is selected).

In one embodiment, the display device 100 may sense a third user input (e.g., a touch input) for the icon in the icon input area 131. [ For example, as shown on the right side of FIG. 5, the display device 100 may sense a third user input for a first icon (e.g., a clock icon) in the icon input area 131. [ As another example, as shown on the right side of FIG. 6, the display device 100 may sense a third user input for a second icon (e.g., a flash icon) in the icon input area 131. [

When a third user input is sensed, the display device 100 can control the selected screen based on the third user input. In one embodiment, when a third user input to the icon in the icon input area 131 is detected, the display device 100 executes an application corresponding to the icon and displays an execution screen of the application on the selected screen . For example, when a third user input for a first icon (e.g., a clock icon) is sensed, as shown on the right hand side of FIG. 5, the display device 100 may display a first application corresponding to the first icon Can be displayed on the selected second horizontal screen. As another example, when a third user input for a second icon (e.g., a flash icon) is detected, as shown on the right side of FIG. 6, the display device 100 displays a second application corresponding to the second icon Application) on the selected second vertical screen. In this way, the display device 100 can display different applications on each divided screen based on the user's input.

FIG. 7 is an exemplary diagram illustrating a method of selecting and controlling a horizontally divided screen according to another embodiment of the present invention. FIG. 8 is an exemplary diagram illustrating a method of selecting and controlling a vertically divided screen according to another embodiment of the present invention. In FIGS. 7 and 8, detailed description of the same parts as those described in FIGS. 5 and 6 will be omitted.

First, the display device 100 in a screen-divided state can activate a screen selection function of the flexible display 110. [ For example, when a first user input (e.g., a touch input) to the first input area 132 of the user interface is sensed in a state in which the screen is divided as shown on the left side of FIGS. 7 and 8, May activate the screen selection function.

When the screen selection function is activated, the display apparatus 100 can sense a second user input (e.g., a touch input) for screen selection. 7 and 8, the display device 100 enlarges the size of the first input area 132 and enlarges the size of the enlarged first input area 232, for example, when the screen selection function is activated Lt; RTI ID = 0.0 > user input. ≪ / RTI >

When the second user input is detected, the display apparatus 100 can select at least one of the divided screens based on the second user input. For example, when the second user input for the third horizontal area of the enlarged first entry area 242 is sensed, as shown in the center of FIG. 7, the display device 100 displays the screen corresponding to the third horizontal area The third horizontal screen can be selected. As another example, when a second user input for the first vertical area of the enlarged first entry area 242 is sensed, as in the middle of FIG. 8, the display device 100 displays the first vertical area corresponding to the first vertical area A first vertical screen which is a screen can be selected. As an embodiment, when a screen is selected, the display device 100 can highlight the selected screen (indicated by a dotted line in the drawing).

When a screen is selected, the display device 100 may sense a third user input (e.g., a touch gesture input or a motion gesture input) for controlling the selected screen. In one embodiment, the display device 100 may sense a third user input to the second input area 133. [ For example, as shown on the right side of FIG. 7, the display device 100 can detect a third user input (e.g., a gesture input 10 that is dragging upward) for the second input area 133 have. As another example, as shown on the right side of FIG. 8, the display device 100 may detect a third user input (e.g., a gesture input 20 dragging in the right direction) to the second input area 133 .

When a third user input is sensed, the display device 100 can control the selected screen based on the third user input. In one embodiment, when a third user input to the second input area 133 is sensed, the display device 100 may control the size of the selected screen based on the third user input in various manners. For example, when a third user input to the second input area 133 is sensed, as shown on the right side of FIG. 7, the display device 100 may reduce the size of the selected third horizontal screen by the dragged ratio . As another example, if a third user input to the second input area 133 is sensed, as shown on the right side of FIG. 8, the display device 100 may increase the size of the selected first vertical screen by the dragged ratio have. Accordingly, the display apparatus 100 can adjust the size of each divided screen based on the gesture input of the user.

9 is an exemplary diagram showing a method of merging a divided screen of a display device according to an embodiment of the present invention. More specifically, FIG. 9 shows a method of merging a screen in which a display device vertically divides.

9 illustrates an example in which the display device 100 merges vertically divided screens, the display device 100 may use a gesture input that is the same as the gesture input illustrated in FIG. 9, It will be apparent to those of ordinary skill in the art that the invention can be combined. In FIG. 9, a detailed description of the same parts as those described in FIGS. 1 to 8 will be omitted.

First, the display device 100 in a screen-divided state can activate a screen merging function of the flexible display 110. [ In one embodiment, when a user input for activating the screen merging function is sensed, the display device 100 may activate the screen merging function. For example, as shown on the left side of FIG. 9, a first user input (e.g., a double touch input, a multi touch input, a long touch input) for the first input region 132 of the user interface long) touch input) is detected, the display device 100 can activate the screen merging function.

When the screen merging function is activated, the display apparatus 100 can detect a second user input (e.g., a touch gesture input or a motion gesture input) for screen merging. In one embodiment, the display device 100 may sense a second user input for a predetermined period of time (e.g., 5 seconds after the screen merging function is activated). 9, the display device 100 may enlarge the size of the first input area 132 and enlarge the size of the second input area 232 for the enlarged first input area 232. For example, when the screen merge function is activated, User input (e.g., rubbing gesture input).

When the second user input is detected, the display device 100 may merge all or part of the divided screen based on the second user input. 9, when the rubbing gesture input rubbing the first vertical area and the second vertical area of the enlarged first entry area 242 is sensed, the display device 100 displays the entire divided screen Can be merged. 9, when the first input area 132 is divided into the first vertical area, the second vertical area and the third vertical area, the second vertical area and the third vertical area are rubbed When the rubbing gesture input is detected, the display device 100 may merge only the second vertical screen corresponding to the second vertical area and the third vertical screen corresponding to the third vertical area. In this case, the flexible display 110 is finally divided into two vertical screens.

As such, the display device 100 can provide a more intuitive user interface to the user by providing the divided screen of the flexible display 110 using the gesture input of the user.

10 is a flowchart illustrating a method of controlling a display device according to an embodiment of the present invention. In FIG. 10, a detailed description of the same parts as those described in FIGS. 1 to 9 will be omitted.

Referring to FIG. 10, the control method includes determining (S10) a split axis based on a first gesture input sensed by the sensor unit. In one embodiment, the display device may determine the split axis based on the direction of the input trajectory of the first gesture input. For example, the display device may determine whether the split axis is a horizontal axis or a vertical axis based on the direction of the input trajectory of the first gesture input. 3 to 4, detailed description thereof will be omitted.

In addition, the control method includes determining (S20) the number of divisions based on at least one second gesture input detected by the sensor unit after the first gesture input is sensed. In one embodiment, the display device may obtain the number of intersections between the input trajectory of the first gesture input and the input trajectory of each of the one or more second gesture inputs, and determine the number of divisions based on the number of intersections. In this case, the display apparatus can determine one more number than the number of intersections as the number of divisions. 3 to 4, detailed description thereof will be omitted.

In addition, the control method includes dividing the screen of the flexible display according to the determined division axis and the number of division (S30). In one embodiment, when the screen of the flexible display is divided, the display device may display the same execution screen as the execution screen displayed on the screen prior to being divided into the divided screens. In addition, when the screen of the flexible display is divided, the display device can display the state of the screen division. In one embodiment, the display device may display the status of the screen division in the first input area of the user interface. 3 to 4, detailed description thereof will be omitted.

11 is a flowchart showing a control method of a display apparatus according to another embodiment of the present invention. In FIG. 11, a detailed description of the same parts as those described in FIGS. 1 to 10 will be omitted. Particularly, steps S10, S20, and S30 in FIG. 11 are the same as those in FIG. 10, so that a detailed description thereof will be omitted.

Referring to FIG. 11, the control method may further include a step S1 of activating a screen division function of the display device before the step S10 of determining the division axis. In one embodiment, the display device may activate the split screen function when user input to the first input area in the user interface is detected. The step S1 of activating the screen dividing function may include a step of enlarging the first input area when the screen dividing function is activated and outputting a first gesture input to the enlarged first input area and a second gesture input using the sensor unit, The method may further include detecting gesture input. 3 to 4, detailed description thereof will be omitted.

As such, the control method of the display device can be implemented in an application or can be implemented in the form of program instructions that can be executed through various computer components and recorded on a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, and the like, alone or in combination. Program instructions that are recorded on a computer-readable recording medium may be those that are specially designed and constructed for the present invention and are known and available to those skilled in the art of computer software.

Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. A hardware device may be configured to operate as one or more software modules to perform processing in accordance with the present invention, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.

In this specification, both the invention and the method invention are explained, and the description of both inventions can be supplemented as necessary.

100: Display device 110: Flexible display
120: sensor unit 130: user interface unit
140:

Claims (26)

A flexible display capable of screen division;
A sensor unit for sensing a user input including a gesture input; And
Determining a division axis based on the first gesture input and determining a division number based on the at least one second gesture input sensed after the first gesture input, And a controller for dividing the display device. The method according to claim 1,
Wherein,
And determines the split axis based on a direction of an input trajectory of the first gesture input. 3. The method of claim 2,
Wherein,
Obtains the number of intersections between the input trajectory of the first gesture input and the input trajectory of each of the one or more second gesture inputs, and determines the number of divisions based on the number of intersection points. The method of claim 3,
Wherein,
And determines one more number than the number of the intersections as the number of divisions. The method according to claim 1,
The sensor unit includes:
A touch sensor that senses a touch input of the user, and a motion sensor that senses a motion input of the user. The method according to claim 1,
And a user interface unit including at least one input area in which the user input is sensed. The method according to claim 6,
The user interface unit,
Wherein the display device is located at the upper or lower end of the flexible display. The method according to claim 6,
Wherein,
And activates a screen division function of the display device when a user input to the first input area in the user interface unit is sensed. 9. The method of claim 8,
Wherein,
Enlarges the first input area when the screen dividing function is activated, and detects the first gesture input and the second gesture input for the enlarged first input area using the sensor unit. The method according to claim 6,
Wherein,
And activates a screen selection function or a screen merging function of the display device when a first user input to the first input area in the user interface unit is sensed in a state that the screen of the flexible display is divided. 11. The method of claim 10,
Wherein,
Enlarges the first input area when the screen selection function is activated and detects a second user input for the enlarged first input area using the sensor unit. 12. The method of claim 11,
Wherein,
Selects at least one of the divided screens based on the second user input and senses a third user input to the second input area in the interface unit using the sensor unit. 13. The method of claim 12,
Wherein,
And controls the selected screen based on the third user input. 11. The method of claim 10,
Wherein,
Enlarges the first input area when the screen merging function is activated, and senses a third gesture input to the enlarged first input area using the sensor unit. 15. The method of claim 14,
Wherein,
And merges the divided screens based on the third gesture input. The method according to claim 1,
Characterized in that the flexible display is fixed in a bent state. 17. The method of claim 16,
Wherein the flexible display is a cylindrical display. Determining a split axis based on the first gesture input sensed by the sensor portion;
Determining a number of divisions based on at least one second gesture input sensed by the sensor unit after the first gesture input is sensed; And
And dividing the screen of the flexible display according to the division axis and the division number. 19. The method of claim 18,
Wherein determining the split axis comprises:
And determines the split axis based on a direction of an input trajectory of the first gesture input. 19. The method of claim 18,
The step of determining the number of divisions includes:
Acquiring the number of intersections between the input trajectory of the first gesture input and the input trajectory of each of the one or more second gesture inputs, and determining the number of divisions based on the number of intersection points. 21. The method of claim 20,
The step of determining the number of divisions includes:
And determines one more number than the number of the intersections as the number of divisions. 19. The method of claim 18,
The sensor unit includes:
A touch sensor that senses a touch input of a user, and a motion sensor that senses a motion input of the user. 19. The method of claim 18,
Prior to determining the split axis,
Further comprising the step of activating a screen division function of the display device. 24. The method of claim 23,
Wherein the step of activating the screen division function comprises:
And activates the screen division function when a user input to the first input area in the user interface is sensed. 25. The method of claim 24,
Wherein the step of activating the screen division function comprises:
And enlarging the first input area when the screen division function is activated and sensing the first gesture input and the second gesture input for the enlarged first input area using the sensor unit Of the display device. A computer-readable recording medium on which a computer program is recorded, for carrying out a control method of a display device according to any one of claims 18 to 25.
KR1020150074898A 2015-05-28 2015-05-28 Display device having splitable display, controlling method thereof and recording medium for performing the method KR101726576B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150074898A KR101726576B1 (en) 2015-05-28 2015-05-28 Display device having splitable display, controlling method thereof and recording medium for performing the method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150074898A KR101726576B1 (en) 2015-05-28 2015-05-28 Display device having splitable display, controlling method thereof and recording medium for performing the method

Publications (2)

Publication Number Publication Date
KR20160139647A true KR20160139647A (en) 2016-12-07
KR101726576B1 KR101726576B1 (en) 2017-04-14

Family

ID=57572919

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150074898A KR101726576B1 (en) 2015-05-28 2015-05-28 Display device having splitable display, controlling method thereof and recording medium for performing the method

Country Status (1)

Country Link
KR (1) KR101726576B1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101861098B1 (en) * 2017-02-21 2018-05-29 한국과학기술연구원 Cylindrical display device including detachable physical control interface, control method thereof and recording medium for performing the method
CN109446850A (en) * 2018-10-30 2019-03-08 维沃移动通信有限公司 A kind of display control method and terminal
CN110177174A (en) * 2019-05-24 2019-08-27 Oppo广东移动通信有限公司 Display processing method, device, mobile terminal and storage medium
KR20200070221A (en) * 2018-12-06 2020-06-17 강태호 Smart remote control for controlling devices using touch patterns and control method for smart remote control
KR20200070220A (en) * 2018-12-06 2020-06-17 강태호 Touch interface device and control method
WO2021208172A1 (en) * 2020-04-13 2021-10-21 安伟 Scroll-type mobile phone with flexible foldable screen

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101987142B1 (en) 2017-06-30 2019-06-10 한국과학기술연구원 Apparatus and method for output image corresponding to 3-dimensional space using transparent displays
KR102403195B1 (en) * 2017-09-29 2022-05-27 삼성디스플레이 주식회사 Touch sensor and display device including the same

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120093148A (en) 2009-07-10 2012-08-22 로엘 버티갈 Interaction techniques for flexible displays
KR101426430B1 (en) * 2013-04-05 2014-08-05 주식회사 엘지유플러스 Mobile terminal and method for controlling the same
KR20140124278A (en) * 2013-04-16 2014-10-24 삼성전자주식회사 Method for adjusting display area and an electronic device thereof
KR20140141305A (en) * 2013-05-31 2014-12-10 삼성전기주식회사 A mobile phone to separate screen and controlling method thereof

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120093148A (en) 2009-07-10 2012-08-22 로엘 버티갈 Interaction techniques for flexible displays
KR101426430B1 (en) * 2013-04-05 2014-08-05 주식회사 엘지유플러스 Mobile terminal and method for controlling the same
KR20140124278A (en) * 2013-04-16 2014-10-24 삼성전자주식회사 Method for adjusting display area and an electronic device thereof
KR20140141305A (en) * 2013-05-31 2014-12-10 삼성전기주식회사 A mobile phone to separate screen and controlling method thereof

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101861098B1 (en) * 2017-02-21 2018-05-29 한국과학기술연구원 Cylindrical display device including detachable physical control interface, control method thereof and recording medium for performing the method
CN109446850A (en) * 2018-10-30 2019-03-08 维沃移动通信有限公司 A kind of display control method and terminal
KR20200070221A (en) * 2018-12-06 2020-06-17 강태호 Smart remote control for controlling devices using touch patterns and control method for smart remote control
KR20200070220A (en) * 2018-12-06 2020-06-17 강태호 Touch interface device and control method
CN110177174A (en) * 2019-05-24 2019-08-27 Oppo广东移动通信有限公司 Display processing method, device, mobile terminal and storage medium
WO2021208172A1 (en) * 2020-04-13 2021-10-21 安伟 Scroll-type mobile phone with flexible foldable screen

Also Published As

Publication number Publication date
KR101726576B1 (en) 2017-04-14

Similar Documents

Publication Publication Date Title
KR101726576B1 (en) Display device having splitable display, controlling method thereof and recording medium for performing the method
US10579205B2 (en) Edge-based hooking gestures for invoking user interfaces
US11586339B2 (en) Electronic device having flexible display screen and processing method thereof
US9250729B2 (en) Method for manipulating a plurality of non-selected graphical user elements
AU2013203010B2 (en) Flexible display apparatus and operating method thereof
KR102582541B1 (en) Method and electronic apparatus for touch input via edge screen
US20130290887A1 (en) Method and terminal for displaying a plurality of pages,method and terminal for displaying a plurality of applications being executed on terminal, and method of executing a plurality of applications
KR20130069066A (en) Display apparatus and display method thereof
KR20170062954A (en) User terminal device and method for display thereof
CN112969986A (en) On-screen keyboard for multi-form factor information processing system
KR20140016082A (en) Flexible display apparatus and display method thereof
CN114153407A (en) Method and device for displaying application
US9965141B2 (en) Movable selection indicators for region or point selection on a user interface
US11366579B2 (en) Controlling window using touch-sensitive edge
US20160154474A1 (en) Electronic apparatus and method for displaying graphical object thereof
EP3356920B1 (en) Electronic device for displaying multiple screens and control method therefor
US20140240232A1 (en) Automatic Cursor Rotation
JP6349015B2 (en) Display method for touch input device
KR20150095533A (en) Electronic apparatus and index display method thereof
US11221754B2 (en) Method for controlling a display device at the edge of an information element to be displayed
KR102179438B1 (en) Display apparatus and display method thereof
EP3128397B1 (en) Electronic apparatus and text input method for the same
KR20140119439A (en) Device for displaying map using touch screen and providing method thereof

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant