WO2017086689A1 - Electronic device and control method therefor - Google Patents

Electronic device and control method therefor Download PDF

Info

Publication number
WO2017086689A1
WO2017086689A1 PCT/KR2016/013195 KR2016013195W WO2017086689A1 WO 2017086689 A1 WO2017086689 A1 WO 2017086689A1 KR 2016013195 W KR2016013195 W KR 2016013195W WO 2017086689 A1 WO2017086689 A1 WO 2017086689A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
display area
touch
area
size
Prior art date
Application number
PCT/KR2016/013195
Other languages
French (fr)
Korean (ko)
Inventor
조규현
정희석
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US201562256889P priority Critical
Priority to US62/256,889 priority
Priority to KR10-2016-0013523 priority
Priority to KR1020160013523A priority patent/KR20170058223A/en
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Priority claimed from US15/775,194 external-priority patent/US20180374452A1/en
Publication of WO2017086689A1 publication Critical patent/WO2017086689A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09FDISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F9/00Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
    • G09F9/30Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements

Abstract

An electronic device and a control method therefor are provided. The electronic device comprises: a housing including a roll; a touch display which is wound on a roll, is capable of changing the size of a display area according to the rotation of the roll, and detects a touch of a user; a sensing part for sensing the size of the display area; and a processor which is electrically connected to the display and the sensing part, wherein if the size of the display area increases by the rotation of the roll while a user touch is detected in one area of the touch display while an execution screen of an application is being provided in the display area, the processor may control the touch display so as to provide new information to the display area.

Description

Electronic device and control method thereof

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an electronic device and a control method thereof, and more particularly, to an electronic device including a display which is wound by a roll and whose size of the display area is changed by the rotation of the roll.

Recently, display devices have become an important device among electronic products. Electronic devices having such display devices are becoming smaller in size. In contrast, many consumers demand large screens. Therefore, recently, research and development on a flexible display that can be wrapped around an electronic device or a screen are being actively performed.

In particular, research on a rollable display that can be rolled up like a scroll has been actively studied recently, and an electronic device equipped with a rollable display is expected to be commercialized in the near future.

An object of the present disclosure is to provide an electronic device for providing new information to a display in which a display area is changed when a touch and rolling interaction or a touch and unrolling interaction is input, and a control method thereof.

According to an embodiment of the present disclosure, an electronic device includes a housing including a roll; A touch display wound around the roll and configured to change a size of a display area according to rotation of the roll, and to sense a user touch; A detector configured to detect a size of the display area; And a processor electrically connected to the display and the sensing unit, wherein the processor is configured to display the roll of the roll in a state where a user touch is sensed on an area of the touch display while an execution screen of an application is provided on the display area. When the size of the display area is increased by rotation, the touch display may be controlled to provide new information to the display area.

On the other hand, according to an embodiment of the present disclosure for achieving the above object, the housing including the roll and the roll is wound, the size of the display area can be changed according to the rotation of the roll, at least one of the display area A control method of an electronic device having a touch display that displays a screen including components of the method includes providing an execution screen of an application on the display area; Detecting an increase in the size of the display area by rotating the roll when a user touch is detected in one area of the touch display; And providing new information along with an execution screen of the application on the display area.

As described above, when the display area is expanded through various interactions, the user's usability may be improved by providing new information.

1 is a view for explaining an embodiment in which new information is provided as a size change of a display area of an electronic device occurs after a user touch is detected in the display area according to an embodiment of the present disclosure;

2A and 2B illustrate an electronic device having a rollable display according to one embodiment of the present disclosure;

3A and 3B are block diagrams illustrating a hardware configuration of an electronic device according to an embodiment of the present disclosure;

4A and 4B are diagrams for describing various embodiments of providing new information according to a location where a user touch is detected, according to an embodiment of the present disclosure;

5 is a view for explaining an embodiment in which a display area is increased in a state where a user touch is not detected, according to an embodiment of the present disclosure;

6A and 6B are diagrams for describing various embodiments of a user touch detected position when a display area is reduced according to one embodiment of the present disclosure;

7 is a view for explaining an embodiment in which a display area is reduced in a state where a user touch is not detected, according to an embodiment of the present disclosure;

8 and 9 are diagrams for describing an exemplary embodiment in which a screen displayed on a display area is changed according to a user interaction according to one embodiment of the present disclosure;

10 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure.

Hereinafter, the present disclosure will be described with reference to the accompanying drawings. While the present disclosure has been described in particular embodiments by way of example in the drawings and related details, various changes may be made and various embodiments may be made. Accordingly, the present disclosure is not intended to be limited to the specific embodiments and should be understood to include all changes or equivalents and substitutes included in the spirit and technical scope of the present disclosure. In the description of the drawings, like reference numerals refer to like elements.

Expressions of "comprises", "may include", etc., which may be used in the present disclosure, refer to the existence of the disclosed corresponding function, operation, component, and the like, and do not limit the additional one or more functions, operations, components, etc. Also, in the present disclosure, terms such as “comprise” or “having” are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more. It is to be understood that it does not exclude in advance the possibility of the presence or addition of other features or numbers, steps, operations, components, components or combinations thereof.

In addition, the expression “and / or” in the present disclosure includes any and all combinations of words listed together. For example, A and / or B may include A, may include B, or may include both A and B.

In addition, the expressions “first”, “second”, “first”, “second”, and the like in the present disclosure may modify various elements of the present disclosure, but do not limit the corresponding elements. For example, the above expressions do not limit the order and / or importance of the corresponding elements. The above expressions may be used to distinguish one component from another. For example, both a first user device and a second user device are user devices and represent different user devices. For example, without departing from the scope of the present disclosure, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between. The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present disclosure. Singular expressions include plural expressions unless the context clearly indicates otherwise.

Also, in the present disclosure, the user interaction may include at least one of touch interaction, rolling interaction, unrolling interaction, touch and rolling interaction, touch and unrolling interaction, bending interaction, voice interaction, button interaction, motion interaction, and multimodal interaction. It may include one, but is not limited thereto.

In particular, in the present disclosure, a "rolling interaction" is an interaction in which the flexible display is wound to reduce the display area of the flexible display, and may be an interaction in which the flexible display enters the housing of the electronic device by the rotation of the roll. In addition, in the present disclosure, “unrolling interaction” is an interaction in which the flexible display is unfolded to increase the display area of the flexible display, and may be an interaction in which the flexible display is drawn out to the housing of the electronic device by the rotation of the roll. In addition, the “touch and rolling interaction” or “touch and unrolling interaction” may be an interaction in which the flexible display is drawn into or taken out of the housing of the electronic device by the rotation of the roll while the user touches the flexible display.

In addition, in this disclosure, an “application” refers to a set of computer programs designed to perform a particular task. In the present disclosure, applications may vary. For example, web applications, game applications, video playback applications, map applications, memo applications, calendar applications, phone book applications, broadcast applications, exercise support applications, payment applications, photo folder applications, medical device control applications, multiple medical devices There may be a user interface providing application, but is not limited thereto.

In addition, in the present disclosure, “layout” may refer to the number of components constituting the screen, the position of the components, and a display method of display items within the components. That is, the change in the layout of the screen means that the number of components constituting the screen is changed, the position of the components is changed, or the display method of display items within the components is changed (for example, video content is changed to an icon). Can mean. In this case, the position of the component may be a relative position between the components.

Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings. 1 is a diagram for describing an example of providing an execution screen of an application according to the size of a display area of the electronic device 100 according to an embodiment of the present disclosure. On the other hand, according to an embodiment of the present invention, the electronic device 100 may be a mobile terminal such as a smart phone, but this is only one embodiment, various electronics such as a tablet PC, notebook PC, desktop PC, digital TV, etc. It may be implemented as a device.

The electronic device 100 may display a screen including at least one component. Here, the screen may be various screens such as an application execution screen, a menu screen, a lock release screen, and the like. In addition, the at least one component may include various components such as content, icons, text, widgets, graphic items (eg, progress bar, etc.). For example, as shown in FIG. 1A, the electronic device 100 may display an execution screen of an application.

Meanwhile, as illustrated in FIG. 1, the electronic device 100 according to an embodiment of the present disclosure includes a left housing 110-1, a right housing 110-2, and a rollable touch display 120. do. In particular, the left housing 110-1 may include a roll 115 through which the display 120 may be wound and an opening 117 through which the display 120 may be retracted / retracted, as shown in FIG. 2A. The right housing 110-2 may be combined with the display 120 to be integrally formed.

In addition, the display 120 may be drawn in / drawn out through the opening 117 according to the rotation of the roll. When the display 120 is drawn through the opening 117, the display area of the display 120 may decrease, and when the display 120 is drawn through the opening 117, the display area of the display 120 May increase. In this case, the rotation of the roll may be performed by a user interaction in which the user pulls or pushes the right housing 110-2, but this is only an example and may be automatically performed by a driving unit for driving the roll. .

Meanwhile, in the above-described embodiment, the rotation of the roll is made through an interaction of pulling or pushing only the right housing 110-2, but this is only an example, and is applied to both housings 110-1 and 110-2. The roll may be provided to rotate the roll through an interaction of pulling or pushing at least one of the two housings 110-1 and 110-2.

In addition, although not illustrated in FIG. 2A, the electronic device 100 may include a configuration for fixing the curled state of the display 120 and the unfolded state of the display 120.

In particular, when the unrolling interaction of the user is input, the electronic device 100 may withdraw the display from the housing of the electronic device 100 according to the rotation of the roll according to the unrolling interaction. Alternatively, when a rolling interaction of the user is input, the electronic device 100 may lead the display into the housing of the electronic device 100 according to the rotation of the roll according to the rolling interaction.

In particular, when the size of the display area is increased by the rotation of the roll while the user touch is detected in one area of the touch display while the execution screen of the application is provided in the display area, the electronic device 100 may change the display area to the new display area. Information can be provided. In this case, the new information may include various information such as a UI including at least one item for controlling the electronic device 100, a UI related to an executed application, notification information, history information, and the like.

In detail, as illustrated in FIG. 1A, the electronic device 100 may display an execution screen 50 of an application (eg, a video application). In addition, when a touch and unrolling interaction in which the size of the display area is increased by the rotation of the roll in the state of touching one region of the touch display 120 is detected, the electronic device 100 is illustrated in FIG. 1B. As described above, the UI 70 including an item for controlling the electronic device 100 may be displayed together with the execution screen 50 of the existing application.

At this time, the UI 70 including the item for controlling the electronic device 100 may determine a position to be displayed according to the area where the user touch is detected. For example, when the size of the display area is increased by the rotation of the roll while the user touches the right area of the touch display 120, the electronic device 100 may determine the left area that is the opposite side to the area where the user touch is detected. New information can be displayed at.

In addition, the UI 70 including the item for controlling the electronic device 100 may increase in size to correspond to the increased size of the display area. That is, while the size of the execution screen 50 of the previously displayed application is maintained, the size of the UI 70 including items for controlling the electronic device 100 may be increased by the size of the increased display area.

Meanwhile, when the size of the display area is increased by the rotation of the roll without the user's touch while the execution screen of the application is displayed on the touch display 120 of the electronic device 100, the electronic device 100 executes the execution of the existing application. The size of the screen can be increased in proportion to the increased display area. In addition, when the size of the increased display area is increased by more than a predetermined size, the electronic device 100 may change and display the layout of the execution screen of the existing application. In this case, changing the layout may mean that the relative arrangement of the components included in the screen is changed, the number of components is changed, or the display form of the components is changed.

3A is a block diagram schematically illustrating a configuration of an electronic device 100 according to an embodiment of the present disclosure. As shown in FIG. 3A, the electronic device 100 includes a touch display 120, a detector 130, and a processor 140.

The touch display 120 displays image data. In particular, the touch display 120 may be implemented as a flexible display. In addition, the touch display 120 may be drawn into or out of the housing 110 of the electronic device 100 according to the rotation of the roll provided in the housing 110 of the electronic device 100.

When the touch display 120 is drawn in or pulled out according to the rotation of the roll, the display area of the touch display 120 may be changed according to the rotation of the roll. In detail, when the touch display 120 is drawn into the housing according to the rotation of the roll, the display area of the touch display 120 may be reduced. In addition, when the touch display 120 is drawn out to the housing as the roll rotates, the display area of the touch display 120 may increase.

In addition, the touch display 120 may display a screen including at least one component under the control of the processor 140. For example, the display 120 may display an execution screen of an application (eg, a web application, a camera application, a gallery application, a message application, etc.) including a plurality of contents and icons. In addition, the display 120 may display a standby screen including a plurality of widgets and a plurality of icons. In addition, the display 120 may display an unlock screen including a plurality of widgets and an unlock icon.

Also, the touch display 120 may detect a user touch for controlling the electronic device 100. In particular, the touch display 120 may include a display panel for outputting an image and a touch panel for sensing a user touch.

The sensing unit 130 may include various sensors, and may transmit information collected by each sensor to the processor 140. In particular, the sensing unit 130 may include a sensor for detecting the withdrawal amount of the display 120 according to the rotation of the roll. Specifically, referring to FIG. 2B, the left housing 110-1, the display 120, and the sensing unit 130 are illustrated. The display 1603 may be wound into the left housing 110-1 or drawn out of the left housing 110-1. The extraction direction of the display 120 may be a lower direction 200. The sensing unit 130 may be an optical sensor and may detect the pattern 131 printed on the display 120. The pattern 131 may be a QR code, a barcode, a black and white pattern, or a color pattern corresponding to the pixel line of the display 120. As the display 120 is extracted, the value of the pattern 131 printed on the display 120 may be changed. The processor 140 may detect the withdrawal amount of the display 120 according to the changed value of the pattern 131.

Meanwhile, the above-described embodiment is merely an example, and the withdrawal amount of the display 120 may be determined in various ways. For example, the withdrawal amount of the display 120 may be determined through a motion sensor such as a gyro sensor, and the withdrawal amount of the display 120 may be determined through a rotation detection sensor that detects rotation of a roll.

The processor 140 is electrically connected to the display 120 and the sensing unit 130, and controls the overall operation of the electronic device 100. Specifically, when the size of the display area is increased by the rotation of the roll while the user touch is detected in one area of the touch display 120 while the execution screen of the application is provided in the display area, the processor 140 displays the display. The touch display 120 may be controlled to provide new information to the area. In particular, the processor 140 may control the touch display 120 to provide new information in the display area while maintaining the size of the execution screen of the application. That is, the processor 140 may control the touch display 120 to increase the size of the area providing new information according to the size of the increased display area while maintaining the size of the execution screen of the application.

In addition, the processor 140 may control the touch display 120 to provide new information at a position opposite to the area where the user touch is detected. For example, when the size of the display area is increased by the rotation of the roll 115 while the user touch touches the right area of the touch display 120, the processor 140 may display new information in the left area of the display area. The touch display 120 may be controlled to provide. In addition, when the size of the display area is increased by the rotation of the roll 115 while the user touch touches the left area of the touch display 120, the processor 140 provides new information to the right area of the display area. The touch display 120 can be controlled.

On the other hand, when the size of the display area is increased by the rotation of the roll 115 while a user touch is not detected in one area of the touch display 120 while the execution screen of the application is provided in the display area, the processor 140 ) May not display new information and may control the touch display 120 to increase the size of an execution screen of an application provided in the display area as the display area size increases.

That is, when the size of the display area is increased by the rotation of the roll 115, the processor 140 may provide a screen having a different layout to the user depending on whether the user touch is detected.

In addition, when the size of the display area is reduced by the rotation of the roll while the user touch is detected while the execution screen of the application and new information are displayed on the display area, the processor 140 may determine the position of the area where the user touch is detected. The touch display 120 may be controlled to provide a different screen according to the method.

For example, when the size of the display area is reduced by the rotation of the roll 115 in a state where a user touch is detected in an area where an execution screen of an application is provided, the processor 140 may display only the execution screen of the application in the display area. The touch display 120 may be controlled to provide. In addition, when the size of the display area is reduced by the rotation of the roll 115 in a state where a user touch is detected in an area where new information is provided, the processor 140 may provide only the new information to the display area. ) Can be controlled.

In addition, when the size of the display area is reduced by the rotation of the roll while the user's touch is not detected on the touch display while the execution screen and new information of the application are displayed on the display area, the processor 140 may determine the size of the display area. As the size decreases, the touch display 120 may be controlled to reduce the size of the execution screen and new information.

In addition, when a drag interaction is detected in an area where new information is displayed while the execution screen of the application and new information are displayed on the display area, the processor 140 may provide other information in the area where the new information is displayed. Can be controlled.

3B is a detailed block diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure. As shown in FIG. 3B, the electronic device 100 may include a sensing unit 130, a processor 140, a memory 150, a driving module 160, a user input module 170, a touch display 120, and communication. Module 180 and bus 190. On the other hand, the configuration shown in Figure 3b is only one embodiment, according to the implementation may add a new component, and may delete at least one component.

The processor 140, for example, the other components (eg, the memory 150, the driving module 160, the user input module 170, the touch display 120, the communication module 160 via the bus 190). Command), the received command can be decrypted, and an operation or data processing according to the decrypted command can be executed.

In addition, the processor 140 controls overall operations of the electronic device 100. In particular, the processor 140 may change one of the size and the layout of the component according to the change of the display area detected by the detector 130. The processor 140 may be implemented by at least one of a graphics processing unit (GPU), a central processing unit (CPU), and an application processor (AP), and may also be implemented as one chip.

The memory 150 is received from the processor 140 or other components (eg, the drive module 160, the user input module 170, the display 120, the communication module 160, etc.) or the processor 140 or It may store instructions or data generated by other components. The memory 150 may include, for example, programming modules such as a kernel 151, middleware 152, an application programming interface (API) 153, or an application 154. Each of the aforementioned programming modules may be composed of software, firmware, hardware, or a combination of two or more thereof.

Meanwhile, the memory 150 may be implemented with various memories. For example, the memory may be implemented as internal memory (for example, volatile memory (DRAM, SRAM) or nonvolatile memory (OTPROM, PROM, etc.) or external memory (for example, flash drive, CD, SD, etc.). Can be.

The drive module 160 is a module capable of driving the rotation of the roll 115 to roll or unfold the display. In this case, the driving module 160 may automatically rotate the roll 115 according to a user command input through the user input module 170 and semi-automatically according to the external force (push and pull) of the user input to the housing. The roll 115 may be rotated. In addition, the driving module 160 may roll or unfold the display through a driving method other than rotation of the roll.

In this case, the driving module 160 may be implemented as a circuit for controlling the motor and the motor, but this is only an example and may be implemented in another configuration.

For example, the user input module 170 may receive a command or data from a user and transfer the command or data to the processor 140 or the memory 150 through the bus 190.

The user input module 170 may include various user input devices such as a (digital) pen sensor, a key or an ultrasonic input device, a keyboard, a mouse, a voice input device, a point device, a remote control signal receiver, and the like. Can be.

The touch display 120 may display an image, an image, or data to a user. In particular, the touch display 120 may be implemented as a liquid-crystal display (LCD) or an active-matrix organic light-emitting diode (AM-OLED) or the like, and may be flexible, transparent, or wearable. It may be implemented wearable.

In addition, the touch display 120 may include a display panel and a touch panel.

The communication module 180 may connect communication between the other electronic device 192 and the electronic device 100, and communicate with the other electronic device 193 and the server 194 through the network 191. The communication module 180 may include a predetermined short range communication protocol (eg, Wifi (wireless fidelity), BT (Bluetooth), near field communication (NFC), or predetermined network communication (eg, Internet, a local area network (LAN), a WAN ( wire area network, telecommunication network, cellular network, satellite network, or plain old telephone service (POTS), etc. Each of the electronic devices 192 and 193 may be the same (eg, the same type) device as the electronic device 100. Or another (eg, other type) device.

In particular, the communication module 180 may receive a data about a web application by performing a communication connection with an external server 194 through the network 191.

The sensing unit 130 may include various sensors such as a gyro sensor, a gesture sensor, a grip sensor, and an acceleration sensor, and provides information collected by each sensor to the processor 140 in predetermined time units.

In particular, the detector 130 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, an RGB (red, green, blue) sensor, a biometric sensor, temperature / humidity, and the like. It may include at least one of a sensor, an illumination sensor, or an ultraviolet (ultra violet) sensor. The detector 130 may measure a physical quantity or detect an operation state of the electronic device to convert the measured or detected information into an electrical signal. The sensing unit 130 may further include a control circuit for controlling at least one or more sensors belonging thereto. In addition, the sensing unit 130 may include various sensors for detecting the rotation of the roll.

The bus 190 may be a circuit connecting the aforementioned components to each other and transferring a communication signal (eg, a control message) between the aforementioned components.

The term “unit” or “module” as used in the present disclosure may refer to a unit including one or a combination of two or more of hardware, software, or firmware. The term “unit” or “module” may be used interchangeably with terms such as, for example, logic, logical block, component, or circuit. The "unit" or "module" may be a minimum unit or part of an integrally constructed part. The module may be a minimum unit or part of performing one or more functions. The "module" can be implemented mechanically or electronically. For example, a “module” in accordance with the present disclosure may be an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs), or programmable logic devices that perform certain operations, known or developed in the future. logic device).

Hereinafter, the present disclosure will be described in more detail with reference to FIGS. 4A to 9. 4A to 5 are diagrams for describing an exemplary embodiment in which new information is provided depending on whether a user touch is present when the size of the display area increases due to an unrolling interaction.

First, as shown in (a) of FIG. 4A, the processor 140 controls the touch display 120 to display an execution screen of a video application.

In addition, the processor 140 may detect a user touch touching the left area of the touch display 120 through the detector 130, and detect a touch and unrolling interaction in which the user extends the display area in the right direction. have.

When a touch and unrolling interaction is detected, the processor 140 displays a UI 420 including execution icons capable of executing another application, in the right region of the touch display, as shown in FIG. 4A (b). The touch display 120 can be controlled.

That is, when the display area is increased by the rotation of the roll 115 while the user touches the left area of the touch display 120, the processor 140 may display new information on the right area of the touch display 120. Can be.

If the display area is increased by the rotation of the roll 115 while the user touches the left area of the touch display 120, the processor 140 maintains the size of the execution screen 410 of the existing video application. The touch display 120 may be controlled to gradually increase the size of the UI 420 including the execution icons as the display area increases. In this case, the UI 420 including the execution icons may be gradually increased as the display area is increased, but this is only an example. When the size of the display area is larger than the preset size, the UI including the execution icons is included. 420 may be displayed.

In addition, as shown in (a) of FIG. 4B, the processor 140 controls the touch display 120 to display the execution screen 410 of the video application.

In addition, the processor 140 may detect a user touch touching the right area of the touch display 120 through the detector 130, and detect a touch and unrolling interaction in which the user extends the display area in the left direction. have.

When a touch and unrolling interaction is detected, the processor 140 displays a UI 420 'including execution icons capable of executing another application as shown in (b) of FIG. 4B in the left region of the touch display. The touch display 120 may be controlled to display.

That is, when the display area is increased by the rotation of the roll 115 while the user touches the right area of the touch display 120, the processor 140 may display new information on the left area of the touch display 120. The touch display 120 may be controlled.

4A and 4B illustrate that the same UI is displayed even if the area in which the new information is displayed is different, this is only an example, and different UIs may be displayed according to the area in which the new information is displayed. For example, if the display area is increased by the rotation of the roll 115 while the user touches the right area of the touch display 120, the processor 140 may execute a first UI (eg, an application). The touch display 120 may be controlled to display a UI including an executable icon) in the left area. When the display area is increased by the rotation of the roll 115 while the user touches the left area of the touch display 120, the processor 140 may control the second UI (eg, the electronic device 100). The touch display 120 may be controlled to display a UI including an icon which may be displayed in the right area.

4A and 4B illustrate that new information is displayed in an area opposite to a point where a user touch is detected, but this is only an example, and new information is displayed in an area corresponding to the point where the user touch is detected. Can be.

In addition, when the size of the display area is increased by the rotation of the roll 115 in a state in which the user touch is not detected on the touch display 120, the processor 140 does not display new information and executes the currently displayed application. The touch display 120 may be controlled to increase the size of the screen.

Specifically, as shown in FIG. 5A, the processor 140 controls the touch display 120 to display the execution screen 510 of the video application.

In addition, the processor 140 may detect an unrolling interaction in which the size of the display area is increased in both directions in the state where the user touch is not detected on the touch display 120 through the sensing unit 130.

When the unrolling interaction is detected, the processor 140 does not display new information, as shown in FIG. 5B, and executes the execution screen 510 ′ of the application currently displayed according to the increased display area size. The touch display 120 may be controlled to increase the size of the touch display 120.

That is, when the size of the display area increases as the roll 115 rotates, the processor 140 may control the touch display 120 to provide a screen having a different layout depending on whether the user touches the touch screen.

6A to 7 are diagrams for describing an exemplary embodiment in which new information is provided depending on the presence or absence of a user touch when the size of the display area is reduced by the rolling interaction.

First, as illustrated in (a) of FIG. 6A, the processor 140 may display a UI 620 including an execution screen 610 of a video application and an execution icon for executing an application. To control.

In addition, the processor 140 may detect a user's touch of touching the right area on which the UI 620 including the execution icon is displayed through the sensor 130, and detect a touch and rolling interaction that reduces the display area. .

When the touch and rolling interaction is detected, the processor 140 may remove the execution screen 610 of the video application and include UI icons for executing another application as shown in FIG. 6A (b). The touch display 120 may be controlled to display only 620 '. In this case, the UI 620 ′ including execution icons capable of executing another application may be changed according to the size of the reduced display area.

In addition, as shown in (a) of FIG. 6B, the processor 140 may display the UI 620 including an execution screen 610 of a video application and an execution icon for executing the application. To control.

In addition, the processor 140 may detect a user touch on a left region on which the execution screen 610 of the video application is displayed through the sensing unit 130, and sense a touch and rolling interaction that reduces the display area.

When a touch and rolling interaction is detected, the processor 140 removes the UI 620 including execution icons capable of executing another application, as shown in FIG. 6B (b), and displays the execution screen of the video application. The touch display 120 may be controlled to display only 610 ′. In this case, the execution screen 610 ′ of the video application may be changed according to the size of the reduced display area.

That is, when a touch and rolling interaction in which the size of the display area is reduced while the user touch is detected while the execution screen and new information of the application are simultaneously displayed is detected, the processor 140 is displayed on the area where the user touch is not detected. The touch display 120 may be controlled to remove the screen and display only the screen displayed on the area where the user touch is detected.

In addition, when the size of the display area is reduced by the rotation of the roll 115 in a state in which the user touch is not detected on the touch display 120, the processor 140 may display an execution screen of the application according to the reduced size of the display area. The touch display 120 may be controlled to reduce the size of new information.

Specifically, as shown in FIG. 7A, the processor 140 displays the touch screen 120 to display a UI 720 including an execution screen 710 of a video application and an execution icon for executing the application. ).

In addition, the processor 140 may detect a rolling interaction in which the size of the display area is reduced in at least one direction in a state in which the user touch is not detected on the touch display 120 through the sensing unit 130.

When the rolling interaction is detected, the processor 140 displays the location of the UI 720 ′ including the execution screen 710 ′ of the video application and the execution icon for executing the application, as shown in FIG. 7B. The touch display 120 can be controlled to maintain the size and reduce the size only.

That is, when the size of the display area decreases as the roll 115 rotates, the processor 140 may control the touch display 120 to provide a screen having a different layout depending on whether the user touches the touch screen.

In addition, according to an embodiment of the present disclosure, when a drag interaction is detected on an area where new information is displayed while an execution screen of the application and new information are displayed on the display area, the processor 140 may change the image to another area where the new information is displayed. The touch display 120 may be controlled to provide information.

First, referring to FIG. 8, a screen displayed on the touch display 120 of the electronic device 100 may conceptually include a main area 810 and a plurality of sub areas 820-1, 820-2, 830-1, and 830-2. Can be. The main area 810 may be an area where various screens (for example, an execution screen, an idle screen, a lock screen, etc. of an application) are displayed, and the sub area 820 is new information generated by touch and unrolling interaction. For example, this may be an area in which a UI including an execution icon for executing an application, information related to a currently executed application, a UI for controlling the electronic device 100, and the like are displayed.

Meanwhile, each of the sub areas 820-1, 820-2, 830-1, and 830-2 may provide different information from each other. In addition, the sub areas 820-1, 820-2, 830-1, and 830-2 may provide different types of information according to locations. In particular, the sub areas 820-1 and 820-2 located on the left side can provide information related to the currently executed application. For example, when the currently executed application is a video application, the first sub area 820-1 provides information about the currently executed video, and the second sub area 820-2 is a play list of the video application. It can provide information about. In addition, the sub region located in the left region may be provided with an execution screen of an application related to the currently executed application (for example, when the currently executed application is a text application, the execution screen of the telephone application to the related application).

In addition, the sub-areas 830-1 and 830-2 located on the right side can provide information not related to the currently executed application. For example, the third sub area 830-1 provides a UI including an execution icon for executing another application, and the fourth sub area 830-2 provides various settings (eg, for example, of electronic devices). , A communication setting, a volume setting, a screen setting, etc.) may be provided. In addition, the sub-region located in the right region may provide a UI including notification information.

In addition, the processor 140 may change the displayed sub area through the drag interaction while the main area 810 and the sub area are displayed.

Specifically, as shown in FIG. 9A, the processor 140 may control the touch display 120 to display the main area 810 and the first sub area 820-1 together. In this case, an execution screen of an application may be provided in the main area 810, and new information generated by touch and unrolling interaction may be provided in the sub area 820.

In addition, the processor 140 may detect a drag interaction of dragging the first sub-region 820-1 in the upward direction while touching the main region 810 through the touch display 120.

When the drag interaction in the upward direction is sensed, the processor 140 removes the first sub-region 820-1 and removes the main display region 810 and the second sub-region as shown in FIG. 7B. The touch display 120 may be controlled to display 820-2 together. In this case, the second sub-region 820-2 may be moved upward and displayed according to the drag interaction.

In addition, the processor 140 may detect a drag interaction that touches a point of each of the main area 810 and the second sub area 820-2 through the touch display 120, and then drags it in the left direction.

When the drag interaction in the left direction is detected, the processor 140 removes the second sub area 820-2 and moves the main display area 810 to the left as shown in FIG. 7C. The touch display 120 may be controlled to display the third sub region 830-1 in the right region. In this case, the third sub-region 830-1 may be displayed by being moved in the left direction according to the drag interaction.

In addition, the processor 140 may detect a drag interaction of dragging the third sub-region 820-1 in the upward direction while touching the main region 810 through the touch display 120.

When the drag interaction in the upward direction is detected, the processor 140 removes the third sub area 820-3 and removes the main display area 810 and the fourth sub area as shown in FIG. 7D. The touch display 120 may be controlled to display 830-2 together. In this case, the fourth sub-region 830-2 may be moved upward and displayed according to the drag interaction.

As described above, the processor 140 may provide various information to the user by changing the sub area through a touch interaction or a drag interaction.

10 is a flowchart illustrating a control method of the electronic device 100 according to an embodiment of the present disclosure.

First, the electronic device 100 provides an execution screen of an application in the display area (S1010). In this case, the execution screen of the application is only one embodiment, and other screens (for example, a standby screen including a plurality of application execution icons, a lock screen, etc.) may also include the technical idea of the present invention.

In operation S1020, the electronic device 100 detects an increase in the size of the display area by the rotation of the roll 115 in a state where a user touch is detected in one area of the touch display 120.

In response to the increase in the size of the display area, the electronic device 100 provides new information along with the execution screen of the application to the display area in operation S1030.

As described above, through various interactions such as touch and unrolling interaction and drag interaction, the user can receive various information while maintaining the execution screen of the application displayed in the main area, thereby enabling multitasking. As a result, the electronic device 100 may improve usability of the user through the rollable display.

According to various embodiments of the present disclosure, a device (eg, modules or electronic device 100) or a method (eg, operations) may be maintained in, for example, computer-readable storage media. It may be performed by at least one computer (for example, the processor 190) that executes instructions included in at least one of the programs.

When the command is executed by a computer (for example, the processor 140), the at least one computer may perform a function corresponding to the command. In this case, the computer-readable storage medium may be, for example, the memory 150.

Programs include, for example, hard disks, floppy disks, magnetic media (such as magnetic tape), optical media (such as compact disc read only memory) and digital versatile disc (DVD). ), Magneto-optical media (e.g. floptical disks), hardware devices (e.g. read only memory (ROM), random access memory (RAM), or flash memory, etc.) In this case, the storage medium is generally included as part of the configuration of the electronic device 100, but may be mounted through a port of the electronic device 100, or electronically. The program may be included in an external device (eg, a cloud, a server, or another electronic device) that is located outside the apparatus 100. In addition, the program may be stored in a plurality of storage media, wherein at least one of the plurality of storage media is stored. Some of the electronic devices 100 It may be located in the device unit.

Instructions can include high-level language code that can be executed by a computer using an interpreter, as well as machine code such as produced by a compiler. The aforementioned hardware device may be configured to operate as one or more software modules to perform the operations of the various embodiments, and vice versa.

In addition, while the above has been shown and described with respect to preferred embodiments of the present disclosure, the present disclosure is not limited to the specific embodiments described above, the technical field to which the present invention belongs without departing from the spirit of the present disclosure claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present disclosure.

Claims (15)

  1. In an electronic device,
    A housing comprising a roll;
    A touch display wound around the roll and configured to change a size of a display area according to rotation of the roll, and to sense a user touch;
    A detector configured to detect a size of the display area; And
    And a processor electrically connected to the display and the sensing unit.
    The processor,
    When the size of the display area is increased by the rotation of the roll while a user touch is detected on one area of the touch display while the execution screen of the application is provided in the display area, new information is provided to the display area. And control the touch display to control the touch display.
  2. The method of claim 1,
    The processor,
    And controlling the touch display to provide new information to the display area while maintaining the size of the execution screen of the application.
  3. The method of claim 1,
    The processor,
    And control the touch display to provide the new information to an area located opposite the area where the user touch is detected.
  4. The method of claim 1,
    The processor,
    When the size of the display area is increased by the rotation of the roll while the user touch is not detected in one area of the touch display while the execution screen of the application is provided in the display area, the size of the display area is increased. And controlling the touch display to increase the size of an execution screen of an application provided in the display area.
  5. The method of claim 1,
    The processor,
    When the size of the display area is reduced by the rotation of the roll while a user touch is detected in the area where the execution screen of the application is provided while the execution screen of the application and new information are displayed on the display area, the display And control the touch display to provide only an execution screen of an application in a region.
  6. The method of claim 1,
    The processor,
    If the size of the display area is reduced by the rotation of the roll while the user touch is detected in the area where the new information is provided while the execution screen of the application and the new information are displayed on the display area, And control the touch display to provide only new information.
  7. The method of claim 1,
    The processor,
    When the size of the display area is reduced by the rotation of the roll while the user's touch is not detected on the touch display while the execution screen of the application and new information are displayed on the display area, the display area size is reduced. And control the touch display to reduce the size of the execution screen and new information.
  8. The method of claim 1,
    The processor,
    The touch display is controlled to provide other information in the area in which the new information is displayed when a drag interaction is detected in the area in which the new information is displayed while the execution screen of the application and the new information are displayed in the display area. Electronic device.
  9. An electronic device comprising a housing including a roll and a touch display wound around the roll, the size of a display area being changed according to the rotation of the roll, and displaying a screen including at least one component on the display area. In the control method of,
    Providing an execution screen of an application on the display area;
    Detecting an increase in the size of the display area by rotating the roll when a user touch is detected in one area of the touch display; And
    And providing new information along with an execution screen of the application in the display area.
  10. The method of claim 9,
    Providing the new information,
    And providing new information to the display area while maintaining the size of the execution screen of the application.
  11. The method of claim 9,
    Providing the new information,
    And providing the new information to an area located opposite the area where the user touch is detected.
  12. The method of claim 9,
    The method,
    Detecting an increase in the size of the display area due to rotation of the roll while a user touch is not detected in one area of the touch display while an execution screen of an application is provided in the display area; And
    And increasing the size of an execution screen of an application provided in the display area according to the increase of the display area size.
  13. The method of claim 9,
    The method,
    Detecting a decrease in the size of the display area due to rotation of the roll in a state where a user touch is sensed in an area where the execution screen of the application is provided while the execution screen and new information of the application are displayed on the display area;
    And providing only an execution screen of an application in the display area.
  14. The method of claim 9,
    The method,
    Detecting a decrease in the size of the display area due to rotation of the roll in a state where a user touch is sensed in an area where the new information is provided while an execution screen of the application and new information are displayed on the display area;
    Providing only new information to the display area.
  15. The method of claim 9,
    The method,
    Detecting a decrease in the size of the display area due to rotation of the roll while a user touch is not detected on the touch display while an execution screen of the application and new information are displayed on the display area;
    And reducing the size of the execution screen and new information according to the decrease of the size of the display area.
PCT/KR2016/013195 2015-11-18 2016-11-16 Electronic device and control method therefor WO2017086689A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US201562256889P true 2015-11-18 2015-11-18
US62/256,889 2015-11-18
KR10-2016-0013523 2016-02-03
KR1020160013523A KR20170058223A (en) 2015-11-18 2016-02-03 Electronic device and Method for controlling the electronic device thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US15/775,194 US20180374452A1 (en) 2015-11-18 2016-11-16 Electronic device and control method therefor

Publications (1)

Publication Number Publication Date
WO2017086689A1 true WO2017086689A1 (en) 2017-05-26

Family

ID=58719083

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2016/013195 WO2017086689A1 (en) 2015-11-18 2016-11-16 Electronic device and control method therefor

Country Status (1)

Country Link
WO (1) WO2017086689A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008150600A1 (en) * 2007-06-05 2008-12-11 Immersion Corporation Method and apparatus for haptic enabled flexible touch sensitive surface
US20090051830A1 (en) * 2006-01-06 2009-02-26 Yoshiteru Matsushita Mobile terminal unit, display method, display program, and recording medium
US20100167791A1 (en) * 2008-12-30 2010-07-01 Lg Electronics Inc. Portable terminal having flexible display and screen controlling method thereof
US20130201208A1 (en) * 2012-02-07 2013-08-08 Eunhyung Cho Icon display method for a pull-out display device
US20140118317A1 (en) * 2012-11-01 2014-05-01 Samsung Electronics Co., Ltd. Method of controlling output of screen of flexible display and portable terminal supporting the same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090051830A1 (en) * 2006-01-06 2009-02-26 Yoshiteru Matsushita Mobile terminal unit, display method, display program, and recording medium
WO2008150600A1 (en) * 2007-06-05 2008-12-11 Immersion Corporation Method and apparatus for haptic enabled flexible touch sensitive surface
US20100167791A1 (en) * 2008-12-30 2010-07-01 Lg Electronics Inc. Portable terminal having flexible display and screen controlling method thereof
US20130201208A1 (en) * 2012-02-07 2013-08-08 Eunhyung Cho Icon display method for a pull-out display device
US20140118317A1 (en) * 2012-11-01 2014-05-01 Samsung Electronics Co., Ltd. Method of controlling output of screen of flexible display and portable terminal supporting the same

Similar Documents

Publication Publication Date Title
EP2241963B1 (en) Information processing apparatus, information processing method and program
WO2014189197A1 (en) Method and apparatus for displaying schedule on wearable device
JP5775445B2 (en) apparatus, method, and program
WO2013180454A1 (en) Method for displaying item in terminal and terminal using the same
WO2013009092A2 (en) Method and apparatus for controlling content using graphical object
WO2011083975A2 (en) Mobile device and method for operating content displayed on transparent display panel
WO2012039567A2 (en) Terminal device for downloading and installing an application and method thereof
JP5606686B2 (en) Information processing apparatus, information processing method, and program
WO2011043601A2 (en) Method for providing gui using motion and display apparatus applying the same
US20150338888A1 (en) Foldable device and method of controlling the same
KR20140016073A (en) Flexible device and methods for controlling operation thereof
US20150378557A1 (en) Foldable electronic apparatus and interfacing method thereof
EP2720132B1 (en) Display apparatus and method of controlling the same
WO2011099806A2 (en) Method and apparatus for providing information of multiple applications
WO2013077537A1 (en) Flexible display apparatus and method of providing user interface by using the same
WO2012053801A2 (en) Method and apparatus for controlling touch screen in mobile terminal responsive to multi-touch inputs
WO2009142468A1 (en) Display mode switching device and method for mobile terminal
WO2012039587A1 (en) Method and apparatus for editing home screen in touch device
WO2012018212A2 (en) Touch-sensitive device and touch-based folder control method thereof
WO2014046525A1 (en) Method and apparatus for providing multi-window in touch device
WO2013089392A1 (en) Bendable display device and displaying method thereof
WO2013103278A1 (en) Method and apparatus for providing event of portable device having flexible display unit
WO2012036327A1 (en) Schedule display method and device in mobile communication terminal
TW201419125A (en) Multi display device and method of providing tool therefor
EP2850911A1 (en) Portable device and method for controlling the same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16866641

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16866641

Country of ref document: EP

Kind code of ref document: A1