KR20150135038A - Foldable electronic apparatus, and method for controlling the same - Google Patents

Abstract

According to an aspect of an embodiment of the present invention, a foldable electronic apparatus comprises: a display unit for displaying at least one screen of a first application; a status detection unit for detecting a folding operation or a stretching operation of the foldable electronic device; and a control unit for controlling to display at least one screen of the first application and at least one screen of a second application, according to the detected result.

Description

[0001] Foldable electronic apparatus and method [0002]

Embodiments of the present invention relate to a foldable electronic apparatus and a control method thereof.

As the display technology has advanced, various display devices such as a flexible display device and a transparent display device have been developed. The flexible display device can be folded or used by the user depending on the use situation, so that the flexible display device can drastically reduce the volume of the electronic device.

The flexible display device may be implemented in the form of an organic light emitting display device, a liquid crystal display device, or the like. For example, in a conventional liquid crystal display device and an organic electroluminescent display device, a flexible display device can be manufactured using a flexible material such as an organic substrate replaced with a plastic film. Further, in a conventional liquid crystal display device and an organic light emitting display device, a foldable display device can be manufactured by using a flexible material at least in a folded portion.

As the flexible display device is used, various application fields are emerging. For example, in the field of e-books that can replace magazines, textbooks, books, comics, and other portable IT products, such as ultra-small PCs that can be folded or rolled up and smart cards capable of real- A flexible display device can be applied. On the other hand, it is required to develop an interface that can take advantage of these advantages while reflecting the characteristics of the flexible display device.

Embodiments of the present invention are intended to allow a user to conveniently view a plurality of application screens in an electronic device having a flexible characteristic.

Embodiments of the present invention are also intended to allow a user to easily use the association function in a flexible electronic device.

Embodiments of the present invention are intended to allow an application screen required for a current situation in a flexible electronic device to be viewed using a simple operation of folding and unfolding the flexible electronic device.

According to an aspect of an embodiment of the present invention, in a foldable electronic device,

A display unit for displaying a screen of at least one first application;

A state detector for detecting a folding operation or an unfolding operation of the foldable electronic device; And

And a control unit for controlling the display unit to display the at least one first application screen and the at least one second application screen according to the detection result.

Wherein the display unit includes two display units and the control unit displays the at least one first application screen on one of the two display units in accordance with the detection result, It can be displayed on the remaining one of the display portions.

The control unit may control the display unit to display a screen of the first application and a screen of the second application when the unfolding operation is detected.

Wherein the foldable electronic device further comprises an input for receiving a user selection, and wherein the control unit, when detecting the folding operation or the unfolding operation, selects a second application selection menu that allows the user to select the at least one second application The at least one second application screen may be displayed together with the at least one first application screen and the at least one second application may be determined according to a user selection through the second application selection menu.

Wherein the folderable electronic device further comprises an input for receiving a user selection, wherein the control unit, when displaying the at least one first application screen, displays the at least one first application screen along with the at least one first application screen, 2 application to select a second application, and determine the at least one second application according to user selection through the second application selection menu.

The control unit may determine the at least one second application based on a list of related applications stored in advance.

The control unit may determine the at least one second application based on the input to the at least one first application.

The control unit may determine an application related to a notification event occurring in the folderable electronic device as the at least one second application.

The control unit may determine the at least one second application based on the application usage history of the user.

The control unit may determine the application designated by the user as the at least one second application.

Wherein the display section includes a first display section and a second display section disposed on the opposite side of the first display section, the status detection section covers a part of the first display section displaying the at least one first application screen, 2 detecting part folding operation such that at least a part of the display part is arranged in the same direction as the first display part, and when the partly folding operation is detected, the control part detects at least part of the uncovered area of the first display part The display of at least one first application and the screen of the at least one second application can be displayed on at least a part of the area arranged in the same direction as the first display part of the second display part.

According to another aspect of an embodiment of the present invention, there is provided a method of controlling a foldable electronic device,

Displaying at least one first application screen;

Detecting a folding or unfolding operation of the foldable electronic device; And

And displaying the at least one first application screen and the at least one second application screen according to the detection result.

Wherein the displaying of the at least one first application screen and the at least one second application screen further comprises displaying the at least one first application screen and the at least one second application screen when the unfolding operation is detected .

Wherein the foldable electronic device control method further comprises the step of displaying a second application selection menu with the at least one first application screen capable of selecting the at least one second application when the folding operation or the unfolding operation is detected ; Receiving a user selection via the second application selection menu; And determining the at least one second application in accordance with the user selection.

Wherein displaying the screen of the at least one first application comprises displaying a second application selection menu capable of selecting the at least one second application with a screen of the at least one first application, The method comprising: receiving a user selection through the second application selection menu; And determining the at least one second application in accordance with the user selection.

The method for controlling a foldable electronic device may further include determining the at least one second application based on a list of related applications stored in advance.

The method of controlling a foldable electronic device may further include determining the at least one second application based on an input to the at least one first application.

The method for controlling a foldable electronic device may further include determining an application related to a notification event occurring in the folderable electronic device as the at least one second application.

The method for controlling a foldable electronic device may further include determining the at least one second application based on a usage history of a user.

The method for controlling a foldable electronic device may further include determining an application designated by the user as the at least one second application.

According to the embodiments of the present invention, in an electronic device having a folder-like characteristic, there is an effect that a user can conveniently view a plurality of application screens.

Further, according to the embodiments of the present invention, there is an effect that, in the foldable electronic apparatus, the user can easily use the association function.

Further, according to the embodiments of the present invention, there is an effect that, in the foldable electronic apparatus, an application screen necessary for the current situation can be viewed using a simple operation of folding and folding the foldable electronic apparatus.

1 is a diagram illustrating an electronic device 100 according to one embodiment.
2 is a diagram illustrating the structure of an electronic device 100a according to an embodiment.
3 is a diagram showing the structure of an electronic device 100b according to an embodiment.
4 is a view showing the arrangement of the first display unit 310 and the second display unit 320 according to an embodiment.
5 is a view showing a state in which the electronic device 100 is implemented in a Ben Double structure.
6 is a view illustrating a structure of the display unit 210a according to an exemplary embodiment of the present invention.
FIG. 7 is a diagram illustrating the structure of the display units 210a1 and 210a2 according to an exemplary embodiment.
8 is a view illustrating a structure of a first display unit 310a and a second display unit 320a according to an embodiment.
9 is a view showing a structure of a first display unit 310a and a second display unit 320b according to an embodiment.
FIG. 10 is a diagram illustrating a structure of a first display unit 310a and a second display unit 320c1 and 220c2 according to an embodiment.
11 is a view showing a structure of the first display units 310b1 and 210b2 and the second display unit 320a according to another embodiment.
12 is a view showing a structure of the first display units 310b1 and 210b2 and the second display unit 320b according to an embodiment.
FIG. 13 is a view showing a structure of the first display units 310b1 and 210b2 and the second display units 320c1 and 220c2 according to another embodiment.
14 is a view for explaining a definition of a folded state according to an embodiment.
15 is a view illustrating a folded state according to an embodiment.
16 is a view illustrating a folded state according to an embodiment.
17 is a view illustrating a folded state according to an embodiment.
18 is a view showing a folded state according to an embodiment.
19 is a view showing a folded state according to an embodiment.
20 is a view for explaining the definition of the spread state according to an embodiment.
21 is a view showing an unfolded state according to an embodiment.
22 is a view showing a spread state according to another embodiment.
23 is a view showing a folding operation and an unfolding operation according to an embodiment.
24 is a view showing a folding operation and an unfolding operation according to an embodiment.
25 is a flowchart illustrating an electronic device control method according to an embodiment.
26 is a flowchart illustrating an electronic device control method according to an embodiment.
27 is a view illustrating a screen in a folded state and an unfolded state according to an embodiment.
28 is a flowchart illustrating an electronic device control method according to an embodiment.
FIG. 29 is a view illustrating a screen in a spread state and a partially folded state according to an embodiment.
FIG. 30 is a view showing a screen in an unfolded state and a folded state according to an embodiment.
FIG. 31 is a view showing a screen in the unfolded state and the folded state according to an embodiment.
32 is a diagram illustrating a method of controlling an electronic device according to an embodiment.
33 is a diagram showing a structure of an electronic device 100c according to an embodiment.
34 is a flowchart illustrating an electronic device control method according to an embodiment.
35 is a view illustrating a second application selection menu according to an embodiment of the present invention.
36 is a view illustrating a second application selection menu according to an exemplary embodiment of the present invention.
37 is a view illustrating a second application selection menu according to an exemplary embodiment of the present invention.
38 is a view illustrating a second application selection menu according to an exemplary embodiment of the present invention.
39 is a flowchart illustrating an electronic device control method according to an embodiment.
FIG. 40 is a view showing an example of a state in which the second application selection menu is displayed together with the screen of the first application in step S3906 of FIG.
41 is a flowchart illustrating an electronic device control method according to an embodiment.
42 is a view illustrating a second application selection menu according to an exemplary embodiment of the present invention.
43 is a view illustrating a second application selection menu according to an embodiment of the present invention.
44 is a diagram illustrating a method of controlling an electronic device according to an embodiment.
45 is a diagram illustrating a list of related applications according to an embodiment.
46 is a view showing a screen of the second application together with a screen of the first application based on the related application list according to an embodiment;
47 is a diagram illustrating a method of controlling an electronic device according to an embodiment.
48 is a view showing a screen of a second application by determining a second application according to an embodiment.
FIG. 49 is a view showing a screen of a second application by determining a second application according to an embodiment. FIG.
50 is a diagram illustrating a method of controlling an electronic device according to an embodiment.
51 is a view showing a screen of a second application by determining a second application according to an embodiment.
52 is a diagram illustrating an electronic device control method according to an embodiment.
53 is a view showing a screen of a second application by determining a second application according to an embodiment.
54 is a view showing a screen of a second application by determining a second application according to an embodiment.
55 is a diagram illustrating a method of controlling an electronic device according to an embodiment.
56 is a diagram illustrating an electronic device control method according to an embodiment.
57 is a diagram illustrating a method of controlling an electronic device according to an embodiment.
58 is a view showing a screen of a second application by determining a second application according to an embodiment.
59 is a diagram illustrating a method of controlling an electronic device according to an embodiment.
60 is a view illustrating a window division selection menu according to an embodiment.
61 is a view showing a screen when the screen of the second application is selected through the window division selection menu.
62 is a view showing a screen when the screen of the second application is not displayed through the window division selection menu.
63 is a view illustrating a window arrangement selection menu according to an embodiment.
FIG. 64 is a view showing a screen when the screen of the first application is displayed on the right side through the window arrangement selection menu; FIG.
65 is a view showing a screen when the screen of the first application is selected to be displayed on the full screen through the window arrangement selection menu.
66 is a view showing a screen when the screen of the first application is displayed on the left side through the window arrangement selection menu.
67 is a diagram illustrating a screen of a first application and a screen layout of a second application according to an embodiment.
68 is a view showing a screen of a first application and a screen layout of a second application according to an embodiment.
69 is a diagram illustrating operation of the electronic device 100 according to one embodiment.
FIG. 70 is a view illustrating information about a second application according to an embodiment.
FIG. 71 is a view illustrating information about a second application according to an embodiment.
78 is a block diagram showing a configuration of an electronic device 100d according to an embodiment.

Brief Description of the Drawings The advantages and features of the present invention, and how to accomplish them, will become apparent with reference to the embodiments described hereinafter with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims.

The terms used in this specification will be briefly described and the present invention will be described in detail.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.

When an element is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements as well, without departing from the spirit or scope of the present invention. Also, as used herein, the term "part " refers to a hardware component such as software, FPGA or ASIC, and" part " However, "part" is not meant to be limited to software or hardware. "Part" may be configured to reside on an addressable storage medium and may be configured to play back one or more processors. Thus, by way of example, and not limitation, "part (s) " refers to components such as software components, object oriented software components, class components and task components, and processes, Subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays and variables. The functions provided in the components and "parts " may be combined into a smaller number of components and" parts " or further separated into additional components and "parts ".

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. In order to clearly explain the present invention in the drawings, parts not related to the description will be omitted.

1 is a diagram illustrating an electronic device 100 according to one embodiment.

The electronic device 100 according to the present embodiment is implemented in the form of a foldable or foldable foldable electronic device as shown in Fig. Here, the flexing of the electronic device 100 means that one side of the electronic device 100 is in a state where the electronic device 100 faces one another, although the opposite sides do not completely contact each other. By folding the electronic device 100, it is meant that the two portions of the electronic device 100 are fully parallel or nearly parallel to each other with respect to the folding line. Also, folding the electronic device 100 means that opposing sides of the two portions of the electronic device 100, relative to the folding line, do not necessarily touch, but are disposed in close proximity.

The electronic device 100 according to the present embodiment may be used in a folded state as shown in Fig. 1 (a), or in an unfolded state as shown in Fig. 1 (b). Further, the electronic device 100 according to the present embodiment can switch the screen according to the folded state or the unfolded state. In this specification, the folding shape of an electronic device can be defined as two states, a folded state and an open state. The definition method of the folded state and the unfolded state will be described later.

Further, in this specification, the folding operation means that the electronic device 100 is changed from the extended state to the folded state. The unfolding operation means that the electronic device 100 is changed from the folded state to the unfolded state.

According to embodiments, the electronic device 100 may be implemented in various forms such as a smart phone, a tablet PC, a notebook, a wearable device, an electronic book, and the like.

The electronic device 100 according to the embodiments of the present invention may be configured such that when the folding operation or the unfolding operation is detected while the screen 110 of the first application is displayed, The screen 120 can be displayed. The second application may be determined according to various embodiments.

In the present specification, " first application screen " or " first application screen " means a screen displayed on the display unit as a result of execution of the first application. The " second application screen " or " second application screen " means a screen displayed on the display unit as a result of execution of the second application.

2 is a diagram illustrating the structure of an electronic device 100a according to an embodiment.

The electronic device 100a according to the present embodiment includes a display unit 210, a state detection unit 220, and a control unit 230.

The display unit 210 displays an application screen, a user interface screen, a screen showing the status of the electronic device 100a, and the like, which are being executed by the control unit 230. [

The control unit 230 executes at least one application and controls the display unit 210 to display a screen of at least one application being executed on the display unit 210. [ According to the present embodiment, when the folding operation or the unfolding operation of the electronic device 100a is detected while the screen of at least one first application is displayed, the control unit 230 displays the screen of the at least one first application And displays a screen of at least one second application together. For example, as shown in FIG. 1, when the electronic device 100a is changed to the unfolded state and the unfolding operation is detected while displaying the screen of the first application in the folded state, 2 Application screen can be displayed.

According to an embodiment, when the screen of the first application and the screen of the second application are displayed in the folded state and the unfolded state, they may be displayed on the same screen and may differ in size.

According to another embodiment, when the screen of the first application and the screen of the second application are displayed in the folded state and the unfolded state, the arrangement of the screens may be different. For example, depending on the collapsed state and the unfolded state, the position or size of the menu may be changed on the screen of the application, or the arrangement or size of the icon may be changed.

The control unit 230 can collectively control the operation of the electronic device 100a. For example, the operation and control of the operating system of the electronic device 100a, the various data processing, and the operation of each component (e.g., the display unit 210, the state detection unit 220, etc.) of the electronic device 100a ) Can be performed.

The state detection unit 220 detects the folding operation and the unfolding operation of the electronic device 100a.

According to one embodiment, the state detecting unit 220 can detect an operation in which the state is changed from the folded state to the extended state, or an operation itself in which the folded state is changed from the expanded state to the expanded state. For example, the state detecting unit 220 can detect the folding operation or the unfolding operation itself by using a Hall sensor or a magnetic sensor provided in the folding structure.

According to another embodiment, the state detecting unit 220 can detect whether the current state of the electronic device 100a is the open state or the folded state, and detect the folding operation or the unfolding operation when the current state is changed.

According to one embodiment, the state detector 220 may measure the angle of bending or folding of the electronic device 100a. When the electronic device 100a has a hinge structure, the folding angle can be measured in the hinge structure.

According to another embodiment, the state detecting section 220 can detect the folded state by disposing the state detection sensors at points close to each other by bending or folding of the electronic device 100a. The state detection sensor may include at least one of a proximity sensor, an illuminance sensor, a magnetic sensor, a hall sensor, a touch sensor, a bending sensor, and an infrared sensor, or a combination thereof.

According to one embodiment, the status detector 220 may determine whether the apparatus is in the folded state or the unfolded state, and may provide the determination result to the controller 230. In this case, the controller 230 can determine whether the folded state is the folded state or the expanded state according to the output of the state detection unit 220 without having to separately determine the folded state or the expanded state.

According to another embodiment, when the state detecting unit 220 provides the information on the bent or folded angle or the sensing information of the state detecting sensor to the control unit 230, the control unit 230 determines whether the state is the folded state or the extended state .

3 is a diagram showing the structure of an electronic device 100b according to an embodiment.

According to the present embodiment, the display unit 210 includes a first display unit 310 and a second display unit 320. The first display unit 310 and the second display unit 320 are components that display different screens. The first display unit 310 and the second display unit 320 may be physically separate or integrally provided.

According to an embodiment, the first display unit 310 and the second display unit 320 are physically separate. In this case, according to the embodiment, the first display unit 310 and the second display unit 320 may be arranged to display the screen in the same direction, or may be disposed on opposite surfaces of the electronic device 100b.

According to another embodiment, the first display unit 310 and the second display unit 320 are physically and integrally formed, and can display different screens by dividing an area on one display panel.

The control unit 230 may control the display of the first application and the screen of the second application to be displayed on at least one of the first display unit 310 and the second display unit 320. [

According to an exemplary embodiment, a first application screen may be displayed on the first display unit 310, and a second application screen may be displayed on the second display unit 320.

4 is a view showing the arrangement of the first display unit 310 and the second display unit 320 according to an embodiment.

4, when the front surface of the electronic device 100b is the first surface and the rear surface is the second surface, the first display portion 310 is disposed on the first surface of the electronic device 100b, The display portion 320 may be disposed on the second side of the electronic device 100b.

The first display unit 310 and the second display unit 320 may be disposed to occupy part or all of one surface of the electronic device 100b. According to embodiments, the first display portion 310 may be integrally disposed on the first surface of the electronic device 100b, or may be disposed in a plurality of regions. According to the embodiments, the second display portion 320 may be integrally disposed on the second surface of the electronic device 100b, or may be disposed in a plurality of regions.

5 is a view showing a state in which the electronic device 100 is implemented in a Ben Double structure.

The electronic device 100 may be implemented as a foldable structure as shown in FIG. 1, or a Ben Double structure as shown in FIG. 4, according to an embodiment.

When the electronic device 100 is implemented as a foldable structure, a folding structure may be implemented in at least one line. The folding structure may be embodied such that the electronic device 100 is symmetrically folded, or asymmetrically folded, according to an embodiment. Further, the folding structure may be implemented using a hinge, for example, or a folding structure implemented by a flexible material.

When the electronic device 100a is implemented in a Ben Double structure, the components such as the first display unit 310, the second display unit 320, the controller 230, and the housing, which constitute the electronic device 100, . ≪ / RTI > According to the embodiment, only some of the components (e.g., the housing) of the flexible electronic device 100 have flexible characteristics, and the remaining components (e.g., battery or the like) are implemented to have rigid characteristics .

The display unit 210 may be implemented in at least one of a foldable structure, a flexible structure, and a rigid structure. In addition, the first display unit 310 has a folder-like property, and the second display unit 320 has a rigid property.

When the display portion 210 has a folder-like property, the folding region is arranged to coincide with the folding region of the electronic device 100. [

When the display unit 210 has a flexible property, the display unit 210 can be freely disposed on the electronic device 100.

If the display portion 210 has a rigid property, the electronic device 100 can be arranged to avoid the folded portion or the bent portion.

6 is a view illustrating a structure of the display unit 210a according to an exemplary embodiment of the present invention.

According to one embodiment, the display portion 210a may be integrally formed to cover the folding structure 610 on the first side of the electronic device 100a. The display unit 210a may be implemented as a foldable display device or a flexible display device. According to the present embodiment, the display unit 210 may not be disposed on the second surface.

According to the present embodiment, the folding operation can be defined as an operation in which the first side is exposed and the two areas divided by the folding structure 610 of the second side face each other. The unfolding operation can be defined as an unfolding operation in a folded state in which the first side is exposed to the outside.

FIG. 7 is a diagram illustrating the structure of the display units 210a1 and 210a2 according to an exemplary embodiment.

According to one embodiment, the display portions 210a1, 210a2 may be disposed in each of the two regions divided by the folding structure 610 so as not to meet the folding structure 610 on the first side of the electronic device 100a. The display units 210a1 and 210a2 may be implemented as at least one of a folder display apparatus, a flexible display apparatus, and a rigid display apparatus.

According to the present embodiment, the folding operation can be defined as an operation in which the first side is exposed and the two areas divided by the folding structure 610 of the second side face each other. The unfolding operation can be defined as an unfolding operation in a folded state in which the first side is exposed to the outside.

8 is a view illustrating a structure of a first display unit 310a and a second display unit 320a according to an embodiment.

According to one embodiment, the first display portion 310a may be integrally formed to cover the folding structure 610 on the first side of the electronic device 100b. The second display portion 320a may be disposed in one of the two areas divided by the folding structure 610 so as not to meet the folding structure 610 on the second side of the electronic device 100b. The first display unit 310a may be embodied as a foldable display device or a flexible display device. The second display unit 320a may be embodied as at least one of a folder display apparatus, a flexible display apparatus, and a rigid display apparatus.

9 is a view showing a structure of a first display unit 310a and a second display unit 320b according to an embodiment.

According to one embodiment, the first display portion 310a may be integrally formed to cover the folding structure 610 on the first side of the electronic device 100b. The second display portion 320b may be integrally formed to cover the folding structure 610 on the second side of the electronic device 100b. The first display unit 310a and the second display unit 320b may be embodied as a foldable display device or a flexible display device.

FIG. 10 is a diagram illustrating a structure of a first display unit 310a and a second display unit 320c1 and 220c2 according to an embodiment.

According to one embodiment, the first display portion 310a may be integrally formed to cover the folding structure 610 on the first side of the electronic device 100b. The second display portions 320c1 and 220c2 may be disposed in each of the two regions divided by the folding structure 610 so as not to meet the folding structure 610 on the second side of the electronic device 100b. The first display unit 310a may be embodied as a foldable display device or a flexible display device. The second display units 320c1 and 220c2 may be implemented as at least one of a folder display apparatus, a flexible display apparatus, and a rigid display apparatus.

11 is a view showing a structure of the first display units 310b1 and 210b2 and the second display unit 320a according to another embodiment.

According to one embodiment, the first display portions 310b1 and 210b2 may be disposed in each of the two regions divided by the folding structure 610 so as not to meet the folding structure 610 on the first side of the electronic device 100b. The second display portion 320a may be disposed on one of two areas divided by the folding structure 610 so as not to meet the folding structure 610 on the second side of the electronic device 100b. The first display units 310b1 and 210b2 and the second display unit 320a may be implemented as at least one of a display unit for a foldable display, a flexible display unit, and a rigid display unit.

12 is a view showing a structure of the first display units 310b1 and 210b2 and the second display unit 320b according to an embodiment.

According to one embodiment, the first display portions 310b1 and 210b2 may be disposed in each of the two regions divided by the folding structure 610 so as not to meet the folding structure 610 on the first side of the electronic device 100b. The second display portion 320b may be integrally formed to cover the folding structure 610 on the second side of the electronic device 100b. The first display units 310b1 and 210b2 may be embodied as at least one of a foldable display device, a flexible display device, and a rigid display device. The second display unit 320b may be embodied as a foldable display device or a flexible display device.

FIG. 13 is a view showing a structure of the first display units 310b1 and 210b2 and the second display units 320c1 and 220c2 according to another embodiment.

According to the present embodiment, the first display portions 310b1 and 210b2 may be disposed in each of the two regions divided by the folding structure 610 so as not to meet the folding structure 610 on the first side of the electronic device 100b. The second display portions 320c1 and 220c2 may be disposed in each of the two regions divided by the folding structure 610 so as not to meet the folding structure 610 on the second side of the electronic device 100b. The first display portions 310b1 and 210b2 And the second display portions 320c1 and 220c2 may be implemented by at least one of a folder display device, a flexible display device, and a rigid display device.

14 is a view for explaining a definition of a folded state according to an embodiment.

The folded state and the unfolded state can be quantized to a folding form evaluation value within a predetermined range. The folded shape evaluation value may be changed according to the structure of the state detector 220. [ The folded shape evaluation value is, for example, a bent angle of the electronic device 100, a folded angle of the electronic device 100, a sensing value of the state detection sensor, and the like. The sensing value of the state detection sensor may be, for example, a sensing value of a proximity sensor, a sensing value of an illuminance sensor, a sensing value of a magnetic sensor, a sensing value of a hall sensor, a sensing value of a touch sensor,

Although an exemplary embodiment of evaluating the folded shape at the folded angle of the electronic device 100 is described herein, the embodiment of the present invention is not limited thereto.

According to one embodiment, the folded condition means that the folding angle of the electronic device 100 is included within the first range. The folded state means, for example, a state in which the folding angle of the electronic device 100 is 0 degree or more and less than a degree. The folding angle means the angle between the opposing faces of the two regions generated by the folding, as shown in Fig. The folding angle can be defined around a vertex defined by the opposing faces of the two regions caused by folding.

According to another embodiment, the folded state refers to a case where a proximity sensor, a magnetic sensor, an infrared sensor, or the like, the sensing value indicating the proximity of the two regions generated by folding falls within the third range.

According to one embodiment, the lines that the electronic device 100 folds are predefined, and the electronic device 100 can be folded only at predefined lines. The folding line may be one or more depending on the embodiment. For example, the electronic device 100 may be folded in various ways, such as folding in two, folding in three.

According to another embodiment, the electronic device 100 may be folded or bent at any point. In this case, the electronic device 100 can detect a folded or bent shape using a predetermined sensor.

15 is a view illustrating a folded state according to an embodiment.

According to one embodiment, the folded state of the electronic device 100 means that the electronic device 100 is folded symmetrically. According to one embodiment, the electronic device 100 may be folded symmetrically by the folding structure 610, as shown in FIG. According to another embodiment, the electronic device 100 may be folded symmetrically in a flexible structure.

16 is a view illustrating a folded state according to an embodiment.

According to the present embodiment, the folded state of the electronic device 100 means that the electronic device 100 is folded asymmetrically. According to the present embodiment, the electronic device 100 may be asymmetrically folded so that the first region 1610 is exposed, as shown in Fig. In the first area 1610, a key button, a partial area of the display unit 210, a touch sensor, and the like may be disposed according to embodiments.

17 is a view illustrating a folded state according to an embodiment.

According to the present embodiment, the folded state of the electronic device 100b is a state in which one of the first display portion 310 and the second display portion 320 of the electronic device 100b is disposed facing the user, Means a state in which a part of the other display parts disposed on the opposite side of the display part are folded in a rectangular shape asymmetrically to face the user. For example, as shown in FIG. 17, in a state in which the first display unit 310 is oriented toward the user, some of the second display units 320 may be folded toward the user.

18 is a view showing a folded state according to an embodiment.

According to the present embodiment, the folded state of the electronic device 100b is a state in which one of the first display portion 310 and the second display portion 320 of the electronic device 100b is disposed facing the user, Means a state in which some of the other display portions disposed on the opposite side of the display portion are folded in a triangular shape asymmetrically to face the user. For example, as shown in FIG. 15, in a state in which the first display unit 310 is oriented toward the user, a part of the second display unit 320 may be folded in a triangular shape toward the user.

19 is a view showing a folded state according to an embodiment.

According to the present embodiment, the folded state of the electronic device 100b is a state in which one of the first display portion 310 and the second display portion 320 of the electronic device 100b is disposed facing the user, Some of the other display portions disposed on the opposite side of the display portion are folded so as to be exposed in a plurality of regions. The third region 1910 and the fourth region 1920 of the second display unit 320 may be displayed in a state where the first display unit 310 is oriented toward the user as shown in FIG. It can be folded to be oriented.

20 is a view for explaining the definition of the spread state according to an embodiment.

According to one embodiment, the unfolded state means that the folding angle of the electronic device 100 is included within the second range. The expanded state means, for example, a state in which the folding angle of the electronic device 100 is a or more and 180 degrees or less.

According to another embodiment, the extended state means a case where a sensing value indicating proximity of two regions generated by folding in a proximity sensor, a magnetic sensor, an infrared sensor, etc. falls within a fourth range.

21 is a view showing an unfolded state according to an embodiment.

The unfolded state according to an embodiment is a state in which the folding angle of the electronic device 100 is unfolded to 180 degrees as shown in FIG. According to one embodiment, as shown in FIG. 21, the window of the display unit 210 shown in the unfolded state may be divided, and a screen of a plurality of applications may be displayed (S2102).

The opposite side of the display unit 210 shown in the unfolded state may have various display units or no display unit according to the embodiments. Further, as shown in Fig. 21, the display portions on the opposite surface may be turned off (S2104).

22 is a view showing a spread state according to another embodiment.

The unfolded state according to the present embodiment is a state in which the folding angle of the electronic device 100 is unfolded to 180 degrees as shown in FIG. According to the present embodiment, one application screen may be displayed on the display unit 210 shown in the unfolded state as shown in FIG. 12 (S2202).

The opposite side of the display unit 210 shown in the unfolded state may have various display units or no display unit according to the embodiments. Further, as shown in Fig. 22, the display portions on the opposite surface may be turned off (S2204).

23 is a view showing a folding operation and an unfolding operation according to an embodiment.

The folding operation and the unfolding operation according to this embodiment can be performed as shown in FIG.

24 is a view showing a folding operation and an unfolding operation according to an embodiment.

The folding operation and the unfolding operation according to this embodiment can be performed as shown in Fig.

25 is a flowchart illustrating an electronic device control method according to an embodiment.

The electronic device implementing the electronic device control method according to the present embodiment can be any type of electronic device as long as it is an electronic device having a foldable structure or a flexible structure and having at least one display portion. It is possible to perform the electronic device control method according to the present embodiment in the electronic device 100a shown in Fig. 2 or the electronic device 100b shown in Fig. 3, for example. Although the electronic device 100a shown in FIG. 2 is described herein with reference to an embodiment in which the electronic device control method according to the embodiments of the present invention is performed, the embodiments of the present invention are not limited thereto.

The electronic device 100a displays the screen of the first application on the display unit 210 (S2502).

When the state detector 220 or the controller 230 detects the folding operation or the unfolding operation (S2504), the controller 230 displays the screen of the first application and the screen of the second application together on the display unit 210 (S2506 ).

7 to FIG. 13, the operation (S2506) of displaying the screen of the first application and the screen of the second application together is performed by displaying the first application screen in step S2502 A display unit other than the one-day display unit may be used, or a display unit displaying the first application screen and a different display unit may be used together.

26 is a flowchart illustrating an electronic device control method according to an embodiment.

The electronic device control method according to the present embodiment displays the screen of the first application and the screen of the second application together when the unfolding operation that changes from the folded state to the unfolded state is detected.

First, the electronic device 100 displays the screen of the first application in the folded state (S2602).

As shown in FIG. 6, when the display unit 210a is integrally formed on the first surface, the screen of the first application may be displayed in a part of the display unit 210a. When the display portions 210a1 and 210a2 are disposed in the two regions divided by the folding structure 610 so as not to meet the folding structure 610 on the first surface of the electronic device 100a as shown in Fig. 7, The screen can be displayed only in one of the two display portions 210a1 and 210a2.

When the second display portion 320b is disposed to cover the folding structure 610 as shown in FIGS. 9 and 12, the screen of the first application may be displayed in a part of the second display portion 320b. Some of the second display portion 320b may be, for example, an area facing the user, a predefined area, or the like. When the second display portions 320c1 and 320c2 are disposed in the two regions divided by the folding structure 610 so as not to meet the folding structure 610 on the second surface of the electronic device 100a as shown in Figs. 10 and 13, The screen of the first application may be displayed only in one of the second display units 320c1 and 320c2. An area of the second display unit 320c1 or 320c2 on which the first application screen is displayed may be, for example, an area facing the user, a predefined area, or the like.

Next, when the state detection unit 220 detects the unfolding operation (S2604), the control unit 230 displays the screen of the first application and the screen of the second application together (S2606).

According to the present embodiment, the user normally uses the electronic device 100 in a folded state, and when the user wants to utilize a wide screen, the electronic device 100 can be opened and used. Also, in the present embodiment, the electronic device 100 displays the second application together with the first application in the extended state, thereby enabling the user to utilize the wide screen more efficiently and to conveniently use a plurality of applications .

27 is a view illustrating a screen in a folded state and an unfolded state according to an embodiment.

27, when the electronic device 100 is changed from the folded state in which the screen of the first application is displayed to the unfolded state as shown in FIG. 27, the display unit 210 displays the screen of the first application, 2 The screen of the application can be displayed.

According to one embodiment, a screen of the first application is displayed on a partial area of the display unit 210 of the first surface in the folded state, and a screen of the first application is displayed on the entire area of the display unit 210 of the first surface, And a screen of the second application are displayed.

According to another embodiment, the screen of the first application is displayed on the display unit 210 of the first surface in the folded state, and the screen of the first application and the screen of the second application are displayed on the display unit 210 of the second surface, Is displayed.

28 is a flowchart illustrating an electronic device control method according to an embodiment.

According to the present embodiment, when the folding operation in which the electronic device 100b is changed from the extended state to the partially folded state is detected, the first application screen and the second application screen are displayed together. In some folded states, as shown in FIGS. 17, 18, and 19, one of the first display portion 310 and the second display portion 320 of the electronic device 100b is arranged to face the user , And a state in which some of the other display portions disposed on the opposite side of the one display portion are asymmetrically folded toward the user.

First, the electronic device 100b displays the screen of the first application on the first display unit 310 in the extended state (S2802). When the state detecting unit 220 detects a folding operation in which the electronic device 100a is partially folded (S2804), the control unit 230 displays a screen of the first application on the first display unit 310, And displays the screen of the second application on the display unit 320 (S2806).

FIG. 29 is a view illustrating a screen in a spread state and a partially folded state according to an embodiment.

29, when the screen of the first application is displayed on the first display unit 310 in the extended state (S2902), the electronic device 100a is changed to the partially folded state of the rectangular shape (S2904), the screen of the first application can be displayed on at least a part of the first display unit 310, and the screen of the second application can be displayed on at least a part of the second display unit 320. [ The screen of the first application can be displayed only in the area of the first display unit 310 that is not covered by the folding. The screen of the first application may be displayed in a size that is changed according to the size of the area not covered by the folding, or a part of the screen of the first application may be displayed in a truncated state according to the embodiment. The screen of the second application may be displayed in the area facing the same direction as the first display unit 310 by folding out of the second display unit 320. [ The screen of the second application may be displayed in a size that is changed according to the size of the screen of the first application due to the folding of the second display unit 320 or a part of the screen of the second application may be displayed in a truncated state.

FIG. 30 is a view showing a screen in an unfolded state and a folded state according to an embodiment.

According to this embodiment, when the first application screen is displayed on the first display unit 310 in the unfolded state and the electronic device 100b is changed to the partially folded state of the triangular shape as shown in FIG. 30, The first application screen can be displayed on at least a part of the first display unit 310 and the second application screen can be displayed on at least a part of the second display unit 320. [ The screen of the first application can be displayed only in the area of the first display unit 310 that is not covered by the folding. The screen of the first application may be displayed in a size that is changed according to the size of the area not covered by the folding, or a part of the screen of the first application may be displayed in a truncated state according to the embodiment. The screen of the second application may be displayed in the area facing the same direction as the first display unit 310 by folding out of the second display unit 320. [ The screen of the second application may be displayed by changing the size of the area of the second display unit 320 that is oriented in the same direction as the first display unit 310 due to the folding.

FIG. 31 is a view showing a screen in the unfolded state and the folded state according to an embodiment.

31, when the electronic device 100b is changed from a plurality of areas to a partially folded state in a state that the screen of the first application is displayed on the first display unit 310 in the extended state as shown in Fig. 31, The screen of the first application can be displayed on at least a part of the first display unit 310 and the screen of the second application can be displayed on at least a part of the second display unit 320. [

According to the present embodiment, the screen of the first application can be displayed only in the area of the first display unit 310 that is not covered by the folding. The screen of the first application may be displayed in a size that is changed according to the size of the area not covered by the folding, or a part of the screen of the first application may be displayed in a truncated state according to the embodiment.

The screen of the second application may be displayed on the plurality of areas 3110 and 3120 of the second display unit facing the same direction as the first display unit 310 by folding. In addition, screens of different applications may be displayed in each of the plurality of areas 3110 and 3120 of the second display unit 320. [ The screen of the second application may be displayed in a size varying according to the size of the areas 3110 and 3120 facing the same direction as the first display unit 310 due to the folding of the second display unit 320. [ For example, a text message received from Kim Chul-soo may be displayed in the second area 3110, and a telephone application screen may be displayed in the third area 3120.

According to the embodiment shown in Figs. 28 to 31, when the user wants to check the simple contents while using the electronic device 100b in the extended state, by folding a part of the area of the electronic device 100b, Can be used to confirm simple contents. For example, when the user watches a moving picture and a notification 2910 indicating that a text message arrives is displayed, the user can easily confirm the contents of the text message by folding a part of the electronic device 100b.

32 is a diagram illustrating a method of controlling an electronic device according to an embodiment.

According to the present embodiment, when the folding operation or the unfolding operation is detected, the electronic device 100 determines the second application according to a predetermined criterion. The criteria for determining the second application may vary depending on the embodiment.

First, the electronic device 100 displays a screen of the first application (S3202). When the state detection unit 220 detects the folding operation or the unfolding operation (S3204), the control unit 230 determines the second application ). Next, the controller 230 displays the determined screen of the second application together with the screen of the first application (S3208).

The criterion for determining the second application may be determined, for example, according to user selection, the application previously designated by the user is determined as the second application, the determination is made according to the predetermined related application list, And determining an application having a high frequency of use by the user as a second application. Various embodiments for determining a second application are described in detail below.

33 is a diagram showing a structure of an electronic device 100c according to an embodiment.

The electronic device 100c according to the present embodiment includes a display unit 210, a state detection unit 220, a control unit 230, and a user input unit 3310.

 The display unit 210 displays an application screen, a user interface screen, a screen that displays the status of the electronic device 100c, and the like, which are being executed by the control unit 230. [ According to one embodiment, the display unit 210 may include a first display unit 310 disposed on the first surface and a second display unit 320 disposed on the second surface.

The control unit 230 executes at least one application and controls the display unit 210 to display a screen of at least one application being executed. According to the present embodiment, when the folding operation or the unfolding operation is detected while the screen of the first application is displayed, the control unit 230 displays the screen of the second application together with the screen of the first application.

The control unit 230 can collectively control the operation of the electronic device 100c. For example, the operation and control of the operating system of the electronic device 100c, the various data processing, the operation of each component (e.g., the display unit 210, the state detection unit 220, the user input unit 3310 ) And the like) can be performed.

The user input unit 3310 receives user input. The user input unit 3310 may include, for example, at least one of a key, a touch sensor, a touch screen, a pen recognition panel, a bending sensor, a biological signal detection sensor, a microphone, or a combination thereof. According to one embodiment, the user input unit 3310 may be provided with a user interface screen provided through a graphic user interface (GUI).

The user input unit 3310 may receive a user input for controlling the electronic device 100c. For example, the user input unit 3310 can receive an on / off instruction of the electronic device 100b, an execution instruction of the application, a user input on the application, and the like. Also, the user input unit 3310 may include a user input for selecting whether to display the screen of the second application together with the screen of the first application when a user input for selecting a second application, a folding operation or an unfolding operation is detected, A user input for selecting a display mode of the screen of the second application when an operation or a unfolding operation is detected, and the like.

According to one embodiment, user input 3310 may receive user input to select a second application. For example, the control unit 230 may display a second application selection menu on the display unit 210 and receive user input through the second application selection menu. The control unit 230 may determine the second application based on the user input through the user input unit 3310. [

According to another embodiment, the user input unit 3310 may receive a user input for selecting whether to display a screen of the second application together with the screen of the first application, when a folding operation or an unfolding operation is detected. The control unit 230 can display the screen of the second application together with the screen of the first application only when the user selects to display the screen of the second application.

34 is a flowchart illustrating an electronic device control method according to an embodiment.

According to this embodiment, a second application selection menu for selecting a second application is provided along with the screen of the first application, and the second application is determined according to the user selection.

First, the control unit 230 displays the second application selection menu together with the screen of the first application (S3402). The second application selection menu is a menu where a user can select a second application.

According to one embodiment, the second application selection menu is displayed on the display unit 210 in the form of a GUI.

According to another embodiment, the second application selection menu is provided to receive user input through a touch sensor, a key button, or the like disposed in a predetermined area of the housing of the electronic device 100c. At this time, information on the second application selection menu may be displayed in a predetermined area of the display unit 210. [

Next, when the state detecting unit 220 detects a folding operation or an unfolding operation (S3404), the controller 230 determines whether a user selection has been received through the second application selection menu (S3406).

When the user selection is received (S3406), the controller 230 determines the application selected by the user as the second application, and displays the screen of the first application and the screen of the second application together (S3408).

When the user selection is not received (S3406), the screen of the display unit 210 is changed according to a predetermined criterion (S3410). The predetermined criteria may vary according to the embodiments. According to one embodiment, the predetermined criterion may be to determine, as the second application, an application preset to be executed together with the first application. According to another embodiment, the predetermined criterion may be that a user designates an application previously designated in a setting menu or the like as a second application. According to another embodiment, the predetermined reference may be to change the screen of the first application, such as changing the size of the screen of the first application or changing the layout of the screen, when a folding operation or an unfolding operation is detected have.

According to the present embodiment, there is an effect that the second application can be determined by accurately reflecting the intention of the user. Further, by automatically displaying the screen of the second application together with the screen of the first application in accordance with the folding operation or the unfolding operation in a state where the user pre-selects a second application to view with the screen of the first application, It is convenient to use multi-window interface.

35 is a view illustrating a second application selection menu according to an embodiment of the present invention.

According to the present embodiment, the electronic device 100c is folded in an asymmetrical shape, the screen of the first application is displayed on the display unit 210 in the folded state, and the second application selection menu 3520 is displayed on the first area 3510).

The second application selection menu 3520 indicates a user selectable application, and the user can select an application. According to one embodiment, as shown in FIG. 35, the first area 3510 can be divided into a plurality of areas, and the selectable applications can be matched to each area.

According to an exemplary embodiment, a screen of the first application may be displayed on the second display unit 320, and a first area 3510 may be an area on the first display unit 310. The first area 3510 may be defined as at least a part of the area of the first display unit 310 which is exposed in the folded state. When the first display unit 310 is implemented as a touch screen, a second application selection menu 3520 is displayed in the first area 3510, and a user selection is received in the form of a touch input on the first display unit 310 can do.

According to another embodiment, the first area 3510 may be an area disposed on the housing of the electronic device 100c, for example, a region in which a touch sensor, a proximity sensor, and the like are disposed. The information on the second application selection menu 3520 may be displayed in the first area 3510 on the housing or in at least part of the apparent area of the display unit 210 according to the embodiment have.

According to the present embodiment, by providing the second application selection menu in a predetermined area physically separated from the display unit 210 displaying the first application by asymmetrically folding, the user intuitively selects the second application selection menu There is an accessible effect. Furthermore, by providing the second application selection menu using the area of the lower layer revealed by the asymmetric folding, it is possible to provide a second application selection menu without covering the screen of the first application or complicating the layout of the screen .

36 is a view illustrating a second application selection menu according to an exemplary embodiment of the present invention.

According to the present embodiment, the second application selection menu may be provided only when the user requests to provide the second application selection menu. For example, the control unit 230 may display a first menu 3640 requesting a second application selection menu along with a screen of the first application on the display unit 210 in a folded state (S3610). The user may request to display the second application selection menu by selecting the first menu 3640. [ For example, the user may request to display the second application selection menu using a method such as clicking, dragging, or the like on the first menu 3640.

When the user requests to display the second application selection menu, the controller 230 displays the second application selection menu 3650 together with the screen of the first application on the display unit 210 (S3620). The user may select the second application via the second application selection menu 3650. [ The user input may be received in the form of a touch input, a key input, a pen input, a voice input, or the like.

When the user selects the second application in the second application selection menu 3650 and changes the electronic device 100c to the expanded state in step S3630, the control unit 230 displays the first application screen on the display unit 210 2 application screen (S3630). As described above with reference to FIG. 34, when the user does not select the second application, the screen of the display unit 210 can be determined and displayed according to a predetermined criterion when the folding operation or the unfolding operation is detected.

36 shows a case in which the state is changed from the folded state to the unfolded state. However, as another embodiment, in a case where the screen of the first application and the screen of the second application are provided together , It is possible to provide a first menu 3640 requesting a second application selection menu. That is, when the user requests the second application selection menu 3650, the first application screen and the second application selection menu 3650 are displayed in the extended state, ) Can be displayed together. Also, when the user selects the second application, when the electronic device 100c is changed from the extended state to the folded state, the screen of the first application and the screen of the second application selected by the user can be displayed together in the folded state .

According to the present embodiment, the second application selection menu is displayed together with the screen of the first application only when the user desires to minimize the side effect of complicating the screen due to the second application selection menu or covering the screen of the first application There is an effect that can be.

37 is a view illustrating a second application selection menu according to an exemplary embodiment of the present invention.

According to this embodiment, the controller 230 displays the second application selection menu 3730 together with the screen of the first application on the first display unit 310 in the extended state (S3710). When the user input for selecting the second application is received through the second application selection menu 3730 and the electronic device 100c is changed to the partially folded state, the control unit 230 controls the first display unit 310 to display the first application And displays the screen of the second application selected by the user in the exposed area of the second display unit 320 (S3720).

According to the present embodiment, in a state where the user selects the second application, it is possible to view the screen of the second application by using a simple gesture of bending or folding only a part of the electronic device 100c, It is possible to browse the screen of the user.

38 is a view illustrating a second application selection menu according to an exemplary embodiment of the present invention.

According to the present embodiment, the electronic device 100c displays information about the second application selection menu along with the first application screen, and the component 3810a of the user input unit 3310 formed on the housing of the electronic device 100c , 3810b. ≪ / RTI > For example, user selections may be received using touch sensors 3810a and 3810b, which are components of user input 3310. [

According to the present embodiment, more accurate user input can be obtained by utilizing the user input unit 3310 disposed on the housing of the electronic device 100c while minimizing the screen area occupied by the second application selection menu.

39 is a flowchart illustrating an electronic device control method according to an embodiment.

According to the present embodiment, when a folding operation or a unfolding operation is detected, a second application selection menu is displayed together with a screen of the first application, and when a user input through the second application selection menu is detected, And displays the screen of the second application together with the screen.

First, the control unit 230 displays the screen of the first application on the display unit 210 (S3902).

Next, when the state detecting unit 220 detects the folding operation or the unfolding operation (S3904), the controller 230 displays the second application selection menu together with the screen of the first application (S3906).

When the user selection for selecting the second application is received (S3908), the controller 230 determines the application selected by the user as the second application, and displays the screen of the first application and the screen of the second application together (S3910).

According to an embodiment, after the folding operation or the unfolding operation is detected (S3904), if the user selection is not received within a predetermined time, the control unit 230 may remove the second application selection menu from the screen.

According to this embodiment, when the folding operation or the unfolding operation is detected, the second application selection menu is provided, so that the user can select an application to be displayed together easily after the folding operation or the unfolding operation.

FIG. 40 is a view showing an example of a state in which the second application selection menu is displayed together with the screen of the first application in step S3906 of FIG.

40, when the folding operation or the unfolding operation of the electronic device 100c is detected, the controller 230 controls the display unit 210 to display a first application screen and a second application selection menu (4010) can be displayed.

41 is a flowchart illustrating an electronic device control method according to an embodiment.

According to the present embodiment, when the folding operation or the unfolding operation is detected, the screen of the first application, the screen of the second application, and the second application selection menu are displayed together.

First, the control unit 230 displays the screen of the first application on the display unit 210 (S4102).

Next, when the state detecting unit 220 detects a folding operation or a unfolding operation (S4104), the screen of the first application, the screen of the second application, and the second application selection menu are displayed together (S4106).

The screen of the second application displayed together with the screen of the first application may be determined according to a predetermined criterion. The criterion for determining the second application may be determined, for example, according to user selection, the application previously designated by the user is determined as the second application, the determination is made according to the predetermined related application list, And determining an application having a high frequency of use by the user as a second application.

When the user selection for selecting the second application is received (S4108), the controller 230 determines the application selected by the user as the second application, and displays the screen of the first application and the screen of the second application selected by the user (S4110). According to one embodiment, the screen of the second application previously displayed is replaced with the screen of the second application selected by the user. According to another embodiment, the screen of the second application displayed previously and the screen of the second application selected by the user are displayed together.

According to an exemplary embodiment, after the folding operation or the unfolding operation is detected (S4104), if the user selection is not received within a predetermined time, the controller 230 may remove the second application selection menu from the screen.

According to the present embodiment, when the folding operation or the unfolding operation is detected, the screen of the second application is displayed together with the screen of the first application, so that the user can easily change the screen of the second application, There is an effect that a plurality of application screens can be browsed.

42 is a view illustrating a second application selection menu according to an exemplary embodiment of the present invention.

According to the present embodiment, the controller 230 displays the screen of the first application on the display unit 210 in the folded state, and displays the screen of the first application on the display unit 210, , And a second application selection menu 4210 together.

43 is a view illustrating a second application selection menu according to an embodiment of the present invention.

According to the present embodiment, the controller 230 displays the screen of the first application on the display unit 210 in the folded state (S4310). When the unfolding operation is detected, the control unit 230 displays the screen of the first application on the display unit 210, A first menu 4350 requesting a screen of the application and a second application selection menu may be displayed together (S4320). When the user requests to provide the second application selection menu through the first menu 4350, the control unit 230 displays the second application selection menu 4360 together with the screen of the first application and the screen of the second application (S4330). When the user input is received through the second application selection menu 4360, the controller 230 displays the screen of the second application selected by the user together with the screen of the first application (S4340).

44 is a diagram illustrating a method of controlling an electronic device according to an embodiment.

According to the present embodiment, when the folding operation or the unfolding operation is detected, the electronic device 100a determines the second application based on the previously stored related application list.

First, the electronic device 100a displays a screen of the first application (S4402). When the folding operation or the unfolding operation is detected in the state detecting unit 220 (S4404), the control unit 230 displays, And determines an application (S4406). The related application list is stored in advance and is a list showing the types of second applications matched according to the type of the first application. The related application list may be stored in a storage unit (not shown) of the electronic device 100c, for example.

Next, the controller 230 displays the determined screen of the second application along with the screen of the first application (S4408).

45 is a diagram illustrating a list of related applications according to an embodiment.

The related application list according to the present embodiment includes information on the type of the second application matched according to the type of the first application. For example, if the first application is a book, the second application is a dictionary, and the first application is a camera, as shown in FIG. 45, the second application may be a photo album.

According to the present embodiment, when the folding operation or the unfolding operation is detected by automatically storing the first application and the second application by storing information on the related application highly likely to be used together by the user, Can be easily utilized.

46 is a diagram showing a screen of a second application together with a screen of a first application based on an associated application list according to an embodiment;

According to this embodiment, if the electronic device 100c is changed to the unfolded state during the use of the social network service (SNS) application in the folded state, the control unit 230 determines the second application as the photo album based on the related application list, Displays the album screen with the SNS screen. According to the present embodiment, there is an effect that a photograph can be easily uploaded to the SNS by dragging and dropping a photograph from the photo album screen.

47 is a diagram illustrating a method of controlling an electronic device according to an embodiment.

According to the present embodiment, when the folding operation or the unfolding operation is detected, the electronic device 100c determines the second application based on the input to the first application. Since the input to the first application often reflects the user's current interests, information about the user's interests may be known according to the present embodiment.

First, the electronic device 100c displays the screen of the first application (S4702). If the folding operation or the unfolding operation is detected in the state detecting unit 220 (S4704), the control unit 230 determines the second application.

The controller 230 analyzes the input to the first application to determine the second application (S4706). The input to the first application may include, for example, the voice of the sender or recipient of the telephony application, the message of the messenger, and so on. Next, the control unit 230 determines the second application based on the analysis result of the input to the first application (S4708).

If the second application is determined, the controller 230 displays the determined screen of the second application together with the screen of the first application (S4710).

48 is a view showing a screen of a second application by determining a second application according to an embodiment.

According to the present embodiment, when the first application is a telephone application, the control unit 230 recognizes the contents of the conversation between the users who make the call and determines the second application according to the contents of the conversation. For example, in the case where one user in the conversation speaks "Would you like to go to Gangnam station on weekends?", The control unit 230 can recognize that the specific place name is included among the conversation contents and decide the second application as a map application .

Thereafter, when the folding operation or the unfolding operation of the electronic device 100c is detected, the control unit 230 displays the screen of the telephone application as the screen of the first application and the screen of the map application as the screen of the second application. According to one embodiment, when displaying the map application screen, the control unit 230 can display a map screen in which the " Gangnam Station "

According to the present embodiment, there is an effect that the user can easily and conveniently provide information of interest to the user by recognizing the contents of the user's call.

FIG. 49 is a view showing a screen of a second application by determining a second application according to an embodiment. FIG.

According to the present exemplary embodiment, when the first application is a messenger application or a text message application, the controller 230 may determine a second application by analyzing contents of a message transmitted or received in the first application. For example, when the message " New Galaxy s5 is newly issued " is sent or received in the first application, the controller 230 analyzes the contents of the message and searches for a content included in the message 2 application.

Thereafter, when the folding operation or the unfolding operation is detected in the electronic device 100c, the control unit 230 displays the screen of the search application as the screen of the second application together with the screen of the messenger or the text message application of the first application can do. According to one embodiment, the control unit 230 may display a screen as a result of inputting a keyword included in a message in a search window on a search application screen.

50 is a diagram illustrating a method of controlling an electronic device according to an embodiment.

According to the present embodiment, when a notification event occurs, the electronic device 100a determines the application related to the notification event to be the second application when the folding operation or the unfolding operation is detected. The user can execute the application related to the notification event by a simple operation of changing the folding form of the electronic device 100a.

First, the electronic device 100a displays a screen of the first application (S5002). If the folding operation or the unfolding operation is detected in the state detecting unit 220 (S5004), the control unit 230 determines the second application.

The control unit 230 first determines whether a notification event has occurred (S5006). The notification event includes, for example, reception of a text message, reception of a telephone, reception of a mail, reception of a messenger message, reception of a notification from an SNS application, and notification from various applications.

If a notification event has occurred (S5006), the control unit 230 determines the application related to the notification event as the second application (S5008). For example, if a text message is received, the second application is a text messaging application. When the mail is received, the second application is a mail application. When receiving the messenger message, the second application is the messenger application. When receiving a notification from the SNS application, the second application is an SNS application.

Next, the control unit 230 displays the determined screen of the second application together with the screen of the first application (S5012).

If the notification event has not occurred (S5006), the control unit 230 changes the screen of the display unit 210 according to a predetermined criterion (S5010). The predetermined criteria may vary according to the embodiments. According to one embodiment, the predetermined criterion may be to determine, as the second application, an application preset to be executed together with the first application. According to another embodiment, the predetermined criterion may be that a user designates an application previously designated in a setting menu or the like as a second application. According to another embodiment, the predetermined reference may be to change the screen of the first application, such as changing the size of the screen of the first application or changing the layout of the screen, when a folding operation or an unfolding operation is detected have.

51 is a view showing a screen of a second application by determining a second application according to an embodiment.

According to the present embodiment, when the messenger message is received while the display of the first application is being displayed and the folding operation or the unfolding operation of the electronic device 100c is detected, the control unit 230 displays the screen of the messenger application as the first application Together with the screen of FIG. When an icon 5110 indicating a notification event is displayed in a state that the screen of the first application is displayed, the user performs a folding operation or an unfolding operation of the electronic device 100b to execute an application related to the notification event, .

52 is a diagram illustrating an electronic device control method according to an embodiment.

According to the present embodiment, when the content or the link is received, the electronic device 100a determines the application for executing the content or the link to be the second application when the folding operation or the unfolding operation is detected. The user can execute an application for executing the received content or link by a simple operation of folding or unfolding the electronic device 100a.

First, the electronic device 100a displays a screen of the first application (S5202). When the folding operation or the unfolding operation is detected in the state detecting unit 220 (S5204), the control unit 230 determines the second application.

The control unit 230 first determines whether the content or link has been received through the first application (S5206). The contents include, for example, pictures, moving pictures, music, contacts, electronic business cards, and the like. The link includes, for example, an Internet site link, an application execution path link, a map information link of a map application, and the like.

If the content or link is received (S5206), the control unit 230 determines the application for executing the content or link received through the first application to be the second application (S5208). For example, when receiving a photo, the second application may include a photo album application, a photo playback application, a photo browsing browser in the first application, and the like. When the moving picture is received, the second application may include a moving picture playback application, a moving picture browsing browser in the first application, and the like. When the music is received, the second application may be a music application. When receiving the contact, the second application may be a contact application. When receiving the electronic business card, the second application may be a contact application, an electronic business card management application, or the like. When the Internet site link is received, the second application may be an Internet browser application. When the application execution path link is received, the second application may be an application installation application. When receiving the map information link of the map application, the second application may be a map application.

Next, the control unit 230 displays the determined screen of the second application together with the screen of the first application (S5212).

If the content or link is not received (S5206), the control unit 230 changes the screen of the display unit 210 according to a predetermined criterion (S5210). The predetermined criteria may vary according to the embodiments. According to one embodiment, the predetermined criterion may be to determine, as the second application, an application preset to be executed together with the first application. According to another embodiment, the predetermined criterion may be that a user designates an application previously designated in a setting menu or the like as a second application. According to another embodiment, the predetermined reference may be to change the screen of the first application, such as changing the size of the screen of the first application or changing the layout of the screen, when a folding operation or an unfolding operation is detected have.

53 is a view showing a screen of a second application by determining a second application according to an embodiment.

According to the present embodiment, when the first application is a messenger application and a message attaching a picture is received in the messenger application, the control unit 230, when a folding operation or an unfolding operation of the electronic device 100c is detected, Can be determined by the photo album application. In such a case, when the folding operation or the unfolding operation of the electronic device 100c is detected, the screen of the photo album application is displayed together with the screen of the messenger application. In addition, the control unit 230 may display a screen in which a picture attached to the message of the instant messenger application is reproduced in the photo album application.

54 is a view showing a screen of a second application by determining a second application according to an embodiment.

According to the present embodiment, when the first application is the messenger application and the message attaching the map link is received in the messenger application, the controller 230 determines that the folding operation or the unfolding operation of the electronic device 100c is detected, The application can be determined as a map application. In such a case, when the folding operation or the unfolding operation of the electronic device 100c is detected, a screen of the map application is displayed along with the screen of the messenger application. Also, the control unit 230 may display a map of a point corresponding to the map link of the messenger application in the map application.

55 is a diagram illustrating a method of controlling an electronic device according to an embodiment.

According to the present embodiment, when the electronic device 100a detects the folding operation or the unfolding operation, it determines the second application based on the user's application usage history.

First, the electronic device 100a displays a screen of the first application (S5502). When the folding operation or the unfolding operation is detected in the state detecting unit 220 (S5504), the control unit 230 displays, based on the user's application usage history And determines a second application (S5506). For example, the control unit 230 can determine an application having a high frequency of use by the user, an application recently executed by the user, an application running in the background, or the like as the second application. According to one embodiment, when the user requests to execute a specific application through the second application selection menu, the user can learn the application selection history to obtain information about the user's preferred application, 2 application.

Next, the control unit 230 displays the determined screen of the second application together with the screen of the first application (S5508).

56 is a diagram illustrating an electronic device control method according to an embodiment.

According to the present embodiment, when the folding operation or the unfolding operation is detected, the electronic device 100a determines the application designated by the user as the second application.

First, the electronic device 100a displays a screen of the first application (S5602). When the folding operation or the unfolding operation is detected at the state detecting unit 220 (S5604), the control unit 230 determines whether the user An application is determined to be the second application (S5606). For example, when the user unfolds the electronic device from the folded state to the unfolded state, it can always be set to display the screen of the Internet browser application together with the screen of the first application. The user can set the second application using a setting application or setting menu of the electronic device 100a.

Next, the control unit 230 displays the determined screen of the second application together with the screen of the first application (S5608).

According to the embodiment, the user designates an application frequently used by the user as the second application, and has an effect of accessing frequently used applications by a simple operation of the folding operation or the unfolding operation.

57 is a diagram illustrating a method of controlling an electronic device according to an embodiment.

According to the present embodiment, when the folding operation or the unfolding operation is detected, the electronic device 100a determines the second application based on the state of the user.

First, the electronic device 100a displays a screen of the first application (S5702). When the folding operation or the unfolding operation is detected in the state detecting unit 220 (S5704), the control unit 230 determines It is decided by the application (S5606). For example, the controller 230 may determine the second application in consideration of the user's current location, time, schedule, and the like.

Next, the control unit 230 displays a screen of the determined second application along with the screen of the first application (S5708).

58 is a view showing a screen of a second application by determining a second application according to an embodiment.

According to the present embodiment, when the first application is a schedule management application, the controller 230 can determine the second application based on the current location, current time, and schedule of the user. For example, if a calendar application records a wedding ceremony at Seocho-dong Cathedral at 3 pm today and the present time is 2 o'clock, if the user performs a folding operation or an unfolding operation while displaying the calendar application, A map application may be displayed together with a schedule application indicating a route from a place to a wedding place, Seocho-dong Cathedral.

59 is a diagram illustrating a method of controlling an electronic device according to an embodiment.

According to the present embodiment, when the folding operation or the unfolding operation of the electronic device 100c is detected, the screen of the second application is displayed together with the screen of the first application according to the user input, .

First, the electronic device 100c displays a screen of the first application and provides a window division selection menu (S5902). According to one embodiment, the window split selection menu may be displayed on the display unit 210 and provided in the form of a GUI. According to another embodiment, the window split selection menu may be provided in a predetermined area of the housing of the electronic device 100c, similar to the way in which the second application selection menu 3520 is provided previously in Fig.

Next, if the state detection unit 220 detects a folding operation or an unfolding operation (S5904), the control unit 230 determines whether window division is selected (S5906).

If the window division is selected, the control unit 230 displays the screen of the first application and the screen of the second application together (S5908). The second application may be determined by various criteria as described above.

If the window division is not selected (S5906), the control unit 230 displays the screen of the first application (S5910). That is, when the window division is not selected, the control unit 230 displays the screen of the first application without displaying the screen of the second application.

60 is a view illustrating a window division selection menu according to an embodiment.

According to the present embodiment, the electronic device 100c is folded in an asymmetrical shape, the screen of the first application is displayed on the display unit 210 in the folded state, the window division selection menu 6020 is displayed on the fourth area 6010, .

The window division selection menu 6020 is a menu for selecting whether to display the screen of the second application together with the screen of the first application (Split Window) or not (Full Window). According to one embodiment, as shown in FIG. 60, the fourth region 6010 may be divided into two regions, and window division options may be matched to the respective regions.

According to one embodiment, the fourth region 6010 may be an area on the display 210. [ The fourth region 6010 may be defined as an area of at least a part of the area of the display unit 210 that is exposed from the folded state. When the display unit 210 is implemented with a touch screen, a window division selection menu 6020 is displayed in the fourth area 6010, and a user selection can be received in the form of a touch input on the display unit 210. [

According to another embodiment, the fourth region 6010 is an area disposed on the housing of the electronic device 100c, and may be an area where, for example, a touch sensor, a proximity sensor, or the like is disposed. In this embodiment, the information on the window division selection menu 6020 may be displayed in the fourth area 6010 on the housing or in at least a part of the apparent area of the display unit 210, depending on the embodiment .

According to the present embodiment, by providing the window division selection menu in a predetermined area physically separated from the display unit 210 displaying the screen of the first application by asymmetrically folding, the user can intuitively select the window division selection menu There is an accessible effect. Furthermore, by providing a window division selection menu using a lower layer area revealed by asymmetric folding, it is possible to provide a window division selection menu without covering the screen of the first application or complicating the screen layout .

61 is a view showing a screen when the screen of the second application is selected through the window division selection menu.

According to the present embodiment, when the user selects an option to display the screen of the second application in the folded state and the electronic device 100c is changed from the folded state to the extended state, And displays the screen of the second application.

62 is a view showing a screen when the screen of the second application is not displayed through the window division selection menu.

According to the present embodiment, when the user selects the option of not displaying the screen of the second application in the folded state and the electronic device 100c is changed from the folded state to the extended state, Display the screen. In the unfolded state, the screen of the first application may be changed in size or screen layout may be changed according to a predetermined standard.

63 is a view illustrating a window arrangement selection menu according to an embodiment.

According to the present embodiment, when displaying the screen of the first application and the screen of the second application together, the electronic device 100c displays a window arrangement selection menu for selecting the screen of the first application and the arrangement form of the second application . The user can select the layout of the first application and the layout of the second application through the window layout selection menu. The window arrangement selection menu may be provided through the display unit 210 or a housing of the electronic device 100c or the like.

According to the embodiment shown in FIG. 63, the electronic device 100c is folded in an asymmetrical shape, the screen of the first application is displayed on the display unit 210 in the folded state, Area < / RTI >

The window arrangement selection menu 6320 is a menu for selecting the options of the screen of the first application and the layout of the screen of the second application. For example, the window layout selection menu 6320 may include options for placing the first application on the left, right, or full screen. According to one embodiment, as shown in FIG. 63, the fifth area 6310 may be divided into three areas, and the window arrangement options may be matched to the respective areas.

According to one embodiment, the fifth area 6310 may be an area on the display unit 210. [ The fifth area 6310 may be defined as an area of at least a part of the area of the display unit 210 which is exposed in the folded state. When the display unit 210 is implemented with a touch screen, a window arrangement selection menu 6320 is displayed in the fifth area 6310 and a user selection can be received in the form of a touch input on the display unit 210. [

According to another embodiment, the fifth area 6310 is an area disposed on the housing of the electronic device 100c, and may be an area in which, for example, a touch sensor, a proximity sensor, or the like is disposed. In this embodiment, the information on the window arrangement selection menu 6320 may be displayed in the fifth area 6310 on the housing or in at least part of the apparent area of the display unit 210, according to the embodiment .

According to the present embodiment, by providing the window arrangement selection menu in a predetermined area physically separated from the display unit 210 displaying the screen of the first application by asymmetrically folding, the user intuitively accesses the window arrangement selection menu There is an effect that can be done. Furthermore, by providing a window arrangement selection menu using a lower layer area revealed by asymmetric folding, it is possible to provide a window division selection menu without covering the screen of the first application or complicating the screen layout .

According to this embodiment, the user can easily select a desired layout by determining the layout of the screen of the first application and the layout of the second application according to the user's selection.

FIG. 64 is a view showing a screen when the screen of the first application is displayed on the right side through the window arrangement selection menu; FIG.

According to the present embodiment, when the user selects the option to display the screen of the first application on the right side in the folded state and the electronic device 100c is changed from the folded state to the extended state, Is displayed on the right side and the screen of the second application is displayed on the left side.

65 is a view showing a screen when the screen of the first application is selected to be displayed on the full screen through the window arrangement selection menu.

According to the present embodiment, when the user selects the option of displaying the screen of the first application on the full screen in the folded state and the electronic device 100c is changed from the folded state to the unfolded state, The screen of the application is displayed on the full screen and the screen of the second application is not displayed.

66 is a view showing a screen when the screen of the first application is displayed on the left side through the window arrangement selection menu.

According to the present embodiment, when the user selects the option to display the screen of the first application on the left in the folded state and the electronic device 100c is changed from the folded state to the extended state, Is displayed on the left side and the screen of the second application is displayed on the right side.

67 is a diagram illustrating a screen of a first application and a screen layout of a second application according to an embodiment.

When the screen of the first application and the screen of the second application are displayed together, the screen of the first application and the screen of the second application may be arranged in various ways according to the embodiments.

67, when the folding form of the electronic device 100a is changed so that the screen of the first application and the screen of the second application are displayed together, the screen 6710 of the second application is displayed as a part of the first application As shown in FIG. In this case, for example, the screen of the second application may be displayed in the form of a pop-up window.

According to an embodiment, when the folding form of the electronic device 100a is changed so that the screen of the first application and the screen of the second application are displayed together, the screen of the first application is displayed as a full screen, The screen 6710 of the first application may be displayed so as to cover a part of the screen of the first application. On the contrary, the screen of the second application may be displayed as a full screen, and the screen of the first application may be displayed so as to cover a part of the screen of the second application.

According to another embodiment, as described above, the screen of the first application and the screen of the second application may be divided and displayed in the same size.

68 is a view showing a screen of a first application and a screen layout of a second application according to an embodiment.

According to one embodiment, when the folding operation or the unfolding operation of the electronic device 100a is detected and the screen of the first application and the screen of the second application are displayed together, a screen of the plurality of second applications is displayed on the screen of the first application ≪ / RTI > The screens of the plurality of second applications may be screens of the same application or screens of other applications according to the embodiment.

According to one embodiment, when the folding form of the electronic device 100a is changed so that the screen of the first application and the screen of the second application are displayed together, the screen of the first application and the screens of the plurality of second applications The screen can be divided and arranged as shown in FIG. The size of the screen of the first application and the size of the screen of the second application may be the same or different according to the embodiment.

According to an embodiment of the present invention, in a state that a screen of a first application and a screen of a second application are displayed together, the screen of the first application and the screen of the second application are changed, It is possible to perform operations such as eliminating one screen among a plurality of screens.

69 is a diagram illustrating operation of the electronic device 100 according to one embodiment.

According to the present embodiment, the electronic device 100 detects the user's gaze and turns on only the display portion of the face of the first display portion 310 and the second display portion 320 facing the user, Can be turned off. For example, when the user is looking at the face on which the first display unit 310 is disposed, the second display unit 320 can be turned off. The electronic device 100 may include a camera, a line-of-sight detection sensor, and the like to detect the user's line of sight.

FIG. 70 is a view illustrating information about a second application according to an embodiment.

According to one embodiment, when displaying the screen of the first application, information about the second application may be provided together. For example, if the second application is a contact, the display of the contact application may be displayed when the electronic device 100a is expanded, as shown in Fig.

FIG. 71 is a view illustrating information about a second application according to an embodiment.

According to an exemplary embodiment, when a notification event occurs while displaying the screen of the first application, information that the notification event can be confirmed when the electronic device 100a is expanded or collapsed can be provided. For example, when a text message is received while displaying the screen of the first application, it may indicate that the text message can be confirmed by expanding the electronic device 100a, as shown in FIG.

72 is a diagram showing a structure of an electronic device 100d according to an embodiment.

According to the present embodiment, the display portion 210c may be disposed on the first surface where the electronic device 100d is hidden by folding, and the display portion may not be disposed on the second surface disposed on the opposite side of the first surface. Further, the electronic device 100d may be folded in an asymmetrical shape, and a portion of the first surface may be exposed when the electronic device 100d is folded.

According to this embodiment, the electronic device 100d may provide a second application selection menu 3520 on a portion of the first side exposed in the collapsed state.

According to one embodiment, the second application selection menu is displayed on the display unit 210 in the form of a GUI. The display portion 210c may be disposed including the first region 7210 exposed when the electronic device 100d is folded. The display unit 210c may include a sixth region 7210 in which the second application selection menu 3520 is displayed and a seventh region 7220 in which the operation screen of the electronic device 100c is displayed, Frame or the like.

According to another embodiment, the second application selection menu 3520 is provided to receive user input through a touch sensor, a key button, or the like disposed in a predetermined area of the housing of the electronic device 100d. At this time, information on the second application selection menu 3520 may be displayed in a predetermined area of the display unit 210. [

73 is a diagram illustrating an example of a second application selection menu 3520 according to an embodiment.

The second application selection menu 3520 indicates a user selectable application, and the user can select an application. According to one embodiment, as shown in FIG. 73, the sixth area 7210 can be divided into a plurality of areas, and the selectable applications can be matched to the respective areas.

74 is a view for explaining an operation of selecting and executing a second application using the second application selection menu 3520 according to an embodiment.

According to the present embodiment, while the electronic device 100d is providing the second application selection menu 3520 in a folded state, the user selects one of the plurality of applications included in the second application selection menu 3520, If the device is changed to the unfolded state (S7402), the electronic device 100d can display a screen of the second application selected by the user in a predetermined area of the display unit 210c. For example, while the electronic device 100d is a smartphone and the user is in the standby mode in the folded state, after the user selects the telephone function in the second application selection menu 3520, the electronic device 100d is switched to the extended state (S7402), the second application screen is displayed in the eighth area 7410 of the display unit 210c, and the first application screen is displayed in the ninth area 7420 (S7404). The first application screen may include, for example, a home screen that appears when the screen is turned on in the standby mode, an application list screen, a screen of an application previously designated by the user, and the like.

75 is a diagram for explaining a process of providing a second application screen according to an embodiment.

According to an exemplary embodiment, when a user is speaking using the electronic device 100d, the user's voice call content is recognized, and when a word related to a specific application is recognized from the call content, (3520). Recognition of voice call content can be performed using various speech recognition algorithms. Information on the application related to the recognized word is stored in advance in the electronic device 100d or can be set by the user.

For example, as shown in FIG. 75, it is assumed that the user refers to the word " schedule " during a conversation while the electronic device 100d is folded (S7532). When the word " schedule " and the related application are designated in the electronic device 100d, the electronic device 100d recognizes the word " schedule " (S7532). The electronic device 100d places a selection menu 7510 on the second application selection menu 3520 that allows selection of an application related to the word " schedule " (S7534). According to one embodiment, the electronic device 100d arranges a selection menu 7510 corresponding to an application associated with a recognized word on a touch interface using the display unit 210a, and displays a picture corresponding to the selection menu 7510 Or characters on the touch interface.

The user selects an associated application and expands the electronic device 100d (S7534), using the related application's selection menu 7510 further disposed on the second application selection menu 3520, The screen 7520 can be viewed (S7536). According to the present embodiment, there is an effect of enhancing user convenience by allowing the user to easily recognize the contents of the user's call and using the application that the user is expected to use immediately.

76 is a diagram showing a structure of an electronic device 100e according to an embodiment.

According to one embodiment, the electronic device 100e can be implemented in the form of a rollable device. According to the present embodiment, as shown in FIG. 76, the display unit 210d can have two states, a rolled state and an unrolled state. The user can pull the predetermined portion 7610 of the electronic device 100e in the rolled state or switch the electronic device 100e to the unfolded state by pressing a predetermined button. According to one embodiment, the electronic device 100e may be provided with a second application selection menu 3520 in a predetermined area of the exposed electronic device 100e in a rolled state. For example, a second application selection menu 3520 may be provided in a predetermined area of the housing of the electronic device 100e storing the display portion 210d in a state in which it is rolled up as shown in Fig.

The second application selection menu 3520 may be provided in the form of a touch screen, a touch sensor, a button, or the like. The type of application selectable in the second application selection menu 3520 may be preset in the electronic device 100e according to the embodiment, determined according to user selection, or changed according to the operation mode of the electronic device 100e .

77 is a diagram for explaining a process of providing a second application screen in the electronic device 100e according to an embodiment.

According to the present embodiment, the second application selection menu 3520 is provided while the electronic device 100e is being rolled up, and after the user selects an application using the second application selection menu 3520 (S7702) When the apparatus 100e is switched to the expanded state (S7704), the screen of the application selected by the user is displayed on the display unit 210d while the display unit 210d is being displayed (S7706). The operation S7702 of selecting an application may be performed before the user starts the operation of expanding the display portion 210d (S7702), or during the operation of expanding S7702, or when the display portion 210d Can be performed in an unfolded state.

According to one embodiment, when the user selects the second application in the second application selection menu 3520, the electronic device 100e displays the first application or the already-running first application, A screen of the selected second application can be displayed.

78 is a block diagram showing a configuration of an electronic device 100f according to an embodiment.

78, the configuration of the electronic device 100f may be a mobile phone, a tablet PC, a PDA, an MP3 player, a kiosk, an electronic frame, a navigation device, a digital TV, a wrist watch, And a wearable device such as a head-mounted display.

According to Figure 78, the electronic device 100f includes a display portion 7810, a control portion 7870, a memory 7820, a GPS chip 7825, a communication portion 7830, a video processor 7835, an audio processor 7840, And may include at least one of a user input unit 7845, a microphone unit 7850, an image sensing unit 7855, a speaker unit 7860, a motion sensing unit 7865, and a sensor unit 7880.

The display portion 7810 may include a display panel 7811 and a controller (not shown) for controlling the display panel 7811. The display panel 7811 may include various types of displays such as a liquid crystal display (LCD), an organic light emitting diode (OLED) display, an active matrix organic light-emitting diode (AM-OLED), and a plasma display panel . The display panel 7811 can be embodied as being flexible, transparent or wearable. The display portion 7810 may be coupled with a touch panel 7847 of the user input portion 7845 and provided as a touch screen (not shown). For example, the touch screen (not shown) may include an integrated module in which a display panel 7811 and a touch panel 7847 are combined in a laminated structure.

The memory 7820 may include at least one of an internal memory (not shown) and an external memory (not shown).

The built-in memory may be a volatile memory (for example, a dynamic RAM (DRAM), a static random access memory (SRAM), a synchronous dynamic RAM (SDRAM), or the like), a nonvolatile memory (e.g., an OTPROM ), A PROM (Programmable ROM), an EPROM (Erasable and Programmable ROM), an EEPROM (Electrically Erasable and Programmable ROM), a Mask ROM, a Flash ROM etc.), a hard disk drive (HDD), or a solid state drive . According to one embodiment, the control unit 7870 can load and process commands or data received from at least one of the non-volatile memory or other components into the volatile memory. In addition, the control unit 7870 can save data received or generated from other components in the nonvolatile memory.

The external memory may store at least one of CF (Compact Flash), SD (Secure Digital), Micro-SD (Micro Secure Digital), Mini-SD (Mini Secure Digital), xD .

The memory 7820 may store various programs and data used in the operation of the electronic device 100f. For example, the memory 7820 may temporarily or semi-permanently store at least a portion of the content to be displayed on the lock screen.

The control unit 7870 can control the display unit 7810 such that a part of the content stored in the memory 7820 is displayed on the display unit 7810. [ In other words, the control unit 7870 can display a part of the content stored in the memory 7820 on the display unit 7810. [ Alternatively, when the user gesture is performed in one area of the display unit 7810, the control unit 7870 may perform a control operation corresponding to the gesture of the user.

The control unit 7870 may include at least one of a RAM 7871, a ROM 7872, a CPU 7873, a GPU (Graphic Processing Unit) 7874, and a bus 7875. The RAM 7871, the ROM 7872, the CPU 7873, and the GPU 7874 may be interconnected via a bus 7875.

The CPU 7873 accesses the memory 7820 and performs booting using the O / S stored in the memory 7820. Various operations are performed using various programs, contents, data, and the like stored in the memory 7820.

The ROM 7872 stores a command set for booting the system and the like. The CPU 7873 copies the OS stored in the memory 7820 to the RAM 7871 in accordance with the instruction stored in the ROM 7872 and outputs the OS to the RAM 7871. [ You can run it to boot the system. When the booting is completed, the CPU 7873 copies various programs stored in the memory 7820 to the RAM 7871, executes the program copied to the RAM 7871, and performs various operations. The GPU 7874 displays the UI screen in the area of the display unit 7810 when the booting of the electronic device 100f is completed. Specifically, the GPU 7874 can generate a screen displaying an electronic document including various objects such as contents, icons, menus, and the like. The GPU 7874 computes an attribute value such as a coordinate value, a shape, a size, and a color to be displayed by each object according to the layout of the screen. Then, the GPU 7874 can generate screens of various layouts including the objects based on the calculated attribute values. The screen generated by the GPU 7874 may be provided to the display unit 7810 and may be displayed in each area of the display unit 7810, respectively.

The GPS chip 7825 can receive the GPS signal from a GPS (Global Positioning System) satellite and calculate the current position of the electronic device 100f. The control unit 7870 can calculate the user position by using the GPS chip 7825 when using the navigation program or otherwise requiring the user's current position.

The communication unit 7830 can perform communication with various types of external devices according to various types of communication methods. The communication unit 7830 may include at least one of a Wi-Fi chip 7831, a Bluetooth chip 7832, a wireless communication chip 7833, and an NFC chip 7834. The control unit 7870 can communicate with various external devices using the communication unit 7830. [

The Wi-Fi chip 7831 and the Bluetooth chip 7832 can perform communication using the WiFi method and the Bluetooth method, respectively. In the case of using the Wi-Fi chip 7831 or the Bluetooth chip 7832, various connection information such as an SSID and a session key may be transmitted and received first, and communication information may be used to transmit and receive various information. The wireless communication chip 7833 refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3G (3rd Generation), 3GPP (Third Generation Partnership Project), LTE (Long Term Evolution) The NFC chip 7834 refers to a chip operating in the NFC (Near Field Communication) mode using the 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz and 2.45 GHz.

The video processor 7835 can process the content received via the communication unit 7830 or the video data included in the content stored in the memory 7820. [ The video processor 7835 can perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, etc. on the video data.

The audio processor 7840 can process the content received via the communication unit 7830 or the audio data contained in the content stored in the memory 7820. [ In the audio processor 7840, various processes such as decoding or amplification of audio data, noise filtering, and the like can be performed.

The control unit 7870 can execute the playback program for the multimedia content and can play the corresponding content by driving the video processor 7835 and the audio processor 7840. The speaker unit 7860 can output the audio data generated by the audio processor 7840.

The user input unit 7845 can receive various commands from the user. The user input portion 7845 may include at least one of a key 7846, a touch panel 7847, and a pen recognition panel 7848.

The key 7846 may include various types of keys, such as mechanical buttons, wheels, etc., formed in various areas such as the front or side of the body exterior of the electronic device 100f,

The touch panel 7847 senses a user's touch input and outputs a touch event value corresponding to the sensed touch signal. When the touch panel 7847 is combined with the display panel 7811 to constitute a touch screen (not shown), the touch screen can be implemented by various types of touch sensors such as an electrostatic type, a pressure sensitive type, a piezoelectric type, The electrostatic type is a method of calculating the touch coordinates by sensing the minute electricity generated by the user's body when a part of the user's body is touched on the touch screen surface by using a dielectric coated on the surface of the touch screen. The depressurization type includes two electrode plates built in the touch screen. When the user touches the screen, the upper and lower plates of the touched point contact each other to sense current flow, and the touch coordinates are calculated. A touch event occurring on a touch screen can be generated by a finger of a person, but can also be generated by a conductive material capable of applying a capacitance change.

The pen recognition panel 7848 senses proximity or touch input of the pen as a result of operation of the user's touch pen (e.g., a stylus pen, a digitizer pen) Touch events can be output. Pen recognition panel 7848, for example, may be implemented in an EMR manner and may sense a touch or proximity input according to proximity of a pen or change in intensity of an electromagnetic field due to a touch. In detail, the pen recognition panel 7848 includes an electromagnetic induction coil sensor (not shown) having a grid structure and an electronic signal processing unit (not shown) for providing an AC signal having a predetermined frequency sequentially to each loop coil of the electromagnetic induction coil sensor ). ≪ / RTI > When a pen incorporating a resonant circuit exists in the vicinity of the loop coil of the pen recognition panel 7848, the magnetic field transmitted from the loop coil generates a current based on mutual electromagnetic induction in the resonant circuit in the pen. Based on this current, an induction magnetic field is generated from the coils constituting the resonance circuit in the pen, and the pen recognition panel 7848 detects the induction magnetic field in the loop coil in the signal reception state, The touch position can be detected. The pen recognition panel 7848 may be provided under the display panel 7811 with a certain area, for example, an area that can cover the display area of the display panel 7811. [

The microphone unit 7850 can receive a user voice or other sound and convert it into audio data. The control unit 7870 can use the user's voice input through the microphone unit 7850 in a call operation or convert the user's voice into audio data and store it in the memory 7820.

The image pickup section 7855 can capture a still image or a moving image under the control of the user. The image pickup unit 7855 may be implemented as a plurality of units such as a front camera and a rear camera.

When the image pickup section 7855 and the microphone section 7850 are provided, the control section 7870 performs a control operation in accordance with the user's voice inputted through the microphone section 7850 or the user motion recognized by the image pickup section 7855 It is possible. For example, the electronic device 100f may operate in a motion control mode or a voice control mode. When operating in the motion control mode, the control unit 7870 activates the image pickup unit 7855 to pick up a user, track the motion change of the user, and perform the corresponding control operation. When operating in the voice control mode, the control unit 7870 analyzes the user voice input through the microphone unit 7850 and operates in a voice recognition mode for performing a control operation according to the analyzed user voice.

The motion detection unit 7865 can detect movement of the main body of the electronic device 100f. The electronic device 100f can be rotated or tilted in various directions. At this time, the motion sensing unit 7865 can sense motion characteristics such as rotation direction, angle, and slope using at least one of various sensors such as a geomagnetic sensor, a gyro sensor, and an acceleration sensor.

In addition, although not shown in FIG. 78, the embodiment includes a USB port through which a USB connector can be connected in the electronic device 100f, various external input ports for connecting with various external terminals such as a headset, a mouse, and a LAN, A DMB chip for receiving and processing a digital multimedia broadcasting (DMB) signal, and various sensors.

The names of components of the electronic device 100f described above may be different. In addition, the electronic device 100f according to the present disclosure may be configured to include at least one of the above-described components, and some components may be omitted or further include other additional components.

The display unit 210 according to an embodiment of the present invention may correspond to the display unit 7810 of FIG. The control unit 230 according to an embodiment of the present invention may correspond to the control unit 7870 of FIG. The user input unit 7845 according to an embodiment of the present invention may correspond to the user input unit 7845 of FIG. The status detector 220 according to an embodiment of the present invention may correspond to the sensor unit 7880 in FIG.

On the other hand, the present invention can be realized by storing a computer-readable code in a computer-readable recording medium. The computer-readable recording medium includes all kinds of storage devices in which data that can be read by a computer system is stored.

The computer readable code is configured to perform the steps of implementing an electronic device control method according to the present invention when read from and executed by a processor from the computer readable recording medium. The computer readable code may be implemented in a variety of programming languages. And functional programs, codes, and code segments for implementing embodiments of the present invention may be readily programmed by those skilled in the art to which the present invention pertains.

Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like. It is also possible that the computer-readable recording medium is distributed over a network-connected computer system so that computer-readable codes are stored and executed in a distributed manner.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It will be understood. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

100, 100a, 100b, 100c, 100d, 100e, 100f:
110: first application screen
120: Second application screen
210:
220:
310: first display section
320: second display section
610: folding structure
3310: User input

Claims (20)

A foldable electronic device comprising:
A first display for displaying an execution of at least one first application;
A second display for displaying execution of at least one second application;
A state detector for detecting a folding operation or an unfolding operation of the foldable electronic device; And
And controls to display the first display section and the second display section simultaneously according to the detection result.
The method according to claim 1,
Wherein the control unit controls the first display unit and the second display unit to display the execution of the first application and the execution of the second application when the unfolding operation is detected.
The method according to claim 1,
Wherein the foldable electronic device further comprises an input for receiving a user selection,
Wherein,
And displaying a second application selection menu with the at least one first application screen, wherein the second application selection menu is selectable when the folding operation or the unfolding operation is detected,
And determines the at least one second application in accordance with a user selection through the second application selection menu.
The method according to claim 1,
Wherein the foldable electronic device further comprises an input for receiving a user selection,
Wherein,
Control to display a second application selection menu that allows selection of the at least one second application with execution of the at least one first application when displaying the execution of the at least one first application,
And determines the at least one second application in accordance with a user selection through the second application selection menu.
The method according to claim 1,
Wherein the control unit determines the at least one second application based on a list of related applications stored in advance.
The method according to claim 1,
Wherein the control unit determines the at least one second application based on an input to the at least one first application.
The method according to claim 1,
Wherein the control unit determines the application associated with the notification event occurring in the folderable electronic device as the at least one second application.
The method according to claim 1,
Wherein the control unit determines the at least one second application based on the application usage history of the user.
The method according to claim 1,
Wherein the control unit determines the application designated by the user as the at least one second application.
The method according to claim 1,
The second display portion is disposed on the opposite side of the first display portion,
The state detecting section detects a partly folding operation of covering at least a part of the first display section indicating execution of the at least one first application and folding at least a part of the second display section in the same direction as the first display section and,
Wherein,
Wherein when at least a part of the uncovered area of the first display unit is detected, the execution of the at least one first application is displayed on the at least a part of the uncovered area of the first display unit, The execution of the at least one second application.
A control method of a foldable electronic device,
Displaying at least one first application screen;
Detecting a folding or unfolding operation of the foldable electronic device; And
And displaying the at least one first application screen and the at least one second application screen according to the detection result.
12. The method of claim 11,
Wherein the step of displaying the at least one first application screen and the at least one second application screen comprises displaying the at least one first application screen and the at least one second application screen when the spreading operation is detected , A method of controlling a foldable electronic device.
12. The method of claim 11,
Displaying a second application selection menu with the at least one first application screen, wherein the second application selection menu is selectable if the folding operation or the unfolding operation is detected;
Receiving a user selection via the second application selection menu; And
And determining the at least one second application in accordance with the user selection.
12. The method of claim 11,
Wherein displaying the screen of the at least one first application comprises displaying a second application selection menu capable of selecting the at least one second application with a screen of the at least one first application,
The foldable electronic device control method includes:
Receiving a user selection via the second application selection menu; And
And determining the at least one second application in accordance with the user selection.
12. The method of claim 11,
Further comprising the step of determining the at least one second application based on a list of pre-stored related applications.
12. The method of claim 11,
Further comprising: determining the at least one second application based on an input to the at least one first application.
12. The method of claim 11,
Further comprising determining an application associated with a notification event occurring in the folderable electronic device as the at least one second application.
12. The method of claim 11,
Further comprising: determining the at least one second application based on a user's application usage history.
12. The method of claim 11,
And determining the application designated by the user as the at least one second application.
12. The method of claim 11,
Wherein the detecting step includes the steps of: covering a part of the first display portion displaying the at least one first application screen; folding at least a part of the second display portion opposite to the first display portion in the same direction as the first display portion Detecting some folding operation,
Wherein the step of displaying the at least one first application screen and the at least one second application screen comprises the steps of: when the partial folding operation is detected, displaying the at least one first application screen and the at least one second application screen on at least a part of the non- Displaying the application screen and displaying the at least one second application screen on at least a part of the area arranged in the same direction as the first display part of the second display part.

Images