WO2016117811A1

WO2016117811A1 - Electronic device and method for controlling electronic device

Info

Publication number: WO2016117811A1
Application number: PCT/KR2015/012088
Authority: WO
Inventors: 장궈리앙; 천리에신
Original assignee: 삼성전자 주식회사
Priority date: 2015-01-19
Filing date: 2015-11-11
Publication date: 2016-07-28

Abstract

A method for controlling an electronic device and an electronic device are disclosed. The disclosed method for controlling an electronic device, according to one embodiment, may comprise the steps of: receiving a user's input by means of a second screen on which a user interface is updated independent of a first screen; and controlling an action, which is performed in an electronic device and displayed on the first screen, on the basis of the user's input.

Description

Electronic device and control method of electronic device

The disclosed embodiments relate to an electronic device and a method of controlling the electronic device, and more particularly, to a method of controlling an electronic device including a plurality of screens.

Electronic devices have become essential devices in people's lives and tasks. In particular, mobile electronic devices, including smartphones and tablet PCs, are most frequently used by users.

The user is accustomed to carrying the electronic devices and controlling the electronic device with one hand. However, as the screen size of the electronic device gradually increases, it is not easy for a user to control the electronic device with one hand. Therefore, there is a need for a method in which a user can conveniently control the electronic device with one hand.

As the size of the screen of the electronic device increases, a method for allowing a user to conveniently control the electronic device with one hand is required.

An electronic device control method according to the disclosed embodiment receives a user input via a second screen whose user interface is updated independently of the first screen, and is performed on the electronic device based on the received user input to perform on the first screen. By controlling the operation displayed on the screen, the user can conveniently control the electronic device with one hand.

The electronic device and the method for controlling the electronic device according to the disclosed embodiment allow the user to conveniently control the electronic device with one hand.

1 is a diagram illustrating an example of an electronic device according to an embodiment of the present disclosure.

2A-2C are flowcharts illustrating a method of controlling an electronic device according to an embodiment of the present disclosure.

3 is a diagram for describing a method of controlling an electronic device, according to an exemplary embodiment.

4 is a diagram for describing mapping a user input to an operation performed by an electronic device and displayed on a first screen according to an embodiment of the present disclosure.

FIG. 5 is a diagram for describing an example of changing a parameter related to a second screen of an electronic device according to an embodiment of the present disclosure.

FIG. 6 is a diagram illustrating an example of dividing a second screen of an electronic device into a plurality of areas according to an exemplary embodiment.

7 is a diagram illustrating an example of a keyboard displayed on a second screen according to an embodiment of the present disclosure.

FIG. 8 is a diagram for describing a method of distinguishing and displaying a user input received through a second screen according to an exemplary embodiment on a first screen.

9 is a diagram for describing a method of releasing a locked state of an electronic device, according to an exemplary embodiment.

10A to 10C are diagrams for describing a method of releasing a locked state of an electronic device, according to an exemplary embodiment.

11 is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure.

12 to 14 are block diagrams illustrating a configuration of an electronic device according to another disclosed embodiment.

15 to 17 are flowcharts illustrating a control method of an electronic device according to another disclosed embodiment.

According to an embodiment of the present disclosure, a method of controlling an electronic device is performed by an electronic device based on a user input and receiving a user input through a second screen on which a user interface is updated independently of the first screen. 1 may include controlling an operation displayed on the screen.

According to an embodiment of the present invention, a method of performing a mapping operation corresponding to a user input based on a mapping result and a step of pre-mapping an operation performed on an electronic device and displayed on a first screen and a mapping result may be performed. The method may further include displaying on a screen.

The user input according to an embodiment of the present invention may include one of an input of dragging on the second screen, an input of single tapping, an input of double tapping, and a touch and hold input.

The controlling of the operation displayed on the first screen according to an embodiment of the present disclosure may include displaying a predetermined operation on the first screen based on a user input, and displaying the first screen and the first screen according to the displayed operation. Controlling the user interface of the two screens.

Receiving a user input according to an embodiment of the present invention includes touching a key of a keyboard displayed on a second screen, and controlling the operation displayed on the first screen. The method may include displaying, on the first screen, an operation determined based on a value corresponding to the touched key.

The method according to an embodiment of the present invention may further include changing a display format of the keyboard according to a user setting.

According to an embodiment of the present invention, the method may be configured to adaptively set at least one of a location, a length, and a width of an area for receiving a user input through a second screen according to a user. It may further comprise the step.

The method may further include dividing the second screen into a plurality of areas and performing different operations according to user input received through the divided areas.

The method according to an embodiment of the present invention further includes updating a user interface of the first screen and the second screen based on state information of the first screen and the second screen, and including the state information. May include at least one of information related to a locked state of the electronic device, a selected application, and a running application.

The method according to an embodiment of the present disclosure may further include unlocking the electronic device based on a preset user input received through the second screen.

According to an embodiment of the present disclosure, an electronic device may include a display unit including a first screen and a second screen whose user interface is updated independently of the first screen, a user input unit receiving a user input through the second screen, and The controller may include a controller to control an operation performed on the first screen and displayed on the first screen based on a user input.

According to an embodiment of the present disclosure, the controller may pre-map an operation performed on the first screen and a user input and is displayed on the first screen based on the mapping result. can do.

The controller according to an embodiment of the present invention may display a predetermined operation on the first screen based on a user input, and control the user interface of the first screen and the second screen according to the displayed operation.

The user input according to an embodiment of the present invention includes an input of touching a key of a keyboard displayed on a second screen, and the controller is configured to perform an operation determined based on a value corresponding to the touched key on the first screen. Can be displayed on.

The control unit according to an embodiment of the present invention may change the display format of the keyboard according to the user setting.

According to an embodiment of the present disclosure, the controller may adaptively set at least one of a position, a length, and a width of an area for receiving a user input through a second screen according to the user.

The second screen according to an embodiment of the present invention may be divided into a plurality of areas, and the controller may perform different operations according to a user input received through the divided areas.

The control unit according to an embodiment of the present invention updates the user interface of the first screen and the second screen based on the state information of the first screen and the second screen, and the state information includes a locked state of the electronic device and a selected application. , And information related to the running application.

Terms used herein will be briefly described and the present invention will be described in detail.

The terms used in the present invention have been selected as widely used general terms as possible in consideration of the functions in the present invention, but this may vary according to the intention or precedent of the person skilled in the art, the emergence of new technologies and the like. In addition, in certain cases, there is also a term arbitrarily selected by the applicant, in which case the meaning will be described in detail in the description of the invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms and the contents throughout the present invention, rather than the names of the simple terms.

When any part of the specification is to "include" any component, this means that it may further include other components, except to exclude other components unless otherwise stated.

In addition, the terms "... unit", "module", etc. described in the specification mean a unit for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software. .

Throughout the specification, "touch input" refers to a gesture that a user makes on a touch screen to control an electronic device. For example, the touch input may include a single tap, a double tap, a touch and hold, a drag, and the like.

A “single tap” refers to an action in which a user immediately touches the screen using a finger or a touch tool (eg, an electronic pen) and immediately lifts off the screen without moving.

“Double tap” refers to an action in which a user touches the screen twice using a finger or a touch tool (eg, an electronic pen).

The term “drag” refers to an operation in which a user touches a finger or a touch tool on the screen and then moves the finger or the touch tool to another position on the screen while maintaining the touch.

"Touch & hold" refers to an operation in which a user holds a touch input for more than a threshold time (eg, 2 seconds) after touching a screen using a finger or a touch tool (eg, an electronic pen). For example, this means that the time difference between the touch-in time point and the touch-out time point is greater than or equal to a threshold time (eg, 2 seconds). In order to allow the user to recognize whether the touch input is a tap or a touch and hold, the feedback signal may be provided visually, acoustically, or tactilely when the touch input is maintained for a threshold time or more. In addition, the threshold time may be changed according to an embodiment.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

The electronic device 100 according to the disclosed embodiment may be implemented in various forms. For example, the electronic device 100 may be a mobile phone, a smart phone, a PC, a tablet PC, a personal digital assistant (PDA), a smart TV, a laptop, a media player, an MP3 player, a portable multimedia player (PMP), Digital cameras, kiosks, navigation, global positioning system (GPS) devices, e-book terminals, digital broadcasting terminals, and other mobile or non-mobile computing devices, but are not limited thereto. The electronic device 100 may be a wearable device such as a watch, glasses, a hair band, and a ring having a communication function and a data processing function, but is not limited thereto.

Referring to FIG. 1, an electronic device 100 according to an embodiment may include a first screen 110 and a second screen 120.

As shown in FIG. 1, the first screen 110 and the second screen 120 may be configured as one curved screen or a plurality of independent screens, but are not limited thereto. In addition, as illustrated in FIG. 1, the second screen 120 may be located at both sides of the electronic device 100, but is not limited thereto.

The second screen 120 may be updated independently of the first screen 110 and the user interface. For example, the first screen 110 may display an overall operation performed on the electronic device 100, and the second screen 120 may be performed by the electronic device 100 to display the first screen 110. A user interface for controlling the displayed operation can be displayed.

The electronic device 100 receives a user input through the second screen 120, and controls an operation performed on the electronic device 100 and displayed on the first screen 110 based on the received user input. can do.

For example, the electronic device 100 may pre-map an operation performed by the electronic device and displayed on the first screen 110 with respect to each user input received through the second screen 120. The electronic device 100 may receive a user input including various touch inputs through the second screen 120. Then, an operation corresponding to the user input based on the mapping result may be performed by the electronic device 100 and displayed on the first screen 110.

2A-2C are flow diagrams illustrating a method of operating an electronic device in accordance with one disclosed embodiment.

Referring to FIG. 2A, in operation S210, the electronic device 100 may receive a user input through the second screen 120. In this case, the user input may be a touch input including a drag, a single tap, a double tap, and a touch and hold, but is not limited thereto.

In operation S212, the electronic device 100 may control an operation performed on the electronic device and displayed on the first screen 110 based on a user input.

When a user input is received through the second screen 120, an operation corresponding to the user input may be performed by the electronic device 100 and displayed on the first screen 110. For example, when an input of dragging downward through the second screen 120 is received, an operation of dragging the page downward may be performed by the electronic device 100 and displayed on the first screen 110. .

In this case, the electronic device 100 may pre-map each user input received through the second screen 120 to an operation performed by the electronic device and displayed on the first screen 110. In addition, a mapping relationship between a user input and an operation performed by the electronic device 100 and displayed on the first screen 110 may be stored in a memory during a manufacturing process of the electronic device 100. In addition, according to an embodiment, the mapping relationship may be changed according to a user's setting. The mapping between the user input and the operation performed by the electronic device 100 and performed on the first screen 110 will be described later with reference to FIG. 4.

In addition, the electronic device 100 displays a predetermined operation on the first screen 110 based on a user input received through the second screen 120, and according to the displayed operation, the first screen 110 and The user interface of the second screen 120 may be updated.

Referring to FIG. 2B, in operation S220, the electronic device 100 may receive a user input through the second screen 120.

In operation S222, the electronic device 100 may determine a mapping relationship between a user input received through the second screen 120 and an operation performed on the electronic device 100 and displayed on the first screen 110. Accordingly, an operation corresponding to the user input may be displayed on the first screen 110. Since the descriptions of step S220 and step S222 have been described in detail with reference to FIG. 2A, overlapping contents are omitted.

In operation S224, the electronic device 100 may update the user interface of at least one of the first screen 110 and the second screen 120 according to the operation displayed on the first screen 110. For example, when a single tap input is received from the second screen 120, an operation of executing a particular application may be performed by the electronic device 100 and displayed on the first screen 110. In this case, when the executed application requests text input, the electronic device 100 may display a keyboard capable of receiving the text input on the second screen 120.

In addition, the electronic device 100 may update the user interface of the first screen 110 and the second screen 120 based on the state information as well as the user input.

Referring to FIG. 2C, the electronic device 100 may receive a user input through the second screen 120 (step S230), and may check state information of the first screen 110 and the second screen 120. (Step S232).

The state information of the first screen 110 may include information related to whether the electronic device 100 is in a locked state, a page displayed on the first screen, a selected page, a selected application, and a running application.

For example, in the case of state information related to a running application, an initial value may be set to "-1", and an initial value "-1" may mean that there is no currently running application. In this case, when a specific application is executed according to a user input, the electronic device 100 may update the serial number of the running application as new state information.

In addition, in the case of state information related to the locked state of the electronic device 100, an initial value may be set to “Yes”. When the locked state of the electronic device 100 is released according to a user input, the electronic device 100 may update state information related to the locked state.

In addition, certain software screens (eg, home screens, lock screens, or application screens) of the electronic device 100 may include a plurality of pages. A plurality of application lists may be displayed on each page, or a running application may be displayed. Accordingly, the state information of the first screen 110 may include the number of the page currently displayed on the first screen 110. And, even if the same user input is received, the electronic device 100 may perform different operations according to the number of pages currently displayed.

The status information of the second screen 120 may include information about whether the second screen 120 is in use by a particular item, the type of item displayed on the second screen 120 and the number of pages of the item. Can be. In this case, the item may be a setting menu, a keyboard, and a predetermined application that can be used by the user on the second screen 120, but is not limited thereto.

For example, when the keyboard is displayed on the second screen 120, the status information regarding the type of the item may be a serial number corresponding to the keyboard. In addition, depending on space constraints, the keyboard may be displayed in a plurality of pages on the second screen 120, and the page number of the currently displayed keyboard may constitute status information.

In operation S234, the electronic device 100 may display a user interface of the first screen 110 and the second screen 120 based on state information and user input of the first screen 110 and the second screen 120. Can be updated.

For example, if there is a selected application and a single tap input is received through the second screen 120, the electronic device 100 may execute the selected application based on state information and user input regarding the selected application. In addition, when no application is selected and a single tap input is received through the second screen 120, the electronic device 100 may be changed to a locked state. However, the operation performed based on the state information and the user input is not limited to the above example.

As described above, as a user input of dragging downward through the second screen 120 is received, dragging the page downward is performed by the electronic device 100 to display on the first screen 110. Can be.

For example, as shown in FIG. 3, as the dragging page downward is performed by the electronic device 100 and displayed on the first screen 110, the display on the first screen 110 is displayed. Pages may be scrolled.

For example, when a page containing text is scrolled and the bottommost text is displayed, the second screen 120 returns to a higher menu or receives a user input for exiting the currently displayed page. Can be displayed.

4 is a diagram for describing a mapping relationship between a user input and an operation performed by an electronic device and displayed on a first screen, according to an exemplary embodiment.

As described above, the user input 410 received through the second screen 120 may be a touch input including drag, single tap, double tap, and touch and hold, but is not limited thereto. In addition, an operation 420 performed by the electronic device 100 according to a user input and displayed on the first screen 110 may be mapped as illustrated in FIG. 3, but is not limited thereto.

Referring to FIG. 4, an input of dragging on the second screen 120 may correspond to a drag operation performed by the electronic device 100 and displayed on the first screen 110. For example, when an input for dragging in a specific direction is received through the second screen 120, the dragging operation in the same direction may be performed by the electronic device 100 and displayed on the first screen.

In addition, the single tap input from the second screen 120 may correspond to an operation of selecting a specific application or executing the selected application from among a plurality of applications displayed on the first screen 110.

In addition, an input of double tapping on the second screen 120 may correspond to an operation of returning to an upper menu on the first screen 110 or terminating an application currently running.

In addition, the electronic device 100 may divide the second screen 120 into a plurality of regions. In addition, according to a user input in each area, different operations may be performed by the electronic device 100 and displayed on the first screen 100. For example, the touch and hold input in the center area may correspond to an operation of changing the electronic device 100 to a locked state. The touch and hold inputs in the up, down, left, and right areas of the second screen 120 may correspond to dragging up, down, left, and right, respectively.

However, the aforementioned mapping relationship is only one embodiment, and other operations may be performed according to the embodiment.

5 is a diagram for describing an example of changing a parameter related to a second screen according to an exemplary embodiment.

The electronic device 100 may change a parameter related to the second screen 120 according to a user setting.

The parameters related to the second screen 120 may include On / Off of the “one hand control function” as shown in FIG. 5. In this case, the “one hand control function” is a function of controlling an operation performed by the electronic device 100 and displayed on the first screen 110 based on a user input received through the second screen 120. It may refer to, but other terms may be used according to the embodiment. Hereinafter, for convenience of explanation, it will be referred to as a one-handed control function.

In addition, the electronic device 100 may set at least one of a location, a length, and a width of an area for receiving a user input through the second screen 120 according to a user's hand. Can be. For example, when the size of the user's hand is small, at least one of the length and width of the area for receiving the user input through the second screen 120 may be changed smaller than the current setting. Alternatively, the electronic device 100 may set a location of an area for receiving a user input through the second screen 120 according to the holding state of the user.

In addition, the electronic device 100 may recognize a repetitive gripping habit of the user and adaptively set an area for receiving a user input through the second screen 120 based on the recognized gripping habit.

The electronic device 100 may change a display format of a keyboard displayed on the second screen 120. For example, the electronic device 100 may change the keyboard displayed on the second screen 120 into a format such as 2x5 or 3x3 according to a user's setting. A keyboard displayed on the second screen 120 will be described later with reference to FIG. 7.

In addition, as described above, the electronic device 100 may change a mapping relationship between a user input and an operation performed by the electronic device 100 and displayed on the first screen according to a user's convenience.

A setting menu of a parameter related to the second screen 120 may be displayed on the first screen 110 as shown in FIG. 5, but according to an embodiment, may be displayed on the second screen 120. Can be.

In addition, since the second screen 120 is relatively smaller than the first screen 110, when the setting menu is displayed on the second screen 120, the setting menu is a drop-down menu. , May be displayed in the form of an icon. However, it is not limited to this.

Referring to FIG. 6, the second screen 120 may be divided into a plurality of areas. For example, as shown in FIG. 6, the second screen 120 may be divided into areas A 601, B 602, C 603, D 604, and E 605. However, the present invention is not limited thereto.

The electronic device 100 may differently set an operation performed by the electronic device 100 and displayed on the first screen 110 according to an area for receiving a user input. For example, as shown in FIG. 4, when a touch & hold input is received through the E region 605, an operation of changing the electronic device 100 to the lock mode is performed by the electronic device 100 to perform the operation. 1 may be displayed on the screen 110. In addition, when a touch and hold input is received through one of A 601, B 602, C 603, and D 604, the currently selected application is executed or the page is dragged in a specific direction. The operation may be performed by the electronic device 100 and displayed on the first screen 110. However, an operation performed by the electronic device 100 according to a user input and displayed on the first screen 110 is not limited to the above-described example.

The electronic device 100 may display a keyboard 700 on the second screen 120 that receives a user input. In this case, the electronic device 100 may divide the number and the English alphabet into a plurality of pages on the second screen 120 and display the divided pages. For example, as shown in FIG. 7, the first page of keyboard 700 displayed on second screen 120 may include numbers 701 displayed in 2 × 5 format. Also, the second page may display a left portion 702 of the keyboard 700, the third page may display a center portion 703 of the keyboard 700, and the fourth page may display a right portion 704 of the keyboard 700. . In this case, the portion of the keyboard 700 displayed on each page is not limited to the above-described example and may be changed according to a user setting. For example, when the display format of the keyboard is set to 3 × 3, the shape and the number of pages displayed on the second screen 120 may be different from those shown in FIG. 7.

In addition, when an input for dragging the keyboard displayed on the second screen 120 is received, the electronic device 100 may change a page of the currently displayed keyboard. For example, when the first page 701 of the current keyboard is displayed, when a user input of dragging to the right through the second screen 120 is received, the electronic device 100 displays the second page 702 of the keyboard. It may be displayed on the second screen 120. However, depending on the embodiment, the user input for changing the page of the keyboard may vary, and is not limited to the above-described example.

FIG. 8 is a diagram for describing a method of distinguishing and displaying a user input received through a second screen 120 on a first screen according to an exemplary embodiment.

When the keyboard 800 is displayed on the second screen 120, the electronic device 100 is performed on the electronic device based on a user input of touching a key of the keyboard 800 to perform the first screen ( The operation displayed on 110 may be controlled. In this case, the electronic device 100 may display the touched key on the first screen 110 so that the key touched through the second screen 120 may be identified.

For example, the electronic device 100 may display the keys currently displayed on the second screen 120 on the first screen 110 and display the touched keys as highlights on the first screen 110. have. In this case, the method of displaying the highlight may include a method of displaying the numbers in bold or different colors, but is not limited thereto. In addition, the electronic device 100 may adjust the transparency of the keys displayed on the first screen 110 according to the user's convenience.

In addition, according to an embodiment, the electronic device 100 may display the touched key on the first screen 110 in a pop-up form. The key displayed in the pop-up form may be displayed in the center area of the first screen 110 or in the edge area of the first screen 110, but is not limited thereto.

In addition, when a key not intended by the user is touched, the electronic device 100 may display a menu on the second screen 120 that may cancel the input of the key. For example, a menu for canceling input of a key may be displayed on the second screen 120 together with the keyboard 800, but is not limited thereto.

Referring to FIG. 9, the electronic device 100 may include a button 130 on one side thereof. However, the position of the button 130 is not limited to one side of the electronic device 100 and may be the top or bottom of the electronic device 100.

When the electronic device 100 is in the locked state, the first screen 110 and the second screen 120 may be in an inactive state. At this time, as the button 130 is clicked, the electronic device 100 may activate the second screen 120. In addition, a lock pattern or a password may be used to release the lock state of the electronic device 100, but is not limited thereto.

When the second screen 120 is activated, the electronic device 100 may display at least one item selectable by the user on the second screen 120. Referring to FIG. 9, an item displayed on the second screen 120 may include a keyboard that may be used to unlock the electronic device 100.

For example, if a password is used, a keyboard may be selected to unlock the electronic device 100. As the key corresponding to the password is touched on the keyboard, the locked state of the electronic device 100 may be released.

10A to 10C illustrate an example in which a lock pattern is used in an electronic device according to an embodiment of the present disclosure.

For example, to unlock the electronic device 100, the lock pattern 1000 illustrated in FIG. 10A may be used. In this case, as shown in FIG. 10A, the lock pattern 1000 may be determined according to a user's setting in a 3 × 3 dot array. Further, in some embodiments, the lock pattern may be set in a 4x4 or 5x5 dot array, but is not limited thereto.

In general, since the second screen 120 is relatively smaller in size than the first screen 110, a space for receiving a user input is narrow. Therefore, when the lock pattern 1000 is used, it is not easy to receive an input for drawing the lock pattern 1000 set by the user through the second screen 120.

Accordingly, the electronic device 100 may map the lock pattern 1000 to the numeric array. When the numbers corresponding to the lock pattern are touched on the keyboard displayed on the second screen 120, the locked state of the electronic device 100 may be released.

For example, the 3 × 3 dot array in which the lock pattern is set may be mapped to the numbers 1010 of 1 to 9, as shown in FIG. 10B. However, the

mapping relationship

1000 and 1010 of each dot and number is not limited to the above-described example, and may be mapped differently according to an embodiment. When the lock pattern 1000 illustrated in FIG. 10A is mapped to the numeric array 1010 illustrated in FIG. 10B, the lock pattern 1000 illustrated in FIG. 10A may correspond to the numeric array illustrated as “23547”.

10C is a diagram illustrating an example in which a locked state of an electronic device is released as numbers corresponding to the lock pattern are touched.

As illustrated in FIG. 10C, when numbers are touched in the order of “23547” on the keyboard 1020 displayed on the second screen 120, the electronic device 100 may display the lock pattern 1030 set by the user. It can be recognized as input. As a result, the locked state of the electronic device 100 may be released.

11 and 12 are block diagrams illustrating a configuration of an electronic device according to an embodiment of the present disclosure.

As illustrated in FIG. 11, the electronic device 100 according to an exemplary embodiment may include a display 1110, a user input unit 1120, and a controller 1130. However, not all illustrated components are essential components. The electronic device 100 may be implemented by more components than the illustrated components, or the electronic device 100 may be implemented by fewer components.

For example, as illustrated in FIG. 12, the electronic device 100 according to an exemplary embodiment may include a communication unit 1140 and a sensing unit, in addition to the display 1110, the user input unit 1120, and the control unit 1130. The unit 1150 may further include an A / V input unit 1160 and a memory 1170.

Hereinafter, the components will be described in order.

The output unit 1115 is for outputting an audio signal, a video signal, or a vibration signal, and the output unit 1115 may include a display unit 1110, an audio output unit 1111, and a vibration motor 1112. It is not limited to this.

The display 1110 displays information processed by the device 100.

In addition, the display 1110 may include a first screen 110 and a second screen 120. The first screen 110 and the second screen 120 may consist of one curved screen or a plurality of independent screens, but is not limited thereto.

The second screen 120 may be updated with a user interface independent of the first screen 110. For example, the first screen 110 may display an overall operation performed on the electronic device 100, and the second screen 120 may be performed on the electronic device 100 to display on the first screen 110. A user interface for controlling the operation may be displayed.

In addition, when the display 1110 and the touch pad form a layer structure to form a touch screen, the display 1110 may be used as an input device in addition to the output device. The display 1110 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. 3D display, an electrophoretic display. In addition, according to the implementation form of the electronic device 100, the electronic device 100 may include two or more display units 1110.

The sound output unit 1111 outputs audio data received from the communication unit 1140 or stored in the memory 1170. In addition, the sound output unit 1111 outputs a sound signal related to a function (for example, a call signal reception sound, a message reception sound, and a notification sound) performed by the electronic device 100. The sound output unit 1111 may include a speaker, a buzzer, and the like.

The vibration motor 1112 may output a vibration signal. For example, the vibration motor 1112 may output a vibration signal corresponding to an output of audio data or video data (eg, a call signal reception sound, a message reception sound, and the like). In addition, the vibration motor 1112 may output a vibration signal when a touch is input to the touch screen.

The user input unit 1120 means a means for a user to input data for controlling the electronic device 100. For example, the user input unit 1120 may include a key pad, a dome switch, a touch pad (contact capacitive type, pressure resistive layer type, infrared sensing type, surface ultrasonic conduction type, and integral type). Tension measurement method, piezo effect method, etc.), jog wheel, jog switch, etc., but is not limited thereto. In addition, the user input unit 1120 may include a touch screen.

The user input unit 1120 may receive a user input for controlling the first screen 110 through the second screen 120. For example, the user input may be one of various touch inputs including a drag, a single tap, a double tap, and a touch and hold input on the second screen 120. In addition, the user input may include an action of clicking the button 130 of the electronic device 100, but is not limited thereto.

The controller 1130 generally controls the overall operation of the electronic device 100. For example, the controller 1130 may execute programs stored in the memory 1170, thereby outputting the output unit 1115, the user input unit 1120, the communication unit 1140, the sensing unit 1150, and the A / V input unit 1160. ) Can be controlled overall.

In addition, the controller 1130 may control an operation performed on the electronic device 100 and displayed on the first screen 110 based on a user input received through the second screen 120. For example, the controller 1130 may previously map an operation performed by the electronic device 100 and displayed on the first screen 110. Based on the mapping result, an operation corresponding to a user input may be performed by the controller 1130 and displayed on the first screen 110. In addition, when an input for touching a key of a keyboard displayed on the second screen 120 is received, an operation determined based on a value corresponding to the touched key is performed by the controller 1130 to perform a first screen 110. Can be displayed on the screen. The controller 1130 may change the display format of the keyboard displayed on the second screen 120 according to a user setting. For example, the controller 1130 may set the keyboard in a format of 3x3 or 2x5 according to the user's convenience, but is not limited thereto.

In addition, the controller 1130 may display an operation corresponding to the user input on the first screen 110 and control the user interface of the first screen 110 and the second screen 120 according to the displayed operation. Can be.

The communication unit 1140 may include one or more components for performing communication between the electronic device 100 and an external device or the electronic device 100 and a server. For example, the communication unit 1140 may include a short range communication unit 1141, a mobile communication unit 1142, and a broadcast receiving unit 1143.

The short-range wireless communication unit 1141 may include a Bluetooth communication unit, a Near Field Communication unit, a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an Infrared Data Association (IrDA) communication unit, It may include a Wi-Fi Direct communication unit, an ultra wideband communication unit, an Ant + communication unit, and the like, but is not limited thereto.

The mobile communication unit 1142 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The broadcast receiving unit 1143 receives a broadcast signal and / or broadcast related information from the outside through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. According to an embodiment, the electronic device 100 may not include the broadcast receiving unit 1143.

The sensing unit 1150 may detect a state of the electronic device 100 or a state around the electronic device 100 and transmit the detected information to the controller 1130.

The sensing unit 1150 may include a geomagnetic sensor 1151, an acceleration sensor 1152, a temperature / humidity sensor 1153, an infrared sensor 1154, a gyroscope sensor 1155, and a position sensor. (Eg, GPS) 1156, barometric pressure sensor 1157, proximity sensor 1158, and RGB sensor 1illuminance sensor 1159, but are not limited thereto. Functions of the respective sensors can be intuitively deduced by those skilled in the art from the names thereof, and thus detailed descriptions thereof are omitted.

The A / V input unit 1160 is for inputting an audio signal or a video signal, and the A / V input unit 1160 may include a camera 1161 and a microphone 1162. The camera 1161 may obtain an image frame such as a still image or a moving image through an image sensor in a video call mode or a photographing mode. The image captured by the image sensor may be processed by the controller 1130 or an additional image processor (not shown).

The image frame processed by the camera 1161 may be stored in the memory 1170 or transmitted to the outside through the communication unit 1140. Two or more cameras 1161 may be provided according to the configuration aspect of the electronic device 100.

The microphone 1162 receives an external sound signal and processes the external sound signal into electrical voice data. For example, the microphone 1162 may receive an acoustic signal from an external device or speaker. The microphone 1162 may use various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The memory 1170 may store a program for processing and controlling the controller 1130. In addition, data input / output (eg, an application, content, an image file, a text file, etc.) may be stored.

The memory 1170 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. In addition, the electronic device 100 may operate a web storage or a cloud server that performs a storage function of the memory 1170 on the Internet.

Programs stored in the memory 1170 may be classified into a plurality of modules according to their functions. For example, the UI module 1171, the touch screen module 1172, the notification module 1173, and the STT (Speak to Text) Module 1174 or the like.

The UI module 1171 may provide a specialized UI, GUI, or the like that is linked to the electronic device 100 for each application. The touch screen module 1172 may detect a touch gesture on the user's touch screen, and may transmit information about the touch gesture to the controller 1130. The touch screen module 1172 may be configured as separate hardware including a controller.

Various sensors may be provided inside or near the touch screen to detect a touch or proximity touch of the touch screen. An example of a sensor for sensing a touch of a touch screen is a tactile sensor. The tactile sensor refers to a sensor that senses the contact of a specific object to the extent that a person feels or more. The tactile sensor may sense various information such as the roughness of the contact surface, the rigidity of the contact object, the temperature of the contact point, and the like.

In addition, an example of a sensor for sensing a touch of a touch screen is a proximity sensor.

The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. The user's touch gesture may include tap, touch and hold, double tap, drag, pan, flick, drag and drop, and swipe.

The notification module 1173 may generate a signal for notifying occurrence of an event of the electronic device 100. Examples of events occurring in the electronic device 100 include call signal reception, message reception, key signal input, schedule notification, and the like. The notification module 1173 may output the notification signal in the form of a video signal through the display 1110, may output the notification signal in the form of an audio signal through the sound output unit 1111, and the vibration motor 1112. Through the notification signal may be output in the form of a vibration signal.

Speech to Text (STT) module 1174 may generate a transcript corresponding to the multimedia content by converting the voice included in the multimedia content into text. In this case, the transcript may be mapped to the play time information of the multimedia content.

13 and 14 are block diagrams illustrating a configuration of an electronic device according to another disclosed embodiment.

According to another disclosed embodiment, the electronic device 100a may include a second screen sensing module 1310, a screen display control module 1320, a second screen display control module 1330, and a first screen display control module 1350. It may include. According to an embodiment, the control unit 1130 illustrated in FIGS. 11 and 12 may include the second screen sensing module 1310, the screen display control module 1320, and the second screen display control module illustrated in FIG. 13. 1330, and a first screen display control module 1350.

The second screen detection module 1310 may detect a user input through the second screen 120.

The screen display control module 1320 may store a mapping relationship between a user input received through the second screen 120 and an operation performed by the electronic device 100 and displayed on the first screen 110. . In addition, the screen display control module 1320 may convert a user input sensed by the second screen sensing module 1310 into an operation performed by the electronic device 100 and displayed on the first screen 110. have.

In addition, the screen display control module 1320 may transmit an operation performed by the electronic device 100 and displayed on the first screen 110 to the first screen display control module 1340. The screen display control module 1320 may update state information of the electronic device 100 and transmit the updated state information to the first screen display control module 1340 and the second screen display control module 1330. have.

The second screen display control module 1330 may update the user interface of the second screen 120 based on the received state information.

The first screen display control module 1340 may perform an operation received from the screen display control module 1320 and update the user interface of the first screen 110 based on the received state information.

However, according to an embodiment, the electronic device 100b may further include a one-handed control setting module 1300 and a first screen sensing module 1340, as shown in FIG. 14.

The one-handed control setting module 1300 may set and store parameters related to the second screen 120. For example, the one hand control setting module 1300 may set at least one of a position, a length, and a width of an area for receiving a user input through the second screen 120. In addition, the one-handed control setting module 1300 may set a mapping relationship between a user input received through the second screen 120 and an operation performed by the electronic device 100 and displayed on the first screen 110. Can be.

The first screen detection module 1340 may detect a user input received from the first screen 110 and transmit the detected user input to the screen display control module 1320. In this case, the user input may be one of drag, single tap, double tap, and touch and hold input, but is not limited thereto. Then, the screen display control module 1320 may transmit the user input transmitted from the first screen detection module 1340 to the first screen display control module 1350. In addition, an operation corresponding to a user input may be performed by the first screen display control module 1350 and displayed on the first screen 110.

15 is a flowchart illustrating an example in which a user input of dragging is received in an electronic device according to another exemplary embodiment of the present disclosure.

In operation S1510, the electronic device 100a may receive a drag input through the second screen 120.

In operation S1520, the electronic device 100a may check whether there is an item displayed on the second screen 120. The item displayed on the second screen 120 may include a keyboard and a setting menu of the electronic device 100a, but is not limited thereto.

If there is an item displayed on the second screen 120 (step S1530), the electronic device 100a may check the type of the item and status information regarding the page of the displayed item.

For example, when the item displayed on the second screen 120 is a keyboard, the status information regarding the item type may be a serial number corresponding to the keyboard. In addition, when the page of the keyboard currently displayed on the second screen 120 is the second page 702, the status information regarding the page of the displayed item may be “2”.

The electronic device 100a may update the user interface of the second screen 120 based on the confirmed state information and the received user input.

However, if there is no item displayed on the second screen 120 (step 1540), the electronic device 100a may check whether the running application is displayed on the first screen 110.

If there is an application being executed (step S1550), an operation corresponding to the user input may be performed by the electronic device 100a and displayed on the first screen 110. For example, when a user input of dragging downward is received, dragging downward with respect to the running application may be performed by the electronic device 100a and displayed on the first screen 110.

However, if there is no application running (step S1560), the electronic device 100a may check whether there is a currently selected page.

If there is a selected page (step S1570), the electronic device 100a may select one of a plurality of applications located in the selected page based on the user input. The electronic device 100a may update state information related to the selected application.

For example, each of the plurality of applications located on a specific page may include a unique serial number. Accordingly, when a specific application is selected based on the user input, the electronic device 100a may update the serial number of the selected application as status information. In addition, the electronic device 100a may display the selected application as a highlight.

However, if there is no selected page (step S1580), the electronic device 100a may change the page displayed on the first screen 110 based on the user input. For example, when a user input of dragging to the left is received, the electronic device 100 may display a page located on the right side of the currently displayed page on the first screen 110. The electronic device 100a may update state information related to the selected page.

16 is a flowchart illustrating an example in which a tap input is received in an electronic device according to another disclosed embodiment.

In operation S1610, the electronic device 100a may receive a single tap or double tap input through the second screen 120.

Then, in operation S1620, the electronic device 100a may check whether the running application is displayed on the first screen 110.

If there is a running application (step S1630), when a single tap input is received, an operation corresponding to the single tap input with respect to the running application is performed by the electronic device 100a to be displayed on the first screen 110. Can be. When the double tap input is received, the electronic device 100a terminates the running application or returns to the previous page of the running application by the electronic device 100a to display on the first screen 110. Can be.

However, if no application is running (step S1640), the electronic device 100a may check whether there is a selected page.

If there is a selected page (step S1650), when a single tap input is received, an application selected based on the status information and the user input may be executed by the electronic device 100a and displayed on the first screen 110. When the double tap input is received, the electronic device 100a may deselect the page and update state information related to the selected page. In addition, the electronic device 100a may update the user interface of the first screen 110.

If there is no selected page (step S1660), when a single tap input is received, the electronic device 100a may select a page currently displayed on the first screen 110 and update status information related to the selected page. . When the double tap input is received, the electronic device 100a may not perform any operation.

17 is a flowchart illustrating an example in which a touch and hold input is received in an electronic device according to another disclosed embodiment.

In operation S1710, the electronic device 100a may receive a “touch and hold in the center area” input through the second screen 120. The electronic device 100a may also receive the received user input. The operation performed by the device 100 may be switched to an operation displayed on the first screen 110. For example, the “touch & hold in the center area” input received through the second screen 120 may be The operation may be changed to change the electronic device 100a to a locked state.

In operation S1720, the electronic device 100a may change the electronic device 100a to a locked state and update the user interface of the first screen 110.

The disclosed embodiments can be embodied in the form of program instructions that can be executed by various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it is to be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the above description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

Claims

In the electronic device control method comprising a plurality of screens,

Receiving user input via a second screen on which the user interface is updated independently of the first screen;

Controlling an operation performed on the electronic device to be displayed on the first screen based on the user input;

The electronic device control method comprising a.
The method of claim 1, wherein the electronic device control method comprises:

Pre-mapping the user input with an operation performed on the electronic device and displayed on the first screen; And

Based on the mapping result, displaying an operation corresponding to the user input on the first screen;

The electronic device control method further comprising.
The method of claim 1, wherein the user input,

And one of a dragging input, a single tapping input, a double tapping input, and a touch and hold input on the second screen.
The method of claim 1, wherein the controlling of the operation displayed on the first screen comprises:

Based on the user input, displaying a predetermined operation on the first screen; And

Controlling a user interface of the first screen and the second screen in accordance with the displayed operation.
The method of claim 1,

Receiving the user input includes touching a key of a keyboard displayed on the second screen,

Controlling the operation displayed on the first screen comprises displaying an operation determined on the first screen based on a value corresponding to the touched key.
The method of claim 5, wherein the electronic device control method comprises:

Changing the display format of the keyboard according to a user setting.
The method of claim 1, wherein the electronic device control method comprises:

And according to the user, adaptively setting at least one of a location, a length, and a width of an area for receiving the user input via the second screen. Control method.
The method of claim 1, wherein the electronic device control method comprises:

Dividing the second screen into a plurality of areas, and performing different operations according to user input received through the divided areas.
The method of claim 1, wherein the electronic device control method comprises:

Updating a user interface of the first screen and the second screen based on state information of the first screen and the second screen,

The state information includes at least one of information related to a locked state of the electronic device, a selected application, and a running application.
The method of claim 1, wherein the electronic device control method comprises:

Unlocking the electronic device based on a preset user input received via the second screen.
A display unit including a first screen and a second screen whose user interface is updated independently of the first screen;

A user input unit configured to receive a user input through the second screen; And

A controller configured to control an operation performed on an electronic device and displayed on the first screen based on the user input;

Comprising an electronic device.
The method of claim 11, wherein the control unit,

And pre-map an operation performed on the electronic device to be displayed on the first screen and the user input, and display an operation corresponding to the user input on the first screen based on the mapping result.
The method of claim 11, wherein the user input,

And one of a dragging input, a single tapping input, a double tapping input, and a touch and hold input on the second screen.
The method of claim 11,

The user input includes an input of touching a key of a keyboard displayed on the second screen,

The controller is further configured to display an operation determined based on a value corresponding to the touched key on the first screen.
The method of claim 11,

The controller may be configured to update a user interface of the first screen and the second screen based on state information of the first screen and the second screen,

The state information includes at least one of information related to a locked state of the electronic device, a selected application, and a running application.