KR20170026045A - An electronic device and an operation method for the electronic device - Google Patents

Abstract

According to embodiments of the present invention, disclosed are an electronic device and an operation method thereof. The electronic device according to an embodiment of the present invention includes a display which displays at least one graphic user interface element and a control unit which identifies a user preference region preferred by a user on the display and controls the display to display the at least one graphic user interface element in the user preference region which is identified. Accordingly, the present invention can remove inconvenience of operating the displayed graphic user interface element even though the user operates the electronic device in a limited environment.

Description

[0001] The present invention relates to an electronic device and an operation method thereof,

One embodiment relates to an electronic device and a method of operating an electronic device, and more particularly to an electronic device for displaying a graphical user interface element and a method of operating the electronic device.

 As touchscreen technology has evolved over the years, touchscreens have never been so widely used in user devices. In addition, many touchscreen devices, such as smartphones and tablet devices, feature a screen that is too large for some users to handle, especially when holding and manipulating devices with one hand. For example, in conventional smartphone operating systems, notifications are displayed near the top edge of the screen, which is hard for the user to reach when the user is holding and holding the smartphone with one hand.

To solve this problem, an interface has been developed in which an icon is displayed along the radius of curvature near the corner of the screen. According to biomechanics, a curved path is selected because the user's finger or thumb draws an arc in the screen when the relative position of the user's hand and the screen is fixed. The system designer must predefine the radius of curvature appropriate for the average finger shape and length of a large population. Thus, individual users may still feel uncomfortable with the use of the interface if their characteristics are significantly different from the population mean.

Embodiments disclosed herein are aimed at providing an electronic device capable of displaying a graphical user interface element in a display area of an electronic device in which a user's hand is easy to operate, and a method of operation of the electronic device.

An electronic device according to an embodiment includes a display for displaying at least one graphical user interface element and a user preference area preferred by the user on the display and for identifying the at least one graphical user interface element in the identified user preference area, And a control unit for controlling the display to display the interface element.

The control unit according to an embodiment may detect the current orientation of the electronic device and identify the user preference area in consideration of the detected current orientation.

The control unit may detect the direction of the user's hand using the electronic device and identify the user's preference area in consideration of the direction of the detected user's hand.

The controller according to an embodiment may monitor the interaction between the user and the electronic device and identify the user preference area based on at least one display area determined to be involved in the monitored interaction.

The control unit according to an embodiment may determine the at least one display area by monitoring an interaction between the user and the electronic device for at least one predetermined application.

The control unit according to an embodiment can identify the user preference region based on a preset user preference.

According to an exemplary embodiment, if the size of the identified user preference region is insufficient to display the at least one graphical user interface element, the control unit may assign a group object corresponding to the at least one graphical user interface element to the user preference region And display the at least one graphical user interface element corresponding to the group object in response to an input for selecting the group object.

According to one embodiment, the user preference area may be within a range capable of operating the electronic device with one hand of the user.

According to one embodiment, the at least one graphical user interface element displayed in the user preference area may include an icon for event notification.

According to one embodiment, the display extends to one or more edges of the electronic device, and the control unit can identify the user preference region comprising a display region arranged in the one or more edges.

An operating method of an electronic device according to an embodiment includes identifying a user preference area preferred by a user on a display; And displaying the at least one graphical user interface element in the identified user preference area.

According to the embodiment disclosed in the present disclosure, even when the user operates the electronic device in a limited environment by displaying the graphical user interface element in an easy-to-operate area or a favorite area mainly used by the user, It is possible to prevent inconvenience in operating the element.

1 is a reference diagram for explaining the concept of the present invention according to an embodiment.
Figure 2 shows a schematic block diagram and network environment of a first example of an electronic device according to one embodiment.
3 is a schematic block diagram of a second example of an electronic device according to one embodiment.
4 is a schematic block diagram of a third example of an electronic device according to one embodiment.
5 is a flow chart illustrating an example of a method of operating an electronic device according to an embodiment.
FIG. 6A is an example of a user interface for receiving a user's preference region according to an exemplary embodiment.
FIG. 6B is an example of a user interface that allows an item to be displayed in a user preference area to be selected according to an exemplary embodiment.
7 shows examples of user preference areas that are set in an electronic device according to embodiments.
8 shows an example in which two user preference regions are arranged in an electronic device according to one embodiment.
9 is a diagram for explaining an example in which the method shown in FIG. 5 is applied to an electronic device including an edge display according to an embodiment.
10A to 10D are diagrams illustrating examples of items that can be displayed in a user preference area set in an electronic device according to embodiments.
FIG. 11 is a flowchart illustrating an example of a method of identifying a user preference region shown in FIG. 5 according to an exemplary embodiment.
12 is a reference diagram for explaining that user preference regions are arranged differently in an electronic device according to the orientation of the electronic device according to an embodiment.
13 is a reference diagram for explaining that the user preference region is arranged differently in the electronic device according to the orientation of the electronic device according to an embodiment.
FIG. 14 is a flowchart illustrating another example of the method of identifying a user preference region shown in FIG. 5 according to an embodiment.
15 is a reference view for explaining how user preference regions are arranged differently in an electronic device according to the direction of the user's hand using the electronic device according to an embodiment.
FIG. 16 is a flowchart illustrating another example of the method of identifying a user preference region shown in FIG. 5 according to an embodiment.
17A is an example of an application having a low degree of freedom.
17B is an example of an application having a high degree of freedom.
18 is a flow diagram illustrating a process of a method for determining a user preference region based on user interaction in accordance with one embodiment.
19A is a reference diagram for explaining an example of determining a user preference area based on user interaction according to an embodiment.
19B is a reference diagram for explaining another example of determining a user preference area based on user interaction according to an embodiment.
20 is a flowchart showing another example of the method of identifying a user preference region shown in FIG. 5 according to an embodiment.
21 is a reference diagram for explaining a method of setting a user preference region directly by a user according to an embodiment.
Figures 22A, 22B, 22C, 22D are diagrams illustrating examples of methods of displaying a GUI element in a user preferred area of an electronic device according to embodiments.
23A, 23B, and 23C show examples of displaying the GUI element in the user preference area on the lock screen when an event notification occurs on the lock screen of the electronic device 100. FIG.
24 is a flowchart illustrating an exemplary process of a method for displaying at least one graphical user interface element in the user preference area shown in FIG. 5 according to one embodiment.
25 is a reference diagram for explaining the group object illustrated in FIG. 24 according to an embodiment.
26A is a diagram illustrating an example of a user interface output when a group object is selected according to an embodiment.
26B is a diagram illustrating another example of a user interface output when a group object is selected according to an embodiment.
26C is a diagram illustrating another example of a user interface output when a group object is selected according to an embodiment.
FIG. 27 is a flow diagram illustrating another example of a method for displaying at least one graphical user interface element in the user preference area shown in FIG. 5 according to one embodiment.
Figure 28 is a reference diagram illustrating a GUI element that is scrollably arranged in accordance with one embodiment.
29 is a reference diagram for explaining an operation when a scrollable GUI element is selected according to an embodiment.
30 is a flow diagram illustrating another exemplary process for operating an electronic device in accordance with one embodiment.
31 is a reference diagram for explaining the operation method shown in Fig.
32 is a flow diagram illustrating another exemplary process for operating an electronic device in accordance with one embodiment.
33A and 33B are reference views for explaining the operation method shown in FIG.
34 is a reference diagram for explaining an example in which a user preference region is determined based on a finger position of a user currently using an electronic device according to an embodiment;

Hereinafter, exemplary embodiments according to the present invention will be described in detail with reference to the contents described in the accompanying drawings. In addition, a method for constructing and using an electronic device according to an embodiment of the present invention will be described in detail with reference to the contents described in the accompanying drawings. Like reference numbers or designations in the various drawings indicate components or components that perform substantially the same function.

Terms including ordinals such as first, second, etc. may be used to describe various elements, but the elements are not limited by terms. Terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. The term " and / or " includes any combination of a plurality of related items or any of a plurality of related items.

The content may include video, image, text, or web documents.

The portion where the actual content is output on the display unit of the electronic device may be referred to as a screen or a screen.

The terminology used herein is for the purpose of describing the embodiments only and is not intended to limit and / or to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the term " comprising or comprising " or " comprising " is intended to specify the presence of stated features, integers, , But do not preclude the presence or addition of one or more other features, elements, components, components, or combinations thereof.

Embodiments will now be described with reference to the drawings.

1 is a reference diagram for explaining the concept of the present invention according to an embodiment.

1 schematically illustrates a preferred region 200 of a display region 150 of an electronic device 100 according to one embodiment while operating the electronic device 100 with one hand. The preference area 200 is shown as a shaded area of the display area 150 in Fig.

In one embodiment, the preference area 200 may be a user preferred area when the user operates the electronic device 100 with one hand 50, as shown in FIG.

In one embodiment, the preference area 200 may be an area within a range where the user can operate the electronic device 100 with one hand.

According to an exemplary embodiment, the electronic device 100 may display a graphic user interface element at a fixed position in a user preference area that is determined adaptively according to a user's preference, instead of displaying the graphic user interface element at a fixed position.

While the embodiment shown in FIG. 1 is described with respect to one-hand operation, in other embodiments, the same principles described herein may be applied to two-hand operation. For example, a user can hold one side of the tablet with one hand and use both thumbs to swipe the touchscreen, in which case the preference area can be determined as the area the user can reach with each thumb have.

The electronic device according to various embodiments may be a device including a communication function. For example, the electronic device can be a smartphone, a tablet personal computer, a mobile phone, a videophone, an e-book reader, a desktop personal computer, a laptop Such as a laptop personal computer (PC), a netbook computer, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, or a wearable device Such as a head-mounted device (HMD) such as electronic glasses, an electronic garment, an electronic bracelet, an electronic necklace, an electronic app apparel, an electronic tattoo, or a smart watch.

According to some embodiments, the electronic device may be a smart home appliance with communication capabilities. [0003] Smart household appliances, such as electronic devices, are widely used in the fields of television, digital video disk (DVD) player, audio, refrigerator, air conditioner, vacuum cleaner, oven, microwave oven, washing machine, air cleaner, set- And may include at least one of a box (e.g., Samsung HomeSyncTM, Apple TVTM, or Google TVTM), game consoles, an electronic dictionary, an electronic key, a camcorder, or an electronic frame.

According to some embodiments, the electronic device may be a variety of medical devices (e.g., magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT) (global positioning system receiver), EDR (event data recorder), flight data recorder (FDR), automotive infotainment device, marine electronic equipment (eg marine navigation device and gyro compass), avionics, A security device, a head unit for a vehicle, an industrial or home robot, an ATM (automatic teller's machine) of a financial institution, or a POS (point of sale) of a shop.

The electronic device according to various embodiments may be one or more of the various devices described above. Further, the electronic device according to various embodiments may be a flexible device. It is also apparent to those skilled in the art that the electronic device according to various embodiments is not limited to the above-described devices.

Figure 2 shows a schematic block diagram and network environment of a first example of an electronic device according to one embodiment.

2, the electronic device 100 may include a bus 110, a processor 120, a memory 130, an input / output interface 140, a display 150, a communication interface 160, and a module 170

The bus 110 may be a circuit that interconnects the components described above and communicates (e.g., control messages) between the components described above.

The memory 130 may be received from the processor 120 or other components (e.g., the input / output interface 140, the display 150, the communication interface 160, or the module 170, etc.) Lt; RTI ID = 0.0 > and / or < / RTI > The memory 130 may include, for example, a programming module such as a kernel, a middleware, an application programming interface (API), or an application. Each of the above-described programming modules may be composed of software, firmware, hardware, or a combination of at least two of them.

According to various embodiments, the application may be an SMS / MMS application, an email application, a calendar application, an alarm application, a health care application (e.g., an application that measures momentum or blood glucose) Humidity or temperature information, etc.) and the like. Additionally or alternatively, the application may be an application related to the exchange of information between the electronic device 100 and an external electronic device (e.g., electronic device 104). The application associated with the information exchange may include, for example, a notification relay application for communicating specific information to the external electronic device, or a device management application for managing the external electronic device .

The input / output interface 140 connects commands or data input from a user via an input / output device (e.g., a sensor, a keyboard or a touch screen) to the processor 120, the memory 130, the communication interface 160 , Or to module 170. For example, the input / output interface 140 may provide the processor 120 with data on the user's touch input through the touch screen. The input / output interface 140 may also send commands or data received from the processor 120, the memory 130, the communication interface 160, or the module 170 via the bus 110 to the input / output device (e.g., ). ≪ / RTI > For example, the input / output interface 140 can output voice data processed through the processor 120 to a user through a speaker.

The display 150 may display various information (e.g., multimedia data or text data) to the user.

The communication interface 160 may connect communication between the electronic device 100 and an external device (e.g., the electronic device 104 or the server 106). For example, the communication interface 160 may be connected to the network 162 via wireless communication or wired communication to communicate with the external device. The wireless communication may include, for example, wireless fidelity, Bluetooth, near field communication (NFC), global positioning system (GPS) , WiBro or GSM, etc.). The wired communication may include at least one of, for example, a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard 232 (RS-232) or a plain old telephone service (POTS).

According to one embodiment, the network 162 may be a telecommunications network. The communication network 162 may include at least one of a computer network, an internet, an internet of things, or a telephone network. According to one embodiment, a protocol (e.g., transport layer protocol, data link layer protocol, or physical layer protocol) for communication between the electronic device 100 and an external device may be implemented as an application, an application programming interface, At least one can be supported.

The processor 120 may receive instructions from other components (e.g., the memory 130, the input / output interface 140, the display 150, the communication interface 160, or the module 170, etc.) Decrypt the received command, and execute an operation or data processing according to the decrypted command.

According to one embodiment, the processor 120 may identify the preferred user preference area by the user on the display and control the display to display the at least one graphical user interface element in the identified user preference area. The user preference area may be within a range that allows the electronic device to operate with one hand of the user. The at least one graphical user interface element displayed in the user preference area may include an icon for event notification.

According to one embodiment, the processor 120 may detect the current orientation of the electronic device and may identify the user preference region in consideration of the detected current orientation.

According to one embodiment, the processor 120 may detect the orientation of the user's hand using the electronic device and may identify the user preference area in consideration of the orientation of the detected user's hand.

According to one embodiment, the processor 120 may monitor the interaction between the user and the electronic device, and may identify the user preference area based on at least one display area determined to be involved in the monitored interaction.

According to one embodiment, the processor 120 may determine the at least one display area by monitoring the interaction between the user and the electronic device for at least one predetermined application.

According to one embodiment, the processor 120 may identify the user preference region based on a predetermined user preference.

According to one embodiment, if the identified size of the identified user preference region is insufficient to display the at least one graphical user interface element, then the processor 120 may assign a group object corresponding to the at least one graphical user interface element to the user preference region And display the at least one graphical user interface element corresponding to the group object in response to an input for selecting the group object.

If the display 150 is extended to one or more edges of the electronic device according to one embodiment, the control unit may identify the user preference region including the display region arranged in the one or more edges.

The module 170 processes at least some of the information obtained from other components (e.g., the processor 120, the memory 130, the input / output interface 140, or the communication interface 160, etc.) and provides it to the user in various ways . For example, the module 170 may control at least some functions of the electronic device 100 using the processor 120 or independently thereof.

According to one embodiment, the module 170 may include a user interaction monitoring module 171, a user preference region identification module 172, and a GUI element display module 173.

The user interaction monitoring module 171 may monitor the interaction between the user and the electronic device, determine a display area in an electronic device having a large number of interactions between the user and the electronic device, and store the determined display area in the user preference area.

The user interaction monitoring module 171 can monitor only the interaction with an application having a high degree of freedom in user input. For example, interaction between a user and an electronic device for an application with a zero degree of freedom can be excluded from monitoring.

The user preference region identification module 172 determines the user preference region in which to display the GUI element in the electronic device. The user preference zone identification module 172 is configured to determine the user preference zone identification module 172 based on the usage orientation of the electronic device, the direction of the user's hand using the electronic device, the preset user preference, the frequency of use of the display area determined by the user interaction monitoring module, The user preference region can be determined in consideration of at least one of the finger positions.

The GUI element display module 173 can display the GUI element in the identified user preference area.

3 is a schematic block diagram of a second example of an electronic device according to one embodiment.

The electronic device 300 shown in Fig. 3 schematically shows a device for displaying a GUI element on a touch screen display.

Referring to FIG. 3, the electronic device 300 includes a processor 310 and a memory 320 in the form of a computer-readable storage medium.

Memory 320 stores executable computer program code for user preference region identification module 321 and user interaction monitoring module 322. User preference region identification module 321 may be configured to identify preference regions using methods described herein (e.g., based on machine learning algorithms or pre-established user preferences).

The electronic device 300 further includes a GUI controller 340, an orientation detection sensor 350 that detects the current orientation of the device, and a touch screen display 330. [ The GUI controller 340 may control the touch screen display 330 to display various GUI elements.

In this embodiment, the user interaction monitoring module 322 monitors the interaction between the current user and the touch screen, and monitors one or more screens that the user interacts most often during operation with at least one degree of freedom And is configured to store information defining the area.

The user preference region identification module 321 is configured to identify the preference region based on the information that the screen interaction monitoring module 322 is storing. In some embodiments, the screen interaction monitoring module 322 may store the coordinates of a touch event for a specific time period (e.g., a day / week / month, etc.) The coordinates for the touch event can be stored.

The user preference region identification module 321 may then identify the preference region in a variety of ways, such as determining the boundaries of the region covering a predetermined percentage of the stored touch event. Alternatively, a machine learning algorithm may be used as described above. For example, the machine learning algorithm may be applied to various input (e.g., the area of contact between the user's finger and the touch screen, the duration of a particular touch event, the speed of a particular gesture, the entire display area, But not limited to).

Other approaches are possible in other embodiments. For example, in some implementations, instead of storing the coordinates of an individual touch event, the current user's interaction history may be stored as a heat map or a density map. In these maps, the higher the user's interaction, the more points are assigned to different areas of the touch screen that represent a large number of touch events in the area.

In some implementations, the user interaction monitoring module 322 is configured to only monitor the interaction with the touch screen 330 for one or more pre-selected applications. For example, only interaction with applications with high degrees of freedom can be considered when determining the boundaries of the preferred region. Thereby, for example, it may be avoided that the preference area is distorted by the touch event in which the interaction of the user and the display screen is limited to a specific area, by touching a specific icon in order to execute a specific application. As an example of an application that can tolerate a high degree of freedom, it is possible to freely select the height of the screen on which the swipe gesture is to be made and also to select the start and end points of the gesture, There is a photo gallery application that you can swipe. Other types of interactions that allow a high degree of freedom include pinch to zoom function, scroll up / down in a document or web page, and up / down / left / There is a wipe.

In another embodiment, the screen interaction module 322 may be omitted if, for example, the preference area is identified based on pre-set user preferences rather than based on the user's previous interaction with the touch screen display 330.

4 is a schematic block diagram of a third example of an electronic device according to one embodiment.

The electronic device 400 may constitute all or part of the electronic device shown in Fig. 2 or Fig. 3, for example. 4, the electronic device 400 includes one or more application processors 410, a communication module 420, a subscriber identification module (SIM) card 424, a memory 430, a sensor module 440, an input device 450, a display 460, 470, an audio module 480, a camera module 491, a power management module 495, a battery 496, an indicator 497, and a motor 498.

The AP 410 may control a plurality of hardware or software components connected to the AP 410 by operating an operating system or an application program, and may perform various data processing and calculations including multimedia data. The AP 410 may be implemented as a system on chip (SoC), for example. According to one embodiment, the AP 410 may further include a graphics processing unit (GPU) (not shown).

The communication module 420 (e.g., the communication interface 160) may perform data transmission / reception in communication between the electronic device 400 and other electronic devices connected via a network. According to one embodiment, the communication module 420 may include a cellular module 421, a Wifi module 423, a BT module 425, a GPS module 427, an NFC module 428, and a radio frequency (RF) module 429.

The cellular module 421 may provide voice calls, video calls, text services, or Internet services over a communication network (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro or GSM). The cellular module 421 may also perform identification and authentication of electronic devices within the communication network, for example, using a subscriber identity module (e.g., a SIM card 424). According to one embodiment, the cellular module 421 may perform at least some of the functions that the AP 410 may provide. For example, the cellular module 421 may perform at least some of the multimedia control functions.

According to one embodiment, the cellular module 421 may include a communication processor (CP). Also, the cellular module 421 may be implemented with, for example, SoC. In FIG. 4, components such as the cellular module 421 (e.g., communication processor), the memory 430, or the power management module 495 are illustrated as separate components from the AP 410, but according to one embodiment, (E.g., cellular module 421) of the above-described components.

According to one embodiment, the AP 410 or the cellular module 421 (e.g., communication processor) loads commands or data received from at least one of non-volatile memory or other components connected to each other into volatile memory for processing can do. In addition, the AP 410 or the cellular module 421 may store data generated from at least one of the other components or generated by at least one of the other components in the non-volatile memory.

Each of the Wifi module 423, the BT module 425, the GPS module 427, and the NFC module 428 may include a processor for processing data transmitted and received through a corresponding module, for example. 4, the cellular module 421, the Wifi module 423, the BT module 425, the GPS module 427, and the NFC module 428 are shown as separate blocks. At least some (e.g., two or more) of the modules 427 or NFC modules 428 may be included in one integrated chip (IC) or IC package. For example, at least some of the processors corresponding to the cellular module 421, the Wifi module 423, the BT module 425, the GPS module 427, or the NFC module 428, respectively (e.g., corresponding to the communication processor and Wifi module 423 corresponding to the cellular module 421 Wifi processor) can be implemented in a single SoC.

The RF module 429 can transmit and receive data, for example, transmit and receive RF signals. The RF module 429 may include, for example, a transceiver, a power amplifier module (PAM), a frequency filter, or a low noise amplifier (LNA). The RF module 429 may further include a component for transmitting and receiving electromagnetic waves in free space in a wireless communication, for example, a conductor or a conductor. 4, the cellular module 421, the Wifi module 423, the BT module 425, the GPS module 427, and the NFC module 428 share one RF module 429. However, according to one embodiment, the cellular module 421, the Wifi module 423 , The BT module 425, the GPS module 427, or the NFC module 428 can transmit and receive RF signals through separate RF modules.

The SIM card 424 may be a card including a subscriber identity module and may be inserted into a slot formed at a specific location of the electronic device. The SIM card 424 may include unique identification information (e.g., an integrated circuit card identifier (ICCID)) or subscriber information (e.g., international mobile subscriber identity (IMSI)).

The memory 430 (e.g., the memory 130) may include an internal memory 432 or an external memory 434. The built-in memory 432 may be a volatile memory (for example, a dynamic RAM, an SRAM, a synchronous dynamic RAM (SDRAM), or the like) or a non-volatile memory , At least one of an OTPROM (one time programmable ROM), a PROM (programmable ROM), an EPROM (erasable and programmable ROM), an EEPROM (electrically erasable and programmable ROM), a mask ROM, a flash ROM, a NAND flash memory, . ≪ / RTI > According to one embodiment, the internal memory 432 may be a solid state drive (SSD). The external memory 434 may be a flash drive, for example, a compact flash (CF), a secure digital (SD), a micro secure digital (SD), a mini secure digital (SD), an extreme digital (Memory Stick) or the like. The external memory 434 may be functionally connected to the electronic device 400 through various interfaces. According to one embodiment, the electronic device 400 may further include a storage device (or storage medium) such as a hard drive.

The sensor module 440 may measure a physical quantity or sense an operation state of the electronic device 400, and convert the measured or sensed information into an electric signal. The sensor module 440 includes a gyro sensor 440A, a gyro sensor 440B, an air pressure sensor 440C, a magnetic sensor 440D, an acceleration sensor 440E, a grip sensor 440F, a proximity sensor 440G, a color sensor 440H blue sensor), a living body sensor 440I, a temperature / humidity sensor 440J, an illuminance sensor 440K, or an ultraviolet (UV) sensor 440M. Additionally or alternatively, the sensor module 440 may include, for example, an E-nose sensor (not shown), an EMG sensor (not shown), an EEG sensor (not shown) an electrocardiogram sensor (not shown), an infra red sensor (not shown), an iris sensor (not shown), or a fingerprint sensor (not shown). The sensor module 440 may further include a control circuit for controlling at least one sensor included therein.

The input device 450 may include a touch panel 452, a (digital) pen sensor 454, a key 456, or an ultrasonic input device 458. The touch panel 452 can recognize the touch input by at least one of an electrostatic type, a pressure sensitive type, an infrared type, and an ultrasonic type. The touch panel 452 may further include a control circuit. In electrostatic mode, physical contact or proximity recognition is possible. The touch panel 452 may further include a tactile layer. In this case, the touch panel 452 may provide a tactile response to the user.

The (digital) pen sensor 454 can be implemented using the same or similar method as receiving the touch input of the user, or using a separate recognizing sheet, for example. The key 456 may include, for example, a physical button, an optical key or a keypad. The ultrasonic input device 858 is an apparatus that can confirm data by sensing a sound wave from a microphone (for example, a microphone 488) in the electronic device 400 through an input tool for generating an ultrasonic signal. According to one embodiment, the electronic device 400 may use the communication module 420 to receive user input from an external device (e.g., a computer or a server) connected thereto.

The display 460 may include a panel 462, a hologram device 464, or a projector 466. The panel 462 may be, for example, a liquid crystal display (LCD) or an active matrix organic light-emitting diode (AM-OLED). The panel 462 may be embodied, for example, as being flexible, transparent or wearable. The panel 462 may be formed of one module with the touch panel 452. The hologram device 464 can display a stereoscopic image in the air using interference of light. The projector 466 can display an image by projecting light on a screen. The screen may be located, for example, inside or outside the electronic device 400. According to one embodiment, the display 460 may further include control circuitry for controlling the panel 462, the hologram device 464, or the projector 466.

The interface 470 may include, for example, a high-definition multimedia interface (HDMI) 472, a universal serial bus (USB) 474, an optical interface 476, or a D-sub (D-subminiature) 478. The interface 470 may, for example, be included in the communication interface 160 shown in FIG. Additionally or alternatively, the interface 470 may include, for example, a mobile high-definition link (MHL) interface, a secure digital (SD) card / multi-media card (MMC) interface, or an infrared data association can do.

The audio module 480 can convert sound and electrical signals into both directions. At least some of the components of the audio module 480 may be included, for example, in the input / output interface 140 shown in FIG. The audio module 480 may process sound information input or output through, for example, a speaker 482, a receiver 484, an earphone 486, a microphone 488, or the like.

The camera module 491 may capture still images and moving images. The camera module 491 may include one or more image sensors (e.g., a front sensor or a rear sensor), a lens (not shown), an image signal processor ) Or a flash (not shown), such as an LED or xenon lamp.

The power management module 495 can manage the power of the electronic device 400. Although not shown, the power management module 495 may include, for example, a power management integrated circuit (PMIC), a charger integrated circuit (PMIC), or a battery or fuel gauge.

The PMIC can be mounted, for example, in an integrated circuit or a SoC semiconductor. The charging method can be classified into wired and wireless. The charging IC can charge the battery, and can prevent an overvoltage or an overcurrent from the charger. According to one embodiment, the charging IC may comprise a charging IC for at least one of a wired charging mode or a wireless charging mode. The wireless charging system may be, for example, a magnetic resonance system, a magnetic induction system or an electromagnetic wave system, and additional circuits for wireless charging may be added, such as a coil loop, a resonant circuit or a rectifier have. The battery gauge can measure the remaining amount of the battery 496, the voltage during charging, the current or the temperature, for example. The battery 496 may store or generate electricity and supply power to the electronic device 400 using the stored or generated electricity. The battery 496 may include, for example, a rechargeable battery or a solar battery.

The indicator 497 may indicate a specific state of the electronic device 400 or a portion thereof (e.g., the AP 410), for example, a boot state, a message state, or a charged state. The motor 498 may convert the electrical signal into mechanical vibration. Although not shown, the electronic device 400 may include a processing unit (e.g., a GPU) for mobile TV support. The processing device for supporting the mobile TV can process media data conforming to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or media flow.

Each of the above-described components of the electronic device according to various embodiments of the present invention may be composed of one or more components, and the name of the component may be changed according to the type of the electronic device. The electronic device according to various embodiments of the present invention may be configured to include at least one of the above-described components, and some components may be omitted or further include other additional components. In addition, some of the components of the electronic device according to various embodiments of the present invention may be combined into one entity, so that the functions of the components before being combined can be performed in the same manner.

5 is a flow chart illustrating an example of a method of operating an electronic device according to an embodiment.

Referring to FIG. 5, in operation 510, the electronic device identifies a user preference area preferred by the user on the display of the electronic device.

The user preference area can refer to a display area of an electronic device that can be reached by one hand or both hands when a user currently using the electronic device uses the electronic device with one hand or both hands. For example, when the user performs a different task from the operation of the electronic device with the left hand, and operates the electronic device with the right hand, the user uses the right hand to turn the electronic device, It may be necessary to manipulate the display area of the device. To this end, it is desirable to arrange at least one graphical user interface element that requires interaction, such as a touch of a user's hand, for operation of the electronic device in an area within a range accessible to the fingers of the user's right hand. The electronic device can thus determine, for example, an area within a range that the finger of the user's right hand can reach as a user preference area.

The user preference area can be determined according to various methods.

The user preference area refers to a portion of the display area preferred by the current user of the electronic device, and such user preference area may include one or more areas separated from each other. For example, two or more user preference regions may be identified when a user uses the electronic device with both hands.

The user preference area can be changed flexibly according to the form of use of the electronic device by the user of the electronic device. For example, when the user uses the electronic device in the longitudinal direction and changes it in the lateral direction, the electronic device may be different from the user preference region when the electronic device is used in the longitudinal direction and the user preference region when the electronic device is used in the lateral direction.

According to one embodiment, the electronic device can detect the current orientation of the electronic device and identify the user preference area in consideration of the detected current orientation.

According to one embodiment, the electronic device can detect the direction of the user's hand using the electronic device and identify the user preference area in consideration of the direction of the detected user's hand.

According to one embodiment, the electronic device can monitor the interaction between the user and the electronic device and identify the user preference area based on at least one display area determined to be involved in the monitored interaction.

According to one embodiment, the electronic device can identify the user preference region based on a pre-established user preference.

At operation 520, the electronic device displays at least one graphical user interface element in the identified user preference area.

A graphical user interface element is something like an icon or item that can be activated by the user's choice. Graphical user interface elements that may be displayed in the user preference area may include a notification icon that notifies the user that a new email or new message has arrived, an application icon, a menu icon that causes the settings of the electronic device to change, have.

According to one embodiment, if the size of the identified user preference area is insufficient to display the at least one graphical user interface element, the electronic device may display a group object corresponding to the at least one graphical user interface element in the user preference area can do.

According to one embodiment, the electronic device may display the at least one graphical user interface element corresponding to the group object in response to an input for selecting a group object.

A user interface may be provided that allows the user to select an option of the ability to display the GUI element in the user preference area of the electronic device according to embodiments.

FIG. 6A is an example of a user interface for receiving a user's preference region according to an exemplary embodiment.

Referring to FIG. 6A, the electronic device 100 outputs a user interface 610 for setting a user preference area to the display unit. The user interface 610 includes a message 611 asking the user whether he / she wants to set the user preference area on the basis of the hand, an input item 612 indicating <left hand>, an input item 613 indicating <right hand> An item 614, and an input item 615 indicating < None >.

The user selects the input item 612 indicating < left hand > if the user preference area is desired to be placed in the left hand direction, or selects the input item 614 indicating < both hands & If it is desired to flexibly arrange in the electronic device without user setting, an input item 615 indicating < None > can be selected.

FIG. 6B is an example of a user interface that allows an item to be displayed in a user preference area to be selected according to an exemplary embodiment.

Referring to FIG. 6B, the electronic device 100 outputs a user interface 620 to the display unit for selecting an item to be displayed in the user preference area. The user interface 620 includes a message 621 for asking the user if he wants to display an item in the user preference area, an input item 622 for < notification message >, an input item 623 for & An input item 624 representing > a menu &gt;, and an input item 625 representing a &lt; character input box &gt;.

The items that can be displayed in the user preference area are not limited to the example shown in FIG. 6B, and the user can select one or more of the input items shown in the user interface 620. The user can select all the input items 622-625 displayed in the user interface 620 when all the items displayed in the user interface shown in Fig. 6B are desired to be displayed in the user preference area.

7 shows examples of user preference areas that are set in an electronic device according to embodiments.

According to one embodiment, the user preference area may have a simple geometric shape such as a square, a rectangle, a circle, and the like. Reference numeral 710 in FIG. 7 shows that the user preference region 711 has a rectangular shape, and 720 shows that the user preference region 721 has a circle shape.

According to one embodiment, the user preference region may have an irregular shape. 730 shows that the user preference region 731 has an irregular shape.

According to one embodiment, one or more user preference regions may be placed in the display portion of the electronic device.

8 shows an example in which two user preference regions are arranged in an electronic device according to one embodiment.

Referring to Fig. 8, the user shows an example in which the electronic device 800 is held in both hands and operated. For example, in the case of electronic devices having a large display size, such as a tablet, for example, the user is not easy to operate the electronic device 800 while holding the electronic device 800 with one hand. Therefore, in this case, the electronic device 800 arranges the first user preference region 810 in the display region close to the user's left hand 811 and arranges the second user preference region 820 in the display region close to the user's right hand 821. The electronic device 100 arranges the first user preference area 810 and the second user preference area 820 and arranges one or more graphical user interface elements in the arranged first user preference area 810 and the second user preference area 820 as shown in FIG. Display allows the user to select one or more displayed graphical user interface elements without moving his or her hands a lot.

According to one embodiment, the user preference region may comprise an edge region of an electronic device including an edge display.

9 is a diagram for explaining an example in which the method shown in FIG. 5 is applied to an electronic device including an edge display according to an embodiment.

Referring to FIG. 9, the embodiment shown in FIG. 5 may also be implemented in an electronic device 900 having a curved touch screen, such as, for example, a device in which a touch screen bends near the edge of the device. 9, when the touch screen 910 extends to one or more edges of the electronic device 900, the electronic device 900 may include an area 940 of the touch screen arranged at one or more edges 930 when identifying the user preference area 920 Can be configured.

That is, according to one embodiment, the electronic device 900 may extend the user preference region 920 to the edge region 940 of the electronic device 900.

In one embodiment, the electronic device 900 treats the major surface of the touch screen 910 and the curved surface edge 940 of the touch screen 910 as a separate display area, and can identify one of the major surface and the curved edge as a user preference area.

According to embodiments, various items may be displayed in the user preference area arranged in the electronic device.

10A to 10D are diagrams illustrating examples of items that can be displayed in a user preference area set in an electronic device according to embodiments.

10A shows that a GUI element indicating an event notification is displayed in the user preference area 1010 identified according to an embodiment.

Referring to FIG. 10A, the user preference area 1010 displays two event notifications, that is, a GUI element 1011 indicating an event notification indicating the reception of a new e-mail, and a GUI element 1012 indicating an event notification indicating reception of a new message.

The event notification may be associated with various events (e.g., an alarm or other message generated by an application, receipt of a new mail or text message, or a reminder for a calendar event). A user may select GUI elements 1011, 1012 to execute an application associated with a particular type of event.

In FIG. 10A, only the GUI element related to a specific event notification is displayed. However, when a specific message is received, for example, a part of the content included in the newly received message is displayed in the user preference area together with the GUI element corresponding to the reception of the new message Can be displayed together.

10B illustrates that a GUI element representing an application or widget is displayed in the user preference area 1020 identified according to one embodiment.

Referring to FIG. 10B, four application GUI elements 1021, 1022, 1023, and 1024 are displayed in the user preference area 1020.

FIG. 10C shows that a GUI element representing an on-screen menu is displayed in the user preference area 1030 identified according to one embodiment.

Referring to FIG. 10C, GUI elements 1031, 1032, 1033, 1034, and 1035 indicating five on-screen menus are displayed in the user preference area 1030. FIG. The on-screen menu refers to a menu for changing the setting state of the electronic device, and may include, for example, a volume resizing menu, a screen brightness adjusting menu, a Wi-Fi setting menu, a Bluetooth setting menu and the like.

10D shows that a GUI element representing a character input box is displayed in the user preference area 1040 identified according to one embodiment.

Referring to FIG. 10D, a GUI element 1041 representing a character input box is displayed in the user preference area 1040. For example, when the user tries to make a phone call while holding the mobile phone with one hand, as shown in FIG. 10D, the character input box is all arranged within a reach of one hand of the user so that the user can easily It is possible to input a number for making a telephone call.

FIG. 11 is a flowchart illustrating an example of a method of identifying a user preference region shown in FIG. 5 according to an exemplary embodiment.

Referring to FIG. 11, at operation 1110, the electronic device 100 detects the current orientation of the electronic device 100. For example, the electronic device 300 can detect the current orientation of the electronic device using the orientation detection sensor 350 or the electronic device 400 using the gyro sensor 440B included in the sensor module 440. [ The current orientation indicates whether the electronic device is placed horizontally or vertically or in use.

At operation 1120, the electronic device 100 may identify the user preference area in consideration of the current orientation of the detected electronic device 100. [

The electronic device can use different preference areas when the electronic device is placed in the other direction.

For example, a user may have other preferences when he or she is holding the electronic device in a longitudinal direction, as opposed to holding the electronic device in a longitudinal direction.

12 is a reference diagram for explaining that user preference regions are arranged differently in an electronic device according to the orientation of the electronic device according to an embodiment.

Referring to FIG. 12, reference numeral 1200a shows a user preference area 1210 when the electronic device 100 is used in the landscape direction, and 1200b shows a user preference area 1220 when the electronic device 100 is used in a landscape direction. The electronic device 100 can detect when the electronic device 100 is used in the transverse direction and when used in the longitudinal direction so that the shape and shape of the user preference region are maintained while the positions and sizes of the user preference region are different from each other.

13 is a reference diagram for explaining that the user preference region is arranged differently in the electronic device according to the orientation of the electronic device according to an embodiment.

13, reference numeral 1300a denotes a user preference area 1310 when the electronic device 100 is used in the longitudinal direction, and 1300b shows a user preference area 1320 when the electronic device 100 is used in a lateral direction. The electronic device 100 may detect when the electronic device 100 is used in the horizontal direction and when used in the vertical direction so that the shape of the user preference region is different and the position and size of the user preference region are different from each other. As described above, by changing the shape, size, and position of the user preference region adaptively depending on whether the user uses the electronic device 100 horizontally or vertically, a user who adaptively changes according to the user's usage pattern A preference area can be provided.

FIG. 14 is a flowchart illustrating another example of the method of identifying a user preference region shown in FIG. 5 according to an embodiment.

14, at operation 1410, the electronic device 100 detects the direction of the user's hand using the electronic device. For example, the electronic device 400 can detect which hand the user holds the electronic device 100 by using the grip sensor 440F of the sensor module 440, the proximity sensor 440G, the temperature / humidity sensor 440J, the touch panel 452,

At operation 1420, the electronic device 100 identifies the user preference area taking into account the direction of the detected hand.

The user can hold the electronic device 100 with his left hand or manipulate it with the right hand. The electronic device 100 can provide a more effective user preference area by identifying the user preference area according to the direction of the hand the user holds the electronic device 100. [

15 is a reference view for explaining how user preference regions are arranged differently in an electronic device according to the direction of the user's hand using the electronic device according to an embodiment.

Referring to FIG. 15, reference numeral 1500a denotes a user preference area 1510 when the user holds the electronic device 100 with his left hand, and 1500b denotes a user preference area 1520 when the user holds the electronic device 100 with the right hand Lt; / RTI &gt; For example, at 1500a, when the user detects that the user is grasping and manipulating the electronic device 100 with his left hand, the electronic device 100 can identify the user preference region 1510 at a position close to the left hand direction. Also at 1500b, if the user detects that the user is grasping and manipulating the electronic device 100 with the right hand, the electronic device 100 can identify the user preference region 1520 at a location close to the right hand direction. For example, when the user operates the electronic device 100 with his left hand, the GUI element 1530 is displayed in the user preference area 1510 arranged in the left part of the electronic device. When the user manipulates the electronic device 100 with the right hand, The GUI element 1530 can be displayed in the user preference area 1520 arranged in the right part of the GUI 1530. [

FIG. 16 is a flowchart illustrating another example of the method of identifying a user preference region shown in FIG. 5 according to an embodiment.

Referring to Figure 16, at operation 1610, the electronic device 100 monitors the interaction between the user and the electronic device. The interaction between a user and an electronic device refers to an operation that a user performs to a display of the electronic device 100 in order to operate the electronic device 100. For example, the interaction with a touch, a swipe, a drag, a pinch, And may include the same user input. For example, the electronic device 400 can monitor the interaction between the user and the electronic device using the touch panel 452, the pen sensor 454, the gesture sensor 440A, and the like.

At operation 1620, the electronic device identifies the user preference area by considering at least one display area that participates in the monitored interaction.

The electronic device 100 may identify the user preference area by considering at least one display area used for the monitored interaction.

According to one embodiment, the electronic device 100 determines the user's preferred area by considering the display area most frequently used in the monitored interaction, thereby determining the display area that is mainly used by the user as the user's preferred area, By displaying an element, a user can easily select a GUI element.

According to one embodiment, the electronic device 100 may monitor the user interaction by the form in which the user uses the electronic device 100 and store the user preference area. In other words, the electronic device 100 may include a user interaction when the user grasps and uses the electronic device with his left hand, a user interaction when using the electronic device in the lateral direction, a user interaction when using the electronic device in the lateral direction, , A user preference area when the electronic device is held and used with the left hand, a user preference area when the user holds the electronic device by using the right hand, a user preference area when the electronic device is used in the landscape direction, Regions can be stored.

 According to one embodiment, the electronic device 100 may monitor the interaction performed in one or more pre-selected applications when monitoring the interaction between the user and the electronic device.

According to one embodiment, the electronic device 100 may be a monitoring object that is used by the electronic device 100 to determine a preferred region only when a user interacts with an input of a user with a high degree of freedom. That is, only interactions with applications with high degrees of freedom can be considered when determining the boundaries of the preferred region.

An application with low degree of freedom and an application with high degree of freedom in the user's input will be described with reference to Figs. 17A and 17B.

17A is an example of an application having a low degree of freedom.

Referring to FIG. 17A, an application 1710 for capturing a photo is activated in the electronic device 100. In an application such as a photo capture, a user can perform a photographing operation of the electronic device by focusing on an object to capture the photograph and touching a photograph taking button 1720 arranged on the right side of the screen of the electronic device. However, since the area for receiving the user's input for executing the photo capturing in the photo capturing application is limited to a specific area of the screen, the user has no freedom to select the area to be touched when executing the photo capturing. These applications represent applications with low or no degrees of freedom. In such an application having low degree of freedom or no freedom, there is no room for user's preference in user interaction. Therefore, the interaction in an application having low degree of freedom or no freedom is excluded from monitoring, Can be avoided.

17B is an example of an application having a high degree of freedom.

17B, the photo gallery application 1730 is activated. In the photo gallery application 1730, the user can freely select the height of the screen, e.g., H1 or H2, on which the swipe gesture is to be made, and also can select the start and end points of the gesture, Or you can swipe right. In this photo gallery application 1730, the user is free to swipe at any height on the screen, since both are performed without problems, either at the height of H1 or at the height of H2 when the user swipes to view another row of pictures Is high. Therefore, the user can swipe in his / her favorite area, so that the user interaction in the application having a high degree of freedom can reflect the user's preference. Accordingly, when user interaction is monitored in an application having a high degree of freedom in user history and used to determine a user preference area, user preferences can be better reflected. Other types of interaction that allow a high degree of freedom include pinch to zoom function, scroll up / down in a document or web page, and up / down / left / right There is a swipe.

Of course, such screen interaction monitoring may be omitted if the preference area is identified based on a pre-established user preference rather than based on the user's previous interaction with the touch screen.

18 is a flow diagram illustrating a process of a method for determining a user preference region based on user interaction in accordance with one embodiment.

Referring to Fig. 18, at operation 1810, the electronic device detects each coordinate or subregion of the display area where interaction occurs between the user and the electronic device. At this time, as described above, the electronic device can not monitor user interaction in all applications but can monitor only user interaction in an application having at least one degree of freedom of user's input.

At operation 1820, the electronic device monitors the number of user interactions at each detected coordinate or subregion.

At operation 1830, the electronic device determines each coordinate or subregion in which the monitored number of interactions exceeds the threshold.

At operation 1840, the electronic device determines the user preference area based on the determined angular coordinates or subregions.

For example, the electronic device may monitor the user interaction using the user interaction monitoring module 171 or 322.

According to one embodiment, the user interaction monitoring module 171 or 322 of the electronic device 100 stores the coordinates of a touch event during a specific time period (e.g., a day / week / month, etc.) Coordinates of a specific number of touch events such as an event can be stored.

According to one embodiment, the user preference zone identification module 171 or 321 of the electronic device 100 can identify the preference zone in various ways, such as determining the boundaries of the area covering a predetermined percentage of the stored touch events. Alternatively, a machine learning algorithm may be used as described above. For example, the machine learning algorithm may be applied to various input (e.g., the area of contact between the user's finger and the touch screen, the duration of a particular touch event, the speed of a particular gesture, the entire display area, But not limited to).

According to one embodiment, the user interaction monitoring module 171 or 322 of the electronic device 100 may store the current user's interaction history as a heat map or a density map, instead of storing the coordinates of the individual touch events . In these maps, a high score is assigned to an area or coordinates indicating a large number of touch events.

19A is a reference diagram for explaining an example of determining a user preference area based on user interaction according to an embodiment.

Referring to FIG. 19A, the electronic device 100 can detect the number of interactions in each coordinate or small area in the display area 1900 as a result of monitoring user interaction in a predetermined application, for example, applications with high degrees of freedom. The electronic device can detect each coordinate or small area in which the number of interactions exceeds the threshold value in each coordinate or small area in which the number of interactions is detected. For example, at 1900a, each coordinate or subregion whose interaction count exceeds the threshold value is indicated by point 1920, and each coordinate or subregion that does not exceed the threshold value is indicated by hollow circle 1910.

According to one embodiment, the electronic device 100 may determine the user preference region 1930 as an area covering each coordinate or subregion where the number of interactions exceeds the threshold, as in 1900b.

19B is a reference diagram for explaining another example of determining a user preference area based on user interaction according to an embodiment.

Referring to FIG. 19B, the electronic device 100 calculates an average value of each coordinate in the coordinates or the small area where the number of times of interaction exceeds the threshold value at 1900a, and determines a center position 1950 according to the average value. This center position 1950 can be the coordinates of the average contact point.

According to one embodiment, the electronic device 100 may determine a circle 1960 having a radius r from the determined center position 1950, as determined at 1900c, as a user preference area.

20 is a flowchart showing another example of the method of identifying a user preference region shown in FIG. 5 according to an embodiment.

Referring to Fig. 20, in operation 2010, the electronic device outputs a user interface for receiving user setting input.

In operation 2020, the electronic device receives the user settings via the output user interface.

At operation 2030, the electronic device identifies the user preference area based on the received user settings.

The user interface for receiving the user setting input may include a user interface as shown in Fig. 6A, for example. The user can select the left or right hand operation through the user interface as shown in FIG. 6A. In such an embodiment, the preference area may be identified by checking whether the user has selected either left-handed or right-handed operation. When the left-hand operation is selected in the user interface, the preference area can be identified on the left side of the touch screen, which is an area close to the user's left hand thumb, and similarly on the right side of the touch screen, for right-hand operation. However, in other embodiments, the machine learning algorithm may be used to adjust the preference area based on the user's previous interaction with the touch screen.

According to one embodiment, the user may set the display area on the display directly where the GUI elements are desired to be displayed.

21 is a reference diagram for explaining a method of setting a user preference region directly by a user according to an embodiment.

21, the electronic device 100 may output a user interface 2110 for setting a user preference area. A message 2111 &quot; Please draw a desired user preference area with a finger &quot; may be displayed in the user interface 2110. The user can draw a desired user preference area 2130 with a finger 2120 by touching.

The electronic device 100 may receive the locus of the portion of the finger that the user's finger 2120 touched, store information about the locus, and store the locus in the user preference region 2140. The electronic device 100 is then able to display the GUI element in the desired display area by identifying the user preference area 2140 thus stored at the point in time when the GUI element should be displayed and displaying the GUI element in the identification user preference area 2140. [

Figures 22A, 22B, 22C, 22D are diagrams illustrating examples of methods of displaying a GUI element in a user preferred area of an electronic device according to embodiments.

22A shows an example in which each of one or more GUI elements is displayed in a user preference area of the electronic device. Referring to FIG. 22A, the user preference area 2200 of the electronic device 100 is displayed with a GUI element 2201 for notifying of new e-mail reception, a GUI element 2202 for informing that there is a missed call, and a GUI element 2203 for informing the reception of a new message. Each GUI element can be displayed in various shapes. In Fig. 22A, each GUI element is displayed in a droplet shape.

22B shows an example in which one group object corresponding to one or more GUI elements is displayed in the user preference area of the electronic device. 22B, in the user preference area 2200 of the electronic device 100, a GUI element for notifying a new e-mail reception, a GUI element for notifying that there is a missed call, a GUI element for notifying a new message reception, Lt; / RTI &gt;

For example, when the number of GUI elements to be displayed in the user preference area 2200 is large and the GUI elements can not be all displayed in the user preference area 2200, the electronic device may combine the plurality of GUI elements into one large group object .

22C shows an example in which one or more GUI elements are displayed in a user preference area of an electronic device using scrolling. Referring to FIG. 22C, only some of the GUI elements to be displayed in the user preference area 2200 of the electronic device 100 may be displayed, and the remaining GUI elements may be displayed using scrolling. That is, in the user preference area 2200, only the GUI element 2206 informing reception of a new e-mail, GUI element 2207 informing reception of a new message is displayed, and an arrow element 2207 enabling scrolling in an upward direction so that other GUI elements can be displayed using scrolling 2205, and an arrow element 2208 that enables scrolling in the downward direction. When the user selects element 2205, electronic device 100 can display the GUI element hidden above, and if element 2208 is selected, electronic device 100 can display the hidden GUI element below.

22D may display each of one or more GUI elements and a group object together in a user preference area. Referring to FIG. 22D, the electronic device 100 indicates that the user preference area 2200 displays the individual GUI elements 2210, 2212 and the group object 2211 together.

According to one embodiment, the electronic device may display a GUI element representing an event notification in a user preference area of the electronic device. The electronic device may display a GUI element indicating an event notification at a lock screen of the electronic device or when the electronic device is being operated by the user.

23A, 23B, and 23C show examples of displaying the GUI element in the user preference area on the lock screen when an event notification occurs on the lock screen of the electronic device 100. FIG.

23A shows an example in which one or more GUI elements can be displayed in a user preference area in a lock screen state according to one embodiment.

23A shows a lock screen state in the electronic device. When a new email is thus received in the locked screen state, the electronic device can first identify the user preference area 2310 and display the GUI element 2311 for the event notification in the identified user preference area 2310 to indicate that a new email has been received . 2300b shows a state in which one GUI element 2311 is displayed in the user preference area 2310. [

In the state 2300b, when a new message is received again before the user selects and confirms the GUI element 2311 informing the reception of the new email, the electronic device further sends a GUI element 2312 to the user preference area 2310 Can be displayed.

Thus, the electronic device can additionally display the newly generated GUI element in the user preference area 2310 whenever a GUI element to be displayed in the user preference area 2310 is newly generated.

23B shows an example in which one or more GUI elements can not be displayed in the user preference area in the lock screen state according to one embodiment.

Reference numeral 2300a in Fig. 23B indicates a state in which no GUI element is displayed yet in the lock screen state of the electronic device. In this way, when a plurality of new notifications can simultaneously occur in the lock screen state and the space for simultaneously displaying each of the GUI elements corresponding to the plurality of new notifications in the user preference area is insufficient, the electronic device displays one The group object 2313 can be displayed in the user preference area 2310. The group object 2313 may be displayed as an image for indicating that a plurality of GUI elements corresponding to a plurality of notification events are contained in the group object. For example, as in 2300d, the group object 2313 may have a single large droplet shape containing a plurality of images of GUI elements in a small size.

FIG. 23C shows another example in which one or more GUI elements can not be displayed in the user preference area in the lock screen state according to one embodiment.

Reference numeral 2300a in FIG. 23C indicates a state in which no GUI element is displayed yet in the lock screen state of the electronic device, and each GUI element corresponding to a plurality of new notifications generated at once in the lock screen state is displayed in the user preference area at the same time When there is insufficient space to display, the electronic device can display the GUI element using the scrolling method.

2300e, the electronic device can display two GUI elements 2314, 2315 in the user preference area 2310 and an arrow icon 2313 to enable scrolling in the upward direction and an arrow icon 2316 to enable scrolling in the downward direction have. The user can scroll using the icon 2313 or 2316 to view the GUI elements that are not displayed in the user preference area 2310. [

24 is a flowchart illustrating an exemplary process of a method for displaying at least one graphical user interface element in the user preference area shown in FIG. 5 according to one embodiment.

Referring to FIG. 24, at operation 2410, the electronic device determines whether all GUI elements can be displayed in the user preference area to be identified. The electronic device is able to display the newly generated GUI element in accordance with the state of the current user preference area regardless of whether the GUI element is already displayed in the user preference area or no GUI element is displayed in the user preference area Can be determined. For example, up to four GUI elements can be displayed in the user preference area. If four GUI elements are displayed in the current user preference area and a new GUI element occurs in this state, the electronic device displays the identified user It can be determined that there is no display of all the GUI elements in the preference area.

In operation 2450, if the electronic device determines that all GUI elements can be displayed in the identified user preference area, newly generated GUI elements can be displayed in the user preference area as they are.

In operation 2420, if the electronic device determines that all GUI elements can not be displayed in the identified user preference area, the group object corresponding to the plurality of GUI elements is displayed in the user preference area.

At operation 2430, if the user selects a group object displayed in the user preference area, then at operation 2440, the electronic device may expand and display one or more GUI elements corresponding to the group object.

25 is a reference diagram for explaining the group object illustrated in FIG. 24 according to an embodiment.

25, 2500a shows a state in which three GUI elements 2501, 2502, and 2503 are displayed in the user preference area 2500 of the electronic device. When three GUI elements are displayed in the user preference area 2500 and two GUI elements to be displayed in the user preference area are newly generated, the electronic device judges whether there is a space for additionally displaying two GUI elements in the user preference area can do. The electronic device can display two additional GUI elements to display one group object 2510 corresponding to five GUI elements to be displayed in total in the user preference area 2500 when it is determined that the space of the user preference area 2500 is insufficient . 2500b indicates a state in which one group object 2510 is displayed in the user preference area 2500. [

26A is a diagram illustrating an example of a user interface output when a group object is selected according to an embodiment.

Referring to FIG. 26A, 2600a shows a state in which one group object 1610 corresponding to a plurality of GUI elements is displayed in the user preference region 2600 in a water droplet form.

2600b shows an effect when the user selects the group object 2610 in the form of a droplet. When the user selects the group object 2610, the electronic device displays an individual GUI element 2611-2616 associated with the group object 2610 as an additional droplet that protrudes out of the group object 2610 or moves out of the group object 2610 It can be displayed using animations. At this time, the individual GUI elements 2611-2616 in the form of a droplet separated from the group object 2610 in the form of a droplet can greatly reduce the size thereof so that all the GUI elements are displayed in the user preference area.

26B is a diagram illustrating another example of a user interface output when a group object is selected according to an embodiment.

Referring to FIG. 26B, 2600a is in a state similar to that in FIG. 26A, and 2600c shows an effect when a user selects a group object 2610 in the form of a droplet. When the user selects group object 2610, the electronic device may display individual GUI elements 2611-2616 associated with group object 2610 using animation representing individual GUI elements 2611-2616 as additional droplets of water drops falling from group object 2610 . At this time, it is possible to display all the GUI elements in the user preference area by displaying the individual GUI elements 2611 to 2616 in the form of a droplet separated from the droplet group object 2610 by overlapping each other.

26C is a diagram illustrating another example of a user interface output when a group object is selected according to an embodiment.

Referring to FIG. 26C, 2600a is in the same state as in FIG. 26A, and 2600d shows an effect when the user selects the group object 2610 in the form of a droplet.

At 2600d, a subset of the individual GUI elements 2611-2616 may be displayed in a scrollable arrangement if space is still lacking to display all the individual GUI elements from the group object 2610. [ The up arrow icon 2631 and the down arrow icon 2632 indicate whether another GUI element is scrolling up or down (e.g., by swiping up or down the displayed GUI elements 2611, 26134 or touching the up / down arrow icons 2631, 2632) And may be displayed to indicate that it can be accessed. In this way, the user can scroll through all the GUI elements without leaving the border of the preference area 2600.

FIG. 27 is a flow diagram illustrating another example of a method for displaying at least one graphical user interface element in the user preference area shown in FIG. 5 according to one embodiment.

27, at operation 2710, the electronic device determines whether all GUI elements can be displayed in the user preference area to be identified.

In operation 2750, if the electronic device determines that all GUI elements can be displayed in the identified user preference area, the newly generated GUI element can be displayed in the user preference area as it is.

In operation 2720, if the electronic device determines that it can not display all the GUI elements in the identified user preference area, the plurality of GUI elements are displayed in the user preference area in a scrollable arrangement.

At operation 2730, if the user selects a scrolling icon displayed in the user preference area, then at operation 2740, the electronic device may display the GUI element in the scroll direction in the user preference area.

Figure 28 is a reference diagram illustrating a GUI element that is scrollably arranged in accordance with one embodiment.

28, reference numeral 2800a denotes a state in which three GUI elements 2801, 2802, and 2803 are displayed in the user preference area 2800. [

2800b shows an example in which GUI elements are displayed in a scroll form when three GUI elements 2801, 2802, and 2803 and newly generated GUI elements can not be simultaneously displayed in the user preference area when a new GUI element to be displayed is additionally generated. The up arrow icon 2804 and the down arrow icon 2805 indicate whether another GUI element is scrolling up / down (e.g., by swiping up or down the displayed GUI elements 2801, 2803 or touching the up / down arrow icons 2804, 2805) And may be displayed to indicate that it can be accessed. In this way, the user can scroll through all the GUI elements without going outside the boundaries of the preference area 2800.

29 is a reference diagram for explaining an operation when a scrollable GUI element is selected according to an embodiment.

2900a shows a state in which the GUI elements 2912 and 2913 are displayed in the user preference area 2900 of the electronic device 100 and the upward direction icon 2911 and the downward direction icon 2914 are displayed for scrolling.

2900b indicates that the application 2913-1 capable of reading a newly received message in the electronic device 100 is displayed on the display of the electronic device when the user selects the GUI element 2913 indicating the reception of a new message in the 2900a state.

2900c shows a screen displayed on the display of the electronic device after the user confirms a new message and ends the message application. Since the user has confirmed a new message, the GUI element 2913, which indicates a new message reception notification, may no longer need to be displayed. Thus, the electronic device may display individual GUI elements 2912, 2915, and 2916 as in 2900c if they no longer display the GUI element 2913 and can display all remaining GUI elements in the user preference area 2900 except for the GUI element 2913 .

30 is a flow diagram illustrating another exemplary process for operating an electronic device in accordance with one embodiment.

Referring to FIG. 30, at operation 3010, the electronic device detects that a GUI element to display in the user preference area has occurred.

At act 3020, the electronic device identifies the direction of the hand the current user is using the electronic device. The electronic device can, for example, use a touch panel or the like to identify with which hand the user currently holds the electronic device. For example, if the user holds the electronic device with his or her right hand, the electronic device will be able to detect the touch on the right side of the panel, and if the user is holding the device with his left hand, You will be able to detect it.

At operation 3030, the electronic device detects a user preference area corresponding to the direction of the identified hand.

At operation 3040, the electronic device displays the GUI element in the detected user preference area.

The user can manipulate the electronic device 100 in real time while using the right hand and left hand alternately. Thus, the electronic device 100 may adaptively change the user preference area in accordance with the orientation of the hand holding the user's electronic device.

At operation 3050, the electronic device detects that the direction of the user's hand holding the electronic device changes.

At operation 3060, the electronic device changes the user preference area according to the direction of the changed user's hand. For example, when a user holds an electronic device with his left hand, the user can hold the electronic device with his or her right hand.

At operation 3070, the electronic device displays the GUI element in the changed user preference area.

31 is a reference diagram for explaining the operation method shown in Fig.

31, 3100a, when the user grasps and operates the electronic device 100 with his left hand, the electronic device 100 detects the direction in which the user holds the electronic device 100 with his left hand and accordingly identifies the user preference area 3110 at a position close to the user's left hand Lt; / RTI &gt;

3100b, when the user grasps and manipulates the electronic device 100 with the right hand, the electronic device 100 detects the direction in which the user holds the electronic device 100 with his right hand, thereby identifying the user preference area 3120 at a location near the user &apos;Lt; / RTI &gt;

The user can manipulate the electronic device 100 in real time while using the right hand and left hand alternately. Thus, when the electronic device 100 detects that the user uses the electronic device with his left hand as in 3100a, he displays the GUI element in the user preference area 3110 arranged near the left hand, The electronic device can detect that the direction of the user's hand manipulating the electronic device has changed and re-identify the user preference area corresponding to the direction of the changed hand accordingly.

32 is a flow diagram illustrating another exemplary process for operating an electronic device in accordance with one embodiment.

Referring to FIG. 32, at operation 3210, the electronic device detects that a GUI element to display in the user preference area has occurred.

At operation 3220, the electronic device identifies the direction of the hand the current user is using the electronic device.

The electronic device can, for example, use a touch panel or the like to identify with which hand the user currently holds the electronic device. For example, if the user holds the electronic device with his or her right hand, the electronic device will be able to detect the touch on the right side of the panel, and if the user is holding the device with his left hand, You will be able to detect it.

At operation 3230, the electronic device detects the current orientation of the electronic device. The electronic device can examine the current orientation of the electronic device using an appropriate directional mechanism such as a gyrometer. Different preference areas can be used when the electronic device is placed in the other direction. For example, a user may have other preferences when he or she is holding the electronic device in a longitudinal direction, as opposed to holding the electronic device in a longitudinal direction.

At operation 3240, the electronic device identifies the direction of the identified hand and a user preference area corresponding to the current orientation of the electronic device.

The electronic device can identify the user preference zone differently depending on whether the user holds the electronic device with his or her left hand or right hand and whether the electronic device is being used in the landscape orientation or the portrait orientation.

At operation 3250, the electronic device displays the GUI element in the detected user preference area.

33A and 33B are reference views for explaining the operation method shown in FIG.

Referring to FIG. 33A, the user holds the electronic device 100 with his left hand and uses the electronic device 100 in the lateral direction. Thus, in this case, the electronic device 100 can identify the user preference area 3310 at the bottom left of the display area of the electronic device, considering that the user is holding the electronic device 100 with his left hand and the electronic device is arranged in the landscape orientation. According to one embodiment, the determined user preference area may be stored by monitoring the user interaction when the user grasps the electronic device 100 with his left hand and uses the device in the landscape orientation, and the electronic device 100 may allow the user to hold the electronic device 100 with his left hand It is possible to identify the stored user preference area for use in the landscape direction.

Referring to FIG. 33B, the user holds the electronic device 100 with his right hand and uses the electronic device 100 in the longitudinal direction. Therefore, in this case, the electronic device 100 can identify the user preference area 3320 in the right-middle position in the display area of the electronic device, considering that the user is holding the right hand with the electronic device 100 and the electronic device is arranged in the longitudinal direction. According to one embodiment, the determined user preference area may be stored by monitoring the user interaction when the user grasps the electronic device 100 and uses it longitudinally, and the electronic device 100 allows the user to control the electronic device 100 by right- It is possible to identify the stored user preference area for the case of holding and using in the vertical direction.

34 is a reference diagram for explaining an example in which a user preference region is determined based on a finger position of a user currently using an electronic device according to an embodiment;

Referring to FIG. 34, the electronic device 100 can detect a display area 3410 corresponding to a finger position of the user 50 using the electronic device 100. Thus, if the finger position of the user currently using the electronic device 100 can be detected on the display, then the electronic device can determine that the display area 3410 corresponding to that finger position is currently the most favored position by the user. Thus, the electronic device can determine an area within the range from the display area 3410 to the user preference area 3420 and display the user graphic interface element, such as an event notification, in the thus determined user preference area 3420. Thus, in the case of identifying the user preference area, the user preference area may be changed in real time as the user's preference area corresponding to the user's finger position changes in real time.

The method of operation of the electronic devices described herein may be implemented in the form of program instructions that may be executed on various computer means and recorded on a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

In the foregoing specification, the present disclosure and advantages have been described with reference to specific embodiments. It will be apparent, however, to one skilled in the art, that various changes and modifications can be readily made without departing from the scope of the present disclosure as set forth in the claims below. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense. All such possible modifications are intended to be included within the scope of this disclosure.

Claims (20)

In an electronic device,
A display for displaying at least one graphical user interface element, and
And a controller for identifying the user preference area preferred by the user on the display and controlling the display to display the at least one graphical user interface element in the identified user preference area. The method according to claim 1,
Wherein,
Detecting a current orientation of the electronic device,
And identifies the user preference region in consideration of the detected current orientation. The method according to claim 1,
Wherein,
Detecting a direction of a user's hand using the electronic device,
And identifies the user preference region in consideration of the direction of the detected hand of the user. The method according to claim 1,
Wherein,
Monitor an interaction between the user and the electronic device and identify the user preference area based on at least one display area determined to be involved in the monitored interaction. 5. The method of claim 4,
Wherein,
Wherein the at least one display area is determined by monitoring an interaction between the user and the electronic device for at least one predetermined application. The method according to claim 1,
Wherein,
And identifies the user preference region based on a preset user preference. The method according to claim 1,
Wherein,
If the size of the identified user preference area is insufficient to display the at least one graphical user interface element, displaying the group object corresponding to the at least one graphical user interface element in the user preference area, Wherein the at least one graphical user interface element corresponding to the group object is displayed in response to an input from the at least one graphical user interface element. The method according to claim 1,
Wherein the user preference area is within a range capable of operating the electronic device with one hand of the user. The method according to claim 1,
Wherein the at least one graphical user interface element displayed in the user preference area comprises an icon for event notification. The method according to claim 1,
The display extending to one or more edges of the electronic device,
Wherein the control unit identifies the user preference area comprising a display area arranged in the at least one edge. A method of operating an electronic device,
Identifying a user preference area preferred by the user on the display; And
And displaying the at least one graphical user interface element in the identified user preference area. 12. The method of claim 11,
Wherein the user preference zone identification step comprises:
Detecting a current orientation of the electronic device, and identifying the user preference area in view of the detected current orientation. 12. The method of claim 11,
Wherein the user preference zone identification step comprises:
Detecting a direction of a user's hand using the electronic device and identifying the user preference area in consideration of a direction of the detected user's hand. 12. The method of claim 11,
Wherein the user preference zone identification step comprises:
Monitoring an interaction between the user and the electronic device, and identifying the user preference region based on at least one display area determined to be involved in the monitored interaction. 15. The method of claim 14,
Wherein the user preference zone identification step comprises:
And determining the at least one display area by monitoring an interaction between the user and the electronic device for at least one predetermined application. 12. The method of claim 11,
Wherein the user preference zone identification step comprises:
Identifying the user preference region based on a pre-established user preference. 12. The method of claim 11,
If the size of the identified user preference area is insufficient to display the at least one graphical user interface element, displaying the group object corresponding to the at least one graphical user interface element in the user preference area, Displaying the at least one graphical user interface element corresponding to the group object in response to an input from the at least one graphical user interface element. 12. The method of claim 11,
Wherein the at least one graphical user interface element displayed in the user preference area comprises an icon for event notification. 12. The method of claim 11,
Wherein the user preference zone identification step comprises:
Identifying the user preference area comprising a display area arranged at one or more edges of the electronic device.  A computer-readable recording medium having recorded thereon a program code for executing the operating method according to any one of claims 11 to 19.

Images